2023-12-18T09:48:08.449 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-18T09:48:08.450 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --name vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} --archive /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411 -- /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/orig.config.yaml 2023-12-18T09:48:08.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-18T09:48:08.577 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411 branch: wip-vshankar-testing1-2023-12-18-1207-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} email: vshankar@redhat.com first_in_suite: false job_id: '7495411' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing1-2023-12-18-1207-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Scrub error on inode sha1: 8688b2517b6002b804a4844986e6ed5ce973d99f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8688b2517b6002b804a4844986e6ed5ce973d99f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-2023-12-18-1207-reef sha1: 8688b2517b6002b804a4844986e6ed5ce973d99f owner: scheduled_vshankar@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1969 sha1: 8688b2517b6002b804a4844986e6ed5ce973d99f sleep_before_teardown: 0 subset: 124/1024 suite: fs suite_branch: wip-vshankar-testing1-2023-12-18-1207-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8688b2517b6002b804a4844986e6ed5ce973d99f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8688b2517b6002b804a4844986e6ed5ce973d99f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4Na7RJPKURD8+eDOvklrAlHYhShrfslpCJWzht5uER5Hra5sfrayjckMt1JAENAtg0Mt8kdjxNmDVo6Zy2IFM= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXvK7iKGMW7gzxDEwIb5C/d8syMDoSiPZ7UmjlldA84GDswvqpEUd+w6QKaPN+HAeOPCYQ8DmJmH6fpHQuq+jw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_multimds_misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-18_09:35:32 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-18T09:48:08.577 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8688b2517b6002b804a4844986e6ed5ce973d99f/qa; will attempt to use it 2023-12-18T09:48:08.578 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8688b2517b6002b804a4844986e6ed5ce973d99f/qa/tasks 2023-12-18T09:48:08.578 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-18T09:48:08.580 INFO:teuthology.task.internal:Checking packages... 2023-12-18T09:48:08.603 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8688b2517b6002b804a4844986e6ed5ce973d99f' 2023-12-18T09:48:08.604 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-18T09:48:08.604 INFO:teuthology.packaging:ref: None 2023-12-18T09:48:08.604 INFO:teuthology.packaging:tag: None 2023-12-18T09:48:08.604 INFO:teuthology.packaging:branch: wip-vshankar-testing1-2023-12-18-1207-reef 2023-12-18T09:48:08.604 INFO:teuthology.packaging:sha1: 8688b2517b6002b804a4844986e6ed5ce973d99f 2023-12-18T09:48:08.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing1-2023-12-18-1207-reef 2023-12-18T09:48:08.966 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1372-g8688b251-1jammy 2023-12-18T09:48:08.967 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-18T09:48:08.974 INFO:teuthology.task.internal:no buildpackages task found 2023-12-18T09:48:08.974 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-18T09:48:08.988 INFO:teuthology.task.internal:Saving configuration 2023-12-18T09:48:09.007 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-18T09:48:09.012 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-18T09:48:09.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-18 09:35:59.913648', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPwFt5x+1TBWWwCfn+J9v8OFSmVWKR7HhmmV9OpBmwCR'} 2023-12-18T09:48:09.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-18 09:35:59.915473', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDzZa5iTKuXJx+G/EUfTRFznBmJVn9DN9/DERtJi6BtI'} 2023-12-18T09:48:09.062 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-18T09:48:09.068 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-18T09:48:09.068 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-18T09:48:09.068 INFO:teuthology.run_tasks:Running task console_log... 2023-12-18T09:48:09.139 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdf8a4f1b80>, signals=[15]) 2023-12-18T09:48:09.139 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-18T09:48:09.145 INFO:teuthology.task.internal:Opening connections... 2023-12-18T09:48:09.145 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T09:48:09.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T09:48:09.220 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T09:48:09.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T09:48:09.293 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-18T09:48:09.300 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-12-18T09:48:09.312 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-12-18T09:48:09.312 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-12-18T09:48:09.360 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-18T09:48:09.360 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-12-18T09:48:09.360 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="22.04" 2023-12-18T09:48:09.360 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-18T09:48:09.360 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=jammy 2023-12-18T09:48:09.360 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-12-18T09:48:09.361 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-12-18T09:48:09.361 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-18T09:48:09.361 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-18T09:48:09.361 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-18T09:48:09.361 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-18T09:48:09.361 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=jammy 2023-12-18T09:48:09.362 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-12-18T09:48:09.384 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-12-18T09:48:09.389 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-12-18T09:48:09.389 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-12-18T09:48:09.436 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-18T09:48:09.436 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2023-12-18T09:48:09.436 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="22.04" 2023-12-18T09:48:09.436 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-18T09:48:09.436 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=jammy 2023-12-18T09:48:09.437 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2023-12-18T09:48:09.437 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2023-12-18T09:48:09.437 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-18T09:48:09.437 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-18T09:48:09.437 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-18T09:48:09.437 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-18T09:48:09.437 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=jammy 2023-12-18T09:48:09.437 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-12-18T09:48:09.459 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-18T09:48:09.468 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-18T09:48:09.476 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-18T09:48:09.477 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-12-18T09:48:09.479 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2023-12-18T09:48:09.484 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-18T09:48:09.490 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-18T09:48:09.490 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-12-18T09:48:09.525 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2023-12-18T09:48:09.620 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-18T09:48:09.667 INFO:teuthology.run_tasks:Running task kernel... 2023-12-18T09:48:09.680 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-18T09:48:09.680 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-18T09:48:09.681 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-18T09:48:09.681 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-18T09:48:09.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T09:48:09.687 DEBUG:teuthology.task.kernel:sha1 for mon.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-18T09:48:09.687 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-18T09:48:09.687 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-12-18T09:48:09.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T09:48:09.688 DEBUG:teuthology.task.kernel:sha1 for mon.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-18T09:48:09.688 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-18T09:48:09.688 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-12-18T09:48:09.732 INFO:teuthology.orchestra.run.smithi133.stdout:5.15.0-56-generic 2023-12-18T09:48:09.733 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-18T09:48:09.733 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-18T09:48:09.733 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-18T09:48:09.741 INFO:teuthology.orchestra.run.smithi142.stdout:5.15.0-56-generic 2023-12-18T09:48:09.742 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-18T09:48:09.742 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-18T09:48:09.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-18T09:48:09.871 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-12-18T09:48:09.871 DEBUG:teuthology.orchestra.run.smithi133:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-18T09:48:09.896 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-18T09:48:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-18T09:48:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-18T09:48:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-18T09:48:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:hint: 2023-12-18T09:48:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:hint: git config --global init.defaultBranch 2023-12-18T09:48:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:hint: 2023-12-18T09:48:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-18T09:48:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-18T09:48:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:hint: 2023-12-18T09:48:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:hint: git branch -m 2023-12-18T09:48:10.048 INFO:teuthology.orchestra.run.smithi133.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-18T09:48:10.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-18T09:48:10.109 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-12-18T09:48:10.109 DEBUG:teuthology.orchestra.run.smithi142:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-18T09:48:10.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-18T09:48:10.130 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-18T09:48:10.177 DEBUG:teuthology.orchestra.run.smithi133:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: git config --global init.defaultBranch 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: 2023-12-18T09:48:10.270 INFO:teuthology.orchestra.run.smithi142.stderr:hint: git branch -m 2023-12-18T09:48:10.271 INFO:teuthology.orchestra.run.smithi142.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-18T09:48:10.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-18T09:48:10.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-18T09:48:10.397 DEBUG:teuthology.orchestra.run.smithi142:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-18T09:58:20.437 INFO:teuthology.orchestra.run.smithi133.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-18T09:58:20.438 INFO:teuthology.orchestra.run.smithi133.stderr: * [new branch] main -> origin/main 2023-12-18T09:58:20.469 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190312 -> 20190312 2023-12-18T09:58:20.469 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190416 -> 20190416 2023-12-18T09:58:20.469 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190514 -> 20190514 2023-12-18T09:58:20.470 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190618 -> 20190618 2023-12-18T09:58:20.470 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190717 -> 20190717 2023-12-18T09:58:20.470 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190815 -> 20190815 2023-12-18T09:58:20.470 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190923 -> 20190923 2023-12-18T09:58:20.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20191022 -> 20191022 2023-12-18T09:58:20.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20191215 -> 20191215 2023-12-18T09:58:20.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200122 -> 20200122 2023-12-18T09:58:20.471 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200316 -> 20200316 2023-12-18T09:58:20.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200421 -> 20200421 2023-12-18T09:58:20.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200519 -> 20200519 2023-12-18T09:58:20.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200619 -> 20200619 2023-12-18T09:58:20.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200721 -> 20200721 2023-12-18T09:58:20.472 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200817 -> 20200817 2023-12-18T09:58:20.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200918 -> 20200918 2023-12-18T09:58:20.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201022 -> 20201022 2023-12-18T09:58:20.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201118 -> 20201118 2023-12-18T09:58:20.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201218 -> 20201218 2023-12-18T09:58:20.473 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210208 -> 20210208 2023-12-18T09:58:20.474 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210315 -> 20210315 2023-12-18T09:58:20.474 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210511 -> 20210511 2023-12-18T09:58:20.474 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210716 -> 20210716 2023-12-18T09:58:20.474 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210818 -> 20210818 2023-12-18T09:58:20.474 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210919 -> 20210919 2023-12-18T09:58:20.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20211027 -> 20211027 2023-12-18T09:58:20.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20211216 -> 20211216 2023-12-18T09:58:20.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220209 -> 20220209 2023-12-18T09:58:20.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220310 -> 20220310 2023-12-18T09:58:20.475 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220411 -> 20220411 2023-12-18T09:58:20.476 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220509 -> 20220509 2023-12-18T09:58:20.476 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220610 -> 20220610 2023-12-18T09:58:20.476 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220708 -> 20220708 2023-12-18T09:58:20.476 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220815 -> 20220815 2023-12-18T09:58:20.476 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220913 -> 20220913 2023-12-18T09:58:20.477 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221012 -> 20221012 2023-12-18T09:58:20.477 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221109 -> 20221109 2023-12-18T09:58:20.477 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221214 -> 20221214 2023-12-18T09:58:20.477 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230117 -> 20230117 2023-12-18T09:58:20.477 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230210 -> 20230210 2023-12-18T09:58:20.478 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230310 -> 20230310 2023-12-18T09:58:20.478 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230404 -> 20230404 2023-12-18T09:58:20.478 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230515 -> 20230515 2023-12-18T09:58:20.478 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230625 -> 20230625 2023-12-18T09:58:20.478 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230804 -> 20230804 2023-12-18T09:58:20.478 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230919 -> 20230919 2023-12-18T09:58:20.479 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20231030 -> 20231030 2023-12-18T09:58:20.479 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20231111 -> 20231111 2023-12-18T09:58:20.479 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20231211 -> 20231211 2023-12-18T09:58:24.463 INFO:teuthology.orchestra.run.smithi133.stderr:Updating files: 51% (1673/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 65% (2118/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2653/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-18T09:58:24.469 INFO:teuthology.orchestra.run.smithi133.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-18T09:58:24.489 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-18T09:58:24.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-18T09:58:24.715 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-18T09:58:24.716 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-18T09:58:24.718 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi133.front.sepia.ceph.com to complete... 2023-12-18T09:58:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18 09:58:26 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-18T09:58:26.559 INFO:teuthology.orchestra.run.smithi133.stderr:FINISHED --2023-12-18 09:58:26-- 2023-12-18T09:58:26.559 INFO:teuthology.orchestra.run.smithi133.stderr:Total wall clock time: 1.8s 2023-12-18T09:58:26.559 INFO:teuthology.orchestra.run.smithi133.stderr:Downloaded: 1 files, 37M in 1.6s (22.7 MB/s) 2023-12-18T09:58:26.562 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-18T09:58:26.563 DEBUG:teuthology.orchestra.run.smithi133:> sudo dpkg -i /tmp/linux-image.deb 2023-12-18T09:58:26.815 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-18T09:58:28.725 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-18T09:58:28.729 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-18T09:58:28.856 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-18T09:58:32.014 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-18T09:58:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-18T09:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-18T09:58:47.395 INFO:teuthology.orchestra.run.smithi142.stderr: * [new branch] main -> origin/main 2023-12-18T09:58:47.427 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190312 -> 20190312 2023-12-18T09:58:47.427 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190416 -> 20190416 2023-12-18T09:58:47.427 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190514 -> 20190514 2023-12-18T09:58:47.427 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190618 -> 20190618 2023-12-18T09:58:47.427 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190717 -> 20190717 2023-12-18T09:58:47.427 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190815 -> 20190815 2023-12-18T09:58:47.427 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20190923 -> 20190923 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20191022 -> 20191022 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20191215 -> 20191215 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200122 -> 20200122 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200316 -> 20200316 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200421 -> 20200421 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200519 -> 20200519 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200619 -> 20200619 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200721 -> 20200721 2023-12-18T09:58:47.429 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200817 -> 20200817 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20200918 -> 20200918 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20201022 -> 20201022 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20201118 -> 20201118 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20201218 -> 20201218 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210208 -> 20210208 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210315 -> 20210315 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210511 -> 20210511 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210716 -> 20210716 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210818 -> 20210818 2023-12-18T09:58:47.431 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20210919 -> 20210919 2023-12-18T09:58:47.432 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20211027 -> 20211027 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20211216 -> 20211216 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220209 -> 20220209 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220310 -> 20220310 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220411 -> 20220411 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220509 -> 20220509 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220610 -> 20220610 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220708 -> 20220708 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220815 -> 20220815 2023-12-18T09:58:47.433 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20220913 -> 20220913 2023-12-18T09:58:47.434 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20221012 -> 20221012 2023-12-18T09:58:47.434 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20221109 -> 20221109 2023-12-18T09:58:47.435 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20221214 -> 20221214 2023-12-18T09:58:47.435 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230117 -> 20230117 2023-12-18T09:58:47.435 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230210 -> 20230210 2023-12-18T09:58:47.435 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230310 -> 20230310 2023-12-18T09:58:47.435 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230404 -> 20230404 2023-12-18T09:58:47.435 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230515 -> 20230515 2023-12-18T09:58:47.435 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230625 -> 20230625 2023-12-18T09:58:47.435 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230804 -> 20230804 2023-12-18T09:58:47.436 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20230919 -> 20230919 2023-12-18T09:58:47.436 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20231030 -> 20231030 2023-12-18T09:58:47.436 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20231111 -> 20231111 2023-12-18T09:58:47.436 INFO:teuthology.orchestra.run.smithi142.stderr: * [new tag] 20231211 -> 20231211 2023-12-18T09:58:51.429 INFO:teuthology.orchestra.run.smithi142.stderr:Updating files: 51% (1672/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 64% (2116/3256) Updating files: 65% (2117/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2653/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-18T09:58:51.433 INFO:teuthology.orchestra.run.smithi142.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-18T09:58:51.455 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-18T09:58:51.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-18T09:58:51.671 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-18T09:58:51.671 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-18T09:58:51.674 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2023-12-18T09:58:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2023-12-18T09:58:52.408 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-18T09:58:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-12-18T09:58:52.737 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-18T09:58:52.755 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-18T09:58:53.032 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-18T09:58:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-18T09:58:53.105 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-18T09:58:53.110 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-18T09:58:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-18T09:58:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-18T09:58:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-18T09:58:53.306 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-12-18T09:58:53.468 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-deb -c /tmp/linux-image.deb 2023-12-18T09:58:53.477 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-18T09:58:53.477 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-18T09:58:53.477 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-18T09:58:53.489 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-18T09:58:53.489 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-18T09:58:53.508 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-18T09:58:53.509 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-18T09:58:53.510 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-18T09:58:53.514 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-18T09:58:53.515 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-18T09:58:53.516 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-18T09:58:53.569 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-18T09:58:53.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-18T09:58:53.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-18T09:58:53.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-18T09:58:53.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-18T09:58:53.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-18T09:58:53.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-18T09:58:53.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-18T09:58:53.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-18T09:58:53.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-18T09:58:53.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-18T09:58:53.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-18T09:58:53.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-18T09:58:53.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-18T09:58:53.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-18T09:58:53.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-18T09:58:53.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-18T09:58:53.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-18T09:58:53.584 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-18T09:58:53.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-18T09:58:53.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-18T09:58:53.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-18T09:58:53.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-18T09:58:53.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-18T09:58:53.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-18T09:58:53.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-18T09:58:53.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-18T09:58:53.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-18T09:58:53.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-18T09:58:53.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-18T09:58:53.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-18T09:58:53.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-18T09:58:53.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-18T09:58:53.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-18T09:58:53.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-18T09:58:53.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-18T09:58:53.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-18T09:58:53.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-18T09:58:53.604 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-18T09:58:53.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-18T09:58:53.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-18T09:58:53.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-18T09:58:53.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-18T09:58:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-18T09:58:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-18T09:58:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-18T09:58:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-18T09:58:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-18T09:58:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-18T09:58:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-18T09:58:53.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-18T09:58:53.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-18T09:58:53.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-18T09:58:53.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-18T09:58:53.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-18T09:58:53.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-18T09:58:53.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-18T09:58:53.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-18T09:58:53.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-18T09:58:53.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-18T09:58:53.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-18T09:58:53.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-18T09:58:53.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-18T09:58:53.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-18T09:58:53.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-18T09:58:53.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-18T09:58:53.676 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-18T09:58:53.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-18T09:58:53.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-18T09:58:53.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-18T09:58:53.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-18T09:58:53.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-18T09:58:53.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-18T09:58:53.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-18T09:58:53.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-18T09:58:53.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-18T09:58:53.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-18T09:58:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-18T09:58:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-18T09:58:53.689 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-18T09:58:53.690 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-18T09:58:53.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-18T09:58:53.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-18T09:58:53.693 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-18T09:58:53.694 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-18T09:58:53.695 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-18T09:58:53.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-18T09:58:53.697 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-18T09:58:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-18T09:58:53.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-18T09:58:53.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-18T09:58:53.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-18T09:58:53.702 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-18T09:58:53.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-18T09:58:53.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-18T09:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-18T09:58:53.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-18T09:58:53.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-18T09:58:53.708 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-18T09:58:53.709 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-18T09:58:53.710 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-18T09:58:53.711 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-18T09:58:53.712 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-18T09:58:53.713 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-18T09:58:53.714 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-18T09:58:53.715 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-18T09:58:53.716 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-18T09:58:53.717 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-18T09:58:53.718 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-18T09:58:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-18T09:58:53.720 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-18T09:58:53.721 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-18T09:58:53.722 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-18T09:58:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-18T09:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-18T09:58:53.725 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-18T09:58:53.726 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-18T09:58:53.727 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-18T09:58:53.728 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-18T09:58:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-18T09:58:53.775 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-18T09:58:53.775 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-18T09:58:53.775 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-18T09:58:53.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-18T09:58:53.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-18T09:58:53.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-18T09:58:53.776 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-18T09:58:53.777 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-18T09:58:53.778 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-18T09:58:53.779 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-18T09:58:53.780 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-18T09:58:53.781 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-18T09:58:53.782 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-18T09:58:53.783 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-18T09:58:53.784 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-18T09:58:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-18T09:58:53.786 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-18T09:58:53.787 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-18T09:58:53.788 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-18T09:58:53.789 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-18T09:58:53.790 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-18T09:58:53.791 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-18T09:58:53.792 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-18T09:58:53.793 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-18T09:58:53.794 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-18T09:58:53.795 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-18T09:58:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-18T09:58:53.797 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-18T09:58:53.798 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-18T09:58:53.799 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-18T09:58:53.800 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-18T09:58:53.801 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-18T09:58:53.802 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-18T09:58:53.803 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-18T09:58:53.804 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-18T09:58:53.805 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-18T09:58:53.806 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-18T09:58:53.807 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-18T09:58:53.808 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-18T09:58:53.809 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-18T09:58:53.810 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-18T09:58:53.811 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-18T09:58:53.812 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-18T09:58:53.813 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-18T09:58:53.814 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-18T09:58:53.815 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-18T09:58:53.816 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-18T09:58:53.816 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-18T09:58:53.816 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-18T09:58:53.853 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-18T09:58:53.854 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-18T09:58:53.855 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-18T09:58:53.856 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-18T09:58:53.857 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-18T09:58:53.858 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-18T09:58:53.859 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-18T09:58:53.860 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-18T09:58:53.861 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-18T09:58:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-18T09:58:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-18T09:58:53.864 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-18T09:58:53.865 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-18T09:58:53.866 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-18T09:58:53.867 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-18T09:58:53.868 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-18T09:58:53.869 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-18T09:58:53.870 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-18T09:58:53.871 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-18T09:58:53.872 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-18T09:58:53.873 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-18T09:58:53.874 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-18T09:58:53.875 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-18T09:58:53.876 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-18T09:58:53.877 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-18T09:58:53.878 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-18T09:58:53.879 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-18T09:58:53.880 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-18T09:58:53.881 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-18T09:58:53.882 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-18T09:58:53.883 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-18T09:58:53.884 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-18T09:58:53.885 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-18T09:58:53.885 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-18T09:58:53.886 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-18T09:58:53.886 DEBUG:teuthology.orchestra.run.smithi133:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-18T09:58:53.903 INFO:teuthology.orchestra.run.smithi133.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-18T09:58:53.903 INFO:teuthology.orchestra.run.smithi133.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-18T09:58:53.903 INFO:teuthology.orchestra.run.smithi133.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-18T09:58:53.904 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-18T09:58:53.904 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-18T09:58:53.904 DEBUG:teuthology.orchestra.run.smithi133:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-18T09:58:53.947 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi133.front.sepia.ceph.com to complete... 2023-12-18T09:58:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2023-12-18T09:58:54.348 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-18T09:58:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-12-18T09:58:54.544 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-18T09:58:54.550 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-18T09:58:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-18T09:58:54.791 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-18T09:58:54.832 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-18T09:58:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-18T09:58:54.953 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-18T09:58:54.953 INFO:teuthology.orchestra.run.smithi133.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-18T09:58:54.953 INFO:teuthology.orchestra.run.smithi133.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-18T09:58:54.981 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-12-18T09:59:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18 09:59:02 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-18T09:59:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2023-12-18 09:59:02-- 2023-12-18T09:59:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 10s 2023-12-18T09:59:02.258 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 37M in 10s (3.68 MB/s) 2023-12-18T09:59:02.262 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-18T09:59:02.262 DEBUG:teuthology.orchestra.run.smithi142:> sudo dpkg -i /tmp/linux-image.deb 2023-12-18T09:59:02.514 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-18T09:59:04.433 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-18T09:59:04.437 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-18T09:59:04.529 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-18T09:59:07.503 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-18T09:59:07.613 INFO:teuthology.orchestra.run.smithi142.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-18T09:59:26.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-18T09:59:26.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-18T09:59:26.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T09:59:26.698 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub' 2023-12-18T09:59:26.714 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-18T09:59:26.738 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2023-12-18T09:59:27.043 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-18T09:59:27.057 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-18T09:59:27.360 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-18T09:59:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-18T09:59:27.435 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-18T09:59:27.440 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-18T09:59:27.573 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-18T09:59:27.573 INFO:teuthology.orchestra.run.smithi142.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-18T09:59:27.573 INFO:teuthology.orchestra.run.smithi142.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-18T09:59:27.613 INFO:teuthology.orchestra.run.smithi142.stderr:done 2023-12-18T09:59:27.772 DEBUG:teuthology.orchestra.run.smithi142:> dpkg-deb -c /tmp/linux-image.deb 2023-12-18T09:59:27.822 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-18T09:59:27.823 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-18T09:59:27.823 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-18T09:59:27.834 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-18T09:59:27.834 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-18T09:59:27.854 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-18T09:59:27.854 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-18T09:59:27.855 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-18T09:59:27.858 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-18T09:59:27.858 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-18T09:59:27.858 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-18T09:59:27.858 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-18T09:59:27.858 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-18T09:59:27.858 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-18T09:59:27.859 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-18T09:59:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-18T09:59:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-18T09:59:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-18T09:59:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-18T09:59:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-18T09:59:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-18T09:59:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-18T09:59:27.860 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-18T09:59:27.954 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-18T09:59:27.954 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-18T09:59:27.954 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-18T09:59:27.954 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-18T09:59:27.954 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-18T09:59:27.955 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-18T09:59:27.956 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-18T09:59:27.957 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-18T09:59:27.958 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-18T09:59:27.959 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-18T09:59:27.960 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-18T09:59:27.961 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-18T09:59:27.962 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-18T09:59:27.963 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-18T09:59:27.964 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-18T09:59:27.965 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-18T09:59:27.966 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-18T09:59:27.967 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-18T09:59:27.968 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-18T09:59:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-18T09:59:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-18T09:59:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-18T09:59:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-18T09:59:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-18T09:59:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-18T09:59:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-18T09:59:27.969 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-18T09:59:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-18T09:59:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-18T09:59:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-18T09:59:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-18T09:59:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-18T09:59:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-18T09:59:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-18T09:59:27.970 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-18T09:59:27.971 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-18T09:59:27.971 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-18T09:59:27.971 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-18T09:59:27.971 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-18T09:59:27.971 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-18T09:59:27.971 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-18T09:59:27.971 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-18T09:59:27.971 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-18T09:59:27.972 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-18T09:59:27.972 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-18T09:59:27.972 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-18T09:59:27.972 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-18T09:59:27.972 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-18T09:59:27.972 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-18T09:59:27.972 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-18T09:59:27.972 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-18T09:59:27.973 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-18T09:59:27.973 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-18T09:59:27.973 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-18T09:59:27.973 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-18T09:59:27.973 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-18T09:59:27.973 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-18T09:59:27.973 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-18T09:59:27.973 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-18T09:59:27.974 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-18T09:59:27.974 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-18T09:59:27.974 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-18T09:59:27.974 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-18T09:59:27.974 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-18T09:59:27.974 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-18T09:59:27.975 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-18T09:59:27.975 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-18T09:59:27.975 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-18T09:59:27.975 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-18T09:59:27.975 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-18T09:59:27.975 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-18T09:59:27.975 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-18T09:59:27.976 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-18T09:59:27.977 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-18T09:59:27.977 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-18T09:59:27.977 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-18T09:59:27.977 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-18T09:59:27.977 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-18T09:59:27.977 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-18T09:59:27.977 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-18T09:59:27.978 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-18T09:59:27.979 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-18T09:59:27.980 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-18T09:59:27.981 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-18T09:59:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-18T09:59:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-18T09:59:27.984 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-18T09:59:27.985 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-18T09:59:27.986 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-18T09:59:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-18T09:59:27.988 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-18T09:59:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-18T09:59:27.990 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-18T09:59:27.991 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-18T09:59:27.992 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-18T09:59:27.993 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-18T09:59:27.994 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-18T09:59:27.995 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-18T09:59:27.996 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-18T09:59:27.997 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-18T09:59:27.998 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-18T09:59:27.999 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-18T09:59:28.000 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-18T09:59:28.001 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-18T09:59:28.002 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-18T09:59:28.003 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-18T09:59:28.004 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-18T09:59:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-18T09:59:28.006 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-18T09:59:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-18T09:59:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-18T09:59:28.009 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-18T09:59:28.010 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-18T09:59:28.011 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-18T09:59:28.012 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-18T09:59:28.013 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-18T09:59:28.013 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-18T09:59:28.013 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-18T09:59:28.013 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-18T09:59:28.013 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-18T09:59:28.013 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-18T09:59:28.013 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-18T09:59:28.014 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-18T09:59:28.014 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-18T09:59:28.014 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-18T09:59:28.014 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-18T09:59:28.014 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-18T09:59:28.014 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-18T09:59:28.014 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-18T09:59:28.015 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-18T09:59:28.016 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-18T09:59:28.016 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-18T09:59:28.016 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-18T09:59:28.016 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-18T09:59:28.016 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-18T09:59:28.016 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-18T09:59:28.016 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-18T09:59:28.017 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-18T09:59:28.017 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-18T09:59:28.017 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-18T09:59:28.017 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-18T09:59:28.017 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-18T09:59:28.017 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-18T09:59:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-18T09:59:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-18T09:59:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-18T09:59:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-18T09:59:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-18T09:59:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-18T09:59:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-18T09:59:28.018 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-18T09:59:28.019 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-18T09:59:28.020 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-18T09:59:28.021 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-18T09:59:28.021 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-18T09:59:28.021 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-18T09:59:28.021 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-18T09:59:28.021 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-18T09:59:28.021 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-18T09:59:28.021 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-18T09:59:28.022 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-18T09:59:28.022 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-18T09:59:28.022 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-18T09:59:28.024 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-18T09:59:28.024 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-18T09:59:28.025 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-18T09:59:28.025 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-18T09:59:28.025 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-18T09:59:28.025 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-18T09:59:28.025 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-18T09:59:28.025 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-18T09:59:28.026 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-18T09:59:28.026 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-18T09:59:28.026 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-18T09:59:28.026 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-18T09:59:28.026 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-18T09:59:28.026 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-18T09:59:28.027 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-18T09:59:28.027 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-18T09:59:28.027 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-18T09:59:28.027 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-18T09:59:28.027 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-18T09:59:28.027 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-18T09:59:28.027 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-18T09:59:28.028 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-18T09:59:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-18T09:59:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-18T09:59:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-18T09:59:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-18T09:59:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-18T09:59:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-18T09:59:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-18T09:59:28.029 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-18T09:59:28.030 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-18T09:59:28.031 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-18T09:59:28.031 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-18T09:59:28.031 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-18T09:59:28.031 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-18T09:59:28.031 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-18T09:59:28.031 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-18T09:59:28.031 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-18T09:59:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-18T09:59:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-18T09:59:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-18T09:59:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-18T09:59:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-18T09:59:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-18T09:59:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-18T09:59:28.032 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-18T09:59:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-18T09:59:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-18T09:59:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-18T09:59:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-18T09:59:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-18T09:59:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-18T09:59:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-18T09:59:28.033 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-18T09:59:28.034 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-18T09:59:28.034 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-18T09:59:28.034 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-18T09:59:28.034 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-18T09:59:28.034 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-18T09:59:28.034 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-18T09:59:28.034 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-18T09:59:28.035 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-18T09:59:28.035 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-18T09:59:28.035 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-18T09:59:28.035 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-18T09:59:28.035 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-18T09:59:28.036 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-18T09:59:28.036 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-18T09:59:28.036 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-18T09:59:28.036 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-18T09:59:28.036 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-18T09:59:28.037 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-18T09:59:28.038 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-18T09:59:28.038 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-18T09:59:28.038 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-18T09:59:28.038 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-18T09:59:28.038 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-18T09:59:28.038 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-18T09:59:28.038 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-18T09:59:28.039 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-18T09:59:28.040 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-18T09:59:28.041 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-18T09:59:28.150 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-18T09:59:28.151 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-18T09:59:28.152 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-18T09:59:28.153 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-18T09:59:28.154 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-18T09:59:28.155 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-18T09:59:28.156 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-18T09:59:28.157 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-18T09:59:28.158 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-18T09:59:28.159 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-18T09:59:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-18T09:59:28.161 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-18T09:59:28.162 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-18T09:59:28.163 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-18T09:59:28.164 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-18T09:59:28.165 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-18T09:59:28.166 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-18T09:59:28.167 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-18T09:59:28.168 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-18T09:59:28.169 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-18T09:59:28.170 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-18T09:59:28.171 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-18T09:59:28.172 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-18T09:59:28.173 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-18T09:59:28.174 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-18T09:59:28.175 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-18T09:59:28.176 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-18T09:59:28.177 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-18T09:59:28.178 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-18T09:59:28.179 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-18T09:59:28.180 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-18T09:59:28.181 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-18T09:59:28.182 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-18T09:59:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-18T09:59:28.184 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-18T09:59:28.185 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-18T09:59:28.186 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-18T09:59:28.187 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-18T09:59:28.188 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-18T09:59:28.189 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-18T09:59:28.190 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-18T09:59:28.191 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-18T09:59:28.192 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-18T09:59:28.193 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-18T09:59:28.194 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-18T09:59:28.195 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-18T09:59:28.196 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-18T09:59:28.197 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-18T09:59:28.198 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-18T09:59:28.199 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-18T09:59:28.200 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-18T09:59:28.201 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-18T09:59:28.202 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-18T09:59:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-18T09:59:28.204 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-18T09:59:28.205 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-18T09:59:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-18T09:59:28.207 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-18T09:59:28.208 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-18T09:59:28.209 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-18T09:59:28.210 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-18T09:59:28.211 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-18T09:59:28.212 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-18T09:59:28.213 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-18T09:59:28.214 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-18T09:59:28.215 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-18T09:59:28.216 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-18T09:59:28.217 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-18T09:59:28.218 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-18T09:59:28.219 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-18T09:59:28.220 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-18T09:59:28.221 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-18T09:59:28.222 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-18T09:59:28.223 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-18T09:59:28.224 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-18T09:59:28.225 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-18T09:59:28.226 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-18T09:59:28.227 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-18T09:59:28.228 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-18T09:59:28.229 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-18T09:59:28.231 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-18T09:59:28.232 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-18T09:59:28.232 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-18T09:59:28.232 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-18T09:59:28.232 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-18T09:59:28.232 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-18T09:59:28.233 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-18T09:59:28.233 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-18T09:59:28.233 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-18T09:59:28.233 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-18T09:59:28.233 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-18T09:59:28.233 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-18T09:59:28.233 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-18T09:59:28.233 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-18T09:59:28.234 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-18T09:59:28.234 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-18T09:59:28.234 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-18T09:59:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-18T09:59:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-18T09:59:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-18T09:59:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-18T09:59:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-18T09:59:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-18T09:59:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-18T09:59:28.235 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-18T09:59:28.236 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-18T09:59:28.237 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-18T09:59:28.238 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-18T09:59:28.239 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-18T09:59:28.240 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-18T09:59:28.241 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-18T09:59:28.242 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-18T09:59:28.243 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-18T09:59:28.244 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-18T09:59:28.245 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-18T09:59:28.245 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-18T09:59:28.245 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-18T09:59:28.245 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-18T09:59:28.245 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-18T09:59:28.246 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-18T09:59:28.247 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-18T09:59:28.248 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-18T09:59:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-18T09:59:28.250 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-18T09:59:28.251 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-18T09:59:28.252 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-18T09:59:28.253 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-18T09:59:28.254 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-18T09:59:28.255 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-18T09:59:28.256 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-18T09:59:28.256 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-18T09:59:28.256 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-18T09:59:28.256 INFO:teuthology.orchestra.run.smithi142.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-18T09:59:28.256 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-18T09:59:28.256 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-18T09:59:28.257 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-18T09:59:28.257 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-18T09:59:28.257 DEBUG:teuthology.orchestra.run.smithi142:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-18T09:59:28.264 INFO:teuthology.orchestra.run.smithi142.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-18T09:59:28.265 INFO:teuthology.orchestra.run.smithi142.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-18T09:59:28.265 INFO:teuthology.orchestra.run.smithi142.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-18T09:59:28.265 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-18T09:59:28.266 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-18T09:59:28.266 DEBUG:teuthology.orchestra.run.smithi142:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-18T09:59:28.308 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi142.front.sepia.ceph.com to complete... 2023-12-18T09:59:28.709 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub' 2023-12-18T09:59:28.711 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-18T09:59:28.740 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2023-12-18T09:59:28.918 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-18T09:59:28.924 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-18T09:59:29.178 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-18T09:59:29.184 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-18T09:59:29.225 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-18T09:59:29.230 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-18T09:59:29.367 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-18T09:59:29.367 INFO:teuthology.orchestra.run.smithi142.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-18T09:59:29.368 INFO:teuthology.orchestra.run.smithi142.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-18T09:59:29.381 INFO:teuthology.orchestra.run.smithi142.stderr:done 2023-12-18T09:59:44.658 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-12-18T09:59:53.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-18T09:59:53.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T09:59:56.721 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-12-18T10:00:00.541 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-18T10:00:00.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-18T10:00:00.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:00:08.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-18T10:00:08.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:00:11.793 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-12-18T10:00:18.961 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-18T10:00:26.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-18T10:00:26.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:00:27.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-18T10:00:27.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:00:29.873 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-12-18T10:00:31.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-18T10:00:43.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-18T10:00:43.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:00:47.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-18T10:00:47.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:00:48.167 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-12-18T10:00:48.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-18T10:00:48.900 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-gcd68252d7b4d"... 2023-12-18T10:00:48.901 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-12-18T10:00:48.953 INFO:teuthology.orchestra.run.smithi133.stdout:6.6.0-gcd68252d7b4d 2023-12-18T10:00:48.953 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-18T10:00:48.953 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-18T10:00:48.954 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-18T10:00:49.955 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-18T10:00:49.955 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-18T10:00:50.052 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2023-12-18T10:00:50.092 DEBUG:teuthology.parallel:result is None 2023-12-18T10:01:01.462 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-12-18T10:01:16.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-18T10:01:16.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:01:16.987 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-12-18T10:01:17.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-18T10:01:17.976 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-gcd68252d7b4d"... 2023-12-18T10:01:17.977 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-12-18T10:01:18.027 INFO:teuthology.orchestra.run.smithi142.stdout:6.6.0-gcd68252d7b4d 2023-12-18T10:01:18.027 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-18T10:01:18.028 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-18T10:01:18.028 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-18T10:01:19.028 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-18T10:01:19.028 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-18T10:01:19.184 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2023-12-18T10:01:19.269 DEBUG:teuthology.parallel:result is None 2023-12-18T10:01:19.270 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-18T10:01:19.280 INFO:teuthology.task.internal:Creating test directory... 2023-12-18T10:01:19.281 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-18T10:01:19.284 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-18T10:01:19.294 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-18T10:01:19.300 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-18T10:01:19.320 INFO:teuthology.task.internal:Creating archive directory... 2023-12-18T10:01:19.322 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-18T10:01:19.340 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-18T10:01:19.377 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-18T10:01:19.386 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-18T10:01:19.386 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-18T10:01:19.405 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-18T10:01:19.426 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-18T10:01:19.440 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-18T10:01:19.447 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-18T10:01:19.460 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-18T10:01:19.462 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-18T10:01:19.472 INFO:teuthology.task.internal:Configuring sudo... 2023-12-18T10:01:19.472 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-18T10:01:19.496 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-18T10:01:19.534 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-18T10:01:19.544 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-18T10:01:19.544 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-18T10:01:19.560 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-18T10:01:19.589 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-18T10:01:19.622 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-18T10:01:19.674 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:01:19.674 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-18T10:01:19.757 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-18T10:01:19.766 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-18T10:01:19.819 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:01:19.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-18T10:01:19.899 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-12-18T10:01:19.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2023-12-18T10:01:20.094 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-18T10:01:20.102 INFO:teuthology.task.internal:Starting timer... 2023-12-18T10:01:20.102 INFO:teuthology.run_tasks:Running task pcp... 2023-12-18T10:01:20.112 INFO:teuthology.run_tasks:Running task selinux... 2023-12-18T10:01:20.121 DEBUG:teuthology.task.selinux:Excluding smithi133: OS 'ubuntu' does not support SELinux 2023-12-18T10:01:20.121 DEBUG:teuthology.task.selinux:Excluding smithi142: OS 'ubuntu' does not support SELinux 2023-12-18T10:01:20.122 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-18T10:01:20.122 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-18T10:01:20.122 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-18T10:01:20.122 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-18T10:01:20.133 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-18T10:01:20.133 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-18T10:01:20.150 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-18T10:01:20.151 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi133.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-18T10:12:24.521 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2023-12-18T10:12:24.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-18T10:12:24.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:12:24.600 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-12-18T10:12:24.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-18T10:12:24.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-18T10:12:24.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-18T10:12:24.805 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-12-18T10:12:24.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-12-18T10:12:24.940 INFO:teuthology.run_tasks:Running task clock... 2023-12-18T10:12:24.950 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-18T10:12:24.951 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-18T10:12:24.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-18T10:12:24.955 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-18T10:12:24.955 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-18T10:12:24.990 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-18T10:12:24.991 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Command line: ntpd -gq 2023-12-18T10:12:24.991 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: ---------------------------------------------------- 2023-12-18T10:12:24.991 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: ntp-4 is maintained by Network Time Foundation, 2023-12-18T10:12:24.991 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-18T10:12:24.991 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: corporation. Support and training for ntp-4 are 2023-12-18T10:12:24.991 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: available at https://www.nwtime.org/support 2023-12-18T10:12:24.991 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: ---------------------------------------------------- 2023-12-18T10:12:24.992 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: proto: precision = 0.043 usec (-24) 2023-12-18T10:12:24.992 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: basedate set to 2022-02-04 2023-12-18T10:12:24.992 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: gps base set to 2022-02-06 (week 2196) 2023-12-18T10:12:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-18T10:12:24.993 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-18T10:12:24.993 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: restrict ::: KOD does nothing without LIMITED. 2023-12-18T10:12:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-18T10:12:24.994 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Listen and drop on 0 v6wildcard [::]:123 2023-12-18T10:12:24.994 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-18T10:12:24.994 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Listen normally on 2 lo 127.0.0.1:123 2023-12-18T10:12:24.995 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Listen normally on 3 enp3s0f1 172.21.15.133:123 2023-12-18T10:12:24.995 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Listen normally on 4 lo [::1]:123 2023-12-18T10:12:24.995 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8087%5]:123 2023-12-18T10:12:24.995 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:24 ntpd[27997]: Listening on routing socket on fd #22 for interface updates 2023-12-18T10:12:25.027 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-18T10:12:25.027 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Command line: ntpd -gq 2023-12-18T10:12:25.027 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: ---------------------------------------------------- 2023-12-18T10:12:25.027 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: ntp-4 is maintained by Network Time Foundation, 2023-12-18T10:12:25.028 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-18T10:12:25.028 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: corporation. Support and training for ntp-4 are 2023-12-18T10:12:25.028 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: available at https://www.nwtime.org/support 2023-12-18T10:12:25.028 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: ---------------------------------------------------- 2023-12-18T10:12:25.028 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: proto: precision = 0.042 usec (-24) 2023-12-18T10:12:25.029 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: basedate set to 2022-02-04 2023-12-18T10:12:25.029 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: gps base set to 2022-02-06 (week 2196) 2023-12-18T10:12:25.029 INFO:teuthology.orchestra.run.smithi142.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-18T10:12:25.029 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-18T10:12:25.029 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: restrict ::: KOD does nothing without LIMITED. 2023-12-18T10:12:25.030 INFO:teuthology.orchestra.run.smithi142.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-18T10:12:25.030 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Listen and drop on 0 v6wildcard [::]:123 2023-12-18T10:12:25.031 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-18T10:12:25.031 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Listen normally on 2 lo 127.0.0.1:123 2023-12-18T10:12:25.031 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Listen normally on 3 enp3s0f1 172.21.15.142:123 2023-12-18T10:12:25.031 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Listen normally on 4 lo [::1]:123 2023-12-18T10:12:25.031 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e0d%5]:123 2023-12-18T10:12:25.031 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:25 ntpd[27985]: Listening on routing socket on fd #22 for interface updates 2023-12-18T10:12:25.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:25 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:25.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:25 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:25.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:25 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:25.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:25 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:25.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:25 ntpd[27997]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:25.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:25 ntpd[27997]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:26 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:26 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:26 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:26 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:26 ntpd[27997]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:26 ntpd[27997]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:27 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:27 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:27 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:27 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:27 ntpd[27997]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:27.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:27 ntpd[27997]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:28.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:28.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:28.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:28.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:28.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:28.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:28.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:28.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:28.030 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:28.030 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:28.030 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:28.030 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:28 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:28.991 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:28 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:28 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:28 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:28 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:28 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:28 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:28 ntpd[27997]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:28.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:28 ntpd[27997]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:29.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:29 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:29.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:29 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:29.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:29 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:29.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:29 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:29.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:29 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:29.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:29 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:29.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:29 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:29.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:29 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:29.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:29.993 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:29.993 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:29.993 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:29.993 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:29 ntpd[27997]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:30.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:30.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:30 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:30 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:30 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:30 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:30 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:30 ntpd[27997]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:30 ntpd[27997]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:31.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:31 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:31.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:31 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:31.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:31 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:31.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:31 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:31.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:31 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:31.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:31 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:31.991 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:31.991 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:31.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:31.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:31.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:31.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:31.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:31.992 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:31.992 INFO:teuthology.orchestra.run.smithi133.stdout:18 Dec 10:12:31 ntpd[27997]: ntpd: time slew -0.002714 s 2023-12-18T10:12:31.992 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time slew -0.002714s 2023-12-18T10:12:31.993 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-18T10:12:31.993 INFO:teuthology.orchestra.run.smithi133.stderr:18 Dec 10:12:31 ntpd[27997]: can't open /var/log/ntpstats/loopstats.20231218: Permission denied 2023-12-18T10:12:32.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:32.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:32.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:32.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:32.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:32.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:32.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:32.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:32.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:32.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:32.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:32.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:32 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:32.093 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-12-18T10:12:32.093 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-12-18T10:12:32.093 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-18T10:12:32.093 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-18T10:12:32.094 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-18T10:12:32.094 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-18T10:12:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:33 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:33 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:33 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:33 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:33 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:33 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:34.028 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-18T10:12:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: can't open /var/log/ntpstats/rawstats.20231218: Permission denied 2023-12-18T10:12:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-18T10:12:34.029 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: can't open /var/log/ntpstats/peerstats.20231218: Permission denied 2023-12-18T10:12:34.029 INFO:teuthology.orchestra.run.smithi142.stdout:18 Dec 10:12:34 ntpd[27985]: ntpd: time slew -0.001314 s 2023-12-18T10:12:34.029 INFO:teuthology.orchestra.run.smithi142.stdout:ntpd: time slew -0.001314s 2023-12-18T10:12:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-18T10:12:34.030 INFO:teuthology.orchestra.run.smithi142.stderr:18 Dec 10:12:34 ntpd[27985]: can't open /var/log/ntpstats/loopstats.20231218: Permission denied 2023-12-18T10:12:34.138 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2023-12-18T10:12:34.138 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2023-12-18T10:12:34.138 INFO:teuthology.orchestra.run.smithi142.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-18T10:12:34.139 INFO:teuthology.orchestra.run.smithi142.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-18T10:12:34.139 INFO:teuthology.orchestra.run.smithi142.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-18T10:12:34.139 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-18T10:12:34.140 INFO:teuthology.run_tasks:Running task install... 2023-12-18T10:12:34.149 DEBUG:teuthology.task.install:project ceph 2023-12-18T10:12:34.149 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f'}} 2023-12-18T10:12:34.149 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f'} 2023-12-18T10:12:34.149 INFO:teuthology.task.install:Using flavor: default 2023-12-18T10:12:34.155 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-18T10:12:34.155 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-18T10:12:34.156 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-key list | grep Ceph 2023-12-18T10:12:34.156 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-key list | grep Ceph 2023-12-18T10:12:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-18T10:12:34.288 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-18T10:12:34.317 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-18T10:12:34.317 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph.com (release key) 2023-12-18T10:12:34.318 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-18T10:12:34.318 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-18T10:12:34.319 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8688b2517b6002b804a4844986e6ed5ce973d99f 2023-12-18T10:12:34.340 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-18T10:12:34.341 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph.com (release key) 2023-12-18T10:12:34.341 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-18T10:12:34.342 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-18T10:12:34.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8688b2517b6002b804a4844986e6ed5ce973d99f 2023-12-18T10:12:34.468 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default/ 2023-12-18T10:12:34.469 INFO:teuthology.task.install.deb:Package version is 18.2.0-1372-g8688b251-1jammy 2023-12-18T10:12:34.489 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default/ 2023-12-18T10:12:34.489 INFO:teuthology.task.install.deb:Package version is 18.2.0-1372-g8688b251-1jammy 2023-12-18T10:12:34.803 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:12:34.804 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-18T10:12:34.814 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:12:34.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-18T10:12:34.825 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-12-18T10:12:34.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get update 2023-12-18T10:12:35.039 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-18T10:12:35.127 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-18T10:12:35.148 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-18T10:12:35.148 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-18T10:12:35.209 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-18T10:12:35.219 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-18T10:12:35.275 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-18T10:12:35.295 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-18T10:12:35.394 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy InRelease 2023-12-18T10:12:35.394 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy InRelease 2023-12-18T10:12:35.481 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-18T10:12:35.481 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-18T10:12:35.588 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-18T10:12:35.588 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-18T10:12:35.689 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,425 B] 2023-12-18T10:12:35.690 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-18T10:12:35.766 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-18T10:12:35.848 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,425 B] 2023-12-18T10:12:35.875 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 28.5 kB in 1s (34.8 kB/s) 2023-12-18T10:12:35.954 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 28.5 kB in 1s (31.4 kB/s) 2023-12-18T10:12:36.804 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-12-18T10:12:36.821 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1372-g8688b251-1jammy cephadm=18.2.0-1372-g8688b251-1jammy ceph-mds=18.2.0-1372-g8688b251-1jammy ceph-mgr=18.2.0-1372-g8688b251-1jammy ceph-common=18.2.0-1372-g8688b251-1jammy ceph-fuse=18.2.0-1372-g8688b251-1jammy ceph-test=18.2.0-1372-g8688b251-1jammy ceph-volume=18.2.0-1372-g8688b251-1jammy radosgw=18.2.0-1372-g8688b251-1jammy python3-rados=18.2.0-1372-g8688b251-1jammy python3-rgw=18.2.0-1372-g8688b251-1jammy python3-cephfs=18.2.0-1372-g8688b251-1jammy python3-rbd=18.2.0-1372-g8688b251-1jammy libcephfs2=18.2.0-1372-g8688b251-1jammy libcephfs-dev=18.2.0-1372-g8688b251-1jammy librados2=18.2.0-1372-g8688b251-1jammy librbd1=18.2.0-1372-g8688b251-1jammy rbd-fuse=18.2.0-1372-g8688b251-1jammy python3-cephfs=18.2.0-1372-g8688b251-1jammy cephfs-shell=18.2.0-1372-g8688b251-1jammy cephfs-top=18.2.0-1372-g8688b251-1jammy cephfs-mirror=18.2.0-1372-g8688b251-1jammy 2023-12-18T10:12:36.895 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-12-18T10:12:36.897 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-12-18T10:12:36.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1372-g8688b251-1jammy cephadm=18.2.0-1372-g8688b251-1jammy ceph-mds=18.2.0-1372-g8688b251-1jammy ceph-mgr=18.2.0-1372-g8688b251-1jammy ceph-common=18.2.0-1372-g8688b251-1jammy ceph-fuse=18.2.0-1372-g8688b251-1jammy ceph-test=18.2.0-1372-g8688b251-1jammy ceph-volume=18.2.0-1372-g8688b251-1jammy radosgw=18.2.0-1372-g8688b251-1jammy python3-rados=18.2.0-1372-g8688b251-1jammy python3-rgw=18.2.0-1372-g8688b251-1jammy python3-cephfs=18.2.0-1372-g8688b251-1jammy python3-rbd=18.2.0-1372-g8688b251-1jammy libcephfs2=18.2.0-1372-g8688b251-1jammy libcephfs-dev=18.2.0-1372-g8688b251-1jammy librados2=18.2.0-1372-g8688b251-1jammy librbd1=18.2.0-1372-g8688b251-1jammy rbd-fuse=18.2.0-1372-g8688b251-1jammy python3-cephfs=18.2.0-1372-g8688b251-1jammy cephfs-shell=18.2.0-1372-g8688b251-1jammy cephfs-top=18.2.0-1372-g8688b251-1jammy cephfs-mirror=18.2.0-1372-g8688b251-1jammy 2023-12-18T10:12:36.985 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-12-18T10:12:37.064 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2023-12-18T10:12:37.065 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2023-12-18T10:12:37.159 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-12-18T10:12:37.159 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-12-18T10:12:37.220 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2023-12-18T10:12:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-18T10:12:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-18T10:12:37.220 INFO:teuthology.orchestra.run.smithi142.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-18T10:12:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-18T10:12:37.221 INFO:teuthology.orchestra.run.smithi142.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-18T10:12:37.221 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-18T10:12:37.222 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2023-12-18T10:12:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-18T10:12:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-18T10:12:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-18T10:12:37.222 INFO:teuthology.orchestra.run.smithi142.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-18T10:12:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-18T10:12:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-18T10:12:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-18T10:12:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-18T10:12:37.223 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-18T10:12:37.224 INFO:teuthology.orchestra.run.smithi142.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-18T10:12:37.225 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2023-12-18T10:12:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-18T10:12:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-18T10:12:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-18T10:12:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-18T10:12:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-18T10:12:37.225 INFO:teuthology.orchestra.run.smithi142.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-18T10:12:37.226 INFO:teuthology.orchestra.run.smithi142.stdout: python3-watchdog 2023-12-18T10:12:37.226 INFO:teuthology.orchestra.run.smithi142.stdout:Recommended packages: 2023-12-18T10:12:37.226 INFO:teuthology.orchestra.run.smithi142.stdout: btrfs-tools 2023-12-18T10:12:37.318 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-12-18T10:12:37.319 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-18T10:12:37.319 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-18T10:12:37.319 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-18T10:12:37.319 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-18T10:12:37.319 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-18T10:12:37.319 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-18T10:12:37.320 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-12-18T10:12:37.320 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-18T10:12:37.320 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-18T10:12:37.320 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-18T10:12:37.320 INFO:teuthology.orchestra.run.smithi133.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-18T10:12:37.321 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-18T10:12:37.322 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-12-18T10:12:37.323 INFO:teuthology.orchestra.run.smithi133.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-18T10:12:37.324 INFO:teuthology.orchestra.run.smithi133.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-18T10:12:37.324 INFO:teuthology.orchestra.run.smithi133.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-18T10:12:37.324 INFO:teuthology.orchestra.run.smithi133.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-18T10:12:37.324 INFO:teuthology.orchestra.run.smithi133.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-18T10:12:37.324 INFO:teuthology.orchestra.run.smithi133.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-18T10:12:37.324 INFO:teuthology.orchestra.run.smithi133.stdout: python3-watchdog 2023-12-18T10:12:37.324 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2023-12-18T10:12:37.324 INFO:teuthology.orchestra.run.smithi133.stdout: btrfs-tools 2023-12-18T10:12:37.367 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2023-12-18T10:12:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-18T10:12:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-18T10:12:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-18T10:12:37.367 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-18T10:12:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-18T10:12:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-18T10:12:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-12-18T10:12:37.369 INFO:teuthology.orchestra.run.smithi142.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-12-18T10:12:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-18T10:12:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-18T10:12:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-18T10:12:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-18T10:12:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-18T10:12:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-18T10:12:37.370 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-18T10:12:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-18T10:12:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-18T10:12:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-18T10:12:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-18T10:12:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-18T10:12:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-18T10:12:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-18T10:12:37.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-18T10:12:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-18T10:12:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-18T10:12:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-18T10:12:37.372 INFO:teuthology.orchestra.run.smithi142.stdout: socat xmlstarlet 2023-12-18T10:12:37.438 INFO:teuthology.orchestra.run.smithi142.stdout:0 upgraded, 115 newly installed, 0 to remove and 268 not upgraded. 2023-12-18T10:12:37.438 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 181 MB of archives. 2023-12-18T10:12:37.438 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 812 MB of additional disk space will be used. 2023-12-18T10:12:37.438 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-18T10:12:37.456 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-18T10:12:37.466 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-12-18T10:12:37.466 INFO:teuthology.orchestra.run.smithi133.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-18T10:12:37.466 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-18T10:12:37.466 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-18T10:12:37.466 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-18T10:12:37.467 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-18T10:12:37.468 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-18T10:12:37.469 INFO:teuthology.orchestra.run.smithi133.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-18T10:12:37.470 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-18T10:12:37.470 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-18T10:12:37.470 INFO:teuthology.orchestra.run.smithi133.stdout: socat xmlstarlet 2023-12-18T10:12:37.508 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-12-18T10:12:37.519 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-18T10:12:37.535 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-18T10:12:37.537 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-18T10:12:37.548 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-18T10:12:37.584 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-18T10:12:37.586 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-18T10:12:37.593 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-18T10:12:37.595 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-18T10:12:37.596 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-18T10:12:37.602 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-18T10:12:37.602 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-18T10:12:37.603 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-18T10:12:37.604 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-18T10:12:37.604 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-18T10:12:37.619 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-18T10:12:37.620 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-18T10:12:37.620 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-18T10:12:37.621 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-18T10:12:37.636 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-18T10:12:37.638 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-18T10:12:37.639 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-18T10:12:37.640 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-18T10:12:37.640 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-18T10:12:37.641 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-18T10:12:37.653 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-18T10:12:37.654 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-18T10:12:37.655 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-18T10:12:37.655 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-18T10:12:37.663 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 115 newly installed, 0 to remove and 268 not upgraded. 2023-12-18T10:12:37.663 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 181 MB of archives. 2023-12-18T10:12:37.663 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 812 MB of additional disk space will be used. 2023-12-18T10:12:37.664 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-18T10:12:37.671 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-18T10:12:37.675 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-18T10:12:37.675 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-18T10:12:37.676 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-18T10:12:37.676 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-18T10:12:37.677 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-18T10:12:37.687 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-18T10:12:37.688 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-18T10:12:37.689 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-18T10:12:37.690 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-18T10:12:37.704 INFO:teuthology.orchestra.run.smithi142.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-18T10:12:37.705 INFO:teuthology.orchestra.run.smithi142.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-18T10:12:37.707 INFO:teuthology.orchestra.run.smithi142.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-18T10:12:37.746 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-18T10:12:37.750 INFO:teuthology.orchestra.run.smithi142.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-18T10:12:37.751 INFO:teuthology.orchestra.run.smithi142.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-18T10:12:37.753 INFO:teuthology.orchestra.run.smithi142.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-18T10:12:37.753 INFO:teuthology.orchestra.run.smithi142.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-18T10:12:37.754 INFO:teuthology.orchestra.run.smithi142.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-18T10:12:37.755 INFO:teuthology.orchestra.run.smithi142.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-18T10:12:37.755 INFO:teuthology.orchestra.run.smithi142.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-18T10:12:37.756 INFO:teuthology.orchestra.run.smithi142.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-18T10:12:37.758 INFO:teuthology.orchestra.run.smithi142.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-18T10:12:37.770 INFO:teuthology.orchestra.run.smithi142.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-18T10:12:37.776 INFO:teuthology.orchestra.run.smithi142.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-18T10:12:37.791 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-18T10:12:37.794 INFO:teuthology.orchestra.run.smithi142.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-18T10:12:37.796 INFO:teuthology.orchestra.run.smithi142.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-18T10:12:37.796 INFO:teuthology.orchestra.run.smithi142.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-18T10:12:37.801 INFO:teuthology.orchestra.run.smithi142.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-1372-g8688b251-1jammy [3,418 kB] 2023-12-18T10:12:37.813 INFO:teuthology.orchestra.run.smithi142.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-18T10:12:37.813 INFO:teuthology.orchestra.run.smithi142.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-18T10:12:37.814 INFO:teuthology.orchestra.run.smithi142.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-18T10:12:37.814 INFO:teuthology.orchestra.run.smithi142.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-18T10:12:37.815 INFO:teuthology.orchestra.run.smithi142.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-18T10:12:37.816 INFO:teuthology.orchestra.run.smithi142.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-18T10:12:37.820 INFO:teuthology.orchestra.run.smithi142.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-18T10:12:37.821 INFO:teuthology.orchestra.run.smithi142.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-18T10:12:37.824 INFO:teuthology.orchestra.run.smithi142.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-18T10:12:37.837 INFO:teuthology.orchestra.run.smithi142.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-18T10:12:37.838 INFO:teuthology.orchestra.run.smithi142.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-18T10:12:37.839 INFO:teuthology.orchestra.run.smithi142.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-18T10:12:37.843 INFO:teuthology.orchestra.run.smithi142.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-18T10:12:37.845 INFO:teuthology.orchestra.run.smithi142.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-18T10:12:37.846 INFO:teuthology.orchestra.run.smithi142.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-18T10:12:37.850 INFO:teuthology.orchestra.run.smithi142.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-18T10:12:37.854 INFO:teuthology.orchestra.run.smithi142.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-18T10:12:37.855 INFO:teuthology.orchestra.run.smithi142.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-18T10:12:37.856 INFO:teuthology.orchestra.run.smithi142.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-18T10:12:37.871 INFO:teuthology.orchestra.run.smithi142.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-18T10:12:37.872 INFO:teuthology.orchestra.run.smithi142.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-18T10:12:37.872 INFO:teuthology.orchestra.run.smithi142.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-18T10:12:37.961 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-1372-g8688b251-1jammy [3,418 kB] 2023-12-18T10:12:37.993 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-12-18T10:12:38.032 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-18T10:12:38.107 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-18T10:12:38.118 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-18T10:12:38.163 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-18T10:12:38.328 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-18T10:12:38.337 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-18T10:12:38.364 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-18T10:12:38.535 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-18T10:12:38.746 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-18T10:12:39.144 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-18T10:12:39.151 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-18T10:12:39.152 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-18T10:12:39.163 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-18T10:12:39.164 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-18T10:12:39.166 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-18T10:12:39.168 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-18T10:12:39.170 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-18T10:12:39.171 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-18T10:12:39.336 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-18T10:12:39.784 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-18T10:12:39.793 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-18T10:12:39.799 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-18T10:12:39.803 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-18T10:12:39.821 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-18T10:12:39.824 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-18T10:12:39.827 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-18T10:12:39.868 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-18T10:12:39.883 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-18T10:12:39.887 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-18T10:12:39.972 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-1372-g8688b251-1jammy [3,104 kB] 2023-12-18T10:12:40.140 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-18T10:12:40.223 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-18T10:12:40.316 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-18T10:12:40.389 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-18T10:12:40.494 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-18T10:12:40.579 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-18T10:12:40.598 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-18T10:12:40.628 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-18T10:12:40.639 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-18T10:12:40.676 INFO:teuthology.orchestra.run.smithi133.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-18T10:12:40.685 INFO:teuthology.orchestra.run.smithi133.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-18T10:12:40.876 INFO:teuthology.orchestra.run.smithi133.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-18T10:12:41.408 INFO:teuthology.orchestra.run.smithi133.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-1372-g8688b251-1jammy [670 kB] 2023-12-18T10:12:41.694 INFO:teuthology.orchestra.run.smithi133.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-1372-g8688b251-1jammy [356 kB] 2023-12-18T10:12:41.704 INFO:teuthology.orchestra.run.smithi133.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-18T10:12:41.705 INFO:teuthology.orchestra.run.smithi133.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-18T10:12:41.707 INFO:teuthology.orchestra.run.smithi133.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-18T10:12:41.707 INFO:teuthology.orchestra.run.smithi133.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-18T10:12:41.708 INFO:teuthology.orchestra.run.smithi133.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-18T10:12:41.709 INFO:teuthology.orchestra.run.smithi133.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-18T10:12:41.710 INFO:teuthology.orchestra.run.smithi133.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-18T10:12:41.710 INFO:teuthology.orchestra.run.smithi133.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-18T10:12:41.713 INFO:teuthology.orchestra.run.smithi133.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-18T10:12:41.785 INFO:teuthology.orchestra.run.smithi133.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-18T10:12:41.855 INFO:teuthology.orchestra.run.smithi133.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-1372-g8688b251-1jammy [32.8 kB] 2023-12-18T10:12:41.895 INFO:teuthology.orchestra.run.smithi133.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-1372-g8688b251-1jammy [180 kB] 2023-12-18T10:12:41.910 INFO:teuthology.orchestra.run.smithi133.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-1372-g8688b251-1jammy [61.5 kB] 2023-12-18T10:12:41.950 INFO:teuthology.orchestra.run.smithi133.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-18T10:12:41.993 INFO:teuthology.orchestra.run.smithi133.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-1372-g8688b251-1jammy [330 kB] 2023-12-18T10:12:42.106 INFO:teuthology.orchestra.run.smithi133.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-1372-g8688b251-1jammy [5,884 kB] 2023-12-18T10:12:42.678 INFO:teuthology.orchestra.run.smithi133.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-18T10:12:42.683 INFO:teuthology.orchestra.run.smithi133.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-18T10:12:42.684 INFO:teuthology.orchestra.run.smithi133.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-18T10:12:42.738 INFO:teuthology.orchestra.run.smithi133.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-18T10:12:42.738 INFO:teuthology.orchestra.run.smithi133.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-18T10:12:42.760 INFO:teuthology.orchestra.run.smithi133.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-18T10:12:42.761 INFO:teuthology.orchestra.run.smithi133.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-18T10:12:42.762 INFO:teuthology.orchestra.run.smithi133.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-18T10:12:42.763 INFO:teuthology.orchestra.run.smithi133.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-18T10:12:42.764 INFO:teuthology.orchestra.run.smithi133.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-18T10:12:42.929 INFO:teuthology.orchestra.run.smithi133.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-18T10:12:42.973 INFO:teuthology.orchestra.run.smithi142.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-1372-g8688b251-1jammy [3,104 kB] 2023-12-18T10:12:43.443 INFO:teuthology.orchestra.run.smithi133.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-18T10:12:43.471 INFO:teuthology.orchestra.run.smithi133.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-18T10:12:43.494 INFO:teuthology.orchestra.run.smithi133.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-18T10:12:43.502 INFO:teuthology.orchestra.run.smithi133.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-18T10:12:43.579 INFO:teuthology.orchestra.run.smithi133.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-18T10:12:43.612 INFO:teuthology.orchestra.run.smithi133.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-18T10:12:43.614 INFO:teuthology.orchestra.run.smithi133.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-18T10:12:43.651 INFO:teuthology.orchestra.run.smithi133.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-18T10:12:43.674 INFO:teuthology.orchestra.run.smithi133.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-18T10:12:43.677 INFO:teuthology.orchestra.run.smithi133.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-18T10:12:43.853 INFO:teuthology.orchestra.run.smithi133.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-18T10:12:44.463 INFO:teuthology.orchestra.run.smithi133.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-18T10:12:44.465 INFO:teuthology.orchestra.run.smithi133.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-18T10:12:44.469 INFO:teuthology.orchestra.run.smithi133.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-18T10:12:45.031 INFO:teuthology.orchestra.run.smithi133.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-1372-g8688b251-1jammy [112 kB] 2023-12-18T10:12:45.039 INFO:teuthology.orchestra.run.smithi133.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-1372-g8688b251-1jammy [442 kB] 2023-12-18T10:12:45.300 INFO:teuthology.orchestra.run.smithi133.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-1372-g8688b251-1jammy [22.0 MB] 2023-12-18T10:12:45.811 INFO:teuthology.orchestra.run.smithi142.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-1372-g8688b251-1jammy [670 kB] 2023-12-18T10:12:46.359 INFO:teuthology.orchestra.run.smithi142.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-1372-g8688b251-1jammy [356 kB] 2023-12-18T10:12:46.654 INFO:teuthology.orchestra.run.smithi142.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-1372-g8688b251-1jammy [32.8 kB] 2023-12-18T10:12:46.726 INFO:teuthology.orchestra.run.smithi142.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-1372-g8688b251-1jammy [180 kB] 2023-12-18T10:12:46.880 INFO:teuthology.orchestra.run.smithi142.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-1372-g8688b251-1jammy [61.5 kB] 2023-12-18T10:12:46.925 INFO:teuthology.orchestra.run.smithi142.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-1372-g8688b251-1jammy [330 kB] 2023-12-18T10:12:47.198 INFO:teuthology.orchestra.run.smithi142.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-1372-g8688b251-1jammy [5,884 kB] 2023-12-18T10:12:51.543 INFO:teuthology.orchestra.run.smithi142.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-1372-g8688b251-1jammy [112 kB] 2023-12-18T10:12:51.659 INFO:teuthology.orchestra.run.smithi142.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-1372-g8688b251-1jammy [442 kB] 2023-12-18T10:12:51.980 INFO:teuthology.orchestra.run.smithi142.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-1372-g8688b251-1jammy [22.0 MB] 2023-12-18T10:13:02.910 INFO:teuthology.orchestra.run.smithi133.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-1372-g8688b251-1jammy [6,835 kB] 2023-12-18T10:13:07.939 INFO:teuthology.orchestra.run.smithi133.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-1372-g8688b251-1jammy [237 kB] 2023-12-18T10:13:08.114 INFO:teuthology.orchestra.run.smithi133.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1372-g8688b251-1jammy [130 kB] 2023-12-18T10:13:08.205 INFO:teuthology.orchestra.run.smithi133.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-1372-g8688b251-1jammy [1,484 kB] 2023-12-18T10:13:09.211 INFO:teuthology.orchestra.run.smithi133.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-1372-g8688b251-1jammy [9,874 kB] 2023-12-18T10:13:10.185 INFO:teuthology.orchestra.run.smithi142.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-1372-g8688b251-1jammy [6,835 kB] 2023-12-18T10:13:15.197 INFO:teuthology.orchestra.run.smithi142.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-1372-g8688b251-1jammy [237 kB] 2023-12-18T10:13:15.409 INFO:teuthology.orchestra.run.smithi142.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1372-g8688b251-1jammy [130 kB] 2023-12-18T10:13:15.494 INFO:teuthology.orchestra.run.smithi133.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-1372-g8688b251-1jammy [31.5 MB] 2023-12-18T10:13:15.498 INFO:teuthology.orchestra.run.smithi142.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-1372-g8688b251-1jammy [1,484 kB] 2023-12-18T10:13:16.944 INFO:teuthology.orchestra.run.smithi142.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-1372-g8688b251-1jammy [9,874 kB] 2023-12-18T10:13:28.957 INFO:teuthology.orchestra.run.smithi142.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-1372-g8688b251-1jammy [31.5 MB] 2023-12-18T10:13:41.343 INFO:teuthology.orchestra.run.smithi133.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-1372-g8688b251-1jammy [14.1 kB] 2023-12-18T10:13:41.366 INFO:teuthology.orchestra.run.smithi133.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-1372-g8688b251-1jammy [824 kB] 2023-12-18T10:13:42.139 INFO:teuthology.orchestra.run.smithi133.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-1372-g8688b251-1jammy [2,173 kB] 2023-12-18T10:13:43.930 INFO:teuthology.orchestra.run.smithi133.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-1372-g8688b251-1jammy [235 kB] 2023-12-18T10:13:44.113 INFO:teuthology.orchestra.run.smithi133.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-1372-g8688b251-1jammy [138 kB] 2023-12-18T10:13:44.227 INFO:teuthology.orchestra.run.smithi133.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-1372-g8688b251-1jammy [1,898 kB] 2023-12-18T10:13:45.828 INFO:teuthology.orchestra.run.smithi133.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1372-g8688b251-1jammy [8,625 kB] 2023-12-18T10:13:50.184 INFO:teuthology.orchestra.run.smithi142.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-1372-g8688b251-1jammy [14.1 kB] 2023-12-18T10:13:50.184 INFO:teuthology.orchestra.run.smithi142.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-1372-g8688b251-1jammy [824 kB] 2023-12-18T10:13:50.669 INFO:teuthology.orchestra.run.smithi142.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-1372-g8688b251-1jammy [2,173 kB] 2023-12-18T10:13:51.827 INFO:teuthology.orchestra.run.smithi142.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-1372-g8688b251-1jammy [235 kB] 2023-12-18T10:13:51.928 INFO:teuthology.orchestra.run.smithi142.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-1372-g8688b251-1jammy [138 kB] 2023-12-18T10:13:51.996 INFO:teuthology.orchestra.run.smithi142.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-1372-g8688b251-1jammy [1,898 kB] 2023-12-18T10:13:52.924 INFO:teuthology.orchestra.run.smithi142.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1372-g8688b251-1jammy [8,625 kB] 2023-12-18T10:13:55.873 INFO:teuthology.orchestra.run.smithi133.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-1372-g8688b251-1jammy [14.2 kB] 2023-12-18T10:13:55.874 INFO:teuthology.orchestra.run.smithi133.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-1372-g8688b251-1jammy [46.4 MB] 2023-12-18T10:13:58.102 INFO:teuthology.orchestra.run.smithi142.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-1372-g8688b251-1jammy [14.2 kB] 2023-12-18T10:13:58.112 INFO:teuthology.orchestra.run.smithi142.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-1372-g8688b251-1jammy [46.4 MB] 2023-12-18T10:14:29.841 INFO:teuthology.orchestra.run.smithi133.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-1372-g8688b251-1jammy [121 kB] 2023-12-18T10:14:29.903 INFO:teuthology.orchestra.run.smithi133.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-1372-g8688b251-1jammy [228 kB] 2023-12-18T10:14:30.022 INFO:teuthology.orchestra.run.smithi133.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-1372-g8688b251-1jammy [34.0 kB] 2023-12-18T10:14:30.049 INFO:teuthology.orchestra.run.smithi133.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-1372-g8688b251-1jammy [23.3 kB] 2023-12-18T10:14:30.068 INFO:teuthology.orchestra.run.smithi133.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-1372-g8688b251-1jammy [38.3 kB] 2023-12-18T10:14:30.078 INFO:teuthology.orchestra.run.smithi133.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-1372-g8688b251-1jammy [11.6 MB] 2023-12-18T10:14:30.542 INFO:teuthology.orchestra.run.smithi142.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-1372-g8688b251-1jammy [121 kB] 2023-12-18T10:14:30.713 INFO:teuthology.orchestra.run.smithi142.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-1372-g8688b251-1jammy [228 kB] 2023-12-18T10:14:31.003 INFO:teuthology.orchestra.run.smithi142.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-1372-g8688b251-1jammy [34.0 kB] 2023-12-18T10:14:31.038 INFO:teuthology.orchestra.run.smithi142.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-1372-g8688b251-1jammy [23.3 kB] 2023-12-18T10:14:31.071 INFO:teuthology.orchestra.run.smithi142.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-1372-g8688b251-1jammy [38.3 kB] 2023-12-18T10:14:31.114 INFO:teuthology.orchestra.run.smithi142.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-1372-g8688b251-1jammy [11.6 MB] 2023-12-18T10:14:36.103 INFO:teuthology.orchestra.run.smithi133.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-1372-g8688b251-1jammy [92.9 kB] 2023-12-18T10:14:36.744 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 181 MB in 1min 59s (1,524 kB/s) 2023-12-18T10:14:36.890 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-18T10:14:36.959 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-18T10:14:36.963 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-18T10:14:37.006 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-18T10:14:37.308 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-18T10:14:37.321 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-18T10:14:37.366 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-18T10:14:37.638 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cmd2. 2023-12-18T10:14:37.651 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-18T10:14:37.705 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-18T10:14:37.982 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfmt8:amd64. 2023-12-18T10:14:37.996 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-12-18T10:14:38.074 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-18T10:14:38.427 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-18T10:14:38.440 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-18T10:14:38.485 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-18T10:14:38.542 INFO:teuthology.orchestra.run.smithi142.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef/8688b2517b6002b804a4844986e6ed5ce973d99f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-1372-g8688b251-1jammy [92.9 kB] 2023-12-18T10:14:38.822 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-18T10:14:38.835 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-18T10:14:38.880 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-18T10:14:39.151 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 181 MB in 2min 1s (1,492 kB/s) 2023-12-18T10:14:39.225 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-18T10:14:39.238 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-18T10:14:39.272 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-18T10:14:39.283 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-18T10:14:39.340 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-18T10:14:39.344 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-18T10:14:39.379 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-18T10:14:39.653 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-18T10:14:39.667 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-18T10:14:39.673 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-18T10:14:39.687 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-18T10:14:39.710 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:14:39.723 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-18T10:14:40.051 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cmd2. 2023-12-18T10:14:40.065 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-18T10:14:40.109 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-18T10:14:40.114 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-18T10:14:40.128 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-18T10:14:40.172 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:14:40.445 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libfmt8:amd64. 2023-12-18T10:14:40.459 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-12-18T10:14:40.509 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-18T10:14:40.522 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-18T10:14:40.546 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-18T10:14:40.567 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:14:40.848 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-18T10:14:40.863 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-18T10:14:40.899 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-18T10:14:40.911 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-18T10:14:40.925 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-18T10:14:40.953 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-18T10:14:41.210 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-18T10:14:41.225 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-18T10:14:41.248 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librados2. 2023-12-18T10:14:41.261 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../011-librados2_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:41.268 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-18T10:14:41.306 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:41.596 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-18T10:14:41.611 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-18T10:14:41.655 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-18T10:14:41.725 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librbd1. 2023-12-18T10:14:41.739 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../012-librbd1_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:41.784 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:42.116 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-18T10:14:42.132 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-18T10:14:42.174 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:14:42.228 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2. 2023-12-18T10:14:42.241 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:42.294 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:42.547 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rados. 2023-12-18T10:14:42.560 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../014-python3-rados_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:42.561 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-18T10:14:42.576 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-18T10:14:42.597 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rados (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:42.619 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:14:42.916 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-18T10:14:42.930 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:14:42.956 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-18T10:14:42.966 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-argparse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:42.970 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-18T10:14:43.014 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:14:43.210 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cephfs. 2023-12-18T10:14:43.224 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:43.268 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cephfs (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:43.384 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-18T10:14:43.399 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-18T10:14:43.434 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-18T10:14:43.605 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-18T10:14:43.618 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:14:43.663 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-common (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:43.728 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librados2. 2023-12-18T10:14:43.744 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../011-librados2_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:43.786 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librados2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:43.966 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-prettytable. 2023-12-18T10:14:43.979 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-12-18T10:14:44.024 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-18T10:14:44.198 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librbd1. 2023-12-18T10:14:44.213 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../012-librbd1_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:44.251 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rbd. 2023-12-18T10:14:44.256 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librbd1 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:44.265 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:44.326 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rbd (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:44.637 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-18T10:14:44.651 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-18T10:14:44.704 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-18T10:14:44.817 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs2. 2023-12-18T10:14:44.832 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:44.900 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:45.057 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2. 2023-12-18T10:14:45.070 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../021-librgw2_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:45.115 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:45.161 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rados. 2023-12-18T10:14:45.176 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../014-python3-rados_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:45.211 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rados (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:45.505 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-18T10:14:45.520 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:14:45.559 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rgw. 2023-12-18T10:14:45.563 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-argparse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:45.572 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:45.617 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rgw (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:45.799 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cephfs. 2023-12-18T10:14:45.814 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:45.857 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cephfs (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:45.945 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-18T10:14:45.958 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-18T10:14:46.012 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-18T10:14:46.177 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-18T10:14:46.192 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:14:46.235 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-common (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:46.281 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1. 2023-12-18T10:14:46.295 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:46.339 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:46.555 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-prettytable. 2023-12-18T10:14:46.570 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-12-18T10:14:46.604 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-18T10:14:46.784 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common. 2023-12-18T10:14:46.798 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../025-ceph-common_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:46.815 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rbd. 2023-12-18T10:14:46.830 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:46.842 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:46.873 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rbd (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:47.218 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-18T10:14:47.233 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-18T10:14:47.277 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-18T10:14:47.596 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librgw2. 2023-12-18T10:14:47.611 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../021-librgw2_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:47.654 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librgw2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:47.831 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-base. 2023-12-18T10:14:47.845 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../026-ceph-base_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:47.890 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-base (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:48.115 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rgw. 2023-12-18T10:14:48.130 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:48.165 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rgw (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:48.476 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-18T10:14:48.491 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-18T10:14:48.543 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-18T10:14:48.719 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-18T10:14:48.733 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-18T10:14:48.777 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-18T10:14:48.845 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libradosstriper1. 2023-12-18T10:14:48.861 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:48.904 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libradosstriper1 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:49.063 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cheroot. 2023-12-18T10:14:49.077 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-18T10:14:49.121 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-18T10:14:49.324 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-common. 2023-12-18T10:14:49.338 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../025-ceph-common_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:49.373 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-common (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:49.445 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-18T10:14:49.459 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-18T10:14:49.507 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-18T10:14:49.810 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-18T10:14:49.824 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-18T10:14:49.868 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-18T10:14:50.213 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-18T10:14:50.227 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-18T10:14:50.271 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-18T10:14:50.487 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-base. 2023-12-18T10:14:50.501 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../026-ceph-base_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:14:50.546 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-base (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:50.607 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempora. 2023-12-18T10:14:50.621 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-12-18T10:14:50.665 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-18T10:14:51.018 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-portend. 2023-12-18T10:14:51.032 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-12-18T10:14:51.076 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-18T10:14:51.225 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-18T10:14:51.238 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-18T10:14:51.283 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-18T10:14:51.387 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-18T10:14:51.402 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-18T10:14:51.445 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-18T10:14:51.586 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cheroot. 2023-12-18T10:14:51.600 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-18T10:14:51.644 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-18T10:14:51.748 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-18T10:14:51.762 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-18T10:14:51.807 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-18T10:14:51.956 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-18T10:14:51.970 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-18T10:14:52.005 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-18T10:14:52.152 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-natsort. 2023-12-18T10:14:52.165 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-12-18T10:14:52.210 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-18T10:14:52.250 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-18T10:14:52.264 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-18T10:14:52.300 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-18T10:14:52.538 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-logutils. 2023-12-18T10:14:52.552 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-12-18T10:14:52.596 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-18T10:14:52.636 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-18T10:14:52.651 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-18T10:14:52.694 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-18T10:14:52.865 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-18T10:14:52.879 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-18T10:14:52.915 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-18T10:14:52.997 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempora. 2023-12-18T10:14:53.012 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-12-18T10:14:53.055 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-18T10:14:53.243 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-mako. 2023-12-18T10:14:53.257 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-18T10:14:53.301 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-18T10:14:53.333 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-portend. 2023-12-18T10:14:53.349 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-12-18T10:14:53.392 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-18T10:14:53.630 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-18T10:14:53.644 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-18T10:14:53.686 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-18T10:14:53.687 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-18T10:14:53.701 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-18T10:14:53.744 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-18T10:14:54.015 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-18T10:14:54.029 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-18T10:14:54.047 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-18T10:14:54.062 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-18T10:14:54.073 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-18T10:14:54.122 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-18T10:14:54.359 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webob. 2023-12-18T10:14:54.374 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-18T10:14:54.409 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-18T10:14:54.434 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-natsort. 2023-12-18T10:14:54.448 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-12-18T10:14:54.492 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-18T10:14:54.737 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-waitress. 2023-12-18T10:14:54.751 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-18T10:14:54.798 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-18T10:14:54.803 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-logutils. 2023-12-18T10:14:54.818 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-12-18T10:14:54.861 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-18T10:14:55.115 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempita. 2023-12-18T10:14:55.129 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-18T10:14:55.164 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-18T10:14:55.173 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-18T10:14:55.179 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-18T10:14:55.223 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-18T10:14:55.484 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-mako. 2023-12-18T10:14:55.498 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-18T10:14:55.518 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-paste. 2023-12-18T10:14:55.532 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-18T10:14:55.533 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-18T10:14:55.576 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-18T10:14:55.845 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-18T10:14:55.861 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-18T10:14:55.887 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-18T10:14:55.901 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-18T10:14:55.903 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-18T10:14:55.945 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-18T10:14:56.190 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-18T10:14:56.205 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-18T10:14:56.247 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-18T10:14:56.273 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-18T10:14:56.287 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-18T10:14:56.332 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-18T10:14:56.534 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webob. 2023-12-18T10:14:56.549 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-18T10:14:56.591 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-18T10:14:56.618 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webtest. 2023-12-18T10:14:56.632 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-12-18T10:14:56.684 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-18T10:14:56.903 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-waitress. 2023-12-18T10:14:56.918 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-18T10:14:56.956 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-18T10:14:57.087 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pecan. 2023-12-18T10:14:57.101 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-18T10:14:57.162 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-18T10:14:57.264 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempita. 2023-12-18T10:14:57.279 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-18T10:14:57.322 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-18T10:14:57.583 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-certifi. 2023-12-18T10:14:57.597 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-12-18T10:14:57.633 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-paste. 2023-12-18T10:14:57.649 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-18T10:14:57.649 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-18T10:14:57.692 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-18T10:14:58.004 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-18T10:14:58.019 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-18T10:14:58.044 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-idna. 2023-12-18T10:14:58.058 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-12-18T10:14:58.061 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-18T10:14:58.102 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-18T10:14:58.365 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-18T10:14:58.380 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-18T10:14:58.422 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-18T10:14:58.447 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-urllib3. 2023-12-18T10:14:58.460 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-18T10:14:58.505 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-18T10:14:58.759 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webtest. 2023-12-18T10:14:58.774 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-12-18T10:14:58.809 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-18T10:14:58.841 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests. 2023-12-18T10:14:58.855 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-18T10:14:58.900 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-18T10:14:59.078 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pecan. 2023-12-18T10:14:59.093 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-18T10:14:59.128 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-18T10:14:59.253 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-18T10:14:59.266 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-18T10:14:59.311 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-18T10:14:59.416 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-certifi. 2023-12-18T10:14:59.431 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-12-18T10:14:59.466 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-18T10:14:59.589 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-18T10:14:59.602 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:14:59.647 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:14:59.786 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-idna. 2023-12-18T10:14:59.801 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-12-18T10:14:59.844 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-18T10:15:00.060 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-18T10:15:00.073 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:00.118 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:00.138 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-urllib3. 2023-12-18T10:15:00.153 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-18T10:15:00.188 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-18T10:15:00.396 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-openssl. 2023-12-18T10:15:00.409 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-18T10:15:00.454 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-18T10:15:00.475 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-requests. 2023-12-18T10:15:00.490 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-18T10:15:00.524 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-18T10:15:00.790 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr. 2023-12-18T10:15:00.804 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:00.827 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-18T10:15:00.842 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-18T10:15:00.848 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:00.886 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-18T10:15:01.138 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-18T10:15:01.153 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:01.188 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:01.251 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon. 2023-12-18T10:15:01.265 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:01.310 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:01.577 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-18T10:15:01.591 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:01.634 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:01.921 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-openssl. 2023-12-18T10:15:01.936 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-18T10:15:01.980 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-18T10:15:02.105 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd. 2023-12-18T10:15:02.120 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:02.155 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:02.324 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr. 2023-12-18T10:15:02.339 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:02.382 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:02.702 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mon. 2023-12-18T10:15:02.716 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:02.760 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mon (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:03.317 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph. 2023-12-18T10:15:03.332 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../061-ceph_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:03.374 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:03.563 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-osd. 2023-12-18T10:15:03.578 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:03.622 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-osd (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:03.719 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse. 2023-12-18T10:15:03.734 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:03.777 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:04.139 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds. 2023-12-18T10:15:04.153 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:04.188 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:04.550 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephadm. 2023-12-18T10:15:04.565 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../064-cephadm_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:04.608 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephadm (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:04.767 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph. 2023-12-18T10:15:04.782 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../061-ceph_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:04.850 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:04.919 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-18T10:15:04.935 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-18T10:15:04.977 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-18T10:15:05.136 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-fuse. 2023-12-18T10:15:05.151 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:05.186 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-fuse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:05.297 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-18T10:15:05.311 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-18T10:15:05.355 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-18T10:15:05.514 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mds. 2023-12-18T10:15:05.529 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:05.572 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mds (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:05.925 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephadm. 2023-12-18T10:15:05.940 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../064-cephadm_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:05.983 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephadm (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:06.278 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-18T10:15:06.293 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-18T10:15:06.310 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-babel. 2023-12-18T10:15:06.324 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-18T10:15:06.328 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-18T10:15:06.401 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-18T10:15:06.672 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-18T10:15:06.688 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-18T10:15:06.704 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jinja2. 2023-12-18T10:15:06.718 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-18T10:15:06.730 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-18T10:15:06.754 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-18T10:15:07.074 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-18T10:15:07.088 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:07.124 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:07.444 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-18T10:15:07.458 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-18T10:15:07.504 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-18T10:15:07.694 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-babel. 2023-12-18T10:15:07.708 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-18T10:15:07.760 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-18T10:15:07.813 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pluggy. 2023-12-18T10:15:07.827 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-18T10:15:07.872 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-18T10:15:08.105 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jinja2. 2023-12-18T10:15:08.119 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-18T10:15:08.163 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-18T10:15:08.233 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-py. 2023-12-18T10:15:08.247 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-12-18T10:15:08.291 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-18T10:15:08.508 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-18T10:15:08.522 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:08.566 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:08.619 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-18T10:15:08.633 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-18T10:15:08.677 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-18T10:15:08.886 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-18T10:15:08.900 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-18T10:15:08.944 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-18T10:15:09.013 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-toml. 2023-12-18T10:15:09.028 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-12-18T10:15:09.063 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-18T10:15:09.189 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pluggy. 2023-12-18T10:15:09.203 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-18T10:15:09.239 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-18T10:15:09.333 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pytest. 2023-12-18T10:15:09.348 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-18T10:15:09.391 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-18T10:15:09.567 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-py. 2023-12-18T10:15:09.582 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-12-18T10:15:09.625 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-18T10:15:09.745 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-18T10:15:09.759 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-12-18T10:15:09.803 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-18T10:15:09.954 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-18T10:15:09.969 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-18T10:15:10.089 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-routes. 2023-12-18T10:15:10.103 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-18T10:15:10.147 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-18T10:15:10.203 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-18T10:15:10.489 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-toml. 2023-12-18T10:15:10.504 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-12-18T10:15:10.509 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-18T10:15:10.523 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:10.548 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-18T10:15:10.567 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:10.800 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pytest. 2023-12-18T10:15:10.816 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-18T10:15:10.850 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-18T10:15:11.003 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-18T10:15:11.017 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-18T10:15:11.061 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-18T10:15:11.221 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-18T10:15:11.237 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-12-18T10:15:11.279 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-18T10:15:11.540 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-routes. 2023-12-18T10:15:11.548 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-joblib. 2023-12-18T10:15:11.555 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-18T10:15:11.562 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-18T10:15:11.590 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-18T10:15:11.606 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-18T10:15:11.876 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-18T10:15:11.891 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:11.926 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:11.993 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-18T10:15:12.007 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-18T10:15:12.051 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-18T10:15:12.320 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn. 2023-12-18T10:15:12.334 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-18T10:15:12.340 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-18T10:15:12.354 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-18T10:15:12.398 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-18T10:15:12.404 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-18T10:15:12.868 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-joblib. 2023-12-18T10:15:12.883 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-18T10:15:12.918 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-18T10:15:13.089 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-18T10:15:13.103 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:13.172 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:13.280 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-18T10:15:13.294 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-18T10:15:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-18T10:15:13.633 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn. 2023-12-18T10:15:13.648 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-18T10:15:13.682 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-18T10:15:14.134 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cachetools. 2023-12-18T10:15:14.149 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-12-18T10:15:14.191 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-18T10:15:14.434 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-18T10:15:14.448 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:14.469 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-18T10:15:14.483 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:14.485 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-18T10:15:14.519 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-18T10:15:14.875 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-18T10:15:14.891 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-18T10:15:14.933 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-18T10:15:15.227 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rsa. 2023-12-18T10:15:15.243 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-12-18T10:15:15.286 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-18T10:15:15.504 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cachetools. 2023-12-18T10:15:15.519 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-12-18T10:15:15.562 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-18T10:15:15.631 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-google-auth. 2023-12-18T10:15:15.646 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-12-18T10:15:15.689 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-18T10:15:15.873 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-18T10:15:15.889 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-18T10:15:15.931 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-18T10:15:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-18T10:15:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-18T10:15:16.092 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-18T10:15:16.218 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-18T10:15:16.234 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-18T10:15:16.276 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-18T10:15:16.387 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-websocket. 2023-12-18T10:15:16.402 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-12-18T10:15:16.445 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-18T10:15:16.562 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rsa. 2023-12-18T10:15:16.578 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-12-18T10:15:16.629 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-18T10:15:16.765 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-18T10:15:16.780 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-18T10:15:16.856 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-18T10:15:16.933 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-google-auth. 2023-12-18T10:15:16.948 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-12-18T10:15:16.991 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-18T10:15:17.336 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-18T10:15:17.351 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-18T10:15:17.394 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-18T10:15:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-18T10:15:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:17.680 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-websocket. 2023-12-18T10:15:17.695 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-12-18T10:15:17.730 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-18T10:15:17.906 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-18T10:15:17.920 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-18T10:15:17.964 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-18T10:15:17.992 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-18T10:15:18.007 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-18T10:15:18.041 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-18T10:15:18.309 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-18T10:15:18.323 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-18T10:15:18.367 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-18T10:15:18.611 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package jq. 2023-12-18T10:15:18.625 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-18T10:15:18.669 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-18T10:15:18.680 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-18T10:15:18.694 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:18.738 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:18.922 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package socat. 2023-12-18T10:15:18.936 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-18T10:15:18.980 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-18T10:15:19.091 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-18T10:15:19.105 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-18T10:15:19.149 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-18T10:15:19.427 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-18T10:15:19.441 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-18T10:15:19.477 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-18T10:15:19.500 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package xmlstarlet. 2023-12-18T10:15:19.515 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-18T10:15:19.558 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-18T10:15:19.721 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package jq. 2023-12-18T10:15:19.736 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-18T10:15:19.788 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-18T10:15:19.929 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test. 2023-12-18T10:15:19.943 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../098-ceph-test_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:19.987 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:20.041 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package socat. 2023-12-18T10:15:20.056 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-18T10:15:20.099 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-18T10:15:20.410 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package xmlstarlet. 2023-12-18T10:15:20.426 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-18T10:15:20.468 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-18T10:15:20.823 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-test. 2023-12-18T10:15:20.837 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../098-ceph-test_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:20.881 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-test (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:21.683 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-volume. 2023-12-18T10:15:21.699 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:21.741 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-volume (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:22.120 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-18T10:15:22.136 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:22.195 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-mirror (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:22.490 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-colorama. 2023-12-18T10:15:22.505 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-12-18T10:15:22.548 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-18T10:15:22.602 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-volume. 2023-12-18T10:15:22.617 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:22.660 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-volume (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:22.809 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-shell. 2023-12-18T10:15:22.825 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:22.892 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-shell (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:22.989 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-18T10:15:23.005 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:23.039 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-mirror (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:23.145 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-top. 2023-12-18T10:15:23.161 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:23.203 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-top (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:23.350 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-colorama. 2023-12-18T10:15:23.366 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-12-18T10:15:23.433 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-18T10:15:23.456 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-18T10:15:23.471 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:23.514 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs-dev (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:23.703 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-shell. 2023-12-18T10:15:23.718 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:23.761 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-shell (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:23.884 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package nvme-cli. 2023-12-18T10:15:23.900 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-18T10:15:23.942 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-18T10:15:24.014 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephfs-top. 2023-12-18T10:15:24.029 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-1372-g8688b251-1jammy_all.deb ... 2023-12-18T10:15:24.073 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephfs-top (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:24.272 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-18T10:15:24.276 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-18T10:15:24.287 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-18T10:15:24.290 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:24.324 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs-dev (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:24.329 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-18T10:15:24.652 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package nvme-cli. 2023-12-18T10:15:24.668 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-18T10:15:24.710 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-18T10:15:24.800 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastescript. 2023-12-18T10:15:24.815 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-12-18T10:15:24.858 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-18T10:15:25.074 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-18T10:15:25.088 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-18T10:15:25.140 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-18T10:15:25.211 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-psutil. 2023-12-18T10:15:25.226 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-18T10:15:25.269 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-18T10:15:25.547 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pygments. 2023-12-18T10:15:25.562 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-18T10:15:25.597 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-18T10:15:25.768 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastescript. 2023-12-18T10:15:25.785 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-12-18T10:15:25.826 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-18T10:15:26.121 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-18T10:15:26.133 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-18T10:15:26.138 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-psutil. 2023-12-18T10:15:26.152 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-18T10:15:26.176 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-18T10:15:26.204 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-18T10:15:26.446 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplejson. 2023-12-18T10:15:26.460 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-18T10:15:26.496 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-18T10:15:26.582 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pygments. 2023-12-18T10:15:26.597 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-18T10:15:26.640 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-18T10:15:26.774 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-18T10:15:26.788 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-18T10:15:26.832 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-18T10:15:27.086 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-18T10:15:27.100 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-18T10:15:27.145 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-18T10:15:27.414 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplejson. 2023-12-18T10:15:27.428 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-18T10:15:27.463 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-18T10:15:27.536 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw. 2023-12-18T10:15:27.550 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../113-radosgw_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:27.594 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:27.691 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-18T10:15:27.706 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-18T10:15:27.741 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-18T10:15:28.139 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse. 2023-12-18T10:15:28.153 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:28.189 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:28.462 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package radosgw. 2023-12-18T10:15:28.476 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../113-radosgw_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:28.480 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-18T10:15:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking radosgw (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:28.743 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-18T10:15:28.886 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-18T10:15:29.081 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package rbd-fuse. 2023-12-18T10:15:29.095 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-1372-g8688b251-1jammy_amd64.deb ... 2023-12-18T10:15:29.126 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-18T10:15:29.139 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking rbd-fuse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:29.407 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-18T10:15:29.527 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-18T10:15:29.702 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-18T10:15:29.828 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-18T10:15:30.068 INFO:teuthology.orchestra.run.smithi133.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-18T10:15:30.090 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-18T10:15:30.116 INFO:teuthology.orchestra.run.smithi133.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-18T10:15:30.154 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephadm (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:30.519 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-18T10:15:30.725 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user cephadm....done 2023-12-18T10:15:30.852 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-18T10:15:31.131 INFO:teuthology.orchestra.run.smithi142.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-18T10:15:31.165 INFO:teuthology.orchestra.run.smithi142.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-18T10:15:31.170 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-18T10:15:31.230 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephadm (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:31.438 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-18T10:15:31.564 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-18T10:15:31.750 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user cephadm....done 2023-12-18T10:15:31.832 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-18T10:15:31.910 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-18T10:15:32.100 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-18T10:15:32.186 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-18T10:15:32.226 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-18T10:15:32.438 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-18T10:15:32.535 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-18T10:15:32.547 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-18T10:15:32.798 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-18T10:15:32.904 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-18T10:15:33.066 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-18T10:15:33.164 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-18T10:15:33.175 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-18T10:15:33.448 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-18T10:15:33.485 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-18T10:15:33.741 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-18T10:15:33.854 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-18T10:15:34.000 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-18T10:15:34.113 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-18T10:15:34.251 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-18T10:15:34.389 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-18T10:15:34.513 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-argparse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:34.657 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-18T10:15:34.779 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-18T10:15:34.905 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-18T10:15:34.917 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-18T10:15:35.172 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-18T10:15:35.193 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-18T10:15:35.452 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-argparse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:35.457 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-18T10:15:35.566 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-18T10:15:35.720 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-18T10:15:35.871 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-18T10:15:35.926 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-18T10:15:36.052 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-18T10:15:36.130 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-18T10:15:36.320 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-18T10:15:36.373 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-18T10:15:36.499 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-18T10:15:36.587 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-18T10:15:36.859 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-18T10:15:36.938 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-18T10:15:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-18T10:15:37.261 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-18T10:15:37.573 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-18T10:15:37.657 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-18T10:15:37.871 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-18T10:15:37.917 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-18T10:15:38.017 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-18T10:15:38.126 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-18T10:15:38.436 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-18T10:15:38.548 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-18T10:15:38.816 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-18T10:15:38.820 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-18T10:15:38.967 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-18T10:15:39.080 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-18T10:15:39.093 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-18T10:15:39.410 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-18T10:15:39.507 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-18T10:15:39.808 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-18T10:15:39.812 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-18T10:15:40.063 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-18T10:15:40.142 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-18T10:15:40.448 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-18T10:15:40.485 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-18T10:15:40.749 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-18T10:15:40.778 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-18T10:15:40.904 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-common (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:41.067 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-18T10:15:41.205 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-idna (3.3-1) ... 2023-12-18T10:15:41.418 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-18T10:15:41.557 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-18T10:15:41.686 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-18T10:15:41.795 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-common (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:42.080 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-idna (3.3-1) ... 2023-12-18T10:15:42.406 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-18T10:15:42.812 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:15:42.946 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-18T10:15:43.222 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-18T10:15:43.348 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-18T10:15:43.450 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-18T10:15:43.637 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:15:43.754 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-18T10:15:43.767 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-18T10:15:44.006 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-18T10:15:44.035 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-18T10:15:44.117 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-18T10:15:44.216 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-18T10:15:44.294 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:15:44.420 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-18T10:15:44.517 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-18T10:15:44.546 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-18T10:15:44.785 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-18T10:15:44.865 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-18T10:15:45.062 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:15:45.116 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-18T10:15:45.170 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-18T10:15:45.280 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-18T10:15:45.383 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-18T10:15:45.573 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-18T10:15:45.651 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-18T10:15:45.816 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-18T10:15:45.952 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-18T10:15:46.092 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-18T10:15:46.220 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-18T10:15:46.345 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-18T10:15:46.368 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-18T10:15:46.630 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-18T10:15:46.636 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-18T10:15:46.756 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-18T10:15:46.911 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-18T10:15:47.037 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-18T10:15:47.049 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-18T10:15:47.322 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-18T10:15:47.342 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-18T10:15:47.431 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-18T10:15:47.610 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-18T10:15:47.707 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-18T10:15:48.017 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-18T10:15:48.036 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-18T10:15:48.301 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-18T10:15:48.304 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-18T10:15:48.430 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-18T10:15:48.664 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-18T10:15:48.832 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-18T10:15:48.913 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-18T10:15:49.030 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-18T10:15:49.133 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-18T10:15:49.375 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:15:49.415 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-18T10:15:49.526 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-18T10:15:49.708 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-18T10:15:49.837 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-18T10:15:49.967 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-18T10:15:50.093 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-18T10:15:50.419 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-18T10:15:50.495 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-18T10:15:50.721 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-18T10:15:50.779 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-18T10:15:50.947 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-18T10:15:50.988 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-18T10:15:51.106 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-18T10:15:51.223 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-18T10:15:51.415 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-18T10:15:51.483 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-18T10:15:51.692 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-18T10:15:51.767 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-18T10:15:51.968 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-18T10:15:52.152 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-18T10:15:52.352 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-18T10:15:52.454 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-18T10:15:52.645 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-18T10:15:52.813 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-18T10:15:52.948 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.023 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-18T10:15:53.074 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.123 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librados2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.241 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librgw2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.285 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.411 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.444 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.537 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.570 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs2 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.663 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-18T10:15:53.705 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libradosstriper1 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:53.814 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-18T10:15:53.957 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:54.058 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-modules-core (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:54.082 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librbd1 (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:54.176 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:54.200 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-modules-core (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:54.359 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-fuse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:54.385 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-18T10:15:54.385 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-18T10:15:54.607 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-18T10:15:54.607 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-18T10:15:54.977 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs-dev (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:55.103 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rados (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:55.229 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-top (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:55.244 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs-dev (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:55.345 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rados (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:55.397 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-18T10:15:55.446 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-top (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:55.564 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-18T10:15:56.676 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rbd (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:56.806 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:56.860 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rbd (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:56.937 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rgw (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:56.969 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up rbd-fuse (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:57.070 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rgw (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:57.071 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cephfs (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:57.171 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cephfs (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:57.197 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-shell (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:57.280 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-shell (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:57.332 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:57.431 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-common (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:57.902 INFO:teuthology.orchestra.run.smithi133.stdout:Adding group ceph....done 2023-12-18T10:15:57.943 INFO:teuthology.orchestra.run.smithi142.stdout:Adding group ceph....done 2023-12-18T10:15:58.279 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user ceph....done 2023-12-18T10:15:58.303 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user ceph....done 2023-12-18T10:15:58.441 INFO:teuthology.orchestra.run.smithi133.stdout:Setting system user ceph properties....done 2023-12-18T10:15:58.460 INFO:teuthology.orchestra.run.smithi133.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-18T10:15:58.465 INFO:teuthology.orchestra.run.smithi142.stdout:Setting system user ceph properties....done 2023-12-18T10:15:58.485 INFO:teuthology.orchestra.run.smithi142.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-18T10:15:58.601 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-18T10:15:58.626 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-18T10:15:58.979 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-18T10:15:58.985 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-18T10:15:59.691 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-mirror (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:59.701 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephfs-mirror (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:15:59.925 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-18T10:15:59.925 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-18T10:15:59.985 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-18T10:15:59.985 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-18T10:16:00.568 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:00.636 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-test (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:00.677 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:00.761 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up radosgw (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:01.218 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-18T10:16:01.218 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-18T10:16:01.316 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-18T10:16:01.316 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-18T10:16:01.812 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-base (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:01.938 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-base (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:02.203 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-18T10:16:02.311 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-18T10:16:02.847 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:02.957 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mds (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:03.078 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-18T10:16:03.078 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-18T10:16:03.180 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-18T10:16:03.180 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-18T10:16:03.707 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:03.800 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:03.922 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-18T10:16:03.923 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-18T10:16:04.021 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-18T10:16:04.021 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-18T10:16:04.584 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:04.676 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-osd (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:04.903 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-18T10:16:04.903 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-18T10:16:04.985 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-18T10:16:04.985 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-18T10:16:05.552 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:05.620 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:05.703 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:05.721 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:05.847 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mon (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:05.854 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:06.055 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-18T10:16:06.055 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-18T10:16:06.075 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-18T10:16:06.075 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-18T10:16:06.681 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-cephadm (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:06.707 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-cephadm (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:06.798 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:06.833 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:06.899 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dashboard (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:06.959 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-dashboard (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:07.042 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-volume (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:07.102 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-volume (18.2.0-1372-g8688b251-1jammy) ... 2023-12-18T10:16:07.420 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-18T10:16:07.455 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-18T10:16:08.597 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-18T10:16:08.605 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-18T10:16:09.048 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-18T10:16:09.052 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-18T10:16:09.082 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-18T10:16:09.087 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-18T10:16:09.127 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2023-12-18T10:16:09.161 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-12-18T10:16:09.295 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2023-12-18T10:16:09.296 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2023-12-18T10:16:09.329 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-12-18T10:16:09.330 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-12-18T10:16:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-18T10:16:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-18T10:16:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-18T10:16:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-18T10:16:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-18T10:16:09.447 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2023-12-18T10:16:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-18T10:16:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-18T10:16:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-18T10:16:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-18T10:16:09.448 INFO:teuthology.orchestra.run.smithi142.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-18T10:16:09.448 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-18T10:16:09.449 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2023-12-18T10:16:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-18T10:16:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-18T10:16:09.449 INFO:teuthology.orchestra.run.smithi142.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-18T10:16:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-18T10:16:09.450 INFO:teuthology.orchestra.run.smithi142.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-18T10:16:09.450 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2023-12-18T10:16:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-18T10:16:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-18T10:16:09.451 INFO:teuthology.orchestra.run.smithi142.stdout: libengine-pkcs11-openssl 2023-12-18T10:16:09.482 INFO:teuthology.orchestra.run.smithi133.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-18T10:16:09.482 INFO:teuthology.orchestra.run.smithi133.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-18T10:16:09.482 INFO:teuthology.orchestra.run.smithi133.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-18T10:16:09.482 INFO:teuthology.orchestra.run.smithi133.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-18T10:16:09.482 INFO:teuthology.orchestra.run.smithi133.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-18T10:16:09.482 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-12-18T10:16:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-18T10:16:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-18T10:16:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-18T10:16:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-18T10:16:09.483 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-18T10:16:09.483 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-18T10:16:09.484 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-12-18T10:16:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-18T10:16:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-18T10:16:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-18T10:16:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-18T10:16:09.484 INFO:teuthology.orchestra.run.smithi133.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-18T10:16:09.486 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-12-18T10:16:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-18T10:16:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-18T10:16:09.486 INFO:teuthology.orchestra.run.smithi133.stdout: libengine-pkcs11-openssl 2023-12-18T10:16:09.499 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2023-12-18T10:16:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-18T10:16:09.500 INFO:teuthology.orchestra.run.smithi142.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-18T10:16:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-18T10:16:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-18T10:16:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-18T10:16:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-18T10:16:09.501 INFO:teuthology.orchestra.run.smithi142.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-18T10:16:09.502 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2023-12-18T10:16:09.502 INFO:teuthology.orchestra.run.smithi142.stdout: libssl3 2023-12-18T10:16:09.535 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-12-18T10:16:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-18T10:16:09.535 INFO:teuthology.orchestra.run.smithi133.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-18T10:16:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-18T10:16:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-18T10:16:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-18T10:16:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-18T10:16:09.536 INFO:teuthology.orchestra.run.smithi133.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-18T10:16:09.537 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-12-18T10:16:09.538 INFO:teuthology.orchestra.run.smithi133.stdout: libssl3 2023-12-18T10:16:09.563 INFO:teuthology.orchestra.run.smithi142.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-18T10:16:09.563 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 54.6 MB of archives. 2023-12-18T10:16:09.563 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-18T10:16:09.563 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-18T10:16:09.684 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-18T10:16:09.722 INFO:teuthology.orchestra.run.smithi133.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-18T10:16:09.722 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 54.6 MB of archives. 2023-12-18T10:16:09.723 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-18T10:16:09.723 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-18T10:16:09.748 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-18T10:16:09.757 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-18T10:16:09.758 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-18T10:16:09.759 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-18T10:16:09.761 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-18T10:16:09.761 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-18T10:16:09.762 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-18T10:16:09.763 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-18T10:16:09.763 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-18T10:16:09.769 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-18T10:16:09.784 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-18T10:16:10.015 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-18T10:16:10.017 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-18T10:16:10.017 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-18T10:16:10.020 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-18T10:16:10.020 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-18T10:16:10.024 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-18T10:16:10.026 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-18T10:16:10.033 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-18T10:16:10.033 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-18T10:16:10.055 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-18T10:16:10.055 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-18T10:16:10.065 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-18T10:16:10.086 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-18T10:16:10.090 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-18T10:16:10.090 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-18T10:16:10.091 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-18T10:16:10.091 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-18T10:16:10.103 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-18T10:16:10.104 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-18T10:16:10.217 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-18T10:16:10.258 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-18T10:16:10.258 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-18T10:16:10.258 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-18T10:16:10.258 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-18T10:16:10.259 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-18T10:16:10.259 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-18T10:16:10.272 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-18T10:16:10.272 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-18T10:16:10.475 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-18T10:16:10.510 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-18T10:16:10.512 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-18T10:16:10.517 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-18T10:16:10.545 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-18T10:16:10.545 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-18T10:16:10.545 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-18T10:16:10.545 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-18T10:16:10.651 INFO:teuthology.orchestra.run.smithi142.stdout:Preconfiguring packages ... 2023-12-18T10:16:10.707 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-18T10:16:10.707 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-18T10:16:10.795 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 54.6 MB in 1s (71.6 MB/s) 2023-12-18T10:16:10.937 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package flex. 2023-12-18T10:16:10.972 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-18T10:16:11.008 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-12-18T10:16:11.012 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-18T10:16:11.052 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-18T10:16:11.698 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-18T10:16:11.867 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-18T10:16:12.005 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-18T10:16:12.007 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-18T10:16:12.007 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-18T10:16:12.009 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-18T10:16:12.010 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-18T10:16:12.014 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-18T10:16:12.016 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-18T10:16:12.039 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-18T10:16:12.204 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-18T10:16:12.256 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-18T10:16:12.801 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package bison. 2023-12-18T10:16:12.874 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-12-18T10:16:12.877 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-18T10:16:12.920 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-18T10:16:12.947 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-18T10:16:12.947 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-18T10:16:12.974 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-18T10:16:13.051 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-18T10:16:13.059 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-18T10:16:13.060 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-18T10:16:13.061 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-18T10:16:13.062 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-18T10:16:13.090 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-18T10:16:13.093 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-18T10:16:13.246 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-18T10:16:13.260 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-18T10:16:13.296 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-18T10:16:13.624 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package dump. 2023-12-18T10:16:13.638 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-18T10:16:13.682 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking dump (0.4b47-3) ... 2023-12-18T10:16:13.718 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-18T10:16:13.801 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-18T10:16:13.801 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-18T10:16:13.801 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-18T10:16:13.892 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-18T10:16:13.905 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-18T10:16:13.961 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package indent. 2023-12-18T10:16:13.975 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:14.019 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-18T10:16:14.288 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-18T10:16:14.303 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-18T10:16:14.338 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-18T10:16:14.360 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-18T10:16:14.362 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-18T10:16:14.633 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-18T10:16:14.648 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-18T10:16:14.691 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-18T10:16:14.755 INFO:teuthology.orchestra.run.smithi133.stdout:Preconfiguring packages ... 2023-12-18T10:16:14.913 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2023-12-18T10:16:14.927 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-18T10:16:14.943 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-18T10:16:14.985 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-18T10:16:15.046 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package flex. 2023-12-18T10:16:15.119 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-12-18T10:16:15.122 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-18T10:16:15.161 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-18T10:16:15.330 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-18T10:16:15.346 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-18T10:16:15.397 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-18T10:16:15.625 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-18T10:16:15.640 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-18T10:16:15.674 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-18T10:16:15.748 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-18T10:16:15.935 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjson-perl. 2023-12-18T10:16:15.951 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-18T10:16:15.993 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-18T10:16:16.051 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-18T10:16:16.297 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-18T10:16:16.312 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-18T10:16:16.354 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-18T10:16:16.449 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-18T10:16:17.002 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package bison. 2023-12-18T10:16:17.073 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-12-18T10:16:17.076 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-18T10:16:17.121 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-18T10:16:17.555 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-18T10:16:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-18T10:16:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-18T10:16:17.700 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-18T10:16:17.716 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-18T10:16:17.750 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-18T10:16:17.916 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package dump. 2023-12-18T10:16:17.930 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-18T10:16:17.975 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking dump (0.4b47-3) ... 2023-12-18T10:16:17.978 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-18T10:16:17.993 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-18T10:16:18.036 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-18T10:16:18.294 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package indent. 2023-12-18T10:16:18.309 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:18.347 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-18T10:16:18.353 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-18T10:16:18.363 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-18T10:16:18.405 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-18T10:16:18.597 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-18T10:16:18.611 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-18T10:16:18.646 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-18T10:16:18.750 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-18T10:16:18.765 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-18T10:16:18.808 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-18T10:16:19.017 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-18T10:16:19.033 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-18T10:16:19.075 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-18T10:16:19.119 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-18T10:16:19.135 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-18T10:16:19.169 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-18T10:16:19.336 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-18T10:16:19.352 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-18T10:16:19.394 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-18T10:16:19.514 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-18T10:16:19.529 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:19.571 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:19.722 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-18T10:16:19.738 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-18T10:16:19.772 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-18T10:16:19.908 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-18T10:16:19.924 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:19.966 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-18T10:16:19.991 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-18T10:16:20.007 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-18T10:16:20.049 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-18T10:16:20.227 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-18T10:16:20.242 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:20.277 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-18T10:16:20.302 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjson-perl. 2023-12-18T10:16:20.317 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-18T10:16:20.393 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-18T10:16:20.521 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-18T10:16:20.536 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-18T10:16:20.579 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-18T10:16:20.688 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-18T10:16:20.704 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-18T10:16:20.746 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-18T10:16:21.083 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-18T10:16:21.096 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-18T10:16:21.133 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-18T10:16:21.461 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package modemmanager. 2023-12-18T10:16:21.473 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-18T10:16:21.511 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-18T10:16:22.133 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-18T10:16:22.149 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-18T10:16:22.183 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-18T10:16:22.184 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package network-manager. 2023-12-18T10:16:22.197 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-18T10:16:22.251 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-18T10:16:22.410 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-18T10:16:22.425 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-18T10:16:22.468 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-18T10:16:22.812 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-18T10:16:22.828 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-18T10:16:22.866 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ppp. 2023-12-18T10:16:22.870 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-18T10:16:22.880 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-18T10:16:23.215 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-18T10:16:23.231 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-18T10:16:23.241 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-18T10:16:23.273 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-18T10:16:23.584 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-18T10:16:23.587 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package pptp-linux. 2023-12-18T10:16:23.599 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-18T10:16:23.600 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-18T10:16:23.634 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-18T10:16:23.637 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-18T10:16:23.898 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-18T10:16:23.910 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-18T10:16:23.949 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-18T10:16:23.970 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-18T10:16:23.986 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:24.061 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:24.226 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-18T10:16:24.238 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-18T10:16:24.268 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client-common (238) ... 2023-12-18T10:16:24.406 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-18T10:16:24.422 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:24.464 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-18T10:16:24.546 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-18T10:16:24.561 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:24.605 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:24.792 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-18T10:16:24.807 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:24.850 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-18T10:16:25.060 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-18T10:16:25.075 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-18T10:16:25.110 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-18T10:16:25.218 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-common. 2023-12-18T10:16:25.231 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-18T10:16:25.302 INFO:teuthology.orchestra.run.smithi142.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-18T10:16:25.333 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-common (238) ... 2023-12-18T10:16:25.655 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-18T10:16:25.670 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-18T10:16:25.705 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-18T10:16:25.834 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-14. 2023-12-18T10:16:25.846 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:25.886 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:26.041 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package modemmanager. 2023-12-18T10:16:26.057 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-18T10:16:26.099 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-18T10:16:26.848 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager. 2023-12-18T10:16:26.863 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-18T10:16:26.915 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-18T10:16:27.580 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ppp. 2023-12-18T10:16:27.595 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-18T10:16:27.706 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql. 2023-12-18T10:16:27.718 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-18T10:16:27.747 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql (14+238) ... 2023-12-18T10:16:27.937 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-18T10:16:27.974 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-client. 2023-12-18T10:16:27.987 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-18T10:16:28.024 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-client (14+238) ... 2023-12-18T10:16:28.268 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package pptp-linux. 2023-12-18T10:16:28.282 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-18T10:16:28.285 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-18T10:16:28.298 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-18T10:16:28.326 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-18T10:16:28.335 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-18T10:16:28.561 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-18T10:16:28.576 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-18T10:16:28.612 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-18T10:16:28.654 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package tcl8.6. 2023-12-18T10:16:28.667 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-18T10:16:28.706 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-18T10:16:28.922 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-18T10:16:28.937 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-18T10:16:28.973 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client-common (238) ... 2023-12-18T10:16:28.982 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package tcl. 2023-12-18T10:16:28.994 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-18T10:16:29.027 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-18T10:16:29.276 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-18T10:16:29.291 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:29.334 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:29.376 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package wpasupplicant. 2023-12-18T10:16:29.389 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-18T10:16:29.426 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-18T10:16:29.789 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-18T10:16:29.801 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-18T10:16:29.838 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-18T10:16:29.889 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-common. 2023-12-18T10:16:29.905 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-18T10:16:29.965 INFO:teuthology.orchestra.run.smithi133.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-18T10:16:29.996 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-common (238) ... 2023-12-18T10:16:30.200 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-18T10:16:30.213 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-18T10:16:30.250 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-18T10:16:30.515 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client-common (238) ... 2023-12-18T10:16:30.555 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-14. 2023-12-18T10:16:30.571 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-18T10:16:30.616 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:30.722 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-18T10:16:30.857 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-18T10:16:30.975 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:31.076 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-18T10:16:31.177 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-18T10:16:31.336 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:31.791 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql. 2023-12-18T10:16:31.806 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-18T10:16:31.849 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql (14+238) ... 2023-12-18T10:16:32.093 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client. 2023-12-18T10:16:32.108 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-18T10:16:32.151 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client (14+238) ... 2023-12-18T10:16:32.341 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-18T10:16:32.404 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-18T10:16:32.419 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-18T10:16:32.453 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-18T10:16:32.458 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-18T10:16:32.739 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package tcl8.6. 2023-12-18T10:16:32.755 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-18T10:16:32.787 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-18T10:16:32.787 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-18T10:16:32.797 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-18T10:16:33.067 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package tcl. 2023-12-18T10:16:33.083 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-18T10:16:33.155 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-18T10:16:33.477 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-18T10:16:33.486 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package wpasupplicant. 2023-12-18T10:16:33.502 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-18T10:16:33.544 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-18T10:16:33.603 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-18T10:16:33.729 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-18T10:16:33.855 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-18T10:16:33.899 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-18T10:16:33.915 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-18T10:16:33.957 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-18T10:16:33.964 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-18T10:16:34.074 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-18T10:16:34.200 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-18T10:16:34.335 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-18T10:16:34.351 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-18T10:16:34.402 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-18T10:16:34.719 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client-common (238) ... 2023-12-18T10:16:34.863 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-18T10:16:34.916 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-18T10:16:35.006 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up dump (0.4b47-3) ... 2023-12-18T10:16:35.033 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-18T10:16:35.101 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-18T10:16:35.143 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:35.166 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-18T10:16:35.269 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-18T10:16:35.292 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-18T10:16:35.418 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-18T10:16:35.420 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-18T10:16:35.519 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-18T10:16:35.545 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:35.637 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-18T10:16:35.726 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-18T10:16:35.796 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-18T10:16:35.956 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-18T10:16:36.132 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-18T10:16:36.260 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-18T10:16:36.384 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-18T10:16:36.544 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-client (14+238) ... 2023-12-18T10:16:36.549 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-18T10:16:36.651 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-18T10:16:36.653 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-18T10:16:37.056 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-18T10:16:37.056 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-18T10:16:37.262 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-18T10:16:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:which means they are currently configured by ifupdown: 2023-12-18T10:16:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:- enp3s0f1 2023-12-18T10:16:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-18T10:16:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:remove their configuration from /etc/network/interfaces. 2023-12-18T10:16:37.263 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:37.395 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-18T10:16:37.737 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-18T10:16:37.804 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-18T10:16:37.863 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-18T10:16:37.981 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-18T10:16:38.099 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-18T10:16:38.208 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-18T10:16:38.214 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-18T10:16:38.359 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-18T10:16:38.485 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-18T10:16:38.930 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-18T10:16:39.065 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-18T10:16:39.173 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-18T10:16:39.174 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-18T10:16:39.275 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-common (238) ... 2023-12-18T10:16:39.291 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up dump (0.4b47-3) ... 2023-12-18T10:16:39.377 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-18T10:16:39.442 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-18T10:16:39.568 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-18T10:16:39.694 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-18T10:16:39.853 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-18T10:16:39.979 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-18T10:16:40.069 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-18T10:16:40.139 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-18T10:16:40.148 INFO:teuthology.orchestra.run.smithi142.stdout:Adding user postgres to group ssl-cert 2023-12-18T10:16:40.274 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-18T10:16:40.418 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:40.418 INFO:teuthology.orchestra.run.smithi142.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-18T10:16:40.425 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-18T10:16:40.667 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-18T10:16:40.692 INFO:teuthology.orchestra.run.smithi142.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-18T10:16:40.692 INFO:teuthology.orchestra.run.smithi142.stdout:Removing obsolete dictionary files: 2023-12-18T10:16:40.793 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-18T10:16:40.961 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client (14+238) ... 2023-12-18T10:16:41.087 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-18T10:16:41.440 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-18T10:16:41.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:41.867 INFO:teuthology.orchestra.run.smithi133.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-18T10:16:41.867 INFO:teuthology.orchestra.run.smithi133.stdout:which means they are currently configured by ifupdown: 2023-12-18T10:16:41.867 INFO:teuthology.orchestra.run.smithi133.stdout:- enp3s0f1 2023-12-18T10:16:41.867 INFO:teuthology.orchestra.run.smithi133.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-18T10:16:41.867 INFO:teuthology.orchestra.run.smithi133.stdout:remove their configuration from /etc/network/interfaces. 2023-12-18T10:16:41.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:41.919 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:42.005 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-18T10:16:42.285 INFO:teuthology.orchestra.run.smithi142.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-18T10:16:42.305 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:This user must also own the server process. 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:The database cluster will be initialized with locale "en_US". 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:The default text search configuration will be set to "english". 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:Data page checksums are disabled. 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:42.359 INFO:teuthology.orchestra.run.smithi142.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-18T10:16:42.360 INFO:teuthology.orchestra.run.smithi142.stdout:creating subdirectories ... ok 2023-12-18T10:16:42.360 INFO:teuthology.orchestra.run.smithi142.stdout:selecting dynamic shared memory implementation ... posix 2023-12-18T10:16:42.384 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default max_connections ... 100 2023-12-18T10:16:42.389 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-18T10:16:42.419 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default shared_buffers ... 128MB 2023-12-18T10:16:42.433 INFO:teuthology.orchestra.run.smithi142.stdout:selecting default time zone ... Etc/UTC 2023-12-18T10:16:42.433 INFO:teuthology.orchestra.run.smithi142.stdout:creating configuration files ... ok 2023-12-18T10:16:42.602 INFO:teuthology.orchestra.run.smithi142.stdout:running bootstrap script ... ok 2023-12-18T10:16:42.788 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-18T10:16:43.220 INFO:teuthology.orchestra.run.smithi142.stdout:performing post-bootstrap initialization ... ok 2023-12-18T10:16:43.482 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-18T10:16:43.608 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-18T10:16:43.734 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-18T10:16:43.777 INFO:teuthology.orchestra.run.smithi142.stdout:syncing data to disk ... ok 2023-12-18T10:16:43.860 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-common (238) ... 2023-12-18T10:16:44.280 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-18T10:16:44.771 INFO:teuthology.orchestra.run.smithi133.stdout:Adding user postgres to group ssl-cert 2023-12-18T10:16:45.035 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:45.035 INFO:teuthology.orchestra.run.smithi133.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-18T10:16:45.328 INFO:teuthology.orchestra.run.smithi133.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-18T10:16:45.329 INFO:teuthology.orchestra.run.smithi133.stdout:Removing obsolete dictionary files: 2023-12-18T10:16:46.025 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-18T10:16:46.511 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-18T10:16:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-18T10:16:46.870 INFO:teuthology.orchestra.run.smithi133.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-18T10:16:46.926 INFO:teuthology.orchestra.run.smithi133.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-18T10:16:46.926 INFO:teuthology.orchestra.run.smithi133.stdout:This user must also own the server process. 2023-12-18T10:16:46.927 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:46.927 INFO:teuthology.orchestra.run.smithi133.stdout:The database cluster will be initialized with locale "en_US". 2023-12-18T10:16:46.927 INFO:teuthology.orchestra.run.smithi133.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-18T10:16:46.927 INFO:teuthology.orchestra.run.smithi133.stdout:The default text search configuration will be set to "english". 2023-12-18T10:16:46.927 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:46.927 INFO:teuthology.orchestra.run.smithi133.stdout:Data page checksums are disabled. 2023-12-18T10:16:46.927 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:46.927 INFO:teuthology.orchestra.run.smithi133.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-18T10:16:46.928 INFO:teuthology.orchestra.run.smithi133.stdout:creating subdirectories ... ok 2023-12-18T10:16:46.928 INFO:teuthology.orchestra.run.smithi133.stdout:selecting dynamic shared memory implementation ... posix 2023-12-18T10:16:46.952 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default max_connections ... 100 2023-12-18T10:16:46.988 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default shared_buffers ... 128MB 2023-12-18T10:16:47.002 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default time zone ... Etc/UTC 2023-12-18T10:16:47.003 INFO:teuthology.orchestra.run.smithi133.stdout:creating configuration files ... ok 2023-12-18T10:16:47.172 INFO:teuthology.orchestra.run.smithi133.stdout:running bootstrap script ... ok 2023-12-18T10:16:47.686 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-18T10:16:47.779 INFO:teuthology.orchestra.run.smithi133.stdout:performing post-bootstrap initialization ... ok 2023-12-18T10:16:47.821 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-18T10:16:47.947 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up postgresql (14+238) ... 2023-12-18T10:16:48.073 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-18T10:16:48.198 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-18T10:16:48.292 INFO:teuthology.orchestra.run.smithi133.stdout:syncing data to disk ... ok 2023-12-18T10:16:48.477 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-18T10:16:48.477 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-18T10:16:48.812 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-18T10:16:49.234 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-18T10:16:49.519 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-18T10:16:49.671 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-18T10:16:50.462 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-18T10:16:50.563 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-18T10:16:51.242 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-18T10:16:51.249 DEBUG:teuthology.parallel:result is None 2023-12-18T10:16:51.860 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-18T10:16:51.986 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-18T10:16:52.112 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql (14+238) ... 2023-12-18T10:16:52.238 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-18T10:16:52.398 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-18T10:16:52.642 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-18T10:16:52.642 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-18T10:16:53.383 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-18T10:16:53.719 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-18T10:16:53.895 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-18T10:16:55.606 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-18T10:16:55.723 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-18T10:16:56.433 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-18T10:16:56.439 DEBUG:teuthology.parallel:result is None 2023-12-18T10:16:56.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8688b2517b6002b804a4844986e6ed5ce973d99f 2023-12-18T10:16:56.659 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-query -W -f '${Version}' ceph 2023-12-18T10:16:56.681 INFO:teuthology.orchestra.run.smithi133.stdout:18.2.0-1372-g8688b251-1jammy 2023-12-18T10:16:56.681 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1372-g8688b251-1jammy 2023-12-18T10:16:56.681 INFO:teuthology.task.install:The correct ceph version 18.2.0-1372-g8688b251-1jammy is installed. 2023-12-18T10:16:56.683 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8688b2517b6002b804a4844986e6ed5ce973d99f 2023-12-18T10:16:56.896 DEBUG:teuthology.orchestra.run.smithi142:> dpkg-query -W -f '${Version}' ceph 2023-12-18T10:16:56.920 INFO:teuthology.orchestra.run.smithi142.stdout:18.2.0-1372-g8688b251-1jammy 2023-12-18T10:16:56.920 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1372-g8688b251-1jammy 2023-12-18T10:16:56.921 INFO:teuthology.task.install:The correct ceph version 18.2.0-1372-g8688b251-1jammy is installed. 2023-12-18T10:16:56.922 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-18T10:16:56.922 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:56.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-18T10:16:56.943 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:16:56.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-18T10:16:56.989 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-18T10:16:56.990 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:56.990 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-12-18T10:16:57.010 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-18T10:16:57.069 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:16:57.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2023-12-18T10:16:57.090 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-18T10:16:57.152 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-18T10:16:57.153 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:57.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-18T10:16:57.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-18T10:16:57.233 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:16:57.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-18T10:16:57.255 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-18T10:16:57.316 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-18T10:16:57.317 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:57.317 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2023-12-18T10:16:57.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-18T10:16:57.397 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:16:57.397 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2023-12-18T10:16:57.419 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-18T10:16:57.480 INFO:teuthology.run_tasks:Running task ceph... 2023-12-18T10:16:57.543 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-18T10:16:57.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2023-12-18T10:16:57.546 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2023-12-18T10:16:57.567 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-18T10:16:57.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-18T10:16:57.605 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-18T10:16:57.628 INFO:tasks.ceph:Creating extra log directories... 2023-12-18T10:16:57.628 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-18T10:16:57.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-18T10:16:57.698 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-18T10:16:57.699 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-18T10:16:57.699 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-18T10:16:57.699 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:57.699 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-18T10:16:57.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-18T10:16:57.820 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:16:57.820 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-18T10:16:57.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-18T10:16:57.927 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-18T10:16:57.927 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Scrub error on inode'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-18T10:16:57.927 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411', 'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7495411', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Scrub error on inode'], 'sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef', 'sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1969, 'sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f', 'sleep_before_teardown': 0, 'subset': '124/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-2023-12-18-1207-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8688b2517b6002b804a4844986e6ed5ce973d99f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4Na7RJPKURD8+eDOvklrAlHYhShrfslpCJWzht5uER5Hra5sfrayjckMt1JAENAtg0Mt8kdjxNmDVo6Zy2IFM=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXvK7iKGMW7gzxDEwIb5C/d8syMDoSiPZ7UmjlldA84GDswvqpEUd+w6QKaPN+HAeOPCYQ8DmJmH6fpHQuq+jw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Scrub error on inode'], 'sha1': '8688b2517b6002b804a4844986e6ed5ce973d99f', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_multimds_misc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-18_09:35:32', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-18T10:16:57.928 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-18T10:16:57.931 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-18T10:16:57.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2023-12-18T10:16:57.981 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2023-12-18T10:16:58.004 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:58.005 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-12-18T10:16:58.050 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-18T10:16:58.051 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-12-18T10:16:58.102 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-18T10:16:58.103 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-18T10:16:58.103 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 900 Links: 1 2023-12-18T10:16:58.103 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-18T10:16:58.103 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-18 10:08:51.321092133 +0000 2023-12-18T10:16:58.103 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-18 10:08:50.909100850 +0000 2023-12-18T10:16:58.103 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-18 10:08:50.909100850 +0000 2023-12-18T10:16:58.103 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-18 10:08:50.909100850 +0000 2023-12-18T10:16:58.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-18T10:16:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-18T10:16:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-18T10:16:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000634158 s, 807 kB/s 2023-12-18T10:16:58.169 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-18T10:16:58.220 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-12-18T10:16:58.270 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-18T10:16:58.271 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-18T10:16:58.271 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 916 Links: 1 2023-12-18T10:16:58.271 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-18T10:16:58.271 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-18 10:08:52.053076861 +0000 2023-12-18T10:16:58.271 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-18 10:08:51.617085937 +0000 2023-12-18T10:16:58.271 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-18 10:08:51.617085937 +0000 2023-12-18T10:16:58.271 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-18 10:08:51.617085937 +0000 2023-12-18T10:16:58.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-18T10:16:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-18T10:16:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-18T10:16:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000355618 s, 1.4 MB/s 2023-12-18T10:16:58.334 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-18T10:16:58.384 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-12-18T10:16:58.438 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-18T10:16:58.438 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-18T10:16:58.438 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 934 Links: 1 2023-12-18T10:16:58.439 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-18T10:16:58.439 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-18 10:08:52.749062989 +0000 2023-12-18T10:16:58.439 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-18 10:08:52.341071121 +0000 2023-12-18T10:16:58.439 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-18 10:08:52.341071121 +0000 2023-12-18T10:16:58.439 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-18 10:08:52.341071121 +0000 2023-12-18T10:16:58.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-18T10:16:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-18T10:16:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-18T10:16:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000353368 s, 1.4 MB/s 2023-12-18T10:16:58.506 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-18T10:16:58.560 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-12-18T10:16:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-18T10:16:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-18T10:16:58.610 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 950 Links: 1 2023-12-18T10:16:58.611 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-18T10:16:58.611 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-18 10:08:53.437048840 +0000 2023-12-18T10:16:58.611 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-18 10:08:53.033057297 +0000 2023-12-18T10:16:58.611 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-18 10:08:53.033057297 +0000 2023-12-18T10:16:58.611 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-18 10:08:53.033057297 +0000 2023-12-18T10:16:58.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-18T10:16:58.676 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-18T10:16:58.676 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-18T10:16:58.676 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000361725 s, 1.4 MB/s 2023-12-18T10:16:58.678 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-18T10:16:58.728 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-18T10:16:58.728 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:16:58.728 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2023-12-18T10:16:58.738 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-18T10:16:58.738 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2023-12-18T10:16:58.789 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-18T10:16:58.789 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-18T10:16:58.789 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-12-18T10:16:58.789 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-18T10:16:58.789 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-12-18 10:08:49.792782322 +0000 2023-12-18T10:16:58.789 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-12-18 10:08:49.404790443 +0000 2023-12-18T10:16:58.789 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-12-18 10:08:49.404790443 +0000 2023-12-18T10:16:58.789 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-12-18 10:08:49.404790443 +0000 2023-12-18T10:16:58.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-18T10:16:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-12-18T10:16:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-12-18T10:16:58.851 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000402641 s, 1.3 MB/s 2023-12-18T10:16:58.853 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-18T10:16:58.907 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2023-12-18T10:16:58.957 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-18T10:16:58.957 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-18T10:16:58.957 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-12-18T10:16:58.957 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-18T10:16:58.957 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-12-18 10:08:50.472768087 +0000 2023-12-18T10:16:58.957 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-12-18 10:08:50.080776293 +0000 2023-12-18T10:16:58.957 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-12-18 10:08:50.080776293 +0000 2023-12-18T10:16:58.957 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-12-18 10:08:50.080776293 +0000 2023-12-18T10:16:58.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-18T10:16:59.019 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-12-18T10:16:59.019 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-12-18T10:16:59.019 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000389062 s, 1.3 MB/s 2023-12-18T10:16:59.021 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-18T10:16:59.075 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2023-12-18T10:16:59.125 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-18T10:16:59.125 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-18T10:16:59.125 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 938 Links: 1 2023-12-18T10:16:59.125 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-18T10:16:59.125 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-12-18 10:08:51.152754002 +0000 2023-12-18T10:16:59.125 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-12-18 10:08:50.736762561 +0000 2023-12-18T10:16:59.125 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-12-18 10:08:50.736762561 +0000 2023-12-18T10:16:59.125 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-12-18 10:08:50.736762561 +0000 2023-12-18T10:16:59.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-18T10:16:59.187 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-12-18T10:16:59.187 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-12-18T10:16:59.187 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000381257 s, 1.3 MB/s 2023-12-18T10:16:59.189 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-18T10:16:59.243 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2023-12-18T10:16:59.297 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-18T10:16:59.297 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-18T10:16:59.297 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 953 Links: 1 2023-12-18T10:16:59.297 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-18T10:16:59.297 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-12-18 10:08:51.836740369 +0000 2023-12-18T10:16:59.297 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-12-18 10:08:51.412748821 +0000 2023-12-18T10:16:59.297 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-12-18 10:08:51.412748821 +0000 2023-12-18T10:16:59.297 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-12-18 10:08:51.412748821 +0000 2023-12-18T10:16:59.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-18T10:16:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-12-18T10:16:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-12-18T10:16:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000384825 s, 1.3 MB/s 2023-12-18T10:16:59.365 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-18T10:16:59.419 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-18T10:16:59.419 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-18T10:16:59.419 INFO:tasks.ceph:Generating config... 2023-12-18T10:16:59.420 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-18T10:16:59.420 INFO:tasks.ceph:[client] debug client = 20 2023-12-18T10:16:59.420 INFO:tasks.ceph:[client] debug ms = 1 2023-12-18T10:16:59.420 INFO:tasks.ceph:[client] pid file = 2023-12-18T10:16:59.421 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-18T10:16:59.421 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-18T10:16:59.421 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-18T10:16:59.422 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-18T10:16:59.422 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-18T10:16:59.422 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-18T10:16:59.422 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-18T10:16:59.422 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-18T10:16:59.423 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-18T10:16:59.423 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-18T10:16:59.423 INFO:tasks.ceph:Setting up mon.a... 2023-12-18T10:16:59.423 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-18T10:16:59.467 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.keyring 2023-12-18T10:16:59.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-18T10:16:59.583 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-18T10:16:59.603 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.133'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2023-12-18T10:16:59.603 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.133,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-18T10:16:59.604 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:59.604 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-18T10:16:59.655 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.133 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: generated fsid 7fe143ee-5f58-4242-8bb4-33cc87443c22 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:setting min_mon_release = pacific 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:epoch 0 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:fsid 7fe143ee-5f58-4242-8bb4-33cc87443c22 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:last_changed 2023-12-18T10:16:59.748402+0000 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:created 2023-12-18T10:16:59.748402+0000 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:min_mon_release 16 (pacific) 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:election_strategy: 1 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2023-12-18T10:16:59.749 INFO:teuthology.orchestra.run.smithi133.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2023-12-18T10:16:59.750 INFO:teuthology.orchestra.run.smithi133.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2023-12-18T10:16:59.750 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-18T10:16:59.752 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-18T10:16:59.760 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7fe143ee-5f58-4242-8bb4-33cc87443c22... 2023-12-18T10:16:59.761 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-18T10:16:59.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2023-12-18T10:16:59.846 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.847 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-18T10:16:59.848 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 7fe143ee-5f58-4242-8bb4-33cc87443c22 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2023-12-18T10:16:59.849 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2023-12-18T10:16:59.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2023-12-18T10:16:59.851 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 20 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 20 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 10 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.852 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2023-12-18T10:16:59.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2023-12-18T10:16:59.854 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2023-12-18T10:16:59.855 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = "" 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-12-18T10:16:59.856 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds balancer = 20 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-12-18T10:16:59.857 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-12-18T10:16:59.858 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-12-18T10:16:59.858 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-12-18T10:16:59.858 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2023-12-18T10:16:59.858 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-18T10:16:59.858 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2023-12-18T10:16:59.858 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.858 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2023-12-18T10:16:59.858 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2023-12-18T10:16:59.859 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-18T10:16:59.860 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2023-12-18T10:16:59.861 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.133,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 7fe143ee-5f58-4242-8bb4-33cc87443c22 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2023-12-18T10:16:59.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.863 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2023-12-18T10:16:59.864 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-12-18T10:16:59.865 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2023-12-18T10:16:59.866 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2023-12-18T10:16:59.867 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2023-12-18T10:16:59.868 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2023-12-18T10:16:59.869 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2023-12-18T10:16:59.870 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2023-12-18T10:16:59.871 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-18T10:16:59.871 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-18T10:16:59.975 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-18T10:16:59.975 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:59.975 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-18T10:16:59.984 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:16:59.984 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-18T10:17:00.034 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:17:00.034 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:00.034 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-18T10:17:00.035 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-18T10:17:00.110 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:00.110 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:00.162 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:17:00.162 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:00.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-18T10:17:00.162 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-18T10:17:00.197 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:00.197 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:00.248 INFO:tasks.ceph:Setting up mon nodes... 2023-12-18T10:17:00.248 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-18T10:17:00.248 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-18T10:17:00.304 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-18T10:17:00.309 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-18T10:17:00.371 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-18T10:17:00.444 INFO:tasks.ceph:Setting up mds nodes... 2023-12-18T10:17:00.444 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-18T10:17:00.500 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-18T10:17:00.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-18T10:17:00.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-18T10:17:00.621 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-18T10:17:00.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-18T10:17:00.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-18T10:17:00.706 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-18T10:17:00.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-18T10:17:00.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-18T10:17:00.828 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-18T10:17:00.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-18T10:17:00.853 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-18T10:17:00.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-18T10:17:00.896 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-18T10:17:00.913 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-18T10:17:00.996 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-18T10:17:01.014 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-18T10:17:01.058 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-18T10:17:01.075 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-18T10:17:01.158 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-18T10:17:01.175 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-18T10:17:01.175 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-18T10:17:01.175 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-18T10:17:01.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-18T10:17:01.195 INFO:tasks.ceph:role: osd.0 2023-12-18T10:17:01.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:17:01.195 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-18T10:17:01.265 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-18T10:17:01.265 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-18T10:17:01.265 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-18T10:17:01.266 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-18T10:17:01.266 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-18T10:17:01.266 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-18T10:17:01.266 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-18T10:17:01.266 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-18T10:17:01.266 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-18T10:17:01.266 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-18T10:17:01.715 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-18T10:17:01.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-18T10:17:01.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-18T10:17:01.833 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-18T10:17:01.850 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-12-18T10:17:01.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:17:01.851 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-18T10:17:01.914 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-18T10:17:01.914 INFO:tasks.ceph:role: osd.1 2023-12-18T10:17:01.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:17:01.914 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-18T10:17:01.983 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-18T10:17:02.455 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-18T10:17:02.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-18T10:17:02.458 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-18T10:17:02.621 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-18T10:17:02.638 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-12-18T10:17:02.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:17:02.640 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-18T10:17:02.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-18T10:17:02.704 INFO:tasks.ceph:role: osd.2 2023-12-18T10:17:02.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:17:02.704 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-18T10:17:02.776 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-18T10:17:02.776 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-18T10:17:02.776 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-18T10:17:02.776 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-18T10:17:02.776 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-18T10:17:02.776 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-18T10:17:02.776 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-18T10:17:02.777 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-18T10:17:02.777 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-18T10:17:02.777 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-18T10:17:03.256 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-18T10:17:03.258 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-18T10:17:03.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-18T10:17:03.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-18T10:17:03.402 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-12-18T10:17:03.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:17:03.403 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-18T10:17:03.467 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-18T10:17:03.467 INFO:tasks.ceph:role: osd.3 2023-12-18T10:17:03.467 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:17:03.468 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-18T10:17:03.539 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-18T10:17:03.995 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-18T10:17:03.997 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-18T10:17:03.998 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-18T10:17:04.100 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-18T10:17:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-12-18T10:17:04.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:17:04.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:04.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:04.243+0000 7fee41f4e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-18T10:17:04.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:04.247+0000 7fee41f4e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-18T10:17:04.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:04.247+0000 7fee41f4e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-18T10:17:04.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:04.247+0000 7fee41f4e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-18T10:17:04.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:04.247+0000 7fee41f4e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-18T10:17:04.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:04.251+0000 7fee41f4e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-18T10:17:07.258 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-18T10:17:07.280 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:07.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:07.375+0000 7ff03dcf3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-18T10:17:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:07.375+0000 7ff03dcf3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-18T10:17:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:07.379+0000 7ff03dcf3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-18T10:17:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:07.379+0000 7ff03dcf3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-18T10:17:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:07.379+0000 7ff03dcf3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-18T10:17:07.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:07.379+0000 7ff03dcf3640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-18T10:17:10.365 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-18T10:17:10.386 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:10.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:10.479+0000 7f505fd0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-18T10:17:10.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:10.479+0000 7f505fd0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-18T10:17:10.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:10.479+0000 7f505fd0b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-18T10:17:10.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:10.479+0000 7f505fd0b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-18T10:17:10.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:10.479+0000 7f505fd0b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-18T10:17:10.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:10.479+0000 7f505fd0b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-18T10:17:13.477 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-18T10:17:13.498 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:13.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:13.587+0000 7f30c305e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-18T10:17:13.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:13.587+0000 7f30c305e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-18T10:17:13.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:13.587+0000 7f30c305e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-18T10:17:13.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:13.587+0000 7f30c305e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-18T10:17:13.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:13.587+0000 7f30c305e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-18T10:17:13.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:13.591+0000 7f30c305e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-18T10:17:16.597 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-18T10:17:16.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-18T10:17:16.641 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-18T10:17:16.641 INFO:tasks.ceph:role: osd.4 2023-12-18T10:17:16.641 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:17:16.641 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-18T10:17:16.713 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-18T10:17:16.713 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-18T10:17:16.714 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-18T10:17:16.714 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-18T10:17:16.714 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-18T10:17:16.714 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-12-18T10:17:16.714 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-18T10:17:16.714 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-18T10:17:16.714 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-18T10:17:16.714 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-18T10:17:17.181 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-12-18T10:17:17.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-12-18T10:17:17.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-18T10:17:17.295 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-18T10:17:17.313 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2023-12-18T10:17:17.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:17:17.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-18T10:17:17.381 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-18T10:17:17.381 INFO:tasks.ceph:role: osd.5 2023-12-18T10:17:17.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:17:17.381 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-18T10:17:17.455 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-18T10:17:17.455 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-18T10:17:17.455 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-18T10:17:17.456 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-18T10:17:17.456 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-18T10:17:17.456 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-12-18T10:17:17.456 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-18T10:17:17.456 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-18T10:17:17.456 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-18T10:17:17.456 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-18T10:17:17.963 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-12-18T10:17:17.967 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-12-18T10:17:17.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-18T10:17:18.094 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-18T10:17:18.112 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2023-12-18T10:17:18.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:17:18.113 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-18T10:17:18.182 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-18T10:17:18.182 INFO:tasks.ceph:role: osd.6 2023-12-18T10:17:18.182 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:17:18.182 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-18T10:17:18.253 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-18T10:17:18.253 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-18T10:17:18.253 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-18T10:17:18.254 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-18T10:17:18.254 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-18T10:17:18.254 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-12-18T10:17:18.254 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-18T10:17:18.254 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-18T10:17:18.254 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-18T10:17:18.254 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-18T10:17:18.732 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-12-18T10:17:18.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-12-18T10:17:18.735 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-18T10:17:18.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-18T10:17:18.877 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2023-12-18T10:17:18.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:17:18.878 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-18T10:17:18.940 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-18T10:17:18.940 INFO:tasks.ceph:role: osd.7 2023-12-18T10:17:18.940 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:17:18.940 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-18T10:17:19.012 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-18T10:17:19.012 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-18T10:17:19.012 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-18T10:17:19.012 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-18T10:17:19.012 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-18T10:17:19.012 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2023-12-18T10:17:19.012 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-18T10:17:19.013 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-18T10:17:19.013 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-18T10:17:19.013 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-18T10:17:19.463 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2023-12-18T10:17:19.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2023-12-18T10:17:19.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-18T10:17:19.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-18T10:17:19.591 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2023-12-18T10:17:19.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:17:19.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:19.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:19.727+0000 7f3942d3c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-18T10:17:19.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:19.727+0000 7f3942d3c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-18T10:17:19.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:19.727+0000 7f3942d3c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-18T10:17:19.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:19.727+0000 7f3942d3c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-18T10:17:19.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:19.727+0000 7f3942d3c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-18T10:17:19.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:19.735+0000 7f3942d3c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-18T10:17:22.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-18T10:17:22.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:22.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:22.847+0000 7feb00307640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-18T10:17:22.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:22.847+0000 7feb00307640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-18T10:17:22.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:22.847+0000 7feb00307640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-18T10:17:22.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:22.847+0000 7feb00307640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-18T10:17:22.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:22.847+0000 7feb00307640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-18T10:17:22.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:22.847+0000 7feb00307640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-18T10:17:25.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-18T10:17:25.857 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:25.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:25.951+0000 7f131682f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-18T10:17:25.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:25.955+0000 7f131682f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-18T10:17:25.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:25.955+0000 7f131682f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-18T10:17:25.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:25.955+0000 7f131682f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-18T10:17:25.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:25.955+0000 7f131682f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-18T10:17:25.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:25.955+0000 7f131682f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-18T10:17:27.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:17:27.933 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:17:28.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-18T10:17:28.971 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:29.067+0000 7ff821efb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-18T10:17:29.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:29.067+0000 7ff821efb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-18T10:17:29.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:29.067+0000 7ff821efb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-18T10:17:29.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:29.067+0000 7ff821efb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-18T10:17:29.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:29.067+0000 7ff821efb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-18T10:17:29.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:29.067+0000 7ff821efb640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-18T10:17:32.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-18T10:17:32.075 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-18T10:17:32.076 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-18T10:17:32.098 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.098 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-18T10:17:32.160 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.160 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-18T10:17:32.228 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.228 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-18T10:17:32.291 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-18T10:17:32.355 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.355 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-18T10:17:32.419 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.419 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-18T10:17:32.483 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-18T10:17:32.509 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.509 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-18T10:17:32.575 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.575 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-18T10:17:32.638 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.638 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-18T10:17:32.701 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.701 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-18T10:17:32.765 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-18T10:17:32.829 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-18T10:17:32.893 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.893 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-18T10:17:32.902 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:32.902 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-18T10:17:32.955 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.955 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-18T10:17:32.964 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:32.964 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-18T10:17:33.021 INFO:tasks.ceph:Adding keys to all mons... 2023-12-18T10:17:33.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-18T10:17:33.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-18T10:17:33.068 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2023-12-18T10:17:33.068 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAcHIBl+lIiEhAAx9zNJbwPBf7oGsFzDJKxEw== 2023-12-18T10:17:33.068 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-12-18T10:17:33.068 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAcHIBlq/3QHRAAeGrWPAL1IMuRSsb9HM8t0Q== 2023-12-18T10:17:33.068 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-12-18T10:17:33.068 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAcHIBlsRoJJRAAYgbCztPYO/qzR7wJgYhPqQ== 2023-12-18T10:17:33.068 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAgHIBlbTjYDhAA2KUnOrWIaGtzxXx9T64djw== 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAjHIBlr8a1FhAAGRT54akJvp65F8xxu9Mw1g== 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAmHIBlv+HSHBAAxDHSTox1AtpTMfCNbatjzA== 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQApHIBlj5xPIxAAkZglsOO2rg+8kXVIb+JK+w== 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAcHIBlDP4UFhAA8KB7vRFpeBSRad2GRiKh/A== 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAcHIBleUoUKhAA7KQ881Hp59b6BfYF5Mc8Rw== 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAcHIBlr0paMRAAUlbr607Vw8Yc0/S1EvLUUA== 2023-12-18T10:17:33.069 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAvHIBlhQRmKxAAahzzO4gYz5LHWhvFvZlOAA== 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAyHIBlatiUMhAAk0X1zO+dYOu5hMZvGBJNkQ== 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQA1HIBl86v0OBAA70FwnvAugWtLupto+cbBjg== 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQA5HIBlZAYVBBAAa0V4jDTdYV8TBoNR7SenjQ== 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAcHIBlugNkNRAADsDapfYnOr+gcvgQ4394aA== 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout:[client.2] 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAcHIBlrzVcOxAAwwd6eFzNGehg/4chJq1qJA== 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAdHIBlM7J1AxAAgoKo5xm3Wz4xWjPX4Mpn0A== 2023-12-18T10:17:33.070 INFO:teuthology.orchestra.run.smithi133.stdout:[client.3] 2023-12-18T10:17:33.071 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAdHIBlRgxmCRAAN/aEmPSonvc17SvLB1GdXQ== 2023-12-18T10:17:33.083 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2023-12-18T10:17:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAcHIBl+lIiEhAAx9zNJbwPBf7oGsFzDJKxEw== 2023-12-18T10:17:33.083 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2023-12-18T10:17:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAcHIBlq/3QHRAAeGrWPAL1IMuRSsb9HM8t0Q== 2023-12-18T10:17:33.083 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2023-12-18T10:17:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAcHIBlsRoJJRAAYgbCztPYO/qzR7wJgYhPqQ== 2023-12-18T10:17:33.083 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAgHIBlbTjYDhAA2KUnOrWIaGtzxXx9T64djw== 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAjHIBlr8a1FhAAGRT54akJvp65F8xxu9Mw1g== 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAmHIBlv+HSHBAAxDHSTox1AtpTMfCNbatjzA== 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQApHIBlj5xPIxAAkZglsOO2rg+8kXVIb+JK+w== 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAcHIBlDP4UFhAA8KB7vRFpeBSRad2GRiKh/A== 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAcHIBleUoUKhAA7KQ881Hp59b6BfYF5Mc8Rw== 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAcHIBlr0paMRAAUlbr607Vw8Yc0/S1EvLUUA== 2023-12-18T10:17:33.084 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAvHIBlhQRmKxAAahzzO4gYz5LHWhvFvZlOAA== 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAyHIBlatiUMhAAk0X1zO+dYOu5hMZvGBJNkQ== 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQA1HIBl86v0OBAA70FwnvAugWtLupto+cbBjg== 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQA5HIBlZAYVBBAAa0V4jDTdYV8TBoNR7SenjQ== 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAcHIBlugNkNRAADsDapfYnOr+gcvgQ4394aA== 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAcHIBlrzVcOxAAwwd6eFzNGehg/4chJq1qJA== 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAdHIBlM7J1AxAAgoKo5xm3Wz4xWjPX4Mpn0A== 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2023-12-18T10:17:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAdHIBlRgxmCRAAN/aEmPSonvc17SvLB1GdXQ== 2023-12-18T10:17:33.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-18T10:17:33.117 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-18T10:17:33.187 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-18T10:17:33.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-18T10:17:33.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-18T10:17:33.254 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-18T10:17:33.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.368 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.484 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-18T10:17:33.546 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-18T10:17:33.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-18T10:17:33.605 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-18T10:17:33.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-18T10:17:33.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-18T10:17:33.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.725 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.841 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.896 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-18T10:17:33.954 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-18T10:17:33.958 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-18T10:17:34.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-18T10:17:34.020 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-18T10:17:34.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-18T10:17:34.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-18T10:17:34.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-18T10:17:34.143 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-18T10:17:34.201 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-18T10:17:34.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-18T10:17:34.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-18T10:17:34.333 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-18T10:17:34.354 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-18T10:17:34.374 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-18T10:17:34.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-18T10:17:34.509 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-18T10:17:34.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-18T10:17:34.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-18T10:17:34.707 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:34.710 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-18T10:17:34.756 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-18T10:17:34.756 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-18T10:17:34.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-18T10:17:34.761 INFO:tasks.ceph.mon.a:Started 2023-12-18T10:17:34.761 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-18T10:17:34.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-18T10:17:34.803 INFO:tasks.ceph.mon.b:Started 2023-12-18T10:17:34.803 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-18T10:17:34.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-18T10:17:34.806 INFO:tasks.ceph.mon.c:Started 2023-12-18T10:17:34.806 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-18T10:17:34.807 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-18T10:17:34.807 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-18T10:17:34.810 INFO:tasks.ceph.mgr.y:Started 2023-12-18T10:17:34.810 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-18T10:17:34.810 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-18T10:17:34.814 INFO:tasks.ceph.mgr.x:Started 2023-12-18T10:17:34.814 INFO:tasks.ceph:Setting crush tunables to default 2023-12-18T10:17:34.814 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd crush tunables default 2023-12-18T10:17:34.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.947+0000 7f0a3be97640 1 Processor -- start 2023-12-18T10:17:34.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.947+0000 7f0a3be97640 1 -- start start 2023-12-18T10:17:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a3be97640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a3be97640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a3be97640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a34070df0 con 0x7f0a34071db0 2023-12-18T10:17:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a3be97640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3415aab0 con 0x7f0a340ca410 2023-12-18T10:17:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a3be97640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3415a4f0 con 0x7f0a34159fb0 2023-12-18T10:17:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39c33640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:34.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39c33640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33810/0 (socket says 172.21.15.133:33810) 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 learned_addr learned my addr 172.21.15.133:0/1477011526 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:34.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:34.951+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.155+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:35.559+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39c33640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:36.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:36.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:36.363+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-18T10:17:37.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a2b7fe640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a34071870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-18T10:17:37.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a2b7fe640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a34071870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:37.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a2b7fe640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 msgr2=0x7f0a34159a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-18T10:17:37.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a2b7fe640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.133:3300/0 conn(0x7f0a340ca410 0x7f0a34159a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:37.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a2b7fe640 1 -- 172.21.15.133:0/1477011526 >> v1:172.21.15.142:6789/0 conn(0x7f0a34071db0 legacy=0x7f0a340cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:37.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a2b7fe640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:37.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a2b7fe640 1 -- 172.21.15.133:0/1477011526 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3415a7d0 con 0x7f0a180036f0 2023-12-18T10:17:37.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a2b7fe640 1 -- 172.21.15.133:0/1477011526 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3415aab0 con 0x7f0a18007380 2023-12-18T10:17:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-18T10:17:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:37.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:37.951+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-18T10:17:38.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.155+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:38.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.155+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-18T10:17:38.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.155+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:38.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.155+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:38.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.155+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-18T10:17:38.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.559+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:38.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.559+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-18T10:17:38.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.559+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:38.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.559+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:38.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:38.559+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-18T10:17:39.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:39.363+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:39.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:39.363+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-18T10:17:39.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:39.363+0000 7f0a39432640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-18T10:17:39.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:39.363+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-18T10:17:39.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:39.363+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-18T10:17:40.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160701798 0 0) 0x7f0a3415a7d0 con 0x7f0a180036f0 2023-12-18T10:17:40.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a20003530 con 0x7f0a180036f0 2023-12-18T10:17:40.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455428199 0 0) 0x7f0a20003530 con 0x7f0a180036f0 2023-12-18T10:17:40.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 msgr2=0x7f0a18009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 --2- 172.21.15.133:0/1477011526 >> v2:172.21.15.142:3300/0 conn(0x7f0a18007380 0x7f0a18009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1800af00 con 0x7f0a180036f0 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f0a3000c570 con 0x7f0a180036f0 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 >> v1:172.21.15.133:6789/0 conn(0x7f0a180036f0 legacy=0x7f0a18005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a200039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a20004030 0x7f0a200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004de0 0x7f0a20005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3415aab0 con 0x7f0a20004de0 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2000ded0 con 0x7f0a20004030 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2000e090 con 0x7f0a34159fb0 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a3a434640 1 -- 172.21.15.133:0/1477011526 reap_dead start 2023-12-18T10:17:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a20004030 0x7f0a200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a3a434640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004de0 0x7f0a20005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.119+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a200039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a3a434640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 msgr2=0x7f0a200039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a3a434640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a200039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a3a434640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a20004030 msgr2=0x7f0a200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a3a434640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a20004030 0x7f0a200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a3a434640 1 -- 172.21.15.133:0/1477011526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20003530 con 0x7f0a20004de0 2023-12-18T10:17:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a39432640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a20004030 0x7f0a200047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:40.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a3a434640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004de0 0x7f0a20005260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a340722a0 tx=0x7f0a2c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f277124d08ae30 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:40.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c005d50 con 0x7f0a20004de0 2023-12-18T10:17:40.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c003980 con 0x7f0a20004de0 2023-12-18T10:17:40.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.123+0000 7f0a38c31640 1 -- 172.21.15.133:0/1477011526 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c003d30 con 0x7f0a20004de0 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 -- 172.21.15.133:0/1477011526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004de0 msgr2=0x7f0a20005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004de0 0x7f0a20005260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a340722a0 tx=0x7f0a2c01c3e0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 -- 172.21.15.133:0/1477011526 shutdown_connections 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004de0 0x7f0a20005260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a34159fb0 0x7f0a200039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 --2- 172.21.15.133:0/1477011526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a20004030 0x7f0a200047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 -- 172.21.15.133:0/1477011526 >> 172.21.15.133:0/1477011526 conn(0x7f0a3406a2a0 msgr2=0x7f0a340aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 -- 172.21.15.133:0/1477011526 shutdown_connections 2023-12-18T10:17:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 -- 172.21.15.133:0/1477011526 wait complete. 2023-12-18T10:17:40.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.127+0000 7f0a3be97640 1 Processor -- start 2023-12-18T10:17:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 -- start start 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004030 0x7f0a340c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a20004de0 0x7f0a340ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a34159fb0 0x7f0a340aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340c64e0 con 0x7f0a20004030 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340c4ff0 con 0x7f0a34159fb0 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340c8100 con 0x7f0a20004de0 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004030 0x7f0a340c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004030 0x7f0a340c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35390/0 (socket says 172.21.15.133:35390) 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 -- 172.21.15.133:0/1296181810 learned_addr learned my addr 172.21.15.133:0/1296181810 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:40.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39432640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a20004de0 0x7f0a340ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3a434640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a34159fb0 0x7f0a340aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 -- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a20004de0 msgr2=0x7f0a340ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a20004de0 0x7f0a340ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 -- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a34159fb0 msgr2=0x7f0a340aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a34159fb0 0x7f0a340aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 -- 172.21.15.133:0/1296181810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a340c5860 con 0x7f0a20004030 2023-12-18T10:17:40.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39432640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a20004de0 0x7f0a340ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:40.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a39c33640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004030 0x7f0a340c4ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000c670 tx=0x7f0a30018810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:40.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a2a7fc640 1 -- 172.21.15.133:0/1296181810 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30004440 con 0x7f0a20004030 2023-12-18T10:17:40.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a2a7fc640 1 -- 172.21.15.133:0/1296181810 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3000c040 con 0x7f0a20004030 2023-12-18T10:17:40.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a2a7fc640 1 -- 172.21.15.133:0/1296181810 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30003860 con 0x7f0a20004030 2023-12-18T10:17:40.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a340c5b40 con 0x7f0a20004030 2023-12-18T10:17:40.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a340c6100 con 0x7f0a20004030 2023-12-18T10:17:40.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a2a7fc640 1 -- 172.21.15.133:0/1296181810 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0a30003cc0 con 0x7f0a20004030 2023-12-18T10:17:40.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a2a7fc640 1 -- 172.21.15.133:0/1296181810 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0a30021cc0 con 0x7f0a20004030 2023-12-18T10:17:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.131+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3404e000 con 0x7f0a20004030 2023-12-18T10:17:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.155+0000 7f0a2a7fc640 1 -- 172.21.15.133:0/1296181810 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f0a30040b40 con 0x7f0a20004030 2023-12-18T10:17:40.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.219+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0a34071040 con 0x7f0a20004030 2023-12-18T10:17:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a2a7fc640 1 -- 172.21.15.133:0/1296181810 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0a3002f070 con 0x7f0a20004030 2023-12-18T10:17:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:adjusted tunables profile to default 2023-12-18T10:17:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004030 msgr2=0x7f0a340c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004030 0x7f0a340c4ab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000c670 tx=0x7f0a30018810 comp rx=0 tx=0).stop 2023-12-18T10:17:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 shutdown_connections 2023-12-18T10:17:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a34159fb0 0x7f0a340aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a20004de0 0x7f0a340ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 --2- 172.21.15.133:0/1296181810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20004030 0x7f0a340c4ab0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 >> 172.21.15.133:0/1296181810 conn(0x7f0a3406a2a0 msgr2=0x7f0a34155ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:40.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 shutdown_connections 2023-12-18T10:17:40.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:40.223+0000 7f0a3be97640 1 -- 172.21.15.133:0/1296181810 wait complete. 2023-12-18T10:17:40.250 INFO:tasks.ceph:check_enable_crimson: False 2023-12-18T10:17:40.251 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-18T10:17:40.251 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:40.251 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-18T10:17:40.272 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:40.272 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-18T10:17:40.339 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:40.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-18T10:17:40.359 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:40.355+0000 7f618884d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-18T10:17:40.380 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:17:40.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-18T10:17:40.447 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:40.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-18T10:17:40.471 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:40.471 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-18T10:17:40.537 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:40.538 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-18T10:17:40.601 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:17:40.601 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-18T10:17:40.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 4bc3d1af-2be3-4a30-a186-eef044c37551 0 2023-12-18T10:17:40.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29ad718640 1 Processor -- start 2023-12-18T10:17:40.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29ad718640 1 -- start start 2023-12-18T10:17:40.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29ad718640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29a81598d0 0x7f29a80ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29ad718640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a80ce8d0 0x7f29a8070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29ad718640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a80c9730 con 0x7f29a8153020 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29ad718640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a80ced60 con 0x7f29a81598d0 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29ad718640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a80c8e00 con 0x7f29a80ce8d0 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a67fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29a81598d0 0x7f29a80ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a77fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a80ce8d0 0x7f29a8070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a67fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29a81598d0 0x7f29a80ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33114/0 (socket says 172.21.15.142:33114) 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a67fc640 1 -- 172.21.15.142:0/891301525 learned_addr learned my addr 172.21.15.142:0/891301525 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:40.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a77fe640 1 -- 172.21.15.142:0/891301525 >> v2:172.21.15.142:3300/0 conn(0x7f29a81598d0 msgr2=0x7f29a80ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:40.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a77fe640 1 --2- 172.21.15.142:0/891301525 >> v2:172.21.15.142:3300/0 conn(0x7f29a81598d0 0x7f29a80ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a77fe640 1 -- 172.21.15.142:0/891301525 >> v1:172.21.15.133:6789/0 conn(0x7f29a8153020 legacy=0x7f29a80c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a77fe640 1 -- 172.21.15.142:0/891301525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a80c90e0 con 0x7f29a80ce8d0 2023-12-18T10:17:40.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.846+0000 7f29a67fc640 1 --2- 172.21.15.142:0/891301525 >> v2:172.21.15.142:3300/0 conn(0x7f29a81598d0 0x7f29a80ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:40.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29a77fe640 1 --2- 172.21.15.142:0/891301525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a80ce8d0 0x7f29a8070590 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f29a000aea0 tx=0x7f29a001d900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e85ff87c47e90856 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:40.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29a5ffb640 1 -- 172.21.15.142:0/891301525 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a000a2d0 con 0x7f29a80ce8d0 2023-12-18T10:17:40.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29a5ffb640 1 -- 172.21.15.142:0/891301525 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00a6800 con 0x7f29a80ce8d0 2023-12-18T10:17:40.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29a5ffb640 1 -- 172.21.15.142:0/891301525 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00a6b90 con 0x7f29a80ce8d0 2023-12-18T10:17:40.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29ad718640 1 -- 172.21.15.142:0/891301525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a80ce8d0 msgr2=0x7f29a8070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29ad718640 1 --2- 172.21.15.142:0/891301525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a80ce8d0 0x7f29a8070590 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f29a000aea0 tx=0x7f29a001d900 comp rx=0 tx=0).stop 2023-12-18T10:17:40.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29ad718640 1 -- 172.21.15.142:0/891301525 shutdown_connections 2023-12-18T10:17:40.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29ad718640 1 --2- 172.21.15.142:0/891301525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a80ce8d0 0x7f29a8070590 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29ad718640 1 --2- 172.21.15.142:0/891301525 >> v2:172.21.15.142:3300/0 conn(0x7f29a81598d0 0x7f29a80ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29ad718640 1 -- 172.21.15.142:0/891301525 >> 172.21.15.142:0/891301525 conn(0x7f29a806a2a0 msgr2=0x7f29a80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:40.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29ad718640 1 -- 172.21.15.142:0/891301525 shutdown_connections 2023-12-18T10:17:40.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.850+0000 7f29ad718640 1 -- 172.21.15.142:0/891301525 wait complete. 2023-12-18T10:17:40.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 Processor -- start 2023-12-18T10:17:40.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 -- start start 2023-12-18T10:17:40.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a80ce8d0 0x7f29a80c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29a8153020 0x7f29a8151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a81598d0 0x7f29a8157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:40.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a80c6fd0 con 0x7f29a8153020 2023-12-18T10:17:40.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a80c66a0 con 0x7f29a80ce8d0 2023-12-18T10:17:40.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a81562c0 con 0x7f29a81598d0 2023-12-18T10:17:40.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a80ce8d0 0x7f29a80c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a77fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a81598d0 0x7f29a8157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a80ce8d0 0x7f29a80c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33124/0 (socket says 172.21.15.142:33124) 2023-12-18T10:17:40.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 -- 172.21.15.142:0/3133906260 learned_addr learned my addr 172.21.15.142:0/3133906260 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:40.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a67fc640 1 --2- 172.21.15.142:0/3133906260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29a8153020 0x7f29a8151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 -- 172.21.15.142:0/3133906260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a81598d0 msgr2=0x7f29a8157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 --2- 172.21.15.142:0/3133906260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a81598d0 0x7f29a8157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 -- 172.21.15.142:0/3133906260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29a8153020 msgr2=0x7f29a8151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 --2- 172.21.15.142:0/3133906260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29a8153020 0x7f29a8151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 -- 172.21.15.142:0/3133906260 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0094d0 con 0x7f29a80ce8d0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29a6ffd640 1 --2- 172.21.15.142:0/3133906260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a80ce8d0 0x7f29a80c73f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f299800c530 tx=0x7f299800c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f298f7fe640 1 -- 172.21.15.142:0/3133906260 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998005220 con 0x7f29a80ce8d0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f298f7fe640 1 -- 172.21.15.142:0/3133906260 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998005380 con 0x7f29a80ce8d0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f298f7fe640 1 -- 172.21.15.142:0/3133906260 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998007270 con 0x7f29a80ce8d0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a000ab80 con 0x7f29a80ce8d0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a80c6bf0 con 0x7f29a80ce8d0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f298f7fe640 1 -- 172.21.15.142:0/3133906260 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f29980067e0 con 0x7f29a80ce8d0 2023-12-18T10:17:40.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f298f7fe640 1 -- 172.21.15.142:0/3133906260 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2998012a30 con 0x7f29a80ce8d0 2023-12-18T10:17:40.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.854+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a804e000 con 0x7f29a80ce8d0 2023-12-18T10:17:40.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.866+0000 7f298f7fe640 1 -- 172.21.15.142:0/3133906260 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f2998016020 con 0x7f29a80ce8d0 2023-12-18T10:17:40.914 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:40.907+0000 7f618884d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-18T10:17:40.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.930+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4bc3d1af-2be3-4a30-a186-eef044c37551", "id": 0} v 0) v1 -- 0x7f29a80cd780 con 0x7f29a80ce8d0 2023-12-18T10:17:40.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f298f7fe640 1 -- 172.21.15.142:0/3133906260 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4bc3d1af-2be3-4a30-a186-eef044c37551", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f299802a0b0 con 0x7f29a80ce8d0 2023-12-18T10:17:40.945 INFO:teuthology.orchestra.run.smithi142.stdout:0 2023-12-18T10:17:40.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a80ce8d0 msgr2=0x7f29a80c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:40.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 --2- 172.21.15.142:0/3133906260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a80ce8d0 0x7f29a80c73f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f299800c530 tx=0x7f299800c9f0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 shutdown_connections 2023-12-18T10:17:40.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 --2- 172.21.15.142:0/3133906260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29a81598d0 0x7f29a8157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 --2- 172.21.15.142:0/3133906260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29a8153020 0x7f29a8151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 --2- 172.21.15.142:0/3133906260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a80ce8d0 0x7f29a80c73f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:40.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 >> 172.21.15.142:0/3133906260 conn(0x7f29a806a2a0 msgr2=0x7f29a815a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:40.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 shutdown_connections 2023-12-18T10:17:40.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:40.942+0000 7f29ad718640 1 -- 172.21.15.142:0/3133906260 wait complete. 2023-12-18T10:17:40.966 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new ce868f18-cb40-44a9-a22d-96e4e89fae3d 1 2023-12-18T10:17:41.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.098+0000 7f0e220d1640 1 Processor -- start 2023-12-18T10:17:41.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.098+0000 7f0e220d1640 1 -- start start 2023-12-18T10:17:41.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e220d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0d2a40 0x7f0e1c0b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e220d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c0b3750 con 0x7f0e1c15c860 2023-12-18T10:17:41.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e220d1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c0d13e0 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e220d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0d1640 con 0x7f0e1c0d2a40 2023-12-18T10:17:41.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1affd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0e1c0b1a20 0x7f0e1c0d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42242/0 (socket says 172.21.15.142:42242) 2023-12-18T10:17:41.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0d2a40 0x7f0e1c0b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1affd640 1 -- 172.21.15.142:0/4153043426 learned_addr learned my addr 172.21.15.142:0/4153043426 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-12-18T10:17:41.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1a7fc640 1 -- 172.21.15.142:0/4153043426 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783902439 0 0) 0x7f0e1c0d13e0 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1bfff640 1 -- 172.21.15.142:0/4153043426 >> v1:172.21.15.142:6789/0 conn(0x7f0e1c0b1a20 legacy=0x7f0e1c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1bfff640 1 -- 172.21.15.142:0/4153043426 >> v1:172.21.15.133:6789/0 conn(0x7f0e1c15c860 legacy=0x7f0e1c0d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1bfff640 1 -- 172.21.15.142:0/4153043426 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c0b2450 con 0x7f0e1c0d2a40 2023-12-18T10:17:41.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1bfff640 1 --2- 172.21.15.142:0/4153043426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0d2a40 0x7f0e1c0b3210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009dc0 tx=0x7f0e1401c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ee814e8f1e4b5a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:41.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1a7fc640 1 -- 172.21.15.142:0/4153043426 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e140a5810 con 0x7f0e1c0d2a40 2023-12-18T10:17:41.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1a7fc640 1 -- 172.21.15.142:0/4153043426 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e140a5970 con 0x7f0e1c0d2a40 2023-12-18T10:17:41.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.102+0000 7f0e1a7fc640 1 -- 172.21.15.142:0/4153043426 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e140a5d00 con 0x7f0e1c0d2a40 2023-12-18T10:17:41.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- 172.21.15.142:0/4153043426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0d2a40 msgr2=0x7f0e1c0b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 --2- 172.21.15.142:0/4153043426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0d2a40 0x7f0e1c0b3210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009dc0 tx=0x7f0e1401c7d0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- 172.21.15.142:0/4153043426 shutdown_connections 2023-12-18T10:17:41.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 --2- 172.21.15.142:0/4153043426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0d2a40 0x7f0e1c0b3210 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- 172.21.15.142:0/4153043426 >> 172.21.15.142:0/4153043426 conn(0x7f0e1c08c130 msgr2=0x7f0e1c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:41.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- 172.21.15.142:0/4153043426 shutdown_connections 2023-12-18T10:17:41.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- 172.21.15.142:0/4153043426 wait complete. 2023-12-18T10:17:41.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 Processor -- start 2023-12-18T10:17:41.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- start start 2023-12-18T10:17:41.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0b1a20 0x7f0e1c0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c0d2a40 0x7f0e1c14a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1c15c860 0x7f0e1c14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c14f130 con 0x7f0e1c15c860 2023-12-18T10:17:41.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0cc580 con 0x7f0e1c0d2a40 2023-12-18T10:17:41.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e220d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c14e520 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e1affd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c0d2a40 0x7f0e1c14a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e1b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0b1a20 0x7f0e1c0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e1affd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c0d2a40 0x7f0e1c14a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33162/0 (socket says 172.21.15.142:33162) 2023-12-18T10:17:41.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e1affd640 1 -- 172.21.15.142:0/4134831091 learned_addr learned my addr 172.21.15.142:0/4134831091 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:41.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.106+0000 7f0e1bfff640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1c15c860 0x7f0e1c14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e1b7fe640 1 -- 172.21.15.142:0/4134831091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c0d2a40 msgr2=0x7f0e1c14a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e1b7fe640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c0d2a40 0x7f0e1c14a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e1b7fe640 1 -- 172.21.15.142:0/4134831091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1c15c860 msgr2=0x7f0e1c14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e1b7fe640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1c15c860 0x7f0e1c14f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e1b7fe640 1 -- 172.21.15.142:0/4134831091 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14009a70 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e1affd640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c0d2a40 0x7f0e1c14a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e1b7fe640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0b1a20 0x7f0e1c0cc040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c750 tx=0x7f0e0c00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e03fff640 1 -- 172.21.15.142:0/4134831091 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0050d0 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e03fff640 1 -- 172.21.15.142:0/4134831091 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c005230 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1c14e800 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e03fff640 1 -- 172.21.15.142:0/4134831091 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c00a850 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c14edc0 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e03fff640 1 -- 172.21.15.142:0/4134831091 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0e0c00acb0 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e03fff640 1 -- 172.21.15.142:0/4134831091 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0e0c0124b0 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.110+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1c04e000 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.114+0000 7f0e03fff640 1 -- 172.21.15.142:0/4134831091 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f0e1c0b3750 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.128 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:41.122+0000 7f4d92a4b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-18T10:17:41.130 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:41.123+0000 7f618884d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-18T10:17:41.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.182+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ce868f18-cb40-44a9-a22d-96e4e89fae3d", "id": 1} v 0) v1 -- 0x7f0e1c0cf9a0 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e03fff640 1 -- 172.21.15.142:0/4134831091 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce868f18-cb40-44a9-a22d-96e4e89fae3d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e0c0037a0 con 0x7f0e1c0b1a20 2023-12-18T10:17:41.194 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-18T10:17:41.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0b1a20 msgr2=0x7f0e1c0cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0b1a20 0x7f0e1c0cc040 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c00c750 tx=0x7f0e0c00cc10 comp rx=0 tx=0).stop 2023-12-18T10:17:41.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 shutdown_connections 2023-12-18T10:17:41.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e1c15c860 0x7f0e1c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e1c0d2a40 0x7f0e1c14a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 --2- 172.21.15.142:0/4134831091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e1c0b1a20 0x7f0e1c0cc040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 >> 172.21.15.142:0/4134831091 conn(0x7f0e1c08c130 msgr2=0x7f0e1c0cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:41.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 shutdown_connections 2023-12-18T10:17:41.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.190+0000 7f0e220d1640 1 -- 172.21.15.142:0/4134831091 wait complete. 2023-12-18T10:17:41.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new b32d4100-94ff-42fc-a875-23edfda1f1ce 2 2023-12-18T10:17:41.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abe96d640 1 Processor -- start 2023-12-18T10:17:41.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abe96d640 1 -- start start 2023-12-18T10:17:41.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abe96d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab815cae0 0x7f1ab80d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abe96d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ab80cf880 0x7f1ab80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abe96d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab815cec0 con 0x7f1ab80cde90 2023-12-18T10:17:41.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abe96d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80d0530 con 0x7f1ab80cf880 2023-12-18T10:17:41.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abe96d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80d0810 con 0x7f1ab815cae0 2023-12-18T10:17:41.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab815cae0 0x7f1ab80d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abcf0a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ab80cf880 0x7f1ab80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab815cae0 0x7f1ab80d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53824/0 (socket says 172.21.15.142:53824) 2023-12-18T10:17:41.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abcf0a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ab80cf880 0x7f1ab80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33170/0 (socket says 172.21.15.142:33170) 2023-12-18T10:17:41.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1ab7fff640 1 -- 172.21.15.142:0/2024234708 learned_addr learned my addr 172.21.15.142:0/2024234708 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:41.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abcf0a640 1 -- 172.21.15.142:0/2024234708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab815cae0 msgr2=0x7f1ab80d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:41.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abcf0a640 1 --2- 172.21.15.142:0/2024234708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab815cae0 0x7f1ab80d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abcf0a640 1 -- 172.21.15.142:0/2024234708 >> v1:172.21.15.133:6789/0 conn(0x7f1ab80cde90 legacy=0x7f1ab80cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1abcf0a640 1 -- 172.21.15.142:0/2024234708 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80d0af0 con 0x7f1ab80cf880 2023-12-18T10:17:41.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.346+0000 7f1ab7fff640 1 --2- 172.21.15.142:0/2024234708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab815cae0 0x7f1ab80d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:41.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abcf0a640 1 --2- 172.21.15.142:0/2024234708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80ce2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009d90 tx=0x7f1ab001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d7694ff92882d01 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:41.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1ab6ffd640 1 -- 172.21.15.142:0/2024234708 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5970 con 0x7f1ab80cf880 2023-12-18T10:17:41.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1ab6ffd640 1 -- 172.21.15.142:0/2024234708 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00a5ad0 con 0x7f1ab80cf880 2023-12-18T10:17:41.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1ab6ffd640 1 -- 172.21.15.142:0/2024234708 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5e60 con 0x7f1ab80cf880 2023-12-18T10:17:41.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abe96d640 1 -- 172.21.15.142:0/2024234708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 msgr2=0x7f1ab80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abe96d640 1 --2- 172.21.15.142:0/2024234708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80ce2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009d90 tx=0x7f1ab001c920 comp rx=0 tx=0).stop 2023-12-18T10:17:41.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abe96d640 1 -- 172.21.15.142:0/2024234708 shutdown_connections 2023-12-18T10:17:41.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abe96d640 1 --2- 172.21.15.142:0/2024234708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80ce2f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abe96d640 1 --2- 172.21.15.142:0/2024234708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab815cae0 0x7f1ab80d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abe96d640 1 -- 172.21.15.142:0/2024234708 >> 172.21.15.142:0/2024234708 conn(0x7f1ab8089fb0 msgr2=0x7f1ab80d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:41.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abe96d640 1 -- 172.21.15.142:0/2024234708 shutdown_connections 2023-12-18T10:17:41.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.350+0000 7f1abe96d640 1 -- 172.21.15.142:0/2024234708 wait complete. 2023-12-18T10:17:41.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 Processor -- start 2023-12-18T10:17:41.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 -- start start 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab80cde90 0x7f1ab81559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab815cae0 0x7f1ab80b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80b0bf0 con 0x7f1ab815cae0 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80c7900 con 0x7f1ab80cf880 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80b0600 con 0x7f1ab80cde90 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab80cde90 0x7f1ab81559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab80cde90 0x7f1ab81559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53840/0 (socket says 172.21.15.142:53840) 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab7fff640 1 -- 172.21.15.142:0/2713303676 learned_addr learned my addr 172.21.15.142:0/2713303676 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33182/0 (socket says 172.21.15.142:33182) 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abcf0a640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab815cae0 0x7f1ab80b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab77fe640 1 -- 172.21.15.142:0/2713303676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab80cde90 msgr2=0x7f1ab81559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab77fe640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab80cde90 0x7f1ab81559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab77fe640 1 -- 172.21.15.142:0/2713303676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab815cae0 msgr2=0x7f1ab80b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab77fe640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab815cae0 0x7f1ab80b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab77fe640 1 -- 172.21.15.142:0/2713303676 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa8009480 con 0x7f1ab80cf880 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abcf0a640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab815cae0 0x7f1ab80b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab77fe640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80c8cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1aac001ec0 tx=0x7f1aac00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab4ff9640 1 -- 172.21.15.142:0/2713303676 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0052d0 con 0x7f1ab80cf880 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab4ff9640 1 -- 172.21.15.142:0/2713303676 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac005430 con 0x7f1ab80cf880 2023-12-18T10:17:41.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab4ff9640 1 -- 172.21.15.142:0/2713303676 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac003840 con 0x7f1ab80cf880 2023-12-18T10:17:41.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab0009a70 con 0x7f1ab80cf880 2023-12-18T10:17:41.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab80c7380 con 0x7f1ab80cf880 2023-12-18T10:17:41.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab4ff9640 1 -- 172.21.15.142:0/2713303676 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1aac003ca0 con 0x7f1ab80cf880 2023-12-18T10:17:41.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.354+0000 7f1ab4ff9640 1 -- 172.21.15.142:0/2713303676 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f1aac0119b0 con 0x7f1ab80cf880 2023-12-18T10:17:41.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.358+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab80b0d30 con 0x7f1ab80cf880 2023-12-18T10:17:41.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.358+0000 7f1ab4ff9640 1 -- 172.21.15.142:0/2713303676 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f1ab80b0d30 con 0x7f1ab80cf880 2023-12-18T10:17:41.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.422+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b32d4100-94ff-42fc-a875-23edfda1f1ce", "id": 2} v 0) v1 -- 0x7f1ab80b1550 con 0x7f1ab80cf880 2023-12-18T10:17:41.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1ab4ff9640 1 -- 172.21.15.142:0/2713303676 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b32d4100-94ff-42fc-a875-23edfda1f1ce", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1aac021060 con 0x7f1ab80cf880 2023-12-18T10:17:41.437 INFO:teuthology.orchestra.run.smithi142.stdout:2 2023-12-18T10:17:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 msgr2=0x7f1ab80c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80c8cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1aac001ec0 tx=0x7f1aac00c890 comp rx=0 tx=0).stop 2023-12-18T10:17:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 shutdown_connections 2023-12-18T10:17:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab815cae0 0x7f1ab80b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ab80cf880 0x7f1ab80c8cf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 --2- 172.21.15.142:0/2713303676 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ab80cde90 0x7f1ab81559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 >> 172.21.15.142:0/2713303676 conn(0x7f1ab8089fb0 msgr2=0x7f1ab80b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 shutdown_connections 2023-12-18T10:17:41.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.434+0000 7f1abe96d640 1 -- 172.21.15.142:0/2713303676 wait complete. 2023-12-18T10:17:41.456 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new df872fbf-221e-4007-9058-ebd940ace311 3 2023-12-18T10:17:41.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d484b6640 1 Processor -- start 2023-12-18T10:17:41.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d484b6640 1 -- start start 2023-12-18T10:17:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d484b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d4015cae0 0x7f4d400d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d484b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d484b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4015cec0 con 0x7f4d400cde90 2023-12-18T10:17:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d484b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d400d0530 con 0x7f4d4015cae0 2023-12-18T10:17:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d484b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400d0810 con 0x7f4d400cf880 2023-12-18T10:17:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d45a51640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4d400cde90 0x7f4d400cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42244/0 (socket says 172.21.15.142:42244) 2023-12-18T10:17:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d45a51640 1 -- 172.21.15.142:0/3753818854 learned_addr learned my addr 172.21.15.142:0/3753818854 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-12-18T10:17:41.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d46a53640 1 --2- 172.21.15.142:0/3753818854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d46252640 1 --2- 172.21.15.142:0/3753818854 >> v2:172.21.15.133:3300/0 conn(0x7f4d4015cae0 0x7f4d400d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d45250640 1 -- 172.21.15.142:0/3753818854 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939023148 0 0) 0x7f4d4015cec0 con 0x7f4d400cde90 2023-12-18T10:17:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d45250640 1 -- 172.21.15.142:0/3753818854 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d2c003530 con 0x7f4d400cde90 2023-12-18T10:17:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d46a53640 1 -- 172.21.15.142:0/3753818854 >> v2:172.21.15.133:3300/0 conn(0x7f4d4015cae0 msgr2=0x7f4d400d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d46a53640 1 --2- 172.21.15.142:0/3753818854 >> v2:172.21.15.133:3300/0 conn(0x7f4d4015cae0 0x7f4d400d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d46a53640 1 -- 172.21.15.142:0/3753818854 >> v1:172.21.15.142:6789/0 conn(0x7f4d400cde90 legacy=0x7f4d400cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.590+0000 7f4d46a53640 1 -- 172.21.15.142:0/3753818854 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400d0af0 con 0x7f4d400cf880 2023-12-18T10:17:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d46a53640 1 --2- 172.21.15.142:0/3753818854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400ce2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009d90 tx=0x7f4d3801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db16ccc5ff63f474 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d45250640 1 -- 172.21.15.142:0/3753818854 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380a5970 con 0x7f4d400cf880 2023-12-18T10:17:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d45250640 1 -- 172.21.15.142:0/3753818854 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d380a5ad0 con 0x7f4d400cf880 2023-12-18T10:17:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d45250640 1 -- 172.21.15.142:0/3753818854 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380a5e40 con 0x7f4d400cf880 2023-12-18T10:17:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d484b6640 1 -- 172.21.15.142:0/3753818854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 msgr2=0x7f4d400ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d484b6640 1 --2- 172.21.15.142:0/3753818854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400ce2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009d90 tx=0x7f4d3801c920 comp rx=0 tx=0).stop 2023-12-18T10:17:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d484b6640 1 -- 172.21.15.142:0/3753818854 shutdown_connections 2023-12-18T10:17:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d484b6640 1 --2- 172.21.15.142:0/3753818854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400ce2f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d484b6640 1 --2- 172.21.15.142:0/3753818854 >> v2:172.21.15.133:3300/0 conn(0x7f4d4015cae0 0x7f4d400d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d484b6640 1 -- 172.21.15.142:0/3753818854 >> 172.21.15.142:0/3753818854 conn(0x7f4d40089fb0 msgr2=0x7f4d400d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d484b6640 1 -- 172.21.15.142:0/3753818854 shutdown_connections 2023-12-18T10:17:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.594+0000 7f4d484b6640 1 -- 172.21.15.142:0/3753818854 wait complete. 2023-12-18T10:17:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 Processor -- start 2023-12-18T10:17:41.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 -- start start 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d400cde90 0x7f4d4015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4015cae0 0x7f4d400c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4015df80 con 0x7f4d400cde90 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4015d970 con 0x7f4d4015cae0 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4015f990 con 0x7f4d400cf880 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d45a51640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4015cae0 0x7f4d400c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4015cae0 0x7f4d400c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33198/0 (socket says 172.21.15.142:33198) 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 -- 172.21.15.142:0/2420750409 learned_addr learned my addr 172.21.15.142:0/2420750409 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:41.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d45a51640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53850/0 (socket says 172.21.15.142:53850) 2023-12-18T10:17:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46252640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d400cde90 0x7f4d4015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 -- 172.21.15.142:0/2420750409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 msgr2=0x7f4d400c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 -- 172.21.15.142:0/2420750409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d400cde90 msgr2=0x7f4d4015f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d400cde90 0x7f4d4015f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 -- 172.21.15.142:0/2420750409 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d38009a70 con 0x7f4d4015cae0 2023-12-18T10:17:41.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d46a53640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4015cae0 0x7f4d400c7e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4d3801a550 tx=0x7f4d380196c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d36ffd640 1 -- 172.21.15.142:0/2420750409 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380aed30 con 0x7f4d4015cae0 2023-12-18T10:17:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d36ffd640 1 -- 172.21.15.142:0/2420750409 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d380aee90 con 0x7f4d4015cae0 2023-12-18T10:17:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4015dc10 con 0x7f4d4015cae0 2023-12-18T10:17:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d36ffd640 1 -- 172.21.15.142:0/2420750409 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380b7610 con 0x7f4d4015cae0 2023-12-18T10:17:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4015fc70 con 0x7f4d4015cae0 2023-12-18T10:17:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d36ffd640 1 -- 172.21.15.142:0/2420750409 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d380b4050 con 0x7f4d4015cae0 2023-12-18T10:17:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.598+0000 7f4d36ffd640 1 -- 172.21.15.142:0/2420750409 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4d380c2b10 con 0x7f4d4015cae0 2023-12-18T10:17:41.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.602+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4004e000 con 0x7f4d4015cae0 2023-12-18T10:17:41.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.602+0000 7f4d36ffd640 1 -- 172.21.15.142:0/2420750409 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f4d380c7060 con 0x7f4d4015cae0 2023-12-18T10:17:41.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.666+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df872fbf-221e-4007-9058-ebd940ace311", "id": 3} v 0) v1 -- 0x7f4d4015e0c0 con 0x7f4d4015cae0 2023-12-18T10:17:41.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.674+0000 7f4d36ffd640 1 -- 172.21.15.142:0/2420750409 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df872fbf-221e-4007-9058-ebd940ace311", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4d380bd070 con 0x7f4d4015cae0 2023-12-18T10:17:41.681 INFO:teuthology.orchestra.run.smithi142.stdout:3 2023-12-18T10:17:41.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4015cae0 msgr2=0x7f4d400c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4015cae0 0x7f4d400c7e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4d3801a550 tx=0x7f4d380196c0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 shutdown_connections 2023-12-18T10:17:41.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d4015cae0 0x7f4d400c7e40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d400cf880 0x7f4d400c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 --2- 172.21.15.142:0/2420750409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d400cde90 0x7f4d4015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 >> 172.21.15.142:0/2420750409 conn(0x7f4d40089fb0 msgr2=0x7f4d401585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:41.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 shutdown_connections 2023-12-18T10:17:41.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.678+0000 7f4d484b6640 1 -- 172.21.15.142:0/2420750409 wait complete. 2023-12-18T10:17:41.688 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:41.682+0000 7f4d92a4b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-18T10:17:41.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 3115d287-cde8-4aad-8efb-f82780bbf5aa 4 2023-12-18T10:17:41.761 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:41.755+0000 7f618884d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-18T10:17:41.823 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:41.819+0000 7f618884d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-18T10:17:41.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.830+0000 7fbc3f254640 1 Processor -- start 2023-12-18T10:17:41.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3f254640 1 -- start start 2023-12-18T10:17:41.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3f254640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc380cd520 0x7fbc380d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3f254640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc3815ca70 0x7fbc380d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3f254640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380d17c0 con 0x7fbc3815c690 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3f254640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380b1c20 con 0x7fbc3815ca70 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3f254640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380d15c0 con 0x7fbc380cd520 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3da51640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc380cd520 0x7fbc380d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3da51640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc380cd520 0x7fbc380d2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33206/0 (socket says 172.21.15.142:33206) 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3da51640 1 -- 172.21.15.142:0/539988681 learned_addr learned my addr 172.21.15.142:0/539988681 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3ea53640 1 --2- 172.21.15.142:0/539988681 >> v2:172.21.15.133:3300/0 conn(0x7fbc3815ca70 0x7fbc380d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3da51640 1 -- 172.21.15.142:0/539988681 >> v2:172.21.15.133:3300/0 conn(0x7fbc3815ca70 msgr2=0x7fbc380d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3da51640 1 --2- 172.21.15.142:0/539988681 >> v2:172.21.15.133:3300/0 conn(0x7fbc3815ca70 0x7fbc380d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3da51640 1 -- 172.21.15.142:0/539988681 >> v1:172.21.15.133:6789/0 conn(0x7fbc3815c690 legacy=0x7fbc380cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.834+0000 7fbc3da51640 1 -- 172.21.15.142:0/539988681 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380d1cb0 con 0x7fbc380cd520 2023-12-18T10:17:41.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3da51640 1 --2- 172.21.15.142:0/539988681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380d2a70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc380cf990 tx=0x7fbc2801ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53ab20bec13a90a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3d250640 1 -- 172.21.15.142:0/539988681 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280a89f0 con 0x7fbc380cd520 2023-12-18T10:17:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3d250640 1 -- 172.21.15.142:0/539988681 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc280a8b50 con 0x7fbc380cd520 2023-12-18T10:17:41.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3d250640 1 -- 172.21.15.142:0/539988681 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280b0440 con 0x7fbc380cd520 2023-12-18T10:17:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3f254640 1 -- 172.21.15.142:0/539988681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 msgr2=0x7fbc380d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3f254640 1 --2- 172.21.15.142:0/539988681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380d2a70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbc380cf990 tx=0x7fbc2801ecf0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3f254640 1 -- 172.21.15.142:0/539988681 shutdown_connections 2023-12-18T10:17:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3f254640 1 --2- 172.21.15.142:0/539988681 >> v2:172.21.15.133:3300/0 conn(0x7fbc3815ca70 0x7fbc380d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3f254640 1 --2- 172.21.15.142:0/539988681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380d2a70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3f254640 1 -- 172.21.15.142:0/539988681 >> 172.21.15.142:0/539988681 conn(0x7fbc380717d0 msgr2=0x7fbc38071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3f254640 1 -- 172.21.15.142:0/539988681 shutdown_connections 2023-12-18T10:17:41.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.838+0000 7fbc3f254640 1 -- 172.21.15.142:0/539988681 wait complete. 2023-12-18T10:17:41.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 Processor -- start 2023-12-18T10:17:41.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 -- start start 2023-12-18T10:17:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3815c690 0x7fbc381e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc3815ca70 0x7fbc381e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381e7460 con 0x7fbc3815ca70 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381e7740 con 0x7fbc380cd520 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc381e7a20 con 0x7fbc3815c690 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3da51640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3815c690 0x7fbc381e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33214/0 (socket says 172.21.15.142:33214) 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3da51640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3815c690 0x7fbc381e6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53856/0 (socket says 172.21.15.142:53856) 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 -- 172.21.15.142:0/1621444834 learned_addr learned my addr 172.21.15.142:0/1621444834 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3ea53640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc3815ca70 0x7fbc381e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 -- 172.21.15.142:0/1621444834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3815c690 msgr2=0x7fbc381e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3815c690 0x7fbc381e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 -- 172.21.15.142:0/1621444834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc3815ca70 msgr2=0x7fbc381e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc3815ca70 0x7fbc381e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 -- 172.21.15.142:0/1621444834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280094d0 con 0x7fbc380cd520 2023-12-18T10:17:41.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3da51640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3815c690 0x7fbc381e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:41.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3e252640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380c8c30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400c500 tx=0x7fbc3400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:41.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc2effd640 1 -- 172.21.15.142:0/1621444834 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34005220 con 0x7fbc380cd520 2023-12-18T10:17:41.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc2effd640 1 -- 172.21.15.142:0/1621444834 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34005380 con 0x7fbc380cd520 2023-12-18T10:17:41.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc2effd640 1 -- 172.21.15.142:0/1621444834 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34007270 con 0x7fbc380cd520 2023-12-18T10:17:41.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc381e7d00 con 0x7fbc380cd520 2023-12-18T10:17:41.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc381e7170 con 0x7fbc380cd520 2023-12-18T10:17:41.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc2effd640 1 -- 172.21.15.142:0/1621444834 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbc340067e0 con 0x7fbc380cd520 2023-12-18T10:17:41.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc2effd640 1 -- 172.21.15.142:0/1621444834 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fbc340129a0 con 0x7fbc380cd520 2023-12-18T10:17:41.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.842+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380d1f70 con 0x7fbc380cd520 2023-12-18T10:17:41.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.846+0000 7fbc2effd640 1 -- 172.21.15.142:0/1621444834 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fbc380d1f70 con 0x7fbc380cd520 2023-12-18T10:17:41.884 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:41.879+0000 7f618884d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-18T10:17:41.888 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:41.882+0000 7f4d92a4b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-18T10:17:41.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.910+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3115d287-cde8-4aad-8efb-f82780bbf5aa", "id": 4} v 0) v1 -- 0x7fbc3804e000 con 0x7fbc380cd520 2023-12-18T10:17:41.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.918+0000 7fbc2effd640 1 -- 172.21.15.142:0/1621444834 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3115d287-cde8-4aad-8efb-f82780bbf5aa", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbc3402a0b0 con 0x7fbc380cd520 2023-12-18T10:17:41.924 INFO:teuthology.orchestra.run.smithi142.stdout:4 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 msgr2=0x7fbc380c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380c8c30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400c500 tx=0x7fbc3400c9c0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 shutdown_connections 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc3815ca70 0x7fbc381e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc3815c690 0x7fbc381e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 --2- 172.21.15.142:0/1621444834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc380cd520 0x7fbc380c8c30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 >> 172.21.15.142:0/1621444834 conn(0x7fbc380717d0 msgr2=0x7fbc3815f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 shutdown_connections 2023-12-18T10:17:41.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:41.922+0000 7fbc3f254640 1 -- 172.21.15.142:0/1621444834 wait complete. 2023-12-18T10:17:41.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new c9471f90-81ae-47e0-9227-aad21906cfd2 5 2023-12-18T10:17:41.973 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:41.967+0000 7f618884d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-18T10:17:42.033 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:42.027+0000 7f618884d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-18T10:17:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.074+0000 7fe16432c640 1 Processor -- start 2023-12-18T10:17:42.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.074+0000 7fe16432c640 1 -- start start 2023-12-18T10:17:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe16432c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe15c15cae0 0x7fe15c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe16432c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cde90 0x7fe15c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe16432c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe15c0cf170 0x7fe15c0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe16432c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0cfb40 con 0x7fe15c0cf170 2023-12-18T10:17:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe16432c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c15cec0 con 0x7fe15c15cae0 2023-12-18T10:17:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe16432c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0d0530 con 0x7fe15c0cde90 2023-12-18T10:17:42.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1618c7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cde90 0x7fe15c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1618c7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cde90 0x7fe15c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53868/0 (socket says 172.21.15.142:53868) 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1618c7640 1 -- 172.21.15.142:0/3739440117 learned_addr learned my addr 172.21.15.142:0/3739440117 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1620c8640 1 --2- 172.21.15.142:0/3739440117 >> v2:172.21.15.142:3300/0 conn(0x7fe15c15cae0 0x7fe15c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1628c9640 1 --2- 172.21.15.142:0/3739440117 >> v2:172.21.15.133:3300/0 conn(0x7fe15c0cf170 0x7fe15c0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1618c7640 1 -- 172.21.15.142:0/3739440117 >> v2:172.21.15.142:3300/0 conn(0x7fe15c15cae0 msgr2=0x7fe15c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1618c7640 1 --2- 172.21.15.142:0/3739440117 >> v2:172.21.15.142:3300/0 conn(0x7fe15c15cae0 0x7fe15c0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1618c7640 1 -- 172.21.15.142:0/3739440117 >> v2:172.21.15.133:3300/0 conn(0x7fe15c0cf170 msgr2=0x7fe15c0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1618c7640 1 --2- 172.21.15.142:0/3739440117 >> v2:172.21.15.133:3300/0 conn(0x7fe15c0cf170 0x7fe15c0cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.078+0000 7fe1618c7640 1 -- 172.21.15.142:0/3739440117 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0d0810 con 0x7fe15c0cde90 2023-12-18T10:17:42.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe1618c7640 1 --2- 172.21.15.142:0/3739440117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cde90 0x7fe15c0ce2f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe15c06a520 tx=0x7fe14c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4506504e2eec6df2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:42.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe1610c6640 1 -- 172.21.15.142:0/3739440117 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0aa5f0 con 0x7fe15c0cde90 2023-12-18T10:17:42.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe1610c6640 1 -- 172.21.15.142:0/3739440117 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0aa750 con 0x7fe15c0cde90 2023-12-18T10:17:42.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe1610c6640 1 -- 172.21.15.142:0/3739440117 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0aaae0 con 0x7fe15c0cde90 2023-12-18T10:17:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 -- 172.21.15.142:0/3739440117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cde90 msgr2=0x7fe15c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 --2- 172.21.15.142:0/3739440117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cde90 0x7fe15c0ce2f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe15c06a520 tx=0x7fe14c01c4d0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 -- 172.21.15.142:0/3739440117 shutdown_connections 2023-12-18T10:17:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 --2- 172.21.15.142:0/3739440117 >> v2:172.21.15.133:3300/0 conn(0x7fe15c0cf170 0x7fe15c0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 --2- 172.21.15.142:0/3739440117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cde90 0x7fe15c0ce2f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 --2- 172.21.15.142:0/3739440117 >> v2:172.21.15.142:3300/0 conn(0x7fe15c15cae0 0x7fe15c0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 -- 172.21.15.142:0/3739440117 >> 172.21.15.142:0/3739440117 conn(0x7fe15c089fb0 msgr2=0x7fe15c0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 -- 172.21.15.142:0/3739440117 shutdown_connections 2023-12-18T10:17:42.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 -- 172.21.15.142:0/3739440117 wait complete. 2023-12-18T10:17:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 Processor -- start 2023-12-18T10:17:42.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.082+0000 7fe16432c640 1 -- start start 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe15c0cde90 0x7fe15c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cf170 0x7fe15c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe15c15cae0 0x7fe15c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c156f80 con 0x7fe15c15cae0 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c15f880 con 0x7fe15c0cde90 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c160090 con 0x7fe15c0cf170 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe15c0cde90 0x7fe15c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1618c7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cf170 0x7fe15c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe15c0cde90 0x7fe15c1525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33234/0 (socket says 172.21.15.142:33234) 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 -- 172.21.15.142:0/2984948950 learned_addr learned my addr 172.21.15.142:0/2984948950 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1628c9640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe15c15cae0 0x7fe15c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 -- 172.21.15.142:0/2984948950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cf170 msgr2=0x7fe15c158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cf170 0x7fe15c158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 -- 172.21.15.142:0/2984948950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe15c15cae0 msgr2=0x7fe15c158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe15c15cae0 0x7fe15c158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 -- 172.21.15.142:0/2984948950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0094d0 con 0x7fe15c0cde90 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1628c9640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe15c15cae0 0x7fe15c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe1620c8640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe15c0cde90 0x7fe15c1525f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe15800e870 tx=0x7fe15800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe152ffd640 1 -- 172.21.15.142:0/2984948950 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1580095d0 con 0x7fe15c0cde90 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe152ffd640 1 -- 172.21.15.142:0/2984948950 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15800c940 con 0x7fe15c0cde90 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe152ffd640 1 -- 172.21.15.142:0/2984948950 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800ccb0 con 0x7fe15c0cde90 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c15fad0 con 0x7fe15c0cde90 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c152b30 con 0x7fe15c0cde90 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe152ffd640 1 -- 172.21.15.142:0/2984948950 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe158013770 con 0x7fe15c0cde90 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe152ffd640 1 -- 172.21.15.142:0/2984948950 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe15801c810 con 0x7fe15c0cde90 2023-12-18T10:17:42.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.086+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c04e000 con 0x7fe15c0cde90 2023-12-18T10:17:42.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.090+0000 7fe152ffd640 1 -- 172.21.15.142:0/2984948950 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fe158021060 con 0x7fe15c0cde90 2023-12-18T10:17:42.122 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:42.115+0000 7f618884d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-18T10:17:42.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.158+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9471f90-81ae-47e0-9227-aad21906cfd2", "id": 5} v 0) v1 -- 0x7fe15c0d1400 con 0x7fe15c0cde90 2023-12-18T10:17:42.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe152ffd640 1 -- 172.21.15.142:0/2984948950 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9471f90-81ae-47e0-9227-aad21906cfd2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe15802a020 con 0x7fe15c0cde90 2023-12-18T10:17:42.169 INFO:teuthology.orchestra.run.smithi142.stdout:5 2023-12-18T10:17:42.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe15c0cde90 msgr2=0x7fe15c1525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe15c0cde90 0x7fe15c1525f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe15800e870 tx=0x7fe15800ed30 comp rx=0 tx=0).stop 2023-12-18T10:17:42.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 shutdown_connections 2023-12-18T10:17:42.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe15c15cae0 0x7fe15c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe15c0cf170 0x7fe15c158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 --2- 172.21.15.142:0/2984948950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe15c0cde90 0x7fe15c1525f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 >> 172.21.15.142:0/2984948950 conn(0x7fe15c089fb0 msgr2=0x7fe15c06c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:42.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 shutdown_connections 2023-12-18T10:17:42.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.166+0000 7fe16432c640 1 -- 172.21.15.142:0/2984948950 wait complete. 2023-12-18T10:17:42.182 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:42.175+0000 7f618884d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-18T10:17:42.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new d6f9484d-a126-4456-a6d4-4f9494bbb5e4 6 2023-12-18T10:17:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.326+0000 7f7bb216d640 1 Processor -- start 2023-12-18T10:17:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.326+0000 7f7bb216d640 1 -- start start 2023-12-18T10:17:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.326+0000 7f7bb216d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac15cae0 0x7f7bac0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.326+0000 7f7bb216d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bac0cf880 0x7f7bac0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.326+0000 7f7bb216d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bac15cec0 con 0x7f7bac0cde90 2023-12-18T10:17:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.326+0000 7f7bb216d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bac0d0530 con 0x7f7bac0cf880 2023-12-18T10:17:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.326+0000 7f7bb216d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0d0810 con 0x7f7bac15cae0 2023-12-18T10:17:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7bab7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac15cae0 0x7f7bac0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7baaffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7bac0cde90 0x7f7bac0cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42260/0 (socket says 172.21.15.142:42260) 2023-12-18T10:17:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7baaffd640 1 -- 172.21.15.142:0/4122052728 learned_addr learned my addr 172.21.15.142:0/4122052728 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-12-18T10:17:42.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7babfff640 1 --2- 172.21.15.142:0/4122052728 >> v2:172.21.15.133:3300/0 conn(0x7f7bac0cf880 0x7f7bac0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7baa7fc640 1 -- 172.21.15.142:0/4122052728 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449267272 0 0) 0x7f7bac15cec0 con 0x7f7bac0cde90 2023-12-18T10:17:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7bab7fe640 1 -- 172.21.15.142:0/4122052728 >> v2:172.21.15.133:3300/0 conn(0x7f7bac0cf880 msgr2=0x7f7bac0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7bab7fe640 1 --2- 172.21.15.142:0/4122052728 >> v2:172.21.15.133:3300/0 conn(0x7f7bac0cf880 0x7f7bac0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7bab7fe640 1 -- 172.21.15.142:0/4122052728 >> v1:172.21.15.142:6789/0 conn(0x7f7bac0cde90 legacy=0x7f7bac0cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7bab7fe640 1 -- 172.21.15.142:0/4122052728 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac0d0af0 con 0x7f7bac15cae0 2023-12-18T10:17:42.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7babfff640 1 --2- 172.21.15.142:0/4122052728 >> v2:172.21.15.133:3300/0 conn(0x7f7bac0cf880 0x7f7bac0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:17:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7bab7fe640 1 --2- 172.21.15.142:0/4122052728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac15cae0 0x7f7bac0d12f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0097a0 tx=0x7f7b9c01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=724e6666a911ca9f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7baa7fc640 1 -- 172.21.15.142:0/4122052728 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0ac620 con 0x7f7bac15cae0 2023-12-18T10:17:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7baa7fc640 1 -- 172.21.15.142:0/4122052728 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0ac780 con 0x7f7bac15cae0 2023-12-18T10:17:42.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.330+0000 7f7baa7fc640 1 -- 172.21.15.142:0/4122052728 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0acb10 con 0x7f7bac15cae0 2023-12-18T10:17:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- 172.21.15.142:0/4122052728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac15cae0 msgr2=0x7f7bac0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 --2- 172.21.15.142:0/4122052728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac15cae0 0x7f7bac0d12f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0097a0 tx=0x7f7b9c01c430 comp rx=0 tx=0).stop 2023-12-18T10:17:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- 172.21.15.142:0/4122052728 shutdown_connections 2023-12-18T10:17:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 --2- 172.21.15.142:0/4122052728 >> v2:172.21.15.133:3300/0 conn(0x7f7bac0cf880 0x7f7bac0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 --2- 172.21.15.142:0/4122052728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac15cae0 0x7f7bac0d12f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- 172.21.15.142:0/4122052728 >> 172.21.15.142:0/4122052728 conn(0x7f7bac089fb0 msgr2=0x7f7bac0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- 172.21.15.142:0/4122052728 shutdown_connections 2023-12-18T10:17:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- 172.21.15.142:0/4122052728 wait complete. 2023-12-18T10:17:42.338 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:42.331+0000 7f618884d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-18T10:17:42.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 Processor -- start 2023-12-18T10:17:42.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- start start 2023-12-18T10:17:42.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac0cde90 0x7f7bac15e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bac0cf880 0x7f7bac0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bac15cae0 0x7f7bac155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac0c8e60 con 0x7f7bac15cae0 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac15ea70 con 0x7f7bac0cf880 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bb216d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac15ed50 con 0x7f7bac0cde90 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bab7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac0cde90 0x7f7bac15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7baaffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bac0cf880 0x7f7bac0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bab7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac0cde90 0x7f7bac15e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:53896/0 (socket says 172.21.15.142:53896) 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7bab7fe640 1 -- 172.21.15.142:0/3388926329 learned_addr learned my addr 172.21.15.142:0/3388926329 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.334+0000 7f7babfff640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bac15cae0 0x7f7bac155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bab7fe640 1 -- 172.21.15.142:0/3388926329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bac0cf880 msgr2=0x7f7bac0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bab7fe640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bac0cf880 0x7f7bac0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bab7fe640 1 -- 172.21.15.142:0/3388926329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bac15cae0 msgr2=0x7f7bac155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bab7fe640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bac15cae0 0x7f7bac155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bab7fe640 1 -- 172.21.15.142:0/3388926329 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0093b0 con 0x7f7bac0cde90 2023-12-18T10:17:42.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7baaffd640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bac0cf880 0x7f7bac0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:42.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bab7fe640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac0cde90 0x7f7bac15e400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0af040 tx=0x7f7b9c01ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:42.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7b93fff640 1 -- 172.21.15.142:0/3388926329 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0059a0 con 0x7f7bac0cde90 2023-12-18T10:17:42.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7b93fff640 1 -- 172.21.15.142:0/3388926329 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c005b00 con 0x7f7bac0cde90 2023-12-18T10:17:42.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac15f030 con 0x7f7bac0cde90 2023-12-18T10:17:42.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7b93fff640 1 -- 172.21.15.142:0/3388926329 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c006020 con 0x7f7bac0cde90 2023-12-18T10:17:42.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac15f5f0 con 0x7f7bac0cde90 2023-12-18T10:17:42.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7b93fff640 1 -- 172.21.15.142:0/3388926329 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7b9c0aa070 con 0x7f7bac0cde90 2023-12-18T10:17:42.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7b93fff640 1 -- 172.21.15.142:0/3388926329 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7b9c0b8c20 con 0x7f7bac0cde90 2023-12-18T10:17:42.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.338+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac15f7e0 con 0x7f7bac0cde90 2023-12-18T10:17:42.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.342+0000 7f7b93fff640 1 -- 172.21.15.142:0/3388926329 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f7b9c0bd020 con 0x7f7bac0cde90 2023-12-18T10:17:42.406 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:42.399+0000 7f618884d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-18T10:17:42.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.406+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d6f9484d-a126-4456-a6d4-4f9494bbb5e4", "id": 6} v 0) v1 -- 0x7f7bac04e000 con 0x7f7bac0cde90 2023-12-18T10:17:42.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7b93fff640 1 -- 172.21.15.142:0/3388926329 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6f9484d-a126-4456-a6d4-4f9494bbb5e4", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7b9c0b1070 con 0x7f7bac0cde90 2023-12-18T10:17:42.418 INFO:teuthology.orchestra.run.smithi142.stdout:6 2023-12-18T10:17:42.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac0cde90 msgr2=0x7f7bac15e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac0cde90 0x7f7bac15e400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0af040 tx=0x7f7b9c01ac70 comp rx=0 tx=0).stop 2023-12-18T10:17:42.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 shutdown_connections 2023-12-18T10:17:42.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bac15cae0 0x7f7bac155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bac0cf880 0x7f7bac0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 --2- 172.21.15.142:0/3388926329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bac0cde90 0x7f7bac15e400 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 >> 172.21.15.142:0/3388926329 conn(0x7f7bac089fb0 msgr2=0x7f7bac0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:42.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 shutdown_connections 2023-12-18T10:17:42.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.414+0000 7f7bb216d640 1 -- 172.21.15.142:0/3388926329 wait complete. 2023-12-18T10:17:42.438 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 6df648c5-a417-44b3-b14b-6acaa248274b 7 2023-12-18T10:17:42.549 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:42.546+0000 7f4d92a4b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-18T10:17:42.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.570+0000 7ff2a0398640 1 Processor -- start 2023-12-18T10:17:42.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.570+0000 7ff2a0398640 1 -- start start 2023-12-18T10:17:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff2a0398640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff2a0398640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2980cf880 0x7ff2980ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff2a0398640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29815cec0 con 0x7ff2980cde90 2023-12-18T10:17:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff2a0398640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980d0530 con 0x7ff2980cf880 2023-12-18T10:17:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff2a0398640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980d0810 con 0x7ff29815cae0 2023-12-18T10:17:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff29d933640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff2980cde90 0x7ff2980cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:42266/0 (socket says 172.21.15.142:42266) 2023-12-18T10:17:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff29d933640 1 -- 172.21.15.142:0/165465160 learned_addr learned my addr 172.21.15.142:0/165465160 (peer_addr_for_me v1:172.21.15.142:0/0) 2023-12-18T10:17:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff29e935640 1 --2- 172.21.15.142:0/165465160 >> v2:172.21.15.142:3300/0 conn(0x7ff2980cf880 0x7ff2980ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff29e134640 1 --2- 172.21.15.142:0/165465160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff29e935640 1 -- 172.21.15.142:0/165465160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 msgr2=0x7ff2980d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff29e935640 1 --2- 172.21.15.142:0/165465160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff29e935640 1 -- 172.21.15.142:0/165465160 >> v1:172.21.15.142:6789/0 conn(0x7ff2980cde90 legacy=0x7ff2980cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.574+0000 7ff29e935640 1 -- 172.21.15.142:0/165465160 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980d0af0 con 0x7ff2980cf880 2023-12-18T10:17:42.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff29e935640 1 --2- 172.21.15.142:0/165465160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980ce2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff290009d90 tx=0x7ff29001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93496f6fa742a75a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:42.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff29d132640 1 -- 172.21.15.142:0/165465160 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900a5970 con 0x7ff2980cf880 2023-12-18T10:17:42.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff29d132640 1 -- 172.21.15.142:0/165465160 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2900a5ad0 con 0x7ff2980cf880 2023-12-18T10:17:42.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff29d132640 1 -- 172.21.15.142:0/165465160 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900a5e60 con 0x7ff2980cf880 2023-12-18T10:17:42.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 -- 172.21.15.142:0/165465160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 msgr2=0x7ff2980ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 --2- 172.21.15.142:0/165465160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980ce2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff290009d90 tx=0x7ff29001c920 comp rx=0 tx=0).stop 2023-12-18T10:17:42.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 -- 172.21.15.142:0/165465160 shutdown_connections 2023-12-18T10:17:42.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 --2- 172.21.15.142:0/165465160 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980ce2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 --2- 172.21.15.142:0/165465160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 -- 172.21.15.142:0/165465160 >> 172.21.15.142:0/165465160 conn(0x7ff298089fb0 msgr2=0x7ff2980d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:42.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 -- 172.21.15.142:0/165465160 shutdown_connections 2023-12-18T10:17:42.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 -- 172.21.15.142:0/165465160 wait complete. 2023-12-18T10:17:42.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 Processor -- start 2023-12-18T10:17:42.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.578+0000 7ff2a0398640 1 -- start start 2023-12-18T10:17:42.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980cde90 0x7ff2981559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980b0bf0 con 0x7ff2980cde90 2023-12-18T10:17:42.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980c7900 con 0x7ff2980cf880 2023-12-18T10:17:42.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980b0600 con 0x7ff29815cae0 2023-12-18T10:17:42.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29d933640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29d933640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33250/0 (socket says 172.21.15.142:33250) 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29d933640 1 -- 172.21.15.142:0/1671273571 learned_addr learned my addr 172.21.15.142:0/1671273571 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29e935640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29e134640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980cde90 0x7ff2981559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29e935640 1 -- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 msgr2=0x7ff2980c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29e935640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29e935640 1 -- 172.21.15.142:0/1671273571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980cde90 msgr2=0x7ff2981559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29e935640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980cde90 0x7ff2981559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29e935640 1 -- 172.21.15.142:0/1671273571 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290009a70 con 0x7ff29815cae0 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29d933640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:42.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff29e935640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980b1010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff298073850 tx=0x7ff2900196c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:42.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff28effd640 1 -- 172.21.15.142:0/1671273571 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290009450 con 0x7ff29815cae0 2023-12-18T10:17:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff28effd640 1 -- 172.21.15.142:0/1671273571 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2900adb00 con 0x7ff29815cae0 2023-12-18T10:17:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff28effd640 1 -- 172.21.15.142:0/1671273571 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900ade90 con 0x7ff29815cae0 2023-12-18T10:17:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2980c9230 con 0x7ff29815cae0 2023-12-18T10:17:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2980b1550 con 0x7ff29815cae0 2023-12-18T10:17:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff28effd640 1 -- 172.21.15.142:0/1671273571 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff2900b9750 con 0x7ff29815cae0 2023-12-18T10:17:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff28effd640 1 -- 172.21.15.142:0/1671273571 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff2900c2cf0 con 0x7ff29815cae0 2023-12-18T10:17:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.582+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2980b0d30 con 0x7ff29815cae0 2023-12-18T10:17:42.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.586+0000 7ff28effd640 1 -- 172.21.15.142:0/1671273571 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7ff2980b0d30 con 0x7ff29815cae0 2023-12-18T10:17:42.615 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:42.610+0000 7f4d92a4b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-18T10:17:42.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.650+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6df648c5-a417-44b3-b14b-6acaa248274b", "id": 7} v 0) v1 -- 0x7ff29804e000 con 0x7ff29815cae0 2023-12-18T10:17:42.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff28effd640 1 -- 172.21.15.142:0/1671273571 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6df648c5-a417-44b3-b14b-6acaa248274b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff2900bd030 con 0x7ff29815cae0 2023-12-18T10:17:42.663 INFO:teuthology.orchestra.run.smithi142.stdout:7 2023-12-18T10:17:42.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 msgr2=0x7ff2980b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980b1010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff298073850 tx=0x7ff2900196c0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 shutdown_connections 2023-12-18T10:17:42.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff29815cae0 0x7ff2980b1010 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2980cf880 0x7ff2980c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 --2- 172.21.15.142:0/1671273571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2980cde90 0x7ff2981559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 >> 172.21.15.142:0/1671273571 conn(0x7ff298089fb0 msgr2=0x7ff2980b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:42.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 shutdown_connections 2023-12-18T10:17:42.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-12-18T10:17:42.658+0000 7ff2a0398640 1 -- 172.21.15.142:0/1671273571 wait complete. 2023-12-18T10:17:42.678 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:42.674+0000 7f4d92a4b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-18T10:17:42.683 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-18T10:17:42.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-18T10:17:42.687 INFO:tasks.ceph.osd.0:Started 2023-12-18T10:17:42.687 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-18T10:17:42.687 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-18T10:17:42.691 INFO:tasks.ceph.osd.1:Started 2023-12-18T10:17:42.691 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-18T10:17:42.691 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-18T10:17:42.694 INFO:tasks.ceph.osd.2:Started 2023-12-18T10:17:42.694 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-18T10:17:42.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-18T10:17:42.698 INFO:tasks.ceph.osd.3:Started 2023-12-18T10:17:42.698 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-18T10:17:42.698 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-18T10:17:42.702 INFO:tasks.ceph.osd.4:Started 2023-12-18T10:17:42.702 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-18T10:17:42.702 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-18T10:17:42.705 INFO:tasks.ceph.osd.5:Started 2023-12-18T10:17:42.705 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-18T10:17:42.705 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-18T10:17:42.709 INFO:tasks.ceph.osd.6:Started 2023-12-18T10:17:42.709 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-18T10:17:42.709 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-18T10:17:42.714 INFO:tasks.ceph.osd.7:Started 2023-12-18T10:17:42.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:17:42.780 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:42.774+0000 7f4d92a4b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-18T10:17:42.860 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:42.858+0000 7f4d92a4b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-18T10:17:42.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917eeb6640 1 Processor -- start 2023-12-18T10:17:42.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917eeb6640 1 -- start start 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917eeb6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91780cf0d0 0x7f91780cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917eeb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917eeb6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91780cfa70 con 0x7f917815ca40 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917eeb6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91780d11c0 con 0x7f91780cf0d0 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917eeb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780d0310 con 0x7f91781648d0 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f9177fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91780cf0d0 0x7f91780cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917d453640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917d453640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178166cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:47568/0 (socket says 172.21.15.133:47568) 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917d453640 1 -- 172.21.15.133:0/1621659393 learned_addr learned my addr 172.21.15.133:0/1621659393 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:42.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f9177fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91780cf0d0 0x7f91780cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:37682/0 (socket says 172.21.15.133:37682) 2023-12-18T10:17:42.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917d453640 1 -- 172.21.15.133:0/1621659393 >> v2:172.21.15.142:3300/0 conn(0x7f91780cf0d0 msgr2=0x7f91780cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:42.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917d453640 1 --2- 172.21.15.133:0/1621659393 >> v2:172.21.15.142:3300/0 conn(0x7f91780cf0d0 0x7f91780cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917d453640 1 -- 172.21.15.133:0/1621659393 >> v1:172.21.15.142:6789/0 conn(0x7f917815ca40 legacy=0x7f91780cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f917d453640 1 -- 172.21.15.133:0/1621659393 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780d05b0 con 0x7f91781648d0 2023-12-18T10:17:42.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.931+0000 7f9177fff640 1 --2- 172.21.15.133:0/1621659393 >> v2:172.21.15.142:3300/0 conn(0x7f91780cf0d0 0x7f91780cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:17:42.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917d453640 1 --2- 172.21.15.133:0/1621659393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178166cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9170009e50 tx=0x7f917001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=464216cea0c791db server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:42.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f91777fe640 1 -- 172.21.15.133:0/1621659393 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700a58a0 con 0x7f91781648d0 2023-12-18T10:17:42.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f91777fe640 1 -- 172.21.15.133:0/1621659393 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91700a5a00 con 0x7f91781648d0 2023-12-18T10:17:42.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f91777fe640 1 -- 172.21.15.133:0/1621659393 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700a5d90 con 0x7f91781648d0 2023-12-18T10:17:42.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917eeb6640 1 -- 172.21.15.133:0/1621659393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 msgr2=0x7f9178166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917eeb6640 1 --2- 172.21.15.133:0/1621659393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178166cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9170009e50 tx=0x7f917001c9e0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917eeb6640 1 -- 172.21.15.133:0/1621659393 shutdown_connections 2023-12-18T10:17:42.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917eeb6640 1 --2- 172.21.15.133:0/1621659393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178166cc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917eeb6640 1 --2- 172.21.15.133:0/1621659393 >> v2:172.21.15.142:3300/0 conn(0x7f91780cf0d0 0x7f91780cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917eeb6640 1 -- 172.21.15.133:0/1621659393 >> 172.21.15.133:0/1621659393 conn(0x7f9178089fb0 msgr2=0x7f91780d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:42.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917eeb6640 1 -- 172.21.15.133:0/1621659393 shutdown_connections 2023-12-18T10:17:42.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.935+0000 7f917eeb6640 1 -- 172.21.15.133:0/1621659393 wait complete. 2023-12-18T10:17:42.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917eeb6640 1 Processor -- start 2023-12-18T10:17:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917eeb6640 1 -- start start 2023-12-18T10:17:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917eeb6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91780cf0d0 0x7f91780b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917eeb6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917815ca40 0x7f9178165770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917eeb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178165cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917eeb6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780b1910 con 0x7f91780cf0d0 2023-12-18T10:17:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917eeb6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780c9810 con 0x7f917815ca40 2023-12-18T10:17:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917eeb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780c9a60 con 0x7f91781648d0 2023-12-18T10:17:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917cc52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91780cf0d0 0x7f91780b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f9177fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917815ca40 0x7f9178165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f9177fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917815ca40 0x7f9178165770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:37692/0 (socket says 172.21.15.133:37692) 2023-12-18T10:17:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f9177fff640 1 -- 172.21.15.133:0/1823492278 learned_addr learned my addr 172.21.15.133:0/1823492278 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.939+0000 7f917d453640 1 --2- 172.21.15.133:0/1823492278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178165cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f9177fff640 1 -- 172.21.15.133:0/1823492278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 msgr2=0x7f9178165cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f9177fff640 1 --2- 172.21.15.133:0/1823492278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178165cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f9177fff640 1 -- 172.21.15.133:0/1823492278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91780cf0d0 msgr2=0x7f91780b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f9177fff640 1 --2- 172.21.15.133:0/1823492278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91780cf0d0 0x7f91780b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f9177fff640 1 -- 172.21.15.133:0/1823492278 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640093b0 con 0x7f917815ca40 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f9177fff640 1 --2- 172.21.15.133:0/1823492278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917815ca40 0x7f9178165770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f916400e960 tx=0x7f916400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f91757fa640 1 -- 172.21.15.133:0/1823492278 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400ca00 con 0x7f917815ca40 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f91757fa640 1 -- 172.21.15.133:0/1823492278 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916400cb60 con 0x7f917815ca40 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f91757fa640 1 -- 172.21.15.133:0/1823492278 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640059a0 con 0x7f917815ca40 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9170009b30 con 0x7f917815ca40 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91780ca020 con 0x7f917815ca40 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f91757fa640 1 -- 172.21.15.133:0/1823492278 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9164006030 con 0x7f917815ca40 2023-12-18T10:17:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f91757fa640 1 -- 172.21.15.133:0/1823492278 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9164013470 con 0x7f917815ca40 2023-12-18T10:17:42.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917804e000 con 0x7f917815ca40 2023-12-18T10:17:42.950 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:42.946+0000 7f4d92a4b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-18T10:17:42.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:42.943+0000 7f91757fa640 1 -- 172.21.15.133:0/1823492278 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f9164020060 con 0x7f917815ca40 2023-12-18T10:17:43.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91780cff10 con 0x7f917815ca40 2023-12-18T10:17:43.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f91757fa640 1 -- 172.21.15.133:0/1823492278 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9164029020 con 0x7f917815ca40 2023-12-18T10:17:43.009 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:17:43.009 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:17:42.655955+0000","last_up_change":"0.000000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:17:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917815ca40 msgr2=0x7f9178165770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 --2- 172.21.15.133:0/1823492278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917815ca40 0x7f9178165770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f916400e960 tx=0x7f916400ee20 comp rx=0 tx=0).stop 2023-12-18T10:17:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 shutdown_connections 2023-12-18T10:17:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 --2- 172.21.15.133:0/1823492278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91781648d0 0x7f9178165cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 --2- 172.21.15.133:0/1823492278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f917815ca40 0x7f9178165770 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 --2- 172.21.15.133:0/1823492278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91780cf0d0 0x7f91780b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 >> 172.21.15.133:0/1823492278 conn(0x7f9178089fb0 msgr2=0x7f917815bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:43.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 shutdown_connections 2023-12-18T10:17:43.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:43.003+0000 7f917eeb6640 1 -- 172.21.15.133:0/1823492278 wait complete. 2023-12-18T10:17:43.011 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:43.006+0000 7f4d92a4b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-18T10:17:43.028 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-18T10:17:43.029 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-18T10:17:43.070 INFO:tasks.ceph.mgr.y.smithi133.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-18T10:17:43.070 INFO:tasks.ceph.mgr.y.smithi133.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-18T10:17:43.070 INFO:tasks.ceph.mgr.y.smithi133.stderr: from numpy import show_config as show_numpy_config 2023-12-18T10:17:43.112 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:43.107+0000 7f618884d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-18T10:17:43.169 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:43.166+0000 7f4d92a4b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-18T10:17:43.237 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:43.234+0000 7f4d92a4b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-18T10:17:43.248 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:43.243+0000 7f618884d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-18T10:17:43.338 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-12-18T10:17:43.334+0000 7f0d910c1640 -1 Falling back to public interface 2023-12-18T10:17:43.349 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-18T10:17:43.346+0000 7f2e78715640 -1 Falling back to public interface 2023-12-18T10:17:43.368 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-12-18T10:17:43.363+0000 7fd9d72a4640 -1 Falling back to public interface 2023-12-18T10:17:43.389 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-12-18T10:17:43.386+0000 7f64466ae640 -1 Falling back to public interface 2023-12-18T10:17:43.400 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-12-18T10:17:43.395+0000 7f8a8c56e640 -1 Falling back to public interface 2023-12-18T10:17:43.406 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-12-18T10:17:43.402+0000 7f8337f43640 -1 Falling back to public interface 2023-12-18T10:17:43.430 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:43.423+0000 7f618884d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-18T10:17:43.436 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-12-18T10:17:43.431+0000 7f7e614d9640 -1 Falling back to public interface 2023-12-18T10:17:43.444 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-12-18T10:17:43.439+0000 7f0978263640 -1 Falling back to public interface 2023-12-18T10:17:43.504 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:43.499+0000 7f618884d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-18T10:17:43.641 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:43.635+0000 7f618884d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-18T10:17:43.833 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-18T10:17:43.889 INFO:tasks.ceph.mgr.x.smithi142.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-18T10:17:43.889 INFO:tasks.ceph.mgr.x.smithi142.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-18T10:17:43.889 INFO:tasks.ceph.mgr.x.smithi142.stderr: from numpy import show_config as show_numpy_config 2023-12-18T10:17:43.954 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:43.950+0000 7f4d92a4b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-18T10:17:43.961 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e9717640 1 Processor -- start 2023-12-18T10:17:43.961 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e9717640 1 -- start start 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e9717640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48e41599f0 0x7f48e40cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e9717640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48e40cc3d0 0x7f48e40ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e9717640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e40cc8e0 con 0x7f48e40cec00 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e9717640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e40cf070 con 0x7f48e41599f0 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e9717640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e40ab140 con 0x7f48e40cc3d0 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48e41599f0 0x7f48e40cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48e41599f0 0x7f48e40cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35460/0 (socket says 172.21.15.133:35460) 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48e2ffd640 1 -- 172.21.15.133:0/56069174 learned_addr learned my addr 172.21.15.133:0/56069174 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:43.963 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.955+0000 7f48dbfff640 1 --2- 172.21.15.133:0/56069174 >> v2:172.21.15.142:3300/0 conn(0x7f48e40cc3d0 0x7f48e40ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:43.964 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e2ffd640 1 -- 172.21.15.133:0/56069174 >> v2:172.21.15.142:3300/0 conn(0x7f48e40cc3d0 msgr2=0x7f48e40ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:43.964 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e2ffd640 1 --2- 172.21.15.133:0/56069174 >> v2:172.21.15.142:3300/0 conn(0x7f48e40cc3d0 0x7f48e40ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:43.964 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e2ffd640 1 -- 172.21.15.133:0/56069174 >> v1:172.21.15.142:6789/0 conn(0x7f48e40cec00 legacy=0x7f48e415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:43.964 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e2ffd640 1 -- 172.21.15.133:0/56069174 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e40ab420 con 0x7f48e41599f0 2023-12-18T10:17:43.966 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e2ffd640 1 --2- 172.21.15.133:0/56069174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e41599f0 0x7f48e40cbe90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48e406ba40 tx=0x7f48d401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83896807562b0ec server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:43.966 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e27fc640 1 -- 172.21.15.133:0/56069174 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40ac410 con 0x7f48e41599f0 2023-12-18T10:17:43.966 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e27fc640 1 -- 172.21.15.133:0/56069174 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40ac570 con 0x7f48e41599f0 2023-12-18T10:17:43.966 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e27fc640 1 -- 172.21.15.133:0/56069174 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40ac900 con 0x7f48e41599f0 2023-12-18T10:17:43.967 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e9717640 1 -- 172.21.15.133:0/56069174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e41599f0 msgr2=0x7f48e40cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:43.967 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.959+0000 7f48e9717640 1 --2- 172.21.15.133:0/56069174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e41599f0 0x7f48e40cbe90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48e406ba40 tx=0x7f48d401c470 comp rx=0 tx=0).stop 2023-12-18T10:17:43.967 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 -- 172.21.15.133:0/56069174 shutdown_connections 2023-12-18T10:17:43.967 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 --2- 172.21.15.133:0/56069174 >> v2:172.21.15.142:3300/0 conn(0x7f48e40cc3d0 0x7f48e40ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:43.968 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 --2- 172.21.15.133:0/56069174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e41599f0 0x7f48e40cbe90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:43.968 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 -- 172.21.15.133:0/56069174 >> 172.21.15.133:0/56069174 conn(0x7f48e406a0a0 msgr2=0x7f48e406a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:43.968 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 -- 172.21.15.133:0/56069174 shutdown_connections 2023-12-18T10:17:43.968 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 -- 172.21.15.133:0/56069174 wait complete. 2023-12-18T10:17:43.969 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 Processor -- start 2023-12-18T10:17:43.969 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 -- start start 2023-12-18T10:17:43.970 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48e40cc3d0 0x7f48e4097830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:43.970 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e40cec00 0x7f48e4163bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:43.970 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48e41599f0 0x7f48e40c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:43.970 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e414fe00 con 0x7f48e40cec00 2023-12-18T10:17:43.970 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e406d7d0 con 0x7f48e40cc3d0 2023-12-18T10:17:43.971 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e9717640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e41633c0 con 0x7f48e41599f0 2023-12-18T10:17:43.971 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e40cec00 0x7f48e4163bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:43.971 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e2ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48e40cc3d0 0x7f48e4097830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:43.971 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e2ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48e40cc3d0 0x7f48e4097830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:37710/0 (socket says 172.21.15.133:37710) 2023-12-18T10:17:43.971 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e2ffd640 1 -- 172.21.15.133:0/3762063759 learned_addr learned my addr 172.21.15.133:0/3762063759 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:43.972 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e37fe640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48e41599f0 0x7f48e40c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:43.972 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e2ffd640 1 -- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48e41599f0 msgr2=0x7f48e40c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:43.972 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e2ffd640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48e41599f0 0x7f48e40c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:43.972 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e2ffd640 1 -- 172.21.15.133:0/3762063759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e40cec00 msgr2=0x7f48e4163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:43.972 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e2ffd640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e40cec00 0x7f48e4163bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:43.972 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e2ffd640 1 -- 172.21.15.133:0/3762063759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4009480 con 0x7f48e40cc3d0 2023-12-18T10:17:43.972 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.963+0000 7f48e37fe640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48e41599f0 0x7f48e40c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48e2ffd640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48e40cc3d0 0x7f48e4097830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48d4019080 tx=0x7f48d4019210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48db7fe640 1 -- 172.21.15.133:0/3762063759 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40059a0 con 0x7f48e40cc3d0 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48db7fe640 1 -- 172.21.15.133:0/3762063759 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4005b00 con 0x7f48e40cc3d0 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e41636a0 con 0x7f48e40cc3d0 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48db7fe640 1 -- 172.21.15.133:0/3762063759 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4005e70 con 0x7f48e40cc3d0 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e4164100 con 0x7f48e40cc3d0 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48db7fe640 1 -- 172.21.15.133:0/3762063759 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f48d40b3040 con 0x7f48e40cc3d0 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48db7fe640 1 -- 172.21.15.133:0/3762063759 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f48d4003cf0 con 0x7f48e40cc3d0 2023-12-18T10:17:43.973 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.967+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e4163220 con 0x7f48e40cc3d0 2023-12-18T10:17:43.976 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:43.971+0000 7f48db7fe640 1 -- 172.21.15.133:0/3762063759 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f48d40dcb40 con 0x7f48e40cc3d0 2023-12-18T10:17:44.033 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.027+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48e40b3030 con 0x7f48e40cc3d0 2023-12-18T10:17:44.035 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.027+0000 7f48db7fe640 1 -- 172.21.15.133:0/3762063759 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f48d40cb030 con 0x7f48e40cc3d0 2023-12-18T10:17:44.035 INFO:teuthology.misc.health.smithi133.stdout: 2023-12-18T10:17:44.035 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":10,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:17:42.655955+0000","last_up_change":"0.000000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:17:44.036 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48e40cc3d0 msgr2=0x7f48e4097830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:44.036 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48e40cc3d0 0x7f48e4097830 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48d4019080 tx=0x7f48d4019210 comp rx=0 tx=0).stop 2023-12-18T10:17:44.036 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 shutdown_connections 2023-12-18T10:17:44.036 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48e41599f0 0x7f48e40c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:44.036 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48e40cec00 0x7f48e4163bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:44.036 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 --2- 172.21.15.133:0/3762063759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48e40cc3d0 0x7f48e4097830 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:44.036 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 >> 172.21.15.133:0/3762063759 conn(0x7f48e406a0a0 msgr2=0x7f48e40b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:44.036 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 shutdown_connections 2023-12-18T10:17:44.037 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:44.031+0000 7f48e9717640 1 -- 172.21.15.133:0/3762063759 wait complete. 2023-12-18T10:17:44.053 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-18T10:17:44.094 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:44.090+0000 7f4d92a4b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-18T10:17:44.275 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:44.270+0000 7f4d92a4b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-18T10:17:44.321 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:44.315+0000 7f618884d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-18T10:17:44.350 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:44.346+0000 7f4d92a4b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-18T10:17:44.409 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:44.403+0000 7f618884d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-18T10:17:44.486 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:44.482+0000 7f4d92a4b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-18T10:17:44.599 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:44.591+0000 7f618884d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-18T10:17:44.683 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:44.679+0000 7f618884d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-18T10:17:45.011 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:45.006+0000 7f618884d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-18T10:17:45.079 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:45.074+0000 7f618884d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-18T10:17:45.171 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:45.166+0000 7f4d92a4b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-18T10:17:45.258 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:45.254+0000 7f4d92a4b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-18T10:17:45.448 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:45.442+0000 7f4d92a4b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-18T10:17:45.534 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:45.530+0000 7f4d92a4b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-18T10:17:45.860 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:45.854+0000 7f4d92a4b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-18T10:17:45.930 INFO:tasks.ceph.mgr.x.smithi142.stderr:2023-12-18T10:17:45.926+0000 7f4d92a4b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-18T10:17:46.099 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:46.094+0000 7f612f4a1640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-18T10:17:46.100 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-18T10:17:46.094+0000 7f612f4a1640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-18T10:17:47.095 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-12-18T10:17:47.090+0000 7f0978263640 -1 osd.3 0 log_to_monitors true 2023-12-18T10:17:47.207 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-18T10:17:47.202+0000 7f2e78715640 -1 osd.5 0 log_to_monitors true 2023-12-18T10:17:47.225 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-12-18T10:17:47.218+0000 7fd9d72a4640 -1 osd.1 0 log_to_monitors true 2023-12-18T10:17:47.273 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-12-18T10:17:47.270+0000 7f0d910c1640 -1 osd.4 0 log_to_monitors true 2023-12-18T10:17:47.344 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-12-18T10:17:47.338+0000 7f8a8c56e640 -1 osd.0 0 log_to_monitors true 2023-12-18T10:17:47.358 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-12-18T10:17:47.350+0000 7f7e614d9640 -1 osd.2 0 log_to_monitors true 2023-12-18T10:17:47.494 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-12-18T10:17:47.490+0000 7f64466ae640 -1 osd.7 0 log_to_monitors true 2023-12-18T10:17:47.617 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-12-18T10:17:47.614+0000 7f8337f43640 -1 osd.6 0 log_to_monitors true 2023-12-18T10:17:50.859 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-18T10:17:51.064 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.058+0000 7fe1bcff0640 1 Processor -- start 2023-12-18T10:17:51.067 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.058+0000 7fe1bcff0640 1 -- start start 2023-12-18T10:17:51.067 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1bcff0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe1b8160b80 0x7fe1b80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:51.067 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1bcff0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe1b80c19a0 0x7fe1b80b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:51.067 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1bcff0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b806cbb0 con 0x7fe1b80b2f60 2023-12-18T10:17:51.068 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1bcff0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b806bb10 con 0x7fe1b80c19a0 2023-12-18T10:17:51.068 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1bcff0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b806bdf0 con 0x7fe1b8160b80 2023-12-18T10:17:51.068 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b5d9b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe1b80b2f60 0x7fe1b80c1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:33968/0 (socket says 172.21.15.133:33968) 2023-12-18T10:17:51.068 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b5d9b640 1 -- 172.21.15.133:0/2689354348 learned_addr learned my addr 172.21.15.133:0/2689354348 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:17:51.068 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b6d9d640 1 --2- 172.21.15.133:0/2689354348 >> v2:172.21.15.133:3300/0 conn(0x7fe1b80c19a0 0x7fe1b80b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:51.069 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b659c640 1 --2- 172.21.15.133:0/2689354348 >> v2:172.21.15.142:3300/0 conn(0x7fe1b8160b80 0x7fe1b80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:51.069 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b559a640 1 -- 172.21.15.133:0/2689354348 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600559274 0 0) 0x7fe1b806cbb0 con 0x7fe1b80b2f60 2023-12-18T10:17:51.069 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b559a640 1 -- 172.21.15.133:0/2689354348 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a0003530 con 0x7fe1b80b2f60 2023-12-18T10:17:51.069 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b6d9d640 1 -- 172.21.15.133:0/2689354348 >> v2:172.21.15.142:3300/0 conn(0x7fe1b8160b80 msgr2=0x7fe1b80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:51.069 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b6d9d640 1 --2- 172.21.15.133:0/2689354348 >> v2:172.21.15.142:3300/0 conn(0x7fe1b8160b80 0x7fe1b80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.069 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b6d9d640 1 -- 172.21.15.133:0/2689354348 >> v1:172.21.15.142:6789/0 conn(0x7fe1b80b2f60 legacy=0x7fe1b80c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:51.069 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.062+0000 7fe1b6d9d640 1 -- 172.21.15.133:0/2689354348 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b806c0d0 con 0x7fe1b80c19a0 2023-12-18T10:17:51.076 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.066+0000 7fe1b6d9d640 1 --2- 172.21.15.133:0/2689354348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b80c19a0 0x7fe1b80b1570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1b806e270 tx=0x7fe1b001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183ef5b8b9f10d00 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:51.076 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1b559a640 1 -- 172.21.15.133:0/2689354348 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00a59c0 con 0x7fe1b80c19a0 2023-12-18T10:17:51.076 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1b559a640 1 -- 172.21.15.133:0/2689354348 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b00a5b20 con 0x7fe1b80c19a0 2023-12-18T10:17:51.076 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1b559a640 1 -- 172.21.15.133:0/2689354348 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00ad440 con 0x7fe1b80c19a0 2023-12-18T10:17:51.076 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1bcff0640 1 -- 172.21.15.133:0/2689354348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b80c19a0 msgr2=0x7fe1b80b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:51.076 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/2689354348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b80c19a0 0x7fe1b80b1570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1b806e270 tx=0x7fe1b001c900 comp rx=0 tx=0).stop 2023-12-18T10:17:51.077 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1bcff0640 1 -- 172.21.15.133:0/2689354348 shutdown_connections 2023-12-18T10:17:51.077 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/2689354348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b80c19a0 0x7fe1b80b1570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.077 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/2689354348 >> v2:172.21.15.142:3300/0 conn(0x7fe1b8160b80 0x7fe1b80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.077 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1bcff0640 1 -- 172.21.15.133:0/2689354348 >> 172.21.15.133:0/2689354348 conn(0x7fe1b806a0a0 msgr2=0x7fe1b806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:51.077 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1bcff0640 1 -- 172.21.15.133:0/2689354348 shutdown_connections 2023-12-18T10:17:51.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.070+0000 7fe1bcff0640 1 -- 172.21.15.133:0/2689354348 wait complete. 2023-12-18T10:17:51.081 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.074+0000 7fe1bcff0640 1 Processor -- start 2023-12-18T10:17:51.081 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.074+0000 7fe1bcff0640 1 -- start start 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.074+0000 7fe1bcff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1b80b2f60 0x7fe1b814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.074+0000 7fe1bcff0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1b80c19a0 0x7fe1b8070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.074+0000 7fe1bcff0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b8160b80 0x7fe1b8071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.074+0000 7fe1bcff0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8163f20 con 0x7fe1b8160b80 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.074+0000 7fe1bcff0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8162060 con 0x7fe1b80c19a0 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.074+0000 7fe1bcff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b8161450 con 0x7fe1b80b2f60 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b5d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1b80c19a0 0x7fe1b8070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b5d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1b80c19a0 0x7fe1b8070f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:45092/0 (socket says 172.21.15.133:45092) 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b5d9b640 1 -- 172.21.15.133:0/752344167 learned_addr learned my addr 172.21.15.133:0/752344167 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b659c640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1b80b2f60 0x7fe1b814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:51.084 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b6d9d640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b8160b80 0x7fe1b8071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:51.085 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b5d9b640 1 -- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1b80b2f60 msgr2=0x7fe1b814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:51.085 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b5d9b640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1b80b2f60 0x7fe1b814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.086 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b5d9b640 1 -- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b8160b80 msgr2=0x7fe1b8071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:51.086 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b5d9b640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b8160b80 0x7fe1b8071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.086 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b5d9b640 1 -- 172.21.15.133:0/752344167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0009a70 con 0x7fe1b80c19a0 2023-12-18T10:17:51.086 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b659c640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1b80b2f60 0x7fe1b814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:17:51.086 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.078+0000 7fe1b6d9d640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b8160b80 0x7fe1b8071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:17:51.088 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.082+0000 7fe1b5d9b640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1b80c19a0 0x7fe1b8070f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c450 tx=0x7fe1ac00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:51.089 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.082+0000 7fe1a6ffd640 1 -- 172.21.15.133:0/752344167 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac005cf0 con 0x7fe1b80c19a0 2023-12-18T10:17:51.089 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.082+0000 7fe1a6ffd640 1 -- 172.21.15.133:0/752344167 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac005e50 con 0x7fe1b80c19a0 2023-12-18T10:17:51.089 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.082+0000 7fe1a6ffd640 1 -- 172.21.15.133:0/752344167 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac007290 con 0x7fe1b80c19a0 2023-12-18T10:17:51.089 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.082+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b8161730 con 0x7fe1b80c19a0 2023-12-18T10:17:51.089 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.082+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b8161cf0 con 0x7fe1b80c19a0 2023-12-18T10:17:51.090 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.082+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b8073e90 con 0x7fe1b80c19a0 2023-12-18T10:17:51.094 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.086+0000 7fe1a6ffd640 1 -- 172.21.15.133:0/752344167 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7fe1ac0073f0 con 0x7fe1b80c19a0 2023-12-18T10:17:51.094 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.086+0000 7fe1a6ffd640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe198065a50 0x7fe198067f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:51.094 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.086+0000 7fe1a6ffd640 1 -- 172.21.15.133:0/752344167 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fe1ac081950 con 0x7fe1b80c19a0 2023-12-18T10:17:51.094 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.086+0000 7fe1b659c640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe198065a50 0x7fe198067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:51.095 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.090+0000 7fe1b659c640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe198065a50 0x7fe198067f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006fd0 tx=0x7fe1a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:51.105 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.098+0000 7fe1a6ffd640 1 -- 172.21.15.133:0/752344167 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe1ac050260 con 0x7fe1b80c19a0 2023-12-18T10:17:51.378 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-12-18T10:17:51.374+0000 7f8333eea640 -1 osd.6 0 waiting for initial osdmap 2023-12-18T10:17:51.383 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.378+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1b80ae530 con 0x7fe1b80c19a0 2023-12-18T10:17:51.395 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.390+0000 7fe1a6ffd640 1 -- 172.21.15.133:0/752344167 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe1ac017030 con 0x7fe1b80c19a0 2023-12-18T10:17:51.396 INFO:teuthology.misc.health.smithi133.stdout: 2023-12-18T10:17:51.396 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":12,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:17:48.878442+0000","last_up_change":"0.000000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:17:51.403 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe198065a50 msgr2=0x7fe198067f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:51.403 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe198065a50 0x7fe198067f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006fd0 tx=0x7fe1a8008040 comp rx=0 tx=0).stop 2023-12-18T10:17:51.404 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1b80c19a0 msgr2=0x7fe1b8070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:51.404 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1b80c19a0 0x7fe1b8070f20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c450 tx=0x7fe1ac00c910 comp rx=0 tx=0).stop 2023-12-18T10:17:51.404 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 shutdown_connections 2023-12-18T10:17:51.404 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe198065a50 0x7fe198067f10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.404 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1b8160b80 0x7fe1b8071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.404 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1b80c19a0 0x7fe1b8070f20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.404 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 --2- 172.21.15.133:0/752344167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe1b80b2f60 0x7fe1b814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:51.404 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 >> 172.21.15.133:0/752344167 conn(0x7fe1b806a0a0 msgr2=0x7fe1b80c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:51.405 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 shutdown_connections 2023-12-18T10:17:51.405 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:51.398+0000 7fe1bcff0640 1 -- 172.21.15.133:0/752344167 wait complete. 2023-12-18T10:17:51.425 INFO:tasks.ceph.osd.6.smithi142.stderr:2023-12-18T10:17:51.422+0000 7f832bd1d640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-18T10:17:51.430 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-18T10:17:51.426+0000 7f2e746ba640 -1 osd.5 0 waiting for initial osdmap 2023-12-18T10:17:51.432 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-12-18T10:17:51.426+0000 7fd9d3249640 -1 osd.1 0 waiting for initial osdmap 2023-12-18T10:17:51.434 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-18T10:17:51.473 INFO:tasks.ceph.osd.5.smithi142.stderr:2023-12-18T10:17:51.470+0000 7f2e6c4ed640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-18T10:17:51.483 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-12-18T10:17:51.478+0000 7fd9cb07c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-18T10:17:51.488 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-12-18T10:17:51.486+0000 7f6442653640 -1 osd.7 0 waiting for initial osdmap 2023-12-18T10:17:51.509 INFO:tasks.ceph.osd.7.smithi142.stderr:2023-12-18T10:17:51.506+0000 7f643a486640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-18T10:17:51.520 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-12-18T10:17:51.514+0000 7f0974208640 -1 osd.3 0 waiting for initial osdmap 2023-12-18T10:17:51.532 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-12-18T10:17:51.530+0000 7f0d8d068640 -1 osd.4 0 waiting for initial osdmap 2023-12-18T10:17:51.541 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-12-18T10:17:51.534+0000 7f8a88d2c640 -1 osd.0 0 waiting for initial osdmap 2023-12-18T10:17:51.547 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-12-18T10:17:51.542+0000 7f7e5d47e640 -1 osd.2 0 waiting for initial osdmap 2023-12-18T10:17:51.557 INFO:tasks.ceph.osd.4.smithi142.stderr:2023-12-18T10:17:51.554+0000 7f0d84e9b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-18T10:17:51.563 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-12-18T10:17:51.558+0000 7f096c03b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-18T10:17:51.575 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-12-18T10:17:51.570+0000 7f8a80348640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-18T10:17:51.575 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-12-18T10:17:51.570+0000 7f7e552b1640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-18T10:17:58.007 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:17:58.011 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:17:58.240 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-18T10:17:58.373 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b66fe9640 1 Processor -- start 2023-12-18T10:17:58.373 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b66fe9640 1 -- start start 2023-12-18T10:17:58.374 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b66fe9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b6015dd80 0x7f6b600ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.374 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b66fe9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b600cc5a0 0x7f6b600ab010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.375 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b66fe9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b600cf060 con 0x7f6b600cec00 2023-12-18T10:17:58.375 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b66fe9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b600cd760 con 0x7f6b600cc5a0 2023-12-18T10:17:58.375 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b66fe9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b600ccb50 con 0x7f6b6015dd80 2023-12-18T10:17:58.375 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b57fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6b600cec00 0x7f6b600cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46680/0 (socket says 172.21.15.133:46680) 2023-12-18T10:17:58.375 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b57fff640 1 -- 172.21.15.133:0/3590461212 learned_addr learned my addr 172.21.15.133:0/3590461212 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:17:58.375 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.366+0000 7f6b65586640 1 --2- 172.21.15.133:0/3590461212 >> v2:172.21.15.133:3300/0 conn(0x7f6b600cc5a0 0x7f6b600ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.375 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b64d85640 1 --2- 172.21.15.133:0/3590461212 >> v2:172.21.15.142:3300/0 conn(0x7f6b6015dd80 0x7f6b600ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.375 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b577fe640 1 -- 172.21.15.133:0/3590461212 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171045166 0 0) 0x7f6b600cf060 con 0x7f6b600cec00 2023-12-18T10:17:58.376 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b65586640 1 -- 172.21.15.133:0/3590461212 >> v2:172.21.15.142:3300/0 conn(0x7f6b6015dd80 msgr2=0x7f6b600ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:58.376 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b65586640 1 --2- 172.21.15.133:0/3590461212 >> v2:172.21.15.142:3300/0 conn(0x7f6b6015dd80 0x7f6b600ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.376 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b65586640 1 -- 172.21.15.133:0/3590461212 >> v1:172.21.15.133:6789/0 conn(0x7f6b600cec00 legacy=0x7f6b600cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.376 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b65586640 1 -- 172.21.15.133:0/3590461212 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600cce30 con 0x7f6b600cc5a0 2023-12-18T10:17:58.376 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b64d85640 1 --2- 172.21.15.133:0/3590461212 >> v2:172.21.15.142:3300/0 conn(0x7f6b6015dd80 0x7f6b600ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:17:58.378 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b65586640 1 --2- 172.21.15.133:0/3590461212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b600ab010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b600cbe40 tx=0x7f6b5801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a8b8e8ad660ede server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:58.378 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b577fe640 1 -- 172.21.15.133:0/3590461212 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b580a58c0 con 0x7f6b600cc5a0 2023-12-18T10:17:58.378 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b577fe640 1 -- 172.21.15.133:0/3590461212 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b580a5a20 con 0x7f6b600cc5a0 2023-12-18T10:17:58.378 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b577fe640 1 -- 172.21.15.133:0/3590461212 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b580a5db0 con 0x7f6b600cc5a0 2023-12-18T10:17:58.379 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b66fe9640 1 -- 172.21.15.133:0/3590461212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 msgr2=0x7f6b600ab010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.379 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.370+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/3590461212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b600ab010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6b600cbe40 tx=0x7f6b5801c910 comp rx=0 tx=0).stop 2023-12-18T10:17:58.379 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 -- 172.21.15.133:0/3590461212 shutdown_connections 2023-12-18T10:17:58.379 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/3590461212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b600ab010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.379 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/3590461212 >> v2:172.21.15.142:3300/0 conn(0x7f6b6015dd80 0x7f6b600ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.379 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 -- 172.21.15.133:0/3590461212 >> 172.21.15.133:0/3590461212 conn(0x7f6b6006a0a0 msgr2=0x7f6b6006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:58.379 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 -- 172.21.15.133:0/3590461212 shutdown_connections 2023-12-18T10:17:58.379 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 -- 172.21.15.133:0/3590461212 wait complete. 2023-12-18T10:17:58.380 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 Processor -- start 2023-12-18T10:17:58.380 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 -- start start 2023-12-18T10:17:58.383 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b601562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.383 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b600cec00 0x7f6b60164840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.383 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b6015dd80 0x7f6b60164d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.383 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b601599b0 con 0x7f6b600cc5a0 2023-12-18T10:17:58.383 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60156c00 con 0x7f6b6015dd80 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b66fe9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60159360 con 0x7f6b600cec00 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b64d85640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b601562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b64d85640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b601562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55420/0 (socket says 172.21.15.133:55420) 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b64d85640 1 -- 172.21.15.133:0/1764630048 learned_addr learned my addr 172.21.15.133:0/1764630048 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b65586640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b6015dd80 0x7f6b60164d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b57fff640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b600cec00 0x7f6b60164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b64d85640 1 -- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b600cec00 msgr2=0x7f6b60164840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b64d85640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b600cec00 0x7f6b60164840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b64d85640 1 -- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b6015dd80 msgr2=0x7f6b60164d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b64d85640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b6015dd80 0x7f6b60164d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b64d85640 1 -- 172.21.15.133:0/1764630048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58009a70 con 0x7f6b600cc5a0 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.374+0000 7f6b57fff640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b600cec00 0x7f6b60164840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b64d85640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b601562e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00d7d0 tx=0x7f6b5c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:58.384 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b557fa640 1 -- 172.21.15.133:0/1764630048 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0059a0 con 0x7f6b600cc5a0 2023-12-18T10:17:58.385 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b557fa640 1 -- 172.21.15.133:0/1764630048 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c005b00 con 0x7f6b600cc5a0 2023-12-18T10:17:58.385 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b60159640 con 0x7f6b600cc5a0 2023-12-18T10:17:58.385 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b557fa640 1 -- 172.21.15.133:0/1764630048 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c005e90 con 0x7f6b600cc5a0 2023-12-18T10:17:58.385 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b600aee90 con 0x7f6b600cc5a0 2023-12-18T10:17:58.385 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b60073e90 con 0x7f6b600cc5a0 2023-12-18T10:17:58.385 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b557fa640 1 -- 172.21.15.133:0/1764630048 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b5c004030 con 0x7f6b600cc5a0 2023-12-18T10:17:58.386 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b557fa640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b4c065a90 0x7f6b4c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.386 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b557fa640 1 -- 172.21.15.133:0/1764630048 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b5c082de0 con 0x7f6b600cc5a0 2023-12-18T10:17:58.386 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b57fff640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b4c065a90 0x7f6b4c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.386 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.378+0000 7f6b57fff640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b4c065a90 0x7f6b4c067f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6b60165430 tx=0x7f6b50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:58.391 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.386+0000 7f6b557fa640 1 -- 172.21.15.133:0/1764630048 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b5c050ae0 con 0x7f6b600cc5a0 2023-12-18T10:17:58.540 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.534+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b60071f50 con 0x7f6b600cc5a0 2023-12-18T10:17:58.541 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.534+0000 7f6b557fa640 1 -- 172.21.15.133:0/1764630048 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f6b5c054100 con 0x7f6b600cc5a0 2023-12-18T10:17:58.541 INFO:teuthology.misc.health.smithi133.stdout: 2023-12-18T10:17:58.541 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":16,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:17:55.908426+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:17:58.543 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b4c065a90 msgr2=0x7f6b4c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.543 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b4c065a90 0x7f6b4c067f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6b60165430 tx=0x7f6b50009040 comp rx=0 tx=0).stop 2023-12-18T10:17:58.543 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 msgr2=0x7f6b601562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b601562e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00d7d0 tx=0x7f6b5c00dc90 comp rx=0 tx=0).stop 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 shutdown_connections 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b4c065a90 0x7f6b4c067f50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b6015dd80 0x7f6b60164d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b600cec00 0x7f6b60164840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 --2- 172.21.15.133:0/1764630048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600cc5a0 0x7f6b601562e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 >> 172.21.15.133:0/1764630048 conn(0x7f6b6006a0a0 msgr2=0x7f6b600caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 shutdown_connections 2023-12-18T10:17:58.544 INFO:teuthology.misc.health.smithi133.stderr:2023-12-18T10:17:58.538+0000 7f6b66fe9640 1 -- 172.21.15.133:0/1764630048 wait complete. 2023-12-18T10:17:58.560 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-18T10:17:58.560 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-18T10:17:58.561 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-18T10:17:58.561 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-18T10:17:58.564 INFO:tasks.ceph.mds.a:Started 2023-12-18T10:17:58.564 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-18T10:17:58.564 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-18T10:17:58.568 INFO:tasks.ceph.mds.c:Started 2023-12-18T10:17:58.568 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-18T10:17:58.568 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-18T10:17:58.571 INFO:tasks.ceph.mds.b:Started 2023-12-18T10:17:58.571 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-18T10:17:58.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-18T10:17:58.575 INFO:tasks.ceph.mds.d:Started 2023-12-18T10:17:58.575 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-18T10:17:58.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:17:58.661 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:17:58.661 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:17:58.676 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:17:58.677 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:17:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.714+0000 7f219277b640 1 Processor -- start 2023-12-18T10:17:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.714+0000 7f219277b640 1 -- start start 2023-12-18T10:17:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.714+0000 7f219277b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f218c06c4f0 0x7f218c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.714+0000 7f219277b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f218c0c9e30 0x7f218c0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.714+0000 7f219277b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218c0c9460 con 0x7f218c1570c0 2023-12-18T10:17:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.714+0000 7f219277b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c1574a0 con 0x7f218c0c9e30 2023-12-18T10:17:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.714+0000 7f219277b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218c0c8b30 con 0x7f218c06c4f0 2023-12-18T10:17:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f2190d18640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f218c0c9e30 0x7f218c0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f218bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f218c1570c0 0x7f218c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46694/0 (socket says 172.21.15.133:46694) 2023-12-18T10:17:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f218bfff640 1 -- 172.21.15.133:0/146238023 learned_addr learned my addr 172.21.15.133:0/146238023 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:17:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f218b7fe640 1 --2- 172.21.15.133:0/146238023 >> v2:172.21.15.142:3300/0 conn(0x7f218c06c4f0 0x7f218c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f2190d18640 1 -- 172.21.15.133:0/146238023 >> v2:172.21.15.142:3300/0 conn(0x7f218c06c4f0 msgr2=0x7f218c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f2190d18640 1 --2- 172.21.15.133:0/146238023 >> v2:172.21.15.142:3300/0 conn(0x7f218c06c4f0 0x7f218c0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f2190d18640 1 -- 172.21.15.133:0/146238023 >> v1:172.21.15.133:6789/0 conn(0x7f218c1570c0 legacy=0x7f218c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f2190d18640 1 -- 172.21.15.133:0/146238023 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c0c8e10 con 0x7f218c0c9e30 2023-12-18T10:17:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f2190d18640 1 --2- 172.21.15.133:0/146238023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c0c9e30 0x7f218c0ca2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f218c0ce330 tx=0x7f218401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b504f2c7dbd1338 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f218affd640 1 -- 172.21.15.133:0/146238023 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840a59d0 con 0x7f218c0c9e30 2023-12-18T10:17:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f218affd640 1 -- 172.21.15.133:0/146238023 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21840a5b30 con 0x7f218c0c9e30 2023-12-18T10:17:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.718+0000 7f218affd640 1 -- 172.21.15.133:0/146238023 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840ad440 con 0x7f218c0c9e30 2023-12-18T10:17:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- 172.21.15.133:0/146238023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c0c9e30 msgr2=0x7f218c0ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 --2- 172.21.15.133:0/146238023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c0c9e30 0x7f218c0ca2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f218c0ce330 tx=0x7f218401c910 comp rx=0 tx=0).stop 2023-12-18T10:17:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- 172.21.15.133:0/146238023 shutdown_connections 2023-12-18T10:17:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 --2- 172.21.15.133:0/146238023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c0c9e30 0x7f218c0ca2c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 --2- 172.21.15.133:0/146238023 >> v2:172.21.15.142:3300/0 conn(0x7f218c06c4f0 0x7f218c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- 172.21.15.133:0/146238023 >> 172.21.15.133:0/146238023 conn(0x7f218c06a3e0 msgr2=0x7f218c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- 172.21.15.133:0/146238023 shutdown_connections 2023-12-18T10:17:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- 172.21.15.133:0/146238023 wait complete. 2023-12-18T10:17:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 Processor -- start 2023-12-18T10:17:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- start start 2023-12-18T10:17:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c06c4f0 0x7f218c1f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0c9e30 0x7f218c0ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c1570c0 0x7f218c0ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c1583b0 con 0x7f218c1570c0 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218c1f82e0 con 0x7f218c06c4f0 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f219277b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c1f85c0 con 0x7f218c0c9e30 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f2190d18640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c1570c0 0x7f218c0ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f2190d18640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c1570c0 0x7f218c0ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55472/0 (socket says 172.21.15.133:55472) 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f2190d18640 1 -- 172.21.15.133:0/1472383036 learned_addr learned my addr 172.21.15.133:0/1472383036 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f218bfff640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c06c4f0 0x7f218c1f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f218b7fe640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0c9e30 0x7f218c0ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f2190d18640 1 -- 172.21.15.133:0/1472383036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0c9e30 msgr2=0x7f218c0ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f2190d18640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0c9e30 0x7f218c0ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f2190d18640 1 -- 172.21.15.133:0/1472383036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c06c4f0 msgr2=0x7f218c1f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f2190d18640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c06c4f0 0x7f218c1f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.722+0000 7f2190d18640 1 -- 172.21.15.133:0/1472383036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2184009a70 con 0x7f218c1570c0 2023-12-18T10:17:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f2190d18640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c1570c0 0x7f218c0ad770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2184019520 tx=0x7f21840196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f2188ff9640 1 -- 172.21.15.133:0/1472383036 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840a59d0 con 0x7f218c1570c0 2023-12-18T10:17:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f2188ff9640 1 -- 172.21.15.133:0/1472383036 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2184009450 con 0x7f218c1570c0 2023-12-18T10:17:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c1f88a0 con 0x7f218c1570c0 2023-12-18T10:17:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f2188ff9640 1 -- 172.21.15.133:0/1472383036 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840b9690 con 0x7f218c1570c0 2023-12-18T10:17:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f218c1f8e60 con 0x7f218c1570c0 2023-12-18T10:17:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218c0735b0 con 0x7f218c1570c0 2023-12-18T10:17:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f2188ff9640 1 -- 172.21.15.133:0/1472383036 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f21840b97f0 con 0x7f218c1570c0 2023-12-18T10:17:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f2188ff9640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2178065a90 0x7f2178067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f2188ff9640 1 -- 172.21.15.133:0/1472383036 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f218411e860 con 0x7f218c1570c0 2023-12-18T10:17:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.726+0000 7f218bfff640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2178065a90 0x7f2178067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:58.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.730+0000 7f218bfff640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2178065a90 0x7f2178067f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f217c005890 tx=0x7f217c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:58.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.730+0000 7f2188ff9640 1 -- 172.21.15.133:0/1472383036 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f21840ec560 con 0x7f218c1570c0 2023-12-18T10:17:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.882+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f218c1f9050 con 0x7f218c1570c0 2023-12-18T10:17:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.882+0000 7f2188ff9640 1 -- 172.21.15.133:0/1472383036 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f21840efb80 con 0x7f218c1570c0 2023-12-18T10:17:58.890 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:17:58.890 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:17:55.908426+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:17:58.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2178065a90 msgr2=0x7f2178067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2178065a90 0x7f2178067f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f217c005890 tx=0x7f217c009040 comp rx=0 tx=0).stop 2023-12-18T10:17:58.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c1570c0 msgr2=0x7f218c0ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:58.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c1570c0 0x7f218c0ad770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2184019520 tx=0x7f21840196b0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 shutdown_connections 2023-12-18T10:17:58.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2178065a90 0x7f2178067f50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f218c1570c0 0x7f218c0ad770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f218c0c9e30 0x7f218c0ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 --2- 172.21.15.133:0/1472383036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f218c06c4f0 0x7f218c1f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:58.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 >> 172.21.15.133:0/1472383036 conn(0x7f218c06a3e0 msgr2=0x7f218c14d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:58.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 shutdown_connections 2023-12-18T10:17:58.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:58.886+0000 7f219277b640 1 -- 172.21.15.133:0/1472383036 wait complete. 2023-12-18T10:17:58.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:17:58.911 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:17:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e14e2d640 1 Processor -- start 2023-12-18T10:17:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e14e2d640 1 -- start start 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e14e2d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e1015cae0 0x7f1e100d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e14e2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e14e2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e100cf170 0x7f1e100cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e14e2d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e100cfb40 con 0x7f1e1015cae0 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e14e2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1015cec0 con 0x7f1e100cf170 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e14e2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100d0530 con 0x7f1e100cde90 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e1015cae0 0x7f1e100d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e1015cae0 0x7f1e100d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55474/0 (socket says 172.21.15.133:55474) 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0e59c640 1 -- 172.21.15.133:0/2184289802 learned_addr learned my addr 172.21.15.133:0/2184289802 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0ed9d640 1 --2- 172.21.15.133:0/2184289802 >> v2:172.21.15.142:3300/0 conn(0x7f1e100cf170 0x7f1e100cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e05d9b640 1 --2- 172.21.15.133:0/2184289802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0e59c640 1 -- 172.21.15.133:0/2184289802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 msgr2=0x7f1e100ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0e59c640 1 --2- 172.21.15.133:0/2184289802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0e59c640 1 -- 172.21.15.133:0/2184289802 >> v2:172.21.15.142:3300/0 conn(0x7f1e100cf170 msgr2=0x7f1e100cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0e59c640 1 --2- 172.21.15.133:0/2184289802 >> v2:172.21.15.142:3300/0 conn(0x7f1e100cf170 0x7f1e100cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0e59c640 1 -- 172.21.15.133:0/2184289802 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100d0810 con 0x7f1e1015cae0 2023-12-18T10:17:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.046+0000 7f1e0ed9d640 1 --2- 172.21.15.133:0/2184289802 >> v2:172.21.15.142:3300/0 conn(0x7f1e100cf170 0x7f1e100cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:17:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e0e59c640 1 --2- 172.21.15.133:0/2184289802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e1015cae0 0x7f1e100d12f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e10160520 tx=0x7f1e0001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169a32a5f07deed2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e0dd9b640 1 -- 172.21.15.133:0/2184289802 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e000a5820 con 0x7f1e1015cae0 2023-12-18T10:17:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e0dd9b640 1 -- 172.21.15.133:0/2184289802 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e000a5980 con 0x7f1e1015cae0 2023-12-18T10:17:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e0dd9b640 1 -- 172.21.15.133:0/2184289802 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e000a5d10 con 0x7f1e1015cae0 2023-12-18T10:17:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2184289802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e1015cae0 msgr2=0x7f1e100d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2184289802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e1015cae0 0x7f1e100d12f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e10160520 tx=0x7f1e0001c9a0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2184289802 shutdown_connections 2023-12-18T10:17:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2184289802 >> v2:172.21.15.142:3300/0 conn(0x7f1e100cf170 0x7f1e100cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2184289802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2184289802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e1015cae0 0x7f1e100d12f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2184289802 >> 172.21.15.133:0/2184289802 conn(0x7f1e10089fb0 msgr2=0x7f1e100d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2184289802 shutdown_connections 2023-12-18T10:17:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.050+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2184289802 wait complete. 2023-12-18T10:17:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 Processor -- start 2023-12-18T10:17:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 -- start start 2023-12-18T10:17:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e100cf170 0x7f1e1015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1015cae0 0x7f1e101f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100c98b0 con 0x7f1e100cf170 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100af370 con 0x7f1e1015cae0 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100b02c0 con 0x7f1e100cde90 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e100cf170 0x7f1e1015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e100cf170 0x7f1e1015b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55490/0 (socket says 172.21.15.133:55490) 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 -- 172.21.15.133:0/2209891295 learned_addr learned my addr 172.21.15.133:0/2209891295 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e0ed9d640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1015cae0 0x7f1e101f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e0e59c640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 -- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 msgr2=0x7f1e100afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 -- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1015cae0 msgr2=0x7f1e101f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1015cae0 0x7f1e101f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 -- 172.21.15.133:0/2209891295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e00009ad0 con 0x7f1e100cf170 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e0ed9d640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1015cae0 0x7f1e101f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e0e59c640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e05d9b640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e100cf170 0x7f1e1015b3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1df800e870 tx=0x7f1df800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e077fe640 1 -- 172.21.15.133:0/2209891295 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df800ee60 con 0x7f1e100cf170 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e077fe640 1 -- 172.21.15.133:0/2209891295 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df800c8e0 con 0x7f1e100cf170 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e077fe640 1 -- 172.21.15.133:0/2209891295 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df800cc90 con 0x7f1e100cf170 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e101f9230 con 0x7f1e100cf170 2023-12-18T10:17:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.054+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100af860 con 0x7f1e100cf170 2023-12-18T10:17:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.058+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e100af9f0 con 0x7f1e100cf170 2023-12-18T10:17:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.058+0000 7f1e077fe640 1 -- 172.21.15.133:0/2209891295 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1df8013470 con 0x7f1e100cf170 2023-12-18T10:17:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.058+0000 7f1e077fe640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1df0065a60 0x7f1df0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.058+0000 7f1e077fe640 1 -- 172.21.15.133:0/2209891295 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1df8082f70 con 0x7f1e100cf170 2023-12-18T10:17:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.058+0000 7f1e0e59c640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1df0065a60 0x7f1df0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.058+0000 7f1e0e59c640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1df0065a60 0x7f1df0067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e000ae000 tx=0x7f1e000a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.062+0000 7f1e077fe640 1 -- 172.21.15.133:0/2209891295 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1df8050b50 con 0x7f1e100cf170 2023-12-18T10:17:59.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.210+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e101f8f50 con 0x7f1e100cf170 2023-12-18T10:17:59.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.210+0000 7f1e077fe640 1 -- 172.21.15.133:0/2209891295 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1df80210a0 con 0x7f1e100cf170 2023-12-18T10:17:59.220 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:17:59.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1df0065a60 msgr2=0x7f1df0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1df0065a60 0x7f1df0067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e000ae000 tx=0x7f1e000a7070 comp rx=0 tx=0).stop 2023-12-18T10:17:59.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e100cf170 msgr2=0x7f1e1015b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e100cf170 0x7f1e1015b3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1df800e870 tx=0x7f1df800ed30 comp rx=0 tx=0).stop 2023-12-18T10:17:59.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 shutdown_connections 2023-12-18T10:17:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1df0065a60 0x7f1df0067f20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e1015cae0 0x7f1e101f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e100cf170 0x7f1e1015b3a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 --2- 172.21.15.133:0/2209891295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e100cde90 0x7f1e100afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 >> 172.21.15.133:0/2209891295 conn(0x7f1e10089fb0 msgr2=0x7f1e1015f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 shutdown_connections 2023-12-18T10:17:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.214+0000 7f1e14e2d640 1 -- 172.21.15.133:0/2209891295 wait complete. 2023-12-18T10:17:59.239 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:17:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd58afa2640 1 Processor -- start 2023-12-18T10:17:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd58afa2640 1 -- start start 2023-12-18T10:17:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd58afa2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5840afd10 0x7fd5840b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd58afa2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd58406fb60 0x7fd58406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd58afa2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5840cbc70 con 0x7fd5840cc6c0 2023-12-18T10:17:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd58afa2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5840b0630 con 0x7fd5840afd10 2023-12-18T10:17:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd58afa2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5840c3bb0 con 0x7fd58406fb60 2023-12-18T10:17:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd589fa0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5840afd10 0x7fd5840b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd589fa0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5840afd10 0x7fd5840b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55494/0 (socket says 172.21.15.133:55494) 2023-12-18T10:17:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd589fa0640 1 -- 172.21.15.133:0/4162635513 learned_addr learned my addr 172.21.15.133:0/4162635513 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd589fa0640 1 -- 172.21.15.133:0/4162635513 >> v2:172.21.15.142:3300/0 conn(0x7fd58406fb60 msgr2=0x7fd58406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd589fa0640 1 --2- 172.21.15.133:0/4162635513 >> v2:172.21.15.142:3300/0 conn(0x7fd58406fb60 0x7fd58406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd589fa0640 1 -- 172.21.15.133:0/4162635513 >> v1:172.21.15.142:6789/0 conn(0x7fd5840cc6c0 legacy=0x7fd5840c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:17:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.370+0000 7fd589fa0640 1 -- 172.21.15.133:0/4162635513 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840c3e90 con 0x7fd5840afd10 2023-12-18T10:17:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd589fa0640 1 --2- 172.21.15.133:0/4162635513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840b00f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5840cab10 tx=0x7fd58001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d691f194b87e19 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd588f9e640 1 -- 172.21.15.133:0/4162635513 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800aa5f0 con 0x7fd5840afd10 2023-12-18T10:17:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd588f9e640 1 -- 172.21.15.133:0/4162635513 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5800aa750 con 0x7fd5840afd10 2023-12-18T10:17:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd588f9e640 1 -- 172.21.15.133:0/4162635513 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800aaae0 con 0x7fd5840afd10 2023-12-18T10:17:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd58afa2640 1 -- 172.21.15.133:0/4162635513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 msgr2=0x7fd5840b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd58afa2640 1 --2- 172.21.15.133:0/4162635513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840b00f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd5840cab10 tx=0x7fd58001c490 comp rx=0 tx=0).stop 2023-12-18T10:17:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd58afa2640 1 -- 172.21.15.133:0/4162635513 shutdown_connections 2023-12-18T10:17:59.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd58afa2640 1 --2- 172.21.15.133:0/4162635513 >> v2:172.21.15.142:3300/0 conn(0x7fd58406fb60 0x7fd58406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd58afa2640 1 --2- 172.21.15.133:0/4162635513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840b00f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd58afa2640 1 -- 172.21.15.133:0/4162635513 >> 172.21.15.133:0/4162635513 conn(0x7fd5840ce130 msgr2=0x7fd5840ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:59.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd58afa2640 1 -- 172.21.15.133:0/4162635513 shutdown_connections 2023-12-18T10:17:59.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.374+0000 7fd58afa2640 1 -- 172.21.15.133:0/4162635513 wait complete. 2023-12-18T10:17:59.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 Processor -- start 2023-12-18T10:17:59.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 -- start start 2023-12-18T10:17:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd58406fb60 0x7fd5840b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5840cc6c0 0x7fd584070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5840b2e50 con 0x7fd5840afd10 2023-12-18T10:17:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5840c8330 con 0x7fd58406fb60 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841f9480 con 0x7fd5840cc6c0 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55500/0 (socket says 172.21.15.133:55500) 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 -- 172.21.15.133:0/1485232271 learned_addr learned my addr 172.21.15.133:0/1485232271 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd589fa0640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd58406fb60 0x7fd5840b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 -- 172.21.15.133:0/1485232271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5840cc6c0 msgr2=0x7fd584070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5840cc6c0 0x7fd584070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 -- 172.21.15.133:0/1485232271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd58406fb60 msgr2=0x7fd5840b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd58406fb60 0x7fd5840b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 -- 172.21.15.133:0/1485232271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800094d0 con 0x7fd5840afd10 2023-12-18T10:17:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd589fa0640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd58406fb60 0x7fd5840b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:17:59.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58979f640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840c7df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd57400b550 tx=0x7fd57400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:59.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd57a7fc640 1 -- 172.21.15.133:0/1485232271 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574010870 con 0x7fd5840afd10 2023-12-18T10:17:59.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd57a7fc640 1 -- 172.21.15.133:0/1485232271 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5740109f0 con 0x7fd5840afd10 2023-12-18T10:17:59.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5840b3110 con 0x7fd5840afd10 2023-12-18T10:17:59.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd57a7fc640 1 -- 172.21.15.133:0/1485232271 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574010da0 con 0x7fd5840afd10 2023-12-18T10:17:59.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.378+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5840b36d0 con 0x7fd5840afd10 2023-12-18T10:17:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.382+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58404e850 con 0x7fd5840afd10 2023-12-18T10:17:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.382+0000 7fd57a7fc640 1 -- 172.21.15.133:0/1485232271 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd57400f3c0 con 0x7fd5840afd10 2023-12-18T10:17:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.382+0000 7fd57a7fc640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd568065a60 0x7fd568067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:17:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.382+0000 7fd57a7fc640 1 -- 172.21.15.133:0/1485232271 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd574082ec0 con 0x7fd5840afd10 2023-12-18T10:17:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.382+0000 7fd589fa0640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd568065a60 0x7fd568067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:17:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.382+0000 7fd589fa0640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd568065a60 0x7fd568067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd5800ae000 tx=0x7fd580008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:17:59.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.386+0000 7fd57a7fc640 1 -- 172.21.15.133:0/1485232271 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd574050b30 con 0x7fd5840afd10 2023-12-18T10:17:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd58413f0d0 con 0x7fd5840afd10 2023-12-18T10:17:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd57a7fc640 1 -- 172.21.15.133:0/1485232271 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fd57401e500 con 0x7fd5840afd10 2023-12-18T10:17:59.573 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:17:59.573 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-18T10:17:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 2 2023-12-18T10:17:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd568065a60 msgr2=0x7fd568067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd568065a60 0x7fd568067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd5800ae000 tx=0x7fd580008040 comp rx=0 tx=0).stop 2023-12-18T10:17:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 msgr2=0x7fd5840c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840c7df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd57400b550 tx=0x7fd57400ba10 comp rx=0 tx=0).stop 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 shutdown_connections 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd568065a60 0x7fd568067f20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5840cc6c0 0x7fd584070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5840afd10 0x7fd5840c7df0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 --2- 172.21.15.133:0/1485232271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd58406fb60 0x7fd5840b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 >> 172.21.15.133:0/1485232271 conn(0x7fd5840ce130 msgr2=0x7fd5840ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 shutdown_connections 2023-12-18T10:17:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:17:59.566+0000 7fd58afa2640 1 -- 172.21.15.133:0/1485232271 wait complete. 2023-12-18T10:18:01.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:18:01.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.734+0000 7fd8186d1640 1 Processor -- start 2023-12-18T10:18:01.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.734+0000 7fd8186d1640 1 -- start start 2023-12-18T10:18:01.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd8186d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8100ca030 0x7fd8100ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:01.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd8186d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100ce6d0 con 0x7fd8100ae040 2023-12-18T10:18:01.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd8186d1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100cccf0 con 0x7fd8100cdd50 2023-12-18T10:18:01.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd8186d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100ae420 con 0x7fd8100ca030 2023-12-18T10:18:01.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd816c6e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8100ca030 0x7fd8100ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:01.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd81646d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd8100ae040 0x7fd81006cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56408/0 (socket says 172.21.15.133:56408) 2023-12-18T10:18:01.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd81646d640 1 -- 172.21.15.133:0/1447428322 learned_addr learned my addr 172.21.15.133:0/1447428322 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:01.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd816c6e640 1 -- 172.21.15.133:0/1447428322 >> v1:172.21.15.142:6789/0 conn(0x7fd8100cdd50 legacy=0x7fd8100c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:01.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd816c6e640 1 -- 172.21.15.133:0/1447428322 >> v1:172.21.15.133:6789/0 conn(0x7fd8100ae040 legacy=0x7fd81006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:01.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.738+0000 7fd816c6e640 1 -- 172.21.15.133:0/1447428322 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100ccf90 con 0x7fd8100ca030 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd816c6e640 1 --2- 172.21.15.133:0/1447428322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100ce190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd808009d90 tx=0x7fd80801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9576e3050ac7d6b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd81546b640 1 -- 172.21.15.133:0/1447428322 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080a59e0 con 0x7fd8100ca030 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd81546b640 1 -- 172.21.15.133:0/1447428322 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8080a5b40 con 0x7fd8100ca030 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd81546b640 1 -- 172.21.15.133:0/1447428322 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080ad440 con 0x7fd8100ca030 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- 172.21.15.133:0/1447428322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 msgr2=0x7fd8100ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 --2- 172.21.15.133:0/1447428322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100ce190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd808009d90 tx=0x7fd80801c920 comp rx=0 tx=0).stop 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- 172.21.15.133:0/1447428322 shutdown_connections 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 --2- 172.21.15.133:0/1447428322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100ce190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- 172.21.15.133:0/1447428322 >> 172.21.15.133:0/1447428322 conn(0x7fd8100cb610 msgr2=0x7fd8100cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- 172.21.15.133:0/1447428322 shutdown_connections 2023-12-18T10:18:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- 172.21.15.133:0/1447428322 wait complete. 2023-12-18T10:18:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 Processor -- start 2023-12-18T10:18:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- start start 2023-12-18T10:18:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8100ae040 0x7fd8101531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:01.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:01.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8100cdd50 0x7fd8100c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:01.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101f9050 con 0x7fd8100ca030 2023-12-18T10:18:01.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100b1cf0 con 0x7fd8100cdd50 2023-12-18T10:18:01.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.742+0000 7fd8186d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101f84d0 con 0x7fd8100ae040 2023-12-18T10:18:01.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:01.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49346/0 (socket says 172.21.15.133:49346) 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 -- 172.21.15.133:0/2860899921 learned_addr learned my addr 172.21.15.133:0/2860899921 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd816c6e640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8100cdd50 0x7fd8100c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd81646d640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8100ae040 0x7fd8101531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 -- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8100ae040 msgr2=0x7fd8101531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8100ae040 0x7fd8101531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 -- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8100cdd50 msgr2=0x7fd8100c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8100cdd50 0x7fd8100c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 -- 172.21.15.133:0/2860899921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808009a70 con 0x7fd8100ca030 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd816c6e640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8100cdd50 0x7fd8100c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd815c6c640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100b17b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c530 tx=0x7fd80000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd806ffd640 1 -- 172.21.15.133:0/2860899921 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800005220 con 0x7fd8100ca030 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd806ffd640 1 -- 172.21.15.133:0/2860899921 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800005380 con 0x7fd8100ca030 2023-12-18T10:18:01.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd806ffd640 1 -- 172.21.15.133:0/2860899921 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800007270 con 0x7fd8100ca030 2023-12-18T10:18:01.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8101f87b0 con 0x7fd8100ca030 2023-12-18T10:18:01.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8101f8d70 con 0x7fd8100ca030 2023-12-18T10:18:01.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81004e000 con 0x7fd8100ca030 2023-12-18T10:18:01.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd806ffd640 1 -- 172.21.15.133:0/2860899921 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd8000073d0 con 0x7fd8100ca030 2023-12-18T10:18:01.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.746+0000 7fd806ffd640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7f4065a90 0x7fd7f4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:01.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.750+0000 7fd806ffd640 1 -- 172.21.15.133:0/2860899921 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8000826f0 con 0x7fd8100ca030 2023-12-18T10:18:01.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.750+0000 7fd81646d640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7f4065a90 0x7fd7f4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:01.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.750+0000 7fd81646d640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7f4065a90 0x7fd7f4067f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd80c005890 tx=0x7fd80c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:01.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.754+0000 7fd806ffd640 1 -- 172.21.15.133:0/2860899921 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd8000503f0 con 0x7fd8100ca030 2023-12-18T10:18:01.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.934+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8100cca30 con 0x7fd8100ca030 2023-12-18T10:18:01.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.934+0000 7fd806ffd640 1 -- 172.21.15.133:0/2860899921 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fd800053a10 con 0x7fd8100ca030 2023-12-18T10:18:01.942 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:01.942 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-18T10:18:01.942 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 3 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7f4065a90 msgr2=0x7fd7f4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7f4065a90 0x7fd7f4067f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd80c005890 tx=0x7fd80c009040 comp rx=0 tx=0).stop 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 msgr2=0x7fd8100b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100b17b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c530 tx=0x7fd80000c9f0 comp rx=0 tx=0).stop 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 shutdown_connections 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7f4065a90 0x7fd7f4067f50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8100cdd50 0x7fd8100c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8100ca030 0x7fd8100b17b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 --2- 172.21.15.133:0/2860899921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8100ae040 0x7fd8101531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 >> 172.21.15.133:0/2860899921 conn(0x7fd8100cb610 msgr2=0x7fd81006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 shutdown_connections 2023-12-18T10:18:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:01.938+0000 7fd8186d1640 1 -- 172.21.15.133:0/2860899921 wait complete. 2023-12-18T10:18:01.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:02.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8949ad7640 1 Processor -- start 2023-12-18T10:18:02.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8949ad7640 1 -- start start 2023-12-18T10:18:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8949ad7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89440ce400 0x7f89441601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8949ad7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8944160700 0x7f89440ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8949ad7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8944160ba0 con 0x7f89440ce7e0 2023-12-18T10:18:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8949ad7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8944161160 con 0x7f8944160700 2023-12-18T10:18:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8949ad7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8944160e80 con 0x7f89440ce400 2023-12-18T10:18:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8948ad5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89440ce400 0x7f89441601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8943fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8944160700 0x7f89440ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8948ad5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89440ce400 0x7f89441601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:37456/0 (socket says 172.21.15.133:37456) 2023-12-18T10:18:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.094+0000 7f8948ad5640 1 -- 172.21.15.133:0/2704319797 learned_addr learned my addr 172.21.15.133:0/2704319797 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f8948ad5640 1 -- 172.21.15.133:0/2704319797 >> v2:172.21.15.142:3300/0 conn(0x7f8944160700 msgr2=0x7f89440ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f8948ad5640 1 --2- 172.21.15.133:0/2704319797 >> v2:172.21.15.142:3300/0 conn(0x7f8944160700 0x7f89440ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f8948ad5640 1 -- 172.21.15.133:0/2704319797 >> v1:172.21.15.142:6789/0 conn(0x7f89440ce7e0 legacy=0x7f89440d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f89437fe640 1 -- 172.21.15.133:0/2704319797 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400796528 0 0) 0x7f8944160ba0 con 0x7f89440ce7e0 2023-12-18T10:18:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f8948ad5640 1 -- 172.21.15.133:0/2704319797 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894406af50 con 0x7f89440ce400 2023-12-18T10:18:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f8948ad5640 1 --2- 172.21.15.133:0/2704319797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89440ce400 0x7f89441601c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8938009870 tx=0x7f893801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef095ab16220d323 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f89437fe640 1 -- 172.21.15.133:0/2704319797 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380a6040 con 0x7f89440ce400 2023-12-18T10:18:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f89437fe640 1 -- 172.21.15.133:0/2704319797 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89380aa600 con 0x7f89440ce400 2023-12-18T10:18:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.098+0000 7f89437fe640 1 -- 172.21.15.133:0/2704319797 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380aa990 con 0x7f89440ce400 2023-12-18T10:18:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- 172.21.15.133:0/2704319797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89440ce400 msgr2=0x7f89441601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 --2- 172.21.15.133:0/2704319797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89440ce400 0x7f89441601c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8938009870 tx=0x7f893801c480 comp rx=0 tx=0).stop 2023-12-18T10:18:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- 172.21.15.133:0/2704319797 shutdown_connections 2023-12-18T10:18:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 --2- 172.21.15.133:0/2704319797 >> v2:172.21.15.142:3300/0 conn(0x7f8944160700 0x7f89440ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 --2- 172.21.15.133:0/2704319797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89440ce400 0x7f89441601c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- 172.21.15.133:0/2704319797 >> 172.21.15.133:0/2704319797 conn(0x7f8944069ca0 msgr2=0x7f894406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- 172.21.15.133:0/2704319797 shutdown_connections 2023-12-18T10:18:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- 172.21.15.133:0/2704319797 wait complete. 2023-12-18T10:18:02.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 Processor -- start 2023-12-18T10:18:02.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- start start 2023-12-18T10:18:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89440ce400 0x7f894415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89440ce7e0 0x7f89440ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8944160700 0x7f894415f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440acfe0 con 0x7f89440ce400 2023-12-18T10:18:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440ac360 con 0x7f89440ce7e0 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8949ad7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440ac640 con 0x7f8944160700 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8948ad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89440ce400 0x7f894415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8948ad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89440ce400 0x7f894415b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49358/0 (socket says 172.21.15.133:49358) 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8948ad5640 1 -- 172.21.15.133:0/566454405 learned_addr learned my addr 172.21.15.133:0/566454405 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8943fff640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89440ce7e0 0x7f89440ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f89492d6640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8944160700 0x7f894415f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8948ad5640 1 -- 172.21.15.133:0/566454405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8944160700 msgr2=0x7f894415f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8948ad5640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8944160700 0x7f894415f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8948ad5640 1 -- 172.21.15.133:0/566454405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89440ce7e0 msgr2=0x7f89440ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8948ad5640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89440ce7e0 0x7f89440ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.102+0000 7f8948ad5640 1 -- 172.21.15.133:0/566454405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380094d0 con 0x7f89440ce400 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f8948ad5640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89440ce400 0x7f894415b440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f893801a0b0 tx=0x7f893801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f89417fa640 1 -- 172.21.15.133:0/566454405 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380b3600 con 0x7f89440ce400 2023-12-18T10:18:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f89417fa640 1 -- 172.21.15.133:0/566454405 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89380b3760 con 0x7f89440ce400 2023-12-18T10:18:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89440ac920 con 0x7f89440ce400 2023-12-18T10:18:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f89417fa640 1 -- 172.21.15.133:0/566454405 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380b3af0 con 0x7f89440ce400 2023-12-18T10:18:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89440ad400 con 0x7f89440ce400 2023-12-18T10:18:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894404e850 con 0x7f89440ce400 2023-12-18T10:18:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f89417fa640 1 -- 172.21.15.133:0/566454405 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f89380b3c50 con 0x7f89440ce400 2023-12-18T10:18:02.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f89417fa640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8928065a90 0x7f8928067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f89417fa640 1 -- 172.21.15.133:0/566454405 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f893811d7f0 con 0x7f89440ce400 2023-12-18T10:18:02.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.106+0000 7f8943fff640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8928065a90 0x7f8928067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.110+0000 7f8943fff640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8928065a90 0x7f8928067f50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89440b4130 tx=0x7f8930009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.114+0000 7f89417fa640 1 -- 172.21.15.133:0/566454405 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f89380eb640 con 0x7f89440ce400 2023-12-18T10:18:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.266+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89440b1f50 con 0x7f89440ce400 2023-12-18T10:18:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.266+0000 7f89417fa640 1 -- 172.21.15.133:0/566454405 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f89380eec60 con 0x7f89440ce400 2023-12-18T10:18:02.274 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:02.274 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:17:55.908426+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:02.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8928065a90 msgr2=0x7f8928067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8928065a90 0x7f8928067f50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89440b4130 tx=0x7f8930009190 comp rx=0 tx=0).stop 2023-12-18T10:18:02.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89440ce400 msgr2=0x7f894415b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89440ce400 0x7f894415b440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f893801a0b0 tx=0x7f893801acc0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 shutdown_connections 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8928065a90 0x7f8928067f50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8944160700 0x7f894415f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89440ce7e0 0x7f89440ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 --2- 172.21.15.133:0/566454405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89440ce400 0x7f894415b440 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 >> 172.21.15.133:0/566454405 conn(0x7f8944069ca0 msgr2=0x7f89440b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 shutdown_connections 2023-12-18T10:18:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.270+0000 7f8949ad7640 1 -- 172.21.15.133:0/566454405 wait complete. 2023-12-18T10:18:02.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:18:02.295 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90ad42d640 1 Processor -- start 2023-12-18T10:18:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90ad42d640 1 -- start start 2023-12-18T10:18:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90ad42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a8070820 0x7f90a80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90ad42d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90a80ce3b0 0x7f90a80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90ad42d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a80c9390 con 0x7f90a81582d0 2023-12-18T10:18:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90ad42d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a80ced80 con 0x7f90a80ce3b0 2023-12-18T10:18:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90ad42d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a815aee0 con 0x7f90a8070820 2023-12-18T10:18:02.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90a77fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90a80ce3b0 0x7f90a80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f909ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a8070820 0x7f90a80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90a77fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90a80ce3b0 0x7f90a80ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47732/0 (socket says 172.21.15.133:47732) 2023-12-18T10:18:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90a77fe640 1 -- 172.21.15.133:0/496207580 learned_addr learned my addr 172.21.15.133:0/496207580 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f909ffff640 1 -- 172.21.15.133:0/496207580 >> v2:172.21.15.142:3300/0 conn(0x7f90a80ce3b0 msgr2=0x7f90a80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f909ffff640 1 --2- 172.21.15.133:0/496207580 >> v2:172.21.15.142:3300/0 conn(0x7f90a80ce3b0 0x7f90a80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f909ffff640 1 -- 172.21.15.133:0/496207580 >> v1:172.21.15.142:6789/0 conn(0x7f90a81582d0 legacy=0x7f90a80ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f909ffff640 1 -- 172.21.15.133:0/496207580 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a815b1c0 con 0x7f90a8070820 2023-12-18T10:18:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.430+0000 7f90a77fe640 1 --2- 172.21.15.133:0/496207580 >> v2:172.21.15.142:3300/0 conn(0x7f90a80ce3b0 0x7f90a80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f909ffff640 1 --2- 172.21.15.133:0/496207580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a8070820 0x7f90a80c8e50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f90900097c0 tx=0x7f909001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d346ad853d3ce24c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90a67fc640 1 -- 172.21.15.133:0/496207580 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900ab650 con 0x7f90a8070820 2023-12-18T10:18:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90a67fc640 1 -- 172.21.15.133:0/496207580 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900ab7b0 con 0x7f90a8070820 2023-12-18T10:18:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90a67fc640 1 -- 172.21.15.133:0/496207580 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900abb40 con 0x7f90a8070820 2023-12-18T10:18:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90ad42d640 1 -- 172.21.15.133:0/496207580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a8070820 msgr2=0x7f90a80c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90ad42d640 1 --2- 172.21.15.133:0/496207580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a8070820 0x7f90a80c8e50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f90900097c0 tx=0x7f909001c450 comp rx=0 tx=0).stop 2023-12-18T10:18:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90ad42d640 1 -- 172.21.15.133:0/496207580 shutdown_connections 2023-12-18T10:18:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90ad42d640 1 --2- 172.21.15.133:0/496207580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a8070820 0x7f90a80c8e50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90ad42d640 1 --2- 172.21.15.133:0/496207580 >> v2:172.21.15.142:3300/0 conn(0x7f90a80ce3b0 0x7f90a80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90ad42d640 1 -- 172.21.15.133:0/496207580 >> 172.21.15.133:0/496207580 conn(0x7f90a806a2a0 msgr2=0x7f90a80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90ad42d640 1 -- 172.21.15.133:0/496207580 shutdown_connections 2023-12-18T10:18:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.434+0000 7f90ad42d640 1 -- 172.21.15.133:0/496207580 wait complete. 2023-12-18T10:18:02.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 Processor -- start 2023-12-18T10:18:02.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 -- start start 2023-12-18T10:18:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90a8070820 0x7f90a8155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90a80ce3b0 0x7f90a80c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a81582d0 0x7f90a80cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81f8110 con 0x7f90a80ce3b0 2023-12-18T10:18:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81636a0 con 0x7f90a8070820 2023-12-18T10:18:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a80c7fd0 con 0x7f90a81582d0 2023-12-18T10:18:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90a80ce3b0 0x7f90a80c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90a80ce3b0 0x7f90a80c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49372/0 (socket says 172.21.15.133:49372) 2023-12-18T10:18:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 -- 172.21.15.133:0/3304222576 learned_addr learned my addr 172.21.15.133:0/3304222576 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90a77fe640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a81582d0 0x7f90a80cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90a6ffd640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90a8070820 0x7f90a8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 -- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a81582d0 msgr2=0x7f90a80cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a81582d0 0x7f90a80cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 -- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90a8070820 msgr2=0x7f90a8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90a8070820 0x7f90a8155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 -- 172.21.15.133:0/3304222576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0009b30 con 0x7f90a80ce3b0 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90a77fe640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a81582d0 0x7f90a80cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90a6ffd640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90a8070820 0x7f90a8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909ffff640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90a80ce3b0 0x7f90a80c7530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f90900ad040 tx=0x7f909001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909f7fe640 1 -- 172.21.15.133:0/3304222576 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900b5810 con 0x7f90a80ce3b0 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909f7fe640 1 -- 172.21.15.133:0/3304222576 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900b5970 con 0x7f90a80ce3b0 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f909f7fe640 1 -- 172.21.15.133:0/3304222576 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900b5d20 con 0x7f90a80ce3b0 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9090009420 con 0x7f90a80ce3b0 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.438+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a81638f0 con 0x7f90a80ce3b0 2023-12-18T10:18:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.442+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a804e000 con 0x7f90a80ce3b0 2023-12-18T10:18:02.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.442+0000 7f909f7fe640 1 -- 172.21.15.133:0/3304222576 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90900bf410 con 0x7f90a80ce3b0 2023-12-18T10:18:02.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.442+0000 7f909f7fe640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9088065a60 0x7f9088067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.442+0000 7f909f7fe640 1 -- 172.21.15.133:0/3304222576 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f909011db00 con 0x7f90a80ce3b0 2023-12-18T10:18:02.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.442+0000 7f90a6ffd640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9088065a60 0x7f9088067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.442+0000 7f90a6ffd640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9088065a60 0x7f9088067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90a8156930 tx=0x7f9098009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.446+0000 7f909f7fe640 1 -- 172.21.15.133:0/3304222576 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f909011fe60 con 0x7f90a80ce3b0 2023-12-18T10:18:02.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.594+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90a80cace0 con 0x7f90a80ce3b0 2023-12-18T10:18:02.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.594+0000 7f909f7fe640 1 -- 172.21.15.133:0/3304222576 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90900eb920 con 0x7f90a80ce3b0 2023-12-18T10:18:02.602 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:02.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9088065a60 msgr2=0x7f9088067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9088065a60 0x7f9088067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90a8156930 tx=0x7f9098009040 comp rx=0 tx=0).stop 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90a80ce3b0 msgr2=0x7f90a80c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90a80ce3b0 0x7f90a80c7530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f90900ad040 tx=0x7f909001ac90 comp rx=0 tx=0).stop 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 shutdown_connections 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9088065a60 0x7f9088067f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90a81582d0 0x7f90a80cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90a80ce3b0 0x7f90a80c7530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 --2- 172.21.15.133:0/3304222576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90a8070820 0x7f90a8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 >> 172.21.15.133:0/3304222576 conn(0x7f90a806a2a0 msgr2=0x7f90a80aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 shutdown_connections 2023-12-18T10:18:02.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.598+0000 7f90ad42d640 1 -- 172.21.15.133:0/3304222576 wait complete. 2023-12-18T10:18:02.622 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-18T10:18:02.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a882d640 1 Processor -- start 2023-12-18T10:18:02.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a882d640 1 -- start start 2023-12-18T10:18:02.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a882d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0a415ca40 0x7fc0a40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a882d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a40cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a882d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0a40cf610 0x7fc0a41605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a882d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40cfa70 con 0x7fc0a40cf610 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a882d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40d11c0 con 0x7fc0a415ca40 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a882d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40d0310 con 0x7fc0a40ce3f0 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a2d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0a40cf610 0x7fc0a41605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a2d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0a40cf610 0x7fc0a41605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49382/0 (socket says 172.21.15.133:49382) 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a2d9d640 1 -- 172.21.15.133:0/4100963224 learned_addr learned my addr 172.21.15.133:0/4100963224 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a259c640 1 --2- 172.21.15.133:0/4100963224 >> v2:172.21.15.142:3300/0 conn(0x7fc0a415ca40 0x7fc0a40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc099d9b640 1 --2- 172.21.15.133:0/4100963224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a40cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a2d9d640 1 -- 172.21.15.133:0/4100963224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 msgr2=0x7fc0a40cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:02.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a2d9d640 1 --2- 172.21.15.133:0/4100963224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a40cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a2d9d640 1 -- 172.21.15.133:0/4100963224 >> v2:172.21.15.142:3300/0 conn(0x7fc0a415ca40 msgr2=0x7fc0a40cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:02.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a2d9d640 1 --2- 172.21.15.133:0/4100963224 >> v2:172.21.15.142:3300/0 conn(0x7fc0a415ca40 0x7fc0a40cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a2d9d640 1 -- 172.21.15.133:0/4100963224 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40d05b0 con 0x7fc0a40cf610 2023-12-18T10:18:02.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc0a259c640 1 --2- 172.21.15.133:0/4100963224 >> v2:172.21.15.142:3300/0 conn(0x7fc0a415ca40 0x7fc0a40cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:02.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.754+0000 7fc099d9b640 1 --2- 172.21.15.133:0/4100963224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a40cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:02.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a2d9d640 1 --2- 172.21.15.133:0/4100963224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a40cf610 0x7fc0a41605b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40736e0 tx=0x7fc09c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bffc50db9f2c16 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a1d9b640 1 -- 172.21.15.133:0/4100963224 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0a5590 con 0x7fc0a40cf610 2023-12-18T10:18:02.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a1d9b640 1 -- 172.21.15.133:0/4100963224 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0a56f0 con 0x7fc0a40cf610 2023-12-18T10:18:02.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a1d9b640 1 -- 172.21.15.133:0/4100963224 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0a5a80 con 0x7fc0a40cf610 2023-12-18T10:18:02.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 -- 172.21.15.133:0/4100963224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a40cf610 msgr2=0x7fc0a41605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4100963224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a40cf610 0x7fc0a41605b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40736e0 tx=0x7fc09c01c710 comp rx=0 tx=0).stop 2023-12-18T10:18:02.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 -- 172.21.15.133:0/4100963224 shutdown_connections 2023-12-18T10:18:02.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4100963224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a40cf610 0x7fc0a41605b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4100963224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a40cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4100963224 >> v2:172.21.15.142:3300/0 conn(0x7fc0a415ca40 0x7fc0a40cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 -- 172.21.15.133:0/4100963224 >> 172.21.15.133:0/4100963224 conn(0x7fc0a4089fb0 msgr2=0x7fc0a40d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:02.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 -- 172.21.15.133:0/4100963224 shutdown_connections 2023-12-18T10:18:02.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.758+0000 7fc0a882d640 1 -- 172.21.15.133:0/4100963224 wait complete. 2023-12-18T10:18:02.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 Processor -- start 2023-12-18T10:18:02.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 -- start start 2023-12-18T10:18:02.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a41559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0a40cf610 0x7fc0a40b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a415ca40 0x7fc0a40b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c76e0 con 0x7fc0a415ca40 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41543a0 con 0x7fc0a40cf610 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4154680 con 0x7fc0a40ce3f0 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a415ca40 0x7fc0a40b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a415ca40 0x7fc0a40b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49386/0 (socket says 172.21.15.133:49386) 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 -- 172.21.15.133:0/4109609939 learned_addr learned my addr 172.21.15.133:0/4109609939 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a259c640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a41559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc099d9b640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0a40cf610 0x7fc0a40b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 -- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 msgr2=0x7fc0a41559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a41559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 -- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0a40cf610 msgr2=0x7fc0a40b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0a40cf610 0x7fc0a40b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 -- 172.21.15.133:0/4109609939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009b30 con 0x7fc0a415ca40 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a259c640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a41559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a2d9d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a415ca40 0x7fc0a40b08a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0af040 tx=0x7fc09c0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc09b7fe640 1 -- 172.21.15.133:0/4109609939 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0a5590 con 0x7fc0a415ca40 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc09b7fe640 1 -- 172.21.15.133:0/4109609939 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0b8690 con 0x7fc0a415ca40 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc09b7fe640 1 -- 172.21.15.133:0/4109609939 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b8a40 con 0x7fc0a415ca40 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a4154960 con 0x7fc0a415ca40 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.762+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4153fc0 con 0x7fc0a415ca40 2023-12-18T10:18:02.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.766+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4154150 con 0x7fc0a415ca40 2023-12-18T10:18:02.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.766+0000 7fc09b7fe640 1 -- 172.21.15.133:0/4109609939 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc09c0b8ba0 con 0x7fc0a415ca40 2023-12-18T10:18:02.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.766+0000 7fc09b7fe640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc084065a60 0x7fc084067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:02.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.766+0000 7fc09b7fe640 1 -- 172.21.15.133:0/4109609939 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc09c11dfe0 con 0x7fc0a415ca40 2023-12-18T10:18:02.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.766+0000 7fc0a259c640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc084065a60 0x7fc084067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:02.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.766+0000 7fc0a259c640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc084065a60 0x7fc084067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc08c006fd0 tx=0x7fc08c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:02.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.770+0000 7fc09b7fe640 1 -- 172.21.15.133:0/4109609939 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc09c0ebd60 con 0x7fc0a415ca40 2023-12-18T10:18:02.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.922+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc0a404e000 con 0x7fc0a415ca40 2023-12-18T10:18:02.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.922+0000 7fc09b7fe640 1 -- 172.21.15.133:0/4109609939 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc09c0bc060 con 0x7fc0a415ca40 2023-12-18T10:18:02.930 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:02.930 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:18:02.930 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:18:02.931 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-18T10:18:02.931 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-18T10:18:02.931 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:18:02.931 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:18:02.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc084065a60 msgr2=0x7fc084067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc084065a60 0x7fc084067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc08c006fd0 tx=0x7fc08c008040 comp rx=0 tx=0).stop 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a415ca40 msgr2=0x7fc0a40b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a415ca40 0x7fc0a40b08a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0af040 tx=0x7fc09c0194b0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 shutdown_connections 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc084065a60 0x7fc084067f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0a415ca40 0x7fc0a40b08a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0a40cf610 0x7fc0a40b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 --2- 172.21.15.133:0/4109609939 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc0a40ce3f0 0x7fc0a41559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 >> 172.21.15.133:0/4109609939 conn(0x7fc0a4089fb0 msgr2=0x7fc0a40b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 shutdown_connections 2023-12-18T10:18:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:02.926+0000 7fc0a882d640 1 -- 172.21.15.133:0/4109609939 wait complete. 2023-12-18T10:18:02.951 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-18T10:18:02.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-18T10:18:03.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48fcf18640 1 Processor -- start 2023-12-18T10:18:03.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48fcf18640 1 -- start start 2023-12-18T10:18:03.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48fcf18640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48f80ca200 0x7f48f80ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:03.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48fcf18640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48f80c89f0 0x7f48f80c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:03.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48fcf18640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f80ad6e0 con 0x7f48f80ce6a0 2023-12-18T10:18:03.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48fcf18640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f8159b20 con 0x7f48f80c89f0 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48fcf18640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f80ad9c0 con 0x7f48f80ca200 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f659c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f48f80ce6a0 0x7f48f80cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56420/0 (socket says 172.21.15.133:56420) 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f659c640 1 -- 172.21.15.133:0/1348347718 learned_addr learned my addr 172.21.15.133:0/1348347718 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f6d9d640 1 --2- 172.21.15.133:0/1348347718 >> v2:172.21.15.133:3300/0 conn(0x7f48f80c89f0 0x7f48f80c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f5d9b640 1 --2- 172.21.15.133:0/1348347718 >> v2:172.21.15.142:3300/0 conn(0x7f48f80ca200 0x7f48f80ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f559a640 1 -- 172.21.15.133:0/1348347718 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951895320 0 0) 0x7f48f80ad6e0 con 0x7f48f80ce6a0 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f559a640 1 -- 172.21.15.133:0/1348347718 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e0005740 con 0x7f48f80ce6a0 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f6d9d640 1 -- 172.21.15.133:0/1348347718 >> v2:172.21.15.142:3300/0 conn(0x7f48f80ca200 msgr2=0x7f48f80ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f6d9d640 1 --2- 172.21.15.133:0/1348347718 >> v2:172.21.15.142:3300/0 conn(0x7f48f80ca200 0x7f48f80ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f6d9d640 1 -- 172.21.15.133:0/1348347718 >> v1:172.21.15.133:6789/0 conn(0x7f48f80ce6a0 legacy=0x7f48f80cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:03.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.090+0000 7f48f6d9d640 1 -- 172.21.15.133:0/1348347718 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f806be20 con 0x7f48f80c89f0 2023-12-18T10:18:03.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48f6d9d640 1 --2- 172.21.15.133:0/1348347718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80c89f0 0x7f48f80c8e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009d90 tx=0x7f48f001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e73d2cd328d0e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:03.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48f559a640 1 -- 172.21.15.133:0/1348347718 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a59a0 con 0x7f48f80c89f0 2023-12-18T10:18:03.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48f559a640 1 -- 172.21.15.133:0/1348347718 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f00a5b00 con 0x7f48f80c89f0 2023-12-18T10:18:03.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48f559a640 1 -- 172.21.15.133:0/1348347718 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a5e70 con 0x7f48f80c89f0 2023-12-18T10:18:03.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48fcf18640 1 -- 172.21.15.133:0/1348347718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80c89f0 msgr2=0x7f48f80c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:03.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48fcf18640 1 --2- 172.21.15.133:0/1348347718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80c89f0 0x7f48f80c8e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009d90 tx=0x7f48f001c8e0 comp rx=0 tx=0).stop 2023-12-18T10:18:03.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48fcf18640 1 -- 172.21.15.133:0/1348347718 shutdown_connections 2023-12-18T10:18:03.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48fcf18640 1 --2- 172.21.15.133:0/1348347718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80c89f0 0x7f48f80c8e60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:03.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48fcf18640 1 --2- 172.21.15.133:0/1348347718 >> v2:172.21.15.142:3300/0 conn(0x7f48f80ca200 0x7f48f80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:03.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48fcf18640 1 -- 172.21.15.133:0/1348347718 >> 172.21.15.133:0/1348347718 conn(0x7f48f8069e70 msgr2=0x7f48f806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:03.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48fcf18640 1 -- 172.21.15.133:0/1348347718 shutdown_connections 2023-12-18T10:18:03.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.094+0000 7f48fcf18640 1 -- 172.21.15.133:0/1348347718 wait complete. 2023-12-18T10:18:03.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 Processor -- start 2023-12-18T10:18:03.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 -- start start 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f80c89f0 0x7f48f80adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80ca200 0x7f48f815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f80ce6a0 0x7f48f8150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f815a7a0 con 0x7f48f80ca200 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f815aa80 con 0x7f48f80ce6a0 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f815ad60 con 0x7f48f80c89f0 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80ca200 0x7f48f815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80ca200 0x7f48f815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49404/0 (socket says 172.21.15.133:49404) 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 -- 172.21.15.133:0/2277389088 learned_addr learned my addr 172.21.15.133:0/2277389088 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f6d9d640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f80ce6a0 0x7f48f8150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:03.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f659c640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f80c89f0 0x7f48f80adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:03.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 -- 172.21.15.133:0/2277389088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f80c89f0 msgr2=0x7f48f80adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:03.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f80c89f0 0x7f48f80adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:03.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 -- 172.21.15.133:0/2277389088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f80ce6a0 msgr2=0x7f48f8150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:03.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f80ce6a0 0x7f48f8150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:03.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 -- 172.21.15.133:0/2277389088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0009a70 con 0x7f48f80ca200 2023-12-18T10:18:03.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48f5d9b640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80ca200 0x7f48f815bfc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00e930 tx=0x7f48ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:03.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48e6ffd640 1 -- 172.21.15.133:0/2277389088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec009690 con 0x7f48f80ca200 2023-12-18T10:18:03.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48e6ffd640 1 -- 172.21.15.133:0/2277389088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec00ca00 con 0x7f48f80ca200 2023-12-18T10:18:03.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f806cd60 con 0x7f48f80ca200 2023-12-18T10:18:03.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48e6ffd640 1 -- 172.21.15.133:0/2277389088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec00cd70 con 0x7f48f80ca200 2023-12-18T10:18:03.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f815b320 con 0x7f48f80ca200 2023-12-18T10:18:03.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.098+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f804e070 con 0x7f48f80ca200 2023-12-18T10:18:03.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.102+0000 7f48e6ffd640 1 -- 172.21.15.133:0/2277389088 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f48ec013470 con 0x7f48f80ca200 2023-12-18T10:18:03.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.102+0000 7f48e6ffd640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f48d8065a60 0x7f48d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:03.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.102+0000 7f48e6ffd640 1 -- 172.21.15.133:0/2277389088 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f48ec082fe0 con 0x7f48f80ca200 2023-12-18T10:18:03.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.102+0000 7f48f659c640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f48d8065a60 0x7f48d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:03.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.102+0000 7f48f659c640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f48d8065a60 0x7f48d8067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007fd0 tx=0x7f48e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:03.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.106+0000 7f48e6ffd640 1 -- 172.21.15.133:0/2277389088 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f48ec050e90 con 0x7f48f80ca200 2023-12-18T10:18:03.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:03.258+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f48f80b15a0 con 0x7f48f80ca200 2023-12-18T10:18:04.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.202+0000 7f48e6ffd640 1 -- 172.21.15.133:0/2277389088 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f48ec0170b0 con 0x7f48f80ca200 2023-12-18T10:18:04.210 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-18T10:18:04.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f48d8065a60 msgr2=0x7f48d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:04.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f48d8065a60 0x7f48d8067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48e8007fd0 tx=0x7f48e8009040 comp rx=0 tx=0).stop 2023-12-18T10:18:04.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80ca200 msgr2=0x7f48f815bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:04.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80ca200 0x7f48f815bfc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00e930 tx=0x7f48ec00edf0 comp rx=0 tx=0).stop 2023-12-18T10:18:04.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 shutdown_connections 2023-12-18T10:18:04.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f48d8065a60 0x7f48d8067f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:04.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48f80ce6a0 0x7f48f8150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:04.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48f80ca200 0x7f48f815bfc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:04.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 --2- 172.21.15.133:0/2277389088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48f80c89f0 0x7f48f80adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:04.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 >> 172.21.15.133:0/2277389088 conn(0x7f48f8069e70 msgr2=0x7f48f80ab190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:04.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.206+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 shutdown_connections 2023-12-18T10:18:04.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.210+0000 7f48fcf18640 1 -- 172.21.15.133:0/2277389088 wait complete. 2023-12-18T10:18:04.240 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-18T10:18:04.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba5bdbc640 1 Processor -- start 2023-12-18T10:18:04.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba5bdbc640 1 -- start start 2023-12-18T10:18:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba5bdbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba54158f20 0x7fba540714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba5bdbc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba540ca2e0 con 0x7fba540ad900 2023-12-18T10:18:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba5bdbc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba540ca000 con 0x7fba540c9b40 2023-12-18T10:18:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba5bdbc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba54070700 con 0x7fba54158f20 2023-12-18T10:18:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba59357640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fba540ad900 0x7fba540cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56434/0 (socket says 172.21.15.133:56434) 2023-12-18T10:18:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba59357640 1 -- 172.21.15.133:0/214675114 learned_addr learned my addr 172.21.15.133:0/214675114 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:04.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba59b58640 1 --2- 172.21.15.133:0/214675114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba54158f20 0x7fba540714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba58b56640 1 -- 172.21.15.133:0/214675114 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314616938 0 0) 0x7fba540ca000 con 0x7fba540c9b40 2023-12-18T10:18:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba58b56640 1 -- 172.21.15.133:0/214675114 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba40003530 con 0x7fba540c9b40 2023-12-18T10:18:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba58b56640 1 -- 172.21.15.133:0/214675114 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585401538 0 0) 0x7fba540ca2e0 con 0x7fba540ad900 2023-12-18T10:18:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba58b56640 1 -- 172.21.15.133:0/214675114 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba540ca000 con 0x7fba540ad900 2023-12-18T10:18:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba59b58640 1 -- 172.21.15.133:0/214675114 >> v1:172.21.15.142:6789/0 conn(0x7fba540c9b40 legacy=0x7fba5406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba59b58640 1 -- 172.21.15.133:0/214675114 >> v1:172.21.15.133:6789/0 conn(0x7fba540ad900 legacy=0x7fba540cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:04.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.382+0000 7fba59b58640 1 -- 172.21.15.133:0/214675114 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540709e0 con 0x7fba54158f20 2023-12-18T10:18:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba59b58640 1 --2- 172.21.15.133:0/214675114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba54158f20 0x7fba540714c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba5000a990 tx=0x7fba5001d860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cdf6935ab6d7811 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba58b56640 1 -- 172.21.15.133:0/214675114 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba500a6910 con 0x7fba54158f20 2023-12-18T10:18:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba58b56640 1 -- 172.21.15.133:0/214675114 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba500a6a70 con 0x7fba54158f20 2023-12-18T10:18:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba58b56640 1 -- 172.21.15.133:0/214675114 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba500a6de0 con 0x7fba54158f20 2023-12-18T10:18:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba5bdbc640 1 -- 172.21.15.133:0/214675114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba54158f20 msgr2=0x7fba540714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba5bdbc640 1 --2- 172.21.15.133:0/214675114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba54158f20 0x7fba540714c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba5000a990 tx=0x7fba5001d860 comp rx=0 tx=0).stop 2023-12-18T10:18:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba5bdbc640 1 -- 172.21.15.133:0/214675114 shutdown_connections 2023-12-18T10:18:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba5bdbc640 1 --2- 172.21.15.133:0/214675114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba54158f20 0x7fba540714c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba5bdbc640 1 -- 172.21.15.133:0/214675114 >> 172.21.15.133:0/214675114 conn(0x7fba540ce450 msgr2=0x7fba540ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba5bdbc640 1 -- 172.21.15.133:0/214675114 shutdown_connections 2023-12-18T10:18:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.386+0000 7fba5bdbc640 1 -- 172.21.15.133:0/214675114 wait complete. 2023-12-18T10:18:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 Processor -- start 2023-12-18T10:18:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 -- start start 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba540ad900 0x7fba54153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba540c9b40 0x7fba540b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba54158f20 0x7fba541578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba540b18c0 con 0x7fba540ad900 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba54154610 con 0x7fba54158f20 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba541548f0 con 0x7fba540c9b40 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba540ad900 0x7fba54153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba540ad900 0x7fba54153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49420/0 (socket says 172.21.15.133:49420) 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 -- 172.21.15.133:0/4038939131 learned_addr learned my addr 172.21.15.133:0/4038939131 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:04.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59357640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba540c9b40 0x7fba540b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5a359640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba54158f20 0x7fba541578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 -- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba540c9b40 msgr2=0x7fba540b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba540c9b40 0x7fba540b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 -- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba54158f20 msgr2=0x7fba541578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba54158f20 0x7fba541578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 -- 172.21.15.133:0/4038939131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5000a5c0 con 0x7fba540ad900 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59357640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba540c9b40 0x7fba540b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5a359640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba54158f20 0x7fba541578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba59b58640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba540ad900 0x7fba54153560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fba50000c10 tx=0x7fba5001a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba4a7fc640 1 -- 172.21.15.133:0/4038939131 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba500bc070 con 0x7fba540ad900 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba4a7fc640 1 -- 172.21.15.133:0/4038939131 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba50004250 con 0x7fba540ad900 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba4a7fc640 1 -- 172.21.15.133:0/4038939131 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50003620 con 0x7fba540ad900 2023-12-18T10:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba54154bd0 con 0x7fba540ad900 2023-12-18T10:18:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.390+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba540b15b0 con 0x7fba540ad900 2023-12-18T10:18:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.394+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba540cf1a0 con 0x7fba540ad900 2023-12-18T10:18:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.394+0000 7fba4a7fc640 1 -- 172.21.15.133:0/4038939131 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba500b5040 con 0x7fba540ad900 2023-12-18T10:18:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.394+0000 7fba4a7fc640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba38065a60 0x7fba38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.394+0000 7fba4a7fc640 1 -- 172.21.15.133:0/4038939131 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fba5011d640 con 0x7fba540ad900 2023-12-18T10:18:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.394+0000 7fba59357640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba38065a60 0x7fba38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.394+0000 7fba59357640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba38065a60 0x7fba38067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba541f8c30 tx=0x7fba44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.398+0000 7fba4a7fc640 1 -- 172.21.15.133:0/4038939131 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fba500eb350 con 0x7fba540ad900 2023-12-18T10:18:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:04.550+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fba541550f0 con 0x7fba540ad900 2023-12-18T10:18:05.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.214+0000 7fba4a7fc640 1 -- 172.21.15.133:0/4038939131 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fba541550f0 con 0x7fba540ad900 2023-12-18T10:18:05.223 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-18T10:18:05.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.218+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba38065a60 msgr2=0x7fba38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.218+0000 7fba5bdbc640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba38065a60 0x7fba38067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba541f8c30 tx=0x7fba44009040 comp rx=0 tx=0).stop 2023-12-18T10:18:05.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.218+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba540ad900 msgr2=0x7fba54153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.218+0000 7fba5bdbc640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba540ad900 0x7fba54153560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fba50000c10 tx=0x7fba5001a600 comp rx=0 tx=0).stop 2023-12-18T10:18:05.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.222+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 shutdown_connections 2023-12-18T10:18:05.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.222+0000 7fba5bdbc640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba38065a60 0x7fba38067f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.222+0000 7fba5bdbc640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba54158f20 0x7fba541578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.222+0000 7fba5bdbc640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba540c9b40 0x7fba540b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.222+0000 7fba5bdbc640 1 --2- 172.21.15.133:0/4038939131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba540ad900 0x7fba54153560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.222+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 >> 172.21.15.133:0/4038939131 conn(0x7fba540ce450 msgr2=0x7fba54151520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:05.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.222+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 shutdown_connections 2023-12-18T10:18:05.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.222+0000 7fba5bdbc640 1 -- 172.21.15.133:0/4038939131 wait complete. 2023-12-18T10:18:05.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-18T10:18:05.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.398+0000 7fe55ed8f640 1 Processor -- start 2023-12-18T10:18:05.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.398+0000 7fe55ed8f640 1 -- start start 2023-12-18T10:18:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.398+0000 7fe55ed8f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5580cde90 0x7fe5580ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.398+0000 7fe55ed8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 0x7fe5580cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.398+0000 7fe55ed8f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55815cec0 con 0x7fe55815cae0 2023-12-18T10:18:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.398+0000 7fe55ed8f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580cfb40 con 0x7fe5580cde90 2023-12-18T10:18:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.398+0000 7fe55ed8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580d0530 con 0x7fe5580cf170 2023-12-18T10:18:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe55cb2b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe55815cae0 0x7fe5580d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56442/0 (socket says 172.21.15.133:56442) 2023-12-18T10:18:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe55cb2b640 1 -- 172.21.15.133:0/1563397651 learned_addr learned my addr 172.21.15.133:0/1563397651 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54ffff640 1 --2- 172.21.15.133:0/1563397651 >> v2:172.21.15.133:3300/0 conn(0x7fe5580cde90 0x7fe5580ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54f7fe640 1 -- 172.21.15.133:0/1563397651 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025371415 0 0) 0x7fe55815cec0 con 0x7fe55815cae0 2023-12-18T10:18:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe55d32c640 1 --2- 172.21.15.133:0/1563397651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 0x7fe5580cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54f7fe640 1 -- 172.21.15.133:0/1563397651 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe540003530 con 0x7fe55815cae0 2023-12-18T10:18:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54ffff640 1 -- 172.21.15.133:0/1563397651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 msgr2=0x7fe5580cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54ffff640 1 --2- 172.21.15.133:0/1563397651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 0x7fe5580cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54ffff640 1 -- 172.21.15.133:0/1563397651 >> v1:172.21.15.133:6789/0 conn(0x7fe55815cae0 legacy=0x7fe5580d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54ffff640 1 -- 172.21.15.133:0/1563397651 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580d0810 con 0x7fe5580cde90 2023-12-18T10:18:05.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54ffff640 1 --2- 172.21.15.133:0/1563397651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5580cde90 0x7fe5580ce2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5480097c0 tx=0x7fe54801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c513d5581e042fa server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:05.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54f7fe640 1 -- 172.21.15.133:0/1563397651 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5480ab650 con 0x7fe5580cde90 2023-12-18T10:18:05.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54f7fe640 1 -- 172.21.15.133:0/1563397651 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5480ab7b0 con 0x7fe5580cde90 2023-12-18T10:18:05.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.402+0000 7fe54f7fe640 1 -- 172.21.15.133:0/1563397651 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5480abb40 con 0x7fe5580cde90 2023-12-18T10:18:05.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- 172.21.15.133:0/1563397651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5580cde90 msgr2=0x7fe5580ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/1563397651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5580cde90 0x7fe5580ce2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe5480097c0 tx=0x7fe54801c450 comp rx=0 tx=0).stop 2023-12-18T10:18:05.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- 172.21.15.133:0/1563397651 shutdown_connections 2023-12-18T10:18:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/1563397651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 0x7fe5580cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/1563397651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5580cde90 0x7fe5580ce2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- 172.21.15.133:0/1563397651 >> 172.21.15.133:0/1563397651 conn(0x7fe558089fb0 msgr2=0x7fe5580d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- 172.21.15.133:0/1563397651 shutdown_connections 2023-12-18T10:18:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- 172.21.15.133:0/1563397651 wait complete. 2023-12-18T10:18:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 Processor -- start 2023-12-18T10:18:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- start start 2023-12-18T10:18:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5580cde90 0x7fe5580afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 0x7fe5580b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe55815cae0 0x7fe55815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe558148040 con 0x7fe55815cae0 2023-12-18T10:18:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55815fbd0 con 0x7fe5580cde90 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55ed8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5581563b0 con 0x7fe5580cf170 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55d32c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe55815cae0 0x7fe55815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55d32c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe55815cae0 0x7fe55815ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49430/0 (socket says 172.21.15.133:49430) 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55d32c640 1 -- 172.21.15.133:0/88483532 learned_addr learned my addr 172.21.15.133:0/88483532 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe54ffff640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 0x7fe5580b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55cb2b640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5580cde90 0x7fe5580afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55d32c640 1 -- 172.21.15.133:0/88483532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 msgr2=0x7fe5580b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55d32c640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 0x7fe5580b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.406+0000 7fe55d32c640 1 -- 172.21.15.133:0/88483532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5580cde90 msgr2=0x7fe5580afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe55d32c640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5580cde90 0x7fe5580afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe55d32c640 1 -- 172.21.15.133:0/88483532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009420 con 0x7fe55815cae0 2023-12-18T10:18:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe55d32c640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe55815cae0 0x7fe55815ee60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe550007d90 tx=0x7fe55000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe54d7fa640 1 -- 172.21.15.133:0/88483532 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550014420 con 0x7fe55815cae0 2023-12-18T10:18:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe54d7fa640 1 -- 172.21.15.133:0/88483532 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5500145a0 con 0x7fe55815cae0 2023-12-18T10:18:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe54d7fa640 1 -- 172.21.15.133:0/88483532 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550014950 con 0x7fe55815cae0 2023-12-18T10:18:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558156690 con 0x7fe55815cae0 2023-12-18T10:18:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe558155d80 con 0x7fe55815cae0 2023-12-18T10:18:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe558156210 con 0x7fe55815cae0 2023-12-18T10:18:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe54d7fa640 1 -- 172.21.15.133:0/88483532 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe550014ab0 con 0x7fe55815cae0 2023-12-18T10:18:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe54d7fa640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe544065a60 0x7fe544067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe54d7fa640 1 -- 172.21.15.133:0/88483532 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe550083ab0 con 0x7fe55815cae0 2023-12-18T10:18:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.410+0000 7fe55cb2b640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe544065a60 0x7fe544067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.414+0000 7fe55cb2b640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe544065a60 0x7fe544067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe554007fd0 tx=0x7fe554009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.418+0000 7fe54d7fa640 1 -- 172.21.15.133:0/88483532 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe558156210 con 0x7fe55815cae0 2023-12-18T10:18:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.598+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe558156210 con 0x7fe55815cae0 2023-12-18T10:18:05.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.606+0000 7fe54d7fa640 1 -- 172.21.15.133:0/88483532 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe558156210 con 0x7fe55815cae0 2023-12-18T10:18:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 2 and data pool 3 2023-12-18T10:18:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.610+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe544065a60 msgr2=0x7fe544067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.610+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe544065a60 0x7fe544067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe554007fd0 tx=0x7fe554009040 comp rx=0 tx=0).stop 2023-12-18T10:18:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe55815cae0 msgr2=0x7fe55815ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe55815cae0 0x7fe55815ee60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe550007d90 tx=0x7fe55000e4b0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 shutdown_connections 2023-12-18T10:18:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe544065a60 0x7fe544067f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe55815cae0 0x7fe55815ee60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5580cf170 0x7fe5580b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 --2- 172.21.15.133:0/88483532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5580cde90 0x7fe5580afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 >> 172.21.15.133:0/88483532 conn(0x7fe558089fb0 msgr2=0x7fe558158690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:05.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 shutdown_connections 2023-12-18T10:18:05.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.614+0000 7fe55ed8f640 1 -- 172.21.15.133:0/88483532 wait complete. 2023-12-18T10:18:05.658 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-18T10:18:05.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-18T10:18:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.794+0000 7f8ad6a63640 1 Processor -- start 2023-12-18T10:18:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.794+0000 7f8ad6a63640 1 -- start start 2023-12-18T10:18:05.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ad6a63640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ad015fd50 0x7f8ad00d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ad6a63640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8ad00d2960 0x7f8ad006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ad6a63640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad0160130 con 0x7f8ad006c260 2023-12-18T10:18:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ad6a63640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00af840 con 0x7f8ad015fd50 2023-12-18T10:18:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ad6a63640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00d2df0 con 0x7f8ad00d2960 2023-12-18T10:18:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8acffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ad015fd50 0x7f8ad00d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ad5000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8ad006c260 0x7f8ad0160350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56454/0 (socket says 172.21.15.133:56454) 2023-12-18T10:18:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ad5000640 1 -- 172.21.15.133:0/408511064 learned_addr learned my addr 172.21.15.133:0/408511064 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ac77fe640 1 --2- 172.21.15.133:0/408511064 >> v2:172.21.15.142:3300/0 conn(0x7f8ad00d2960 0x7f8ad006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8acffff640 1 -- 172.21.15.133:0/408511064 >> v2:172.21.15.142:3300/0 conn(0x7f8ad00d2960 msgr2=0x7f8ad006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:05.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8acffff640 1 --2- 172.21.15.133:0/408511064 >> v2:172.21.15.142:3300/0 conn(0x7f8ad00d2960 0x7f8ad006bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8acffff640 1 -- 172.21.15.133:0/408511064 >> v1:172.21.15.133:6789/0 conn(0x7f8ad006c260 legacy=0x7f8ad0160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8acf7fe640 1 -- 172.21.15.133:0/408511064 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504376295 0 0) 0x7f8ad0160130 con 0x7f8ad006c260 2023-12-18T10:18:05.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8acffff640 1 -- 172.21.15.133:0/408511064 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad006ca10 con 0x7f8ad015fd50 2023-12-18T10:18:05.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.798+0000 7f8ac77fe640 1 --2- 172.21.15.133:0/408511064 >> v2:172.21.15.142:3300/0 conn(0x7f8ad00d2960 0x7f8ad006bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8acffff640 1 --2- 172.21.15.133:0/408511064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad015fd50 0x7f8ad00d2420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00b1ff0 tx=0x7f8ab801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc485a96135c540 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8acf7fe640 1 -- 172.21.15.133:0/408511064 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80ab610 con 0x7f8ad015fd50 2023-12-18T10:18:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8acf7fe640 1 -- 172.21.15.133:0/408511064 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80ab770 con 0x7f8ad015fd50 2023-12-18T10:18:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8acf7fe640 1 -- 172.21.15.133:0/408511064 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80abb00 con 0x7f8ad015fd50 2023-12-18T10:18:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 -- 172.21.15.133:0/408511064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad015fd50 msgr2=0x7f8ad00d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/408511064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad015fd50 0x7f8ad00d2420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00b1ff0 tx=0x7f8ab801c410 comp rx=0 tx=0).stop 2023-12-18T10:18:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 -- 172.21.15.133:0/408511064 shutdown_connections 2023-12-18T10:18:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/408511064 >> v2:172.21.15.142:3300/0 conn(0x7f8ad00d2960 0x7f8ad006bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/408511064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad015fd50 0x7f8ad00d2420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 -- 172.21.15.133:0/408511064 >> 172.21.15.133:0/408511064 conn(0x7f8ad0089fb0 msgr2=0x7f8ad009b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 -- 172.21.15.133:0/408511064 shutdown_connections 2023-12-18T10:18:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 -- 172.21.15.133:0/408511064 wait complete. 2023-12-18T10:18:05.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 Processor -- start 2023-12-18T10:18:05.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.802+0000 7f8ad6a63640 1 -- start start 2023-12-18T10:18:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad006c260 0x7f8ad00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ad00d2960 0x7f8ad015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ad015fd50 0x7f8ad0155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00cfde0 con 0x7f8ad006c260 2023-12-18T10:18:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00cf820 con 0x7f8ad015fd50 2023-12-18T10:18:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad00cfb00 con 0x7f8ad00d2960 2023-12-18T10:18:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad006c260 0x7f8ad00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad006c260 0x7f8ad00ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49448/0 (socket says 172.21.15.133:49448) 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 -- 172.21.15.133:0/3436669421 learned_addr learned my addr 172.21.15.133:0/3436669421 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ac77fe640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ad00d2960 0x7f8ad015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad5000640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ad015fd50 0x7f8ad0155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 -- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ad00d2960 msgr2=0x7f8ad015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ad00d2960 0x7f8ad015de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 -- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ad015fd50 msgr2=0x7f8ad0155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ad015fd50 0x7f8ad0155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 -- 172.21.15.133:0/3436669421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80093b0 con 0x7f8ad006c260 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ac77fe640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ad00d2960 0x7f8ad015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acffff640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad006c260 0x7f8ad00ceac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8019020 tx=0x7f8ab801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acd7fa640 1 -- 172.21.15.133:0/3436669421 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8004230 con 0x7f8ad006c260 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acd7fa640 1 -- 172.21.15.133:0/3436669421 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80b9070 con 0x7f8ad006c260 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acd7fa640 1 -- 172.21.15.133:0/3436669421 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80059a0 con 0x7f8ad006c260 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad0156f70 con 0x7f8ad006c260 2023-12-18T10:18:05.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad0157530 con 0x7f8ad006c260 2023-12-18T10:18:05.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad0156dd0 con 0x7f8ad006c260 2023-12-18T10:18:05.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.806+0000 7f8acd7fa640 1 -- 172.21.15.133:0/3436669421 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8ab8005b00 con 0x7f8ad006c260 2023-12-18T10:18:05.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.810+0000 7f8acd7fa640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ab0065a60 0x7f8ab0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:05.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.810+0000 7f8acd7fa640 1 -- 172.21.15.133:0/3436669421 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab80bb070 con 0x7f8ad006c260 2023-12-18T10:18:05.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.810+0000 7f8ac77fe640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ab0065a60 0x7f8ab0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:05.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.810+0000 7f8ac77fe640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ab0065a60 0x7f8ab0067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0006fd0 tx=0x7f8ac0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:05.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.814+0000 7f8acd7fa640 1 -- 172.21.15.133:0/3436669421 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8ad0156dd0 con 0x7f8ad006c260 2023-12-18T10:18:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:05.970+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f8ad0156dd0 con 0x7f8ad006c260 2023-12-18T10:18:06.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.614+0000 7f8acd7fa640 1 -- 172.21.15.133:0/3436669421 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f8ad0156dd0 con 0x7f8ad006c260 2023-12-18T10:18:06.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ab0065a60 msgr2=0x7f8ab0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:06.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ab0065a60 0x7f8ab0067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0006fd0 tx=0x7f8ac0008040 comp rx=0 tx=0).stop 2023-12-18T10:18:06.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad006c260 msgr2=0x7f8ad00ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad006c260 0x7f8ad00ceac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8019020 tx=0x7f8ab801ac50 comp rx=0 tx=0).stop 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 shutdown_connections 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ab0065a60 0x7f8ab0067f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8ad015fd50 0x7f8ad0155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8ad00d2960 0x7f8ad015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 --2- 172.21.15.133:0/3436669421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad006c260 0x7f8ad00ceac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 >> 172.21.15.133:0/3436669421 conn(0x7f8ad0089fb0 msgr2=0x7f8ad015c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 shutdown_connections 2023-12-18T10:18:06.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.618+0000 7f8ad6a63640 1 -- 172.21.15.133:0/3436669421 wait complete. 2023-12-18T10:18:06.645 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-18T10:18:06.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f2805055640 1 Processor -- start 2023-12-18T10:18:06.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f2805055640 1 -- start start 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f2805055640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280015a700 0x7f280006ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f2805055640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28000ce940 0x7f28000658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f2805055640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2800066270 con 0x7f2800065e20 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f2805055640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2800069e40 con 0x7f28000ce940 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f2805055640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280006a120 con 0x7f280015a700 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f27fe59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28000ce940 0x7f28000658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f27fe59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28000ce940 0x7f28000658e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49452/0 (socket says 172.21.15.133:49452) 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f27fe59c640 1 -- 172.21.15.133:0/4116439986 learned_addr learned my addr 172.21.15.133:0/4116439986 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f27fed9d640 1 --2- 172.21.15.133:0/4116439986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280015a700 0x7f280006ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f27fe59c640 1 -- 172.21.15.133:0/4116439986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280015a700 msgr2=0x7f280006ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f27fe59c640 1 --2- 172.21.15.133:0/4116439986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280015a700 0x7f280006ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f27fe59c640 1 -- 172.21.15.133:0/4116439986 >> v1:172.21.15.142:6789/0 conn(0x7f2800065e20 legacy=0x7f280015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.786+0000 7f27fe59c640 1 -- 172.21.15.133:0/4116439986 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280006a400 con 0x7f28000ce940 2023-12-18T10:18:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f27fe59c640 1 --2- 172.21.15.133:0/4116439986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28000ce940 0x7f28000658e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27f4009870 tx=0x7f27f401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f975f7cb79f039a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f27fdd9b640 1 -- 172.21.15.133:0/4116439986 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40aa670 con 0x7f28000ce940 2023-12-18T10:18:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f27fdd9b640 1 -- 172.21.15.133:0/4116439986 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f40aa7d0 con 0x7f28000ce940 2023-12-18T10:18:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f27fdd9b640 1 -- 172.21.15.133:0/4116439986 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40aab60 con 0x7f28000ce940 2023-12-18T10:18:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f2805055640 1 -- 172.21.15.133:0/4116439986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28000ce940 msgr2=0x7f28000658e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f2805055640 1 --2- 172.21.15.133:0/4116439986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28000ce940 0x7f28000658e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27f4009870 tx=0x7f27f401c510 comp rx=0 tx=0).stop 2023-12-18T10:18:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f2805055640 1 -- 172.21.15.133:0/4116439986 shutdown_connections 2023-12-18T10:18:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f2805055640 1 --2- 172.21.15.133:0/4116439986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28000ce940 0x7f28000658e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f2805055640 1 --2- 172.21.15.133:0/4116439986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280015a700 0x7f280006ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f2805055640 1 -- 172.21.15.133:0/4116439986 >> 172.21.15.133:0/4116439986 conn(0x7f28000b0990 msgr2=0x7f28000b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f2805055640 1 -- 172.21.15.133:0/4116439986 shutdown_connections 2023-12-18T10:18:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.790+0000 7f2805055640 1 -- 172.21.15.133:0/4116439986 wait complete. 2023-12-18T10:18:06.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 Processor -- start 2023-12-18T10:18:06.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 -- start start 2023-12-18T10:18:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2800065e20 0x7f28000b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000ce940 0x7f28000c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280015a700 0x7f28001f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000c5450 con 0x7f2800065e20 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28001f5a40 con 0x7f280015a700 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28001f5c70 con 0x7f28000ce940 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2800065e20 0x7f28000b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2800065e20 0x7f28000b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49468/0 (socket says 172.21.15.133:49468) 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 -- 172.21.15.133:0/3449695242 learned_addr learned my addr 172.21.15.133:0/3449695242 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fe59c640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000ce940 0x7f28000c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27ff59e640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280015a700 0x7f28001f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 -- 172.21.15.133:0/3449695242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000ce940 msgr2=0x7f28000c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000ce940 0x7f28000c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 -- 172.21.15.133:0/3449695242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280015a700 msgr2=0x7f28001f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280015a700 0x7f28001f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 -- 172.21.15.133:0/3449695242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f40094d0 con 0x7f2800065e20 2023-12-18T10:18:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27fed9d640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2800065e20 0x7f28000b24d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27f000d5f0 tx=0x7f27f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27e77fe640 1 -- 172.21.15.133:0/3449695242 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00125f0 con 0x7f2800065e20 2023-12-18T10:18:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27e77fe640 1 -- 172.21.15.133:0/3449695242 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0012750 con 0x7f2800065e20 2023-12-18T10:18:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f27e77fe640 1 -- 172.21.15.133:0/3449695242 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0012ae0 con 0x7f2800065e20 2023-12-18T10:18:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28001f5f50 con 0x7f2800065e20 2023-12-18T10:18:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28001f8c90 con 0x7f2800065e20 2023-12-18T10:18:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.794+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28000ae490 con 0x7f2800065e20 2023-12-18T10:18:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.798+0000 7f27e77fe640 1 -- 172.21.15.133:0/3449695242 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27f0012c40 con 0x7f2800065e20 2023-12-18T10:18:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.798+0000 7f27e77fe640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27ec065a60 0x7f27ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.798+0000 7f27e77fe640 1 -- 172.21.15.133:0/3449695242 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f27f0083690 con 0x7f2800065e20 2023-12-18T10:18:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.798+0000 7f27fe59c640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27ec065a60 0x7f27ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.798+0000 7f27fe59c640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27ec065a60 0x7f27ec067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f27f40ae000 tx=0x7f27f40b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:06.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.802+0000 7f27e77fe640 1 -- 172.21.15.133:0/3449695242 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f27f0050f80 con 0x7f2800065e20 2023-12-18T10:18:06.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:06.954+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f28001f8af0 con 0x7f2800065e20 2023-12-18T10:18:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.626+0000 7f27e77fe640 1 -- 172.21.15.133:0/3449695242 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f28001f8af0 con 0x7f2800065e20 2023-12-18T10:18:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data_ec' created 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.626+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27ec065a60 msgr2=0x7f27ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.626+0000 7f2805055640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27ec065a60 0x7f27ec067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f27f40ae000 tx=0x7f27f40b5040 comp rx=0 tx=0).stop 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.626+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2800065e20 msgr2=0x7f28000b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.626+0000 7f2805055640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2800065e20 0x7f28000b24d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27f000d5f0 tx=0x7f27f000dab0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.630+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 shutdown_connections 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.630+0000 7f2805055640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27ec065a60 0x7f27ec067f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.630+0000 7f2805055640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280015a700 0x7f28001f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.630+0000 7f2805055640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28000ce940 0x7f28000c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.630+0000 7f2805055640 1 --2- 172.21.15.133:0/3449695242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2800065e20 0x7f28000b24d0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27f000d5f0 tx=0x7f27f000dab0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.630+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 >> 172.21.15.133:0/3449695242 conn(0x7f28000b0990 msgr2=0x7f2800156b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:08.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.630+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 shutdown_connections 2023-12-18T10:18:08.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.630+0000 7f2805055640 1 -- 172.21.15.133:0/3449695242 wait complete. 2023-12-18T10:18:08.667 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-18T10:18:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a9866640 1 Processor -- start 2023-12-18T10:18:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a9866640 1 -- start start 2023-12-18T10:18:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a9866640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57a40714c0 0x7f57a406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a9866640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f57a406b1f0 0x7f57a40c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a9866640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a40ca9f0 con 0x7f57a415c710 2023-12-18T10:18:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a9866640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a40c3b40 con 0x7f57a40714c0 2023-12-18T10:18:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a9866640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a40ca800 con 0x7f57a406b1f0 2023-12-18T10:18:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a2ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f57a415c710 0x7f57a40ca0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56460/0 (socket says 172.21.15.133:56460) 2023-12-18T10:18:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a2ffd640 1 -- 172.21.15.133:0/806102789 learned_addr learned my addr 172.21.15.133:0/806102789 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:08.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a27fc640 1 --2- 172.21.15.133:0/806102789 >> v2:172.21.15.133:3300/0 conn(0x7f57a40714c0 0x7f57a406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:08.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a37fe640 1 --2- 172.21.15.133:0/806102789 >> v2:172.21.15.142:3300/0 conn(0x7f57a406b1f0 0x7f57a40c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:08.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a1ffb640 1 -- 172.21.15.133:0/806102789 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564665867 0 0) 0x7f57a40ca9f0 con 0x7f57a415c710 2023-12-18T10:18:08.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a1ffb640 1 -- 172.21.15.133:0/806102789 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f578c003530 con 0x7f57a415c710 2023-12-18T10:18:08.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a27fc640 1 -- 172.21.15.133:0/806102789 >> v2:172.21.15.142:3300/0 conn(0x7f57a406b1f0 msgr2=0x7f57a40c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:08.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a27fc640 1 --2- 172.21.15.133:0/806102789 >> v2:172.21.15.142:3300/0 conn(0x7f57a406b1f0 0x7f57a40c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a27fc640 1 -- 172.21.15.133:0/806102789 >> v1:172.21.15.133:6789/0 conn(0x7f57a415c710 legacy=0x7f57a40ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:08.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.806+0000 7f57a27fc640 1 -- 172.21.15.133:0/806102789 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a40cacd0 con 0x7f57a40714c0 2023-12-18T10:18:08.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a27fc640 1 --2- 172.21.15.133:0/806102789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a406acb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57a40ce7e0 tx=0x7f579801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5451779e0fc3cad server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:08.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a1ffb640 1 -- 172.21.15.133:0/806102789 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980ab600 con 0x7f57a40714c0 2023-12-18T10:18:08.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a1ffb640 1 -- 172.21.15.133:0/806102789 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57980a7050 con 0x7f57a40714c0 2023-12-18T10:18:08.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a1ffb640 1 -- 172.21.15.133:0/806102789 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980ab960 con 0x7f57a40714c0 2023-12-18T10:18:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 -- 172.21.15.133:0/806102789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 msgr2=0x7f57a406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 --2- 172.21.15.133:0/806102789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a406acb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57a40ce7e0 tx=0x7f579801c460 comp rx=0 tx=0).stop 2023-12-18T10:18:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 -- 172.21.15.133:0/806102789 shutdown_connections 2023-12-18T10:18:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 --2- 172.21.15.133:0/806102789 >> v2:172.21.15.142:3300/0 conn(0x7f57a406b1f0 0x7f57a40c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 --2- 172.21.15.133:0/806102789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a406acb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 -- 172.21.15.133:0/806102789 >> 172.21.15.133:0/806102789 conn(0x7f57a4070530 msgr2=0x7f57a4070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 -- 172.21.15.133:0/806102789 shutdown_connections 2023-12-18T10:18:08.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 -- 172.21.15.133:0/806102789 wait complete. 2023-12-18T10:18:08.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.810+0000 7f57a9866640 1 Processor -- start 2023-12-18T10:18:08.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 -- start start 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a406b1f0 0x7f57a4144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a40ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a415c710 0x7f57a40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40ac7d0 con 0x7f57a40714c0 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40ac460 con 0x7f57a406b1f0 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40c5f40 con 0x7f57a415c710 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a40ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a40ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49500/0 (socket says 172.21.15.133:49500) 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 -- 172.21.15.133:0/2251865667 learned_addr learned my addr 172.21.15.133:0/2251865667 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a37fe640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a415c710 0x7f57a40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a2ffd640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a406b1f0 0x7f57a4144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 -- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a415c710 msgr2=0x7f57a40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a415c710 0x7f57a40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 -- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a406b1f0 msgr2=0x7f57a4144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a406b1f0 0x7f57a4144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 -- 172.21.15.133:0/2251865667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798009420 con 0x7f57a40714c0 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a37fe640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a415c710 0x7f57a40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a27fc640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a40ab890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f579801a090 tx=0x7f5798019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f578bfff640 1 -- 172.21.15.133:0/2251865667 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5798003ab0 con 0x7f57a40714c0 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f578bfff640 1 -- 172.21.15.133:0/2251865667 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798003c10 con 0x7f57a40714c0 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a40ad420 con 0x7f57a40714c0 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f578bfff640 1 -- 172.21.15.133:0/2251865667 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980ab400 con 0x7f57a40714c0 2023-12-18T10:18:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a4144b60 con 0x7f57a40714c0 2023-12-18T10:18:08.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.814+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a40ac910 con 0x7f57a40714c0 2023-12-18T10:18:08.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.818+0000 7f578bfff640 1 -- 172.21.15.133:0/2251865667 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57980b2040 con 0x7f57a40714c0 2023-12-18T10:18:08.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.818+0000 7f578bfff640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5790065a60 0x7f5790067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:08.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.818+0000 7f578bfff640 1 -- 172.21.15.133:0/2251865667 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f579811d190 con 0x7f57a40714c0 2023-12-18T10:18:08.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.818+0000 7f57a2ffd640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5790065a60 0x7f5790067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:08.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.818+0000 7f57a2ffd640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5790065a60 0x7f5790067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5794005890 tx=0x7f5794009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:08.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.822+0000 7f578bfff640 1 -- 172.21.15.133:0/2251865667 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f57a40ac910 con 0x7f57a40714c0 2023-12-18T10:18:08.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:08.970+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f57a40ac910 con 0x7f57a40714c0 2023-12-18T10:18:09.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.634+0000 7f578bfff640 1 -- 172.21.15.133:0/2251865667 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f57a40ac910 con 0x7f57a40714c0 2023-12-18T10:18:09.641 INFO:teuthology.orchestra.run.smithi133.stderr:set pool 4 allow_ec_overwrites to true 2023-12-18T10:18:09.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.638+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5790065a60 msgr2=0x7f5790067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:09.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.638+0000 7f57a9866640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5790065a60 0x7f5790067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5794005890 tx=0x7f5794009040 comp rx=0 tx=0).stop 2023-12-18T10:18:09.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.638+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 msgr2=0x7f57a40ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:09.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.638+0000 7f57a9866640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a40ab890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f579801a090 tx=0x7f5798019200 comp rx=0 tx=0).stop 2023-12-18T10:18:09.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.642+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 shutdown_connections 2023-12-18T10:18:09.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.642+0000 7f57a9866640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5790065a60 0x7f5790067f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.642+0000 7f57a9866640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a415c710 0x7f57a40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.642+0000 7f57a9866640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a40714c0 0x7f57a40ab890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.642+0000 7f57a9866640 1 --2- 172.21.15.133:0/2251865667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a406b1f0 0x7f57a4144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.642+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 >> 172.21.15.133:0/2251865667 conn(0x7f57a4070530 msgr2=0x7f57a41583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:09.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.642+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 shutdown_connections 2023-12-18T10:18:09.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.646+0000 7f57a9866640 1 -- 172.21.15.133:0/2251865667 wait complete. 2023-12-18T10:18:09.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-18T10:18:09.691 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-12-18T10:18:09.686+0000 7f94f7564640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:18:09.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.822+0000 7f9ac8139640 1 Processor -- start 2023-12-18T10:18:09.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.822+0000 7f9ac8139640 1 -- start start 2023-12-18T10:18:09.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.822+0000 7f9ac8139640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ac01582d0 0x7f9ac00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:09.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.822+0000 7f9ac8139640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:09.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.822+0000 7f9ac8139640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac00c9390 con 0x7f9ac0070820 2023-12-18T10:18:09.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.822+0000 7f9ac8139640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac00ced80 con 0x7f9ac01582d0 2023-12-18T10:18:09.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.822+0000 7f9ac8139640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac015aee0 con 0x7f9ac00ce3b0 2023-12-18T10:18:09.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.822+0000 7f9ac5ed5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ac01582d0 0x7f9ac00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:09.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac5ed5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ac01582d0 0x7f9ac00c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49514/0 (socket says 172.21.15.133:49514) 2023-12-18T10:18:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac5ed5640 1 -- 172.21.15.133:0/4081199443 learned_addr learned my addr 172.21.15.133:0/4081199443 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac66d6640 1 --2- 172.21.15.133:0/4081199443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac5ed5640 1 -- 172.21.15.133:0/4081199443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 msgr2=0x7f9ac00ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac5ed5640 1 --2- 172.21.15.133:0/4081199443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac00ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac5ed5640 1 -- 172.21.15.133:0/4081199443 >> v1:172.21.15.142:6789/0 conn(0x7f9ac0070820 legacy=0x7f9ac00ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac5ed5640 1 -- 172.21.15.133:0/4081199443 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac015b1c0 con 0x7f9ac01582d0 2023-12-18T10:18:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac66d6640 1 --2- 172.21.15.133:0/4081199443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac00ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:09.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac5ed5640 1 --2- 172.21.15.133:0/4081199443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 0x7f9ac00c8e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414680f1725de237 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:09.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac4ed3640 1 -- 172.21.15.133:0/4081199443 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0aa670 con 0x7f9ac01582d0 2023-12-18T10:18:09.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac4ed3640 1 -- 172.21.15.133:0/4081199443 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0aa7d0 con 0x7f9ac01582d0 2023-12-18T10:18:09.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.826+0000 7f9ac4ed3640 1 -- 172.21.15.133:0/4081199443 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0aab60 con 0x7f9ac01582d0 2023-12-18T10:18:09.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- 172.21.15.133:0/4081199443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 msgr2=0x7f9ac00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:09.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 --2- 172.21.15.133:0/4081199443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 0x7f9ac00c8e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc01c510 comp rx=0 tx=0).stop 2023-12-18T10:18:09.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- 172.21.15.133:0/4081199443 shutdown_connections 2023-12-18T10:18:09.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 --2- 172.21.15.133:0/4081199443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac00ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 --2- 172.21.15.133:0/4081199443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 0x7f9ac00c8e50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- 172.21.15.133:0/4081199443 >> 172.21.15.133:0/4081199443 conn(0x7f9ac006a2a0 msgr2=0x7f9ac00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:09.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- 172.21.15.133:0/4081199443 shutdown_connections 2023-12-18T10:18:09.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- 172.21.15.133:0/4081199443 wait complete. 2023-12-18T10:18:09.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 Processor -- start 2023-12-18T10:18:09.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- start start 2023-12-18T10:18:09.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac0070820 0x7f9ac015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:09.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac015c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:09.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 0x7f9ac00c1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:09.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00b3d00 con 0x7f9ac01582d0 2023-12-18T10:18:09.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac015c5c0 con 0x7f9ac0070820 2023-12-18T10:18:09.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac8139640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00c17a0 con 0x7f9ac00ce3b0 2023-12-18T10:18:09.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac5ed5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac0070820 0x7f9ac015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:09.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac66d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 0x7f9ac00c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:09.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac5ed5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac0070820 0x7f9ac015e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47844/0 (socket says 172.21.15.133:47844) 2023-12-18T10:18:09.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac56d4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:09.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac5ed5640 1 -- 172.21.15.133:0/1580817071 learned_addr learned my addr 172.21.15.133:0/1580817071 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:09.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac66d6640 1 -- 172.21.15.133:0/1580817071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 msgr2=0x7f9ac015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:09.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac66d6640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac015c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac66d6640 1 -- 172.21.15.133:0/1580817071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac0070820 msgr2=0x7f9ac015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:09.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac66d6640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac0070820 0x7f9ac015e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:09.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac66d6640 1 -- 172.21.15.133:0/1580817071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0094d0 con 0x7f9ac01582d0 2023-12-18T10:18:09.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.830+0000 7f9ac5ed5640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac0070820 0x7f9ac015e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:09.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ac66d6640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 0x7f9ac00c1260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800ce50 tx=0x7f9ab800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:09.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ab67fc640 1 -- 172.21.15.133:0/1580817071 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800d840 con 0x7f9ac01582d0 2023-12-18T10:18:09.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ab67fc640 1 -- 172.21.15.133:0/1580817071 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800d9a0 con 0x7f9ac01582d0 2023-12-18T10:18:09.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac00b3360 con 0x7f9ac01582d0 2023-12-18T10:18:09.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ab67fc640 1 -- 172.21.15.133:0/1580817071 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800dd50 con 0x7f9ac01582d0 2023-12-18T10:18:09.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac00b3920 con 0x7f9ac01582d0 2023-12-18T10:18:09.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac015c790 con 0x7f9ac01582d0 2023-12-18T10:18:09.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ab67fc640 1 -- 172.21.15.133:0/1580817071 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ab801e3b0 con 0x7f9ac01582d0 2023-12-18T10:18:09.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ab67fc640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4065a60 0x7f9aa4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:09.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ab67fc640 1 -- 172.21.15.133:0/1580817071 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f9ab8083d60 con 0x7f9ac01582d0 2023-12-18T10:18:09.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.834+0000 7f9ac5ed5640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4065a60 0x7f9aa4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:09.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.838+0000 7f9ac5ed5640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4065a60 0x7f9aa4067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:09.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:09.838+0000 7f9ab67fc640 1 -- 172.21.15.133:0/1580817071 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9ac015c790 con 0x7f9ac01582d0 2023-12-18T10:18:10.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.022+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f9ac015c790 con 0x7f9ac01582d0 2023-12-18T10:18:10.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.026+0000 7f9ab67fc640 1 -- 172.21.15.133:0/1580817071 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9ac015c790 con 0x7f9ac01582d0 2023-12-18T10:18:10.035 INFO:teuthology.orchestra.run.smithi133.stderr:added data pool 4 to fsmap 2023-12-18T10:18:10.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4065a60 msgr2=0x7f9aa4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4065a60 0x7f9aa4067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc0b5040 comp rx=0 tx=0).stop 2023-12-18T10:18:10.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 msgr2=0x7f9ac00c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 0x7f9ac00c1260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800ce50 tx=0x7f9ab800a710 comp rx=0 tx=0).stop 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 shutdown_connections 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4065a60 0x7f9aa4067f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac01582d0 0x7f9ac00c1260 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9ac00ce3b0 0x7f9ac015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 --2- 172.21.15.133:0/1580817071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ac0070820 0x7f9ac015e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 >> 172.21.15.133:0/1580817071 conn(0x7f9ac006a2a0 msgr2=0x7f9ac0154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 shutdown_connections 2023-12-18T10:18:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.030+0000 7f9ac8139640 1 -- 172.21.15.133:0/1580817071 wait complete. 2023-12-18T10:18:10.056 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:18:10.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7be5e8c640 1 Processor -- start 2023-12-18T10:18:10.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7be5e8c640 1 -- start start 2023-12-18T10:18:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7be5e8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7be015a680 0x7f7be015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7be5e8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be00cac10 0x7f7be015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7be5e8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7be015afa0 0x7f7be006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7be5e8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be015f100 con 0x7f7be015afa0 2023-12-18T10:18:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7be5e8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be00ca7d0 con 0x7f7be015a680 2023-12-18T10:18:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7be5e8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be015e860 con 0x7f7be00cac10 2023-12-18T10:18:10.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7bdffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7be015afa0 0x7f7be006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.186+0000 7f7bdffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7be015afa0 0x7f7be006fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41194/0 (socket says 172.21.15.133:41194) 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdffff640 1 -- 172.21.15.133:0/3238536351 learned_addr learned my addr 172.21.15.133:0/3238536351 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdeffd640 1 --2- 172.21.15.133:0/3238536351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be00cac10 0x7f7be015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdf7fe640 1 --2- 172.21.15.133:0/3238536351 >> v2:172.21.15.142:3300/0 conn(0x7f7be015a680 0x7f7be015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdffff640 1 -- 172.21.15.133:0/3238536351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be00cac10 msgr2=0x7f7be015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdffff640 1 --2- 172.21.15.133:0/3238536351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be00cac10 0x7f7be015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdffff640 1 -- 172.21.15.133:0/3238536351 >> v2:172.21.15.142:3300/0 conn(0x7f7be015a680 msgr2=0x7f7be015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdffff640 1 --2- 172.21.15.133:0/3238536351 >> v2:172.21.15.142:3300/0 conn(0x7f7be015a680 0x7f7be015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdffff640 1 -- 172.21.15.133:0/3238536351 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be015eb40 con 0x7f7be015afa0 2023-12-18T10:18:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdeffd640 1 --2- 172.21.15.133:0/3238536351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be00cac10 0x7f7be015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:10.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bdffff640 1 --2- 172.21.15.133:0/3238536351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be015afa0 0x7f7be006fdb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7be006ce40 tx=0x7f7bd801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5388d3792d9d9f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bde7fc640 1 -- 172.21.15.133:0/3238536351 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80a56d0 con 0x7f7be015afa0 2023-12-18T10:18:10.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bde7fc640 1 -- 172.21.15.133:0/3238536351 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd80a5830 con 0x7f7be015afa0 2023-12-18T10:18:10.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7bde7fc640 1 -- 172.21.15.133:0/3238536351 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80a5bc0 con 0x7f7be015afa0 2023-12-18T10:18:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3238536351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be015afa0 msgr2=0x7f7be006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.190+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3238536351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be015afa0 0x7f7be006fdb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7be006ce40 tx=0x7f7bd801c940 comp rx=0 tx=0).stop 2023-12-18T10:18:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3238536351 shutdown_connections 2023-12-18T10:18:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3238536351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be015afa0 0x7f7be006fdb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3238536351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be00cac10 0x7f7be015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3238536351 >> v2:172.21.15.142:3300/0 conn(0x7f7be015a680 0x7f7be015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3238536351 >> 172.21.15.133:0/3238536351 conn(0x7f7be006a3e0 msgr2=0x7f7be00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:10.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3238536351 shutdown_connections 2023-12-18T10:18:10.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3238536351 wait complete. 2023-12-18T10:18:10.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 Processor -- start 2023-12-18T10:18:10.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 -- start start 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be00cac10 0x7f7be00c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7be015a680 0x7f7be015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be015afa0 0x7f7be0155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00c3900 con 0x7f7be00cac10 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00c2fd0 con 0x7f7be015a680 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7be5e8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00c32b0 con 0x7f7be015afa0 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be00cac10 0x7f7be00c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be00cac10 0x7f7be00c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41198/0 (socket says 172.21.15.133:41198) 2023-12-18T10:18:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdf7fe640 1 -- 172.21.15.133:0/3968543475 learned_addr learned my addr 172.21.15.133:0/3968543475 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdeffd640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7be015a680 0x7f7be015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdffff640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be015afa0 0x7f7be0155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdf7fe640 1 -- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be015afa0 msgr2=0x7f7be0155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdf7fe640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be015afa0 0x7f7be0155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdf7fe640 1 -- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7be015a680 msgr2=0x7f7be015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdf7fe640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7be015a680 0x7f7be015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdf7fe640 1 -- 172.21.15.133:0/3968543475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd8009b30 con 0x7f7be00cac10 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.194+0000 7f7bdffff640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be015afa0 0x7f7be0155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7bdf7fe640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be00cac10 0x7f7be00c4660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000d800 tx=0x7f7bd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7bc7fff640 1 -- 172.21.15.133:0/3968543475 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000b6c0 con 0x7f7be00cac10 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7bc7fff640 1 -- 172.21.15.133:0/3968543475 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000b820 con 0x7f7be00cac10 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7bc7fff640 1 -- 172.21.15.133:0/3968543475 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000bb90 con 0x7f7be00cac10 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be00c3590 con 0x7f7be00cac10 2023-12-18T10:18:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be00c2bf0 con 0x7f7be00cac10 2023-12-18T10:18:10.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be00735b0 con 0x7f7be00cac10 2023-12-18T10:18:10.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7bc7fff640 1 -- 172.21.15.133:0/3968543475 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7bd000bcf0 con 0x7f7be00cac10 2023-12-18T10:18:10.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7bc7fff640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bcc065a60 0x7f7bcc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7bc7fff640 1 -- 172.21.15.133:0/3968543475 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7bd00838e0 con 0x7f7be00cac10 2023-12-18T10:18:10.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.198+0000 7f7bdeffd640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bcc065a60 0x7f7bcc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.202+0000 7f7bdeffd640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bcc065a60 0x7f7bcc067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7be0163650 tx=0x7f7bd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.206+0000 7f7bc7fff640 1 -- 172.21.15.133:0/3968543475 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7bd0050fb0 con 0x7f7be00cac10 2023-12-18T10:18:10.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7be004e000 con 0x7f7be00cac10 2023-12-18T10:18:10.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7bc7fff640 1 -- 172.21.15.133:0/3968543475 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f7bd00545d0 con 0x7f7be00cac10 2023-12-18T10:18:10.392 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:10.392 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:10.028590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-18T10:18:10.393 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2023-12-18T10:18:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bcc065a60 msgr2=0x7f7bcc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bcc065a60 0x7f7bcc067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7be0163650 tx=0x7f7bd4008040 comp rx=0 tx=0).stop 2023-12-18T10:18:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be00cac10 msgr2=0x7f7be00c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be00cac10 0x7f7be00c4660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000d800 tx=0x7f7bd000dcc0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 shutdown_connections 2023-12-18T10:18:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bcc065a60 0x7f7bcc067f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7be015afa0 0x7f7be0155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7be015a680 0x7f7be015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 --2- 172.21.15.133:0/3968543475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7be00cac10 0x7f7be00c4660 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 >> 172.21.15.133:0/3968543475 conn(0x7f7be006a3e0 msgr2=0x7f7be01591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 shutdown_connections 2023-12-18T10:18:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.386+0000 7f7be5e8c640 1 -- 172.21.15.133:0/3968543475 wait complete. 2023-12-18T10:18:10.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:10.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc115bce640 1 Processor -- start 2023-12-18T10:18:10.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc115bce640 1 -- start start 2023-12-18T10:18:10.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc115bce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc11015a680 0x7fc11015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc115bce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1100cac10 0x7fc11015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc115bce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11015f100 con 0x7fc11015afa0 2023-12-18T10:18:10.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc115bce640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100ca7d0 con 0x7fc1100cac10 2023-12-18T10:18:10.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc115bce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11015e860 con 0x7fc11015a680 2023-12-18T10:18:10.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc10effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1100cac10 0x7fc11015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc10effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1100cac10 0x7fc11015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41204/0 (socket says 172.21.15.133:41204) 2023-12-18T10:18:10.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc10effd640 1 -- 172.21.15.133:0/930802974 learned_addr learned my addr 172.21.15.133:0/930802974 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:10.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc10f7fe640 1 --2- 172.21.15.133:0/930802974 >> v2:172.21.15.142:3300/0 conn(0x7fc11015a680 0x7fc11015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc10effd640 1 -- 172.21.15.133:0/930802974 >> v2:172.21.15.142:3300/0 conn(0x7fc11015a680 msgr2=0x7fc11015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:10.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc10effd640 1 --2- 172.21.15.133:0/930802974 >> v2:172.21.15.142:3300/0 conn(0x7fc11015a680 0x7fc11015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc10effd640 1 -- 172.21.15.133:0/930802974 >> v1:172.21.15.142:6789/0 conn(0x7fc11015afa0 legacy=0x7fc11006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.546+0000 7fc10effd640 1 -- 172.21.15.133:0/930802974 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11015eb40 con 0x7fc1100cac10 2023-12-18T10:18:10.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc10effd640 1 --2- 172.21.15.133:0/930802974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1100cac10 0x7fc11015aa60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc104009870 tx=0x7fc10401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddca92e145bb4dad server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc10e7fc640 1 -- 172.21.15.133:0/930802974 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040ad680 con 0x7fc1100cac10 2023-12-18T10:18:10.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc10e7fc640 1 -- 172.21.15.133:0/930802974 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1040ad7e0 con 0x7fc1100cac10 2023-12-18T10:18:10.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc10e7fc640 1 -- 172.21.15.133:0/930802974 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040adb70 con 0x7fc1100cac10 2023-12-18T10:18:10.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc115bce640 1 -- 172.21.15.133:0/930802974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1100cac10 msgr2=0x7fc11015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc115bce640 1 --2- 172.21.15.133:0/930802974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1100cac10 0x7fc11015aa60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc104009870 tx=0x7fc10401c470 comp rx=0 tx=0).stop 2023-12-18T10:18:10.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc115bce640 1 -- 172.21.15.133:0/930802974 shutdown_connections 2023-12-18T10:18:10.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc115bce640 1 --2- 172.21.15.133:0/930802974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1100cac10 0x7fc11015aa60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc115bce640 1 --2- 172.21.15.133:0/930802974 >> v2:172.21.15.142:3300/0 conn(0x7fc11015a680 0x7fc11015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc115bce640 1 -- 172.21.15.133:0/930802974 >> 172.21.15.133:0/930802974 conn(0x7fc11006a3e0 msgr2=0x7fc1100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:10.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc115bce640 1 -- 172.21.15.133:0/930802974 shutdown_connections 2023-12-18T10:18:10.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.550+0000 7fc115bce640 1 -- 172.21.15.133:0/930802974 wait complete. 2023-12-18T10:18:10.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 Processor -- start 2023-12-18T10:18:10.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 -- start start 2023-12-18T10:18:10.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cac10 0x7fc1100cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11015a680 0x7fc110149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc11015afa0 0x7fc110151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1101573d0 con 0x7fc11015afa0 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100cdfc0 con 0x7fc1100cac10 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100af6c0 con 0x7fc11015a680 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc11015afa0 0x7fc110151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc11015afa0 0x7fc110151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41206/0 (socket says 172.21.15.133:41206) 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 -- 172.21.15.133:0/3726496827 learned_addr learned my addr 172.21.15.133:0/3726496827 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10effd640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11015a680 0x7fc110149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10f7fe640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cac10 0x7fc1100cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 -- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11015a680 msgr2=0x7fc110149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11015a680 0x7fc110149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 -- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cac10 msgr2=0x7fc1100cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cac10 0x7fc1100cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 -- 172.21.15.133:0/3726496827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1040094d0 con 0x7fc11015afa0 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10f7fe640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cac10 0x7fc1100cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc10ffff640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc11015afa0 0x7fc110151ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c760 tx=0x7fc10800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc0f7fff640 1 -- 172.21.15.133:0/3726496827 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108003b80 con 0x7fc11015afa0 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc0f7fff640 1 -- 172.21.15.133:0/3726496827 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108003ce0 con 0x7fc11015afa0 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc0f7fff640 1 -- 172.21.15.133:0/3726496827 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10800aa30 con 0x7fc11015afa0 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1100af100 con 0x7fc11015afa0 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1100cd560 con 0x7fc11015afa0 2023-12-18T10:18:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.554+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1100735b0 con 0x7fc11015afa0 2023-12-18T10:18:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.558+0000 7fc0f7fff640 1 -- 172.21.15.133:0/3726496827 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc10800ab90 con 0x7fc11015afa0 2023-12-18T10:18:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.558+0000 7fc0f7fff640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0fc065a90 0x7fc0fc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.558+0000 7fc0f7fff640 1 -- 172.21.15.133:0/3726496827 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc108083140 con 0x7fc11015afa0 2023-12-18T10:18:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.558+0000 7fc10f7fe640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0fc065a90 0x7fc0fc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.558+0000 7fc10f7fe640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0fc065a90 0x7fc0fc067f50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc100009bb0 tx=0x7fc100008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.562+0000 7fc0f7fff640 1 -- 172.21.15.133:0/3726496827 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc108050810 con 0x7fc11015afa0 2023-12-18T10:18:10.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.718+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1100cd750 con 0x7fc11015afa0 2023-12-18T10:18:10.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.718+0000 7fc0f7fff640 1 -- 172.21.15.133:0/3726496827 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fc108053e30 con 0x7fc11015afa0 2023-12-18T10:18:10.726 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:10.727 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:10.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0fc065a90 msgr2=0x7fc0fc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0fc065a90 0x7fc0fc067f50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc100009bb0 tx=0x7fc100008040 comp rx=0 tx=0).stop 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc11015afa0 msgr2=0x7fc110151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc11015afa0 0x7fc110151ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c760 tx=0x7fc10800cc20 comp rx=0 tx=0).stop 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 shutdown_connections 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0fc065a90 0x7fc0fc067f50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc11015afa0 0x7fc110151ab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc11015a680 0x7fc110149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 --2- 172.21.15.133:0/3726496827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1100cac10 0x7fc1100cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 >> 172.21.15.133:0/3726496827 conn(0x7fc11006a3e0 msgr2=0x7fc1100ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 shutdown_connections 2023-12-18T10:18:10.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.722+0000 7fc115bce640 1 -- 172.21.15.133:0/3726496827 wait complete. 2023-12-18T10:18:10.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:10.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.878+0000 7f4a5b525640 1 Processor -- start 2023-12-18T10:18:10.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.878+0000 7f4a5b525640 1 -- start start 2023-12-18T10:18:10.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.878+0000 7f4a5b525640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a541570c0 0x7f4a5406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.878+0000 7f4a5b525640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a5406c320 0x7f4a540c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.878+0000 7f4a5b525640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a540c9460 con 0x7f4a540c9e30 2023-12-18T10:18:10.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.878+0000 7f4a5b525640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5406c7a0 con 0x7f4a5406c320 2023-12-18T10:18:10.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.878+0000 7f4a5b525640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a541574a0 con 0x7f4a541570c0 2023-12-18T10:18:10.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a58ac0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a5406c320 0x7f4a540c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a58ac0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a5406c320 0x7f4a540c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41214/0 (socket says 172.21.15.133:41214) 2023-12-18T10:18:10.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a58ac0640 1 -- 172.21.15.133:0/3640313010 learned_addr learned my addr 172.21.15.133:0/3640313010 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:10.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a592c1640 1 --2- 172.21.15.133:0/3640313010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a541570c0 0x7f4a5406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a58ac0640 1 -- 172.21.15.133:0/3640313010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a541570c0 msgr2=0x7f4a5406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:10.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a58ac0640 1 --2- 172.21.15.133:0/3640313010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a541570c0 0x7f4a5406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a58ac0640 1 -- 172.21.15.133:0/3640313010 >> v1:172.21.15.142:6789/0 conn(0x7f4a540c9e30 legacy=0x7f4a5415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:10.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a58ac0640 1 -- 172.21.15.133:0/3640313010 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540c8b30 con 0x7f4a5406c320 2023-12-18T10:18:10.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a58ac0640 1 --2- 172.21.15.133:0/3640313010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a5406c320 0x7f4a540c98f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009870 tx=0x7f4a4401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc38ed5949ecdac1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a4bfff640 1 -- 172.21.15.133:0/3640313010 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440ac640 con 0x7f4a5406c320 2023-12-18T10:18:10.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a4bfff640 1 -- 172.21.15.133:0/3640313010 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a440ac7a0 con 0x7f4a5406c320 2023-12-18T10:18:10.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.882+0000 7f4a4bfff640 1 -- 172.21.15.133:0/3640313010 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440acb30 con 0x7f4a5406c320 2023-12-18T10:18:10.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- 172.21.15.133:0/3640313010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a5406c320 msgr2=0x7f4a540c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 --2- 172.21.15.133:0/3640313010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a5406c320 0x7f4a540c98f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009870 tx=0x7f4a4401c440 comp rx=0 tx=0).stop 2023-12-18T10:18:10.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- 172.21.15.133:0/3640313010 shutdown_connections 2023-12-18T10:18:10.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 --2- 172.21.15.133:0/3640313010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a5406c320 0x7f4a540c98f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 --2- 172.21.15.133:0/3640313010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a541570c0 0x7f4a5406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- 172.21.15.133:0/3640313010 >> 172.21.15.133:0/3640313010 conn(0x7f4a5406a3e0 msgr2=0x7f4a540afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:10.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- 172.21.15.133:0/3640313010 shutdown_connections 2023-12-18T10:18:10.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- 172.21.15.133:0/3640313010 wait complete. 2023-12-18T10:18:10.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 Processor -- start 2023-12-18T10:18:10.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- start start 2023-12-18T10:18:10.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5406c320 0x7f4a54151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a540c9e30 0x7f4a54151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a541570c0 0x7f4a540c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540c5f80 con 0x7f4a541570c0 2023-12-18T10:18:10.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540c6260 con 0x7f4a540c9e30 2023-12-18T10:18:10.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a5b525640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540c6540 con 0x7f4a5406c320 2023-12-18T10:18:10.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a59ac2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a541570c0 0x7f4a540c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a59ac2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a541570c0 0x7f4a540c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41216/0 (socket says 172.21.15.133:41216) 2023-12-18T10:18:10.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a59ac2640 1 -- 172.21.15.133:0/1170389859 learned_addr learned my addr 172.21.15.133:0/1170389859 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a58ac0640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a540c9e30 0x7f4a54151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a592c1640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5406c320 0x7f4a54151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a59ac2640 1 -- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5406c320 msgr2=0x7f4a54151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a59ac2640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5406c320 0x7f4a54151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a59ac2640 1 -- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a540c9e30 msgr2=0x7f4a54151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a59ac2640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a540c9e30 0x7f4a54151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.886+0000 7f4a59ac2640 1 -- 172.21.15.133:0/1170389859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440094d0 con 0x7f4a541570c0 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a58ac0640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a540c9e30 0x7f4a54151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a59ac2640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a541570c0 0x7f4a540c5430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c780 tx=0x7f4a4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a49ffb640 1 -- 172.21.15.133:0/1170389859 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c004b70 con 0x7f4a541570c0 2023-12-18T10:18:10.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a49ffb640 1 -- 172.21.15.133:0/1170389859 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c00ce90 con 0x7f4a541570c0 2023-12-18T10:18:10.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a49ffb640 1 -- 172.21.15.133:0/1170389859 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00a850 con 0x7f4a541570c0 2023-12-18T10:18:10.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540c6820 con 0x7f4a541570c0 2023-12-18T10:18:10.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a54151d60 con 0x7f4a541570c0 2023-12-18T10:18:10.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a540735b0 con 0x7f4a541570c0 2023-12-18T10:18:10.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a49ffb640 1 -- 172.21.15.133:0/1170389859 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4a4c00a9b0 con 0x7f4a541570c0 2023-12-18T10:18:10.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a49ffb640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4a38065a60 0x7f4a38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:10.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a49ffb640 1 -- 172.21.15.133:0/1170389859 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a4c0835b0 con 0x7f4a541570c0 2023-12-18T10:18:10.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.890+0000 7f4a592c1640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4a38065a60 0x7f4a38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:10.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.894+0000 7f4a592c1640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4a38065a60 0x7f4a38067f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000b930 tx=0x7f4a50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:10.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:10.894+0000 7f4a49ffb640 1 -- 172.21.15.133:0/1170389859 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4a4c050d10 con 0x7f4a541570c0 2023-12-18T10:18:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.046+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a540c6d40 con 0x7f4a541570c0 2023-12-18T10:18:11.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.046+0000 7f4a49ffb640 1 -- 172.21.15.133:0/1170389859 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f4a540c6d40 con 0x7f4a541570c0 2023-12-18T10:18:11.054 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:11.054 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4a38065a60 msgr2=0x7f4a38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4a38065a60 0x7f4a38067f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000b930 tx=0x7f4a50008040 comp rx=0 tx=0).stop 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a541570c0 msgr2=0x7f4a540c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a541570c0 0x7f4a540c5430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00c780 tx=0x7f4a4c00cc40 comp rx=0 tx=0).stop 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 shutdown_connections 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4a38065a60 0x7f4a38067f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a541570c0 0x7f4a540c5430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4a540c9e30 0x7f4a54151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 --2- 172.21.15.133:0/1170389859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4a5406c320 0x7f4a54151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 >> 172.21.15.133:0/1170389859 conn(0x7f4a5406a3e0 msgr2=0x7f4a540cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 shutdown_connections 2023-12-18T10:18:11.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.050+0000 7f4a5b525640 1 -- 172.21.15.133:0/1170389859 wait complete. 2023-12-18T10:18:11.088 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:18:11.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b905c0640 1 Processor -- start 2023-12-18T10:18:11.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b905c0640 1 -- start start 2023-12-18T10:18:11.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b905c0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b880cac10 0x7f9b8815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b905c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8806fdb0 0x7f9b88070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b905c0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8815f100 con 0x7f9b8815a680 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b905c0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b88070780 con 0x7f9b880cac10 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b905c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880ca7d0 con 0x7f9b8806fdb0 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b8db5b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b880cac10 0x7f9b8815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b8e35c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9b8815a680 0x7f9b8815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55140/0 (socket says 172.21.15.133:55140) 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b8db5b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b880cac10 0x7f9b8815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41228/0 (socket says 172.21.15.133:41228) 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b8e35c640 1 -- 172.21.15.133:0/1947359392 learned_addr learned my addr 172.21.15.133:0/1947359392 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.222+0000 7f9b8eb5d640 1 --2- 172.21.15.133:0/1947359392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8806fdb0 0x7f9b88070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8db5b640 1 -- 172.21.15.133:0/1947359392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8806fdb0 msgr2=0x7f9b88070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8db5b640 1 --2- 172.21.15.133:0/1947359392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8806fdb0 0x7f9b88070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8db5b640 1 -- 172.21.15.133:0/1947359392 >> v1:172.21.15.133:6789/0 conn(0x7f9b8815a680 legacy=0x7f9b8815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8db5b640 1 -- 172.21.15.133:0/1947359392 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8815e860 con 0x7f9b880cac10 2023-12-18T10:18:11.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8eb5d640 1 --2- 172.21.15.133:0/1947359392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8806fdb0 0x7f9b88070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:11.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8d35a640 1 -- 172.21.15.133:0/1947359392 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093355444 0 0) 0x7f9b8815f100 con 0x7f9b8815a680 2023-12-18T10:18:11.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8db5b640 1 --2- 172.21.15.133:0/1947359392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b8815e160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b780097c0 tx=0x7f9b7801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8c5de95ea201f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:11.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8d35a640 1 -- 172.21.15.133:0/1947359392 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780ab5f0 con 0x7f9b880cac10 2023-12-18T10:18:11.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8d35a640 1 -- 172.21.15.133:0/1947359392 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b780ab750 con 0x7f9b880cac10 2023-12-18T10:18:11.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b8d35a640 1 -- 172.21.15.133:0/1947359392 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780abae0 con 0x7f9b880cac10 2023-12-18T10:18:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b905c0640 1 -- 172.21.15.133:0/1947359392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 msgr2=0x7f9b8815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b905c0640 1 --2- 172.21.15.133:0/1947359392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b8815e160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b780097c0 tx=0x7f9b7801c3f0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b905c0640 1 -- 172.21.15.133:0/1947359392 shutdown_connections 2023-12-18T10:18:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b905c0640 1 --2- 172.21.15.133:0/1947359392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8806fdb0 0x7f9b88070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b905c0640 1 --2- 172.21.15.133:0/1947359392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b8815e160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.226+0000 7f9b905c0640 1 -- 172.21.15.133:0/1947359392 >> 172.21.15.133:0/1947359392 conn(0x7f9b8806a3e0 msgr2=0x7f9b880afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 -- 172.21.15.133:0/1947359392 shutdown_connections 2023-12-18T10:18:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 -- 172.21.15.133:0/1947359392 wait complete. 2023-12-18T10:18:11.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 Processor -- start 2023-12-18T10:18:11.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 -- start start 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8806fdb0 0x7f9b88150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b88155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8815a680 0x7f9b8815d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88150e50 con 0x7f9b880cac10 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880af0a0 con 0x7f9b8806fdb0 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880af380 con 0x7f9b8815a680 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b88155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b88155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41236/0 (socket says 172.21.15.133:41236) 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 -- 172.21.15.133:0/3290904357 learned_addr learned my addr 172.21.15.133:0/3290904357 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8eb5d640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8815a680 0x7f9b8815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8e35c640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8806fdb0 0x7f9b88150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 -- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8815a680 msgr2=0x7f9b8815d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8815a680 0x7f9b8815d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 -- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8806fdb0 msgr2=0x7f9b88150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8806fdb0 0x7f9b88150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 -- 172.21.15.133:0/3290904357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78009420 con 0x7f9b880cac10 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8e35c640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8806fdb0 0x7f9b88150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b8db5b640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b88155fb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9b780ad040 tx=0x7f9b7801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b7effd640 1 -- 172.21.15.133:0/3290904357 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780b5810 con 0x7f9b880cac10 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b7effd640 1 -- 172.21.15.133:0/3290904357 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b780b5990 con 0x7f9b880cac10 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b7effd640 1 -- 172.21.15.133:0/3290904357 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780b5d40 con 0x7f9b880cac10 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.230+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b880af660 con 0x7f9b880cac10 2023-12-18T10:18:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.234+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b880afc20 con 0x7f9b880cac10 2023-12-18T10:18:11.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.234+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b880735b0 con 0x7f9b880cac10 2023-12-18T10:18:11.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.234+0000 7f9b7effd640 1 -- 172.21.15.133:0/3290904357 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b780b4390 con 0x7f9b880cac10 2023-12-18T10:18:11.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.234+0000 7f9b7effd640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.234+0000 7f9b7effd640 1 -- 172.21.15.133:0/3290904357 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b780a8050 con 0x7f9b880cac10 2023-12-18T10:18:11.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.234+0000 7f9b8e35c640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.234+0000 7f9b8e35c640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b84007fd0 tx=0x7f9b84007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:11.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.238+0000 7f9b7effd640 1 -- 172.21.15.133:0/3290904357 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b780eb400 con 0x7f9b880cac10 2023-12-18T10:18:11.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b8804e000 con 0x7f9b880cac10 2023-12-18T10:18:11.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b7effd640 1 -- 172.21.15.133:0/3290904357 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f9b780ab5b0 con 0x7f9b880cac10 2023-12-18T10:18:11.429 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:11.429 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:10.028590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-18T10:18:11.429 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 7 2023-12-18T10:18:11.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 msgr2=0x7f9b6c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b84007fd0 tx=0x7f9b84007c20 comp rx=0 tx=0).stop 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 msgr2=0x7f9b88155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b88155fb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9b780ad040 tx=0x7f9b7801ac30 comp rx=0 tx=0).stop 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 shutdown_connections 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8815a680 0x7f9b8815d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b880cac10 0x7f9b88155fb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 --2- 172.21.15.133:0/3290904357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8806fdb0 0x7f9b88150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 >> 172.21.15.133:0/3290904357 conn(0x7f9b8806a3e0 msgr2=0x7f9b8806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 shutdown_connections 2023-12-18T10:18:11.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.422+0000 7f9b905c0640 1 -- 172.21.15.133:0/3290904357 wait complete. 2023-12-18T10:18:11.449 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.578+0000 7f20b0241640 1 Processor -- start 2023-12-18T10:18:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.578+0000 7f20b0241640 1 -- start start 2023-12-18T10:18:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20b0241640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20a80cac10 0x7f20a815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20b0241640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a815f100 con 0x7f20a815a680 2023-12-18T10:18:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20b0241640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a80ca7d0 con 0x7f20a806fdb0 2023-12-18T10:18:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20b0241640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a815e860 con 0x7f20a80cac10 2023-12-18T10:18:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20adfdd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f20a815a680 0x7f20a815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55150/0 (socket says 172.21.15.133:55150) 2023-12-18T10:18:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20adfdd640 1 -- 172.21.15.133:0/2697345657 learned_addr learned my addr 172.21.15.133:0/2697345657 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20ad7dc640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20a80cac10 0x7f20a815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534341898 0 0) 0x7f20a815f100 con 0x7f20a815a680 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2094003530 con 0x7f20a815a680 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1916200294 0 0) 0x7f2094003530 con 0x7f20a815a680 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20a80cac10 msgr2=0x7f20a815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20a80cac10 0x7f20a815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 >> v1:172.21.15.142:6789/0 conn(0x7f20a806fdb0 legacy=0x7f20a80c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a815eb40 con 0x7f20a815a680 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f20a4001680 con 0x7f20a815a680 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 >> v1:172.21.15.133:6789/0 conn(0x7f20a815a680 legacy=0x7f20a815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 0x7f2094003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20940043a0 0x7f2094004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2094005110 0x7f209400fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a815e860 con 0x7f2094005110 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094010440 con 0x7f20940043a0 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2094009980 con 0x7f20940039b0 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20ad7dc640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20a80cac10 0x7f20a815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20adfdd640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 0x7f2094003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20ae7de640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2094005110 0x7f209400fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20ad7dc640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20940043a0 0x7f2094004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20adfdd640 1 -- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20940043a0 msgr2=0x7f2094004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20adfdd640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20940043a0 0x7f2094004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20adfdd640 1 -- 172.21.15.133:0/2697345657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2094005110 msgr2=0x7f209400fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20adfdd640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2094005110 0x7f209400fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20adfdd640 1 -- 172.21.15.133:0/2697345657 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2094003530 con 0x7f20940039b0 2023-12-18T10:18:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.582+0000 7f20ae7de640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2094005110 0x7f209400fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20adfdd640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 0x7f2094003dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c240 tx=0x7f20a401f2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b86bb798ee192796 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4005ae0 con 0x7f20940039b0 2023-12-18T10:18:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a40ab070 con 0x7f20940039b0 2023-12-18T10:18:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20acfdb640 1 -- 172.21.15.133:0/2697345657 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a4007070 con 0x7f20940039b0 2023-12-18T10:18:11.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20b0241640 1 -- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 msgr2=0x7f2094003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20b0241640 1 --2- 172.21.15.133:0/2697345657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 0x7f2094003dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c240 tx=0x7f20a401f2f0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20ae7de640 1 -- 172.21.15.133:0/2697345657 reap_dead start 2023-12-18T10:18:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20b0241640 1 -- 172.21.15.133:0/2697345657 shutdown_connections 2023-12-18T10:18:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20b0241640 1 -- 172.21.15.133:0/2697345657 >> 172.21.15.133:0/2697345657 conn(0x7f20a806a3e0 msgr2=0x7f20a80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20b0241640 1 -- 172.21.15.133:0/2697345657 shutdown_connections 2023-12-18T10:18:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.586+0000 7f20b0241640 1 -- 172.21.15.133:0/2697345657 wait complete. 2023-12-18T10:18:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 Processor -- start 2023-12-18T10:18:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 -- start start 2023-12-18T10:18:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 0x7f20a8155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20a80c7cc0 0x7f20a80c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a8158440 0x7f20a80c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8158940 con 0x7f20a8158440 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8158c20 con 0x7f20a80c7cc0 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8158f00 con 0x7f20940039b0 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a8158440 0x7f20a80c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a8158440 0x7f20a80c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41248/0 (socket says 172.21.15.133:41248) 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 -- 172.21.15.133:0/3680540356 learned_addr learned my addr 172.21.15.133:0/3680540356 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20adfdd640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 0x7f20a8155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ad7dc640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20a80c7cc0 0x7f20a80c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 -- 172.21.15.133:0/3680540356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 msgr2=0x7f20a8155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 0x7f20a8155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 -- 172.21.15.133:0/3680540356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20a80c7cc0 msgr2=0x7f20a80c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20a80c7cc0 0x7f20a80c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 -- 172.21.15.133:0/3680540356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a80c2030 con 0x7f20a8158440 2023-12-18T10:18:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20ae7de640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a8158440 0x7f20a80c4ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20a80ce140 tx=0x7f20a000feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f209e7fc640 1 -- 172.21.15.133:0/3680540356 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0003b90 con 0x7f20a8158440 2023-12-18T10:18:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f209e7fc640 1 -- 172.21.15.133:0/3680540356 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0003d10 con 0x7f20a8158440 2023-12-18T10:18:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a8155c70 con 0x7f20a8158440 2023-12-18T10:18:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f209e7fc640 1 -- 172.21.15.133:0/3680540356 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000d980 con 0x7f20a8158440 2023-12-18T10:18:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a80c8480 con 0x7f20a8158440 2023-12-18T10:18:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.590+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a80735b0 con 0x7f20a8158440 2023-12-18T10:18:11.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.594+0000 7f209e7fc640 1 -- 172.21.15.133:0/3680540356 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f20a000dae0 con 0x7f20a8158440 2023-12-18T10:18:11.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.594+0000 7f209e7fc640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f208c065a60 0x7f208c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:11.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.594+0000 7f209e7fc640 1 -- 172.21.15.133:0/3680540356 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20a0083350 con 0x7f20a8158440 2023-12-18T10:18:11.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.594+0000 7f20adfdd640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f208c065a60 0x7f208c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:11.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.594+0000 7f20adfdd640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f208c065a60 0x7f208c067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20a40af000 tx=0x7f20a40aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:11.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.598+0000 7f209e7fc640 1 -- 172.21.15.133:0/3680540356 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f20a0050a10 con 0x7f20a8158440 2023-12-18T10:18:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a80c1e90 con 0x7f20a8158440 2023-12-18T10:18:11.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f209e7fc640 1 -- 172.21.15.133:0/3680540356 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f20a80c1e90 con 0x7f20a8158440 2023-12-18T10:18:11.757 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:11.757 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f208c065a60 msgr2=0x7f208c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f208c065a60 0x7f208c067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20a40af000 tx=0x7f20a40aa000 comp rx=0 tx=0).stop 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a8158440 msgr2=0x7f20a80c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a8158440 0x7f20a80c4ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20a80ce140 tx=0x7f20a000feb0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 shutdown_connections 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f208c065a60 0x7f208c067f20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20a8158440 0x7f20a80c4ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20a80c7cc0 0x7f20a80c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 --2- 172.21.15.133:0/3680540356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20940039b0 0x7f20a8155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:11.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.750+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 >> 172.21.15.133:0/3680540356 conn(0x7f20a806a3e0 msgr2=0x7f20a80ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:11.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.754+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 shutdown_connections 2023-12-18T10:18:11.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:11.754+0000 7f20b0241640 1 -- 172.21.15.133:0/3680540356 wait complete. 2023-12-18T10:18:12.180 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:18:05.604323+0000', 'modified': '2023-12-18T10:18:10.028590+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/229940980', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 229940980}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 229940980}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-18T10:18:12.180 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-18T10:18:12.180 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-18T10:18:12.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c659b3640 1 Processor -- start 2023-12-18T10:18:12.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c659b3640 1 -- start start 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c659b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015a680 0x7f4c6015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c659b3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c600cac10 0x7f4c6015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c659b3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4c6015afa0 0x7f4c6006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c659b3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6015f100 con 0x7f4c600cac10 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c659b3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600ca7d0 con 0x7f4c6015afa0 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c659b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6015e860 con 0x7f4c6015a680 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c57fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c600cac10 0x7f4c6015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c57fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c600cac10 0x7f4c6015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41250/0 (socket says 172.21.15.133:41250) 2023-12-18T10:18:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c57fff640 1 -- 172.21.15.133:0/2484898925 learned_addr learned my addr 172.21.15.133:0/2484898925 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c5effd640 1 --2- 172.21.15.133:0/2484898925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015a680 0x7f4c6015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c5f7fe640 1 --2- 172.21.15.133:0/2484898925 >> v2:172.21.15.142:3300/0 conn(0x7f4c6015afa0 0x7f4c6006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c57fff640 1 -- 172.21.15.133:0/2484898925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015a680 msgr2=0x7f4c6015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c57fff640 1 --2- 172.21.15.133:0/2484898925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015a680 0x7f4c6015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c57fff640 1 -- 172.21.15.133:0/2484898925 >> v2:172.21.15.142:3300/0 conn(0x7f4c6015afa0 msgr2=0x7f4c6006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c57fff640 1 --2- 172.21.15.133:0/2484898925 >> v2:172.21.15.142:3300/0 conn(0x7f4c6015afa0 0x7f4c6006fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c57fff640 1 -- 172.21.15.133:0/2484898925 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6015eb40 con 0x7f4c600cac10 2023-12-18T10:18:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.314+0000 7f4c5effd640 1 --2- 172.21.15.133:0/2484898925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015a680 0x7f4c6015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:12.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c57fff640 1 --2- 172.21.15.133:0/2484898925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c600cac10 0x7f4c6015aa60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c600add90 tx=0x7f4c4801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c72e9182684393 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c5e7fc640 1 -- 172.21.15.133:0/2484898925 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480ab600 con 0x7f4c600cac10 2023-12-18T10:18:12.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c5e7fc640 1 -- 172.21.15.133:0/2484898925 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480a7050 con 0x7f4c600cac10 2023-12-18T10:18:12.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c5e7fc640 1 -- 172.21.15.133:0/2484898925 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480ab980 con 0x7f4c600cac10 2023-12-18T10:18:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 -- 172.21.15.133:0/2484898925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c600cac10 msgr2=0x7f4c6015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 --2- 172.21.15.133:0/2484898925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c600cac10 0x7f4c6015aa60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c600add90 tx=0x7f4c4801c470 comp rx=0 tx=0).stop 2023-12-18T10:18:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 -- 172.21.15.133:0/2484898925 shutdown_connections 2023-12-18T10:18:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 --2- 172.21.15.133:0/2484898925 >> v2:172.21.15.142:3300/0 conn(0x7f4c6015afa0 0x7f4c6006fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 --2- 172.21.15.133:0/2484898925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c600cac10 0x7f4c6015aa60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 --2- 172.21.15.133:0/2484898925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015a680 0x7f4c6015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 -- 172.21.15.133:0/2484898925 >> 172.21.15.133:0/2484898925 conn(0x7f4c6006a3e0 msgr2=0x7f4c600afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 -- 172.21.15.133:0/2484898925 shutdown_connections 2023-12-18T10:18:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 -- 172.21.15.133:0/2484898925 wait complete. 2023-12-18T10:18:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.318+0000 7f4c659b3640 1 Processor -- start 2023-12-18T10:18:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 -- start start 2023-12-18T10:18:12.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c600cac10 0x7f4c600c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6015a680 0x7f4c60157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015afa0 0x7f4c60148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600a7490 con 0x7f4c6015a680 2023-12-18T10:18:12.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60157680 con 0x7f4c600cac10 2023-12-18T10:18:12.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60157950 con 0x7f4c6015afa0 2023-12-18T10:18:12.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6015a680 0x7f4c60157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6015a680 0x7f4c60157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41266/0 (socket says 172.21.15.133:41266) 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 -- 172.21.15.133:0/1149028668 learned_addr learned my addr 172.21.15.133:0/1149028668 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c5effd640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c600cac10 0x7f4c600c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c5f7fe640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015afa0 0x7f4c60148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 -- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015afa0 msgr2=0x7f4c60148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015afa0 0x7f4c60148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 -- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c600cac10 msgr2=0x7f4c600c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c600cac10 0x7f4c600c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 -- 172.21.15.133:0/1149028668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480094d0 con 0x7f4c6015a680 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c5effd640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c600cac10 0x7f4c600c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c57fff640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6015a680 0x7f4c60157140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c4801cd10 tx=0x7f4c48019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c5cff9640 1 -- 172.21.15.133:0/1149028668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b6440 con 0x7f4c6015a680 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c5cff9640 1 -- 172.21.15.133:0/1149028668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480b65a0 con 0x7f4c6015a680 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c5cff9640 1 -- 172.21.15.133:0/1149028668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b6930 con 0x7f4c6015a680 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 -- 172.21.15.133:0/1149028668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c600a76e0 con 0x7f4c6015a680 2023-12-18T10:18:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.322+0000 7f4c659b3640 1 -- 172.21.15.133:0/1149028668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c600a7ca0 con 0x7f4c6015a680 2023-12-18T10:18:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c5cff9640 1 -- 172.21.15.133:0/1149028668 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4c480b2040 con 0x7f4c6015a680 2023-12-18T10:18:12.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c5cff9640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c40065a60 0x7f4c40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c5cff9640 1 -- 172.21.15.133:0/1149028668 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c4811d170 con 0x7f4c6015a680 2023-12-18T10:18:12.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c5effd640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c40065a60 0x7f4c40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c68d27000 1 Processor -- start 2023-12-18T10:18:12.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c68d27000 1 -- start start 2023-12-18T10:18:12.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c5effd640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c40065a60 0x7f4c40067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009970 tx=0x7f4c50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 0x55842a5836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a583be0 0x55842a539090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5395d0 0x55842a5399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c68d27000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842a358c90 con 0x55842a583be0 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c68d27000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842a38a220 con 0x55842a5395d0 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c68d27000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55842a3877f0 con 0x55842a5832c0 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a583be0 0x55842a539090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a583be0 0x55842a539090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41278/0 (socket says 172.21.15.133:41278) 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 -- 172.21.15.133:0/3533651370 learned_addr learned my addr 172.21.15.133:0/3533651370 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c5effd640 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 0x55842a5836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c5f7fe640 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5395d0 0x55842a5399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 -- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 msgr2=0x55842a5836a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 0x55842a5836a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 -- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5395d0 msgr2=0x55842a5399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5395d0 0x55842a5399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 -- 172.21.15.133:0/3533651370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55842a07f890 con 0x55842a583be0 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c5f7fe640 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5395d0 0x55842a5399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.326+0000 7f4c57fff640 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a583be0 0x55842a539090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c480f5fa0 tx=0x7f4c480eecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bd18071ff6ee36 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c557fa640 1 -- 172.21.15.133:0/3533651370 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480f64d0 con 0x55842a583be0 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c557fa640 1 -- 172.21.15.133:0/3533651370 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480ec890 con 0x55842a583be0 2023-12-18T10:18:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c557fa640 1 -- 172.21.15.133:0/3533651370 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480eac00 con 0x55842a583be0 2023-12-18T10:18:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- 172.21.15.133:0/3533651370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a583be0 msgr2=0x55842a539090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a583be0 0x55842a539090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c480f5fa0 tx=0x7f4c480eecb0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- 172.21.15.133:0/3533651370 shutdown_connections 2023-12-18T10:18:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5395d0 0x55842a5399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a583be0 0x55842a539090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3533651370 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 0x55842a5836a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- 172.21.15.133:0/3533651370 >> 172.21.15.133:0/3533651370 conn(0x55842a53b950 msgr2=0x55842a533560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- 172.21.15.133:0/3533651370 shutdown_connections 2023-12-18T10:18:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- 172.21.15.133:0/3533651370 wait complete. 2023-12-18T10:18:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- start start 2023-12-18T10:18:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 Processor -- start 2023-12-18T10:18:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a582b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 0x55842a583fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a583be0 0x55842a584500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842a3830e0 con 0x55842a5395d0 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842a322310 con 0x55842a583be0 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55842a340770 con 0x55842a5832c0 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c68d27000 10 client.0 _ll_register_callbacks cb 0x55842a520b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a582b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a582b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41290/0 (socket says 172.21.15.133:41290) 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 -- 172.21.15.133:0/2325147968 learned_addr learned my addr 172.21.15.133:0/2325147968 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c57fff640 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 0x55842a583fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5f7fe640 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a583be0 0x55842a584500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 -- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 msgr2=0x55842a583fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 0x55842a583fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 -- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a583be0 msgr2=0x55842a584500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a583be0 0x55842a584500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 -- 172.21.15.133:0/2325147968 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c600a7ca0 con 0x55842a5395d0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c5effd640 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a582b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4c500157c0 tx=0x7f4c500046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b47c29d7b7c638 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.330+0000 7f4c3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/2325147968 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50016bb0 con 0x55842a5395d0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/2325147968 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c50016d10 con 0x55842a5395d0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 -- 172.21.15.133:0/2325147968 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55842a352c10 con 0x55842a5395d0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/2325147968 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c500223f0 con 0x55842a5395d0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 10 client.4425 fetch_fsmap learned FSMap version 7 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 -- 172.21.15.133:0/2325147968 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55842a348260 con 0x55842a5395d0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/2325147968 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55842a352c10 con 0x55842a5395d0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/2325147968 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f4c50022550 con 0x55842a5395d0 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 20 client.4425 populate_metadata read hostname 'smithi133' 2023-12-18T10:18:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55842a584f10 0x55842a5852f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 4 client.4425 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:18:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 -- 172.21.15.133:0/2325147968 --> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55842a381a30 con 0x55842a584f10 2023-12-18T10:18:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c57fff640 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55842a584f10 0x55842a5852f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c57fff640 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55842a584f10 0x55842a5852f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9ac36a7abc344be server_cookie=35588ffd3d4911cc in_seq=0 out_seq=0 2023-12-18T10:18:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 10 client.4425 ms_handle_connect on v2:172.21.15.142:6833/229940980 2023-12-18T10:18:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/2325147968 <== mds.0 v2:172.21.15.142:6833/229940980 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55842a381a30 con 0x55842a584f10 2023-12-18T10:18:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 10 client.4425 handle_command_reply: tid=0 2023-12-18T10:18:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 client.4425 shutdown 2023-12-18T10:18:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 -- 172.21.15.133:0/2325147968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 msgr2=0x55842a582b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a582b00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4c500157c0 tx=0x7f4c500046d0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 -- 172.21.15.133:0/2325147968 shutdown_connections 2023-12-18T10:18:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55842a584f10 0x55842a5852f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a583be0 0x55842a584500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5832c0 0x55842a583fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c3e7fc640 0 client.4425 ms_handle_reset on v2:172.21.15.142:6833/229940980 2023-12-18T10:18:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 --2- 172.21.15.133:0/2325147968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a582b00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 -- 172.21.15.133:0/2325147968 >> 172.21.15.133:0/2325147968 conn(0x55842a53b950 msgr2=0x55842a532cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 -- 172.21.15.133:0/2325147968 shutdown_connections 2023-12-18T10:18:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 1 -- 172.21.15.133:0/2325147968 wait complete. 2023-12-18T10:18:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.334+0000 7f4c68d27000 20 client.4425 trim_cache size 0 max 16384 2023-12-18T10:18:12.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c68d27000 1 Processor -- start 2023-12-18T10:18:12.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c68d27000 1 -- start start 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a53b950 0x55842a5de330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5395d0 0x55842a5de870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 0x55842a5dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c68d27000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842a040940 con 0x55842a53b950 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c68d27000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842a32b860 con 0x55842a5832c0 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c68d27000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55842a3804e0 con 0x55842a5395d0 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a53b950 0x55842a5de330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a53b950 0x55842a5de330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41302/0 (socket says 172.21.15.133:41302) 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 -- 172.21.15.133:0/429729239 learned_addr learned my addr 172.21.15.133:0/429729239 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 -- 172.21.15.133:0/429729239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5395d0 msgr2=0x55842a5de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 --2- 172.21.15.133:0/429729239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5395d0 0x55842a5de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 -- 172.21.15.133:0/429729239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 msgr2=0x55842a5dedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 --2- 172.21.15.133:0/429729239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 0x55842a5dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 -- 172.21.15.133:0/429729239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55842a32e3b0 con 0x55842a53b950 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c5effd640 1 --2- 172.21.15.133:0/429729239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a53b950 0x55842a5de330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c50010db0 tx=0x7f4c50023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2603450aa980b1c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c55ffb640 1 -- 172.21.15.133:0/429729239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500167f0 con 0x55842a53b950 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c55ffb640 1 -- 172.21.15.133:0/429729239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50022d40 con 0x55842a53b950 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.350+0000 7f4c55ffb640 1 -- 172.21.15.133:0/429729239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500223f0 con 0x55842a53b950 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- 172.21.15.133:0/429729239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a53b950 msgr2=0x55842a5de330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 --2- 172.21.15.133:0/429729239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a53b950 0x55842a5de330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c50010db0 tx=0x7f4c50023000 comp rx=0 tx=0).stop 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- 172.21.15.133:0/429729239 shutdown_connections 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 --2- 172.21.15.133:0/429729239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 0x55842a5dedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 --2- 172.21.15.133:0/429729239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a5395d0 0x55842a5de870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 --2- 172.21.15.133:0/429729239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a53b950 0x55842a5de330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- 172.21.15.133:0/429729239 >> 172.21.15.133:0/429729239 conn(0x55842a5900d0 msgr2=0x55842a540f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:12.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- 172.21.15.133:0/429729239 shutdown_connections 2023-12-18T10:18:12.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- 172.21.15.133:0/429729239 wait complete. 2023-12-18T10:18:12.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- start start 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 Processor -- start 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a5e3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a53b950 0x55842a5e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 0x55842a5366d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842a38a220 con 0x55842a5395d0 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55842a3870e0 con 0x55842a5832c0 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55842a3877f0 con 0x55842a53b950 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 10 client.0 _ll_register_callbacks cb 0x55842a331640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a5e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a5e3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41304/0 (socket says 172.21.15.133:41304) 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 -- 172.21.15.133:0/3773432869 learned_addr learned my addr 172.21.15.133:0/3773432869 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c57fff640 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a53b950 0x55842a5e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5f7fe640 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 0x55842a5366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 -- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a53b950 msgr2=0x55842a5e3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a53b950 0x55842a5e3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 -- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 msgr2=0x55842a5366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 0x55842a5366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 -- 172.21.15.133:0/3773432869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55842a348260 con 0x55842a5395d0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c5effd640 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a5e3980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c50010ff0 tx=0x7f4c50022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4f4a1077d33e87 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/3773432869 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500167f0 con 0x55842a5395d0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/3773432869 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c50015e00 con 0x55842a5395d0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.354+0000 7f4c68d27000 1 -- 172.21.15.133:0/3773432869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55842a348e00 con 0x55842a5395d0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/3773432869 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c50022600 con 0x55842a5395d0 2023-12-18T10:18:12.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 10 client.4431 fetch_fsmap learned FSMap version 7 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 -- 172.21.15.133:0/3773432869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55842a07fcc0 con 0x55842a5395d0 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/3773432869 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55842a348e00 con 0x55842a5395d0 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/3773432869 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f4c50016bb0 con 0x55842a5395d0 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 10 client.4431 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 20 client.4431 populate_metadata read hostname 'smithi133' 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55842a583be0 0x55842a536c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 4 client.4431 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 -- 172.21.15.133:0/3773432869 --> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55842a37c160 con 0x55842a583be0 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c57fff640 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55842a583be0 0x55842a536c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c57fff640 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55842a583be0 0x55842a536c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adf20d64a4d50c2a server_cookie=400d855eef29311d in_seq=0 out_seq=0 2023-12-18T10:18:12.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c3e7fc640 10 client.4431 ms_handle_connect on v2:172.21.15.142:6833/229940980 2023-12-18T10:18:12.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c3e7fc640 1 -- 172.21.15.133:0/3773432869 <== mds.0 v2:172.21.15.142:6833/229940980 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55842a37c160 con 0x55842a583be0 2023-12-18T10:18:12.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c3e7fc640 10 client.4431 handle_command_reply: tid=0 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 client.4431 shutdown 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 -- 172.21.15.133:0/3773432869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 msgr2=0x55842a5e3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a5e3980 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c50010ff0 tx=0x7f4c50022000 comp rx=0 tx=0).stop 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 -- 172.21.15.133:0/3773432869 shutdown_connections 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55842a583be0 0x55842a536c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55842a5832c0 0x55842a5366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55842a53b950 0x55842a5e3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 --2- 172.21.15.133:0/3773432869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55842a5395d0 0x55842a5e3980 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c3e7fc640 0 client.4431 ms_handle_reset on v2:172.21.15.142:6833/229940980 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 -- 172.21.15.133:0/3773432869 >> 172.21.15.133:0/3773432869 conn(0x55842a5900d0 msgr2=0x55842a5399b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 -- 172.21.15.133:0/3773432869 shutdown_connections 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 1 -- 172.21.15.133:0/3773432869 wait complete. 2023-12-18T10:18:12.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c68d27000 20 client.4431 trim_cache size 0 max 16384 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4288, 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 6.755085931, 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 7, 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 24, 2023-12-18T10:18:12.369 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 23, 2023-12-18T10:18:12.370 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 13.683132389000001 2023-12-18T10:18:12.370 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:18:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 -- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c40065a60 msgr2=0x7f4c40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c40065a60 0x7f4c40067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c50009970 tx=0x7f4c50008040 comp rx=0 tx=0).stop 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 -- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6015a680 msgr2=0x7f4c60157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6015a680 0x7f4c60157140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4c4801cd10 tx=0x7f4c48019210 comp rx=0 tx=0).stop 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 -- 172.21.15.133:0/1149028668 shutdown_connections 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c40065a60 0x7f4c40067f20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c6015afa0 0x7f4c60148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c6015a680 0x7f4c60157140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 --2- 172.21.15.133:0/1149028668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c600cac10 0x7f4c600c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 -- 172.21.15.133:0/1149028668 >> 172.21.15.133:0/1149028668 conn(0x7f4c6006a3e0 msgr2=0x7f4c6015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 -- 172.21.15.133:0/1149028668 shutdown_connections 2023-12-18T10:18:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.358+0000 7f4c659b3640 1 -- 172.21.15.133:0/1149028668 wait complete. 2023-12-18T10:18:12.384 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-18T10:18:12.384 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-18T10:18:12.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:18:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.514+0000 7f3bfeda2640 1 Processor -- start 2023-12-18T10:18:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.514+0000 7f3bfeda2640 1 -- start start 2023-12-18T10:18:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfeda2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf80ce400 0x7f3bf81601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfeda2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf8160700 0x7f3bf80ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfeda2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf8160ba0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfeda2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf8161160 con 0x7f3bf8160700 2023-12-18T10:18:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfeda2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8160e80 con 0x7f3bf80ce400 2023-12-18T10:18:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfd59f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf8160700 0x7f3bf80ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfd59f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf8160700 0x7f3bf80ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41318/0 (socket says 172.21.15.133:41318) 2023-12-18T10:18:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfd59f640 1 -- 172.21.15.133:0/2589720073 learned_addr learned my addr 172.21.15.133:0/2589720073 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:12.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfdda0640 1 --2- 172.21.15.133:0/2589720073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf80ce400 0x7f3bf81601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfd59f640 1 -- 172.21.15.133:0/2589720073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf80ce400 msgr2=0x7f3bf81601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfd59f640 1 --2- 172.21.15.133:0/2589720073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf80ce400 0x7f3bf81601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfd59f640 1 -- 172.21.15.133:0/2589720073 >> v1:172.21.15.142:6789/0 conn(0x7f3bf80ce7e0 legacy=0x7f3bf80d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:12.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.518+0000 7f3bfd59f640 1 -- 172.21.15.133:0/2589720073 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf806af50 con 0x7f3bf8160700 2023-12-18T10:18:12.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfd59f640 1 --2- 172.21.15.133:0/2589720073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf8160700 0x7f3bf80ccd70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009870 tx=0x7f3be801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41a1f9b6dbd81f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfcd9e640 1 -- 172.21.15.133:0/2589720073 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80ab620 con 0x7f3bf8160700 2023-12-18T10:18:12.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfcd9e640 1 -- 172.21.15.133:0/2589720073 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be80ab780 con 0x7f3bf8160700 2023-12-18T10:18:12.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfcd9e640 1 -- 172.21.15.133:0/2589720073 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80abb10 con 0x7f3bf8160700 2023-12-18T10:18:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 -- 172.21.15.133:0/2589720073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf8160700 msgr2=0x7f3bf80ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/2589720073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf8160700 0x7f3bf80ccd70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009870 tx=0x7f3be801c440 comp rx=0 tx=0).stop 2023-12-18T10:18:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 -- 172.21.15.133:0/2589720073 shutdown_connections 2023-12-18T10:18:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/2589720073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf8160700 0x7f3bf80ccd70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/2589720073 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf80ce400 0x7f3bf81601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 -- 172.21.15.133:0/2589720073 >> 172.21.15.133:0/2589720073 conn(0x7f3bf8069ca0 msgr2=0x7f3bf806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 -- 172.21.15.133:0/2589720073 shutdown_connections 2023-12-18T10:18:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 -- 172.21.15.133:0/2589720073 wait complete. 2023-12-18T10:18:12.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 Processor -- start 2023-12-18T10:18:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 -- start start 2023-12-18T10:18:12.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.522+0000 7f3bfeda2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf80ce400 0x7f3bf8158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfeda2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf80ce7e0 0x7f3bf80ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfeda2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf8160700 0x7f3bf815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfeda2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf815fbd0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfeda2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8158d70 con 0x7f3bf80ce400 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfeda2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf81586d0 con 0x7f3bf8160700 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf80ce7e0 0x7f3bf80ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf80ce7e0 0x7f3bf80ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41332/0 (socket says 172.21.15.133:41332) 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 -- 172.21.15.133:0/1809150673 learned_addr learned my addr 172.21.15.133:0/1809150673 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfdda0640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf80ce400 0x7f3bf8158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfe5a1640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf8160700 0x7f3bf815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 -- 172.21.15.133:0/1809150673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf8160700 msgr2=0x7f3bf815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf8160700 0x7f3bf815ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 -- 172.21.15.133:0/1809150673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf80ce400 msgr2=0x7f3bf8158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf80ce400 0x7f3bf8158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 -- 172.21.15.133:0/1809150673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80094d0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfd59f640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf80ce7e0 0x7f3bf80ab8a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3be80ad040 tx=0x7f3be801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bee7fc640 1 -- 172.21.15.133:0/1809150673 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80be3f0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bee7fc640 1 -- 172.21.15.133:0/1809150673 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be80be550 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bee7fc640 1 -- 172.21.15.133:0/1809150673 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80be900 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf8158a40 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf815f8f0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf81588a0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.526+0000 7f3bee7fc640 1 -- 172.21.15.133:0/1809150673 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3be80b43f0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.530+0000 7f3bee7fc640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3bdc065a90 0x7f3bdc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:12.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.530+0000 7f3bee7fc640 1 -- 172.21.15.133:0/1809150673 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3be811d7e0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.530+0000 7f3bfdda0640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3bdc065a90 0x7f3bdc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:12.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.530+0000 7f3bfdda0640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3bdc065a90 0x7f3bdc067f50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3bf81f89d0 tx=0x7f3bf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:12.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.534+0000 7f3bee7fc640 1 -- 172.21.15.133:0/1809150673 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3bf81588a0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3bf81588a0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bee7fc640 1 -- 172.21.15.133:0/1809150673 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3bf81588a0 con 0x7f3bf80ce7e0 2023-12-18T10:18:12.724 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3bdc065a90 msgr2=0x7f3bdc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3bdc065a90 0x7f3bdc067f50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3bf81f89d0 tx=0x7f3bf4008040 comp rx=0 tx=0).stop 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf80ce7e0 msgr2=0x7f3bf80ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf80ce7e0 0x7f3bf80ab8a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3be80ad040 tx=0x7f3be801ac80 comp rx=0 tx=0).stop 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 shutdown_connections 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3bdc065a90 0x7f3bdc067f50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf8160700 0x7f3bf815ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf80ce7e0 0x7f3bf80ab8a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 --2- 172.21.15.133:0/1809150673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf80ce400 0x7f3bf8158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 >> 172.21.15.133:0/1809150673 conn(0x7f3bf8069ca0 msgr2=0x7f3bf806b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 shutdown_connections 2023-12-18T10:18:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:12.718+0000 7f3bfeda2640 1 -- 172.21.15.133:0/1809150673 wait complete. 2023-12-18T10:18:12.744 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-18T10:18:12.744 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:18:12.744 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:18:12.744 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-18T10:18:12.744 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-18T10:18:12.744 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-18T10:18:12.744 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:18:12.744 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:18:12.745 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-18T10:18:12.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:12.745 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:18:12.754 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42143sec preferred_lft 42143sec 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:18:12.755 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:12.756 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-18T10:18:12.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:12.757 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:12.757 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:12.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2023-12-18T10:18:12.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2023-12-18T10:18:12.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2023-12-18T10:18:12.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-18T10:18:12.757 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:12.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:12.874 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:18:12.893 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:18:12.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:12.896 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:12.985 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:18:12.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:12.986 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:12.986 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:12.986 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:18:12.986 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:18:12.986 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:18:12.986 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:13.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:13.077 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:18:13.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:13.087 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-12-18T10:18:13.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:13.139 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:13.139 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:13.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-18T10:18:13.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-18T10:18:13.139 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:13.226 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-18T10:18:13.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:13.227 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:13.227 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:13.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-18T10:18:13.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-18T10:18:13.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-18T10:18:13.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-18T10:18:13.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-18T10:18:13.227 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:13.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:13.391 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:13.391 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:13.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-18T10:18:13.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2023-12-18T10:18:13.391 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:13.431 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-18T10:18:13.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:13.431 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-18T10:18:13.487 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-18T10:18:13.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:13.487 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-18T10:18:13.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:18:13.603 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:13.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:13.671 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:13.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:13.671 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:18:13.722 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:18:13.722 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-18T10:18:13.769 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:18:13.791 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:13.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:13.857 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:13.859 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:13.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:13.859 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:18:13.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi133.stderr:2023-12-18T10:18:13.866+0000 7f16a1055580 -1 init, newargv = 0x55ec24bc69f0 newargc=15 2023-12-18T10:18:13.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi133.stderr:ceph-fuse[44428]: starting ceph client 2023-12-18T10:18:13.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi133.stderr:ceph-fuse[44428]: starting fuse 2023-12-18T10:18:14.984 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:18:15.008 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:15.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:15.074 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:15.076 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:15.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:15.076 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:18:15.131 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:18:15.132 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:15.132 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.admin")) 2023-12-18T10:18:15.133 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:18:15.260 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.admin.44428.asok 2023-12-18T10:18:15.443 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44428.asok 2023-12-18T10:18:15.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:15.444 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44428.asok status 2023-12-18T10:18:15.619 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:18:15.619 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:18:15.619 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:18:15.619 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:18:15.619 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "admin", 2023-12-18T10:18:15.619 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "44428", 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4443, 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 4443 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:15.620 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 166594752 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 166594752 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.4443 192.168.0.1:0/166594752", 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/166594752", 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 7, 2023-12-18T10:18:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 24, 2023-12-18T10:18:15.622 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:18:15.622 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:18:15.622 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:18:15.622 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:18:15.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:15.635 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:18:15.635 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-18T10:18:15.646 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:18:15.646 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-18T10:18:15.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:15.646 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-18T10:18:15.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:15.712 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-18T10:18:15.809 INFO:teuthology.orchestra.run.smithi133.stdout:# file: . 2023-12-18T10:18:15.809 INFO:teuthology.orchestra.run.smithi133.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-18T10:18:15.809 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:15.810 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:18:15.810 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:18:15.819 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:15.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a43466640 1 Processor -- start 2023-12-18T10:18:15.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a43466640 1 -- start start 2023-12-18T10:18:16.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a43466640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a43466640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5a3c06c270 0x7f5a3c0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a43466640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c070b20 con 0x7f5a3c0b02c0 2023-12-18T10:18:16.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a43466640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c070d70 con 0x7f5a3c06c270 2023-12-18T10:18:16.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a43466640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c071050 con 0x7f5a3c15cd30 2023-12-18T10:18:16.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a41a03640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5a3c0b02c0 0x7f5a3c1606e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55152/0 (socket says 172.21.15.133:55152) 2023-12-18T10:18:16.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a41a03640 1 -- 172.21.15.133:0/2517518495 learned_addr learned my addr 172.21.15.133:0/2517518495 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:16.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a40a01640 1 --2- 172.21.15.133:0/2517518495 >> v2:172.21.15.133:3300/0 conn(0x7f5a3c06c270 0x7f5a3c0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a41202640 1 --2- 172.21.15.133:0/2517518495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a33fff640 1 -- 172.21.15.133:0/2517518495 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406659414 0 0) 0x7f5a3c070b20 con 0x7f5a3c0b02c0 2023-12-18T10:18:16.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a33fff640 1 -- 172.21.15.133:0/2517518495 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a28003530 con 0x7f5a3c0b02c0 2023-12-18T10:18:16.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a40a01640 1 -- 172.21.15.133:0/2517518495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 msgr2=0x7f5a3c0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:16.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a40a01640 1 --2- 172.21.15.133:0/2517518495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c0cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a40a01640 1 -- 172.21.15.133:0/2517518495 >> v1:172.21.15.133:6789/0 conn(0x7f5a3c0b02c0 legacy=0x7f5a3c1606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.994+0000 7f5a40a01640 1 -- 172.21.15.133:0/2517518495 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c0c9180 con 0x7f5a3c06c270 2023-12-18T10:18:16.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a40a01640 1 --2- 172.21.15.133:0/2517518495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c0ccd10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0097c0 tx=0x7f5a2c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6006028cd6688c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a33fff640 1 -- 172.21.15.133:0/2517518495 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0ab600 con 0x7f5a3c06c270 2023-12-18T10:18:16.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a33fff640 1 -- 172.21.15.133:0/2517518495 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c0a7050 con 0x7f5a3c06c270 2023-12-18T10:18:16.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a33fff640 1 -- 172.21.15.133:0/2517518495 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c0ab980 con 0x7f5a3c06c270 2023-12-18T10:18:16.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a43466640 1 -- 172.21.15.133:0/2517518495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 msgr2=0x7f5a3c0ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a43466640 1 --2- 172.21.15.133:0/2517518495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c0ccd10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0097c0 tx=0x7f5a2c01c3f0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a43466640 1 -- 172.21.15.133:0/2517518495 shutdown_connections 2023-12-18T10:18:16.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a43466640 1 --2- 172.21.15.133:0/2517518495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c0ccd10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a43466640 1 --2- 172.21.15.133:0/2517518495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a43466640 1 -- 172.21.15.133:0/2517518495 >> 172.21.15.133:0/2517518495 conn(0x7f5a3c0ce7c0 msgr2=0x7f5a3c0cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:16.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a43466640 1 -- 172.21.15.133:0/2517518495 shutdown_connections 2023-12-18T10:18:16.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:15.998+0000 7f5a43466640 1 -- 172.21.15.133:0/2517518495 wait complete. 2023-12-18T10:18:16.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 Processor -- start 2023-12-18T10:18:16.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 -- start start 2023-12-18T10:18:16.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3c0b02c0 0x7f5a3c159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c15d1a0 con 0x7f5a3c06c270 2023-12-18T10:18:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c15da40 con 0x7f5a3c0b02c0 2023-12-18T10:18:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0c8a10 con 0x7f5a3c15cd30 2023-12-18T10:18:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c1530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41350/0 (socket says 172.21.15.133:41350) 2023-12-18T10:18:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 -- 172.21.15.133:0/2078668902 learned_addr learned my addr 172.21.15.133:0/2078668902 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41a03640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a40a01640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3c0b02c0 0x7f5a3c159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 -- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 msgr2=0x7f5a3c15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 -- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3c0b02c0 msgr2=0x7f5a3c159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3c0b02c0 0x7f5a3c159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 -- 172.21.15.133:0/2078668902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009420 con 0x7f5a3c06c270 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41a03640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a40a01640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3c0b02c0 0x7f5a3c159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a41202640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c1530b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800e960 tx=0x7f5a3800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a31ffb640 1 -- 172.21.15.133:0/2078668902 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38009690 con 0x7f5a3c06c270 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a31ffb640 1 -- 172.21.15.133:0/2078668902 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800c9a0 con 0x7f5a3c06c270 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a31ffb640 1 -- 172.21.15.133:0/2078668902 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800cd10 con 0x7f5a3c06c270 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c15d3f0 con 0x7f5a3c06c270 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c1535f0 con 0x7f5a3c06c270 2023-12-18T10:18:16.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.002+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c04e000 con 0x7f5a3c06c270 2023-12-18T10:18:16.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.006+0000 7f5a31ffb640 1 -- 172.21.15.133:0/2078668902 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a38013470 con 0x7f5a3c06c270 2023-12-18T10:18:16.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.006+0000 7f5a31ffb640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a20065a60 0x7f5a20067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.006+0000 7f5a31ffb640 1 -- 172.21.15.133:0/2078668902 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a38083a60 con 0x7f5a3c06c270 2023-12-18T10:18:16.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.006+0000 7f5a40a01640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a20065a60 0x7f5a20067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.006+0000 7f5a40a01640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a20065a60 0x7f5a20067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0ad000 tx=0x7f5a2c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.010+0000 7f5a31ffb640 1 -- 172.21.15.133:0/2078668902 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5a38051120 con 0x7f5a3c06c270 2023-12-18T10:18:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.162+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a3c0ccaf0 con 0x7f5a3c06c270 2023-12-18T10:18:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.162+0000 7f5a31ffb640 1 -- 172.21.15.133:0/2078668902 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f5a38017090 con 0x7f5a3c06c270 2023-12-18T10:18:16.170 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:16.171 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a20065a60 msgr2=0x7f5a20067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a20065a60 0x7f5a20067f20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0ad000 tx=0x7f5a2c0a6000 comp rx=0 tx=0).stop 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 msgr2=0x7f5a3c1530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c1530b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800e960 tx=0x7f5a3800ee20 comp rx=0 tx=0).stop 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 shutdown_connections 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a20065a60 0x7f5a20067f20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a3c15cd30 0x7f5a3c15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3c0b02c0 0x7f5a3c159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 --2- 172.21.15.133:0/2078668902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a3c06c270 0x7f5a3c1530b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 >> 172.21.15.133:0/2078668902 conn(0x7f5a3c0ce7c0 msgr2=0x7f5a3c06c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 shutdown_connections 2023-12-18T10:18:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.166+0000 7f5a43466640 1 -- 172.21.15.133:0/2078668902 wait complete. 2023-12-18T10:18:16.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:16.192 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:16.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7eaa2fc640 1 Processor -- start 2023-12-18T10:18:16.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7eaa2fc640 1 -- start start 2023-12-18T10:18:16.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7eaa2fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ea415cae0 0x7f7ea40d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7eaa2fc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea415cec0 con 0x7f7ea40cf880 2023-12-18T10:18:16.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7eaa2fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea40d0530 con 0x7f7ea40cde90 2023-12-18T10:18:16.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7eaa2fc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea40d0810 con 0x7f7ea415cae0 2023-12-18T10:18:16.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7ea3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ea415cae0 0x7f7ea40d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7ea8899640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7ea40cf880 0x7f7ea406add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55166/0 (socket says 172.21.15.133:55166) 2023-12-18T10:18:16.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7ea3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ea415cae0 0x7f7ea40d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41364/0 (socket says 172.21.15.133:41364) 2023-12-18T10:18:16.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7ea8899640 1 -- 172.21.15.133:0/1976979319 learned_addr learned my addr 172.21.15.133:0/1976979319 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:16.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7ea3fff640 1 -- 172.21.15.133:0/1976979319 >> v1:172.21.15.142:6789/0 conn(0x7f7ea40cde90 legacy=0x7f7ea40cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:16.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7ea3fff640 1 -- 172.21.15.133:0/1976979319 >> v1:172.21.15.133:6789/0 conn(0x7f7ea40cf880 legacy=0x7f7ea406add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7ea2ffd640 1 -- 172.21.15.133:0/1976979319 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164556241 0 0) 0x7f7ea415cec0 con 0x7f7ea40cf880 2023-12-18T10:18:16.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.326+0000 7f7ea3fff640 1 -- 172.21.15.133:0/1976979319 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea40d0af0 con 0x7f7ea415cae0 2023-12-18T10:18:16.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7ea3fff640 1 --2- 172.21.15.133:0/1976979319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea415cae0 0x7f7ea40d12f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e940097a0 tx=0x7f7e9401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dd4a6c570e7c0d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7ea2ffd640 1 -- 172.21.15.133:0/1976979319 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940ab600 con 0x7f7ea415cae0 2023-12-18T10:18:16.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7ea2ffd640 1 -- 172.21.15.133:0/1976979319 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e940a7050 con 0x7f7ea415cae0 2023-12-18T10:18:16.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7ea2ffd640 1 -- 172.21.15.133:0/1976979319 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940ab980 con 0x7f7ea415cae0 2023-12-18T10:18:16.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/1976979319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea415cae0 msgr2=0x7f7ea40d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7eaa2fc640 1 --2- 172.21.15.133:0/1976979319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea415cae0 0x7f7ea40d12f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e940097a0 tx=0x7f7e9401c3f0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/1976979319 shutdown_connections 2023-12-18T10:18:16.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7eaa2fc640 1 --2- 172.21.15.133:0/1976979319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea415cae0 0x7f7ea40d12f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/1976979319 >> 172.21.15.133:0/1976979319 conn(0x7f7ea4089fb0 msgr2=0x7f7ea40d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/1976979319 shutdown_connections 2023-12-18T10:18:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.330+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/1976979319 wait complete. 2023-12-18T10:18:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 Processor -- start 2023-12-18T10:18:16.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 -- start start 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea40cde90 0x7f7ea415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea40cf880 0x7f7ea413e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea415cae0 0x7f7ea413eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea40c66d0 con 0x7f7ea40cde90 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea40c69b0 con 0x7f7ea415cae0 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea415dbb0 con 0x7f7ea40cf880 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea40cde90 0x7f7ea415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea40cde90 0x7f7ea415e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41370/0 (socket says 172.21.15.133:41370) 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 -- 172.21.15.133:0/3709644576 learned_addr learned my addr 172.21.15.133:0/3709644576 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:16.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea37fe640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea40cf880 0x7f7ea413e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea8899640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea415cae0 0x7f7ea413eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 -- 172.21.15.133:0/3709644576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea40cf880 msgr2=0x7f7ea413e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea40cf880 0x7f7ea413e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 -- 172.21.15.133:0/3709644576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea415cae0 msgr2=0x7f7ea413eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea415cae0 0x7f7ea413eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 -- 172.21.15.133:0/3709644576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940093b0 con 0x7f7ea40cde90 2023-12-18T10:18:16.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea3fff640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea40cde90 0x7f7ea415e3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e9401a020 tx=0x7f7e9401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea0ff9640 1 -- 172.21.15.133:0/3709644576 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94005ba0 con 0x7f7ea40cde90 2023-12-18T10:18:16.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea0ff9640 1 -- 172.21.15.133:0/3709644576 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e94005d00 con 0x7f7ea40cde90 2023-12-18T10:18:16.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea415de90 con 0x7f7ea40cde90 2023-12-18T10:18:16.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7ea0ff9640 1 -- 172.21.15.133:0/3709644576 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94004220 con 0x7f7ea40cde90 2023-12-18T10:18:16.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.334+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea413f070 con 0x7f7ea40cde90 2023-12-18T10:18:16.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.338+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea415e0b0 con 0x7f7ea40cde90 2023-12-18T10:18:16.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.338+0000 7f7ea0ff9640 1 -- 172.21.15.133:0/3709644576 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e94004380 con 0x7f7ea40cde90 2023-12-18T10:18:16.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.338+0000 7f7ea0ff9640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e90065a60 0x7f7e90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.338+0000 7f7ea0ff9640 1 -- 172.21.15.133:0/3709644576 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e9411d060 con 0x7f7ea40cde90 2023-12-18T10:18:16.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.338+0000 7f7ea37fe640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e90065a60 0x7f7e90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.338+0000 7f7ea37fe640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e90065a60 0x7f7e90067f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7ea413e4c0 tx=0x7f7e98007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.342+0000 7f7ea0ff9640 1 -- 172.21.15.133:0/3709644576 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7e940ea740 con 0x7f7ea40cde90 2023-12-18T10:18:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.494+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ea404e000 con 0x7f7ea40cde90 2023-12-18T10:18:16.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.494+0000 7f7ea0ff9640 1 -- 172.21.15.133:0/3709644576 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e940b00a0 con 0x7f7ea40cde90 2023-12-18T10:18:16.502 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e90065a60 msgr2=0x7f7e90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e90065a60 0x7f7e90067f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7ea413e4c0 tx=0x7f7e98007e40 comp rx=0 tx=0).stop 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea40cde90 msgr2=0x7f7ea415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea40cde90 0x7f7ea415e3b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e9401a020 tx=0x7f7e9401ac30 comp rx=0 tx=0).stop 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 shutdown_connections 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e90065a60 0x7f7e90067f20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ea415cae0 0x7f7ea413eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ea40cf880 0x7f7ea413e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 --2- 172.21.15.133:0/3709644576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ea40cde90 0x7f7ea415e3b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 >> 172.21.15.133:0/3709644576 conn(0x7f7ea4089fb0 msgr2=0x7f7ea40b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 shutdown_connections 2023-12-18T10:18:16.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.498+0000 7f7eaa2fc640 1 -- 172.21.15.133:0/3709644576 wait complete. 2023-12-18T10:18:16.522 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:16.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc44ac8c640 1 Processor -- start 2023-12-18T10:18:16.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc44ac8c640 1 -- start start 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc44ac8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc4440cc700 0x7fc444071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc44ac8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc444070df0 con 0x7fc4440ca410 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc44ac8c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc44415a4f0 con 0x7fc444071870 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc44ac8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44415aab0 con 0x7fc4440cc700 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc448a28640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc4440ca410 0x7fc444159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55178/0 (socket says 172.21.15.133:55178) 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc448a28640 1 -- 172.21.15.133:0/2473666968 learned_addr learned my addr 172.21.15.133:0/2473666968 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc449229640 1 --2- 172.21.15.133:0/2473666968 >> v2:172.21.15.142:3300/0 conn(0x7fc4440cc700 0x7fc444071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc4437fe640 1 -- 172.21.15.133:0/2473666968 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544277309 0 0) 0x7fc444070df0 con 0x7fc4440ca410 2023-12-18T10:18:16.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc4437fe640 1 -- 172.21.15.133:0/2473666968 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc434003530 con 0x7fc4440ca410 2023-12-18T10:18:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc4437fe640 1 -- 172.21.15.133:0/2473666968 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891524649 0 0) 0x7fc44415a4f0 con 0x7fc444071870 2023-12-18T10:18:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc4437fe640 1 -- 172.21.15.133:0/2473666968 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc444070df0 con 0x7fc444071870 2023-12-18T10:18:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc4437fe640 1 -- 172.21.15.133:0/2473666968 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578295260 0 0) 0x7fc434003530 con 0x7fc4440ca410 2023-12-18T10:18:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc449229640 1 -- 172.21.15.133:0/2473666968 >> v1:172.21.15.142:6789/0 conn(0x7fc444071870 legacy=0x7fc4440cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc449229640 1 -- 172.21.15.133:0/2473666968 >> v1:172.21.15.133:6789/0 conn(0x7fc4440ca410 legacy=0x7fc444159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.658+0000 7fc449229640 1 -- 172.21.15.133:0/2473666968 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44415a7d0 con 0x7fc4440cc700 2023-12-18T10:18:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc449229640 1 --2- 172.21.15.133:0/2473666968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4440cc700 0x7fc444071d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009d90 tx=0x7fc43c01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6275e96ad06911 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc4437fe640 1 -- 172.21.15.133:0/2473666968 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438001680 con 0x7fc4440cc700 2023-12-18T10:18:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc4437fe640 1 -- 172.21.15.133:0/2473666968 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c0a5680 con 0x7fc4440cc700 2023-12-18T10:18:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc4437fe640 1 -- 172.21.15.133:0/2473666968 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43c0a59f0 con 0x7fc4440cc700 2023-12-18T10:18:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc44ac8c640 1 -- 172.21.15.133:0/2473666968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4440cc700 msgr2=0x7fc444071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc44ac8c640 1 --2- 172.21.15.133:0/2473666968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4440cc700 0x7fc444071d00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009d90 tx=0x7fc43c01c840 comp rx=0 tx=0).stop 2023-12-18T10:18:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc44ac8c640 1 -- 172.21.15.133:0/2473666968 shutdown_connections 2023-12-18T10:18:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc44ac8c640 1 --2- 172.21.15.133:0/2473666968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4440cc700 0x7fc444071d00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc44ac8c640 1 -- 172.21.15.133:0/2473666968 >> 172.21.15.133:0/2473666968 conn(0x7fc44406a2a0 msgr2=0x7fc4440aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc44ac8c640 1 -- 172.21.15.133:0/2473666968 shutdown_connections 2023-12-18T10:18:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.662+0000 7fc44ac8c640 1 -- 172.21.15.133:0/2473666968 wait complete. 2023-12-18T10:18:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 Processor -- start 2023-12-18T10:18:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 -- start start 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc444071870 0x7fc4441428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4440ca410 0x7fc4440c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc444150980 0x7fc444151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4441f87f0 con 0x7fc4440ca410 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc444153b70 con 0x7fc444071870 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4441f7be0 con 0x7fc444150980 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4440ca410 0x7fc4440c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4440ca410 0x7fc4440c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41386/0 (socket says 172.21.15.133:41386) 2023-12-18T10:18:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 -- 172.21.15.133:0/1675845640 learned_addr learned my addr 172.21.15.133:0/1675845640 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc448a28640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc444071870 0x7fc4441428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc449229640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc444150980 0x7fc444151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 -- 172.21.15.133:0/1675845640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc444150980 msgr2=0x7fc444151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc444150980 0x7fc444151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 -- 172.21.15.133:0/1675845640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc444071870 msgr2=0x7fc4441428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc444071870 0x7fc4441428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 -- 172.21.15.133:0/1675845640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c009a70 con 0x7fc4440ca410 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc443fff640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4440ca410 0x7fc4440c49e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c460 tx=0x7fc43000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc4417fa640 1 -- 172.21.15.133:0/1675845640 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4300052d0 con 0x7fc4440ca410 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc4417fa640 1 -- 172.21.15.133:0/1675845640 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430005450 con 0x7fc4440ca410 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4441f7e50 con 0x7fc4440ca410 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc4417fa640 1 -- 172.21.15.133:0/1675845640 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430003840 con 0x7fc4440ca410 2023-12-18T10:18:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.666+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4441f8410 con 0x7fc4440ca410 2023-12-18T10:18:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.670+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4441f8930 con 0x7fc4440ca410 2023-12-18T10:18:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.670+0000 7fc4417fa640 1 -- 172.21.15.133:0/1675845640 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc4300039a0 con 0x7fc4440ca410 2023-12-18T10:18:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.670+0000 7fc4417fa640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc428065a90 0x7fc428067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.670+0000 7fc4417fa640 1 -- 172.21.15.133:0/1675845640 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4300829d0 con 0x7fc4440ca410 2023-12-18T10:18:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.670+0000 7fc448a28640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc428065a90 0x7fc428067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.670+0000 7fc448a28640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc428065a90 0x7fc428067f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc438001ec0 tx=0x7fc438001a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.674+0000 7fc4417fa640 1 -- 172.21.15.133:0/1675845640 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc4441f8930 con 0x7fc4440ca410 2023-12-18T10:18:16.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.822+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4441f8930 con 0x7fc4440ca410 2023-12-18T10:18:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.822+0000 7fc4417fa640 1 -- 172.21.15.133:0/1675845640 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4441f8930 con 0x7fc4440ca410 2023-12-18T10:18:16.831 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc428065a90 msgr2=0x7fc428067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc428065a90 0x7fc428067f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc438001ec0 tx=0x7fc438001a60 comp rx=0 tx=0).stop 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4440ca410 msgr2=0x7fc4440c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4440ca410 0x7fc4440c49e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c460 tx=0x7fc43000c920 comp rx=0 tx=0).stop 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 shutdown_connections 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc428065a90 0x7fc428067f50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc444150980 0x7fc444151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4440ca410 0x7fc4440c49e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 --2- 172.21.15.133:0/1675845640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc444071870 0x7fc4441428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 >> 172.21.15.133:0/1675845640 conn(0x7fc44406a2a0 msgr2=0x7fc4441569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 shutdown_connections 2023-12-18T10:18:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.826+0000 7fc44ac8c640 1 -- 172.21.15.133:0/1675845640 wait complete. 2023-12-18T10:18:16.851 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:16.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a42c95640 1 Processor -- start 2023-12-18T10:18:16.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a42c95640 1 -- start start 2023-12-18T10:18:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a42c95640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a3c0cb740 0x7f2a3c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a42c95640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c071dc0 con 0x7f2a3c15a5b0 2023-12-18T10:18:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a42c95640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c0cdf10 con 0x7f2a3c06d390 2023-12-18T10:18:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a42c95640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c071800 con 0x7f2a3c0cb740 2023-12-18T10:18:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a33fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a3c0cb740 0x7f2a3c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a40a31640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2a3c15a5b0 0x7f2a3c0b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55188/0 (socket says 172.21.15.133:55188) 2023-12-18T10:18:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a40a31640 1 -- 172.21.15.133:0/2375347528 learned_addr learned my addr 172.21.15.133:0/2375347528 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a33fff640 1 -- 172.21.15.133:0/2375347528 >> v1:172.21.15.142:6789/0 conn(0x7f2a3c06d390 legacy=0x7f2a3c06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a33fff640 1 -- 172.21.15.133:0/2375347528 >> v1:172.21.15.133:6789/0 conn(0x7f2a3c15a5b0 legacy=0x7f2a3c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.986+0000 7f2a33fff640 1 -- 172.21.15.133:0/2375347528 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c071ae0 con 0x7f2a3c0cb740 2023-12-18T10:18:16.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a33fff640 1 --2- 172.21.15.133:0/2375347528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0cb740 0x7f2a3c070f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097c0 tx=0x7f2a2c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68ab5157ec5c545 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:16.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a337fe640 1 -- 172.21.15.133:0/2375347528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0ad680 con 0x7f2a3c0cb740 2023-12-18T10:18:16.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a337fe640 1 -- 172.21.15.133:0/2375347528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0ad7e0 con 0x7f2a3c0cb740 2023-12-18T10:18:16.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a337fe640 1 -- 172.21.15.133:0/2375347528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0adb70 con 0x7f2a3c0cb740 2023-12-18T10:18:16.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a42c95640 1 -- 172.21.15.133:0/2375347528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0cb740 msgr2=0x7f2a3c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:16.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a42c95640 1 --2- 172.21.15.133:0/2375347528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0cb740 0x7f2a3c070f00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097c0 tx=0x7f2a2c01c380 comp rx=0 tx=0).stop 2023-12-18T10:18:16.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a42c95640 1 -- 172.21.15.133:0/2375347528 shutdown_connections 2023-12-18T10:18:16.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a42c95640 1 --2- 172.21.15.133:0/2375347528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0cb740 0x7f2a3c070f00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:16.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a42c95640 1 -- 172.21.15.133:0/2375347528 >> 172.21.15.133:0/2375347528 conn(0x7f2a3c06b1b0 msgr2=0x7f2a3c06b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:16.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a42c95640 1 -- 172.21.15.133:0/2375347528 shutdown_connections 2023-12-18T10:18:16.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.990+0000 7f2a42c95640 1 -- 172.21.15.133:0/2375347528 wait complete. 2023-12-18T10:18:16.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 Processor -- start 2023-12-18T10:18:16.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 -- start start 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a3c06d390 0x7f2a3c1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a3c0cb740 0x7f2a3c0c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15a5b0 0x7f2a3c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0b3040 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0b3320 con 0x7f2a3c0cb740 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0b3600 con 0x7f2a3c06d390 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15a5b0 0x7f2a3c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15a5b0 0x7f2a3c0c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41398/0 (socket says 172.21.15.133:41398) 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 -- 172.21.15.133:0/4145456172 learned_addr learned my addr 172.21.15.133:0/4145456172 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:17.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a33fff640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a3c0cb740 0x7f2a3c0c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a40a31640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a3c06d390 0x7f2a3c1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 -- 172.21.15.133:0/4145456172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a3c06d390 msgr2=0x7f2a3c1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a3c06d390 0x7f2a3c1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 -- 172.21.15.133:0/4145456172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a3c0cb740 msgr2=0x7f2a3c0c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a3c0cb740 0x7f2a3c0c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 -- 172.21.15.133:0/4145456172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009420 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a41232640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15a5b0 0x7f2a3c0c6ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c780 tx=0x7f2a3400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:17.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a317fa640 1 -- 172.21.15.133:0/4145456172 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34004b70 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a317fa640 1 -- 172.21.15.133:0/4145456172 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400ce90 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a317fa640 1 -- 172.21.15.133:0/4145456172 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400a850 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c0b38e0 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.994+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c151de0 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.998+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c04e000 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.998+0000 7f2a317fa640 1 -- 172.21.15.133:0/4145456172 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2a3400a9b0 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.998+0000 7f2a317fa640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a28065a60 0x7f2a28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.998+0000 7f2a317fa640 1 -- 172.21.15.133:0/4145456172 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a34083720 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.998+0000 7f2a40a31640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a28065a60 0x7f2a28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:16.998+0000 7f2a40a31640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a28065a60 0x7f2a28067f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a38005890 tx=0x7f2a38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:17.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.002+0000 7f2a317fa640 1 -- 172.21.15.133:0/4145456172 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2a34050d50 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a3c0b3d90 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a317fa640 1 -- 172.21.15.133:0/4145456172 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a34054370 con 0x7f2a3c15a5b0 2023-12-18T10:18:17.160 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:17.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a28065a60 msgr2=0x7f2a28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a28065a60 0x7f2a28067f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a38005890 tx=0x7f2a38009040 comp rx=0 tx=0).stop 2023-12-18T10:18:17.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15a5b0 msgr2=0x7f2a3c0c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15a5b0 0x7f2a3c0c6ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c780 tx=0x7f2a3400cc40 comp rx=0 tx=0).stop 2023-12-18T10:18:17.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 shutdown_connections 2023-12-18T10:18:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a28065a60 0x7f2a28067f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c15a5b0 0x7f2a3c0c6ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a3c0cb740 0x7f2a3c0c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 --2- 172.21.15.133:0/4145456172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2a3c06d390 0x7f2a3c1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 >> 172.21.15.133:0/4145456172 conn(0x7f2a3c06b1b0 msgr2=0x7f2a3c06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 shutdown_connections 2023-12-18T10:18:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.154+0000 7f2a42c95640 1 -- 172.21.15.133:0/4145456172 wait complete. 2023-12-18T10:18:17.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7132525640 1 Processor -- start 2023-12-18T10:18:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7132525640 1 -- start start 2023-12-18T10:18:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7132525640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f712c0adb30 0x7f712c0caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7132525640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c15daf0 0x7f712c15c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7132525640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c160860 con 0x7f712c0cb4c0 2023-12-18T10:18:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7132525640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c1611e0 con 0x7f712c0adb30 2023-12-18T10:18:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7132525640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c15e110 con 0x7f712c15daf0 2023-12-18T10:18:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f712c0cb4c0 0x7f712c15d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55204/0 (socket says 172.21.15.133:55204) 2023-12-18T10:18:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712b7fe640 1 -- 172.21.15.133:0/1941827422 learned_addr learned my addr 172.21.15.133:0/1941827422 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077033927 0 0) 0x7f712c160860 con 0x7f712c0cb4c0 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712bfff640 1 --2- 172.21.15.133:0/1941827422 >> v2:172.21.15.142:3300/0 conn(0x7f712c0adb30 0x7f712c0caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7114003530 con 0x7f712c0cb4c0 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7130ac2640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c15daf0 0x7f712c15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3892670390 0 0) 0x7f7114003530 con 0x7f712c0cb4c0 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c15daf0 msgr2=0x7f712c15c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c15daf0 0x7f712c15c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 >> v2:172.21.15.142:3300/0 conn(0x7f712c0adb30 msgr2=0x7f712c0caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 --2- 172.21.15.133:0/1941827422 >> v2:172.21.15.142:3300/0 conn(0x7f712c0adb30 0x7f712c0caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c160b20 con 0x7f712c0cb4c0 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f7120001680 con 0x7f712c0cb4c0 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 >> v1:172.21.15.133:6789/0 conn(0x7f712c0cb4c0 legacy=0x7f712c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f7114003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140047d0 0x7f7114004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c15daf0 0x7f7114005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c1611e0 con 0x7f7114003980 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c15e110 con 0x7f71140047d0 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711400b990 con 0x7f712c15daf0 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712bfff640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f7114003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712b7fe640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140047d0 0x7f7114004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f7130ac2640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c15daf0 0x7f7114005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712bfff640 1 -- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c15daf0 msgr2=0x7f7114005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712bfff640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c15daf0 0x7f7114005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712bfff640 1 -- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140047d0 msgr2=0x7f7114004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712bfff640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140047d0 0x7f7114004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712bfff640 1 -- 172.21.15.133:0/1941827422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114003530 con 0x7f7114003980 2023-12-18T10:18:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.318+0000 7f712b7fe640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71140047d0 0x7f7114004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f712bfff640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f7114003da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f711c009ae0 tx=0x7f711c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924385d2d5020991 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0a6470 con 0x7f7114003980 2023-12-18T10:18:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c0a65d0 con 0x7f7114003980 2023-12-18T10:18:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f712affd640 1 -- 172.21.15.133:0/1941827422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0a6980 con 0x7f7114003980 2023-12-18T10:18:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f7132525640 1 -- 172.21.15.133:0/1941827422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 msgr2=0x7f7114003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f7132525640 1 --2- 172.21.15.133:0/1941827422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f7114003da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f711c009ae0 tx=0x7f711c01ca60 comp rx=0 tx=0).stop 2023-12-18T10:18:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f7130ac2640 1 -- 172.21.15.133:0/1941827422 reap_dead start 2023-12-18T10:18:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f7132525640 1 -- 172.21.15.133:0/1941827422 shutdown_connections 2023-12-18T10:18:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f7132525640 1 -- 172.21.15.133:0/1941827422 >> 172.21.15.133:0/1941827422 conn(0x7f712c0b0380 msgr2=0x7f712c0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f7132525640 1 -- 172.21.15.133:0/1941827422 shutdown_connections 2023-12-18T10:18:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.322+0000 7f7132525640 1 -- 172.21.15.133:0/1941827422 wait complete. 2023-12-18T10:18:17.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 Processor -- start 2023-12-18T10:18:17.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 -- start start 2023-12-18T10:18:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f712c14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c0cee20 0x7f712c0af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c14fd10 0x7f712c15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0ae250 con 0x7f7114003980 2023-12-18T10:18:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0ae530 con 0x7f712c0cee20 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0ae810 con 0x7f712c14fd10 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f712c14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f712c14f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41410/0 (socket says 172.21.15.133:41410) 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 -- 172.21.15.133:0/2821425911 learned_addr learned my addr 172.21.15.133:0/2821425911 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7130ac2640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c14fd10 0x7f712c15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712b7fe640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c0cee20 0x7f712c0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 -- 172.21.15.133:0/2821425911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c14fd10 msgr2=0x7f712c15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c14fd10 0x7f712c15e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 -- 172.21.15.133:0/2821425911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c0cee20 msgr2=0x7f712c0af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c0cee20 0x7f712c0af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 -- 172.21.15.133:0/2821425911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c0aeaf0 con 0x7f7114003980 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f712bfff640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f712c14f0e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f711c009ae0 tx=0x7f7114005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7128ff9640 1 -- 172.21.15.133:0/2821425911 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0b5070 con 0x7f7114003980 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7128ff9640 1 -- 172.21.15.133:0/2821425911 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00f000 con 0x7f7114003980 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7128ff9640 1 -- 172.21.15.133:0/2821425911 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0a6e60 con 0x7f7114003980 2023-12-18T10:18:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.326+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c0cf2b0 con 0x7f7114003980 2023-12-18T10:18:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.330+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c0af720 con 0x7f7114003980 2023-12-18T10:18:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.330+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c0cd0a0 con 0x7f7114003980 2023-12-18T10:18:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.330+0000 7f7128ff9640 1 -- 172.21.15.133:0/2821425911 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f711c0b9070 con 0x7f7114003980 2023-12-18T10:18:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.330+0000 7f7128ff9640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7118065a60 0x7f7118067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.330+0000 7f7128ff9640 1 -- 172.21.15.133:0/2821425911 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f711c11cee0 con 0x7f7114003980 2023-12-18T10:18:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.330+0000 7f712b7fe640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7118065a60 0x7f7118067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.330+0000 7f712b7fe640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7118065a60 0x7f7118067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f712c160180 tx=0x7f7120007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:17.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.334+0000 7f7128ff9640 1 -- 172.21.15.133:0/2821425911 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f711c0ea5c0 con 0x7f7114003980 2023-12-18T10:18:17.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f712c0aec80 con 0x7f7114003980 2023-12-18T10:18:17.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7128ff9640 1 -- 172.21.15.133:0/2821425911 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f711c0c0020 con 0x7f7114003980 2023-12-18T10:18:17.495 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:17.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7118065a60 msgr2=0x7f7118067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7118065a60 0x7f7118067f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f712c160180 tx=0x7f7120007040 comp rx=0 tx=0).stop 2023-12-18T10:18:17.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 msgr2=0x7f712c14f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f712c14f0e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f711c009ae0 tx=0x7f7114005800 comp rx=0 tx=0).stop 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 shutdown_connections 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7118065a60 0x7f7118067f20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f712c14fd10 0x7f712c15e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f712c0cee20 0x7f712c0af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 --2- 172.21.15.133:0/2821425911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003980 0x7f712c14f0e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 >> 172.21.15.133:0/2821425911 conn(0x7f712c0b0380 msgr2=0x7f712c0706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 shutdown_connections 2023-12-18T10:18:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.490+0000 7f7132525640 1 -- 172.21.15.133:0/2821425911 wait complete. 2023-12-18T10:18:17.516 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:18:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.646+0000 7f7f7f3b3640 1 Processor -- start 2023-12-18T10:18:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.646+0000 7f7f7f3b3640 1 -- start start 2023-12-18T10:18:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7f3b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f78160cc0 0x7f7f780cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7f3b3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f780c1280 0x7f7f780cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7f3b3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7806fdb0 con 0x7f7f780c17d0 2023-12-18T10:18:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7f3b3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f781654a0 con 0x7f7f780c1280 2023-12-18T10:18:17.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7f3b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781610a0 con 0x7f7f78160cc0 2023-12-18T10:18:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7c94e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f780c1280 0x7f7f780cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7d950640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7f780c17d0 0x7f7f7806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:60864/0 (socket says 172.21.15.133:60864) 2023-12-18T10:18:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7d950640 1 -- 172.21.15.133:0/627025009 learned_addr learned my addr 172.21.15.133:0/627025009 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7c94e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f780c1280 0x7f7f780cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:52842/0 (socket says 172.21.15.133:52842) 2023-12-18T10:18:17.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7d14f640 1 --2- 172.21.15.133:0/627025009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f78160cc0 0x7f7f780cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f6ffff640 1 -- 172.21.15.133:0/627025009 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238692156 0 0) 0x7f7f7806fdb0 con 0x7f7f780c17d0 2023-12-18T10:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7c94e640 1 -- 172.21.15.133:0/627025009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f78160cc0 msgr2=0x7f7f780cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7c94e640 1 --2- 172.21.15.133:0/627025009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f78160cc0 0x7f7f780cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7c94e640 1 -- 172.21.15.133:0/627025009 >> v1:172.21.15.142:6789/0 conn(0x7f7f780c17d0 legacy=0x7f7f7806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.650+0000 7f7f7c94e640 1 -- 172.21.15.133:0/627025009 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780cb6b0 con 0x7f7f780c1280 2023-12-18T10:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7c94e640 1 --2- 172.21.15.133:0/627025009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f780c1280 0x7f7f780cb170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7f680097f0 tx=0x7f7f6801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d2000506b69fa5b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f6ffff640 1 -- 172.21.15.133:0/627025009 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680ab600 con 0x7f7f780c1280 2023-12-18T10:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f6ffff640 1 -- 172.21.15.133:0/627025009 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f680a7050 con 0x7f7f780c1280 2023-12-18T10:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f6ffff640 1 -- 172.21.15.133:0/627025009 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680ab980 con 0x7f7f780c1280 2023-12-18T10:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/627025009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f780c1280 msgr2=0x7f7f780cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/627025009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f780c1280 0x7f7f780cb170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7f680097f0 tx=0x7f7f6801c3c0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/627025009 shutdown_connections 2023-12-18T10:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/627025009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f780c1280 0x7f7f780cb170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/627025009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f78160cc0 0x7f7f780cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/627025009 >> 172.21.15.133:0/627025009 conn(0x7f7f7806a3e0 msgr2=0x7f7f780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/627025009 shutdown_connections 2023-12-18T10:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/627025009 wait complete. 2023-12-18T10:18:17.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 Processor -- start 2023-12-18T10:18:17.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 -- start start 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.654+0000 7f7f7f3b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f780c1280 0x7f7f7815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7f3b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f780c17d0 0x7f7f78163610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7f3b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f78160cc0 0x7f7f7815f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7f3b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78163f40 con 0x7f7f780c1280 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7f3b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780b1080 con 0x7f7f78160cc0 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7f3b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780b1360 con 0x7f7f780c17d0 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f780c1280 0x7f7f7815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f780c1280 0x7f7f7815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41414/0 (socket says 172.21.15.133:41414) 2023-12-18T10:18:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 -- 172.21.15.133:0/1807670104 learned_addr learned my addr 172.21.15.133:0/1807670104 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7c94e640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f780c17d0 0x7f7f78163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d950640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f78160cc0 0x7f7f7815f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 -- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f780c17d0 msgr2=0x7f7f78163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f780c17d0 0x7f7f78163610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 -- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f78160cc0 msgr2=0x7f7f7815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f78160cc0 0x7f7f7815f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 -- 172.21.15.133:0/1807670104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68009420 con 0x7f7f780c1280 2023-12-18T10:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d950640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f78160cc0 0x7f7f7815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7d14f640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f780c1280 0x7f7f7815afe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400e870 tx=0x7f7f7400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f6dffb640 1 -- 172.21.15.133:0/1807670104 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74009510 con 0x7f7f780c1280 2023-12-18T10:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f6dffb640 1 -- 172.21.15.133:0/1807670104 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400eec0 con 0x7f7f780c1280 2023-12-18T10:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f6dffb640 1 -- 172.21.15.133:0/1807670104 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400cb40 con 0x7f7f780c1280 2023-12-18T10:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f780b1640 con 0x7f7f780c1280 2023-12-18T10:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f78163b50 con 0x7f7f780c1280 2023-12-18T10:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.658+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f780735b0 con 0x7f7f780c1280 2023-12-18T10:18:17.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.662+0000 7f7f6dffb640 1 -- 172.21.15.133:0/1807670104 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f7400cca0 con 0x7f7f780c1280 2023-12-18T10:18:17.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.662+0000 7f7f6dffb640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f5c065a60 0x7f7f5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:17.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.662+0000 7f7f6dffb640 1 -- 172.21.15.133:0/1807670104 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f740835d0 con 0x7f7f780c1280 2023-12-18T10:18:17.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.662+0000 7f7f7c94e640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f5c065a60 0x7f7f5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:17.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.662+0000 7f7f7c94e640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f5c065a60 0x7f7f5c067f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7f680ad000 tx=0x7f7f680a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:17.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.666+0000 7f7f6dffb640 1 -- 172.21.15.133:0/1807670104 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7f74050ca0 con 0x7f7f780c1280 2023-12-18T10:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.826+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f7804e000 con 0x7f7f780c1280 2023-12-18T10:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.826+0000 7f7f6dffb640 1 -- 172.21.15.133:0/1807670104 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7f740542c0 con 0x7f7f780c1280 2023-12-18T10:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:18:17.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f5c065a60 msgr2=0x7f7f5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f5c065a60 0x7f7f5c067f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7f680ad000 tx=0x7f7f680a6000 comp rx=0 tx=0).stop 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f780c1280 msgr2=0x7f7f7815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f780c1280 0x7f7f7815afe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400e870 tx=0x7f7f7400ec70 comp rx=0 tx=0).stop 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 shutdown_connections 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f5c065a60 0x7f7f5c067f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f78160cc0 0x7f7f7815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f780c17d0 0x7f7f78163610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 --2- 172.21.15.133:0/1807670104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f780c1280 0x7f7f7815afe0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 >> 172.21.15.133:0/1807670104 conn(0x7f7f7806a3e0 msgr2=0x7f7f7806fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 shutdown_connections 2023-12-18T10:18:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:17.830+0000 7f7f7f3b3640 1 -- 172.21.15.133:0/1807670104 wait complete. 2023-12-18T10:18:17.855 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:18:17.855 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:18:17.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:18.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe42b48c640 1 Processor -- start 2023-12-18T10:18:18.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe42b48c640 1 -- start start 2023-12-18T10:18:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe42b48c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe42415ca40 0x7fe4240cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe42b48c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4240d11c0 con 0x7fe4240cf7e0 2023-12-18T10:18:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe42b48c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4240d0310 con 0x7fe4240ce3f0 2023-12-18T10:18:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe42b48c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4240d05b0 con 0x7fe42415ca40 2023-12-18T10:18:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe429a29640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe4240cf7e0 0x7fe4241668e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55210/0 (socket says 172.21.15.133:55210) 2023-12-18T10:18:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe429a29640 1 -- 172.21.15.133:0/3877608933 learned_addr learned my addr 172.21.15.133:0/3877608933 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe429228640 1 --2- 172.21.15.133:0/3877608933 >> v2:172.21.15.142:3300/0 conn(0x7fe42415ca40 0x7fe4240cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339895219 0 0) 0x7fe4240d11c0 con 0x7fe4240cf7e0 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe410003530 con 0x7fe4240cf7e0 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303641981 0 0) 0x7fe410003530 con 0x7fe4240cf7e0 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 >> v2:172.21.15.142:3300/0 conn(0x7fe42415ca40 msgr2=0x7fe4240cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 --2- 172.21.15.133:0/3877608933 >> v2:172.21.15.142:3300/0 conn(0x7fe42415ca40 0x7fe4240cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 >> v1:172.21.15.142:6789/0 conn(0x7fe4240ce3f0 legacy=0x7fe4240cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240d0890 con 0x7fe4240cf7e0 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fe41c001a00 con 0x7fe4240cf7e0 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 >> v1:172.21.15.133:6789/0 conn(0x7fe4240cf7e0 legacy=0x7fe4241668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe410003980 0x7fe410003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe410004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe410005190 0x7fe41000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240d05b0 con 0x7fe4100047d0 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41000c030 con 0x7fe410005190 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41000c1f0 con 0x7fe410003980 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe428a27640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe410004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.038+0000 7fe429a29640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe410005190 0x7fe41000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe429228640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe410003980 0x7fe410003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe428a27640 1 -- 172.21.15.133:0/3877608933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe410003980 msgr2=0x7fe410003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe428a27640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe410003980 0x7fe410003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe428a27640 1 -- 172.21.15.133:0/3877608933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe410005190 msgr2=0x7fe41000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe428a27640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe410005190 0x7fe41000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe429a29640 1 -- 172.21.15.133:0/3877608933 reap_dead start 2023-12-18T10:18:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe428a27640 1 -- 172.21.15.133:0/3877608933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe410003530 con 0x7fe4100047d0 2023-12-18T10:18:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe428a27640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe410004c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4140017b0 tx=0x7fe41401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87292ed9a4e32d8e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4140052d0 con 0x7fe4100047d0 2023-12-18T10:18:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4140a7050 con 0x7fe4100047d0 2023-12-18T10:18:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe41bfff640 1 -- 172.21.15.133:0/3877608933 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414003650 con 0x7fe4100047d0 2023-12-18T10:18:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe42b48c640 1 -- 172.21.15.133:0/3877608933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 msgr2=0x7fe410004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.042+0000 7fe42b48c640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe410004c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4140017b0 tx=0x7fe41401c3c0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 -- 172.21.15.133:0/3877608933 shutdown_connections 2023-12-18T10:18:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 --2- 172.21.15.133:0/3877608933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe410004c50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 -- 172.21.15.133:0/3877608933 >> 172.21.15.133:0/3877608933 conn(0x7fe424089fb0 msgr2=0x7fe4240d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 -- 172.21.15.133:0/3877608933 shutdown_connections 2023-12-18T10:18:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 -- 172.21.15.133:0/3877608933 wait complete. 2023-12-18T10:18:18.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 Processor -- start 2023-12-18T10:18:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 -- start start 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe424156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4240b0490 0x7fe4240b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe42415a570 0x7fe42415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42415af30 con 0x7fe4100047d0 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe424157470 con 0x7fe42415a570 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe42b48c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4240b0f50 con 0x7fe4240b0490 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe424156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe424156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41430/0 (socket says 172.21.15.133:41430) 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 -- 172.21.15.133:0/860834855 learned_addr learned my addr 172.21.15.133:0/860834855 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429a29640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe42415a570 0x7fe42415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe428a27640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4240b0490 0x7fe4240b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 -- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4240b0490 msgr2=0x7fe4240b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4240b0490 0x7fe4240b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 -- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe42415a570 msgr2=0x7fe42415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe42415a570 0x7fe42415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 -- 172.21.15.133:0/860834855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4240b1230 con 0x7fe4100047d0 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe428a27640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4240b0490 0x7fe4240b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe429228640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe424156f30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe420011890 tx=0x7fe420011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.046+0000 7fe419ffb640 1 -- 172.21.15.133:0/860834855 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420005bb0 con 0x7fe4100047d0 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe419ffb640 1 -- 172.21.15.133:0/860834855 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420005d10 con 0x7fe4100047d0 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4240b1510 con 0x7fe4100047d0 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe419ffb640 1 -- 172.21.15.133:0/860834855 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42000fa60 con 0x7fe4100047d0 2023-12-18T10:18:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4240b6180 con 0x7fe4100047d0 2023-12-18T10:18:18.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4240b6370 con 0x7fe4100047d0 2023-12-18T10:18:18.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe419ffb640 1 -- 172.21.15.133:0/860834855 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe42000fbc0 con 0x7fe4100047d0 2023-12-18T10:18:18.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe419ffb640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe408065a60 0x7fe408067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe419ffb640 1 -- 172.21.15.133:0/860834855 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe420083d10 con 0x7fe4100047d0 2023-12-18T10:18:18.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe428a27640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe408065a60 0x7fe408067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.050+0000 7fe428a27640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe408065a60 0x7fe408067f20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4140ac000 tx=0x7fe4140011f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.054+0000 7fe419ffb640 1 -- 172.21.15.133:0/860834855 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe4200513c0 con 0x7fe4100047d0 2023-12-18T10:18:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.206+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe42404e000 con 0x7fe4100047d0 2023-12-18T10:18:18.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe419ffb640 1 -- 172.21.15.133:0/860834855 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fe4200549e0 con 0x7fe4100047d0 2023-12-18T10:18:18.215 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:18.215 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe408065a60 msgr2=0x7fe408067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe408065a60 0x7fe408067f20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe4140ac000 tx=0x7fe4140011f0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 msgr2=0x7fe424156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe424156f30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe420011890 tx=0x7fe420011d50 comp rx=0 tx=0).stop 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 shutdown_connections 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe408065a60 0x7fe408067f20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe42415a570 0x7fe42415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4240b0490 0x7fe4240b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 --2- 172.21.15.133:0/860834855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4100047d0 0x7fe424156f30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 >> 172.21.15.133:0/860834855 conn(0x7fe424089fb0 msgr2=0x7fe4240cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:18.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 shutdown_connections 2023-12-18T10:18:18.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.210+0000 7fe42b48c640 1 -- 172.21.15.133:0/860834855 wait complete. 2023-12-18T10:18:18.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:18.236 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:18.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bffa6640 1 Processor -- start 2023-12-18T10:18:18.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bffa6640 1 -- start start 2023-12-18T10:18:18.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bffa6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8160a60 0x7fd0b80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bffa6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd0b8165030 0x7fd0b80cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bffa6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b80ced50 con 0x7fd0b80ce8f0 2023-12-18T10:18:18.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bffa6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b80cc980 con 0x7fd0b8165030 2023-12-18T10:18:18.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bffa6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80cc090 con 0x7fd0b8160a60 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0be543640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd0b8165030 0x7fd0b80cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bdd42640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8160a60 0x7fd0b80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bd541640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd0b80ce8f0 0x7fd0b8164920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:60890/0 (socket says 172.21.15.133:60890) 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bd541640 1 -- 172.21.15.133:0/341006921 learned_addr learned my addr 172.21.15.133:0/341006921 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0be543640 1 -- 172.21.15.133:0/341006921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8160a60 msgr2=0x7fd0b80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0be543640 1 --2- 172.21.15.133:0/341006921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8160a60 0x7fd0b80ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0be543640 1 -- 172.21.15.133:0/341006921 >> v1:172.21.15.142:6789/0 conn(0x7fd0b80ce8f0 legacy=0x7fd0b8164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0be543640 1 -- 172.21.15.133:0/341006921 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80cc330 con 0x7fd0b8165030 2023-12-18T10:18:18.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.370+0000 7fd0bdd42640 1 --2- 172.21.15.133:0/341006921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8160a60 0x7fd0b80ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:18.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0be543640 1 --2- 172.21.15.133:0/341006921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b8165030 0x7fd0b80cce10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d90 tx=0x7fd0b001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dac64b1735c22c31 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bcd40640 1 -- 172.21.15.133:0/341006921 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00a5a30 con 0x7fd0b8165030 2023-12-18T10:18:18.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bcd40640 1 -- 172.21.15.133:0/341006921 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b00a5b90 con 0x7fd0b8165030 2023-12-18T10:18:18.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bcd40640 1 -- 172.21.15.133:0/341006921 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00ad440 con 0x7fd0b8165030 2023-12-18T10:18:18.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bffa6640 1 -- 172.21.15.133:0/341006921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b8165030 msgr2=0x7fd0b80cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/341006921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b8165030 0x7fd0b80cce10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009d90 tx=0x7fd0b001c950 comp rx=0 tx=0).stop 2023-12-18T10:18:18.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bffa6640 1 -- 172.21.15.133:0/341006921 shutdown_connections 2023-12-18T10:18:18.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/341006921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b8165030 0x7fd0b80cce10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/341006921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8160a60 0x7fd0b80ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bffa6640 1 -- 172.21.15.133:0/341006921 >> 172.21.15.133:0/341006921 conn(0x7fd0b806a2a0 msgr2=0x7fd0b80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:18.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bffa6640 1 -- 172.21.15.133:0/341006921 shutdown_connections 2023-12-18T10:18:18.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.374+0000 7fd0bffa6640 1 -- 172.21.15.133:0/341006921 wait complete. 2023-12-18T10:18:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 Processor -- start 2023-12-18T10:18:18.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 -- start start 2023-12-18T10:18:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b80ce8f0 0x7fd0b81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8160a60 0x7fd0b80c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8165030 0x7fd0b80c2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80b1d00 con 0x7fd0b8160a60 2023-12-18T10:18:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b8157800 con 0x7fd0b80ce8f0 2023-12-18T10:18:18.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80b10f0 con 0x7fd0b8165030 2023-12-18T10:18:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8160a60 0x7fd0b80c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8160a60 0x7fd0b80c23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41432/0 (socket says 172.21.15.133:41432) 2023-12-18T10:18:18.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 -- 172.21.15.133:0/3510952438 learned_addr learned my addr 172.21.15.133:0/3510952438 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0be543640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8165030 0x7fd0b80c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bdd42640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b80ce8f0 0x7fd0b81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 -- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8165030 msgr2=0x7fd0b80c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8165030 0x7fd0b80c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 -- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b80ce8f0 msgr2=0x7fd0b81572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b80ce8f0 0x7fd0b81572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 -- 172.21.15.133:0/3510952438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b4009420 con 0x7fd0b8160a60 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0be543640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8165030 0x7fd0b80c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bd541640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8160a60 0x7fd0b80c23e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c530 tx=0x7fd0a800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0ae7fc640 1 -- 172.21.15.133:0/3510952438 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8005cf0 con 0x7fd0b8160a60 2023-12-18T10:18:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0ae7fc640 1 -- 172.21.15.133:0/3510952438 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a8005e50 con 0x7fd0b8160a60 2023-12-18T10:18:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b0009a70 con 0x7fd0b8160a60 2023-12-18T10:18:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0ae7fc640 1 -- 172.21.15.133:0/3510952438 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8007270 con 0x7fd0b8160a60 2023-12-18T10:18:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.378+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b80b16b0 con 0x7fd0b8160a60 2023-12-18T10:18:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.382+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b804e000 con 0x7fd0b8160a60 2023-12-18T10:18:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.382+0000 7fd0ae7fc640 1 -- 172.21.15.133:0/3510952438 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd0a80073d0 con 0x7fd0b8160a60 2023-12-18T10:18:18.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.382+0000 7fd0ae7fc640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd09c065a60 0x7fd09c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.382+0000 7fd0ae7fc640 1 -- 172.21.15.133:0/3510952438 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0a8082a00 con 0x7fd0b8160a60 2023-12-18T10:18:18.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.382+0000 7fd0bdd42640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd09c065a60 0x7fd09c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.382+0000 7fd0bdd42640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd09c065a60 0x7fd09c067f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009c80 tx=0x7fd0b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.386+0000 7fd0ae7fc640 1 -- 172.21.15.133:0/3510952438 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd0a8050050 con 0x7fd0b8160a60 2023-12-18T10:18:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.534+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0b80b0c00 con 0x7fd0b8160a60 2023-12-18T10:18:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.534+0000 7fd0ae7fc640 1 -- 172.21.15.133:0/3510952438 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0a8017020 con 0x7fd0b8160a60 2023-12-18T10:18:18.542 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd09c065a60 msgr2=0x7fd09c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd09c065a60 0x7fd09c067f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009c80 tx=0x7fd0b4008040 comp rx=0 tx=0).stop 2023-12-18T10:18:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8160a60 msgr2=0x7fd0b80c23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8160a60 0x7fd0b80c23e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c530 tx=0x7fd0a800c9f0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 shutdown_connections 2023-12-18T10:18:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd09c065a60 0x7fd09c067f20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0b8165030 0x7fd0b80c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0b8160a60 0x7fd0b80c23e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 --2- 172.21.15.133:0/3510952438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0b80ce8f0 0x7fd0b81572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 >> 172.21.15.133:0/3510952438 conn(0x7fd0b806a2a0 msgr2=0x7fd0b815fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 shutdown_connections 2023-12-18T10:18:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.538+0000 7fd0bffa6640 1 -- 172.21.15.133:0/3510952438 wait complete. 2023-12-18T10:18:18.563 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:18.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8737139640 1 Processor -- start 2023-12-18T10:18:18.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8737139640 1 -- start start 2023-12-18T10:18:18.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8737139640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87301582d0 0x7f87300c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8737139640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8730070820 0x7f87300ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8737139640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f87300ce3b0 0x7f87300ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8737139640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87300ced80 con 0x7f87301582d0 2023-12-18T10:18:18.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8737139640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87300c9390 con 0x7f87300ce3b0 2023-12-18T10:18:18.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8737139640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873015aee0 con 0x7f8730070820 2023-12-18T10:18:18.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8734ed5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87301582d0 0x7f87300c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8734ed5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87301582d0 0x7f87300c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41436/0 (socket says 172.21.15.133:41436) 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8734ed5640 1 -- 172.21.15.133:0/1922500174 learned_addr learned my addr 172.21.15.133:0/1922500174 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f87356d6640 1 --2- 172.21.15.133:0/1922500174 >> v2:172.21.15.142:3300/0 conn(0x7f87300ce3b0 0x7f87300ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f872ffff640 1 --2- 172.21.15.133:0/1922500174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8730070820 0x7f87300ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8734ed5640 1 -- 172.21.15.133:0/1922500174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8730070820 msgr2=0x7f87300ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8734ed5640 1 --2- 172.21.15.133:0/1922500174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8730070820 0x7f87300ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8734ed5640 1 -- 172.21.15.133:0/1922500174 >> v2:172.21.15.142:3300/0 conn(0x7f87300ce3b0 msgr2=0x7f87300ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8734ed5640 1 --2- 172.21.15.133:0/1922500174 >> v2:172.21.15.142:3300/0 conn(0x7f87300ce3b0 0x7f87300ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f8734ed5640 1 -- 172.21.15.133:0/1922500174 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873015b1c0 con 0x7f87301582d0 2023-12-18T10:18:18.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.698+0000 7f87356d6640 1 --2- 172.21.15.133:0/1922500174 >> v2:172.21.15.142:3300/0 conn(0x7f87300ce3b0 0x7f87300ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:18.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8734ed5640 1 --2- 172.21.15.133:0/1922500174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87301582d0 0x7f87300c8e50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f87300c5480 tx=0x7f872401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9c39af60afd808 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f872f7fe640 1 -- 172.21.15.133:0/1922500174 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240aa5f0 con 0x7f87301582d0 2023-12-18T10:18:18.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f872f7fe640 1 -- 172.21.15.133:0/1922500174 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87240aa750 con 0x7f87301582d0 2023-12-18T10:18:18.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f872f7fe640 1 -- 172.21.15.133:0/1922500174 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240aaae0 con 0x7f87301582d0 2023-12-18T10:18:18.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 -- 172.21.15.133:0/1922500174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87301582d0 msgr2=0x7f87300c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 --2- 172.21.15.133:0/1922500174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87301582d0 0x7f87300c8e50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f87300c5480 tx=0x7f872401c4d0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 -- 172.21.15.133:0/1922500174 shutdown_connections 2023-12-18T10:18:18.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 --2- 172.21.15.133:0/1922500174 >> v2:172.21.15.142:3300/0 conn(0x7f87300ce3b0 0x7f87300ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 --2- 172.21.15.133:0/1922500174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8730070820 0x7f87300ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 --2- 172.21.15.133:0/1922500174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87301582d0 0x7f87300c8e50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 -- 172.21.15.133:0/1922500174 >> 172.21.15.133:0/1922500174 conn(0x7f873006a2a0 msgr2=0x7f87300aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:18.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 -- 172.21.15.133:0/1922500174 shutdown_connections 2023-12-18T10:18:18.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.702+0000 7f8737139640 1 -- 172.21.15.133:0/1922500174 wait complete. 2023-12-18T10:18:18.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 Processor -- start 2023-12-18T10:18:18.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 -- start start 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8730070820 0x7f8730156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ce3b0 0x7f87300c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87301582d0 0x7f873015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87300b14e0 con 0x7f8730070820 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87300c7460 con 0x7f87301582d0 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87300c7ef0 con 0x7f87300ce3b0 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8730070820 0x7f8730156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8730070820 0x7f8730156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41440/0 (socket says 172.21.15.133:41440) 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 -- 172.21.15.133:0/1898519004 learned_addr learned my addr 172.21.15.133:0/1898519004 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f87356d6640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87301582d0 0x7f873015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f872ffff640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ce3b0 0x7f87300c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 -- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ce3b0 msgr2=0x7f87300c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ce3b0 0x7f87300c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 -- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87301582d0 msgr2=0x7f873015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87301582d0 0x7f873015c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 -- 172.21.15.133:0/1898519004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240094d0 con 0x7f8730070820 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f872ffff640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ce3b0 0x7f87300c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f87356d6640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87301582d0 0x7f873015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8734ed5640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8730070820 0x7f8730156e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f87240ac040 tx=0x7f872401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f872d7fa640 1 -- 172.21.15.133:0/1898519004 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240b3800 con 0x7f8730070820 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f872d7fa640 1 -- 172.21.15.133:0/1898519004 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87240b3960 con 0x7f8730070820 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f872d7fa640 1 -- 172.21.15.133:0/1898519004 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240b3cf0 con 0x7f8730070820 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.706+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87300c7650 con 0x7f8730070820 2023-12-18T10:18:18.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.710+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87300c7c10 con 0x7f8730070820 2023-12-18T10:18:18.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.710+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8730071190 con 0x7f8730070820 2023-12-18T10:18:18.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.710+0000 7f872d7fa640 1 -- 172.21.15.133:0/1898519004 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f87240b2380 con 0x7f8730070820 2023-12-18T10:18:18.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.710+0000 7f872d7fa640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8714065a60 0x7f8714067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:18.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.710+0000 7f872d7fa640 1 -- 172.21.15.133:0/1898519004 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87240a7070 con 0x7f8730070820 2023-12-18T10:18:18.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.710+0000 7f872ffff640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8714065a60 0x7f8714067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:18.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.710+0000 7f872ffff640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8714065a60 0x7f8714067f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8730070020 tx=0x7f871c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:18.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.714+0000 7f872d7fa640 1 -- 172.21.15.133:0/1898519004 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f87240eb230 con 0x7f8730070820 2023-12-18T10:18:18.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f873004e000 con 0x7f8730070820 2023-12-18T10:18:18.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f872d7fa640 1 -- 172.21.15.133:0/1898519004 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87240c30a0 con 0x7f8730070820 2023-12-18T10:18:18.872 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:18.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8714065a60 msgr2=0x7f8714067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8714065a60 0x7f8714067f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8730070020 tx=0x7f871c008040 comp rx=0 tx=0).stop 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8730070820 msgr2=0x7f8730156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8730070820 0x7f8730156e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f87240ac040 tx=0x7f872401ad10 comp rx=0 tx=0).stop 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 shutdown_connections 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8714065a60 0x7f8714067f20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87301582d0 0x7f873015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87300ce3b0 0x7f87300c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 --2- 172.21.15.133:0/1898519004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8730070820 0x7f8730156e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 >> 172.21.15.133:0/1898519004 conn(0x7f873006a2a0 msgr2=0x7f87301636a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 shutdown_connections 2023-12-18T10:18:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:18.866+0000 7f8737139640 1 -- 172.21.15.133:0/1898519004 wait complete. 2023-12-18T10:18:18.893 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:19.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecba88c640 1 Processor -- start 2023-12-18T10:18:19.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecba88c640 1 -- start start 2023-12-18T10:18:19.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecba88c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecba88c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fecb41598d0 0x7fecb40ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecba88c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40c9730 con 0x7fecb40ce8d0 2023-12-18T10:18:19.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecba88c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40ced60 con 0x7fecb41598d0 2023-12-18T10:18:19.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecba88c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40c8e00 con 0x7fecb4153020 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecb8e29640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fecb40ce8d0 0x7fecb4070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55226/0 (socket says 172.21.15.133:55226) 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.026+0000 7fecb8e29640 1 -- 172.21.15.133:0/72248544 learned_addr learned my addr 172.21.15.133:0/72248544 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb37fe640 1 --2- 172.21.15.133:0/72248544 >> v2:172.21.15.142:3300/0 conn(0x7fecb41598d0 0x7fecb40ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb3fff640 1 --2- 172.21.15.133:0/72248544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb2ffd640 1 -- 172.21.15.133:0/72248544 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566671543 0 0) 0x7fecb40c9730 con 0x7fecb40ce8d0 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb2ffd640 1 -- 172.21.15.133:0/72248544 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec9c003530 con 0x7fecb40ce8d0 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb3fff640 1 -- 172.21.15.133:0/72248544 >> v2:172.21.15.142:3300/0 conn(0x7fecb41598d0 msgr2=0x7fecb40ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb3fff640 1 --2- 172.21.15.133:0/72248544 >> v2:172.21.15.142:3300/0 conn(0x7fecb41598d0 0x7fecb40ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb3fff640 1 -- 172.21.15.133:0/72248544 >> v1:172.21.15.133:6789/0 conn(0x7fecb40ce8d0 legacy=0x7fecb4070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb3fff640 1 -- 172.21.15.133:0/72248544 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40c90e0 con 0x7fecb4153020 2023-12-18T10:18:19.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb37fe640 1 --2- 172.21.15.133:0/72248544 >> v2:172.21.15.142:3300/0 conn(0x7fecb41598d0 0x7fecb40ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:19.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb3fff640 1 --2- 172.21.15.133:0/72248544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c9bc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feca40097c0 tx=0x7feca401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61f1f1871e8992bc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb2ffd640 1 -- 172.21.15.133:0/72248544 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40ab600 con 0x7fecb4153020 2023-12-18T10:18:19.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.030+0000 7fecb2ffd640 1 -- 172.21.15.133:0/72248544 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca40a7050 con 0x7fecb4153020 2023-12-18T10:18:19.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecb2ffd640 1 -- 172.21.15.133:0/72248544 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40ab980 con 0x7fecb4153020 2023-12-18T10:18:19.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- 172.21.15.133:0/72248544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 msgr2=0x7fecb40c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 --2- 172.21.15.133:0/72248544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c9bc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feca40097c0 tx=0x7feca401c330 comp rx=0 tx=0).stop 2023-12-18T10:18:19.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- 172.21.15.133:0/72248544 shutdown_connections 2023-12-18T10:18:19.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 --2- 172.21.15.133:0/72248544 >> v2:172.21.15.142:3300/0 conn(0x7fecb41598d0 0x7fecb40ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 --2- 172.21.15.133:0/72248544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c9bc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- 172.21.15.133:0/72248544 >> 172.21.15.133:0/72248544 conn(0x7fecb406a2a0 msgr2=0x7fecb40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:19.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- 172.21.15.133:0/72248544 shutdown_connections 2023-12-18T10:18:19.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- 172.21.15.133:0/72248544 wait complete. 2023-12-18T10:18:19.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 Processor -- start 2023-12-18T10:18:19.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- start start 2023-12-18T10:18:19.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb40ce8d0 0x7fecb4166fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecb41598d0 0x7fecb4166540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb4167c60 con 0x7fecb40ce8d0 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40c5ce0 con 0x7fecb41598d0 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecba88c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41676a0 con 0x7fecb4153020 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb40ce8d0 0x7fecb4166fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb40ce8d0 0x7fecb4166fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41452/0 (socket says 172.21.15.133:41452) 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecb3fff640 1 -- 172.21.15.133:0/856902712 learned_addr learned my addr 172.21.15.133:0/856902712 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecb8e29640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecb41598d0 0x7fecb4166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.034+0000 7fecb37fe640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb3fff640 1 -- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 msgr2=0x7fecb40c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb3fff640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb3fff640 1 -- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecb41598d0 msgr2=0x7fecb4166540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb3fff640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecb41598d0 0x7fecb4166540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb3fff640 1 -- 172.21.15.133:0/856902712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8009420 con 0x7fecb40ce8d0 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb8e29640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecb41598d0 0x7fecb4166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb37fe640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb3fff640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb40ce8d0 0x7fecb4166fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feca4019f60 tx=0x7feca401ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb0ff9640 1 -- 172.21.15.133:0/856902712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40b7450 con 0x7fecb40ce8d0 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb0ff9640 1 -- 172.21.15.133:0/856902712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca40b75d0 con 0x7fecb40ce8d0 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca4009420 con 0x7fecb40ce8d0 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb0ff9640 1 -- 172.21.15.133:0/856902712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca40b7980 con 0x7fecb40ce8d0 2023-12-18T10:18:19.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb4165d40 con 0x7fecb40ce8d0 2023-12-18T10:18:19.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb404e000 con 0x7fecb40ce8d0 2023-12-18T10:18:19.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb0ff9640 1 -- 172.21.15.133:0/856902712 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feca40b7ae0 con 0x7fecb40ce8d0 2023-12-18T10:18:19.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb0ff9640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feca0065a90 0x7feca0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb0ff9640 1 -- 172.21.15.133:0/856902712 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feca411da30 con 0x7fecb40ce8d0 2023-12-18T10:18:19.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.038+0000 7fecb37fe640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feca0065a90 0x7feca0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.042+0000 7fecb37fe640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feca0065a90 0x7feca0067f50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fecb40cc840 tx=0x7feca8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.042+0000 7fecb0ff9640 1 -- 172.21.15.133:0/856902712 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feca40eb2b0 con 0x7fecb40ce8d0 2023-12-18T10:18:19.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.194+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecb40cc600 con 0x7fecb40ce8d0 2023-12-18T10:18:19.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.194+0000 7fecb0ff9640 1 -- 172.21.15.133:0/856902712 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7feca40b0020 con 0x7fecb40ce8d0 2023-12-18T10:18:19.201 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:19.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feca0065a90 msgr2=0x7feca0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feca0065a90 0x7feca0067f50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fecb40cc840 tx=0x7feca8008040 comp rx=0 tx=0).stop 2023-12-18T10:18:19.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb40ce8d0 msgr2=0x7fecb4166fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb40ce8d0 0x7fecb4166fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feca4019f60 tx=0x7feca401ab70 comp rx=0 tx=0).stop 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 shutdown_connections 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feca0065a90 0x7feca0067f50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecb41598d0 0x7fecb4166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecb4153020 0x7fecb40c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 --2- 172.21.15.133:0/856902712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb40ce8d0 0x7fecb4166fe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 >> 172.21.15.133:0/856902712 conn(0x7fecb406a2a0 msgr2=0x7fecb415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 shutdown_connections 2023-12-18T10:18:19.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.198+0000 7fecba88c640 1 -- 172.21.15.133:0/856902712 wait complete. 2023-12-18T10:18:19.222 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:19.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.354+0000 7fa587d60640 1 Processor -- start 2023-12-18T10:18:19.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.354+0000 7fa587d60640 1 -- start start 2023-12-18T10:18:19.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa587d60640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa580070820 0x7fa5800c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa587d60640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5800c9390 con 0x7fa5801582d0 2023-12-18T10:18:19.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa587d60640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58015aee0 con 0x7fa5800ce3b0 2023-12-18T10:18:19.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa587d60640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58015b1c0 con 0x7fa580070820 2023-12-18T10:18:19.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa5852fb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa580070820 0x7fa5800c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa585afc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa5801582d0 0x7fa5800ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55240/0 (socket says 172.21.15.133:55240) 2023-12-18T10:18:19.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa585afc640 1 -- 172.21.15.133:0/2241825772 learned_addr learned my addr 172.21.15.133:0/2241825772 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:19.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa5852fb640 1 --2- 172.21.15.133:0/2241825772 >> v2:172.21.15.133:3300/0 conn(0x7fa580070820 0x7fa5800c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41464/0 (socket says 172.21.15.133:41464) 2023-12-18T10:18:19.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa5852fb640 1 -- 172.21.15.133:0/2241825772 >> v1:172.21.15.142:6789/0 conn(0x7fa5800ce3b0 legacy=0x7fa5800cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:19.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa5852fb640 1 -- 172.21.15.133:0/2241825772 >> v1:172.21.15.133:6789/0 conn(0x7fa5801582d0 legacy=0x7fa5800ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa5852fb640 1 -- 172.21.15.133:0/2241825772 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58015b4a0 con 0x7fa580070820 2023-12-18T10:18:19.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.358+0000 7fa584afa640 1 -- 172.21.15.133:0/2241825772 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672851875 0 0) 0x7fa5800c9390 con 0x7fa5801582d0 2023-12-18T10:18:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa5852fb640 1 --2- 172.21.15.133:0/2241825772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c8e50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5700097c0 tx=0x7fa57001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c236b21c20f727cc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa584afa640 1 -- 172.21.15.133:0/2241825772 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5700ab670 con 0x7fa580070820 2023-12-18T10:18:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa584afa640 1 -- 172.21.15.133:0/2241825772 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5700ab7d0 con 0x7fa580070820 2023-12-18T10:18:19.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa584afa640 1 -- 172.21.15.133:0/2241825772 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5700abb60 con 0x7fa580070820 2023-12-18T10:18:19.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 -- 172.21.15.133:0/2241825772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 msgr2=0x7fa5800c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 --2- 172.21.15.133:0/2241825772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c8e50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5700097c0 tx=0x7fa57001c450 comp rx=0 tx=0).stop 2023-12-18T10:18:19.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 -- 172.21.15.133:0/2241825772 shutdown_connections 2023-12-18T10:18:19.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 --2- 172.21.15.133:0/2241825772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c8e50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 -- 172.21.15.133:0/2241825772 >> 172.21.15.133:0/2241825772 conn(0x7fa58006a2a0 msgr2=0x7fa5800aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:19.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 -- 172.21.15.133:0/2241825772 shutdown_connections 2023-12-18T10:18:19.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 -- 172.21.15.133:0/2241825772 wait complete. 2023-12-18T10:18:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 Processor -- start 2023-12-18T10:18:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.362+0000 7fa587d60640 1 -- start start 2023-12-18T10:18:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5800ce3b0 0x7fa5800c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5801582d0 0x7fa58014e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800ac5e0 con 0x7fa580070820 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800ab9d0 con 0x7fa5801582d0 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800abcb0 con 0x7fa5800ce3b0 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41474/0 (socket says 172.21.15.133:41474) 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 -- 172.21.15.133:0/2627569019 learned_addr learned my addr 172.21.15.133:0/2627569019 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa5862fd640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5801582d0 0x7fa58014e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa5852fb640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5800ce3b0 0x7fa5800c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 -- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5800ce3b0 msgr2=0x7fa5800c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5800ce3b0 0x7fa5800c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 -- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5801582d0 msgr2=0x7fa58014e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5801582d0 0x7fa58014e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 -- 172.21.15.133:0/2627569019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570009420 con 0x7fa580070820 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa5862fd640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5801582d0 0x7fa58014e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa5852fb640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5800ce3b0 0x7fa5800c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa585afc640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c1f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00c410 tx=0x7fa57c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa5767fc640 1 -- 172.21.15.133:0/2627569019 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0074e0 con 0x7fa580070820 2023-12-18T10:18:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa5767fc640 1 -- 172.21.15.133:0/2627569019 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c007640 con 0x7fa580070820 2023-12-18T10:18:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa5767fc640 1 -- 172.21.15.133:0/2627569019 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c004a30 con 0x7fa580070820 2023-12-18T10:18:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5800abf90 con 0x7fa580070820 2023-12-18T10:18:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5800cc0d0 con 0x7fa580070820 2023-12-18T10:18:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58004e000 con 0x7fa580070820 2023-12-18T10:18:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.366+0000 7fa5767fc640 1 -- 172.21.15.133:0/2627569019 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa57c004b90 con 0x7fa580070820 2023-12-18T10:18:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.370+0000 7fa5767fc640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa564065a60 0x7fa564067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.370+0000 7fa5767fc640 1 -- 172.21.15.133:0/2627569019 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa57c083270 con 0x7fa580070820 2023-12-18T10:18:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.370+0000 7fa5852fb640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa564065a60 0x7fa564067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.370+0000 7fa5852fb640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa564065a60 0x7fa564067f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5700af000 tx=0x7fa5700a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.374+0000 7fa5767fc640 1 -- 172.21.15.133:0/2627569019 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa57c0509b0 con 0x7fa580070820 2023-12-18T10:18:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa5800b0c00 con 0x7fa580070820 2023-12-18T10:18:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa5767fc640 1 -- 172.21.15.133:0/2627569019 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa57c053fd0 con 0x7fa580070820 2023-12-18T10:18:19.533 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:19.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa564065a60 msgr2=0x7fa564067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa564065a60 0x7fa564067f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5700af000 tx=0x7fa5700a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:19.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 msgr2=0x7fa5800c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c1f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa57c00c410 tx=0x7fa57c00c8d0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 shutdown_connections 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa564065a60 0x7fa564067f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5801582d0 0x7fa58014e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5800ce3b0 0x7fa5800c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 --2- 172.21.15.133:0/2627569019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa580070820 0x7fa5800c1f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 >> 172.21.15.133:0/2627569019 conn(0x7fa58006a2a0 msgr2=0x7fa58006be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 shutdown_connections 2023-12-18T10:18:19.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.526+0000 7fa587d60640 1 -- 172.21.15.133:0/2627569019 wait complete. 2023-12-18T10:18:19.554 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:18:19.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.686+0000 7f826e3ce640 1 Processor -- start 2023-12-18T10:18:19.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.686+0000 7f826e3ce640 1 -- start start 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.686+0000 7f826e3ce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8268158c20 0x7f8268070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.686+0000 7f826e3ce640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8268070b80 con 0x7f82680cb180 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.686+0000 7f826e3ce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8268070e60 con 0x7f826815c800 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.686+0000 7f826e3ce640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8268071140 con 0x7f8268158c20 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8267fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8268158c20 0x7f8268070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8267fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8268158c20 0x7f8268070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41486/0 (socket says 172.21.15.133:41486) 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8267fff640 1 -- 172.21.15.133:0/3660606341 learned_addr learned my addr 172.21.15.133:0/3660606341 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f826c96b640 1 --1- 172.21.15.133:0/3660606341 >> v1:172.21.15.133:6789/0 conn(0x7f82680cb180 0x7f82680ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55254/0 (socket says 172.21.15.133:55254) 2023-12-18T10:18:19.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8267fff640 1 -- 172.21.15.133:0/3660606341 >> v1:172.21.15.142:6789/0 conn(0x7f826815c800 legacy=0x7f82680caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8267fff640 1 -- 172.21.15.133:0/3660606341 >> v1:172.21.15.133:6789/0 conn(0x7f82680cb180 legacy=0x7f82680ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8267fff640 1 -- 172.21.15.133:0/3660606341 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268071420 con 0x7f8268158c20 2023-12-18T10:18:19.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8267fff640 1 --2- 172.21.15.133:0/3660606341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268070510 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8258009870 tx=0x7f825801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c93eca4f50e3dc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8266ffd640 1 -- 172.21.15.133:0/3660606341 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580a6040 con 0x7f8268158c20 2023-12-18T10:18:19.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8266ffd640 1 -- 172.21.15.133:0/3660606341 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82580aa600 con 0x7f8268158c20 2023-12-18T10:18:19.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.690+0000 7f8266ffd640 1 -- 172.21.15.133:0/3660606341 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82580aa990 con 0x7f8268158c20 2023-12-18T10:18:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- 172.21.15.133:0/3660606341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 msgr2=0x7f8268070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 --2- 172.21.15.133:0/3660606341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268070510 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8258009870 tx=0x7f825801cee0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- 172.21.15.133:0/3660606341 shutdown_connections 2023-12-18T10:18:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 --2- 172.21.15.133:0/3660606341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268070510 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- 172.21.15.133:0/3660606341 >> 172.21.15.133:0/3660606341 conn(0x7f826806a3e0 msgr2=0x7f82680afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- 172.21.15.133:0/3660606341 shutdown_connections 2023-12-18T10:18:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- 172.21.15.133:0/3660606341 wait complete. 2023-12-18T10:18:19.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 Processor -- start 2023-12-18T10:18:19.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- start start 2023-12-18T10:18:19.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82680cb180 0x7f826814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826815c800 0x7f8268159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826814d8b0 con 0x7f8268158c20 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826814cca0 con 0x7f82680cb180 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826e3ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826814cf80 con 0x7f826815c800 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f82677fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f82677fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41492/0 (socket says 172.21.15.133:41492) 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f82677fe640 1 -- 172.21.15.133:0/3073584724 learned_addr learned my addr 172.21.15.133:0/3073584724 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f8267fff640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82680cb180 0x7f826814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.694+0000 7f826c96b640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826815c800 0x7f8268159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f82677fe640 1 -- 172.21.15.133:0/3073584724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826815c800 msgr2=0x7f8268159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f82677fe640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826815c800 0x7f8268159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f82677fe640 1 -- 172.21.15.133:0/3073584724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82680cb180 msgr2=0x7f826814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f82677fe640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82680cb180 0x7f826814c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f82677fe640 1 -- 172.21.15.133:0/3073584724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580094d0 con 0x7f8268158c20 2023-12-18T10:18:19.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f82677fe640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268159a70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c370 tx=0x7f825c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f8264ff9640 1 -- 172.21.15.133:0/3073584724 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0052d0 con 0x7f8268158c20 2023-12-18T10:18:19.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f8264ff9640 1 -- 172.21.15.133:0/3073584724 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c005430 con 0x7f8268158c20 2023-12-18T10:18:19.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f8264ff9640 1 -- 172.21.15.133:0/3073584724 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c007260 con 0x7f8268158c20 2023-12-18T10:18:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82680c8800 con 0x7f8268158c20 2023-12-18T10:18:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826814d540 con 0x7f8268158c20 2023-12-18T10:18:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826814d700 con 0x7f8268158c20 2023-12-18T10:18:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f8264ff9640 1 -- 172.21.15.133:0/3073584724 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f825c0073c0 con 0x7f8268158c20 2023-12-18T10:18:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f8264ff9640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8254065a60 0x7f8254067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f8264ff9640 1 -- 172.21.15.133:0/3073584724 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f825c082780 con 0x7f8268158c20 2023-12-18T10:18:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.698+0000 7f8267fff640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8254065a60 0x7f8254067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:19.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.702+0000 7f8267fff640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8254065a60 0x7f8254067f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f82580ae000 tx=0x7f82580b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.702+0000 7f8264ff9640 1 -- 172.21.15.133:0/3073584724 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f825c04ff00 con 0x7f8268158c20 2023-12-18T10:18:19.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82680735b0 con 0x7f8268158c20 2023-12-18T10:18:19.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f8264ff9640 1 -- 172.21.15.133:0/3073584724 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f825c053520 con 0x7f8268158c20 2023-12-18T10:18:19.872 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:18:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8254065a60 msgr2=0x7f8254067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8254065a60 0x7f8254067f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f82580ae000 tx=0x7f82580b5040 comp rx=0 tx=0).stop 2023-12-18T10:18:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 msgr2=0x7f8268159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268159a70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c370 tx=0x7f825c00c830 comp rx=0 tx=0).stop 2023-12-18T10:18:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 shutdown_connections 2023-12-18T10:18:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8254065a60 0x7f8254067f20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f826815c800 0x7f8268159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8268158c20 0x7f8268159a70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 --2- 172.21.15.133:0/3073584724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82680cb180 0x7f826814c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 >> 172.21.15.133:0/3073584724 conn(0x7f826806a3e0 msgr2=0x7f8268155a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 shutdown_connections 2023-12-18T10:18:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:19.866+0000 7f826e3ce640 1 -- 172.21.15.133:0/3073584724 wait complete. 2023-12-18T10:18:19.893 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:18:19.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:19.893 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-18T10:18:19.924 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi133.stderr:ceph-fuse[44428]: fuse finished with error 0 and tester_r 0 2023-12-18T10:18:19.926 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:18:26.027 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:18:26.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:26.028 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-18T10:18:26.056 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:26.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.238+0000 7f35d73e9640 1 Processor -- start 2023-12-18T10:18:26.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.238+0000 7f35d73e9640 1 -- start start 2023-12-18T10:18:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.238+0000 7f35d73e9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35d006c4f0 0x7f35d00c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.238+0000 7f35d73e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d00c9e30 0x7f35d0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.238+0000 7f35d73e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00c9460 con 0x7f35d01570c0 2023-12-18T10:18:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.238+0000 7f35d73e9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d01574a0 con 0x7f35d006c4f0 2023-12-18T10:18:26.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.238+0000 7f35d73e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00c8b30 con 0x7f35d00c9e30 2023-12-18T10:18:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d5986640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d00c9e30 0x7f35d0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d4984640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35d006c4f0 0x7f35d00c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d5986640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d00c9e30 0x7f35d0070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:45412/0 (socket says 172.21.15.133:45412) 2023-12-18T10:18:26.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d5986640 1 -- 172.21.15.133:0/1086933580 learned_addr learned my addr 172.21.15.133:0/1086933580 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:26.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35c7fff640 1 -- 172.21.15.133:0/1086933580 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707510851 0 0) 0x7f35d00c9460 con 0x7f35d01570c0 2023-12-18T10:18:26.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35c7fff640 1 -- 172.21.15.133:0/1086933580 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc003530 con 0x7f35d01570c0 2023-12-18T10:18:26.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d5986640 1 -- 172.21.15.133:0/1086933580 >> v2:172.21.15.142:3300/0 conn(0x7f35d006c4f0 msgr2=0x7f35d00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:26.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d5986640 1 --2- 172.21.15.133:0/1086933580 >> v2:172.21.15.142:3300/0 conn(0x7f35d006c4f0 0x7f35d00c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d5986640 1 -- 172.21.15.133:0/1086933580 >> v1:172.21.15.142:6789/0 conn(0x7f35d01570c0 legacy=0x7f35d006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d5986640 1 -- 172.21.15.133:0/1086933580 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00c8e10 con 0x7f35d00c9e30 2023-12-18T10:18:26.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d4984640 1 --2- 172.21.15.133:0/1086933580 >> v2:172.21.15.142:3300/0 conn(0x7f35d006c4f0 0x7f35d00c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:26.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.242+0000 7f35d5986640 1 --2- 172.21.15.133:0/1086933580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d00c9e30 0x7f35d0070df0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009e50 tx=0x7f35c801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6350cad50d274eb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35c7fff640 1 -- 172.21.15.133:0/1086933580 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c80a5720 con 0x7f35d00c9e30 2023-12-18T10:18:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35c7fff640 1 -- 172.21.15.133:0/1086933580 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c80a5880 con 0x7f35d00c9e30 2023-12-18T10:18:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35c7fff640 1 -- 172.21.15.133:0/1086933580 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c80a5c10 con 0x7f35d00c9e30 2023-12-18T10:18:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- 172.21.15.133:0/1086933580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d00c9e30 msgr2=0x7f35d0070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 --2- 172.21.15.133:0/1086933580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d00c9e30 0x7f35d0070df0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009e50 tx=0x7f35c801c950 comp rx=0 tx=0).stop 2023-12-18T10:18:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- 172.21.15.133:0/1086933580 shutdown_connections 2023-12-18T10:18:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 --2- 172.21.15.133:0/1086933580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d00c9e30 0x7f35d0070df0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 --2- 172.21.15.133:0/1086933580 >> v2:172.21.15.142:3300/0 conn(0x7f35d006c4f0 0x7f35d00c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- 172.21.15.133:0/1086933580 >> 172.21.15.133:0/1086933580 conn(0x7f35d006a3e0 msgr2=0x7f35d00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- 172.21.15.133:0/1086933580 shutdown_connections 2023-12-18T10:18:26.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- 172.21.15.133:0/1086933580 wait complete. 2023-12-18T10:18:26.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 Processor -- start 2023-12-18T10:18:26.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- start start 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d006c4f0 0x7f35d00c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d00c9e30 0x7f35d014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d01570c0 0x7f35d0151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00c70e0 con 0x7f35d00c9e30 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00c73c0 con 0x7f35d01570c0 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.246+0000 7f35d73e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00c76a0 con 0x7f35d006c4f0 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d00c9e30 0x7f35d014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d00c9e30 0x7f35d014c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43698/0 (socket says 172.21.15.133:43698) 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 -- 172.21.15.133:0/878944183 learned_addr learned my addr 172.21.15.133:0/878944183 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d5185640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d006c4f0 0x7f35d00c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d5986640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d01570c0 0x7f35d0151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 -- 172.21.15.133:0/878944183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d006c4f0 msgr2=0x7f35d00c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d006c4f0 0x7f35d00c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 -- 172.21.15.133:0/878944183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d01570c0 msgr2=0x7f35d0151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d01570c0 0x7f35d0151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 -- 172.21.15.133:0/878944183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0009420 con 0x7f35d00c9e30 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d4984640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d00c9e30 0x7f35d014c760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35c000e980 tx=0x7f35c000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35c5ffb640 1 -- 172.21.15.133:0/878944183 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c000ca00 con 0x7f35d00c9e30 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35c5ffb640 1 -- 172.21.15.133:0/878944183 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c000cb60 con 0x7f35d00c9e30 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c8009b30 con 0x7f35d00c9e30 2023-12-18T10:18:26.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35c5ffb640 1 -- 172.21.15.133:0/878944183 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0013470 con 0x7f35d00c9e30 2023-12-18T10:18:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d00c3870 con 0x7f35d00c9e30 2023-12-18T10:18:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d00735b0 con 0x7f35d00c9e30 2023-12-18T10:18:26.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35c5ffb640 1 -- 172.21.15.133:0/878944183 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f35c00135d0 con 0x7f35d00c9e30 2023-12-18T10:18:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.250+0000 7f35c5ffb640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35b4065a60 0x7f35b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.254+0000 7f35c5ffb640 1 -- 172.21.15.133:0/878944183 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35c0083610 con 0x7f35d00c9e30 2023-12-18T10:18:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.254+0000 7f35d5185640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35b4065a60 0x7f35b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.254+0000 7f35d5185640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35b4065a60 0x7f35b4067f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0011f0 tx=0x7f35cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.258+0000 7f35c5ffb640 1 -- 172.21.15.133:0/878944183 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f35c0050d90 con 0x7f35d00c9e30 2023-12-18T10:18:26.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.410+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35d004e000 con 0x7f35d00c9e30 2023-12-18T10:18:26.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.410+0000 7f35c5ffb640 1 -- 172.21.15.133:0/878944183 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f35c00543b0 con 0x7f35d00c9e30 2023-12-18T10:18:26.414 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:26.414 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35b4065a60 msgr2=0x7f35b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35b4065a60 0x7f35b4067f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0011f0 tx=0x7f35cc009040 comp rx=0 tx=0).stop 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d00c9e30 msgr2=0x7f35d014c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d00c9e30 0x7f35d014c760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35c000e980 tx=0x7f35c000ee40 comp rx=0 tx=0).stop 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 shutdown_connections 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35b4065a60 0x7f35b4067f20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d01570c0 0x7f35d0151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d00c9e30 0x7f35d014c760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 --2- 172.21.15.133:0/878944183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d006c4f0 0x7f35d00c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 >> 172.21.15.133:0/878944183 conn(0x7f35d006a3e0 msgr2=0x7f35d00af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 shutdown_connections 2023-12-18T10:18:26.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.414+0000 7f35d73e9640 1 -- 172.21.15.133:0/878944183 wait complete. 2023-12-18T10:18:26.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:26.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f776d640 1 Processor -- start 2023-12-18T10:18:26.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f776d640 1 -- start start 2023-12-18T10:18:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f776d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80f0160cc0 0x7f80f00cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f776d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80f00c1280 0x7f80f00cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f776d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f006fdb0 con 0x7f80f00c17d0 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f776d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f01654a0 con 0x7f80f0160cc0 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f776d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f01610a0 con 0x7f80f00c1280 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f5509640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80f0160cc0 0x7f80f00cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f5509640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80f0160cc0 0x7f80f00cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43704/0 (socket says 172.21.15.133:43704) 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f5509640 1 -- 172.21.15.133:0/2112341587 learned_addr learned my addr 172.21.15.133:0/2112341587 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f5509640 1 -- 172.21.15.133:0/2112341587 >> v2:172.21.15.142:3300/0 conn(0x7f80f00c1280 msgr2=0x7f80f00cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f5509640 1 --2- 172.21.15.133:0/2112341587 >> v2:172.21.15.142:3300/0 conn(0x7f80f00c1280 0x7f80f00cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f5509640 1 -- 172.21.15.133:0/2112341587 >> v1:172.21.15.142:6789/0 conn(0x7f80f00c17d0 legacy=0x7f80f006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:26.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.570+0000 7f80f5509640 1 -- 172.21.15.133:0/2112341587 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00cb6b0 con 0x7f80f0160cc0 2023-12-18T10:18:26.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f5509640 1 --2- 172.21.15.133:0/2112341587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f0160cc0 0x7f80f00cac30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80f00c8ad0 tx=0x7f80ec01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964fad1638a0059 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80e7fff640 1 -- 172.21.15.133:0/2112341587 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0ab600 con 0x7f80f0160cc0 2023-12-18T10:18:26.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80e7fff640 1 -- 172.21.15.133:0/2112341587 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec0a7050 con 0x7f80f0160cc0 2023-12-18T10:18:26.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80e7fff640 1 -- 172.21.15.133:0/2112341587 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0ab980 con 0x7f80f0160cc0 2023-12-18T10:18:26.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f776d640 1 -- 172.21.15.133:0/2112341587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f0160cc0 msgr2=0x7f80f00cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f776d640 1 --2- 172.21.15.133:0/2112341587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f0160cc0 0x7f80f00cac30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f80f00c8ad0 tx=0x7f80ec01c400 comp rx=0 tx=0).stop 2023-12-18T10:18:26.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f776d640 1 -- 172.21.15.133:0/2112341587 shutdown_connections 2023-12-18T10:18:26.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f776d640 1 --2- 172.21.15.133:0/2112341587 >> v2:172.21.15.142:3300/0 conn(0x7f80f00c1280 0x7f80f00cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f776d640 1 --2- 172.21.15.133:0/2112341587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f0160cc0 0x7f80f00cac30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f776d640 1 -- 172.21.15.133:0/2112341587 >> 172.21.15.133:0/2112341587 conn(0x7f80f006a3e0 msgr2=0x7f80f00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:26.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f776d640 1 -- 172.21.15.133:0/2112341587 shutdown_connections 2023-12-18T10:18:26.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.574+0000 7f80f776d640 1 -- 172.21.15.133:0/2112341587 wait complete. 2023-12-18T10:18:26.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 Processor -- start 2023-12-18T10:18:26.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 -- start start 2023-12-18T10:18:26.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f00c1280 0x7f80f00c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f00c17d0 0x7f80f00b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f0160cc0 0x7f80f0156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00c40b0 con 0x7f80f00c17d0 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00b2370 con 0x7f80f00c1280 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00b2d40 con 0x7f80f0160cc0 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f00c17d0 0x7f80f00b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f00c17d0 0x7f80f00b2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43706/0 (socket says 172.21.15.133:43706) 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 -- 172.21.15.133:0/2452137614 learned_addr learned my addr 172.21.15.133:0/2452137614 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f5509640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f00c1280 0x7f80f00c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f5d0a640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f0160cc0 0x7f80f0156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 -- 172.21.15.133:0/2452137614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f0160cc0 msgr2=0x7f80f0156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f0160cc0 0x7f80f0156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 -- 172.21.15.133:0/2452137614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f00c1280 msgr2=0x7f80f00c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f00c1280 0x7f80f00c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 -- 172.21.15.133:0/2452137614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0094d0 con 0x7f80f00c17d0 2023-12-18T10:18:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f4d08640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f00c17d0 0x7f80f00b2800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f80e000b440 tx=0x7f80e000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80e5ffb640 1 -- 172.21.15.133:0/2452137614 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0011890 con 0x7f80f00c17d0 2023-12-18T10:18:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80e5ffb640 1 -- 172.21.15.133:0/2452137614 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0011a10 con 0x7f80f00c17d0 2023-12-18T10:18:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80e5ffb640 1 -- 172.21.15.133:0/2452137614 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0011dc0 con 0x7f80f00c17d0 2023-12-18T10:18:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.578+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f00c4780 con 0x7f80f00c17d0 2023-12-18T10:18:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.582+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f00b2000 con 0x7f80f00c17d0 2023-12-18T10:18:26.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.582+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f00735b0 con 0x7f80f00c17d0 2023-12-18T10:18:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.582+0000 7f80e5ffb640 1 -- 172.21.15.133:0/2452137614 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80e001a400 con 0x7f80f00c17d0 2023-12-18T10:18:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.582+0000 7f80e5ffb640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80d4065ab0 0x7f80d4067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.582+0000 7f80e5ffb640 1 -- 172.21.15.133:0/2452137614 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f80e0083630 con 0x7f80f00c17d0 2023-12-18T10:18:26.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.582+0000 7f80f5509640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80d4065ab0 0x7f80d4067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.582+0000 7f80f5509640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80d4065ab0 0x7f80d4067f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0ad000 tx=0x7f80ec0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.586+0000 7f80e5ffb640 1 -- 172.21.15.133:0/2452137614 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f80e0050e20 con 0x7f80f00c17d0 2023-12-18T10:18:26.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.738+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80f00b0c10 con 0x7f80f00c17d0 2023-12-18T10:18:26.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80e5ffb640 1 -- 172.21.15.133:0/2452137614 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f80e0054440 con 0x7f80f00c17d0 2023-12-18T10:18:26.743 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:26.743 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80d4065ab0 msgr2=0x7f80d4067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80d4065ab0 0x7f80d4067f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f80ec0ad000 tx=0x7f80ec0a6000 comp rx=0 tx=0).stop 2023-12-18T10:18:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f00c17d0 msgr2=0x7f80f00b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f00c17d0 0x7f80f00b2800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f80e000b440 tx=0x7f80e000b900 comp rx=0 tx=0).stop 2023-12-18T10:18:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 shutdown_connections 2023-12-18T10:18:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80d4065ab0 0x7f80d4067f70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80f0160cc0 0x7f80f0156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80f00c17d0 0x7f80f00b2800 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 --2- 172.21.15.133:0/2452137614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80f00c1280 0x7f80f00c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 >> 172.21.15.133:0/2452137614 conn(0x7f80f006a3e0 msgr2=0x7f80f0071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 shutdown_connections 2023-12-18T10:18:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.742+0000 7f80f776d640 1 -- 172.21.15.133:0/2452137614 wait complete. 2023-12-18T10:18:26.764 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-18T10:18:26.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492c066640 1 Processor -- start 2023-12-18T10:18:26.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492c066640 1 -- start start 2023-12-18T10:18:26.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492c066640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49241582d0 0x7f49240c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492c066640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4924070820 0x7f49240ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492c066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240ce3b0 0x7f49240ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492c066640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240ced80 con 0x7f4924070820 2023-12-18T10:18:26.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492c066640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240c9390 con 0x7f49241582d0 2023-12-18T10:18:26.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492c066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492415aee0 con 0x7f49240ce3b0 2023-12-18T10:18:26.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929601640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4924070820 0x7f49240ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929e02640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49241582d0 0x7f49240c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f492a603640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240ce3b0 0x7f49240ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929601640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4924070820 0x7f49240ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43708/0 (socket says 172.21.15.133:43708) 2023-12-18T10:18:26.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929601640 1 -- 172.21.15.133:0/342731859 learned_addr learned my addr 172.21.15.133:0/342731859 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:26.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929601640 1 -- 172.21.15.133:0/342731859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240ce3b0 msgr2=0x7f49240ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:26.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929601640 1 --2- 172.21.15.133:0/342731859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240ce3b0 0x7f49240ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929601640 1 -- 172.21.15.133:0/342731859 >> v2:172.21.15.142:3300/0 conn(0x7f49241582d0 msgr2=0x7f49240c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:26.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929601640 1 --2- 172.21.15.133:0/342731859 >> v2:172.21.15.142:3300/0 conn(0x7f49241582d0 0x7f49240c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.902+0000 7f4929601640 1 -- 172.21.15.133:0/342731859 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492415b1c0 con 0x7f4924070820 2023-12-18T10:18:26.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f4929601640 1 --2- 172.21.15.133:0/342731859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240ca5f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f49240cf000 tx=0x7f491401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a31fab865c0a86b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f4928e00640 1 -- 172.21.15.133:0/342731859 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140aa5f0 con 0x7f4924070820 2023-12-18T10:18:26.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f4928e00640 1 -- 172.21.15.133:0/342731859 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49140aa750 con 0x7f4924070820 2023-12-18T10:18:26.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f4928e00640 1 -- 172.21.15.133:0/342731859 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140aaae0 con 0x7f4924070820 2023-12-18T10:18:26.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 -- 172.21.15.133:0/342731859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 msgr2=0x7f49240ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 --2- 172.21.15.133:0/342731859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240ca5f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f49240cf000 tx=0x7f491401c4d0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 -- 172.21.15.133:0/342731859 shutdown_connections 2023-12-18T10:18:26.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 --2- 172.21.15.133:0/342731859 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49240ce3b0 0x7f49240ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 --2- 172.21.15.133:0/342731859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240ca5f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 --2- 172.21.15.133:0/342731859 >> v2:172.21.15.142:3300/0 conn(0x7f49241582d0 0x7f49240c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 -- 172.21.15.133:0/342731859 >> 172.21.15.133:0/342731859 conn(0x7f492406a2a0 msgr2=0x7f49240aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:26.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 -- 172.21.15.133:0/342731859 shutdown_connections 2023-12-18T10:18:26.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.906+0000 7f492c066640 1 -- 172.21.15.133:0/342731859 wait complete. 2023-12-18T10:18:26.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 Processor -- start 2023-12-18T10:18:26.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 -- start start 2023-12-18T10:18:26.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49240ce3b0 0x7f49241f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49241582d0 0x7f49240ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240ad340 con 0x7f4924070820 2023-12-18T10:18:26.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240ac7c0 con 0x7f49240ce3b0 2023-12-18T10:18:26.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240acaa0 con 0x7f49241582d0 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43720/0 (socket says 172.21.15.133:43720) 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 -- 172.21.15.133:0/2030982230 learned_addr learned my addr 172.21.15.133:0/2030982230 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492a603640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49241582d0 0x7f49240ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929601640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49240ce3b0 0x7f49241f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 -- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49241582d0 msgr2=0x7f49240ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49241582d0 0x7f49240ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 -- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49240ce3b0 msgr2=0x7f49241f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49240ce3b0 0x7f49241f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 -- 172.21.15.133:0/2030982230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49140094d0 con 0x7f4924070820 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929601640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49240ce3b0 0x7f49241f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f4929e02640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240abf00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f492000e930 tx=0x7f492000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f491a7fc640 1 -- 172.21.15.133:0/2030982230 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920009690 con 0x7f4924070820 2023-12-18T10:18:26.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f491a7fc640 1 -- 172.21.15.133:0/2030982230 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492000ca00 con 0x7f4924070820 2023-12-18T10:18:26.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f491a7fc640 1 -- 172.21.15.133:0/2030982230 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000cd70 con 0x7f4924070820 2023-12-18T10:18:26.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49240acd80 con 0x7f4924070820 2023-12-18T10:18:26.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.910+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49240ac440 con 0x7f4924070820 2023-12-18T10:18:26.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.914+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492404e000 con 0x7f4924070820 2023-12-18T10:18:26.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.914+0000 7f491a7fc640 1 -- 172.21.15.133:0/2030982230 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4920013470 con 0x7f4924070820 2023-12-18T10:18:26.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.914+0000 7f491a7fc640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4908065a60 0x7f4908067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:26.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.914+0000 7f491a7fc640 1 -- 172.21.15.133:0/2030982230 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4920083740 con 0x7f4924070820 2023-12-18T10:18:26.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.914+0000 7f4929601640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4908065a60 0x7f4908067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:26.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.914+0000 7f4929601640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4908065a60 0x7f4908067f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f49140ae000 tx=0x7f4914008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:26.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:26.918+0000 7f491a7fc640 1 -- 172.21.15.133:0/2030982230 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4920050e30 con 0x7f4924070820 2023-12-18T10:18:27.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.102+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f49240cbff0 con 0x7f4924070820 2023-12-18T10:18:27.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.930+0000 7f491a7fc640 1 -- 172.21.15.133:0/2030982230 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4920054450 con 0x7f4924070820 2023-12-18T10:18:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4908065a60 msgr2=0x7f4908067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4908065a60 0x7f4908067f20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f49140ae000 tx=0x7f4914008040 comp rx=0 tx=0).stop 2023-12-18T10:18:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 msgr2=0x7f49240abf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240abf00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f492000e930 tx=0x7f492000edf0 comp rx=0 tx=0).stop 2023-12-18T10:18:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 shutdown_connections 2023-12-18T10:18:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4908065a60 0x7f4908067f20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:27.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49241582d0 0x7f49240ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:27.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49240ce3b0 0x7f49241f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:27.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 --2- 172.21.15.133:0/2030982230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4924070820 0x7f49240abf00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:27.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 >> 172.21.15.133:0/2030982230 conn(0x7f492406a2a0 msgr2=0x7f4924159540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:27.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 shutdown_connections 2023-12-18T10:18:27.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:27.934+0000 7f492c066640 1 -- 172.21.15.133:0/2030982230 wait complete. 2023-12-18T10:18:27.959 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-18T10:18:27.959 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-18T10:18:28.064 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:18:28.067 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:18:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.102+0000 7f594c495640 1 Processor -- start 2023-12-18T10:18:28.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.102+0000 7f594c495640 1 -- start start 2023-12-18T10:18:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.102+0000 7f594c495640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f59440cde90 0x7f59440ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:28.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.102+0000 7f594c495640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594415cec0 con 0x7f594415cae0 2023-12-18T10:18:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.102+0000 7f594c495640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440d0530 con 0x7f59440cf170 2023-12-18T10:18:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.102+0000 7f594c495640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440d0810 con 0x7f59440cde90 2023-12-18T10:18:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.102+0000 7f594a231640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f594415cae0 0x7f59440d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39388/0 (socket says 172.21.15.133:39388) 2023-12-18T10:18:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.102+0000 7f594a231640 1 -- 172.21.15.133:0/3549601563 learned_addr learned my addr 172.21.15.133:0/3549601563 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:28.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f5949a30640 1 --2- 172.21.15.133:0/3549601563 >> v2:172.21.15.142:3300/0 conn(0x7f59440cde90 0x7f59440ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f594922f640 1 -- 172.21.15.133:0/3549601563 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565589278 0 0) 0x7f594415cec0 con 0x7f594415cae0 2023-12-18T10:18:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f594922f640 1 -- 172.21.15.133:0/3549601563 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5930003530 con 0x7f594415cae0 2023-12-18T10:18:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f594922f640 1 -- 172.21.15.133:0/3549601563 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359139994 0 0) 0x7f59440d0530 con 0x7f59440cf170 2023-12-18T10:18:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f594922f640 1 -- 172.21.15.133:0/3549601563 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f594415cec0 con 0x7f59440cf170 2023-12-18T10:18:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f5949a30640 1 -- 172.21.15.133:0/3549601563 >> v1:172.21.15.142:6789/0 conn(0x7f59440cf170 legacy=0x7f594406add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f5949a30640 1 -- 172.21.15.133:0/3549601563 >> v1:172.21.15.133:6789/0 conn(0x7f594415cae0 legacy=0x7f59440d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:28.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f5949a30640 1 -- 172.21.15.133:0/3549601563 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59440d0af0 con 0x7f59440cde90 2023-12-18T10:18:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f5949a30640 1 --2- 172.21.15.133:0/3549601563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cde90 0x7f59440ce2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f59340097c0 tx=0x7f593401ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3597ef303d51afcb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f594922f640 1 -- 172.21.15.133:0/3549601563 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59340ab670 con 0x7f59440cde90 2023-12-18T10:18:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f594922f640 1 -- 172.21.15.133:0/3549601563 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59340ab7d0 con 0x7f59440cde90 2023-12-18T10:18:28.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.106+0000 7f594922f640 1 -- 172.21.15.133:0/3549601563 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59340abb60 con 0x7f59440cde90 2023-12-18T10:18:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- 172.21.15.133:0/3549601563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cde90 msgr2=0x7f59440ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 --2- 172.21.15.133:0/3549601563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cde90 0x7f59440ce2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f59340097c0 tx=0x7f593401ceb0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- 172.21.15.133:0/3549601563 shutdown_connections 2023-12-18T10:18:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 --2- 172.21.15.133:0/3549601563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cde90 0x7f59440ce2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- 172.21.15.133:0/3549601563 >> 172.21.15.133:0/3549601563 conn(0x7f5944089fb0 msgr2=0x7f59440d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- 172.21.15.133:0/3549601563 shutdown_connections 2023-12-18T10:18:28.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- 172.21.15.133:0/3549601563 wait complete. 2023-12-18T10:18:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 Processor -- start 2023-12-18T10:18:28.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- start start 2023-12-18T10:18:28.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59440cde90 0x7f59440b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:28.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cf170 0x7f59440c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:28.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594415cae0 0x7f59440c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:28.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440b6360 con 0x7f594415cae0 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440b5750 con 0x7f59440cf170 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594c495640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59440b5a30 con 0x7f59440cde90 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594aa32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594415cae0 0x7f59440c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594aa32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594415cae0 0x7f59440c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43728/0 (socket says 172.21.15.133:43728) 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594aa32640 1 -- 172.21.15.133:0/1400561458 learned_addr learned my addr 172.21.15.133:0/1400561458 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594aa32640 1 -- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59440cde90 msgr2=0x7f59440b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.110+0000 7f594a231640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59440cde90 0x7f59440b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f5949a30640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cf170 0x7f59440c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594aa32640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59440cde90 0x7f59440b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594aa32640 1 -- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cf170 msgr2=0x7f59440c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594aa32640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cf170 0x7f59440c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594aa32640 1 -- 172.21.15.133:0/1400561458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5934009420 con 0x7f594415cae0 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f5949a30640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cf170 0x7f59440c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:28.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594aa32640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594415cae0 0x7f59440c7f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c730 tx=0x7f593c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:28.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f593affd640 1 -- 172.21.15.133:0/1400561458 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c003b80 con 0x7f594415cae0 2023-12-18T10:18:28.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f593affd640 1 -- 172.21.15.133:0/1400561458 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c003ce0 con 0x7f594415cae0 2023-12-18T10:18:28.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f593affd640 1 -- 172.21.15.133:0/1400561458 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00aa90 con 0x7f594415cae0 2023-12-18T10:18:28.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59440cfb10 con 0x7f594415cae0 2023-12-18T10:18:28.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59440b5ff0 con 0x7f594415cae0 2023-12-18T10:18:28.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59440b64d0 con 0x7f594415cae0 2023-12-18T10:18:28.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f593affd640 1 -- 172.21.15.133:0/1400561458 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f593c00abf0 con 0x7f594415cae0 2023-12-18T10:18:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f593affd640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5928065a90 0x7f5928067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f593affd640 1 -- 172.21.15.133:0/1400561458 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f593c083350 con 0x7f594415cae0 2023-12-18T10:18:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.114+0000 7f594a231640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5928065a90 0x7f5928067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:28.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.118+0000 7f594a231640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5928065a90 0x7f5928067f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59400010f0 tx=0x7f5940009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:28.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.118+0000 7f593affd640 1 -- 172.21.15.133:0/1400561458 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f593c050980 con 0x7f594415cae0 2023-12-18T10:18:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.302+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f594404e000 con 0x7f594415cae0 2023-12-18T10:18:28.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.934+0000 7f593affd640 1 -- 172.21.15.133:0/1400561458 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f593c053fa0 con 0x7f594415cae0 2023-12-18T10:18:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5928065a90 msgr2=0x7f5928067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5928065a90 0x7f5928067f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59400010f0 tx=0x7f5940009040 comp rx=0 tx=0).stop 2023-12-18T10:18:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594415cae0 msgr2=0x7f59440c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594415cae0 0x7f59440c7f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f593c00c730 tx=0x7f593c00cbf0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 shutdown_connections 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5928065a90 0x7f5928067f50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f594415cae0 0x7f59440c7f90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59440cf170 0x7f59440c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 --2- 172.21.15.133:0/1400561458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f59440cde90 0x7f59440b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 >> 172.21.15.133:0/1400561458 conn(0x7f5944089fb0 msgr2=0x7f59440cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 shutdown_connections 2023-12-18T10:18:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:28.938+0000 7f594c495640 1 -- 172.21.15.133:0/1400561458 wait complete. 2023-12-18T10:18:28.963 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-18T10:18:28.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:18:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f772a62d640 1 Processor -- start 2023-12-18T10:18:29.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f772a62d640 1 -- start start 2023-12-18T10:18:29.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f772a62d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f77240704c0 0x7f772415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f772a62d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772415f100 con 0x7f77240cac10 2023-12-18T10:18:29.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f772a62d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240ca7d0 con 0x7f772415a680 2023-12-18T10:18:29.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f772a62d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772415e860 con 0x7f77240704c0 2023-12-18T10:18:29.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f77237fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f77240cac10 0x7f772406fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39398/0 (socket says 172.21.15.133:39398) 2023-12-18T10:18:29.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f77237fe640 1 -- 172.21.15.133:0/1645317279 learned_addr learned my addr 172.21.15.133:0/1645317279 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.146+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242990328 0 0) 0x7f772415f100 con 0x7f77240cac10 2023-12-18T10:18:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7728bca640 1 --2- 172.21.15.133:0/1645317279 >> v2:172.21.15.142:3300/0 conn(0x7f77240704c0 0x7f772415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f770c003530 con 0x7f77240cac10 2023-12-18T10:18:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 968756805 0 0) 0x7f770c003530 con 0x7f77240cac10 2023-12-18T10:18:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 >> v2:172.21.15.142:3300/0 conn(0x7f77240704c0 msgr2=0x7f772415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 --2- 172.21.15.133:0/1645317279 >> v2:172.21.15.142:3300/0 conn(0x7f77240704c0 0x7f772415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 >> v1:172.21.15.142:6789/0 conn(0x7f772415a680 legacy=0x7f772415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772415eb40 con 0x7f77240cac10 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f7718001680 con 0x7f77240cac10 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 >> v1:172.21.15.133:6789/0 conn(0x7f77240cac10 legacy=0x7f772406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f770c003980 0x7f770c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f770c0047d0 0x7f770c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c005190 0x7f770c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772415e860 con 0x7f770c003980 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c00c130 con 0x7f770c0047d0 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c00c2f0 con 0x7f770c005190 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7723fff640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f770c003980 0x7f770c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f77237fe640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f770c0047d0 0x7f770c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7728bca640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c005190 0x7f770c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7723fff640 1 -- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c005190 msgr2=0x7f770c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7723fff640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c005190 0x7f770c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7723fff640 1 -- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f770c0047d0 msgr2=0x7f770c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7723fff640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f770c0047d0 0x7f770c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7723fff640 1 -- 172.21.15.133:0/1645317279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c003530 con 0x7f770c003980 2023-12-18T10:18:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7728bca640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c005190 0x7f770c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:29.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.150+0000 7f7728bca640 1 -- 172.21.15.133:0/1645317279 reap_dead start 2023-12-18T10:18:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f7723fff640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f770c003980 0x7f770c003da0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7714001780 tx=0x7f771401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0c52607fb884f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140052d0 con 0x7f770c003980 2023-12-18T10:18:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77140a7050 con 0x7f770c003980 2023-12-18T10:18:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f7722ffd640 1 -- 172.21.15.133:0/1645317279 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714003600 con 0x7f770c003980 2023-12-18T10:18:29.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 -- 172.21.15.133:0/1645317279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f770c003980 msgr2=0x7f770c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f770c003980 0x7f770c003da0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7714001780 tx=0x7f771401c3b0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 -- 172.21.15.133:0/1645317279 shutdown_connections 2023-12-18T10:18:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 --2- 172.21.15.133:0/1645317279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f770c003980 0x7f770c003da0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 -- 172.21.15.133:0/1645317279 >> 172.21.15.133:0/1645317279 conn(0x7f772406a3e0 msgr2=0x7f77240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 -- 172.21.15.133:0/1645317279 shutdown_connections 2023-12-18T10:18:29.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 -- 172.21.15.133:0/1645317279 wait complete. 2023-12-18T10:18:29.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 Processor -- start 2023-12-18T10:18:29.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 -- start start 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c003980 0x7f772414d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.154+0000 7f772a62d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77240b2a80 0x7f77240ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f772a62d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772415d540 0x7f772415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f772a62d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772415df00 con 0x7f772415d540 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f772a62d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240b3020 con 0x7f77240b2a80 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f772a62d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240b3300 con 0x7f770c003980 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772415d540 0x7f772415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772415d540 0x7f772415d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43752/0 (socket says 172.21.15.133:43752) 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 -- 172.21.15.133:0/2433906149 learned_addr learned my addr 172.21.15.133:0/2433906149 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7723fff640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c003980 0x7f772414d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f77237fe640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77240b2a80 0x7f77240ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 -- 172.21.15.133:0/2433906149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c003980 msgr2=0x7f772414d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c003980 0x7f772414d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 -- 172.21.15.133:0/2433906149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77240b2a80 msgr2=0x7f77240ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77240b2a80 0x7f77240ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 -- 172.21.15.133:0/2433906149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240b35e0 con 0x7f772415d540 2023-12-18T10:18:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7728bca640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772415d540 0x7f772415d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f77240718f0 tx=0x7f771c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7720ff9640 1 -- 172.21.15.133:0/2433906149 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c01b070 con 0x7f772415d540 2023-12-18T10:18:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7720ff9640 1 -- 172.21.15.133:0/2433906149 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c00f040 con 0x7f772415d540 2023-12-18T10:18:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77240b38c0 con 0x7f772415d540 2023-12-18T10:18:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7720ff9640 1 -- 172.21.15.133:0/2433906149 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c00e050 con 0x7f772415d540 2023-12-18T10:18:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772414dbf0 con 0x7f772415d540 2023-12-18T10:18:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77240735b0 con 0x7f772415d540 2023-12-18T10:18:29.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.158+0000 7f7720ff9640 1 -- 172.21.15.133:0/2433906149 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f771c003be0 con 0x7f772415d540 2023-12-18T10:18:29.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.162+0000 7f7720ff9640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7710065a60 0x7f7710067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.162+0000 7f7720ff9640 1 -- 172.21.15.133:0/2433906149 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f771c0836b0 con 0x7f772415d540 2023-12-18T10:18:29.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.162+0000 7f7723fff640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7710065a60 0x7f7710067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.162+0000 7f7723fff640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7710065a60 0x7f7710067f20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7714001750 tx=0x7f77140011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.166+0000 7f7720ff9640 1 -- 172.21.15.133:0/2433906149 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f771c050ec0 con 0x7f772415d540 2023-12-18T10:18:29.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.350+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f772404e000 con 0x7f772415d540 2023-12-18T10:18:29.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.350+0000 7f7720ff9640 1 -- 172.21.15.133:0/2433906149 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f771c0544e0 con 0x7f772415d540 2023-12-18T10:18:29.354 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:29.354 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:28.930501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-18T10:18:29.354 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 9 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7710065a60 msgr2=0x7f7710067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7710065a60 0x7f7710067f20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7714001750 tx=0x7f77140011a0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772415d540 msgr2=0x7f772415d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772415d540 0x7f772415d9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f77240718f0 tx=0x7f771c010590 comp rx=0 tx=0).stop 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 shutdown_connections 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7710065a60 0x7f7710067f20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772415d540 0x7f772415d9c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77240b2a80 0x7f77240ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 --2- 172.21.15.133:0/2433906149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f770c003980 0x7f772414d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 >> 172.21.15.133:0/2433906149 conn(0x7f772406a3e0 msgr2=0x7f77240ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 shutdown_connections 2023-12-18T10:18:29.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.354+0000 7f772a62d640 1 -- 172.21.15.133:0/2433906149 wait complete. 2023-12-18T10:18:29.375 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31c9afc640 1 Processor -- start 2023-12-18T10:18:29.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31c9afc640 1 -- start start 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31c9afc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c4160cc0 0x7f31c40cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31c9afc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31c40c1280 0x7f31c40cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31c9afc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c406fdb0 con 0x7f31c40c17d0 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31c9afc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c41654a0 con 0x7f31c40c1280 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31c9afc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c41610a0 con 0x7f31c4160cc0 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31bbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31c40c1280 0x7f31c40cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31bbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31c40c1280 0x7f31c40cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43760/0 (socket says 172.21.15.133:43760) 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31bbfff640 1 -- 172.21.15.133:0/277569306 learned_addr learned my addr 172.21.15.133:0/277569306 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.510+0000 7f31c37fe640 1 --2- 172.21.15.133:0/277569306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c4160cc0 0x7f31c40cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31bbfff640 1 -- 172.21.15.133:0/277569306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c4160cc0 msgr2=0x7f31c40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31bbfff640 1 --2- 172.21.15.133:0/277569306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c4160cc0 0x7f31c40cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31bbfff640 1 -- 172.21.15.133:0/277569306 >> v1:172.21.15.142:6789/0 conn(0x7f31c40c17d0 legacy=0x7f31c406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31bbfff640 1 -- 172.21.15.133:0/277569306 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c40cb6b0 con 0x7f31c40c1280 2023-12-18T10:18:29.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31bbfff640 1 --2- 172.21.15.133:0/277569306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c40cb170 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0098a0 tx=0x7f31ac01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e389556f0c879dd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c2ffd640 1 -- 172.21.15.133:0/277569306 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0ac600 con 0x7f31c40c1280 2023-12-18T10:18:29.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c2ffd640 1 -- 172.21.15.133:0/277569306 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac0a8050 con 0x7f31c40c1280 2023-12-18T10:18:29.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c2ffd640 1 -- 172.21.15.133:0/277569306 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0ac980 con 0x7f31c40c1280 2023-12-18T10:18:29.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c9afc640 1 -- 172.21.15.133:0/277569306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 msgr2=0x7f31c40cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c9afc640 1 --2- 172.21.15.133:0/277569306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c40cb170 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0098a0 tx=0x7f31ac01c460 comp rx=0 tx=0).stop 2023-12-18T10:18:29.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c9afc640 1 -- 172.21.15.133:0/277569306 shutdown_connections 2023-12-18T10:18:29.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c9afc640 1 --2- 172.21.15.133:0/277569306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c40cb170 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c9afc640 1 --2- 172.21.15.133:0/277569306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c4160cc0 0x7f31c40cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.514+0000 7f31c9afc640 1 -- 172.21.15.133:0/277569306 >> 172.21.15.133:0/277569306 conn(0x7f31c406a3e0 msgr2=0x7f31c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:29.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 -- 172.21.15.133:0/277569306 shutdown_connections 2023-12-18T10:18:29.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 -- 172.21.15.133:0/277569306 wait complete. 2023-12-18T10:18:29.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 Processor -- start 2023-12-18T10:18:29.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 -- start start 2023-12-18T10:18:29.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c4153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c40c17d0 0x7f31c40c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c4160cc0 0x7f31c40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4154190 con 0x7f31c40c1280 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4154ff0 con 0x7f31c4160cc0 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4155a10 con 0x7f31c40c17d0 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c4153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c4153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43774/0 (socket says 172.21.15.133:43774) 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 -- 172.21.15.133:0/816840780 learned_addr learned my addr 172.21.15.133:0/816840780 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c3fff640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c4160cc0 0x7f31c40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31bbfff640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c40c17d0 0x7f31c40c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 -- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c40c17d0 msgr2=0x7f31c40c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c40c17d0 0x7f31c40c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 -- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c4160cc0 msgr2=0x7f31c40b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c4160cc0 0x7f31c40b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 -- 172.21.15.133:0/816840780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0094d0 con 0x7f31c40c1280 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c3fff640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c4160cc0 0x7f31c40b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31bbfff640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c40c17d0 0x7f31c40c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c37fe640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c4153a60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31b400e8a0 tx=0x7f31b400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c0ff9640 1 -- 172.21.15.133:0/816840780 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4009510 con 0x7f31c40c1280 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c0ff9640 1 -- 172.21.15.133:0/816840780 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b400c940 con 0x7f31c40c1280 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c4153fa0 con 0x7f31c40c1280 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.518+0000 7f31c0ff9640 1 -- 172.21.15.133:0/816840780 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400ccb0 con 0x7f31c40c1280 2023-12-18T10:18:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.522+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c41546c0 con 0x7f31c40c1280 2023-12-18T10:18:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.522+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c40735b0 con 0x7f31c40c1280 2023-12-18T10:18:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.522+0000 7f31c0ff9640 1 -- 172.21.15.133:0/816840780 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31b4013470 con 0x7f31c40c1280 2023-12-18T10:18:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.522+0000 7f31c0ff9640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.522+0000 7f31c0ff9640 1 -- 172.21.15.133:0/816840780 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31b4083630 con 0x7f31c40c1280 2023-12-18T10:18:29.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.522+0000 7f31bbfff640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.522+0000 7f31bbfff640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0ae000 tx=0x7f31ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.526+0000 7f31c0ff9640 1 -- 172.21.15.133:0/816840780 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f31b4050c60 con 0x7f31c40c1280 2023-12-18T10:18:29.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.682+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31c404e000 con 0x7f31c40c1280 2023-12-18T10:18:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.682+0000 7f31c0ff9640 1 -- 172.21.15.133:0/816840780 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f31b4054280 con 0x7f31c40c1280 2023-12-18T10:18:29.685 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:29.686 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:29.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 msgr2=0x7f31a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0ae000 tx=0x7f31ac008040 comp rx=0 tx=0).stop 2023-12-18T10:18:29.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 msgr2=0x7f31c4153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c4153a60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31b400e8a0 tx=0x7f31b400eca0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 shutdown_connections 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c4160cc0 0x7f31c40b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c40c17d0 0x7f31c40c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 --2- 172.21.15.133:0/816840780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c40c1280 0x7f31c4153a60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 >> 172.21.15.133:0/816840780 conn(0x7f31c406a3e0 msgr2=0x7f31c40705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 shutdown_connections 2023-12-18T10:18:29.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.686+0000 7f31c9afc640 1 -- 172.21.15.133:0/816840780 wait complete. 2023-12-18T10:18:29.706 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-18T10:18:29.707 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:18:29.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.838+0000 7f136b59e640 1 Processor -- start 2023-12-18T10:18:29.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.838+0000 7f136b59e640 1 -- start start 2023-12-18T10:18:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f136b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c143cf0 0x7f136c0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f136b59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f136c069d80 0x7f136c06a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f136b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c15b950 con 0x7f136c0715f0 2023-12-18T10:18:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f136b59e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c06a720 con 0x7f136c069d80 2023-12-18T10:18:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f136b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0ce480 con 0x7f136c143cf0 2023-12-18T10:18:29.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f1363fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f136c069d80 0x7f136c06a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f1363fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f136c069d80 0x7f136c06a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43784/0 (socket says 172.21.15.133:43784) 2023-12-18T10:18:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f1363fff640 1 -- 172.21.15.133:0/1494136792 learned_addr learned my addr 172.21.15.133:0/1494136792 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f1363fff640 1 -- 172.21.15.133:0/1494136792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c143cf0 msgr2=0x7f136c0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f1363fff640 1 --2- 172.21.15.133:0/1494136792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c143cf0 0x7f136c0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f1363fff640 1 -- 172.21.15.133:0/1494136792 >> v1:172.21.15.142:6789/0 conn(0x7f136c0715f0 legacy=0x7f136c15e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:29.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.842+0000 7f1363fff640 1 -- 172.21.15.133:0/1494136792 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c15aa80 con 0x7f136c069d80 2023-12-18T10:18:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f1363fff640 1 --2- 172.21.15.133:0/1494136792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c069d80 0x7f136c06a1e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1354009870 tx=0x7f135401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d49bfb4f4a477d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f1369d9b640 1 -- 172.21.15.133:0/1494136792 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540aa5f0 con 0x7f136c069d80 2023-12-18T10:18:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f1369d9b640 1 -- 172.21.15.133:0/1494136792 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13540aa750 con 0x7f136c069d80 2023-12-18T10:18:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f1369d9b640 1 -- 172.21.15.133:0/1494136792 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540aaae0 con 0x7f136c069d80 2023-12-18T10:18:29.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 -- 172.21.15.133:0/1494136792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c069d80 msgr2=0x7f136c06a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 --2- 172.21.15.133:0/1494136792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c069d80 0x7f136c06a1e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1354009870 tx=0x7f135401c4d0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 -- 172.21.15.133:0/1494136792 shutdown_connections 2023-12-18T10:18:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 --2- 172.21.15.133:0/1494136792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c069d80 0x7f136c06a1e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 --2- 172.21.15.133:0/1494136792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c143cf0 0x7f136c0cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 -- 172.21.15.133:0/1494136792 >> 172.21.15.133:0/1494136792 conn(0x7f136c0b0ea0 msgr2=0x7f136c0b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 -- 172.21.15.133:0/1494136792 shutdown_connections 2023-12-18T10:18:29.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 -- 172.21.15.133:0/1494136792 wait complete. 2023-12-18T10:18:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 Processor -- start 2023-12-18T10:18:29.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.846+0000 7f136b59e640 1 -- start start 2023-12-18T10:18:29.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f136c069d80 0x7f136c13cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c0715f0 0x7f136c160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c143cf0 0x7f136c162b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c161320 con 0x7f136c143cf0 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c15ef10 con 0x7f136c069d80 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c15f1f0 con 0x7f136c0715f0 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c143cf0 0x7f136c162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c143cf0 0x7f136c162b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43788/0 (socket says 172.21.15.133:43788) 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 -- 172.21.15.133:0/3985294537 learned_addr learned my addr 172.21.15.133:0/3985294537 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f1363fff640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c0715f0 0x7f136c160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136a59c640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f136c069d80 0x7f136c13cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 -- 172.21.15.133:0/3985294537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c0715f0 msgr2=0x7f136c160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c0715f0 0x7f136c160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 -- 172.21.15.133:0/3985294537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f136c069d80 msgr2=0x7f136c13cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f136c069d80 0x7f136c13cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:29.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 -- 172.21.15.133:0/3985294537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540094d0 con 0x7f136c143cf0 2023-12-18T10:18:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136ad9d640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c143cf0 0x7f136c162b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f136400c780 tx=0x7f136400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f1362ffd640 1 -- 172.21.15.133:0/3985294537 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364003d90 con 0x7f136c143cf0 2023-12-18T10:18:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f1362ffd640 1 -- 172.21.15.133:0/3985294537 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136400ce90 con 0x7f136c143cf0 2023-12-18T10:18:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f1362ffd640 1 -- 172.21.15.133:0/3985294537 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13640052b0 con 0x7f136c143cf0 2023-12-18T10:18:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c15f4d0 con 0x7f136c143cf0 2023-12-18T10:18:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c13d150 con 0x7f136c143cf0 2023-12-18T10:18:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c15f710 con 0x7f136c143cf0 2023-12-18T10:18:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.850+0000 7f1362ffd640 1 -- 172.21.15.133:0/3985294537 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1364005410 con 0x7f136c143cf0 2023-12-18T10:18:29.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.854+0000 7f1362ffd640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f134c065a60 0x7f134c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.854+0000 7f1362ffd640 1 -- 172.21.15.133:0/3985294537 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1364082850 con 0x7f136c143cf0 2023-12-18T10:18:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.854+0000 7f136a59c640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f134c065a60 0x7f134c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.854+0000 7f136a59c640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f134c065a60 0x7f134c067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f135c0098f0 tx=0x7f135c006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:29.858+0000 7f1362ffd640 1 -- 172.21.15.133:0/3985294537 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f136c15f710 con 0x7f136c143cf0 2023-12-18T10:18:30.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.006+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f136c15b5e0 con 0x7f134c065a60 2023-12-18T10:18:30.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.018+0000 7f1362ffd640 1 -- 172.21.15.133:0/3985294537 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345284 (secure 0 0 0) 0x7f135c009540 con 0x7f134c065a60 2023-12-18T10:18:30.022 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:30.026 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f134c065a60 msgr2=0x7f134c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f134c065a60 0x7f134c067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f135c0098f0 tx=0x7f135c006f90 comp rx=0 tx=0).stop 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c143cf0 msgr2=0x7f136c162b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c143cf0 0x7f136c162b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f136400c780 tx=0x7f136400cc40 comp rx=0 tx=0).stop 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 shutdown_connections 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f134c065a60 0x7f134c067f20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c143cf0 0x7f136c162b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f136c0715f0 0x7f136c160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 --2- 172.21.15.133:0/3985294537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f136c069d80 0x7f136c13cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 >> 172.21.15.133:0/3985294537 conn(0x7f136c0b0ea0 msgr2=0x7f136c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 shutdown_connections 2023-12-18T10:18:30.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.022+0000 7f136b59e640 1 -- 172.21.15.133:0/3985294537 wait complete. 2023-12-18T10:18:30.044 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-12-18T10:18:29.100040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1988164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002569"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647104+0000","last_change":"2023-12-18T10:18:05.252867+0000","last_active":"2023-12-18T10:18:09.647104+0000","last_peered":"2023-12-18T10:18:09.647104+0000","last_clean":"2023-12-18T10:18:09.647104+0000","last_became_active":"2023-12-18T10:18:05.252419+0000","last_became_peered":"2023-12-18T10:18:05.252419+0000","last_unstale":"2023-12-18T10:18:09.647104+0000","last_undegraded":"2023-12-18T10:18:09.647104+0000","last_fullsized":"2023-12-18T10:18:09.647104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:47:42.905512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645468+0000","last_change":"2023-12-18T10:18:05.643046+0000","last_active":"2023-12-18T10:18:09.645468+0000","last_peered":"2023-12-18T10:18:09.645468+0000","last_clean":"2023-12-18T10:18:09.645468+0000","last_became_active":"2023-12-18T10:18:05.642791+0000","last_became_peered":"2023-12-18T10:18:05.642791+0000","last_unstale":"2023-12-18T10:18:09.645468+0000","last_undegraded":"2023-12-18T10:18:09.645468+0000","last_fullsized":"2023-12-18T10:18:09.645468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034832+0000","last_change":"2023-12-18T10:18:09.709220+0000","last_active":"2023-12-18T10:18:10.034832+0000","last_peered":"2023-12-18T10:18:10.034832+0000","last_clean":"2023-12-18T10:18:10.034832+0000","last_became_active":"2023-12-18T10:18:09.708175+0000","last_became_peered":"2023-12-18T10:18:09.708175+0000","last_unstale":"2023-12-18T10:18:10.034832+0000","last_undegraded":"2023-12-18T10:18:10.034832+0000","last_fullsized":"2023-12-18T10:18:10.034832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:02.059562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648001+0000","last_change":"2023-12-18T10:18:05.240468+0000","last_active":"2023-12-18T10:18:09.648001+0000","last_peered":"2023-12-18T10:18:09.648001+0000","last_clean":"2023-12-18T10:18:09.648001+0000","last_became_active":"2023-12-18T10:18:05.239955+0000","last_became_peered":"2023-12-18T10:18:05.239955+0000","last_unstale":"2023-12-18T10:18:09.648001+0000","last_undegraded":"2023-12-18T10:18:09.648001+0000","last_fullsized":"2023-12-18T10:18:09.648001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646951+0000","last_change":"2023-12-18T10:18:05.648087+0000","last_active":"2023-12-18T10:18:09.646951+0000","last_peered":"2023-12-18T10:18:09.646951+0000","last_clean":"2023-12-18T10:18:09.646951+0000","last_became_active":"2023-12-18T10:18:05.647265+0000","last_became_peered":"2023-12-18T10:18:05.647265+0000","last_unstale":"2023-12-18T10:18:09.646951+0000","last_undegraded":"2023-12-18T10:18:09.646951+0000","last_fullsized":"2023-12-18T10:18:09.646951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:15.127242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171471+0000","last_change":"2023-12-18T10:18:09.667338+0000","last_active":"2023-12-18T10:18:11.171471+0000","last_peered":"2023-12-18T10:18:11.171471+0000","last_clean":"2023-12-18T10:18:11.171471+0000","last_became_active":"2023-12-18T10:18:09.666888+0000","last_became_peered":"2023-12-18T10:18:09.666888+0000","last_unstale":"2023-12-18T10:18:11.171471+0000","last_undegraded":"2023-12-18T10:18:11.171471+0000","last_fullsized":"2023-12-18T10:18:11.171471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:21.579648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704718+0000","last_change":"2023-12-18T10:18:05.255666+0000","last_active":"2023-12-18T10:18:09.704718+0000","last_peered":"2023-12-18T10:18:09.704718+0000","last_clean":"2023-12-18T10:18:09.704718+0000","last_became_active":"2023-12-18T10:18:05.255121+0000","last_became_peered":"2023-12-18T10:18:05.255121+0000","last_unstale":"2023-12-18T10:18:09.704718+0000","last_undegraded":"2023-12-18T10:18:09.704718+0000","last_fullsized":"2023-12-18T10:18:09.704718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:19.309867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646594+0000","last_change":"2023-12-18T10:18:05.651636+0000","last_active":"2023-12-18T10:18:09.646594+0000","last_peered":"2023-12-18T10:18:09.646594+0000","last_clean":"2023-12-18T10:18:09.646594+0000","last_became_active":"2023-12-18T10:18:05.651333+0000","last_became_peered":"2023-12-18T10:18:05.651333+0000","last_unstale":"2023-12-18T10:18:09.646594+0000","last_undegraded":"2023-12-18T10:18:09.646594+0000","last_fullsized":"2023-12-18T10:18:09.646594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171893+0000","last_change":"2023-12-18T10:18:09.672786+0000","last_active":"2023-12-18T10:18:11.171893+0000","last_peered":"2023-12-18T10:18:11.171893+0000","last_clean":"2023-12-18T10:18:11.171893+0000","last_became_active":"2023-12-18T10:18:09.672297+0000","last_became_peered":"2023-12-18T10:18:09.672297+0000","last_unstale":"2023-12-18T10:18:11.171893+0000","last_undegraded":"2023-12-18T10:18:11.171893+0000","last_fullsized":"2023-12-18T10:18:11.171893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704387+0000","last_change":"2023-12-18T10:18:05.259470+0000","last_active":"2023-12-18T10:18:09.704387+0000","last_peered":"2023-12-18T10:18:09.704387+0000","last_clean":"2023-12-18T10:18:09.704387+0000","last_became_active":"2023-12-18T10:18:05.259178+0000","last_became_peered":"2023-12-18T10:18:05.259178+0000","last_unstale":"2023-12-18T10:18:09.704387+0000","last_undegraded":"2023-12-18T10:18:09.704387+0000","last_fullsized":"2023-12-18T10:18:09.704387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:18.551106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645863+0000","last_change":"2023-12-18T10:18:05.647456+0000","last_active":"2023-12-18T10:18:09.645863+0000","last_peered":"2023-12-18T10:18:09.645863+0000","last_clean":"2023-12-18T10:18:09.645863+0000","last_became_active":"2023-12-18T10:18:05.647171+0000","last_became_peered":"2023-12-18T10:18:05.647171+0000","last_unstale":"2023-12-18T10:18:09.645863+0000","last_undegraded":"2023-12-18T10:18:09.645863+0000","last_fullsized":"2023-12-18T10:18:09.645863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171921+0000","last_change":"2023-12-18T10:18:09.663391+0000","last_active":"2023-12-18T10:18:11.171921+0000","last_peered":"2023-12-18T10:18:11.171921+0000","last_clean":"2023-12-18T10:18:11.171921+0000","last_became_active":"2023-12-18T10:18:09.662939+0000","last_became_peered":"2023-12-18T10:18:09.662939+0000","last_unstale":"2023-12-18T10:18:11.171921+0000","last_undegraded":"2023-12-18T10:18:11.171921+0000","last_fullsized":"2023-12-18T10:18:11.171921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:40.435617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648575+0000","last_change":"2023-12-18T10:18:05.631751+0000","last_active":"2023-12-18T10:18:09.648575+0000","last_peered":"2023-12-18T10:18:09.648575+0000","last_clean":"2023-12-18T10:18:09.648575+0000","last_became_active":"2023-12-18T10:18:05.631484+0000","last_became_peered":"2023-12-18T10:18:05.631484+0000","last_unstale":"2023-12-18T10:18:09.648575+0000","last_undegraded":"2023-12-18T10:18:09.648575+0000","last_fullsized":"2023-12-18T10:18:09.648575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704350+0000","last_change":"2023-12-18T10:18:05.249053+0000","last_active":"2023-12-18T10:18:09.704350+0000","last_peered":"2023-12-18T10:18:09.704350+0000","last_clean":"2023-12-18T10:18:09.704350+0000","last_became_active":"2023-12-18T10:18:05.248510+0000","last_became_peered":"2023-12-18T10:18:05.248510+0000","last_unstale":"2023-12-18T10:18:09.704350+0000","last_undegraded":"2023-12-18T10:18:09.704350+0000","last_fullsized":"2023-12-18T10:18:09.704350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172429+0000","last_change":"2023-12-18T10:18:09.674408+0000","last_active":"2023-12-18T10:18:11.172429+0000","last_peered":"2023-12-18T10:18:11.172429+0000","last_clean":"2023-12-18T10:18:11.172429+0000","last_became_active":"2023-12-18T10:18:09.673681+0000","last_became_peered":"2023-12-18T10:18:09.673681+0000","last_unstale":"2023-12-18T10:18:11.172429+0000","last_undegraded":"2023-12-18T10:18:11.172429+0000","last_fullsized":"2023-12-18T10:18:11.172429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642885+0000","last_change":"2023-12-18T10:18:05.635754+0000","last_active":"2023-12-18T10:18:09.642885+0000","last_peered":"2023-12-18T10:18:09.642885+0000","last_clean":"2023-12-18T10:18:09.642885+0000","last_became_active":"2023-12-18T10:18:05.635426+0000","last_became_peered":"2023-12-18T10:18:05.635426+0000","last_unstale":"2023-12-18T10:18:09.642885+0000","last_undegraded":"2023-12-18T10:18:09.642885+0000","last_fullsized":"2023-12-18T10:18:09.642885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637872+0000","last_change":"2023-12-18T10:18:05.237366+0000","last_active":"2023-12-18T10:18:09.637872+0000","last_peered":"2023-12-18T10:18:09.637872+0000","last_clean":"2023-12-18T10:18:09.637872+0000","last_became_active":"2023-12-18T10:18:05.237115+0000","last_became_peered":"2023-12-18T10:18:05.237115+0000","last_unstale":"2023-12-18T10:18:09.637872+0000","last_undegraded":"2023-12-18T10:18:09.637872+0000","last_fullsized":"2023-12-18T10:18:09.637872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172373+0000","last_change":"2023-12-18T10:18:09.672293+0000","last_active":"2023-12-18T10:18:11.172373+0000","last_peered":"2023-12-18T10:18:11.172373+0000","last_clean":"2023-12-18T10:18:11.172373+0000","last_became_active":"2023-12-18T10:18:09.671846+0000","last_became_peered":"2023-12-18T10:18:09.671846+0000","last_unstale":"2023-12-18T10:18:11.172373+0000","last_undegraded":"2023-12-18T10:18:11.172373+0000","last_fullsized":"2023-12-18T10:18:11.172373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:15:09.032674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.640106+0000","last_change":"2023-12-18T10:18:05.626910+0000","last_active":"2023-12-18T10:18:09.640106+0000","last_peered":"2023-12-18T10:18:09.640106+0000","last_clean":"2023-12-18T10:18:09.640106+0000","last_became_active":"2023-12-18T10:18:05.623599+0000","last_became_peered":"2023-12-18T10:18:05.623599+0000","last_unstale":"2023-12-18T10:18:09.640106+0000","last_undegraded":"2023-12-18T10:18:09.640106+0000","last_fullsized":"2023-12-18T10:18:09.640106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637099+0000","last_change":"2023-12-18T10:18:05.233603+0000","last_active":"2023-12-18T10:18:09.637099+0000","last_peered":"2023-12-18T10:18:09.637099+0000","last_clean":"2023-12-18T10:18:09.637099+0000","last_became_active":"2023-12-18T10:18:05.233168+0000","last_became_peered":"2023-12-18T10:18:05.233168+0000","last_unstale":"2023-12-18T10:18:09.637099+0000","last_undegraded":"2023-12-18T10:18:09.637099+0000","last_fullsized":"2023-12-18T10:18:09.637099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168704+0000","last_change":"2023-12-18T10:18:09.706676+0000","last_active":"2023-12-18T10:18:11.168704+0000","last_peered":"2023-12-18T10:18:11.168704+0000","last_clean":"2023-12-18T10:18:11.168704+0000","last_became_active":"2023-12-18T10:18:09.705912+0000","last_became_peered":"2023-12-18T10:18:09.705912+0000","last_unstale":"2023-12-18T10:18:11.168704+0000","last_undegraded":"2023-12-18T10:18:11.168704+0000","last_fullsized":"2023-12-18T10:18:11.168704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:57:16.183086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647321+0000","last_change":"2023-12-18T10:18:05.633413+0000","last_active":"2023-12-18T10:18:09.647321+0000","last_peered":"2023-12-18T10:18:09.647321+0000","last_clean":"2023-12-18T10:18:09.647321+0000","last_became_active":"2023-12-18T10:18:05.633042+0000","last_became_peered":"2023-12-18T10:18:05.633042+0000","last_unstale":"2023-12-18T10:18:09.647321+0000","last_undegraded":"2023-12-18T10:18:09.647321+0000","last_fullsized":"2023-12-18T10:18:09.647321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:04.543394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.703942+0000","last_change":"2023-12-18T10:18:05.247809+0000","last_active":"2023-12-18T10:18:09.703942+0000","last_peered":"2023-12-18T10:18:09.703942+0000","last_clean":"2023-12-18T10:18:09.703942+0000","last_became_active":"2023-12-18T10:18:05.247430+0000","last_became_peered":"2023-12-18T10:18:05.247430+0000","last_unstale":"2023-12-18T10:18:09.703942+0000","last_undegraded":"2023-12-18T10:18:09.703942+0000","last_fullsized":"2023-12-18T10:18:09.703942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172259+0000","last_change":"2023-12-18T10:18:09.673789+0000","last_active":"2023-12-18T10:18:11.172259+0000","last_peered":"2023-12-18T10:18:11.172259+0000","last_clean":"2023-12-18T10:18:11.172259+0000","last_became_active":"2023-12-18T10:18:09.672245+0000","last_became_peered":"2023-12-18T10:18:09.672245+0000","last_unstale":"2023-12-18T10:18:11.172259+0000","last_undegraded":"2023-12-18T10:18:11.172259+0000","last_fullsized":"2023-12-18T10:18:11.172259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:57:16.183086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646514+0000","last_change":"2023-12-18T10:18:05.618676+0000","last_active":"2023-12-18T10:18:09.646514+0000","last_peered":"2023-12-18T10:18:09.646514+0000","last_clean":"2023-12-18T10:18:09.646514+0000","last_became_active":"2023-12-18T10:18:05.617947+0000","last_became_peered":"2023-12-18T10:18:05.617947+0000","last_unstale":"2023-12-18T10:18:09.646514+0000","last_undegraded":"2023-12-18T10:18:09.646514+0000","last_fullsized":"2023-12-18T10:18:09.646514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:17.447234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649866+0000","last_change":"2023-12-18T10:18:05.252886+0000","last_active":"2023-12-18T10:18:09.649866+0000","last_peered":"2023-12-18T10:18:09.649866+0000","last_clean":"2023-12-18T10:18:09.649866+0000","last_became_active":"2023-12-18T10:18:05.252552+0000","last_became_peered":"2023-12-18T10:18:05.252552+0000","last_unstale":"2023-12-18T10:18:09.649866+0000","last_undegraded":"2023-12-18T10:18:09.649866+0000","last_fullsized":"2023-12-18T10:18:09.649866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171556+0000","last_change":"2023-12-18T10:18:09.708967+0000","last_active":"2023-12-18T10:18:11.171556+0000","last_peered":"2023-12-18T10:18:11.171556+0000","last_clean":"2023-12-18T10:18:11.171556+0000","last_became_active":"2023-12-18T10:18:09.708596+0000","last_became_peered":"2023-12-18T10:18:09.708596+0000","last_unstale":"2023-12-18T10:18:11.171556+0000","last_undegraded":"2023-12-18T10:18:11.171556+0000","last_fullsized":"2023-12-18T10:18:11.171556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:17.773172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650186+0000","last_change":"2023-12-18T10:18:05.636290+0000","last_active":"2023-12-18T10:18:09.650186+0000","last_peered":"2023-12-18T10:18:09.650186+0000","last_clean":"2023-12-18T10:18:09.650186+0000","last_became_active":"2023-12-18T10:18:05.636016+0000","last_became_peered":"2023-12-18T10:18:05.636016+0000","last_unstale":"2023-12-18T10:18:09.650186+0000","last_undegraded":"2023-12-18T10:18:09.650186+0000","last_fullsized":"2023-12-18T10:18:09.650186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637989+0000","last_change":"2023-12-18T10:18:05.249790+0000","last_active":"2023-12-18T10:18:09.637989+0000","last_peered":"2023-12-18T10:18:09.637989+0000","last_clean":"2023-12-18T10:18:09.637989+0000","last_became_active":"2023-12-18T10:18:05.249433+0000","last_became_peered":"2023-12-18T10:18:05.249433+0000","last_unstale":"2023-12-18T10:18:09.637989+0000","last_undegraded":"2023-12-18T10:18:09.637989+0000","last_fullsized":"2023-12-18T10:18:09.637989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:19.309867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034309+0000","last_change":"2023-12-18T10:18:09.708773+0000","last_active":"2023-12-18T10:18:10.034309+0000","last_peered":"2023-12-18T10:18:10.034309+0000","last_clean":"2023-12-18T10:18:10.034309+0000","last_became_active":"2023-12-18T10:18:09.708308+0000","last_became_peered":"2023-12-18T10:18:09.708308+0000","last_unstale":"2023-12-18T10:18:10.034309+0000","last_undegraded":"2023-12-18T10:18:10.034309+0000","last_fullsized":"2023-12-18T10:18:10.034309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:47:06.075688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638426+0000","last_change":"2023-12-18T10:18:05.631244+0000","last_active":"2023-12-18T10:18:09.638426+0000","last_peered":"2023-12-18T10:18:09.638426+0000","last_clean":"2023-12-18T10:18:09.638426+0000","last_became_active":"2023-12-18T10:18:05.630991+0000","last_became_peered":"2023-12-18T10:18:05.630991+0000","last_unstale":"2023-12-18T10:18:09.638426+0000","last_undegraded":"2023-12-18T10:18:09.638426+0000","last_fullsized":"2023-12-18T10:18:09.638426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704655+0000","last_change":"2023-12-18T10:18:05.250025+0000","last_active":"2023-12-18T10:18:09.704655+0000","last_peered":"2023-12-18T10:18:09.704655+0000","last_clean":"2023-12-18T10:18:09.704655+0000","last_became_active":"2023-12-18T10:18:05.249699+0000","last_became_peered":"2023-12-18T10:18:05.249699+0000","last_unstale":"2023-12-18T10:18:09.704655+0000","last_undegraded":"2023-12-18T10:18:09.704655+0000","last_fullsized":"2023-12-18T10:18:09.704655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169743+0000","last_change":"2023-12-18T10:18:09.706868+0000","last_active":"2023-12-18T10:18:11.169743+0000","last_peered":"2023-12-18T10:18:11.169743+0000","last_clean":"2023-12-18T10:18:11.169743+0000","last_became_active":"2023-12-18T10:18:09.706468+0000","last_became_peered":"2023-12-18T10:18:09.706468+0000","last_unstale":"2023-12-18T10:18:11.169743+0000","last_undegraded":"2023-12-18T10:18:11.169743+0000","last_fullsized":"2023-12-18T10:18:11.169743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645946+0000","last_change":"2023-12-18T10:18:05.645165+0000","last_active":"2023-12-18T10:18:09.645946+0000","last_peered":"2023-12-18T10:18:09.645946+0000","last_clean":"2023-12-18T10:18:09.645946+0000","last_became_active":"2023-12-18T10:18:05.644797+0000","last_became_peered":"2023-12-18T10:18:05.644797+0000","last_unstale":"2023-12-18T10:18:09.645946+0000","last_undegraded":"2023-12-18T10:18:09.645946+0000","last_fullsized":"2023-12-18T10:18:09.645946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:14.759979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638502+0000","last_change":"2023-12-18T10:18:05.240747+0000","last_active":"2023-12-18T10:18:09.638502+0000","last_peered":"2023-12-18T10:18:09.638502+0000","last_clean":"2023-12-18T10:18:09.638502+0000","last_became_active":"2023-12-18T10:18:05.240498+0000","last_became_peered":"2023-12-18T10:18:05.240498+0000","last_unstale":"2023-12-18T10:18:09.638502+0000","last_undegraded":"2023-12-18T10:18:09.638502+0000","last_fullsized":"2023-12-18T10:18:09.638502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168534+0000","last_change":"2023-12-18T10:18:09.668534+0000","last_active":"2023-12-18T10:18:11.168534+0000","last_peered":"2023-12-18T10:18:11.168534+0000","last_clean":"2023-12-18T10:18:11.168534+0000","last_became_active":"2023-12-18T10:18:09.667999+0000","last_became_peered":"2023-12-18T10:18:09.667999+0000","last_unstale":"2023-12-18T10:18:11.168534+0000","last_undegraded":"2023-12-18T10:18:11.168534+0000","last_fullsized":"2023-12-18T10:18:11.168534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:21.579648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649514+0000","last_change":"2023-12-18T10:18:05.631117+0000","last_active":"2023-12-18T10:18:09.649514+0000","last_peered":"2023-12-18T10:18:09.649514+0000","last_clean":"2023-12-18T10:18:09.649514+0000","last_became_active":"2023-12-18T10:18:05.629667+0000","last_became_peered":"2023-12-18T10:18:05.629667+0000","last_unstale":"2023-12-18T10:18:09.649514+0000","last_undegraded":"2023-12-18T10:18:09.649514+0000","last_fullsized":"2023-12-18T10:18:09.649514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:42.689686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645552+0000","last_change":"2023-12-18T10:18:05.245165+0000","last_active":"2023-12-18T10:18:09.645552+0000","last_peered":"2023-12-18T10:18:09.645552+0000","last_clean":"2023-12-18T10:18:09.645552+0000","last_became_active":"2023-12-18T10:18:05.244850+0000","last_became_peered":"2023-12-18T10:18:05.244850+0000","last_unstale":"2023-12-18T10:18:09.645552+0000","last_undegraded":"2023-12-18T10:18:09.645552+0000","last_fullsized":"2023-12-18T10:18:09.645552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168819+0000","last_change":"2023-12-18T10:18:09.665513+0000","last_active":"2023-12-18T10:18:11.168819+0000","last_peered":"2023-12-18T10:18:11.168819+0000","last_clean":"2023-12-18T10:18:11.168819+0000","last_became_active":"2023-12-18T10:18:09.665159+0000","last_became_peered":"2023-12-18T10:18:09.665159+0000","last_unstale":"2023-12-18T10:18:11.168819+0000","last_undegraded":"2023-12-18T10:18:11.168819+0000","last_fullsized":"2023-12-18T10:18:11.168819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:14.170257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637020+0000","last_change":"2023-12-18T10:18:05.629368+0000","last_active":"2023-12-18T10:18:09.637020+0000","last_peered":"2023-12-18T10:18:09.637020+0000","last_clean":"2023-12-18T10:18:09.637020+0000","last_became_active":"2023-12-18T10:18:05.629000+0000","last_became_peered":"2023-12-18T10:18:05.629000+0000","last_unstale":"2023-12-18T10:18:09.637020+0000","last_undegraded":"2023-12-18T10:18:09.637020+0000","last_fullsized":"2023-12-18T10:18:09.637020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655736+0000","last_change":"2023-12-18T10:18:05.238202+0000","last_active":"2023-12-18T10:18:09.655736+0000","last_peered":"2023-12-18T10:18:09.655736+0000","last_clean":"2023-12-18T10:18:09.655736+0000","last_became_active":"2023-12-18T10:18:05.236931+0000","last_became_peered":"2023-12-18T10:18:05.236931+0000","last_unstale":"2023-12-18T10:18:09.655736+0000","last_undegraded":"2023-12-18T10:18:09.655736+0000","last_fullsized":"2023-12-18T10:18:09.655736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168802+0000","last_change":"2023-12-18T10:18:09.666802+0000","last_active":"2023-12-18T10:18:11.168802+0000","last_peered":"2023-12-18T10:18:11.168802+0000","last_clean":"2023-12-18T10:18:11.168802+0000","last_became_active":"2023-12-18T10:18:09.666414+0000","last_became_peered":"2023-12-18T10:18:09.666414+0000","last_unstale":"2023-12-18T10:18:11.168802+0000","last_undegraded":"2023-12-18T10:18:11.168802+0000","last_fullsized":"2023-12-18T10:18:11.168802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644736+0000","last_change":"2023-12-18T10:18:05.622921+0000","last_active":"2023-12-18T10:18:09.644736+0000","last_peered":"2023-12-18T10:18:09.644736+0000","last_clean":"2023-12-18T10:18:09.644736+0000","last_became_active":"2023-12-18T10:18:05.621321+0000","last_became_peered":"2023-12-18T10:18:05.621321+0000","last_unstale":"2023-12-18T10:18:09.644736+0000","last_undegraded":"2023-12-18T10:18:09.644736+0000","last_fullsized":"2023-12-18T10:18:09.644736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.703942+0000","last_change":"2023-12-18T10:18:05.243529+0000","last_active":"2023-12-18T10:18:09.703942+0000","last_peered":"2023-12-18T10:18:09.703942+0000","last_clean":"2023-12-18T10:18:09.703942+0000","last_became_active":"2023-12-18T10:18:05.242883+0000","last_became_peered":"2023-12-18T10:18:05.242883+0000","last_unstale":"2023-12-18T10:18:09.703942+0000","last_undegraded":"2023-12-18T10:18:09.703942+0000","last_fullsized":"2023-12-18T10:18:09.703942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169242+0000","last_change":"2023-12-18T10:18:09.706427+0000","last_active":"2023-12-18T10:18:11.169242+0000","last_peered":"2023-12-18T10:18:11.169242+0000","last_clean":"2023-12-18T10:18:11.169242+0000","last_became_active":"2023-12-18T10:18:09.705936+0000","last_became_peered":"2023-12-18T10:18:09.705936+0000","last_unstale":"2023-12-18T10:18:11.169242+0000","last_undegraded":"2023-12-18T10:18:11.169242+0000","last_fullsized":"2023-12-18T10:18:11.169242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642900+0000","last_change":"2023-12-18T10:18:05.643802+0000","last_active":"2023-12-18T10:18:09.642900+0000","last_peered":"2023-12-18T10:18:09.642900+0000","last_clean":"2023-12-18T10:18:09.642900+0000","last_became_active":"2023-12-18T10:18:05.643536+0000","last_became_peered":"2023-12-18T10:18:05.643536+0000","last_unstale":"2023-12-18T10:18:09.642900+0000","last_undegraded":"2023-12-18T10:18:09.642900+0000","last_fullsized":"2023-12-18T10:18:09.642900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644527+0000","last_change":"2023-12-18T10:18:05.246307+0000","last_active":"2023-12-18T10:18:09.644527+0000","last_peered":"2023-12-18T10:18:09.644527+0000","last_clean":"2023-12-18T10:18:09.644527+0000","last_became_active":"2023-12-18T10:18:05.246011+0000","last_became_peered":"2023-12-18T10:18:05.246011+0000","last_unstale":"2023-12-18T10:18:09.644527+0000","last_undegraded":"2023-12-18T10:18:09.644527+0000","last_fullsized":"2023-12-18T10:18:09.644527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704051+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:18:09.704051+0000","last_peered":"2023-12-18T10:18:09.704051+0000","last_clean":"2023-12-18T10:18:09.704051+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:18:09.704051+0000","last_undegraded":"2023-12-18T10:18:09.704051+0000","last_fullsized":"2023-12-18T10:18:09.704051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169876+0000","last_change":"2023-12-18T10:18:09.708354+0000","last_active":"2023-12-18T10:18:11.169876+0000","last_peered":"2023-12-18T10:18:11.169876+0000","last_clean":"2023-12-18T10:18:11.169876+0000","last_became_active":"2023-12-18T10:18:09.707960+0000","last_became_peered":"2023-12-18T10:18:09.707960+0000","last_unstale":"2023-12-18T10:18:11.169876+0000","last_undegraded":"2023-12-18T10:18:11.169876+0000","last_fullsized":"2023-12-18T10:18:11.169876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:14.308904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704499+0000","last_change":"2023-12-18T10:18:05.632931+0000","last_active":"2023-12-18T10:18:09.704499+0000","last_peered":"2023-12-18T10:18:09.704499+0000","last_clean":"2023-12-18T10:18:09.704499+0000","last_became_active":"2023-12-18T10:18:05.632651+0000","last_became_peered":"2023-12-18T10:18:05.632651+0000","last_unstale":"2023-12-18T10:18:09.704499+0000","last_undegraded":"2023-12-18T10:18:09.704499+0000","last_fullsized":"2023-12-18T10:18:09.704499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656199+0000","last_change":"2023-12-18T10:18:05.242533+0000","last_active":"2023-12-18T10:18:09.656199+0000","last_peered":"2023-12-18T10:18:09.656199+0000","last_clean":"2023-12-18T10:18:09.656199+0000","last_became_active":"2023-12-18T10:18:05.242002+0000","last_became_peered":"2023-12-18T10:18:05.242002+0000","last_unstale":"2023-12-18T10:18:09.656199+0000","last_undegraded":"2023-12-18T10:18:09.656199+0000","last_fullsized":"2023-12-18T10:18:09.656199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:59:16.313417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169703+0000","last_change":"2023-12-18T10:18:09.706487+0000","last_active":"2023-12-18T10:18:11.169703+0000","last_peered":"2023-12-18T10:18:11.169703+0000","last_clean":"2023-12-18T10:18:11.169703+0000","last_became_active":"2023-12-18T10:18:09.705811+0000","last_became_peered":"2023-12-18T10:18:09.705811+0000","last_unstale":"2023-12-18T10:18:11.169703+0000","last_undegraded":"2023-12-18T10:18:11.169703+0000","last_fullsized":"2023-12-18T10:18:11.169703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:04:14.972185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646691+0000","last_change":"2023-12-18T10:18:05.644339+0000","last_active":"2023-12-18T10:18:09.646691+0000","last_peered":"2023-12-18T10:18:09.646691+0000","last_clean":"2023-12-18T10:18:09.646691+0000","last_became_active":"2023-12-18T10:18:05.643830+0000","last_became_peered":"2023-12-18T10:18:05.643830+0000","last_unstale":"2023-12-18T10:18:09.646691+0000","last_undegraded":"2023-12-18T10:18:09.646691+0000","last_fullsized":"2023-12-18T10:18:09.646691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:26.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638847+0000","last_change":"2023-12-18T10:18:05.238798+0000","last_active":"2023-12-18T10:18:09.638847+0000","last_peered":"2023-12-18T10:18:09.638847+0000","last_clean":"2023-12-18T10:18:09.638847+0000","last_became_active":"2023-12-18T10:18:05.238543+0000","last_became_peered":"2023-12-18T10:18:05.238543+0000","last_unstale":"2023-12-18T10:18:09.638847+0000","last_undegraded":"2023-12-18T10:18:09.638847+0000","last_fullsized":"2023-12-18T10:18:09.638847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169838+0000","last_change":"2023-12-18T10:18:09.665779+0000","last_active":"2023-12-18T10:18:11.169838+0000","last_peered":"2023-12-18T10:18:11.169838+0000","last_clean":"2023-12-18T10:18:11.169838+0000","last_became_active":"2023-12-18T10:18:09.665395+0000","last_became_peered":"2023-12-18T10:18:09.665395+0000","last_unstale":"2023-12-18T10:18:11.169838+0000","last_undegraded":"2023-12-18T10:18:11.169838+0000","last_fullsized":"2023-12-18T10:18:11.169838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:14.170257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704713+0000","last_change":"2023-12-18T10:18:05.650433+0000","last_active":"2023-12-18T10:18:09.704713+0000","last_peered":"2023-12-18T10:18:09.704713+0000","last_clean":"2023-12-18T10:18:09.704713+0000","last_became_active":"2023-12-18T10:18:05.650144+0000","last_became_peered":"2023-12-18T10:18:05.650144+0000","last_unstale":"2023-12-18T10:18:09.704713+0000","last_undegraded":"2023-12-18T10:18:09.704713+0000","last_fullsized":"2023-12-18T10:18:09.704713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:26.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656188+0000","last_change":"2023-12-18T10:18:05.239626+0000","last_active":"2023-12-18T10:18:09.656188+0000","last_peered":"2023-12-18T10:18:09.656188+0000","last_clean":"2023-12-18T10:18:09.656188+0000","last_became_active":"2023-12-18T10:18:05.239178+0000","last_became_peered":"2023-12-18T10:18:05.239178+0000","last_unstale":"2023-12-18T10:18:09.656188+0000","last_undegraded":"2023-12-18T10:18:09.656188+0000","last_fullsized":"2023-12-18T10:18:09.656188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169287+0000","last_change":"2023-12-18T10:18:09.708746+0000","last_active":"2023-12-18T10:18:11.169287+0000","last_peered":"2023-12-18T10:18:11.169287+0000","last_clean":"2023-12-18T10:18:11.169287+0000","last_became_active":"2023-12-18T10:18:09.708295+0000","last_became_peered":"2023-12-18T10:18:09.708295+0000","last_unstale":"2023-12-18T10:18:11.169287+0000","last_undegraded":"2023-12-18T10:18:11.169287+0000","last_fullsized":"2023-12-18T10:18:11.169287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704543+0000","last_change":"2023-12-18T10:18:05.632812+0000","last_active":"2023-12-18T10:18:09.704543+0000","last_peered":"2023-12-18T10:18:09.704543+0000","last_clean":"2023-12-18T10:18:09.704543+0000","last_became_active":"2023-12-18T10:18:05.632540+0000","last_became_peered":"2023-12-18T10:18:05.632540+0000","last_unstale":"2023-12-18T10:18:09.704543+0000","last_undegraded":"2023-12-18T10:18:09.704543+0000","last_fullsized":"2023-12-18T10:18:09.704543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.652216+0000","last_change":"2023-12-18T10:18:05.242325+0000","last_active":"2023-12-18T10:18:09.652216+0000","last_peered":"2023-12-18T10:18:09.652216+0000","last_clean":"2023-12-18T10:18:09.652216+0000","last_became_active":"2023-12-18T10:18:05.241704+0000","last_became_peered":"2023-12-18T10:18:05.241704+0000","last_unstale":"2023-12-18T10:18:09.652216+0000","last_undegraded":"2023-12-18T10:18:09.652216+0000","last_fullsized":"2023-12-18T10:18:09.652216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:11:58.708994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171517+0000","last_change":"2023-12-18T10:18:09.667114+0000","last_active":"2023-12-18T10:18:11.171517+0000","last_peered":"2023-12-18T10:18:11.171517+0000","last_clean":"2023-12-18T10:18:11.171517+0000","last_became_active":"2023-12-18T10:18:09.666693+0000","last_became_peered":"2023-12-18T10:18:09.666693+0000","last_unstale":"2023-12-18T10:18:11.171517+0000","last_undegraded":"2023-12-18T10:18:11.171517+0000","last_fullsized":"2023-12-18T10:18:11.171517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:32:34.740316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704259+0000","last_change":"2023-12-18T10:18:05.655274+0000","last_active":"2023-12-18T10:18:09.704259+0000","last_peered":"2023-12-18T10:18:09.704259+0000","last_clean":"2023-12-18T10:18:09.704259+0000","last_became_active":"2023-12-18T10:18:05.654951+0000","last_became_peered":"2023-12-18T10:18:05.654951+0000","last_unstale":"2023-12-18T10:18:09.704259+0000","last_undegraded":"2023-12-18T10:18:09.704259+0000","last_fullsized":"2023-12-18T10:18:09.704259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:53:47.177413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655713+0000","last_change":"2023-12-18T10:18:05.235218+0000","last_active":"2023-12-18T10:18:09.655713+0000","last_peered":"2023-12-18T10:18:09.655713+0000","last_clean":"2023-12-18T10:18:09.655713+0000","last_became_active":"2023-12-18T10:18:05.234772+0000","last_became_peered":"2023-12-18T10:18:05.234772+0000","last_unstale":"2023-12-18T10:18:09.655713+0000","last_undegraded":"2023-12-18T10:18:09.655713+0000","last_fullsized":"2023-12-18T10:18:09.655713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169252+0000","last_change":"2023-12-18T10:18:09.663654+0000","last_active":"2023-12-18T10:18:11.169252+0000","last_peered":"2023-12-18T10:18:11.169252+0000","last_clean":"2023-12-18T10:18:11.169252+0000","last_became_active":"2023-12-18T10:18:09.663075+0000","last_became_peered":"2023-12-18T10:18:09.663075+0000","last_unstale":"2023-12-18T10:18:11.169252+0000","last_undegraded":"2023-12-18T10:18:11.169252+0000","last_fullsized":"2023-12-18T10:18:11.169252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:44:55.941621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648084+0000","last_change":"2023-12-18T10:18:05.628464+0000","last_active":"2023-12-18T10:18:09.648084+0000","last_peered":"2023-12-18T10:18:09.648084+0000","last_clean":"2023-12-18T10:18:09.648084+0000","last_became_active":"2023-12-18T10:18:05.627764+0000","last_became_peered":"2023-12-18T10:18:05.627764+0000","last_unstale":"2023-12-18T10:18:09.648084+0000","last_undegraded":"2023-12-18T10:18:09.648084+0000","last_fullsized":"2023-12-18T10:18:09.648084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:52:49.957417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647814+0000","last_change":"2023-12-18T10:18:05.245296+0000","last_active":"2023-12-18T10:18:09.647814+0000","last_peered":"2023-12-18T10:18:09.647814+0000","last_clean":"2023-12-18T10:18:09.647814+0000","last_became_active":"2023-12-18T10:18:05.242075+0000","last_became_peered":"2023-12-18T10:18:05.242075+0000","last_unstale":"2023-12-18T10:18:09.647814+0000","last_undegraded":"2023-12-18T10:18:09.647814+0000","last_fullsized":"2023-12-18T10:18:09.647814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.035200+0000","last_change":"2023-12-18T10:18:09.709330+0000","last_active":"2023-12-18T10:18:10.035200+0000","last_peered":"2023-12-18T10:18:10.035200+0000","last_clean":"2023-12-18T10:18:10.035200+0000","last_became_active":"2023-12-18T10:18:09.708913+0000","last_became_peered":"2023-12-18T10:18:09.708913+0000","last_unstale":"2023-12-18T10:18:10.035200+0000","last_undegraded":"2023-12-18T10:18:10.035200+0000","last_fullsized":"2023-12-18T10:18:10.035200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:02:51.214432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704354+0000","last_change":"2023-12-18T10:18:05.650555+0000","last_active":"2023-12-18T10:18:09.704354+0000","last_peered":"2023-12-18T10:18:09.704354+0000","last_clean":"2023-12-18T10:18:09.704354+0000","last_became_active":"2023-12-18T10:18:05.648504+0000","last_became_peered":"2023-12-18T10:18:05.648504+0000","last_unstale":"2023-12-18T10:18:09.704354+0000","last_undegraded":"2023-12-18T10:18:09.704354+0000","last_fullsized":"2023-12-18T10:18:09.704354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645470+0000","last_change":"2023-12-18T10:18:05.244257+0000","last_active":"2023-12-18T10:18:09.645470+0000","last_peered":"2023-12-18T10:18:09.645470+0000","last_clean":"2023-12-18T10:18:09.645470+0000","last_became_active":"2023-12-18T10:18:05.242236+0000","last_became_peered":"2023-12-18T10:18:05.242236+0000","last_unstale":"2023-12-18T10:18:09.645470+0000","last_undegraded":"2023-12-18T10:18:09.645470+0000","last_fullsized":"2023-12-18T10:18:09.645470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034855+0000","last_change":"2023-12-18T10:18:09.707426+0000","last_active":"2023-12-18T10:18:10.034855+0000","last_peered":"2023-12-18T10:18:10.034855+0000","last_clean":"2023-12-18T10:18:10.034855+0000","last_became_active":"2023-12-18T10:18:09.705876+0000","last_became_peered":"2023-12-18T10:18:09.705876+0000","last_unstale":"2023-12-18T10:18:10.034855+0000","last_undegraded":"2023-12-18T10:18:10.034855+0000","last_fullsized":"2023-12-18T10:18:10.034855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:55.894492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644039+0000","last_change":"2023-12-18T10:18:05.625605+0000","last_active":"2023-12-18T10:18:09.644039+0000","last_peered":"2023-12-18T10:18:09.644039+0000","last_clean":"2023-12-18T10:18:09.644039+0000","last_became_active":"2023-12-18T10:18:05.625234+0000","last_became_peered":"2023-12-18T10:18:05.625234+0000","last_unstale":"2023-12-18T10:18:09.644039+0000","last_undegraded":"2023-12-18T10:18:09.644039+0000","last_fullsized":"2023-12-18T10:18:09.644039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647757+0000","last_change":"2023-12-18T10:18:05.238939+0000","last_active":"2023-12-18T10:18:09.647757+0000","last_peered":"2023-12-18T10:18:09.647757+0000","last_clean":"2023-12-18T10:18:09.647757+0000","last_became_active":"2023-12-18T10:18:05.238646+0000","last_became_peered":"2023-12-18T10:18:05.238646+0000","last_unstale":"2023-12-18T10:18:09.647757+0000","last_undegraded":"2023-12-18T10:18:09.647757+0000","last_fullsized":"2023-12-18T10:18:09.647757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:20:34.086830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.170663+0000","last_change":"2023-12-18T10:18:09.708597+0000","last_active":"2023-12-18T10:18:11.170663+0000","last_peered":"2023-12-18T10:18:11.170663+0000","last_clean":"2023-12-18T10:18:11.170663+0000","last_became_active":"2023-12-18T10:18:09.708149+0000","last_became_peered":"2023-12-18T10:18:09.708149+0000","last_unstale":"2023-12-18T10:18:11.170663+0000","last_undegraded":"2023-12-18T10:18:11.170663+0000","last_fullsized":"2023-12-18T10:18:11.170663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704400+0000","last_change":"2023-12-18T10:18:05.641901+0000","last_active":"2023-12-18T10:18:09.704400+0000","last_peered":"2023-12-18T10:18:09.704400+0000","last_clean":"2023-12-18T10:18:09.704400+0000","last_became_active":"2023-12-18T10:18:05.641618+0000","last_became_peered":"2023-12-18T10:18:05.641618+0000","last_unstale":"2023-12-18T10:18:09.704400+0000","last_undegraded":"2023-12-18T10:18:09.704400+0000","last_fullsized":"2023-12-18T10:18:09.704400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:15.794107+0000","last_change":"2023-12-18T10:18:05.250912+0000","last_active":"2023-12-18T10:18:15.794107+0000","last_peered":"2023-12-18T10:18:15.794107+0000","last_clean":"2023-12-18T10:18:15.794107+0000","last_became_active":"2023-12-18T10:18:05.250664+0000","last_became_peered":"2023-12-18T10:18:05.250664+0000","last_unstale":"2023-12-18T10:18:15.794107+0000","last_undegraded":"2023-12-18T10:18:15.794107+0000","last_fullsized":"2023-12-18T10:18:15.794107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168630+0000","last_change":"2023-12-18T10:18:09.664263+0000","last_active":"2023-12-18T10:18:11.168630+0000","last_peered":"2023-12-18T10:18:11.168630+0000","last_clean":"2023-12-18T10:18:11.168630+0000","last_became_active":"2023-12-18T10:18:09.663085+0000","last_became_peered":"2023-12-18T10:18:09.663085+0000","last_unstale":"2023-12-18T10:18:11.168630+0000","last_undegraded":"2023-12-18T10:18:11.168630+0000","last_fullsized":"2023-12-18T10:18:11.168630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649600+0000","last_change":"2023-12-18T10:18:05.634453+0000","last_active":"2023-12-18T10:18:09.649600+0000","last_peered":"2023-12-18T10:18:09.649600+0000","last_clean":"2023-12-18T10:18:09.649600+0000","last_became_active":"2023-12-18T10:18:05.633857+0000","last_became_peered":"2023-12-18T10:18:05.633857+0000","last_unstale":"2023-12-18T10:18:09.649600+0000","last_undegraded":"2023-12-18T10:18:09.649600+0000","last_fullsized":"2023-12-18T10:18:09.649600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:20.317228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638790+0000","last_change":"2023-12-18T10:18:05.240204+0000","last_active":"2023-12-18T10:18:09.638790+0000","last_peered":"2023-12-18T10:18:09.638790+0000","last_clean":"2023-12-18T10:18:09.638790+0000","last_became_active":"2023-12-18T10:18:05.239930+0000","last_became_peered":"2023-12-18T10:18:05.239930+0000","last_unstale":"2023-12-18T10:18:09.638790+0000","last_undegraded":"2023-12-18T10:18:09.638790+0000","last_fullsized":"2023-12-18T10:18:09.638790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:18.551106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172071+0000","last_change":"2023-12-18T10:18:09.672679+0000","last_active":"2023-12-18T10:18:11.172071+0000","last_peered":"2023-12-18T10:18:11.172071+0000","last_clean":"2023-12-18T10:18:11.172071+0000","last_became_active":"2023-12-18T10:18:09.672224+0000","last_became_peered":"2023-12-18T10:18:09.672224+0000","last_unstale":"2023-12-18T10:18:11.172071+0000","last_undegraded":"2023-12-18T10:18:11.172071+0000","last_fullsized":"2023-12-18T10:18:11.172071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647023+0000","last_change":"2023-12-18T10:18:05.641647+0000","last_active":"2023-12-18T10:18:09.647023+0000","last_peered":"2023-12-18T10:18:09.647023+0000","last_clean":"2023-12-18T10:18:09.647023+0000","last_became_active":"2023-12-18T10:18:05.641380+0000","last_became_peered":"2023-12-18T10:18:05.641380+0000","last_unstale":"2023-12-18T10:18:09.647023+0000","last_undegraded":"2023-12-18T10:18:09.647023+0000","last_fullsized":"2023-12-18T10:18:09.647023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:52:49.957417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645469+0000","last_change":"2023-12-18T10:18:05.255298+0000","last_active":"2023-12-18T10:18:09.645469+0000","last_peered":"2023-12-18T10:18:09.645469+0000","last_clean":"2023-12-18T10:18:09.645469+0000","last_became_active":"2023-12-18T10:18:05.249553+0000","last_became_peered":"2023-12-18T10:18:05.249553+0000","last_unstale":"2023-12-18T10:18:09.645469+0000","last_undegraded":"2023-12-18T10:18:09.645469+0000","last_fullsized":"2023-12-18T10:18:09.645469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034469+0000","last_change":"2023-12-18T10:18:09.654532+0000","last_active":"2023-12-18T10:18:10.034469+0000","last_peered":"2023-12-18T10:18:10.034469+0000","last_clean":"2023-12-18T10:18:10.034469+0000","last_became_active":"2023-12-18T10:18:09.654162+0000","last_became_peered":"2023-12-18T10:18:09.654162+0000","last_unstale":"2023-12-18T10:18:10.034469+0000","last_undegraded":"2023-12-18T10:18:10.034469+0000","last_fullsized":"2023-12-18T10:18:10.034469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:09.243674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645396+0000","last_change":"2023-12-18T10:18:05.645545+0000","last_active":"2023-12-18T10:18:09.645396+0000","last_peered":"2023-12-18T10:18:09.645396+0000","last_clean":"2023-12-18T10:18:09.645396+0000","last_became_active":"2023-12-18T10:18:05.643058+0000","last_became_peered":"2023-12-18T10:18:05.643058+0000","last_unstale":"2023-12-18T10:18:09.645396+0000","last_undegraded":"2023-12-18T10:18:09.645396+0000","last_fullsized":"2023-12-18T10:18:09.645396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:04:11.553722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649775+0000","last_change":"2023-12-18T10:18:05.251656+0000","last_active":"2023-12-18T10:18:09.649775+0000","last_peered":"2023-12-18T10:18:09.649775+0000","last_clean":"2023-12-18T10:18:09.649775+0000","last_became_active":"2023-12-18T10:18:05.251325+0000","last_became_peered":"2023-12-18T10:18:05.251325+0000","last_unstale":"2023-12-18T10:18:09.649775+0000","last_undegraded":"2023-12-18T10:18:09.649775+0000","last_fullsized":"2023-12-18T10:18:09.649775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034536+0000","last_change":"2023-12-18T10:18:09.706442+0000","last_active":"2023-12-18T10:18:10.034536+0000","last_peered":"2023-12-18T10:18:10.034536+0000","last_clean":"2023-12-18T10:18:10.034536+0000","last_became_active":"2023-12-18T10:18:09.705840+0000","last_became_peered":"2023-12-18T10:18:09.705840+0000","last_unstale":"2023-12-18T10:18:10.034536+0000","last_undegraded":"2023-12-18T10:18:10.034536+0000","last_fullsized":"2023-12-18T10:18:10.034536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:45:44.671578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169136+0000","last_change":"2023-12-18T10:18:09.708551+0000","last_active":"2023-12-18T10:18:11.169136+0000","last_peered":"2023-12-18T10:18:11.169136+0000","last_clean":"2023-12-18T10:18:11.169136+0000","last_became_active":"2023-12-18T10:18:09.708120+0000","last_became_peered":"2023-12-18T10:18:09.708120+0000","last_unstale":"2023-12-18T10:18:11.169136+0000","last_undegraded":"2023-12-18T10:18:11.169136+0000","last_fullsized":"2023-12-18T10:18:11.169136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637013+0000","last_change":"2023-12-18T10:18:05.626780+0000","last_active":"2023-12-18T10:18:09.637013+0000","last_peered":"2023-12-18T10:18:09.637013+0000","last_clean":"2023-12-18T10:18:09.637013+0000","last_became_active":"2023-12-18T10:18:05.626520+0000","last_became_peered":"2023-12-18T10:18:05.626520+0000","last_unstale":"2023-12-18T10:18:09.637013+0000","last_undegraded":"2023-12-18T10:18:09.637013+0000","last_fullsized":"2023-12-18T10:18:09.637013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643961+0000","last_change":"2023-12-18T10:18:05.248820+0000","last_active":"2023-12-18T10:18:09.643961+0000","last_peered":"2023-12-18T10:18:09.643961+0000","last_clean":"2023-12-18T10:18:09.643961+0000","last_became_active":"2023-12-18T10:18:05.247238+0000","last_became_peered":"2023-12-18T10:18:05.247238+0000","last_unstale":"2023-12-18T10:18:09.643961+0000","last_undegraded":"2023-12-18T10:18:09.643961+0000","last_fullsized":"2023-12-18T10:18:09.643961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.170305+0000","last_change":"2023-12-18T10:18:09.672371+0000","last_active":"2023-12-18T10:18:11.170305+0000","last_peered":"2023-12-18T10:18:11.170305+0000","last_clean":"2023-12-18T10:18:11.170305+0000","last_became_active":"2023-12-18T10:18:09.671986+0000","last_became_peered":"2023-12-18T10:18:09.671986+0000","last_unstale":"2023-12-18T10:18:11.170305+0000","last_undegraded":"2023-12-18T10:18:11.170305+0000","last_fullsized":"2023-12-18T10:18:11.170305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:44:55.941621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.640030+0000","last_change":"2023-12-18T10:18:05.627295+0000","last_active":"2023-12-18T10:18:09.640030+0000","last_peered":"2023-12-18T10:18:09.640030+0000","last_clean":"2023-12-18T10:18:09.640030+0000","last_became_active":"2023-12-18T10:18:05.626947+0000","last_became_peered":"2023-12-18T10:18:05.626947+0000","last_unstale":"2023-12-18T10:18:09.640030+0000","last_undegraded":"2023-12-18T10:18:09.640030+0000","last_fullsized":"2023-12-18T10:18:09.640030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.641252+0000","last_change":"2023-12-18T10:18:05.249020+0000","last_active":"2023-12-18T10:18:09.641252+0000","last_peered":"2023-12-18T10:18:09.641252+0000","last_clean":"2023-12-18T10:18:09.641252+0000","last_became_active":"2023-12-18T10:18:05.248677+0000","last_became_peered":"2023-12-18T10:18:05.248677+0000","last_unstale":"2023-12-18T10:18:09.641252+0000","last_undegraded":"2023-12-18T10:18:09.641252+0000","last_fullsized":"2023-12-18T10:18:09.641252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648681+0000","last_change":"2023-12-18T10:18:05.249748+0000","last_active":"2023-12-18T10:18:09.648681+0000","last_peered":"2023-12-18T10:18:09.648681+0000","last_clean":"2023-12-18T10:18:09.648681+0000","last_became_active":"2023-12-18T10:18:05.249479+0000","last_became_peered":"2023-12-18T10:18:05.249479+0000","last_unstale":"2023-12-18T10:18:09.648681+0000","last_undegraded":"2023-12-18T10:18:09.648681+0000","last_fullsized":"2023-12-18T10:18:09.648681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647579+0000","last_change":"2023-12-18T10:18:05.630648+0000","last_active":"2023-12-18T10:18:09.647579+0000","last_peered":"2023-12-18T10:18:09.647579+0000","last_clean":"2023-12-18T10:18:09.647579+0000","last_became_active":"2023-12-18T10:18:05.630392+0000","last_became_peered":"2023-12-18T10:18:05.630392+0000","last_unstale":"2023-12-18T10:18:09.647579+0000","last_undegraded":"2023-12-18T10:18:09.647579+0000","last_fullsized":"2023-12-18T10:18:09.647579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:00.204642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.033552+0000","last_change":"2023-12-18T10:18:09.672491+0000","last_active":"2023-12-18T10:18:10.033552+0000","last_peered":"2023-12-18T10:18:10.033552+0000","last_clean":"2023-12-18T10:18:10.033552+0000","last_became_active":"2023-12-18T10:18:09.671959+0000","last_became_peered":"2023-12-18T10:18:09.671959+0000","last_unstale":"2023-12-18T10:18:10.033552+0000","last_undegraded":"2023-12-18T10:18:10.033552+0000","last_fullsized":"2023-12-18T10:18:10.033552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:21.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643160+0000","last_change":"2023-12-18T10:18:05.252875+0000","last_active":"2023-12-18T10:18:09.643160+0000","last_peered":"2023-12-18T10:18:09.643160+0000","last_clean":"2023-12-18T10:18:09.643160+0000","last_became_active":"2023-12-18T10:18:05.252600+0000","last_became_peered":"2023-12-18T10:18:05.252600+0000","last_unstale":"2023-12-18T10:18:09.643160+0000","last_undegraded":"2023-12-18T10:18:09.643160+0000","last_fullsized":"2023-12-18T10:18:09.643160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648805+0000","last_change":"2023-12-18T10:18:05.627361+0000","last_active":"2023-12-18T10:18:09.648805+0000","last_peered":"2023-12-18T10:18:09.648805+0000","last_clean":"2023-12-18T10:18:09.648805+0000","last_became_active":"2023-12-18T10:18:05.626588+0000","last_became_peered":"2023-12-18T10:18:05.626588+0000","last_unstale":"2023-12-18T10:18:09.648805+0000","last_undegraded":"2023-12-18T10:18:09.648805+0000","last_fullsized":"2023-12-18T10:18:09.648805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:41.607752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.035047+0000","last_change":"2023-12-18T10:18:09.660419+0000","last_active":"2023-12-18T10:18:10.035047+0000","last_peered":"2023-12-18T10:18:10.035047+0000","last_clean":"2023-12-18T10:18:10.035047+0000","last_became_active":"2023-12-18T10:18:09.659964+0000","last_became_peered":"2023-12-18T10:18:09.659964+0000","last_unstale":"2023-12-18T10:18:10.035047+0000","last_undegraded":"2023-12-18T10:18:10.035047+0000","last_fullsized":"2023-12-18T10:18:10.035047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:33:51.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647972+0000","last_change":"2023-12-18T10:18:05.628648+0000","last_active":"2023-12-18T10:18:09.647972+0000","last_peered":"2023-12-18T10:18:09.647972+0000","last_clean":"2023-12-18T10:18:09.647972+0000","last_became_active":"2023-12-18T10:18:05.628154+0000","last_became_peered":"2023-12-18T10:18:05.628154+0000","last_unstale":"2023-12-18T10:18:09.647972+0000","last_undegraded":"2023-12-18T10:18:09.647972+0000","last_fullsized":"2023-12-18T10:18:09.647972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:50:58.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655680+0000","last_change":"2023-12-18T10:18:05.643692+0000","last_active":"2023-12-18T10:18:09.655680+0000","last_peered":"2023-12-18T10:18:09.655680+0000","last_clean":"2023-12-18T10:18:09.655680+0000","last_became_active":"2023-12-18T10:18:05.643379+0000","last_became_peered":"2023-12-18T10:18:05.643379+0000","last_unstale":"2023-12-18T10:18:09.655680+0000","last_undegraded":"2023-12-18T10:18:09.655680+0000","last_fullsized":"2023-12-18T10:18:09.655680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:19.558466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645387+0000","last_change":"2023-12-18T10:18:05.646467+0000","last_active":"2023-12-18T10:18:09.645387+0000","last_peered":"2023-12-18T10:18:09.645387+0000","last_clean":"2023-12-18T10:18:09.645387+0000","last_became_active":"2023-12-18T10:18:05.646251+0000","last_became_peered":"2023-12-18T10:18:05.646251+0000","last_unstale":"2023-12-18T10:18:09.645387+0000","last_undegraded":"2023-12-18T10:18:09.645387+0000","last_fullsized":"2023-12-18T10:18:09.645387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:53:47.177413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647452+0000","last_change":"2023-12-18T10:18:05.636522+0000","last_active":"2023-12-18T10:18:09.647452+0000","last_peered":"2023-12-18T10:18:09.647452+0000","last_clean":"2023-12-18T10:18:09.647452+0000","last_became_active":"2023-12-18T10:18:05.636274+0000","last_became_peered":"2023-12-18T10:18:05.636274+0000","last_unstale":"2023-12-18T10:18:09.647452+0000","last_undegraded":"2023-12-18T10:18:09.647452+0000","last_fullsized":"2023-12-18T10:18:09.647452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644075+0000","last_change":"2023-12-18T10:18:05.641530+0000","last_active":"2023-12-18T10:18:09.644075+0000","last_peered":"2023-12-18T10:18:09.644075+0000","last_clean":"2023-12-18T10:18:09.644075+0000","last_became_active":"2023-12-18T10:18:05.641184+0000","last_became_peered":"2023-12-18T10:18:05.641184+0000","last_unstale":"2023-12-18T10:18:09.644075+0000","last_undegraded":"2023-12-18T10:18:09.644075+0000","last_fullsized":"2023-12-18T10:18:09.644075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:13:52.820727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638695+0000","last_change":"2023-12-18T10:18:05.642375+0000","last_active":"2023-12-18T10:18:09.638695+0000","last_peered":"2023-12-18T10:18:09.638695+0000","last_clean":"2023-12-18T10:18:09.638695+0000","last_became_active":"2023-12-18T10:18:05.641952+0000","last_became_peered":"2023-12-18T10:18:05.641952+0000","last_unstale":"2023-12-18T10:18:09.638695+0000","last_undegraded":"2023-12-18T10:18:09.638695+0000","last_fullsized":"2023-12-18T10:18:09.638695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650445+0000","last_change":"2023-12-18T10:18:05.633875+0000","last_active":"2023-12-18T10:18:09.650445+0000","last_peered":"2023-12-18T10:18:09.650445+0000","last_clean":"2023-12-18T10:18:09.650445+0000","last_became_active":"2023-12-18T10:18:05.633604+0000","last_became_peered":"2023-12-18T10:18:05.633604+0000","last_unstale":"2023-12-18T10:18:09.650445+0000","last_undegraded":"2023-12-18T10:18:09.650445+0000","last_fullsized":"2023-12-18T10:18:09.650445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650100+0000","last_change":"2023-12-18T10:18:05.641319+0000","last_active":"2023-12-18T10:18:09.650100+0000","last_peered":"2023-12-18T10:18:09.650100+0000","last_clean":"2023-12-18T10:18:09.650100+0000","last_became_active":"2023-12-18T10:18:05.641023+0000","last_became_peered":"2023-12-18T10:18:05.641023+0000","last_unstale":"2023-12-18T10:18:09.650100+0000","last_undegraded":"2023-12-18T10:18:09.650100+0000","last_fullsized":"2023-12-18T10:18:09.650100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643898+0000","last_change":"2023-12-18T10:18:05.644280+0000","last_active":"2023-12-18T10:18:09.643898+0000","last_peered":"2023-12-18T10:18:09.643898+0000","last_clean":"2023-12-18T10:18:09.643898+0000","last_became_active":"2023-12-18T10:18:05.643995+0000","last_became_peered":"2023-12-18T10:18:05.643995+0000","last_unstale":"2023-12-18T10:18:09.643898+0000","last_undegraded":"2023-12-18T10:18:09.643898+0000","last_fullsized":"2023-12-18T10:18:09.643898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.641117+0000","last_change":"2023-12-18T10:18:05.633363+0000","last_active":"2023-12-18T10:18:09.641117+0000","last_peered":"2023-12-18T10:18:09.641117+0000","last_clean":"2023-12-18T10:18:09.641117+0000","last_became_active":"2023-12-18T10:18:05.633080+0000","last_became_peered":"2023-12-18T10:18:05.633080+0000","last_unstale":"2023-12-18T10:18:09.641117+0000","last_undegraded":"2023-12-18T10:18:09.641117+0000","last_fullsized":"2023-12-18T10:18:09.641117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645306+0000","last_change":"2023-12-18T10:18:05.647944+0000","last_active":"2023-12-18T10:18:09.645306+0000","last_peered":"2023-12-18T10:18:09.645306+0000","last_clean":"2023-12-18T10:18:09.645306+0000","last_became_active":"2023-12-18T10:18:05.646783+0000","last_became_peered":"2023-12-18T10:18:05.646783+0000","last_unstale":"2023-12-18T10:18:09.645306+0000","last_undegraded":"2023-12-18T10:18:09.645306+0000","last_fullsized":"2023-12-18T10:18:09.645306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646684+0000","last_change":"2023-12-18T10:18:05.625564+0000","last_active":"2023-12-18T10:18:09.646684+0000","last_peered":"2023-12-18T10:18:09.646684+0000","last_clean":"2023-12-18T10:18:09.646684+0000","last_became_active":"2023-12-18T10:18:05.625276+0000","last_became_peered":"2023-12-18T10:18:05.625276+0000","last_unstale":"2023-12-18T10:18:09.646684+0000","last_undegraded":"2023-12-18T10:18:09.646684+0000","last_fullsized":"2023-12-18T10:18:09.646684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647564+0000","last_change":"2023-12-18T10:18:05.630745+0000","last_active":"2023-12-18T10:18:09.647564+0000","last_peered":"2023-12-18T10:18:09.647564+0000","last_clean":"2023-12-18T10:18:09.647564+0000","last_became_active":"2023-12-18T10:18:05.630408+0000","last_became_peered":"2023-12-18T10:18:05.630408+0000","last_unstale":"2023-12-18T10:18:09.647564+0000","last_undegraded":"2023-12-18T10:18:09.647564+0000","last_fullsized":"2023-12-18T10:18:09.647564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704579+0000","last_change":"2023-12-18T10:18:05.631928+0000","last_active":"2023-12-18T10:18:09.704579+0000","last_peered":"2023-12-18T10:18:09.704579+0000","last_clean":"2023-12-18T10:18:09.704579+0000","last_became_active":"2023-12-18T10:18:05.631639+0000","last_became_peered":"2023-12-18T10:18:05.631639+0000","last_unstale":"2023-12-18T10:18:09.704579+0000","last_undegraded":"2023-12-18T10:18:09.704579+0000","last_fullsized":"2023-12-18T10:18:09.704579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656090+0000","last_change":"2023-12-18T10:18:05.641653+0000","last_active":"2023-12-18T10:18:09.656090+0000","last_peered":"2023-12-18T10:18:09.656090+0000","last_clean":"2023-12-18T10:18:09.656090+0000","last_became_active":"2023-12-18T10:18:05.641408+0000","last_became_peered":"2023-12-18T10:18:05.641408+0000","last_unstale":"2023-12-18T10:18:09.656090+0000","last_undegraded":"2023-12-18T10:18:09.656090+0000","last_fullsized":"2023-12-18T10:18:09.656090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:20.317228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644857+0000","last_change":"2023-12-18T10:18:05.650138+0000","last_active":"2023-12-18T10:18:09.644857+0000","last_peered":"2023-12-18T10:18:09.644857+0000","last_clean":"2023-12-18T10:18:09.644857+0000","last_became_active":"2023-12-18T10:18:05.647457+0000","last_became_peered":"2023-12-18T10:18:05.647457+0000","last_unstale":"2023-12-18T10:18:09.644857+0000","last_undegraded":"2023-12-18T10:18:09.644857+0000","last_fullsized":"2023-12-18T10:18:09.644857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:12:38.639031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643520+0000","last_change":"2023-12-18T10:18:05.640210+0000","last_active":"2023-12-18T10:18:09.643520+0000","last_peered":"2023-12-18T10:18:09.643520+0000","last_clean":"2023-12-18T10:18:09.643520+0000","last_became_active":"2023-12-18T10:18:05.639794+0000","last_became_peered":"2023-12-18T10:18:05.639794+0000","last_unstale":"2023-12-18T10:18:09.643520+0000","last_undegraded":"2023-12-18T10:18:09.643520+0000","last_fullsized":"2023-12-18T10:18:09.643520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637153+0000","last_change":"2023-12-18T10:18:05.633876+0000","last_active":"2023-12-18T10:18:09.637153+0000","last_peered":"2023-12-18T10:18:09.637153+0000","last_clean":"2023-12-18T10:18:09.637153+0000","last_became_active":"2023-12-18T10:18:05.632329+0000","last_became_peered":"2023-12-18T10:18:05.632329+0000","last_unstale":"2023-12-18T10:18:09.637153+0000","last_undegraded":"2023-12-18T10:18:09.637153+0000","last_fullsized":"2023-12-18T10:18:09.637153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643976+0000","last_change":"2023-12-18T10:18:05.620955+0000","last_active":"2023-12-18T10:18:09.643976+0000","last_peered":"2023-12-18T10:18:09.643976+0000","last_clean":"2023-12-18T10:18:09.643976+0000","last_became_active":"2023-12-18T10:18:05.620450+0000","last_became_peered":"2023-12-18T10:18:05.620450+0000","last_unstale":"2023-12-18T10:18:09.643976+0000","last_undegraded":"2023-12-18T10:18:09.643976+0000","last_fullsized":"2023-12-18T10:18:09.643976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:50:58.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642806+0000","last_change":"2023-12-18T10:18:05.642199+0000","last_active":"2023-12-18T10:18:09.642806+0000","last_peered":"2023-12-18T10:18:09.642806+0000","last_clean":"2023-12-18T10:18:09.642806+0000","last_became_active":"2023-12-18T10:18:05.641941+0000","last_became_peered":"2023-12-18T10:18:05.641941+0000","last_unstale":"2023-12-18T10:18:09.642806+0000","last_undegraded":"2023-12-18T10:18:09.642806+0000","last_fullsized":"2023-12-18T10:18:09.642806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649504+0000","last_change":"2023-12-18T10:18:05.634730+0000","last_active":"2023-12-18T10:18:09.649504+0000","last_peered":"2023-12-18T10:18:09.649504+0000","last_clean":"2023-12-18T10:18:09.649504+0000","last_became_active":"2023-12-18T10:18:05.634191+0000","last_became_peered":"2023-12-18T10:18:05.634191+0000","last_unstale":"2023-12-18T10:18:09.649504+0000","last_undegraded":"2023-12-18T10:18:09.649504+0000","last_fullsized":"2023-12-18T10:18:09.649504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:13.517290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647871+0000","last_change":"2023-12-18T10:18:05.636229+0000","last_active":"2023-12-18T10:18:09.647871+0000","last_peered":"2023-12-18T10:18:09.647871+0000","last_clean":"2023-12-18T10:18:09.647871+0000","last_became_active":"2023-12-18T10:18:05.635905+0000","last_became_peered":"2023-12-18T10:18:05.635905+0000","last_unstale":"2023-12-18T10:18:09.647871+0000","last_undegraded":"2023-12-18T10:18:09.647871+0000","last_fullsized":"2023-12-18T10:18:09.647871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650359+0000","last_change":"2023-12-18T10:18:05.638343+0000","last_active":"2023-12-18T10:18:09.650359+0000","last_peered":"2023-12-18T10:18:09.650359+0000","last_clean":"2023-12-18T10:18:09.650359+0000","last_became_active":"2023-12-18T10:18:05.637808+0000","last_became_peered":"2023-12-18T10:18:05.637808+0000","last_unstale":"2023-12-18T10:18:09.650359+0000","last_undegraded":"2023-12-18T10:18:09.650359+0000","last_fullsized":"2023-12-18T10:18:09.650359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704697+0000","last_change":"2023-12-18T10:18:05.644226+0000","last_active":"2023-12-18T10:18:09.704697+0000","last_peered":"2023-12-18T10:18:09.704697+0000","last_clean":"2023-12-18T10:18:09.704697+0000","last_became_active":"2023-12-18T10:18:05.643711+0000","last_became_peered":"2023-12-18T10:18:05.643711+0000","last_unstale":"2023-12-18T10:18:09.704697+0000","last_undegraded":"2023-12-18T10:18:09.704697+0000","last_fullsized":"2023-12-18T10:18:09.704697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:14.759979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.639933+0000","last_change":"2023-12-18T10:18:05.643930+0000","last_active":"2023-12-18T10:18:09.639933+0000","last_peered":"2023-12-18T10:18:09.639933+0000","last_clean":"2023-12-18T10:18:09.639933+0000","last_became_active":"2023-12-18T10:18:05.642465+0000","last_became_peered":"2023-12-18T10:18:05.642465+0000","last_unstale":"2023-12-18T10:18:09.639933+0000","last_undegraded":"2023-12-18T10:18:09.639933+0000","last_fullsized":"2023-12-18T10:18:09.639933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704110+0000","last_change":"2023-12-18T10:18:05.629320+0000","last_active":"2023-12-18T10:18:09.704110+0000","last_peered":"2023-12-18T10:18:09.704110+0000","last_clean":"2023-12-18T10:18:09.704110+0000","last_became_active":"2023-12-18T10:18:05.628995+0000","last_became_peered":"2023-12-18T10:18:05.628995+0000","last_unstale":"2023-12-18T10:18:09.704110+0000","last_undegraded":"2023-12-18T10:18:09.704110+0000","last_fullsized":"2023-12-18T10:18:09.704110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:01:46.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645210+0000","last_change":"2023-12-18T10:18:05.639987+0000","last_active":"2023-12-18T10:18:09.645210+0000","last_peered":"2023-12-18T10:18:09.645210+0000","last_clean":"2023-12-18T10:18:09.645210+0000","last_became_active":"2023-12-18T10:18:05.639712+0000","last_became_peered":"2023-12-18T10:18:05.639712+0000","last_unstale":"2023-12-18T10:18:09.645210+0000","last_undegraded":"2023-12-18T10:18:09.645210+0000","last_fullsized":"2023-12-18T10:18:09.645210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704265+0000","last_change":"2023-12-18T10:18:05.633072+0000","last_active":"2023-12-18T10:18:09.704265+0000","last_peered":"2023-12-18T10:18:09.704265+0000","last_clean":"2023-12-18T10:18:09.704265+0000","last_became_active":"2023-12-18T10:18:05.632175+0000","last_became_peered":"2023-12-18T10:18:05.632175+0000","last_unstale":"2023-12-18T10:18:09.704265+0000","last_undegraded":"2023-12-18T10:18:09.704265+0000","last_fullsized":"2023-12-18T10:18:09.704265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646517+0000","last_change":"2023-12-18T10:18:05.644282+0000","last_active":"2023-12-18T10:18:09.646517+0000","last_peered":"2023-12-18T10:18:09.646517+0000","last_clean":"2023-12-18T10:18:09.646517+0000","last_became_active":"2023-12-18T10:18:05.643886+0000","last_became_peered":"2023-12-18T10:18:05.643886+0000","last_unstale":"2023-12-18T10:18:09.646517+0000","last_undegraded":"2023-12-18T10:18:09.646517+0000","last_fullsized":"2023-12-18T10:18:09.646517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:01:46.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643972+0000","last_change":"2023-12-18T10:18:05.627422+0000","last_active":"2023-12-18T10:18:09.643972+0000","last_peered":"2023-12-18T10:18:09.643972+0000","last_clean":"2023-12-18T10:18:09.643972+0000","last_became_active":"2023-12-18T10:18:05.627154+0000","last_became_peered":"2023-12-18T10:18:05.627154+0000","last_unstale":"2023-12-18T10:18:09.643972+0000","last_undegraded":"2023-12-18T10:18:09.643972+0000","last_fullsized":"2023-12-18T10:18:09.643972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:13:52.820727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637893+0000","last_change":"2023-12-18T10:18:05.617908+0000","last_active":"2023-12-18T10:18:09.637893+0000","last_peered":"2023-12-18T10:18:09.637893+0000","last_clean":"2023-12-18T10:18:09.637893+0000","last_became_active":"2023-12-18T10:18:05.617637+0000","last_became_peered":"2023-12-18T10:18:05.617637+0000","last_unstale":"2023-12-18T10:18:09.637893+0000","last_undegraded":"2023-12-18T10:18:09.637893+0000","last_fullsized":"2023-12-18T10:18:09.637893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704633+0000","last_change":"2023-12-18T10:18:05.643965+0000","last_active":"2023-12-18T10:18:09.704633+0000","last_peered":"2023-12-18T10:18:09.704633+0000","last_clean":"2023-12-18T10:18:09.704633+0000","last_became_active":"2023-12-18T10:18:05.643043+0000","last_became_peered":"2023-12-18T10:18:05.643043+0000","last_unstale":"2023-12-18T10:18:09.704633+0000","last_undegraded":"2023-12-18T10:18:09.704633+0000","last_fullsized":"2023-12-18T10:18:09.704633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:12:38.639031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:18:30.050 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:18:30.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d3b39640 1 Processor -- start 2023-12-18T10:18:30.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d3b39640 1 -- start start 2023-12-18T10:18:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d3b39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc15ca40 0x7f69cc0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d3b39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69cc0ce3f0 0x7f69cc0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d3b39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69cc0cf610 0x7f69cc1605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d3b39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69cc0cfa70 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d3b39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69cc0d11c0 con 0x7f69cc0cf610 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d3b39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0d0310 con 0x7f69cc15ca40 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d10d4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69cc0ce3f0 0x7f69cc0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d10d4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69cc0ce3f0 0x7f69cc0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48288/0 (socket says 172.21.15.133:48288) 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d10d4640 1 -- 172.21.15.133:0/2253183631 learned_addr learned my addr 172.21.15.133:0/2253183631 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d20d6640 1 --2- 172.21.15.133:0/2253183631 >> v2:172.21.15.142:3300/0 conn(0x7f69cc0cf610 0x7f69cc1605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d18d5640 1 --2- 172.21.15.133:0/2253183631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc15ca40 0x7f69cc0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d10d4640 1 -- 172.21.15.133:0/2253183631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc15ca40 msgr2=0x7f69cc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d10d4640 1 --2- 172.21.15.133:0/2253183631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc15ca40 0x7f69cc0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d10d4640 1 -- 172.21.15.133:0/2253183631 >> v2:172.21.15.142:3300/0 conn(0x7f69cc0cf610 msgr2=0x7f69cc1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d10d4640 1 --2- 172.21.15.133:0/2253183631 >> v2:172.21.15.142:3300/0 conn(0x7f69cc0cf610 0x7f69cc1605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.222+0000 7f69d10d4640 1 -- 172.21.15.133:0/2253183631 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc0d05b0 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d10d4640 1 --2- 172.21.15.133:0/2253183631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc0cf0d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0b52f0 tx=0x7f69bc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769143ba1ba783a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d08d3640 1 -- 172.21.15.133:0/2253183631 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0ab600 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d08d3640 1 -- 172.21.15.133:0/2253183631 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc0a7050 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d08d3640 1 -- 172.21.15.133:0/2253183631 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0ab980 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 -- 172.21.15.133:0/2253183631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 msgr2=0x7f69cc0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 --2- 172.21.15.133:0/2253183631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc0cf0d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0b52f0 tx=0x7f69bc01c240 comp rx=0 tx=0).stop 2023-12-18T10:18:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 -- 172.21.15.133:0/2253183631 shutdown_connections 2023-12-18T10:18:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 --2- 172.21.15.133:0/2253183631 >> v2:172.21.15.142:3300/0 conn(0x7f69cc0cf610 0x7f69cc1605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 --2- 172.21.15.133:0/2253183631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc0cf0d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 --2- 172.21.15.133:0/2253183631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc15ca40 0x7f69cc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 -- 172.21.15.133:0/2253183631 >> 172.21.15.133:0/2253183631 conn(0x7f69cc089fb0 msgr2=0x7f69cc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 -- 172.21.15.133:0/2253183631 shutdown_connections 2023-12-18T10:18:30.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.226+0000 7f69d3b39640 1 -- 172.21.15.133:0/2253183631 wait complete. 2023-12-18T10:18:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 Processor -- start 2023-12-18T10:18:30.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 -- start start 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc0cf610 0x7f69cc15d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc15ca40 0x7f69cc0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0c9240 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc154ee0 con 0x7f69cc15ca40 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0c8fa0 con 0x7f69cc0cf610 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc1549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48300/0 (socket says 172.21.15.133:48300) 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 -- 172.21.15.133:0/1954804202 learned_addr learned my addr 172.21.15.133:0/1954804202 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d20d6640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc15ca40 0x7f69cc0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d10d4640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc0cf610 0x7f69cc15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 -- 172.21.15.133:0/1954804202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc0cf610 msgr2=0x7f69cc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc0cf610 0x7f69cc15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 -- 172.21.15.133:0/1954804202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc15ca40 msgr2=0x7f69cc0c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc15ca40 0x7f69cc0c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 -- 172.21.15.133:0/1954804202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc009480 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d18d5640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc1549a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f69c800e9b0 tx=0x7f69c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69c27fc640 1 -- 172.21.15.133:0/1954804202 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c8009670 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69c27fc640 1 -- 172.21.15.133:0/1954804202 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c800c9a0 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69c27fc640 1 -- 172.21.15.133:0/1954804202 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c800cd10 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc0c6ca0 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc0b8140 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.230+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc0c6e30 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.234+0000 7f69c27fc640 1 -- 172.21.15.133:0/1954804202 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f69c8013470 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.234+0000 7f69c27fc640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f69b0065a60 0x7f69b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.234+0000 7f69c27fc640 1 -- 172.21.15.133:0/1954804202 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69c8083ad0 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.234+0000 7f69d10d4640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f69b0065a60 0x7f69b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.234+0000 7f69d10d4640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f69b0065a60 0x7f69b0067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0ad000 tx=0x7f69bc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.238+0000 7f69c27fc640 1 -- 172.21.15.133:0/1954804202 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f69cc0c6e30 con 0x7f69cc0ce3f0 2023-12-18T10:18:30.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.382+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69cc15ce20 con 0x7f69b0065a60 2023-12-18T10:18:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.394+0000 7f69c27fc640 1 -- 172.21.15.133:0/1954804202 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345284 (secure 0 0 0) 0x7f69bc0a4e90 con 0x7f69b0065a60 2023-12-18T10:18:30.398 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:30.400 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:18:30.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f69b0065a60 msgr2=0x7f69b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f69b0065a60 0x7f69b0067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0ad000 tx=0x7f69bc0a6000 comp rx=0 tx=0).stop 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 msgr2=0x7f69cc1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc1549a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f69c800e9b0 tx=0x7f69c800ee70 comp rx=0 tx=0).stop 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 shutdown_connections 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f69b0065a60 0x7f69b0067f20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69cc15ca40 0x7f69cc0c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69cc0cf610 0x7f69cc15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 --2- 172.21.15.133:0/1954804202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69cc0ce3f0 0x7f69cc1549a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 >> 172.21.15.133:0/1954804202 conn(0x7f69cc089fb0 msgr2=0x7f69cc15ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 shutdown_connections 2023-12-18T10:18:30.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.398+0000 7f69d3b39640 1 -- 172.21.15.133:0/1954804202 wait complete. 2023-12-18T10:18:30.418 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-12-18T10:18:29.100040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1988164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002569"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647104+0000","last_change":"2023-12-18T10:18:05.252867+0000","last_active":"2023-12-18T10:18:09.647104+0000","last_peered":"2023-12-18T10:18:09.647104+0000","last_clean":"2023-12-18T10:18:09.647104+0000","last_became_active":"2023-12-18T10:18:05.252419+0000","last_became_peered":"2023-12-18T10:18:05.252419+0000","last_unstale":"2023-12-18T10:18:09.647104+0000","last_undegraded":"2023-12-18T10:18:09.647104+0000","last_fullsized":"2023-12-18T10:18:09.647104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:47:42.905512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645468+0000","last_change":"2023-12-18T10:18:05.643046+0000","last_active":"2023-12-18T10:18:09.645468+0000","last_peered":"2023-12-18T10:18:09.645468+0000","last_clean":"2023-12-18T10:18:09.645468+0000","last_became_active":"2023-12-18T10:18:05.642791+0000","last_became_peered":"2023-12-18T10:18:05.642791+0000","last_unstale":"2023-12-18T10:18:09.645468+0000","last_undegraded":"2023-12-18T10:18:09.645468+0000","last_fullsized":"2023-12-18T10:18:09.645468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034832+0000","last_change":"2023-12-18T10:18:09.709220+0000","last_active":"2023-12-18T10:18:10.034832+0000","last_peered":"2023-12-18T10:18:10.034832+0000","last_clean":"2023-12-18T10:18:10.034832+0000","last_became_active":"2023-12-18T10:18:09.708175+0000","last_became_peered":"2023-12-18T10:18:09.708175+0000","last_unstale":"2023-12-18T10:18:10.034832+0000","last_undegraded":"2023-12-18T10:18:10.034832+0000","last_fullsized":"2023-12-18T10:18:10.034832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:02.059562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648001+0000","last_change":"2023-12-18T10:18:05.240468+0000","last_active":"2023-12-18T10:18:09.648001+0000","last_peered":"2023-12-18T10:18:09.648001+0000","last_clean":"2023-12-18T10:18:09.648001+0000","last_became_active":"2023-12-18T10:18:05.239955+0000","last_became_peered":"2023-12-18T10:18:05.239955+0000","last_unstale":"2023-12-18T10:18:09.648001+0000","last_undegraded":"2023-12-18T10:18:09.648001+0000","last_fullsized":"2023-12-18T10:18:09.648001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646951+0000","last_change":"2023-12-18T10:18:05.648087+0000","last_active":"2023-12-18T10:18:09.646951+0000","last_peered":"2023-12-18T10:18:09.646951+0000","last_clean":"2023-12-18T10:18:09.646951+0000","last_became_active":"2023-12-18T10:18:05.647265+0000","last_became_peered":"2023-12-18T10:18:05.647265+0000","last_unstale":"2023-12-18T10:18:09.646951+0000","last_undegraded":"2023-12-18T10:18:09.646951+0000","last_fullsized":"2023-12-18T10:18:09.646951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:15.127242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171471+0000","last_change":"2023-12-18T10:18:09.667338+0000","last_active":"2023-12-18T10:18:11.171471+0000","last_peered":"2023-12-18T10:18:11.171471+0000","last_clean":"2023-12-18T10:18:11.171471+0000","last_became_active":"2023-12-18T10:18:09.666888+0000","last_became_peered":"2023-12-18T10:18:09.666888+0000","last_unstale":"2023-12-18T10:18:11.171471+0000","last_undegraded":"2023-12-18T10:18:11.171471+0000","last_fullsized":"2023-12-18T10:18:11.171471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:21.579648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704718+0000","last_change":"2023-12-18T10:18:05.255666+0000","last_active":"2023-12-18T10:18:09.704718+0000","last_peered":"2023-12-18T10:18:09.704718+0000","last_clean":"2023-12-18T10:18:09.704718+0000","last_became_active":"2023-12-18T10:18:05.255121+0000","last_became_peered":"2023-12-18T10:18:05.255121+0000","last_unstale":"2023-12-18T10:18:09.704718+0000","last_undegraded":"2023-12-18T10:18:09.704718+0000","last_fullsized":"2023-12-18T10:18:09.704718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:19.309867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646594+0000","last_change":"2023-12-18T10:18:05.651636+0000","last_active":"2023-12-18T10:18:09.646594+0000","last_peered":"2023-12-18T10:18:09.646594+0000","last_clean":"2023-12-18T10:18:09.646594+0000","last_became_active":"2023-12-18T10:18:05.651333+0000","last_became_peered":"2023-12-18T10:18:05.651333+0000","last_unstale":"2023-12-18T10:18:09.646594+0000","last_undegraded":"2023-12-18T10:18:09.646594+0000","last_fullsized":"2023-12-18T10:18:09.646594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171893+0000","last_change":"2023-12-18T10:18:09.672786+0000","last_active":"2023-12-18T10:18:11.171893+0000","last_peered":"2023-12-18T10:18:11.171893+0000","last_clean":"2023-12-18T10:18:11.171893+0000","last_became_active":"2023-12-18T10:18:09.672297+0000","last_became_peered":"2023-12-18T10:18:09.672297+0000","last_unstale":"2023-12-18T10:18:11.171893+0000","last_undegraded":"2023-12-18T10:18:11.171893+0000","last_fullsized":"2023-12-18T10:18:11.171893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704387+0000","last_change":"2023-12-18T10:18:05.259470+0000","last_active":"2023-12-18T10:18:09.704387+0000","last_peered":"2023-12-18T10:18:09.704387+0000","last_clean":"2023-12-18T10:18:09.704387+0000","last_became_active":"2023-12-18T10:18:05.259178+0000","last_became_peered":"2023-12-18T10:18:05.259178+0000","last_unstale":"2023-12-18T10:18:09.704387+0000","last_undegraded":"2023-12-18T10:18:09.704387+0000","last_fullsized":"2023-12-18T10:18:09.704387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:18.551106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645863+0000","last_change":"2023-12-18T10:18:05.647456+0000","last_active":"2023-12-18T10:18:09.645863+0000","last_peered":"2023-12-18T10:18:09.645863+0000","last_clean":"2023-12-18T10:18:09.645863+0000","last_became_active":"2023-12-18T10:18:05.647171+0000","last_became_peered":"2023-12-18T10:18:05.647171+0000","last_unstale":"2023-12-18T10:18:09.645863+0000","last_undegraded":"2023-12-18T10:18:09.645863+0000","last_fullsized":"2023-12-18T10:18:09.645863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171921+0000","last_change":"2023-12-18T10:18:09.663391+0000","last_active":"2023-12-18T10:18:11.171921+0000","last_peered":"2023-12-18T10:18:11.171921+0000","last_clean":"2023-12-18T10:18:11.171921+0000","last_became_active":"2023-12-18T10:18:09.662939+0000","last_became_peered":"2023-12-18T10:18:09.662939+0000","last_unstale":"2023-12-18T10:18:11.171921+0000","last_undegraded":"2023-12-18T10:18:11.171921+0000","last_fullsized":"2023-12-18T10:18:11.171921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:40.435617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648575+0000","last_change":"2023-12-18T10:18:05.631751+0000","last_active":"2023-12-18T10:18:09.648575+0000","last_peered":"2023-12-18T10:18:09.648575+0000","last_clean":"2023-12-18T10:18:09.648575+0000","last_became_active":"2023-12-18T10:18:05.631484+0000","last_became_peered":"2023-12-18T10:18:05.631484+0000","last_unstale":"2023-12-18T10:18:09.648575+0000","last_undegraded":"2023-12-18T10:18:09.648575+0000","last_fullsized":"2023-12-18T10:18:09.648575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704350+0000","last_change":"2023-12-18T10:18:05.249053+0000","last_active":"2023-12-18T10:18:09.704350+0000","last_peered":"2023-12-18T10:18:09.704350+0000","last_clean":"2023-12-18T10:18:09.704350+0000","last_became_active":"2023-12-18T10:18:05.248510+0000","last_became_peered":"2023-12-18T10:18:05.248510+0000","last_unstale":"2023-12-18T10:18:09.704350+0000","last_undegraded":"2023-12-18T10:18:09.704350+0000","last_fullsized":"2023-12-18T10:18:09.704350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172429+0000","last_change":"2023-12-18T10:18:09.674408+0000","last_active":"2023-12-18T10:18:11.172429+0000","last_peered":"2023-12-18T10:18:11.172429+0000","last_clean":"2023-12-18T10:18:11.172429+0000","last_became_active":"2023-12-18T10:18:09.673681+0000","last_became_peered":"2023-12-18T10:18:09.673681+0000","last_unstale":"2023-12-18T10:18:11.172429+0000","last_undegraded":"2023-12-18T10:18:11.172429+0000","last_fullsized":"2023-12-18T10:18:11.172429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642885+0000","last_change":"2023-12-18T10:18:05.635754+0000","last_active":"2023-12-18T10:18:09.642885+0000","last_peered":"2023-12-18T10:18:09.642885+0000","last_clean":"2023-12-18T10:18:09.642885+0000","last_became_active":"2023-12-18T10:18:05.635426+0000","last_became_peered":"2023-12-18T10:18:05.635426+0000","last_unstale":"2023-12-18T10:18:09.642885+0000","last_undegraded":"2023-12-18T10:18:09.642885+0000","last_fullsized":"2023-12-18T10:18:09.642885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637872+0000","last_change":"2023-12-18T10:18:05.237366+0000","last_active":"2023-12-18T10:18:09.637872+0000","last_peered":"2023-12-18T10:18:09.637872+0000","last_clean":"2023-12-18T10:18:09.637872+0000","last_became_active":"2023-12-18T10:18:05.237115+0000","last_became_peered":"2023-12-18T10:18:05.237115+0000","last_unstale":"2023-12-18T10:18:09.637872+0000","last_undegraded":"2023-12-18T10:18:09.637872+0000","last_fullsized":"2023-12-18T10:18:09.637872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172373+0000","last_change":"2023-12-18T10:18:09.672293+0000","last_active":"2023-12-18T10:18:11.172373+0000","last_peered":"2023-12-18T10:18:11.172373+0000","last_clean":"2023-12-18T10:18:11.172373+0000","last_became_active":"2023-12-18T10:18:09.671846+0000","last_became_peered":"2023-12-18T10:18:09.671846+0000","last_unstale":"2023-12-18T10:18:11.172373+0000","last_undegraded":"2023-12-18T10:18:11.172373+0000","last_fullsized":"2023-12-18T10:18:11.172373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:15:09.032674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.640106+0000","last_change":"2023-12-18T10:18:05.626910+0000","last_active":"2023-12-18T10:18:09.640106+0000","last_peered":"2023-12-18T10:18:09.640106+0000","last_clean":"2023-12-18T10:18:09.640106+0000","last_became_active":"2023-12-18T10:18:05.623599+0000","last_became_peered":"2023-12-18T10:18:05.623599+0000","last_unstale":"2023-12-18T10:18:09.640106+0000","last_undegraded":"2023-12-18T10:18:09.640106+0000","last_fullsized":"2023-12-18T10:18:09.640106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637099+0000","last_change":"2023-12-18T10:18:05.233603+0000","last_active":"2023-12-18T10:18:09.637099+0000","last_peered":"2023-12-18T10:18:09.637099+0000","last_clean":"2023-12-18T10:18:09.637099+0000","last_became_active":"2023-12-18T10:18:05.233168+0000","last_became_peered":"2023-12-18T10:18:05.233168+0000","last_unstale":"2023-12-18T10:18:09.637099+0000","last_undegraded":"2023-12-18T10:18:09.637099+0000","last_fullsized":"2023-12-18T10:18:09.637099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168704+0000","last_change":"2023-12-18T10:18:09.706676+0000","last_active":"2023-12-18T10:18:11.168704+0000","last_peered":"2023-12-18T10:18:11.168704+0000","last_clean":"2023-12-18T10:18:11.168704+0000","last_became_active":"2023-12-18T10:18:09.705912+0000","last_became_peered":"2023-12-18T10:18:09.705912+0000","last_unstale":"2023-12-18T10:18:11.168704+0000","last_undegraded":"2023-12-18T10:18:11.168704+0000","last_fullsized":"2023-12-18T10:18:11.168704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:57:16.183086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647321+0000","last_change":"2023-12-18T10:18:05.633413+0000","last_active":"2023-12-18T10:18:09.647321+0000","last_peered":"2023-12-18T10:18:09.647321+0000","last_clean":"2023-12-18T10:18:09.647321+0000","last_became_active":"2023-12-18T10:18:05.633042+0000","last_became_peered":"2023-12-18T10:18:05.633042+0000","last_unstale":"2023-12-18T10:18:09.647321+0000","last_undegraded":"2023-12-18T10:18:09.647321+0000","last_fullsized":"2023-12-18T10:18:09.647321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:04.543394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.703942+0000","last_change":"2023-12-18T10:18:05.247809+0000","last_active":"2023-12-18T10:18:09.703942+0000","last_peered":"2023-12-18T10:18:09.703942+0000","last_clean":"2023-12-18T10:18:09.703942+0000","last_became_active":"2023-12-18T10:18:05.247430+0000","last_became_peered":"2023-12-18T10:18:05.247430+0000","last_unstale":"2023-12-18T10:18:09.703942+0000","last_undegraded":"2023-12-18T10:18:09.703942+0000","last_fullsized":"2023-12-18T10:18:09.703942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172259+0000","last_change":"2023-12-18T10:18:09.673789+0000","last_active":"2023-12-18T10:18:11.172259+0000","last_peered":"2023-12-18T10:18:11.172259+0000","last_clean":"2023-12-18T10:18:11.172259+0000","last_became_active":"2023-12-18T10:18:09.672245+0000","last_became_peered":"2023-12-18T10:18:09.672245+0000","last_unstale":"2023-12-18T10:18:11.172259+0000","last_undegraded":"2023-12-18T10:18:11.172259+0000","last_fullsized":"2023-12-18T10:18:11.172259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:57:16.183086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646514+0000","last_change":"2023-12-18T10:18:05.618676+0000","last_active":"2023-12-18T10:18:09.646514+0000","last_peered":"2023-12-18T10:18:09.646514+0000","last_clean":"2023-12-18T10:18:09.646514+0000","last_became_active":"2023-12-18T10:18:05.617947+0000","last_became_peered":"2023-12-18T10:18:05.617947+0000","last_unstale":"2023-12-18T10:18:09.646514+0000","last_undegraded":"2023-12-18T10:18:09.646514+0000","last_fullsized":"2023-12-18T10:18:09.646514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:17.447234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649866+0000","last_change":"2023-12-18T10:18:05.252886+0000","last_active":"2023-12-18T10:18:09.649866+0000","last_peered":"2023-12-18T10:18:09.649866+0000","last_clean":"2023-12-18T10:18:09.649866+0000","last_became_active":"2023-12-18T10:18:05.252552+0000","last_became_peered":"2023-12-18T10:18:05.252552+0000","last_unstale":"2023-12-18T10:18:09.649866+0000","last_undegraded":"2023-12-18T10:18:09.649866+0000","last_fullsized":"2023-12-18T10:18:09.649866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171556+0000","last_change":"2023-12-18T10:18:09.708967+0000","last_active":"2023-12-18T10:18:11.171556+0000","last_peered":"2023-12-18T10:18:11.171556+0000","last_clean":"2023-12-18T10:18:11.171556+0000","last_became_active":"2023-12-18T10:18:09.708596+0000","last_became_peered":"2023-12-18T10:18:09.708596+0000","last_unstale":"2023-12-18T10:18:11.171556+0000","last_undegraded":"2023-12-18T10:18:11.171556+0000","last_fullsized":"2023-12-18T10:18:11.171556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:17.773172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650186+0000","last_change":"2023-12-18T10:18:05.636290+0000","last_active":"2023-12-18T10:18:09.650186+0000","last_peered":"2023-12-18T10:18:09.650186+0000","last_clean":"2023-12-18T10:18:09.650186+0000","last_became_active":"2023-12-18T10:18:05.636016+0000","last_became_peered":"2023-12-18T10:18:05.636016+0000","last_unstale":"2023-12-18T10:18:09.650186+0000","last_undegraded":"2023-12-18T10:18:09.650186+0000","last_fullsized":"2023-12-18T10:18:09.650186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637989+0000","last_change":"2023-12-18T10:18:05.249790+0000","last_active":"2023-12-18T10:18:09.637989+0000","last_peered":"2023-12-18T10:18:09.637989+0000","last_clean":"2023-12-18T10:18:09.637989+0000","last_became_active":"2023-12-18T10:18:05.249433+0000","last_became_peered":"2023-12-18T10:18:05.249433+0000","last_unstale":"2023-12-18T10:18:09.637989+0000","last_undegraded":"2023-12-18T10:18:09.637989+0000","last_fullsized":"2023-12-18T10:18:09.637989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:19.309867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034309+0000","last_change":"2023-12-18T10:18:09.708773+0000","last_active":"2023-12-18T10:18:10.034309+0000","last_peered":"2023-12-18T10:18:10.034309+0000","last_clean":"2023-12-18T10:18:10.034309+0000","last_became_active":"2023-12-18T10:18:09.708308+0000","last_became_peered":"2023-12-18T10:18:09.708308+0000","last_unstale":"2023-12-18T10:18:10.034309+0000","last_undegraded":"2023-12-18T10:18:10.034309+0000","last_fullsized":"2023-12-18T10:18:10.034309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:47:06.075688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638426+0000","last_change":"2023-12-18T10:18:05.631244+0000","last_active":"2023-12-18T10:18:09.638426+0000","last_peered":"2023-12-18T10:18:09.638426+0000","last_clean":"2023-12-18T10:18:09.638426+0000","last_became_active":"2023-12-18T10:18:05.630991+0000","last_became_peered":"2023-12-18T10:18:05.630991+0000","last_unstale":"2023-12-18T10:18:09.638426+0000","last_undegraded":"2023-12-18T10:18:09.638426+0000","last_fullsized":"2023-12-18T10:18:09.638426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704655+0000","last_change":"2023-12-18T10:18:05.250025+0000","last_active":"2023-12-18T10:18:09.704655+0000","last_peered":"2023-12-18T10:18:09.704655+0000","last_clean":"2023-12-18T10:18:09.704655+0000","last_became_active":"2023-12-18T10:18:05.249699+0000","last_became_peered":"2023-12-18T10:18:05.249699+0000","last_unstale":"2023-12-18T10:18:09.704655+0000","last_undegraded":"2023-12-18T10:18:09.704655+0000","last_fullsized":"2023-12-18T10:18:09.704655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169743+0000","last_change":"2023-12-18T10:18:09.706868+0000","last_active":"2023-12-18T10:18:11.169743+0000","last_peered":"2023-12-18T10:18:11.169743+0000","last_clean":"2023-12-18T10:18:11.169743+0000","last_became_active":"2023-12-18T10:18:09.706468+0000","last_became_peered":"2023-12-18T10:18:09.706468+0000","last_unstale":"2023-12-18T10:18:11.169743+0000","last_undegraded":"2023-12-18T10:18:11.169743+0000","last_fullsized":"2023-12-18T10:18:11.169743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645946+0000","last_change":"2023-12-18T10:18:05.645165+0000","last_active":"2023-12-18T10:18:09.645946+0000","last_peered":"2023-12-18T10:18:09.645946+0000","last_clean":"2023-12-18T10:18:09.645946+0000","last_became_active":"2023-12-18T10:18:05.644797+0000","last_became_peered":"2023-12-18T10:18:05.644797+0000","last_unstale":"2023-12-18T10:18:09.645946+0000","last_undegraded":"2023-12-18T10:18:09.645946+0000","last_fullsized":"2023-12-18T10:18:09.645946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:14.759979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638502+0000","last_change":"2023-12-18T10:18:05.240747+0000","last_active":"2023-12-18T10:18:09.638502+0000","last_peered":"2023-12-18T10:18:09.638502+0000","last_clean":"2023-12-18T10:18:09.638502+0000","last_became_active":"2023-12-18T10:18:05.240498+0000","last_became_peered":"2023-12-18T10:18:05.240498+0000","last_unstale":"2023-12-18T10:18:09.638502+0000","last_undegraded":"2023-12-18T10:18:09.638502+0000","last_fullsized":"2023-12-18T10:18:09.638502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168534+0000","last_change":"2023-12-18T10:18:09.668534+0000","last_active":"2023-12-18T10:18:11.168534+0000","last_peered":"2023-12-18T10:18:11.168534+0000","last_clean":"2023-12-18T10:18:11.168534+0000","last_became_active":"2023-12-18T10:18:09.667999+0000","last_became_peered":"2023-12-18T10:18:09.667999+0000","last_unstale":"2023-12-18T10:18:11.168534+0000","last_undegraded":"2023-12-18T10:18:11.168534+0000","last_fullsized":"2023-12-18T10:18:11.168534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:21.579648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649514+0000","last_change":"2023-12-18T10:18:05.631117+0000","last_active":"2023-12-18T10:18:09.649514+0000","last_peered":"2023-12-18T10:18:09.649514+0000","last_clean":"2023-12-18T10:18:09.649514+0000","last_became_active":"2023-12-18T10:18:05.629667+0000","last_became_peered":"2023-12-18T10:18:05.629667+0000","last_unstale":"2023-12-18T10:18:09.649514+0000","last_undegraded":"2023-12-18T10:18:09.649514+0000","last_fullsized":"2023-12-18T10:18:09.649514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:42.689686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645552+0000","last_change":"2023-12-18T10:18:05.245165+0000","last_active":"2023-12-18T10:18:09.645552+0000","last_peered":"2023-12-18T10:18:09.645552+0000","last_clean":"2023-12-18T10:18:09.645552+0000","last_became_active":"2023-12-18T10:18:05.244850+0000","last_became_peered":"2023-12-18T10:18:05.244850+0000","last_unstale":"2023-12-18T10:18:09.645552+0000","last_undegraded":"2023-12-18T10:18:09.645552+0000","last_fullsized":"2023-12-18T10:18:09.645552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168819+0000","last_change":"2023-12-18T10:18:09.665513+0000","last_active":"2023-12-18T10:18:11.168819+0000","last_peered":"2023-12-18T10:18:11.168819+0000","last_clean":"2023-12-18T10:18:11.168819+0000","last_became_active":"2023-12-18T10:18:09.665159+0000","last_became_peered":"2023-12-18T10:18:09.665159+0000","last_unstale":"2023-12-18T10:18:11.168819+0000","last_undegraded":"2023-12-18T10:18:11.168819+0000","last_fullsized":"2023-12-18T10:18:11.168819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:14.170257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637020+0000","last_change":"2023-12-18T10:18:05.629368+0000","last_active":"2023-12-18T10:18:09.637020+0000","last_peered":"2023-12-18T10:18:09.637020+0000","last_clean":"2023-12-18T10:18:09.637020+0000","last_became_active":"2023-12-18T10:18:05.629000+0000","last_became_peered":"2023-12-18T10:18:05.629000+0000","last_unstale":"2023-12-18T10:18:09.637020+0000","last_undegraded":"2023-12-18T10:18:09.637020+0000","last_fullsized":"2023-12-18T10:18:09.637020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655736+0000","last_change":"2023-12-18T10:18:05.238202+0000","last_active":"2023-12-18T10:18:09.655736+0000","last_peered":"2023-12-18T10:18:09.655736+0000","last_clean":"2023-12-18T10:18:09.655736+0000","last_became_active":"2023-12-18T10:18:05.236931+0000","last_became_peered":"2023-12-18T10:18:05.236931+0000","last_unstale":"2023-12-18T10:18:09.655736+0000","last_undegraded":"2023-12-18T10:18:09.655736+0000","last_fullsized":"2023-12-18T10:18:09.655736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168802+0000","last_change":"2023-12-18T10:18:09.666802+0000","last_active":"2023-12-18T10:18:11.168802+0000","last_peered":"2023-12-18T10:18:11.168802+0000","last_clean":"2023-12-18T10:18:11.168802+0000","last_became_active":"2023-12-18T10:18:09.666414+0000","last_became_peered":"2023-12-18T10:18:09.666414+0000","last_unstale":"2023-12-18T10:18:11.168802+0000","last_undegraded":"2023-12-18T10:18:11.168802+0000","last_fullsized":"2023-12-18T10:18:11.168802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644736+0000","last_change":"2023-12-18T10:18:05.622921+0000","last_active":"2023-12-18T10:18:09.644736+0000","last_peered":"2023-12-18T10:18:09.644736+0000","last_clean":"2023-12-18T10:18:09.644736+0000","last_became_active":"2023-12-18T10:18:05.621321+0000","last_became_peered":"2023-12-18T10:18:05.621321+0000","last_unstale":"2023-12-18T10:18:09.644736+0000","last_undegraded":"2023-12-18T10:18:09.644736+0000","last_fullsized":"2023-12-18T10:18:09.644736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.703942+0000","last_change":"2023-12-18T10:18:05.243529+0000","last_active":"2023-12-18T10:18:09.703942+0000","last_peered":"2023-12-18T10:18:09.703942+0000","last_clean":"2023-12-18T10:18:09.703942+0000","last_became_active":"2023-12-18T10:18:05.242883+0000","last_became_peered":"2023-12-18T10:18:05.242883+0000","last_unstale":"2023-12-18T10:18:09.703942+0000","last_undegraded":"2023-12-18T10:18:09.703942+0000","last_fullsized":"2023-12-18T10:18:09.703942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169242+0000","last_change":"2023-12-18T10:18:09.706427+0000","last_active":"2023-12-18T10:18:11.169242+0000","last_peered":"2023-12-18T10:18:11.169242+0000","last_clean":"2023-12-18T10:18:11.169242+0000","last_became_active":"2023-12-18T10:18:09.705936+0000","last_became_peered":"2023-12-18T10:18:09.705936+0000","last_unstale":"2023-12-18T10:18:11.169242+0000","last_undegraded":"2023-12-18T10:18:11.169242+0000","last_fullsized":"2023-12-18T10:18:11.169242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642900+0000","last_change":"2023-12-18T10:18:05.643802+0000","last_active":"2023-12-18T10:18:09.642900+0000","last_peered":"2023-12-18T10:18:09.642900+0000","last_clean":"2023-12-18T10:18:09.642900+0000","last_became_active":"2023-12-18T10:18:05.643536+0000","last_became_peered":"2023-12-18T10:18:05.643536+0000","last_unstale":"2023-12-18T10:18:09.642900+0000","last_undegraded":"2023-12-18T10:18:09.642900+0000","last_fullsized":"2023-12-18T10:18:09.642900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644527+0000","last_change":"2023-12-18T10:18:05.246307+0000","last_active":"2023-12-18T10:18:09.644527+0000","last_peered":"2023-12-18T10:18:09.644527+0000","last_clean":"2023-12-18T10:18:09.644527+0000","last_became_active":"2023-12-18T10:18:05.246011+0000","last_became_peered":"2023-12-18T10:18:05.246011+0000","last_unstale":"2023-12-18T10:18:09.644527+0000","last_undegraded":"2023-12-18T10:18:09.644527+0000","last_fullsized":"2023-12-18T10:18:09.644527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704051+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:18:09.704051+0000","last_peered":"2023-12-18T10:18:09.704051+0000","last_clean":"2023-12-18T10:18:09.704051+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:18:09.704051+0000","last_undegraded":"2023-12-18T10:18:09.704051+0000","last_fullsized":"2023-12-18T10:18:09.704051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169876+0000","last_change":"2023-12-18T10:18:09.708354+0000","last_active":"2023-12-18T10:18:11.169876+0000","last_peered":"2023-12-18T10:18:11.169876+0000","last_clean":"2023-12-18T10:18:11.169876+0000","last_became_active":"2023-12-18T10:18:09.707960+0000","last_became_peered":"2023-12-18T10:18:09.707960+0000","last_unstale":"2023-12-18T10:18:11.169876+0000","last_undegraded":"2023-12-18T10:18:11.169876+0000","last_fullsized":"2023-12-18T10:18:11.169876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:14.308904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704499+0000","last_change":"2023-12-18T10:18:05.632931+0000","last_active":"2023-12-18T10:18:09.704499+0000","last_peered":"2023-12-18T10:18:09.704499+0000","last_clean":"2023-12-18T10:18:09.704499+0000","last_became_active":"2023-12-18T10:18:05.632651+0000","last_became_peered":"2023-12-18T10:18:05.632651+0000","last_unstale":"2023-12-18T10:18:09.704499+0000","last_undegraded":"2023-12-18T10:18:09.704499+0000","last_fullsized":"2023-12-18T10:18:09.704499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656199+0000","last_change":"2023-12-18T10:18:05.242533+0000","last_active":"2023-12-18T10:18:09.656199+0000","last_peered":"2023-12-18T10:18:09.656199+0000","last_clean":"2023-12-18T10:18:09.656199+0000","last_became_active":"2023-12-18T10:18:05.242002+0000","last_became_peered":"2023-12-18T10:18:05.242002+0000","last_unstale":"2023-12-18T10:18:09.656199+0000","last_undegraded":"2023-12-18T10:18:09.656199+0000","last_fullsized":"2023-12-18T10:18:09.656199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:59:16.313417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169703+0000","last_change":"2023-12-18T10:18:09.706487+0000","last_active":"2023-12-18T10:18:11.169703+0000","last_peered":"2023-12-18T10:18:11.169703+0000","last_clean":"2023-12-18T10:18:11.169703+0000","last_became_active":"2023-12-18T10:18:09.705811+0000","last_became_peered":"2023-12-18T10:18:09.705811+0000","last_unstale":"2023-12-18T10:18:11.169703+0000","last_undegraded":"2023-12-18T10:18:11.169703+0000","last_fullsized":"2023-12-18T10:18:11.169703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:04:14.972185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646691+0000","last_change":"2023-12-18T10:18:05.644339+0000","last_active":"2023-12-18T10:18:09.646691+0000","last_peered":"2023-12-18T10:18:09.646691+0000","last_clean":"2023-12-18T10:18:09.646691+0000","last_became_active":"2023-12-18T10:18:05.643830+0000","last_became_peered":"2023-12-18T10:18:05.643830+0000","last_unstale":"2023-12-18T10:18:09.646691+0000","last_undegraded":"2023-12-18T10:18:09.646691+0000","last_fullsized":"2023-12-18T10:18:09.646691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:26.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638847+0000","last_change":"2023-12-18T10:18:05.238798+0000","last_active":"2023-12-18T10:18:09.638847+0000","last_peered":"2023-12-18T10:18:09.638847+0000","last_clean":"2023-12-18T10:18:09.638847+0000","last_became_active":"2023-12-18T10:18:05.238543+0000","last_became_peered":"2023-12-18T10:18:05.238543+0000","last_unstale":"2023-12-18T10:18:09.638847+0000","last_undegraded":"2023-12-18T10:18:09.638847+0000","last_fullsized":"2023-12-18T10:18:09.638847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169838+0000","last_change":"2023-12-18T10:18:09.665779+0000","last_active":"2023-12-18T10:18:11.169838+0000","last_peered":"2023-12-18T10:18:11.169838+0000","last_clean":"2023-12-18T10:18:11.169838+0000","last_became_active":"2023-12-18T10:18:09.665395+0000","last_became_peered":"2023-12-18T10:18:09.665395+0000","last_unstale":"2023-12-18T10:18:11.169838+0000","last_undegraded":"2023-12-18T10:18:11.169838+0000","last_fullsized":"2023-12-18T10:18:11.169838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:14.170257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704713+0000","last_change":"2023-12-18T10:18:05.650433+0000","last_active":"2023-12-18T10:18:09.704713+0000","last_peered":"2023-12-18T10:18:09.704713+0000","last_clean":"2023-12-18T10:18:09.704713+0000","last_became_active":"2023-12-18T10:18:05.650144+0000","last_became_peered":"2023-12-18T10:18:05.650144+0000","last_unstale":"2023-12-18T10:18:09.704713+0000","last_undegraded":"2023-12-18T10:18:09.704713+0000","last_fullsized":"2023-12-18T10:18:09.704713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:26.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656188+0000","last_change":"2023-12-18T10:18:05.239626+0000","last_active":"2023-12-18T10:18:09.656188+0000","last_peered":"2023-12-18T10:18:09.656188+0000","last_clean":"2023-12-18T10:18:09.656188+0000","last_became_active":"2023-12-18T10:18:05.239178+0000","last_became_peered":"2023-12-18T10:18:05.239178+0000","last_unstale":"2023-12-18T10:18:09.656188+0000","last_undegraded":"2023-12-18T10:18:09.656188+0000","last_fullsized":"2023-12-18T10:18:09.656188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169287+0000","last_change":"2023-12-18T10:18:09.708746+0000","last_active":"2023-12-18T10:18:11.169287+0000","last_peered":"2023-12-18T10:18:11.169287+0000","last_clean":"2023-12-18T10:18:11.169287+0000","last_became_active":"2023-12-18T10:18:09.708295+0000","last_became_peered":"2023-12-18T10:18:09.708295+0000","last_unstale":"2023-12-18T10:18:11.169287+0000","last_undegraded":"2023-12-18T10:18:11.169287+0000","last_fullsized":"2023-12-18T10:18:11.169287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704543+0000","last_change":"2023-12-18T10:18:05.632812+0000","last_active":"2023-12-18T10:18:09.704543+0000","last_peered":"2023-12-18T10:18:09.704543+0000","last_clean":"2023-12-18T10:18:09.704543+0000","last_became_active":"2023-12-18T10:18:05.632540+0000","last_became_peered":"2023-12-18T10:18:05.632540+0000","last_unstale":"2023-12-18T10:18:09.704543+0000","last_undegraded":"2023-12-18T10:18:09.704543+0000","last_fullsized":"2023-12-18T10:18:09.704543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.652216+0000","last_change":"2023-12-18T10:18:05.242325+0000","last_active":"2023-12-18T10:18:09.652216+0000","last_peered":"2023-12-18T10:18:09.652216+0000","last_clean":"2023-12-18T10:18:09.652216+0000","last_became_active":"2023-12-18T10:18:05.241704+0000","last_became_peered":"2023-12-18T10:18:05.241704+0000","last_unstale":"2023-12-18T10:18:09.652216+0000","last_undegraded":"2023-12-18T10:18:09.652216+0000","last_fullsized":"2023-12-18T10:18:09.652216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:11:58.708994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171517+0000","last_change":"2023-12-18T10:18:09.667114+0000","last_active":"2023-12-18T10:18:11.171517+0000","last_peered":"2023-12-18T10:18:11.171517+0000","last_clean":"2023-12-18T10:18:11.171517+0000","last_became_active":"2023-12-18T10:18:09.666693+0000","last_became_peered":"2023-12-18T10:18:09.666693+0000","last_unstale":"2023-12-18T10:18:11.171517+0000","last_undegraded":"2023-12-18T10:18:11.171517+0000","last_fullsized":"2023-12-18T10:18:11.171517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:32:34.740316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704259+0000","last_change":"2023-12-18T10:18:05.655274+0000","last_active":"2023-12-18T10:18:09.704259+0000","last_peered":"2023-12-18T10:18:09.704259+0000","last_clean":"2023-12-18T10:18:09.704259+0000","last_became_active":"2023-12-18T10:18:05.654951+0000","last_became_peered":"2023-12-18T10:18:05.654951+0000","last_unstale":"2023-12-18T10:18:09.704259+0000","last_undegraded":"2023-12-18T10:18:09.704259+0000","last_fullsized":"2023-12-18T10:18:09.704259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:53:47.177413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655713+0000","last_change":"2023-12-18T10:18:05.235218+0000","last_active":"2023-12-18T10:18:09.655713+0000","last_peered":"2023-12-18T10:18:09.655713+0000","last_clean":"2023-12-18T10:18:09.655713+0000","last_became_active":"2023-12-18T10:18:05.234772+0000","last_became_peered":"2023-12-18T10:18:05.234772+0000","last_unstale":"2023-12-18T10:18:09.655713+0000","last_undegraded":"2023-12-18T10:18:09.655713+0000","last_fullsized":"2023-12-18T10:18:09.655713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169252+0000","last_change":"2023-12-18T10:18:09.663654+0000","last_active":"2023-12-18T10:18:11.169252+0000","last_peered":"2023-12-18T10:18:11.169252+0000","last_clean":"2023-12-18T10:18:11.169252+0000","last_became_active":"2023-12-18T10:18:09.663075+0000","last_became_peered":"2023-12-18T10:18:09.663075+0000","last_unstale":"2023-12-18T10:18:11.169252+0000","last_undegraded":"2023-12-18T10:18:11.169252+0000","last_fullsized":"2023-12-18T10:18:11.169252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:44:55.941621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648084+0000","last_change":"2023-12-18T10:18:05.628464+0000","last_active":"2023-12-18T10:18:09.648084+0000","last_peered":"2023-12-18T10:18:09.648084+0000","last_clean":"2023-12-18T10:18:09.648084+0000","last_became_active":"2023-12-18T10:18:05.627764+0000","last_became_peered":"2023-12-18T10:18:05.627764+0000","last_unstale":"2023-12-18T10:18:09.648084+0000","last_undegraded":"2023-12-18T10:18:09.648084+0000","last_fullsized":"2023-12-18T10:18:09.648084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:52:49.957417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647814+0000","last_change":"2023-12-18T10:18:05.245296+0000","last_active":"2023-12-18T10:18:09.647814+0000","last_peered":"2023-12-18T10:18:09.647814+0000","last_clean":"2023-12-18T10:18:09.647814+0000","last_became_active":"2023-12-18T10:18:05.242075+0000","last_became_peered":"2023-12-18T10:18:05.242075+0000","last_unstale":"2023-12-18T10:18:09.647814+0000","last_undegraded":"2023-12-18T10:18:09.647814+0000","last_fullsized":"2023-12-18T10:18:09.647814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.035200+0000","last_change":"2023-12-18T10:18:09.709330+0000","last_active":"2023-12-18T10:18:10.035200+0000","last_peered":"2023-12-18T10:18:10.035200+0000","last_clean":"2023-12-18T10:18:10.035200+0000","last_became_active":"2023-12-18T10:18:09.708913+0000","last_became_peered":"2023-12-18T10:18:09.708913+0000","last_unstale":"2023-12-18T10:18:10.035200+0000","last_undegraded":"2023-12-18T10:18:10.035200+0000","last_fullsized":"2023-12-18T10:18:10.035200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:02:51.214432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704354+0000","last_change":"2023-12-18T10:18:05.650555+0000","last_active":"2023-12-18T10:18:09.704354+0000","last_peered":"2023-12-18T10:18:09.704354+0000","last_clean":"2023-12-18T10:18:09.704354+0000","last_became_active":"2023-12-18T10:18:05.648504+0000","last_became_peered":"2023-12-18T10:18:05.648504+0000","last_unstale":"2023-12-18T10:18:09.704354+0000","last_undegraded":"2023-12-18T10:18:09.704354+0000","last_fullsized":"2023-12-18T10:18:09.704354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645470+0000","last_change":"2023-12-18T10:18:05.244257+0000","last_active":"2023-12-18T10:18:09.645470+0000","last_peered":"2023-12-18T10:18:09.645470+0000","last_clean":"2023-12-18T10:18:09.645470+0000","last_became_active":"2023-12-18T10:18:05.242236+0000","last_became_peered":"2023-12-18T10:18:05.242236+0000","last_unstale":"2023-12-18T10:18:09.645470+0000","last_undegraded":"2023-12-18T10:18:09.645470+0000","last_fullsized":"2023-12-18T10:18:09.645470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034855+0000","last_change":"2023-12-18T10:18:09.707426+0000","last_active":"2023-12-18T10:18:10.034855+0000","last_peered":"2023-12-18T10:18:10.034855+0000","last_clean":"2023-12-18T10:18:10.034855+0000","last_became_active":"2023-12-18T10:18:09.705876+0000","last_became_peered":"2023-12-18T10:18:09.705876+0000","last_unstale":"2023-12-18T10:18:10.034855+0000","last_undegraded":"2023-12-18T10:18:10.034855+0000","last_fullsized":"2023-12-18T10:18:10.034855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:55.894492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644039+0000","last_change":"2023-12-18T10:18:05.625605+0000","last_active":"2023-12-18T10:18:09.644039+0000","last_peered":"2023-12-18T10:18:09.644039+0000","last_clean":"2023-12-18T10:18:09.644039+0000","last_became_active":"2023-12-18T10:18:05.625234+0000","last_became_peered":"2023-12-18T10:18:05.625234+0000","last_unstale":"2023-12-18T10:18:09.644039+0000","last_undegraded":"2023-12-18T10:18:09.644039+0000","last_fullsized":"2023-12-18T10:18:09.644039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647757+0000","last_change":"2023-12-18T10:18:05.238939+0000","last_active":"2023-12-18T10:18:09.647757+0000","last_peered":"2023-12-18T10:18:09.647757+0000","last_clean":"2023-12-18T10:18:09.647757+0000","last_became_active":"2023-12-18T10:18:05.238646+0000","last_became_peered":"2023-12-18T10:18:05.238646+0000","last_unstale":"2023-12-18T10:18:09.647757+0000","last_undegraded":"2023-12-18T10:18:09.647757+0000","last_fullsized":"2023-12-18T10:18:09.647757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:20:34.086830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.170663+0000","last_change":"2023-12-18T10:18:09.708597+0000","last_active":"2023-12-18T10:18:11.170663+0000","last_peered":"2023-12-18T10:18:11.170663+0000","last_clean":"2023-12-18T10:18:11.170663+0000","last_became_active":"2023-12-18T10:18:09.708149+0000","last_became_peered":"2023-12-18T10:18:09.708149+0000","last_unstale":"2023-12-18T10:18:11.170663+0000","last_undegraded":"2023-12-18T10:18:11.170663+0000","last_fullsized":"2023-12-18T10:18:11.170663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704400+0000","last_change":"2023-12-18T10:18:05.641901+0000","last_active":"2023-12-18T10:18:09.704400+0000","last_peered":"2023-12-18T10:18:09.704400+0000","last_clean":"2023-12-18T10:18:09.704400+0000","last_became_active":"2023-12-18T10:18:05.641618+0000","last_became_peered":"2023-12-18T10:18:05.641618+0000","last_unstale":"2023-12-18T10:18:09.704400+0000","last_undegraded":"2023-12-18T10:18:09.704400+0000","last_fullsized":"2023-12-18T10:18:09.704400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:15.794107+0000","last_change":"2023-12-18T10:18:05.250912+0000","last_active":"2023-12-18T10:18:15.794107+0000","last_peered":"2023-12-18T10:18:15.794107+0000","last_clean":"2023-12-18T10:18:15.794107+0000","last_became_active":"2023-12-18T10:18:05.250664+0000","last_became_peered":"2023-12-18T10:18:05.250664+0000","last_unstale":"2023-12-18T10:18:15.794107+0000","last_undegraded":"2023-12-18T10:18:15.794107+0000","last_fullsized":"2023-12-18T10:18:15.794107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168630+0000","last_change":"2023-12-18T10:18:09.664263+0000","last_active":"2023-12-18T10:18:11.168630+0000","last_peered":"2023-12-18T10:18:11.168630+0000","last_clean":"2023-12-18T10:18:11.168630+0000","last_became_active":"2023-12-18T10:18:09.663085+0000","last_became_peered":"2023-12-18T10:18:09.663085+0000","last_unstale":"2023-12-18T10:18:11.168630+0000","last_undegraded":"2023-12-18T10:18:11.168630+0000","last_fullsized":"2023-12-18T10:18:11.168630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649600+0000","last_change":"2023-12-18T10:18:05.634453+0000","last_active":"2023-12-18T10:18:09.649600+0000","last_peered":"2023-12-18T10:18:09.649600+0000","last_clean":"2023-12-18T10:18:09.649600+0000","last_became_active":"2023-12-18T10:18:05.633857+0000","last_became_peered":"2023-12-18T10:18:05.633857+0000","last_unstale":"2023-12-18T10:18:09.649600+0000","last_undegraded":"2023-12-18T10:18:09.649600+0000","last_fullsized":"2023-12-18T10:18:09.649600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:20.317228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638790+0000","last_change":"2023-12-18T10:18:05.240204+0000","last_active":"2023-12-18T10:18:09.638790+0000","last_peered":"2023-12-18T10:18:09.638790+0000","last_clean":"2023-12-18T10:18:09.638790+0000","last_became_active":"2023-12-18T10:18:05.239930+0000","last_became_peered":"2023-12-18T10:18:05.239930+0000","last_unstale":"2023-12-18T10:18:09.638790+0000","last_undegraded":"2023-12-18T10:18:09.638790+0000","last_fullsized":"2023-12-18T10:18:09.638790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:18.551106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172071+0000","last_change":"2023-12-18T10:18:09.672679+0000","last_active":"2023-12-18T10:18:11.172071+0000","last_peered":"2023-12-18T10:18:11.172071+0000","last_clean":"2023-12-18T10:18:11.172071+0000","last_became_active":"2023-12-18T10:18:09.672224+0000","last_became_peered":"2023-12-18T10:18:09.672224+0000","last_unstale":"2023-12-18T10:18:11.172071+0000","last_undegraded":"2023-12-18T10:18:11.172071+0000","last_fullsized":"2023-12-18T10:18:11.172071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647023+0000","last_change":"2023-12-18T10:18:05.641647+0000","last_active":"2023-12-18T10:18:09.647023+0000","last_peered":"2023-12-18T10:18:09.647023+0000","last_clean":"2023-12-18T10:18:09.647023+0000","last_became_active":"2023-12-18T10:18:05.641380+0000","last_became_peered":"2023-12-18T10:18:05.641380+0000","last_unstale":"2023-12-18T10:18:09.647023+0000","last_undegraded":"2023-12-18T10:18:09.647023+0000","last_fullsized":"2023-12-18T10:18:09.647023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:52:49.957417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645469+0000","last_change":"2023-12-18T10:18:05.255298+0000","last_active":"2023-12-18T10:18:09.645469+0000","last_peered":"2023-12-18T10:18:09.645469+0000","last_clean":"2023-12-18T10:18:09.645469+0000","last_became_active":"2023-12-18T10:18:05.249553+0000","last_became_peered":"2023-12-18T10:18:05.249553+0000","last_unstale":"2023-12-18T10:18:09.645469+0000","last_undegraded":"2023-12-18T10:18:09.645469+0000","last_fullsized":"2023-12-18T10:18:09.645469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034469+0000","last_change":"2023-12-18T10:18:09.654532+0000","last_active":"2023-12-18T10:18:10.034469+0000","last_peered":"2023-12-18T10:18:10.034469+0000","last_clean":"2023-12-18T10:18:10.034469+0000","last_became_active":"2023-12-18T10:18:09.654162+0000","last_became_peered":"2023-12-18T10:18:09.654162+0000","last_unstale":"2023-12-18T10:18:10.034469+0000","last_undegraded":"2023-12-18T10:18:10.034469+0000","last_fullsized":"2023-12-18T10:18:10.034469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:09.243674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645396+0000","last_change":"2023-12-18T10:18:05.645545+0000","last_active":"2023-12-18T10:18:09.645396+0000","last_peered":"2023-12-18T10:18:09.645396+0000","last_clean":"2023-12-18T10:18:09.645396+0000","last_became_active":"2023-12-18T10:18:05.643058+0000","last_became_peered":"2023-12-18T10:18:05.643058+0000","last_unstale":"2023-12-18T10:18:09.645396+0000","last_undegraded":"2023-12-18T10:18:09.645396+0000","last_fullsized":"2023-12-18T10:18:09.645396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:04:11.553722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649775+0000","last_change":"2023-12-18T10:18:05.251656+0000","last_active":"2023-12-18T10:18:09.649775+0000","last_peered":"2023-12-18T10:18:09.649775+0000","last_clean":"2023-12-18T10:18:09.649775+0000","last_became_active":"2023-12-18T10:18:05.251325+0000","last_became_peered":"2023-12-18T10:18:05.251325+0000","last_unstale":"2023-12-18T10:18:09.649775+0000","last_undegraded":"2023-12-18T10:18:09.649775+0000","last_fullsized":"2023-12-18T10:18:09.649775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034536+0000","last_change":"2023-12-18T10:18:09.706442+0000","last_active":"2023-12-18T10:18:10.034536+0000","last_peered":"2023-12-18T10:18:10.034536+0000","last_clean":"2023-12-18T10:18:10.034536+0000","last_became_active":"2023-12-18T10:18:09.705840+0000","last_became_peered":"2023-12-18T10:18:09.705840+0000","last_unstale":"2023-12-18T10:18:10.034536+0000","last_undegraded":"2023-12-18T10:18:10.034536+0000","last_fullsized":"2023-12-18T10:18:10.034536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:45:44.671578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169136+0000","last_change":"2023-12-18T10:18:09.708551+0000","last_active":"2023-12-18T10:18:11.169136+0000","last_peered":"2023-12-18T10:18:11.169136+0000","last_clean":"2023-12-18T10:18:11.169136+0000","last_became_active":"2023-12-18T10:18:09.708120+0000","last_became_peered":"2023-12-18T10:18:09.708120+0000","last_unstale":"2023-12-18T10:18:11.169136+0000","last_undegraded":"2023-12-18T10:18:11.169136+0000","last_fullsized":"2023-12-18T10:18:11.169136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637013+0000","last_change":"2023-12-18T10:18:05.626780+0000","last_active":"2023-12-18T10:18:09.637013+0000","last_peered":"2023-12-18T10:18:09.637013+0000","last_clean":"2023-12-18T10:18:09.637013+0000","last_became_active":"2023-12-18T10:18:05.626520+0000","last_became_peered":"2023-12-18T10:18:05.626520+0000","last_unstale":"2023-12-18T10:18:09.637013+0000","last_undegraded":"2023-12-18T10:18:09.637013+0000","last_fullsized":"2023-12-18T10:18:09.637013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643961+0000","last_change":"2023-12-18T10:18:05.248820+0000","last_active":"2023-12-18T10:18:09.643961+0000","last_peered":"2023-12-18T10:18:09.643961+0000","last_clean":"2023-12-18T10:18:09.643961+0000","last_became_active":"2023-12-18T10:18:05.247238+0000","last_became_peered":"2023-12-18T10:18:05.247238+0000","last_unstale":"2023-12-18T10:18:09.643961+0000","last_undegraded":"2023-12-18T10:18:09.643961+0000","last_fullsized":"2023-12-18T10:18:09.643961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.170305+0000","last_change":"2023-12-18T10:18:09.672371+0000","last_active":"2023-12-18T10:18:11.170305+0000","last_peered":"2023-12-18T10:18:11.170305+0000","last_clean":"2023-12-18T10:18:11.170305+0000","last_became_active":"2023-12-18T10:18:09.671986+0000","last_became_peered":"2023-12-18T10:18:09.671986+0000","last_unstale":"2023-12-18T10:18:11.170305+0000","last_undegraded":"2023-12-18T10:18:11.170305+0000","last_fullsized":"2023-12-18T10:18:11.170305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:44:55.941621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.640030+0000","last_change":"2023-12-18T10:18:05.627295+0000","last_active":"2023-12-18T10:18:09.640030+0000","last_peered":"2023-12-18T10:18:09.640030+0000","last_clean":"2023-12-18T10:18:09.640030+0000","last_became_active":"2023-12-18T10:18:05.626947+0000","last_became_peered":"2023-12-18T10:18:05.626947+0000","last_unstale":"2023-12-18T10:18:09.640030+0000","last_undegraded":"2023-12-18T10:18:09.640030+0000","last_fullsized":"2023-12-18T10:18:09.640030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.641252+0000","last_change":"2023-12-18T10:18:05.249020+0000","last_active":"2023-12-18T10:18:09.641252+0000","last_peered":"2023-12-18T10:18:09.641252+0000","last_clean":"2023-12-18T10:18:09.641252+0000","last_became_active":"2023-12-18T10:18:05.248677+0000","last_became_peered":"2023-12-18T10:18:05.248677+0000","last_unstale":"2023-12-18T10:18:09.641252+0000","last_undegraded":"2023-12-18T10:18:09.641252+0000","last_fullsized":"2023-12-18T10:18:09.641252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648681+0000","last_change":"2023-12-18T10:18:05.249748+0000","last_active":"2023-12-18T10:18:09.648681+0000","last_peered":"2023-12-18T10:18:09.648681+0000","last_clean":"2023-12-18T10:18:09.648681+0000","last_became_active":"2023-12-18T10:18:05.249479+0000","last_became_peered":"2023-12-18T10:18:05.249479+0000","last_unstale":"2023-12-18T10:18:09.648681+0000","last_undegraded":"2023-12-18T10:18:09.648681+0000","last_fullsized":"2023-12-18T10:18:09.648681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647579+0000","last_change":"2023-12-18T10:18:05.630648+0000","last_active":"2023-12-18T10:18:09.647579+0000","last_peered":"2023-12-18T10:18:09.647579+0000","last_clean":"2023-12-18T10:18:09.647579+0000","last_became_active":"2023-12-18T10:18:05.630392+0000","last_became_peered":"2023-12-18T10:18:05.630392+0000","last_unstale":"2023-12-18T10:18:09.647579+0000","last_undegraded":"2023-12-18T10:18:09.647579+0000","last_fullsized":"2023-12-18T10:18:09.647579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:00.204642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.033552+0000","last_change":"2023-12-18T10:18:09.672491+0000","last_active":"2023-12-18T10:18:10.033552+0000","last_peered":"2023-12-18T10:18:10.033552+0000","last_clean":"2023-12-18T10:18:10.033552+0000","last_became_active":"2023-12-18T10:18:09.671959+0000","last_became_peered":"2023-12-18T10:18:09.671959+0000","last_unstale":"2023-12-18T10:18:10.033552+0000","last_undegraded":"2023-12-18T10:18:10.033552+0000","last_fullsized":"2023-12-18T10:18:10.033552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:21.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643160+0000","last_change":"2023-12-18T10:18:05.252875+0000","last_active":"2023-12-18T10:18:09.643160+0000","last_peered":"2023-12-18T10:18:09.643160+0000","last_clean":"2023-12-18T10:18:09.643160+0000","last_became_active":"2023-12-18T10:18:05.252600+0000","last_became_peered":"2023-12-18T10:18:05.252600+0000","last_unstale":"2023-12-18T10:18:09.643160+0000","last_undegraded":"2023-12-18T10:18:09.643160+0000","last_fullsized":"2023-12-18T10:18:09.643160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648805+0000","last_change":"2023-12-18T10:18:05.627361+0000","last_active":"2023-12-18T10:18:09.648805+0000","last_peered":"2023-12-18T10:18:09.648805+0000","last_clean":"2023-12-18T10:18:09.648805+0000","last_became_active":"2023-12-18T10:18:05.626588+0000","last_became_peered":"2023-12-18T10:18:05.626588+0000","last_unstale":"2023-12-18T10:18:09.648805+0000","last_undegraded":"2023-12-18T10:18:09.648805+0000","last_fullsized":"2023-12-18T10:18:09.648805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:41.607752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.035047+0000","last_change":"2023-12-18T10:18:09.660419+0000","last_active":"2023-12-18T10:18:10.035047+0000","last_peered":"2023-12-18T10:18:10.035047+0000","last_clean":"2023-12-18T10:18:10.035047+0000","last_became_active":"2023-12-18T10:18:09.659964+0000","last_became_peered":"2023-12-18T10:18:09.659964+0000","last_unstale":"2023-12-18T10:18:10.035047+0000","last_undegraded":"2023-12-18T10:18:10.035047+0000","last_fullsized":"2023-12-18T10:18:10.035047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:33:51.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647972+0000","last_change":"2023-12-18T10:18:05.628648+0000","last_active":"2023-12-18T10:18:09.647972+0000","last_peered":"2023-12-18T10:18:09.647972+0000","last_clean":"2023-12-18T10:18:09.647972+0000","last_became_active":"2023-12-18T10:18:05.628154+0000","last_became_peered":"2023-12-18T10:18:05.628154+0000","last_unstale":"2023-12-18T10:18:09.647972+0000","last_undegraded":"2023-12-18T10:18:09.647972+0000","last_fullsized":"2023-12-18T10:18:09.647972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:50:58.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655680+0000","last_change":"2023-12-18T10:18:05.643692+0000","last_active":"2023-12-18T10:18:09.655680+0000","last_peered":"2023-12-18T10:18:09.655680+0000","last_clean":"2023-12-18T10:18:09.655680+0000","last_became_active":"2023-12-18T10:18:05.643379+0000","last_became_peered":"2023-12-18T10:18:05.643379+0000","last_unstale":"2023-12-18T10:18:09.655680+0000","last_undegraded":"2023-12-18T10:18:09.655680+0000","last_fullsized":"2023-12-18T10:18:09.655680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:19.558466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645387+0000","last_change":"2023-12-18T10:18:05.646467+0000","last_active":"2023-12-18T10:18:09.645387+0000","last_peered":"2023-12-18T10:18:09.645387+0000","last_clean":"2023-12-18T10:18:09.645387+0000","last_became_active":"2023-12-18T10:18:05.646251+0000","last_became_peered":"2023-12-18T10:18:05.646251+0000","last_unstale":"2023-12-18T10:18:09.645387+0000","last_undegraded":"2023-12-18T10:18:09.645387+0000","last_fullsized":"2023-12-18T10:18:09.645387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:53:47.177413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647452+0000","last_change":"2023-12-18T10:18:05.636522+0000","last_active":"2023-12-18T10:18:09.647452+0000","last_peered":"2023-12-18T10:18:09.647452+0000","last_clean":"2023-12-18T10:18:09.647452+0000","last_became_active":"2023-12-18T10:18:05.636274+0000","last_became_peered":"2023-12-18T10:18:05.636274+0000","last_unstale":"2023-12-18T10:18:09.647452+0000","last_undegraded":"2023-12-18T10:18:09.647452+0000","last_fullsized":"2023-12-18T10:18:09.647452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644075+0000","last_change":"2023-12-18T10:18:05.641530+0000","last_active":"2023-12-18T10:18:09.644075+0000","last_peered":"2023-12-18T10:18:09.644075+0000","last_clean":"2023-12-18T10:18:09.644075+0000","last_became_active":"2023-12-18T10:18:05.641184+0000","last_became_peered":"2023-12-18T10:18:05.641184+0000","last_unstale":"2023-12-18T10:18:09.644075+0000","last_undegraded":"2023-12-18T10:18:09.644075+0000","last_fullsized":"2023-12-18T10:18:09.644075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:13:52.820727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638695+0000","last_change":"2023-12-18T10:18:05.642375+0000","last_active":"2023-12-18T10:18:09.638695+0000","last_peered":"2023-12-18T10:18:09.638695+0000","last_clean":"2023-12-18T10:18:09.638695+0000","last_became_active":"2023-12-18T10:18:05.641952+0000","last_became_peered":"2023-12-18T10:18:05.641952+0000","last_unstale":"2023-12-18T10:18:09.638695+0000","last_undegraded":"2023-12-18T10:18:09.638695+0000","last_fullsized":"2023-12-18T10:18:09.638695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650445+0000","last_change":"2023-12-18T10:18:05.633875+0000","last_active":"2023-12-18T10:18:09.650445+0000","last_peered":"2023-12-18T10:18:09.650445+0000","last_clean":"2023-12-18T10:18:09.650445+0000","last_became_active":"2023-12-18T10:18:05.633604+0000","last_became_peered":"2023-12-18T10:18:05.633604+0000","last_unstale":"2023-12-18T10:18:09.650445+0000","last_undegraded":"2023-12-18T10:18:09.650445+0000","last_fullsized":"2023-12-18T10:18:09.650445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650100+0000","last_change":"2023-12-18T10:18:05.641319+0000","last_active":"2023-12-18T10:18:09.650100+0000","last_peered":"2023-12-18T10:18:09.650100+0000","last_clean":"2023-12-18T10:18:09.650100+0000","last_became_active":"2023-12-18T10:18:05.641023+0000","last_became_peered":"2023-12-18T10:18:05.641023+0000","last_unstale":"2023-12-18T10:18:09.650100+0000","last_undegraded":"2023-12-18T10:18:09.650100+0000","last_fullsized":"2023-12-18T10:18:09.650100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643898+0000","last_change":"2023-12-18T10:18:05.644280+0000","last_active":"2023-12-18T10:18:09.643898+0000","last_peered":"2023-12-18T10:18:09.643898+0000","last_clean":"2023-12-18T10:18:09.643898+0000","last_became_active":"2023-12-18T10:18:05.643995+0000","last_became_peered":"2023-12-18T10:18:05.643995+0000","last_unstale":"2023-12-18T10:18:09.643898+0000","last_undegraded":"2023-12-18T10:18:09.643898+0000","last_fullsized":"2023-12-18T10:18:09.643898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.641117+0000","last_change":"2023-12-18T10:18:05.633363+0000","last_active":"2023-12-18T10:18:09.641117+0000","last_peered":"2023-12-18T10:18:09.641117+0000","last_clean":"2023-12-18T10:18:09.641117+0000","last_became_active":"2023-12-18T10:18:05.633080+0000","last_became_peered":"2023-12-18T10:18:05.633080+0000","last_unstale":"2023-12-18T10:18:09.641117+0000","last_undegraded":"2023-12-18T10:18:09.641117+0000","last_fullsized":"2023-12-18T10:18:09.641117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645306+0000","last_change":"2023-12-18T10:18:05.647944+0000","last_active":"2023-12-18T10:18:09.645306+0000","last_peered":"2023-12-18T10:18:09.645306+0000","last_clean":"2023-12-18T10:18:09.645306+0000","last_became_active":"2023-12-18T10:18:05.646783+0000","last_became_peered":"2023-12-18T10:18:05.646783+0000","last_unstale":"2023-12-18T10:18:09.645306+0000","last_undegraded":"2023-12-18T10:18:09.645306+0000","last_fullsized":"2023-12-18T10:18:09.645306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646684+0000","last_change":"2023-12-18T10:18:05.625564+0000","last_active":"2023-12-18T10:18:09.646684+0000","last_peered":"2023-12-18T10:18:09.646684+0000","last_clean":"2023-12-18T10:18:09.646684+0000","last_became_active":"2023-12-18T10:18:05.625276+0000","last_became_peered":"2023-12-18T10:18:05.625276+0000","last_unstale":"2023-12-18T10:18:09.646684+0000","last_undegraded":"2023-12-18T10:18:09.646684+0000","last_fullsized":"2023-12-18T10:18:09.646684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647564+0000","last_change":"2023-12-18T10:18:05.630745+0000","last_active":"2023-12-18T10:18:09.647564+0000","last_peered":"2023-12-18T10:18:09.647564+0000","last_clean":"2023-12-18T10:18:09.647564+0000","last_became_active":"2023-12-18T10:18:05.630408+0000","last_became_peered":"2023-12-18T10:18:05.630408+0000","last_unstale":"2023-12-18T10:18:09.647564+0000","last_undegraded":"2023-12-18T10:18:09.647564+0000","last_fullsized":"2023-12-18T10:18:09.647564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704579+0000","last_change":"2023-12-18T10:18:05.631928+0000","last_active":"2023-12-18T10:18:09.704579+0000","last_peered":"2023-12-18T10:18:09.704579+0000","last_clean":"2023-12-18T10:18:09.704579+0000","last_became_active":"2023-12-18T10:18:05.631639+0000","last_became_peered":"2023-12-18T10:18:05.631639+0000","last_unstale":"2023-12-18T10:18:09.704579+0000","last_undegraded":"2023-12-18T10:18:09.704579+0000","last_fullsized":"2023-12-18T10:18:09.704579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656090+0000","last_change":"2023-12-18T10:18:05.641653+0000","last_active":"2023-12-18T10:18:09.656090+0000","last_peered":"2023-12-18T10:18:09.656090+0000","last_clean":"2023-12-18T10:18:09.656090+0000","last_became_active":"2023-12-18T10:18:05.641408+0000","last_became_peered":"2023-12-18T10:18:05.641408+0000","last_unstale":"2023-12-18T10:18:09.656090+0000","last_undegraded":"2023-12-18T10:18:09.656090+0000","last_fullsized":"2023-12-18T10:18:09.656090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:20.317228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644857+0000","last_change":"2023-12-18T10:18:05.650138+0000","last_active":"2023-12-18T10:18:09.644857+0000","last_peered":"2023-12-18T10:18:09.644857+0000","last_clean":"2023-12-18T10:18:09.644857+0000","last_became_active":"2023-12-18T10:18:05.647457+0000","last_became_peered":"2023-12-18T10:18:05.647457+0000","last_unstale":"2023-12-18T10:18:09.644857+0000","last_undegraded":"2023-12-18T10:18:09.644857+0000","last_fullsized":"2023-12-18T10:18:09.644857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:12:38.639031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643520+0000","last_change":"2023-12-18T10:18:05.640210+0000","last_active":"2023-12-18T10:18:09.643520+0000","last_peered":"2023-12-18T10:18:09.643520+0000","last_clean":"2023-12-18T10:18:09.643520+0000","last_became_active":"2023-12-18T10:18:05.639794+0000","last_became_peered":"2023-12-18T10:18:05.639794+0000","last_unstale":"2023-12-18T10:18:09.643520+0000","last_undegraded":"2023-12-18T10:18:09.643520+0000","last_fullsized":"2023-12-18T10:18:09.643520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637153+0000","last_change":"2023-12-18T10:18:05.633876+0000","last_active":"2023-12-18T10:18:09.637153+0000","last_peered":"2023-12-18T10:18:09.637153+0000","last_clean":"2023-12-18T10:18:09.637153+0000","last_became_active":"2023-12-18T10:18:05.632329+0000","last_became_peered":"2023-12-18T10:18:05.632329+0000","last_unstale":"2023-12-18T10:18:09.637153+0000","last_undegraded":"2023-12-18T10:18:09.637153+0000","last_fullsized":"2023-12-18T10:18:09.637153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643976+0000","last_change":"2023-12-18T10:18:05.620955+0000","last_active":"2023-12-18T10:18:09.643976+0000","last_peered":"2023-12-18T10:18:09.643976+0000","last_clean":"2023-12-18T10:18:09.643976+0000","last_became_active":"2023-12-18T10:18:05.620450+0000","last_became_peered":"2023-12-18T10:18:05.620450+0000","last_unstale":"2023-12-18T10:18:09.643976+0000","last_undegraded":"2023-12-18T10:18:09.643976+0000","last_fullsized":"2023-12-18T10:18:09.643976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:50:58.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642806+0000","last_change":"2023-12-18T10:18:05.642199+0000","last_active":"2023-12-18T10:18:09.642806+0000","last_peered":"2023-12-18T10:18:09.642806+0000","last_clean":"2023-12-18T10:18:09.642806+0000","last_became_active":"2023-12-18T10:18:05.641941+0000","last_became_peered":"2023-12-18T10:18:05.641941+0000","last_unstale":"2023-12-18T10:18:09.642806+0000","last_undegraded":"2023-12-18T10:18:09.642806+0000","last_fullsized":"2023-12-18T10:18:09.642806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649504+0000","last_change":"2023-12-18T10:18:05.634730+0000","last_active":"2023-12-18T10:18:09.649504+0000","last_peered":"2023-12-18T10:18:09.649504+0000","last_clean":"2023-12-18T10:18:09.649504+0000","last_became_active":"2023-12-18T10:18:05.634191+0000","last_became_peered":"2023-12-18T10:18:05.634191+0000","last_unstale":"2023-12-18T10:18:09.649504+0000","last_undegraded":"2023-12-18T10:18:09.649504+0000","last_fullsized":"2023-12-18T10:18:09.649504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:13.517290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647871+0000","last_change":"2023-12-18T10:18:05.636229+0000","last_active":"2023-12-18T10:18:09.647871+0000","last_peered":"2023-12-18T10:18:09.647871+0000","last_clean":"2023-12-18T10:18:09.647871+0000","last_became_active":"2023-12-18T10:18:05.635905+0000","last_became_peered":"2023-12-18T10:18:05.635905+0000","last_unstale":"2023-12-18T10:18:09.647871+0000","last_undegraded":"2023-12-18T10:18:09.647871+0000","last_fullsized":"2023-12-18T10:18:09.647871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650359+0000","last_change":"2023-12-18T10:18:05.638343+0000","last_active":"2023-12-18T10:18:09.650359+0000","last_peered":"2023-12-18T10:18:09.650359+0000","last_clean":"2023-12-18T10:18:09.650359+0000","last_became_active":"2023-12-18T10:18:05.637808+0000","last_became_peered":"2023-12-18T10:18:05.637808+0000","last_unstale":"2023-12-18T10:18:09.650359+0000","last_undegraded":"2023-12-18T10:18:09.650359+0000","last_fullsized":"2023-12-18T10:18:09.650359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704697+0000","last_change":"2023-12-18T10:18:05.644226+0000","last_active":"2023-12-18T10:18:09.704697+0000","last_peered":"2023-12-18T10:18:09.704697+0000","last_clean":"2023-12-18T10:18:09.704697+0000","last_became_active":"2023-12-18T10:18:05.643711+0000","last_became_peered":"2023-12-18T10:18:05.643711+0000","last_unstale":"2023-12-18T10:18:09.704697+0000","last_undegraded":"2023-12-18T10:18:09.704697+0000","last_fullsized":"2023-12-18T10:18:09.704697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:14.759979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.639933+0000","last_change":"2023-12-18T10:18:05.643930+0000","last_active":"2023-12-18T10:18:09.639933+0000","last_peered":"2023-12-18T10:18:09.639933+0000","last_clean":"2023-12-18T10:18:09.639933+0000","last_became_active":"2023-12-18T10:18:05.642465+0000","last_became_peered":"2023-12-18T10:18:05.642465+0000","last_unstale":"2023-12-18T10:18:09.639933+0000","last_undegraded":"2023-12-18T10:18:09.639933+0000","last_fullsized":"2023-12-18T10:18:09.639933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704110+0000","last_change":"2023-12-18T10:18:05.629320+0000","last_active":"2023-12-18T10:18:09.704110+0000","last_peered":"2023-12-18T10:18:09.704110+0000","last_clean":"2023-12-18T10:18:09.704110+0000","last_became_active":"2023-12-18T10:18:05.628995+0000","last_became_peered":"2023-12-18T10:18:05.628995+0000","last_unstale":"2023-12-18T10:18:09.704110+0000","last_undegraded":"2023-12-18T10:18:09.704110+0000","last_fullsized":"2023-12-18T10:18:09.704110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:01:46.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645210+0000","last_change":"2023-12-18T10:18:05.639987+0000","last_active":"2023-12-18T10:18:09.645210+0000","last_peered":"2023-12-18T10:18:09.645210+0000","last_clean":"2023-12-18T10:18:09.645210+0000","last_became_active":"2023-12-18T10:18:05.639712+0000","last_became_peered":"2023-12-18T10:18:05.639712+0000","last_unstale":"2023-12-18T10:18:09.645210+0000","last_undegraded":"2023-12-18T10:18:09.645210+0000","last_fullsized":"2023-12-18T10:18:09.645210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704265+0000","last_change":"2023-12-18T10:18:05.633072+0000","last_active":"2023-12-18T10:18:09.704265+0000","last_peered":"2023-12-18T10:18:09.704265+0000","last_clean":"2023-12-18T10:18:09.704265+0000","last_became_active":"2023-12-18T10:18:05.632175+0000","last_became_peered":"2023-12-18T10:18:05.632175+0000","last_unstale":"2023-12-18T10:18:09.704265+0000","last_undegraded":"2023-12-18T10:18:09.704265+0000","last_fullsized":"2023-12-18T10:18:09.704265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646517+0000","last_change":"2023-12-18T10:18:05.644282+0000","last_active":"2023-12-18T10:18:09.646517+0000","last_peered":"2023-12-18T10:18:09.646517+0000","last_clean":"2023-12-18T10:18:09.646517+0000","last_became_active":"2023-12-18T10:18:05.643886+0000","last_became_peered":"2023-12-18T10:18:05.643886+0000","last_unstale":"2023-12-18T10:18:09.646517+0000","last_undegraded":"2023-12-18T10:18:09.646517+0000","last_fullsized":"2023-12-18T10:18:09.646517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:01:46.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643972+0000","last_change":"2023-12-18T10:18:05.627422+0000","last_active":"2023-12-18T10:18:09.643972+0000","last_peered":"2023-12-18T10:18:09.643972+0000","last_clean":"2023-12-18T10:18:09.643972+0000","last_became_active":"2023-12-18T10:18:05.627154+0000","last_became_peered":"2023-12-18T10:18:05.627154+0000","last_unstale":"2023-12-18T10:18:09.643972+0000","last_undegraded":"2023-12-18T10:18:09.643972+0000","last_fullsized":"2023-12-18T10:18:09.643972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:13:52.820727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637893+0000","last_change":"2023-12-18T10:18:05.617908+0000","last_active":"2023-12-18T10:18:09.637893+0000","last_peered":"2023-12-18T10:18:09.637893+0000","last_clean":"2023-12-18T10:18:09.637893+0000","last_became_active":"2023-12-18T10:18:05.617637+0000","last_became_peered":"2023-12-18T10:18:05.617637+0000","last_unstale":"2023-12-18T10:18:09.637893+0000","last_undegraded":"2023-12-18T10:18:09.637893+0000","last_fullsized":"2023-12-18T10:18:09.637893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704633+0000","last_change":"2023-12-18T10:18:05.643965+0000","last_active":"2023-12-18T10:18:09.704633+0000","last_peered":"2023-12-18T10:18:09.704633+0000","last_clean":"2023-12-18T10:18:09.704633+0000","last_became_active":"2023-12-18T10:18:05.643043+0000","last_became_peered":"2023-12-18T10:18:05.643043+0000","last_unstale":"2023-12-18T10:18:09.704633+0000","last_undegraded":"2023-12-18T10:18:09.704633+0000","last_fullsized":"2023-12-18T10:18:09.704633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:12:38.639031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:18:30.423 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-18T10:18:30.423 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-18T10:18:30.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-18T10:18:30.424 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-18T10:18:30.424 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-18T10:18:30.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.594+0000 7f694db6d640 1 Processor -- start 2023-12-18T10:18:30.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.594+0000 7f694db6d640 1 -- start start 2023-12-18T10:18:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f694db6d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69481570c0 0x7f694806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f694db6d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f694806c320 0x7f69480c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f694db6d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69480c9460 con 0x7f69480c9e30 2023-12-18T10:18:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f694db6d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694806c7a0 con 0x7f69481570c0 2023-12-18T10:18:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f694db6d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69481574a0 con 0x7f694806c320 2023-12-18T10:18:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f69477fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69481570c0 0x7f694806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f6947fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f69480c9e30 0x7f694815d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48090/0 (socket says 172.21.15.133:48090) 2023-12-18T10:18:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f6947fff640 1 -- 172.21.15.133:0/297392276 learned_addr learned my addr 172.21.15.133:0/297392276 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f693ffff640 1 --2- 172.21.15.133:0/297392276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f694806c320 0x7f69480c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f69477fe640 1 -- 172.21.15.133:0/297392276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f694806c320 msgr2=0x7f69480c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f69477fe640 1 --2- 172.21.15.133:0/297392276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f694806c320 0x7f69480c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f69477fe640 1 -- 172.21.15.133:0/297392276 >> v1:172.21.15.133:6789/0 conn(0x7f69480c9e30 legacy=0x7f694815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f69477fe640 1 -- 172.21.15.133:0/297392276 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69480c8b30 con 0x7f69481570c0 2023-12-18T10:18:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.598+0000 7f6946ffd640 1 -- 172.21.15.133:0/297392276 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067053592 0 0) 0x7f69480c9460 con 0x7f69480c9e30 2023-12-18T10:18:30.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f69477fe640 1 --2- 172.21.15.133:0/297392276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69481570c0 0x7f694806bde0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f69380097c0 tx=0x7f693801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500518e9bd3a08ac server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f6946ffd640 1 -- 172.21.15.133:0/297392276 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380ab600 con 0x7f69481570c0 2023-12-18T10:18:30.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f6946ffd640 1 -- 172.21.15.133:0/297392276 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69380a7050 con 0x7f69481570c0 2023-12-18T10:18:30.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f6946ffd640 1 -- 172.21.15.133:0/297392276 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380ab980 con 0x7f69481570c0 2023-12-18T10:18:30.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 -- 172.21.15.133:0/297392276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69481570c0 msgr2=0x7f694806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 --2- 172.21.15.133:0/297392276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69481570c0 0x7f694806bde0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f69380097c0 tx=0x7f693801c3c0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 -- 172.21.15.133:0/297392276 shutdown_connections 2023-12-18T10:18:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 --2- 172.21.15.133:0/297392276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f694806c320 0x7f69480c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 --2- 172.21.15.133:0/297392276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69481570c0 0x7f694806bde0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 -- 172.21.15.133:0/297392276 >> 172.21.15.133:0/297392276 conn(0x7f694806a3e0 msgr2=0x7f69480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 -- 172.21.15.133:0/297392276 shutdown_connections 2023-12-18T10:18:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 -- 172.21.15.133:0/297392276 wait complete. 2023-12-18T10:18:30.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 Processor -- start 2023-12-18T10:18:30.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.602+0000 7f694db6d640 1 -- start start 2023-12-18T10:18:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f694806c320 0x7f69480c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480c9e30 0x7f6948141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69481570c0 0x7f6948159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6948158630 con 0x7f69480c9e30 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6948143e30 con 0x7f694806c320 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6948158880 con 0x7f69481570c0 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480c9e30 0x7f6948141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480c9e30 0x7f6948141050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48324/0 (socket says 172.21.15.133:48324) 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 -- 172.21.15.133:0/2081429266 learned_addr learned my addr 172.21.15.133:0/2081429266 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f6947fff640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69481570c0 0x7f6948159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f69477fe640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f694806c320 0x7f69480c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 -- 172.21.15.133:0/2081429266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69481570c0 msgr2=0x7f6948159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69481570c0 0x7f6948159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 -- 172.21.15.133:0/2081429266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f694806c320 msgr2=0x7f69480c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f694806c320 0x7f69480c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 -- 172.21.15.133:0/2081429266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6938009420 con 0x7f69480c9e30 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f693ffff640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480c9e30 0x7f6948141050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f693000d5f0 tx=0x7f693000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f6944ff9640 1 -- 172.21.15.133:0/2081429266 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300125f0 con 0x7f69480c9e30 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f6944ff9640 1 -- 172.21.15.133:0/2081429266 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6930012750 con 0x7f69480c9e30 2023-12-18T10:18:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f6944ff9640 1 -- 172.21.15.133:0/2081429266 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930012ae0 con 0x7f69480c9e30 2023-12-18T10:18:30.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6948158b60 con 0x7f69480c9e30 2023-12-18T10:18:30.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6948159120 con 0x7f69480c9e30 2023-12-18T10:18:30.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69480735b0 con 0x7f69480c9e30 2023-12-18T10:18:30.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.606+0000 7f6944ff9640 1 -- 172.21.15.133:0/2081429266 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6930012c40 con 0x7f69480c9e30 2023-12-18T10:18:30.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.610+0000 7f6944ff9640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6928065a60 0x7f6928067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.610+0000 7f6944ff9640 1 -- 172.21.15.133:0/2081429266 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6930083a50 con 0x7f69480c9e30 2023-12-18T10:18:30.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.610+0000 7f69477fe640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6928065a60 0x7f6928067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.610+0000 7f69477fe640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6928065a60 0x7f6928067f20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69380ad000 tx=0x7f69380a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.614+0000 7f6944ff9640 1 -- 172.21.15.133:0/2081429266 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6930050ff0 con 0x7f69480c9e30 2023-12-18T10:18:30.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.798+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f694804e000 con 0x7f69480c9e30 2023-12-18T10:18:30.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.798+0000 7f6944ff9640 1 -- 172.21.15.133:0/2081429266 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163369 (secure 0 0 0) 0x7f6930007380 con 0x7f69480c9e30 2023-12-18T10:18:30.804 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:30.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6928065a60 msgr2=0x7f6928067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6928065a60 0x7f6928067f20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69380ad000 tx=0x7f69380a6000 comp rx=0 tx=0).stop 2023-12-18T10:18:30.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480c9e30 msgr2=0x7f6948141050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480c9e30 0x7f6948141050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f693000d5f0 tx=0x7f693000dab0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 shutdown_connections 2023-12-18T10:18:30.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6928065a60 0x7f6928067f20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69481570c0 0x7f6948159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480c9e30 0x7f6948141050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 --2- 172.21.15.133:0/2081429266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f694806c320 0x7f69480c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 >> 172.21.15.133:0/2081429266 conn(0x7f694806a3e0 msgr2=0x7f69480c3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:30.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 shutdown_connections 2023-12-18T10:18:30.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.802+0000 7f694db6d640 1 -- 172.21.15.133:0/2081429266 wait complete. 2023-12-18T10:18:30.824 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":38097},{"type":"v1","addr":"172.21.15.133:6833","nonce":38097}]},"active_addr":"172.21.15.133:6833/38097","active_change":"2023-12-18T10:17:45.080368+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4119,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":4249662743}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":3194007305}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":1291060092}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":118965456}]}]} 2023-12-18T10:18:30.827 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-18T10:18:30.827 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-18T10:18:30.827 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.962+0000 7f01500d1640 1 Processor -- start 2023-12-18T10:18:30.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f01500d1640 1 -- start start 2023-12-18T10:18:30.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f01500d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01480cac10 0x7f014815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f01500d1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f014806fdb0 0x7f0148070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f01500d1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014815f100 con 0x7f014815a680 2023-12-18T10:18:30.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f01500d1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480707a0 con 0x7f014806fdb0 2023-12-18T10:18:30.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f01500d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480ca7d0 con 0x7f01480cac10 2023-12-18T10:18:30.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014d66c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01480cac10 0x7f014815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014de6d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f014815a680 0x7f014815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:42924/0 (socket says 172.21.15.133:42924) 2023-12-18T10:18:30.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014de6d640 1 -- 172.21.15.133:0/3787081139 learned_addr learned my addr 172.21.15.133:0/3787081139 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:30.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014e66e640 1 --2- 172.21.15.133:0/3787081139 >> v2:172.21.15.142:3300/0 conn(0x7f014806fdb0 0x7f0148070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014ce6b640 1 -- 172.21.15.133:0/3787081139 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405135351 0 0) 0x7f014815f100 con 0x7f014815a680 2023-12-18T10:18:30.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014ce6b640 1 -- 172.21.15.133:0/3787081139 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0134003530 con 0x7f014815a680 2023-12-18T10:18:30.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014e66e640 1 -- 172.21.15.133:0/3787081139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01480cac10 msgr2=0x7f014815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:30.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014e66e640 1 --2- 172.21.15.133:0/3787081139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01480cac10 0x7f014815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014e66e640 1 -- 172.21.15.133:0/3787081139 >> v1:172.21.15.142:6789/0 conn(0x7f014815a680 legacy=0x7f014815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014e66e640 1 -- 172.21.15.133:0/3787081139 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014815e860 con 0x7f014806fdb0 2023-12-18T10:18:30.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.966+0000 7f014d66c640 1 --2- 172.21.15.133:0/3787081139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01480cac10 0x7f014815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:30.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f014e66e640 1 --2- 172.21.15.133:0/3787081139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014806fdb0 0x7f0148070260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0140009d90 tx=0x7f014001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df944f0c8555f696 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f014ce6b640 1 -- 172.21.15.133:0/3787081139 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a5980 con 0x7f014806fdb0 2023-12-18T10:18:30.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f014ce6b640 1 -- 172.21.15.133:0/3787081139 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01400a5ae0 con 0x7f014806fdb0 2023-12-18T10:18:30.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f014ce6b640 1 -- 172.21.15.133:0/3787081139 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a5e70 con 0x7f014806fdb0 2023-12-18T10:18:30.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 -- 172.21.15.133:0/3787081139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014806fdb0 msgr2=0x7f0148070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 --2- 172.21.15.133:0/3787081139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014806fdb0 0x7f0148070260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0140009d90 tx=0x7f014001c8c0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 -- 172.21.15.133:0/3787081139 shutdown_connections 2023-12-18T10:18:30.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 --2- 172.21.15.133:0/3787081139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01480cac10 0x7f014815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 --2- 172.21.15.133:0/3787081139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014806fdb0 0x7f0148070260 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 -- 172.21.15.133:0/3787081139 >> 172.21.15.133:0/3787081139 conn(0x7f014806a3e0 msgr2=0x7f01480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:30.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 -- 172.21.15.133:0/3787081139 shutdown_connections 2023-12-18T10:18:30.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 -- 172.21.15.133:0/3787081139 wait complete. 2023-12-18T10:18:30.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 Processor -- start 2023-12-18T10:18:30.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.970+0000 7f01500d1640 1 -- start start 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014806fdb0 0x7f01480c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480cac10 0x7f014806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014815a680 0x7f01481529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c6ba0 con 0x7f01480cac10 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c6dd0 con 0x7f014815a680 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c8350 con 0x7f014806fdb0 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480cac10 0x7f014806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480cac10 0x7f014806bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48340/0 (socket says 172.21.15.133:48340) 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 -- 172.21.15.133:0/1906008522 learned_addr learned my addr 172.21.15.133:0/1906008522 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014de6d640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014806fdb0 0x7f01480c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014e66e640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014815a680 0x7f01481529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 -- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014806fdb0 msgr2=0x7f01480c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014806fdb0 0x7f01480c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 -- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014815a680 msgr2=0x7f01481529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014815a680 0x7f01481529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 -- 172.21.15.133:0/1906008522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138009420 con 0x7f01480cac10 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014e66e640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014815a680 0x7f01481529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f014d66c640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480cac10 0x7f014806bf20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f013800ebb0 tx=0x7f013800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f013e7fc640 1 -- 172.21.15.133:0/1906008522 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800eeb0 con 0x7f01480cac10 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f013e7fc640 1 -- 172.21.15.133:0/1906008522 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013800cc30 con 0x7f01480cac10 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140009a70 con 0x7f01480cac10 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f013e7fc640 1 -- 172.21.15.133:0/1906008522 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138013470 con 0x7f01480cac10 2023-12-18T10:18:30.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01480c7630 con 0x7f01480cac10 2023-12-18T10:18:30.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01480735b0 con 0x7f01480cac10 2023-12-18T10:18:30.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.974+0000 7f013e7fc640 1 -- 172.21.15.133:0/1906008522 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f01380135d0 con 0x7f01480cac10 2023-12-18T10:18:30.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.978+0000 7f013e7fc640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f012c065a60 0x7f012c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:30.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.978+0000 7f013e7fc640 1 -- 172.21.15.133:0/1906008522 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f01380837e0 con 0x7f01480cac10 2023-12-18T10:18:30.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.978+0000 7f014de6d640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f012c065a60 0x7f012c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:30.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.978+0000 7f014de6d640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f012c065a60 0x7f012c067f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01440011f0 tx=0x7f0144009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:30.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:30.982+0000 7f013e7fc640 1 -- 172.21.15.133:0/1906008522 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0138050ea0 con 0x7f01480cac10 2023-12-18T10:18:31.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f014804e000 con 0x7f01480cac10 2023-12-18T10:18:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f013e7fc640 1 -- 172.21.15.133:0/1906008522 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f01380544c0 con 0x7f01480cac10 2023-12-18T10:18:31.136 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:31.137 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f012c065a60 msgr2=0x7f012c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f012c065a60 0x7f012c067f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01440011f0 tx=0x7f0144009040 comp rx=0 tx=0).stop 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480cac10 msgr2=0x7f014806bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480cac10 0x7f014806bf20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f013800ebb0 tx=0x7f013800c520 comp rx=0 tx=0).stop 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 shutdown_connections 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f012c065a60 0x7f012c067f20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f014815a680 0x7f01481529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480cac10 0x7f014806bf20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 --2- 172.21.15.133:0/1906008522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f014806fdb0 0x7f01480c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 >> 172.21.15.133:0/1906008522 conn(0x7f014806a3e0 msgr2=0x7f01480cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 shutdown_connections 2023-12-18T10:18:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.134+0000 7f01500d1640 1 -- 172.21.15.133:0/1906008522 wait complete. 2023-12-18T10:18:31.158 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-18T10:18:31.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.290+0000 7fe9725f0640 1 Processor -- start 2023-12-18T10:18:31.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.290+0000 7fe9725f0640 1 -- start start 2023-12-18T10:18:31.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe9725f0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe96c158c20 0x7fe96c070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe9725f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe96c15c800 0x7fe96c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe9725f0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c070b80 con 0x7fe96c0cafb0 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe9725f0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c070e60 con 0x7fe96c15c800 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe9725f0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96c071140 con 0x7fe96c158c20 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe96b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe96c15c800 0x7fe96c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe96b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe96c15c800 0x7fe96c0caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48354/0 (socket says 172.21.15.133:48354) 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe96b7fe640 1 -- 172.21.15.133:0/2650586478 learned_addr learned my addr 172.21.15.133:0/2650586478 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe96bfff640 1 --2- 172.21.15.133:0/2650586478 >> v2:172.21.15.142:3300/0 conn(0x7fe96c158c20 0x7fe96c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe96b7fe640 1 -- 172.21.15.133:0/2650586478 >> v2:172.21.15.142:3300/0 conn(0x7fe96c158c20 msgr2=0x7fe96c070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe96b7fe640 1 --2- 172.21.15.133:0/2650586478 >> v2:172.21.15.142:3300/0 conn(0x7fe96c158c20 0x7fe96c070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe96b7fe640 1 -- 172.21.15.133:0/2650586478 >> v1:172.21.15.142:6789/0 conn(0x7fe96c0cafb0 legacy=0x7fe96c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.294+0000 7fe96b7fe640 1 -- 172.21.15.133:0/2650586478 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c071420 con 0x7fe96c15c800 2023-12-18T10:18:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe96b7fe640 1 --2- 172.21.15.133:0/2650586478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c15c800 0x7fe96c0caa70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0cc0c0 tx=0x7fe96001cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb7573d9ca56b1d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe96affd640 1 -- 172.21.15.133:0/2650586478 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600ab660 con 0x7fe96c15c800 2023-12-18T10:18:31.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe96affd640 1 -- 172.21.15.133:0/2650586478 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9600ab7c0 con 0x7fe96c15c800 2023-12-18T10:18:31.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe96affd640 1 -- 172.21.15.133:0/2650586478 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600abb50 con 0x7fe96c15c800 2023-12-18T10:18:31.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 -- 172.21.15.133:0/2650586478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c15c800 msgr2=0x7fe96c0caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 --2- 172.21.15.133:0/2650586478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c15c800 0x7fe96c0caa70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0cc0c0 tx=0x7fe96001cea0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 -- 172.21.15.133:0/2650586478 shutdown_connections 2023-12-18T10:18:31.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 --2- 172.21.15.133:0/2650586478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c15c800 0x7fe96c0caa70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 --2- 172.21.15.133:0/2650586478 >> v2:172.21.15.142:3300/0 conn(0x7fe96c158c20 0x7fe96c070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 -- 172.21.15.133:0/2650586478 >> 172.21.15.133:0/2650586478 conn(0x7fe96c06a3e0 msgr2=0x7fe96c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 -- 172.21.15.133:0/2650586478 shutdown_connections 2023-12-18T10:18:31.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 -- 172.21.15.133:0/2650586478 wait complete. 2023-12-18T10:18:31.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 Processor -- start 2023-12-18T10:18:31.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.298+0000 7fe9725f0640 1 -- start start 2023-12-18T10:18:31.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0cafb0 0x7fe96c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c158c20 0x7fe96c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c15c800 0x7fe96c0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1571c0 con 0x7fe96c158c20 2023-12-18T10:18:31.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0b1ce0 con 0x7fe96c0cafb0 2023-12-18T10:18:31.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0b1fc0 con 0x7fe96c15c800 2023-12-18T10:18:31.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c158c20 0x7fe96c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96bfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0cafb0 0x7fe96c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c158c20 0x7fe96c0c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48362/0 (socket says 172.21.15.133:48362) 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 -- 172.21.15.133:0/341310591 learned_addr learned my addr 172.21.15.133:0/341310591 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96bfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0cafb0 0x7fe96c0abce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:46868/0 (socket says 172.21.15.133:46868) 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe970b8d640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c15c800 0x7fe96c0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 -- 172.21.15.133:0/341310591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c15c800 msgr2=0x7fe96c0c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c15c800 0x7fe96c0c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 -- 172.21.15.133:0/341310591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0cafb0 msgr2=0x7fe96c0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0cafb0 0x7fe96c0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 -- 172.21.15.133:0/341310591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9600094d0 con 0x7fe96c158c20 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe96b7fe640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c158c20 0x7fe96c0c9a80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe96001aaf0 tx=0x7fe9600191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe968ff9640 1 -- 172.21.15.133:0/341310591 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600b5810 con 0x7fe96c158c20 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe968ff9640 1 -- 172.21.15.133:0/341310591 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9600b5970 con 0x7fe96c158c20 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe968ff9640 1 -- 172.21.15.133:0/341310591 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600b5d00 con 0x7fe96c158c20 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c0c8800 con 0x7fe96c158c20 2023-12-18T10:18:31.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c0b2580 con 0x7fe96c158c20 2023-12-18T10:18:31.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.302+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c0735b0 con 0x7fe96c158c20 2023-12-18T10:18:31.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.306+0000 7fe968ff9640 1 -- 172.21.15.133:0/341310591 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe9600a9070 con 0x7fe96c158c20 2023-12-18T10:18:31.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.306+0000 7fe968ff9640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe958065a60 0x7fe958067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.306+0000 7fe968ff9640 1 -- 172.21.15.133:0/341310591 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe96011df50 con 0x7fe96c158c20 2023-12-18T10:18:31.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.306+0000 7fe96bfff640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe958065a60 0x7fe958067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.306+0000 7fe96bfff640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe958065a60 0x7fe958067f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe95c007a60 tx=0x7fe95c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.310+0000 7fe968ff9640 1 -- 172.21.15.133:0/341310591 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe9600eb7e0 con 0x7fe96c158c20 2023-12-18T10:18:31.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.462+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe96c04e000 con 0x7fe96c158c20 2023-12-18T10:18:31.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.462+0000 7fe968ff9640 1 -- 172.21.15.133:0/341310591 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fe9600c4090 con 0x7fe96c158c20 2023-12-18T10:18:31.466 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:31.466 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:31.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe958065a60 msgr2=0x7fe958067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe958065a60 0x7fe958067f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe95c007a60 tx=0x7fe95c008040 comp rx=0 tx=0).stop 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c158c20 msgr2=0x7fe96c0c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c158c20 0x7fe96c0c9a80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe96001aaf0 tx=0x7fe9600191e0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 shutdown_connections 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe958065a60 0x7fe958067f20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe96c15c800 0x7fe96c0c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe96c158c20 0x7fe96c0c9a80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 --2- 172.21.15.133:0/341310591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe96c0cafb0 0x7fe96c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 >> 172.21.15.133:0/341310591 conn(0x7fe96c06a3e0 msgr2=0x7fe96c14e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 shutdown_connections 2023-12-18T10:18:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.466+0000 7fe9725f0640 1 -- 172.21.15.133:0/341310591 wait complete. 2023-12-18T10:18:31.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-18T10:18:31.488 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-18T10:18:31.488 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-18T10:18:31.488 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-18T10:18:31.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-18T10:18:31.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-18T10:18:31.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-18T10:18:31.490 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-18T10:18:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f11591f0640 1 Processor -- start 2023-12-18T10:18:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f11591f0640 1 -- start start 2023-12-18T10:18:31.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f11591f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 0x7f114c0065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f11591f0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f114c0532a0 0x7f114c053700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f11591f0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114c037ad0 con 0x7f114c0e7710 2023-12-18T10:18:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f11591f0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114c04f5c0 con 0x7f114c0532a0 2023-12-18T10:18:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f11591f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0483e0 con 0x7f114c04f160 2023-12-18T10:18:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f1152d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f114c0e7710 0x7f114c005ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48102/0 (socket says 172.21.15.133:48102) 2023-12-18T10:18:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f1152d9d640 1 -- 172.21.15.133:0/3453130800 learned_addr learned my addr 172.21.15.133:0/3453130800 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f115259c640 1 --2- 172.21.15.133:0/3453130800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 0x7f114c0065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.726+0000 7f115359e640 1 --2- 172.21.15.133:0/3453130800 >> v2:172.21.15.142:3300/0 conn(0x7f114c0532a0 0x7f114c053700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.730+0000 7f115359e640 1 -- 172.21.15.133:0/3453130800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 msgr2=0x7f114c0065f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.730+0000 7f115359e640 1 --2- 172.21.15.133:0/3453130800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 0x7f114c0065f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.730+0000 7f115359e640 1 -- 172.21.15.133:0/3453130800 >> v1:172.21.15.133:6789/0 conn(0x7f114c0e7710 legacy=0x7f114c005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.730+0000 7f115359e640 1 -- 172.21.15.133:0/3453130800 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c050210 con 0x7f114c0532a0 2023-12-18T10:18:31.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.730+0000 7f7e49b0b640 1 Processor -- start 2023-12-18T10:18:31.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.730+0000 7f7e49b0b640 1 -- start start 2023-12-18T10:18:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f115359e640 1 --2- 172.21.15.133:0/3453130800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 0x7f114c053700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f11480097c0 tx=0x7f114801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34facd11a76ff533 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e49b0b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c038fc0 0x7f7e3c056740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e49b0b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e3c03c750 0x7f7e3c039fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e49b0b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c055a10 con 0x7f7e3c0e4690 2023-12-18T10:18:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e49b0b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c056c80 con 0x7f7e3c03c750 2023-12-18T10:18:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e49b0b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c03cc30 con 0x7f7e3c038fc0 2023-12-18T10:18:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f1151d9b640 1 -- 172.21.15.133:0/3453130800 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11480ab600 con 0x7f114c0532a0 2023-12-18T10:18:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f1151d9b640 1 -- 172.21.15.133:0/3453130800 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11480a7050 con 0x7f114c0532a0 2023-12-18T10:18:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f1151d9b640 1 -- 172.21.15.133:0/3453130800 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11480ab600 con 0x7f114c0532a0 2023-12-18T10:18:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e43fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c038fc0 0x7f7e3c056740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e4930a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e3c03c750 0x7f7e3c039fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e43fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c038fc0 0x7f7e3c056740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44134/0 (socket says 172.21.15.133:44134) 2023-12-18T10:18:31.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e43fff640 1 -- 172.21.15.133:0/1844315011 learned_addr learned my addr 172.21.15.133:0/1844315011 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f11591f0640 1 -- 172.21.15.133:0/3453130800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 msgr2=0x7f114c053700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f11591f0640 1 --2- 172.21.15.133:0/3453130800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 0x7f114c053700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f11480097c0 tx=0x7f114801c480 comp rx=0 tx=0).stop 2023-12-18T10:18:31.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e43fff640 1 -- 172.21.15.133:0/1844315011 >> v2:172.21.15.142:3300/0 conn(0x7f7e3c03c750 msgr2=0x7f7e3c039fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e43fff640 1 --2- 172.21.15.133:0/1844315011 >> v2:172.21.15.142:3300/0 conn(0x7f7e3c03c750 0x7f7e3c039fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e43fff640 1 -- 172.21.15.133:0/1844315011 >> v1:172.21.15.133:6789/0 conn(0x7f7e3c0e4690 legacy=0x7f7e3c0388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.734+0000 7f7e43fff640 1 -- 172.21.15.133:0/1844315011 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c055c60 con 0x7f7e3c038fc0 2023-12-18T10:18:31.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f11591f0640 1 -- 172.21.15.133:0/3453130800 shutdown_connections 2023-12-18T10:18:31.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f11591f0640 1 --2- 172.21.15.133:0/3453130800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 0x7f114c053700 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f11591f0640 1 --2- 172.21.15.133:0/3453130800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 0x7f114c0065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f11591f0640 1 -- 172.21.15.133:0/3453130800 >> 172.21.15.133:0/3453130800 conn(0x7f114c054b10 msgr2=0x7f114c054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f11591f0640 1 -- 172.21.15.133:0/3453130800 shutdown_connections 2023-12-18T10:18:31.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f11591f0640 1 -- 172.21.15.133:0/3453130800 wait complete. 2023-12-18T10:18:31.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f6fa0dce640 1 Processor -- start 2023-12-18T10:18:31.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f6fa0dce640 1 -- start start 2023-12-18T10:18:31.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f11591f0640 1 Processor -- start 2023-12-18T10:18:31.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f7e43fff640 1 --2- 172.21.15.133:0/1844315011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c038fc0 0x7f7e3c056740 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009870 tx=0x7f7e3001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f928c39be1ea937 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.738+0000 7f11591f0640 1 -- start start 2023-12-18T10:18:31.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e437fe640 1 -- 172.21.15.133:0/1844315011 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300ab600 con 0x7f7e3c038fc0 2023-12-18T10:18:31.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e437fe640 1 -- 172.21.15.133:0/1844315011 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e300a7050 con 0x7f7e3c038fc0 2023-12-18T10:18:31.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e437fe640 1 -- 172.21.15.133:0/1844315011 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300ab980 con 0x7f7e3c038fc0 2023-12-18T10:18:31.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6fa0dce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f9c158900 0x7f6f9c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6fa0dce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c06bde0 0x7f6f9c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6fa0dce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9c06c270 con 0x7f6f9c070190 2023-12-18T10:18:31.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6fa0dce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c06cdf0 con 0x7f6f9c158900 2023-12-18T10:18:31.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6fa0dce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c06c550 con 0x7f6f9c06bde0 2023-12-18T10:18:31.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f11591f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 0x7f114c04a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f11591f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 0x7f114c048560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f11591f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f114c0e7710 0x7f114c0e29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f11591f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0d3a90 con 0x7f114c0e7710 2023-12-18T10:18:31.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f11591f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0e1940 con 0x7f114c0532a0 2023-12-18T10:18:31.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f11591f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114c0e1c20 con 0x7f114c04f160 2023-12-18T10:18:31.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e49b0b640 1 -- 172.21.15.133:0/1844315011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c038fc0 msgr2=0x7f7e3c056740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e49b0b640 1 --2- 172.21.15.133:0/1844315011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c038fc0 0x7f7e3c056740 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009870 tx=0x7f7e3001c3b0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7bfcaa8640 1 Processor -- start 2023-12-18T10:18:31.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f9a59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f9c158900 0x7f6f9c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7bfcaa8640 1 -- start start 2023-12-18T10:18:31.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f9a59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f9c158900 0x7f6f9c0cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:46898/0 (socket says 172.21.15.133:46898) 2023-12-18T10:18:31.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f9a59c640 1 -- 172.21.15.133:0/2332192406 learned_addr learned my addr 172.21.15.133:0/2332192406 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f99d9b640 1 --2- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c06bde0 0x7f6f9c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e49b0b640 1 -- 172.21.15.133:0/1844315011 shutdown_connections 2023-12-18T10:18:31.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e49b0b640 1 --2- 172.21.15.133:0/1844315011 >> v2:172.21.15.142:3300/0 conn(0x7f7e3c03c750 0x7f7e3c039fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e49b0b640 1 --2- 172.21.15.133:0/1844315011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c038fc0 0x7f7e3c056740 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e49b0b640 1 -- 172.21.15.133:0/1844315011 >> 172.21.15.133:0/1844315011 conn(0x7f7e3c0538b0 msgr2=0x7f7e3c053cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e49b0b640 1 -- 172.21.15.133:0/1844315011 shutdown_connections 2023-12-18T10:18:31.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f9a59c640 1 -- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c06bde0 msgr2=0x7f6f9c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f9a59c640 1 --2- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c06bde0 0x7f6f9c0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f9959a640 1 -- 172.21.15.133:0/2332192406 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439988952 0 0) 0x7f6f9c06c270 con 0x7f6f9c070190 2023-12-18T10:18:31.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7e49b0b640 1 -- 172.21.15.133:0/1844315011 wait complete. 2023-12-18T10:18:31.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 0x7f114c048560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 0x7f114c048560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:46900/0 (socket says 172.21.15.133:46900) 2023-12-18T10:18:31.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 -- 172.21.15.133:0/1604954703 learned_addr learned my addr 172.21.15.133:0/1604954703 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f1152d9d640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 0x7f114c04a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115359e640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f114c0e7710 0x7f114c0e29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 -- 172.21.15.133:0/1604954703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 msgr2=0x7f114c04a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f114c04f160 0x7f114c04a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 -- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f114c0e7710 msgr2=0x7f114c0e29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f114c0e7710 0x7f114c0e29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 -- 172.21.15.133:0/1604954703 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148009420 con 0x7f114c0532a0 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f115259c640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 0x7f114c048560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f114400e870 tx=0x7f114400ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1144009510 con 0x7f114c0532a0 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400eec0 con 0x7f114c0532a0 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400cb40 con 0x7f114c0532a0 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7bfcaa8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7bfcaa8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bf80cf670 0x7f7bf80b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7bfcaa8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf815cb10 con 0x7f7bf80cea00 2023-12-18T10:18:31.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7bfcaa8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf80b84c0 con 0x7f7bf80cf670 2023-12-18T10:18:31.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f7bfcaa8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf80cd960 con 0x7f7bf815c730 2023-12-18T10:18:31.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f9a59c640 1 -- 172.21.15.133:0/2332192406 >> v1:172.21.15.142:6789/0 conn(0x7f6f9c070190 legacy=0x7f6f9c15c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f9a59c640 1 -- 172.21.15.133:0/2332192406 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c06c830 con 0x7f6f9c158900 2023-12-18T10:18:31.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.742+0000 7f6f99d9b640 1 --2- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c06bde0 0x7f6f9c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7bf6ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7bf80cea00 0x7f7bf80cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:42952/0 (socket says 172.21.15.133:42952) 2023-12-18T10:18:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7bf6ffd640 1 -- 172.21.15.133:0/1545670841 learned_addr learned my addr 172.21.15.133:0/1545670841 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7bf77fe640 1 --2- 172.21.15.133:0/1545670841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7bf7fff640 1 --2- 172.21.15.133:0/1545670841 >> v2:172.21.15.133:3300/0 conn(0x7f7bf80cf670 0x7f7bf80b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f11591f0640 1 -- 172.21.15.133:0/1604954703 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114c0e1f00 con 0x7f114c0532a0 2023-12-18T10:18:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f11591f0640 1 -- 172.21.15.133:0/1604954703 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114c0e24c0 con 0x7f114c0532a0 2023-12-18T10:18:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7e49b0b640 1 Processor -- start 2023-12-18T10:18:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7bf77fe640 1 -- 172.21.15.133:0/1545670841 >> v2:172.21.15.133:3300/0 conn(0x7f7bf80cf670 msgr2=0x7f7bf80b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7bf77fe640 1 --2- 172.21.15.133:0/1545670841 >> v2:172.21.15.133:3300/0 conn(0x7f7bf80cf670 0x7f7bf80b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7bf77fe640 1 -- 172.21.15.133:0/1545670841 >> v1:172.21.15.142:6789/0 conn(0x7f7bf80cea00 legacy=0x7f7bf80cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7fee77ef9640 1 Processor -- start 2023-12-18T10:18:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7bf77fe640 1 -- 172.21.15.133:0/1545670841 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf80cdc40 con 0x7f7bf815c730 2023-12-18T10:18:31.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f114c052d80 con 0x7f114c0532a0 2023-12-18T10:18:31.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7fee77ef9640 1 -- start start 2023-12-18T10:18:31.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f7e49b0b640 1 -- start start 2023-12-18T10:18:31.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.746+0000 7f6f9a59c640 1 --2- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c158900 0x7f6f9c0cb1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009ed0 tx=0x7f6f9401ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f3336fe99f378e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f114400cca0 con 0x7f114c0532a0 2023-12-18T10:18:31.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f6f9959a640 1 -- 172.21.15.133:0/2332192406 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940a7ba0 con 0x7f6f9c158900 2023-12-18T10:18:31.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f6f9959a640 1 -- 172.21.15.133:0/2332192406 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f940a7d00 con 0x7f6f9c158900 2023-12-18T10:18:31.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f6f9959a640 1 -- 172.21.15.133:0/2332192406 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f940a7ba0 con 0x7f6f9c158900 2023-12-18T10:18:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee77ef9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 0x7fee700cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e49b0b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e3c038fc0 0x7f7e3c182570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee77ef9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7006fdb0 con 0x7fee700cb340 2023-12-18T10:18:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee77ef9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee70164820 con 0x7fee70160cc0 2023-12-18T10:18:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee77ef9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee701654a0 con 0x7fee700c1280 2023-12-18T10:18:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e49b0b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e3c03c750 0x7f7e3c0500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e49b0b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c0e4690 0x7f7e3c050610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e49b0b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c008430 con 0x7f7e3c03c750 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e49b0b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c189230 con 0x7f7e3c038fc0 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e49b0b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c1894b0 con 0x7f7e3c0e4690 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c0e4690 0x7f7e3c050610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c0e4690 0x7f7e3c050610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44176/0 (socket says 172.21.15.133:44176) 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 -- 172.21.15.133:0/3445810614 learned_addr learned my addr 172.21.15.133:0/3445810614 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f113b7fe640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1140065b30 0x7f1140067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 -- 172.21.15.133:0/3445810614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e3c038fc0 msgr2=0x7f7e3c182570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-18T10:18:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e3c038fc0 0x7f7e3c182570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 -- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e3c03c750 msgr2=0x7f7e3c0500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e3c03c750 0x7f7e3c0500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 -- 172.21.15.133:0/3445810614 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300094d0 con 0x7f7e3c0e4690 2023-12-18T10:18:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee75c95640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fee70160cc0 0x7fee700cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:42966/0 (socket says 172.21.15.133:42966) 2023-12-18T10:18:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee75c95640 1 -- 172.21.15.133:0/1662003522 learned_addr learned my addr 172.21.15.133:0/1662003522 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee75494640 1 --2- 172.21.15.133:0/1662003522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 0x7fee700cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11440835b0 con 0x7f114c0532a0 2023-12-18T10:18:31.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e4930a640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c0e4690 0x7f7e3c050610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7e4404f9a0 tx=0x7f7e44073770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee74c93640 1 -- 172.21.15.133:0/1662003522 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806371407 0 0) 0x7fee7006fdb0 con 0x7fee700cb340 2023-12-18T10:18:31.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee74c93640 1 -- 172.21.15.133:0/1662003522 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee5c003530 con 0x7fee700cb340 2023-12-18T10:18:31.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f113b7fe640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f114006f170 0x7f11400715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1140071c80 con 0x7f114006f170 2023-12-18T10:18:31.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1144085bd0 con 0x7f114c0532a0 2023-12-18T10:18:31.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44072870 con 0x7f7e3c0e4690 2023-12-18T10:18:31.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e440729d0 con 0x7f7e3c0e4690 2023-12-18T10:18:31.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44072d40 con 0x7f7e3c0e4690 2023-12-18T10:18:31.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c04cd80 con 0x7f7e3c0e4690 2023-12-18T10:18:31.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7bf77fe640 1 --2- 172.21.15.133:0/1545670841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b7f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0097c0 tx=0x7f7bec01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd5643107f443762 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f1152d9d640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1140065b30 0x7f1140067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c04d340 con 0x7f7e3c0e4690 2023-12-18T10:18:31.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f6fa0dce640 1 -- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c158900 msgr2=0x7f6f9c0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f6fa0dce640 1 --2- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c158900 0x7f6f9c0cb1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009ed0 tx=0x7f6f9401ede0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f7bf67fc640 1 -- 172.21.15.133:0/1545670841 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0ab600 con 0x7f7bf815c730 2023-12-18T10:18:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bf67fc640 1 -- 172.21.15.133:0/1545670841 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec0a7050 con 0x7f7bf815c730 2023-12-18T10:18:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bf67fc640 1 -- 172.21.15.133:0/1545670841 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0ab980 con 0x7f7bf815c730 2023-12-18T10:18:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f0388e04640 1 Processor -- start 2023-12-18T10:18:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7f0388e04640 1 -- start start 2023-12-18T10:18:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f115359e640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f114006f170 0x7f11400715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f6fa0dce640 1 -- 172.21.15.133:0/2332192406 shutdown_connections 2023-12-18T10:18:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f6fa0dce640 1 --2- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c06bde0 0x7f6f9c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f6fa0dce640 1 --2- 172.21.15.133:0/2332192406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c158900 0x7f6f9c0cb1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f6fa0dce640 1 -- 172.21.15.133:0/2332192406 >> 172.21.15.133:0/2332192406 conn(0x7f6f9c0afe90 msgr2=0x7f6f9c0b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee75494640 1 -- 172.21.15.133:0/1662003522 >> v1:172.21.15.142:6789/0 conn(0x7fee70160cc0 legacy=0x7fee700cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.750+0000 7fee75494640 1 -- 172.21.15.133:0/1662003522 >> v1:172.21.15.133:6789/0 conn(0x7fee700cb340 legacy=0x7fee700cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7fee75494640 1 -- 172.21.15.133:0/1662003522 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70164b00 con 0x7fee700c1280 2023-12-18T10:18:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/1545670841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 msgr2=0x7f7bf80b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bfcaa8640 1 --2- 172.21.15.133:0/1545670841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b7f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0097c0 tx=0x7f7bec01c3a0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e3c0e4a70 con 0x7f7e3c0e4690 2023-12-18T10:18:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f6fa0dce640 1 -- 172.21.15.133:0/2332192406 shutdown_connections 2023-12-18T10:18:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/1545670841 shutdown_connections 2023-12-18T10:18:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f6fa0dce640 1 -- 172.21.15.133:0/2332192406 wait complete. 2023-12-18T10:18:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bfcaa8640 1 --2- 172.21.15.133:0/1545670841 >> v2:172.21.15.133:3300/0 conn(0x7f7bf80cf670 0x7f7bf80b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bfcaa8640 1 --2- 172.21.15.133:0/1545670841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b7f80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/1545670841 >> 172.21.15.133:0/1545670841 conn(0x7f7bf806b120 msgr2=0x7f7bf806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f115359e640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f114006f170 0x7f11400715b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0388e04640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03840b1af0 0x7f03840d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0388e04640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cf150 0x7f03840cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0388e04640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03840cdea0 con 0x7f03840d3280 2023-12-18T10:18:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0388e04640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03840cfb10 con 0x7f03840b1af0 2023-12-18T10:18:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0388e04640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03840cea40 con 0x7f03840cf150 2023-12-18T10:18:31.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1140071c80 con 0x7f114006f170 2023-12-18T10:18:31.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f1152d9d640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1140065b30 0x7f1140067ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f11540618c0 tx=0x7f115406d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e4409c440 con 0x7f7e3c0e4690 2023-12-18T10:18:31.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7e417fa640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e28065b30 0x7f7e28067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e440fc980 con 0x7f7e3c0e4690 2023-12-18T10:18:31.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7e417fa640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7f7e2806f0f0 0x7f7e28071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 --> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e28071c00 con 0x7f7e2806f0f0 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/1545670841 shutdown_connections 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/1545670841 wait complete. 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f038259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03840b1af0 0x7f03840d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0382d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cf150 0x7f03840cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0382d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cf150 0x7f03840cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44178/0 (socket says 172.21.15.133:44178) 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0382d9d640 1 -- 172.21.15.133:0/3465896552 learned_addr learned my addr 172.21.15.133:0/3465896552 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0382d9d640 1 -- 172.21.15.133:0/3465896552 >> v2:172.21.15.133:3300/0 conn(0x7f03840b1af0 msgr2=0x7f03840d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0382d9d640 1 --2- 172.21.15.133:0/3465896552 >> v2:172.21.15.133:3300/0 conn(0x7f03840b1af0 0x7f03840d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0382d9d640 1 -- 172.21.15.133:0/3465896552 >> v1:172.21.15.142:6789/0 conn(0x7f03840d3280 legacy=0x7f03840ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7f0382d9d640 1 -- 172.21.15.133:0/3465896552 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840cd310 con 0x7f03840cf150 2023-12-18T10:18:31.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7fd829866640 1 Processor -- start 2023-12-18T10:18:31.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.754+0000 7fd829866640 1 -- start start 2023-12-18T10:18:31.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e440ca030 con 0x7f7e3c0e4690 2023-12-18T10:18:31.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7e48b09640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e28065b30 0x7f7e28067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7e43fff640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7f7e2806f0f0 0x7f7e28071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6fa0dce640 1 Processor -- start 2023-12-18T10:18:31.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6fa0dce640 1 -- start start 2023-12-18T10:18:31.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7bfcaa8640 1 Processor -- start 2023-12-18T10:18:31.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd829866640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8240cb480 0x7fd8240cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd829866640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8240cdba0 0x7fd824158530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd829866640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8240cbf30 con 0x7fd82406dea0 2023-12-18T10:18:31.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd829866640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82415d090 con 0x7fd8240cb480 2023-12-18T10:18:31.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd829866640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82415c760 con 0x7fd8240cdba0 2023-12-18T10:18:31.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fee75494640 1 --2- 172.21.15.133:0/1662003522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 0x7fee700cc400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee60009820 tx=0x7fee6001bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8400a17b7ad33325 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7e48b09640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e28065b30 0x7f7e28067ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009690 tx=0x7f7e38006b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7e43fff640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7f7e2806f0f0 0x7f7e28071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6fa0dce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c070190 0x7f6f9c0c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6fa0dce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c158900 0x7f6f9c0c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6fa0dce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c0c4cc0 0x7f6f9c147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7bfcaa8640 1 -- start start 2023-12-18T10:18:31.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7bfcaa8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf80cea00 0x7f7bf806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7bfcaa8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf80cf670 0x7f7bf814d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7bfcaa8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7bfcaa8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf815b5d0 con 0x7f7bf80cf670 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7bfcaa8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf806d500 con 0x7f7bf80cea00 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f7bfcaa8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf81f7000 con 0x7f7bf815c730 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8237fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8240cdba0 0x7fd824158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8237fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd8240cdba0 0x7fd824158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:46916/0 (socket says 172.21.15.133:46916) 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8237fe640 1 -- 172.21.15.133:0/3288497628 learned_addr learned my addr 172.21.15.133:0/3288497628 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8237fe640 1 -- 172.21.15.133:0/3288497628 >> v2:172.21.15.133:3300/0 conn(0x7fd8240cb480 msgr2=0x7fd8240cd660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8227fc640 1 --2- 172.21.15.133:0/3288497628 >> v2:172.21.15.133:3300/0 conn(0x7fd8240cb480 0x7fd8240cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8237fe640 1 --2- 172.21.15.133:0/3288497628 >> v2:172.21.15.133:3300/0 conn(0x7fd8240cb480 0x7fd8240cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8237fe640 1 -- 172.21.15.133:0/3288497628 >> v1:172.21.15.133:6789/0 conn(0x7fd82406dea0 legacy=0x7fd8240cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8237fe640 1 -- 172.21.15.133:0/3288497628 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82415ca40 con 0x7fd8240cdba0 2023-12-18T10:18:31.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7fd8227fc640 1 --2- 172.21.15.133:0/3288497628 >> v2:172.21.15.133:3300/0 conn(0x7fd8240cb480 0x7fd8240cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:31.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f5a4ca2a640 1 Processor -- start 2023-12-18T10:18:31.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f5a4ca2a640 1 -- start start 2023-12-18T10:18:31.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6fa0dce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0c48a0 con 0x7f6f9c158900 2023-12-18T10:18:31.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6fa0dce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0c59e0 con 0x7f6f9c070190 2023-12-18T10:18:31.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6fa0dce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0c3b10 con 0x7f6f9c0c4cc0 2023-12-18T10:18:31.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f6f9a59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c070190 0x7f6f9c0c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 <== osd.1 v2:172.21.15.133:6800/38184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7e28071c00 con 0x7f7e2806f0f0 2023-12-18T10:18:31.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f99d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c158900 0x7f6f9c0c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f9ad9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c0c4cc0 0x7f6f9c147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.758+0000 7f5a4ca2a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 0x7f5a40007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a4ca2a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a40055630 0x7f5a40054110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a4ca2a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a40006370 con 0x7f5a40005ee0 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a4ca2a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a40006650 con 0x7f5a40055630 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a4ca2a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40006930 con 0x7f5a400df460 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f99d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c158900 0x7f6f9c0c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48414/0 (socket says 172.21.15.133:48414) 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f9a59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c070190 0x7f6f9c0c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:46924/0 (socket says 172.21.15.133:46924) 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f99d9b640 1 -- 172.21.15.133:0/1718816976 learned_addr learned my addr 172.21.15.133:0/1718816976 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f9a59c640 1 -- 172.21.15.133:0/1718816976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c0c4cc0 msgr2=0x7f6f9c147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f9a59c640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f9c0c4cc0 0x7f6f9c147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f9a59c640 1 -- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c158900 msgr2=0x7f6f9c0c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f9a59c640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c158900 0x7f6f9c0c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f9a59c640 1 -- 172.21.15.133:0/1718816976 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94009b30 con 0x7f6f9c070190 2023-12-18T10:18:31.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44186/0 (socket says 172.21.15.133:44186) 2023-12-18T10:18:31.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf7fff640 1 -- 172.21.15.133:0/2717038735 learned_addr learned my addr 172.21.15.133:0/2717038735 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf80cea00 0x7f7bf806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf6ffd640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf80cf670 0x7f7bf814d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a46ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5a40005ee0 0x7f5a400e2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:42980/0 (socket says 172.21.15.133:42980) 2023-12-18T10:18:31.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a46ffd640 1 -- 172.21.15.133:0/1822552581 learned_addr learned my addr 172.21.15.133:0/1822552581 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:31.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a477fe640 1 --2- 172.21.15.133:0/1822552581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 0x7f5a40007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a47fff640 1 --2- 172.21.15.133:0/1822552581 >> v2:172.21.15.142:3300/0 conn(0x7f5a40055630 0x7f5a40054110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f0382d9d640 1 --2- 172.21.15.133:0/3465896552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cf150 0x7f03840cf5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0378009870 tx=0x7f037801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a31b5861a424252e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f038159a640 1 -- 172.21.15.133:0/3465896552 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780ab600 con 0x7f03840cf150 2023-12-18T10:18:31.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a477fe640 1 -- 172.21.15.133:0/1822552581 >> v2:172.21.15.142:3300/0 conn(0x7f5a40055630 msgr2=0x7f5a40054110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:31.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a467fc640 1 -- 172.21.15.133:0/1822552581 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623068347 0 0) 0x7f5a40006370 con 0x7f5a40005ee0 2023-12-18T10:18:31.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a477fe640 1 --2- 172.21.15.133:0/1822552581 >> v2:172.21.15.142:3300/0 conn(0x7f5a40055630 0x7f5a40054110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a477fe640 1 -- 172.21.15.133:0/1822552581 >> v1:172.21.15.142:6789/0 conn(0x7f5a40005ee0 legacy=0x7f5a400e2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a477fe640 1 -- 172.21.15.133:0/1822552581 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40006c10 con 0x7f5a400df460 2023-12-18T10:18:31.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf6ffd640 1 -- 172.21.15.133:0/2717038735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 msgr2=0x7f7bf80b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf6ffd640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bf815c730 0x7f7bf80b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf6ffd640 1 -- 172.21.15.133:0/2717038735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf80cea00 msgr2=0x7f7bf806cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf6ffd640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf80cea00 0x7f7bf806cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf6ffd640 1 -- 172.21.15.133:0/2717038735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec009420 con 0x7f7bf80cf670 2023-12-18T10:18:31.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f5a47fff640 1 --2- 172.21.15.133:0/1822552581 >> v2:172.21.15.142:3300/0 conn(0x7f5a40055630 0x7f5a40054110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:31.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f038159a640 1 -- 172.21.15.133:0/3465896552 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03780a7050 con 0x7f03840cf150 2023-12-18T10:18:31.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f038159a640 1 -- 172.21.15.133:0/3465896552 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780ab980 con 0x7f03840cf150 2023-12-18T10:18:31.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f9a59c640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c070190 0x7f6f9c0c3480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0cf460 tx=0x7f6f9401bb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bf6ffd640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf80cf670 0x7f7bf814d860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009e70 tx=0x7f7be800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7fee74c93640 1 -- 172.21.15.133:0/1662003522 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68001980 con 0x7fee700c1280 2023-12-18T10:18:31.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7fee74c93640 1 -- 172.21.15.133:0/1662003522 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600a7420 con 0x7fee700c1280 2023-12-18T10:18:31.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7fee74c93640 1 -- 172.21.15.133:0/1662003522 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600a77b0 con 0x7fee700c1280 2023-12-18T10:18:31.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94004450 con 0x7f6f9c070190 2023-12-18T10:18:31.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f940045b0 con 0x7f6f9c070190 2023-12-18T10:18:31.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94009510 con 0x7f6f9c070190 2023-12-18T10:18:31.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c0c3f40 con 0x7f6f9c070190 2023-12-18T10:18:31.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c0c44c0 con 0x7f6f9c070190 2023-12-18T10:18:31.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f0388e04640 1 -- 172.21.15.133:0/3465896552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cf150 msgr2=0x7f03840cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f0388e04640 1 --2- 172.21.15.133:0/3465896552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cf150 0x7f03840cf5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0378009870 tx=0x7f037801c3f0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80078f0 con 0x7f7bf80cf670 2023-12-18T10:18:31.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be8007a50 con 0x7f7bf80cf670 2023-12-18T10:18:31.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7fee77ef9640 1 -- 172.21.15.133:0/1662003522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 msgr2=0x7fee700cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7fee77ef9640 1 --2- 172.21.15.133:0/1662003522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 0x7fee700cc400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fee60009820 tx=0x7fee6001bf00 comp rx=0 tx=0).stop 2023-12-18T10:18:31.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f9c0c9af0 con 0x7f6f9c070190 2023-12-18T10:18:31.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8007de0 con 0x7f7bf80cf670 2023-12-18T10:18:31.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.762+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf81f66d0 con 0x7f7bf80cf670 2023-12-18T10:18:31.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f0388e04640 1 -- 172.21.15.133:0/3465896552 shutdown_connections 2023-12-18T10:18:31.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f0388e04640 1 --2- 172.21.15.133:0/3465896552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840cf150 0x7f03840cf5d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f0388e04640 1 --2- 172.21.15.133:0/3465896552 >> v2:172.21.15.133:3300/0 conn(0x7f03840b1af0 0x7f03840d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f0388e04640 1 -- 172.21.15.133:0/3465896552 >> 172.21.15.133:0/3465896552 conn(0x7f0384089fb0 msgr2=0x7f03840d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf81f6c90 con 0x7f7bf80cf670 2023-12-18T10:18:31.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fee77ef9640 1 -- 172.21.15.133:0/1662003522 shutdown_connections 2023-12-18T10:18:31.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fee77ef9640 1 --2- 172.21.15.133:0/1662003522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 0x7fee700cc400 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fee77ef9640 1 -- 172.21.15.133:0/1662003522 >> 172.21.15.133:0/1662003522 conn(0x7fee7006a3e0 msgr2=0x7fee700afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd8237fe640 1 --2- 172.21.15.133:0/3288497628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8240cdba0 0x7fd824158530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8240b0be0 tx=0x7fd81801ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2845ef156dbca9d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fee77ef9640 1 -- 172.21.15.133:0/1662003522 shutdown_connections 2023-12-18T10:18:31.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7bf80ce200 con 0x7f7bf80cf670 2023-12-18T10:18:31.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd821ffb640 1 -- 172.21.15.133:0/3288497628 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180a89f0 con 0x7fd8240cdba0 2023-12-18T10:18:31.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd821ffb640 1 -- 172.21.15.133:0/3288497628 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8180a8b50 con 0x7fd8240cdba0 2023-12-18T10:18:31.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd821ffb640 1 -- 172.21.15.133:0/3288497628 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180b0440 con 0x7fd8240cdba0 2023-12-18T10:18:31.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fee77ef9640 1 -- 172.21.15.133:0/1662003522 wait complete. 2023-12-18T10:18:31.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f5a477fe640 1 --2- 172.21.15.133:0/1822552581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 0x7f5a40007410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5a340097c0 tx=0x7f5a3401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15839b1690a4b81 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd829866640 1 -- 172.21.15.133:0/3288497628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8240cdba0 msgr2=0x7fd824158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd829866640 1 --2- 172.21.15.133:0/3288497628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8240cdba0 0x7fd824158530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8240b0be0 tx=0x7fd81801ecf0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f5a467fc640 1 -- 172.21.15.133:0/1822552581 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340ab600 con 0x7f5a400df460 2023-12-18T10:18:31.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd829866640 1 -- 172.21.15.133:0/3288497628 shutdown_connections 2023-12-18T10:18:31.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd829866640 1 --2- 172.21.15.133:0/3288497628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8240cdba0 0x7fd824158530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd829866640 1 --2- 172.21.15.133:0/3288497628 >> v2:172.21.15.133:3300/0 conn(0x7fd8240cb480 0x7fd8240cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd829866640 1 -- 172.21.15.133:0/3288497628 >> 172.21.15.133:0/3288497628 conn(0x7fd82406a3e0 msgr2=0x7fd8240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f5a467fc640 1 -- 172.21.15.133:0/1822552581 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340a7050 con 0x7f5a400df460 2023-12-18T10:18:31.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f5a467fc640 1 -- 172.21.15.133:0/1822552581 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340ab980 con 0x7f5a400df460 2023-12-18T10:18:31.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd829866640 1 -- 172.21.15.133:0/3288497628 shutdown_connections 2023-12-18T10:18:31.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f0388e04640 1 -- 172.21.15.133:0/3465896552 shutdown_connections 2023-12-18T10:18:31.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7fd829866640 1 -- 172.21.15.133:0/3288497628 wait complete. 2023-12-18T10:18:31.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee77ef9640 1 Processor -- start 2023-12-18T10:18:31.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/1822552581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 msgr2=0x7f5a40007410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 --2- 172.21.15.133:0/1822552581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 0x7f5a40007410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5a340097c0 tx=0x7f5a3401c480 comp rx=0 tx=0).stop 2023-12-18T10:18:31.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/1822552581 shutdown_connections 2023-12-18T10:18:31.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee77ef9640 1 -- start start 2023-12-18T10:18:31.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 --2- 172.21.15.133:0/1822552581 >> v2:172.21.15.142:3300/0 conn(0x7f5a40055630 0x7f5a40054110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 --2- 172.21.15.133:0/1822552581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 0x7f5a40007410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/1822552581 >> 172.21.15.133:0/1822552581 conn(0x7f5a40054b10 msgr2=0x7f5a40054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f940af3f0 con 0x7f6f9c070190 2023-12-18T10:18:31.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f6f8affd640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6f7c065b60 0x7f6f7c068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f9411ddb0 con 0x7f6f9c070190 2023-12-18T10:18:31.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f6f8affd640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6f7c06f1a0 0x7f6f7c0715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 --> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f7c071cb0 con 0x7f6f7c06f1a0 2023-12-18T10:18:31.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f9411e160 con 0x7f6f9c070190 2023-12-18T10:18:31.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/1822552581 shutdown_connections 2023-12-18T10:18:31.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fd829866640 1 Processor -- start 2023-12-18T10:18:31.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/1822552581 wait complete. 2023-12-18T10:18:31.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fd829866640 1 -- start start 2023-12-18T10:18:31.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f6f99d9b640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6f7c065b60 0x7f6f7c068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f6f9ad9d640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6f7c06f1a0 0x7f6f7c0715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f6f9ad9d640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6f7c06f1a0 0x7f6f7c0715e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f6f99d9b640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6f7c065b60 0x7f6f7c068020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0cdfb0 tx=0x7f6f8c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 <== osd.2 v2:172.21.15.133:6816/38205 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6f7c071cb0 con 0x7f6f7c06f1a0 2023-12-18T10:18:31.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7be80090f0 con 0x7f7bf80cf670 2023-12-18T10:18:31.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f7bdffff640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7be4065b30 0x7f7be4067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7be8085af0 con 0x7f7bf80cf670 2023-12-18T10:18:31.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f7bdffff640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7f7be406f170 0x7f7be40715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 --> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7be4071c80 con 0x7f7be406f170 2023-12-18T10:18:31.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7be8085ea0 con 0x7f7bf80cf670 2023-12-18T10:18:31.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f7bf77fe640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7be4065b30 0x7f7be4067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f7bf7fff640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7f7be406f170 0x7f7be40715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f7bf77fe640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7be4065b30 0x7f7be4067ff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0ad000 tx=0x7f7bec0a4f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f7bf7fff640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7f7be406f170 0x7f7be40715b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee77ef9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 0x7fee70151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee77ef9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee700cb340 0x7fee700c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee77ef9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70160cc0 0x7fee700ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee77ef9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700c2e00 con 0x7fee700cb340 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee77ef9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700c5e80 con 0x7fee70160cc0 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee77ef9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee700c6160 con 0x7fee700c1280 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee75c95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 0x7fee70151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee75494640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee700cb340 0x7fee700c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee76496640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70160cc0 0x7fee700ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee75494640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee700cb340 0x7fee700c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48426/0 (socket says 172.21.15.133:48426) 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee75494640 1 -- 172.21.15.133:0/3094207702 learned_addr learned my addr 172.21.15.133:0/3094207702 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee75494640 1 -- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 msgr2=0x7fee70151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee75494640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee700c1280 0x7fee70151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee75494640 1 -- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70160cc0 msgr2=0x7fee700ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fee75494640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70160cc0 0x7fee700ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee75494640 1 -- 172.21.15.133:0/3094207702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009420 con 0x7fee700cb340 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee76496640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee70160cc0 0x7fee700ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee75494640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee700cb340 0x7fee700c5430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee60009820 tx=0x7fee60018fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600b3040 con 0x7fee700cb340 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600b7400 con 0x7fee700cb340 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600b77b0 con 0x7fee700cb340 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee700c6440 con 0x7fee700cb340 2023-12-18T10:18:31.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee70151d60 con 0x7fee700cb340 2023-12-18T10:18:31.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee7004e000 con 0x7fee700cb340 2023-12-18T10:18:31.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.766+0000 7f0388e04640 1 -- 172.21.15.133:0/3465896552 wait complete. 2023-12-18T10:18:31.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f0388e04640 1 Processor -- start 2023-12-18T10:18:31.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fd829866640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd82406dea0 0x7fd8240c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fd829866640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8240cb480 0x7fd824148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fd829866640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8240cdba0 0x7fd8240c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fd822ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd82406dea0 0x7fd8240c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fd829866640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd824148650 con 0x7fd8240cdba0 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7fd829866640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd824070590 con 0x7fd82406dea0 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd822ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd82406dea0 0x7fd8240c01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:46938/0 (socket says 172.21.15.133:46938) 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8237fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8240cdba0 0x7fd8240c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8227fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8240cb480 0x7fd824148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8237fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8240cdba0 0x7fd8240c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48434/0 (socket says 172.21.15.133:48434) 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8237fe640 1 -- 172.21.15.133:0/448632081 learned_addr learned my addr 172.21.15.133:0/448632081 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82414c600 con 0x7fd8240cb480 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8227fc640 1 -- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd82406dea0 msgr2=0x7fd8240c01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8227fc640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd82406dea0 0x7fd8240c01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8227fc640 1 -- 172.21.15.133:0/448632081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8240cdba0 msgr2=0x7fd8240c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8227fc640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8240cdba0 0x7fd8240c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8227fc640 1 -- 172.21.15.133:0/448632081 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8180094d0 con 0x7fd8240cb480 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8237fe640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8240cdba0 0x7fd8240c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd822ffd640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd82406dea0 0x7fd8240c01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd8227fc640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8240cb480 0x7fd824148ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd81400cea0 tx=0x7fd81400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 Processor -- start 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.770+0000 7f5a4ca2a640 1 -- start start 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a4ca2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a40055630 0x7f5a4004bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a4ca2a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 0x7f5a400cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a4ca2a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a4004e070 0x7f5a4004e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a4ca2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a400d2560 con 0x7f5a40055630 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a4ca2a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4004c120 con 0x7f5a4004e070 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a4ca2a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40034770 con 0x7f5a400df460 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a40055630 0x7f5a4004bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a40055630 0x7f5a4004bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48438/0 (socket says 172.21.15.133:48438) 2023-12-18T10:18:31.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a477fe640 1 -- 172.21.15.133:0/4068745232 learned_addr learned my addr 172.21.15.133:0/4068745232 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a46ffd640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 0x7f5a400cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a47fff640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a4004e070 0x7f5a4004e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a477fe640 1 -- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 msgr2=0x7f5a400cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a477fe640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a400df460 0x7f5a400cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a477fe640 1 -- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a4004e070 msgr2=0x7f5a4004e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a477fe640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a4004e070 0x7f5a4004e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7f5a477fe640 1 -- 172.21.15.133:0/4068745232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34009420 con 0x7f5a40055630 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81400d840 con 0x7fd8240cb480 2023-12-18T10:18:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81400d9a0 con 0x7fd8240cb480 2023-12-18T10:18:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81400dd30 con 0x7fd8240cb480 2023-12-18T10:18:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd824149020 con 0x7fd8240cb480 2023-12-18T10:18:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.774+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8240c1ae0 con 0x7fd8240cb480 2023-12-18T10:18:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 <== osd.3 v2:172.21.15.133:6824/38188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7be4071c80 con 0x7f7be406f170 2023-12-18T10:18:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fee600b7910 con 0x7fee700cb340 2023-12-18T10:18:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd82415cd20 con 0x7fd8240cb480 2023-12-18T10:18:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f5a477fe640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a40055630 0x7f5a4004bbe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a34019090 tx=0x7f5a34019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0388e04640 1 -- start start 2023-12-18T10:18:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0388e04640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03840b1af0 0x7f0384160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0388e04640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840cf150 0x7f03840c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0388e04640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840d3280 0x7f03840c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0388e04640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03840c5c50 con 0x7f03840b1af0 2023-12-18T10:18:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0388e04640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03840c5f30 con 0x7f03840cf150 2023-12-18T10:18:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0388e04640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03840c6210 con 0x7f03840d3280 2023-12-18T10:18:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340b4600 con 0x7f5a40055630 2023-12-18T10:18:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340b4760 con 0x7f5a40055630 2023-12-18T10:18:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340b4b10 con 0x7f5a40055630 2023-12-18T10:18:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840cf150 0x7f03840c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840cf150 0x7f03840c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:46966/0 (socket says 172.21.15.133:46966) 2023-12-18T10:18:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 -- 172.21.15.133:0/767519443 learned_addr learned my addr 172.21.15.133:0/767519443 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:31.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7fee667fc640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee54065ab0 0x7fee54067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 -- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840d3280 msgr2=0x7f03840c7d00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-18T10:18:31.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03840d3280 0x7f03840c7d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 -- 172.21.15.133:0/767519443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03840b1af0 msgr2=0x7f0384160a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-18T10:18:31.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03840b1af0 0x7f0384160a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 -- 172.21.15.133:0/767519443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780094d0 con 0x7f03840cf150 2023-12-18T10:18:31.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee6011d750 con 0x7fee700cb340 2023-12-18T10:18:31.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7fee667fc640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7fee5406f0f0 0x7fee54071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f0381d9b640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840cf150 0x7f03840c6cf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f037400e780 tx=0x7f037400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a400cdf90 con 0x7f5a40055630 2023-12-18T10:18:31.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7fee75c95640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee54065ab0 0x7fee54067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.778+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a40034120 con 0x7f5a40055630 2023-12-18T10:18:31.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 --> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee54071c00 con 0x7fee5406f0f0 2023-12-18T10:18:31.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee6011dac0 con 0x7fee700cb340 2023-12-18T10:18:31.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fee76496640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7fee5406f0f0 0x7fee54071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a40005350 con 0x7f5a40055630 2023-12-18T10:18:31.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374003b80 con 0x7f03840cf150 2023-12-18T10:18:31.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0374003d00 con 0x7f03840cf150 2023-12-18T10:18:31.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400f970 con 0x7f03840cf150 2023-12-18T10:18:31.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03840c64f0 con 0x7f03840cf150 2023-12-18T10:18:31.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 --> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e3c04cbe0 con 0x7f7e2806f0f0 2023-12-18T10:18:31.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0384160fa0 con 0x7f03840cf150 2023-12-18T10:18:31.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fee75c95640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee54065ab0 0x7fee54067f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee6c005eb0 tx=0x7fee6c007cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fee76496640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7fee5406f0f0 0x7fee54071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 <== osd.4 v2:172.21.15.142:6800/38344 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fee54071c00 con 0x7fee5406f0f0 2023-12-18T10:18:31.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7f7e417fa640 1 -- 172.21.15.133:0/3445810614 <== osd.1 v2:172.21.15.133:6800/38184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7e3c04cbe0 con 0x7f7e2806f0f0 2023-12-18T10:18:31.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd814015440 con 0x7fd8240cb480 2023-12-18T10:18:31.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fd80bfff640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd810065b60 0x7fd810068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd814083cf0 con 0x7fd8240cb480 2023-12-18T10:18:31.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fd80bfff640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7fd81006f1a0 0x7fd8100715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd810071cb0 con 0x7fd81006f1a0 2023-12-18T10:18:31.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.782+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd814086310 con 0x7fd8240cb480 2023-12-18T10:18:31.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7fd822ffd640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd810065b60 0x7fd810068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7fd8237fe640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7fd81006f1a0 0x7fd8100715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7f7e2806f0f0 msgr2=0x7f7e28071530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f7e49b0b640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7f7e2806f0f0 0x7f7e28071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03840d1810 con 0x7f03840cf150 2023-12-18T10:18:31.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7fd8237fe640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7fd81006f1a0 0x7fd8100715e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a340b2040 con 0x7f5a40055630 2023-12-18T10:18:31.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f037400fad0 con 0x7f03840cf150 2023-12-18T10:18:31.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 <== osd.6 v2:172.21.15.142:6824/38346 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd810071cb0 con 0x7fd81006f1a0 2023-12-18T10:18:31.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7fd822ffd640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd810065b60 0x7fd810068020 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd81c000f70 tx=0x7fd81c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f5a33fff640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a2c065ae0 0x7f5a2c067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f0372ffd640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0364065ab0 0x7f0364067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a3411dc40 con 0x7f5a40055630 2023-12-18T10:18:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f5a33fff640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7f5a2c06f120 0x7f5a2c071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 --> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a2c071c30 con 0x7f5a2c06f120 2023-12-18T10:18:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a3411e0e0 con 0x7f5a40055630 2023-12-18T10:18:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f5a46ffd640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a2c065ae0 0x7f5a2c067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0374085b20 con 0x7f03840cf150 2023-12-18T10:18:31.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.786+0000 7f038259c640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0364065ab0 0x7f0364067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f5a47fff640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7f5a2c06f120 0x7f5a2c071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e28065b30 msgr2=0x7f7e28067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e49b0b640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e28065b30 0x7f7e28067ff0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009690 tx=0x7f7e38006b60 comp rx=0 tx=0).stop 2023-12-18T10:18:31.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c0e4690 msgr2=0x7f7e3c050610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e49b0b640 1 --2- 172.21.15.133:0/3445810614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e3c0e4690 0x7f7e3c050610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7e4404f9a0 tx=0x7f7e44073770 comp rx=0 tx=0).stop 2023-12-18T10:18:31.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e4930a640 1 -- 172.21.15.133:0/3445810614 reap_dead start 2023-12-18T10:18:31.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 shutdown_connections 2023-12-18T10:18:31.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f0372ffd640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7f036406f070 0x7f03640714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:31.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f5a46ffd640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a2c065ae0 0x7f5a2c067fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a4802c850 tx=0x7f5a4806d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 >> 172.21.15.133:0/3445810614 conn(0x7f7e3c0538b0 msgr2=0x7f7e3c051790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f038259c640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0364065ab0 0x7f0364067f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f037c00a790 tx=0x7f037c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f5a47fff640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7f5a2c06f120 0x7f5a2c071560 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 shutdown_connections 2023-12-18T10:18:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f7e49b0b640 1 -- 172.21.15.133:0/3445810614 wait complete. 2023-12-18T10:18:31.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f0382d9d640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7f036406f070 0x7f03640714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:31.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 --> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0364071b80 con 0x7f036406f070 2023-12-18T10:18:31.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0374053070 con 0x7f03840cf150 2023-12-18T10:18:31.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f0382d9d640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7f036406f070 0x7f03640714b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:31.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 <== osd.7 v2:172.21.15.142:6816/38355 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5a2c071c30 con 0x7f5a2c06f120 2023-12-18T10:18:31.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.790+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 <== osd.5 v2:172.21.15.142:6808/38345 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0364071b80 con 0x7f036406f070 2023-12-18T10:18:31.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.798+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f114c0e26e0 con 0x7f114006f170 2023-12-18T10:18:31.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.798+0000 7f113b7fe640 1 -- 172.21.15.133:0/1604954703 <== osd.0 v2:172.21.15.133:6808/38183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f114c0e26e0 con 0x7f114006f170 2023-12-18T10:18:31.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.798+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f114006f170 msgr2=0x7f11400715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.798+0000 7f11397fa640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f114006f170 0x7f11400715b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1140065b30 msgr2=0x7f1140067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f11397fa640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1140065b30 0x7f1140067ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f11540618c0 tx=0x7f115406d040 comp rx=0 tx=0).stop 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 msgr2=0x7f114c048560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f11397fa640 1 --2- 172.21.15.133:0/1604954703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f114c0532a0 0x7f114c048560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f114400e870 tx=0x7f114400ec70 comp rx=0 tx=0).stop 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f115359e640 1 -- 172.21.15.133:0/1604954703 reap_dead start 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 shutdown_connections 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 >> 172.21.15.133:0/1604954703 conn(0x7f114c054b10 msgr2=0x7f114c0e66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 shutdown_connections 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.802+0000 7f11397fa640 1 -- 172.21.15.133:0/1604954703 wait complete. 2023-12-18T10:18:31.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.806+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 --> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f9c0cda00 con 0x7f6f7c06f1a0 2023-12-18T10:18:31.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.806+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 --> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7bf80cdf20 con 0x7f7be406f170 2023-12-18T10:18:31.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6f8affd640 1 -- 172.21.15.133:0/1718816976 <== osd.2 v2:172.21.15.133:6816/38205 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f9c0cda00 con 0x7f6f7c06f1a0 2023-12-18T10:18:31.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6f7c06f1a0 msgr2=0x7f6f7c0715e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6f7c06f1a0 0x7f6f7c0715e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f7bdffff640 1 -- 172.21.15.133:0/2717038735 <== osd.3 v2:172.21.15.133:6824/38188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7bf0009da0 con 0x7f7be406f170 2023-12-18T10:18:31.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6f7c065b60 msgr2=0x7f6f7c068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6f7c065b60 0x7f6f7c068020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0cdfb0 tx=0x7f6f8c00c040 comp rx=0 tx=0).stop 2023-12-18T10:18:31.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c070190 msgr2=0x7f6f9c0c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 --2- 172.21.15.133:0/1718816976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f9c070190 0x7f6f9c0c3480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0cf460 tx=0x7f6f9401bb80 comp rx=0 tx=0).stop 2023-12-18T10:18:31.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 --> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee700c62d0 con 0x7fee5406f0f0 2023-12-18T10:18:31.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6f9ad9d640 1 -- 172.21.15.133:0/1718816976 reap_dead start 2023-12-18T10:18:31.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 shutdown_connections 2023-12-18T10:18:31.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 >> 172.21.15.133:0/1718816976 conn(0x7f6f9c0afe90 msgr2=0x7f6f9c0b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7f7be406f170 msgr2=0x7f7be40715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f7bfcaa8640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7f7be406f170 0x7f7be40715b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7fee667fc640 1 -- 172.21.15.133:0/3094207702 <== osd.4 v2:172.21.15.142:6800/38344 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee700c62d0 con 0x7fee5406f0f0 2023-12-18T10:18:31.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 shutdown_connections 2023-12-18T10:18:31.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.810+0000 7f6fa0dce640 1 -- 172.21.15.133:0/1718816976 wait complete. 2023-12-18T10:18:31.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7fee5406f0f0 msgr2=0x7fee54071530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7fee5406f0f0 0x7fee54071530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7be4065b30 msgr2=0x7f7be4067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee54065ab0 msgr2=0x7fee54067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee54065ab0 0x7fee54067f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee6c005eb0 tx=0x7fee6c007cd0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bfcaa8640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7be4065b30 0x7f7be4067ff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0ad000 tx=0x7f7bec0a4f90 comp rx=0 tx=0).stop 2023-12-18T10:18:31.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf80cf670 msgr2=0x7f7bf814d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bfcaa8640 1 --2- 172.21.15.133:0/2717038735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bf80cf670 0x7f7bf814d860 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009e70 tx=0x7f7be800c430 comp rx=0 tx=0).stop 2023-12-18T10:18:31.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee700cb340 msgr2=0x7fee700c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 --2- 172.21.15.133:0/3094207702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee700cb340 0x7fee700c5430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee60009820 tx=0x7fee60018fc0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee76496640 1 -- 172.21.15.133:0/3094207702 reap_dead start 2023-12-18T10:18:31.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 shutdown_connections 2023-12-18T10:18:31.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 >> 172.21.15.133:0/3094207702 conn(0x7fee7006a3e0 msgr2=0x7fee700af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 shutdown_connections 2023-12-18T10:18:31.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fee77ef9640 1 -- 172.21.15.133:0/3094207702 wait complete. 2023-12-18T10:18:31.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bf7fff640 1 -- 172.21.15.133:0/2717038735 reap_dead start 2023-12-18T10:18:31.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 shutdown_connections 2023-12-18T10:18:31.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 >> 172.21.15.133:0/2717038735 conn(0x7f7bf806b120 msgr2=0x7f7bf80b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 shutdown_connections 2023-12-18T10:18:31.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7f7bfcaa8640 1 -- 172.21.15.133:0/2717038735 wait complete. 2023-12-18T10:18:31.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd82404e000 con 0x7fd81006f1a0 2023-12-18T10:18:31.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.814+0000 7fd80bfff640 1 -- 172.21.15.133:0/448632081 <== osd.6 v2:172.21.15.142:6824/38346 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd82404e000 con 0x7fd81006f1a0 2023-12-18T10:18:31.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7fd81006f1a0 msgr2=0x7fd8100715e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7fd81006f1a0 0x7fd8100715e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 --> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a400348b0 con 0x7f5a2c06f120 2023-12-18T10:18:31.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd810065b60 msgr2=0x7fd810068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd810065b60 0x7fd810068020 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd81c000f70 tx=0x7fd81c009040 comp rx=0 tx=0).stop 2023-12-18T10:18:31.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8240cb480 msgr2=0x7fd824148ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 --2- 172.21.15.133:0/448632081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8240cb480 0x7fd824148ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd81400cea0 tx=0x7fd81400cf90 comp rx=0 tx=0).stop 2023-12-18T10:18:31.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd8237fe640 1 -- 172.21.15.133:0/448632081 reap_dead start 2023-12-18T10:18:31.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 shutdown_connections 2023-12-18T10:18:31.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 >> 172.21.15.133:0/448632081 conn(0x7fd82406a3e0 msgr2=0x7fd824158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a33fff640 1 -- 172.21.15.133:0/4068745232 <== osd.7 v2:172.21.15.142:6816/38355 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a3c00c040 con 0x7f5a2c06f120 2023-12-18T10:18:31.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 --> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03840cd5b0 con 0x7f036406f070 2023-12-18T10:18:31.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 shutdown_connections 2023-12-18T10:18:31.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7fd829866640 1 -- 172.21.15.133:0/448632081 wait complete. 2023-12-18T10:18:31.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7f5a2c06f120 msgr2=0x7f5a2c071560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7f5a2c06f120 0x7f5a2c071560 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a2c065ae0 msgr2=0x7f5a2c067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5a2c065ae0 0x7f5a2c067fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a4802c850 tx=0x7f5a4806d040 comp rx=0 tx=0).stop 2023-12-18T10:18:31.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a40055630 msgr2=0x7f5a4004bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 --2- 172.21.15.133:0/4068745232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a40055630 0x7f5a4004bbe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5a34019090 tx=0x7f5a34019220 comp rx=0 tx=0).stop 2023-12-18T10:18:31.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a47fff640 1 -- 172.21.15.133:0/4068745232 reap_dead start 2023-12-18T10:18:31.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 shutdown_connections 2023-12-18T10:18:31.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.818+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 >> 172.21.15.133:0/4068745232 conn(0x7f5a40054b10 msgr2=0x7f5a400dfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.834 INFO:teuthology.orchestra.run.smithi133.stdout:55834574859 2023-12-18T10:18:31.834 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-18T10:18:31.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 shutdown_connections 2023-12-18T10:18:31.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f5a4ca2a640 1 -- 172.21.15.133:0/4068745232 wait complete. 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f0372ffd640 1 -- 172.21.15.133:0/767519443 <== osd.5 v2:172.21.15.142:6808/38345 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0378004040 con 0x7f036406f070 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7f036406f070 msgr2=0x7f03640714b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f0388e04640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7f036406f070 0x7f03640714b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0364065ab0 msgr2=0x7f0364067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f0388e04640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0364065ab0 0x7f0364067f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f037c00a790 tx=0x7f037c008040 comp rx=0 tx=0).stop 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840cf150 msgr2=0x7f03840c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.822+0000 7f0388e04640 1 --2- 172.21.15.133:0/767519443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03840cf150 0x7f03840c6cf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f037400e780 tx=0x7f037400ec40 comp rx=0 tx=0).stop 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.826+0000 7f0382d9d640 1 -- 172.21.15.133:0/767519443 reap_dead start 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.826+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 shutdown_connections 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.826+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 >> 172.21.15.133:0/767519443 conn(0x7f0384089fb0 msgr2=0x7f03840b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.830+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 shutdown_connections 2023-12-18T10:18:31.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:31.830+0000 7f0388e04640 1 -- 172.21.15.133:0/767519443 wait complete. 2023-12-18T10:18:31.847 INFO:teuthology.orchestra.run.smithi133.stdout:55834574859 2023-12-18T10:18:31.847 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-18T10:18:31.855 INFO:teuthology.orchestra.run.smithi133.stdout:55834574859 2023-12-18T10:18:31.856 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-18T10:18:31.857 INFO:teuthology.orchestra.run.smithi133.stdout:55834574859 2023-12-18T10:18:31.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-18T10:18:31.862 INFO:teuthology.orchestra.run.smithi133.stdout:55834574858 2023-12-18T10:18:31.862 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-18T10:18:31.866 INFO:teuthology.orchestra.run.smithi133.stdout:55834574857 2023-12-18T10:18:31.866 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-18T10:18:31.878 INFO:teuthology.orchestra.run.smithi133.stdout:55834574859 2023-12-18T10:18:31.878 INFO:teuthology.orchestra.run.smithi133.stdout:55834574858 2023-12-18T10:18:31.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-18T10:18:31.879 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-18T10:18:32.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.082+0000 7fdcef9e9640 1 Processor -- start 2023-12-18T10:18:32.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.082+0000 7fdcef9e9640 1 -- start start 2023-12-18T10:18:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdcef9e9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdce815cb30 0x7fdce806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdcef9e9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdce80cefe0 0x7fdce80cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdcef9e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce806c140 con 0x7fdce815d2d0 2023-12-18T10:18:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdcef9e9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce815cf10 con 0x7fdce80cefe0 2023-12-18T10:18:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdcef9e9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce815e000 con 0x7fdce815cb30 2023-12-18T10:18:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdcedf86640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fdce815d2d0 0x7fdce815d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:42984/0 (socket says 172.21.15.133:42984) 2023-12-18T10:18:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdced785640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdce815cb30 0x7fdce806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdcedf86640 1 -- 172.21.15.133:0/3652008029 learned_addr learned my addr 172.21.15.133:0/3652008029 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdcecf84640 1 --2- 172.21.15.133:0/3652008029 >> v2:172.21.15.133:3300/0 conn(0x7fdce80cefe0 0x7fdce80cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdced785640 1 -- 172.21.15.133:0/3652008029 >> v2:172.21.15.133:3300/0 conn(0x7fdce80cefe0 msgr2=0x7fdce80cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdced785640 1 --2- 172.21.15.133:0/3652008029 >> v2:172.21.15.133:3300/0 conn(0x7fdce80cefe0 0x7fdce80cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdced785640 1 -- 172.21.15.133:0/3652008029 >> v1:172.21.15.142:6789/0 conn(0x7fdce815d2d0 legacy=0x7fdce815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.086+0000 7fdced785640 1 -- 172.21.15.133:0/3652008029 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce80cf960 con 0x7fdce815cb30 2023-12-18T10:18:32.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.094+0000 7fdced785640 1 --2- 172.21.15.133:0/3652008029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce815cb30 0x7fdce806bc00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdce80d3630 tx=0x7fdce401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=209158754a481586 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.094+0000 7f136be66640 1 Processor -- start 2023-12-18T10:18:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.094+0000 7f136be66640 1 -- start start 2023-12-18T10:18:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.094+0000 7fdcdffff640 1 -- 172.21.15.133:0/3652008029 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ab600 con 0x7fdce815cb30 2023-12-18T10:18:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.094+0000 7fdcdffff640 1 -- 172.21.15.133:0/3652008029 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce40a7050 con 0x7fdce815cb30 2023-12-18T10:18:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.094+0000 7fdcdffff640 1 -- 172.21.15.133:0/3652008029 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40ab980 con 0x7fdce815cb30 2023-12-18T10:18:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.094+0000 7f4e236e5640 1 Processor -- start 2023-12-18T10:18:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f4e236e5640 1 -- start start 2023-12-18T10:18:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f136be66640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f136406bde0 0x7f13640c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fdcef9e9640 1 -- 172.21.15.133:0/3652008029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce815cb30 msgr2=0x7fdce806bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/3652008029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce815cb30 0x7fdce806bc00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdce80d3630 tx=0x7fdce401c460 comp rx=0 tx=0).stop 2023-12-18T10:18:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f136be66640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136406c270 con 0x7f1364158900 2023-12-18T10:18:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f136be66640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136406c550 con 0x7f1364070190 2023-12-18T10:18:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f136be66640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136406cdf0 con 0x7f136406bde0 2023-12-18T10:18:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f58dfae5640 1 Processor -- start 2023-12-18T10:18:32.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fb318efc640 1 Processor -- start 2023-12-18T10:18:32.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f58dfae5640 1 -- start start 2023-12-18T10:18:32.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fb318efc640 1 -- start start 2023-12-18T10:18:32.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1369c02640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1364158900 0x7f13640cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48146/0 (socket says 172.21.15.133:48146) 2023-12-18T10:18:32.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1369c02640 1 -- 172.21.15.133:0/4228689700 learned_addr learned my addr 172.21.15.133:0/4228689700 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:32.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fdcef9e9640 1 -- 172.21.15.133:0/3652008029 shutdown_connections 2023-12-18T10:18:32.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/3652008029 >> v2:172.21.15.133:3300/0 conn(0x7fdce80cefe0 0x7fdce80cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/3652008029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce815cb30 0x7fdce806bc00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fdcef9e9640 1 -- 172.21.15.133:0/3652008029 >> 172.21.15.133:0/3652008029 conn(0x7fdce8089fb0 msgr2=0x7fdce809b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1369401640 1 --2- 172.21.15.133:0/4228689700 >> v2:172.21.15.142:3300/0 conn(0x7f136406bde0 0x7f13640c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fdcef9e9640 1 -- 172.21.15.133:0/3652008029 shutdown_connections 2023-12-18T10:18:32.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fdcef9e9640 1 -- 172.21.15.133:0/3652008029 wait complete. 2023-12-18T10:18:32.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509355819 0 0) 0x7f136406c270 con 0x7f1364158900 2023-12-18T10:18:32.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1350003530 con 0x7f1364158900 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1412836533 0 0) 0x7f1350003530 con 0x7f1364158900 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 >> v2:172.21.15.142:3300/0 conn(0x7f136406bde0 msgr2=0x7f13640c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 --2- 172.21.15.133:0/4228689700 >> v2:172.21.15.142:3300/0 conn(0x7f136406bde0 0x7f13640c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 >> v1:172.21.15.142:6789/0 conn(0x7f1364070190 legacy=0x7f13640cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136406c830 con 0x7f1364158900 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f135c001a00 con 0x7f1364158900 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 >> v1:172.21.15.133:6789/0 conn(0x7f1364158900 legacy=0x7f13640cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f58dfae5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58d8160cc0 0x7f58d80cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f58dfae5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58d80c17d0 0x7f58d80cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f58dfae5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d806fdb0 con 0x7f58d80c1280 2023-12-18T10:18:32.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f58dfae5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d81654a0 con 0x7f58d8160cc0 2023-12-18T10:18:32.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f58dfae5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d81610a0 con 0x7f58d80c17d0 2023-12-18T10:18:32.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1350003980 0x7f1350003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13500047d0 0x7f1350004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500052b0 0x7f135000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136406cdf0 con 0x7f13500047d0 2023-12-18T10:18:32.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135000c160 con 0x7f13500052b0 2023-12-18T10:18:32.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135000c320 con 0x7f1350003980 2023-12-18T10:18:32.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fb318efc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb3140c1280 0x7fb3140cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fb318efc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31406fdb0 con 0x7fb314160cc0 2023-12-18T10:18:32.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fb318efc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb314164820 con 0x7fb3140cb340 2023-12-18T10:18:32.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.098+0000 7fb318efc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3141654a0 con 0x7fb3140c1280 2023-12-18T10:18:32.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7fb31259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb314160cc0 0x7fb3140cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48154/0 (socket says 172.21.15.133:48154) 2023-12-18T10:18:32.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7fb31259c640 1 -- 172.21.15.133:0/3166682845 learned_addr learned my addr 172.21.15.133:0/3166682845 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:32.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f58de082640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f58d80c17d0 0x7f58d80cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f1369401640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13500047d0 0x7f1350004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f136a403640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500052b0 0x7f135000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f1369c02640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1350003980 0x7f1350003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7fb311d9b640 1 --2- 172.21.15.133:0/3166682845 >> v2:172.21.15.142:3300/0 conn(0x7fb3140c1280 0x7fb3140cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f58dd080640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f58d80c1280 0x7f58d806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:43010/0 (socket says 172.21.15.133:43010) 2023-12-18T10:18:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f58dd080640 1 -- 172.21.15.133:0/3933738871 learned_addr learned my addr 172.21.15.133:0/3933738871 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f58dd881640 1 --2- 172.21.15.133:0/3933738871 >> v2:172.21.15.133:3300/0 conn(0x7f58d8160cc0 0x7f58d80cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f58de082640 1 -- 172.21.15.133:0/3933738871 >> v2:172.21.15.133:3300/0 conn(0x7f58d8160cc0 msgr2=0x7f58d80cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f58de082640 1 --2- 172.21.15.133:0/3933738871 >> v2:172.21.15.133:3300/0 conn(0x7f58d8160cc0 0x7f58d80cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f58de082640 1 -- 172.21.15.133:0/3933738871 >> v1:172.21.15.142:6789/0 conn(0x7f58d80c1280 legacy=0x7f58d806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f58de082640 1 -- 172.21.15.133:0/3933738871 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80cb6b0 con 0x7f58d80c17d0 2023-12-18T10:18:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7fb311d9b640 1 -- 172.21.15.133:0/3166682845 >> v1:172.21.15.142:6789/0 conn(0x7fb3140cb340 legacy=0x7fb3140cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7fb311d9b640 1 -- 172.21.15.133:0/3166682845 >> v1:172.21.15.133:6789/0 conn(0x7fb314160cc0 legacy=0x7fb3140cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7fb311d9b640 1 -- 172.21.15.133:0/3166682845 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314164b00 con 0x7fb3140c1280 2023-12-18T10:18:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7fb31159a640 1 -- 172.21.15.133:0/3166682845 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994045305 0 0) 0x7fb314164820 con 0x7fb3140cb340 2023-12-18T10:18:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f4e236e5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4e1c0b09b0 0x7f4e1c0cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f4e21481640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4e1c158900 0x7f4e1c0cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:43024/0 (socket says 172.21.15.133:43024) 2023-12-18T10:18:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f136a403640 1 -- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1350003980 msgr2=0x7f1350003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f136a403640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1350003980 0x7f1350003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f136a403640 1 -- 172.21.15.133:0/4228689700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13500047d0 msgr2=0x7f1350004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f136a403640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13500047d0 0x7f1350004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f136a403640 1 -- 172.21.15.133:0/4228689700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136406c830 con 0x7f13500052b0 2023-12-18T10:18:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f1369401640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13500047d0 0x7f1350004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f4e236e5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c06c270 con 0x7f4e1c06bde0 2023-12-18T10:18:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f4e236e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c06c550 con 0x7f4e1c158900 2023-12-18T10:18:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f4e236e5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c06cdf0 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.102+0000 7f4e21481640 1 -- 172.21.15.133:0/2053217197 learned_addr learned my addr 172.21.15.133:0/2053217197 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcef9e9640 1 Processor -- start 2023-12-18T10:18:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcef9e9640 1 -- start start 2023-12-18T10:18:32.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f4e21c82640 1 --2- 172.21.15.133:0/2053217197 >> v2:172.21.15.133:3300/0 conn(0x7f4e1c0b09b0 0x7f4e1c0cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f4e1bfff640 1 -- 172.21.15.133:0/2053217197 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172922389 0 0) 0x7f4e1c06c550 con 0x7f4e1c158900 2023-12-18T10:18:32.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f4e21c82640 1 -- 172.21.15.133:0/2053217197 >> v1:172.21.15.142:6789/0 conn(0x7f4e1c158900 legacy=0x7f4e1c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcef9e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80cefe0 0x7fdce80b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f4e21c82640 1 -- 172.21.15.133:0/2053217197 >> v1:172.21.15.133:6789/0 conn(0x7f4e1c06bde0 legacy=0x7f4e1c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f4e21c82640 1 -- 172.21.15.133:0/2053217197 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c06c830 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcef9e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815cb30 0x7fdce8156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcef9e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce815d2d0 0x7fdce80cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcef9e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b4fd0 con 0x7fdce815cb30 2023-12-18T10:18:32.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fb311d9b640 1 --2- 172.21.15.133:0/3166682845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 0x7fb3140cc400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0097c0 tx=0x7fb2fc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56138347ddd329b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f58de082640 1 --2- 172.21.15.133:0/3933738871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 0x7f58d80cb170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58d80c1e40 tx=0x7f58d001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63b90abc83fd3e86 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdced785640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80cefe0 0x7fdce80b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcecf84640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815cb30 0x7fdce8156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdced785640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80cefe0 0x7fdce80b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47014/0 (socket says 172.21.15.133:47014) 2023-12-18T10:18:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdced785640 1 -- 172.21.15.133:0/214178654 learned_addr learned my addr 172.21.15.133:0/214178654 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80ca410 con 0x7fdce80cefe0 2023-12-18T10:18:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80c9800 con 0x7fdce815d2d0 2023-12-18T10:18:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcedf86640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce815d2d0 0x7fdce80cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f58dc87f640 1 -- 172.21.15.133:0/3933738871 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00a5830 con 0x7f58d80c17d0 2023-12-18T10:18:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f58dc87f640 1 -- 172.21.15.133:0/3933738871 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d00a5990 con 0x7f58d80c17d0 2023-12-18T10:18:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f58dc87f640 1 -- 172.21.15.133:0/3933738871 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00a5d20 con 0x7f58d80c17d0 2023-12-18T10:18:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcedf86640 1 -- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80cefe0 msgr2=0x7fdce80b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcedf86640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80cefe0 0x7fdce80b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcedf86640 1 -- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815cb30 msgr2=0x7fdce8156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7f136a403640 1 -- 172.21.15.133:0/4228689700 reap_dead start 2023-12-18T10:18:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcedf86640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815cb30 0x7fdce8156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcedf86640 1 -- 172.21.15.133:0/214178654 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40093b0 con 0x7fdce815d2d0 2023-12-18T10:18:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdced785640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80cefe0 0x7fdce80b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.106+0000 7fdcecf84640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815cb30 0x7fdce8156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f58dfae5640 1 -- 172.21.15.133:0/3933738871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 msgr2=0x7f58d80cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3933738871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 0x7f58d80cb170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58d80c1e40 tx=0x7f58d001c870 comp rx=0 tx=0).stop 2023-12-18T10:18:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fdcedf86640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce815d2d0 0x7fdce80cb810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdce000caa0 tx=0x7fdce000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb31159a640 1 -- 172.21.15.133:0/3166682845 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0ab600 con 0x7fb3140c1280 2023-12-18T10:18:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb31159a640 1 -- 172.21.15.133:0/3166682845 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0a7050 con 0x7fb3140c1280 2023-12-18T10:18:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb31159a640 1 -- 172.21.15.133:0/3166682845 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0ab9c0 con 0x7fb3140c1280 2023-12-18T10:18:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fdcddffb640 1 -- 172.21.15.133:0/214178654 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000aac0 con 0x7fdce815d2d0 2023-12-18T10:18:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fdcddffb640 1 -- 172.21.15.133:0/214178654 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce000ac20 con 0x7fdce815d2d0 2023-12-18T10:18:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fdcddffb640 1 -- 172.21.15.133:0/214178654 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0012400 con 0x7fdce815d2d0 2023-12-18T10:18:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce80c9ae0 con 0x7fdce815d2d0 2023-12-18T10:18:32.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f136a403640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500052b0 0x7f135000b990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1360003dd0 tx=0x7f136001c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e27bad3c416981cb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce80ca0a0 con 0x7fdce815d2d0 2023-12-18T10:18:32.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f58dfae5640 1 -- 172.21.15.133:0/3933738871 shutdown_connections 2023-12-18T10:18:32.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3933738871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 0x7f58d80cb170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3933738871 >> v2:172.21.15.133:3300/0 conn(0x7f58d8160cc0 0x7f58d80cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f58dfae5640 1 -- 172.21.15.133:0/3933738871 >> 172.21.15.133:0/3933738871 conn(0x7f58d806a3e0 msgr2=0x7f58d80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600ab640 con 0x7f13500052b0 2023-12-18T10:18:32.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f58dfae5640 1 -- 172.21.15.133:0/3933738871 shutdown_connections 2023-12-18T10:18:32.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f58dfae5640 1 -- 172.21.15.133:0/3933738871 wait complete. 2023-12-18T10:18:32.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce8152190 con 0x7fdce815d2d0 2023-12-18T10:18:32.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13600a7050 con 0x7f13500052b0 2023-12-18T10:18:32.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f1368c00640 1 -- 172.21.15.133:0/4228689700 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600ab9e0 con 0x7f13500052b0 2023-12-18T10:18:32.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb318efc640 1 -- 172.21.15.133:0/3166682845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 msgr2=0x7fb3140cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb318efc640 1 --2- 172.21.15.133:0/3166682845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 0x7fb3140cc400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0097c0 tx=0x7fb2fc01c410 comp rx=0 tx=0).stop 2023-12-18T10:18:32.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f136be66640 1 -- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500052b0 msgr2=0x7f135000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f136be66640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500052b0 0x7f135000b990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1360003dd0 tx=0x7f136001c2e0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f136be66640 1 -- 172.21.15.133:0/4228689700 shutdown_connections 2023-12-18T10:18:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f136be66640 1 --2- 172.21.15.133:0/4228689700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13500052b0 0x7f135000b990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f136be66640 1 -- 172.21.15.133:0/4228689700 >> 172.21.15.133:0/4228689700 conn(0x7f13640afe90 msgr2=0x7f13640b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb318efc640 1 -- 172.21.15.133:0/3166682845 shutdown_connections 2023-12-18T10:18:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb318efc640 1 --2- 172.21.15.133:0/3166682845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 0x7fb3140cc400 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb318efc640 1 -- 172.21.15.133:0/3166682845 >> 172.21.15.133:0/3166682845 conn(0x7fb31406a3e0 msgr2=0x7fb3140afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb318efc640 1 -- 172.21.15.133:0/3166682845 shutdown_connections 2023-12-18T10:18:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7fb318efc640 1 -- 172.21.15.133:0/3166682845 wait complete. 2023-12-18T10:18:32.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fdcddffb640 1 -- 172.21.15.133:0/214178654 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdce0007070 con 0x7fdce815d2d0 2023-12-18T10:18:32.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dfae5640 1 Processor -- start 2023-12-18T10:18:32.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fdcddffb640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065b30 0x7fdccc067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f136be66640 1 -- 172.21.15.133:0/4228689700 shutdown_connections 2023-12-18T10:18:32.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.110+0000 7f136be66640 1 -- 172.21.15.133:0/4228689700 wait complete. 2023-12-18T10:18:32.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f136be66640 1 Processor -- start 2023-12-18T10:18:32.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f136be66640 1 -- start start 2023-12-18T10:18:32.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dfae5640 1 -- start start 2023-12-18T10:18:32.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fdcddffb640 1 -- 172.21.15.133:0/214178654 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdce0083200 con 0x7fdce815d2d0 2023-12-18T10:18:32.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dfae5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58d80c1280 0x7f58d8156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dfae5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 0x7f58d81611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dfae5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d8160cc0 0x7f58d80c2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dfae5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80c2bf0 con 0x7f58d80c1280 2023-12-18T10:18:32.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dfae5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d815e780 con 0x7f58d80c17d0 2023-12-18T10:18:32.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dfae5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d815ea60 con 0x7f58d8160cc0 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb318efc640 1 Processor -- start 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb318efc640 1 -- start start 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb318efc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 0x7fb31415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb318efc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3140cb340 0x7fb3140c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb318efc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb314160cc0 0x7fb31415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb318efc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140c3d10 con 0x7fb3140cb340 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb318efc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140c3f70 con 0x7fb3140c1280 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb318efc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140c4250 con 0x7fb314160cc0 2023-12-18T10:18:32.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb311d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3140cb340 0x7fb3140c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dd881640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58d80c1280 0x7f58d8156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb311d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3140cb340 0x7fb3140c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48528/0 (socket says 172.21.15.133:48528) 2023-12-18T10:18:32.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb311d9b640 1 -- 172.21.15.133:0/159023154 learned_addr learned my addr 172.21.15.133:0/159023154 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f4e21c82640 1 --2- 172.21.15.133:0/2053217197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c0cc9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e100097c0 tx=0x7f4e1001c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b38a7693c1f2b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fdced785640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065b30 0x7fdccc067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dd080640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 0x7f58d81611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dd881640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58d80c1280 0x7f58d8156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48512/0 (socket says 172.21.15.133:48512) 2023-12-18T10:18:32.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58dd881640 1 -- 172.21.15.133:0/3739676788 learned_addr learned my addr 172.21.15.133:0/3739676788 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7f58de082640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d8160cc0 0x7f58d80c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.114+0000 7fb31259c640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 0x7fb31415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb311d9b640 1 -- 172.21.15.133:0/159023154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb314160cc0 msgr2=0x7fb31415d1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-18T10:18:32.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb311d9b640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb314160cc0 0x7fb31415d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb311d9b640 1 -- 172.21.15.133:0/159023154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 msgr2=0x7fb31415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb311d9b640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 0x7fb31415c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb311d9b640 1 -- 172.21.15.133:0/159023154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009420 con 0x7fb3140cb340 2023-12-18T10:18:32.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb311d9b640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3140cb340 0x7fb3140c37d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc01aac0 tx=0x7fb2fc0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dd080640 1 -- 172.21.15.133:0/3739676788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d8160cc0 msgr2=0x7f58d80c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dd080640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d8160cc0 0x7f58d80c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dd080640 1 -- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58d80c1280 msgr2=0x7f58d8156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f4e1bfff640 1 -- 172.21.15.133:0/2053217197 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e100ab600 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dd080640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58d80c1280 0x7f58d8156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dd080640 1 -- 172.21.15.133:0/3739676788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0009a70 con 0x7f58d80c17d0 2023-12-18T10:18:32.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dd881640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58d80c1280 0x7f58d8156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:32.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f136be66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13500052b0 0x7f136414d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f136be66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1364154020 0x7f13640b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f136be66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13640b2740 0x7f1364156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f4e1bfff640 1 -- 172.21.15.133:0/2053217197 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e100a7050 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dd080640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 0x7f58d81611e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c340 tx=0x7f58d400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f1369c02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13500052b0 0x7f136414d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f1369c02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13500052b0 0x7f136414d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44272/0 (socket says 172.21.15.133:44272) 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f1369c02640 1 -- 172.21.15.133:0/753307369 learned_addr learned my addr 172.21.15.133:0/753307369 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f136a403640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13640b2740 0x7f1364156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13641504d0 con 0x7f1364154020 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1364156190 con 0x7f13640b2740 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1364156470 con 0x7f13500052b0 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58ce7fc640 1 -- 172.21.15.133:0/3739676788 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4005cf0 con 0x7f58d80c17d0 2023-12-18T10:18:32.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fdced785640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065b30 0x7fdccc067ff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdce401c4a0 tx=0x7fdce40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58ce7fc640 1 -- 172.21.15.133:0/3739676788 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4005e50 con 0x7f58d80c17d0 2023-12-18T10:18:32.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58ce7fc640 1 -- 172.21.15.133:0/3739676788 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d40072d0 con 0x7f58d80c17d0 2023-12-18T10:18:32.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d815ed40 con 0x7f58d80c17d0 2023-12-18T10:18:32.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d815f300 con 0x7f58d80c17d0 2023-12-18T10:18:32.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f4e236e5640 1 -- 172.21.15.133:0/2053217197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 msgr2=0x7f4e1c0cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f4e236e5640 1 --2- 172.21.15.133:0/2053217197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c0cc9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4e100097c0 tx=0x7f4e1001c280 comp rx=0 tx=0).stop 2023-12-18T10:18:32.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f95c4895640 1 Processor -- start 2023-12-18T10:18:32.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb30affd640 1 -- 172.21.15.133:0/159023154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0b4600 con 0x7fb3140cb340 2023-12-18T10:18:32.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb30affd640 1 -- 172.21.15.133:0/159023154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0b4760 con 0x7fb3140cb340 2023-12-18T10:18:32.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb30affd640 1 -- 172.21.15.133:0/159023154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0b4af0 con 0x7fb3140cb340 2023-12-18T10:18:32.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb318efc640 1 -- 172.21.15.133:0/159023154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31415c6d0 con 0x7fb3140cb340 2023-12-18T10:18:32.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7fb318efc640 1 -- 172.21.15.133:0/159023154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31415cc90 con 0x7fb3140cb340 2023-12-18T10:18:32.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f1369401640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1364154020 0x7f13640b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.118+0000 7f95c4895640 1 -- start start 2023-12-18T10:18:32.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7fdcddffb640 1 -- 172.21.15.133:0/214178654 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdce8152190 con 0x7fdce815d2d0 2023-12-18T10:18:32.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f4e236e5640 1 -- 172.21.15.133:0/2053217197 shutdown_connections 2023-12-18T10:18:32.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f4e236e5640 1 --2- 172.21.15.133:0/2053217197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c0cc9b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f4e236e5640 1 -- 172.21.15.133:0/2053217197 >> 172.21.15.133:0/2053217197 conn(0x7f4e1c0afe90 msgr2=0x7f4e1c0b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f1369c02640 1 -- 172.21.15.133:0/753307369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13640b2740 msgr2=0x7f1364156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f1369c02640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13640b2740 0x7f1364156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f1369c02640 1 -- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1364154020 msgr2=0x7f13640b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f1369c02640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1364154020 0x7f13640b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f1369c02640 1 -- 172.21.15.133:0/753307369 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364156750 con 0x7f13500052b0 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f1369401640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1364154020 0x7f13640b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f1369c02640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13500052b0 0x7f136414d400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f135c017e40 tx=0x7f135c00ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f135a7fc640 1 -- 172.21.15.133:0/753307369 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c001900 con 0x7f13500052b0 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f135a7fc640 1 -- 172.21.15.133:0/753307369 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c004db0 con 0x7f13500052b0 2023-12-18T10:18:32.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f135a7fc640 1 -- 172.21.15.133:0/753307369 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0077e0 con 0x7f13500052b0 2023-12-18T10:18:32.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d80735b0 con 0x7f58d80c17d0 2023-12-18T10:18:32.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95c4895640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95c0160cc0 0x7f95c00cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95c4895640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95c00c1280 0x7f95c00cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95c4895640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c006fdb0 con 0x7f95c00c17d0 2023-12-18T10:18:32.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95c4895640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c01654a0 con 0x7f95c0160cc0 2023-12-18T10:18:32.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95c4895640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c01610a0 con 0x7f95c00c1280 2023-12-18T10:18:32.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13640c6fc0 con 0x7f13500052b0 2023-12-18T10:18:32.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136414d940 con 0x7f13500052b0 2023-12-18T10:18:32.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95be59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95c0160cc0 0x7f95c00cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95bdd9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95c00c1280 0x7f95c00cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95be59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95c0160cc0 0x7f95c00cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48534/0 (socket says 172.21.15.133:48534) 2023-12-18T10:18:32.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f95be59c640 1 -- 172.21.15.133:0/1188000334 learned_addr learned my addr 172.21.15.133:0/1188000334 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.122+0000 7f58ce7fc640 1 -- 172.21.15.133:0/3739676788 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f58d4007430 con 0x7f58d80c17d0 2023-12-18T10:18:32.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f95be59c640 1 -- 172.21.15.133:0/1188000334 >> v2:172.21.15.142:3300/0 conn(0x7f95c00c1280 msgr2=0x7f95c00cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f95be59c640 1 --2- 172.21.15.133:0/1188000334 >> v2:172.21.15.142:3300/0 conn(0x7f95c00c1280 0x7f95c00cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f95be59c640 1 -- 172.21.15.133:0/1188000334 >> v1:172.21.15.142:6789/0 conn(0x7f95c00c17d0 legacy=0x7f95c006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f95bd59a640 1 -- 172.21.15.133:0/1188000334 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020934941 0 0) 0x7f95c006fdb0 con 0x7f95c00c17d0 2023-12-18T10:18:32.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f58ce7fc640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58bc065ab0 0x7f58bc067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f58ce7fc640 1 -- 172.21.15.133:0/3739676788 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58d4082730 con 0x7f58d80c17d0 2023-12-18T10:18:32.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f58dd881640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58bc065ab0 0x7f58bc067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f58dd881640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58bc065ab0 0x7f58bc067f70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f58d81fc540 tx=0x7f58c8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f4e236e5640 1 -- 172.21.15.133:0/2053217197 shutdown_connections 2023-12-18T10:18:32.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c005260 con 0x7f13500052b0 2023-12-18T10:18:32.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f135a7fc640 1 -- 172.21.15.133:0/753307369 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f135c007940 con 0x7f13500052b0 2023-12-18T10:18:32.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f95be59c640 1 -- 172.21.15.133:0/1188000334 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00cb6b0 con 0x7f95c0160cc0 2023-12-18T10:18:32.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7fb30affd640 1 -- 172.21.15.133:0/159023154 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb2fc0b2040 con 0x7fb3140cb340 2023-12-18T10:18:32.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7fb318efc640 1 -- 172.21.15.133:0/159023154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3140735b0 con 0x7fb3140cb340 2023-12-18T10:18:32.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7fb30affd640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb2f4065ab0 0x7fb2f4067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7fb30affd640 1 -- 172.21.15.133:0/159023154 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb2fc11cfb0 con 0x7fb3140cb340 2023-12-18T10:18:32.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f4e236e5640 1 -- 172.21.15.133:0/2053217197 wait complete. 2023-12-18T10:18:32.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f95bdd9b640 1 --2- 172.21.15.133:0/1188000334 >> v2:172.21.15.142:3300/0 conn(0x7f95c00c1280 0x7f95c00cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:32.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f4e236e5640 1 Processor -- start 2023-12-18T10:18:32.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7fb31259c640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb2f4065ab0 0x7fb2f4067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f135a7fc640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1348065b30 0x7f1348067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.126+0000 7f135a7fc640 1 -- 172.21.15.133:0/753307369 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f135c08bca0 con 0x7f13500052b0 2023-12-18T10:18:32.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7fb31259c640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb2f4065ab0 0x7fb2f4067f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb304005c10 tx=0x7fb304009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f1369401640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1348065b30 0x7f1348067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e236e5640 1 -- start start 2023-12-18T10:18:32.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f95be59c640 1 --2- 172.21.15.133:0/1188000334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c0160cc0 0x7f95c00cac30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f95c00c8ad0 tx=0x7f95b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe450288d042ad8e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f1369401640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1348065b30 0x7f1348067ff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1354006fb0 tx=0x7f1354008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e236e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c202d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e236e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1c158900 0x7f4e1c0c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e236e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e1c205830 0x7f4e1c205cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e236e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c157400 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e236e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c2063a0 con 0x7f4e1c158900 2023-12-18T10:18:32.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e236e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c206680 con 0x7f4e1c205830 2023-12-18T10:18:32.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f58ce7fc640 1 -- 172.21.15.133:0/3739676788 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f58d4050020 con 0x7f58d80c17d0 2023-12-18T10:18:32.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21481640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c202d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e20c80640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1c158900 0x7f4e1c0c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21481640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c202d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48536/0 (socket says 172.21.15.133:48536) 2023-12-18T10:18:32.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21481640 1 -- 172.21.15.133:0/877788338 learned_addr learned my addr 172.21.15.133:0/877788338 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21c82640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e1c205830 0x7f4e1c205cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f135a7fc640 1 -- 172.21.15.133:0/753307369 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f135c059490 con 0x7f13500052b0 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21481640 1 -- 172.21.15.133:0/877788338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e1c205830 msgr2=0x7f4e1c205cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21481640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e1c205830 0x7f4e1c205cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21481640 1 -- 172.21.15.133:0/877788338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1c158900 msgr2=0x7f4e1c0c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21481640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1c158900 0x7f4e1c0c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.130+0000 7f4e21481640 1 -- 172.21.15.133:0/877788338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10009420 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f4e21481640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c202d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400c410 tx=0x7f4e1400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95bd59a640 1 -- 172.21.15.133:0/1188000334 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40ad680 con 0x7f95c0160cc0 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95bd59a640 1 -- 172.21.15.133:0/1188000334 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b40ad7e0 con 0x7f95c0160cc0 2023-12-18T10:18:32.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95bd59a640 1 -- 172.21.15.133:0/1188000334 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40adb70 con 0x7f95c0160cc0 2023-12-18T10:18:32.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7fb30affd640 1 -- 172.21.15.133:0/159023154 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb2fc0ea760 con 0x7fb3140cb340 2023-12-18T10:18:32.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f4e19ffb640 1 -- 172.21.15.133:0/877788338 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140074e0 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95c4895640 1 -- 172.21.15.133:0/1188000334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c0160cc0 msgr2=0x7f95c00cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95c4895640 1 --2- 172.21.15.133:0/1188000334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c0160cc0 0x7f95c00cac30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f95c00c8ad0 tx=0x7f95b401c460 comp rx=0 tx=0).stop 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95c4895640 1 -- 172.21.15.133:0/1188000334 shutdown_connections 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95c4895640 1 --2- 172.21.15.133:0/1188000334 >> v2:172.21.15.142:3300/0 conn(0x7f95c00c1280 0x7f95c00cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95c4895640 1 --2- 172.21.15.133:0/1188000334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c0160cc0 0x7f95c00cac30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.134+0000 7f95c4895640 1 -- 172.21.15.133:0/1188000334 >> 172.21.15.133:0/1188000334 conn(0x7f95c006a3e0 msgr2=0x7f95c00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.138+0000 7f95c4895640 1 -- 172.21.15.133:0/1188000334 shutdown_connections 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.138+0000 7f95c4895640 1 -- 172.21.15.133:0/1188000334 wait complete. 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.138+0000 7f95c4895640 1 Processor -- start 2023-12-18T10:18:32.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.138+0000 7f95c4895640 1 -- start start 2023-12-18T10:18:32.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f4e19ffb640 1 -- 172.21.15.133:0/877788338 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14007640 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f4e19ffb640 1 -- 172.21.15.133:0/877788338 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14004a30 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c202590 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95c4895640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c00c1280 0x7f95c0156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c202240 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95c4895640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95c00c17d0 0x7f95c00c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95be59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c00c1280 0x7f95c0156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95be59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c00c1280 0x7f95c0156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48548/0 (socket says 172.21.15.133:48548) 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95be59c640 1 -- 172.21.15.133:0/278044845 learned_addr learned my addr 172.21.15.133:0/278044845 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95c4895640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95c0160cc0 0x7f95c00c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c0156b80 con 0x7f95c00c1280 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00c6e40 con 0x7f95c00c17d0 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00c6880 con 0x7f95c0160cc0 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95bdd9b640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95c00c17d0 0x7f95c00c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95bed9d640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95c0160cc0 0x7f95c00c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95bdd9b640 1 -- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95c0160cc0 msgr2=0x7f95c00c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95bdd9b640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95c0160cc0 0x7f95c00c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95bdd9b640 1 -- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c00c1280 msgr2=0x7f95c0156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95bdd9b640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c00c1280 0x7f95c0156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.142+0000 7f95bdd9b640 1 -- 172.21.15.133:0/278044845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009420 con 0x7f95c00c17d0 2023-12-18T10:18:32.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.146+0000 7f95bed9d640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95c0160cc0 0x7f95c00c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:32.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.146+0000 7f95bdd9b640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95c00c17d0 0x7f95c00c7fb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95b000e9b0 tx=0x7f95b000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.146+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1c04e000 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.146+0000 7f95aeffd640 1 -- 172.21.15.133:0/278044845 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000c9a0 con 0x7f95c00c17d0 2023-12-18T10:18:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.146+0000 7f95aeffd640 1 -- 172.21.15.133:0/278044845 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000cb00 con 0x7f95c00c17d0 2023-12-18T10:18:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.146+0000 7f95aeffd640 1 -- 172.21.15.133:0/278044845 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000ce90 con 0x7f95c00c17d0 2023-12-18T10:18:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.146+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40094d0 con 0x7f95c00c17d0 2023-12-18T10:18:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.146+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c0162360 con 0x7f95c00c17d0 2023-12-18T10:18:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.150+0000 7f95aeffd640 1 -- 172.21.15.133:0/278044845 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f95b0013470 con 0x7f95c00c17d0 2023-12-18T10:18:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.150+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c00735b0 con 0x7f95c00c17d0 2023-12-18T10:18:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.150+0000 7f4e19ffb640 1 -- 172.21.15.133:0/877788338 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4e14004b90 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.150+0000 7f4e19ffb640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4e08065ab0 0x7f4e08067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.150+0000 7f95aeffd640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f95a0065ae0 0x7f95a0067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.150+0000 7f4e19ffb640 1 -- 172.21.15.133:0/877788338 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4e14054cb0 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.154+0000 7f4e20c80640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4e08065ab0 0x7f4e08067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.154+0000 7f95be59c640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f95a0065ae0 0x7f95a0067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.154+0000 7f4e20c80640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4e08065ab0 0x7f4e08067f70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c205790 tx=0x7f4e0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.154+0000 7f95aeffd640 1 -- 172.21.15.133:0/278044845 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f95b0055140 con 0x7f95c00c17d0 2023-12-18T10:18:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.158+0000 7f95be59c640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f95a0065ae0 0x7f95a0067fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f95b401c4a0 tx=0x7f95b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.158+0000 7f95aeffd640 1 -- 172.21.15.133:0/278044845 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f95b0051510 con 0x7f95c00c17d0 2023-12-18T10:18:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.162+0000 7f4e19ffb640 1 -- 172.21.15.133:0/877788338 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4e14051080 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.170+0000 7f8e9fe8c640 1 Processor -- start 2023-12-18T10:18:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.170+0000 7f8e9fe8c640 1 -- start start 2023-12-18T10:18:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f3dcbf2c640 1 Processor -- start 2023-12-18T10:18:32.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9fe8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e980cd380 0x7f8e9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9fe8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e980cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f3dcbf2c640 1 -- start start 2023-12-18T10:18:32.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9fe8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e98165180 con 0x7f8e980cc710 2023-12-18T10:18:32.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9fe8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e98165460 con 0x7f8e980cd380 2023-12-18T10:18:32.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9fe8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98165740 con 0x7f8e981649a0 2023-12-18T10:18:32.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f3dcbf2c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3dc4160d80 0x7f3dc40c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9d427640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e980cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9dc28640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e980cd380 0x7f8e9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9d427640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e980cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44298/0 (socket says 172.21.15.133:44298) 2023-12-18T10:18:32.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9d427640 1 -- 172.21.15.133:0/2546171118 learned_addr learned my addr 172.21.15.133:0/2546171118 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9dc28640 1 -- 172.21.15.133:0/2546171118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 msgr2=0x7f8e980cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9dc28640 1 --2- 172.21.15.133:0/2546171118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e980cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9dc28640 1 -- 172.21.15.133:0/2546171118 >> v1:172.21.15.133:6789/0 conn(0x7f8e980cc710 legacy=0x7f8e98161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f8e9dc28640 1 -- 172.21.15.133:0/2546171118 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e981616f0 con 0x7f8e980cd380 2023-12-18T10:18:32.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f3dcbf2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc40c9080 0x7f3dc40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f3dc94c7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3dc4160d80 0x7f3dc40c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f3dc94c7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3dc4160d80 0x7f3dc40c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47084/0 (socket says 172.21.15.133:47084) 2023-12-18T10:18:32.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.174+0000 7f3dc94c7640 1 -- 172.21.15.133:0/3023777453 learned_addr learned my addr 172.21.15.133:0/3023777453 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.178+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/3023777453 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc40ac790 con 0x7f3dc415c890 2023-12-18T10:18:32.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.178+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/3023777453 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40c9510 con 0x7f3dc4160d80 2023-12-18T10:18:32.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.178+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/3023777453 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415cc70 con 0x7f3dc40c9080 2023-12-18T10:18:32.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.178+0000 7f3dca4c9640 1 --2- 172.21.15.133:0/3023777453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc40c9080 0x7f3dc40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.178+0000 7f3dc94c7640 1 -- 172.21.15.133:0/3023777453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc40c9080 msgr2=0x7f3dc40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.178+0000 7f3dc94c7640 1 --2- 172.21.15.133:0/3023777453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc40c9080 0x7f3dc40acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.178+0000 7f3dc94c7640 1 -- 172.21.15.133:0/3023777453 >> v1:172.21.15.133:6789/0 conn(0x7f3dc415c890 legacy=0x7f3dc40cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:32.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.178+0000 7f3dc94c7640 1 -- 172.21.15.133:0/3023777453 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40ab8a0 con 0x7f3dc4160d80 2023-12-18T10:18:32.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9dc28640 1 --2- 172.21.15.133:0/2546171118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e980cd380 0x7f8e9806c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e880097c0 tx=0x7f8e8801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a96fc257aac3aec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9cc26640 1 -- 172.21.15.133:0/2546171118 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880aa640 con 0x7f8e980cd380 2023-12-18T10:18:32.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9cc26640 1 -- 172.21.15.133:0/2546171118 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880aa7a0 con 0x7f8e980cd380 2023-12-18T10:18:32.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9cc26640 1 -- 172.21.15.133:0/2546171118 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880aab70 con 0x7f8e980cd380 2023-12-18T10:18:32.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/2546171118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e980cd380 msgr2=0x7f8e9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/2546171118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e980cd380 0x7f8e9806c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8e880097c0 tx=0x7f8e8801c480 comp rx=0 tx=0).stop 2023-12-18T10:18:32.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/2546171118 shutdown_connections 2023-12-18T10:18:32.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/2546171118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e980cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/2546171118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e980cd380 0x7f8e9806c8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/2546171118 >> 172.21.15.133:0/2546171118 conn(0x7f8e980afe90 msgr2=0x7f8e980b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f3dc94c7640 1 --2- 172.21.15.133:0/3023777453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40c8b40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009e50 tx=0x7f3dbc01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=129cc05417bae906 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/2546171118 shutdown_connections 2023-12-18T10:18:32.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/2546171118 wait complete. 2023-12-18T10:18:32.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f3dc8cc6640 1 -- 172.21.15.133:0/3023777453 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0a5820 con 0x7f3dc4160d80 2023-12-18T10:18:32.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f3dc8cc6640 1 -- 172.21.15.133:0/3023777453 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0a5980 con 0x7f3dc4160d80 2023-12-18T10:18:32.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.182+0000 7f3dc8cc6640 1 -- 172.21.15.133:0/3023777453 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0a5d10 con 0x7f3dc4160d80 2023-12-18T10:18:32.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/3023777453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 msgr2=0x7f3dc40c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/3023777453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40c8b40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009e50 tx=0x7f3dbc01c9a0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/3023777453 shutdown_connections 2023-12-18T10:18:32.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/3023777453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc40c9080 0x7f3dc40acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/3023777453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40c8b40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/3023777453 >> 172.21.15.133:0/3023777453 conn(0x7f3dc40afc80 msgr2=0x7f3dc40b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/3023777453 shutdown_connections 2023-12-18T10:18:32.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/3023777453 wait complete. 2023-12-18T10:18:32.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f8e9fe8c640 1 Processor -- start 2023-12-18T10:18:32.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.186+0000 7f8e9fe8c640 1 -- start start 2023-12-18T10:18:32.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9fe8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e980cc710 0x7f8e980c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9fe8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cd380 0x7f8e9815fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9fe8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e98160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9fe8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b1ec0 con 0x7f8e980cd380 2023-12-18T10:18:32.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f3dcbf2c640 1 Processor -- start 2023-12-18T10:18:32.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e98160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e98160220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44320/0 (socket says 172.21.15.133:44320) 2023-12-18T10:18:32.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 -- 172.21.15.133:0/1170868847 learned_addr learned my addr 172.21.15.133:0/1170868847 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b1100 con 0x7f8e980cc710 2023-12-18T10:18:32.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f3dcbf2c640 1 -- start start 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b13e0 con 0x7f8e981649a0 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 -- 172.21.15.133:0/1170868847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e980cc710 msgr2=0x7f8e980c6bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e980cc710 0x7f8e980c6bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 -- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cd380 msgr2=0x7f8e9815fce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cd380 0x7f8e9815fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 -- 172.21.15.133:0/1170868847 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88009420 con 0x7f8e981649a0 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e9e429640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e98160220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000c700 tx=0x7f8e9000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.190+0000 7f8e8e7fc640 1 -- 172.21.15.133:0/1170868847 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90006d60 con 0x7f8e981649a0 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f8e8e7fc640 1 -- 172.21.15.133:0/1170868847 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000ce10 con 0x7f8e981649a0 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f8e8e7fc640 1 -- 172.21.15.133:0/1170868847 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000aa70 con 0x7f8e981649a0 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dcbf2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40c9080 0x7f3dc415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dcbf2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc415c890 0x7f3dc4154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dcbf2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e980b16c0 con 0x7f8e981649a0 2023-12-18T10:18:32.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e980c7130 con 0x7f8e981649a0 2023-12-18T10:18:32.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dcbf2c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415b0d0 con 0x7f3dc40c9080 2023-12-18T10:18:32.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dcbf2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415a4c0 con 0x7f3dc4160d80 2023-12-18T10:18:32.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dcbf2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415a7a0 con 0x7f3dc415c890 2023-12-18T10:18:32.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dca4c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dca4c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40ae190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47108/0 (socket says 172.21.15.133:47108) 2023-12-18T10:18:32.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dca4c9640 1 -- 172.21.15.133:0/2333262489 learned_addr learned my addr 172.21.15.133:0/2333262489 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:32.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dc94c7640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc415c890 0x7f3dc4154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e980b1be0 con 0x7f8e981649a0 2023-12-18T10:18:32.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dc9cc8640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40c9080 0x7f3dc415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dca4c9640 1 -- 172.21.15.133:0/2333262489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc415c890 msgr2=0x7f3dc4154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dca4c9640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc415c890 0x7f3dc4154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dca4c9640 1 -- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40c9080 msgr2=0x7f3dc415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dca4c9640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40c9080 0x7f3dc415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f3dca4c9640 1 -- 172.21.15.133:0/2333262489 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc009b30 con 0x7f3dc4160d80 2023-12-18T10:18:32.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f3dca4c9640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40ae190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3db400e930 tx=0x7f3db400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f3dba7fc640 1 -- 172.21.15.133:0/2333262489 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40096b0 con 0x7f3dc4160d80 2023-12-18T10:18:32.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f3dba7fc640 1 -- 172.21.15.133:0/2333262489 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db400c9a0 con 0x7f3dc4160d80 2023-12-18T10:18:32.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.194+0000 7f8e8e7fc640 1 -- 172.21.15.133:0/1170868847 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e9000abd0 con 0x7f8e981649a0 2023-12-18T10:18:32.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f8e8e7fc640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e7c065b30 0x7f8e7c067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f8e8e7fc640 1 -- 172.21.15.133:0/1170868847 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e90082de0 con 0x7f8e981649a0 2023-12-18T10:18:32.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f8e9dc28640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e7c065b30 0x7f8e7c067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f3dba7fc640 1 -- 172.21.15.133:0/2333262489 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400cd30 con 0x7f3dc4160d80 2023-12-18T10:18:32.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc415aa80 con 0x7f3dc4160d80 2023-12-18T10:18:32.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc415d3b0 con 0x7f3dc4160d80 2023-12-18T10:18:32.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f8e9dc28640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e7c065b30 0x7f8e7c067ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ae000 tx=0x7f8e88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.198+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc415b240 con 0x7f3dc4160d80 2023-12-18T10:18:32.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.202+0000 7f8e8e7fc640 1 -- 172.21.15.133:0/1170868847 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8e980b1be0 con 0x7f8e981649a0 2023-12-18T10:18:32.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.206+0000 7f3dba7fc640 1 -- 172.21.15.133:0/2333262489 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3db4013470 con 0x7f3dc4160d80 2023-12-18T10:18:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.210+0000 7f3dba7fc640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3da8065a60 0x7f3da8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.210+0000 7f3dba7fc640 1 -- 172.21.15.133:0/2333262489 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3db4083680 con 0x7f3dc4160d80 2023-12-18T10:18:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.210+0000 7f3dba7fc640 1 -- 172.21.15.133:0/2333262489 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3db4085bf0 con 0x7f3dc4160d80 2023-12-18T10:18:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.210+0000 7f3dc9cc8640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3da8065a60 0x7f3da8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.214+0000 7f3dc9cc8640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3da8065a60 0x7f3da8067f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00016c0 tx=0x7f3dc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:32.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.446+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdce8152190 con 0x7fdce815d2d0 2023-12-18T10:18:32.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.446+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f58d804e000 con 0x7f58d80c17d0 2023-12-18T10:18:32.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.446+0000 7f58ce7fc640 1 -- 172.21.15.133:0/3739676788 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58d4053640 con 0x7f58d80c17d0 2023-12-18T10:18:32.452 INFO:teuthology.orchestra.run.smithi133.stdout:55834574858 2023-12-18T10:18:32.452 INFO:teuthology.orchestra.run.smithi133.stdout:55834574858 2023-12-18T10:18:32.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcddffb640 1 -- 172.21.15.133:0/214178654 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdce8152190 con 0x7fdce815d2d0 2023-12-18T10:18:32.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58bc065ab0 msgr2=0x7f58bc067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58bc065ab0 0x7f58bc067f70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f58d81fc540 tx=0x7f58c8009190 comp rx=0 tx=0).stop 2023-12-18T10:18:32.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 msgr2=0x7f58d81611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 0x7f58d81611e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c340 tx=0x7f58d400c800 comp rx=0 tx=0).stop 2023-12-18T10:18:32.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 shutdown_connections 2023-12-18T10:18:32.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58bc065ab0 0x7f58bc067f70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f58d8160cc0 0x7f58d80c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58d80c17d0 0x7f58d81611e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 --2- 172.21.15.133:0/3739676788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58d80c1280 0x7f58d8156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 >> 172.21.15.133:0/3739676788 conn(0x7f58d806a3e0 msgr2=0x7f58d80cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 shutdown_connections 2023-12-18T10:18:32.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7f58dfae5640 1 -- 172.21.15.133:0/3739676788 wait complete. 2023-12-18T10:18:32.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065b30 msgr2=0x7fdccc067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065b30 0x7fdccc067ff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdce401c4a0 tx=0x7fdce40a6000 comp rx=0 tx=0).stop 2023-12-18T10:18:32.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce815d2d0 msgr2=0x7fdce80cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce815d2d0 0x7fdce80cb810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdce000caa0 tx=0x7fdce000cf60 comp rx=0 tx=0).stop 2023-12-18T10:18:32.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 shutdown_connections 2023-12-18T10:18:32.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065b30 0x7fdccc067ff0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce815d2d0 0x7fdce80cb810 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815cb30 0x7fdce8156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 --2- 172.21.15.133:0/214178654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80cefe0 0x7fdce80b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.450+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 >> 172.21.15.133:0/214178654 conn(0x7fdce8089fb0 msgr2=0x7fdce80b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.454+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 shutdown_connections 2023-12-18T10:18:32.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.454+0000 7fdcef9e9640 1 -- 172.21.15.133:0/214178654 wait complete. 2023-12-18T10:18:32.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.458+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f134c005510 con 0x7f13500052b0 2023-12-18T10:18:32.464 INFO:teuthology.orchestra.run.smithi133.stdout:55834574858 2023-12-18T10:18:32.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.458+0000 7f135a7fc640 1 -- 172.21.15.133:0/753307369 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f135c05cab0 con 0x7f13500052b0 2023-12-18T10:18:32.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1348065b30 msgr2=0x7f1348067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1348065b30 0x7f1348067ff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1354006fb0 tx=0x7f1354008040 comp rx=0 tx=0).stop 2023-12-18T10:18:32.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13500052b0 msgr2=0x7f136414d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13500052b0 0x7f136414d400 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f135c017e40 tx=0x7f135c00ebb0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 shutdown_connections 2023-12-18T10:18:32.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1348065b30 0x7f1348067ff0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13640b2740 0x7f1364156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1364154020 0x7f13640b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 --2- 172.21.15.133:0/753307369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13500052b0 0x7f136414d400 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 >> 172.21.15.133:0/753307369 conn(0x7f13640afe90 msgr2=0x7f136415a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 shutdown_connections 2023-12-18T10:18:32.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.462+0000 7f136be66640 1 -- 172.21.15.133:0/753307369 wait complete. 2023-12-18T10:18:32.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.470+0000 7fb318efc640 1 -- 172.21.15.133:0/159023154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb31415ceb0 con 0x7fb3140cb340 2023-12-18T10:18:32.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.474+0000 7fb30affd640 1 -- 172.21.15.133:0/159023154 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb2fc0b0030 con 0x7fb3140cb340 2023-12-18T10:18:32.478 INFO:teuthology.orchestra.run.smithi133.stdout:55834574858 2023-12-18T10:18:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f95c004e000 con 0x7f95c00c17d0 2023-12-18T10:18:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 -- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb2f4065ab0 msgr2=0x7fb2f4067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb2f4065ab0 0x7fb2f4067f70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb304005c10 tx=0x7fb304009040 comp rx=0 tx=0).stop 2023-12-18T10:18:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 -- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3140cb340 msgr2=0x7fb3140c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3140cb340 0x7fb3140c37d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc01aac0 tx=0x7fb2fc0191b0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7f95aeffd640 1 -- 172.21.15.133:0/278044845 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95b0017030 con 0x7f95c00c17d0 2023-12-18T10:18:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 -- 172.21.15.133:0/159023154 shutdown_connections 2023-12-18T10:18:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb2f4065ab0 0x7fb2f4067f70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb314160cc0 0x7fb31415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3140cb340 0x7fb3140c37d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 --2- 172.21.15.133:0/159023154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb3140c1280 0x7fb31415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 -- 172.21.15.133:0/159023154 >> 172.21.15.133:0/159023154 conn(0x7fb31406a3e0 msgr2=0x7fb3140ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 -- 172.21.15.133:0/159023154 shutdown_connections 2023-12-18T10:18:32.482 INFO:teuthology.orchestra.run.smithi133.stdout:55834574856 2023-12-18T10:18:32.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.478+0000 7fb308ff9640 1 -- 172.21.15.133:0/159023154 wait complete. 2023-12-18T10:18:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.482+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f95a0065ae0 msgr2=0x7f95a0067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.482+0000 7f95c4895640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f95a0065ae0 0x7f95a0067fa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f95b401c4a0 tx=0x7f95b4008040 comp rx=0 tx=0).stop 2023-12-18T10:18:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.482+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95c00c17d0 msgr2=0x7f95c00c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.482+0000 7f95c4895640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95c00c17d0 0x7f95c00c7fb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95b000e9b0 tx=0x7f95b000ee70 comp rx=0 tx=0).stop 2023-12-18T10:18:32.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 shutdown_connections 2023-12-18T10:18:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f95c4895640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f95a0065ae0 0x7f95a0067fa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f95c4895640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f95c0160cc0 0x7f95c00c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f95c4895640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95c00c17d0 0x7f95c00c7fb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f95c4895640 1 --2- 172.21.15.133:0/278044845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95c00c1280 0x7f95c0156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 >> 172.21.15.133:0/278044845 conn(0x7f95c006a3e0 msgr2=0x7f95c0070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 shutdown_connections 2023-12-18T10:18:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f95c4895640 1 -- 172.21.15.133:0/278044845 wait complete. 2023-12-18T10:18:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4e1c0b42e0 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.486+0000 7f4e19ffb640 1 -- 172.21.15.133:0/877788338 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e14051080 con 0x7f4e1c0b09b0 2023-12-18T10:18:32.490 INFO:teuthology.orchestra.run.smithi133.stdout:55834574857 2023-12-18T10:18:32.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-12-18T10:18:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4e08065ab0 msgr2=0x7f4e08067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4e08065ab0 0x7f4e08067f70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c205790 tx=0x7f4e0c009040 comp rx=0 tx=0).stop 2023-12-18T10:18:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 msgr2=0x7f4e1c202d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c202d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400c410 tx=0x7f4e1400c8d0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 shutdown_connections 2023-12-18T10:18:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4e08065ab0 0x7f4e08067f70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4e1c205830 0x7f4e1c205cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e1c158900 0x7f4e1c0c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 --2- 172.21.15.133:0/877788338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e1c0b09b0 0x7f4e1c202d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.490+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 >> 172.21.15.133:0/877788338 conn(0x7f4e1c0afe90 msgr2=0x7f4e1c167970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2023-12-18T10:18:32.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.494+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 shutdown_connections 2023-12-18T10:18:32.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.494+0000 7f4e236e5640 1 -- 172.21.15.133:0/877788338 wait complete. 2023-12-18T10:18:32.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-12-18T10:18:32.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-12-18T10:18:32.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.514+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8e980b1be0 con 0x7f8e981649a0 2023-12-18T10:18:32.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e8e7fc640 1 -- 172.21.15.133:0/1170868847 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e980b1be0 con 0x7f8e981649a0 2023-12-18T10:18:32.519 INFO:teuthology.orchestra.run.smithi133.stdout:55834574858 2023-12-18T10:18:32.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e7c065b30 msgr2=0x7f8e7c067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e7c065b30 0x7f8e7c067ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ae000 tx=0x7f8e88008040 comp rx=0 tx=0).stop 2023-12-18T10:18:32.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 msgr2=0x7f8e98160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e98160220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000c700 tx=0x7f8e9000cbc0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-12-18T10:18:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 shutdown_connections 2023-12-18T10:18:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e7c065b30 0x7f8e7c067ff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e981649a0 0x7f8e98160220 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cd380 0x7f8e9815fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 --2- 172.21.15.133:0/1170868847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e980cc710 0x7f8e980c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 >> 172.21.15.133:0/1170868847 conn(0x7f8e980afe90 msgr2=0x7f8e98162aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 shutdown_connections 2023-12-18T10:18:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.518+0000 7f8e9fe8c640 1 -- 172.21.15.133:0/1170868847 wait complete. 2023-12-18T10:18:32.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-12-18T10:18:32.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.526+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3dc404e000 con 0x7f3dc4160d80 2023-12-18T10:18:32.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.526+0000 7f3dba7fc640 1 -- 172.21.15.133:0/2333262489 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3db4050eb0 con 0x7f3dc4160d80 2023-12-18T10:18:32.529 INFO:teuthology.orchestra.run.smithi133.stdout:55834574857 2023-12-18T10:18:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3da8065a60 msgr2=0x7f3da8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3da8065a60 0x7f3da8067f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00016c0 tx=0x7f3dc0009040 comp rx=0 tx=0).stop 2023-12-18T10:18:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 msgr2=0x7f3dc40ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40ae190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3db400e930 tx=0x7f3db400edf0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 shutdown_connections 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3da8065a60 0x7f3da8067f20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dc4160d80 0x7f3dc40ae190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dc415c890 0x7f3dc4154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 --2- 172.21.15.133:0/2333262489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40c9080 0x7f3dc415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 >> 172.21.15.133:0/2333262489 conn(0x7f3dc40afc80 msgr2=0x7f3dc40cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 shutdown_connections 2023-12-18T10:18:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:32.530+0000 7f3dcbf2c640 1 -- 172.21.15.133:0/2333262489 wait complete. 2023-12-18T10:18:32.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-12-18T10:18:32.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-12-18T10:18:33.494 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-18T10:18:33.496 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-18T10:18:33.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-18T10:18:33.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-18T10:18:33.523 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-18T10:18:33.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-18T10:18:33.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-18T10:18:33.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-18T10:18:33.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.714+0000 7fbbd6152640 1 Processor -- start 2023-12-18T10:18:33.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.714+0000 7efc7adce640 1 Processor -- start 2023-12-18T10:18:33.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.714+0000 7fbbd6152640 1 -- start start 2023-12-18T10:18:33.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.714+0000 7efc7adce640 1 -- start start 2023-12-18T10:18:33.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7adce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc74158c80 0x7efc7406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7adce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740cd000 0x7efc740cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbd6152640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbd00b1b00 0x7fbbd0164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbd6152640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd00b1ee0 con 0x7fbbd006afb0 2023-12-18T10:18:33.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbd6152640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd0165140 con 0x7fbbd006b700 2023-12-18T10:18:33.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbd6152640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd01659e0 con 0x7fbbd00b1b00 2023-12-18T10:18:33.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbcf7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbd00b1b00 0x7fbbd0164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7adce640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740703a0 con 0x7efc740c8a80 2023-12-18T10:18:33.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7936b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740cd000 0x7efc740cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7936b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740cd000 0x7efc740cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44332/0 (socket says 172.21.15.133:44332) 2023-12-18T10:18:33.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7936b640 1 -- 172.21.15.133:0/392259490 learned_addr learned my addr 172.21.15.133:0/392259490 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc73fff640 1 --2- 172.21.15.133:0/392259490 >> v2:172.21.15.133:3300/0 conn(0x7efc74158c80 0x7efc7406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbcf7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbd00b1b00 0x7fbbd0164ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47114/0 (socket says 172.21.15.133:47114) 2023-12-18T10:18:33.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7adce640 1 -- 172.21.15.133:0/392259490 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc740cdaa0 con 0x7efc74158c80 2023-12-18T10:18:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7adce640 1 -- 172.21.15.133:0/392259490 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc740cdd80 con 0x7efc740cd000 2023-12-18T10:18:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbcf7fe640 1 -- 172.21.15.133:0/2520679831 learned_addr learned my addr 172.21.15.133:0/2520679831 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbcf7fe640 1 -- 172.21.15.133:0/2520679831 >> v1:172.21.15.142:6789/0 conn(0x7fbbd006b700 legacy=0x7fbbd00cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbcf7fe640 1 -- 172.21.15.133:0/2520679831 >> v1:172.21.15.133:6789/0 conn(0x7fbbd006afb0 legacy=0x7fbbd0161c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7fbbcf7fe640 1 -- 172.21.15.133:0/2520679831 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0165420 con 0x7fbbd00b1b00 2023-12-18T10:18:33.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7936b640 1 -- 172.21.15.133:0/392259490 >> v2:172.21.15.133:3300/0 conn(0x7efc74158c80 msgr2=0x7efc7406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:33.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7936b640 1 --2- 172.21.15.133:0/392259490 >> v2:172.21.15.133:3300/0 conn(0x7efc74158c80 0x7efc7406fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7936b640 1 -- 172.21.15.133:0/392259490 >> v1:172.21.15.133:6789/0 conn(0x7efc740c8a80 legacy=0x7efc740c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.718+0000 7efc7936b640 1 -- 172.21.15.133:0/392259490 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7406da30 con 0x7efc740cd000 2023-12-18T10:18:33.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.722+0000 7fbbcf7fe640 1 --2- 172.21.15.133:0/2520679831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd00b1b00 0x7fbbd0164ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009ea0 tx=0x7fbbc801ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cfc3ff7f5aadf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7efc7936b640 1 --2- 172.21.15.133:0/392259490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740cd000 0x7efc740cc0d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009a50 tx=0x7efc6c01cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=372c776eb3f90efb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.722+0000 7fbbce7fc640 1 -- 172.21.15.133:0/2520679831 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80a58f0 con 0x7fbbd00b1b00 2023-12-18T10:18:33.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbce7fc640 1 -- 172.21.15.133:0/2520679831 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc80a5a50 con 0x7fbbd00b1b00 2023-12-18T10:18:33.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbce7fc640 1 -- 172.21.15.133:0/2520679831 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80a5de0 con 0x7fbbd00b1b00 2023-12-18T10:18:33.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7efc737fe640 1 -- 172.21.15.133:0/392259490 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc740c9850 con 0x7efc740cd000 2023-12-18T10:18:33.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7efc737fe640 1 -- 172.21.15.133:0/392259490 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0a5b70 con 0x7efc740cd000 2023-12-18T10:18:33.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7efc737fe640 1 -- 172.21.15.133:0/392259490 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc740c9850 con 0x7efc740cd000 2023-12-18T10:18:33.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbd6152640 1 -- 172.21.15.133:0/2520679831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd00b1b00 msgr2=0x7fbbd0164ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbd6152640 1 --2- 172.21.15.133:0/2520679831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd00b1b00 0x7fbbd0164ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009ea0 tx=0x7fbbc801ca20 comp rx=0 tx=0).stop 2023-12-18T10:18:33.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbd6152640 1 -- 172.21.15.133:0/2520679831 shutdown_connections 2023-12-18T10:18:33.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7efc7adce640 1 -- 172.21.15.133:0/392259490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740cd000 msgr2=0x7efc740cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7efc7adce640 1 --2- 172.21.15.133:0/392259490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740cd000 0x7efc740cc0d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009a50 tx=0x7efc6c01cca0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbd6152640 1 --2- 172.21.15.133:0/2520679831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd00b1b00 0x7fbbd0164ab0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbd6152640 1 -- 172.21.15.133:0/2520679831 >> 172.21.15.133:0/2520679831 conn(0x7fbbd0089fb0 msgr2=0x7fbbd009b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:33.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbd6152640 1 -- 172.21.15.133:0/2520679831 shutdown_connections 2023-12-18T10:18:33.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.726+0000 7fbbd6152640 1 -- 172.21.15.133:0/2520679831 wait complete. 2023-12-18T10:18:33.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.730+0000 7efc7adce640 1 -- 172.21.15.133:0/392259490 shutdown_connections 2023-12-18T10:18:33.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.730+0000 7efc7adce640 1 --2- 172.21.15.133:0/392259490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740cd000 0x7efc740cc0d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.730+0000 7efc7adce640 1 --2- 172.21.15.133:0/392259490 >> v2:172.21.15.133:3300/0 conn(0x7efc74158c80 0x7efc7406fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.730+0000 7efc7adce640 1 -- 172.21.15.133:0/392259490 >> 172.21.15.133:0/392259490 conn(0x7efc740afc80 msgr2=0x7efc740b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:33.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.730+0000 7efc7adce640 1 -- 172.21.15.133:0/392259490 shutdown_connections 2023-12-18T10:18:33.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.730+0000 7efc7adce640 1 -- 172.21.15.133:0/392259490 wait complete. 2023-12-18T10:18:33.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.730+0000 7fbbd6152640 1 Processor -- start 2023-12-18T10:18:33.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.730+0000 7fbbd6152640 1 -- start start 2023-12-18T10:18:33.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc7adce640 1 Processor -- start 2023-12-18T10:18:33.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbd6152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd006afb0 0x7fbbd01fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbd6152640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbd006b700 0x7fbbd00b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbd6152640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbd00b1b00 0x7fbbd01f9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbd6152640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd00c9a40 con 0x7fbbd006b700 2023-12-18T10:18:33.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbd6152640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd01fb6d0 con 0x7fbbd006afb0 2023-12-18T10:18:33.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbd6152640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd01fa6f0 con 0x7fbbd00b1b00 2023-12-18T10:18:33.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbd00b1b00 0x7fbbd01f9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbd00b1b00 0x7fbbd01f9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44340/0 (socket says 172.21.15.133:44340) 2023-12-18T10:18:33.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 -- 172.21.15.133:0/3835433795 learned_addr learned my addr 172.21.15.133:0/3835433795 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcf7fe640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd006afb0 0x7fbbd01fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 -- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd006afb0 msgr2=0x7fbbd01fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbceffd640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbd006b700 0x7fbbd00b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd006afb0 0x7fbbd01fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 -- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbd006b700 msgr2=0x7fbbd00b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbd006b700 0x7fbbd00b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 -- 172.21.15.133:0/3835433795 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc8009b30 con 0x7fbbd00b1b00 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcf7fe640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd006afb0 0x7fbbd01fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbceffd640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbd006b700 0x7fbbd00b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:33.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbcffff640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbd00b1b00 0x7fbbd01f9bf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400c3a0 tx=0x7fbbc400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc7adce640 1 -- start start 2023-12-18T10:18:33.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc7adce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc740c8a80 0x7efc74157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc7adce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc740cd000 0x7efc74155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc7adce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740b36e0 0x7efc74155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbb7fff640 1 -- 172.21.15.133:0/3835433795 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4011790 con 0x7fbbd00b1b00 2023-12-18T10:18:33.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc73fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc740cd000 0x7efc74155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc73fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc740cd000 0x7efc74155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47132/0 (socket says 172.21.15.133:47132) 2023-12-18T10:18:33.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc73fff640 1 -- 172.21.15.133:0/3848027591 learned_addr learned my addr 172.21.15.133:0/3848027591 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc7936b640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740b36e0 0x7efc74155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7415c2f0 con 0x7efc740c8a80 2023-12-18T10:18:33.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740b2920 con 0x7efc740cd000 2023-12-18T10:18:33.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc740b2c00 con 0x7efc740b36e0 2023-12-18T10:18:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc78b6a640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc740c8a80 0x7efc74157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbb7fff640 1 -- 172.21.15.133:0/3835433795 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc40118f0 con 0x7fbbd00b1b00 2023-12-18T10:18:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.734+0000 7fbbb7fff640 1 -- 172.21.15.133:0/3835433795 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4011ca0 con 0x7fbbd00b1b00 2023-12-18T10:18:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd01fa9d0 con 0x7fbbd00b1b00 2023-12-18T10:18:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7936b640 1 -- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc740cd000 msgr2=0x7efc74155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7936b640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc740cd000 0x7efc74155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7936b640 1 -- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc740c8a80 msgr2=0x7efc74157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7936b640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc740c8a80 0x7efc74157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7936b640 1 -- 172.21.15.133:0/3848027591 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0096b0 con 0x7efc740b36e0 2023-12-18T10:18:33.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7936b640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740b36e0 0x7efc74155770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0ab000 tx=0x7efc6c019a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd00c9660 con 0x7fbbd00b1b00 2023-12-18T10:18:33.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc73fff640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc740cd000 0x7efc74155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:33.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc717fa640 1 -- 172.21.15.133:0/3848027591 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c004040 con 0x7efc740b36e0 2023-12-18T10:18:33.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc717fa640 1 -- 172.21.15.133:0/3848027591 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0041a0 con 0x7efc740b36e0 2023-12-18T10:18:33.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc717fa640 1 -- 172.21.15.133:0/3848027591 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c004510 con 0x7efc740b36e0 2023-12-18T10:18:33.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc740cce20 con 0x7efc740b36e0 2023-12-18T10:18:33.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc740b31c0 con 0x7efc740b36e0 2023-12-18T10:18:33.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.738+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd00c9b80 con 0x7fbbd00b1b00 2023-12-18T10:18:33.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.742+0000 7fbbb7fff640 1 -- 172.21.15.133:0/3835433795 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbbc401c460 con 0x7fbbd00b1b00 2023-12-18T10:18:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.742+0000 7fbbb7fff640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbbbc065a90 0x7fbbbc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.742+0000 7fbbb7fff640 1 -- 172.21.15.133:0/3835433795 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbc4083330 con 0x7fbbd00b1b00 2023-12-18T10:18:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.746+0000 7fbbcf7fe640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbbbc065a90 0x7fbbbc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.742+0000 7efc717fa640 1 -- 172.21.15.133:0/3848027591 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efc6c004670 con 0x7efc740b36e0 2023-12-18T10:18:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.746+0000 7efc717fa640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efc54065b60 0x7efc54068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.746+0000 7efc717fa640 1 -- 172.21.15.133:0/3848027591 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc6c11e740 con 0x7efc740b36e0 2023-12-18T10:18:33.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.746+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc740b33b0 con 0x7efc740b36e0 2023-12-18T10:18:33.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.746+0000 7fbbcf7fe640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbbbc065a90 0x7fbbbc067f50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80ae000 tx=0x7fbbc80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.746+0000 7fbbb7fff640 1 -- 172.21.15.133:0/3835433795 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbbd00c9b80 con 0x7fbbd00b1b00 2023-12-18T10:18:33.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.746+0000 7efc78b6a640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efc54065b60 0x7efc54068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.750+0000 7efc78b6a640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efc54065b60 0x7efc54068020 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc64000f70 tx=0x7efc64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.750+0000 7efc717fa640 1 -- 172.21.15.133:0/3848027591 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efc6c0ebe80 con 0x7efc740b36e0 2023-12-18T10:18:33.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.774+0000 7fd74d42d640 1 Processor -- start 2023-12-18T10:18:33.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.774+0000 7fd74d42d640 1 -- start start 2023-12-18T10:18:33.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.778+0000 7fd74d42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd74806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.778+0000 7fd74d42d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7480703a0 con 0x7fd7480c9190 2023-12-18T10:18:33.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.778+0000 7fd74d42d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7480cdaa0 con 0x7fd7480cd000 2023-12-18T10:18:33.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.778+0000 7fd74d42d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480cdd80 con 0x7fd7480b0770 2023-12-18T10:18:33.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.778+0000 7fd746ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd7480cd000 0x7fd7480c8a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:43044/0 (socket says 172.21.15.133:43044) 2023-12-18T10:18:33.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.782+0000 7fd746ffd640 1 -- 172.21.15.133:0/1902077434 learned_addr learned my addr 172.21.15.133:0/1902077434 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:33.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.778+0000 7fd7467fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd7480c9190 0x7fd7480cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48194/0 (socket says 172.21.15.133:48194) 2023-12-18T10:18:33.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.782+0000 7fd7477fe640 1 --2- 172.21.15.133:0/1902077434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd74806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.782+0000 7fd745ffb640 1 -- 172.21.15.133:0/1902077434 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738615059 0 0) 0x7fd7480cdaa0 con 0x7fd7480cd000 2023-12-18T10:18:33.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.782+0000 7fd745ffb640 1 -- 172.21.15.133:0/1902077434 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd730005740 con 0x7fd7480cd000 2023-12-18T10:18:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.782+0000 7fd7477fe640 1 -- 172.21.15.133:0/1902077434 >> v1:172.21.15.142:6789/0 conn(0x7fd7480cd000 legacy=0x7fd7480c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.782+0000 7fd7477fe640 1 -- 172.21.15.133:0/1902077434 >> v1:172.21.15.133:6789/0 conn(0x7fd7480c9190 legacy=0x7fd7480cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.782+0000 7fd7477fe640 1 -- 172.21.15.133:0/1902077434 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74806da30 con 0x7fd7480b0770 2023-12-18T10:18:33.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd7477fe640 1 --2- 172.21.15.133:0/1902077434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd74806fe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097f0 tx=0x7fd73801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759d14abe0fdbe9b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7f9f668fe640 1 Processor -- start 2023-12-18T10:18:33.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd745ffb640 1 -- 172.21.15.133:0/1902077434 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7480c9850 con 0x7fd7480b0770 2023-12-18T10:18:33.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd745ffb640 1 -- 172.21.15.133:0/1902077434 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380a8050 con 0x7fd7480b0770 2023-12-18T10:18:33.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd745ffb640 1 -- 172.21.15.133:0/1902077434 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7380ac820 con 0x7fd7480b0770 2023-12-18T10:18:33.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7f9f668fe640 1 -- start start 2023-12-18T10:18:33.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd74d42d640 1 -- 172.21.15.133:0/1902077434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 msgr2=0x7fd74806fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd74d42d640 1 --2- 172.21.15.133:0/1902077434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd74806fe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097f0 tx=0x7fd73801c480 comp rx=0 tx=0).stop 2023-12-18T10:18:33.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd74d42d640 1 -- 172.21.15.133:0/1902077434 shutdown_connections 2023-12-18T10:18:33.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd74d42d640 1 --2- 172.21.15.133:0/1902077434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd74806fe60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd74d42d640 1 -- 172.21.15.133:0/1902077434 >> 172.21.15.133:0/1902077434 conn(0x7fd7480afc80 msgr2=0x7fd7480b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:33.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd74d42d640 1 -- 172.21.15.133:0/1902077434 shutdown_connections 2023-12-18T10:18:33.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7fd74d42d640 1 -- 172.21.15.133:0/1902077434 wait complete. 2023-12-18T10:18:33.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7f9f668fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f580583c0 0x7f9f58058870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7f9f668fe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f58057040 con 0x7f9f580e33f0 2023-12-18T10:18:33.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7f9f668fe640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f58057320 con 0x7f9f58053d90 2023-12-18T10:18:33.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.790+0000 7f9f668fe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5803eff0 con 0x7f9f580583c0 2023-12-18T10:18:33.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7f9f660fd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f580583c0 0x7f9f58058870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7f9f660fd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f580583c0 0x7f9f58058870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48610/0 (socket says 172.21.15.133:48610) 2023-12-18T10:18:33.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7f9f660fd640 1 -- 172.21.15.133:0/105306355 learned_addr learned my addr 172.21.15.133:0/105306355 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7f9f660fd640 1 -- 172.21.15.133:0/105306355 >> v1:172.21.15.142:6789/0 conn(0x7f9f58053d90 legacy=0x7f9f58054170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7f9f660fd640 1 -- 172.21.15.133:0/105306355 >> v1:172.21.15.133:6789/0 conn(0x7f9f580e33f0 legacy=0x7f9f5803e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7f9f648fa640 1 -- 172.21.15.133:0/105306355 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819912852 0 0) 0x7f9f58057040 con 0x7f9f580e33f0 2023-12-18T10:18:33.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7f9f660fd640 1 -- 172.21.15.133:0/105306355 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f58057600 con 0x7f9f580583c0 2023-12-18T10:18:33.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7fd74d42d640 1 Processor -- start 2023-12-18T10:18:33.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.794+0000 7fd74d42d640 1 -- start start 2023-12-18T10:18:33.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd74d42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd748201ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd74d42d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7480c9190 0x7fd748159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd74d42d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7480cd000 0x7fd7480c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd746ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd748201ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd746ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd748201ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44372/0 (socket says 172.21.15.133:44372) 2023-12-18T10:18:33.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd7467fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7480c9190 0x7fd748159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd7467fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7480c9190 0x7fd748159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47138/0 (socket says 172.21.15.133:47138) 2023-12-18T10:18:33.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7f9f660fd640 1 --2- 172.21.15.133:0/105306355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 0x7f9f58058870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002c850 tx=0x7f9f60098b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c98ffcc8f370a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd746ffd640 1 -- 172.21.15.133:0/3964816181 learned_addr learned my addr 172.21.15.133:0/3964816181 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480b2470 con 0x7fd7480cd000 2023-12-18T10:18:33.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480b2a30 con 0x7fd7480c9190 2023-12-18T10:18:33.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd7477fe640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7480cd000 0x7fd7480c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7f9f648fa640 1 -- 172.21.15.133:0/105306355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f601227e0 con 0x7f9f580583c0 2023-12-18T10:18:33.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74815a490 con 0x7fd7480b0770 2023-12-18T10:18:33.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7f9f648fa640 1 -- 172.21.15.133:0/105306355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60122940 con 0x7f9f580583c0 2023-12-18T10:18:33.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7f9f648fa640 1 -- 172.21.15.133:0/105306355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f601227e0 con 0x7f9f580583c0 2023-12-18T10:18:33.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f9f668fe640 1 -- 172.21.15.133:0/105306355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 msgr2=0x7f9f58058870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f9f668fe640 1 --2- 172.21.15.133:0/105306355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 0x7f9f58058870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002c850 tx=0x7f9f60098b40 comp rx=0 tx=0).stop 2023-12-18T10:18:33.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd7467fc640 1 -- 172.21.15.133:0/3964816181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 msgr2=0x7fd748201ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd7467fc640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd748201ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd7467fc640 1 -- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7480cd000 msgr2=0x7fd7480c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd7467fc640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7480cd000 0x7fd7480c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd7467fc640 1 -- 172.21.15.133:0/3964816181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738009420 con 0x7fd7480c9190 2023-12-18T10:18:33.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7f1953066640 1 Processor -- start 2023-12-18T10:18:33.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7f1953066640 1 -- start start 2023-12-18T10:18:33.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7f1953066640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f194c0cd380 0x7f194c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.798+0000 7f1953066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f194bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1951603640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f194c0cc710 0x7f194c161c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48208/0 (socket says 172.21.15.133:48208) 2023-12-18T10:18:33.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1950e02640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f194c0cd380 0x7f194c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f9f668fe640 1 -- 172.21.15.133:0/105306355 shutdown_connections 2023-12-18T10:18:33.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f9f668fe640 1 --2- 172.21.15.133:0/105306355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 0x7f9f58058870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f9f668fe640 1 -- 172.21.15.133:0/105306355 >> 172.21.15.133:0/105306355 conn(0x7f9f58055a40 msgr2=0x7f9f58055e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:33.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1950e02640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f194c0cd380 0x7f194c06c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48630/0 (socket says 172.21.15.133:48630) 2023-12-18T10:18:33.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1951603640 1 -- 172.21.15.133:0/3738705015 learned_addr learned my addr 172.21.15.133:0/3738705015 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:33.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1953066640 1 -- 172.21.15.133:0/3738705015 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c165180 con 0x7f194c0cc710 2023-12-18T10:18:33.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd7467fc640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7480c9190 0x7fd748159a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd74000c780 tx=0x7fd74000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1953066640 1 -- 172.21.15.133:0/3738705015 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c165460 con 0x7f194c0cd380 2023-12-18T10:18:33.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1953066640 1 -- 172.21.15.133:0/3738705015 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c165740 con 0x7f194c1649a0 2023-12-18T10:18:33.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f194bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c0cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44378/0 (socket says 172.21.15.133:44378) 2023-12-18T10:18:33.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f9f668fe640 1 -- 172.21.15.133:0/105306355 shutdown_connections 2023-12-18T10:18:33.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f9f668fe640 1 -- 172.21.15.133:0/105306355 wait complete. 2023-12-18T10:18:33.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f194b7fe640 1 -- 172.21.15.133:0/3738705015 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728798285 0 0) 0x7f194c165180 con 0x7f194c0cc710 2023-12-18T10:18:33.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f194b7fe640 1 -- 172.21.15.133:0/3738705015 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1934003530 con 0x7f194c0cc710 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1950e02640 1 -- 172.21.15.133:0/3738705015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 msgr2=0x7f194c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1950e02640 1 --2- 172.21.15.133:0/3738705015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1950e02640 1 -- 172.21.15.133:0/3738705015 >> v1:172.21.15.133:6789/0 conn(0x7f194c0cc710 legacy=0x7f194c161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7f1950e02640 1 -- 172.21.15.133:0/3738705015 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c1616f0 con 0x7f194c0cd380 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7f9f668fe640 1 Processor -- start 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd72f7fe640 1 -- 172.21.15.133:0/3964816181 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000ce90 con 0x7fd7480c9190 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74815a770 con 0x7fd7480c9190 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7480c3ec0 con 0x7fd7480c9190 2023-12-18T10:18:33.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd72f7fe640 1 -- 172.21.15.133:0/3964816181 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74000a5e0 con 0x7fd7480c9190 2023-12-18T10:18:33.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd72f7fe640 1 -- 172.21.15.133:0/3964816181 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000a970 con 0x7fd7480c9190 2023-12-18T10:18:33.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.802+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd728005260 con 0x7fd7480c9190 2023-12-18T10:18:33.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7f9f668fe640 1 -- start start 2023-12-18T10:18:33.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7f9f668fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f58053d90 0x7f9f580d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7f9f668fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 0x7f9f58051af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7fd72f7fe640 1 -- 172.21.15.133:0/3964816181 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd74000aad0 con 0x7fd7480c9190 2023-12-18T10:18:33.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7fd72f7fe640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd734065ab0 0x7fd734067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7f9f658fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f58053d90 0x7f9f580d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7f9f658fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f58053d90 0x7f9f580d8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44380/0 (socket says 172.21.15.133:44380) 2023-12-18T10:18:33.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7f9f658fc640 1 -- 172.21.15.133:0/1118694966 learned_addr learned my addr 172.21.15.133:0/1118694966 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.806+0000 7f9f668fe640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f580e33f0 0x7f9f580d94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580da110 con 0x7f9f580583c0 2023-12-18T10:18:33.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1950e02640 1 --2- 172.21.15.133:0/3738705015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c06c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f193c0097c0 tx=0x7f193c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd93941fd1b1b3d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58052140 con 0x7f9f580e33f0 2023-12-18T10:18:33.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f58052420 con 0x7f9f58053d90 2023-12-18T10:18:33.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f650fb640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 0x7f9f58051af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f660fd640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f580e33f0 0x7f9f580d94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f660fd640 1 -- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f58053d90 msgr2=0x7f9f580d8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f194b7fe640 1 -- 172.21.15.133:0/3738705015 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c0a6040 con 0x7f194c0cd380 2023-12-18T10:18:33.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f194b7fe640 1 -- 172.21.15.133:0/3738705015 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c0aa600 con 0x7f194c0cd380 2023-12-18T10:18:33.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f660fd640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f58053d90 0x7f9f580d8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f660fd640 1 -- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 msgr2=0x7f9f58051af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f660fd640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 0x7f9f58051af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f660fd640 1 -- 172.21.15.133:0/1118694966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f58052700 con 0x7f9f580e33f0 2023-12-18T10:18:33.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f660fd640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f580e33f0 0x7f9f580d94b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f600638f0 tx=0x7f9f60095900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7fd72f7fe640 1 -- 172.21.15.133:0/3964816181 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd740082c00 con 0x7fd7480c9190 2023-12-18T10:18:33.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7fd746ffd640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd734065ab0 0x7fd734067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f194b7fe640 1 -- 172.21.15.133:0/3738705015 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c0a6040 con 0x7f194c0cd380 2023-12-18T10:18:33.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1953066640 1 -- 172.21.15.133:0/3738705015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 msgr2=0x7f194c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1953066640 1 --2- 172.21.15.133:0/3738705015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c06c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f193c0097c0 tx=0x7f193c01c440 comp rx=0 tx=0).stop 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1953066640 1 -- 172.21.15.133:0/3738705015 shutdown_connections 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1953066640 1 --2- 172.21.15.133:0/3738705015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1953066640 1 --2- 172.21.15.133:0/3738705015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c06c8f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1953066640 1 -- 172.21.15.133:0/3738705015 >> 172.21.15.133:0/3738705015 conn(0x7f194c0afe90 msgr2=0x7f194c0b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f567fc640 1 -- 172.21.15.133:0/1118694966 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6012a850 con 0x7f9f580e33f0 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f567fc640 1 -- 172.21.15.133:0/1118694966 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6012a9b0 con 0x7f9f580e33f0 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f567fc640 1 -- 172.21.15.133:0/1118694966 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6012ad60 con 0x7f9f580e33f0 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f580529e0 con 0x7f9f580e33f0 2023-12-18T10:18:33.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f580d99f0 con 0x7f9f580e33f0 2023-12-18T10:18:33.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1953066640 1 -- 172.21.15.133:0/3738705015 shutdown_connections 2023-12-18T10:18:33.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.810+0000 7f1953066640 1 -- 172.21.15.133:0/3738705015 wait complete. 2023-12-18T10:18:33.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7fd746ffd640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd734065ab0 0x7fd734067f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd73c005890 tx=0x7fd73c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7fd72f7fe640 1 -- 172.21.15.133:0/3964816181 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd7400503f0 con 0x7fd7480c9190 2023-12-18T10:18:33.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f74c241f640 1 Processor -- start 2023-12-18T10:18:33.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f9f567fc640 1 -- 172.21.15.133:0/1118694966 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9f60134480 con 0x7f9f580e33f0 2023-12-18T10:18:33.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f9f567fc640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f44065ab0 0x7f9f44067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f9f567fc640 1 -- 172.21.15.133:0/1118694966 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f6016b460 con 0x7f9f580e33f0 2023-12-18T10:18:33.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f74c241f640 1 -- start start 2023-12-18T10:18:33.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f74c241f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74bc15ca40 0x7f74bc0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f74c241f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f74c241f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74bc0cf610 0x7f74bc1605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f74c241f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc0cfa70 con 0x7f74bc15ca40 2023-12-18T10:18:33.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f74c241f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc0d11c0 con 0x7f74bc0cf610 2023-12-18T10:18:33.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f1953066640 1 Processor -- start 2023-12-18T10:18:33.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.814+0000 7f74c241f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc0d0310 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f9f658fc640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f44065ab0 0x7f9f44067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1953066640 1 -- start start 2023-12-18T10:18:33.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f48005260 con 0x7f9f580e33f0 2023-12-18T10:18:33.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74c09bc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74bc0cf610 0x7f74bc1605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74c09bc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f74bc0cf610 0x7f74bc1605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47150/0 (socket says 172.21.15.133:47150) 2023-12-18T10:18:33.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bb7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bb7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44392/0 (socket says 172.21.15.133:44392) 2023-12-18T10:18:33.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bb7fe640 1 -- 172.21.15.133:0/3590248490 learned_addr learned my addr 172.21.15.133:0/3590248490 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f9f658fc640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f44065ab0 0x7f9f44067f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c007fd0 tx=0x7f9f5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bbfff640 1 --2- 172.21.15.133:0/3590248490 >> v2:172.21.15.133:3300/0 conn(0x7f74bc15ca40 0x7f74bc0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bb7fe640 1 -- 172.21.15.133:0/3590248490 >> v2:172.21.15.142:3300/0 conn(0x7f74bc0cf610 msgr2=0x7f74bc1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:33.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bb7fe640 1 --2- 172.21.15.133:0/3590248490 >> v2:172.21.15.142:3300/0 conn(0x7f74bc0cf610 0x7f74bc1605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bb7fe640 1 -- 172.21.15.133:0/3590248490 >> v2:172.21.15.133:3300/0 conn(0x7f74bc15ca40 msgr2=0x7f74bc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:33.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bb7fe640 1 --2- 172.21.15.133:0/3590248490 >> v2:172.21.15.133:3300/0 conn(0x7f74bc15ca40 0x7f74bc0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bb7fe640 1 -- 172.21.15.133:0/3590248490 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc0d05b0 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f74bbfff640 1 --2- 172.21.15.133:0/3590248490 >> v2:172.21.15.133:3300/0 conn(0x7f74bc15ca40 0x7f74bc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:33.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1953066640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f194c0cc710 0x7f194c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1953066640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c15cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1953066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1953066640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c0c8000 con 0x7f194c0cd380 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1953066640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c15c7c0 con 0x7f194c0cc710 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1953066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c15d190 con 0x7f194c1649a0 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f194bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c15cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1950e02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f194c0cc710 0x7f194c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f194bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c15cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48660/0 (socket says 172.21.15.133:48660) 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f194bfff640 1 -- 172.21.15.133:0/299795154 learned_addr learned my addr 172.21.15.133:0/299795154 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f1951603640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f194bfff640 1 -- 172.21.15.133:0/299795154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 msgr2=0x7f194c15f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f194bfff640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c15f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f194bfff640 1 -- 172.21.15.133:0/299795154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f194c0cc710 msgr2=0x7f194c0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f194bfff640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f194c0cc710 0x7f194c0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.818+0000 7f194bfff640 1 -- 172.21.15.133:0/299795154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c009420 con 0x7f194c0cd380 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f194bfff640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c15cc50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1944009d10 tx=0x7f194400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f1951603640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f19497fa640 1 -- 172.21.15.133:0/299795154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944014480 con 0x7f194c0cd380 2023-12-18T10:18:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f19497fa640 1 -- 172.21.15.133:0/299795154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194400f040 con 0x7f194c0cd380 2023-12-18T10:18:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f19497fa640 1 -- 172.21.15.133:0/299795154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440147e0 con 0x7f194c0cd380 2023-12-18T10:18:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f1953066640 1 -- 172.21.15.133:0/299795154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c15bed0 con 0x7f194c0cd380 2023-12-18T10:18:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f1953066640 1 -- 172.21.15.133:0/299795154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c15c450 con 0x7f194c0cd380 2023-12-18T10:18:33.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f1932ffd640 1 -- 172.21.15.133:0/299795154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c04e000 con 0x7f194c0cd380 2023-12-18T10:18:33.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f9f567fc640 1 -- 172.21.15.133:0/1118694966 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9f60167f30 con 0x7f9f580e33f0 2023-12-18T10:18:33.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f74bb7fe640 1 --2- 172.21.15.133:0/3590248490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc0cf0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0b52f0 tx=0x7f74ac01c240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d36e619399da1880 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f74baffd640 1 -- 172.21.15.133:0/3590248490 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0ab600 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f74baffd640 1 -- 172.21.15.133:0/3590248490 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac0a7050 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.822+0000 7f74baffd640 1 -- 172.21.15.133:0/3590248490 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0ab980 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f19497fa640 1 -- 172.21.15.133:0/299795154 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1944014940 con 0x7f194c0cd380 2023-12-18T10:18:33.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f74c241f640 1 -- 172.21.15.133:0/3590248490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 msgr2=0x7f74bc0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f74c241f640 1 --2- 172.21.15.133:0/3590248490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc0cf0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0b52f0 tx=0x7f74ac01c240 comp rx=0 tx=0).stop 2023-12-18T10:18:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f74c241f640 1 -- 172.21.15.133:0/3590248490 shutdown_connections 2023-12-18T10:18:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f74c241f640 1 --2- 172.21.15.133:0/3590248490 >> v2:172.21.15.142:3300/0 conn(0x7f74bc0cf610 0x7f74bc1605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f74c241f640 1 --2- 172.21.15.133:0/3590248490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc0cf0d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f74c241f640 1 --2- 172.21.15.133:0/3590248490 >> v2:172.21.15.133:3300/0 conn(0x7f74bc15ca40 0x7f74bc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f74c241f640 1 -- 172.21.15.133:0/3590248490 >> 172.21.15.133:0/3590248490 conn(0x7f74bc089fb0 msgr2=0x7f74bc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f19497fa640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1938065ab0 0x7f1938067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.830+0000 7f74c241f640 1 -- 172.21.15.133:0/3590248490 shutdown_connections 2023-12-18T10:18:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.830+0000 7f74c241f640 1 -- 172.21.15.133:0/3590248490 wait complete. 2023-12-18T10:18:33.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.826+0000 7f19497fa640 1 -- 172.21.15.133:0/299795154 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1944084a40 con 0x7f194c0cd380 2023-12-18T10:18:33.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.830+0000 7f1950e02640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1938065ab0 0x7f1938067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.830+0000 7f1950e02640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1938065ab0 0x7f1938067f70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f193c0ae000 tx=0x7f193c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.830+0000 7f74c241f640 1 Processor -- start 2023-12-18T10:18:33.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74c241f640 1 -- start start 2023-12-18T10:18:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74c241f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc15f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74c241f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74bc0cf610 0x7f74bc15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74bbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc15f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74bbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc15f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44412/0 (socket says 172.21.15.133:44412) 2023-12-18T10:18:33.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74bb7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74bc0cf610 0x7f74bc15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74bb7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74bc0cf610 0x7f74bc15d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47168/0 (socket says 172.21.15.133:47168) 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74bbfff640 1 -- 172.21.15.133:0/1393724388 learned_addr learned my addr 172.21.15.133:0/1393724388 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.834+0000 7f74c241f640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74bc15ca40 0x7f74bc0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74c09bc640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74bc15ca40 0x7f74bc0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc0b7c90 con 0x7f74bc15ca40 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1503d0 con 0x7f74bc0cf610 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc15fec0 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74bbfff640 1 -- 172.21.15.133:0/1393724388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74bc0cf610 msgr2=0x7f74bc15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74bbfff640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74bc0cf610 0x7f74bc15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74bbfff640 1 -- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74bc15ca40 msgr2=0x7f74bc0b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74bbfff640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74bc15ca40 0x7f74bc0b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74bbfff640 1 -- 172.21.15.133:0/1393724388 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac009480 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74bbfff640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc15f980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f74b000c820 tx=0x7f74b000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f19497fa640 1 -- 172.21.15.133:0/299795154 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1944051900 con 0x7f194c0cd380 2023-12-18T10:18:33.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74b8ff9640 1 -- 172.21.15.133:0/1393724388 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0005ba0 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74b8ff9640 1 -- 172.21.15.133:0/1393724388 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b0005d00 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74bc150080 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.838+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc0b0d10 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.842+0000 7f74b8ff9640 1 -- 172.21.15.133:0/1393724388 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0007a50 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.842+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c005260 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.846+0000 7f74b8ff9640 1 -- 172.21.15.133:0/1393724388 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f74b0007bb0 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.846+0000 7f74b8ff9640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f74a8065a90 0x7f74a8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.846+0000 7f74bb7fe640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f74a8065a90 0x7f74a8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.846+0000 7f74b8ff9640 1 -- 172.21.15.133:0/1393724388 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74b00833b0 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.850+0000 7f74bb7fe640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f74a8065a90 0x7f74a8067f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0ad000 tx=0x7f74ac0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.850+0000 7f74b8ff9640 1 -- 172.21.15.133:0/1393724388 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f74b0050a80 con 0x7f74bc0ce3f0 2023-12-18T10:18:33.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c8611640 1 Processor -- start 2023-12-18T10:18:33.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c8611640 1 -- start start 2023-12-18T10:18:33.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c8611640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93c00cad30 0x7f93c00cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c8611640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93c00abd30 0x7f93c006c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7fa8e9da5640 1 Processor -- start 2023-12-18T10:18:33.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c63ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93c00cad30 0x7f93c00cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7fa8e9da5640 1 -- start start 2023-12-18T10:18:33.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c6bae640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93c00abd30 0x7f93c006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c6bae640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93c00abd30 0x7f93c006c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48686/0 (socket says 172.21.15.133:48686) 2023-12-18T10:18:33.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c63ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93c00cad30 0x7f93c00cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47184/0 (socket says 172.21.15.133:47184) 2023-12-18T10:18:33.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c6bae640 1 -- 172.21.15.133:0/3639687455 learned_addr learned my addr 172.21.15.133:0/3639687455 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c8611640 1 -- 172.21.15.133:0/3639687455 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c006bde0 con 0x7f93c00ab8a0 2023-12-18T10:18:33.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c8611640 1 -- 172.21.15.133:0/3639687455 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c00cb650 con 0x7f93c00abd30 2023-12-18T10:18:33.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.854+0000 7f93c8611640 1 -- 172.21.15.133:0/3639687455 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c0160810 con 0x7f93c00cad30 2023-12-18T10:18:33.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e9da5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8e40c9250 0x7fa8e40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e9da5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e40ac790 con 0x7fa8e415c890 2023-12-18T10:18:33.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e9da5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e415cc70 con 0x7fa8e4160d80 2023-12-18T10:18:33.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e9da5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40ab8a0 con 0x7fa8e40c9250 2023-12-18T10:18:33.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8e40c9250 0x7fa8e40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa8e40c9250 0x7fa8e40acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47196/0 (socket says 172.21.15.133:47196) 2023-12-18T10:18:33.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e3fff640 1 -- 172.21.15.133:0/1853557558 learned_addr learned my addr 172.21.15.133:0/1853557558 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e3fff640 1 -- 172.21.15.133:0/1853557558 >> v1:172.21.15.142:6789/0 conn(0x7fa8e4160d80 legacy=0x7fa8e40c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e3fff640 1 -- 172.21.15.133:0/1853557558 >> v1:172.21.15.133:6789/0 conn(0x7fa8e415c890 legacy=0x7fa8e40cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7fa8e3fff640 1 -- 172.21.15.133:0/1853557558 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40abb80 con 0x7fa8e40c9250 2023-12-18T10:18:33.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7f93c63ad640 1 -- 172.21.15.133:0/3639687455 >> v2:172.21.15.133:3300/0 conn(0x7f93c00abd30 msgr2=0x7f93c006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7f93c63ad640 1 --2- 172.21.15.133:0/3639687455 >> v2:172.21.15.133:3300/0 conn(0x7f93c00abd30 0x7f93c006c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7f93c63ad640 1 -- 172.21.15.133:0/3639687455 >> v1:172.21.15.142:6789/0 conn(0x7f93c00ab8a0 legacy=0x7f93c015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.858+0000 7f93c63ad640 1 -- 172.21.15.133:0/3639687455 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0160af0 con 0x7f93c00cad30 2023-12-18T10:18:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.862+0000 7f93c63ad640 1 --2- 172.21.15.133:0/3639687455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93c00cad30 0x7f93c00cb110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0097c0 tx=0x7f93bc01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cdb0e7eefc22ab server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.862+0000 7f93c53ab640 1 -- 172.21.15.133:0/3639687455 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc0ab600 con 0x7f93c00cad30 2023-12-18T10:18:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.862+0000 7f93c53ab640 1 -- 172.21.15.133:0/3639687455 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc0a7050 con 0x7f93c00cad30 2023-12-18T10:18:33.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.862+0000 7f93c53ab640 1 -- 172.21.15.133:0/3639687455 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc0ab980 con 0x7f93c00cad30 2023-12-18T10:18:33.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.862+0000 7f93c8611640 1 -- 172.21.15.133:0/3639687455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93c00cad30 msgr2=0x7f93c00cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.862+0000 7f93c8611640 1 --2- 172.21.15.133:0/3639687455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93c00cad30 0x7f93c00cb110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0097c0 tx=0x7f93bc01c440 comp rx=0 tx=0).stop 2023-12-18T10:18:33.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7f93c8611640 1 -- 172.21.15.133:0/3639687455 shutdown_connections 2023-12-18T10:18:33.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7f93c8611640 1 --2- 172.21.15.133:0/3639687455 >> v2:172.21.15.133:3300/0 conn(0x7f93c00abd30 0x7f93c006c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7f93c8611640 1 --2- 172.21.15.133:0/3639687455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93c00cad30 0x7f93c00cb110 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7f93c8611640 1 -- 172.21.15.133:0/3639687455 >> 172.21.15.133:0/3639687455 conn(0x7f93c00afe90 msgr2=0x7f93c00b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:33.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7fa8e3fff640 1 --2- 172.21.15.133:0/1853557558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 0x7fa8e40acc20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009e50 tx=0x7fa8dc01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62ebe90550709828 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7f93c8611640 1 -- 172.21.15.133:0/3639687455 shutdown_connections 2023-12-18T10:18:33.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7f93c8611640 1 -- 172.21.15.133:0/3639687455 wait complete. 2023-12-18T10:18:33.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7f93c8611640 1 Processor -- start 2023-12-18T10:18:33.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.866+0000 7f93c8611640 1 -- start start 2023-12-18T10:18:33.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7fa8e27fc640 1 -- 172.21.15.133:0/1853557558 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0a58b0 con 0x7fa8e40c9250 2023-12-18T10:18:33.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7fa8e27fc640 1 -- 172.21.15.133:0/1853557558 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc0a5a10 con 0x7fa8e40c9250 2023-12-18T10:18:33.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7fa8e27fc640 1 -- 172.21.15.133:0/1853557558 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0a5da0 con 0x7fa8e40c9250 2023-12-18T10:18:33.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c8611640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c00ab8a0 0x7f93c0153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c8611640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93c00abd30 0x7f93c01f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c8611640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93c00cad30 0x7f93c0070430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c8611640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c01f9790 con 0x7f93c00ab8a0 2023-12-18T10:18:33.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c8611640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0154010 con 0x7f93c00abd30 2023-12-18T10:18:33.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c8611640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c01f91d0 con 0x7f93c00cad30 2023-12-18T10:18:33.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7fa8e9da5640 1 -- 172.21.15.133:0/1853557558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 msgr2=0x7fa8e40acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7fa8e9da5640 1 --2- 172.21.15.133:0/1853557558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 0x7fa8e40acc20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc009e50 tx=0x7fa8dc01ca00 comp rx=0 tx=0).stop 2023-12-18T10:18:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93c00cad30 0x7f93c0070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93c00cad30 0x7f93c0070430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44424/0 (socket says 172.21.15.133:44424) 2023-12-18T10:18:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 -- 172.21.15.133:0/219202713 learned_addr learned my addr 172.21.15.133:0/219202713 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c63ad640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c00ab8a0 0x7f93c0153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 -- 172.21.15.133:0/219202713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93c00abd30 msgr2=0x7f93c01f8860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-18T10:18:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93c00abd30 0x7f93c01f8860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 -- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c00ab8a0 msgr2=0x7f93c0153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c00ab8a0 0x7f93c0153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 -- 172.21.15.133:0/219202713 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc009420 con 0x7f93c00cad30 2023-12-18T10:18:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7fa8e9da5640 1 -- 172.21.15.133:0/1853557558 shutdown_connections 2023-12-18T10:18:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7fa8e9da5640 1 --2- 172.21.15.133:0/1853557558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 0x7fa8e40acc20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c63ad640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c00ab8a0 0x7f93c0153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.870+0000 7f93c6bae640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93c00cad30 0x7f93c0070430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f93b000e7f0 tx=0x7f93b000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.874+0000 7f93b6ffd640 1 -- 172.21.15.133:0/219202713 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000eea0 con 0x7f93c00cad30 2023-12-18T10:18:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.874+0000 7f93b6ffd640 1 -- 172.21.15.133:0/219202713 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b000c940 con 0x7f93c00cad30 2023-12-18T10:18:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.874+0000 7f93b6ffd640 1 -- 172.21.15.133:0/219202713 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b000ccf0 con 0x7f93c00cad30 2023-12-18T10:18:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.874+0000 7fa8e9da5640 1 -- 172.21.15.133:0/1853557558 >> 172.21.15.133:0/1853557558 conn(0x7fa8e40afc80 msgr2=0x7fa8e40b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.874+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c01f94b0 con 0x7f93c00cad30 2023-12-18T10:18:33.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.874+0000 7fa8e9da5640 1 -- 172.21.15.133:0/1853557558 shutdown_connections 2023-12-18T10:18:33.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.874+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c015e4a0 con 0x7f93c00cad30 2023-12-18T10:18:33.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.874+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c015e690 con 0x7f93c00cad30 2023-12-18T10:18:33.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.878+0000 7fa8e9da5640 1 -- 172.21.15.133:0/1853557558 wait complete. 2023-12-18T10:18:33.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.878+0000 7f93b6ffd640 1 -- 172.21.15.133:0/219202713 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f93b0013470 con 0x7f93c00cad30 2023-12-18T10:18:33.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.878+0000 7f93b6ffd640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93a4065b30 0x7f93a4067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.878+0000 7f93b6ffd640 1 -- 172.21.15.133:0/219202713 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93b0083470 con 0x7f93c00cad30 2023-12-18T10:18:33.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.878+0000 7fa8e9da5640 1 Processor -- start 2023-12-18T10:18:33.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.878+0000 7fa8e9da5640 1 -- start start 2023-12-18T10:18:33.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.878+0000 7f93c63ad640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93a4065b30 0x7f93a4067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7f93c63ad640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93a4065b30 0x7f93a4067ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0ad000 tx=0x7f93bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e9da5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 0x7fa8e40c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e9da5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8e415c890 0x7fa8e40b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e9da5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e4160d80 0x7fa8e40ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 0x7fa8e40c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 0x7fa8e40c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47206/0 (socket says 172.21.15.133:47206) 2023-12-18T10:18:33.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e37fe640 1 -- 172.21.15.133:0/2646632391 learned_addr learned my addr 172.21.15.133:0/2646632391 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:33.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40b3c30 con 0x7fa8e415c890 2023-12-18T10:18:33.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e3fff640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e4160d80 0x7fa8e40ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e415d8b0 con 0x7fa8e40c9250 2023-12-18T10:18:33.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e40c1810 con 0x7fa8e4160d80 2023-12-18T10:18:33.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7f93b6ffd640 1 -- 172.21.15.133:0/219202713 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f93b0050bb0 con 0x7f93c00cad30 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e2ffd640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8e415c890 0x7fa8e40b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e3fff640 1 -- 172.21.15.133:0/2646632391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 msgr2=0x7fa8e40c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e3fff640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 0x7fa8e40c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e3fff640 1 -- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8e415c890 msgr2=0x7fa8e40b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e3fff640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8e415c890 0x7fa8e40b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e3fff640 1 -- 172.21.15.133:0/2646632391 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc009b30 con 0x7fa8e4160d80 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8e3fff640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e4160d80 0x7fa8e40ae3e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0ab000 tx=0x7fa8dc0197a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8cbfff640 1 -- 172.21.15.133:0/2646632391 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0bd070 con 0x7fa8e4160d80 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8cbfff640 1 -- 172.21.15.133:0/2646632391 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8dc009290 con 0x7fa8e4160d80 2023-12-18T10:18:33.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.882+0000 7fa8cbfff640 1 -- 172.21.15.133:0/2646632391 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0b8880 con 0x7fa8e4160d80 2023-12-18T10:18:33.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.886+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e415cf80 con 0x7fa8e4160d80 2023-12-18T10:18:33.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.886+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e415d540 con 0x7fa8e4160d80 2023-12-18T10:18:33.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.886+0000 7fa8e2ffd640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8e415c890 0x7fa8e40b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:33.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.890+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e415da20 con 0x7fa8e4160d80 2023-12-18T10:18:33.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.890+0000 7fa8cbfff640 1 -- 172.21.15.133:0/2646632391 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa8dc0b89e0 con 0x7fa8e4160d80 2023-12-18T10:18:33.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.890+0000 7fa8cbfff640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa8d0065ae0 0x7fa8d0067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:33.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.890+0000 7fa8e37fe640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa8d0065ae0 0x7fa8d0067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:33.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.894+0000 7fa8cbfff640 1 -- 172.21.15.133:0/2646632391 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8dc11e3c0 con 0x7fa8e4160d80 2023-12-18T10:18:33.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.894+0000 7fa8e37fe640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa8d0065ae0 0x7fa8d0067fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4156d50 tx=0x7fa8d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:33.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:33.894+0000 7fa8cbfff640 1 -- 172.21.15.133:0/2646632391 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa8dc0ebb70 con 0x7fa8e4160d80 2023-12-18T10:18:34.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.074+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc7404e000 con 0x7efc740b36e0 2023-12-18T10:18:34.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.074+0000 7efc717fa640 1 -- 172.21.15.133:0/3848027591 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc6c0ef4a0 con 0x7efc740b36e0 2023-12-18T10:18:34.076 INFO:teuthology.orchestra.run.smithi133.stdout:55834574860 2023-12-18T10:18:34.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efc54065b60 msgr2=0x7efc54068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efc54065b60 0x7efc54068020 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efc64000f70 tx=0x7efc64009040 comp rx=0 tx=0).stop 2023-12-18T10:18:34.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740b36e0 msgr2=0x7efc74155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740b36e0 0x7efc74155770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0ab000 tx=0x7efc6c019a40 comp rx=0 tx=0).stop 2023-12-18T10:18:34.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 shutdown_connections 2023-12-18T10:18:34.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efc54065b60 0x7efc54068020 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc740b36e0 0x7efc74155770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc740cd000 0x7efc74155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 --2- 172.21.15.133:0/3848027591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc740c8a80 0x7efc74157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 >> 172.21.15.133:0/3848027591 conn(0x7efc740afc80 msgr2=0x7efc7415c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.078+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 shutdown_connections 2023-12-18T10:18:34.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.082+0000 7efc7adce640 1 -- 172.21.15.133:0/3848027591 wait complete. 2023-12-18T10:18:34.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.082+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbbd00c9b80 con 0x7fbbd00b1b00 2023-12-18T10:18:34.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.082+0000 7fbbb7fff640 1 -- 172.21.15.133:0/3835433795 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbd00c9b80 con 0x7fbbd00b1b00 2023-12-18T10:18:34.085 INFO:teuthology.orchestra.run.smithi133.stdout:55834574860 2023-12-18T10:18:34.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.086+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbbbc065a90 msgr2=0x7fbbbc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.086+0000 7fbbd6152640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbbbc065a90 0x7fbbbc067f50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80ae000 tx=0x7fbbc80a7070 comp rx=0 tx=0).stop 2023-12-18T10:18:34.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.086+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbd00b1b00 msgr2=0x7fbbd01f9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.086+0000 7fbbd6152640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbd00b1b00 0x7fbbd01f9bf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400c3a0 tx=0x7fbbc400c860 comp rx=0 tx=0).stop 2023-12-18T10:18:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.086+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 shutdown_connections 2023-12-18T10:18:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.086+0000 7fbbd6152640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbbbc065a90 0x7fbbbc067f50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.086+0000 7fbbd6152640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbbd00b1b00 0x7fbbd01f9bf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.086+0000 7fbbd6152640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbd006b700 0x7fbbd00b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.090+0000 7fbbd6152640 1 --2- 172.21.15.133:0/3835433795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbd006afb0 0x7fbbd01fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.090+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 >> 172.21.15.133:0/3835433795 conn(0x7fbbd0089fb0 msgr2=0x7fbbd00cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.090+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 shutdown_connections 2023-12-18T10:18:34.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.090+0000 7fbbd6152640 1 -- 172.21.15.133:0/3835433795 wait complete. 2023-12-18T10:18:34.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.1 2023-12-18T10:18:34.118 DEBUG:teuthology.parallel:result is None 2023-12-18T10:18:34.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.0 2023-12-18T10:18:34.127 DEBUG:teuthology.parallel:result is None 2023-12-18T10:18:34.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.130+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd728005510 con 0x7fd7480c9190 2023-12-18T10:18:34.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd72f7fe640 1 -- 172.21.15.133:0/3964816181 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd740053a10 con 0x7fd7480c9190 2023-12-18T10:18:34.135 INFO:teuthology.orchestra.run.smithi133.stdout:55834574858 2023-12-18T10:18:34.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd734065ab0 msgr2=0x7fd734067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd734065ab0 0x7fd734067f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd73c005890 tx=0x7fd73c009040 comp rx=0 tx=0).stop 2023-12-18T10:18:34.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7480c9190 msgr2=0x7fd748159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7480c9190 0x7fd748159a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd74000c780 tx=0x7fd74000cc40 comp rx=0 tx=0).stop 2023-12-18T10:18:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 shutdown_connections 2023-12-18T10:18:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd734065ab0 0x7fd734067f70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7480cd000 0x7fd7480c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7480c9190 0x7fd748159a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 --2- 172.21.15.133:0/3964816181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7480b0770 0x7fd748201ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 >> 172.21.15.133:0/3964816181 conn(0x7fd7480afc80 msgr2=0x7fd74815c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 shutdown_connections 2023-12-18T10:18:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.134+0000 7fd74d42d640 1 -- 172.21.15.133:0/3964816181 wait complete. 2023-12-18T10:18:34.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2023-12-18T10:18:34.158 DEBUG:teuthology.parallel:result is None 2023-12-18T10:18:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.162+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f480057e0 con 0x7f9f580e33f0 2023-12-18T10:18:34.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.162+0000 7f9f567fc640 1 -- 172.21.15.133:0/1118694966 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f601680d0 con 0x7f9f580e33f0 2023-12-18T10:18:34.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.162+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f93c004e000 con 0x7f93c00cad30 2023-12-18T10:18:34.164 INFO:teuthology.orchestra.run.smithi133.stdout:55834574860 2023-12-18T10:18:34.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.162+0000 7f93b6ffd640 1 -- 172.21.15.133:0/219202713 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93b00541d0 con 0x7f93c00cad30 2023-12-18T10:18:34.165 INFO:teuthology.orchestra.run.smithi133.stdout:55834574859 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.162+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93a4065b30 msgr2=0x7f93a4067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.162+0000 7f93c8611640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93a4065b30 0x7f93a4067ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0ad000 tx=0x7f93bc008040 comp rx=0 tx=0).stop 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.162+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93c00cad30 msgr2=0x7f93c0070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.162+0000 7f93c8611640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93c00cad30 0x7f93c0070430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f93b000e7f0 tx=0x7f93b000ecb0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 shutdown_connections 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f93c8611640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93a4065b30 0x7f93a4067ff0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f93c8611640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93c00cad30 0x7f93c0070430 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f93c8611640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93c00abd30 0x7f93c01f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f93c8611640 1 --2- 172.21.15.133:0/219202713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93c00ab8a0 0x7f93c0153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 >> 172.21.15.133:0/219202713 conn(0x7f93c00afe90 msgr2=0x7f93c00ae3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 shutdown_connections 2023-12-18T10:18:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f93c8611640 1 -- 172.21.15.133:0/219202713 wait complete. 2023-12-18T10:18:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f44065ab0 msgr2=0x7f9f44067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f44065ab0 0x7f9f44067f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c007fd0 tx=0x7f9f5c009040 comp rx=0 tx=0).stop 2023-12-18T10:18:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f580e33f0 msgr2=0x7f9f580d94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f580e33f0 0x7f9f580d94b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f600638f0 tx=0x7f9f60095900 comp rx=0 tx=0).stop 2023-12-18T10:18:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 shutdown_connections 2023-12-18T10:18:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f44065ab0 0x7f9f44067f70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f580e33f0 0x7f9f580d94b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f580583c0 0x7f9f58051af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 --2- 172.21.15.133:0/1118694966 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f58053d90 0x7f9f580d8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 >> 172.21.15.133:0/1118694966 conn(0x7f9f58055a40 msgr2=0x7f9f580e2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 shutdown_connections 2023-12-18T10:18:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.166+0000 7f9f668fe640 1 -- 172.21.15.133:0/1118694966 wait complete. 2023-12-18T10:18:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.170+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f749c0057e0 con 0x7f74bc0ce3f0 2023-12-18T10:18:34.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.170+0000 7f74b8ff9640 1 -- 172.21.15.133:0/1393724388 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74b001e090 con 0x7f74bc0ce3f0 2023-12-18T10:18:34.173 INFO:teuthology.orchestra.run.smithi133.stdout:55834574859 2023-12-18T10:18:34.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.170+0000 7f1932ffd640 1 -- 172.21.15.133:0/299795154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f194c15c900 con 0x7f194c0cd380 2023-12-18T10:18:34.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.170+0000 7f19497fa640 1 -- 172.21.15.133:0/299795154 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1944018070 con 0x7f194c0cd380 2023-12-18T10:18:34.174 INFO:teuthology.orchestra.run.smithi133.stdout:55834574860 2023-12-18T10:18:34.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f74a8065a90 msgr2=0x7f74a8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f74a8065a90 0x7f74a8067f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0ad000 tx=0x7f74ac0a6000 comp rx=0 tx=0).stop 2023-12-18T10:18:34.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 msgr2=0x7f74bc15f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc15f980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f74b000c820 tx=0x7f74b000cc20 comp rx=0 tx=0).stop 2023-12-18T10:18:34.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 shutdown_connections 2023-12-18T10:18:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f74a8065a90 0x7f74a8067f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74bc15ca40 0x7f74bc0b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74bc0cf610 0x7f74bc15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 --2- 172.21.15.133:0/1393724388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f74bc0ce3f0 0x7f74bc15f980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 >> 172.21.15.133:0/1393724388 conn(0x7f74bc089fb0 msgr2=0x7f74bc06ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 shutdown_connections 2023-12-18T10:18:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f74c241f640 1 -- 172.21.15.133:0/1393724388 wait complete. 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 -- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1938065ab0 msgr2=0x7f1938067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1938065ab0 0x7f1938067f70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f193c0ae000 tx=0x7f193c0a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 -- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 msgr2=0x7f194c15cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c15cc50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1944009d10 tx=0x7f194400c490 comp rx=0 tx=0).stop 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 -- 172.21.15.133:0/299795154 shutdown_connections 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1938065ab0 0x7f1938067f70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f194c1649a0 0x7f194c15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f194c0cd380 0x7f194c15cc50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 --2- 172.21.15.133:0/299795154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f194c0cc710 0x7f194c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 -- 172.21.15.133:0/299795154 >> 172.21.15.133:0/299795154 conn(0x7f194c0afe90 msgr2=0x7f194c0cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.174+0000 7f1932ffd640 1 -- 172.21.15.133:0/299795154 shutdown_connections 2023-12-18T10:18:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.178+0000 7f1932ffd640 1 -- 172.21.15.133:0/299795154 wait complete. 2023-12-18T10:18:34.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.3 2023-12-18T10:18:34.194 DEBUG:teuthology.parallel:result is None 2023-12-18T10:18:34.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.7 2023-12-18T10:18:34.202 DEBUG:teuthology.parallel:result is None 2023-12-18T10:18:34.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.4 2023-12-18T10:18:34.209 DEBUG:teuthology.parallel:result is None 2023-12-18T10:18:34.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.2 2023-12-18T10:18:34.214 DEBUG:teuthology.parallel:result is None 2023-12-18T10:18:34.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.214+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa8e404e000 con 0x7fa8e4160d80 2023-12-18T10:18:34.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.214+0000 7fa8cbfff640 1 -- 172.21.15.133:0/2646632391 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8dc0ef190 con 0x7fa8e4160d80 2023-12-18T10:18:34.218 INFO:teuthology.orchestra.run.smithi133.stdout:55834574860 2023-12-18T10:18:34.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa8d0065ae0 msgr2=0x7fa8d0067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa8d0065ae0 0x7fa8d0067fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4156d50 tx=0x7fa8d4009040 comp rx=0 tx=0).stop 2023-12-18T10:18:34.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e4160d80 msgr2=0x7fa8e40ae3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e4160d80 0x7fa8e40ae3e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0ab000 tx=0x7fa8dc0197a0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 shutdown_connections 2023-12-18T10:18:34.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa8d0065ae0 0x7fa8d0067fa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa8e4160d80 0x7fa8e40ae3e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8e415c890 0x7fa8e40b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 --2- 172.21.15.133:0/2646632391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa8e40c9250 0x7fa8e40c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 >> 172.21.15.133:0/2646632391 conn(0x7fa8e40afc80 msgr2=0x7fa8e40c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 shutdown_connections 2023-12-18T10:18:34.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.218+0000 7fa8e9da5640 1 -- 172.21.15.133:0/2646632391 wait complete. 2023-12-18T10:18:34.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.5 2023-12-18T10:18:34.239 DEBUG:teuthology.parallel:result is None 2023-12-18T10:18:34.239 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-18T10:18:34.239 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:18:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe15a2640 1 Processor -- start 2023-12-18T10:18:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe15a2640 1 -- start start 2023-12-18T10:18:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe15a2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6fdc15c730 0x7f6fdc0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe15a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cea00 0x7f6fdc0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe15a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc0b65c0 con 0x7f6fdc0cd3a0 2023-12-18T10:18:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe15a2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc15cb10 con 0x7f6fdc15c730 2023-12-18T10:18:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe15a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0b84c0 con 0x7f6fdc0cea00 2023-12-18T10:18:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fdbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6fdc15c730 0x7f6fdc0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe0da1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6fdc0cd3a0 0x7f6fdc0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48236/0 (socket says 172.21.15.133:48236) 2023-12-18T10:18:34.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fe0da1640 1 -- 172.21.15.133:0/4244677232 learned_addr learned my addr 172.21.15.133:0/4244677232 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fdb7fe640 1 --2- 172.21.15.133:0/4244677232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cea00 0x7f6fdc0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fdbfff640 1 -- 172.21.15.133:0/4244677232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cea00 msgr2=0x7f6fdc0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fdbfff640 1 --2- 172.21.15.133:0/4244677232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cea00 0x7f6fdc0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fdbfff640 1 -- 172.21.15.133:0/4244677232 >> v1:172.21.15.133:6789/0 conn(0x7f6fdc0cd3a0 legacy=0x7f6fdc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fdbfff640 1 -- 172.21.15.133:0/4244677232 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0cd960 con 0x7f6fdc15c730 2023-12-18T10:18:34.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.422+0000 7f6fdaffd640 1 -- 172.21.15.133:0/4244677232 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412361400 0 0) 0x7f6fdc0b65c0 con 0x7f6fdc0cd3a0 2023-12-18T10:18:34.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fdbfff640 1 --2- 172.21.15.133:0/4244677232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc0b7f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0097c0 tx=0x7f6fcc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8324196561705841 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:34.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fdaffd640 1 -- 172.21.15.133:0/4244677232 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0a8970 con 0x7f6fdc15c730 2023-12-18T10:18:34.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fdaffd640 1 -- 172.21.15.133:0/4244677232 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc0a8ad0 con 0x7f6fdc15c730 2023-12-18T10:18:34.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fdaffd640 1 -- 172.21.15.133:0/4244677232 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0a8e60 con 0x7f6fdc15c730 2023-12-18T10:18:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fe15a2640 1 -- 172.21.15.133:0/4244677232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 msgr2=0x7f6fdc0b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/4244677232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc0b7f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0097c0 tx=0x7f6fcc01ec70 comp rx=0 tx=0).stop 2023-12-18T10:18:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fe15a2640 1 -- 172.21.15.133:0/4244677232 shutdown_connections 2023-12-18T10:18:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/4244677232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cea00 0x7f6fdc0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/4244677232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc0b7f80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fe15a2640 1 -- 172.21.15.133:0/4244677232 >> 172.21.15.133:0/4244677232 conn(0x7f6fdc06b120 msgr2=0x7f6fdc06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fe15a2640 1 -- 172.21.15.133:0/4244677232 shutdown_connections 2023-12-18T10:18:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.426+0000 7f6fe15a2640 1 -- 172.21.15.133:0/4244677232 wait complete. 2023-12-18T10:18:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 Processor -- start 2023-12-18T10:18:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 -- start start 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cd3a0 0x7f6fdc15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc0cea00 0x7f6fdc149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0cc130 con 0x7f6fdc15c730 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc1e4f60 con 0x7f6fdc0cea00 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc1e5240 con 0x7f6fdc0cd3a0 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc15a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48742/0 (socket says 172.21.15.133:48742) 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 -- 172.21.15.133:0/3075235108 learned_addr learned my addr 172.21.15.133:0/3075235108 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fdbfff640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cd3a0 0x7f6fdc15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fdb7fe640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc0cea00 0x7f6fdc149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 -- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cd3a0 msgr2=0x7f6fdc15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cd3a0 0x7f6fdc15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 -- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc0cea00 msgr2=0x7f6fdc149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc0cea00 0x7f6fdc149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 -- 172.21.15.133:0/3075235108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc009420 con 0x7f6fdc15c730 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fdbfff640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cd3a0 0x7f6fdc15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fdb7fe640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc0cea00 0x7f6fdc149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe0da1640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc15a850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400cb30 tx=0x7f6fd400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fd8ff9640 1 -- 172.21.15.133:0/3075235108 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400aca0 con 0x7f6fdc15c730 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fd8ff9640 1 -- 172.21.15.133:0/3075235108 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd400ae20 con 0x7f6fdc15c730 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc1e5520 con 0x7f6fdc15c730 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fd8ff9640 1 -- 172.21.15.133:0/3075235108 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4012640 con 0x7f6fdc15c730 2023-12-18T10:18:34.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.430+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0cc410 con 0x7f6fdc15c730 2023-12-18T10:18:34.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.434+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc066c50 con 0x7f6fdc15c730 2023-12-18T10:18:34.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.434+0000 7f6fd8ff9640 1 -- 172.21.15.133:0/3075235108 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6fd4007070 con 0x7f6fdc15c730 2023-12-18T10:18:34.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.434+0000 7f6fd8ff9640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6fc8065a60 0x7f6fc8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.434+0000 7f6fd8ff9640 1 -- 172.21.15.133:0/3075235108 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6fd40834d0 con 0x7f6fdc15c730 2023-12-18T10:18:34.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.434+0000 7f6fdbfff640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6fc8065a60 0x7f6fc8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.434+0000 7f6fdbfff640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6fc8065a60 0x7f6fc8067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0b2000 tx=0x7f6fcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:34.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.438+0000 7f6fd8ff9640 1 -- 172.21.15.133:0/3075235108 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6fd4050b90 con 0x7f6fdc15c730 2023-12-18T10:18:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.586+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fdc0cdf20 con 0x7f6fc8065a60 2023-12-18T10:18:34.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.594+0000 7f6fd8ff9640 1 -- 172.21.15.133:0/3075235108 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345193 (secure 0 0 0) 0x7f6fcc0b04c0 con 0x7f6fc8065a60 2023-12-18T10:18:34.600 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:18:34.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6fc8065a60 msgr2=0x7f6fc8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6fc8065a60 0x7f6fc8067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0b2000 tx=0x7f6fcc008040 comp rx=0 tx=0).stop 2023-12-18T10:18:34.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 msgr2=0x7f6fdc15a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc15a850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400cb30 tx=0x7f6fd400a060 comp rx=0 tx=0).stop 2023-12-18T10:18:34.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 shutdown_connections 2023-12-18T10:18:34.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6fc8065a60 0x7f6fc8067f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fdc15c730 0x7f6fdc15a850 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fdc0cea00 0x7f6fdc149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 --2- 172.21.15.133:0/3075235108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6fdc0cd3a0 0x7f6fdc15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 >> 172.21.15.133:0/3075235108 conn(0x7f6fdc06b120 msgr2=0x7f6fdc0b5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 shutdown_connections 2023-12-18T10:18:34.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.598+0000 7f6fe15a2640 1 -- 172.21.15.133:0/3075235108 wait complete. 2023-12-18T10:18:34.620 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-18T10:18:33.100821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1988164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002582"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647104+0000","last_change":"2023-12-18T10:18:05.252867+0000","last_active":"2023-12-18T10:18:09.647104+0000","last_peered":"2023-12-18T10:18:09.647104+0000","last_clean":"2023-12-18T10:18:09.647104+0000","last_became_active":"2023-12-18T10:18:05.252419+0000","last_became_peered":"2023-12-18T10:18:05.252419+0000","last_unstale":"2023-12-18T10:18:09.647104+0000","last_undegraded":"2023-12-18T10:18:09.647104+0000","last_fullsized":"2023-12-18T10:18:09.647104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:47:42.905512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645468+0000","last_change":"2023-12-18T10:18:05.643046+0000","last_active":"2023-12-18T10:18:09.645468+0000","last_peered":"2023-12-18T10:18:09.645468+0000","last_clean":"2023-12-18T10:18:09.645468+0000","last_became_active":"2023-12-18T10:18:05.642791+0000","last_became_peered":"2023-12-18T10:18:05.642791+0000","last_unstale":"2023-12-18T10:18:09.645468+0000","last_undegraded":"2023-12-18T10:18:09.645468+0000","last_fullsized":"2023-12-18T10:18:09.645468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034832+0000","last_change":"2023-12-18T10:18:09.709220+0000","last_active":"2023-12-18T10:18:10.034832+0000","last_peered":"2023-12-18T10:18:10.034832+0000","last_clean":"2023-12-18T10:18:10.034832+0000","last_became_active":"2023-12-18T10:18:09.708175+0000","last_became_peered":"2023-12-18T10:18:09.708175+0000","last_unstale":"2023-12-18T10:18:10.034832+0000","last_undegraded":"2023-12-18T10:18:10.034832+0000","last_fullsized":"2023-12-18T10:18:10.034832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:02.059562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648001+0000","last_change":"2023-12-18T10:18:05.240468+0000","last_active":"2023-12-18T10:18:09.648001+0000","last_peered":"2023-12-18T10:18:09.648001+0000","last_clean":"2023-12-18T10:18:09.648001+0000","last_became_active":"2023-12-18T10:18:05.239955+0000","last_became_peered":"2023-12-18T10:18:05.239955+0000","last_unstale":"2023-12-18T10:18:09.648001+0000","last_undegraded":"2023-12-18T10:18:09.648001+0000","last_fullsized":"2023-12-18T10:18:09.648001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646951+0000","last_change":"2023-12-18T10:18:05.648087+0000","last_active":"2023-12-18T10:18:09.646951+0000","last_peered":"2023-12-18T10:18:09.646951+0000","last_clean":"2023-12-18T10:18:09.646951+0000","last_became_active":"2023-12-18T10:18:05.647265+0000","last_became_peered":"2023-12-18T10:18:05.647265+0000","last_unstale":"2023-12-18T10:18:09.646951+0000","last_undegraded":"2023-12-18T10:18:09.646951+0000","last_fullsized":"2023-12-18T10:18:09.646951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:15.127242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171471+0000","last_change":"2023-12-18T10:18:09.667338+0000","last_active":"2023-12-18T10:18:11.171471+0000","last_peered":"2023-12-18T10:18:11.171471+0000","last_clean":"2023-12-18T10:18:11.171471+0000","last_became_active":"2023-12-18T10:18:09.666888+0000","last_became_peered":"2023-12-18T10:18:09.666888+0000","last_unstale":"2023-12-18T10:18:11.171471+0000","last_undegraded":"2023-12-18T10:18:11.171471+0000","last_fullsized":"2023-12-18T10:18:11.171471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:21.579648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704718+0000","last_change":"2023-12-18T10:18:05.255666+0000","last_active":"2023-12-18T10:18:09.704718+0000","last_peered":"2023-12-18T10:18:09.704718+0000","last_clean":"2023-12-18T10:18:09.704718+0000","last_became_active":"2023-12-18T10:18:05.255121+0000","last_became_peered":"2023-12-18T10:18:05.255121+0000","last_unstale":"2023-12-18T10:18:09.704718+0000","last_undegraded":"2023-12-18T10:18:09.704718+0000","last_fullsized":"2023-12-18T10:18:09.704718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:19.309867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646594+0000","last_change":"2023-12-18T10:18:05.651636+0000","last_active":"2023-12-18T10:18:09.646594+0000","last_peered":"2023-12-18T10:18:09.646594+0000","last_clean":"2023-12-18T10:18:09.646594+0000","last_became_active":"2023-12-18T10:18:05.651333+0000","last_became_peered":"2023-12-18T10:18:05.651333+0000","last_unstale":"2023-12-18T10:18:09.646594+0000","last_undegraded":"2023-12-18T10:18:09.646594+0000","last_fullsized":"2023-12-18T10:18:09.646594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171893+0000","last_change":"2023-12-18T10:18:09.672786+0000","last_active":"2023-12-18T10:18:11.171893+0000","last_peered":"2023-12-18T10:18:11.171893+0000","last_clean":"2023-12-18T10:18:11.171893+0000","last_became_active":"2023-12-18T10:18:09.672297+0000","last_became_peered":"2023-12-18T10:18:09.672297+0000","last_unstale":"2023-12-18T10:18:11.171893+0000","last_undegraded":"2023-12-18T10:18:11.171893+0000","last_fullsized":"2023-12-18T10:18:11.171893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704387+0000","last_change":"2023-12-18T10:18:05.259470+0000","last_active":"2023-12-18T10:18:09.704387+0000","last_peered":"2023-12-18T10:18:09.704387+0000","last_clean":"2023-12-18T10:18:09.704387+0000","last_became_active":"2023-12-18T10:18:05.259178+0000","last_became_peered":"2023-12-18T10:18:05.259178+0000","last_unstale":"2023-12-18T10:18:09.704387+0000","last_undegraded":"2023-12-18T10:18:09.704387+0000","last_fullsized":"2023-12-18T10:18:09.704387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:18.551106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645863+0000","last_change":"2023-12-18T10:18:05.647456+0000","last_active":"2023-12-18T10:18:09.645863+0000","last_peered":"2023-12-18T10:18:09.645863+0000","last_clean":"2023-12-18T10:18:09.645863+0000","last_became_active":"2023-12-18T10:18:05.647171+0000","last_became_peered":"2023-12-18T10:18:05.647171+0000","last_unstale":"2023-12-18T10:18:09.645863+0000","last_undegraded":"2023-12-18T10:18:09.645863+0000","last_fullsized":"2023-12-18T10:18:09.645863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171921+0000","last_change":"2023-12-18T10:18:09.663391+0000","last_active":"2023-12-18T10:18:11.171921+0000","last_peered":"2023-12-18T10:18:11.171921+0000","last_clean":"2023-12-18T10:18:11.171921+0000","last_became_active":"2023-12-18T10:18:09.662939+0000","last_became_peered":"2023-12-18T10:18:09.662939+0000","last_unstale":"2023-12-18T10:18:11.171921+0000","last_undegraded":"2023-12-18T10:18:11.171921+0000","last_fullsized":"2023-12-18T10:18:11.171921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:40.435617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648575+0000","last_change":"2023-12-18T10:18:05.631751+0000","last_active":"2023-12-18T10:18:09.648575+0000","last_peered":"2023-12-18T10:18:09.648575+0000","last_clean":"2023-12-18T10:18:09.648575+0000","last_became_active":"2023-12-18T10:18:05.631484+0000","last_became_peered":"2023-12-18T10:18:05.631484+0000","last_unstale":"2023-12-18T10:18:09.648575+0000","last_undegraded":"2023-12-18T10:18:09.648575+0000","last_fullsized":"2023-12-18T10:18:09.648575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704350+0000","last_change":"2023-12-18T10:18:05.249053+0000","last_active":"2023-12-18T10:18:09.704350+0000","last_peered":"2023-12-18T10:18:09.704350+0000","last_clean":"2023-12-18T10:18:09.704350+0000","last_became_active":"2023-12-18T10:18:05.248510+0000","last_became_peered":"2023-12-18T10:18:05.248510+0000","last_unstale":"2023-12-18T10:18:09.704350+0000","last_undegraded":"2023-12-18T10:18:09.704350+0000","last_fullsized":"2023-12-18T10:18:09.704350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172429+0000","last_change":"2023-12-18T10:18:09.674408+0000","last_active":"2023-12-18T10:18:11.172429+0000","last_peered":"2023-12-18T10:18:11.172429+0000","last_clean":"2023-12-18T10:18:11.172429+0000","last_became_active":"2023-12-18T10:18:09.673681+0000","last_became_peered":"2023-12-18T10:18:09.673681+0000","last_unstale":"2023-12-18T10:18:11.172429+0000","last_undegraded":"2023-12-18T10:18:11.172429+0000","last_fullsized":"2023-12-18T10:18:11.172429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642885+0000","last_change":"2023-12-18T10:18:05.635754+0000","last_active":"2023-12-18T10:18:09.642885+0000","last_peered":"2023-12-18T10:18:09.642885+0000","last_clean":"2023-12-18T10:18:09.642885+0000","last_became_active":"2023-12-18T10:18:05.635426+0000","last_became_peered":"2023-12-18T10:18:05.635426+0000","last_unstale":"2023-12-18T10:18:09.642885+0000","last_undegraded":"2023-12-18T10:18:09.642885+0000","last_fullsized":"2023-12-18T10:18:09.642885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637872+0000","last_change":"2023-12-18T10:18:05.237366+0000","last_active":"2023-12-18T10:18:09.637872+0000","last_peered":"2023-12-18T10:18:09.637872+0000","last_clean":"2023-12-18T10:18:09.637872+0000","last_became_active":"2023-12-18T10:18:05.237115+0000","last_became_peered":"2023-12-18T10:18:05.237115+0000","last_unstale":"2023-12-18T10:18:09.637872+0000","last_undegraded":"2023-12-18T10:18:09.637872+0000","last_fullsized":"2023-12-18T10:18:09.637872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172373+0000","last_change":"2023-12-18T10:18:09.672293+0000","last_active":"2023-12-18T10:18:11.172373+0000","last_peered":"2023-12-18T10:18:11.172373+0000","last_clean":"2023-12-18T10:18:11.172373+0000","last_became_active":"2023-12-18T10:18:09.671846+0000","last_became_peered":"2023-12-18T10:18:09.671846+0000","last_unstale":"2023-12-18T10:18:11.172373+0000","last_undegraded":"2023-12-18T10:18:11.172373+0000","last_fullsized":"2023-12-18T10:18:11.172373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:15:09.032674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.640106+0000","last_change":"2023-12-18T10:18:05.626910+0000","last_active":"2023-12-18T10:18:09.640106+0000","last_peered":"2023-12-18T10:18:09.640106+0000","last_clean":"2023-12-18T10:18:09.640106+0000","last_became_active":"2023-12-18T10:18:05.623599+0000","last_became_peered":"2023-12-18T10:18:05.623599+0000","last_unstale":"2023-12-18T10:18:09.640106+0000","last_undegraded":"2023-12-18T10:18:09.640106+0000","last_fullsized":"2023-12-18T10:18:09.640106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637099+0000","last_change":"2023-12-18T10:18:05.233603+0000","last_active":"2023-12-18T10:18:09.637099+0000","last_peered":"2023-12-18T10:18:09.637099+0000","last_clean":"2023-12-18T10:18:09.637099+0000","last_became_active":"2023-12-18T10:18:05.233168+0000","last_became_peered":"2023-12-18T10:18:05.233168+0000","last_unstale":"2023-12-18T10:18:09.637099+0000","last_undegraded":"2023-12-18T10:18:09.637099+0000","last_fullsized":"2023-12-18T10:18:09.637099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168704+0000","last_change":"2023-12-18T10:18:09.706676+0000","last_active":"2023-12-18T10:18:11.168704+0000","last_peered":"2023-12-18T10:18:11.168704+0000","last_clean":"2023-12-18T10:18:11.168704+0000","last_became_active":"2023-12-18T10:18:09.705912+0000","last_became_peered":"2023-12-18T10:18:09.705912+0000","last_unstale":"2023-12-18T10:18:11.168704+0000","last_undegraded":"2023-12-18T10:18:11.168704+0000","last_fullsized":"2023-12-18T10:18:11.168704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:57:16.183086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647321+0000","last_change":"2023-12-18T10:18:05.633413+0000","last_active":"2023-12-18T10:18:09.647321+0000","last_peered":"2023-12-18T10:18:09.647321+0000","last_clean":"2023-12-18T10:18:09.647321+0000","last_became_active":"2023-12-18T10:18:05.633042+0000","last_became_peered":"2023-12-18T10:18:05.633042+0000","last_unstale":"2023-12-18T10:18:09.647321+0000","last_undegraded":"2023-12-18T10:18:09.647321+0000","last_fullsized":"2023-12-18T10:18:09.647321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:04.543394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.703942+0000","last_change":"2023-12-18T10:18:05.247809+0000","last_active":"2023-12-18T10:18:09.703942+0000","last_peered":"2023-12-18T10:18:09.703942+0000","last_clean":"2023-12-18T10:18:09.703942+0000","last_became_active":"2023-12-18T10:18:05.247430+0000","last_became_peered":"2023-12-18T10:18:05.247430+0000","last_unstale":"2023-12-18T10:18:09.703942+0000","last_undegraded":"2023-12-18T10:18:09.703942+0000","last_fullsized":"2023-12-18T10:18:09.703942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172259+0000","last_change":"2023-12-18T10:18:09.673789+0000","last_active":"2023-12-18T10:18:11.172259+0000","last_peered":"2023-12-18T10:18:11.172259+0000","last_clean":"2023-12-18T10:18:11.172259+0000","last_became_active":"2023-12-18T10:18:09.672245+0000","last_became_peered":"2023-12-18T10:18:09.672245+0000","last_unstale":"2023-12-18T10:18:11.172259+0000","last_undegraded":"2023-12-18T10:18:11.172259+0000","last_fullsized":"2023-12-18T10:18:11.172259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:57:16.183086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646514+0000","last_change":"2023-12-18T10:18:05.618676+0000","last_active":"2023-12-18T10:18:09.646514+0000","last_peered":"2023-12-18T10:18:09.646514+0000","last_clean":"2023-12-18T10:18:09.646514+0000","last_became_active":"2023-12-18T10:18:05.617947+0000","last_became_peered":"2023-12-18T10:18:05.617947+0000","last_unstale":"2023-12-18T10:18:09.646514+0000","last_undegraded":"2023-12-18T10:18:09.646514+0000","last_fullsized":"2023-12-18T10:18:09.646514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:17.447234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649866+0000","last_change":"2023-12-18T10:18:05.252886+0000","last_active":"2023-12-18T10:18:09.649866+0000","last_peered":"2023-12-18T10:18:09.649866+0000","last_clean":"2023-12-18T10:18:09.649866+0000","last_became_active":"2023-12-18T10:18:05.252552+0000","last_became_peered":"2023-12-18T10:18:05.252552+0000","last_unstale":"2023-12-18T10:18:09.649866+0000","last_undegraded":"2023-12-18T10:18:09.649866+0000","last_fullsized":"2023-12-18T10:18:09.649866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171556+0000","last_change":"2023-12-18T10:18:09.708967+0000","last_active":"2023-12-18T10:18:11.171556+0000","last_peered":"2023-12-18T10:18:11.171556+0000","last_clean":"2023-12-18T10:18:11.171556+0000","last_became_active":"2023-12-18T10:18:09.708596+0000","last_became_peered":"2023-12-18T10:18:09.708596+0000","last_unstale":"2023-12-18T10:18:11.171556+0000","last_undegraded":"2023-12-18T10:18:11.171556+0000","last_fullsized":"2023-12-18T10:18:11.171556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:17.773172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650186+0000","last_change":"2023-12-18T10:18:05.636290+0000","last_active":"2023-12-18T10:18:09.650186+0000","last_peered":"2023-12-18T10:18:09.650186+0000","last_clean":"2023-12-18T10:18:09.650186+0000","last_became_active":"2023-12-18T10:18:05.636016+0000","last_became_peered":"2023-12-18T10:18:05.636016+0000","last_unstale":"2023-12-18T10:18:09.650186+0000","last_undegraded":"2023-12-18T10:18:09.650186+0000","last_fullsized":"2023-12-18T10:18:09.650186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637989+0000","last_change":"2023-12-18T10:18:05.249790+0000","last_active":"2023-12-18T10:18:09.637989+0000","last_peered":"2023-12-18T10:18:09.637989+0000","last_clean":"2023-12-18T10:18:09.637989+0000","last_became_active":"2023-12-18T10:18:05.249433+0000","last_became_peered":"2023-12-18T10:18:05.249433+0000","last_unstale":"2023-12-18T10:18:09.637989+0000","last_undegraded":"2023-12-18T10:18:09.637989+0000","last_fullsized":"2023-12-18T10:18:09.637989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:19.309867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034309+0000","last_change":"2023-12-18T10:18:09.708773+0000","last_active":"2023-12-18T10:18:10.034309+0000","last_peered":"2023-12-18T10:18:10.034309+0000","last_clean":"2023-12-18T10:18:10.034309+0000","last_became_active":"2023-12-18T10:18:09.708308+0000","last_became_peered":"2023-12-18T10:18:09.708308+0000","last_unstale":"2023-12-18T10:18:10.034309+0000","last_undegraded":"2023-12-18T10:18:10.034309+0000","last_fullsized":"2023-12-18T10:18:10.034309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:47:06.075688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638426+0000","last_change":"2023-12-18T10:18:05.631244+0000","last_active":"2023-12-18T10:18:09.638426+0000","last_peered":"2023-12-18T10:18:09.638426+0000","last_clean":"2023-12-18T10:18:09.638426+0000","last_became_active":"2023-12-18T10:18:05.630991+0000","last_became_peered":"2023-12-18T10:18:05.630991+0000","last_unstale":"2023-12-18T10:18:09.638426+0000","last_undegraded":"2023-12-18T10:18:09.638426+0000","last_fullsized":"2023-12-18T10:18:09.638426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704655+0000","last_change":"2023-12-18T10:18:05.250025+0000","last_active":"2023-12-18T10:18:09.704655+0000","last_peered":"2023-12-18T10:18:09.704655+0000","last_clean":"2023-12-18T10:18:09.704655+0000","last_became_active":"2023-12-18T10:18:05.249699+0000","last_became_peered":"2023-12-18T10:18:05.249699+0000","last_unstale":"2023-12-18T10:18:09.704655+0000","last_undegraded":"2023-12-18T10:18:09.704655+0000","last_fullsized":"2023-12-18T10:18:09.704655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169743+0000","last_change":"2023-12-18T10:18:09.706868+0000","last_active":"2023-12-18T10:18:11.169743+0000","last_peered":"2023-12-18T10:18:11.169743+0000","last_clean":"2023-12-18T10:18:11.169743+0000","last_became_active":"2023-12-18T10:18:09.706468+0000","last_became_peered":"2023-12-18T10:18:09.706468+0000","last_unstale":"2023-12-18T10:18:11.169743+0000","last_undegraded":"2023-12-18T10:18:11.169743+0000","last_fullsized":"2023-12-18T10:18:11.169743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645946+0000","last_change":"2023-12-18T10:18:05.645165+0000","last_active":"2023-12-18T10:18:09.645946+0000","last_peered":"2023-12-18T10:18:09.645946+0000","last_clean":"2023-12-18T10:18:09.645946+0000","last_became_active":"2023-12-18T10:18:05.644797+0000","last_became_peered":"2023-12-18T10:18:05.644797+0000","last_unstale":"2023-12-18T10:18:09.645946+0000","last_undegraded":"2023-12-18T10:18:09.645946+0000","last_fullsized":"2023-12-18T10:18:09.645946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:14.759979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638502+0000","last_change":"2023-12-18T10:18:05.240747+0000","last_active":"2023-12-18T10:18:09.638502+0000","last_peered":"2023-12-18T10:18:09.638502+0000","last_clean":"2023-12-18T10:18:09.638502+0000","last_became_active":"2023-12-18T10:18:05.240498+0000","last_became_peered":"2023-12-18T10:18:05.240498+0000","last_unstale":"2023-12-18T10:18:09.638502+0000","last_undegraded":"2023-12-18T10:18:09.638502+0000","last_fullsized":"2023-12-18T10:18:09.638502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168534+0000","last_change":"2023-12-18T10:18:09.668534+0000","last_active":"2023-12-18T10:18:11.168534+0000","last_peered":"2023-12-18T10:18:11.168534+0000","last_clean":"2023-12-18T10:18:11.168534+0000","last_became_active":"2023-12-18T10:18:09.667999+0000","last_became_peered":"2023-12-18T10:18:09.667999+0000","last_unstale":"2023-12-18T10:18:11.168534+0000","last_undegraded":"2023-12-18T10:18:11.168534+0000","last_fullsized":"2023-12-18T10:18:11.168534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:21.579648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649514+0000","last_change":"2023-12-18T10:18:05.631117+0000","last_active":"2023-12-18T10:18:09.649514+0000","last_peered":"2023-12-18T10:18:09.649514+0000","last_clean":"2023-12-18T10:18:09.649514+0000","last_became_active":"2023-12-18T10:18:05.629667+0000","last_became_peered":"2023-12-18T10:18:05.629667+0000","last_unstale":"2023-12-18T10:18:09.649514+0000","last_undegraded":"2023-12-18T10:18:09.649514+0000","last_fullsized":"2023-12-18T10:18:09.649514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:42.689686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645552+0000","last_change":"2023-12-18T10:18:05.245165+0000","last_active":"2023-12-18T10:18:09.645552+0000","last_peered":"2023-12-18T10:18:09.645552+0000","last_clean":"2023-12-18T10:18:09.645552+0000","last_became_active":"2023-12-18T10:18:05.244850+0000","last_became_peered":"2023-12-18T10:18:05.244850+0000","last_unstale":"2023-12-18T10:18:09.645552+0000","last_undegraded":"2023-12-18T10:18:09.645552+0000","last_fullsized":"2023-12-18T10:18:09.645552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168819+0000","last_change":"2023-12-18T10:18:09.665513+0000","last_active":"2023-12-18T10:18:11.168819+0000","last_peered":"2023-12-18T10:18:11.168819+0000","last_clean":"2023-12-18T10:18:11.168819+0000","last_became_active":"2023-12-18T10:18:09.665159+0000","last_became_peered":"2023-12-18T10:18:09.665159+0000","last_unstale":"2023-12-18T10:18:11.168819+0000","last_undegraded":"2023-12-18T10:18:11.168819+0000","last_fullsized":"2023-12-18T10:18:11.168819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:14.170257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637020+0000","last_change":"2023-12-18T10:18:05.629368+0000","last_active":"2023-12-18T10:18:09.637020+0000","last_peered":"2023-12-18T10:18:09.637020+0000","last_clean":"2023-12-18T10:18:09.637020+0000","last_became_active":"2023-12-18T10:18:05.629000+0000","last_became_peered":"2023-12-18T10:18:05.629000+0000","last_unstale":"2023-12-18T10:18:09.637020+0000","last_undegraded":"2023-12-18T10:18:09.637020+0000","last_fullsized":"2023-12-18T10:18:09.637020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655736+0000","last_change":"2023-12-18T10:18:05.238202+0000","last_active":"2023-12-18T10:18:09.655736+0000","last_peered":"2023-12-18T10:18:09.655736+0000","last_clean":"2023-12-18T10:18:09.655736+0000","last_became_active":"2023-12-18T10:18:05.236931+0000","last_became_peered":"2023-12-18T10:18:05.236931+0000","last_unstale":"2023-12-18T10:18:09.655736+0000","last_undegraded":"2023-12-18T10:18:09.655736+0000","last_fullsized":"2023-12-18T10:18:09.655736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168802+0000","last_change":"2023-12-18T10:18:09.666802+0000","last_active":"2023-12-18T10:18:11.168802+0000","last_peered":"2023-12-18T10:18:11.168802+0000","last_clean":"2023-12-18T10:18:11.168802+0000","last_became_active":"2023-12-18T10:18:09.666414+0000","last_became_peered":"2023-12-18T10:18:09.666414+0000","last_unstale":"2023-12-18T10:18:11.168802+0000","last_undegraded":"2023-12-18T10:18:11.168802+0000","last_fullsized":"2023-12-18T10:18:11.168802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644736+0000","last_change":"2023-12-18T10:18:05.622921+0000","last_active":"2023-12-18T10:18:09.644736+0000","last_peered":"2023-12-18T10:18:09.644736+0000","last_clean":"2023-12-18T10:18:09.644736+0000","last_became_active":"2023-12-18T10:18:05.621321+0000","last_became_peered":"2023-12-18T10:18:05.621321+0000","last_unstale":"2023-12-18T10:18:09.644736+0000","last_undegraded":"2023-12-18T10:18:09.644736+0000","last_fullsized":"2023-12-18T10:18:09.644736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.703942+0000","last_change":"2023-12-18T10:18:05.243529+0000","last_active":"2023-12-18T10:18:09.703942+0000","last_peered":"2023-12-18T10:18:09.703942+0000","last_clean":"2023-12-18T10:18:09.703942+0000","last_became_active":"2023-12-18T10:18:05.242883+0000","last_became_peered":"2023-12-18T10:18:05.242883+0000","last_unstale":"2023-12-18T10:18:09.703942+0000","last_undegraded":"2023-12-18T10:18:09.703942+0000","last_fullsized":"2023-12-18T10:18:09.703942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169242+0000","last_change":"2023-12-18T10:18:09.706427+0000","last_active":"2023-12-18T10:18:11.169242+0000","last_peered":"2023-12-18T10:18:11.169242+0000","last_clean":"2023-12-18T10:18:11.169242+0000","last_became_active":"2023-12-18T10:18:09.705936+0000","last_became_peered":"2023-12-18T10:18:09.705936+0000","last_unstale":"2023-12-18T10:18:11.169242+0000","last_undegraded":"2023-12-18T10:18:11.169242+0000","last_fullsized":"2023-12-18T10:18:11.169242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642900+0000","last_change":"2023-12-18T10:18:05.643802+0000","last_active":"2023-12-18T10:18:09.642900+0000","last_peered":"2023-12-18T10:18:09.642900+0000","last_clean":"2023-12-18T10:18:09.642900+0000","last_became_active":"2023-12-18T10:18:05.643536+0000","last_became_peered":"2023-12-18T10:18:05.643536+0000","last_unstale":"2023-12-18T10:18:09.642900+0000","last_undegraded":"2023-12-18T10:18:09.642900+0000","last_fullsized":"2023-12-18T10:18:09.642900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644527+0000","last_change":"2023-12-18T10:18:05.246307+0000","last_active":"2023-12-18T10:18:09.644527+0000","last_peered":"2023-12-18T10:18:09.644527+0000","last_clean":"2023-12-18T10:18:09.644527+0000","last_became_active":"2023-12-18T10:18:05.246011+0000","last_became_peered":"2023-12-18T10:18:05.246011+0000","last_unstale":"2023-12-18T10:18:09.644527+0000","last_undegraded":"2023-12-18T10:18:09.644527+0000","last_fullsized":"2023-12-18T10:18:09.644527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704051+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:18:09.704051+0000","last_peered":"2023-12-18T10:18:09.704051+0000","last_clean":"2023-12-18T10:18:09.704051+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:18:09.704051+0000","last_undegraded":"2023-12-18T10:18:09.704051+0000","last_fullsized":"2023-12-18T10:18:09.704051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169876+0000","last_change":"2023-12-18T10:18:09.708354+0000","last_active":"2023-12-18T10:18:11.169876+0000","last_peered":"2023-12-18T10:18:11.169876+0000","last_clean":"2023-12-18T10:18:11.169876+0000","last_became_active":"2023-12-18T10:18:09.707960+0000","last_became_peered":"2023-12-18T10:18:09.707960+0000","last_unstale":"2023-12-18T10:18:11.169876+0000","last_undegraded":"2023-12-18T10:18:11.169876+0000","last_fullsized":"2023-12-18T10:18:11.169876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:14.308904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704499+0000","last_change":"2023-12-18T10:18:05.632931+0000","last_active":"2023-12-18T10:18:09.704499+0000","last_peered":"2023-12-18T10:18:09.704499+0000","last_clean":"2023-12-18T10:18:09.704499+0000","last_became_active":"2023-12-18T10:18:05.632651+0000","last_became_peered":"2023-12-18T10:18:05.632651+0000","last_unstale":"2023-12-18T10:18:09.704499+0000","last_undegraded":"2023-12-18T10:18:09.704499+0000","last_fullsized":"2023-12-18T10:18:09.704499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656199+0000","last_change":"2023-12-18T10:18:05.242533+0000","last_active":"2023-12-18T10:18:09.656199+0000","last_peered":"2023-12-18T10:18:09.656199+0000","last_clean":"2023-12-18T10:18:09.656199+0000","last_became_active":"2023-12-18T10:18:05.242002+0000","last_became_peered":"2023-12-18T10:18:05.242002+0000","last_unstale":"2023-12-18T10:18:09.656199+0000","last_undegraded":"2023-12-18T10:18:09.656199+0000","last_fullsized":"2023-12-18T10:18:09.656199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:59:16.313417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169703+0000","last_change":"2023-12-18T10:18:09.706487+0000","last_active":"2023-12-18T10:18:11.169703+0000","last_peered":"2023-12-18T10:18:11.169703+0000","last_clean":"2023-12-18T10:18:11.169703+0000","last_became_active":"2023-12-18T10:18:09.705811+0000","last_became_peered":"2023-12-18T10:18:09.705811+0000","last_unstale":"2023-12-18T10:18:11.169703+0000","last_undegraded":"2023-12-18T10:18:11.169703+0000","last_fullsized":"2023-12-18T10:18:11.169703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:04:14.972185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646691+0000","last_change":"2023-12-18T10:18:05.644339+0000","last_active":"2023-12-18T10:18:09.646691+0000","last_peered":"2023-12-18T10:18:09.646691+0000","last_clean":"2023-12-18T10:18:09.646691+0000","last_became_active":"2023-12-18T10:18:05.643830+0000","last_became_peered":"2023-12-18T10:18:05.643830+0000","last_unstale":"2023-12-18T10:18:09.646691+0000","last_undegraded":"2023-12-18T10:18:09.646691+0000","last_fullsized":"2023-12-18T10:18:09.646691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:26.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638847+0000","last_change":"2023-12-18T10:18:05.238798+0000","last_active":"2023-12-18T10:18:09.638847+0000","last_peered":"2023-12-18T10:18:09.638847+0000","last_clean":"2023-12-18T10:18:09.638847+0000","last_became_active":"2023-12-18T10:18:05.238543+0000","last_became_peered":"2023-12-18T10:18:05.238543+0000","last_unstale":"2023-12-18T10:18:09.638847+0000","last_undegraded":"2023-12-18T10:18:09.638847+0000","last_fullsized":"2023-12-18T10:18:09.638847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169838+0000","last_change":"2023-12-18T10:18:09.665779+0000","last_active":"2023-12-18T10:18:11.169838+0000","last_peered":"2023-12-18T10:18:11.169838+0000","last_clean":"2023-12-18T10:18:11.169838+0000","last_became_active":"2023-12-18T10:18:09.665395+0000","last_became_peered":"2023-12-18T10:18:09.665395+0000","last_unstale":"2023-12-18T10:18:11.169838+0000","last_undegraded":"2023-12-18T10:18:11.169838+0000","last_fullsized":"2023-12-18T10:18:11.169838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:14.170257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704713+0000","last_change":"2023-12-18T10:18:05.650433+0000","last_active":"2023-12-18T10:18:09.704713+0000","last_peered":"2023-12-18T10:18:09.704713+0000","last_clean":"2023-12-18T10:18:09.704713+0000","last_became_active":"2023-12-18T10:18:05.650144+0000","last_became_peered":"2023-12-18T10:18:05.650144+0000","last_unstale":"2023-12-18T10:18:09.704713+0000","last_undegraded":"2023-12-18T10:18:09.704713+0000","last_fullsized":"2023-12-18T10:18:09.704713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:26.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656188+0000","last_change":"2023-12-18T10:18:05.239626+0000","last_active":"2023-12-18T10:18:09.656188+0000","last_peered":"2023-12-18T10:18:09.656188+0000","last_clean":"2023-12-18T10:18:09.656188+0000","last_became_active":"2023-12-18T10:18:05.239178+0000","last_became_peered":"2023-12-18T10:18:05.239178+0000","last_unstale":"2023-12-18T10:18:09.656188+0000","last_undegraded":"2023-12-18T10:18:09.656188+0000","last_fullsized":"2023-12-18T10:18:09.656188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169287+0000","last_change":"2023-12-18T10:18:09.708746+0000","last_active":"2023-12-18T10:18:11.169287+0000","last_peered":"2023-12-18T10:18:11.169287+0000","last_clean":"2023-12-18T10:18:11.169287+0000","last_became_active":"2023-12-18T10:18:09.708295+0000","last_became_peered":"2023-12-18T10:18:09.708295+0000","last_unstale":"2023-12-18T10:18:11.169287+0000","last_undegraded":"2023-12-18T10:18:11.169287+0000","last_fullsized":"2023-12-18T10:18:11.169287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704543+0000","last_change":"2023-12-18T10:18:05.632812+0000","last_active":"2023-12-18T10:18:09.704543+0000","last_peered":"2023-12-18T10:18:09.704543+0000","last_clean":"2023-12-18T10:18:09.704543+0000","last_became_active":"2023-12-18T10:18:05.632540+0000","last_became_peered":"2023-12-18T10:18:05.632540+0000","last_unstale":"2023-12-18T10:18:09.704543+0000","last_undegraded":"2023-12-18T10:18:09.704543+0000","last_fullsized":"2023-12-18T10:18:09.704543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.652216+0000","last_change":"2023-12-18T10:18:05.242325+0000","last_active":"2023-12-18T10:18:09.652216+0000","last_peered":"2023-12-18T10:18:09.652216+0000","last_clean":"2023-12-18T10:18:09.652216+0000","last_became_active":"2023-12-18T10:18:05.241704+0000","last_became_peered":"2023-12-18T10:18:05.241704+0000","last_unstale":"2023-12-18T10:18:09.652216+0000","last_undegraded":"2023-12-18T10:18:09.652216+0000","last_fullsized":"2023-12-18T10:18:09.652216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:11:58.708994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171517+0000","last_change":"2023-12-18T10:18:09.667114+0000","last_active":"2023-12-18T10:18:11.171517+0000","last_peered":"2023-12-18T10:18:11.171517+0000","last_clean":"2023-12-18T10:18:11.171517+0000","last_became_active":"2023-12-18T10:18:09.666693+0000","last_became_peered":"2023-12-18T10:18:09.666693+0000","last_unstale":"2023-12-18T10:18:11.171517+0000","last_undegraded":"2023-12-18T10:18:11.171517+0000","last_fullsized":"2023-12-18T10:18:11.171517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:32:34.740316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704259+0000","last_change":"2023-12-18T10:18:05.655274+0000","last_active":"2023-12-18T10:18:09.704259+0000","last_peered":"2023-12-18T10:18:09.704259+0000","last_clean":"2023-12-18T10:18:09.704259+0000","last_became_active":"2023-12-18T10:18:05.654951+0000","last_became_peered":"2023-12-18T10:18:05.654951+0000","last_unstale":"2023-12-18T10:18:09.704259+0000","last_undegraded":"2023-12-18T10:18:09.704259+0000","last_fullsized":"2023-12-18T10:18:09.704259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:53:47.177413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655713+0000","last_change":"2023-12-18T10:18:05.235218+0000","last_active":"2023-12-18T10:18:09.655713+0000","last_peered":"2023-12-18T10:18:09.655713+0000","last_clean":"2023-12-18T10:18:09.655713+0000","last_became_active":"2023-12-18T10:18:05.234772+0000","last_became_peered":"2023-12-18T10:18:05.234772+0000","last_unstale":"2023-12-18T10:18:09.655713+0000","last_undegraded":"2023-12-18T10:18:09.655713+0000","last_fullsized":"2023-12-18T10:18:09.655713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169252+0000","last_change":"2023-12-18T10:18:09.663654+0000","last_active":"2023-12-18T10:18:11.169252+0000","last_peered":"2023-12-18T10:18:11.169252+0000","last_clean":"2023-12-18T10:18:11.169252+0000","last_became_active":"2023-12-18T10:18:09.663075+0000","last_became_peered":"2023-12-18T10:18:09.663075+0000","last_unstale":"2023-12-18T10:18:11.169252+0000","last_undegraded":"2023-12-18T10:18:11.169252+0000","last_fullsized":"2023-12-18T10:18:11.169252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:44:55.941621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648084+0000","last_change":"2023-12-18T10:18:05.628464+0000","last_active":"2023-12-18T10:18:09.648084+0000","last_peered":"2023-12-18T10:18:09.648084+0000","last_clean":"2023-12-18T10:18:09.648084+0000","last_became_active":"2023-12-18T10:18:05.627764+0000","last_became_peered":"2023-12-18T10:18:05.627764+0000","last_unstale":"2023-12-18T10:18:09.648084+0000","last_undegraded":"2023-12-18T10:18:09.648084+0000","last_fullsized":"2023-12-18T10:18:09.648084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:52:49.957417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647814+0000","last_change":"2023-12-18T10:18:05.245296+0000","last_active":"2023-12-18T10:18:09.647814+0000","last_peered":"2023-12-18T10:18:09.647814+0000","last_clean":"2023-12-18T10:18:09.647814+0000","last_became_active":"2023-12-18T10:18:05.242075+0000","last_became_peered":"2023-12-18T10:18:05.242075+0000","last_unstale":"2023-12-18T10:18:09.647814+0000","last_undegraded":"2023-12-18T10:18:09.647814+0000","last_fullsized":"2023-12-18T10:18:09.647814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.035200+0000","last_change":"2023-12-18T10:18:09.709330+0000","last_active":"2023-12-18T10:18:10.035200+0000","last_peered":"2023-12-18T10:18:10.035200+0000","last_clean":"2023-12-18T10:18:10.035200+0000","last_became_active":"2023-12-18T10:18:09.708913+0000","last_became_peered":"2023-12-18T10:18:09.708913+0000","last_unstale":"2023-12-18T10:18:10.035200+0000","last_undegraded":"2023-12-18T10:18:10.035200+0000","last_fullsized":"2023-12-18T10:18:10.035200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:02:51.214432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704354+0000","last_change":"2023-12-18T10:18:05.650555+0000","last_active":"2023-12-18T10:18:09.704354+0000","last_peered":"2023-12-18T10:18:09.704354+0000","last_clean":"2023-12-18T10:18:09.704354+0000","last_became_active":"2023-12-18T10:18:05.648504+0000","last_became_peered":"2023-12-18T10:18:05.648504+0000","last_unstale":"2023-12-18T10:18:09.704354+0000","last_undegraded":"2023-12-18T10:18:09.704354+0000","last_fullsized":"2023-12-18T10:18:09.704354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645470+0000","last_change":"2023-12-18T10:18:05.244257+0000","last_active":"2023-12-18T10:18:09.645470+0000","last_peered":"2023-12-18T10:18:09.645470+0000","last_clean":"2023-12-18T10:18:09.645470+0000","last_became_active":"2023-12-18T10:18:05.242236+0000","last_became_peered":"2023-12-18T10:18:05.242236+0000","last_unstale":"2023-12-18T10:18:09.645470+0000","last_undegraded":"2023-12-18T10:18:09.645470+0000","last_fullsized":"2023-12-18T10:18:09.645470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034855+0000","last_change":"2023-12-18T10:18:09.707426+0000","last_active":"2023-12-18T10:18:10.034855+0000","last_peered":"2023-12-18T10:18:10.034855+0000","last_clean":"2023-12-18T10:18:10.034855+0000","last_became_active":"2023-12-18T10:18:09.705876+0000","last_became_peered":"2023-12-18T10:18:09.705876+0000","last_unstale":"2023-12-18T10:18:10.034855+0000","last_undegraded":"2023-12-18T10:18:10.034855+0000","last_fullsized":"2023-12-18T10:18:10.034855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:55.894492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644039+0000","last_change":"2023-12-18T10:18:05.625605+0000","last_active":"2023-12-18T10:18:09.644039+0000","last_peered":"2023-12-18T10:18:09.644039+0000","last_clean":"2023-12-18T10:18:09.644039+0000","last_became_active":"2023-12-18T10:18:05.625234+0000","last_became_peered":"2023-12-18T10:18:05.625234+0000","last_unstale":"2023-12-18T10:18:09.644039+0000","last_undegraded":"2023-12-18T10:18:09.644039+0000","last_fullsized":"2023-12-18T10:18:09.644039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647757+0000","last_change":"2023-12-18T10:18:05.238939+0000","last_active":"2023-12-18T10:18:09.647757+0000","last_peered":"2023-12-18T10:18:09.647757+0000","last_clean":"2023-12-18T10:18:09.647757+0000","last_became_active":"2023-12-18T10:18:05.238646+0000","last_became_peered":"2023-12-18T10:18:05.238646+0000","last_unstale":"2023-12-18T10:18:09.647757+0000","last_undegraded":"2023-12-18T10:18:09.647757+0000","last_fullsized":"2023-12-18T10:18:09.647757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:20:34.086830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.170663+0000","last_change":"2023-12-18T10:18:09.708597+0000","last_active":"2023-12-18T10:18:11.170663+0000","last_peered":"2023-12-18T10:18:11.170663+0000","last_clean":"2023-12-18T10:18:11.170663+0000","last_became_active":"2023-12-18T10:18:09.708149+0000","last_became_peered":"2023-12-18T10:18:09.708149+0000","last_unstale":"2023-12-18T10:18:11.170663+0000","last_undegraded":"2023-12-18T10:18:11.170663+0000","last_fullsized":"2023-12-18T10:18:11.170663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704400+0000","last_change":"2023-12-18T10:18:05.641901+0000","last_active":"2023-12-18T10:18:09.704400+0000","last_peered":"2023-12-18T10:18:09.704400+0000","last_clean":"2023-12-18T10:18:09.704400+0000","last_became_active":"2023-12-18T10:18:05.641618+0000","last_became_peered":"2023-12-18T10:18:05.641618+0000","last_unstale":"2023-12-18T10:18:09.704400+0000","last_undegraded":"2023-12-18T10:18:09.704400+0000","last_fullsized":"2023-12-18T10:18:09.704400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:15.794107+0000","last_change":"2023-12-18T10:18:05.250912+0000","last_active":"2023-12-18T10:18:15.794107+0000","last_peered":"2023-12-18T10:18:15.794107+0000","last_clean":"2023-12-18T10:18:15.794107+0000","last_became_active":"2023-12-18T10:18:05.250664+0000","last_became_peered":"2023-12-18T10:18:05.250664+0000","last_unstale":"2023-12-18T10:18:15.794107+0000","last_undegraded":"2023-12-18T10:18:15.794107+0000","last_fullsized":"2023-12-18T10:18:15.794107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168630+0000","last_change":"2023-12-18T10:18:09.664263+0000","last_active":"2023-12-18T10:18:11.168630+0000","last_peered":"2023-12-18T10:18:11.168630+0000","last_clean":"2023-12-18T10:18:11.168630+0000","last_became_active":"2023-12-18T10:18:09.663085+0000","last_became_peered":"2023-12-18T10:18:09.663085+0000","last_unstale":"2023-12-18T10:18:11.168630+0000","last_undegraded":"2023-12-18T10:18:11.168630+0000","last_fullsized":"2023-12-18T10:18:11.168630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649600+0000","last_change":"2023-12-18T10:18:05.634453+0000","last_active":"2023-12-18T10:18:09.649600+0000","last_peered":"2023-12-18T10:18:09.649600+0000","last_clean":"2023-12-18T10:18:09.649600+0000","last_became_active":"2023-12-18T10:18:05.633857+0000","last_became_peered":"2023-12-18T10:18:05.633857+0000","last_unstale":"2023-12-18T10:18:09.649600+0000","last_undegraded":"2023-12-18T10:18:09.649600+0000","last_fullsized":"2023-12-18T10:18:09.649600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:20.317228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638790+0000","last_change":"2023-12-18T10:18:05.240204+0000","last_active":"2023-12-18T10:18:09.638790+0000","last_peered":"2023-12-18T10:18:09.638790+0000","last_clean":"2023-12-18T10:18:09.638790+0000","last_became_active":"2023-12-18T10:18:05.239930+0000","last_became_peered":"2023-12-18T10:18:05.239930+0000","last_unstale":"2023-12-18T10:18:09.638790+0000","last_undegraded":"2023-12-18T10:18:09.638790+0000","last_fullsized":"2023-12-18T10:18:09.638790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:18.551106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172071+0000","last_change":"2023-12-18T10:18:09.672679+0000","last_active":"2023-12-18T10:18:11.172071+0000","last_peered":"2023-12-18T10:18:11.172071+0000","last_clean":"2023-12-18T10:18:11.172071+0000","last_became_active":"2023-12-18T10:18:09.672224+0000","last_became_peered":"2023-12-18T10:18:09.672224+0000","last_unstale":"2023-12-18T10:18:11.172071+0000","last_undegraded":"2023-12-18T10:18:11.172071+0000","last_fullsized":"2023-12-18T10:18:11.172071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647023+0000","last_change":"2023-12-18T10:18:05.641647+0000","last_active":"2023-12-18T10:18:09.647023+0000","last_peered":"2023-12-18T10:18:09.647023+0000","last_clean":"2023-12-18T10:18:09.647023+0000","last_became_active":"2023-12-18T10:18:05.641380+0000","last_became_peered":"2023-12-18T10:18:05.641380+0000","last_unstale":"2023-12-18T10:18:09.647023+0000","last_undegraded":"2023-12-18T10:18:09.647023+0000","last_fullsized":"2023-12-18T10:18:09.647023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:52:49.957417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645469+0000","last_change":"2023-12-18T10:18:05.255298+0000","last_active":"2023-12-18T10:18:09.645469+0000","last_peered":"2023-12-18T10:18:09.645469+0000","last_clean":"2023-12-18T10:18:09.645469+0000","last_became_active":"2023-12-18T10:18:05.249553+0000","last_became_peered":"2023-12-18T10:18:05.249553+0000","last_unstale":"2023-12-18T10:18:09.645469+0000","last_undegraded":"2023-12-18T10:18:09.645469+0000","last_fullsized":"2023-12-18T10:18:09.645469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034469+0000","last_change":"2023-12-18T10:18:09.654532+0000","last_active":"2023-12-18T10:18:10.034469+0000","last_peered":"2023-12-18T10:18:10.034469+0000","last_clean":"2023-12-18T10:18:10.034469+0000","last_became_active":"2023-12-18T10:18:09.654162+0000","last_became_peered":"2023-12-18T10:18:09.654162+0000","last_unstale":"2023-12-18T10:18:10.034469+0000","last_undegraded":"2023-12-18T10:18:10.034469+0000","last_fullsized":"2023-12-18T10:18:10.034469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:09.243674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645396+0000","last_change":"2023-12-18T10:18:05.645545+0000","last_active":"2023-12-18T10:18:09.645396+0000","last_peered":"2023-12-18T10:18:09.645396+0000","last_clean":"2023-12-18T10:18:09.645396+0000","last_became_active":"2023-12-18T10:18:05.643058+0000","last_became_peered":"2023-12-18T10:18:05.643058+0000","last_unstale":"2023-12-18T10:18:09.645396+0000","last_undegraded":"2023-12-18T10:18:09.645396+0000","last_fullsized":"2023-12-18T10:18:09.645396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:04:11.553722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649775+0000","last_change":"2023-12-18T10:18:05.251656+0000","last_active":"2023-12-18T10:18:09.649775+0000","last_peered":"2023-12-18T10:18:09.649775+0000","last_clean":"2023-12-18T10:18:09.649775+0000","last_became_active":"2023-12-18T10:18:05.251325+0000","last_became_peered":"2023-12-18T10:18:05.251325+0000","last_unstale":"2023-12-18T10:18:09.649775+0000","last_undegraded":"2023-12-18T10:18:09.649775+0000","last_fullsized":"2023-12-18T10:18:09.649775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034536+0000","last_change":"2023-12-18T10:18:09.706442+0000","last_active":"2023-12-18T10:18:10.034536+0000","last_peered":"2023-12-18T10:18:10.034536+0000","last_clean":"2023-12-18T10:18:10.034536+0000","last_became_active":"2023-12-18T10:18:09.705840+0000","last_became_peered":"2023-12-18T10:18:09.705840+0000","last_unstale":"2023-12-18T10:18:10.034536+0000","last_undegraded":"2023-12-18T10:18:10.034536+0000","last_fullsized":"2023-12-18T10:18:10.034536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:45:44.671578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169136+0000","last_change":"2023-12-18T10:18:09.708551+0000","last_active":"2023-12-18T10:18:11.169136+0000","last_peered":"2023-12-18T10:18:11.169136+0000","last_clean":"2023-12-18T10:18:11.169136+0000","last_became_active":"2023-12-18T10:18:09.708120+0000","last_became_peered":"2023-12-18T10:18:09.708120+0000","last_unstale":"2023-12-18T10:18:11.169136+0000","last_undegraded":"2023-12-18T10:18:11.169136+0000","last_fullsized":"2023-12-18T10:18:11.169136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637013+0000","last_change":"2023-12-18T10:18:05.626780+0000","last_active":"2023-12-18T10:18:09.637013+0000","last_peered":"2023-12-18T10:18:09.637013+0000","last_clean":"2023-12-18T10:18:09.637013+0000","last_became_active":"2023-12-18T10:18:05.626520+0000","last_became_peered":"2023-12-18T10:18:05.626520+0000","last_unstale":"2023-12-18T10:18:09.637013+0000","last_undegraded":"2023-12-18T10:18:09.637013+0000","last_fullsized":"2023-12-18T10:18:09.637013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643961+0000","last_change":"2023-12-18T10:18:05.248820+0000","last_active":"2023-12-18T10:18:09.643961+0000","last_peered":"2023-12-18T10:18:09.643961+0000","last_clean":"2023-12-18T10:18:09.643961+0000","last_became_active":"2023-12-18T10:18:05.247238+0000","last_became_peered":"2023-12-18T10:18:05.247238+0000","last_unstale":"2023-12-18T10:18:09.643961+0000","last_undegraded":"2023-12-18T10:18:09.643961+0000","last_fullsized":"2023-12-18T10:18:09.643961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.170305+0000","last_change":"2023-12-18T10:18:09.672371+0000","last_active":"2023-12-18T10:18:11.170305+0000","last_peered":"2023-12-18T10:18:11.170305+0000","last_clean":"2023-12-18T10:18:11.170305+0000","last_became_active":"2023-12-18T10:18:09.671986+0000","last_became_peered":"2023-12-18T10:18:09.671986+0000","last_unstale":"2023-12-18T10:18:11.170305+0000","last_undegraded":"2023-12-18T10:18:11.170305+0000","last_fullsized":"2023-12-18T10:18:11.170305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:44:55.941621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.640030+0000","last_change":"2023-12-18T10:18:05.627295+0000","last_active":"2023-12-18T10:18:09.640030+0000","last_peered":"2023-12-18T10:18:09.640030+0000","last_clean":"2023-12-18T10:18:09.640030+0000","last_became_active":"2023-12-18T10:18:05.626947+0000","last_became_peered":"2023-12-18T10:18:05.626947+0000","last_unstale":"2023-12-18T10:18:09.640030+0000","last_undegraded":"2023-12-18T10:18:09.640030+0000","last_fullsized":"2023-12-18T10:18:09.640030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.641252+0000","last_change":"2023-12-18T10:18:05.249020+0000","last_active":"2023-12-18T10:18:09.641252+0000","last_peered":"2023-12-18T10:18:09.641252+0000","last_clean":"2023-12-18T10:18:09.641252+0000","last_became_active":"2023-12-18T10:18:05.248677+0000","last_became_peered":"2023-12-18T10:18:05.248677+0000","last_unstale":"2023-12-18T10:18:09.641252+0000","last_undegraded":"2023-12-18T10:18:09.641252+0000","last_fullsized":"2023-12-18T10:18:09.641252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648681+0000","last_change":"2023-12-18T10:18:05.249748+0000","last_active":"2023-12-18T10:18:09.648681+0000","last_peered":"2023-12-18T10:18:09.648681+0000","last_clean":"2023-12-18T10:18:09.648681+0000","last_became_active":"2023-12-18T10:18:05.249479+0000","last_became_peered":"2023-12-18T10:18:05.249479+0000","last_unstale":"2023-12-18T10:18:09.648681+0000","last_undegraded":"2023-12-18T10:18:09.648681+0000","last_fullsized":"2023-12-18T10:18:09.648681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647579+0000","last_change":"2023-12-18T10:18:05.630648+0000","last_active":"2023-12-18T10:18:09.647579+0000","last_peered":"2023-12-18T10:18:09.647579+0000","last_clean":"2023-12-18T10:18:09.647579+0000","last_became_active":"2023-12-18T10:18:05.630392+0000","last_became_peered":"2023-12-18T10:18:05.630392+0000","last_unstale":"2023-12-18T10:18:09.647579+0000","last_undegraded":"2023-12-18T10:18:09.647579+0000","last_fullsized":"2023-12-18T10:18:09.647579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:00.204642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.033552+0000","last_change":"2023-12-18T10:18:09.672491+0000","last_active":"2023-12-18T10:18:10.033552+0000","last_peered":"2023-12-18T10:18:10.033552+0000","last_clean":"2023-12-18T10:18:10.033552+0000","last_became_active":"2023-12-18T10:18:09.671959+0000","last_became_peered":"2023-12-18T10:18:09.671959+0000","last_unstale":"2023-12-18T10:18:10.033552+0000","last_undegraded":"2023-12-18T10:18:10.033552+0000","last_fullsized":"2023-12-18T10:18:10.033552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:21.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643160+0000","last_change":"2023-12-18T10:18:05.252875+0000","last_active":"2023-12-18T10:18:09.643160+0000","last_peered":"2023-12-18T10:18:09.643160+0000","last_clean":"2023-12-18T10:18:09.643160+0000","last_became_active":"2023-12-18T10:18:05.252600+0000","last_became_peered":"2023-12-18T10:18:05.252600+0000","last_unstale":"2023-12-18T10:18:09.643160+0000","last_undegraded":"2023-12-18T10:18:09.643160+0000","last_fullsized":"2023-12-18T10:18:09.643160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648805+0000","last_change":"2023-12-18T10:18:05.627361+0000","last_active":"2023-12-18T10:18:09.648805+0000","last_peered":"2023-12-18T10:18:09.648805+0000","last_clean":"2023-12-18T10:18:09.648805+0000","last_became_active":"2023-12-18T10:18:05.626588+0000","last_became_peered":"2023-12-18T10:18:05.626588+0000","last_unstale":"2023-12-18T10:18:09.648805+0000","last_undegraded":"2023-12-18T10:18:09.648805+0000","last_fullsized":"2023-12-18T10:18:09.648805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:41.607752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.035047+0000","last_change":"2023-12-18T10:18:09.660419+0000","last_active":"2023-12-18T10:18:10.035047+0000","last_peered":"2023-12-18T10:18:10.035047+0000","last_clean":"2023-12-18T10:18:10.035047+0000","last_became_active":"2023-12-18T10:18:09.659964+0000","last_became_peered":"2023-12-18T10:18:09.659964+0000","last_unstale":"2023-12-18T10:18:10.035047+0000","last_undegraded":"2023-12-18T10:18:10.035047+0000","last_fullsized":"2023-12-18T10:18:10.035047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:33:51.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647972+0000","last_change":"2023-12-18T10:18:05.628648+0000","last_active":"2023-12-18T10:18:09.647972+0000","last_peered":"2023-12-18T10:18:09.647972+0000","last_clean":"2023-12-18T10:18:09.647972+0000","last_became_active":"2023-12-18T10:18:05.628154+0000","last_became_peered":"2023-12-18T10:18:05.628154+0000","last_unstale":"2023-12-18T10:18:09.647972+0000","last_undegraded":"2023-12-18T10:18:09.647972+0000","last_fullsized":"2023-12-18T10:18:09.647972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:50:58.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655680+0000","last_change":"2023-12-18T10:18:05.643692+0000","last_active":"2023-12-18T10:18:09.655680+0000","last_peered":"2023-12-18T10:18:09.655680+0000","last_clean":"2023-12-18T10:18:09.655680+0000","last_became_active":"2023-12-18T10:18:05.643379+0000","last_became_peered":"2023-12-18T10:18:05.643379+0000","last_unstale":"2023-12-18T10:18:09.655680+0000","last_undegraded":"2023-12-18T10:18:09.655680+0000","last_fullsized":"2023-12-18T10:18:09.655680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:19.558466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645387+0000","last_change":"2023-12-18T10:18:05.646467+0000","last_active":"2023-12-18T10:18:09.645387+0000","last_peered":"2023-12-18T10:18:09.645387+0000","last_clean":"2023-12-18T10:18:09.645387+0000","last_became_active":"2023-12-18T10:18:05.646251+0000","last_became_peered":"2023-12-18T10:18:05.646251+0000","last_unstale":"2023-12-18T10:18:09.645387+0000","last_undegraded":"2023-12-18T10:18:09.645387+0000","last_fullsized":"2023-12-18T10:18:09.645387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:53:47.177413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647452+0000","last_change":"2023-12-18T10:18:05.636522+0000","last_active":"2023-12-18T10:18:09.647452+0000","last_peered":"2023-12-18T10:18:09.647452+0000","last_clean":"2023-12-18T10:18:09.647452+0000","last_became_active":"2023-12-18T10:18:05.636274+0000","last_became_peered":"2023-12-18T10:18:05.636274+0000","last_unstale":"2023-12-18T10:18:09.647452+0000","last_undegraded":"2023-12-18T10:18:09.647452+0000","last_fullsized":"2023-12-18T10:18:09.647452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644075+0000","last_change":"2023-12-18T10:18:05.641530+0000","last_active":"2023-12-18T10:18:09.644075+0000","last_peered":"2023-12-18T10:18:09.644075+0000","last_clean":"2023-12-18T10:18:09.644075+0000","last_became_active":"2023-12-18T10:18:05.641184+0000","last_became_peered":"2023-12-18T10:18:05.641184+0000","last_unstale":"2023-12-18T10:18:09.644075+0000","last_undegraded":"2023-12-18T10:18:09.644075+0000","last_fullsized":"2023-12-18T10:18:09.644075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:13:52.820727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638695+0000","last_change":"2023-12-18T10:18:05.642375+0000","last_active":"2023-12-18T10:18:09.638695+0000","last_peered":"2023-12-18T10:18:09.638695+0000","last_clean":"2023-12-18T10:18:09.638695+0000","last_became_active":"2023-12-18T10:18:05.641952+0000","last_became_peered":"2023-12-18T10:18:05.641952+0000","last_unstale":"2023-12-18T10:18:09.638695+0000","last_undegraded":"2023-12-18T10:18:09.638695+0000","last_fullsized":"2023-12-18T10:18:09.638695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650445+0000","last_change":"2023-12-18T10:18:05.633875+0000","last_active":"2023-12-18T10:18:09.650445+0000","last_peered":"2023-12-18T10:18:09.650445+0000","last_clean":"2023-12-18T10:18:09.650445+0000","last_became_active":"2023-12-18T10:18:05.633604+0000","last_became_peered":"2023-12-18T10:18:05.633604+0000","last_unstale":"2023-12-18T10:18:09.650445+0000","last_undegraded":"2023-12-18T10:18:09.650445+0000","last_fullsized":"2023-12-18T10:18:09.650445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650100+0000","last_change":"2023-12-18T10:18:05.641319+0000","last_active":"2023-12-18T10:18:09.650100+0000","last_peered":"2023-12-18T10:18:09.650100+0000","last_clean":"2023-12-18T10:18:09.650100+0000","last_became_active":"2023-12-18T10:18:05.641023+0000","last_became_peered":"2023-12-18T10:18:05.641023+0000","last_unstale":"2023-12-18T10:18:09.650100+0000","last_undegraded":"2023-12-18T10:18:09.650100+0000","last_fullsized":"2023-12-18T10:18:09.650100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643898+0000","last_change":"2023-12-18T10:18:05.644280+0000","last_active":"2023-12-18T10:18:09.643898+0000","last_peered":"2023-12-18T10:18:09.643898+0000","last_clean":"2023-12-18T10:18:09.643898+0000","last_became_active":"2023-12-18T10:18:05.643995+0000","last_became_peered":"2023-12-18T10:18:05.643995+0000","last_unstale":"2023-12-18T10:18:09.643898+0000","last_undegraded":"2023-12-18T10:18:09.643898+0000","last_fullsized":"2023-12-18T10:18:09.643898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.641117+0000","last_change":"2023-12-18T10:18:05.633363+0000","last_active":"2023-12-18T10:18:09.641117+0000","last_peered":"2023-12-18T10:18:09.641117+0000","last_clean":"2023-12-18T10:18:09.641117+0000","last_became_active":"2023-12-18T10:18:05.633080+0000","last_became_peered":"2023-12-18T10:18:05.633080+0000","last_unstale":"2023-12-18T10:18:09.641117+0000","last_undegraded":"2023-12-18T10:18:09.641117+0000","last_fullsized":"2023-12-18T10:18:09.641117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645306+0000","last_change":"2023-12-18T10:18:05.647944+0000","last_active":"2023-12-18T10:18:09.645306+0000","last_peered":"2023-12-18T10:18:09.645306+0000","last_clean":"2023-12-18T10:18:09.645306+0000","last_became_active":"2023-12-18T10:18:05.646783+0000","last_became_peered":"2023-12-18T10:18:05.646783+0000","last_unstale":"2023-12-18T10:18:09.645306+0000","last_undegraded":"2023-12-18T10:18:09.645306+0000","last_fullsized":"2023-12-18T10:18:09.645306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646684+0000","last_change":"2023-12-18T10:18:05.625564+0000","last_active":"2023-12-18T10:18:09.646684+0000","last_peered":"2023-12-18T10:18:09.646684+0000","last_clean":"2023-12-18T10:18:09.646684+0000","last_became_active":"2023-12-18T10:18:05.625276+0000","last_became_peered":"2023-12-18T10:18:05.625276+0000","last_unstale":"2023-12-18T10:18:09.646684+0000","last_undegraded":"2023-12-18T10:18:09.646684+0000","last_fullsized":"2023-12-18T10:18:09.646684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647564+0000","last_change":"2023-12-18T10:18:05.630745+0000","last_active":"2023-12-18T10:18:09.647564+0000","last_peered":"2023-12-18T10:18:09.647564+0000","last_clean":"2023-12-18T10:18:09.647564+0000","last_became_active":"2023-12-18T10:18:05.630408+0000","last_became_peered":"2023-12-18T10:18:05.630408+0000","last_unstale":"2023-12-18T10:18:09.647564+0000","last_undegraded":"2023-12-18T10:18:09.647564+0000","last_fullsized":"2023-12-18T10:18:09.647564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704579+0000","last_change":"2023-12-18T10:18:05.631928+0000","last_active":"2023-12-18T10:18:09.704579+0000","last_peered":"2023-12-18T10:18:09.704579+0000","last_clean":"2023-12-18T10:18:09.704579+0000","last_became_active":"2023-12-18T10:18:05.631639+0000","last_became_peered":"2023-12-18T10:18:05.631639+0000","last_unstale":"2023-12-18T10:18:09.704579+0000","last_undegraded":"2023-12-18T10:18:09.704579+0000","last_fullsized":"2023-12-18T10:18:09.704579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656090+0000","last_change":"2023-12-18T10:18:05.641653+0000","last_active":"2023-12-18T10:18:09.656090+0000","last_peered":"2023-12-18T10:18:09.656090+0000","last_clean":"2023-12-18T10:18:09.656090+0000","last_became_active":"2023-12-18T10:18:05.641408+0000","last_became_peered":"2023-12-18T10:18:05.641408+0000","last_unstale":"2023-12-18T10:18:09.656090+0000","last_undegraded":"2023-12-18T10:18:09.656090+0000","last_fullsized":"2023-12-18T10:18:09.656090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:20.317228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644857+0000","last_change":"2023-12-18T10:18:05.650138+0000","last_active":"2023-12-18T10:18:09.644857+0000","last_peered":"2023-12-18T10:18:09.644857+0000","last_clean":"2023-12-18T10:18:09.644857+0000","last_became_active":"2023-12-18T10:18:05.647457+0000","last_became_peered":"2023-12-18T10:18:05.647457+0000","last_unstale":"2023-12-18T10:18:09.644857+0000","last_undegraded":"2023-12-18T10:18:09.644857+0000","last_fullsized":"2023-12-18T10:18:09.644857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:12:38.639031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643520+0000","last_change":"2023-12-18T10:18:05.640210+0000","last_active":"2023-12-18T10:18:09.643520+0000","last_peered":"2023-12-18T10:18:09.643520+0000","last_clean":"2023-12-18T10:18:09.643520+0000","last_became_active":"2023-12-18T10:18:05.639794+0000","last_became_peered":"2023-12-18T10:18:05.639794+0000","last_unstale":"2023-12-18T10:18:09.643520+0000","last_undegraded":"2023-12-18T10:18:09.643520+0000","last_fullsized":"2023-12-18T10:18:09.643520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637153+0000","last_change":"2023-12-18T10:18:05.633876+0000","last_active":"2023-12-18T10:18:09.637153+0000","last_peered":"2023-12-18T10:18:09.637153+0000","last_clean":"2023-12-18T10:18:09.637153+0000","last_became_active":"2023-12-18T10:18:05.632329+0000","last_became_peered":"2023-12-18T10:18:05.632329+0000","last_unstale":"2023-12-18T10:18:09.637153+0000","last_undegraded":"2023-12-18T10:18:09.637153+0000","last_fullsized":"2023-12-18T10:18:09.637153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643976+0000","last_change":"2023-12-18T10:18:05.620955+0000","last_active":"2023-12-18T10:18:09.643976+0000","last_peered":"2023-12-18T10:18:09.643976+0000","last_clean":"2023-12-18T10:18:09.643976+0000","last_became_active":"2023-12-18T10:18:05.620450+0000","last_became_peered":"2023-12-18T10:18:05.620450+0000","last_unstale":"2023-12-18T10:18:09.643976+0000","last_undegraded":"2023-12-18T10:18:09.643976+0000","last_fullsized":"2023-12-18T10:18:09.643976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:50:58.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642806+0000","last_change":"2023-12-18T10:18:05.642199+0000","last_active":"2023-12-18T10:18:09.642806+0000","last_peered":"2023-12-18T10:18:09.642806+0000","last_clean":"2023-12-18T10:18:09.642806+0000","last_became_active":"2023-12-18T10:18:05.641941+0000","last_became_peered":"2023-12-18T10:18:05.641941+0000","last_unstale":"2023-12-18T10:18:09.642806+0000","last_undegraded":"2023-12-18T10:18:09.642806+0000","last_fullsized":"2023-12-18T10:18:09.642806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649504+0000","last_change":"2023-12-18T10:18:05.634730+0000","last_active":"2023-12-18T10:18:09.649504+0000","last_peered":"2023-12-18T10:18:09.649504+0000","last_clean":"2023-12-18T10:18:09.649504+0000","last_became_active":"2023-12-18T10:18:05.634191+0000","last_became_peered":"2023-12-18T10:18:05.634191+0000","last_unstale":"2023-12-18T10:18:09.649504+0000","last_undegraded":"2023-12-18T10:18:09.649504+0000","last_fullsized":"2023-12-18T10:18:09.649504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:13.517290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647871+0000","last_change":"2023-12-18T10:18:05.636229+0000","last_active":"2023-12-18T10:18:09.647871+0000","last_peered":"2023-12-18T10:18:09.647871+0000","last_clean":"2023-12-18T10:18:09.647871+0000","last_became_active":"2023-12-18T10:18:05.635905+0000","last_became_peered":"2023-12-18T10:18:05.635905+0000","last_unstale":"2023-12-18T10:18:09.647871+0000","last_undegraded":"2023-12-18T10:18:09.647871+0000","last_fullsized":"2023-12-18T10:18:09.647871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650359+0000","last_change":"2023-12-18T10:18:05.638343+0000","last_active":"2023-12-18T10:18:09.650359+0000","last_peered":"2023-12-18T10:18:09.650359+0000","last_clean":"2023-12-18T10:18:09.650359+0000","last_became_active":"2023-12-18T10:18:05.637808+0000","last_became_peered":"2023-12-18T10:18:05.637808+0000","last_unstale":"2023-12-18T10:18:09.650359+0000","last_undegraded":"2023-12-18T10:18:09.650359+0000","last_fullsized":"2023-12-18T10:18:09.650359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704697+0000","last_change":"2023-12-18T10:18:05.644226+0000","last_active":"2023-12-18T10:18:09.704697+0000","last_peered":"2023-12-18T10:18:09.704697+0000","last_clean":"2023-12-18T10:18:09.704697+0000","last_became_active":"2023-12-18T10:18:05.643711+0000","last_became_peered":"2023-12-18T10:18:05.643711+0000","last_unstale":"2023-12-18T10:18:09.704697+0000","last_undegraded":"2023-12-18T10:18:09.704697+0000","last_fullsized":"2023-12-18T10:18:09.704697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:14.759979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.639933+0000","last_change":"2023-12-18T10:18:05.643930+0000","last_active":"2023-12-18T10:18:09.639933+0000","last_peered":"2023-12-18T10:18:09.639933+0000","last_clean":"2023-12-18T10:18:09.639933+0000","last_became_active":"2023-12-18T10:18:05.642465+0000","last_became_peered":"2023-12-18T10:18:05.642465+0000","last_unstale":"2023-12-18T10:18:09.639933+0000","last_undegraded":"2023-12-18T10:18:09.639933+0000","last_fullsized":"2023-12-18T10:18:09.639933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704110+0000","last_change":"2023-12-18T10:18:05.629320+0000","last_active":"2023-12-18T10:18:09.704110+0000","last_peered":"2023-12-18T10:18:09.704110+0000","last_clean":"2023-12-18T10:18:09.704110+0000","last_became_active":"2023-12-18T10:18:05.628995+0000","last_became_peered":"2023-12-18T10:18:05.628995+0000","last_unstale":"2023-12-18T10:18:09.704110+0000","last_undegraded":"2023-12-18T10:18:09.704110+0000","last_fullsized":"2023-12-18T10:18:09.704110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:01:46.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645210+0000","last_change":"2023-12-18T10:18:05.639987+0000","last_active":"2023-12-18T10:18:09.645210+0000","last_peered":"2023-12-18T10:18:09.645210+0000","last_clean":"2023-12-18T10:18:09.645210+0000","last_became_active":"2023-12-18T10:18:05.639712+0000","last_became_peered":"2023-12-18T10:18:05.639712+0000","last_unstale":"2023-12-18T10:18:09.645210+0000","last_undegraded":"2023-12-18T10:18:09.645210+0000","last_fullsized":"2023-12-18T10:18:09.645210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704265+0000","last_change":"2023-12-18T10:18:05.633072+0000","last_active":"2023-12-18T10:18:09.704265+0000","last_peered":"2023-12-18T10:18:09.704265+0000","last_clean":"2023-12-18T10:18:09.704265+0000","last_became_active":"2023-12-18T10:18:05.632175+0000","last_became_peered":"2023-12-18T10:18:05.632175+0000","last_unstale":"2023-12-18T10:18:09.704265+0000","last_undegraded":"2023-12-18T10:18:09.704265+0000","last_fullsized":"2023-12-18T10:18:09.704265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646517+0000","last_change":"2023-12-18T10:18:05.644282+0000","last_active":"2023-12-18T10:18:09.646517+0000","last_peered":"2023-12-18T10:18:09.646517+0000","last_clean":"2023-12-18T10:18:09.646517+0000","last_became_active":"2023-12-18T10:18:05.643886+0000","last_became_peered":"2023-12-18T10:18:05.643886+0000","last_unstale":"2023-12-18T10:18:09.646517+0000","last_undegraded":"2023-12-18T10:18:09.646517+0000","last_fullsized":"2023-12-18T10:18:09.646517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:01:46.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643972+0000","last_change":"2023-12-18T10:18:05.627422+0000","last_active":"2023-12-18T10:18:09.643972+0000","last_peered":"2023-12-18T10:18:09.643972+0000","last_clean":"2023-12-18T10:18:09.643972+0000","last_became_active":"2023-12-18T10:18:05.627154+0000","last_became_peered":"2023-12-18T10:18:05.627154+0000","last_unstale":"2023-12-18T10:18:09.643972+0000","last_undegraded":"2023-12-18T10:18:09.643972+0000","last_fullsized":"2023-12-18T10:18:09.643972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:13:52.820727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637893+0000","last_change":"2023-12-18T10:18:05.617908+0000","last_active":"2023-12-18T10:18:09.637893+0000","last_peered":"2023-12-18T10:18:09.637893+0000","last_clean":"2023-12-18T10:18:09.637893+0000","last_became_active":"2023-12-18T10:18:05.617637+0000","last_became_peered":"2023-12-18T10:18:05.617637+0000","last_unstale":"2023-12-18T10:18:09.637893+0000","last_undegraded":"2023-12-18T10:18:09.637893+0000","last_fullsized":"2023-12-18T10:18:09.637893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704633+0000","last_change":"2023-12-18T10:18:05.643965+0000","last_active":"2023-12-18T10:18:09.704633+0000","last_peered":"2023-12-18T10:18:09.704633+0000","last_clean":"2023-12-18T10:18:09.704633+0000","last_became_active":"2023-12-18T10:18:05.643043+0000","last_became_peered":"2023-12-18T10:18:05.643043+0000","last_unstale":"2023-12-18T10:18:09.704633+0000","last_undegraded":"2023-12-18T10:18:09.704633+0000","last_fullsized":"2023-12-18T10:18:09.704633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:12:38.639031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.976}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.786}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.859}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:18:34.625 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:18:34.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b301f640 1 Processor -- start 2023-12-18T10:18:34.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b301f640 1 -- start start 2023-12-18T10:18:34.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b301f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 0x7fd1ac0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b301f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd1ac0cf7e0 0x7fd1ac1668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b301f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0d11c0 con 0x7fd1ac0ce3f0 2023-12-18T10:18:34.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b301f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0d0310 con 0x7fd1ac0cf7e0 2023-12-18T10:18:34.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b301f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0d05b0 con 0x7fd1ac15ca40 2023-12-18T10:18:34.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1abfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd1ac0ce3f0 0x7fd1ac0cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48238/0 (socket says 172.21.15.133:48238) 2023-12-18T10:18:34.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1abfff640 1 -- 172.21.15.133:0/2710623531 learned_addr learned my addr 172.21.15.133:0/2710623531 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b0dbb640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 0x7fd1ac0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1b15bc640 1 --2- 172.21.15.133:0/2710623531 >> v2:172.21.15.142:3300/0 conn(0x7fd1ac0cf7e0 0x7fd1ac1668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298562605 0 0) 0x7fd1ac0d11c0 con 0x7fd1ac0ce3f0 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd19c003530 con 0x7fd1ac0ce3f0 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3293276505 0 0) 0x7fd19c003530 con 0x7fd1ac0ce3f0 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 msgr2=0x7fd1ac0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 0x7fd1ac0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 >> v2:172.21.15.142:3300/0 conn(0x7fd1ac0cf7e0 msgr2=0x7fd1ac1668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 --2- 172.21.15.133:0/2710623531 >> v2:172.21.15.142:3300/0 conn(0x7fd1ac0cf7e0 0x7fd1ac1668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0d0890 con 0x7fd1ac0ce3f0 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fd198001800 con 0x7fd1ac0ce3f0 2023-12-18T10:18:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.802+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 >> v1:172.21.15.133:6789/0 conn(0x7fd1ac0ce3f0 legacy=0x7fd1ac0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c003980 0x7fd19c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 0x7fd19c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd19c004d10 0x7fd19c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0d0310 con 0x7fd19c004d10 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0d05b0 con 0x7fd19c003980 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c00b990 con 0x7fd1ac15ca40 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1b15bc640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd19c004d10 0x7fd19c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1b0dbb640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c003980 0x7fd19c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1abfff640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 0x7fd19c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1b15bc640 1 -- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 msgr2=0x7fd19c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1b15bc640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 0x7fd19c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1b15bc640 1 -- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c003980 msgr2=0x7fd19c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1b15bc640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c003980 0x7fd19c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1b15bc640 1 -- 172.21.15.133:0/2710623531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c003530 con 0x7fd19c004d10 2023-12-18T10:18:34.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1abfff640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac15ca40 0x7fd19c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:34.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1b15bc640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd19c004d10 0x7fd19c005190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009fc0 tx=0x7fd1a401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a567cc666d9c3ffc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:34.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40a5cb0 con 0x7fd19c004d10 2023-12-18T10:18:34.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400f040 con 0x7fd19c004d10 2023-12-18T10:18:34.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.806+0000 7fd1ab7fe640 1 -- 172.21.15.133:0/2710623531 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40ad680 con 0x7fd19c004d10 2023-12-18T10:18:34.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- 172.21.15.133:0/2710623531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd19c004d10 msgr2=0x7fd19c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 --2- 172.21.15.133:0/2710623531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd19c004d10 0x7fd19c005190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009fc0 tx=0x7fd1a401cca0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 -- 172.21.15.133:0/2710623531 reap_dead start 2023-12-18T10:18:34.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- 172.21.15.133:0/2710623531 shutdown_connections 2023-12-18T10:18:34.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- 172.21.15.133:0/2710623531 >> 172.21.15.133:0/2710623531 conn(0x7fd1ac089fb0 msgr2=0x7fd1ac0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- 172.21.15.133:0/2710623531 shutdown_connections 2023-12-18T10:18:34.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- 172.21.15.133:0/2710623531 wait complete. 2023-12-18T10:18:34.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 Processor -- start 2023-12-18T10:18:34.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- start start 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c004d10 0x7fd1ac0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac151d50 0x7fd1ac15f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1ac0ca670 0x7fd1ac0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac15fc40 con 0x7fd1ac0ca670 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1521d0 con 0x7fd19c004d10 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b301f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac15fea0 con 0x7fd1ac151d50 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1ac0ca670 0x7fd1ac0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1ac0ca670 0x7fd1ac0c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48766/0 (socket says 172.21.15.133:48766) 2023-12-18T10:18:34.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 -- 172.21.15.133:0/3153090872 learned_addr learned my addr 172.21.15.133:0/3153090872 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1abfff640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac151d50 0x7fd1ac15f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b0dbb640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c004d10 0x7fd1ac0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 -- 172.21.15.133:0/3153090872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac151d50 msgr2=0x7fd1ac15f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac151d50 0x7fd1ac15f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 -- 172.21.15.133:0/3153090872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c004d10 msgr2=0x7fd1ac0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c004d10 0x7fd1ac0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.810+0000 7fd1b15bc640 1 -- 172.21.15.133:0/3153090872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac15d1e0 con 0x7fd1ac0ca670 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1b15bc640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1ac0ca670 0x7fd1ac0c81d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4002240 tx=0x7fd1a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1a97fa640 1 -- 172.21.15.133:0/3153090872 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40ad440 con 0x7fd1ac0ca670 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1a97fa640 1 -- 172.21.15.133:0/3153090872 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a40aeab0 con 0x7fd1ac0ca670 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac15d4c0 con 0x7fd1ac0ca670 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1a97fa640 1 -- 172.21.15.133:0/3153090872 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40aee60 con 0x7fd1ac0ca670 2023-12-18T10:18:34.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac15da80 con 0x7fd1ac0ca670 2023-12-18T10:18:34.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac15dc70 con 0x7fd1ac0ca670 2023-12-18T10:18:34.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1a97fa640 1 -- 172.21.15.133:0/3153090872 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd1a40b4040 con 0x7fd1ac0ca670 2023-12-18T10:18:34.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1a97fa640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd190065a90 0x7fd190067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:34.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1a97fa640 1 -- 172.21.15.133:0/3153090872 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1a411d200 con 0x7fd1ac0ca670 2023-12-18T10:18:34.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.814+0000 7fd1b0dbb640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd190065a90 0x7fd190067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:34.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.818+0000 7fd1b0dbb640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd190065a90 0x7fd190067f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009b40 tx=0x7fd1a0006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:34.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.818+0000 7fd1a97fa640 1 -- 172.21.15.133:0/3153090872 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd1a40ea970 con 0x7fd1ac0ca670 2023-12-18T10:18:34.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.966+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1ac0d0e50 con 0x7fd190065a90 2023-12-18T10:18:34.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.978+0000 7fd1a97fa640 1 -- 172.21.15.133:0/3153090872 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345193 (secure 0 0 0) 0x7fd1a0014b50 con 0x7fd190065a90 2023-12-18T10:18:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:34.984 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:18:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd190065a90 msgr2=0x7fd190067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd190065a90 0x7fd190067f50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009b40 tx=0x7fd1a0006f90 comp rx=0 tx=0).stop 2023-12-18T10:18:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1ac0ca670 msgr2=0x7fd1ac0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1ac0ca670 0x7fd1ac0c81d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4002240 tx=0x7fd1a4009750 comp rx=0 tx=0).stop 2023-12-18T10:18:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 shutdown_connections 2023-12-18T10:18:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd190065a90 0x7fd190067f50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1ac0ca670 0x7fd1ac0c81d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1ac151d50 0x7fd1ac15f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 --2- 172.21.15.133:0/3153090872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c004d10 0x7fd1ac0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 >> 172.21.15.133:0/3153090872 conn(0x7fd1ac089fb0 msgr2=0x7fd1ac06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 shutdown_connections 2023-12-18T10:18:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:34.982+0000 7fd1b301f640 1 -- 172.21.15.133:0/3153090872 wait complete. 2023-12-18T10:18:35.002 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-18T10:18:33.100821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218824,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755896,"statfs":{"total":773094113280,"available":772870037504,"internally_reserved":0,"allocated":3284992,"data_stored":1988164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002582"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647104+0000","last_change":"2023-12-18T10:18:05.252867+0000","last_active":"2023-12-18T10:18:09.647104+0000","last_peered":"2023-12-18T10:18:09.647104+0000","last_clean":"2023-12-18T10:18:09.647104+0000","last_became_active":"2023-12-18T10:18:05.252419+0000","last_became_peered":"2023-12-18T10:18:05.252419+0000","last_unstale":"2023-12-18T10:18:09.647104+0000","last_undegraded":"2023-12-18T10:18:09.647104+0000","last_fullsized":"2023-12-18T10:18:09.647104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:47:42.905512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645468+0000","last_change":"2023-12-18T10:18:05.643046+0000","last_active":"2023-12-18T10:18:09.645468+0000","last_peered":"2023-12-18T10:18:09.645468+0000","last_clean":"2023-12-18T10:18:09.645468+0000","last_became_active":"2023-12-18T10:18:05.642791+0000","last_became_peered":"2023-12-18T10:18:05.642791+0000","last_unstale":"2023-12-18T10:18:09.645468+0000","last_undegraded":"2023-12-18T10:18:09.645468+0000","last_fullsized":"2023-12-18T10:18:09.645468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034832+0000","last_change":"2023-12-18T10:18:09.709220+0000","last_active":"2023-12-18T10:18:10.034832+0000","last_peered":"2023-12-18T10:18:10.034832+0000","last_clean":"2023-12-18T10:18:10.034832+0000","last_became_active":"2023-12-18T10:18:09.708175+0000","last_became_peered":"2023-12-18T10:18:09.708175+0000","last_unstale":"2023-12-18T10:18:10.034832+0000","last_undegraded":"2023-12-18T10:18:10.034832+0000","last_fullsized":"2023-12-18T10:18:10.034832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:02.059562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648001+0000","last_change":"2023-12-18T10:18:05.240468+0000","last_active":"2023-12-18T10:18:09.648001+0000","last_peered":"2023-12-18T10:18:09.648001+0000","last_clean":"2023-12-18T10:18:09.648001+0000","last_became_active":"2023-12-18T10:18:05.239955+0000","last_became_peered":"2023-12-18T10:18:05.239955+0000","last_unstale":"2023-12-18T10:18:09.648001+0000","last_undegraded":"2023-12-18T10:18:09.648001+0000","last_fullsized":"2023-12-18T10:18:09.648001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646951+0000","last_change":"2023-12-18T10:18:05.648087+0000","last_active":"2023-12-18T10:18:09.646951+0000","last_peered":"2023-12-18T10:18:09.646951+0000","last_clean":"2023-12-18T10:18:09.646951+0000","last_became_active":"2023-12-18T10:18:05.647265+0000","last_became_peered":"2023-12-18T10:18:05.647265+0000","last_unstale":"2023-12-18T10:18:09.646951+0000","last_undegraded":"2023-12-18T10:18:09.646951+0000","last_fullsized":"2023-12-18T10:18:09.646951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:15.127242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171471+0000","last_change":"2023-12-18T10:18:09.667338+0000","last_active":"2023-12-18T10:18:11.171471+0000","last_peered":"2023-12-18T10:18:11.171471+0000","last_clean":"2023-12-18T10:18:11.171471+0000","last_became_active":"2023-12-18T10:18:09.666888+0000","last_became_peered":"2023-12-18T10:18:09.666888+0000","last_unstale":"2023-12-18T10:18:11.171471+0000","last_undegraded":"2023-12-18T10:18:11.171471+0000","last_fullsized":"2023-12-18T10:18:11.171471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:21.579648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704718+0000","last_change":"2023-12-18T10:18:05.255666+0000","last_active":"2023-12-18T10:18:09.704718+0000","last_peered":"2023-12-18T10:18:09.704718+0000","last_clean":"2023-12-18T10:18:09.704718+0000","last_became_active":"2023-12-18T10:18:05.255121+0000","last_became_peered":"2023-12-18T10:18:05.255121+0000","last_unstale":"2023-12-18T10:18:09.704718+0000","last_undegraded":"2023-12-18T10:18:09.704718+0000","last_fullsized":"2023-12-18T10:18:09.704718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:19.309867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646594+0000","last_change":"2023-12-18T10:18:05.651636+0000","last_active":"2023-12-18T10:18:09.646594+0000","last_peered":"2023-12-18T10:18:09.646594+0000","last_clean":"2023-12-18T10:18:09.646594+0000","last_became_active":"2023-12-18T10:18:05.651333+0000","last_became_peered":"2023-12-18T10:18:05.651333+0000","last_unstale":"2023-12-18T10:18:09.646594+0000","last_undegraded":"2023-12-18T10:18:09.646594+0000","last_fullsized":"2023-12-18T10:18:09.646594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171893+0000","last_change":"2023-12-18T10:18:09.672786+0000","last_active":"2023-12-18T10:18:11.171893+0000","last_peered":"2023-12-18T10:18:11.171893+0000","last_clean":"2023-12-18T10:18:11.171893+0000","last_became_active":"2023-12-18T10:18:09.672297+0000","last_became_peered":"2023-12-18T10:18:09.672297+0000","last_unstale":"2023-12-18T10:18:11.171893+0000","last_undegraded":"2023-12-18T10:18:11.171893+0000","last_fullsized":"2023-12-18T10:18:11.171893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704387+0000","last_change":"2023-12-18T10:18:05.259470+0000","last_active":"2023-12-18T10:18:09.704387+0000","last_peered":"2023-12-18T10:18:09.704387+0000","last_clean":"2023-12-18T10:18:09.704387+0000","last_became_active":"2023-12-18T10:18:05.259178+0000","last_became_peered":"2023-12-18T10:18:05.259178+0000","last_unstale":"2023-12-18T10:18:09.704387+0000","last_undegraded":"2023-12-18T10:18:09.704387+0000","last_fullsized":"2023-12-18T10:18:09.704387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:18.551106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645863+0000","last_change":"2023-12-18T10:18:05.647456+0000","last_active":"2023-12-18T10:18:09.645863+0000","last_peered":"2023-12-18T10:18:09.645863+0000","last_clean":"2023-12-18T10:18:09.645863+0000","last_became_active":"2023-12-18T10:18:05.647171+0000","last_became_peered":"2023-12-18T10:18:05.647171+0000","last_unstale":"2023-12-18T10:18:09.645863+0000","last_undegraded":"2023-12-18T10:18:09.645863+0000","last_fullsized":"2023-12-18T10:18:09.645863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171921+0000","last_change":"2023-12-18T10:18:09.663391+0000","last_active":"2023-12-18T10:18:11.171921+0000","last_peered":"2023-12-18T10:18:11.171921+0000","last_clean":"2023-12-18T10:18:11.171921+0000","last_became_active":"2023-12-18T10:18:09.662939+0000","last_became_peered":"2023-12-18T10:18:09.662939+0000","last_unstale":"2023-12-18T10:18:11.171921+0000","last_undegraded":"2023-12-18T10:18:11.171921+0000","last_fullsized":"2023-12-18T10:18:11.171921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:40.435617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648575+0000","last_change":"2023-12-18T10:18:05.631751+0000","last_active":"2023-12-18T10:18:09.648575+0000","last_peered":"2023-12-18T10:18:09.648575+0000","last_clean":"2023-12-18T10:18:09.648575+0000","last_became_active":"2023-12-18T10:18:05.631484+0000","last_became_peered":"2023-12-18T10:18:05.631484+0000","last_unstale":"2023-12-18T10:18:09.648575+0000","last_undegraded":"2023-12-18T10:18:09.648575+0000","last_fullsized":"2023-12-18T10:18:09.648575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704350+0000","last_change":"2023-12-18T10:18:05.249053+0000","last_active":"2023-12-18T10:18:09.704350+0000","last_peered":"2023-12-18T10:18:09.704350+0000","last_clean":"2023-12-18T10:18:09.704350+0000","last_became_active":"2023-12-18T10:18:05.248510+0000","last_became_peered":"2023-12-18T10:18:05.248510+0000","last_unstale":"2023-12-18T10:18:09.704350+0000","last_undegraded":"2023-12-18T10:18:09.704350+0000","last_fullsized":"2023-12-18T10:18:09.704350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172429+0000","last_change":"2023-12-18T10:18:09.674408+0000","last_active":"2023-12-18T10:18:11.172429+0000","last_peered":"2023-12-18T10:18:11.172429+0000","last_clean":"2023-12-18T10:18:11.172429+0000","last_became_active":"2023-12-18T10:18:09.673681+0000","last_became_peered":"2023-12-18T10:18:09.673681+0000","last_unstale":"2023-12-18T10:18:11.172429+0000","last_undegraded":"2023-12-18T10:18:11.172429+0000","last_fullsized":"2023-12-18T10:18:11.172429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642885+0000","last_change":"2023-12-18T10:18:05.635754+0000","last_active":"2023-12-18T10:18:09.642885+0000","last_peered":"2023-12-18T10:18:09.642885+0000","last_clean":"2023-12-18T10:18:09.642885+0000","last_became_active":"2023-12-18T10:18:05.635426+0000","last_became_peered":"2023-12-18T10:18:05.635426+0000","last_unstale":"2023-12-18T10:18:09.642885+0000","last_undegraded":"2023-12-18T10:18:09.642885+0000","last_fullsized":"2023-12-18T10:18:09.642885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637872+0000","last_change":"2023-12-18T10:18:05.237366+0000","last_active":"2023-12-18T10:18:09.637872+0000","last_peered":"2023-12-18T10:18:09.637872+0000","last_clean":"2023-12-18T10:18:09.637872+0000","last_became_active":"2023-12-18T10:18:05.237115+0000","last_became_peered":"2023-12-18T10:18:05.237115+0000","last_unstale":"2023-12-18T10:18:09.637872+0000","last_undegraded":"2023-12-18T10:18:09.637872+0000","last_fullsized":"2023-12-18T10:18:09.637872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172373+0000","last_change":"2023-12-18T10:18:09.672293+0000","last_active":"2023-12-18T10:18:11.172373+0000","last_peered":"2023-12-18T10:18:11.172373+0000","last_clean":"2023-12-18T10:18:11.172373+0000","last_became_active":"2023-12-18T10:18:09.671846+0000","last_became_peered":"2023-12-18T10:18:09.671846+0000","last_unstale":"2023-12-18T10:18:11.172373+0000","last_undegraded":"2023-12-18T10:18:11.172373+0000","last_fullsized":"2023-12-18T10:18:11.172373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:15:09.032674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.640106+0000","last_change":"2023-12-18T10:18:05.626910+0000","last_active":"2023-12-18T10:18:09.640106+0000","last_peered":"2023-12-18T10:18:09.640106+0000","last_clean":"2023-12-18T10:18:09.640106+0000","last_became_active":"2023-12-18T10:18:05.623599+0000","last_became_peered":"2023-12-18T10:18:05.623599+0000","last_unstale":"2023-12-18T10:18:09.640106+0000","last_undegraded":"2023-12-18T10:18:09.640106+0000","last_fullsized":"2023-12-18T10:18:09.640106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637099+0000","last_change":"2023-12-18T10:18:05.233603+0000","last_active":"2023-12-18T10:18:09.637099+0000","last_peered":"2023-12-18T10:18:09.637099+0000","last_clean":"2023-12-18T10:18:09.637099+0000","last_became_active":"2023-12-18T10:18:05.233168+0000","last_became_peered":"2023-12-18T10:18:05.233168+0000","last_unstale":"2023-12-18T10:18:09.637099+0000","last_undegraded":"2023-12-18T10:18:09.637099+0000","last_fullsized":"2023-12-18T10:18:09.637099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168704+0000","last_change":"2023-12-18T10:18:09.706676+0000","last_active":"2023-12-18T10:18:11.168704+0000","last_peered":"2023-12-18T10:18:11.168704+0000","last_clean":"2023-12-18T10:18:11.168704+0000","last_became_active":"2023-12-18T10:18:09.705912+0000","last_became_peered":"2023-12-18T10:18:09.705912+0000","last_unstale":"2023-12-18T10:18:11.168704+0000","last_undegraded":"2023-12-18T10:18:11.168704+0000","last_fullsized":"2023-12-18T10:18:11.168704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:57:16.183086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647321+0000","last_change":"2023-12-18T10:18:05.633413+0000","last_active":"2023-12-18T10:18:09.647321+0000","last_peered":"2023-12-18T10:18:09.647321+0000","last_clean":"2023-12-18T10:18:09.647321+0000","last_became_active":"2023-12-18T10:18:05.633042+0000","last_became_peered":"2023-12-18T10:18:05.633042+0000","last_unstale":"2023-12-18T10:18:09.647321+0000","last_undegraded":"2023-12-18T10:18:09.647321+0000","last_fullsized":"2023-12-18T10:18:09.647321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:04.543394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.703942+0000","last_change":"2023-12-18T10:18:05.247809+0000","last_active":"2023-12-18T10:18:09.703942+0000","last_peered":"2023-12-18T10:18:09.703942+0000","last_clean":"2023-12-18T10:18:09.703942+0000","last_became_active":"2023-12-18T10:18:05.247430+0000","last_became_peered":"2023-12-18T10:18:05.247430+0000","last_unstale":"2023-12-18T10:18:09.703942+0000","last_undegraded":"2023-12-18T10:18:09.703942+0000","last_fullsized":"2023-12-18T10:18:09.703942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172259+0000","last_change":"2023-12-18T10:18:09.673789+0000","last_active":"2023-12-18T10:18:11.172259+0000","last_peered":"2023-12-18T10:18:11.172259+0000","last_clean":"2023-12-18T10:18:11.172259+0000","last_became_active":"2023-12-18T10:18:09.672245+0000","last_became_peered":"2023-12-18T10:18:09.672245+0000","last_unstale":"2023-12-18T10:18:11.172259+0000","last_undegraded":"2023-12-18T10:18:11.172259+0000","last_fullsized":"2023-12-18T10:18:11.172259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:57:16.183086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646514+0000","last_change":"2023-12-18T10:18:05.618676+0000","last_active":"2023-12-18T10:18:09.646514+0000","last_peered":"2023-12-18T10:18:09.646514+0000","last_clean":"2023-12-18T10:18:09.646514+0000","last_became_active":"2023-12-18T10:18:05.617947+0000","last_became_peered":"2023-12-18T10:18:05.617947+0000","last_unstale":"2023-12-18T10:18:09.646514+0000","last_undegraded":"2023-12-18T10:18:09.646514+0000","last_fullsized":"2023-12-18T10:18:09.646514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:17.447234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649866+0000","last_change":"2023-12-18T10:18:05.252886+0000","last_active":"2023-12-18T10:18:09.649866+0000","last_peered":"2023-12-18T10:18:09.649866+0000","last_clean":"2023-12-18T10:18:09.649866+0000","last_became_active":"2023-12-18T10:18:05.252552+0000","last_became_peered":"2023-12-18T10:18:05.252552+0000","last_unstale":"2023-12-18T10:18:09.649866+0000","last_undegraded":"2023-12-18T10:18:09.649866+0000","last_fullsized":"2023-12-18T10:18:09.649866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171556+0000","last_change":"2023-12-18T10:18:09.708967+0000","last_active":"2023-12-18T10:18:11.171556+0000","last_peered":"2023-12-18T10:18:11.171556+0000","last_clean":"2023-12-18T10:18:11.171556+0000","last_became_active":"2023-12-18T10:18:09.708596+0000","last_became_peered":"2023-12-18T10:18:09.708596+0000","last_unstale":"2023-12-18T10:18:11.171556+0000","last_undegraded":"2023-12-18T10:18:11.171556+0000","last_fullsized":"2023-12-18T10:18:11.171556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:17.773172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650186+0000","last_change":"2023-12-18T10:18:05.636290+0000","last_active":"2023-12-18T10:18:09.650186+0000","last_peered":"2023-12-18T10:18:09.650186+0000","last_clean":"2023-12-18T10:18:09.650186+0000","last_became_active":"2023-12-18T10:18:05.636016+0000","last_became_peered":"2023-12-18T10:18:05.636016+0000","last_unstale":"2023-12-18T10:18:09.650186+0000","last_undegraded":"2023-12-18T10:18:09.650186+0000","last_fullsized":"2023-12-18T10:18:09.650186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637989+0000","last_change":"2023-12-18T10:18:05.249790+0000","last_active":"2023-12-18T10:18:09.637989+0000","last_peered":"2023-12-18T10:18:09.637989+0000","last_clean":"2023-12-18T10:18:09.637989+0000","last_became_active":"2023-12-18T10:18:05.249433+0000","last_became_peered":"2023-12-18T10:18:05.249433+0000","last_unstale":"2023-12-18T10:18:09.637989+0000","last_undegraded":"2023-12-18T10:18:09.637989+0000","last_fullsized":"2023-12-18T10:18:09.637989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:19.309867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034309+0000","last_change":"2023-12-18T10:18:09.708773+0000","last_active":"2023-12-18T10:18:10.034309+0000","last_peered":"2023-12-18T10:18:10.034309+0000","last_clean":"2023-12-18T10:18:10.034309+0000","last_became_active":"2023-12-18T10:18:09.708308+0000","last_became_peered":"2023-12-18T10:18:09.708308+0000","last_unstale":"2023-12-18T10:18:10.034309+0000","last_undegraded":"2023-12-18T10:18:10.034309+0000","last_fullsized":"2023-12-18T10:18:10.034309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:47:06.075688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638426+0000","last_change":"2023-12-18T10:18:05.631244+0000","last_active":"2023-12-18T10:18:09.638426+0000","last_peered":"2023-12-18T10:18:09.638426+0000","last_clean":"2023-12-18T10:18:09.638426+0000","last_became_active":"2023-12-18T10:18:05.630991+0000","last_became_peered":"2023-12-18T10:18:05.630991+0000","last_unstale":"2023-12-18T10:18:09.638426+0000","last_undegraded":"2023-12-18T10:18:09.638426+0000","last_fullsized":"2023-12-18T10:18:09.638426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704655+0000","last_change":"2023-12-18T10:18:05.250025+0000","last_active":"2023-12-18T10:18:09.704655+0000","last_peered":"2023-12-18T10:18:09.704655+0000","last_clean":"2023-12-18T10:18:09.704655+0000","last_became_active":"2023-12-18T10:18:05.249699+0000","last_became_peered":"2023-12-18T10:18:05.249699+0000","last_unstale":"2023-12-18T10:18:09.704655+0000","last_undegraded":"2023-12-18T10:18:09.704655+0000","last_fullsized":"2023-12-18T10:18:09.704655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169743+0000","last_change":"2023-12-18T10:18:09.706868+0000","last_active":"2023-12-18T10:18:11.169743+0000","last_peered":"2023-12-18T10:18:11.169743+0000","last_clean":"2023-12-18T10:18:11.169743+0000","last_became_active":"2023-12-18T10:18:09.706468+0000","last_became_peered":"2023-12-18T10:18:09.706468+0000","last_unstale":"2023-12-18T10:18:11.169743+0000","last_undegraded":"2023-12-18T10:18:11.169743+0000","last_fullsized":"2023-12-18T10:18:11.169743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645946+0000","last_change":"2023-12-18T10:18:05.645165+0000","last_active":"2023-12-18T10:18:09.645946+0000","last_peered":"2023-12-18T10:18:09.645946+0000","last_clean":"2023-12-18T10:18:09.645946+0000","last_became_active":"2023-12-18T10:18:05.644797+0000","last_became_peered":"2023-12-18T10:18:05.644797+0000","last_unstale":"2023-12-18T10:18:09.645946+0000","last_undegraded":"2023-12-18T10:18:09.645946+0000","last_fullsized":"2023-12-18T10:18:09.645946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:14.759979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638502+0000","last_change":"2023-12-18T10:18:05.240747+0000","last_active":"2023-12-18T10:18:09.638502+0000","last_peered":"2023-12-18T10:18:09.638502+0000","last_clean":"2023-12-18T10:18:09.638502+0000","last_became_active":"2023-12-18T10:18:05.240498+0000","last_became_peered":"2023-12-18T10:18:05.240498+0000","last_unstale":"2023-12-18T10:18:09.638502+0000","last_undegraded":"2023-12-18T10:18:09.638502+0000","last_fullsized":"2023-12-18T10:18:09.638502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168534+0000","last_change":"2023-12-18T10:18:09.668534+0000","last_active":"2023-12-18T10:18:11.168534+0000","last_peered":"2023-12-18T10:18:11.168534+0000","last_clean":"2023-12-18T10:18:11.168534+0000","last_became_active":"2023-12-18T10:18:09.667999+0000","last_became_peered":"2023-12-18T10:18:09.667999+0000","last_unstale":"2023-12-18T10:18:11.168534+0000","last_undegraded":"2023-12-18T10:18:11.168534+0000","last_fullsized":"2023-12-18T10:18:11.168534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:21.579648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649514+0000","last_change":"2023-12-18T10:18:05.631117+0000","last_active":"2023-12-18T10:18:09.649514+0000","last_peered":"2023-12-18T10:18:09.649514+0000","last_clean":"2023-12-18T10:18:09.649514+0000","last_became_active":"2023-12-18T10:18:05.629667+0000","last_became_peered":"2023-12-18T10:18:05.629667+0000","last_unstale":"2023-12-18T10:18:09.649514+0000","last_undegraded":"2023-12-18T10:18:09.649514+0000","last_fullsized":"2023-12-18T10:18:09.649514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:42.689686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645552+0000","last_change":"2023-12-18T10:18:05.245165+0000","last_active":"2023-12-18T10:18:09.645552+0000","last_peered":"2023-12-18T10:18:09.645552+0000","last_clean":"2023-12-18T10:18:09.645552+0000","last_became_active":"2023-12-18T10:18:05.244850+0000","last_became_peered":"2023-12-18T10:18:05.244850+0000","last_unstale":"2023-12-18T10:18:09.645552+0000","last_undegraded":"2023-12-18T10:18:09.645552+0000","last_fullsized":"2023-12-18T10:18:09.645552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168819+0000","last_change":"2023-12-18T10:18:09.665513+0000","last_active":"2023-12-18T10:18:11.168819+0000","last_peered":"2023-12-18T10:18:11.168819+0000","last_clean":"2023-12-18T10:18:11.168819+0000","last_became_active":"2023-12-18T10:18:09.665159+0000","last_became_peered":"2023-12-18T10:18:09.665159+0000","last_unstale":"2023-12-18T10:18:11.168819+0000","last_undegraded":"2023-12-18T10:18:11.168819+0000","last_fullsized":"2023-12-18T10:18:11.168819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:14.170257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637020+0000","last_change":"2023-12-18T10:18:05.629368+0000","last_active":"2023-12-18T10:18:09.637020+0000","last_peered":"2023-12-18T10:18:09.637020+0000","last_clean":"2023-12-18T10:18:09.637020+0000","last_became_active":"2023-12-18T10:18:05.629000+0000","last_became_peered":"2023-12-18T10:18:05.629000+0000","last_unstale":"2023-12-18T10:18:09.637020+0000","last_undegraded":"2023-12-18T10:18:09.637020+0000","last_fullsized":"2023-12-18T10:18:09.637020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655736+0000","last_change":"2023-12-18T10:18:05.238202+0000","last_active":"2023-12-18T10:18:09.655736+0000","last_peered":"2023-12-18T10:18:09.655736+0000","last_clean":"2023-12-18T10:18:09.655736+0000","last_became_active":"2023-12-18T10:18:05.236931+0000","last_became_peered":"2023-12-18T10:18:05.236931+0000","last_unstale":"2023-12-18T10:18:09.655736+0000","last_undegraded":"2023-12-18T10:18:09.655736+0000","last_fullsized":"2023-12-18T10:18:09.655736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168802+0000","last_change":"2023-12-18T10:18:09.666802+0000","last_active":"2023-12-18T10:18:11.168802+0000","last_peered":"2023-12-18T10:18:11.168802+0000","last_clean":"2023-12-18T10:18:11.168802+0000","last_became_active":"2023-12-18T10:18:09.666414+0000","last_became_peered":"2023-12-18T10:18:09.666414+0000","last_unstale":"2023-12-18T10:18:11.168802+0000","last_undegraded":"2023-12-18T10:18:11.168802+0000","last_fullsized":"2023-12-18T10:18:11.168802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644736+0000","last_change":"2023-12-18T10:18:05.622921+0000","last_active":"2023-12-18T10:18:09.644736+0000","last_peered":"2023-12-18T10:18:09.644736+0000","last_clean":"2023-12-18T10:18:09.644736+0000","last_became_active":"2023-12-18T10:18:05.621321+0000","last_became_peered":"2023-12-18T10:18:05.621321+0000","last_unstale":"2023-12-18T10:18:09.644736+0000","last_undegraded":"2023-12-18T10:18:09.644736+0000","last_fullsized":"2023-12-18T10:18:09.644736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.703942+0000","last_change":"2023-12-18T10:18:05.243529+0000","last_active":"2023-12-18T10:18:09.703942+0000","last_peered":"2023-12-18T10:18:09.703942+0000","last_clean":"2023-12-18T10:18:09.703942+0000","last_became_active":"2023-12-18T10:18:05.242883+0000","last_became_peered":"2023-12-18T10:18:05.242883+0000","last_unstale":"2023-12-18T10:18:09.703942+0000","last_undegraded":"2023-12-18T10:18:09.703942+0000","last_fullsized":"2023-12-18T10:18:09.703942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169242+0000","last_change":"2023-12-18T10:18:09.706427+0000","last_active":"2023-12-18T10:18:11.169242+0000","last_peered":"2023-12-18T10:18:11.169242+0000","last_clean":"2023-12-18T10:18:11.169242+0000","last_became_active":"2023-12-18T10:18:09.705936+0000","last_became_peered":"2023-12-18T10:18:09.705936+0000","last_unstale":"2023-12-18T10:18:11.169242+0000","last_undegraded":"2023-12-18T10:18:11.169242+0000","last_fullsized":"2023-12-18T10:18:11.169242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642900+0000","last_change":"2023-12-18T10:18:05.643802+0000","last_active":"2023-12-18T10:18:09.642900+0000","last_peered":"2023-12-18T10:18:09.642900+0000","last_clean":"2023-12-18T10:18:09.642900+0000","last_became_active":"2023-12-18T10:18:05.643536+0000","last_became_peered":"2023-12-18T10:18:05.643536+0000","last_unstale":"2023-12-18T10:18:09.642900+0000","last_undegraded":"2023-12-18T10:18:09.642900+0000","last_fullsized":"2023-12-18T10:18:09.642900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644527+0000","last_change":"2023-12-18T10:18:05.246307+0000","last_active":"2023-12-18T10:18:09.644527+0000","last_peered":"2023-12-18T10:18:09.644527+0000","last_clean":"2023-12-18T10:18:09.644527+0000","last_became_active":"2023-12-18T10:18:05.246011+0000","last_became_peered":"2023-12-18T10:18:05.246011+0000","last_unstale":"2023-12-18T10:18:09.644527+0000","last_undegraded":"2023-12-18T10:18:09.644527+0000","last_fullsized":"2023-12-18T10:18:09.644527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704051+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:18:09.704051+0000","last_peered":"2023-12-18T10:18:09.704051+0000","last_clean":"2023-12-18T10:18:09.704051+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:18:09.704051+0000","last_undegraded":"2023-12-18T10:18:09.704051+0000","last_fullsized":"2023-12-18T10:18:09.704051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169876+0000","last_change":"2023-12-18T10:18:09.708354+0000","last_active":"2023-12-18T10:18:11.169876+0000","last_peered":"2023-12-18T10:18:11.169876+0000","last_clean":"2023-12-18T10:18:11.169876+0000","last_became_active":"2023-12-18T10:18:09.707960+0000","last_became_peered":"2023-12-18T10:18:09.707960+0000","last_unstale":"2023-12-18T10:18:11.169876+0000","last_undegraded":"2023-12-18T10:18:11.169876+0000","last_fullsized":"2023-12-18T10:18:11.169876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:14.308904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704499+0000","last_change":"2023-12-18T10:18:05.632931+0000","last_active":"2023-12-18T10:18:09.704499+0000","last_peered":"2023-12-18T10:18:09.704499+0000","last_clean":"2023-12-18T10:18:09.704499+0000","last_became_active":"2023-12-18T10:18:05.632651+0000","last_became_peered":"2023-12-18T10:18:05.632651+0000","last_unstale":"2023-12-18T10:18:09.704499+0000","last_undegraded":"2023-12-18T10:18:09.704499+0000","last_fullsized":"2023-12-18T10:18:09.704499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656199+0000","last_change":"2023-12-18T10:18:05.242533+0000","last_active":"2023-12-18T10:18:09.656199+0000","last_peered":"2023-12-18T10:18:09.656199+0000","last_clean":"2023-12-18T10:18:09.656199+0000","last_became_active":"2023-12-18T10:18:05.242002+0000","last_became_peered":"2023-12-18T10:18:05.242002+0000","last_unstale":"2023-12-18T10:18:09.656199+0000","last_undegraded":"2023-12-18T10:18:09.656199+0000","last_fullsized":"2023-12-18T10:18:09.656199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:59:16.313417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169703+0000","last_change":"2023-12-18T10:18:09.706487+0000","last_active":"2023-12-18T10:18:11.169703+0000","last_peered":"2023-12-18T10:18:11.169703+0000","last_clean":"2023-12-18T10:18:11.169703+0000","last_became_active":"2023-12-18T10:18:09.705811+0000","last_became_peered":"2023-12-18T10:18:09.705811+0000","last_unstale":"2023-12-18T10:18:11.169703+0000","last_undegraded":"2023-12-18T10:18:11.169703+0000","last_fullsized":"2023-12-18T10:18:11.169703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:04:14.972185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646691+0000","last_change":"2023-12-18T10:18:05.644339+0000","last_active":"2023-12-18T10:18:09.646691+0000","last_peered":"2023-12-18T10:18:09.646691+0000","last_clean":"2023-12-18T10:18:09.646691+0000","last_became_active":"2023-12-18T10:18:05.643830+0000","last_became_peered":"2023-12-18T10:18:05.643830+0000","last_unstale":"2023-12-18T10:18:09.646691+0000","last_undegraded":"2023-12-18T10:18:09.646691+0000","last_fullsized":"2023-12-18T10:18:09.646691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:26.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638847+0000","last_change":"2023-12-18T10:18:05.238798+0000","last_active":"2023-12-18T10:18:09.638847+0000","last_peered":"2023-12-18T10:18:09.638847+0000","last_clean":"2023-12-18T10:18:09.638847+0000","last_became_active":"2023-12-18T10:18:05.238543+0000","last_became_peered":"2023-12-18T10:18:05.238543+0000","last_unstale":"2023-12-18T10:18:09.638847+0000","last_undegraded":"2023-12-18T10:18:09.638847+0000","last_fullsized":"2023-12-18T10:18:09.638847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:41.682326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169838+0000","last_change":"2023-12-18T10:18:09.665779+0000","last_active":"2023-12-18T10:18:11.169838+0000","last_peered":"2023-12-18T10:18:11.169838+0000","last_clean":"2023-12-18T10:18:11.169838+0000","last_became_active":"2023-12-18T10:18:09.665395+0000","last_became_peered":"2023-12-18T10:18:09.665395+0000","last_unstale":"2023-12-18T10:18:11.169838+0000","last_undegraded":"2023-12-18T10:18:11.169838+0000","last_fullsized":"2023-12-18T10:18:11.169838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:14.170257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704713+0000","last_change":"2023-12-18T10:18:05.650433+0000","last_active":"2023-12-18T10:18:09.704713+0000","last_peered":"2023-12-18T10:18:09.704713+0000","last_clean":"2023-12-18T10:18:09.704713+0000","last_became_active":"2023-12-18T10:18:05.650144+0000","last_became_peered":"2023-12-18T10:18:05.650144+0000","last_unstale":"2023-12-18T10:18:09.704713+0000","last_undegraded":"2023-12-18T10:18:09.704713+0000","last_fullsized":"2023-12-18T10:18:09.704713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:26.524909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656188+0000","last_change":"2023-12-18T10:18:05.239626+0000","last_active":"2023-12-18T10:18:09.656188+0000","last_peered":"2023-12-18T10:18:09.656188+0000","last_clean":"2023-12-18T10:18:09.656188+0000","last_became_active":"2023-12-18T10:18:05.239178+0000","last_became_peered":"2023-12-18T10:18:05.239178+0000","last_unstale":"2023-12-18T10:18:09.656188+0000","last_undegraded":"2023-12-18T10:18:09.656188+0000","last_fullsized":"2023-12-18T10:18:09.656188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169287+0000","last_change":"2023-12-18T10:18:09.708746+0000","last_active":"2023-12-18T10:18:11.169287+0000","last_peered":"2023-12-18T10:18:11.169287+0000","last_clean":"2023-12-18T10:18:11.169287+0000","last_became_active":"2023-12-18T10:18:09.708295+0000","last_became_peered":"2023-12-18T10:18:09.708295+0000","last_unstale":"2023-12-18T10:18:11.169287+0000","last_undegraded":"2023-12-18T10:18:11.169287+0000","last_fullsized":"2023-12-18T10:18:11.169287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:24.090823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704543+0000","last_change":"2023-12-18T10:18:05.632812+0000","last_active":"2023-12-18T10:18:09.704543+0000","last_peered":"2023-12-18T10:18:09.704543+0000","last_clean":"2023-12-18T10:18:09.704543+0000","last_became_active":"2023-12-18T10:18:05.632540+0000","last_became_peered":"2023-12-18T10:18:05.632540+0000","last_unstale":"2023-12-18T10:18:09.704543+0000","last_undegraded":"2023-12-18T10:18:09.704543+0000","last_fullsized":"2023-12-18T10:18:09.704543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.652216+0000","last_change":"2023-12-18T10:18:05.242325+0000","last_active":"2023-12-18T10:18:09.652216+0000","last_peered":"2023-12-18T10:18:09.652216+0000","last_clean":"2023-12-18T10:18:09.652216+0000","last_became_active":"2023-12-18T10:18:05.241704+0000","last_became_peered":"2023-12-18T10:18:05.241704+0000","last_unstale":"2023-12-18T10:18:09.652216+0000","last_undegraded":"2023-12-18T10:18:09.652216+0000","last_fullsized":"2023-12-18T10:18:09.652216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:11:58.708994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.171517+0000","last_change":"2023-12-18T10:18:09.667114+0000","last_active":"2023-12-18T10:18:11.171517+0000","last_peered":"2023-12-18T10:18:11.171517+0000","last_clean":"2023-12-18T10:18:11.171517+0000","last_became_active":"2023-12-18T10:18:09.666693+0000","last_became_peered":"2023-12-18T10:18:09.666693+0000","last_unstale":"2023-12-18T10:18:11.171517+0000","last_undegraded":"2023-12-18T10:18:11.171517+0000","last_fullsized":"2023-12-18T10:18:11.171517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:32:34.740316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704259+0000","last_change":"2023-12-18T10:18:05.655274+0000","last_active":"2023-12-18T10:18:09.704259+0000","last_peered":"2023-12-18T10:18:09.704259+0000","last_clean":"2023-12-18T10:18:09.704259+0000","last_became_active":"2023-12-18T10:18:05.654951+0000","last_became_peered":"2023-12-18T10:18:05.654951+0000","last_unstale":"2023-12-18T10:18:09.704259+0000","last_undegraded":"2023-12-18T10:18:09.704259+0000","last_fullsized":"2023-12-18T10:18:09.704259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:53:47.177413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655713+0000","last_change":"2023-12-18T10:18:05.235218+0000","last_active":"2023-12-18T10:18:09.655713+0000","last_peered":"2023-12-18T10:18:09.655713+0000","last_clean":"2023-12-18T10:18:09.655713+0000","last_became_active":"2023-12-18T10:18:05.234772+0000","last_became_peered":"2023-12-18T10:18:05.234772+0000","last_unstale":"2023-12-18T10:18:09.655713+0000","last_undegraded":"2023-12-18T10:18:09.655713+0000","last_fullsized":"2023-12-18T10:18:09.655713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169252+0000","last_change":"2023-12-18T10:18:09.663654+0000","last_active":"2023-12-18T10:18:11.169252+0000","last_peered":"2023-12-18T10:18:11.169252+0000","last_clean":"2023-12-18T10:18:11.169252+0000","last_became_active":"2023-12-18T10:18:09.663075+0000","last_became_peered":"2023-12-18T10:18:09.663075+0000","last_unstale":"2023-12-18T10:18:11.169252+0000","last_undegraded":"2023-12-18T10:18:11.169252+0000","last_fullsized":"2023-12-18T10:18:11.169252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:44:55.941621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648084+0000","last_change":"2023-12-18T10:18:05.628464+0000","last_active":"2023-12-18T10:18:09.648084+0000","last_peered":"2023-12-18T10:18:09.648084+0000","last_clean":"2023-12-18T10:18:09.648084+0000","last_became_active":"2023-12-18T10:18:05.627764+0000","last_became_peered":"2023-12-18T10:18:05.627764+0000","last_unstale":"2023-12-18T10:18:09.648084+0000","last_undegraded":"2023-12-18T10:18:09.648084+0000","last_fullsized":"2023-12-18T10:18:09.648084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:52:49.957417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647814+0000","last_change":"2023-12-18T10:18:05.245296+0000","last_active":"2023-12-18T10:18:09.647814+0000","last_peered":"2023-12-18T10:18:09.647814+0000","last_clean":"2023-12-18T10:18:09.647814+0000","last_became_active":"2023-12-18T10:18:05.242075+0000","last_became_peered":"2023-12-18T10:18:05.242075+0000","last_unstale":"2023-12-18T10:18:09.647814+0000","last_undegraded":"2023-12-18T10:18:09.647814+0000","last_fullsized":"2023-12-18T10:18:09.647814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.035200+0000","last_change":"2023-12-18T10:18:09.709330+0000","last_active":"2023-12-18T10:18:10.035200+0000","last_peered":"2023-12-18T10:18:10.035200+0000","last_clean":"2023-12-18T10:18:10.035200+0000","last_became_active":"2023-12-18T10:18:09.708913+0000","last_became_peered":"2023-12-18T10:18:09.708913+0000","last_unstale":"2023-12-18T10:18:10.035200+0000","last_undegraded":"2023-12-18T10:18:10.035200+0000","last_fullsized":"2023-12-18T10:18:10.035200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:02:51.214432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704354+0000","last_change":"2023-12-18T10:18:05.650555+0000","last_active":"2023-12-18T10:18:09.704354+0000","last_peered":"2023-12-18T10:18:09.704354+0000","last_clean":"2023-12-18T10:18:09.704354+0000","last_became_active":"2023-12-18T10:18:05.648504+0000","last_became_peered":"2023-12-18T10:18:05.648504+0000","last_unstale":"2023-12-18T10:18:09.704354+0000","last_undegraded":"2023-12-18T10:18:09.704354+0000","last_fullsized":"2023-12-18T10:18:09.704354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:01:47.818692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645470+0000","last_change":"2023-12-18T10:18:05.244257+0000","last_active":"2023-12-18T10:18:09.645470+0000","last_peered":"2023-12-18T10:18:09.645470+0000","last_clean":"2023-12-18T10:18:09.645470+0000","last_became_active":"2023-12-18T10:18:05.242236+0000","last_became_peered":"2023-12-18T10:18:05.242236+0000","last_unstale":"2023-12-18T10:18:09.645470+0000","last_undegraded":"2023-12-18T10:18:09.645470+0000","last_fullsized":"2023-12-18T10:18:09.645470+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034855+0000","last_change":"2023-12-18T10:18:09.707426+0000","last_active":"2023-12-18T10:18:10.034855+0000","last_peered":"2023-12-18T10:18:10.034855+0000","last_clean":"2023-12-18T10:18:10.034855+0000","last_became_active":"2023-12-18T10:18:09.705876+0000","last_became_peered":"2023-12-18T10:18:09.705876+0000","last_unstale":"2023-12-18T10:18:10.034855+0000","last_undegraded":"2023-12-18T10:18:10.034855+0000","last_fullsized":"2023-12-18T10:18:10.034855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:55.894492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644039+0000","last_change":"2023-12-18T10:18:05.625605+0000","last_active":"2023-12-18T10:18:09.644039+0000","last_peered":"2023-12-18T10:18:09.644039+0000","last_clean":"2023-12-18T10:18:09.644039+0000","last_became_active":"2023-12-18T10:18:05.625234+0000","last_became_peered":"2023-12-18T10:18:05.625234+0000","last_unstale":"2023-12-18T10:18:09.644039+0000","last_undegraded":"2023-12-18T10:18:09.644039+0000","last_fullsized":"2023-12-18T10:18:09.644039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:18.367324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647757+0000","last_change":"2023-12-18T10:18:05.238939+0000","last_active":"2023-12-18T10:18:09.647757+0000","last_peered":"2023-12-18T10:18:09.647757+0000","last_clean":"2023-12-18T10:18:09.647757+0000","last_became_active":"2023-12-18T10:18:05.238646+0000","last_became_peered":"2023-12-18T10:18:05.238646+0000","last_unstale":"2023-12-18T10:18:09.647757+0000","last_undegraded":"2023-12-18T10:18:09.647757+0000","last_fullsized":"2023-12-18T10:18:09.647757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:20:34.086830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.170663+0000","last_change":"2023-12-18T10:18:09.708597+0000","last_active":"2023-12-18T10:18:11.170663+0000","last_peered":"2023-12-18T10:18:11.170663+0000","last_clean":"2023-12-18T10:18:11.170663+0000","last_became_active":"2023-12-18T10:18:09.708149+0000","last_became_peered":"2023-12-18T10:18:09.708149+0000","last_unstale":"2023-12-18T10:18:11.170663+0000","last_undegraded":"2023-12-18T10:18:11.170663+0000","last_fullsized":"2023-12-18T10:18:11.170663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704400+0000","last_change":"2023-12-18T10:18:05.641901+0000","last_active":"2023-12-18T10:18:09.704400+0000","last_peered":"2023-12-18T10:18:09.704400+0000","last_clean":"2023-12-18T10:18:09.704400+0000","last_became_active":"2023-12-18T10:18:05.641618+0000","last_became_peered":"2023-12-18T10:18:05.641618+0000","last_unstale":"2023-12-18T10:18:09.704400+0000","last_undegraded":"2023-12-18T10:18:09.704400+0000","last_fullsized":"2023-12-18T10:18:09.704400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:15.794107+0000","last_change":"2023-12-18T10:18:05.250912+0000","last_active":"2023-12-18T10:18:15.794107+0000","last_peered":"2023-12-18T10:18:15.794107+0000","last_clean":"2023-12-18T10:18:15.794107+0000","last_became_active":"2023-12-18T10:18:05.250664+0000","last_became_peered":"2023-12-18T10:18:05.250664+0000","last_unstale":"2023-12-18T10:18:15.794107+0000","last_undegraded":"2023-12-18T10:18:15.794107+0000","last_fullsized":"2023-12-18T10:18:15.794107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:42:03.536034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.168630+0000","last_change":"2023-12-18T10:18:09.664263+0000","last_active":"2023-12-18T10:18:11.168630+0000","last_peered":"2023-12-18T10:18:11.168630+0000","last_clean":"2023-12-18T10:18:11.168630+0000","last_became_active":"2023-12-18T10:18:09.663085+0000","last_became_peered":"2023-12-18T10:18:09.663085+0000","last_unstale":"2023-12-18T10:18:11.168630+0000","last_undegraded":"2023-12-18T10:18:11.168630+0000","last_fullsized":"2023-12-18T10:18:11.168630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649600+0000","last_change":"2023-12-18T10:18:05.634453+0000","last_active":"2023-12-18T10:18:09.649600+0000","last_peered":"2023-12-18T10:18:09.649600+0000","last_clean":"2023-12-18T10:18:09.649600+0000","last_became_active":"2023-12-18T10:18:05.633857+0000","last_became_peered":"2023-12-18T10:18:05.633857+0000","last_unstale":"2023-12-18T10:18:09.649600+0000","last_undegraded":"2023-12-18T10:18:09.649600+0000","last_fullsized":"2023-12-18T10:18:09.649600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:20.317228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638790+0000","last_change":"2023-12-18T10:18:05.240204+0000","last_active":"2023-12-18T10:18:09.638790+0000","last_peered":"2023-12-18T10:18:09.638790+0000","last_clean":"2023-12-18T10:18:09.638790+0000","last_became_active":"2023-12-18T10:18:05.239930+0000","last_became_peered":"2023-12-18T10:18:05.239930+0000","last_unstale":"2023-12-18T10:18:09.638790+0000","last_undegraded":"2023-12-18T10:18:09.638790+0000","last_fullsized":"2023-12-18T10:18:09.638790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:18.551106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.172071+0000","last_change":"2023-12-18T10:18:09.672679+0000","last_active":"2023-12-18T10:18:11.172071+0000","last_peered":"2023-12-18T10:18:11.172071+0000","last_clean":"2023-12-18T10:18:11.172071+0000","last_became_active":"2023-12-18T10:18:09.672224+0000","last_became_peered":"2023-12-18T10:18:09.672224+0000","last_unstale":"2023-12-18T10:18:11.172071+0000","last_undegraded":"2023-12-18T10:18:11.172071+0000","last_fullsized":"2023-12-18T10:18:11.172071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:21:33.965578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647023+0000","last_change":"2023-12-18T10:18:05.641647+0000","last_active":"2023-12-18T10:18:09.647023+0000","last_peered":"2023-12-18T10:18:09.647023+0000","last_clean":"2023-12-18T10:18:09.647023+0000","last_became_active":"2023-12-18T10:18:05.641380+0000","last_became_peered":"2023-12-18T10:18:05.641380+0000","last_unstale":"2023-12-18T10:18:09.647023+0000","last_undegraded":"2023-12-18T10:18:09.647023+0000","last_fullsized":"2023-12-18T10:18:09.647023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:52:49.957417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645469+0000","last_change":"2023-12-18T10:18:05.255298+0000","last_active":"2023-12-18T10:18:09.645469+0000","last_peered":"2023-12-18T10:18:09.645469+0000","last_clean":"2023-12-18T10:18:09.645469+0000","last_became_active":"2023-12-18T10:18:05.249553+0000","last_became_peered":"2023-12-18T10:18:05.249553+0000","last_unstale":"2023-12-18T10:18:09.645469+0000","last_undegraded":"2023-12-18T10:18:09.645469+0000","last_fullsized":"2023-12-18T10:18:09.645469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:29.650880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034469+0000","last_change":"2023-12-18T10:18:09.654532+0000","last_active":"2023-12-18T10:18:10.034469+0000","last_peered":"2023-12-18T10:18:10.034469+0000","last_clean":"2023-12-18T10:18:10.034469+0000","last_became_active":"2023-12-18T10:18:09.654162+0000","last_became_peered":"2023-12-18T10:18:09.654162+0000","last_unstale":"2023-12-18T10:18:10.034469+0000","last_undegraded":"2023-12-18T10:18:10.034469+0000","last_fullsized":"2023-12-18T10:18:10.034469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:09.243674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645396+0000","last_change":"2023-12-18T10:18:05.645545+0000","last_active":"2023-12-18T10:18:09.645396+0000","last_peered":"2023-12-18T10:18:09.645396+0000","last_clean":"2023-12-18T10:18:09.645396+0000","last_became_active":"2023-12-18T10:18:05.643058+0000","last_became_peered":"2023-12-18T10:18:05.643058+0000","last_unstale":"2023-12-18T10:18:09.645396+0000","last_undegraded":"2023-12-18T10:18:09.645396+0000","last_fullsized":"2023-12-18T10:18:09.645396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:04:11.553722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649775+0000","last_change":"2023-12-18T10:18:05.251656+0000","last_active":"2023-12-18T10:18:09.649775+0000","last_peered":"2023-12-18T10:18:09.649775+0000","last_clean":"2023-12-18T10:18:09.649775+0000","last_became_active":"2023-12-18T10:18:05.251325+0000","last_became_peered":"2023-12-18T10:18:05.251325+0000","last_unstale":"2023-12-18T10:18:09.649775+0000","last_undegraded":"2023-12-18T10:18:09.649775+0000","last_fullsized":"2023-12-18T10:18:09.649775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:12.509930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.034536+0000","last_change":"2023-12-18T10:18:09.706442+0000","last_active":"2023-12-18T10:18:10.034536+0000","last_peered":"2023-12-18T10:18:10.034536+0000","last_clean":"2023-12-18T10:18:10.034536+0000","last_became_active":"2023-12-18T10:18:09.705840+0000","last_became_peered":"2023-12-18T10:18:09.705840+0000","last_unstale":"2023-12-18T10:18:10.034536+0000","last_undegraded":"2023-12-18T10:18:10.034536+0000","last_fullsized":"2023-12-18T10:18:10.034536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:45:44.671578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.169136+0000","last_change":"2023-12-18T10:18:09.708551+0000","last_active":"2023-12-18T10:18:11.169136+0000","last_peered":"2023-12-18T10:18:11.169136+0000","last_clean":"2023-12-18T10:18:11.169136+0000","last_became_active":"2023-12-18T10:18:09.708120+0000","last_became_peered":"2023-12-18T10:18:09.708120+0000","last_unstale":"2023-12-18T10:18:11.169136+0000","last_undegraded":"2023-12-18T10:18:11.169136+0000","last_fullsized":"2023-12-18T10:18:11.169136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:47:21.185100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637013+0000","last_change":"2023-12-18T10:18:05.626780+0000","last_active":"2023-12-18T10:18:09.637013+0000","last_peered":"2023-12-18T10:18:09.637013+0000","last_clean":"2023-12-18T10:18:09.637013+0000","last_became_active":"2023-12-18T10:18:05.626520+0000","last_became_peered":"2023-12-18T10:18:05.626520+0000","last_unstale":"2023-12-18T10:18:09.637013+0000","last_undegraded":"2023-12-18T10:18:09.637013+0000","last_fullsized":"2023-12-18T10:18:09.637013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:49:17.552841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643961+0000","last_change":"2023-12-18T10:18:05.248820+0000","last_active":"2023-12-18T10:18:09.643961+0000","last_peered":"2023-12-18T10:18:09.643961+0000","last_clean":"2023-12-18T10:18:09.643961+0000","last_became_active":"2023-12-18T10:18:05.247238+0000","last_became_peered":"2023-12-18T10:18:05.247238+0000","last_unstale":"2023-12-18T10:18:09.643961+0000","last_undegraded":"2023-12-18T10:18:09.643961+0000","last_fullsized":"2023-12-18T10:18:09.643961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:11.170305+0000","last_change":"2023-12-18T10:18:09.672371+0000","last_active":"2023-12-18T10:18:11.170305+0000","last_peered":"2023-12-18T10:18:11.170305+0000","last_clean":"2023-12-18T10:18:11.170305+0000","last_became_active":"2023-12-18T10:18:09.671986+0000","last_became_peered":"2023-12-18T10:18:09.671986+0000","last_unstale":"2023-12-18T10:18:11.170305+0000","last_undegraded":"2023-12-18T10:18:11.170305+0000","last_fullsized":"2023-12-18T10:18:11.170305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:44:55.941621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.640030+0000","last_change":"2023-12-18T10:18:05.627295+0000","last_active":"2023-12-18T10:18:09.640030+0000","last_peered":"2023-12-18T10:18:09.640030+0000","last_clean":"2023-12-18T10:18:09.640030+0000","last_became_active":"2023-12-18T10:18:05.626947+0000","last_became_peered":"2023-12-18T10:18:05.626947+0000","last_unstale":"2023-12-18T10:18:09.640030+0000","last_undegraded":"2023-12-18T10:18:09.640030+0000","last_fullsized":"2023-12-18T10:18:09.640030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.641252+0000","last_change":"2023-12-18T10:18:05.249020+0000","last_active":"2023-12-18T10:18:09.641252+0000","last_peered":"2023-12-18T10:18:09.641252+0000","last_clean":"2023-12-18T10:18:09.641252+0000","last_became_active":"2023-12-18T10:18:05.248677+0000","last_became_peered":"2023-12-18T10:18:05.248677+0000","last_unstale":"2023-12-18T10:18:09.641252+0000","last_undegraded":"2023-12-18T10:18:09.641252+0000","last_fullsized":"2023-12-18T10:18:09.641252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:40.600392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648681+0000","last_change":"2023-12-18T10:18:05.249748+0000","last_active":"2023-12-18T10:18:09.648681+0000","last_peered":"2023-12-18T10:18:09.648681+0000","last_clean":"2023-12-18T10:18:09.648681+0000","last_became_active":"2023-12-18T10:18:05.249479+0000","last_became_peered":"2023-12-18T10:18:05.249479+0000","last_unstale":"2023-12-18T10:18:09.648681+0000","last_undegraded":"2023-12-18T10:18:09.648681+0000","last_fullsized":"2023-12-18T10:18:09.648681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647579+0000","last_change":"2023-12-18T10:18:05.630648+0000","last_active":"2023-12-18T10:18:09.647579+0000","last_peered":"2023-12-18T10:18:09.647579+0000","last_clean":"2023-12-18T10:18:09.647579+0000","last_became_active":"2023-12-18T10:18:05.630392+0000","last_became_peered":"2023-12-18T10:18:05.630392+0000","last_unstale":"2023-12-18T10:18:09.647579+0000","last_undegraded":"2023-12-18T10:18:09.647579+0000","last_fullsized":"2023-12-18T10:18:09.647579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:00.204642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.033552+0000","last_change":"2023-12-18T10:18:09.672491+0000","last_active":"2023-12-18T10:18:10.033552+0000","last_peered":"2023-12-18T10:18:10.033552+0000","last_clean":"2023-12-18T10:18:10.033552+0000","last_became_active":"2023-12-18T10:18:09.671959+0000","last_became_peered":"2023-12-18T10:18:09.671959+0000","last_unstale":"2023-12-18T10:18:10.033552+0000","last_undegraded":"2023-12-18T10:18:10.033552+0000","last_fullsized":"2023-12-18T10:18:10.033552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:21.785787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643160+0000","last_change":"2023-12-18T10:18:05.252875+0000","last_active":"2023-12-18T10:18:09.643160+0000","last_peered":"2023-12-18T10:18:09.643160+0000","last_clean":"2023-12-18T10:18:09.643160+0000","last_became_active":"2023-12-18T10:18:05.252600+0000","last_became_peered":"2023-12-18T10:18:05.252600+0000","last_unstale":"2023-12-18T10:18:09.643160+0000","last_undegraded":"2023-12-18T10:18:09.643160+0000","last_fullsized":"2023-12-18T10:18:09.643160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:04.199295+0000","last_clean_scrub_stamp":"2023-12-18T10:18:04.199295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:27:03.794045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.648805+0000","last_change":"2023-12-18T10:18:05.627361+0000","last_active":"2023-12-18T10:18:09.648805+0000","last_peered":"2023-12-18T10:18:09.648805+0000","last_clean":"2023-12-18T10:18:09.648805+0000","last_became_active":"2023-12-18T10:18:05.626588+0000","last_became_peered":"2023-12-18T10:18:05.626588+0000","last_unstale":"2023-12-18T10:18:09.648805+0000","last_undegraded":"2023-12-18T10:18:09.648805+0000","last_fullsized":"2023-12-18T10:18:09.648805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:41.607752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-18T10:18:10.035047+0000","last_change":"2023-12-18T10:18:09.660419+0000","last_active":"2023-12-18T10:18:10.035047+0000","last_peered":"2023-12-18T10:18:10.035047+0000","last_clean":"2023-12-18T10:18:10.035047+0000","last_became_active":"2023-12-18T10:18:09.659964+0000","last_became_peered":"2023-12-18T10:18:09.659964+0000","last_unstale":"2023-12-18T10:18:10.035047+0000","last_undegraded":"2023-12-18T10:18:10.035047+0000","last_fullsized":"2023-12-18T10:18:10.035047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:08.625119+0000","last_clean_scrub_stamp":"2023-12-18T10:18:08.625119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:33:51.773589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647972+0000","last_change":"2023-12-18T10:18:05.628648+0000","last_active":"2023-12-18T10:18:09.647972+0000","last_peered":"2023-12-18T10:18:09.647972+0000","last_clean":"2023-12-18T10:18:09.647972+0000","last_became_active":"2023-12-18T10:18:05.628154+0000","last_became_peered":"2023-12-18T10:18:05.628154+0000","last_unstale":"2023-12-18T10:18:09.647972+0000","last_undegraded":"2023-12-18T10:18:09.647972+0000","last_fullsized":"2023-12-18T10:18:09.647972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:50:58.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.655680+0000","last_change":"2023-12-18T10:18:05.643692+0000","last_active":"2023-12-18T10:18:09.655680+0000","last_peered":"2023-12-18T10:18:09.655680+0000","last_clean":"2023-12-18T10:18:09.655680+0000","last_became_active":"2023-12-18T10:18:05.643379+0000","last_became_peered":"2023-12-18T10:18:05.643379+0000","last_unstale":"2023-12-18T10:18:09.655680+0000","last_undegraded":"2023-12-18T10:18:09.655680+0000","last_fullsized":"2023-12-18T10:18:09.655680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:19.558466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645387+0000","last_change":"2023-12-18T10:18:05.646467+0000","last_active":"2023-12-18T10:18:09.645387+0000","last_peered":"2023-12-18T10:18:09.645387+0000","last_clean":"2023-12-18T10:18:09.645387+0000","last_became_active":"2023-12-18T10:18:05.646251+0000","last_became_peered":"2023-12-18T10:18:05.646251+0000","last_unstale":"2023-12-18T10:18:09.645387+0000","last_undegraded":"2023-12-18T10:18:09.645387+0000","last_fullsized":"2023-12-18T10:18:09.645387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:53:47.177413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647452+0000","last_change":"2023-12-18T10:18:05.636522+0000","last_active":"2023-12-18T10:18:09.647452+0000","last_peered":"2023-12-18T10:18:09.647452+0000","last_clean":"2023-12-18T10:18:09.647452+0000","last_became_active":"2023-12-18T10:18:05.636274+0000","last_became_peered":"2023-12-18T10:18:05.636274+0000","last_unstale":"2023-12-18T10:18:09.647452+0000","last_undegraded":"2023-12-18T10:18:09.647452+0000","last_fullsized":"2023-12-18T10:18:09.647452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644075+0000","last_change":"2023-12-18T10:18:05.641530+0000","last_active":"2023-12-18T10:18:09.644075+0000","last_peered":"2023-12-18T10:18:09.644075+0000","last_clean":"2023-12-18T10:18:09.644075+0000","last_became_active":"2023-12-18T10:18:05.641184+0000","last_became_peered":"2023-12-18T10:18:05.641184+0000","last_unstale":"2023-12-18T10:18:09.644075+0000","last_undegraded":"2023-12-18T10:18:09.644075+0000","last_fullsized":"2023-12-18T10:18:09.644075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:13:52.820727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.638695+0000","last_change":"2023-12-18T10:18:05.642375+0000","last_active":"2023-12-18T10:18:09.638695+0000","last_peered":"2023-12-18T10:18:09.638695+0000","last_clean":"2023-12-18T10:18:09.638695+0000","last_became_active":"2023-12-18T10:18:05.641952+0000","last_became_peered":"2023-12-18T10:18:05.641952+0000","last_unstale":"2023-12-18T10:18:09.638695+0000","last_undegraded":"2023-12-18T10:18:09.638695+0000","last_fullsized":"2023-12-18T10:18:09.638695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650445+0000","last_change":"2023-12-18T10:18:05.633875+0000","last_active":"2023-12-18T10:18:09.650445+0000","last_peered":"2023-12-18T10:18:09.650445+0000","last_clean":"2023-12-18T10:18:09.650445+0000","last_became_active":"2023-12-18T10:18:05.633604+0000","last_became_peered":"2023-12-18T10:18:05.633604+0000","last_unstale":"2023-12-18T10:18:09.650445+0000","last_undegraded":"2023-12-18T10:18:09.650445+0000","last_fullsized":"2023-12-18T10:18:09.650445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650100+0000","last_change":"2023-12-18T10:18:05.641319+0000","last_active":"2023-12-18T10:18:09.650100+0000","last_peered":"2023-12-18T10:18:09.650100+0000","last_clean":"2023-12-18T10:18:09.650100+0000","last_became_active":"2023-12-18T10:18:05.641023+0000","last_became_peered":"2023-12-18T10:18:05.641023+0000","last_unstale":"2023-12-18T10:18:09.650100+0000","last_undegraded":"2023-12-18T10:18:09.650100+0000","last_fullsized":"2023-12-18T10:18:09.650100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643898+0000","last_change":"2023-12-18T10:18:05.644280+0000","last_active":"2023-12-18T10:18:09.643898+0000","last_peered":"2023-12-18T10:18:09.643898+0000","last_clean":"2023-12-18T10:18:09.643898+0000","last_became_active":"2023-12-18T10:18:05.643995+0000","last_became_peered":"2023-12-18T10:18:05.643995+0000","last_unstale":"2023-12-18T10:18:09.643898+0000","last_undegraded":"2023-12-18T10:18:09.643898+0000","last_fullsized":"2023-12-18T10:18:09.643898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:16.214623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.641117+0000","last_change":"2023-12-18T10:18:05.633363+0000","last_active":"2023-12-18T10:18:09.641117+0000","last_peered":"2023-12-18T10:18:09.641117+0000","last_clean":"2023-12-18T10:18:09.641117+0000","last_became_active":"2023-12-18T10:18:05.633080+0000","last_became_peered":"2023-12-18T10:18:05.633080+0000","last_unstale":"2023-12-18T10:18:09.641117+0000","last_undegraded":"2023-12-18T10:18:09.641117+0000","last_fullsized":"2023-12-18T10:18:09.641117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645306+0000","last_change":"2023-12-18T10:18:05.647944+0000","last_active":"2023-12-18T10:18:09.645306+0000","last_peered":"2023-12-18T10:18:09.645306+0000","last_clean":"2023-12-18T10:18:09.645306+0000","last_became_active":"2023-12-18T10:18:05.646783+0000","last_became_peered":"2023-12-18T10:18:05.646783+0000","last_unstale":"2023-12-18T10:18:09.645306+0000","last_undegraded":"2023-12-18T10:18:09.645306+0000","last_fullsized":"2023-12-18T10:18:09.645306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646684+0000","last_change":"2023-12-18T10:18:05.625564+0000","last_active":"2023-12-18T10:18:09.646684+0000","last_peered":"2023-12-18T10:18:09.646684+0000","last_clean":"2023-12-18T10:18:09.646684+0000","last_became_active":"2023-12-18T10:18:05.625276+0000","last_became_peered":"2023-12-18T10:18:05.625276+0000","last_unstale":"2023-12-18T10:18:09.646684+0000","last_undegraded":"2023-12-18T10:18:09.646684+0000","last_fullsized":"2023-12-18T10:18:09.646684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647564+0000","last_change":"2023-12-18T10:18:05.630745+0000","last_active":"2023-12-18T10:18:09.647564+0000","last_peered":"2023-12-18T10:18:09.647564+0000","last_clean":"2023-12-18T10:18:09.647564+0000","last_became_active":"2023-12-18T10:18:05.630408+0000","last_became_peered":"2023-12-18T10:18:05.630408+0000","last_unstale":"2023-12-18T10:18:09.647564+0000","last_undegraded":"2023-12-18T10:18:09.647564+0000","last_fullsized":"2023-12-18T10:18:09.647564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:34:58.460000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704579+0000","last_change":"2023-12-18T10:18:05.631928+0000","last_active":"2023-12-18T10:18:09.704579+0000","last_peered":"2023-12-18T10:18:09.704579+0000","last_clean":"2023-12-18T10:18:09.704579+0000","last_became_active":"2023-12-18T10:18:05.631639+0000","last_became_peered":"2023-12-18T10:18:05.631639+0000","last_unstale":"2023-12-18T10:18:09.704579+0000","last_undegraded":"2023-12-18T10:18:09.704579+0000","last_fullsized":"2023-12-18T10:18:09.704579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.656090+0000","last_change":"2023-12-18T10:18:05.641653+0000","last_active":"2023-12-18T10:18:09.656090+0000","last_peered":"2023-12-18T10:18:09.656090+0000","last_clean":"2023-12-18T10:18:09.656090+0000","last_became_active":"2023-12-18T10:18:05.641408+0000","last_became_peered":"2023-12-18T10:18:05.641408+0000","last_unstale":"2023-12-18T10:18:09.656090+0000","last_undegraded":"2023-12-18T10:18:09.656090+0000","last_fullsized":"2023-12-18T10:18:09.656090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:50:20.317228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.644857+0000","last_change":"2023-12-18T10:18:05.650138+0000","last_active":"2023-12-18T10:18:09.644857+0000","last_peered":"2023-12-18T10:18:09.644857+0000","last_clean":"2023-12-18T10:18:09.644857+0000","last_became_active":"2023-12-18T10:18:05.647457+0000","last_became_peered":"2023-12-18T10:18:05.647457+0000","last_unstale":"2023-12-18T10:18:09.644857+0000","last_undegraded":"2023-12-18T10:18:09.644857+0000","last_fullsized":"2023-12-18T10:18:09.644857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:12:38.639031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643520+0000","last_change":"2023-12-18T10:18:05.640210+0000","last_active":"2023-12-18T10:18:09.643520+0000","last_peered":"2023-12-18T10:18:09.643520+0000","last_clean":"2023-12-18T10:18:09.643520+0000","last_became_active":"2023-12-18T10:18:05.639794+0000","last_became_peered":"2023-12-18T10:18:05.639794+0000","last_unstale":"2023-12-18T10:18:09.643520+0000","last_undegraded":"2023-12-18T10:18:09.643520+0000","last_fullsized":"2023-12-18T10:18:09.643520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637153+0000","last_change":"2023-12-18T10:18:05.633876+0000","last_active":"2023-12-18T10:18:09.637153+0000","last_peered":"2023-12-18T10:18:09.637153+0000","last_clean":"2023-12-18T10:18:09.637153+0000","last_became_active":"2023-12-18T10:18:05.632329+0000","last_became_peered":"2023-12-18T10:18:05.632329+0000","last_unstale":"2023-12-18T10:18:09.637153+0000","last_undegraded":"2023-12-18T10:18:09.637153+0000","last_fullsized":"2023-12-18T10:18:09.637153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643976+0000","last_change":"2023-12-18T10:18:05.620955+0000","last_active":"2023-12-18T10:18:09.643976+0000","last_peered":"2023-12-18T10:18:09.643976+0000","last_clean":"2023-12-18T10:18:09.643976+0000","last_became_active":"2023-12-18T10:18:05.620450+0000","last_became_peered":"2023-12-18T10:18:05.620450+0000","last_unstale":"2023-12-18T10:18:09.643976+0000","last_undegraded":"2023-12-18T10:18:09.643976+0000","last_fullsized":"2023-12-18T10:18:09.643976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:50:58.736616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.642806+0000","last_change":"2023-12-18T10:18:05.642199+0000","last_active":"2023-12-18T10:18:09.642806+0000","last_peered":"2023-12-18T10:18:09.642806+0000","last_clean":"2023-12-18T10:18:09.642806+0000","last_became_active":"2023-12-18T10:18:05.641941+0000","last_became_peered":"2023-12-18T10:18:05.641941+0000","last_unstale":"2023-12-18T10:18:09.642806+0000","last_undegraded":"2023-12-18T10:18:09.642806+0000","last_fullsized":"2023-12-18T10:18:09.642806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:50.077765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.649504+0000","last_change":"2023-12-18T10:18:05.634730+0000","last_active":"2023-12-18T10:18:09.649504+0000","last_peered":"2023-12-18T10:18:09.649504+0000","last_clean":"2023-12-18T10:18:09.649504+0000","last_became_active":"2023-12-18T10:18:05.634191+0000","last_became_peered":"2023-12-18T10:18:05.634191+0000","last_unstale":"2023-12-18T10:18:09.649504+0000","last_undegraded":"2023-12-18T10:18:09.649504+0000","last_fullsized":"2023-12-18T10:18:09.649504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:30:13.517290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.647871+0000","last_change":"2023-12-18T10:18:05.636229+0000","last_active":"2023-12-18T10:18:09.647871+0000","last_peered":"2023-12-18T10:18:09.647871+0000","last_clean":"2023-12-18T10:18:09.647871+0000","last_became_active":"2023-12-18T10:18:05.635905+0000","last_became_peered":"2023-12-18T10:18:05.635905+0000","last_unstale":"2023-12-18T10:18:09.647871+0000","last_undegraded":"2023-12-18T10:18:09.647871+0000","last_fullsized":"2023-12-18T10:18:09.647871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.650359+0000","last_change":"2023-12-18T10:18:05.638343+0000","last_active":"2023-12-18T10:18:09.650359+0000","last_peered":"2023-12-18T10:18:09.650359+0000","last_clean":"2023-12-18T10:18:09.650359+0000","last_became_active":"2023-12-18T10:18:05.637808+0000","last_became_peered":"2023-12-18T10:18:05.637808+0000","last_unstale":"2023-12-18T10:18:09.650359+0000","last_undegraded":"2023-12-18T10:18:09.650359+0000","last_fullsized":"2023-12-18T10:18:09.650359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:59:50.148486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704697+0000","last_change":"2023-12-18T10:18:05.644226+0000","last_active":"2023-12-18T10:18:09.704697+0000","last_peered":"2023-12-18T10:18:09.704697+0000","last_clean":"2023-12-18T10:18:09.704697+0000","last_became_active":"2023-12-18T10:18:05.643711+0000","last_became_peered":"2023-12-18T10:18:05.643711+0000","last_unstale":"2023-12-18T10:18:09.704697+0000","last_undegraded":"2023-12-18T10:18:09.704697+0000","last_fullsized":"2023-12-18T10:18:09.704697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:14.759979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.639933+0000","last_change":"2023-12-18T10:18:05.643930+0000","last_active":"2023-12-18T10:18:09.639933+0000","last_peered":"2023-12-18T10:18:09.639933+0000","last_clean":"2023-12-18T10:18:09.639933+0000","last_became_active":"2023-12-18T10:18:05.642465+0000","last_became_peered":"2023-12-18T10:18:05.642465+0000","last_unstale":"2023-12-18T10:18:09.639933+0000","last_undegraded":"2023-12-18T10:18:09.639933+0000","last_fullsized":"2023-12-18T10:18:09.639933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:59:52.667734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704110+0000","last_change":"2023-12-18T10:18:05.629320+0000","last_active":"2023-12-18T10:18:09.704110+0000","last_peered":"2023-12-18T10:18:09.704110+0000","last_clean":"2023-12-18T10:18:09.704110+0000","last_became_active":"2023-12-18T10:18:05.628995+0000","last_became_peered":"2023-12-18T10:18:05.628995+0000","last_unstale":"2023-12-18T10:18:09.704110+0000","last_undegraded":"2023-12-18T10:18:09.704110+0000","last_fullsized":"2023-12-18T10:18:09.704110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:01:46.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.645210+0000","last_change":"2023-12-18T10:18:05.639987+0000","last_active":"2023-12-18T10:18:09.645210+0000","last_peered":"2023-12-18T10:18:09.645210+0000","last_clean":"2023-12-18T10:18:09.645210+0000","last_became_active":"2023-12-18T10:18:05.639712+0000","last_became_peered":"2023-12-18T10:18:05.639712+0000","last_unstale":"2023-12-18T10:18:09.645210+0000","last_undegraded":"2023-12-18T10:18:09.645210+0000","last_fullsized":"2023-12-18T10:18:09.645210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:26.360831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704265+0000","last_change":"2023-12-18T10:18:05.633072+0000","last_active":"2023-12-18T10:18:09.704265+0000","last_peered":"2023-12-18T10:18:09.704265+0000","last_clean":"2023-12-18T10:18:09.704265+0000","last_became_active":"2023-12-18T10:18:05.632175+0000","last_became_peered":"2023-12-18T10:18:05.632175+0000","last_unstale":"2023-12-18T10:18:09.704265+0000","last_undegraded":"2023-12-18T10:18:09.704265+0000","last_fullsized":"2023-12-18T10:18:09.704265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:33:01.190529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.646517+0000","last_change":"2023-12-18T10:18:05.644282+0000","last_active":"2023-12-18T10:18:09.646517+0000","last_peered":"2023-12-18T10:18:09.646517+0000","last_clean":"2023-12-18T10:18:09.646517+0000","last_became_active":"2023-12-18T10:18:05.643886+0000","last_became_peered":"2023-12-18T10:18:05.643886+0000","last_unstale":"2023-12-18T10:18:09.646517+0000","last_undegraded":"2023-12-18T10:18:09.646517+0000","last_fullsized":"2023-12-18T10:18:09.646517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:01:46.102137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.643972+0000","last_change":"2023-12-18T10:18:05.627422+0000","last_active":"2023-12-18T10:18:09.643972+0000","last_peered":"2023-12-18T10:18:09.643972+0000","last_clean":"2023-12-18T10:18:09.643972+0000","last_became_active":"2023-12-18T10:18:05.627154+0000","last_became_peered":"2023-12-18T10:18:05.627154+0000","last_unstale":"2023-12-18T10:18:09.643972+0000","last_undegraded":"2023-12-18T10:18:09.643972+0000","last_fullsized":"2023-12-18T10:18:09.643972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:13:52.820727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.637893+0000","last_change":"2023-12-18T10:18:05.617908+0000","last_active":"2023-12-18T10:18:09.637893+0000","last_peered":"2023-12-18T10:18:09.637893+0000","last_clean":"2023-12-18T10:18:09.637893+0000","last_became_active":"2023-12-18T10:18:05.617637+0000","last_became_peered":"2023-12-18T10:18:05.617637+0000","last_unstale":"2023-12-18T10:18:09.637893+0000","last_undegraded":"2023-12-18T10:18:09.637893+0000","last_fullsized":"2023-12-18T10:18:09.637893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:02.249690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-18T10:18:09.704633+0000","last_change":"2023-12-18T10:18:05.643965+0000","last_active":"2023-12-18T10:18:09.704633+0000","last_peered":"2023-12-18T10:18:09.704633+0000","last_clean":"2023-12-18T10:18:09.704633+0000","last_became_active":"2023-12-18T10:18:05.643043+0000","last_became_peered":"2023-12-18T10:18:05.643043+0000","last_unstale":"2023-12-18T10:18:09.704633+0000","last_undegraded":"2023-12-18T10:18:09.704633+0000","last_fullsized":"2023-12-18T10:18:09.704633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:18:05.206656+0000","last_clean_scrub_stamp":"2023-12-18T10:18:05.206656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:12:38.639031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.976}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.786}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.859}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:18:35.007 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-18T10:18:35.007 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-18T10:18:35.007 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-18T10:18:35.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-18T10:18:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57ae48c640 1 Processor -- start 2023-12-18T10:18:35.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57ae48c640 1 -- start start 2023-12-18T10:18:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57ae48c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a815ca40 0x7f57a80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57ae48c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a80d11c0 con 0x7f57a80cf7e0 2023-12-18T10:18:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57ae48c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a80d0310 con 0x7f57a80ce3f0 2023-12-18T10:18:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57ae48c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80d05b0 con 0x7f57a815ca40 2023-12-18T10:18:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57aca29640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f57a80cf7e0 0x7f57a81668e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48240/0 (socket says 172.21.15.133:48240) 2023-12-18T10:18:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57aca29640 1 -- 172.21.15.133:0/3857006988 learned_addr learned my addr 172.21.15.133:0/3857006988 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:35.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57a7fff640 1 --2- 172.21.15.133:0/3857006988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a815ca40 0x7f57a80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57a6ffd640 1 -- 172.21.15.133:0/3857006988 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374780272 0 0) 0x7f57a80d11c0 con 0x7f57a80cf7e0 2023-12-18T10:18:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57a6ffd640 1 -- 172.21.15.133:0/3857006988 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5790003530 con 0x7f57a80cf7e0 2023-12-18T10:18:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57a6ffd640 1 -- 172.21.15.133:0/3857006988 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518589003 0 0) 0x7f57a80d0310 con 0x7f57a80ce3f0 2023-12-18T10:18:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57a6ffd640 1 -- 172.21.15.133:0/3857006988 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a80d11c0 con 0x7f57a80ce3f0 2023-12-18T10:18:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57a7fff640 1 -- 172.21.15.133:0/3857006988 >> v1:172.21.15.142:6789/0 conn(0x7f57a80ce3f0 legacy=0x7f57a80cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57a7fff640 1 -- 172.21.15.133:0/3857006988 >> v1:172.21.15.133:6789/0 conn(0x7f57a80cf7e0 legacy=0x7f57a81668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.182+0000 7f57a7fff640 1 -- 172.21.15.133:0/3857006988 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80d0890 con 0x7f57a815ca40 2023-12-18T10:18:35.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57a7fff640 1 --2- 172.21.15.133:0/3857006988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a815ca40 0x7f57a80cdeb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57980097d0 tx=0x7f579801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39b60fab58a60892 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57a6ffd640 1 -- 172.21.15.133:0/3857006988 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980a6040 con 0x7f57a815ca40 2023-12-18T10:18:35.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57a6ffd640 1 -- 172.21.15.133:0/3857006988 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57980aa600 con 0x7f57a815ca40 2023-12-18T10:18:35.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57a6ffd640 1 -- 172.21.15.133:0/3857006988 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980aa990 con 0x7f57a815ca40 2023-12-18T10:18:35.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57ae48c640 1 -- 172.21.15.133:0/3857006988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a815ca40 msgr2=0x7f57a80cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57ae48c640 1 --2- 172.21.15.133:0/3857006988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a815ca40 0x7f57a80cdeb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57980097d0 tx=0x7f579801c4a0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57ae48c640 1 -- 172.21.15.133:0/3857006988 shutdown_connections 2023-12-18T10:18:35.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57ae48c640 1 --2- 172.21.15.133:0/3857006988 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a815ca40 0x7f57a80cdeb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57ae48c640 1 -- 172.21.15.133:0/3857006988 >> 172.21.15.133:0/3857006988 conn(0x7f57a8089fb0 msgr2=0x7f57a80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:35.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57ae48c640 1 -- 172.21.15.133:0/3857006988 shutdown_connections 2023-12-18T10:18:35.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.186+0000 7f57ae48c640 1 -- 172.21.15.133:0/3857006988 wait complete. 2023-12-18T10:18:35.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 Processor -- start 2023-12-18T10:18:35.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 -- start start 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a80ce3f0 0x7f57a815f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a80cf7e0 0x7f57a81588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a815ca40 0x7f57a815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815b950 con 0x7f57a815ca40 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a81548e0 con 0x7f57a80ce3f0 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a81545b0 con 0x7f57a80cf7e0 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a815ca40 0x7f57a815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a815ca40 0x7f57a815a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48774/0 (socket says 172.21.15.133:48774) 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 -- 172.21.15.133:0/1737251557 learned_addr learned my addr 172.21.15.133:0/1737251557 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57a77fe640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a80cf7e0 0x7f57a81588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57a7fff640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a80ce3f0 0x7f57a815f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 -- 172.21.15.133:0/1737251557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a80cf7e0 msgr2=0x7f57a81588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a80cf7e0 0x7f57a81588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 -- 172.21.15.133:0/1737251557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a80ce3f0 msgr2=0x7f57a815f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a80ce3f0 0x7f57a815f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 -- 172.21.15.133:0/1737251557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57980093b0 con 0x7f57a815ca40 2023-12-18T10:18:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57aca29640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a815ca40 0x7f57a815a510 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57a000cad0 tx=0x7f57a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57a4ff9640 1 -- 172.21.15.133:0/1737251557 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000ac30 con 0x7f57a815ca40 2023-12-18T10:18:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57a4ff9640 1 -- 172.21.15.133:0/1737251557 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a000adb0 con 0x7f57a815ca40 2023-12-18T10:18:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57a4ff9640 1 -- 172.21.15.133:0/1737251557 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0012640 con 0x7f57a815ca40 2023-12-18T10:18:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a80d17d0 con 0x7f57a815ca40 2023-12-18T10:18:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.190+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a815b670 con 0x7f57a815ca40 2023-12-18T10:18:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.194+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a8154410 con 0x7f57a815ca40 2023-12-18T10:18:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.194+0000 7f57a4ff9640 1 -- 172.21.15.133:0/1737251557 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57a0007070 con 0x7f57a815ca40 2023-12-18T10:18:35.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.194+0000 7f57a4ff9640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5794065a60 0x7f5794067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.194+0000 7f57a4ff9640 1 -- 172.21.15.133:0/1737251557 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57a00833c0 con 0x7f57a815ca40 2023-12-18T10:18:35.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.194+0000 7f57a7fff640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5794065a60 0x7f5794067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.194+0000 7f57a7fff640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5794065a60 0x7f5794067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f57980ae000 tx=0x7f57980b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.198+0000 7f57a4ff9640 1 -- 172.21.15.133:0/1737251557 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f57a8154410 con 0x7f57a815ca40 2023-12-18T10:18:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f57a8154410 con 0x7f57a815ca40 2023-12-18T10:18:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57a4ff9640 1 -- 172.21.15.133:0/1737251557 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f57a8154410 con 0x7f57a815ca40 2023-12-18T10:18:35.384 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:35.384 INFO:teuthology.orchestra.run.smithi133.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-18T10:18:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5794065a60 msgr2=0x7f5794067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5794065a60 0x7f5794067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f57980ae000 tx=0x7f57980b5040 comp rx=0 tx=0).stop 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a815ca40 msgr2=0x7f57a815a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a815ca40 0x7f57a815a510 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57a000cad0 tx=0x7f57a000cf90 comp rx=0 tx=0).stop 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 shutdown_connections 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5794065a60 0x7f5794067f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a815ca40 0x7f57a815a510 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57a80cf7e0 0x7f57a81588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 --2- 172.21.15.133:0/1737251557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57a80ce3f0 0x7f57a815f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 >> 172.21.15.133:0/1737251557 conn(0x7f57a8089fb0 msgr2=0x7f57a80ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 shutdown_connections 2023-12-18T10:18:35.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.382+0000 7f57ae48c640 1 -- 172.21.15.133:0/1737251557 wait complete. 2023-12-18T10:18:35.404 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-18T10:18:35.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:35.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.538+0000 7fcefed39640 1 Processor -- start 2023-12-18T10:18:35.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.538+0000 7fcefed39640 1 -- start start 2023-12-18T10:18:35.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcefed39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcef81570c0 0x7fcef806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcefed39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcef806c320 0x7fcef80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcefed39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80c9460 con 0x7fcef80c9e30 2023-12-18T10:18:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcefed39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef806c7a0 con 0x7fcef806c320 2023-12-18T10:18:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcefed39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef81574a0 con 0x7fcef81570c0 2023-12-18T10:18:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcef7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcef806c320 0x7fcef80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcef7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcef806c320 0x7fcef80c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48788/0 (socket says 172.21.15.133:48788) 2023-12-18T10:18:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcef7fff640 1 -- 172.21.15.133:0/1593382264 learned_addr learned my addr 172.21.15.133:0/1593382264 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:35.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcefcad5640 1 --2- 172.21.15.133:0/1593382264 >> v2:172.21.15.142:3300/0 conn(0x7fcef81570c0 0x7fcef806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcef7fff640 1 -- 172.21.15.133:0/1593382264 >> v2:172.21.15.142:3300/0 conn(0x7fcef81570c0 msgr2=0x7fcef806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcef7fff640 1 --2- 172.21.15.133:0/1593382264 >> v2:172.21.15.142:3300/0 conn(0x7fcef81570c0 0x7fcef806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcef7fff640 1 -- 172.21.15.133:0/1593382264 >> v1:172.21.15.142:6789/0 conn(0x7fcef80c9e30 legacy=0x7fcef815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:35.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.542+0000 7fcef7fff640 1 -- 172.21.15.133:0/1593382264 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80c8b30 con 0x7fcef806c320 2023-12-18T10:18:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcef7fff640 1 --2- 172.21.15.133:0/1593382264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef80c98f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcef806e280 tx=0x7fcee401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7564d3c90786d3c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcef77fe640 1 -- 172.21.15.133:0/1593382264 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40ac640 con 0x7fcef806c320 2023-12-18T10:18:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcef77fe640 1 -- 172.21.15.133:0/1593382264 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee40ac7a0 con 0x7fcef806c320 2023-12-18T10:18:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcef77fe640 1 -- 172.21.15.133:0/1593382264 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40acb30 con 0x7fcef806c320 2023-12-18T10:18:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 -- 172.21.15.133:0/1593382264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 msgr2=0x7fcef80c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 --2- 172.21.15.133:0/1593382264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef80c98f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcef806e280 tx=0x7fcee401c400 comp rx=0 tx=0).stop 2023-12-18T10:18:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 -- 172.21.15.133:0/1593382264 shutdown_connections 2023-12-18T10:18:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 --2- 172.21.15.133:0/1593382264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef80c98f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 --2- 172.21.15.133:0/1593382264 >> v2:172.21.15.142:3300/0 conn(0x7fcef81570c0 0x7fcef806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 -- 172.21.15.133:0/1593382264 >> 172.21.15.133:0/1593382264 conn(0x7fcef806a3e0 msgr2=0x7fcef80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 -- 172.21.15.133:0/1593382264 shutdown_connections 2023-12-18T10:18:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 -- 172.21.15.133:0/1593382264 wait complete. 2023-12-18T10:18:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 Processor -- start 2023-12-18T10:18:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.546+0000 7fcefed39640 1 -- start start 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef8151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80c9e30 0x7fcef80cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef81570c0 0x7fcef815ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80c5e00 con 0x7fcef806c320 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80cd4f0 con 0x7fcef80c9e30 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80c54d0 con 0x7fcef81570c0 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef8151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef8151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48796/0 (socket says 172.21.15.133:48796) 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 -- 172.21.15.133:0/2987358028 learned_addr learned my addr 172.21.15.133:0/2987358028 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcef7fff640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80c9e30 0x7fcef80cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefd2d6640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef81570c0 0x7fcef815ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 -- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef81570c0 msgr2=0x7fcef815ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef81570c0 0x7fcef815ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 -- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80c9e30 msgr2=0x7fcef80cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80c9e30 0x7fcef80cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 -- 172.21.15.133:0/2987358028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40094d0 con 0x7fcef806c320 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcef7fff640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80c9e30 0x7fcef80cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefcad5640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef8151170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fceec00d5f0 tx=0x7fceec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcef57fa640 1 -- 172.21.15.133:0/2987358028 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0125f0 con 0x7fcef806c320 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcef57fa640 1 -- 172.21.15.133:0/2987358028 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec012750 con 0x7fcef806c320 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcef57fa640 1 -- 172.21.15.133:0/2987358028 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec012ae0 con 0x7fcef806c320 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef80c57b0 con 0x7fcef806c320 2023-12-18T10:18:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef8151df0 con 0x7fcef806c320 2023-12-18T10:18:35.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef80735b0 con 0x7fcef806c320 2023-12-18T10:18:35.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.550+0000 7fcef57fa640 1 -- 172.21.15.133:0/2987358028 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fceec012c40 con 0x7fcef806c320 2023-12-18T10:18:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.554+0000 7fcef57fa640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcedc065a60 0x7fcedc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.554+0000 7fcef57fa640 1 -- 172.21.15.133:0/2987358028 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fceec083950 con 0x7fcef806c320 2023-12-18T10:18:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.554+0000 7fcef7fff640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcedc065a60 0x7fcedc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.554+0000 7fcef7fff640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcedc065a60 0x7fcedc067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcee40ae000 tx=0x7fcee4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.554+0000 7fcef57fa640 1 -- 172.21.15.133:0/2987358028 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fceec051010 con 0x7fcef806c320 2023-12-18T10:18:35.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.706+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcef804e000 con 0x7fcef806c320 2023-12-18T10:18:35.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.706+0000 7fcef57fa640 1 -- 172.21.15.133:0/2987358028 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fceec007380 con 0x7fcef806c320 2023-12-18T10:18:35.711 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:35.711 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcedc065a60 msgr2=0x7fcedc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcedc065a60 0x7fcedc067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcee40ae000 tx=0x7fcee4008040 comp rx=0 tx=0).stop 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 msgr2=0x7fcef8151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef8151170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fceec00d5f0 tx=0x7fceec00dab0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 shutdown_connections 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcedc065a60 0x7fcedc067f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcef81570c0 0x7fcef815ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcef80c9e30 0x7fcef80cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 --2- 172.21.15.133:0/2987358028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcef806c320 0x7fcef8151170 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 >> 172.21.15.133:0/2987358028 conn(0x7fcef806a3e0 msgr2=0x7fcef80ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:35.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 shutdown_connections 2023-12-18T10:18:35.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.710+0000 7fcefed39640 1 -- 172.21.15.133:0/2987358028 wait complete. 2023-12-18T10:18:35.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:35.732 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:35.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe1e02d640 1 Processor -- start 2023-12-18T10:18:35.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe1e02d640 1 -- start start 2023-12-18T10:18:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe1e02d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe180cc700 0x7fbe18071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe1e02d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe18070df0 con 0x7fbe180ca410 2023-12-18T10:18:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe1e02d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1815a4f0 con 0x7fbe18071870 2023-12-18T10:18:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe1e02d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1815aab0 con 0x7fbe180cc700 2023-12-18T10:18:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe177fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbe180ca410 0x7fbe18159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48248/0 (socket says 172.21.15.133:48248) 2023-12-18T10:18:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe177fe640 1 -- 172.21.15.133:0/300758649 learned_addr learned my addr 172.21.15.133:0/300758649 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe17fff640 1 --2- 172.21.15.133:0/300758649 >> v2:172.21.15.142:3300/0 conn(0x7fbe180cc700 0x7fbe18071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.870+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284806517 0 0) 0x7fbe18070df0 con 0x7fbe180ca410 2023-12-18T10:18:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe00005740 con 0x7fbe180ca410 2023-12-18T10:18:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3435010782 0 0) 0x7fbe00005740 con 0x7fbe180ca410 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 >> v2:172.21.15.142:3300/0 conn(0x7fbe180cc700 msgr2=0x7fbe18071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 --2- 172.21.15.133:0/300758649 >> v2:172.21.15.142:3300/0 conn(0x7fbe180cc700 0x7fbe18071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 >> v1:172.21.15.142:6789/0 conn(0x7fbe18071870 legacy=0x7fbe180cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1815a7d0 con 0x7fbe180ca410 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fbe08001680 con 0x7fbe180ca410 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 >> v1:172.21.15.133:6789/0 conn(0x7fbe180ca410 legacy=0x7fbe18159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe00005b90 0x7fbe00005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe00006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe000073a0 0x7fbe0000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1815aab0 con 0x7fbe000069e0 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0000e240 con 0x7fbe00005b90 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0000e400 con 0x7fbe000073a0 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe17fff640 1 --2- 172.21.15.133:0/300758649 >> v2:172.21.15.142:3300/0 conn(0x7fbe180cc700 0x7fbe18071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe16ffd640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe00006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe177fe640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe00005b90 0x7fbe00005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe17fff640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe000073a0 0x7fbe0000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe16ffd640 1 -- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe000073a0 msgr2=0x7fbe0000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe16ffd640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe000073a0 0x7fbe0000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe16ffd640 1 -- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe00005b90 msgr2=0x7fbe00005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe16ffd640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe00005b90 0x7fbe00005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe16ffd640 1 -- 172.21.15.133:0/300758649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00005740 con 0x7fbe000069e0 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe17fff640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe000073a0 0x7fbe0000dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe177fe640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe00005b90 0x7fbe00005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.874+0000 7fbe17fff640 1 -- 172.21.15.133:0/300758649 reap_dead start 2023-12-18T10:18:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe16ffd640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe00006e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c001780 tx=0x7fbe0c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d173c0f2c73586a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0052d0 con 0x7fbe000069e0 2023-12-18T10:18:35.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c0a7050 con 0x7fbe000069e0 2023-12-18T10:18:35.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe167fc640 1 -- 172.21.15.133:0/300758649 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c003600 con 0x7fbe000069e0 2023-12-18T10:18:35.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- 172.21.15.133:0/300758649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 msgr2=0x7fbe00006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe00006e60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c001780 tx=0x7fbe0c01c3e0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- 172.21.15.133:0/300758649 shutdown_connections 2023-12-18T10:18:35.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 --2- 172.21.15.133:0/300758649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe00006e60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- 172.21.15.133:0/300758649 >> 172.21.15.133:0/300758649 conn(0x7fbe1806a2a0 msgr2=0x7fbe180aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:35.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- 172.21.15.133:0/300758649 shutdown_connections 2023-12-18T10:18:35.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- 172.21.15.133:0/300758649 wait complete. 2023-12-18T10:18:35.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 Processor -- start 2023-12-18T10:18:35.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- start start 2023-12-18T10:18:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe181f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe180ab8a0 0x7fbe180abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe180aff70 0x7fbe180b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180b0930 con 0x7fbe000069e0 2023-12-18T10:18:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180adb70 con 0x7fbe180aff70 2023-12-18T10:18:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.878+0000 7fbe1e02d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180ac360 con 0x7fbe180ab8a0 2023-12-18T10:18:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe181f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe181f1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48820/0 (socket says 172.21.15.133:48820) 2023-12-18T10:18:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 -- 172.21.15.133:0/123950019 learned_addr learned my addr 172.21.15.133:0/123950019 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 -- 172.21.15.133:0/123950019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe180ab8a0 msgr2=0x7fbe180abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe17fff640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe180aff70 0x7fbe180b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe180ab8a0 0x7fbe180abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 -- 172.21.15.133:0/123950019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe180aff70 msgr2=0x7fbe180b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe180aff70 0x7fbe180b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 -- 172.21.15.133:0/123950019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe180ac640 con 0x7fbe000069e0 2023-12-18T10:18:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe17fff640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe180aff70 0x7fbe180b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe177fe640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe181f1310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe08000c10 tx=0x7fbe08005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbdfffff640 1 -- 172.21.15.133:0/123950019 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0800ec10 con 0x7fbe000069e0 2023-12-18T10:18:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbdfffff640 1 -- 172.21.15.133:0/123950019 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0800ed70 con 0x7fbe000069e0 2023-12-18T10:18:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe180ac920 con 0x7fbe000069e0 2023-12-18T10:18:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbdfffff640 1 -- 172.21.15.133:0/123950019 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe080145a0 con 0x7fbe000069e0 2023-12-18T10:18:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe180ad790 con 0x7fbe000069e0 2023-12-18T10:18:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1804e000 con 0x7fbe000069e0 2023-12-18T10:18:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.882+0000 7fbdfffff640 1 -- 172.21.15.133:0/123950019 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe08014700 con 0x7fbe000069e0 2023-12-18T10:18:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.886+0000 7fbdfffff640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe04065a60 0x7fbe04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.886+0000 7fbdfffff640 1 -- 172.21.15.133:0/123950019 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe080864d0 con 0x7fbe000069e0 2023-12-18T10:18:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.886+0000 7fbe16ffd640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe04065a60 0x7fbe04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.886+0000 7fbe16ffd640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe04065a60 0x7fbe04067f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c001750 tx=0x7fbe0c001130 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:35.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:35.890+0000 7fbdfffff640 1 -- 172.21.15.133:0/123950019 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbe08053a70 con 0x7fbe000069e0 2023-12-18T10:18:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.042+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe180adcb0 con 0x7fbe000069e0 2023-12-18T10:18:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.042+0000 7fbdfffff640 1 -- 172.21.15.133:0/123950019 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe0801b0a0 con 0x7fbe000069e0 2023-12-18T10:18:36.046 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe04065a60 msgr2=0x7fbe04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe04065a60 0x7fbe04067f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c001750 tx=0x7fbe0c001130 comp rx=0 tx=0).stop 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 msgr2=0x7fbe181f1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe181f1310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe08000c10 tx=0x7fbe08005810 comp rx=0 tx=0).stop 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 shutdown_connections 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe04065a60 0x7fbe04067f20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe180aff70 0x7fbe180b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe180ab8a0 0x7fbe180abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 --2- 172.21.15.133:0/123950019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe000069e0 0x7fbe181f1310 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 >> 172.21.15.133:0/123950019 conn(0x7fbe1806a2a0 msgr2=0x7fbe18156960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 shutdown_connections 2023-12-18T10:18:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.046+0000 7fbe1e02d640 1 -- 172.21.15.133:0/123950019 wait complete. 2023-12-18T10:18:36.067 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:36.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06bcc4640 1 Processor -- start 2023-12-18T10:18:36.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06bcc4640 1 -- start start 2023-12-18T10:18:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06bcc4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe064158ca0 0x7fe06406c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06bcc4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064159b60 0x7fe0640c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06bcc4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06406d150 con 0x7fe06406ccc0 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06bcc4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe064159fd0 con 0x7fe064158ca0 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06bcc4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06415d230 con 0x7fe064159b60 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe069a60640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe064158ca0 0x7fe06406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe069a60640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe064158ca0 0x7fe06406c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48826/0 (socket says 172.21.15.133:48826) 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe069a60640 1 -- 172.21.15.133:0/1351998915 learned_addr learned my addr 172.21.15.133:0/1351998915 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06a261640 1 --2- 172.21.15.133:0/1351998915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064159b60 0x7fe0640c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe069a60640 1 -- 172.21.15.133:0/1351998915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064159b60 msgr2=0x7fe0640c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe069a60640 1 --2- 172.21.15.133:0/1351998915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064159b60 0x7fe0640c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe069a60640 1 -- 172.21.15.133:0/1351998915 >> v1:172.21.15.142:6789/0 conn(0x7fe06406ccc0 legacy=0x7fe064159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe069a60640 1 -- 172.21.15.133:0/1351998915 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06415c900 con 0x7fe064158ca0 2023-12-18T10:18:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.206+0000 7fe06a261640 1 --2- 172.21.15.133:0/1351998915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064159b60 0x7fe0640c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe069a60640 1 --2- 172.21.15.133:0/1351998915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064158ca0 0x7fe06406c780 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe060009870 tx=0x7fe06001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81510415d6aaf63 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe068a5e640 1 -- 172.21.15.133:0/1351998915 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600ab640 con 0x7fe064158ca0 2023-12-18T10:18:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe068a5e640 1 -- 172.21.15.133:0/1351998915 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0600a7070 con 0x7fe064158ca0 2023-12-18T10:18:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe068a5e640 1 -- 172.21.15.133:0/1351998915 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600ab9c0 con 0x7fe064158ca0 2023-12-18T10:18:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe06bcc4640 1 -- 172.21.15.133:0/1351998915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064158ca0 msgr2=0x7fe06406c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/1351998915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064158ca0 0x7fe06406c780 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe060009870 tx=0x7fe06001c500 comp rx=0 tx=0).stop 2023-12-18T10:18:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe06bcc4640 1 -- 172.21.15.133:0/1351998915 shutdown_connections 2023-12-18T10:18:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/1351998915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064159b60 0x7fe0640c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/1351998915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064158ca0 0x7fe06406c780 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe06bcc4640 1 -- 172.21.15.133:0/1351998915 >> 172.21.15.133:0/1351998915 conn(0x7fe0640cebc0 msgr2=0x7fe0640cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe06bcc4640 1 -- 172.21.15.133:0/1351998915 shutdown_connections 2023-12-18T10:18:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.210+0000 7fe06bcc4640 1 -- 172.21.15.133:0/1351998915 wait complete. 2023-12-18T10:18:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 Processor -- start 2023-12-18T10:18:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 -- start start 2023-12-18T10:18:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe06406ccc0 0x7fe06414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064158ca0 0x7fe064150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064159b60 0x7fe0640ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640b1b90 con 0x7fe064159b60 2023-12-18T10:18:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06414f2e0 con 0x7fe06406ccc0 2023-12-18T10:18:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06414f5c0 con 0x7fe064158ca0 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064159b60 0x7fe0640ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064159b60 0x7fe0640ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48834/0 (socket says 172.21.15.133:48834) 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 -- 172.21.15.133:0/4001332674 learned_addr learned my addr 172.21.15.133:0/4001332674 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe069a60640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe06406ccc0 0x7fe06414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06925f640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064158ca0 0x7fe064150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 -- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064158ca0 msgr2=0x7fe064150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064158ca0 0x7fe064150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 -- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe06406ccc0 msgr2=0x7fe06414b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe06406ccc0 0x7fe06414b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 -- 172.21.15.133:0/4001332674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0600094d0 con 0x7fe064159b60 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06925f640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064158ca0 0x7fe064150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06a261640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064159b60 0x7fe0640ca250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00cef0 tx=0x7fe05c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe05a7fc640 1 -- 172.21.15.133:0/4001332674 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00d840 con 0x7fe064159b60 2023-12-18T10:18:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe05a7fc640 1 -- 172.21.15.133:0/4001332674 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c00d9c0 con 0x7fe064159b60 2023-12-18T10:18:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe05a7fc640 1 -- 172.21.15.133:0/4001332674 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00dd70 con 0x7fe064159b60 2023-12-18T10:18:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06414f8a0 con 0x7fe064159b60 2023-12-18T10:18:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.214+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06414fe60 con 0x7fe064159b60 2023-12-18T10:18:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.218+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0640714f0 con 0x7fe064159b60 2023-12-18T10:18:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.218+0000 7fe05a7fc640 1 -- 172.21.15.133:0/4001332674 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe05c01e3b0 con 0x7fe064159b60 2023-12-18T10:18:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.218+0000 7fe05a7fc640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe048065a60 0x7fe048067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.218+0000 7fe05a7fc640 1 -- 172.21.15.133:0/4001332674 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe05c083fa0 con 0x7fe064159b60 2023-12-18T10:18:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.218+0000 7fe069a60640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe048065a60 0x7fe048067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.218+0000 7fe069a60640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe048065a60 0x7fe048067f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0600af000 tx=0x7fe0600a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.222+0000 7fe05a7fc640 1 -- 172.21.15.133:0/4001332674 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe05c051690 con 0x7fe064159b60 2023-12-18T10:18:36.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.370+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe06415d6a0 con 0x7fe064159b60 2023-12-18T10:18:36.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.370+0000 7fe05a7fc640 1 -- 172.21.15.133:0/4001332674 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe05c01a020 con 0x7fe064159b60 2023-12-18T10:18:36.375 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe048065a60 msgr2=0x7fe048067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe048065a60 0x7fe048067f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0600af000 tx=0x7fe0600a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064159b60 msgr2=0x7fe0640ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064159b60 0x7fe0640ca250 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00cef0 tx=0x7fe05c00a710 comp rx=0 tx=0).stop 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 shutdown_connections 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe048065a60 0x7fe048067f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe064159b60 0x7fe0640ca250 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe064158ca0 0x7fe064150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 --2- 172.21.15.133:0/4001332674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe06406ccc0 0x7fe06414b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 >> 172.21.15.133:0/4001332674 conn(0x7fe0640cebc0 msgr2=0x7fe064151230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:36.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 shutdown_connections 2023-12-18T10:18:36.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.374+0000 7fe06bcc4640 1 -- 172.21.15.133:0/4001332674 wait complete. 2023-12-18T10:18:36.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:36.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39ac0c4640 1 Processor -- start 2023-12-18T10:18:36.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39ac0c4640 1 -- start start 2023-12-18T10:18:36.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39ac0c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39a4071870 0x7f39a4071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39ac0c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a4070df0 con 0x7f39a40cbff0 2023-12-18T10:18:36.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39ac0c4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a415a4f0 con 0x7f39a40ca410 2023-12-18T10:18:36.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39ac0c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a415aab0 con 0x7f39a4071870 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39aa661640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f39a40cbff0 0x7f39a40ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48254/0 (socket says 172.21.15.133:48254) 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39aa661640 1 -- 172.21.15.133:0/3257059361 learned_addr learned my addr 172.21.15.133:0/3257059361 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39a965f640 1 --2- 172.21.15.133:0/3257059361 >> v2:172.21.15.142:3300/0 conn(0x7f39a4071870 0x7f39a4071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39a8e5e640 1 -- 172.21.15.133:0/3257059361 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010021059 0 0) 0x7f39a4070df0 con 0x7f39a40cbff0 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39a8e5e640 1 -- 172.21.15.133:0/3257059361 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3990003530 con 0x7f39a40cbff0 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39a965f640 1 -- 172.21.15.133:0/3257059361 >> v1:172.21.15.142:6789/0 conn(0x7f39a40ca410 legacy=0x7f39a4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39a8e5e640 1 -- 172.21.15.133:0/3257059361 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562617760 0 0) 0x7f39a415a4f0 con 0x7f39a40ca410 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39a965f640 1 -- 172.21.15.133:0/3257059361 >> v1:172.21.15.133:6789/0 conn(0x7f39a40cbff0 legacy=0x7f39a40ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.534+0000 7f39a965f640 1 -- 172.21.15.133:0/3257059361 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a415a7d0 con 0x7f39a4071870 2023-12-18T10:18:36.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39a965f640 1 --2- 172.21.15.133:0/3257059361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a4071870 0x7f39a4071d00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39940097c0 tx=0x7f399401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a31a9a9042cb121e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39a8e5e640 1 -- 172.21.15.133:0/3257059361 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940ab650 con 0x7f39a4071870 2023-12-18T10:18:36.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39a8e5e640 1 -- 172.21.15.133:0/3257059361 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39940ab7b0 con 0x7f39a4071870 2023-12-18T10:18:36.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39a8e5e640 1 -- 172.21.15.133:0/3257059361 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940abb20 con 0x7f39a4071870 2023-12-18T10:18:36.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3257059361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a4071870 msgr2=0x7f39a4071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39ac0c4640 1 --2- 172.21.15.133:0/3257059361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a4071870 0x7f39a4071d00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39940097c0 tx=0x7f399401c450 comp rx=0 tx=0).stop 2023-12-18T10:18:36.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3257059361 shutdown_connections 2023-12-18T10:18:36.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39ac0c4640 1 --2- 172.21.15.133:0/3257059361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a4071870 0x7f39a4071d00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3257059361 >> 172.21.15.133:0/3257059361 conn(0x7f39a406a2a0 msgr2=0x7f39a40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:36.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3257059361 shutdown_connections 2023-12-18T10:18:36.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.538+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3257059361 wait complete. 2023-12-18T10:18:36.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 Processor -- start 2023-12-18T10:18:36.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 -- start start 2023-12-18T10:18:36.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a4071870 0x7f39a40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39a40ca410 0x7f39a40c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a40cbff0 0x7f39a40c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4168550 con 0x7f39a40ca410 2023-12-18T10:18:36.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4168830 con 0x7f39a40cbff0 2023-12-18T10:18:36.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4168b10 con 0x7f39a4071870 2023-12-18T10:18:36.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39a40ca410 0x7f39a40c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39a40ca410 0x7f39a40c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48846/0 (socket says 172.21.15.133:48846) 2023-12-18T10:18:36.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 -- 172.21.15.133:0/3361016991 learned_addr learned my addr 172.21.15.133:0/3361016991 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:36.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39aa661640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a40cbff0 0x7f39a40c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a9e60640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a4071870 0x7f39a40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 -- 172.21.15.133:0/3361016991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a4071870 msgr2=0x7f39a40b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a4071870 0x7f39a40b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 -- 172.21.15.133:0/3361016991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a40cbff0 msgr2=0x7f39a40c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a40cbff0 0x7f39a40c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 -- 172.21.15.133:0/3361016991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994009420 con 0x7f39a40ca410 2023-12-18T10:18:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39a965f640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39a40ca410 0x7f39a40c4180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f39940ad040 tx=0x7f39940191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f399a7fc640 1 -- 172.21.15.133:0/3361016991 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994004450 con 0x7f39a40ca410 2023-12-18T10:18:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f399a7fc640 1 -- 172.21.15.133:0/3361016991 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39940ab920 con 0x7f39a40ca410 2023-12-18T10:18:36.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f399a7fc640 1 -- 172.21.15.133:0/3361016991 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940abcb0 con 0x7f39a40ca410 2023-12-18T10:18:36.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a40cc960 con 0x7f39a40ca410 2023-12-18T10:18:36.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.542+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a41690d0 con 0x7f39a40ca410 2023-12-18T10:18:36.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.546+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a41692c0 con 0x7f39a40ca410 2023-12-18T10:18:36.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.546+0000 7f399a7fc640 1 -- 172.21.15.133:0/3361016991 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3994003620 con 0x7f39a40ca410 2023-12-18T10:18:36.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.546+0000 7f399a7fc640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3988065a60 0x7f3988067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.546+0000 7f399a7fc640 1 -- 172.21.15.133:0/3361016991 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f399411d800 con 0x7f39a40ca410 2023-12-18T10:18:36.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.546+0000 7f39a9e60640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3988065a60 0x7f3988067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.546+0000 7f39a9e60640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3988065a60 0x7f3988067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f39a0000f70 tx=0x7f39a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.550+0000 7f399a7fc640 1 -- 172.21.15.133:0/3361016991 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39940eae30 con 0x7f39a40ca410 2023-12-18T10:18:36.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.698+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39a404e000 con 0x7f39a40ca410 2023-12-18T10:18:36.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.698+0000 7f399a7fc640 1 -- 172.21.15.133:0/3361016991 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39940ee450 con 0x7f39a40ca410 2023-12-18T10:18:36.702 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:36.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3988065a60 msgr2=0x7f3988067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3988065a60 0x7f3988067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f39a0000f70 tx=0x7f39a0009040 comp rx=0 tx=0).stop 2023-12-18T10:18:36.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39a40ca410 msgr2=0x7f39a40c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39a40ca410 0x7f39a40c4180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f39940ad040 tx=0x7f39940191f0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 shutdown_connections 2023-12-18T10:18:36.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3988065a60 0x7f3988067f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39a40cbff0 0x7f39a40c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39a40ca410 0x7f39a40c4180 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 --2- 172.21.15.133:0/3361016991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39a4071870 0x7f39a40b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 >> 172.21.15.133:0/3361016991 conn(0x7f39a406a2a0 msgr2=0x7f39a40ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:36.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 shutdown_connections 2023-12-18T10:18:36.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.702+0000 7f39ac0c4640 1 -- 172.21.15.133:0/3361016991 wait complete. 2023-12-18T10:18:36.723 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:36.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d3612640 1 Processor -- start 2023-12-18T10:18:36.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d3612640 1 -- start start 2023-12-18T10:18:36.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d3612640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8cc0cde20 0x7ff8cc165030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d3612640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc0cc980 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d3612640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc0cc090 con 0x7ff8cc160a60 2023-12-18T10:18:36.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d3612640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc0cc330 con 0x7ff8cc0cde20 2023-12-18T10:18:36.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d0bad640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff8cc0ceac0 0x7ff8cc164920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48256/0 (socket says 172.21.15.133:48256) 2023-12-18T10:18:36.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d0bad640 1 -- 172.21.15.133:0/3314024418 learned_addr learned my addr 172.21.15.133:0/3314024418 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:36.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d1baf640 1 --2- 172.21.15.133:0/3314024418 >> v2:172.21.15.142:3300/0 conn(0x7ff8cc0cde20 0x7ff8cc165030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8c3fff640 1 -- 172.21.15.133:0/3314024418 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692925730 0 0) 0x7ff8cc0cc980 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8c3fff640 1 -- 172.21.15.133:0/3314024418 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b8003530 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d1baf640 1 -- 172.21.15.133:0/3314024418 >> v1:172.21.15.142:6789/0 conn(0x7ff8cc160a60 legacy=0x7ff8cc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8c3fff640 1 -- 172.21.15.133:0/3314024418 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 274093927 0 0) 0x7ff8b8003530 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d1baf640 1 -- 172.21.15.133:0/3314024418 >> v1:172.21.15.133:6789/0 conn(0x7ff8cc0ceac0 legacy=0x7ff8cc164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.862+0000 7ff8d1baf640 1 -- 172.21.15.133:0/3314024418 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0cc610 con 0x7ff8cc0cde20 2023-12-18T10:18:36.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8d1baf640 1 --2- 172.21.15.133:0/3314024418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc0cde20 0x7ff8cc165030 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009d90 tx=0x7ff8c401c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2da730133fee509e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8c3fff640 1 -- 172.21.15.133:0/3314024418 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc001680 con 0x7ff8cc0cde20 2023-12-18T10:18:36.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8c3fff640 1 -- 172.21.15.133:0/3314024418 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c40a5580 con 0x7ff8cc0cde20 2023-12-18T10:18:36.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8c3fff640 1 -- 172.21.15.133:0/3314024418 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40a5910 con 0x7ff8cc0cde20 2023-12-18T10:18:36.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8d3612640 1 -- 172.21.15.133:0/3314024418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc0cde20 msgr2=0x7ff8cc165030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8d3612640 1 --2- 172.21.15.133:0/3314024418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc0cde20 0x7ff8cc165030 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009d90 tx=0x7ff8c401c720 comp rx=0 tx=0).stop 2023-12-18T10:18:36.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8d3612640 1 -- 172.21.15.133:0/3314024418 shutdown_connections 2023-12-18T10:18:36.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8d3612640 1 --2- 172.21.15.133:0/3314024418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc0cde20 0x7ff8cc165030 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8d3612640 1 -- 172.21.15.133:0/3314024418 >> 172.21.15.133:0/3314024418 conn(0x7ff8cc06a2a0 msgr2=0x7ff8cc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:36.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8d3612640 1 -- 172.21.15.133:0/3314024418 shutdown_connections 2023-12-18T10:18:36.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.866+0000 7ff8d3612640 1 -- 172.21.15.133:0/3314024418 wait complete. 2023-12-18T10:18:36.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 Processor -- start 2023-12-18T10:18:36.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 -- start start 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cde20 0x7ff8cc14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc0ceac0 0x7ff8cc154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc160a60 0x7ff8cc15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc14cea0 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc155240 con 0x7ff8cc160a60 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc154f60 con 0x7ff8cc0cde20 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc0ceac0 0x7ff8cc154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc0ceac0 0x7ff8cc154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48850/0 (socket says 172.21.15.133:48850) 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 -- 172.21.15.133:0/3369496875 learned_addr learned my addr 172.21.15.133:0/3369496875 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d13ae640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cde20 0x7ff8cc14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d1baf640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc160a60 0x7ff8cc15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 -- 172.21.15.133:0/3369496875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cde20 msgr2=0x7ff8cc14bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cde20 0x7ff8cc14bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 -- 172.21.15.133:0/3369496875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc160a60 msgr2=0x7ff8cc15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc160a60 0x7ff8cc15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 -- 172.21.15.133:0/3369496875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009a70 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d0bad640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc0ceac0 0x7ff8cc154710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c730 tx=0x7ff8bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8c1ffb640 1 -- 172.21.15.133:0/3369496875 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0072d0 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8c1ffb640 1 -- 172.21.15.133:0/3369496875 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc007450 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc14c850 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8c1ffb640 1 -- 172.21.15.133:0/3369496875 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0047f0 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.870+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc14c4a0 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.874+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc14d050 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.874+0000 7ff8c1ffb640 1 -- 172.21.15.133:0/3369496875 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8bc004950 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.874+0000 7ff8c1ffb640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b0065a60 0x7ff8b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:36.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.874+0000 7ff8c1ffb640 1 -- 172.21.15.133:0/3369496875 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff8bc082890 con 0x7ff8cc0ceac0 2023-12-18T10:18:36.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.874+0000 7ff8d13ae640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b0065a60 0x7ff8b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.874+0000 7ff8d13ae640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b0065a60 0x7ff8b0067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8007fd0 tx=0x7ff8c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:36.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:36.878+0000 7ff8c1ffb640 1 -- 172.21.15.133:0/3369496875 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff8cc14d050 con 0x7ff8cc0ceac0 2023-12-18T10:18:37.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.026+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff8cc14d050 con 0x7ff8cc0ceac0 2023-12-18T10:18:37.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.026+0000 7ff8c1ffb640 1 -- 172.21.15.133:0/3369496875 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff8cc14d050 con 0x7ff8cc0ceac0 2023-12-18T10:18:37.030 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b0065a60 msgr2=0x7ff8b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b0065a60 0x7ff8b0067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8007fd0 tx=0x7ff8c8009040 comp rx=0 tx=0).stop 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc0ceac0 msgr2=0x7ff8cc154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc0ceac0 0x7ff8cc154710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c730 tx=0x7ff8bc00cbf0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 shutdown_connections 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b0065a60 0x7ff8b0067f20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8cc160a60 0x7ff8cc15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc0ceac0 0x7ff8cc154710 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 --2- 172.21.15.133:0/3369496875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8cc0cde20 0x7ff8cc14bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 >> 172.21.15.133:0/3369496875 conn(0x7ff8cc06a2a0 msgr2=0x7ff8cc0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 shutdown_connections 2023-12-18T10:18:37.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.030+0000 7ff8d3612640 1 -- 172.21.15.133:0/3369496875 wait complete. 2023-12-18T10:18:37.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:18:37.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.186+0000 7f25b6ff0640 1 Processor -- start 2023-12-18T10:18:37.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.186+0000 7f25b6ff0640 1 -- start start 2023-12-18T10:18:37.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.186+0000 7f25b6ff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b015a680 0x7f25b015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.186+0000 7f25b6ff0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25b006fdb0 0x7f25b0070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.186+0000 7f25b6ff0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b015f100 con 0x7f25b00cac10 2023-12-18T10:18:37.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.186+0000 7f25b6ff0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b0070780 con 0x7f25b006fdb0 2023-12-18T10:18:37.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.186+0000 7f25b6ff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00ca7d0 con 0x7f25b015a680 2023-12-18T10:18:37.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.186+0000 7f25b558d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25b006fdb0 0x7f25b0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25b558d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25b006fdb0 0x7f25b0070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48858/0 (socket says 172.21.15.133:48858) 2023-12-18T10:18:37.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25b558d640 1 -- 172.21.15.133:0/1192401102 learned_addr learned my addr 172.21.15.133:0/1192401102 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:37.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25b4d8c640 1 --2- 172.21.15.133:0/1192401102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b015a680 0x7f25b015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25b558d640 1 -- 172.21.15.133:0/1192401102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b015a680 msgr2=0x7f25b015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:37.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25b558d640 1 --2- 172.21.15.133:0/1192401102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b015a680 0x7f25b015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25b558d640 1 -- 172.21.15.133:0/1192401102 >> v1:172.21.15.142:6789/0 conn(0x7f25b00cac10 legacy=0x7f25b015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:37.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25b558d640 1 -- 172.21.15.133:0/1192401102 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b015e860 con 0x7f25b006fdb0 2023-12-18T10:18:37.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25b558d640 1 --2- 172.21.15.133:0/1192401102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b006fdb0 0x7f25b0070240 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009e50 tx=0x7f25a801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f35b69de215e8a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25af7fe640 1 -- 172.21.15.133:0/1192401102 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80a57c0 con 0x7f25b006fdb0 2023-12-18T10:18:37.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25af7fe640 1 -- 172.21.15.133:0/1192401102 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80a5920 con 0x7f25b006fdb0 2023-12-18T10:18:37.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.190+0000 7f25af7fe640 1 -- 172.21.15.133:0/1192401102 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80a5cb0 con 0x7f25b006fdb0 2023-12-18T10:18:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- 172.21.15.133:0/1192401102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b006fdb0 msgr2=0x7f25b0070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/1192401102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b006fdb0 0x7f25b0070240 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009e50 tx=0x7f25a801c940 comp rx=0 tx=0).stop 2023-12-18T10:18:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- 172.21.15.133:0/1192401102 shutdown_connections 2023-12-18T10:18:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/1192401102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b006fdb0 0x7f25b0070240 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/1192401102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b015a680 0x7f25b015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- 172.21.15.133:0/1192401102 >> 172.21.15.133:0/1192401102 conn(0x7f25b006a3e0 msgr2=0x7f25b00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- 172.21.15.133:0/1192401102 shutdown_connections 2023-12-18T10:18:37.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- 172.21.15.133:0/1192401102 wait complete. 2023-12-18T10:18:37.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 Processor -- start 2023-12-18T10:18:37.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- start start 2023-12-18T10:18:37.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b006fdb0 0x7f25b00c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b00cac10 0x7f25b0158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b015a680 0x7f25b00b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c67f0 con 0x7f25b015a680 2023-12-18T10:18:37.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00b1cb0 con 0x7f25b00cac10 2023-12-18T10:18:37.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b6ff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c5be0 con 0x7f25b006fdb0 2023-12-18T10:18:37.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b558d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b015a680 0x7f25b00b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b558d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b015a680 0x7f25b00b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48860/0 (socket says 172.21.15.133:48860) 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b558d640 1 -- 172.21.15.133:0/2757257701 learned_addr learned my addr 172.21.15.133:0/2757257701 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b4d8c640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b006fdb0 0x7f25b00c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25affff640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b00cac10 0x7f25b0158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b558d640 1 -- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b006fdb0 msgr2=0x7f25b00c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b558d640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b006fdb0 0x7f25b00c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b558d640 1 -- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b00cac10 msgr2=0x7f25b0158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b558d640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b00cac10 0x7f25b0158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b558d640 1 -- 172.21.15.133:0/2757257701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8009b30 con 0x7f25b015a680 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.194+0000 7f25b4d8c640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b006fdb0 0x7f25b00c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25b558d640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b015a680 0x7f25b00b1770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f25a80af040 tx=0x7f25a80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2757257701 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80b8670 con 0x7f25b015a680 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2757257701 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80b87d0 con 0x7f25b015a680 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2757257701 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80b8b80 con 0x7f25b015a680 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b00c5ec0 con 0x7f25b015a680 2023-12-18T10:18:37.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b00c6480 con 0x7f25b015a680 2023-12-18T10:18:37.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b00735b0 con 0x7f25b015a680 2023-12-18T10:18:37.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2757257701 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f25a80b8ce0 con 0x7f25b015a680 2023-12-18T10:18:37.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25ad7fa640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2594065a60 0x7f2594067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2757257701 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25a811e8d0 con 0x7f25b015a680 2023-12-18T10:18:37.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.198+0000 7f25b4d8c640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2594065a60 0x7f2594067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.202+0000 7f25b4d8c640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2594065a60 0x7f2594067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f25b00af210 tx=0x7f25a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.202+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2757257701 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f25a80ebf00 con 0x7f25b015a680 2023-12-18T10:18:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.386+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25b00c69a0 con 0x7f25b015a680 2023-12-18T10:18:37.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.386+0000 7f25ad7fa640 1 -- 172.21.15.133:0/2757257701 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f25b00c69a0 con 0x7f25b015a680 2023-12-18T10:18:37.390 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:37.390 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:28.930501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-18T10:18:37.390 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 9 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2594065a60 msgr2=0x7f2594067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2594065a60 0x7f2594067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f25b00af210 tx=0x7f25a4008040 comp rx=0 tx=0).stop 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b015a680 msgr2=0x7f25b00b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b015a680 0x7f25b00b1770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f25a80af040 tx=0x7f25a80196e0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 shutdown_connections 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2594065a60 0x7f2594067f20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b015a680 0x7f25b00b1770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b00cac10 0x7f25b0158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 --2- 172.21.15.133:0/2757257701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b006fdb0 0x7f25b00c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 >> 172.21.15.133:0/2757257701 conn(0x7f25b006a3e0 msgr2=0x7f25b015c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:37.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 shutdown_connections 2023-12-18T10:18:37.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.390+0000 7f25b6ff0640 1 -- 172.21.15.133:0/2757257701 wait complete. 2023-12-18T10:18:37.411 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:37.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.546+0000 7f4970598640 1 Processor -- start 2023-12-18T10:18:37.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.546+0000 7f4970598640 1 -- start start 2023-12-18T10:18:37.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.546+0000 7f4970598640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49680704c0 0x7f49680cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.546+0000 7f4970598640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4968160690 con 0x7f496815c9d0 2023-12-18T10:18:37.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.546+0000 7f4970598640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49680b0d80 con 0x7f49680cdd40 2023-12-18T10:18:37.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.546+0000 7f4970598640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49681603f0 con 0x7f49680704c0 2023-12-18T10:18:37.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.546+0000 7f496e334640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f496815c9d0 0x7f4968160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48272/0 (socket says 172.21.15.133:48272) 2023-12-18T10:18:37.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.546+0000 7f496e334640 1 -- 172.21.15.133:0/1055512444 learned_addr learned my addr 172.21.15.133:0/1055512444 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496eb35640 1 --2- 172.21.15.133:0/1055512444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49680704c0 0x7f49680cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496d332640 1 -- 172.21.15.133:0/1055512444 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236029234 0 0) 0x7f4968160690 con 0x7f496815c9d0 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496d332640 1 -- 172.21.15.133:0/1055512444 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4954003530 con 0x7f496815c9d0 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496d332640 1 -- 172.21.15.133:0/1055512444 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005417631 0 0) 0x7f49680b0d80 con 0x7f49680cdd40 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496d332640 1 -- 172.21.15.133:0/1055512444 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4968160690 con 0x7f49680cdd40 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496eb35640 1 -- 172.21.15.133:0/1055512444 >> v1:172.21.15.142:6789/0 conn(0x7f49680cdd40 legacy=0x7f496806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496eb35640 1 -- 172.21.15.133:0/1055512444 >> v1:172.21.15.133:6789/0 conn(0x7f496815c9d0 legacy=0x7f4968160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496d332640 1 -- 172.21.15.133:0/1055512444 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3829486824 0 0) 0x7f4954003530 con 0x7f496815c9d0 2023-12-18T10:18:37.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496eb35640 1 -- 172.21.15.133:0/1055512444 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680ccb00 con 0x7f49680704c0 2023-12-18T10:18:37.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496eb35640 1 --2- 172.21.15.133:0/1055512444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49680704c0 0x7f49680cc400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4960009dc0 tx=0x7f496001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c1e47d83f860395 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496d332640 1 -- 172.21.15.133:0/1055512444 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964001680 con 0x7f49680704c0 2023-12-18T10:18:37.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496d332640 1 -- 172.21.15.133:0/1055512444 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49600a56f0 con 0x7f49680704c0 2023-12-18T10:18:37.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.550+0000 7f496d332640 1 -- 172.21.15.133:0/1055512444 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600a5a60 con 0x7f49680704c0 2023-12-18T10:18:37.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- 172.21.15.133:0/1055512444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49680704c0 msgr2=0x7f49680cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 --2- 172.21.15.133:0/1055512444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49680704c0 0x7f49680cc400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4960009dc0 tx=0x7f496001c890 comp rx=0 tx=0).stop 2023-12-18T10:18:37.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- 172.21.15.133:0/1055512444 shutdown_connections 2023-12-18T10:18:37.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 --2- 172.21.15.133:0/1055512444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49680704c0 0x7f49680cc400 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- 172.21.15.133:0/1055512444 >> 172.21.15.133:0/1055512444 conn(0x7f496806a3e0 msgr2=0x7f49680afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:37.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- 172.21.15.133:0/1055512444 shutdown_connections 2023-12-18T10:18:37.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- 172.21.15.133:0/1055512444 wait complete. 2023-12-18T10:18:37.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 Processor -- start 2023-12-18T10:18:37.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- start start 2023-12-18T10:18:37.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49680cdd40 0x7f49680c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496815c9d0 0x7f49680c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4968155880 0x7f496815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680c46a0 con 0x7f49680cdd40 2023-12-18T10:18:37.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496815e4b0 con 0x7f496815c9d0 2023-12-18T10:18:37.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f4970598640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496815e750 con 0x7f4968155880 2023-12-18T10:18:37.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496e334640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49680cdd40 0x7f49680c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496e334640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49680cdd40 0x7f49680c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48874/0 (socket says 172.21.15.133:48874) 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496e334640 1 -- 172.21.15.133:0/1671842852 learned_addr learned my addr 172.21.15.133:0/1671842852 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496db33640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496815c9d0 0x7f49680c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496eb35640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4968155880 0x7f496815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496e334640 1 -- 172.21.15.133:0/1671842852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4968155880 msgr2=0x7f496815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496e334640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4968155880 0x7f496815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496e334640 1 -- 172.21.15.133:0/1671842852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496815c9d0 msgr2=0x7f49680c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.554+0000 7f496e334640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496815c9d0 0x7f49680c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f496e334640 1 -- 172.21.15.133:0/1671842852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009a70 con 0x7f49680cdd40 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f496e334640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49680cdd40 0x7f49680c4160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f496400c700 tx=0x7f496400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f495effd640 1 -- 172.21.15.133:0/1671842852 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964005ae0 con 0x7f49680cdd40 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f495effd640 1 -- 172.21.15.133:0/1671842852 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4964005c40 con 0x7f49680cdd40 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49681613b0 con 0x7f49680cdd40 2023-12-18T10:18:37.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f495effd640 1 -- 172.21.15.133:0/1671842852 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964007270 con 0x7f49680cdd40 2023-12-18T10:18:37.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496815ed10 con 0x7f49680cdd40 2023-12-18T10:18:37.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49680735b0 con 0x7f49680cdd40 2023-12-18T10:18:37.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f495effd640 1 -- 172.21.15.133:0/1671842852 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f49640073d0 con 0x7f49680cdd40 2023-12-18T10:18:37.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.558+0000 7f495effd640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f494c065a60 0x7f494c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.562+0000 7f495effd640 1 -- 172.21.15.133:0/1671842852 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4964082a80 con 0x7f49680cdd40 2023-12-18T10:18:37.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.562+0000 7f496db33640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f494c065a60 0x7f494c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.562+0000 7f496db33640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f494c065a60 0x7f494c067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f496815e2a0 tx=0x7f4958009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.566+0000 7f495effd640 1 -- 172.21.15.133:0/1671842852 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4964050200 con 0x7f49680cdd40 2023-12-18T10:18:37.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f496804e000 con 0x7f49680cdd40 2023-12-18T10:18:37.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f495effd640 1 -- 172.21.15.133:0/1671842852 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f4964017020 con 0x7f49680cdd40 2023-12-18T10:18:37.725 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:37.725 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:37.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f494c065a60 msgr2=0x7f494c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f494c065a60 0x7f494c067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f496815e2a0 tx=0x7f4958009040 comp rx=0 tx=0).stop 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49680cdd40 msgr2=0x7f49680c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49680cdd40 0x7f49680c4160 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f496400c700 tx=0x7f496400cbc0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 shutdown_connections 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f494c065a60 0x7f494c067f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4968155880 0x7f496815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496815c9d0 0x7f49680c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 --2- 172.21.15.133:0/1671842852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49680cdd40 0x7f49680c4160 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.722+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 >> 172.21.15.133:0/1671842852 conn(0x7f496806a3e0 msgr2=0x7f49680b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.726+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 shutdown_connections 2023-12-18T10:18:37.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.726+0000 7f4970598640 1 -- 172.21.15.133:0/1671842852 wait complete. 2023-12-18T10:18:37.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:37.746 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:37.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.882+0000 7f1848a8c640 1 Processor -- start 2023-12-18T10:18:37.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.882+0000 7f1848a8c640 1 -- start start 2023-12-18T10:18:37.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f1848a8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18440ca410 0x7f1844159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f1848a8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1844159fb0 0x7f1844071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f1848a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1844071db0 0x7f18440cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f1848a8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184415aab0 con 0x7f18440ca410 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f1848a8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1844070df0 con 0x7f1844159fb0 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f1848a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184415a4f0 con 0x7f1844071db0 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f184259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18440ca410 0x7f1844159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f184259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18440ca410 0x7f1844159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48888/0 (socket says 172.21.15.133:48888) 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f184259c640 1 -- 172.21.15.133:0/393030406 learned_addr learned my addr 172.21.15.133:0/393030406 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f1841d9b640 1 --2- 172.21.15.133:0/393030406 >> v2:172.21.15.142:3300/0 conn(0x7f1844159fb0 0x7f1844071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f1842d9d640 1 --2- 172.21.15.133:0/393030406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1844071db0 0x7f18440cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f184259c640 1 -- 172.21.15.133:0/393030406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1844071db0 msgr2=0x7f18440cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f184259c640 1 --2- 172.21.15.133:0/393030406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1844071db0 0x7f18440cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f184259c640 1 -- 172.21.15.133:0/393030406 >> v2:172.21.15.142:3300/0 conn(0x7f1844159fb0 msgr2=0x7f1844071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f184259c640 1 --2- 172.21.15.133:0/393030406 >> v2:172.21.15.142:3300/0 conn(0x7f1844159fb0 0x7f1844071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.886+0000 7f184259c640 1 -- 172.21.15.133:0/393030406 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184415a7d0 con 0x7f18440ca410 2023-12-18T10:18:37.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f184259c640 1 --2- 172.21.15.133:0/393030406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18440ca410 0x7f1844159a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f18440cbeb0 tx=0x7f183401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acad83f0b4aef355 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f184159a640 1 -- 172.21.15.133:0/393030406 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340ac600 con 0x7f18440ca410 2023-12-18T10:18:37.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f184159a640 1 -- 172.21.15.133:0/393030406 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18340a8050 con 0x7f18440ca410 2023-12-18T10:18:37.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f184159a640 1 -- 172.21.15.133:0/393030406 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340ac980 con 0x7f18440ca410 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 -- 172.21.15.133:0/393030406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18440ca410 msgr2=0x7f1844159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 --2- 172.21.15.133:0/393030406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18440ca410 0x7f1844159a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f18440cbeb0 tx=0x7f183401c4d0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 -- 172.21.15.133:0/393030406 shutdown_connections 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 --2- 172.21.15.133:0/393030406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1844071db0 0x7f18440cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 --2- 172.21.15.133:0/393030406 >> v2:172.21.15.142:3300/0 conn(0x7f1844159fb0 0x7f1844071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 --2- 172.21.15.133:0/393030406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18440ca410 0x7f1844159a70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 -- 172.21.15.133:0/393030406 >> 172.21.15.133:0/393030406 conn(0x7f184406a2a0 msgr2=0x7f18440aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 -- 172.21.15.133:0/393030406 shutdown_connections 2023-12-18T10:18:37.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 -- 172.21.15.133:0/393030406 wait complete. 2023-12-18T10:18:37.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.890+0000 7f1848a8c640 1 Processor -- start 2023-12-18T10:18:37.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 -- start start 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1844071db0 0x7f18440c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18440ca410 0x7f18440ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1844159fb0 0x7f1844158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440c4ce0 con 0x7f1844071db0 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440ac2a0 con 0x7f1844159fb0 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18440ac580 con 0x7f18440ca410 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1844071db0 0x7f18440c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1844071db0 0x7f18440c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48904/0 (socket says 172.21.15.133:48904) 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 -- 172.21.15.133:0/52490500 learned_addr learned my addr 172.21.15.133:0/52490500 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1841d9b640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18440ca410 0x7f18440ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1842d9d640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1844159fb0 0x7f1844158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 -- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18440ca410 msgr2=0x7f18440ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18440ca410 0x7f18440ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 -- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1844159fb0 msgr2=0x7f1844158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1844159fb0 0x7f1844158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 -- 172.21.15.133:0/52490500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18340094d0 con 0x7f1844071db0 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1842d9d640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1844159fb0 0x7f1844158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f184259c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1844071db0 0x7f18440c47a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f183401ab80 tx=0x7f183401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1832ffd640 1 -- 172.21.15.133:0/52490500 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340bc070 con 0x7f1844071db0 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1832ffd640 1 -- 172.21.15.133:0/52490500 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18340ace70 con 0x7f1844071db0 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1832ffd640 1 -- 172.21.15.133:0/52490500 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340b7650 con 0x7f1844071db0 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18440ac860 con 0x7f1844071db0 2023-12-18T10:18:37.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18440ace20 con 0x7f1844071db0 2023-12-18T10:18:37.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.894+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184404e000 con 0x7f1844071db0 2023-12-18T10:18:37.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.898+0000 7f1832ffd640 1 -- 172.21.15.133:0/52490500 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f18340b3070 con 0x7f1844071db0 2023-12-18T10:18:37.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.898+0000 7f1832ffd640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1824065a90 0x7f1824067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:37.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.898+0000 7f1832ffd640 1 -- 172.21.15.133:0/52490500 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f183411cf30 con 0x7f1844071db0 2023-12-18T10:18:37.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.898+0000 7f1841d9b640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1824065a90 0x7f1824067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:37.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.898+0000 7f1841d9b640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1824065a90 0x7f1824067f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f184415bc60 tx=0x7f1838008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:37.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:37.902+0000 7f1832ffd640 1 -- 172.21.15.133:0/52490500 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f18340ea550 con 0x7f1844071db0 2023-12-18T10:18:38.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.050+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18440c9c80 con 0x7f1844071db0 2023-12-18T10:18:38.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.050+0000 7f1832ffd640 1 -- 172.21.15.133:0/52490500 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18340b10a0 con 0x7f1844071db0 2023-12-18T10:18:38.054 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:38.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1824065a90 msgr2=0x7f1824067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1824065a90 0x7f1824067f50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f184415bc60 tx=0x7f1838008040 comp rx=0 tx=0).stop 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1844071db0 msgr2=0x7f18440c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1844071db0 0x7f18440c47a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f183401ab80 tx=0x7f183401ad10 comp rx=0 tx=0).stop 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 shutdown_connections 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1824065a90 0x7f1824067f50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1844159fb0 0x7f1844158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18440ca410 0x7f18440ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 --2- 172.21.15.133:0/52490500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1844071db0 0x7f18440c47a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 >> 172.21.15.133:0/52490500 conn(0x7f184406a2a0 msgr2=0x7f18440aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 shutdown_connections 2023-12-18T10:18:38.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.054+0000 7f1848a8c640 1 -- 172.21.15.133:0/52490500 wait complete. 2023-12-18T10:18:38.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:38.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bc5a55640 1 Processor -- start 2023-12-18T10:18:38.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bc5a55640 1 -- start start 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bc5a55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc00c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bc5a55640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1bc01598d0 0x7f1bc00ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bc5a55640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bc00ce8d0 0x7f1bc0070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bc5a55640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00ced60 con 0x7f1bc01598d0 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bc5a55640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00c9730 con 0x7f1bc00ce8d0 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bc5a55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00c8e00 con 0x7f1bc0153020 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bb67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1bc01598d0 0x7f1bc00ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bb67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1bc01598d0 0x7f1bc00ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48912/0 (socket says 172.21.15.133:48912) 2023-12-18T10:18:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bb67fc640 1 -- 172.21.15.133:0/3651585887 learned_addr learned my addr 172.21.15.133:0/3651585887 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:38.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.214+0000 7f1bbf7fe640 1 --2- 172.21.15.133:0/3651585887 >> v2:172.21.15.142:3300/0 conn(0x7f1bc00ce8d0 0x7f1bc0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bb67fc640 1 -- 172.21.15.133:0/3651585887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 msgr2=0x7f1bc00c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:38.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bbeffd640 1 --2- 172.21.15.133:0/3651585887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc00c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bb67fc640 1 --2- 172.21.15.133:0/3651585887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc00c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bb67fc640 1 -- 172.21.15.133:0/3651585887 >> v2:172.21.15.142:3300/0 conn(0x7f1bc00ce8d0 msgr2=0x7f1bc0070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:38.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bb67fc640 1 --2- 172.21.15.133:0/3651585887 >> v2:172.21.15.142:3300/0 conn(0x7f1bc00ce8d0 0x7f1bc0070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bb67fc640 1 -- 172.21.15.133:0/3651585887 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00c90e0 con 0x7f1bc01598d0 2023-12-18T10:18:38.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bbf7fe640 1 --2- 172.21.15.133:0/3651585887 >> v2:172.21.15.142:3300/0 conn(0x7f1bc00ce8d0 0x7f1bc0070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:38.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bbeffd640 1 --2- 172.21.15.133:0/3651585887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc00c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:38.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bb67fc640 1 --2- 172.21.15.133:0/3651585887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc00ce390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00b1030 tx=0x7f1ba801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567514ece78eb2ca server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bbe7fc640 1 -- 172.21.15.133:0/3651585887 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba80ab600 con 0x7f1bc01598d0 2023-12-18T10:18:38.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bbe7fc640 1 -- 172.21.15.133:0/3651585887 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba80a7050 con 0x7f1bc01598d0 2023-12-18T10:18:38.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bbe7fc640 1 -- 172.21.15.133:0/3651585887 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba80ab980 con 0x7f1bc01598d0 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bc5a55640 1 -- 172.21.15.133:0/3651585887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 msgr2=0x7f1bc00ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/3651585887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc00ce390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00b1030 tx=0x7f1ba801c3b0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bc5a55640 1 -- 172.21.15.133:0/3651585887 shutdown_connections 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/3651585887 >> v2:172.21.15.142:3300/0 conn(0x7f1bc00ce8d0 0x7f1bc0070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/3651585887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc00ce390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/3651585887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc00c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.218+0000 7f1bc5a55640 1 -- 172.21.15.133:0/3651585887 >> 172.21.15.133:0/3651585887 conn(0x7f1bc006a2a0 msgr2=0x7f1bc00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 -- 172.21.15.133:0/3651585887 shutdown_connections 2023-12-18T10:18:38.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 -- 172.21.15.133:0/3651585887 wait complete. 2023-12-18T10:18:38.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 Processor -- start 2023-12-18T10:18:38.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 -- start start 2023-12-18T10:18:38.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bc00ce8d0 0x7f1bc0148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00c5690 con 0x7f1bc01598d0 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00c5970 con 0x7f1bc00ce8d0 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bc5a55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00c5c50 con 0x7f1bc0153020 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc015b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48928/0 (socket says 172.21.15.133:48928) 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 -- 172.21.15.133:0/1341379753 learned_addr learned my addr 172.21.15.133:0/1341379753 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bb67fc640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbeffd640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bc00ce8d0 0x7f1bc0148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 -- 172.21.15.133:0/1341379753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 msgr2=0x7f1bc015acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc015acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 -- 172.21.15.133:0/1341379753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bc00ce8d0 msgr2=0x7f1bc0148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bc00ce8d0 0x7f1bc0148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 -- 172.21.15.133:0/1341379753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80094d0 con 0x7f1bc01598d0 2023-12-18T10:18:38.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbf7fe640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc015b230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c7f0 tx=0x7f1bb800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.222+0000 7f1bbcff9640 1 -- 172.21.15.133:0/1341379753 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8004230 con 0x7f1bc01598d0 2023-12-18T10:18:38.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bbcff9640 1 -- 172.21.15.133:0/1341379753 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80043b0 con 0x7f1bc01598d0 2023-12-18T10:18:38.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bbcff9640 1 -- 172.21.15.133:0/1341379753 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8003860 con 0x7f1bc01598d0 2023-12-18T10:18:38.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc00c5f30 con 0x7f1bc01598d0 2023-12-18T10:18:38.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc00afed0 con 0x7f1bc01598d0 2023-12-18T10:18:38.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc00c6120 con 0x7f1bc01598d0 2023-12-18T10:18:38.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bbcff9640 1 -- 172.21.15.133:0/1341379753 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1bb8003bd0 con 0x7f1bc01598d0 2023-12-18T10:18:38.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bbcff9640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ba0065a60 0x7f1ba0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bbcff9640 1 -- 172.21.15.133:0/1341379753 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1bb8083930 con 0x7f1bc01598d0 2023-12-18T10:18:38.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bbeffd640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ba0065a60 0x7f1ba0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.226+0000 7f1bbeffd640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ba0065a60 0x7f1ba0067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0007130 tx=0x7f1bb0007060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.230+0000 7f1bbcff9640 1 -- 172.21.15.133:0/1341379753 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1bb8050ff0 con 0x7f1bc01598d0 2023-12-18T10:18:38.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.378+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bc00c57d0 con 0x7f1bc01598d0 2023-12-18T10:18:38.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bbcff9640 1 -- 172.21.15.133:0/1341379753 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bc00c57d0 con 0x7f1bc01598d0 2023-12-18T10:18:38.383 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ba0065a60 msgr2=0x7f1ba0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ba0065a60 0x7f1ba0067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0007130 tx=0x7f1bb0007060 comp rx=0 tx=0).stop 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 msgr2=0x7f1bc015b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc015b230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c7f0 tx=0x7f1bb800ccb0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 shutdown_connections 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ba0065a60 0x7f1ba0067f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc01598d0 0x7f1bc015b230 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bc0153020 0x7f1bc015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 --2- 172.21.15.133:0/1341379753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bc00ce8d0 0x7f1bc0148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 >> 172.21.15.133:0/1341379753 conn(0x7f1bc006a2a0 msgr2=0x7f1bc01514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 shutdown_connections 2023-12-18T10:18:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.382+0000 7f1bc5a55640 1 -- 172.21.15.133:0/1341379753 wait complete. 2023-12-18T10:18:38.404 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f013e939640 1 Processor -- start 2023-12-18T10:18:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f013e939640 1 -- start start 2023-12-18T10:18:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f013e939640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0138070820 0x7f01380c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f013e939640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01380c9390 con 0x7f01380ce3b0 2023-12-18T10:18:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f013e939640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013815aee0 con 0x7f01381582d0 2023-12-18T10:18:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f013e939640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013815b1c0 con 0x7f0138070820 2023-12-18T10:18:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f01377fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0138070820 0x7f01380c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f013ced6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f01380ce3b0 0x7f01380cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48278/0 (socket says 172.21.15.133:48278) 2023-12-18T10:18:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f013ced6640 1 -- 172.21.15.133:0/3397076432 learned_addr learned my addr 172.21.15.133:0/3397076432 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f01377fe640 1 -- 172.21.15.133:0/3397076432 >> v1:172.21.15.142:6789/0 conn(0x7f01381582d0 legacy=0x7f01380ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f01377fe640 1 -- 172.21.15.133:0/3397076432 >> v1:172.21.15.133:6789/0 conn(0x7f01380ce3b0 legacy=0x7f01380cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f01377fe640 1 -- 172.21.15.133:0/3397076432 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013815b4a0 con 0x7f0138070820 2023-12-18T10:18:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.542+0000 7f0136ffd640 1 -- 172.21.15.133:0/3397076432 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268990398 0 0) 0x7f01380c9390 con 0x7f01380ce3b0 2023-12-18T10:18:38.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f01377fe640 1 --2- 172.21.15.133:0/3397076432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0138070820 0x7f01380c8e50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f012c0097c0 tx=0x7f012c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe50fbe2f48e130 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f0136ffd640 1 -- 172.21.15.133:0/3397076432 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c0ab670 con 0x7f0138070820 2023-12-18T10:18:38.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f0136ffd640 1 -- 172.21.15.133:0/3397076432 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c0ab7d0 con 0x7f0138070820 2023-12-18T10:18:38.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f0136ffd640 1 -- 172.21.15.133:0/3397076432 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c0abb60 con 0x7f0138070820 2023-12-18T10:18:38.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f013e939640 1 -- 172.21.15.133:0/3397076432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0138070820 msgr2=0x7f01380c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f013e939640 1 --2- 172.21.15.133:0/3397076432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0138070820 0x7f01380c8e50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f012c0097c0 tx=0x7f012c01c450 comp rx=0 tx=0).stop 2023-12-18T10:18:38.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f013e939640 1 -- 172.21.15.133:0/3397076432 shutdown_connections 2023-12-18T10:18:38.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f013e939640 1 --2- 172.21.15.133:0/3397076432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0138070820 0x7f01380c8e50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f013e939640 1 -- 172.21.15.133:0/3397076432 >> 172.21.15.133:0/3397076432 conn(0x7f013806a2a0 msgr2=0x7f01380aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:38.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f013e939640 1 -- 172.21.15.133:0/3397076432 shutdown_connections 2023-12-18T10:18:38.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.546+0000 7f013e939640 1 -- 172.21.15.133:0/3397076432 wait complete. 2023-12-18T10:18:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 Processor -- start 2023-12-18T10:18:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 -- start start 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138070820 0x7f01380af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01380ce3b0 0x7f0138153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01381582d0 0x7f013813fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013815e170 con 0x7f01381582d0 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013806c770 con 0x7f01380ce3b0 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013806c4d0 con 0x7f0138070820 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01381582d0 0x7f013813fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01381582d0 0x7f013813fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48952/0 (socket says 172.21.15.133:48952) 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f0137fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138070820 0x7f01380af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 -- 172.21.15.133:0/1359951212 learned_addr learned my addr 172.21.15.133:0/1359951212 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f01377fe640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01380ce3b0 0x7f0138153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 -- 172.21.15.133:0/1359951212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138070820 msgr2=0x7f01380af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138070820 0x7f01380af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 -- 172.21.15.133:0/1359951212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01380ce3b0 msgr2=0x7f0138153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01380ce3b0 0x7f0138153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 -- 172.21.15.133:0/1359951212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c009420 con 0x7f01381582d0 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013ced6640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01381582d0 0x7f013813fcd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f013000c7a0 tx=0x7f013000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f0134ff9640 1 -- 172.21.15.133:0/1359951212 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013000a640 con 0x7f01381582d0 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f0134ff9640 1 -- 172.21.15.133:0/1359951212 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013000a7a0 con 0x7f01381582d0 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013815e3a0 con 0x7f01381582d0 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f0134ff9640 1 -- 172.21.15.133:0/1359951212 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013000ab90 con 0x7f01381582d0 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.550+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013815e960 con 0x7f01381582d0 2023-12-18T10:18:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.554+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013815eb80 con 0x7f01381582d0 2023-12-18T10:18:38.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.554+0000 7f0134ff9640 1 -- 172.21.15.133:0/1359951212 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f013000acf0 con 0x7f01381582d0 2023-12-18T10:18:38.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.554+0000 7f0134ff9640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0124065a60 0x7f0124067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.554+0000 7f0134ff9640 1 -- 172.21.15.133:0/1359951212 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0130082be0 con 0x7f01381582d0 2023-12-18T10:18:38.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.554+0000 7f0137fff640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0124065a60 0x7f0124067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.554+0000 7f0137fff640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0124065a60 0x7f0124067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.558+0000 7f0134ff9640 1 -- 172.21.15.133:0/1359951212 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0130050350 con 0x7f01381582d0 2023-12-18T10:18:38.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f013815ab10 con 0x7f01381582d0 2023-12-18T10:18:38.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f0134ff9640 1 -- 172.21.15.133:0/1359951212 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0130053970 con 0x7f01381582d0 2023-12-18T10:18:38.712 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0124065a60 msgr2=0x7f0124067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0124065a60 0x7f0124067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128009040 comp rx=0 tx=0).stop 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01381582d0 msgr2=0x7f013813fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01381582d0 0x7f013813fcd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f013000c7a0 tx=0x7f013000cc60 comp rx=0 tx=0).stop 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 shutdown_connections 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0124065a60 0x7f0124067f20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01381582d0 0x7f013813fcd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01380ce3b0 0x7f0138153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 --2- 172.21.15.133:0/1359951212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0138070820 0x7f01380af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 >> 172.21.15.133:0/1359951212 conn(0x7f013806a2a0 msgr2=0x7f01380ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:38.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 shutdown_connections 2023-12-18T10:18:38.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.710+0000 7f013e939640 1 -- 172.21.15.133:0/1359951212 wait complete. 2023-12-18T10:18:38.733 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:38.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.870+0000 7fbdbd666640 1 Processor -- start 2023-12-18T10:18:38.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.870+0000 7fbdbd666640 1 -- start start 2023-12-18T10:18:38.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdbd666640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb80cb790 0x7fbdb8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdbd666640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb80cdf40 con 0x7fbdb806d3b0 2023-12-18T10:18:38.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdbd666640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb8071dc0 con 0x7fbdb815a380 2023-12-18T10:18:38.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdbd666640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb80b13e0 con 0x7fbdb80cb790 2023-12-18T10:18:38.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdb77fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbdb806d3b0 0x7fbdb815ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48286/0 (socket says 172.21.15.133:48286) 2023-12-18T10:18:38.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdb77fe640 1 -- 172.21.15.133:0/2969137843 learned_addr learned my addr 172.21.15.133:0/2969137843 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:38.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdae7fc640 1 --2- 172.21.15.133:0/2969137843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb80cb790 0x7fbdb8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdb67fc640 1 -- 172.21.15.133:0/2969137843 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028663093 0 0) 0x7fbdb80cdf40 con 0x7fbdb806d3b0 2023-12-18T10:18:38.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdb67fc640 1 -- 172.21.15.133:0/2969137843 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda4003530 con 0x7fbdb806d3b0 2023-12-18T10:18:38.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdb67fc640 1 -- 172.21.15.133:0/2969137843 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396132455 0 0) 0x7fbdb8071dc0 con 0x7fbdb815a380 2023-12-18T10:18:38.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdb67fc640 1 -- 172.21.15.133:0/2969137843 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdb80cdf40 con 0x7fbdb815a380 2023-12-18T10:18:38.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdae7fc640 1 -- 172.21.15.133:0/2969137843 >> v1:172.21.15.142:6789/0 conn(0x7fbdb815a380 legacy=0x7fbdb80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdae7fc640 1 -- 172.21.15.133:0/2969137843 >> v1:172.21.15.133:6789/0 conn(0x7fbdb806d3b0 legacy=0x7fbdb815ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdae7fc640 1 -- 172.21.15.133:0/2969137843 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb8071800 con 0x7fbdb80cb790 2023-12-18T10:18:38.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.874+0000 7fbdae7fc640 1 --2- 172.21.15.133:0/2969137843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb80cb790 0x7fbdb8070f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbda00097f0 tx=0x7fbda001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da214da81873d4d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdb67fc640 1 -- 172.21.15.133:0/2969137843 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda00ab600 con 0x7fbdb80cb790 2023-12-18T10:18:38.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdb67fc640 1 -- 172.21.15.133:0/2969137843 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda00ab760 con 0x7fbdb80cb790 2023-12-18T10:18:38.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdb67fc640 1 -- 172.21.15.133:0/2969137843 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda00abad0 con 0x7fbdb80cb790 2023-12-18T10:18:38.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- 172.21.15.133:0/2969137843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb80cb790 msgr2=0x7fbdb8070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 --2- 172.21.15.133:0/2969137843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb80cb790 0x7fbdb8070f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbda00097f0 tx=0x7fbda001c400 comp rx=0 tx=0).stop 2023-12-18T10:18:38.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- 172.21.15.133:0/2969137843 shutdown_connections 2023-12-18T10:18:38.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 --2- 172.21.15.133:0/2969137843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb80cb790 0x7fbdb8070f00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- 172.21.15.133:0/2969137843 >> 172.21.15.133:0/2969137843 conn(0x7fbdb806b1b0 msgr2=0x7fbdb806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:38.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- 172.21.15.133:0/2969137843 shutdown_connections 2023-12-18T10:18:38.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- 172.21.15.133:0/2969137843 wait complete. 2023-12-18T10:18:38.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 Processor -- start 2023-12-18T10:18:38.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- start start 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdb806d3b0 0x7fbdb814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb80cb790 0x7fbdb81549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb815a380 0x7fbdb814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb814f760 con 0x7fbdb806d3b0 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb8152840 con 0x7fbdb80cb790 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.878+0000 7fbdbd666640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb814b2d0 con 0x7fbdb815a380 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdb806d3b0 0x7fbdb814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdb806d3b0 0x7fbdb814cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48962/0 (socket says 172.21.15.133:48962) 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 -- 172.21.15.133:0/503939288 learned_addr learned my addr 172.21.15.133:0/503939288 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdae7fc640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb80cb790 0x7fbdb81549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb77fe640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb815a380 0x7fbdb814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 -- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb815a380 msgr2=0x7fbdb814d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb815a380 0x7fbdb814d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 -- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb80cb790 msgr2=0x7fbdb81549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb80cb790 0x7fbdb81549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 -- 172.21.15.133:0/503939288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0009420 con 0x7fbdb806d3b0 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb77fe640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb815a380 0x7fbdb814d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdb6ffd640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdb806d3b0 0x7fbdb814cb50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c7a0 tx=0x7fbda800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdaffff640 1 -- 172.21.15.133:0/503939288 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8003b80 con 0x7fbdb806d3b0 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdaffff640 1 -- 172.21.15.133:0/503939288 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8003d00 con 0x7fbdb806d3b0 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb814b5b0 con 0x7fbdb806d3b0 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdaffff640 1 -- 172.21.15.133:0/503939288 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda800aa90 con 0x7fbdb806d3b0 2023-12-18T10:18:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb814b890 con 0x7fbdb806d3b0 2023-12-18T10:18:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb814f8d0 con 0x7fbdb806d3b0 2023-12-18T10:18:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdaffff640 1 -- 172.21.15.133:0/503939288 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbda800abf0 con 0x7fbdb806d3b0 2023-12-18T10:18:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdaffff640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98065a60 0x7fbd98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.882+0000 7fbdaffff640 1 -- 172.21.15.133:0/503939288 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbda80833d0 con 0x7fbdb806d3b0 2023-12-18T10:18:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.886+0000 7fbdae7fc640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98065a60 0x7fbd98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.886+0000 7fbdae7fc640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98065a60 0x7fbd98067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbda00af000 tx=0x7fbda00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:38.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:38.886+0000 7fbdaffff640 1 -- 172.21.15.133:0/503939288 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbda8050a10 con 0x7fbdb806d3b0 2023-12-18T10:18:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.038+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbdb804e000 con 0x7fbdb806d3b0 2023-12-18T10:18:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.038+0000 7fbdaffff640 1 -- 172.21.15.133:0/503939288 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbda8054030 con 0x7fbdb806d3b0 2023-12-18T10:18:39.042 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98065a60 msgr2=0x7fbd98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98065a60 0x7fbd98067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbda00af000 tx=0x7fbda00a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdb806d3b0 msgr2=0x7fbdb814cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdb806d3b0 0x7fbdb814cb50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c7a0 tx=0x7fbda800cc60 comp rx=0 tx=0).stop 2023-12-18T10:18:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 shutdown_connections 2023-12-18T10:18:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98065a60 0x7fbd98067f20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdb815a380 0x7fbdb814d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdb80cb790 0x7fbdb81549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 --2- 172.21.15.133:0/503939288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdb806d3b0 0x7fbdb814cb50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 >> 172.21.15.133:0/503939288 conn(0x7fbdb806b1b0 msgr2=0x7fbdb80c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 shutdown_connections 2023-12-18T10:18:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.042+0000 7fbdbd666640 1 -- 172.21.15.133:0/503939288 wait complete. 2023-12-18T10:18:39.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:18:39.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.198+0000 7f5c437f0640 1 Processor -- start 2023-12-18T10:18:39.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.198+0000 7f5c437f0640 1 -- start start 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c437f0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5c3c160cc0 0x7f5c3c0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c437f0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c06fdb0 con 0x7f5c3c0c1280 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c437f0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c06cc00 con 0x7f5c3c0c17d0 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c437f0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c1654a0 con 0x7f5c3c160cc0 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c40d8b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5c3c0c1280 0x7f5c3c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48296/0 (socket says 172.21.15.133:48296) 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c40d8b640 1 -- 172.21.15.133:0/2925192912 learned_addr learned my addr 172.21.15.133:0/2925192912 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c4158c640 1 --2- 172.21.15.133:0/2925192912 >> v2:172.21.15.142:3300/0 conn(0x7f5c3c160cc0 0x7f5c3c0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442166500 0 0) 0x7f5c3c06fdb0 con 0x7f5c3c0c1280 2023-12-18T10:18:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c28003530 con 0x7f5c3c0c1280 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2711580663 0 0) 0x7f5c28003530 con 0x7f5c3c0c1280 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 >> v2:172.21.15.142:3300/0 conn(0x7f5c3c160cc0 msgr2=0x7f5c3c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 --2- 172.21.15.133:0/2925192912 >> v2:172.21.15.142:3300/0 conn(0x7f5c3c160cc0 0x7f5c3c0cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 >> v1:172.21.15.142:6789/0 conn(0x7f5c3c0c17d0 legacy=0x7f5c3c06c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c164820 con 0x7f5c3c0c1280 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f5c2c001680 con 0x7f5c3c0c1280 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 >> v1:172.21.15.133:6789/0 conn(0x7f5c3c0c1280 legacy=0x7f5c3c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c28003980 0x7f5c28003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c28004380 0x7f5c28004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c280050f0 0x7f5c2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c1654a0 con 0x7f5c280050f0 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2800c030 con 0x7f5c28003980 2023-12-18T10:18:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2800c1f0 con 0x7f5c28004380 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c41d8d640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c280050f0 0x7f5c2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c4158c640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c28003980 0x7f5c28003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c40d8b640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c28004380 0x7f5c28004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c41d8d640 1 -- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c28004380 msgr2=0x7f5c28004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c41d8d640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c28004380 0x7f5c28004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c41d8d640 1 -- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c28003980 msgr2=0x7f5c28003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c41d8d640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c28003980 0x7f5c28003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c41d8d640 1 -- 172.21.15.133:0/2925192912 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c28003530 con 0x7f5c280050f0 2023-12-18T10:18:39.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.202+0000 7f5c40d8b640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c28004380 0x7f5c28004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:39.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c41d8d640 1 -- 172.21.15.133:0/2925192912 reap_dead start 2023-12-18T10:18:39.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c41d8d640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c280050f0 0x7f5c2800b990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c34001f60 tx=0x7f5c3401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61da875b1ca90a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34003b80 con 0x7f5c280050f0 2023-12-18T10:18:39.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34003ce0 con 0x7f5c280050f0 2023-12-18T10:18:39.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c33fff640 1 -- 172.21.15.133:0/2925192912 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340052f0 con 0x7f5c280050f0 2023-12-18T10:18:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c437f0640 1 -- 172.21.15.133:0/2925192912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c280050f0 msgr2=0x7f5c2800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c437f0640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c280050f0 0x7f5c2800b990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c34001f60 tx=0x7f5c3401c860 comp rx=0 tx=0).stop 2023-12-18T10:18:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c437f0640 1 -- 172.21.15.133:0/2925192912 shutdown_connections 2023-12-18T10:18:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c437f0640 1 --2- 172.21.15.133:0/2925192912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c280050f0 0x7f5c2800b990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c437f0640 1 -- 172.21.15.133:0/2925192912 >> 172.21.15.133:0/2925192912 conn(0x7f5c3c06a3e0 msgr2=0x7f5c3c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c437f0640 1 -- 172.21.15.133:0/2925192912 shutdown_connections 2023-12-18T10:18:39.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c437f0640 1 -- 172.21.15.133:0/2925192912 wait complete. 2023-12-18T10:18:39.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.206+0000 7f5c437f0640 1 Processor -- start 2023-12-18T10:18:39.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 -- start start 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c280050f0 0x7f5c3c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c3c150e60 0x7f5c3c0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c1512e0 0x7f5c3c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0c7710 con 0x7f5c3c150e60 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0c79f0 con 0x7f5c280050f0 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c1518c0 con 0x7f5c3c1512e0 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c3c150e60 0x7f5c3c0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c3c150e60 0x7f5c3c0b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48974/0 (socket says 172.21.15.133:48974) 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 -- 172.21.15.133:0/522218287 learned_addr learned my addr 172.21.15.133:0/522218287 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c4158c640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c280050f0 0x7f5c3c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c41d8d640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c1512e0 0x7f5c3c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 -- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c1512e0 msgr2=0x7f5c3c0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c1512e0 0x7f5c3c0b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 -- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c280050f0 msgr2=0x7f5c3c153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c280050f0 0x7f5c3c153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 -- 172.21.15.133:0/522218287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c151ba0 con 0x7f5c3c150e60 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c41d8d640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c1512e0 0x7f5c3c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c40d8b640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c3c150e60 0x7f5c3c0b0df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e700 tx=0x7f5c2c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c31ffb640 1 -- 172.21.15.133:0/522218287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00c6c0 con 0x7f5c3c150e60 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c31ffb640 1 -- 172.21.15.133:0/522218287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c00c820 con 0x7f5c3c150e60 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c1543f0 con 0x7f5c3c150e60 2023-12-18T10:18:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c31ffb640 1 -- 172.21.15.133:0/522218287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00cb90 con 0x7f5c3c150e60 2023-12-18T10:18:39.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c0b1a40 con 0x7f5c3c150e60 2023-12-18T10:18:39.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.210+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c0735b0 con 0x7f5c3c150e60 2023-12-18T10:18:39.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.214+0000 7f5c31ffb640 1 -- 172.21.15.133:0/522218287 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5c2c00ccf0 con 0x7f5c3c150e60 2023-12-18T10:18:39.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.214+0000 7f5c31ffb640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5c20065a60 0x7f5c20067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.214+0000 7f5c31ffb640 1 -- 172.21.15.133:0/522218287 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c2c083340 con 0x7f5c3c150e60 2023-12-18T10:18:39.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.214+0000 7f5c4158c640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5c20065a60 0x7f5c20067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.214+0000 7f5c4158c640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5c20065a60 0x7f5c20067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009aa0 tx=0x7f5c38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.218+0000 7f5c31ffb640 1 -- 172.21.15.133:0/522218287 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5c2c0544a0 con 0x7f5c3c150e60 2023-12-18T10:18:39.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c3c0b1c60 con 0x7f5c3c150e60 2023-12-18T10:18:39.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c31ffb640 1 -- 172.21.15.133:0/522218287 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f5c3c0b1c60 con 0x7f5c3c150e60 2023-12-18T10:18:39.405 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:39.405 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:28.930501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-18T10:18:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 9 2023-12-18T10:18:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5c20065a60 msgr2=0x7f5c20067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5c20065a60 0x7f5c20067f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009aa0 tx=0x7f5c38008040 comp rx=0 tx=0).stop 2023-12-18T10:18:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c3c150e60 msgr2=0x7f5c3c0b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c3c150e60 0x7f5c3c0b0df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e700 tx=0x7f5c2c00ebc0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 shutdown_connections 2023-12-18T10:18:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5c20065a60 0x7f5c20067f20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c3c1512e0 0x7f5c3c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c3c150e60 0x7f5c3c0b0df0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 --2- 172.21.15.133:0/522218287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c280050f0 0x7f5c3c153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 >> 172.21.15.133:0/522218287 conn(0x7f5c3c06a3e0 msgr2=0x7f5c3c06fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 shutdown_connections 2023-12-18T10:18:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.402+0000 7f5c437f0640 1 -- 172.21.15.133:0/522218287 wait complete. 2023-12-18T10:18:39.424 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:39.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.558+0000 7f32269a6640 1 Processor -- start 2023-12-18T10:18:39.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.558+0000 7f32269a6640 1 -- start start 2023-12-18T10:18:39.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f32269a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32201570c0 0x7f322006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f32269a6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32200ca000 0x7f3220070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f32269a6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32200c9460 con 0x7f322006c320 2023-12-18T10:18:39.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f32269a6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322006c7a0 con 0x7f32201570c0 2023-12-18T10:18:39.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f32269a6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32201574a0 con 0x7f32200ca000 2023-12-18T10:18:39.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f321ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32201570c0 0x7f322006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f321ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32201570c0 0x7f322006bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48980/0 (socket says 172.21.15.133:48980) 2023-12-18T10:18:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f321ffff640 1 -- 172.21.15.133:0/434042592 learned_addr learned my addr 172.21.15.133:0/434042592 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f3224f43640 1 --2- 172.21.15.133:0/434042592 >> v2:172.21.15.142:3300/0 conn(0x7f32200ca000 0x7f3220070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f321ffff640 1 -- 172.21.15.133:0/434042592 >> v2:172.21.15.142:3300/0 conn(0x7f32200ca000 msgr2=0x7f3220070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f321ffff640 1 --2- 172.21.15.133:0/434042592 >> v2:172.21.15.142:3300/0 conn(0x7f32200ca000 0x7f3220070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f321ffff640 1 -- 172.21.15.133:0/434042592 >> v1:172.21.15.142:6789/0 conn(0x7f322006c320 legacy=0x7f32200c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.562+0000 7f321ffff640 1 -- 172.21.15.133:0/434042592 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200c8b30 con 0x7f32201570c0 2023-12-18T10:18:39.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f321ffff640 1 --2- 172.21.15.133:0/434042592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32201570c0 0x7f322006bde0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f322006cf60 tx=0x7f321001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9a08e9e317a4c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f321effd640 1 -- 172.21.15.133:0/434042592 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100ab640 con 0x7f32201570c0 2023-12-18T10:18:39.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f321effd640 1 -- 172.21.15.133:0/434042592 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32100a7070 con 0x7f32201570c0 2023-12-18T10:18:39.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f321effd640 1 -- 172.21.15.133:0/434042592 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100ab9c0 con 0x7f32201570c0 2023-12-18T10:18:39.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 -- 172.21.15.133:0/434042592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32201570c0 msgr2=0x7f322006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 --2- 172.21.15.133:0/434042592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32201570c0 0x7f322006bde0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f322006cf60 tx=0x7f321001c440 comp rx=0 tx=0).stop 2023-12-18T10:18:39.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 -- 172.21.15.133:0/434042592 shutdown_connections 2023-12-18T10:18:39.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 --2- 172.21.15.133:0/434042592 >> v2:172.21.15.142:3300/0 conn(0x7f32200ca000 0x7f3220070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 --2- 172.21.15.133:0/434042592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32201570c0 0x7f322006bde0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 -- 172.21.15.133:0/434042592 >> 172.21.15.133:0/434042592 conn(0x7f322006a3e0 msgr2=0x7f32200afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 -- 172.21.15.133:0/434042592 shutdown_connections 2023-12-18T10:18:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 -- 172.21.15.133:0/434042592 wait complete. 2023-12-18T10:18:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 Processor -- start 2023-12-18T10:18:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.566+0000 7f32269a6640 1 -- start start 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f322006c320 0x7f32200caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200ca000 0x7f32200af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32201570c0 0x7f32201597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3220157a70 con 0x7f32200ca000 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32200cd670 con 0x7f32201570c0 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3220159330 con 0x7f322006c320 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200ca000 0x7f32200af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200ca000 0x7f32200af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48982/0 (socket says 172.21.15.133:48982) 2023-12-18T10:18:39.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 -- 172.21.15.133:0/2187156541 learned_addr learned my addr 172.21.15.133:0/2187156541 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321ffff640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f322006c320 0x7f32200caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f3224f43640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32201570c0 0x7f32201597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 -- 172.21.15.133:0/2187156541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f322006c320 msgr2=0x7f32200caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f322006c320 0x7f32200caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 -- 172.21.15.133:0/2187156541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32201570c0 msgr2=0x7f32201597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32201570c0 0x7f32201597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 -- 172.21.15.133:0/2187156541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100094d0 con 0x7f32200ca000 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321f7fe640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200ca000 0x7f32200af1e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f321400c3c0 tx=0x7f321400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321cff9640 1 -- 172.21.15.133:0/2187156541 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140052d0 con 0x7f32200ca000 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321cff9640 1 -- 172.21.15.133:0/2187156541 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3214005430 con 0x7f32200ca000 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321cff9640 1 -- 172.21.15.133:0/2187156541 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214003840 con 0x7f32200ca000 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3220159000 con 0x7f32200ca000 2023-12-18T10:18:39.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32200cdb90 con 0x7f32200ca000 2023-12-18T10:18:39.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32200735b0 con 0x7f32200ca000 2023-12-18T10:18:39.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.570+0000 7f321cff9640 1 -- 172.21.15.133:0/2187156541 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f32140039a0 con 0x7f32200ca000 2023-12-18T10:18:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.574+0000 7f321cff9640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f320c065a60 0x7f320c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.574+0000 7f321cff9640 1 -- 172.21.15.133:0/2187156541 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32140829b0 con 0x7f32200ca000 2023-12-18T10:18:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.574+0000 7f321ffff640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f320c065a60 0x7f320c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.574+0000 7f321ffff640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f320c065a60 0x7f320c067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f32100af000 tx=0x7f32100b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.578+0000 7f321cff9640 1 -- 172.21.15.133:0/2187156541 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3214050090 con 0x7f32200ca000 2023-12-18T10:18:39.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3220158e60 con 0x7f32200ca000 2023-12-18T10:18:39.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f321cff9640 1 -- 172.21.15.133:0/2187156541 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f3220158e60 con 0x7f32200ca000 2023-12-18T10:18:39.732 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:39.732 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:10.028319+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f320c065a60 msgr2=0x7f320c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f320c065a60 0x7f320c067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f32100af000 tx=0x7f32100b6040 comp rx=0 tx=0).stop 2023-12-18T10:18:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200ca000 msgr2=0x7f32200af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200ca000 0x7f32200af1e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f321400c3c0 tx=0x7f321400c880 comp rx=0 tx=0).stop 2023-12-18T10:18:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 shutdown_connections 2023-12-18T10:18:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f320c065a60 0x7f320c067f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32201570c0 0x7f32201597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32200ca000 0x7f32200af1e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 --2- 172.21.15.133:0/2187156541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f322006c320 0x7f32200caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 >> 172.21.15.133:0/2187156541 conn(0x7f322006a3e0 msgr2=0x7f32200c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 shutdown_connections 2023-12-18T10:18:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.730+0000 7f32269a6640 1 -- 172.21.15.133:0/2187156541 wait complete. 2023-12-18T10:18:39.754 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:18:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7759e640 1 Processor -- start 2023-12-18T10:18:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7759e640 1 -- start start 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7759e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba780b0420 0x7fba780c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba7806bea0 0x7fba7806c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7759e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba780c36c0 con 0x7fba78143f50 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7759e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780c39a0 con 0x7fba780b0420 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba780c3c80 con 0x7fba7806bea0 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7659c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fba78143f50 0x7fba780afd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45378/0 (socket says 172.21.15.133:45378) 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba7659c640 1 -- 172.21.15.133:0/2797272304 learned_addr learned my addr 172.21.15.133:0/2797272304 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba6dd9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba780b0420 0x7fba780c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba76d9d640 1 --2- 172.21.15.133:0/2797272304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba7806bea0 0x7fba7806c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba6dd9b640 1 -- 172.21.15.133:0/2797272304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba7806bea0 msgr2=0x7fba7806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba6dd9b640 1 --2- 172.21.15.133:0/2797272304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba7806bea0 0x7fba7806c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba6dd9b640 1 -- 172.21.15.133:0/2797272304 >> v1:172.21.15.133:6789/0 conn(0x7fba78143f50 legacy=0x7fba780afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba6dd9b640 1 -- 172.21.15.133:0/2797272304 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780c3f60 con 0x7fba780b0420 2023-12-18T10:18:39.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.890+0000 7fba75d9b640 1 -- 172.21.15.133:0/2797272304 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510375464 0 0) 0x7fba780c36c0 con 0x7fba78143f50 2023-12-18T10:18:39.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba6dd9b640 1 --2- 172.21.15.133:0/2797272304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba780b0420 0x7fba780c4480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba600097c0 tx=0x7fba6001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1203956e8a811192 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba75d9b640 1 -- 172.21.15.133:0/2797272304 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600a6040 con 0x7fba780b0420 2023-12-18T10:18:39.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba75d9b640 1 -- 172.21.15.133:0/2797272304 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba600aa600 con 0x7fba780b0420 2023-12-18T10:18:39.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba75d9b640 1 -- 172.21.15.133:0/2797272304 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600aa990 con 0x7fba780b0420 2023-12-18T10:18:39.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba7759e640 1 -- 172.21.15.133:0/2797272304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba780b0420 msgr2=0x7fba780c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba7759e640 1 --2- 172.21.15.133:0/2797272304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba780b0420 0x7fba780c4480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba600097c0 tx=0x7fba6001c480 comp rx=0 tx=0).stop 2023-12-18T10:18:39.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba7759e640 1 -- 172.21.15.133:0/2797272304 shutdown_connections 2023-12-18T10:18:39.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba7759e640 1 --2- 172.21.15.133:0/2797272304 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba7806bea0 0x7fba7806c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba7759e640 1 --2- 172.21.15.133:0/2797272304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba780b0420 0x7fba780c4480 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba7759e640 1 -- 172.21.15.133:0/2797272304 >> 172.21.15.133:0/2797272304 conn(0x7fba780ce130 msgr2=0x7fba780ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:39.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba7759e640 1 -- 172.21.15.133:0/2797272304 shutdown_connections 2023-12-18T10:18:39.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.894+0000 7fba7759e640 1 -- 172.21.15.133:0/2797272304 wait complete. 2023-12-18T10:18:39.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 Processor -- start 2023-12-18T10:18:39.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 -- start start 2023-12-18T10:18:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7806bea0 0x7fba7813bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba780b0420 0x7fba78140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba78143f50 0x7fba78140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7813c310 con 0x7fba7806bea0 2023-12-18T10:18:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780c7fa0 con 0x7fba780b0420 2023-12-18T10:18:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba78143230 con 0x7fba78143f50 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7806bea0 0x7fba7813bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7806bea0 0x7fba7813bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56088/0 (socket says 172.21.15.133:56088) 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 -- 172.21.15.133:0/4289665163 learned_addr learned my addr 172.21.15.133:0/4289665163 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba76d9d640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba78143f50 0x7fba78140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba6dd9b640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba780b0420 0x7fba78140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 -- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba78143f50 msgr2=0x7fba78140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba78143f50 0x7fba78140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 -- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba780b0420 msgr2=0x7fba78140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba780b0420 0x7fba78140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 -- 172.21.15.133:0/4289665163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60009420 con 0x7fba7806bea0 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba76d9d640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba78143f50 0x7fba78140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba6dd9b640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba780b0420 0x7fba78140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7659c640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7806bea0 0x7fba7813bdd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fba6800c520 tx=0x7fba6800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba6f7fe640 1 -- 172.21.15.133:0/4289665163 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680074e0 con 0x7fba7806bea0 2023-12-18T10:18:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba6f7fe640 1 -- 172.21.15.133:0/4289665163 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68007640 con 0x7fba7806bea0 2023-12-18T10:18:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba6f7fe640 1 -- 172.21.15.133:0/4289665163 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680049f0 con 0x7fba7806bea0 2023-12-18T10:18:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba78142620 con 0x7fba7806bea0 2023-12-18T10:18:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.898+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba78142be0 con 0x7fba7806bea0 2023-12-18T10:18:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.902+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7804e850 con 0x7fba7806bea0 2023-12-18T10:18:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.902+0000 7fba6f7fe640 1 -- 172.21.15.133:0/4289665163 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba68004b50 con 0x7fba7806bea0 2023-12-18T10:18:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.902+0000 7fba6f7fe640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba58065a60 0x7fba58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.902+0000 7fba6f7fe640 1 -- 172.21.15.133:0/4289665163 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba680827e0 con 0x7fba7806bea0 2023-12-18T10:18:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.902+0000 7fba6dd9b640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba58065a60 0x7fba58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.902+0000 7fba6dd9b640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba58065a60 0x7fba58067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba600ae000 tx=0x7fba600a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:39.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:39.906+0000 7fba6f7fe640 1 -- 172.21.15.133:0/4289665163 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fba6804feb0 con 0x7fba7806bea0 2023-12-18T10:18:40.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.090+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba780b0940 con 0x7fba7806bea0 2023-12-18T10:18:40.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.090+0000 7fba6f7fe640 1 -- 172.21.15.133:0/4289665163 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7fba68018020 con 0x7fba7806bea0 2023-12-18T10:18:40.094 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:40.094 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:28.930501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-18T10:18:40.094 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 9 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba58065a60 msgr2=0x7fba58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba58065a60 0x7fba58067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba600ae000 tx=0x7fba600a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7806bea0 msgr2=0x7fba7813bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7806bea0 0x7fba7813bdd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fba6800c520 tx=0x7fba6800c9e0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 shutdown_connections 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fba58065a60 0x7fba58067f20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fba78143f50 0x7fba78140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba780b0420 0x7fba78140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 --2- 172.21.15.133:0/4289665163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7806bea0 0x7fba7813bdd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 >> 172.21.15.133:0/4289665163 conn(0x7fba780ce130 msgr2=0x7fba7813faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:40.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 shutdown_connections 2023-12-18T10:18:40.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.094+0000 7fba7759e640 1 -- 172.21.15.133:0/4289665163 wait complete. 2023-12-18T10:18:40.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:18:05.604323+0000', 'modified': '2023-12-18T10:18:28.930501+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/229940980', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 229940980}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 229940980}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:18:40.518 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-18T10:18:40.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-18T10:18:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d6a5b3640 1 Processor -- start 2023-12-18T10:18:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d6a5b3640 1 -- start start 2023-12-18T10:18:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d6a5b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d641570c0 0x7f5d6406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d6a5b3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d640ca000 0x7f5d64070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d6a5b3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d640c9460 con 0x7f5d6406c320 2023-12-18T10:18:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d6a5b3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6406c7a0 con 0x7f5d640ca000 2023-12-18T10:18:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d6a5b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d641574a0 con 0x7f5d641570c0 2023-12-18T10:18:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d637fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5d6406c320 0x7f5d640c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45384/0 (socket says 172.21.15.133:45384) 2023-12-18T10:18:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d637fe640 1 -- 172.21.15.133:0/359824611 learned_addr learned my addr 172.21.15.133:0/359824611 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557832257 0 0) 0x7f5d640c9460 con 0x7f5d6406c320 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d68b50640 1 --2- 172.21.15.133:0/359824611 >> v2:172.21.15.142:3300/0 conn(0x7f5d640ca000 0x7f5d64070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d63fff640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d641570c0 0x7f5d6406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d4c005740 con 0x7f5d6406c320 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3885911446 0 0) 0x7f5d4c005740 con 0x7f5d6406c320 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d641570c0 msgr2=0x7f5d6406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d641570c0 0x7f5d6406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 >> v2:172.21.15.142:3300/0 conn(0x7f5d640ca000 msgr2=0x7f5d64070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 --2- 172.21.15.133:0/359824611 >> v2:172.21.15.142:3300/0 conn(0x7f5d640ca000 0x7f5d64070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d640c8b30 con 0x7f5d6406c320 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f5d58001680 con 0x7f5d6406c320 2023-12-18T10:18:40.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 >> v1:172.21.15.133:6789/0 conn(0x7f5d6406c320 legacy=0x7f5d640c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c005b90 0x7f5d4c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d641570c0 0x7f5d4c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c006f20 0x7f5d4c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6406c7a0 con 0x7f5d4c006f20 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d641574a0 con 0x7f5d4c005b90 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c00dba0 con 0x7f5d641570c0 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d68b50640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c006f20 0x7f5d4c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d63fff640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c005b90 0x7f5d4c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d637fe640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d641570c0 0x7f5d4c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d68b50640 1 -- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d641570c0 msgr2=0x7f5d4c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d68b50640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d641570c0 0x7f5d4c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d68b50640 1 -- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c005b90 msgr2=0x7f5d4c005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d68b50640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c005b90 0x7f5d4c005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.658+0000 7f5d68b50640 1 -- 172.21.15.133:0/359824611 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c005740 con 0x7f5d4c006f20 2023-12-18T10:18:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d68b50640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c006f20 0x7f5d4c0073a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009fc0 tx=0x7f5d5c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e82e4bfcd0a72d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0a5cb0 con 0x7f5d4c006f20 2023-12-18T10:18:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c00f040 con 0x7f5d4c006f20 2023-12-18T10:18:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d62ffd640 1 -- 172.21.15.133:0/359824611 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0ad680 con 0x7f5d4c006f20 2023-12-18T10:18:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/359824611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c006f20 msgr2=0x7f5d4c0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d6a5b3640 1 --2- 172.21.15.133:0/359824611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c006f20 0x7f5d4c0073a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009fc0 tx=0x7f5d5c01cca0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d68b50640 1 -- 172.21.15.133:0/359824611 reap_dead start 2023-12-18T10:18:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/359824611 shutdown_connections 2023-12-18T10:18:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/359824611 >> 172.21.15.133:0/359824611 conn(0x7f5d6406a3e0 msgr2=0x7f5d640afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/359824611 shutdown_connections 2023-12-18T10:18:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.662+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/359824611 wait complete. 2023-12-18T10:18:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 Processor -- start 2023-12-18T10:18:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 -- start start 2023-12-18T10:18:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c006f20 0x7f5d6414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d64159630 0x7f5d64159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640cc1d0 0x7f5d640cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d64159ff0 con 0x7f5d64159630 2023-12-18T10:18:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d64158360 con 0x7f5d4c006f20 2023-12-18T10:18:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d64158640 con 0x7f5d640cc1d0 2023-12-18T10:18:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d64159630 0x7f5d64159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d64159630 0x7f5d64159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56096/0 (socket says 172.21.15.133:56096) 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 -- 172.21.15.133:0/1180864736 learned_addr learned my addr 172.21.15.133:0/1180864736 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d68b50640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640cc1d0 0x7f5d640cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d63fff640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c006f20 0x7f5d6414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 -- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640cc1d0 msgr2=0x7f5d640cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640cc1d0 0x7f5d640cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 -- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c006f20 msgr2=0x7f5d6414f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c006f20 0x7f5d6414f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 -- 172.21.15.133:0/1180864736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64158920 con 0x7f5d64159630 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d68b50640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640cc1d0 0x7f5d640cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d637fe640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d64159630 0x7f5d64159ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5d58012510 tx=0x7f5d580129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d60ff9640 1 -- 172.21.15.133:0/1180864736 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58014810 con 0x7f5d64159630 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d60ff9640 1 -- 172.21.15.133:0/1180864736 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d58014970 con 0x7f5d64159630 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d60ff9640 1 -- 172.21.15.133:0/1180864736 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58014d20 con 0x7f5d64159630 2023-12-18T10:18:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/1180864736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d64158c00 con 0x7f5d64159630 2023-12-18T10:18:40.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.666+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/1180864736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6414fdd0 con 0x7f5d64159630 2023-12-18T10:18:40.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d60ff9640 1 -- 172.21.15.133:0/1180864736 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5d580153e0 con 0x7f5d64159630 2023-12-18T10:18:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d60ff9640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5d50065a90 0x7f5d50067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d60ff9640 1 -- 172.21.15.133:0/1180864736 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d58085df0 con 0x7f5d64159630 2023-12-18T10:18:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d63fff640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5d50065a90 0x7f5d50067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d6d929000 1 Processor -- start 2023-12-18T10:18:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d6d929000 1 -- start start 2023-12-18T10:18:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d63fff640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5d50065a90 0x7f5d50067f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d640c3ca0 tx=0x7f5d54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:40.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a693450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a648c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d6d929000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da5a46cc90 con 0x55da5a6491c0 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d6d929000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da5a49e220 con 0x55da5a693990 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.670+0000 7f5d6d929000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da5a49b7f0 con 0x55da5a693070 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56098/0 (socket says 172.21.15.133:56098) 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 -- 172.21.15.133:0/1936777762 learned_addr learned my addr 172.21.15.133:0/1936777762 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d637fe640 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a648c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d63fff640 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a693450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 -- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 msgr2=0x55da5a693450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a693450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 -- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 msgr2=0x55da5a648c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a648c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 -- 172.21.15.133:0/1936777762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da5a193890 con 0x55da5a6491c0 2023-12-18T10:18:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d637fe640 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a648c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d68b50640 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6495a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c002240 tx=0x7f5d5c01b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f329523e6f0b8d20 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d49ffb640 1 -- 172.21.15.133:0/1936777762 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0a5bf0 con 0x55da5a6491c0 2023-12-18T10:18:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d49ffb640 1 -- 172.21.15.133:0/1936777762 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c0a5d50 con 0x55da5a6491c0 2023-12-18T10:18:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d49ffb640 1 -- 172.21.15.133:0/1936777762 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c003ba0 con 0x55da5a6491c0 2023-12-18T10:18:40.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- 172.21.15.133:0/1936777762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 msgr2=0x55da5a6495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6495a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c002240 tx=0x7f5d5c01b4e0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- 172.21.15.133:0/1936777762 shutdown_connections 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6495a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a648c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 --2- 172.21.15.133:0/1936777762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a693450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- 172.21.15.133:0/1936777762 >> 172.21.15.133:0/1936777762 conn(0x55da5a64f950 msgr2=0x55da5a647560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- 172.21.15.133:0/1936777762 shutdown_connections 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- 172.21.15.133:0/1936777762 wait complete. 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- start start 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 Processor -- start 2023-12-18T10:18:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a6491c0 0x55da5a64e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693070 0x55da5a655080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da5a4970e0 con 0x55da5a693070 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da5a436310 con 0x55da5a693990 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da5a454770 con 0x55da5a6491c0 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.674+0000 7f5d6d929000 10 client.0 _ll_register_callbacks cb 0x55da5a634b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693070 0x55da5a655080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693070 0x55da5a655080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56108/0 (socket says 172.21.15.133:56108) 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 -- 172.21.15.133:0/639329227 learned_addr learned my addr 172.21.15.133:0/639329227 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d68b50640 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d63fff640 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a6491c0 0x55da5a64e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 -- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a6491c0 msgr2=0x55da5a64e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a6491c0 0x55da5a64e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 -- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 msgr2=0x55da5a6555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 -- 172.21.15.133:0/639329227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6414fdd0 con 0x55da5a693070 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d63fff640 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a6491c0 0x55da5a64e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d637fe640 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693070 0x55da5a655080 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d58057070 tx=0x7f5d58012490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b2446c168dceae server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 1 -- 172.21.15.133:0/639329227 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5805ee30 con 0x55da5a693070 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 1 -- 172.21.15.133:0/639329227 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d58014e80 con 0x55da5a693070 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 -- 172.21.15.133:0/639329227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da5a466c10 con 0x55da5a693070 2023-12-18T10:18:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 1 -- 172.21.15.133:0/639329227 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d5806ab10 con 0x55da5a693070 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 10 client.4824 fetch_fsmap learned FSMap version 9 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 -- 172.21.15.133:0/639329227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f5d4c005740 con 0x55da5a693070 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 1 -- 172.21.15.133:0/639329227 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d58078080 con 0x55da5a693070 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 1 -- 172.21.15.133:0/639329227 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5d5806ac70 con 0x55da5a693070 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 10 client.4824 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 20 client.4824 populate_metadata read hostname 'smithi133' 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55da5a69a8d0 0x55da5a69acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 4 client.4824 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 -- 172.21.15.133:0/639329227 --> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da5a495a30 con 0x55da5a69a8d0 2023-12-18T10:18:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d63fff640 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55da5a69a8d0 0x55da5a69acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d63fff640 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55da5a69a8d0 0x55da5a69acb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2be8ebe9e20d9ffb server_cookie=ece8ed05aca2193c in_seq=0 out_seq=0 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 10 client.4824 ms_handle_connect on v2:172.21.15.142:6833/229940980 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 1 -- 172.21.15.133:0/639329227 <== mds.0 v2:172.21.15.142:6833/229940980 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55da5a495a30 con 0x55da5a69a8d0 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 10 client.4824 handle_command_reply: tid=0 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 client.4824 shutdown 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 -- 172.21.15.133:0/639329227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693070 msgr2=0x55da5a655080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693070 0x55da5a655080 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d58057070 tx=0x7f5d58012490 comp rx=0 tx=0).stop 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 -- 172.21.15.133:0/639329227 shutdown_connections 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55da5a69a8d0 0x55da5a69acb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693070 0x55da5a655080 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 --2- 172.21.15.133:0/639329227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a6491c0 0x55da5a64e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d42ffd640 0 client.4824 ms_handle_reset on v2:172.21.15.142:6833/229940980 2023-12-18T10:18:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 -- 172.21.15.133:0/639329227 >> 172.21.15.133:0/639329227 conn(0x55da5a64f950 msgr2=0x55da5a647c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 -- 172.21.15.133:0/639329227 shutdown_connections 2023-12-18T10:18:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.678+0000 7f5d6d929000 1 -- 172.21.15.133:0/639329227 wait complete. 2023-12-18T10:18:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.682+0000 7f5d6d929000 20 client.4824 trim_cache size 0 max 16384 2023-12-18T10:18:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d6d929000 1 Processor -- start 2023-12-18T10:18:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d6d929000 1 -- start start 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a6491c0 0x55da5a6eb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a6eb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693990 0x55da5a6ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d6d929000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da5a154940 con 0x55da5a693990 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d6d929000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da5a498670 con 0x55da5a6491c0 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d6d929000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da5a6409d0 con 0x55da5a693070 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d68b50640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693990 0x55da5a6ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d68b50640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693990 0x55da5a6ebd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56118/0 (socket says 172.21.15.133:56118) 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d68b50640 1 -- 172.21.15.133:0/1144351928 learned_addr learned my addr 172.21.15.133:0/1144351928 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d68b50640 1 -- 172.21.15.133:0/1144351928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 msgr2=0x55da5a6eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d63fff640 1 --2- 172.21.15.133:0/1144351928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a6491c0 0x55da5a6eb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d68b50640 1 --2- 172.21.15.133:0/1144351928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a6eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d68b50640 1 -- 172.21.15.133:0/1144351928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a6491c0 msgr2=0x55da5a6eb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.694+0000 7f5d68b50640 1 --2- 172.21.15.133:0/1144351928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a6491c0 0x55da5a6eb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d68b50640 1 -- 172.21.15.133:0/1144351928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da5a45c260 con 0x55da5a693990 2023-12-18T10:18:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d68b50640 1 --2- 172.21.15.133:0/1144351928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693990 0x55da5a6ebd70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c01d540 tx=0x7f5d5c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4c14d408a96e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d4a7fc640 1 -- 172.21.15.133:0/1144351928 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0a5bf0 con 0x55da5a693990 2023-12-18T10:18:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d4a7fc640 1 -- 172.21.15.133:0/1144351928 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c0a5d50 con 0x55da5a693990 2023-12-18T10:18:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d4a7fc640 1 -- 172.21.15.133:0/1144351928 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c003bc0 con 0x55da5a693990 2023-12-18T10:18:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- 172.21.15.133:0/1144351928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693990 msgr2=0x55da5a6ebd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 --2- 172.21.15.133:0/1144351928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693990 0x55da5a6ebd70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c01d540 tx=0x7f5d5c004a50 comp rx=0 tx=0).stop 2023-12-18T10:18:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- 172.21.15.133:0/1144351928 shutdown_connections 2023-12-18T10:18:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 --2- 172.21.15.133:0/1144351928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a693990 0x55da5a6ebd70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 --2- 172.21.15.133:0/1144351928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a6eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 --2- 172.21.15.133:0/1144351928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a6491c0 0x55da5a6eb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- 172.21.15.133:0/1144351928 >> 172.21.15.133:0/1144351928 conn(0x55da5a64f950 msgr2=0x55da5a654f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- 172.21.15.133:0/1144351928 shutdown_connections 2023-12-18T10:18:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- 172.21.15.133:0/1144351928 wait complete. 2023-12-18T10:18:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- start start 2023-12-18T10:18:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 Processor -- start 2023-12-18T10:18:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a6d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6d45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da5a62cda0 con 0x55da5a6491c0 2023-12-18T10:18:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da5a64e7a0 con 0x55da5a693990 2023-12-18T10:18:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da5a4dace0 con 0x55da5a693070 2023-12-18T10:18:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d6d929000 10 client.0 _ll_register_callbacks cb 0x55da5a445640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:18:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d63fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d63fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6d3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56124/0 (socket says 172.21.15.133:56124) 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d63fff640 1 -- 172.21.15.133:0/2134881152 learned_addr learned my addr 172.21.15.133:0/2134881152 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d637fe640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a6d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d68b50640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6d45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d63fff640 1 -- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 msgr2=0x55da5a6d4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d63fff640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a6d4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d63fff640 1 -- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 msgr2=0x55da5a6d45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d63fff640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6d45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d63fff640 1 -- 172.21.15.133:0/2134881152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da5a193890 con 0x55da5a6491c0 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d637fe640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a6d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.698+0000 7f5d68b50640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6d45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d63fff640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6d3b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5d54006e90 tx=0x7f5d54004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6b66ca98a8019f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:18:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 1 -- 172.21.15.133:0/2134881152 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5402c620 con 0x55da5a6491c0 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 1 -- 172.21.15.133:0/2134881152 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d5402c780 con 0x55da5a6491c0 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 -- 172.21.15.133:0/2134881152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da5a45ce00 con 0x55da5a6491c0 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 1 -- 172.21.15.133:0/2134881152 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d5402c940 con 0x55da5a6491c0 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 10 client.4830 fetch_fsmap learned FSMap version 9 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 -- 172.21.15.133:0/2134881152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55da5a4423b0 con 0x55da5a6491c0 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 1 -- 172.21.15.133:0/2134881152 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da5a45ce00 con 0x55da5a6491c0 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 1 -- 172.21.15.133:0/2134881152 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5d54032020 con 0x55da5a6491c0 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 10 client.4830 fetch_fsmap finished waiting for FSMap version 9 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 10 client.4830 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 20 client.4830 populate_metadata read hostname 'smithi133' 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55da5a6d4b10 0x55da5a6d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 4 client.4830 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-12-18T10:18:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 -- 172.21.15.133:0/2134881152 --> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55da5a490160 con 0x55da5a6d4b10 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d637fe640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55da5a6d4b10 0x55da5a6d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d637fe640 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55da5a6d4b10 0x55da5a6d4ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=638e8a38b7f08c32 server_cookie=1693f9093f36320f in_seq=0 out_seq=0 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 10 client.4830 ms_handle_connect on v2:172.21.15.142:6833/229940980 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 1 -- 172.21.15.133:0/2134881152 <== mds.0 v2:172.21.15.142:6833/229940980 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55da5a490160 con 0x55da5a6d4b10 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 10 client.4830 handle_command_reply: tid=0 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 client.4830 shutdown 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 -- 172.21.15.133:0/2134881152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 msgr2=0x55da5a6d3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6d3b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5d54006e90 tx=0x7f5d54004740 comp rx=0 tx=0).stop 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 -- 172.21.15.133:0/2134881152 shutdown_connections 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:6833/229940980,v1:172.21.15.142:6835/229940980] conn(0x55da5a6d4b10 0x55da5a6d4ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55da5a693990 0x55da5a6d45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55da5a693070 0x55da5a6d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d42ffd640 0 client.4830 ms_handle_reset on v2:172.21.15.142:6833/229940980 2023-12-18T10:18:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 --2- 172.21.15.133:0/2134881152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da5a6491c0 0x55da5a6d3b50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 -- 172.21.15.133:0/2134881152 >> 172.21.15.133:0/2134881152 conn(0x55da5a64f950 msgr2=0x55da5a690060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 -- 172.21.15.133:0/2134881152 shutdown_connections 2023-12-18T10:18:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 1 -- 172.21.15.133:0/2134881152 wait complete. 2023-12-18T10:18:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6d929000 20 client.4830 trim_cache size 0 max 16384 2023-12-18T10:18:40.710 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:18:40.710 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:18:40.710 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:18:40.710 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4288, 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 35.095928286000003, 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 9, 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 24, 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 24, 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 42.023975894000003 2023-12-18T10:18:40.711 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:18:40.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5d50065a90 msgr2=0x7f5d50067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5d50065a90 0x7f5d50067f50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5d640c3ca0 tx=0x7f5d54008040 comp rx=0 tx=0).stop 2023-12-18T10:18:40.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d64159630 msgr2=0x7f5d64159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:40.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d64159630 0x7f5d64159ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5d58012510 tx=0x7f5d580129d0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/1180864736 shutdown_connections 2023-12-18T10:18:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5d50065a90 0x7f5d50067f50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640cc1d0 0x7f5d640cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d64159630 0x7f5d64159ab0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 --2- 172.21.15.133:0/1180864736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d4c006f20 0x7f5d6414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/1180864736 >> 172.21.15.133:0/1180864736 conn(0x7f5d6406a3e0 msgr2=0x7f5d641517b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/1180864736 shutdown_connections 2023-12-18T10:18:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:40.702+0000 7f5d6a5b3640 1 -- 172.21.15.133:0/1180864736 wait complete. 2023-12-18T10:18:40.725 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-18T10:18:40.736 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-18T10:18:40.736 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-18T10:18:40.736 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-18T10:18:40.736 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-18T10:18:40.736 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-18T10:18:40.736 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-18T10:18:40.736 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-18T10:18:40.736 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-18T10:18:40.736 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-18T10:18:40.737 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-18T10:18:40.737 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-18T10:18:40.737 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-18T10:18:40.737 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-18T10:18:40.737 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-18T10:18:40.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:40.737 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-18T10:18:40.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:40.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-12-18T10:18:40.817 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-12-18T10:18:40.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:18:40.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:40.821 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:18:40.830 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-18T10:18:40.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:40.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-18T10:18:40.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:40.896 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-12-18T10:18:41.137 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-18T10:18:41.137 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:18:41.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.270+0000 7f88b0539640 1 Processor -- start 2023-12-18T10:18:41.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88b0539640 1 -- start start 2023-12-18T10:18:41.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88b0539640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88a815ca40 0x7f88a80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:41.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88b0539640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88a80ce3f0 0x7f88a80cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:41.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88b0539640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a80d11c0 con 0x7f88a80cf610 2023-12-18T10:18:41.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88b0539640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a80cfaa0 con 0x7f88a80ce3f0 2023-12-18T10:18:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88b0539640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a80d0310 con 0x7f88a815ca40 2023-12-18T10:18:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88adad4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88a80ce3f0 0x7f88a80cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88aead6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f88a80cf610 0x7f88a81605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45400/0 (socket says 172.21.15.133:45400) 2023-12-18T10:18:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88aead6640 1 -- 172.21.15.133:0/2882860056 learned_addr learned my addr 172.21.15.133:0/2882860056 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88ae2d5640 1 --2- 172.21.15.133:0/2882860056 >> v2:172.21.15.142:3300/0 conn(0x7f88a815ca40 0x7f88a80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88adad4640 1 -- 172.21.15.133:0/2882860056 >> v2:172.21.15.142:3300/0 conn(0x7f88a815ca40 msgr2=0x7f88a80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:41.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88adad4640 1 --2- 172.21.15.133:0/2882860056 >> v2:172.21.15.142:3300/0 conn(0x7f88a815ca40 0x7f88a80cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88adad4640 1 -- 172.21.15.133:0/2882860056 >> v1:172.21.15.133:6789/0 conn(0x7f88a80cf610 legacy=0x7f88a81605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88adad4640 1 -- 172.21.15.133:0/2882860056 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80d05b0 con 0x7f88a80ce3f0 2023-12-18T10:18:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.274+0000 7f88ad2d3640 1 -- 172.21.15.133:0/2882860056 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678548273 0 0) 0x7f88a80d11c0 con 0x7f88a80cf610 2023-12-18T10:18:41.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88adad4640 1 --2- 172.21.15.133:0/2882860056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a80ce3f0 0x7f88a80cf0d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88a80736e0 tx=0x7f889801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76274ab84299c446 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:41.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88ad2d3640 1 -- 172.21.15.133:0/2882860056 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980ad660 con 0x7f88a80ce3f0 2023-12-18T10:18:41.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88ad2d3640 1 -- 172.21.15.133:0/2882860056 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88980ad7c0 con 0x7f88a80ce3f0 2023-12-18T10:18:41.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88ad2d3640 1 -- 172.21.15.133:0/2882860056 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980adb50 con 0x7f88a80ce3f0 2023-12-18T10:18:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 -- 172.21.15.133:0/2882860056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a80ce3f0 msgr2=0x7f88a80cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 --2- 172.21.15.133:0/2882860056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a80ce3f0 0x7f88a80cf0d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88a80736e0 tx=0x7f889801c440 comp rx=0 tx=0).stop 2023-12-18T10:18:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 -- 172.21.15.133:0/2882860056 shutdown_connections 2023-12-18T10:18:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 --2- 172.21.15.133:0/2882860056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a80ce3f0 0x7f88a80cf0d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 --2- 172.21.15.133:0/2882860056 >> v2:172.21.15.142:3300/0 conn(0x7f88a815ca40 0x7f88a80cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 -- 172.21.15.133:0/2882860056 >> 172.21.15.133:0/2882860056 conn(0x7f88a8089fb0 msgr2=0x7f88a80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 -- 172.21.15.133:0/2882860056 shutdown_connections 2023-12-18T10:18:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 -- 172.21.15.133:0/2882860056 wait complete. 2023-12-18T10:18:41.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.278+0000 7f88b0539640 1 Processor -- start 2023-12-18T10:18:41.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 -- start start 2023-12-18T10:18:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88a80ce3f0 0x7f88a814cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a80cf610 0x7f88a814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a815ca40 0x7f88a814d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a80cb280 con 0x7f88a815ca40 2023-12-18T10:18:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a814ec70 con 0x7f88a80cf610 2023-12-18T10:18:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a814d1b0 con 0x7f88a80ce3f0 2023-12-18T10:18:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a815ca40 0x7f88a814d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a815ca40 0x7f88a814d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56156/0 (socket says 172.21.15.133:56156) 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 -- 172.21.15.133:0/408570722 learned_addr learned my addr 172.21.15.133:0/408570722 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88adad4640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a80cf610 0x7f88a814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88ae2d5640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88a80ce3f0 0x7f88a814cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 -- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88a80ce3f0 msgr2=0x7f88a814cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88a80ce3f0 0x7f88a814cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 -- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a80cf610 msgr2=0x7f88a814d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a80cf610 0x7f88a814d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 -- 172.21.15.133:0/408570722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980093b0 con 0x7f88a815ca40 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88adad4640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a80cf610 0x7f88a814d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88aead6640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a815ca40 0x7f88a814d900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c410 tx=0x7f88a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f889effd640 1 -- 172.21.15.133:0/408570722 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a00074e0 con 0x7f88a815ca40 2023-12-18T10:18:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f889effd640 1 -- 172.21.15.133:0/408570722 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0007640 con 0x7f88a815ca40 2023-12-18T10:18:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f889effd640 1 -- 172.21.15.133:0/408570722 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0004a30 con 0x7f88a815ca40 2023-12-18T10:18:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a80cabe0 con 0x7f88a815ca40 2023-12-18T10:18:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a80ca6d0 con 0x7f88a815ca40 2023-12-18T10:18:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.282+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a804e000 con 0x7f88a815ca40 2023-12-18T10:18:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.286+0000 7f889effd640 1 -- 172.21.15.133:0/408570722 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f88a0004b90 con 0x7f88a815ca40 2023-12-18T10:18:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.286+0000 7f889effd640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f888c065a60 0x7f888c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.286+0000 7f889effd640 1 -- 172.21.15.133:0/408570722 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88a0083080 con 0x7f88a815ca40 2023-12-18T10:18:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.286+0000 7f88ae2d5640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f888c065a60 0x7f888c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.286+0000 7f88ae2d5640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f888c065a60 0x7f888c067f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f88a4011440 tx=0x7f88a400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.290+0000 7f889effd640 1 -- 172.21.15.133:0/408570722 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f88a00b40a0 con 0x7f88a815ca40 2023-12-18T10:18:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.470+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88a80cff10 con 0x7f88a815ca40 2023-12-18T10:18:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.470+0000 7f889effd640 1 -- 172.21.15.133:0/408570722 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f88a0050740 con 0x7f88a815ca40 2023-12-18T10:18:41.474 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f888c065a60 msgr2=0x7f888c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f888c065a60 0x7f888c067f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f88a4011440 tx=0x7f88a400b040 comp rx=0 tx=0).stop 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a815ca40 msgr2=0x7f88a814d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a815ca40 0x7f88a814d900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c410 tx=0x7f88a000c8d0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 shutdown_connections 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f888c065a60 0x7f888c067f20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88a815ca40 0x7f88a814d900 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88a80cf610 0x7f88a814d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 --2- 172.21.15.133:0/408570722 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88a80ce3f0 0x7f88a814cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 >> 172.21.15.133:0/408570722 conn(0x7f88a8089fb0 msgr2=0x7f88a80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 shutdown_connections 2023-12-18T10:18:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:41.474+0000 7f88b0539640 1 -- 172.21.15.133:0/408570722 wait complete. 2023-12-18T10:18:41.494 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:18:41.494 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:18:41.495 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:18:41.495 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-18T10:18:41.495 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-18T10:18:41.495 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:18:41.495 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:18:41.495 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:18:41.495 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:18:41.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.495 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:41.505 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42115sec preferred_lft 42115sec 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:18:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:41.507 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-18T10:18:41.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.508 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:41.508 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:41.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2023-12-18T10:18:41.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2023-12-18T10:18:41.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2023-12-18T10:18:41.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-18T10:18:41.508 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:41.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.624 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:18:41.643 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:18:41.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.645 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:18:41.701 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:18:41.701 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:18:41.701 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:18:41.702 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:18:41.702 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:18:41.702 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:18:41.702 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:41.702 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:41.702 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:41.702 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:18:41.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.702 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:41.702 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:41.702 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:18:41.702 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:18:41.702 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:18:41.703 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:41.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.796 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:18:41.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.806 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-12-18T10:18:41.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.859 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:41.859 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:41.859 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:18:41.859 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-18T10:18:41.859 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:41.941 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-18T10:18:41.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:41.941 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:41.941 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:41.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-18T10:18:41.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-18T10:18:41.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-18T10:18:41.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-18T10:18:41.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-18T10:18:41.941 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:42.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:42.081 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:42.081 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:42.081 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-18T10:18:42.081 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2023-12-18T10:18:42.081 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:42.122 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-18T10:18:42.122 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:42.122 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-18T10:18:42.175 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:18:42.175 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:42.175 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:18:42.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:18:42.296 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:42.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:42.358 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:42.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:42.359 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:18:42.410 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:18:42.411 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-18T10:18:42.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:18:42.478 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:42.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:42.545 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:42.547 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:42.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:42.548 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:18:42.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:2023-12-18T10:18:42.549+0000 7f6dd764b580 -1 init, newargv = 0x561532d50f60 newargc=15 2023-12-18T10:18:42.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[46336]: starting ceph client 2023-12-18T10:18:42.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[46336]: starting fuse 2023-12-18T10:18:42.562 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:18:42.562 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:18:42.562 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:18:42.562 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:18:42.562 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:18:42.562 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:18:42.562 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:18:42.563 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:18:42.564 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:18:42.564 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:18:42.564 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:42.564 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.0")) 2023-12-18T10:18:42.564 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:18:42.686 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.0.46336.asok 2023-12-18T10:18:42.870 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46336.asok 2023-12-18T10:18:42.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:42.870 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46336.asok status 2023-12-18T10:18:43.042 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "0", 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "46336", 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:18:43.043 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4845, 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 4845 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1919329444 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:18:43.044 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1919329444 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.4845 192.168.0.1:0/1919329444", 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/1919329444", 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 9, 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 24, 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:18:43.045 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:18:43.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:18:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1cb6139640 1 Processor -- start 2023-12-18T10:18:43.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1cb6139640 1 -- start start 2023-12-18T10:18:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1cb6139640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb015a680 0x7f1cb015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1cb6139640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1cb00cac10 0x7f1cb015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1cb6139640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb015f100 con 0x7f1cb015afa0 2023-12-18T10:18:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1cb6139640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb00ca7d0 con 0x7f1cb00cac10 2023-12-18T10:18:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1cb6139640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb015e860 con 0x7f1cb015a680 2023-12-18T10:18:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1cb015afa0 0x7f1cb006fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45416/0 (socket says 172.21.15.133:45416) 2023-12-18T10:18:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caffff640 1 -- 172.21.15.133:0/1089454591 learned_addr learned my addr 172.21.15.133:0/1089454591 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caf7fe640 1 --2- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb015a680 0x7f1cb015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:43.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caeffd640 1 --2- 172.21.15.133:0/1089454591 >> v2:172.21.15.142:3300/0 conn(0x7f1cb00cac10 0x7f1cb015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caeffd640 1 -- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb015a680 msgr2=0x7f1cb015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caeffd640 1 --2- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb015a680 0x7f1cb015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caeffd640 1 -- 172.21.15.133:0/1089454591 >> v1:172.21.15.133:6789/0 conn(0x7f1cb015afa0 legacy=0x7f1cb006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caeffd640 1 -- 172.21.15.133:0/1089454591 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb015eb40 con 0x7f1cb00cac10 2023-12-18T10:18:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.193+0000 7f1caf7fe640 1 --2- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb015a680 0x7f1cb015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.197+0000 7f1caeffd640 1 --2- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb00cac10 0x7f1cb015aa60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40097c0 tx=0x7f1ca401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac13f9f1f6c664c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cae7fc640 1 -- 172.21.15.133:0/1089454591 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40ab600 con 0x7f1cb00cac10 2023-12-18T10:18:43.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cae7fc640 1 -- 172.21.15.133:0/1089454591 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca40a7050 con 0x7f1cb00cac10 2023-12-18T10:18:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cae7fc640 1 -- 172.21.15.133:0/1089454591 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40ab980 con 0x7f1cb00cac10 2023-12-18T10:18:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 -- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb00cac10 msgr2=0x7f1cb015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:43.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 --2- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb00cac10 0x7f1cb015aa60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40097c0 tx=0x7f1ca401c3f0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 -- 172.21.15.133:0/1089454591 shutdown_connections 2023-12-18T10:18:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 --2- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb00cac10 0x7f1cb015aa60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 --2- 172.21.15.133:0/1089454591 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb015a680 0x7f1cb015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 -- 172.21.15.133:0/1089454591 >> 172.21.15.133:0/1089454591 conn(0x7f1cb006a3e0 msgr2=0x7f1cb00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 -- 172.21.15.133:0/1089454591 shutdown_connections 2023-12-18T10:18:43.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 -- 172.21.15.133:0/1089454591 wait complete. 2023-12-18T10:18:43.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 Processor -- start 2023-12-18T10:18:43.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.201+0000 7f1cb6139640 1 -- start start 2023-12-18T10:18:43.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb00c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:43.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb014b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:43.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb015afa0 0x7f1cb0158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:43.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb014d190 con 0x7f1cb015afa0 2023-12-18T10:18:43.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0158660 con 0x7f1cb015a680 2023-12-18T10:18:43.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00c4cb0 con 0x7f1cb00cac10 2023-12-18T10:18:43.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caf7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb00c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:43.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb015afa0 0x7f1cb0158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caeffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb014b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caf7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb00c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:42246/0 (socket says 172.21.15.133:42246) 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caf7fe640 1 -- 172.21.15.133:0/4209445680 learned_addr learned my addr 172.21.15.133:0/4209445680 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caeffd640 1 -- 172.21.15.133:0/4209445680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 msgr2=0x7f1cb00c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caeffd640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb00c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caeffd640 1 -- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb015afa0 msgr2=0x7f1cb0158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caeffd640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb015afa0 0x7f1cb0158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caeffd640 1 -- 172.21.15.133:0/4209445680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0009420 con 0x7f1cb015a680 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caffff640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb015afa0 0x7f1cb0158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:43.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caf7fe640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb00c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:43.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1caeffd640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb014b140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40ab000 tx=0x7f1ca4019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:43.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1c97fff640 1 -- 172.21.15.133:0/4209445680 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40b4840 con 0x7f1cb015a680 2023-12-18T10:18:43.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1c97fff640 1 -- 172.21.15.133:0/4209445680 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca40b49e0 con 0x7f1cb015a680 2023-12-18T10:18:43.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca4009420 con 0x7f1cb015a680 2023-12-18T10:18:43.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1c97fff640 1 -- 172.21.15.133:0/4209445680 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40b4d90 con 0x7f1cb015a680 2023-12-18T10:18:43.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb00c4f00 con 0x7f1cb015a680 2023-12-18T10:18:43.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.205+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb00735b0 con 0x7f1cb015a680 2023-12-18T10:18:43.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.209+0000 7f1c97fff640 1 -- 172.21.15.133:0/4209445680 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ca40b2040 con 0x7f1cb015a680 2023-12-18T10:18:43.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.209+0000 7f1c97fff640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c9c065a60 0x7f1c9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:43.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.209+0000 7f1c97fff640 1 -- 172.21.15.133:0/4209445680 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ca411d390 con 0x7f1cb015a680 2023-12-18T10:18:43.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.209+0000 7f1caf7fe640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c9c065a60 0x7f1c9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:43.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.209+0000 7f1caf7fe640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c9c065a60 0x7f1c9c067f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009fd0 tx=0x7f1ca0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.213+0000 7f1c97fff640 1 -- 172.21.15.133:0/4209445680 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1ca40eaba0 con 0x7f1cb015a680 2023-12-18T10:18:43.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1cb004e000 con 0x7f1cb015a680 2023-12-18T10:18:43.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1c97fff640 1 -- 172.21.15.133:0/4209445680 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1ca40ee1c0 con 0x7f1cb015a680 2023-12-18T10:18:43.396 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-18T10:18:43.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c9c065a60 msgr2=0x7f1c9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c9c065a60 0x7f1c9c067f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009fd0 tx=0x7f1ca0009190 comp rx=0 tx=0).stop 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 msgr2=0x7f1cb014b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb014b140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40ab000 tx=0x7f1ca4019190 comp rx=0 tx=0).stop 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 shutdown_connections 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c9c065a60 0x7f1c9c067f20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb015afa0 0x7f1cb0158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb014b140 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 --2- 172.21.15.133:0/4209445680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb00c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 >> 172.21.15.133:0/4209445680 conn(0x7f1cb006a3e0 msgr2=0x7f1cb0152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 shutdown_connections 2023-12-18T10:18:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:43.393+0000 7f1cb6139640 1 -- 172.21.15.133:0/4209445680 wait complete. 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:18:43.418 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-18T10:18:43.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.419 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:18:43.428 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:43.428 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:43.428 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:43.428 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.428 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:43.428 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.428 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:43.428 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42113sec preferred_lft 42113sec 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:18:43.429 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-12-18T10:18:43.430 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.431 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:18:43.497 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:18:43.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.499 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:18:43.553 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:18:43.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.555 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:43.555 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:43.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:18:43.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:18:43.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:18:43.555 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:43.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.644 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:18:43.654 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-18T10:18:43.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.654 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-12-18T10:18:43.706 INFO:teuthology.orchestra.run.smithi133.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-18T10:18:43.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.708 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:43.708 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:43.708 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-18T10:18:43.708 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-18T10:18:43.708 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:43.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.790 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether da:ad:6e:be:7d:5f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.855 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::d8ad:6eff:febe:7d5f/64 scope link tentative 2023-12-18T10:18:43.856 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-18T10:18:43.918 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether da:ad:6e:be:7d:5f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::d8ad:6eff:febe:7d5f/64 scope link tentative 2023-12-18T10:18:43.919 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:43.921 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-18T10:18:43.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:43.921 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:43.921 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:43.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-18T10:18:43.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-18T10:18:43.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-18T10:18:43.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-18T10:18:43.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-18T10:18:43.922 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:44.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:44.059 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:18:44.059 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:18:44.059 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.1 up 2023-12-18T10:18:44.059 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.1 master ceph-brx 2023-12-18T10:18:44.060 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:18:44.101 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-18T10:18:44.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:44.101 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-18T10:18:44.152 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-18T10:18:44.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:44.153 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-18T10:18:44.203 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:18:44.267 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:44.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:44.330 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:44.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:44.331 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:18:44.382 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:18:44.383 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-12-18T10:18:44.383 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-18T10:18:44.429 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:18:44.451 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:44.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:44.517 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:44.519 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:44.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:44.520 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:18:44.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi133.stderr:2023-12-18T10:18:44.521+0000 7f303dffc580 -1 init, newargv = 0x561e2103ef50 newargc=15 2023-12-18T10:18:44.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi133.stderr:ceph-fuse[46470]: starting ceph client 2023-12-18T10:18:44.532 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi133.stderr:ceph-fuse[46470]: starting fuse 2023-12-18T10:18:44.535 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:18:44.535 INFO:teuthology.orchestra.run.smithi133.stdout:44 2023-12-18T10:18:44.535 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-12-18T10:18:44.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:18:44.535 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:18:44.535 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:18:44.535 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:18:44.535 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:18:44.535 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:18:44.536 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:18:44.537 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:18:44.537 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:18:44.537 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.2")) 2023-12-18T10:18:44.537 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:18:44.658 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.2.46470.asok 2023-12-18T10:18:44.842 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46470.asok 2023-12-18T10:18:44.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:44.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46470.asok status 2023-12-18T10:18:45.016 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:18:45.016 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:18:45.016 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:18:45.016 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:18:45.016 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "2", 2023-12-18T10:18:45.016 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:18:45.016 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "46470", 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4854, 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 4854 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:18:45.017 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.2:0", 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3013620615 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.2:0", 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3013620615 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.4854 192.168.0.2:0/3013620615", 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.2:0/3013620615", 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 9, 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 24, 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:18:45.018 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:18:45.019 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:18:45.019 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:18:45.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:18:45.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.165+0000 7fb892efe640 1 Processor -- start 2023-12-18T10:18:45.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.165+0000 7fb892efe640 1 -- start start 2023-12-18T10:18:45.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb892efe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb88c0c4ce0 0x7fb88c0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:45.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb892efe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb88c06c1b0 0x7fb88c0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:45.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb892efe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c0ccce0 con 0x7fb88c06bdd0 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb892efe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88c0caa70 con 0x7fb88c06c1b0 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb892efe640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88c0cd550 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb8926fd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb88c06c1b0 0x7fb88c0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb891efc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb88c06bdd0 0x7fb88c0c45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45432/0 (socket says 172.21.15.133:45432) 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb891efc640 1 -- 172.21.15.133:0/2830044874 learned_addr learned my addr 172.21.15.133:0/2830044874 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb8916fb640 1 --2- 172.21.15.133:0/2830044874 >> v2:172.21.15.142:3300/0 conn(0x7fb88c0c4ce0 0x7fb88c0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb8926fd640 1 -- 172.21.15.133:0/2830044874 >> v2:172.21.15.142:3300/0 conn(0x7fb88c0c4ce0 msgr2=0x7fb88c0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb8926fd640 1 --2- 172.21.15.133:0/2830044874 >> v2:172.21.15.142:3300/0 conn(0x7fb88c0c4ce0 0x7fb88c0cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb8926fd640 1 -- 172.21.15.133:0/2830044874 >> v1:172.21.15.133:6789/0 conn(0x7fb88c06bdd0 legacy=0x7fb88c0c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb890efa640 1 -- 172.21.15.133:0/2830044874 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460337923 0 0) 0x7fb88c0ccce0 con 0x7fb88c06bdd0 2023-12-18T10:18:45.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.169+0000 7fb8926fd640 1 -- 172.21.15.133:0/2830044874 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c0ccf90 con 0x7fb88c06c1b0 2023-12-18T10:18:45.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb8926fd640 1 --2- 172.21.15.133:0/2830044874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c06c1b0 0x7fb88c0cc7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb88c06c730 tx=0x7fb88401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef51f1859c4ae8b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:45.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb890efa640 1 -- 172.21.15.133:0/2830044874 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8840a5920 con 0x7fb88c06c1b0 2023-12-18T10:18:45.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb890efa640 1 -- 172.21.15.133:0/2830044874 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8840a5a80 con 0x7fb88c06c1b0 2023-12-18T10:18:45.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb890efa640 1 -- 172.21.15.133:0/2830044874 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8840a5e10 con 0x7fb88c06c1b0 2023-12-18T10:18:45.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 -- 172.21.15.133:0/2830044874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c06c1b0 msgr2=0x7fb88c0cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:45.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 --2- 172.21.15.133:0/2830044874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c06c1b0 0x7fb88c0cc7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb88c06c730 tx=0x7fb88401c8e0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 -- 172.21.15.133:0/2830044874 shutdown_connections 2023-12-18T10:18:45.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 --2- 172.21.15.133:0/2830044874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c06c1b0 0x7fb88c0cc7a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 --2- 172.21.15.133:0/2830044874 >> v2:172.21.15.142:3300/0 conn(0x7fb88c0c4ce0 0x7fb88c0cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 -- 172.21.15.133:0/2830044874 >> 172.21.15.133:0/2830044874 conn(0x7fb88c0ce130 msgr2=0x7fb88c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:45.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 -- 172.21.15.133:0/2830044874 shutdown_connections 2023-12-18T10:18:45.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 -- 172.21.15.133:0/2830044874 wait complete. 2023-12-18T10:18:45.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 Processor -- start 2023-12-18T10:18:45.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.173+0000 7fb892efe640 1 -- start start 2023-12-18T10:18:45.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88c06bdd0 0x7fb88c15cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb88c06c1b0 0x7fb88c15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c0c4ce0 0x7fb88c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c14bcd0 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c15c930 con 0x7fb88c06bdd0 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c15bd20 con 0x7fb88c06c1b0 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c0c4ce0 0x7fb88c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c0c4ce0 0x7fb88c14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56184/0 (socket says 172.21.15.133:56184) 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 -- 172.21.15.133:0/24293699 learned_addr learned my addr 172.21.15.133:0/24293699 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb891efc640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88c06bdd0 0x7fb88c15cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8916fb640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb88c06c1b0 0x7fb88c15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:45.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 -- 172.21.15.133:0/24293699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb88c06c1b0 msgr2=0x7fb88c15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:45.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb88c06c1b0 0x7fb88c15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 -- 172.21.15.133:0/24293699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88c06bdd0 msgr2=0x7fb88c15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:45.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88c06bdd0 0x7fb88c15cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 -- 172.21.15.133:0/24293699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884009a70 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8926fd640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c0c4ce0 0x7fb88c14b790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb88401cdc0 tx=0x7fb884019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:45.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8827fc640 1 -- 172.21.15.133:0/24293699 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8840aee10 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8827fc640 1 -- 172.21.15.133:0/24293699 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8840b7410 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88c15c000 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8827fc640 1 -- 172.21.15.133:0/24293699 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8840b77c0 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88c15c5c0 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c04e850 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.177+0000 7fb8827fc640 1 -- 172.21.15.133:0/24293699 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8840b4050 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.181+0000 7fb8827fc640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb870065a60 0x7fb870067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:45.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.181+0000 7fb8827fc640 1 -- 172.21.15.133:0/24293699 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb88411e140 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.181+0000 7fb891efc640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb870065a60 0x7fb870067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:45.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.181+0000 7fb891efc640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb870065a60 0x7fb870067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb888000f70 tx=0x7fb888007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:45.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.185+0000 7fb8827fc640 1 -- 172.21.15.133:0/24293699 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb8840eb8b0 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.369+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb88c15ca70 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.369+0000 7fb8827fc640 1 -- 172.21.15.133:0/24293699 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb8840eeed0 con 0x7fb88c0c4ce0 2023-12-18T10:18:45.374 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb870065a60 msgr2=0x7fb870067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb870065a60 0x7fb870067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb888000f70 tx=0x7fb888007df0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c0c4ce0 msgr2=0x7fb88c14b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c0c4ce0 0x7fb88c14b790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb88401cdc0 tx=0x7fb884019680 comp rx=0 tx=0).stop 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 shutdown_connections 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb870065a60 0x7fb870067f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb88c0c4ce0 0x7fb88c14b790 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb88c06c1b0 0x7fb88c15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 --2- 172.21.15.133:0/24293699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb88c06bdd0 0x7fb88c15cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 >> 172.21.15.133:0/24293699 conn(0x7fb88c0ce130 msgr2=0x7fb88c0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 shutdown_connections 2023-12-18T10:18:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:45.373+0000 7fb892efe640 1 -- 172.21.15.133:0/24293699 wait complete. 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:18:45.394 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-18T10:18:45.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.395 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-18T10:18:45.405 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42143sec preferred_lft 42143sec 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 02:42:a7:94:54:97 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:18:45.406 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:45.408 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-18T10:18:45.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.408 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:45.408 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:45.408 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2023-12-18T10:18:45.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2023-12-18T10:18:45.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2023-12-18T10:18:45.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-18T10:18:45.409 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:45.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.533 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:18:45.554 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-18T10:18:45.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.556 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-18T10:18:45.627 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-18T10:18:45.627 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run.smithi142.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run.smithi142.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run.smithi142.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:18:45.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.628 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:45.628 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:45.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:18:45.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:18:45.629 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:18:45.629 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:45.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.727 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-18T10:18:45.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.736 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-12-18T10:18:45.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.793 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:45.793 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:45.793 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-18T10:18:45.793 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-18T10:18:45.793 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:45.880 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-18T10:18:45.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:45.881 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:45.881 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:45.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-18T10:18:45.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-18T10:18:45.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-18T10:18:45.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-18T10:18:45.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-18T10:18:45.881 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:46.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:46.046 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:46.046 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:46.046 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-12-18T10:18:46.046 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2023-12-18T10:18:46.046 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:46.089 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-18T10:18:46.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:46.089 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-18T10:18:46.140 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-18T10:18:46.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:46.140 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-18T10:18:46.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-12-18T10:18:46.252 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:46.252 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:46.315 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:46.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:46.316 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-12-18T10:18:46.368 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:18:46.368 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-18T10:18:46.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-12-18T10:18:46.436 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:46.436 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:46.499 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:46.501 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:46.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:46.502 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-12-18T10:18:46.515 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:2023-12-18T10:18:46.509+0000 7f49d9b10580 -1 init, newargv = 0x562ddad38050 newargc=15 2023-12-18T10:18:46.515 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:ceph-fuse[44129]: starting ceph client 2023-12-18T10:18:46.523 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi142.stderr:ceph-fuse[44129]: starting fuse 2023-12-18T10:18:46.524 INFO:teuthology.orchestra.run.smithi142.stdout:43 2023-12-18T10:18:46.524 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:18:46.524 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:18:46.524 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2023-12-18T10:18:46.524 DEBUG:teuthology.orchestra.run.smithi142:> import re 2023-12-18T10:18:46.524 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-12-18T10:18:46.524 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2023-12-18T10:18:46.524 DEBUG:teuthology.orchestra.run.smithi142:> 2023-12-18T10:18:46.524 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2023-12-18T10:18:46.524 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2023-12-18T10:18:46.525 DEBUG:teuthology.orchestra.run.smithi142:> return f 2023-12-18T10:18:46.526 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:18:46.526 DEBUG:teuthology.orchestra.run.smithi142:> 2023-12-18T10:18:46.526 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.1")) 2023-12-18T10:18:46.526 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-12-18T10:18:46.646 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.1.44129.asok 2023-12-18T10:18:46.831 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44129.asok 2023-12-18T10:18:46.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:46.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44129.asok status 2023-12-18T10:18:47.004 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-12-18T10:18:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2023-12-18T10:18:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:18:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:18:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "1", 2023-12-18T10:18:47.004 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "44129", 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4834, 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 4834 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2023-12-18T10:18:47.005 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 1030320639 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 1030320639 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.4834 192.168.0.1:0/1030320639", 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "192.168.0.1:0/1030320639", 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 9, 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 25, 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:18:47.006 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2023-12-18T10:18:47.007 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2023-12-18T10:18:47.007 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-12-18T10:18:47.019 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:18:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba359e640 1 Processor -- start 2023-12-18T10:18:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba359e640 1 -- start start 2023-12-18T10:18:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba415ffb0 0x7f7ba40d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba359e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7ba40d1280 0x7f7ba40af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba359e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba40d33d0 con 0x7f7ba40b13d0 2023-12-18T10:18:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba359e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba40ce500 con 0x7f7ba40d1280 2023-12-18T10:18:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40af330 con 0x7f7ba415ffb0 2023-12-18T10:18:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba1d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7ba40b13d0 0x7f7ba40d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45448/0 (socket says 172.21.15.133:45448) 2023-12-18T10:18:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba1d9b640 1 -- 172.21.15.133:0/2515417596 learned_addr learned my addr 172.21.15.133:0/2515417596 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba2d9d640 1 --2- 172.21.15.133:0/2515417596 >> v2:172.21.15.142:3300/0 conn(0x7f7ba40d1280 0x7f7ba40af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba259c640 1 --2- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba415ffb0 0x7f7ba40d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba159a640 1 -- 172.21.15.133:0/2515417596 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303304249 0 0) 0x7f7ba40d33d0 con 0x7f7ba40b13d0 2023-12-18T10:18:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba159a640 1 -- 172.21.15.133:0/2515417596 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b8c003530 con 0x7f7ba40b13d0 2023-12-18T10:18:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba2d9d640 1 -- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba415ffb0 msgr2=0x7f7ba40d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba2d9d640 1 --2- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba415ffb0 0x7f7ba40d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba2d9d640 1 -- 172.21.15.133:0/2515417596 >> v1:172.21.15.133:6789/0 conn(0x7f7ba40b13d0 legacy=0x7f7ba40d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba2d9d640 1 -- 172.21.15.133:0/2515417596 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba40d3060 con 0x7f7ba40d1280 2023-12-18T10:18:47.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.161+0000 7f7ba259c640 1 --2- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba415ffb0 0x7f7ba40d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba2d9d640 1 --2- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba40d1280 0x7f7ba40af850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009d90 tx=0x7f7b9c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6119430e01f986 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba159a640 1 -- 172.21.15.133:0/2515417596 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0a5810 con 0x7f7ba40d1280 2023-12-18T10:18:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba159a640 1 -- 172.21.15.133:0/2515417596 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0a5970 con 0x7f7ba40d1280 2023-12-18T10:18:47.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba159a640 1 -- 172.21.15.133:0/2515417596 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0a5d00 con 0x7f7ba40d1280 2023-12-18T10:18:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba359e640 1 -- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba40d1280 msgr2=0x7f7ba40af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba359e640 1 --2- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba40d1280 0x7f7ba40af850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009d90 tx=0x7f7b9c01c950 comp rx=0 tx=0).stop 2023-12-18T10:18:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba359e640 1 -- 172.21.15.133:0/2515417596 shutdown_connections 2023-12-18T10:18:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba359e640 1 --2- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba40d1280 0x7f7ba40af850 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba359e640 1 --2- 172.21.15.133:0/2515417596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba415ffb0 0x7f7ba40d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba359e640 1 -- 172.21.15.133:0/2515417596 >> 172.21.15.133:0/2515417596 conn(0x7f7ba409b930 msgr2=0x7f7ba40d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba359e640 1 -- 172.21.15.133:0/2515417596 shutdown_connections 2023-12-18T10:18:47.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.165+0000 7f7ba359e640 1 -- 172.21.15.133:0/2515417596 wait complete. 2023-12-18T10:18:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 Processor -- start 2023-12-18T10:18:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 -- start start 2023-12-18T10:18:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ba40b13d0 0x7f7ba40c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba40d1280 0x7f7ba40ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba415ffb0 0x7f7ba40cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40cac30 con 0x7f7ba40b13d0 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40caf10 con 0x7f7ba415ffb0 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40cb1f0 con 0x7f7ba40d1280 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ba40b13d0 0x7f7ba40c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ba40b13d0 0x7f7ba40c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56186/0 (socket says 172.21.15.133:56186) 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 -- 172.21.15.133:0/3370315136 learned_addr learned my addr 172.21.15.133:0/3370315136 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba1d9b640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba40d1280 0x7f7ba40ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba2d9d640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba415ffb0 0x7f7ba40cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 -- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba40d1280 msgr2=0x7f7ba40ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba40d1280 0x7f7ba40ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 -- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba415ffb0 msgr2=0x7f7ba40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba415ffb0 0x7f7ba40cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 -- 172.21.15.133:0/3370315136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94009420 con 0x7f7ba40b13d0 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba1d9b640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba40d1280 0x7f7ba40ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba259c640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ba40b13d0 0x7f7ba40c8100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400e980 tx=0x7f7b9400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7b92ffd640 1 -- 172.21.15.133:0/3370315136 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400ca00 con 0x7f7ba40b13d0 2023-12-18T10:18:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7b92ffd640 1 -- 172.21.15.133:0/3370315136 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9400cb60 con 0x7f7ba40b13d0 2023-12-18T10:18:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7b92ffd640 1 -- 172.21.15.133:0/3370315136 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b94013470 con 0x7f7ba40b13d0 2023-12-18T10:18:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c009a70 con 0x7f7ba40b13d0 2023-12-18T10:18:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba40cb7b0 con 0x7f7ba40b13d0 2023-12-18T10:18:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.169+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba404e850 con 0x7f7ba40b13d0 2023-12-18T10:18:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.173+0000 7f7b92ffd640 1 -- 172.21.15.133:0/3370315136 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7b940135d0 con 0x7f7ba40b13d0 2023-12-18T10:18:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.173+0000 7f7b92ffd640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b84065a90 0x7f7b84067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.173+0000 7f7b92ffd640 1 -- 172.21.15.133:0/3370315136 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7b94083700 con 0x7f7ba40b13d0 2023-12-18T10:18:47.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.173+0000 7f7ba1d9b640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b84065a90 0x7f7b84067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:47.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.173+0000 7f7ba1d9b640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b84065a90 0x7f7b84067f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ba415f9a0 tx=0x7f7b98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:47.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.177+0000 7f7b92ffd640 1 -- 172.21.15.133:0/3370315136 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7b94050d90 con 0x7f7ba40b13d0 2023-12-18T10:18:47.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.361+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ba40c8b10 con 0x7f7ba40b13d0 2023-12-18T10:18:47.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7b92ffd640 1 -- 172.21.15.133:0/3370315136 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7b940543b0 con 0x7f7ba40b13d0 2023-12-18T10:18:47.369 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b84065a90 msgr2=0x7f7b84067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b84065a90 0x7f7b84067f50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ba415f9a0 tx=0x7f7b98009040 comp rx=0 tx=0).stop 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ba40b13d0 msgr2=0x7f7ba40c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ba40b13d0 0x7f7ba40c8100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400e980 tx=0x7f7b9400ee40 comp rx=0 tx=0).stop 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 shutdown_connections 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b84065a90 0x7f7b84067f50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ba415ffb0 0x7f7ba40cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ba40d1280 0x7f7ba40ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 --2- 172.21.15.133:0/3370315136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ba40b13d0 0x7f7ba40c8100 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:47.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 >> 172.21.15.133:0/3370315136 conn(0x7f7ba409b930 msgr2=0x7f7ba415e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:47.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 shutdown_connections 2023-12-18T10:18:47.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:47.365+0000 7f7ba359e640 1 -- 172.21.15.133:0/3370315136 wait complete. 2023-12-18T10:18:47.387 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:18:47.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:18:47.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-12-18T10:18:47.387 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-18T10:18:47.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-18T10:18:47.388 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:18:47.388 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:18:47.388 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:18:47.388 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-18T10:18:47.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.388 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-12-18T10:18:47.398 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42141sec preferred_lft 42141sec 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 02:42:a7:94:54:97 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:47.399 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-18T10:18:47.400 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.401 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:18:47.461 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-12-18T10:18:47.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.464 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:47.519 INFO:teuthology.orchestra.run.smithi142.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:18:47.520 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:18:47.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.520 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:47.520 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:47.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:18:47.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:18:47.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:18:47.520 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:47.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.610 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-18T10:18:47.619 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-18T10:18:47.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.619 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-12-18T10:18:47.668 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-18T10:18:47.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.669 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:47.669 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:47.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-18T10:18:47.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-18T10:18:47.669 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:47.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 3a:a5:0f:0b:93:8d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::38a5:fff:fe0b:938d/64 scope link 2023-12-18T10:18:47.820 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-18T10:18:47.885 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:18:47.885 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:18:47.885 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:18:47.885 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.885 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-12-18T10:18:47.885 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.885 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:18:47.886 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 3a:a5:0f:0b:93:8d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-18T10:18:47.886 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-18T10:18:47.886 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.886 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::38a5:fff:fe0b:938d/64 scope link 2023-12-18T10:18:47.886 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:18:47.887 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-18T10:18:47.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:47.887 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:47.887 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:47.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-18T10:18:47.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-18T10:18:47.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-18T10:18:47.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-18T10:18:47.888 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-18T10:18:47.888 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:48.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:48.027 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-12-18T10:18:48.027 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-12-18T10:18:48.027 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2023-12-18T10:18:48.027 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2023-12-18T10:18:48.027 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-12-18T10:18:48.066 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-18T10:18:48.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:48.066 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-18T10:18:48.119 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-18T10:18:48.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:18:48.119 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-18T10:18:48.171 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-12-18T10:18:48.236 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:48.236 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:48.297 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:48.299 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:48.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:48.300 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-12-18T10:18:48.351 INFO:teuthology.orchestra.run.smithi142.stdout:43 2023-12-18T10:18:48.352 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-12-18T10:18:48.352 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-18T10:18:48.398 DEBUG:teuthology.orchestra.run.smithi142:> sudo modprobe fuse 2023-12-18T10:18:48.419 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:18:48.419 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:18:48.478 INFO:teuthology.orchestra.run.smithi142.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:18:48.480 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:18:48.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:48.480 DEBUG:teuthology.orchestra.run.smithi142:> ls /sys/fs/fuse/connections 2023-12-18T10:18:48.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:2023-12-18T10:18:48.489+0000 7f38d242a580 -1 init, newargv = 0x55d2eebef1e0 newargc=15 2023-12-18T10:18:48.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:ceph-fuse[44237]: starting ceph client 2023-12-18T10:18:48.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi142.stderr:ceph-fuse[44237]: starting fuse 2023-12-18T10:18:48.502 INFO:teuthology.orchestra.run.smithi142.stdout:43 2023-12-18T10:18:48.502 INFO:teuthology.orchestra.run.smithi142.stdout:44 2023-12-18T10:18:48.502 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-12-18T10:18:48.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:18:48.502 DEBUG:teuthology.orchestra.run.smithi142:> import glob 2023-12-18T10:18:48.502 DEBUG:teuthology.orchestra.run.smithi142:> import re 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> import os 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> import subprocess 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> def _find_admin_socket(client_name): 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> files = glob.glob(asok_path) 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> # Given a non-glob path, it better be there 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> if "*" not in asok_path: 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> assert(len(files) == 1) 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> return files[0] 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> for f in files: 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:18:48.503 DEBUG:teuthology.orchestra.run.smithi142:> contents = proc_f.read() 2023-12-18T10:18:48.504 DEBUG:teuthology.orchestra.run.smithi142:> if mountpoint in contents: 2023-12-18T10:18:48.504 DEBUG:teuthology.orchestra.run.smithi142:> return f 2023-12-18T10:18:48.504 DEBUG:teuthology.orchestra.run.smithi142:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:18:48.504 DEBUG:teuthology.orchestra.run.smithi142:> 2023-12-18T10:18:48.504 DEBUG:teuthology.orchestra.run.smithi142:> print(_find_admin_socket("client.3")) 2023-12-18T10:18:48.504 DEBUG:teuthology.orchestra.run.smithi142:> ' 2023-12-18T10:18:48.623 INFO:teuthology.orchestra.run.smithi142.stdout:/var/run/ceph/ceph-client.3.44237.asok 2023-12-18T10:18:48.807 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44237.asok 2023-12-18T10:18:48.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:48.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44237.asok status 2023-12-18T10:18:48.980 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-12-18T10:18:48.980 INFO:teuthology.orchestra.run.smithi142.stdout: "metadata": { 2023-12-18T10:18:48.980 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:18:48.980 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:18:48.980 INFO:teuthology.orchestra.run.smithi142.stdout: "entity_id": "3", 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": "smithi142", 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "pid": "44237", 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "root": "/" 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_count": 0, 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "dentry_pinned_count": 0, 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 4658, 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "inst": { 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "name": { 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "client", 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: "num": 4658 2023-12-18T10:18:48.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.2:0", 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 35263557 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": { 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "192.168.0.2:0", 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 35263557 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "inst_str": "client.4658 192.168.0.2:0/35263557", 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "addr_str": "192.168.0.2:0/35263557", 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "inode_count": 1, 2023-12-18T10:18:48.982 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_epoch": 9, 2023-12-18T10:18:48.983 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch": 26, 2023-12-18T10:18:48.983 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:18:48.983 INFO:teuthology.orchestra.run.smithi142.stdout: "blocklisted": false, 2023-12-18T10:18:48.983 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs" 2023-12-18T10:18:48.983 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-12-18T10:18:48.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:48.996 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:18:48.996 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-18T10:18:49.007 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:18:49.008 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-18T10:18:49.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:49.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:18:49.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:49.072 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:18:49.072 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-18T10:18:49.128 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:18:49.128 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-18T10:18:49.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:49.128 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-18T10:18:49.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:49.192 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2023-12-18T10:18:49.192 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-18T10:18:49.202 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2023-12-18T10:18:49.202 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-18T10:18:49.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:49.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-18T10:18:49.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:49.265 DEBUG:teuthology.orchestra.run.smithi142:> stat --file-system '--printf=%T 2023-12-18T10:18:49.265 DEBUG:teuthology.orchestra.run.smithi142:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-18T10:18:49.316 INFO:teuthology.orchestra.run.smithi142.stdout:fuseblk 2023-12-18T10:18:49.316 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-18T10:18:49.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:18:49.316 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-18T10:18:49.384 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-18T10:18:49.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:49.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a8352640 1 Processor -- start 2023-12-18T10:18:49.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a8352640 1 -- start start 2023-12-18T10:18:49.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a8352640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a015a680 0x7f12a015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a8352640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12a00cac10 0x7f12a015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a8352640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a015f100 con 0x7f12a015afa0 2023-12-18T10:18:49.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a8352640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a00ca7d0 con 0x7f12a00cac10 2023-12-18T10:18:49.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a8352640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a015e860 con 0x7f12a015a680 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a58ed640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12a00cac10 0x7f12a015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a60ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a015a680 0x7f12a015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a68ef640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f12a015afa0 0x7f12a006fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:34972/0 (socket says 172.21.15.133:34972) 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a58ed640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12a00cac10 0x7f12a015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:56094/0 (socket says 172.21.15.133:56094) 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.545+0000 7f12a68ef640 1 -- 172.21.15.133:0/379145892 learned_addr learned my addr 172.21.15.133:0/379145892 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a60ee640 1 -- 172.21.15.133:0/379145892 >> v2:172.21.15.142:3300/0 conn(0x7f12a00cac10 msgr2=0x7f12a015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a50ec640 1 -- 172.21.15.133:0/379145892 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835006807 0 0) 0x7f12a015f100 con 0x7f12a015afa0 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a60ee640 1 --2- 172.21.15.133:0/379145892 >> v2:172.21.15.142:3300/0 conn(0x7f12a00cac10 0x7f12a015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a60ee640 1 -- 172.21.15.133:0/379145892 >> v1:172.21.15.142:6789/0 conn(0x7f12a015afa0 legacy=0x7f12a006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a60ee640 1 -- 172.21.15.133:0/379145892 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a015eb40 con 0x7f12a015a680 2023-12-18T10:18:49.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a58ed640 1 --2- 172.21.15.133:0/379145892 >> v2:172.21.15.142:3300/0 conn(0x7f12a00cac10 0x7f12a015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:49.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a60ee640 1 --2- 172.21.15.133:0/379145892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a015a680 0x7f12a015e160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f129c0097c0 tx=0x7f129c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63bb8bf84cd80c3b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:49.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a50ec640 1 -- 172.21.15.133:0/379145892 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0ab610 con 0x7f12a015a680 2023-12-18T10:18:49.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a50ec640 1 -- 172.21.15.133:0/379145892 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c0ab770 con 0x7f12a015a680 2023-12-18T10:18:49.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a50ec640 1 -- 172.21.15.133:0/379145892 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c0abb00 con 0x7f12a015a680 2023-12-18T10:18:49.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a8352640 1 -- 172.21.15.133:0/379145892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a015a680 msgr2=0x7f12a015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.549+0000 7f12a8352640 1 --2- 172.21.15.133:0/379145892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a015a680 0x7f12a015e160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f129c0097c0 tx=0x7f129c01c3f0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 -- 172.21.15.133:0/379145892 shutdown_connections 2023-12-18T10:18:49.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 --2- 172.21.15.133:0/379145892 >> v2:172.21.15.142:3300/0 conn(0x7f12a00cac10 0x7f12a015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 --2- 172.21.15.133:0/379145892 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a015a680 0x7f12a015e160 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 -- 172.21.15.133:0/379145892 >> 172.21.15.133:0/379145892 conn(0x7f12a006a3e0 msgr2=0x7f12a00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:49.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 -- 172.21.15.133:0/379145892 shutdown_connections 2023-12-18T10:18:49.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 -- 172.21.15.133:0/379145892 wait complete. 2023-12-18T10:18:49.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 Processor -- start 2023-12-18T10:18:49.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 -- start start 2023-12-18T10:18:49.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a00cac10 0x7f12a00ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a015a680 0x7f12a01f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12a015afa0 0x7f12a0159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a01f8a50 con 0x7f12a015a680 2023-12-18T10:18:49.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a01f8cd0 con 0x7f12a015afa0 2023-12-18T10:18:49.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a8352640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a01f8fb0 con 0x7f12a00cac10 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a015a680 0x7f12a01f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a015a680 0x7f12a01f8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56200/0 (socket says 172.21.15.133:56200) 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a60ee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a00cac10 0x7f12a00ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 -- 172.21.15.133:0/2422314206 learned_addr learned my addr 172.21.15.133:0/2422314206 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a68ef640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12a015afa0 0x7f12a0159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 -- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a00cac10 msgr2=0x7f12a00ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a00cac10 0x7f12a00ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 -- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12a015afa0 msgr2=0x7f12a0159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12a015afa0 0x7f12a0159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 -- 172.21.15.133:0/2422314206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1290009420 con 0x7f12a015a680 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a60ee640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a00cac10 0x7f12a00ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a68ef640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12a015afa0 0x7f12a0159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.553+0000 7f12a58ed640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a015a680 0x7f12a01f8510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f129000ebe0 tx=0x7f129000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:49.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f1296ffd640 1 -- 172.21.15.133:0/2422314206 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000eee0 con 0x7f12a015a680 2023-12-18T10:18:49.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f1296ffd640 1 -- 172.21.15.133:0/2422314206 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000cc30 con 0x7f12a015a680 2023-12-18T10:18:49.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f1296ffd640 1 -- 172.21.15.133:0/2422314206 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290013470 con 0x7f12a015a680 2023-12-18T10:18:49.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c009420 con 0x7f12a015a680 2023-12-18T10:18:49.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a00c57d0 con 0x7f12a015a680 2023-12-18T10:18:49.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a00735b0 con 0x7f12a015a680 2023-12-18T10:18:49.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f1296ffd640 1 -- 172.21.15.133:0/2422314206 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f12900135d0 con 0x7f12a015a680 2023-12-18T10:18:49.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f1296ffd640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1284065a60 0x7f1284067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f1296ffd640 1 -- 172.21.15.133:0/2422314206 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1290083870 con 0x7f12a015a680 2023-12-18T10:18:49.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.557+0000 7f12a60ee640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1284065a60 0x7f1284067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.561+0000 7f12a60ee640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1284065a60 0x7f1284067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f129c0af000 tx=0x7f129c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:49.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.561+0000 7f1296ffd640 1 -- 172.21.15.133:0/2422314206 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1290050e80 con 0x7f12a015a680 2023-12-18T10:18:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.721+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12a004e000 con 0x7f12a015a680 2023-12-18T10:18:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.721+0000 7f1296ffd640 1 -- 172.21.15.133:0/2422314206 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f12900544a0 con 0x7f12a015a680 2023-12-18T10:18:49.726 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:49.727 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1284065a60 msgr2=0x7f1284067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1284065a60 0x7f1284067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f129c0af000 tx=0x7f129c0a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a015a680 msgr2=0x7f12a01f8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a015a680 0x7f12a01f8510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f129000ebe0 tx=0x7f129000c520 comp rx=0 tx=0).stop 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 shutdown_connections 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1284065a60 0x7f1284067f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12a015afa0 0x7f12a0159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a015a680 0x7f12a01f8510 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 --2- 172.21.15.133:0/2422314206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12a00cac10 0x7f12a00ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 >> 172.21.15.133:0/2422314206 conn(0x7f12a006a3e0 msgr2=0x7f12a0151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 shutdown_connections 2023-12-18T10:18:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.725+0000 7f12a8352640 1 -- 172.21.15.133:0/2422314206 wait complete. 2023-12-18T10:18:49.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:49.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:49.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f19a0a66640 1 Processor -- start 2023-12-18T10:18:49.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f19a0a66640 1 -- start start 2023-12-18T10:18:49.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f19a0a66640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f199c070820 0x7f199c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f19a0a66640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f199c0ce3b0 0x7f199c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f19a0a66640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0c9390 con 0x7f199c1582d0 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f19a0a66640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0ced60 con 0x7f199c0ce3b0 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f19a0a66640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c15aee0 con 0x7f199c070820 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f199ad9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f199c0ce3b0 0x7f199c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f199a59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f199c1582d0 0x7f199c0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45456/0 (socket says 172.21.15.133:45456) 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f199a59c640 1 -- 172.21.15.133:0/674815070 learned_addr learned my addr 172.21.15.133:0/674815070 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.885+0000 7f1991d9b640 1 --2- 172.21.15.133:0/674815070 >> v2:172.21.15.142:3300/0 conn(0x7f199c070820 0x7f199c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f199ad9d640 1 -- 172.21.15.133:0/674815070 >> v2:172.21.15.142:3300/0 conn(0x7f199c070820 msgr2=0x7f199c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f199ad9d640 1 --2- 172.21.15.133:0/674815070 >> v2:172.21.15.142:3300/0 conn(0x7f199c070820 0x7f199c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f199ad9d640 1 -- 172.21.15.133:0/674815070 >> v1:172.21.15.133:6789/0 conn(0x7f199c1582d0 legacy=0x7f199c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f199ad9d640 1 -- 172.21.15.133:0/674815070 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c15b1c0 con 0x7f199c0ce3b0 2023-12-18T10:18:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f1999d9b640 1 -- 172.21.15.133:0/674815070 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871426814 0 0) 0x7f199c0c9390 con 0x7f199c1582d0 2023-12-18T10:18:49.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f199ad9d640 1 --2- 172.21.15.133:0/674815070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c0ce3b0 0x7f199c0ce820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f199c06dfa0 tx=0x7f199401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df97e9e15eb7ec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f1999d9b640 1 -- 172.21.15.133:0/674815070 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940a7070 con 0x7f199c0ce3b0 2023-12-18T10:18:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f1999d9b640 1 -- 172.21.15.133:0/674815070 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19940ab430 con 0x7f199c0ce3b0 2023-12-18T10:18:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f1999d9b640 1 -- 172.21.15.133:0/674815070 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940ab7c0 con 0x7f199c0ce3b0 2023-12-18T10:18:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f19a0a66640 1 -- 172.21.15.133:0/674815070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c0ce3b0 msgr2=0x7f199c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f19a0a66640 1 --2- 172.21.15.133:0/674815070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c0ce3b0 0x7f199c0ce820 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f199c06dfa0 tx=0x7f199401c430 comp rx=0 tx=0).stop 2023-12-18T10:18:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f19a0a66640 1 -- 172.21.15.133:0/674815070 shutdown_connections 2023-12-18T10:18:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f19a0a66640 1 --2- 172.21.15.133:0/674815070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c0ce3b0 0x7f199c0ce820 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f19a0a66640 1 --2- 172.21.15.133:0/674815070 >> v2:172.21.15.142:3300/0 conn(0x7f199c070820 0x7f199c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f19a0a66640 1 -- 172.21.15.133:0/674815070 >> 172.21.15.133:0/674815070 conn(0x7f199c06a2a0 msgr2=0x7f199c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f19a0a66640 1 -- 172.21.15.133:0/674815070 shutdown_connections 2023-12-18T10:18:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.889+0000 7f19a0a66640 1 -- 172.21.15.133:0/674815070 wait complete. 2023-12-18T10:18:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f19a0a66640 1 Processor -- start 2023-12-18T10:18:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f19a0a66640 1 -- start start 2023-12-18T10:18:49.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f19a0a66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199c070820 0x7f199c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f19a0a66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199c0ce3b0 0x7f199c164a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f19a0a66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c1582d0 0x7f199c0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f19a0a66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c1636a0 con 0x7f199c1582d0 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f19a0a66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c163980 con 0x7f199c0ce3b0 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f19a0a66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c163c60 con 0x7f199c070820 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c1582d0 0x7f199c0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c1582d0 0x7f199c0cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51706/0 (socket says 172.21.15.133:51706) 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 -- 172.21.15.133:0/3412278509 learned_addr learned my addr 172.21.15.133:0/3412278509 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f1991d9b640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199c0ce3b0 0x7f199c164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199a59c640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199c070820 0x7f199c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 -- 172.21.15.133:0/3412278509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199c070820 msgr2=0x7f199c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199c070820 0x7f199c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 -- 172.21.15.133:0/3412278509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199c0ce3b0 msgr2=0x7f199c164a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199c0ce3b0 0x7f199c164a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:49.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 -- 172.21.15.133:0/3412278509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994009420 con 0x7f199c1582d0 2023-12-18T10:18:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.893+0000 7f199ad9d640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c1582d0 0x7f199c0cd3a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f19940ad040 tx=0x7f199401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19937fe640 1 -- 172.21.15.133:0/3412278509 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940bf610 con 0x7f199c1582d0 2023-12-18T10:18:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19937fe640 1 -- 172.21.15.133:0/3412278509 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19940bf790 con 0x7f199c1582d0 2023-12-18T10:18:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19937fe640 1 -- 172.21.15.133:0/3412278509 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940bfb40 con 0x7f199c1582d0 2023-12-18T10:18:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c163f40 con 0x7f199c1582d0 2023-12-18T10:18:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c164500 con 0x7f199c1582d0 2023-12-18T10:18:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c04e000 con 0x7f199c1582d0 2023-12-18T10:18:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19937fe640 1 -- 172.21.15.133:0/3412278509 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f19940b5400 con 0x7f199c1582d0 2023-12-18T10:18:49.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19937fe640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f197c065a60 0x7f197c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:49.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f19937fe640 1 -- 172.21.15.133:0/3412278509 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f199411dcd0 con 0x7f199c1582d0 2023-12-18T10:18:49.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f199a59c640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f197c065a60 0x7f197c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:49.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.897+0000 7f199a59c640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f197c065a60 0x7f197c067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f198c0012f0 tx=0x7f198c001690 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:49.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:49.901+0000 7f19937fe640 1 -- 172.21.15.133:0/3412278509 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f19940eb2e0 con 0x7f199c1582d0 2023-12-18T10:18:50.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.053+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f199c0b0c00 con 0x7f199c1582d0 2023-12-18T10:18:50.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.053+0000 7f19937fe640 1 -- 172.21.15.133:0/3412278509 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19940c40a0 con 0x7f199c1582d0 2023-12-18T10:18:50.057 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f197c065a60 msgr2=0x7f197c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f197c065a60 0x7f197c067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f198c0012f0 tx=0x7f198c001690 comp rx=0 tx=0).stop 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c1582d0 msgr2=0x7f199c0cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c1582d0 0x7f199c0cd3a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f19940ad040 tx=0x7f199401ac70 comp rx=0 tx=0).stop 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 shutdown_connections 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f197c065a60 0x7f197c067f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f199c1582d0 0x7f199c0cd3a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f199c0ce3b0 0x7f199c164a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 --2- 172.21.15.133:0/3412278509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f199c070820 0x7f199c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 >> 172.21.15.133:0/3412278509 conn(0x7f199c06a2a0 msgr2=0x7f199c157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:50.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 shutdown_connections 2023-12-18T10:18:50.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.057+0000 7f19a0a66640 1 -- 172.21.15.133:0/3412278509 wait complete. 2023-12-18T10:18:50.078 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:50.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06b0841640 1 Processor -- start 2023-12-18T10:18:50.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06b0841640 1 -- start start 2023-12-18T10:18:50.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06b0841640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06ac15cae0 0x7f06ac0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06b0841640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06b0841640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac15cec0 con 0x7f06ac0cf170 2023-12-18T10:18:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06b0841640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0d0530 con 0x7f06ac15cae0 2023-12-18T10:18:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06b0841640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0d0810 con 0x7f06ac0cde90 2023-12-18T10:18:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06aa59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06ac15cae0 0x7f06ac0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06aad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f06ac0cf170 0x7f06ac06add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48242/0 (socket says 172.21.15.133:48242) 2023-12-18T10:18:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06aa59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06ac15cae0 0x7f06ac0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51710/0 (socket says 172.21.15.133:51710) 2023-12-18T10:18:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06aad9d640 1 -- 172.21.15.133:0/2889054049 learned_addr learned my addr 172.21.15.133:0/2889054049 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06a9d9b640 1 --2- 172.21.15.133:0/2889054049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06aa59c640 1 -- 172.21.15.133:0/2889054049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 msgr2=0x7f06ac0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06aa59c640 1 --2- 172.21.15.133:0/2889054049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06aa59c640 1 -- 172.21.15.133:0/2889054049 >> v1:172.21.15.133:6789/0 conn(0x7f06ac0cf170 legacy=0x7f06ac06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06aa59c640 1 -- 172.21.15.133:0/2889054049 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0d0af0 con 0x7f06ac15cae0 2023-12-18T10:18:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.221+0000 7f06a959a640 1 -- 172.21.15.133:0/2889054049 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417925562 0 0) 0x7f06ac15cec0 con 0x7f06ac0cf170 2023-12-18T10:18:50.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.225+0000 7f06aa59c640 1 --2- 172.21.15.133:0/2889054049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac15cae0 0x7f06ac0d12f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f069c0097a0 tx=0x7f069c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d417e62b89bf3c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.225+0000 7f06a959a640 1 -- 172.21.15.133:0/2889054049 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c0ab650 con 0x7f06ac15cae0 2023-12-18T10:18:50.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.225+0000 7f06a959a640 1 -- 172.21.15.133:0/2889054049 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c0ab7b0 con 0x7f06ac15cae0 2023-12-18T10:18:50.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.225+0000 7f06a959a640 1 -- 172.21.15.133:0/2889054049 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c0abb40 con 0x7f06ac15cae0 2023-12-18T10:18:50.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- 172.21.15.133:0/2889054049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac15cae0 msgr2=0x7f06ac0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 --2- 172.21.15.133:0/2889054049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac15cae0 0x7f06ac0d12f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f069c0097a0 tx=0x7f069c01ce90 comp rx=0 tx=0).stop 2023-12-18T10:18:50.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- 172.21.15.133:0/2889054049 shutdown_connections 2023-12-18T10:18:50.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 --2- 172.21.15.133:0/2889054049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 --2- 172.21.15.133:0/2889054049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac15cae0 0x7f06ac0d12f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- 172.21.15.133:0/2889054049 >> 172.21.15.133:0/2889054049 conn(0x7f06ac089fb0 msgr2=0x7f06ac0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:50.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- 172.21.15.133:0/2889054049 shutdown_connections 2023-12-18T10:18:50.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- 172.21.15.133:0/2889054049 wait complete. 2023-12-18T10:18:50.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 Processor -- start 2023-12-18T10:18:50.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- start start 2023-12-18T10:18:50.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac0cf170 0x7f06ac0afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06ac15cae0 0x7f06ac0b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0cb1b0 con 0x7f06ac0cf170 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac158320 con 0x7f06ac15cae0 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06b0841640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0ca5a0 con 0x7f06ac0cde90 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06a9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac0cf170 0x7f06ac0afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06aa59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06a9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac0cf170 0x7f06ac0afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51714/0 (socket says 172.21.15.133:51714) 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06a9d9b640 1 -- 172.21.15.133:0/2050923778 learned_addr learned my addr 172.21.15.133:0/2050923778 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.229+0000 7f06aad9d640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06ac15cae0 0x7f06ac0b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06a9d9b640 1 -- 172.21.15.133:0/2050923778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 msgr2=0x7f06ac157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06a9d9b640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06a9d9b640 1 -- 172.21.15.133:0/2050923778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06ac15cae0 msgr2=0x7f06ac0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06a9d9b640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06ac15cae0 0x7f06ac0b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06a9d9b640 1 -- 172.21.15.133:0/2050923778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0093b0 con 0x7f06ac0cf170 2023-12-18T10:18:50.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06aa59c640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:50.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06a9d9b640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac0cf170 0x7f06ac0afeb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f06a000e930 tx=0x7f06a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f069affd640 1 -- 172.21.15.133:0/2050923778 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0009690 con 0x7f06ac0cf170 2023-12-18T10:18:50.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f069affd640 1 -- 172.21.15.133:0/2050923778 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a000ca00 con 0x7f06ac0cf170 2023-12-18T10:18:50.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f069affd640 1 -- 172.21.15.133:0/2050923778 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a000cd70 con 0x7f06ac0cf170 2023-12-18T10:18:50.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac0ca880 con 0x7f06ac0cf170 2023-12-18T10:18:50.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac0cae40 con 0x7f06ac0cf170 2023-12-18T10:18:50.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac155fe0 con 0x7f06ac0cf170 2023-12-18T10:18:50.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f069affd640 1 -- 172.21.15.133:0/2050923778 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f06a0013470 con 0x7f06ac0cf170 2023-12-18T10:18:50.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f069affd640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f068c065a60 0x7f068c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f069affd640 1 -- 172.21.15.133:0/2050923778 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06a00837a0 con 0x7f06ac0cf170 2023-12-18T10:18:50.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.233+0000 7f06aa59c640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f068c065a60 0x7f068c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.237+0000 7f06aa59c640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f068c065a60 0x7f068c067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f069c0af000 tx=0x7f069c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.237+0000 7f069affd640 1 -- 172.21.15.133:0/2050923778 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f06a0050f00 con 0x7f06ac0cf170 2023-12-18T10:18:50.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.389+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06ac04e000 con 0x7f06ac0cf170 2023-12-18T10:18:50.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f069affd640 1 -- 172.21.15.133:0/2050923778 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06a0054520 con 0x7f06ac0cf170 2023-12-18T10:18:50.394 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:50.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f068c065a60 msgr2=0x7f068c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f068c065a60 0x7f068c067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f069c0af000 tx=0x7f069c004740 comp rx=0 tx=0).stop 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac0cf170 msgr2=0x7f06ac0afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac0cf170 0x7f06ac0afeb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f06a000e930 tx=0x7f06a000edf0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 shutdown_connections 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f068c065a60 0x7f068c067f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06ac15cae0 0x7f06ac0b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06ac0cf170 0x7f06ac0afeb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 --2- 172.21.15.133:0/2050923778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06ac0cde90 0x7f06ac157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 >> 172.21.15.133:0/2050923778 conn(0x7f06ac089fb0 msgr2=0x7f06ac06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 shutdown_connections 2023-12-18T10:18:50.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.393+0000 7f06b0841640 1 -- 172.21.15.133:0/2050923778 wait complete. 2023-12-18T10:18:50.416 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:50.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b8f7b640 1 Processor -- start 2023-12-18T10:18:50.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b8f7b640 1 -- start start 2023-12-18T10:18:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b8f7b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54b40c92b0 0x7f54b4160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b8f7b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b4142cd0 con 0x7f54b40ceac0 2023-12-18T10:18:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b8f7b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b41604c0 con 0x7f54b40c9690 2023-12-18T10:18:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b8f7b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b4142fb0 con 0x7f54b40c92b0 2023-12-18T10:18:50.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54b40c92b0 0x7f54b4160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54b40c92b0 0x7f54b4160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51722/0 (socket says 172.21.15.133:51722) 2023-12-18T10:18:50.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b259c640 1 -- 172.21.15.133:0/3854229185 learned_addr learned my addr 172.21.15.133:0/3854229185 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:50.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.553+0000 7f54b2d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f54b40ceac0 0x7f54b4142020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48244/0 (socket says 172.21.15.133:48244) 2023-12-18T10:18:50.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b259c640 1 -- 172.21.15.133:0/3854229185 >> v1:172.21.15.142:6789/0 conn(0x7f54b40c9690 legacy=0x7f54b40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b259c640 1 -- 172.21.15.133:0/3854229185 >> v1:172.21.15.133:6789/0 conn(0x7f54b40ceac0 legacy=0x7f54b4142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b259c640 1 -- 172.21.15.133:0/3854229185 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b41607a0 con 0x7f54b40c92b0 2023-12-18T10:18:50.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b259c640 1 --2- 172.21.15.133:0/3854229185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b4160fa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009870 tx=0x7f54a401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c2a9ea293a8fc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b1d9b640 1 -- 172.21.15.133:0/3854229185 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40aa430 con 0x7f54b40c92b0 2023-12-18T10:18:50.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b1d9b640 1 -- 172.21.15.133:0/3854229185 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40aa590 con 0x7f54b40c92b0 2023-12-18T10:18:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b1d9b640 1 -- 172.21.15.133:0/3854229185 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40aa920 con 0x7f54b40c92b0 2023-12-18T10:18:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3854229185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 msgr2=0x7f54b4160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.557+0000 7f54b8f7b640 1 --2- 172.21.15.133:0/3854229185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b4160fa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009870 tx=0x7f54a401c4b0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3854229185 shutdown_connections 2023-12-18T10:18:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 --2- 172.21.15.133:0/3854229185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b4160fa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3854229185 >> 172.21.15.133:0/3854229185 conn(0x7f54b406a2a0 msgr2=0x7f54b40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3854229185 shutdown_connections 2023-12-18T10:18:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3854229185 wait complete. 2023-12-18T10:18:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 Processor -- start 2023-12-18T10:18:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 -- start start 2023-12-18T10:18:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c9690 0x7f54b415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40ceac0 0x7f54b415b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4143170 con 0x7f54b40c92b0 2023-12-18T10:18:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40af430 con 0x7f54b40ceac0 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b8f7b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b415be00 con 0x7f54b40c9690 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b415d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51728/0 (socket says 172.21.15.133:51728) 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b259c640 1 -- 172.21.15.133:0/3889834834 learned_addr learned my addr 172.21.15.133:0/3889834834 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b2d9d640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40ceac0 0x7f54b415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54a9d9b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c9690 0x7f54b415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b259c640 1 -- 172.21.15.133:0/3889834834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c9690 msgr2=0x7f54b415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b259c640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c9690 0x7f54b415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b259c640 1 -- 172.21.15.133:0/3889834834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40ceac0 msgr2=0x7f54b415b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b259c640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40ceac0 0x7f54b415b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.561+0000 7f54b259c640 1 -- 172.21.15.133:0/3889834834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a40094d0 con 0x7f54b40c92b0 2023-12-18T10:18:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54b259c640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b415d070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f54a40ac040 tx=0x7f54a401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54ab7fe640 1 -- 172.21.15.133:0/3889834834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40a99e0 con 0x7f54b40c92b0 2023-12-18T10:18:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54ab7fe640 1 -- 172.21.15.133:0/3889834834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40a9b60 con 0x7f54b40c92b0 2023-12-18T10:18:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54ab7fe640 1 -- 172.21.15.133:0/3889834834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40a9f10 con 0x7f54b40c92b0 2023-12-18T10:18:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b415c0e0 con 0x7f54b40c92b0 2023-12-18T10:18:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b41436a0 con 0x7f54b40c92b0 2023-12-18T10:18:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4143890 con 0x7f54b40c92b0 2023-12-18T10:18:50.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54ab7fe640 1 -- 172.21.15.133:0/3889834834 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f54a40b33f0 con 0x7f54b40c92b0 2023-12-18T10:18:50.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.565+0000 7f54ab7fe640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5494065a60 0x7f5494067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.569+0000 7f54ab7fe640 1 -- 172.21.15.133:0/3889834834 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f54a411dd70 con 0x7f54b40c92b0 2023-12-18T10:18:50.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.569+0000 7f54a9d9b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5494065a60 0x7f5494067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.569+0000 7f54a9d9b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5494065a60 0x7f5494067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54b41f8ec0 tx=0x7f549c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.573+0000 7f54ab7fe640 1 -- 172.21.15.133:0/3889834834 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f54a4122070 con 0x7f54b40c92b0 2023-12-18T10:18:50.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.721+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54b404e000 con 0x7f54b40c92b0 2023-12-18T10:18:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.721+0000 7f54ab7fe640 1 -- 172.21.15.133:0/3889834834 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54a40eb4e0 con 0x7f54b40c92b0 2023-12-18T10:18:50.726 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5494065a60 msgr2=0x7f5494067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5494065a60 0x7f5494067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54b41f8ec0 tx=0x7f549c009040 comp rx=0 tx=0).stop 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 msgr2=0x7f54b415d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b415d070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f54a40ac040 tx=0x7f54a401acf0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 shutdown_connections 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5494065a60 0x7f5494067f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40ceac0 0x7f54b415b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c9690 0x7f54b415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 --2- 172.21.15.133:0/3889834834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b40c92b0 0x7f54b415d070 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 >> 172.21.15.133:0/3889834834 conn(0x7f54b406a2a0 msgr2=0x7f54b40cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 shutdown_connections 2023-12-18T10:18:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.725+0000 7f54b8f7b640 1 -- 172.21.15.133:0/3889834834 wait complete. 2023-12-18T10:18:50.746 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b5b1bc640 1 Processor -- start 2023-12-18T10:18:50.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b5b1bc640 1 -- start start 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b5b1bc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b54071870 0x7f5b54071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b5b1bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 0x7f5b540cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b5b1bc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b540cc930 con 0x7f5b540ca410 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b5b1bc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5415aab0 con 0x7f5b54071870 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b5b1bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54070df0 con 0x7f5b540cbff0 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b53fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b54071870 0x7f5b54071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b58f58640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5b540ca410 0x7f5b54159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48258/0 (socket says 172.21.15.133:48258) 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b58f58640 1 -- 172.21.15.133:0/2904452434 learned_addr learned my addr 172.21.15.133:0/2904452434 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b59759640 1 --2- 172.21.15.133:0/2904452434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 0x7f5b540cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b53fff640 1 -- 172.21.15.133:0/2904452434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 msgr2=0x7f5b540cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b53fff640 1 --2- 172.21.15.133:0/2904452434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 0x7f5b540cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b53fff640 1 -- 172.21.15.133:0/2904452434 >> v1:172.21.15.133:6789/0 conn(0x7f5b540ca410 legacy=0x7f5b54159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b53fff640 1 -- 172.21.15.133:0/2904452434 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5415a4f0 con 0x7f5b54071870 2023-12-18T10:18:50.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.885+0000 7f5b537fe640 1 -- 172.21.15.133:0/2904452434 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103160945 0 0) 0x7f5b540cc930 con 0x7f5b540ca410 2023-12-18T10:18:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b53fff640 1 --2- 172.21.15.133:0/2904452434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b54071d00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5b400097c0 tx=0x7f5b4001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2667699104ea619b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b537fe640 1 -- 172.21.15.133:0/2904452434 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400ab650 con 0x7f5b54071870 2023-12-18T10:18:50.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b537fe640 1 -- 172.21.15.133:0/2904452434 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b400ab7b0 con 0x7f5b54071870 2023-12-18T10:18:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b537fe640 1 -- 172.21.15.133:0/2904452434 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400abb40 con 0x7f5b54071870 2023-12-18T10:18:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/2904452434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 msgr2=0x7f5b54071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/2904452434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b54071d00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5b400097c0 tx=0x7f5b4001c450 comp rx=0 tx=0).stop 2023-12-18T10:18:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/2904452434 shutdown_connections 2023-12-18T10:18:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/2904452434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 0x7f5b540cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/2904452434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b54071d00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/2904452434 >> 172.21.15.133:0/2904452434 conn(0x7f5b5406a2a0 msgr2=0x7f5b540aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:50.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/2904452434 shutdown_connections 2023-12-18T10:18:50.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.889+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/2904452434 wait complete. 2023-12-18T10:18:50.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 Processor -- start 2023-12-18T10:18:50.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 -- start start 2023-12-18T10:18:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b540aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b540ca410 0x7f5b540b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 0x7f5b540aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540ac350 con 0x7f5b54071870 2023-12-18T10:18:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540aba20 con 0x7f5b540ca410 2023-12-18T10:18:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b540abd00 con 0x7f5b540cbff0 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b540aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b540aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51736/0 (socket says 172.21.15.133:51736) 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 -- 172.21.15.133:0/1892061808 learned_addr learned my addr 172.21.15.133:0/1892061808 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b59759640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 0x7f5b540aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b53fff640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b540ca410 0x7f5b540b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 -- 172.21.15.133:0/1892061808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 msgr2=0x7f5b540aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 0x7f5b540aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 -- 172.21.15.133:0/1892061808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b540ca410 msgr2=0x7f5b540b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b540ca410 0x7f5b540b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 -- 172.21.15.133:0/1892061808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b40009420 con 0x7f5b54071870 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b58f58640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b540aff70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800c550 tx=0x7f5b4800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b517fa640 1 -- 172.21.15.133:0/1892061808 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48005cf0 con 0x7f5b54071870 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b517fa640 1 -- 172.21.15.133:0/1892061808 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b48005e70 con 0x7f5b54071870 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b517fa640 1 -- 172.21.15.133:0/1892061808 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48007310 con 0x7f5b54071870 2023-12-18T10:18:50.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b540abfe0 con 0x7f5b54071870 2023-12-18T10:18:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5414e430 con 0x7f5b54071870 2023-12-18T10:18:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.893+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5404e000 con 0x7f5b54071870 2023-12-18T10:18:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.897+0000 7f5b517fa640 1 -- 172.21.15.133:0/1892061808 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b48007470 con 0x7f5b54071870 2023-12-18T10:18:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.897+0000 7f5b517fa640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5b38065a90 0x7f5b38067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.897+0000 7f5b517fa640 1 -- 172.21.15.133:0/1892061808 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5b48082ac0 con 0x7f5b54071870 2023-12-18T10:18:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.897+0000 7f5b53fff640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5b38065a90 0x7f5b38067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.897+0000 7f5b53fff640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5b38065a90 0x7f5b38067f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b400af000 tx=0x7f5b400a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:50.901+0000 7f5b517fa640 1 -- 172.21.15.133:0/1892061808 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5b48050160 con 0x7f5b54071870 2023-12-18T10:18:51.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5b540ad850 con 0x7f5b54071870 2023-12-18T10:18:51.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b517fa640 1 -- 172.21.15.133:0/1892061808 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5b480170a0 con 0x7f5b54071870 2023-12-18T10:18:51.052 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5b38065a90 msgr2=0x7f5b38067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5b38065a90 0x7f5b38067f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b400af000 tx=0x7f5b400a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 msgr2=0x7f5b540aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b540aff70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800c550 tx=0x7f5b4800ca10 comp rx=0 tx=0).stop 2023-12-18T10:18:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 shutdown_connections 2023-12-18T10:18:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5b38065a90 0x7f5b38067f50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b540cbff0 0x7f5b540aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5b540ca410 0x7f5b540b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 --2- 172.21.15.133:0/1892061808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b54071870 0x7f5b540aff70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 >> 172.21.15.133:0/1892061808 conn(0x7f5b5406a2a0 msgr2=0x7f5b5414f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 shutdown_connections 2023-12-18T10:18:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.049+0000 7f5b5b1bc640 1 -- 172.21.15.133:0/1892061808 wait complete. 2023-12-18T10:18:51.074 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb6d666640 1 Processor -- start 2023-12-18T10:18:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb6d666640 1 -- start start 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb6d666640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6815a840 0x7feb680c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb6d666640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb680ce210 0x7feb680c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb6d666640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb680cf390 con 0x7feb680cd050 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb6d666640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb680cb8c0 con 0x7feb680ce210 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb6d666640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680ce780 con 0x7feb6815a840 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb66ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feb680cd050 0x7feb680cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48262/0 (socket says 172.21.15.133:48262) 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb66ffd640 1 -- 172.21.15.133:0/3423001714 learned_addr learned my addr 172.21.15.133:0/3423001714 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.209+0000 7feb677fe640 1 --2- 172.21.15.133:0/3423001714 >> v2:172.21.15.133:3300/0 conn(0x7feb680ce210 0x7feb680c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb667fc640 1 --2- 172.21.15.133:0/3423001714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6815a840 0x7feb680c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb677fe640 1 -- 172.21.15.133:0/3423001714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6815a840 msgr2=0x7feb680c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb677fe640 1 --2- 172.21.15.133:0/3423001714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6815a840 0x7feb680c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb677fe640 1 -- 172.21.15.133:0/3423001714 >> v1:172.21.15.133:6789/0 conn(0x7feb680cd050 legacy=0x7feb680cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb677fe640 1 -- 172.21.15.133:0/3423001714 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680cea60 con 0x7feb680ce210 2023-12-18T10:18:51.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb65ffb640 1 -- 172.21.15.133:0/3423001714 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863037364 0 0) 0x7feb680cf390 con 0x7feb680cd050 2023-12-18T10:18:51.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb677fe640 1 --2- 172.21.15.133:0/3423001714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb680ce210 0x7feb680c47d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afa007e1a85f1ed server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb65ffb640 1 -- 172.21.15.133:0/3423001714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600a59e0 con 0x7feb680ce210 2023-12-18T10:18:51.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb65ffb640 1 -- 172.21.15.133:0/3423001714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb600a5b40 con 0x7feb680ce210 2023-12-18T10:18:51.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.213+0000 7feb65ffb640 1 -- 172.21.15.133:0/3423001714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600ad440 con 0x7feb680ce210 2023-12-18T10:18:51.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- 172.21.15.133:0/3423001714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb680ce210 msgr2=0x7feb680c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 --2- 172.21.15.133:0/3423001714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb680ce210 0x7feb680c47d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6001c920 comp rx=0 tx=0).stop 2023-12-18T10:18:51.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- 172.21.15.133:0/3423001714 shutdown_connections 2023-12-18T10:18:51.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 --2- 172.21.15.133:0/3423001714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb680ce210 0x7feb680c47d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 --2- 172.21.15.133:0/3423001714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb6815a840 0x7feb680c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- 172.21.15.133:0/3423001714 >> 172.21.15.133:0/3423001714 conn(0x7feb68069ca0 msgr2=0x7feb6806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:51.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- 172.21.15.133:0/3423001714 shutdown_connections 2023-12-18T10:18:51.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- 172.21.15.133:0/3423001714 wait complete. 2023-12-18T10:18:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 Processor -- start 2023-12-18T10:18:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- start start 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680cd050 0x7feb681463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680ce210 0x7feb68163320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb6815a840 0x7feb680b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68163c90 con 0x7feb6815a840 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb68163f70 con 0x7feb680ce210 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb6d666640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb68164250 con 0x7feb680cd050 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb677fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb6815a840 0x7feb680b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb677fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb6815a840 0x7feb680b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51754/0 (socket says 172.21.15.133:51754) 2023-12-18T10:18:51.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb677fe640 1 -- 172.21.15.133:0/2010642566 learned_addr learned my addr 172.21.15.133:0/2010642566 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb667fc640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680ce210 0x7feb68163320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb66ffd640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680cd050 0x7feb681463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb677fe640 1 -- 172.21.15.133:0/2010642566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680cd050 msgr2=0x7feb681463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb677fe640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680cd050 0x7feb681463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb677fe640 1 -- 172.21.15.133:0/2010642566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680ce210 msgr2=0x7feb68163320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb677fe640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680ce210 0x7feb68163320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.217+0000 7feb677fe640 1 -- 172.21.15.133:0/2010642566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009a70 con 0x7feb6815a840 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb677fe640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb6815a840 0x7feb680b2fe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feb6001afd0 tx=0x7feb600196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb4f7fe640 1 -- 172.21.15.133:0/2010642566 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600add90 con 0x7feb6815a840 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb4f7fe640 1 -- 172.21.15.133:0/2010642566 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb60009450 con 0x7feb6815a840 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb68164530 con 0x7feb6815a840 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb4f7fe640 1 -- 172.21.15.133:0/2010642566 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600b9670 con 0x7feb6815a840 2023-12-18T10:18:51.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb68163860 con 0x7feb6815a840 2023-12-18T10:18:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb68164d30 con 0x7feb6815a840 2023-12-18T10:18:51.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb4f7fe640 1 -- 172.21.15.133:0/2010642566 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb600039a0 con 0x7feb6815a840 2023-12-18T10:18:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.221+0000 7feb4f7fe640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a90 0x7feb54067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.225+0000 7feb4f7fe640 1 -- 172.21.15.133:0/2010642566 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb6011ea60 con 0x7feb6815a840 2023-12-18T10:18:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.225+0000 7feb66ffd640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a90 0x7feb54067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.225+0000 7feb66ffd640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a90 0x7feb54067f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb58007fd0 tx=0x7feb58007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.225+0000 7feb4f7fe640 1 -- 172.21.15.133:0/2010642566 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feb600ec190 con 0x7feb6815a840 2023-12-18T10:18:51.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.377+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb68163a50 con 0x7feb6815a840 2023-12-18T10:18:51.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.377+0000 7feb4f7fe640 1 -- 172.21.15.133:0/2010642566 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7feb68163a50 con 0x7feb6815a840 2023-12-18T10:18:51.382 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:51.383 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a90 msgr2=0x7feb54067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a90 0x7feb54067f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb58007fd0 tx=0x7feb58007d60 comp rx=0 tx=0).stop 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb6815a840 msgr2=0x7feb680b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb6815a840 0x7feb680b2fe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feb6001afd0 tx=0x7feb600196c0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 shutdown_connections 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a90 0x7feb54067f50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb6815a840 0x7feb680b2fe0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680ce210 0x7feb68163320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 --2- 172.21.15.133:0/2010642566 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680cd050 0x7feb681463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 >> 172.21.15.133:0/2010642566 conn(0x7feb68069ca0 msgr2=0x7feb680b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 shutdown_connections 2023-12-18T10:18:51.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.381+0000 7feb6d666640 1 -- 172.21.15.133:0/2010642566 wait complete. 2023-12-18T10:18:51.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:51.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.541+0000 7fb24797b640 1 Processor -- start 2023-12-18T10:18:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb24797b640 1 -- start start 2023-12-18T10:18:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb24797b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb24797b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb240070820 0x7fb2400ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb24797b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2400c9390 con 0x7fb2400ce3b0 2023-12-18T10:18:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb24797b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24015aee0 con 0x7fb240070820 2023-12-18T10:18:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb24797b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24015b1c0 con 0x7fb2401582d0 2023-12-18T10:18:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb245f18640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb2400ce3b0 0x7fb2400cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48274/0 (socket says 172.21.15.133:48274) 2023-12-18T10:18:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb245f18640 1 -- 172.21.15.133:0/1592227985 learned_addr learned my addr 172.21.15.133:0/1592227985 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb244f16640 1 --2- 172.21.15.133:0/1592227985 >> v2:172.21.15.142:3300/0 conn(0x7fb240070820 0x7fb2400ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb245717640 1 --2- 172.21.15.133:0/1592227985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb237fff640 1 -- 172.21.15.133:0/1592227985 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907770312 0 0) 0x7fb2400c9390 con 0x7fb2400ce3b0 2023-12-18T10:18:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb237fff640 1 -- 172.21.15.133:0/1592227985 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb22c003530 con 0x7fb2400ce3b0 2023-12-18T10:18:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb244f16640 1 -- 172.21.15.133:0/1592227985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 msgr2=0x7fb2400c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb244f16640 1 --2- 172.21.15.133:0/1592227985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb244f16640 1 -- 172.21.15.133:0/1592227985 >> v1:172.21.15.133:6789/0 conn(0x7fb2400ce3b0 legacy=0x7fb2400cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.545+0000 7fb244f16640 1 -- 172.21.15.133:0/1592227985 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24015b4a0 con 0x7fb240070820 2023-12-18T10:18:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb244f16640 1 --2- 172.21.15.133:0/1592227985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 0x7fb2400ca5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097c0 tx=0x7fb23001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89468cb148659684 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb237fff640 1 -- 172.21.15.133:0/1592227985 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300ab670 con 0x7fb240070820 2023-12-18T10:18:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb237fff640 1 -- 172.21.15.133:0/1592227985 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300ab7d0 con 0x7fb240070820 2023-12-18T10:18:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb237fff640 1 -- 172.21.15.133:0/1592227985 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300abb60 con 0x7fb240070820 2023-12-18T10:18:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb24797b640 1 -- 172.21.15.133:0/1592227985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 msgr2=0x7fb2400ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb24797b640 1 --2- 172.21.15.133:0/1592227985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 0x7fb2400ca5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097c0 tx=0x7fb23001c450 comp rx=0 tx=0).stop 2023-12-18T10:18:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb24797b640 1 -- 172.21.15.133:0/1592227985 shutdown_connections 2023-12-18T10:18:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb24797b640 1 --2- 172.21.15.133:0/1592227985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 0x7fb2400ca5f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb24797b640 1 --2- 172.21.15.133:0/1592227985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb24797b640 1 -- 172.21.15.133:0/1592227985 >> 172.21.15.133:0/1592227985 conn(0x7fb24006a2a0 msgr2=0x7fb2400aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb24797b640 1 -- 172.21.15.133:0/1592227985 shutdown_connections 2023-12-18T10:18:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.549+0000 7fb24797b640 1 -- 172.21.15.133:0/1592227985 wait complete. 2023-12-18T10:18:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 Processor -- start 2023-12-18T10:18:51.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 -- start start 2023-12-18T10:18:51.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 0x7fb240153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2400ce3b0 0x7fb2400b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240153fd0 con 0x7fb2400ce3b0 2023-12-18T10:18:51.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400b3180 con 0x7fb240070820 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400b3460 con 0x7fb2401582d0 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2400ce3b0 0x7fb2400b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2400ce3b0 0x7fb2400b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51758/0 (socket says 172.21.15.133:51758) 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 -- 172.21.15.133:0/745300448 learned_addr learned my addr 172.21.15.133:0/745300448 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb245717640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 0x7fb240153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 -- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 msgr2=0x7fb2400b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb245f18640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 -- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 msgr2=0x7fb240153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 0x7fb240153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 -- 172.21.15.133:0/745300448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230009420 con 0x7fb2400ce3b0 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb245717640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 0x7fb240153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:51.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb245f18640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb244f16640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2400ce3b0 0x7fb2400b26e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2300ad040 tx=0x7fb23001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb235ffb640 1 -- 172.21.15.133:0/745300448 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300bf610 con 0x7fb2400ce3b0 2023-12-18T10:18:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb235ffb640 1 -- 172.21.15.133:0/745300448 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300bf770 con 0x7fb2400ce3b0 2023-12-18T10:18:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2400b3740 con 0x7fb2400ce3b0 2023-12-18T10:18:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb235ffb640 1 -- 172.21.15.133:0/745300448 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300bfb20 con 0x7fb2400ce3b0 2023-12-18T10:18:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2400c81a0 con 0x7fb2400ce3b0 2023-12-18T10:18:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.553+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24004e000 con 0x7fb2400ce3b0 2023-12-18T10:18:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.557+0000 7fb235ffb640 1 -- 172.21.15.133:0/745300448 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb2300bfc80 con 0x7fb2400ce3b0 2023-12-18T10:18:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.557+0000 7fb235ffb640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb224065a60 0x7fb224067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.557+0000 7fb235ffb640 1 -- 172.21.15.133:0/745300448 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb23011e050 con 0x7fb2400ce3b0 2023-12-18T10:18:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.557+0000 7fb245717640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb224065a60 0x7fb224067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.557+0000 7fb245717640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb224065a60 0x7fb224067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009a40 tx=0x7fb23c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.561+0000 7fb235ffb640 1 -- 172.21.15.133:0/745300448 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb2300eb520 con 0x7fb2400ce3b0 2023-12-18T10:18:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2400b35a0 con 0x7fb2400ce3b0 2023-12-18T10:18:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb235ffb640 1 -- 172.21.15.133:0/745300448 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2400b35a0 con 0x7fb2400ce3b0 2023-12-18T10:18:51.716 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb224065a60 msgr2=0x7fb224067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb224065a60 0x7fb224067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009a40 tx=0x7fb23c008040 comp rx=0 tx=0).stop 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2400ce3b0 msgr2=0x7fb2400b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2400ce3b0 0x7fb2400b26e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2300ad040 tx=0x7fb23001ac90 comp rx=0 tx=0).stop 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 shutdown_connections 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb224065a60 0x7fb224067f20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2401582d0 0x7fb2400b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2400ce3b0 0x7fb2400b26e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 --2- 172.21.15.133:0/745300448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb240070820 0x7fb240153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 >> 172.21.15.133:0/745300448 conn(0x7fb24006a2a0 msgr2=0x7fb240157840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 shutdown_connections 2023-12-18T10:18:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.713+0000 7fb24797b640 1 -- 172.21.15.133:0/745300448 wait complete. 2023-12-18T10:18:51.736 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.873+0000 7f2fc27a2640 1 Processor -- start 2023-12-18T10:18:51.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.873+0000 7f2fc27a2640 1 -- start start 2023-12-18T10:18:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.873+0000 7f2fc27a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2fbc0cb3e0 0x7f2fbc15b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.873+0000 7f2fc27a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0b61f0 con 0x7f2fbc0cb000 2023-12-18T10:18:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.873+0000 7f2fc27a2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc15ee70 con 0x7f2fbc0ccbc0 2023-12-18T10:18:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.873+0000 7f2fc27a2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc15f150 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.873+0000 7f2fc17a0640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2fbc0cb000 0x7f2fbc15e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48288/0 (socket says 172.21.15.133:48288) 2023-12-18T10:18:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.873+0000 7f2fc17a0640 1 -- 172.21.15.133:0/1490757364 learned_addr learned my addr 172.21.15.133:0/1490757364 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fc0f9f640 1 --2- 172.21.15.133:0/1490757364 >> v2:172.21.15.142:3300/0 conn(0x7f2fbc0cb3e0 0x7f2fbc15b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fb3fff640 1 -- 172.21.15.133:0/1490757364 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869921738 0 0) 0x7f2fbc0b61f0 con 0x7f2fbc0cb000 2023-12-18T10:18:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fb3fff640 1 -- 172.21.15.133:0/1490757364 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa8003530 con 0x7f2fbc0cb000 2023-12-18T10:18:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fb3fff640 1 -- 172.21.15.133:0/1490757364 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536204374 0 0) 0x7f2fbc15ee70 con 0x7f2fbc0ccbc0 2023-12-18T10:18:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fb3fff640 1 -- 172.21.15.133:0/1490757364 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fbc0b61f0 con 0x7f2fbc0ccbc0 2023-12-18T10:18:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fc0f9f640 1 -- 172.21.15.133:0/1490757364 >> v1:172.21.15.142:6789/0 conn(0x7f2fbc0ccbc0 legacy=0x7f2fbc0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fc0f9f640 1 -- 172.21.15.133:0/1490757364 >> v1:172.21.15.133:6789/0 conn(0x7f2fbc0cb000 legacy=0x7f2fbc15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fc0f9f640 1 -- 172.21.15.133:0/1490757364 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc15b0f0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fc0f9f640 1 --2- 172.21.15.133:0/1490757364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc15b8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0097c0 tx=0x7f2fac01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f5f7ff03013d153 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fb3fff640 1 -- 172.21.15.133:0/1490757364 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0ab5f0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fb3fff640 1 -- 172.21.15.133:0/1490757364 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0ab750 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.877+0000 7f2fb3fff640 1 -- 172.21.15.133:0/1490757364 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0abac0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- 172.21.15.133:0/1490757364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0cb3e0 msgr2=0x7f2fbc15b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 --2- 172.21.15.133:0/1490757364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc15b8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0097c0 tx=0x7f2fac01c450 comp rx=0 tx=0).stop 2023-12-18T10:18:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- 172.21.15.133:0/1490757364 shutdown_connections 2023-12-18T10:18:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 --2- 172.21.15.133:0/1490757364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc15b8f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- 172.21.15.133:0/1490757364 >> 172.21.15.133:0/1490757364 conn(0x7f2fbc069ca0 msgr2=0x7f2fbc06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- 172.21.15.133:0/1490757364 shutdown_connections 2023-12-18T10:18:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- 172.21.15.133:0/1490757364 wait complete. 2023-12-18T10:18:51.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 Processor -- start 2023-12-18T10:18:51.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- start start 2023-12-18T10:18:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fbc0cb000 0x7f2fbc0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0ccbc0 0x7f2fbc153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc153920 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c61b0 con 0x7f2fbc0ccbc0 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc27a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc152d10 con 0x7f2fbc0cb000 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc0f9f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc0f9f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51768/0 (socket says 172.21.15.133:51768) 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc0f9f640 1 -- 172.21.15.133:0/305920202 learned_addr learned my addr 172.21.15.133:0/305920202 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc17a0640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fbc0cb000 0x7f2fbc0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.881+0000 7f2fc1fa1640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0ccbc0 0x7f2fbc153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc0f9f640 1 -- 172.21.15.133:0/305920202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fbc0cb000 msgr2=0x7f2fbc0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc0f9f640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fbc0cb000 0x7f2fbc0c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc0f9f640 1 -- 172.21.15.133:0/305920202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0ccbc0 msgr2=0x7f2fbc153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc0f9f640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0ccbc0 0x7f2fbc153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc0f9f640 1 -- 172.21.15.133:0/305920202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac009420 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc0f9f640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc152230 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fac000c10 tx=0x7f2fac0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/305920202 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac004440 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/305920202 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0ab8c0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc15ec40 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/305920202 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0abc30 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc1532d0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc153ad0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/305920202 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fac003620 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fb1ffb640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fa0065a60 0x7f2fa0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.885+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/305920202 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2fac0a8050 con 0x7f2fbc0cb3e0 2023-12-18T10:18:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.889+0000 7f2fc17a0640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fa0065a60 0x7f2fa0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:51.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.889+0000 7f2fc17a0640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fa0065a60 0x7f2fa0067f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8000f70 tx=0x7f2fb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:51.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:51.889+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/305920202 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2fbc153ad0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fbc153ad0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:52.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/305920202 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2fbc153ad0 con 0x7f2fbc0cb3e0 2023-12-18T10:18:52.044 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fa0065a60 msgr2=0x7f2fa0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fa0065a60 0x7f2fa0067f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8000f70 tx=0x7f2fb8009040 comp rx=0 tx=0).stop 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0cb3e0 msgr2=0x7f2fbc152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc152230 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fac000c10 tx=0x7f2fac0191f0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 shutdown_connections 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fa0065a60 0x7f2fa0067f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fbc0ccbc0 0x7f2fbc153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0cb3e0 0x7f2fbc152230 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 --2- 172.21.15.133:0/305920202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fbc0cb000 0x7f2fbc0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 >> 172.21.15.133:0/305920202 conn(0x7f2fbc069ca0 msgr2=0x7f2fbc0ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:52.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 shutdown_connections 2023-12-18T10:18:52.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.041+0000 7f2fc27a2640 1 -- 172.21.15.133:0/305920202 wait complete. 2023-12-18T10:18:52.064 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:52.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.201+0000 7efe9bb18640 1 Processor -- start 2023-12-18T10:18:52.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.201+0000 7efe9bb18640 1 -- start start 2023-12-18T10:18:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.201+0000 7efe9bb18640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe940c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.201+0000 7efe9bb18640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe940c9390 con 0x7efe941582d0 2023-12-18T10:18:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.201+0000 7efe9bb18640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9415aee0 con 0x7efe94070820 2023-12-18T10:18:52.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.201+0000 7efe9bb18640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9415b1c0 con 0x7efe940ceac0 2023-12-18T10:18:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.201+0000 7efe998b4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efe941582d0 0x7efe940ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48298/0 (socket says 172.21.15.133:48298) 2023-12-18T10:18:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.201+0000 7efe998b4640 1 -- 172.21.15.133:0/3596245779 learned_addr learned my addr 172.21.15.133:0/3596245779 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe9a0b5640 1 --2- 172.21.15.133:0/3596245779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe940c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe988b2640 1 -- 172.21.15.133:0/3596245779 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031803919 0 0) 0x7efe940c9390 con 0x7efe941582d0 2023-12-18T10:18:52.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe988b2640 1 -- 172.21.15.133:0/3596245779 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe80003530 con 0x7efe941582d0 2023-12-18T10:18:52.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe988b2640 1 -- 172.21.15.133:0/3596245779 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691068137 0 0) 0x7efe9415aee0 con 0x7efe94070820 2023-12-18T10:18:52.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe988b2640 1 -- 172.21.15.133:0/3596245779 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe940c9390 con 0x7efe94070820 2023-12-18T10:18:52.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe9a0b5640 1 -- 172.21.15.133:0/3596245779 >> v1:172.21.15.142:6789/0 conn(0x7efe94070820 legacy=0x7efe940ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe9a0b5640 1 -- 172.21.15.133:0/3596245779 >> v1:172.21.15.133:6789/0 conn(0x7efe941582d0 legacy=0x7efe940ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe9a0b5640 1 -- 172.21.15.133:0/3596245779 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9415b4a0 con 0x7efe940ceac0 2023-12-18T10:18:52.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe9a0b5640 1 --2- 172.21.15.133:0/3596245779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe940c8e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009dc0 tx=0x7efe8c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffac787b2985de98 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe988b2640 1 -- 172.21.15.133:0/3596245779 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c0a5a20 con 0x7efe940ceac0 2023-12-18T10:18:52.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe988b2640 1 -- 172.21.15.133:0/3596245779 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c0a5b80 con 0x7efe940ceac0 2023-12-18T10:18:52.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.205+0000 7efe988b2640 1 -- 172.21.15.133:0/3596245779 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c0ad440 con 0x7efe940ceac0 2023-12-18T10:18:52.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- 172.21.15.133:0/3596245779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 msgr2=0x7efe940c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 --2- 172.21.15.133:0/3596245779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe940c8e50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009dc0 tx=0x7efe8c01c940 comp rx=0 tx=0).stop 2023-12-18T10:18:52.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- 172.21.15.133:0/3596245779 shutdown_connections 2023-12-18T10:18:52.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 --2- 172.21.15.133:0/3596245779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe940c8e50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- 172.21.15.133:0/3596245779 >> 172.21.15.133:0/3596245779 conn(0x7efe9406a2a0 msgr2=0x7efe940aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- 172.21.15.133:0/3596245779 shutdown_connections 2023-12-18T10:18:52.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- 172.21.15.133:0/3596245779 wait complete. 2023-12-18T10:18:52.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 Processor -- start 2023-12-18T10:18:52.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- start start 2023-12-18T10:18:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe94070820 0x7efe940ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe94152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe941582d0 0x7efe940af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940cbff0 con 0x7efe94070820 2023-12-18T10:18:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940cc800 con 0x7efe941582d0 2023-12-18T10:18:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9bb18640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe940ac7f0 con 0x7efe940ceac0 2023-12-18T10:18:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe998b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe94070820 0x7efe940ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe998b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe94070820 0x7efe940ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51776/0 (socket says 172.21.15.133:51776) 2023-12-18T10:18:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe998b4640 1 -- 172.21.15.133:0/573393806 learned_addr learned my addr 172.21.15.133:0/573393806 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe990b3640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe94152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.209+0000 7efe9a0b5640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe941582d0 0x7efe940af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe998b4640 1 -- 172.21.15.133:0/573393806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 msgr2=0x7efe94152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe998b4640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe94152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe998b4640 1 -- 172.21.15.133:0/573393806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe941582d0 msgr2=0x7efe940af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe998b4640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe941582d0 0x7efe940af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe998b4640 1 -- 172.21.15.133:0/573393806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c009a70 con 0x7efe94070820 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe998b4640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe94070820 0x7efe940ac2b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c420 tx=0x7efe9000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe8a7fc640 1 -- 172.21.15.133:0/573393806 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90005cf0 con 0x7efe94070820 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe8a7fc640 1 -- 172.21.15.133:0/573393806 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90005e50 con 0x7efe94070820 2023-12-18T10:18:52.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe940cc240 con 0x7efe94070820 2023-12-18T10:18:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe8a7fc640 1 -- 172.21.15.133:0/573393806 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900072d0 con 0x7efe94070820 2023-12-18T10:18:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe940c30d0 con 0x7efe94070820 2023-12-18T10:18:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9404e000 con 0x7efe94070820 2023-12-18T10:18:52.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe8a7fc640 1 -- 172.21.15.133:0/573393806 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efe90007430 con 0x7efe94070820 2023-12-18T10:18:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe8a7fc640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efe78065a60 0x7efe78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe8a7fc640 1 -- 172.21.15.133:0/573393806 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efe90082ac0 con 0x7efe94070820 2023-12-18T10:18:52.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.213+0000 7efe990b3640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efe78065a60 0x7efe78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.217+0000 7efe990b3640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efe78065a60 0x7efe78067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe940ce4f0 tx=0x7efe84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.217+0000 7efe8a7fc640 1 -- 172.21.15.133:0/573393806 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efe90050160 con 0x7efe94070820 2023-12-18T10:18:52.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.369+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe940b0c00 con 0x7efe94070820 2023-12-18T10:18:52.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.369+0000 7efe8a7fc640 1 -- 172.21.15.133:0/573393806 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe900170a0 con 0x7efe94070820 2023-12-18T10:18:52.374 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efe78065a60 msgr2=0x7efe78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efe78065a60 0x7efe78067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe940ce4f0 tx=0x7efe84009040 comp rx=0 tx=0).stop 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe94070820 msgr2=0x7efe940ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe94070820 0x7efe940ac2b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c420 tx=0x7efe9000c8e0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 shutdown_connections 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efe78065a60 0x7efe78067f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efe941582d0 0x7efe940af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efe940ceac0 0x7efe94152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 --2- 172.21.15.133:0/573393806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe94070820 0x7efe940ac2b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 >> 172.21.15.133:0/573393806 conn(0x7efe9406a2a0 msgr2=0x7efe940ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 shutdown_connections 2023-12-18T10:18:52.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.373+0000 7efe9bb18640 1 -- 172.21.15.133:0/573393806 wait complete. 2023-12-18T10:18:52.395 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:52.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea56af0640 1 Processor -- start 2023-12-18T10:18:52.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea56af0640 1 -- start start 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea56af0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea500b0460 0x7fea5015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea56af0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea5015aa10 0x7fea5015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea56af0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5015e000 con 0x7fea5006fc80 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea56af0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5015e5c0 con 0x7fea5015aa10 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea56af0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5015b4d0 con 0x7fea500b0460 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea562ef640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fea5006fc80 0x7fea500c87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48300/0 (socket says 172.21.15.133:48300) 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea562ef640 1 -- 172.21.15.133:0/3169426818 learned_addr learned my addr 172.21.15.133:0/3169426818 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea552ed640 1 --2- 172.21.15.133:0/3169426818 >> v2:172.21.15.142:3300/0 conn(0x7fea5015aa10 0x7fea5015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea55aee640 1 --2- 172.21.15.133:0/3169426818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea500b0460 0x7fea5015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.533+0000 7fea54aec640 1 -- 172.21.15.133:0/3169426818 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469982014 0 0) 0x7fea5015e000 con 0x7fea5006fc80 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea54aec640 1 -- 172.21.15.133:0/3169426818 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea3c003530 con 0x7fea5006fc80 2023-12-18T10:18:52.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea54aec640 1 -- 172.21.15.133:0/3169426818 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3141083982 0 0) 0x7fea3c003530 con 0x7fea5006fc80 2023-12-18T10:18:52.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea552ed640 1 -- 172.21.15.133:0/3169426818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea500b0460 msgr2=0x7fea5015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:52.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea552ed640 1 --2- 172.21.15.133:0/3169426818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea500b0460 0x7fea5015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea552ed640 1 -- 172.21.15.133:0/3169426818 >> v1:172.21.15.133:6789/0 conn(0x7fea5006fc80 legacy=0x7fea500c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea552ed640 1 -- 172.21.15.133:0/3169426818 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5015b7b0 con 0x7fea5015aa10 2023-12-18T10:18:52.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea552ed640 1 --2- 172.21.15.133:0/3169426818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5015aa10 0x7fea5015ae90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea400097c0 tx=0x7fea4001c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=206cd5cf10df5f65 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea54aec640 1 -- 172.21.15.133:0/3169426818 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48001a00 con 0x7fea5015aa10 2023-12-18T10:18:52.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea54aec640 1 -- 172.21.15.133:0/3169426818 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea400a7050 con 0x7fea5015aa10 2023-12-18T10:18:52.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.537+0000 7fea54aec640 1 -- 172.21.15.133:0/3169426818 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea400ab620 con 0x7fea5015aa10 2023-12-18T10:18:52.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- 172.21.15.133:0/3169426818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5015aa10 msgr2=0x7fea5015ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 --2- 172.21.15.133:0/3169426818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5015aa10 0x7fea5015ae90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea400097c0 tx=0x7fea4001c2e0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- 172.21.15.133:0/3169426818 shutdown_connections 2023-12-18T10:18:52.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 --2- 172.21.15.133:0/3169426818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea5015aa10 0x7fea5015ae90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 --2- 172.21.15.133:0/3169426818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea500b0460 0x7fea5015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- 172.21.15.133:0/3169426818 >> 172.21.15.133:0/3169426818 conn(0x7fea5006a2a0 msgr2=0x7fea500cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:52.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- 172.21.15.133:0/3169426818 shutdown_connections 2023-12-18T10:18:52.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- 172.21.15.133:0/3169426818 wait complete. 2023-12-18T10:18:52.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 Processor -- start 2023-12-18T10:18:52.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- start start 2023-12-18T10:18:52.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea5006fc80 0x7fea500c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea500b0460 0x7fea5006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea5015aa10 0x7fea5006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5014efa0 con 0x7fea5006fc80 2023-12-18T10:18:52.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501480a0 con 0x7fea500b0460 2023-12-18T10:18:52.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea56af0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea500c2870 con 0x7fea5015aa10 2023-12-18T10:18:52.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea55aee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea5006fc80 0x7fea500c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea55aee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea5006fc80 0x7fea500c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51780/0 (socket says 172.21.15.133:51780) 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea55aee640 1 -- 172.21.15.133:0/1930123476 learned_addr learned my addr 172.21.15.133:0/1930123476 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea55aee640 1 -- 172.21.15.133:0/1930123476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea5015aa10 msgr2=0x7fea5006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea55aee640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea5015aa10 0x7fea5006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea55aee640 1 -- 172.21.15.133:0/1930123476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea500b0460 msgr2=0x7fea5006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea552ed640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea500b0460 0x7fea5006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea55aee640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea500b0460 0x7fea5006bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea55aee640 1 -- 172.21.15.133:0/1930123476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40009420 con 0x7fea5006fc80 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.541+0000 7fea552ed640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea500b0460 0x7fea5006bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:52.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea55aee640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea5006fc80 0x7fea500c45e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00e930 tx=0x7fea4c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea467fc640 1 -- 172.21.15.133:0/1930123476 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c009690 con 0x7fea5006fc80 2023-12-18T10:18:52.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea467fc640 1 -- 172.21.15.133:0/1930123476 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00ca00 con 0x7fea5006fc80 2023-12-18T10:18:52.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea467fc640 1 -- 172.21.15.133:0/1930123476 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00cd70 con 0x7fea5006fc80 2023-12-18T10:18:52.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea500c2b50 con 0x7fea5006fc80 2023-12-18T10:18:52.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea500c3110 con 0x7fea5006fc80 2023-12-18T10:18:52.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5004e850 con 0x7fea5006fc80 2023-12-18T10:18:52.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea467fc640 1 -- 172.21.15.133:0/1930123476 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea4c013470 con 0x7fea5006fc80 2023-12-18T10:18:52.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea467fc640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea34065a60 0x7fea34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea467fc640 1 -- 172.21.15.133:0/1930123476 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fea4c083850 con 0x7fea5006fc80 2023-12-18T10:18:52.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.545+0000 7fea552ed640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea34065a60 0x7fea34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.549+0000 7fea552ed640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea34065a60 0x7fea34067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea400ad000 tx=0x7fea40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.549+0000 7fea467fc640 1 -- 172.21.15.133:0/1930123476 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fea4c050f00 con 0x7fea5006fc80 2023-12-18T10:18:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.697+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fea500cb770 con 0x7fea5006fc80 2023-12-18T10:18:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.697+0000 7fea467fc640 1 -- 172.21.15.133:0/1930123476 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fea4c054520 con 0x7fea5006fc80 2023-12-18T10:18:52.702 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea34065a60 msgr2=0x7fea34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea34065a60 0x7fea34067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea400ad000 tx=0x7fea40008040 comp rx=0 tx=0).stop 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea5006fc80 msgr2=0x7fea500c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea5006fc80 0x7fea500c45e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00e930 tx=0x7fea4c00edf0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 shutdown_connections 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea34065a60 0x7fea34067f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea5015aa10 0x7fea5006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea500b0460 0x7fea5006bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 --2- 172.21.15.133:0/1930123476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea5006fc80 0x7fea500c45e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 >> 172.21.15.133:0/1930123476 conn(0x7fea5006a2a0 msgr2=0x7fea501545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:52.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 shutdown_connections 2023-12-18T10:18:52.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.701+0000 7fea56af0640 1 -- 172.21.15.133:0/1930123476 wait complete. 2023-12-18T10:18:52.724 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:52.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.857+0000 7f0049d8e640 1 Processor -- start 2023-12-18T10:18:52.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.857+0000 7f0049d8e640 1 -- start start 2023-12-18T10:18:52.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.857+0000 7f0049d8e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0049d8e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f004406fb60 0x7f004406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0049d8e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00440cbc70 con 0x7f00440cc6c0 2023-12-18T10:18:52.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0049d8e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00440b0630 con 0x7f004406fb60 2023-12-18T10:18:52.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0049d8e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440c3bb0 con 0x7f00440afd10 2023-12-18T10:18:52.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f004958d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f00440cc6c0 0x7f00440c2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48302/0 (socket says 172.21.15.133:48302) 2023-12-18T10:18:52.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f004958d640 1 -- 172.21.15.133:0/3666304233 learned_addr learned my addr 172.21.15.133:0/3666304233 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:52.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0043fff640 1 --2- 172.21.15.133:0/3666304233 >> v2:172.21.15.142:3300/0 conn(0x7f004406fb60 0x7f004406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0048d8c640 1 --2- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f00437fe640 1 -- 172.21.15.133:0/3666304233 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016849225 0 0) 0x7f00440cbc70 con 0x7f00440cc6c0 2023-12-18T10:18:52.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f00437fe640 1 -- 172.21.15.133:0/3666304233 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0034003530 con 0x7f00440cc6c0 2023-12-18T10:18:52.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0043fff640 1 -- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 msgr2=0x7f00440b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:52.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0043fff640 1 --2- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0043fff640 1 -- 172.21.15.133:0/3666304233 >> v1:172.21.15.133:6789/0 conn(0x7f00440cc6c0 legacy=0x7f00440c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f00437fe640 1 -- 172.21.15.133:0/3666304233 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537333314 0 0) 0x7f0034003530 con 0x7f00440cc6c0 2023-12-18T10:18:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0043fff640 1 -- 172.21.15.133:0/3666304233 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440c3e90 con 0x7f004406fb60 2023-12-18T10:18:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.861+0000 7f0048d8c640 1 --2- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0043fff640 1 --2- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004406fb60 0x7f004406ffe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00300097c0 tx=0x7f003001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76efaae785bd9fa9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f00437fe640 1 -- 172.21.15.133:0/3666304233 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c001a00 con 0x7f004406fb60 2023-12-18T10:18:52.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f00437fe640 1 -- 172.21.15.133:0/3666304233 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00300a7050 con 0x7f004406fb60 2023-12-18T10:18:52.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f00437fe640 1 -- 172.21.15.133:0/3666304233 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00300ab620 con 0x7f004406fb60 2023-12-18T10:18:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 -- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004406fb60 msgr2=0x7f004406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 --2- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004406fb60 0x7f004406ffe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00300097c0 tx=0x7f003001c370 comp rx=0 tx=0).stop 2023-12-18T10:18:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 -- 172.21.15.133:0/3666304233 shutdown_connections 2023-12-18T10:18:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 --2- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f004406fb60 0x7f004406ffe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 --2- 172.21.15.133:0/3666304233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 -- 172.21.15.133:0/3666304233 >> 172.21.15.133:0/3666304233 conn(0x7f00440ce130 msgr2=0x7f00440ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 -- 172.21.15.133:0/3666304233 shutdown_connections 2023-12-18T10:18:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 -- 172.21.15.133:0/3666304233 wait complete. 2023-12-18T10:18:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 Processor -- start 2023-12-18T10:18:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 -- start start 2023-12-18T10:18:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f004406fb60 0x7f0044157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00440cc6c0 0x7f00440c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.865+0000 7f0049d8e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044158080 con 0x7f004406fb60 2023-12-18T10:18:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0049d8e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044158360 con 0x7f00440cc6c0 2023-12-18T10:18:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0049d8e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0044158640 con 0x7f00440afd10 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f004406fb60 0x7f0044157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f004406fb60 0x7f0044157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51784/0 (socket says 172.21.15.133:51784) 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 -- 172.21.15.133:0/4191333854 learned_addr learned my addr 172.21.15.133:0/4191333854 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f004958d640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00440cc6c0 0x7f00440c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0043fff640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 -- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 msgr2=0x7f00440c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 -- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00440cc6c0 msgr2=0x7f00440c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00440cc6c0 0x7f00440c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 -- 172.21.15.133:0/4191333854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038009420 con 0x7f004406fb60 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f004958d640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00440cc6c0 0x7f00440c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0048d8c640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f004406fb60 0x7f0044157790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f003800ebe0 tx=0x7f003800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f00417fa640 1 -- 172.21.15.133:0/4191333854 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800eee0 con 0x7f004406fb60 2023-12-18T10:18:52.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f00417fa640 1 -- 172.21.15.133:0/4191333854 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800cc30 con 0x7f004406fb60 2023-12-18T10:18:52.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0030009420 con 0x7f004406fb60 2023-12-18T10:18:52.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f00417fa640 1 -- 172.21.15.133:0/4191333854 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038013470 con 0x7f004406fb60 2023-12-18T10:18:52.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0044158c00 con 0x7f004406fb60 2023-12-18T10:18:52.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004404e850 con 0x7f004406fb60 2023-12-18T10:18:52.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.869+0000 7f00417fa640 1 -- 172.21.15.133:0/4191333854 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f00380135d0 con 0x7f004406fb60 2023-12-18T10:18:52.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.873+0000 7f00417fa640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0028065a60 0x7f0028067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.873+0000 7f00417fa640 1 -- 172.21.15.133:0/4191333854 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00380838f0 con 0x7f004406fb60 2023-12-18T10:18:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.873+0000 7f0043fff640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0028065a60 0x7f0028067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.873+0000 7f0043fff640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0028065a60 0x7f0028067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00300ad000 tx=0x7f00300a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:52.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:52.877+0000 7f00417fa640 1 -- 172.21.15.133:0/4191333854 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0038050e70 con 0x7f004406fb60 2023-12-18T10:18:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.029+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00440c8940 con 0x7f004406fb60 2023-12-18T10:18:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.029+0000 7f00417fa640 1 -- 172.21.15.133:0/4191333854 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f0038054490 con 0x7f004406fb60 2023-12-18T10:18:53.033 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:53.033 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.029+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0028065a60 msgr2=0x7f0028067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.029+0000 7f0049d8e640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0028065a60 0x7f0028067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00300ad000 tx=0x7f00300a6000 comp rx=0 tx=0).stop 2023-12-18T10:18:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.029+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f004406fb60 msgr2=0x7f0044157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.029+0000 7f0049d8e640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f004406fb60 0x7f0044157790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f003800ebe0 tx=0x7f003800c520 comp rx=0 tx=0).stop 2023-12-18T10:18:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.033+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 shutdown_connections 2023-12-18T10:18:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.033+0000 7f0049d8e640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0028065a60 0x7f0028067f20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.033+0000 7f0049d8e640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00440cc6c0 0x7f00440c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.033+0000 7f0049d8e640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00440afd10 0x7f00440c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.033+0000 7f0049d8e640 1 --2- 172.21.15.133:0/4191333854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f004406fb60 0x7f0044157790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.033+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 >> 172.21.15.133:0/4191333854 conn(0x7f00440ce130 msgr2=0x7f004415bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.033+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 shutdown_connections 2023-12-18T10:18:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.033+0000 7f0049d8e640 1 -- 172.21.15.133:0/4191333854 wait complete. 2023-12-18T10:18:53.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:53.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:53.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c308c640 1 Processor -- start 2023-12-18T10:18:53.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c308c640 1 -- start start 2023-12-18T10:18:53.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c308c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0ca410 0x7fd3bc159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c308c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3bc0cbff0 0x7fd3bc0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c308c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc070df0 con 0x7fd3bc159fb0 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c308c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc15aab0 con 0x7fd3bc0cbff0 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c308c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0cc980 con 0x7fd3bc0ca410 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c1629640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3bc0cbff0 0x7fd3bc0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c1629640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3bc0cbff0 0x7fd3bc0cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51794/0 (socket says 172.21.15.133:51794) 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c1629640 1 -- 172.21.15.133:0/3501960497 learned_addr learned my addr 172.21.15.133:0/3501960497 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c0e28640 1 --2- 172.21.15.133:0/3501960497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0ca410 0x7fd3bc159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c1629640 1 -- 172.21.15.133:0/3501960497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0ca410 msgr2=0x7fd3bc159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c1629640 1 --2- 172.21.15.133:0/3501960497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0ca410 0x7fd3bc159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c1629640 1 -- 172.21.15.133:0/3501960497 >> v1:172.21.15.142:6789/0 conn(0x7fd3bc159fb0 legacy=0x7fd3bc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.193+0000 7fd3c1629640 1 -- 172.21.15.133:0/3501960497 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc15a4f0 con 0x7fd3bc0cbff0 2023-12-18T10:18:53.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c1629640 1 --2- 172.21.15.133:0/3501960497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0cbff0 0x7fd3bc0cc440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009e50 tx=0x7fd3b401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fad824b11d4bee2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3b37fe640 1 -- 172.21.15.133:0/3501960497 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40a7ac0 con 0x7fd3bc0cbff0 2023-12-18T10:18:53.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3b37fe640 1 -- 172.21.15.133:0/3501960497 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b40a7c20 con 0x7fd3bc0cbff0 2023-12-18T10:18:53.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3b37fe640 1 -- 172.21.15.133:0/3501960497 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40af3f0 con 0x7fd3bc0cbff0 2023-12-18T10:18:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c308c640 1 -- 172.21.15.133:0/3501960497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0cbff0 msgr2=0x7fd3bc0cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c308c640 1 --2- 172.21.15.133:0/3501960497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0cbff0 0x7fd3bc0cc440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009e50 tx=0x7fd3b401ebf0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c308c640 1 -- 172.21.15.133:0/3501960497 shutdown_connections 2023-12-18T10:18:53.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c308c640 1 --2- 172.21.15.133:0/3501960497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0cbff0 0x7fd3bc0cc440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c308c640 1 --2- 172.21.15.133:0/3501960497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0ca410 0x7fd3bc159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c308c640 1 -- 172.21.15.133:0/3501960497 >> 172.21.15.133:0/3501960497 conn(0x7fd3bc06a2a0 msgr2=0x7fd3bc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c308c640 1 -- 172.21.15.133:0/3501960497 shutdown_connections 2023-12-18T10:18:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.197+0000 7fd3c308c640 1 -- 172.21.15.133:0/3501960497 wait complete. 2023-12-18T10:18:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 Processor -- start 2023-12-18T10:18:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 -- start start 2023-12-18T10:18:53.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3bc0ca410 0x7fd3bc0c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0cbff0 0x7fd3bc1f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc159fb0 0x7fd3bc13a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0c3920 con 0x7fd3bc159fb0 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0c2880 con 0x7fd3bc0ca410 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0c2b60 con 0x7fd3bc0cbff0 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc159fb0 0x7fd3bc13a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc159fb0 0x7fd3bc13a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51798/0 (socket says 172.21.15.133:51798) 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 -- 172.21.15.133:0/678355429 learned_addr learned my addr 172.21.15.133:0/678355429 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 -- 172.21.15.133:0/678355429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0cbff0 msgr2=0x7fd3bc1f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0cbff0 0x7fd3bc1f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 -- 172.21.15.133:0/678355429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3bc0ca410 msgr2=0x7fd3bc0c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3bc0ca410 0x7fd3bc0c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 -- 172.21.15.133:0/678355429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b4009b30 con 0x7fd3bc159fb0 2023-12-18T10:18:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c1629640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc159fb0 0x7fd3bc13a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd3b401c820 tx=0x7fd3b401b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3b17fa640 1 -- 172.21.15.133:0/678355429 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40a7ac0 con 0x7fd3bc159fb0 2023-12-18T10:18:53.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3b17fa640 1 -- 172.21.15.133:0/678355429 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4007e80 con 0x7fd3bc159fb0 2023-12-18T10:18:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc0c2e40 con 0x7fd3bc159fb0 2023-12-18T10:18:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3b17fa640 1 -- 172.21.15.133:0/678355429 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40ba6b0 con 0x7fd3bc159fb0 2023-12-18T10:18:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc0c3400 con 0x7fd3bc159fb0 2023-12-18T10:18:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.201+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc0c35f0 con 0x7fd3bc159fb0 2023-12-18T10:18:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.205+0000 7fd3b17fa640 1 -- 172.21.15.133:0/678355429 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd3b40ba810 con 0x7fd3bc159fb0 2023-12-18T10:18:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.205+0000 7fd3b17fa640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd3a8065a60 0x7fd3a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.205+0000 7fd3b17fa640 1 -- 172.21.15.133:0/678355429 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3b41210d0 con 0x7fd3bc159fb0 2023-12-18T10:18:53.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.205+0000 7fd3c0e28640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd3a8065a60 0x7fd3a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.205+0000 7fd3c0e28640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd3a8065a60 0x7fd3a8067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800b850 tx=0x7fd3b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.209+0000 7fd3b17fa640 1 -- 172.21.15.133:0/678355429 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd3b40ee810 con 0x7fd3bc159fb0 2023-12-18T10:18:53.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3bc04e000 con 0x7fd3bc159fb0 2023-12-18T10:18:53.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3b17fa640 1 -- 172.21.15.133:0/678355429 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3b4009510 con 0x7fd3bc159fb0 2023-12-18T10:18:53.367 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:53.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd3a8065a60 msgr2=0x7fd3a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd3a8065a60 0x7fd3a8067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800b850 tx=0x7fd3b8008040 comp rx=0 tx=0).stop 2023-12-18T10:18:53.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc159fb0 msgr2=0x7fd3bc13a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc159fb0 0x7fd3bc13a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd3b401c820 tx=0x7fd3b401b990 comp rx=0 tx=0).stop 2023-12-18T10:18:53.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 shutdown_connections 2023-12-18T10:18:53.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd3a8065a60 0x7fd3a8067f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc159fb0 0x7fd3bc13a7a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3bc0cbff0 0x7fd3bc1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 --2- 172.21.15.133:0/678355429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3bc0ca410 0x7fd3bc0c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 >> 172.21.15.133:0/678355429 conn(0x7fd3bc06a2a0 msgr2=0x7fd3bc0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:53.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 shutdown_connections 2023-12-18T10:18:53.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.365+0000 7fd3c308c640 1 -- 172.21.15.133:0/678355429 wait complete. 2023-12-18T10:18:53.388 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:53.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f52482d1640 1 Processor -- start 2023-12-18T10:18:53.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f52482d1640 1 -- start start 2023-12-18T10:18:53.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f52482d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5240070820 0x7f52400c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f52482d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52400ce3b0 0x7f52400ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f52482d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52400c9390 con 0x7f52401582d0 2023-12-18T10:18:53.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f52482d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52400ced80 con 0x7f5240070820 2023-12-18T10:18:53.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f52482d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524015aee0 con 0x7f52400ce3b0 2023-12-18T10:18:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f524586c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5240070820 0x7f52400c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f524606d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f52401582d0 0x7f52400ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48312/0 (socket says 172.21.15.133:48312) 2023-12-18T10:18:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f524586c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5240070820 0x7f52400c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51800/0 (socket says 172.21.15.133:51800) 2023-12-18T10:18:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f524606d640 1 -- 172.21.15.133:0/1699297847 learned_addr learned my addr 172.21.15.133:0/1699297847 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.525+0000 7f524686e640 1 --2- 172.21.15.133:0/1699297847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52400ce3b0 0x7f52400ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524586c640 1 -- 172.21.15.133:0/1699297847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52400ce3b0 msgr2=0x7f52400ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524586c640 1 --2- 172.21.15.133:0/1699297847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52400ce3b0 0x7f52400ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524506b640 1 -- 172.21.15.133:0/1699297847 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841844392 0 0) 0x7f52400c9390 con 0x7f52401582d0 2023-12-18T10:18:53.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524586c640 1 -- 172.21.15.133:0/1699297847 >> v1:172.21.15.133:6789/0 conn(0x7f52401582d0 legacy=0x7f52400ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524586c640 1 -- 172.21.15.133:0/1699297847 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524015b1c0 con 0x7f5240070820 2023-12-18T10:18:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524586c640 1 --2- 172.21.15.133:0/1699297847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5240070820 0x7f52400c8e50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52300097c0 tx=0x7f523001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdf166276f3addf server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524506b640 1 -- 172.21.15.133:0/1699297847 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300ab650 con 0x7f5240070820 2023-12-18T10:18:53.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524506b640 1 -- 172.21.15.133:0/1699297847 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52300ab7b0 con 0x7f5240070820 2023-12-18T10:18:53.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f524506b640 1 -- 172.21.15.133:0/1699297847 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300abb40 con 0x7f5240070820 2023-12-18T10:18:53.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f52482d1640 1 -- 172.21.15.133:0/1699297847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5240070820 msgr2=0x7f52400c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f52482d1640 1 --2- 172.21.15.133:0/1699297847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5240070820 0x7f52400c8e50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52300097c0 tx=0x7f523001c450 comp rx=0 tx=0).stop 2023-12-18T10:18:53.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f52482d1640 1 -- 172.21.15.133:0/1699297847 shutdown_connections 2023-12-18T10:18:53.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f52482d1640 1 --2- 172.21.15.133:0/1699297847 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52400ce3b0 0x7f52400ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f52482d1640 1 --2- 172.21.15.133:0/1699297847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5240070820 0x7f52400c8e50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.529+0000 7f52482d1640 1 -- 172.21.15.133:0/1699297847 >> 172.21.15.133:0/1699297847 conn(0x7f524006a2a0 msgr2=0x7f52400aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:53.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 -- 172.21.15.133:0/1699297847 shutdown_connections 2023-12-18T10:18:53.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 -- 172.21.15.133:0/1699297847 wait complete. 2023-12-18T10:18:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 Processor -- start 2023-12-18T10:18:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 -- start start 2023-12-18T10:18:53.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5240070820 0x7f52400c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52400ce3b0 0x7f524014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52401582d0 0x7f52400c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400c2200 con 0x7f52401582d0 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52400c5590 con 0x7f52400ce3b0 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400c3060 con 0x7f5240070820 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52401582d0 0x7f52400c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52401582d0 0x7f52400c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51816/0 (socket says 172.21.15.133:51816) 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 -- 172.21.15.133:0/1907685523 learned_addr learned my addr 172.21.15.133:0/1907685523 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524586c640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52400ce3b0 0x7f524014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524606d640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5240070820 0x7f52400c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 -- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5240070820 msgr2=0x7f52400c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5240070820 0x7f52400c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 -- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52400ce3b0 msgr2=0x7f524014f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52400ce3b0 0x7f524014f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 -- 172.21.15.133:0/1907685523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230009420 con 0x7f52401582d0 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524586c640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52400ce3b0 0x7f524014f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524606d640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5240070820 0x7f52400c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f524686e640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52401582d0 0x7f52400c5d50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f523800efc0 tx=0x7f523800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f5236ffd640 1 -- 172.21.15.133:0/1907685523 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238014480 con 0x7f52401582d0 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f5236ffd640 1 -- 172.21.15.133:0/1907685523 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523800f040 con 0x7f52401582d0 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52400c3340 con 0x7f52401582d0 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.533+0000 7f5236ffd640 1 -- 172.21.15.133:0/1907685523 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238014820 con 0x7f52401582d0 2023-12-18T10:18:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.537+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524014f6f0 con 0x7f52401582d0 2023-12-18T10:18:53.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.537+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52400c5a70 con 0x7f52401582d0 2023-12-18T10:18:53.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.537+0000 7f5236ffd640 1 -- 172.21.15.133:0/1907685523 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5238014980 con 0x7f52401582d0 2023-12-18T10:18:53.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.537+0000 7f5236ffd640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5224065a60 0x7f5224067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.537+0000 7f5236ffd640 1 -- 172.21.15.133:0/1907685523 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52380841b0 con 0x7f52401582d0 2023-12-18T10:18:53.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.537+0000 7f524606d640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5224065a60 0x7f5224067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.537+0000 7f524606d640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5224065a60 0x7f5224067f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f523c000f70 tx=0x7f523c007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.541+0000 7f5236ffd640 1 -- 172.21.15.133:0/1907685523 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f52400c5a70 con 0x7f52401582d0 2023-12-18T10:18:53.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.693+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52400c5a70 con 0x7f52401582d0 2023-12-18T10:18:53.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.693+0000 7f5236ffd640 1 -- 172.21.15.133:0/1907685523 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52400c5a70 con 0x7f52401582d0 2023-12-18T10:18:53.698 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:53.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5224065a60 msgr2=0x7f5224067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5224065a60 0x7f5224067f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f523c000f70 tx=0x7f523c007cb0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52401582d0 msgr2=0x7f52400c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52401582d0 0x7f52400c5d50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f523800efc0 tx=0x7f523800c490 comp rx=0 tx=0).stop 2023-12-18T10:18:53.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 shutdown_connections 2023-12-18T10:18:53.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5224065a60 0x7f5224067f20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52401582d0 0x7f52400c5d50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52400ce3b0 0x7f524014f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 --2- 172.21.15.133:0/1907685523 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5240070820 0x7f52400c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 >> 172.21.15.133:0/1907685523 conn(0x7f524006a2a0 msgr2=0x7f52400aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:53.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 shutdown_connections 2023-12-18T10:18:53.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.697+0000 7f52482d1640 1 -- 172.21.15.133:0/1907685523 wait complete. 2023-12-18T10:18:53.719 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1ca66640 1 Processor -- start 2023-12-18T10:18:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1ca66640 1 -- start start 2023-12-18T10:18:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1ca66640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f181582d0 0x7f4f180c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1ca66640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180c9390 con 0x7f4f180ce3b0 2023-12-18T10:18:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1ca66640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1815aee0 con 0x7f4f18070820 2023-12-18T10:18:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1ca66640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1815b1c0 con 0x7f4f181582d0 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f16d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4f180ce3b0 0x7f4f180cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48328/0 (socket says 172.21.15.133:48328) 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f16d9d640 1 -- 172.21.15.133:0/145760748 learned_addr learned my addr 172.21.15.133:0/145760748 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1659c640 1 --2- 172.21.15.133:0/145760748 >> v2:172.21.15.142:3300/0 conn(0x7f4f181582d0 0x7f4f180c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953617592 0 0) 0x7f4f180c9390 con 0x7f4f180ce3b0 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f00003530 con 0x7f4f180ce3b0 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3798955255 0 0) 0x7f4f00003530 con 0x7f4f180ce3b0 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 >> v2:172.21.15.142:3300/0 conn(0x7f4f181582d0 msgr2=0x7f4f180c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 --2- 172.21.15.133:0/145760748 >> v2:172.21.15.142:3300/0 conn(0x7f4f181582d0 0x7f4f180c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 >> v1:172.21.15.142:6789/0 conn(0x7f4f18070820 legacy=0x7f4f180ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1815b4a0 con 0x7f4f180ce3b0 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f4f10001a00 con 0x7f4f180ce3b0 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 >> v1:172.21.15.133:6789/0 conn(0x7f4f180ce3b0 legacy=0x7f4f180cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f00003980 0x7f4f00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f000047d0 0x7f4f00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00005190 0x7f4f0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815b1c0 con 0x7f4f00003980 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0000c030 con 0x7f4f00005190 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0000c1f0 con 0x7f4f000047d0 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1659c640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f00003980 0x7f4f00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f16d9d640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00005190 0x7f4f0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f15d9b640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f000047d0 0x7f4f00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1659c640 1 -- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f000047d0 msgr2=0x7f4f00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1659c640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f000047d0 0x7f4f00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1659c640 1 -- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00005190 msgr2=0x7f4f0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1659c640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00005190 0x7f4f0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f1659c640 1 -- 172.21.15.133:0/145760748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00003530 con 0x7f4f00003980 2023-12-18T10:18:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f16d9d640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00005190 0x7f4f0000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f15d9b640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f000047d0 0x7f4f00004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.857+0000 7f4f16d9d640 1 -- 172.21.15.133:0/145760748 reap_dead start 2023-12-18T10:18:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1659c640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f00003980 0x7f4f00003da0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009ae0 tx=0x7f4f0801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629b34dfeced547e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080a6510 con 0x7f4f00003980 2023-12-18T10:18:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f080a6670 con 0x7f4f00003980 2023-12-18T10:18:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1559a640 1 -- 172.21.15.133:0/145760748 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080a6a20 con 0x7f4f00003980 2023-12-18T10:18:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1ca66640 1 -- 172.21.15.133:0/145760748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f00003980 msgr2=0x7f4f00003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1ca66640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f00003980 0x7f4f00003da0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009ae0 tx=0x7f4f0801ca20 comp rx=0 tx=0).stop 2023-12-18T10:18:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1ca66640 1 -- 172.21.15.133:0/145760748 shutdown_connections 2023-12-18T10:18:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1ca66640 1 --2- 172.21.15.133:0/145760748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f00003980 0x7f4f00003da0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1ca66640 1 -- 172.21.15.133:0/145760748 >> 172.21.15.133:0/145760748 conn(0x7f4f1806a2a0 msgr2=0x7f4f180aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1ca66640 1 -- 172.21.15.133:0/145760748 shutdown_connections 2023-12-18T10:18:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.861+0000 7f4f1ca66640 1 -- 172.21.15.133:0/145760748 wait complete. 2023-12-18T10:18:53.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 Processor -- start 2023-12-18T10:18:53.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 -- start start 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00003980 0x7f4f18156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f180cd6e0 0x7f4f180cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180c76c0 0x7f4f180c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c8080 con 0x7f4f180cd6e0 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180ce080 con 0x7f4f00003980 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18157ea0 con 0x7f4f180c76c0 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f180cd6e0 0x7f4f180cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f180cd6e0 0x7f4f180cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51838/0 (socket says 172.21.15.133:51838) 2023-12-18T10:18:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 -- 172.21.15.133:0/3102509155 learned_addr learned my addr 172.21.15.133:0/3102509155 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f16d9d640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180c76c0 0x7f4f180c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1659c640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00003980 0x7f4f18156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 -- 172.21.15.133:0/3102509155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180c76c0 msgr2=0x7f4f180c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180c76c0 0x7f4f180c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 -- 172.21.15.133:0/3102509155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00003980 msgr2=0x7f4f18156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00003980 0x7f4f18156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 -- 172.21.15.133:0/3102509155 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180ced50 con 0x7f4f180cd6e0 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f15d9b640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f180cd6e0 0x7f4f180cdb40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00e480 tx=0x7f4f0c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f06ffd640 1 -- 172.21.15.133:0/3102509155 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c017070 con 0x7f4f180cd6e0 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f06ffd640 1 -- 172.21.15.133:0/3102509155 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0052e0 con 0x7f4f180cd6e0 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f06ffd640 1 -- 172.21.15.133:0/3102509155 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c007e40 con 0x7f4f180cd6e0 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180c40e0 con 0x7f4f180cd6e0 2023-12-18T10:18:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.865+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180c46a0 con 0x7f4f180cd6e0 2023-12-18T10:18:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.869+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1804e000 con 0x7f4f180cd6e0 2023-12-18T10:18:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.869+0000 7f4f06ffd640 1 -- 172.21.15.133:0/3102509155 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4f0c007020 con 0x7f4f180cd6e0 2023-12-18T10:18:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.869+0000 7f4f06ffd640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef8065a60 0x7f4ef8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.869+0000 7f4f06ffd640 1 -- 172.21.15.133:0/3102509155 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f0c082b20 con 0x7f4f180cd6e0 2023-12-18T10:18:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.869+0000 7f4f1659c640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef8065a60 0x7f4ef8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.869+0000 7f4f1659c640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef8065a60 0x7f4ef8067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f080af000 tx=0x7f4f080046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:53.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:53.873+0000 7f4f06ffd640 1 -- 172.21.15.133:0/3102509155 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4f0c0501b0 con 0x7f4f180cd6e0 2023-12-18T10:18:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.021+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f180b0c00 con 0x7f4f180cd6e0 2023-12-18T10:18:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.021+0000 7f4f06ffd640 1 -- 172.21.15.133:0/3102509155 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f0c0537d0 con 0x7f4f180cd6e0 2023-12-18T10:18:54.026 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef8065a60 msgr2=0x7f4ef8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef8065a60 0x7f4ef8067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f080af000 tx=0x7f4f080046d0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f180cd6e0 msgr2=0x7f4f180cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f180cd6e0 0x7f4f180cdb40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00e480 tx=0x7f4f0c00e940 comp rx=0 tx=0).stop 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 shutdown_connections 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef8065a60 0x7f4ef8067f20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f180c76c0 0x7f4f180c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f180cd6e0 0x7f4f180cdb40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 --2- 172.21.15.133:0/3102509155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00003980 0x7f4f18156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 >> 172.21.15.133:0/3102509155 conn(0x7f4f1806a2a0 msgr2=0x7f4f18159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 shutdown_connections 2023-12-18T10:18:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.025+0000 7f4f1ca66640 1 -- 172.21.15.133:0/3102509155 wait complete. 2023-12-18T10:18:54.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:54.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.185+0000 7ff97256d640 1 Processor -- start 2023-12-18T10:18:54.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.185+0000 7ff97256d640 1 -- start start 2023-12-18T10:18:54.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.185+0000 7ff97256d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0ca410 0x7ff96c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.185+0000 7ff97256d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c070df0 con 0x7ff96c159fb0 2023-12-18T10:18:54.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.185+0000 7ff97256d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c15a4f0 con 0x7ff96c0cbff0 2023-12-18T10:18:54.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.185+0000 7ff97256d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15aab0 con 0x7ff96c0ca410 2023-12-18T10:18:54.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff96c159fb0 0x7ff96c071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48338/0 (socket says 172.21.15.133:48338) 2023-12-18T10:18:54.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96b7fe640 1 -- 172.21.15.133:0/4221328243 learned_addr learned my addr 172.21.15.133:0/4221328243 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:54.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96bfff640 1 --2- 172.21.15.133:0/4221328243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0ca410 0x7ff96c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96affd640 1 -- 172.21.15.133:0/4221328243 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794631891 0 0) 0x7ff96c070df0 con 0x7ff96c159fb0 2023-12-18T10:18:54.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96affd640 1 -- 172.21.15.133:0/4221328243 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff954003530 con 0x7ff96c159fb0 2023-12-18T10:18:54.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96bfff640 1 -- 172.21.15.133:0/4221328243 >> v1:172.21.15.142:6789/0 conn(0x7ff96c0cbff0 legacy=0x7ff96c0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96bfff640 1 -- 172.21.15.133:0/4221328243 >> v1:172.21.15.133:6789/0 conn(0x7ff96c159fb0 legacy=0x7ff96c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96bfff640 1 -- 172.21.15.133:0/4221328243 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c15a7d0 con 0x7ff96c0ca410 2023-12-18T10:18:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96bfff640 1 --2- 172.21.15.133:0/4221328243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0ca410 0x7ff96c159a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0097f0 tx=0x7ff95c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32c1255901f20e16 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96affd640 1 -- 172.21.15.133:0/4221328243 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0aa5f0 con 0x7ff96c0ca410 2023-12-18T10:18:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96affd640 1 -- 172.21.15.133:0/4221328243 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c0aa750 con 0x7ff96c0ca410 2023-12-18T10:18:54.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.189+0000 7ff96affd640 1 -- 172.21.15.133:0/4221328243 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0aaae0 con 0x7ff96c0ca410 2023-12-18T10:18:54.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- 172.21.15.133:0/4221328243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0ca410 msgr2=0x7ff96c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 --2- 172.21.15.133:0/4221328243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0ca410 0x7ff96c159a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0097f0 tx=0x7ff95c01c490 comp rx=0 tx=0).stop 2023-12-18T10:18:54.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- 172.21.15.133:0/4221328243 shutdown_connections 2023-12-18T10:18:54.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 --2- 172.21.15.133:0/4221328243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0ca410 0x7ff96c159a70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- 172.21.15.133:0/4221328243 >> 172.21.15.133:0/4221328243 conn(0x7ff96c06a2a0 msgr2=0x7ff96c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:54.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- 172.21.15.133:0/4221328243 shutdown_connections 2023-12-18T10:18:54.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- 172.21.15.133:0/4221328243 wait complete. 2023-12-18T10:18:54.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 Processor -- start 2023-12-18T10:18:54.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- start start 2023-12-18T10:18:54.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0ca410 0x7ff96c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0cbff0 0x7ff96c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96c159fb0 0x7ff96c1f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0c85d0 con 0x7ff96c159fb0 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c151ba0 con 0x7ff96c0ca410 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff97256d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0c8010 con 0x7ff96c0cbff0 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff970b0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96c159fb0 0x7ff96c1f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff96b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0cbff0 0x7ff96c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff96bfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0ca410 0x7ff96c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff970b0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96c159fb0 0x7ff96c1f6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51844/0 (socket says 172.21.15.133:51844) 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.193+0000 7ff970b0a640 1 -- 172.21.15.133:0/2666246132 learned_addr learned my addr 172.21.15.133:0/2666246132 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff970b0a640 1 -- 172.21.15.133:0/2666246132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0cbff0 msgr2=0x7ff96c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff970b0a640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0cbff0 0x7ff96c157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff970b0a640 1 -- 172.21.15.133:0/2666246132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0ca410 msgr2=0x7ff96c158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff970b0a640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0ca410 0x7ff96c158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff970b0a640 1 -- 172.21.15.133:0/2666246132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009420 con 0x7ff96c159fb0 2023-12-18T10:18:54.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff970b0a640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96c159fb0 0x7ff96c1f6860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c770 tx=0x7ff96400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff968ff9640 1 -- 172.21.15.133:0/2666246132 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964003b80 con 0x7ff96c159fb0 2023-12-18T10:18:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff968ff9640 1 -- 172.21.15.133:0/2666246132 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964003ce0 con 0x7ff96c159fb0 2023-12-18T10:18:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c0c82f0 con 0x7ff96c159fb0 2023-12-18T10:18:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff968ff9640 1 -- 172.21.15.133:0/2666246132 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400aa90 con 0x7ff96c159fb0 2023-12-18T10:18:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c0c5970 con 0x7ff96c159fb0 2023-12-18T10:18:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c0c54f0 con 0x7ff96c159fb0 2023-12-18T10:18:54.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff968ff9640 1 -- 172.21.15.133:0/2666246132 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff96400abf0 con 0x7ff96c159fb0 2023-12-18T10:18:54.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff968ff9640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff958065a60 0x7ff958067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff968ff9640 1 -- 172.21.15.133:0/2666246132 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff964083260 con 0x7ff96c159fb0 2023-12-18T10:18:54.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.197+0000 7ff96bfff640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff958065a60 0x7ff958067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.201+0000 7ff96bfff640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff958065a60 0x7ff958067f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0ae000 tx=0x7ff95c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.201+0000 7ff968ff9640 1 -- 172.21.15.133:0/2666246132 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff96c0c54f0 con 0x7ff96c159fb0 2023-12-18T10:18:54.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.353+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff96c0c54f0 con 0x7ff96c159fb0 2023-12-18T10:18:54.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.353+0000 7ff968ff9640 1 -- 172.21.15.133:0/2666246132 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff96c0c54f0 con 0x7ff96c159fb0 2023-12-18T10:18:54.358 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff958065a60 msgr2=0x7ff958067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff958065a60 0x7ff958067f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0ae000 tx=0x7ff95c0a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96c159fb0 msgr2=0x7ff96c1f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96c159fb0 0x7ff96c1f6860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff96400c770 tx=0x7ff96400cc30 comp rx=0 tx=0).stop 2023-12-18T10:18:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 shutdown_connections 2023-12-18T10:18:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff958065a60 0x7ff958067f20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff96c159fb0 0x7ff96c1f6860 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff96c0cbff0 0x7ff96c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 --2- 172.21.15.133:0/2666246132 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96c0ca410 0x7ff96c158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 >> 172.21.15.133:0/2666246132 conn(0x7ff96c06a2a0 msgr2=0x7ff96c0ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:54.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 shutdown_connections 2023-12-18T10:18:54.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.357+0000 7ff97256d640 1 -- 172.21.15.133:0/2666246132 wait complete. 2023-12-18T10:18:54.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:54.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d11da6640 1 Processor -- start 2023-12-18T10:18:54.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d11da6640 1 -- start start 2023-12-18T10:18:54.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d11da6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d0c15c9d0 0x7f1d0c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d11da6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d0c0cdd40 0x7f1d0c160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d11da6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c161060 0x7f1d0c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d11da6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0c1603f0 con 0x7f1d0c0cdd40 2023-12-18T10:18:54.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d11da6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0c160690 con 0x7f1d0c15c9d0 2023-12-18T10:18:54.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d11da6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0b0d80 con 0x7f1d0c161060 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d03fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d0c0cdd40 0x7f1d0c160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d03fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d0c0cdd40 0x7f1d0c160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51848/0 (socket says 172.21.15.133:51848) 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d03fff640 1 -- 172.21.15.133:0/775914702 learned_addr learned my addr 172.21.15.133:0/775914702 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d0bfff640 1 --2- 172.21.15.133:0/775914702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c161060 0x7f1d0c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d0b7fe640 1 --2- 172.21.15.133:0/775914702 >> v2:172.21.15.142:3300/0 conn(0x7f1d0c15c9d0 0x7f1d0c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d03fff640 1 -- 172.21.15.133:0/775914702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c161060 msgr2=0x7f1d0c06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d03fff640 1 --2- 172.21.15.133:0/775914702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c161060 0x7f1d0c06fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d03fff640 1 -- 172.21.15.133:0/775914702 >> v2:172.21.15.142:3300/0 conn(0x7f1d0c15c9d0 msgr2=0x7f1d0c0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d03fff640 1 --2- 172.21.15.133:0/775914702 >> v2:172.21.15.142:3300/0 conn(0x7f1d0c15c9d0 0x7f1d0c0cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.513+0000 7f1d03fff640 1 -- 172.21.15.133:0/775914702 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c0ccb00 con 0x7f1d0c0cdd40 2023-12-18T10:18:54.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d03fff640 1 --2- 172.21.15.133:0/775914702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c0cdd40 0x7f1d0c160b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c06cff0 tx=0x7f1cf401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6704b006ad6fe74b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d0affd640 1 -- 172.21.15.133:0/775914702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40aa640 con 0x7f1d0c0cdd40 2023-12-18T10:18:54.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d0affd640 1 -- 172.21.15.133:0/775914702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf40aa7a0 con 0x7f1d0c0cdd40 2023-12-18T10:18:54.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d0affd640 1 -- 172.21.15.133:0/775914702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40aab30 con 0x7f1d0c0cdd40 2023-12-18T10:18:54.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 -- 172.21.15.133:0/775914702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c0cdd40 msgr2=0x7f1d0c160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 --2- 172.21.15.133:0/775914702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c0cdd40 0x7f1d0c160b20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c06cff0 tx=0x7f1cf401c500 comp rx=0 tx=0).stop 2023-12-18T10:18:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 -- 172.21.15.133:0/775914702 shutdown_connections 2023-12-18T10:18:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 --2- 172.21.15.133:0/775914702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c161060 0x7f1d0c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 --2- 172.21.15.133:0/775914702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c0cdd40 0x7f1d0c160b20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 --2- 172.21.15.133:0/775914702 >> v2:172.21.15.142:3300/0 conn(0x7f1d0c15c9d0 0x7f1d0c0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 -- 172.21.15.133:0/775914702 >> 172.21.15.133:0/775914702 conn(0x7f1d0c06a3e0 msgr2=0x7f1d0c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 -- 172.21.15.133:0/775914702 shutdown_connections 2023-12-18T10:18:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.517+0000 7f1d11da6640 1 -- 172.21.15.133:0/775914702 wait complete. 2023-12-18T10:18:54.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 Processor -- start 2023-12-18T10:18:54.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 -- start start 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d0c0cdd40 0x7f1d0c14a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c15c9d0 0x7f1d0c1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c161060 0x7f1d0c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0c77b0 con 0x7f1d0c161060 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0c6b30 con 0x7f1d0c0cdd40 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0c6e10 con 0x7f1d0c15c9d0 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c161060 0x7f1d0c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d0c0cdd40 0x7f1d0c14a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c161060 0x7f1d0c157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51864/0 (socket says 172.21.15.133:51864) 2023-12-18T10:18:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 -- 172.21.15.133:0/1861742191 learned_addr learned my addr 172.21.15.133:0/1861742191 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d0c0cdd40 0x7f1d0c14a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47720/0 (socket says 172.21.15.133:47720) 2023-12-18T10:18:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d03fff640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c15c9d0 0x7f1d0c1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 -- 172.21.15.133:0/1861742191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c15c9d0 msgr2=0x7f1d0c1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c15c9d0 0x7f1d0c1576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 -- 172.21.15.133:0/1861742191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d0c0cdd40 msgr2=0x7f1d0c14a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d0c0cdd40 0x7f1d0c14a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 -- 172.21.15.133:0/1861742191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40094d0 con 0x7f1d0c161060 2023-12-18T10:18:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d0bfff640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c161060 0x7f1d0c157c00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d04007e60 tx=0x7f1d0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d08ff9640 1 -- 172.21.15.133:0/1861742191 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04014420 con 0x7f1d0c161060 2023-12-18T10:18:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d08ff9640 1 -- 172.21.15.133:0/1861742191 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d040145a0 con 0x7f1d0c161060 2023-12-18T10:18:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d08ff9640 1 -- 172.21.15.133:0/1861742191 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04014950 con 0x7f1d0c161060 2023-12-18T10:18:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c0c70f0 con 0x7f1d0c161060 2023-12-18T10:18:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.521+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c14ae60 con 0x7f1d0c161060 2023-12-18T10:18:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.525+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c0735b0 con 0x7f1d0c161060 2023-12-18T10:18:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.525+0000 7f1d08ff9640 1 -- 172.21.15.133:0/1861742191 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d04014ab0 con 0x7f1d0c161060 2023-12-18T10:18:54.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.525+0000 7f1d08ff9640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cec065a60 0x7f1cec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.525+0000 7f1d08ff9640 1 -- 172.21.15.133:0/1861742191 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d04083ca0 con 0x7f1d0c161060 2023-12-18T10:18:54.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.525+0000 7f1d0b7fe640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cec065a60 0x7f1cec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.525+0000 7f1d0b7fe640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cec065a60 0x7f1cec067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc007a60 tx=0x7f1cfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.529+0000 7f1d08ff9640 1 -- 172.21.15.133:0/1861742191 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1d04051340 con 0x7f1d0c161060 2023-12-18T10:18:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.681+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d0c0c78f0 con 0x7f1d0c161060 2023-12-18T10:18:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.681+0000 7f1d08ff9640 1 -- 172.21.15.133:0/1861742191 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f1d04054960 con 0x7f1d0c161060 2023-12-18T10:18:54.687 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:54.687 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:54.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cec065a60 msgr2=0x7f1cec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cec065a60 0x7f1cec067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc007a60 tx=0x7f1cfc008040 comp rx=0 tx=0).stop 2023-12-18T10:18:54.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c161060 msgr2=0x7f1d0c157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c161060 0x7f1d0c157c00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d04007e60 tx=0x7f1d0400e4b0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 shutdown_connections 2023-12-18T10:18:54.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cec065a60 0x7f1cec067f20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c161060 0x7f1d0c157c00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0c15c9d0 0x7f1d0c1576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 --2- 172.21.15.133:0/1861742191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d0c0cdd40 0x7f1d0c14a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 >> 172.21.15.133:0/1861742191 conn(0x7f1d0c06a3e0 msgr2=0x7f1d0c0ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:54.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 shutdown_connections 2023-12-18T10:18:54.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.685+0000 7f1d11da6640 1 -- 172.21.15.133:0/1861742191 wait complete. 2023-12-18T10:18:54.708 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:54.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:54.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.845+0000 7f07bd539640 1 Processor -- start 2023-12-18T10:18:54.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.845+0000 7f07bd539640 1 -- start start 2023-12-18T10:18:54.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07bd539640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b80ca410 0x7f07b8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07bd539640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07b80cbff0 0x7f07b80cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07bd539640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b8070df0 con 0x7f07b8159fb0 2023-12-18T10:18:54.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07bd539640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b815aab0 con 0x7f07b80cbff0 2023-12-18T10:18:54.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07bd539640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80cc980 con 0x7f07b80ca410 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07b80cbff0 0x7f07b80cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07b80cbff0 0x7f07b80cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51876/0 (socket says 172.21.15.133:51876) 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b77fe640 1 -- 172.21.15.133:0/1561082126 learned_addr learned my addr 172.21.15.133:0/1561082126 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b6ffd640 1 --2- 172.21.15.133:0/1561082126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b80ca410 0x7f07b8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b77fe640 1 -- 172.21.15.133:0/1561082126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b80ca410 msgr2=0x7f07b8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b77fe640 1 --2- 172.21.15.133:0/1561082126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b80ca410 0x7f07b8159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b77fe640 1 -- 172.21.15.133:0/1561082126 >> v1:172.21.15.142:6789/0 conn(0x7f07b8159fb0 legacy=0x7f07b8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b77fe640 1 -- 172.21.15.133:0/1561082126 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b815a4f0 con 0x7f07b80cbff0 2023-12-18T10:18:54.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b6ffd640 1 --2- 172.21.15.133:0/1561082126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b80ca410 0x7f07b8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:54.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b77fe640 1 --2- 172.21.15.133:0/1561082126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b80cc440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009e50 tx=0x7f07b001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1b639657e17f99 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.849+0000 7f07b67fc640 1 -- 172.21.15.133:0/1561082126 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00a58a0 con 0x7f07b80cbff0 2023-12-18T10:18:54.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07b67fc640 1 -- 172.21.15.133:0/1561082126 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b00a5a00 con 0x7f07b80cbff0 2023-12-18T10:18:54.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07b67fc640 1 -- 172.21.15.133:0/1561082126 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00a5d90 con 0x7f07b80cbff0 2023-12-18T10:18:54.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- 172.21.15.133:0/1561082126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 msgr2=0x7f07b80cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 --2- 172.21.15.133:0/1561082126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b80cc440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009e50 tx=0x7f07b001c9e0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- 172.21.15.133:0/1561082126 shutdown_connections 2023-12-18T10:18:54.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 --2- 172.21.15.133:0/1561082126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b80cc440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 --2- 172.21.15.133:0/1561082126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b80ca410 0x7f07b8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- 172.21.15.133:0/1561082126 >> 172.21.15.133:0/1561082126 conn(0x7f07b806a2a0 msgr2=0x7f07b80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:54.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- 172.21.15.133:0/1561082126 shutdown_connections 2023-12-18T10:18:54.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- 172.21.15.133:0/1561082126 wait complete. 2023-12-18T10:18:54.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 Processor -- start 2023-12-18T10:18:54.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- start start 2023-12-18T10:18:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80ca410 0x7f07b814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b8141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8159fb0 0x7f07b8154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81594f0 con 0x7f07b80cbff0 2023-12-18T10:18:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80ae610 con 0x7f07b80ca410 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07bd539640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80ae8f0 con 0x7f07b8159fb0 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07affff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b8141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07affff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b8141640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51890/0 (socket says 172.21.15.133:51890) 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07affff640 1 -- 172.21.15.133:0/500544585 learned_addr learned my addr 172.21.15.133:0/500544585 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07b6ffd640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80ca410 0x7f07b814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07b77fe640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8159fb0 0x7f07b8154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07affff640 1 -- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8159fb0 msgr2=0x7f07b8154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.853+0000 7f07affff640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8159fb0 0x7f07b8154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07affff640 1 -- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80ca410 msgr2=0x7f07b814d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07affff640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80ca410 0x7f07b814d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07affff640 1 -- 172.21.15.133:0/500544585 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b0009b30 con 0x7f07b80cbff0 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07b77fe640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8159fb0 0x7f07b8154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07affff640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b8141640 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07a000c500 tx=0x7f07a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07af7fe640 1 -- 172.21.15.133:0/500544585 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0005220 con 0x7f07b80cbff0 2023-12-18T10:18:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07af7fe640 1 -- 172.21.15.133:0/500544585 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a0005380 con 0x7f07b80cbff0 2023-12-18T10:18:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07af7fe640 1 -- 172.21.15.133:0/500544585 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0007270 con 0x7f07b80cbff0 2023-12-18T10:18:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b80aebd0 con 0x7f07b80cbff0 2023-12-18T10:18:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b814dda0 con 0x7f07b80cbff0 2023-12-18T10:18:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b804e000 con 0x7f07b80cbff0 2023-12-18T10:18:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07af7fe640 1 -- 172.21.15.133:0/500544585 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f07a00073d0 con 0x7f07b80cbff0 2023-12-18T10:18:54.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07af7fe640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0798065a60 0x7f0798067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:54.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.857+0000 7f07af7fe640 1 -- 172.21.15.133:0/500544585 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f07a0082920 con 0x7f07b80cbff0 2023-12-18T10:18:54.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.861+0000 7f07b6ffd640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0798065a60 0x7f0798067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:54.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.861+0000 7f07b6ffd640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0798065a60 0x7f0798067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07b80c89d0 tx=0x7f07a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:54.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:54.861+0000 7f07af7fe640 1 -- 172.21.15.133:0/500544585 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f07a004ff30 con 0x7f07b80cbff0 2023-12-18T10:18:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07b80af080 con 0x7f07b80cbff0 2023-12-18T10:18:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07af7fe640 1 -- 172.21.15.133:0/500544585 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07a0053550 con 0x7f07b80cbff0 2023-12-18T10:18:55.021 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0798065a60 msgr2=0x7f0798067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0798065a60 0x7f0798067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07b80c89d0 tx=0x7f07a8008040 comp rx=0 tx=0).stop 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 msgr2=0x7f07b8141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b8141640 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07a000c500 tx=0x7f07a000c9c0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 shutdown_connections 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0798065a60 0x7f0798067f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f07b8159fb0 0x7f07b8154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07b80cbff0 0x7f07b8141640 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 --2- 172.21.15.133:0/500544585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07b80ca410 0x7f07b814d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 >> 172.21.15.133:0/500544585 conn(0x7f07b806a2a0 msgr2=0x7f07b80acf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.017+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 shutdown_connections 2023-12-18T10:18:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.021+0000 7f07bd539640 1 -- 172.21.15.133:0/500544585 wait complete. 2023-12-18T10:18:55.041 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb79404640 1 Processor -- start 2023-12-18T10:18:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb79404640 1 -- start start 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb79404640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb7415c690 0x7ffb740d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb79404640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb740cd520 0x7ffb740d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb79404640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb740d17c0 con 0x7ffb7415ca70 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb79404640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb740b1c20 con 0x7ffb7415c690 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb79404640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740d15c0 con 0x7ffb740cd520 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb72ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb7415c690 0x7ffb740d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb72ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb7415c690 0x7ffb740d2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51896/0 (socket says 172.21.15.133:51896) 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb72ffd640 1 -- 172.21.15.133:0/2268602514 learned_addr learned my addr 172.21.15.133:0/2268602514 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb737fe640 1 --2- 172.21.15.133:0/2268602514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb740cd520 0x7ffb740d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb72ffd640 1 -- 172.21.15.133:0/2268602514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb740cd520 msgr2=0x7ffb740d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb72ffd640 1 --2- 172.21.15.133:0/2268602514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb740cd520 0x7ffb740d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb72ffd640 1 -- 172.21.15.133:0/2268602514 >> v1:172.21.15.142:6789/0 conn(0x7ffb7415ca70 legacy=0x7ffb740cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.181+0000 7ffb72ffd640 1 -- 172.21.15.133:0/2268602514 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740d1cb0 con 0x7ffb7415c690 2023-12-18T10:18:55.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb72ffd640 1 --2- 172.21.15.133:0/2268602514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb7415c690 0x7ffb740d2a70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009870 tx=0x7ffb6401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dfe57fcd2995aa server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb727fc640 1 -- 172.21.15.133:0/2268602514 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640a8a30 con 0x7ffb7415c690 2023-12-18T10:18:55.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb727fc640 1 -- 172.21.15.133:0/2268602514 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb640a8b90 con 0x7ffb7415c690 2023-12-18T10:18:55.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb727fc640 1 -- 172.21.15.133:0/2268602514 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640b0440 con 0x7ffb7415c690 2023-12-18T10:18:55.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb79404640 1 -- 172.21.15.133:0/2268602514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb7415c690 msgr2=0x7ffb740d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb79404640 1 --2- 172.21.15.133:0/2268602514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb7415c690 0x7ffb740d2a70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009870 tx=0x7ffb6401ed30 comp rx=0 tx=0).stop 2023-12-18T10:18:55.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb79404640 1 -- 172.21.15.133:0/2268602514 shutdown_connections 2023-12-18T10:18:55.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb79404640 1 --2- 172.21.15.133:0/2268602514 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb740cd520 0x7ffb740d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb79404640 1 --2- 172.21.15.133:0/2268602514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb7415c690 0x7ffb740d2a70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb79404640 1 -- 172.21.15.133:0/2268602514 >> 172.21.15.133:0/2268602514 conn(0x7ffb740717d0 msgr2=0x7ffb74071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:55.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb79404640 1 -- 172.21.15.133:0/2268602514 shutdown_connections 2023-12-18T10:18:55.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.185+0000 7ffb79404640 1 -- 172.21.15.133:0/2268602514 wait complete. 2023-12-18T10:18:55.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 Processor -- start 2023-12-18T10:18:55.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 -- start start 2023-12-18T10:18:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb740cd520 0x7ffb740c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7415c690 0x7ffb741e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7415ca70 0x7ffb741f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740c72c0 con 0x7ffb740cd520 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb741e7090 con 0x7ffb7415c690 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb741e7370 con 0x7ffb7415ca70 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb740cd520 0x7ffb740c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb740cd520 0x7ffb740c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51900/0 (socket says 172.21.15.133:51900) 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 -- 172.21.15.133:0/3997829715 learned_addr learned my addr 172.21.15.133:0/3997829715 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb737fe640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7415ca70 0x7ffb741f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb6a7fc640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7415c690 0x7ffb741e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 -- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7415ca70 msgr2=0x7ffb741f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7415ca70 0x7ffb741f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 -- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7415c690 msgr2=0x7ffb741e5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7415c690 0x7ffb741e5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 -- 172.21.15.133:0/3997829715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640094d0 con 0x7ffb740cd520 2023-12-18T10:18:55.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb737fe640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7415ca70 0x7ffb741f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb72ffd640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb740cd520 0x7ffb740c6d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb640b3040 tx=0x7ffb6401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb6bfff640 1 -- 172.21.15.133:0/3997829715 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640be070 con 0x7ffb740cd520 2023-12-18T10:18:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb6bfff640 1 -- 172.21.15.133:0/3997829715 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb640ba400 con 0x7ffb740cd520 2023-12-18T10:18:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb6bfff640 1 -- 172.21.15.133:0/3997829715 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640ba7d0 con 0x7ffb740cd520 2023-12-18T10:18:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb741e7650 con 0x7ffb740cd520 2023-12-18T10:18:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.189+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb741e7c10 con 0x7ffb740cd520 2023-12-18T10:18:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.193+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7404e000 con 0x7ffb740cd520 2023-12-18T10:18:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.193+0000 7ffb6bfff640 1 -- 172.21.15.133:0/3997829715 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb640c3410 con 0x7ffb740cd520 2023-12-18T10:18:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.193+0000 7ffb6bfff640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb54065a60 0x7ffb54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.193+0000 7ffb6bfff640 1 -- 172.21.15.133:0/3997829715 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffb64121150 con 0x7ffb740cd520 2023-12-18T10:18:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.193+0000 7ffb6a7fc640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb54065a60 0x7ffb54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.193+0000 7ffb6a7fc640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb54065a60 0x7ffb54067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffb741f6650 tx=0x7ffb5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.197+0000 7ffb6bfff640 1 -- 172.21.15.133:0/3997829715 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb640ee740 con 0x7ffb740cd520 2023-12-18T10:18:55.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb740c5ec0 con 0x7ffb740cd520 2023-12-18T10:18:55.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb6bfff640 1 -- 172.21.15.133:0/3997829715 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb640f1d60 con 0x7ffb740cd520 2023-12-18T10:18:55.352 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb54065a60 msgr2=0x7ffb54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb54065a60 0x7ffb54067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffb741f6650 tx=0x7ffb5c009040 comp rx=0 tx=0).stop 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb740cd520 msgr2=0x7ffb740c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb740cd520 0x7ffb740c6d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb640b3040 tx=0x7ffb6401bad0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 shutdown_connections 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb54065a60 0x7ffb54067f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb7415ca70 0x7ffb741f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb7415c690 0x7ffb741e5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 --2- 172.21.15.133:0/3997829715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb740cd520 0x7ffb740c6d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 >> 172.21.15.133:0/3997829715 conn(0x7ffb740717d0 msgr2=0x7ffb7415de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 shutdown_connections 2023-12-18T10:18:55.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.349+0000 7ffb79404640 1 -- 172.21.15.133:0/3997829715 wait complete. 2023-12-18T10:18:55.372 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.509+0000 7f0975d39640 1 Processor -- start 2023-12-18T10:18:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.509+0000 7f0975d39640 1 -- start start 2023-12-18T10:18:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.509+0000 7f0975d39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09700ca410 0x7f0970159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.509+0000 7f0975d39640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0970070df0 con 0x7f09700cbff0 2023-12-18T10:18:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.509+0000 7f0975d39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097015a4f0 con 0x7f0970159fb0 2023-12-18T10:18:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.509+0000 7f0975d39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097015aab0 con 0x7f09700ca410 2023-12-18T10:18:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f09700cbff0 0x7f09700ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48342/0 (socket says 172.21.15.133:48342) 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096ffff640 1 -- 172.21.15.133:0/4157034024 learned_addr learned my addr 172.21.15.133:0/4157034024 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096f7fe640 1 --2- 172.21.15.133:0/4157034024 >> v2:172.21.15.142:3300/0 conn(0x7f09700ca410 0x7f0970159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096effd640 1 -- 172.21.15.133:0/4157034024 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514775835 0 0) 0x7f0970070df0 con 0x7f09700cbff0 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096effd640 1 -- 172.21.15.133:0/4157034024 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f095c003530 con 0x7f09700cbff0 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096effd640 1 -- 172.21.15.133:0/4157034024 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789942111 0 0) 0x7f097015a4f0 con 0x7f0970159fb0 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096effd640 1 -- 172.21.15.133:0/4157034024 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0970070df0 con 0x7f0970159fb0 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096effd640 1 -- 172.21.15.133:0/4157034024 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1754624413 0 0) 0x7f095c003530 con 0x7f09700cbff0 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096f7fe640 1 -- 172.21.15.133:0/4157034024 >> v1:172.21.15.142:6789/0 conn(0x7f0970159fb0 legacy=0x7f0970071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096f7fe640 1 -- 172.21.15.133:0/4157034024 >> v1:172.21.15.133:6789/0 conn(0x7f09700cbff0 legacy=0x7f09700ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096f7fe640 1 -- 172.21.15.133:0/4157034024 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097015a7d0 con 0x7f09700ca410 2023-12-18T10:18:55.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.513+0000 7f096f7fe640 1 --2- 172.21.15.133:0/4157034024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700ca410 0x7f0970159a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09600097c0 tx=0x7f096001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf2d558c15fad14 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f096effd640 1 -- 172.21.15.133:0/4157034024 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0968001a00 con 0x7f09700ca410 2023-12-18T10:18:55.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f096effd640 1 -- 172.21.15.133:0/4157034024 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09600a7050 con 0x7f09700ca410 2023-12-18T10:18:55.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f096effd640 1 -- 172.21.15.133:0/4157034024 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600ab620 con 0x7f09700ca410 2023-12-18T10:18:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- 172.21.15.133:0/4157034024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700ca410 msgr2=0x7f0970159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 --2- 172.21.15.133:0/4157034024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700ca410 0x7f0970159a70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09600097c0 tx=0x7f096001c370 comp rx=0 tx=0).stop 2023-12-18T10:18:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- 172.21.15.133:0/4157034024 shutdown_connections 2023-12-18T10:18:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 --2- 172.21.15.133:0/4157034024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700ca410 0x7f0970159a70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- 172.21.15.133:0/4157034024 >> 172.21.15.133:0/4157034024 conn(0x7f097006a2a0 msgr2=0x7f09700aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:55.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- 172.21.15.133:0/4157034024 shutdown_connections 2023-12-18T10:18:55.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- 172.21.15.133:0/4157034024 wait complete. 2023-12-18T10:18:55.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 Processor -- start 2023-12-18T10:18:55.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- start start 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09700ca410 0x7f097014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700cbff0 0x7f0970156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0970159fb0 0x7f09701522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097014fdb0 con 0x7f09700ca410 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0970151e90 con 0x7f09700cbff0 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f0975d39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09700c3f20 con 0x7f0970159fb0 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.517+0000 7f096f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09700ca410 0x7f097014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09700ca410 0x7f097014b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51916/0 (socket says 172.21.15.133:51916) 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096f7fe640 1 -- 172.21.15.133:0/2006680783 learned_addr learned my addr 172.21.15.133:0/2006680783 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096ffff640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0970159fb0 0x7f09701522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f0967fff640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700cbff0 0x7f0970156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096f7fe640 1 -- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0970159fb0 msgr2=0x7f09701522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096f7fe640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0970159fb0 0x7f09701522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096f7fe640 1 -- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700cbff0 msgr2=0x7f0970156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096f7fe640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700cbff0 0x7f0970156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096f7fe640 1 -- 172.21.15.133:0/2006680783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960009420 con 0x7f09700ca410 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096ffff640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0970159fb0 0x7f09701522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f0967fff640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700cbff0 0x7f0970156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096f7fe640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09700ca410 0x7f097014b630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f09600ae040 tx=0x7f096001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096cff9640 1 -- 172.21.15.133:0/2006680783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600bc070 con 0x7f09700ca410 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096cff9640 1 -- 172.21.15.133:0/2006680783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09600abc50 con 0x7f09700ca410 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096cff9640 1 -- 172.21.15.133:0/2006680783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960004020 con 0x7f09700ca410 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0970156f60 con 0x7f09700ca410 2023-12-18T10:18:55.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09700c3c40 con 0x7f09700ca410 2023-12-18T10:18:55.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097004e000 con 0x7f09700ca410 2023-12-18T10:18:55.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096cff9640 1 -- 172.21.15.133:0/2006680783 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0960004180 con 0x7f09700ca410 2023-12-18T10:18:55.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.521+0000 7f096cff9640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0950065a60 0x7f0950067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.525+0000 7f096cff9640 1 -- 172.21.15.133:0/2006680783 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f096011d4d0 con 0x7f09700ca410 2023-12-18T10:18:55.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.525+0000 7f0967fff640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0950065a60 0x7f0950067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.525+0000 7f0967fff640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0950065a60 0x7f0950067f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0970156990 tx=0x7f0958009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.525+0000 7f096cff9640 1 -- 172.21.15.133:0/2006680783 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f09600eaa30 con 0x7f09700ca410 2023-12-18T10:18:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09700ca970 con 0x7f09700ca410 2023-12-18T10:18:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f096cff9640 1 -- 172.21.15.133:0/2006680783 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09600ee050 con 0x7f09700ca410 2023-12-18T10:18:55.683 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0950065a60 msgr2=0x7f0950067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0950065a60 0x7f0950067f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0970156990 tx=0x7f0958009040 comp rx=0 tx=0).stop 2023-12-18T10:18:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09700ca410 msgr2=0x7f097014b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09700ca410 0x7f097014b630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f09600ae040 tx=0x7f096001abb0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 shutdown_connections 2023-12-18T10:18:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0950065a60 0x7f0950067f20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0970159fb0 0x7f09701522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09700cbff0 0x7f0970156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 --2- 172.21.15.133:0/2006680783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09700ca410 0x7f097014b630 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 >> 172.21.15.133:0/2006680783 conn(0x7f097006a2a0 msgr2=0x7f0970158990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:55.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 shutdown_connections 2023-12-18T10:18:55.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.681+0000 7f0975d39640 1 -- 172.21.15.133:0/2006680783 wait complete. 2023-12-18T10:18:55.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:55.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56a1266640 1 Processor -- start 2023-12-18T10:18:55.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56a1266640 1 -- start start 2023-12-18T10:18:55.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56a1266640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f569c070820 0x7f569c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56a1266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c0ce3b0 0x7f569c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56a1266640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c0c9390 con 0x7f569c1582d0 2023-12-18T10:18:55.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56a1266640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c0ced80 con 0x7f569c070820 2023-12-18T10:18:55.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56a1266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c15aee0 con 0x7f569c0ce3b0 2023-12-18T10:18:55.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56927fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f569c070820 0x7f569c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56927fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f569c070820 0x7f569c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51920/0 (socket says 172.21.15.133:51920) 2023-12-18T10:18:55.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56927fc640 1 -- 172.21.15.133:0/2582103053 learned_addr learned my addr 172.21.15.133:0/2582103053 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:55.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56927fc640 1 -- 172.21.15.133:0/2582103053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c0ce3b0 msgr2=0x7f569c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:55.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56927fc640 1 --2- 172.21.15.133:0/2582103053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c0ce3b0 0x7f569c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56927fc640 1 -- 172.21.15.133:0/2582103053 >> v1:172.21.15.142:6789/0 conn(0x7f569c1582d0 legacy=0x7f569c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:55.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.841+0000 7f56927fc640 1 -- 172.21.15.133:0/2582103053 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c15b1c0 con 0x7f569c070820 2023-12-18T10:18:55.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56927fc640 1 --2- 172.21.15.133:0/2582103053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c070820 0x7f569c0c8e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5684009e50 tx=0x7f568401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2520632c5199d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f569a7fc640 1 -- 172.21.15.133:0/2582103053 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840a5820 con 0x7f569c070820 2023-12-18T10:18:55.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f569a7fc640 1 -- 172.21.15.133:0/2582103053 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56840a5980 con 0x7f569c070820 2023-12-18T10:18:55.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f569a7fc640 1 -- 172.21.15.133:0/2582103053 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840a5d10 con 0x7f569c070820 2023-12-18T10:18:55.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56a1266640 1 -- 172.21.15.133:0/2582103053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c070820 msgr2=0x7f569c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56a1266640 1 --2- 172.21.15.133:0/2582103053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c070820 0x7f569c0c8e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5684009e50 tx=0x7f568401c9a0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56a1266640 1 -- 172.21.15.133:0/2582103053 shutdown_connections 2023-12-18T10:18:55.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56a1266640 1 --2- 172.21.15.133:0/2582103053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c0ce3b0 0x7f569c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56a1266640 1 --2- 172.21.15.133:0/2582103053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c070820 0x7f569c0c8e50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56a1266640 1 -- 172.21.15.133:0/2582103053 >> 172.21.15.133:0/2582103053 conn(0x7f569c06a2a0 msgr2=0x7f569c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56a1266640 1 -- 172.21.15.133:0/2582103053 shutdown_connections 2023-12-18T10:18:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.845+0000 7f56a1266640 1 -- 172.21.15.133:0/2582103053 wait complete. 2023-12-18T10:18:55.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 Processor -- start 2023-12-18T10:18:55.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 -- start start 2023-12-18T10:18:55.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c070820 0x7f569c0c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f569c0ce3b0 0x7f569c150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c1582d0 0x7f569c0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0c4870 con 0x7f569c1582d0 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c0c4150 con 0x7f569c0ce3b0 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c153480 con 0x7f569c070820 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c1582d0 0x7f569c0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c1582d0 0x7f569c0aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51934/0 (socket says 172.21.15.133:51934) 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 -- 172.21.15.133:0/1603720898 learned_addr learned my addr 172.21.15.133:0/1603720898 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569affd640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c070820 0x7f569c0c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56927fc640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f569c0ce3b0 0x7f569c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 -- 172.21.15.133:0/1603720898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c070820 msgr2=0x7f569c0c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c070820 0x7f569c0c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 -- 172.21.15.133:0/1603720898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f569c0ce3b0 msgr2=0x7f569c150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f569c0ce3b0 0x7f569c150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 -- 172.21.15.133:0/1603720898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684009b30 con 0x7f569c1582d0 2023-12-18T10:18:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f569b7fe640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c1582d0 0x7f569c0aef80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f569400b430 tx=0x7f569400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f5693fff640 1 -- 172.21.15.133:0/1603720898 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011830 con 0x7f569c1582d0 2023-12-18T10:18:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f5693fff640 1 -- 172.21.15.133:0/1603720898 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694011990 con 0x7f569c1582d0 2023-12-18T10:18:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f5693fff640 1 -- 172.21.15.133:0/1603720898 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011d40 con 0x7f569c1582d0 2023-12-18T10:18:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c0c2e50 con 0x7f569c1582d0 2023-12-18T10:18:55.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c0c3410 con 0x7f569c1582d0 2023-12-18T10:18:55.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.849+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c04e000 con 0x7f569c1582d0 2023-12-18T10:18:55.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.853+0000 7f5693fff640 1 -- 172.21.15.133:0/1603720898 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f569401a400 con 0x7f569c1582d0 2023-12-18T10:18:55.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.853+0000 7f5693fff640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f567c065a90 0x7f567c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:55.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.853+0000 7f5693fff640 1 -- 172.21.15.133:0/1603720898 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5694083530 con 0x7f569c1582d0 2023-12-18T10:18:55.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.853+0000 7f569affd640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f567c065a90 0x7f567c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:55.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.853+0000 7f569affd640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f567c065a90 0x7f567c067f50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f568c0098e0 tx=0x7f568c009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:55.857+0000 7f5693fff640 1 -- 172.21.15.133:0/1603720898 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5694050be0 con 0x7f569c1582d0 2023-12-18T10:18:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.005+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f569c0c8970 con 0x7f569c1582d0 2023-12-18T10:18:56.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f5693fff640 1 -- 172.21.15.133:0/1603720898 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5694054200 con 0x7f569c1582d0 2023-12-18T10:18:56.011 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f567c065a90 msgr2=0x7f567c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f567c065a90 0x7f567c067f50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f568c0098e0 tx=0x7f568c009060 comp rx=0 tx=0).stop 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c1582d0 msgr2=0x7f569c0aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c1582d0 0x7f569c0aef80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f569400b430 tx=0x7f569400b8f0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 shutdown_connections 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f567c065a90 0x7f567c067f50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f569c1582d0 0x7f569c0aef80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f569c0ce3b0 0x7f569c150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 --2- 172.21.15.133:0/1603720898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f569c070820 0x7f569c0c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 >> 172.21.15.133:0/1603720898 conn(0x7f569c06a2a0 msgr2=0x7f569c0acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 shutdown_connections 2023-12-18T10:18:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.009+0000 7f56a1266640 1 -- 172.21.15.133:0/1603720898 wait complete. 2023-12-18T10:18:56.038 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-12-18T10:18:56.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2023-12-18T10:18:56.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2bb266640 1 Processor -- start 2023-12-18T10:18:56.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2bb266640 1 -- start start 2023-12-18T10:18:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2bb266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 0x7fb2b406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2bb266640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2b40ca000 0x7fb2b4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2bb266640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b40c9460 con 0x7fb2b406c320 2023-12-18T10:18:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2bb266640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b406c7a0 con 0x7fb2b40ca000 2023-12-18T10:18:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2bb266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41574a0 con 0x7fb2b41570c0 2023-12-18T10:18:56.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2b9803640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2b40ca000 0x7fb2b4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2b9803640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2b40ca000 0x7fb2b4070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51938/0 (socket says 172.21.15.133:51938) 2023-12-18T10:18:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2b9803640 1 -- 172.21.15.133:0/3738720969 learned_addr learned my addr 172.21.15.133:0/3738720969 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2b9002640 1 --2- 172.21.15.133:0/3738720969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 0x7fb2b406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2b9803640 1 -- 172.21.15.133:0/3738720969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 msgr2=0x7fb2b406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2b9803640 1 --2- 172.21.15.133:0/3738720969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 0x7fb2b406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2b9803640 1 -- 172.21.15.133:0/3738720969 >> v1:172.21.15.133:6789/0 conn(0x7fb2b406c320 legacy=0x7fb2b40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2b9803640 1 -- 172.21.15.133:0/3738720969 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40c8b30 con 0x7fb2b40ca000 2023-12-18T10:18:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.173+0000 7fb2abfff640 1 -- 172.21.15.133:0/3738720969 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537293379 0 0) 0x7fb2b40c9460 con 0x7fb2b406c320 2023-12-18T10:18:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2b9803640 1 --2- 172.21.15.133:0/3738720969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b4070df0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009e50 tx=0x7fb2ac01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9c894c2b82e719 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2abfff640 1 -- 172.21.15.133:0/3738720969 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0a5810 con 0x7fb2b40ca000 2023-12-18T10:18:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2abfff640 1 -- 172.21.15.133:0/3738720969 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0a5970 con 0x7fb2b40ca000 2023-12-18T10:18:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2abfff640 1 -- 172.21.15.133:0/3738720969 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0a5d00 con 0x7fb2b40ca000 2023-12-18T10:18:56.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2bb266640 1 -- 172.21.15.133:0/3738720969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 msgr2=0x7fb2b4070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:56.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2bb266640 1 --2- 172.21.15.133:0/3738720969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b4070df0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009e50 tx=0x7fb2ac01c950 comp rx=0 tx=0).stop 2023-12-18T10:18:56.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2bb266640 1 -- 172.21.15.133:0/3738720969 shutdown_connections 2023-12-18T10:18:56.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2bb266640 1 --2- 172.21.15.133:0/3738720969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b4070df0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2bb266640 1 --2- 172.21.15.133:0/3738720969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 0x7fb2b406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2bb266640 1 -- 172.21.15.133:0/3738720969 >> 172.21.15.133:0/3738720969 conn(0x7fb2b406a3e0 msgr2=0x7fb2b40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:56.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2bb266640 1 -- 172.21.15.133:0/3738720969 shutdown_connections 2023-12-18T10:18:56.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.177+0000 7fb2bb266640 1 -- 172.21.15.133:0/3738720969 wait complete. 2023-12-18T10:18:56.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 Processor -- start 2023-12-18T10:18:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 -- start start 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2b406c320 0x7fb2b4150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b40cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 0x7fb2b40c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41575e0 con 0x7fb2b40ca000 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b40cd090 con 0x7fb2b406c320 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41578a0 con 0x7fb2b41570c0 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b40cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b40cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51940/0 (socket says 172.21.15.133:51940) 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 -- 172.21.15.133:0/2339328200 learned_addr learned my addr 172.21.15.133:0/2339328200 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b9803640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 0x7fb2b40c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:56.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b9002640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2b406c320 0x7fb2b4150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:56.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 -- 172.21.15.133:0/2339328200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 msgr2=0x7fb2b40c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:56.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 0x7fb2b40c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 -- 172.21.15.133:0/2339328200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2b406c320 msgr2=0x7fb2b4150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:56.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2b406c320 0x7fb2b4150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:56.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 -- 172.21.15.133:0/2339328200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac009b30 con 0x7fb2b40ca000 2023-12-18T10:18:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2b8801640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b40cc810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c4d0 tx=0x7fb2a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2a9ffb640 1 -- 172.21.15.133:0/2339328200 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4005480 con 0x7fb2b40ca000 2023-12-18T10:18:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2a9ffb640 1 -- 172.21.15.133:0/2339328200 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4003600 con 0x7fb2b40ca000 2023-12-18T10:18:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b4157b80 con 0x7fb2b40ca000 2023-12-18T10:18:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.181+0000 7fb2a9ffb640 1 -- 172.21.15.133:0/2339328200 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40039b0 con 0x7fb2b40ca000 2023-12-18T10:18:56.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.185+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b40ccd50 con 0x7fb2b40ca000 2023-12-18T10:18:56.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.185+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b40735b0 con 0x7fb2b40ca000 2023-12-18T10:18:56.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.185+0000 7fb2a9ffb640 1 -- 172.21.15.133:0/2339328200 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb2a4003b10 con 0x7fb2b40ca000 2023-12-18T10:18:56.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.185+0000 7fb2a9ffb640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb298065a60 0x7fb298067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:56.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.185+0000 7fb2a9ffb640 1 -- 172.21.15.133:0/2339328200 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb2a4082b50 con 0x7fb2b40ca000 2023-12-18T10:18:56.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.185+0000 7fb2b9002640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb298065a60 0x7fb298067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:56.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.185+0000 7fb2b9002640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb298065a60 0x7fb298067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00079c0 tx=0x7fb2b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:56.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.189+0000 7fb2a9ffb640 1 -- 172.21.15.133:0/2339328200 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb2a4050220 con 0x7fb2b40ca000 2023-12-18T10:18:56.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:56.393+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) v1 -- 0x7fb2b40cde60 con 0x7fb2b40ca000 2023-12-18T10:18:57.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.233+0000 7fb2a9ffb640 1 -- 172.21.15.133:0/2339328200 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v71) v1 ==== 139+0+0 (secure 0 0 0) 0x7fb2a4017070 con 0x7fb2b40ca000 2023-12-18T10:18:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb298065a60 msgr2=0x7fb298067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb298065a60 0x7fb298067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00079c0 tx=0x7fb2b0008040 comp rx=0 tx=0).stop 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 msgr2=0x7fb2b40cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b40cc810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400c4d0 tx=0x7fb2a400c990 comp rx=0 tx=0).stop 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 shutdown_connections 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb298065a60 0x7fb298067f20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2b41570c0 0x7fb2b40c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2b40ca000 0x7fb2b40cc810 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 --2- 172.21.15.133:0/2339328200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb2b406c320 0x7fb2b4150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 >> 172.21.15.133:0/2339328200 conn(0x7fb2b406a3e0 msgr2=0x7fb2b41561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 shutdown_connections 2023-12-18T10:18:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.237+0000 7fb2bb266640 1 -- 172.21.15.133:0/2339328200 wait complete. 2023-12-18T10:18:57.264 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-18T10:18:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.405+0000 7f170e266640 1 Processor -- start 2023-12-18T10:18:57.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.405+0000 7f170e266640 1 -- start start 2023-12-18T10:18:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170e266640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1708070820 0x7f17080c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170e266640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17080ce3b0 0x7f17080ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170e266640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17080c9390 con 0x7f17081582d0 2023-12-18T10:18:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170e266640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17080ced60 con 0x7f17080ce3b0 2023-12-18T10:18:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170e266640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170815aee0 con 0x7f1708070820 2023-12-18T10:18:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f1707fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f17081582d0 0x7f17080ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48350/0 (socket says 172.21.15.133:48350) 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f1707fff640 1 -- 172.21.15.133:0/3699667348 learned_addr learned my addr 172.21.15.133:0/3699667348 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170c803640 1 --2- 172.21.15.133:0/3699667348 >> v2:172.21.15.133:3300/0 conn(0x7f17080ce3b0 0x7f17080ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f17077fe640 1 --2- 172.21.15.133:0/3699667348 >> v2:172.21.15.142:3300/0 conn(0x7f1708070820 0x7f17080c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f1706ffd640 1 -- 172.21.15.133:0/3699667348 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330546011 0 0) 0x7f17080c9390 con 0x7f17081582d0 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f1706ffd640 1 -- 172.21.15.133:0/3699667348 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16f0003530 con 0x7f17081582d0 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170c803640 1 -- 172.21.15.133:0/3699667348 >> v2:172.21.15.142:3300/0 conn(0x7f1708070820 msgr2=0x7f17080c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170c803640 1 --2- 172.21.15.133:0/3699667348 >> v2:172.21.15.142:3300/0 conn(0x7f1708070820 0x7f17080c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170c803640 1 -- 172.21.15.133:0/3699667348 >> v1:172.21.15.133:6789/0 conn(0x7f17081582d0 legacy=0x7f17080ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f170c803640 1 -- 172.21.15.133:0/3699667348 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170815b1c0 con 0x7f17080ce3b0 2023-12-18T10:18:57.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.409+0000 7f17077fe640 1 --2- 172.21.15.133:0/3699667348 >> v2:172.21.15.142:3300/0 conn(0x7f1708070820 0x7f17080c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170c803640 1 --2- 172.21.15.133:0/3699667348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17080ce3b0 0x7f17080ce820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f170806dfa0 tx=0x7f170001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc806e7eb5c0f7f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f1706ffd640 1 -- 172.21.15.133:0/3699667348 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000a59a0 con 0x7f17080ce3b0 2023-12-18T10:18:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f1706ffd640 1 -- 172.21.15.133:0/3699667348 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17000a5b00 con 0x7f17080ce3b0 2023-12-18T10:18:57.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f1706ffd640 1 -- 172.21.15.133:0/3699667348 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000a5e70 con 0x7f17080ce3b0 2023-12-18T10:18:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 -- 172.21.15.133:0/3699667348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17080ce3b0 msgr2=0x7f17080ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 --2- 172.21.15.133:0/3699667348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17080ce3b0 0x7f17080ce820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f170806dfa0 tx=0x7f170001c8e0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 -- 172.21.15.133:0/3699667348 shutdown_connections 2023-12-18T10:18:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 --2- 172.21.15.133:0/3699667348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17080ce3b0 0x7f17080ce820 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 --2- 172.21.15.133:0/3699667348 >> v2:172.21.15.142:3300/0 conn(0x7f1708070820 0x7f17080c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 -- 172.21.15.133:0/3699667348 >> 172.21.15.133:0/3699667348 conn(0x7f170806a2a0 msgr2=0x7f17080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 -- 172.21.15.133:0/3699667348 shutdown_connections 2023-12-18T10:18:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 -- 172.21.15.133:0/3699667348 wait complete. 2023-12-18T10:18:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 Processor -- start 2023-12-18T10:18:57.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.413+0000 7f170e266640 1 -- start start 2023-12-18T10:18:57.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1708070820 0x7f170815e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17080ce3b0 0x7f17081567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17081582d0 0x7f170815d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17080c3060 con 0x7f1708070820 2023-12-18T10:18:57.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170815ed20 con 0x7f17080ce3b0 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17080c2450 con 0x7f17081582d0 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1708070820 0x7f170815e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1708070820 0x7f170815e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51948/0 (socket says 172.21.15.133:51948) 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 -- 172.21.15.133:0/881110327 learned_addr learned my addr 172.21.15.133:0/881110327 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f17077fe640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17080ce3b0 0x7f17081567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 -- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17081582d0 msgr2=0x7f170815d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170c803640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17081582d0 0x7f170815d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17081582d0 0x7f170815d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 -- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17080ce3b0 msgr2=0x7f17081567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17080ce3b0 0x7f17081567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 -- 172.21.15.133:0/881110327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700009a70 con 0x7f1708070820 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f17077fe640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17080ce3b0 0x7f17081567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1707fff640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1708070820 0x7f170815e7e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c3c0 tx=0x7f16f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:57.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1704ff9640 1 -- 172.21.15.133:0/881110327 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8005cf0 con 0x7f1708070820 2023-12-18T10:18:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1704ff9640 1 -- 172.21.15.133:0/881110327 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8005e50 con 0x7f1708070820 2023-12-18T10:18:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1704ff9640 1 -- 172.21.15.133:0/881110327 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80072f0 con 0x7f1708070820 2023-12-18T10:18:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17080c2730 con 0x7f1708070820 2023-12-18T10:18:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17080c2cf0 con 0x7f1708070820 2023-12-18T10:18:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170804e000 con 0x7f1708070820 2023-12-18T10:18:57.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.417+0000 7f1704ff9640 1 -- 172.21.15.133:0/881110327 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f16f8007450 con 0x7f1708070820 2023-12-18T10:18:57.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.421+0000 7f1704ff9640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16f4065a60 0x7f16f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.421+0000 7f1704ff9640 1 -- 172.21.15.133:0/881110327 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f16f8082b40 con 0x7f1708070820 2023-12-18T10:18:57.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.421+0000 7f17077fe640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16f4065a60 0x7f16f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.421+0000 7f17077fe640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16f4065a60 0x7f16f4067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f17081f8120 tx=0x7f16fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:57.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.425+0000 7f1704ff9640 1 -- 172.21.15.133:0/881110327 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f16f8050120 con 0x7f1708070820 2023-12-18T10:18:57.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.573+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f17080b0c00 con 0x7f1708070820 2023-12-18T10:18:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.581+0000 7f1704ff9640 1 -- 172.21.15.133:0/881110327 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f16f8017070 con 0x7f1708070820 2023-12-18T10:18:57.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16f4065a60 msgr2=0x7f16f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16f4065a60 0x7f16f4067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f17081f8120 tx=0x7f16fc008040 comp rx=0 tx=0).stop 2023-12-18T10:18:57.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1708070820 msgr2=0x7f170815e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1708070820 0x7f170815e7e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f16f800c3c0 tx=0x7f16f800c880 comp rx=0 tx=0).stop 2023-12-18T10:18:57.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 shutdown_connections 2023-12-18T10:18:57.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16f4065a60 0x7f16f4067f20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f17081582d0 0x7f170815d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17080ce3b0 0x7f17081567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 --2- 172.21.15.133:0/881110327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1708070820 0x7f170815e7e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 >> 172.21.15.133:0/881110327 conn(0x7f170806a2a0 msgr2=0x7f17081578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 shutdown_connections 2023-12-18T10:18:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.585+0000 7f170e266640 1 -- 172.21.15.133:0/881110327 wait complete. 2023-12-18T10:18:57.607 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:18:57.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:18:57.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:18:57.742 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:18:57.742 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:18:57.743 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:18:57.752 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:18:57.752 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:18:57.802 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:18:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac193a2640 1 Processor -- start 2023-12-18T10:18:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac193a2640 1 -- start start 2023-12-18T10:18:57.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac193a2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac140ce400 0x7fac141601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac193a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac140ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac193a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac14160ba0 con 0x7fac140ce7e0 2023-12-18T10:18:57.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac193a2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac14161160 con 0x7fac140ce400 2023-12-18T10:18:57.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac193a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac14160e80 con 0x7fac14160700 2023-12-18T10:18:57.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac18ba1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fac140ce7e0 0x7fac140d02c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48354/0 (socket says 172.21.15.133:48354) 2023-12-18T10:18:57.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac13fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac140ce400 0x7fac141601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.981+0000 7fac18ba1640 1 -- 172.21.15.133:0/887834850 learned_addr learned my addr 172.21.15.133:0/887834850 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:57.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac137fe640 1 --2- 172.21.15.133:0/887834850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac140ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac12ffd640 1 -- 172.21.15.133:0/887834850 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247561075 0 0) 0x7fac14160ba0 con 0x7fac140ce7e0 2023-12-18T10:18:57.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac13fff640 1 -- 172.21.15.133:0/887834850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 msgr2=0x7fac140ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:57.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac13fff640 1 --2- 172.21.15.133:0/887834850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac140ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac13fff640 1 -- 172.21.15.133:0/887834850 >> v1:172.21.15.133:6789/0 conn(0x7fac140ce7e0 legacy=0x7fac140d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac13fff640 1 -- 172.21.15.133:0/887834850 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1406af50 con 0x7fac140ce400 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac13fff640 1 --2- 172.21.15.133:0/887834850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce400 0x7fac141601c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac040097c0 tx=0x7fac0401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd65465c124a7bb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac12ffd640 1 -- 172.21.15.133:0/887834850 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040ac640 con 0x7fac140ce400 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac12ffd640 1 -- 172.21.15.133:0/887834850 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040ac7a0 con 0x7fac140ce400 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.985+0000 7fac12ffd640 1 -- 172.21.15.133:0/887834850 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040acb30 con 0x7fac140ce400 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- 172.21.15.133:0/887834850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce400 msgr2=0x7fac141601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 --2- 172.21.15.133:0/887834850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce400 0x7fac141601c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac040097c0 tx=0x7fac0401c3c0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- 172.21.15.133:0/887834850 shutdown_connections 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 --2- 172.21.15.133:0/887834850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac140ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 --2- 172.21.15.133:0/887834850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce400 0x7fac141601c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- 172.21.15.133:0/887834850 >> 172.21.15.133:0/887834850 conn(0x7fac14069ca0 msgr2=0x7fac1406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- 172.21.15.133:0/887834850 shutdown_connections 2023-12-18T10:18:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- 172.21.15.133:0/887834850 wait complete. 2023-12-18T10:18:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 Processor -- start 2023-12-18T10:18:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- start start 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac140ce400 0x7fac141582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce7e0 0x7fac140ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac1415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac140af7f0 con 0x7fac140ce7e0 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac140aebe0 con 0x7fac140ce400 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac193a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac140aeec0 con 0x7fac14160700 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac137fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce7e0 0x7fac140ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac137fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce7e0 0x7fac140ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51968/0 (socket says 172.21.15.133:51968) 2023-12-18T10:18:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac137fe640 1 -- 172.21.15.133:0/3438103593 learned_addr learned my addr 172.21.15.133:0/3438103593 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac13fff640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac140ce400 0x7fac141582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac18ba1640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac1415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.989+0000 7fac137fe640 1 -- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 msgr2=0x7fac1415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac137fe640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac1415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac137fe640 1 -- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac140ce400 msgr2=0x7fac141582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac137fe640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac140ce400 0x7fac141582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac137fe640 1 -- 172.21.15.133:0/3438103593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac04009420 con 0x7fac140ce7e0 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac13fff640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac140ce400 0x7fac141582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac18ba1640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac1415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac137fe640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce7e0 0x7fac140ab8a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac0800d800 tx=0x7fac0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac10ff9640 1 -- 172.21.15.133:0/3438103593 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800b6c0 con 0x7fac140ce7e0 2023-12-18T10:18:57.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac10ff9640 1 -- 172.21.15.133:0/3438103593 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800b820 con 0x7fac140ce7e0 2023-12-18T10:18:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac10ff9640 1 -- 172.21.15.133:0/3438103593 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800bb90 con 0x7fac140ce7e0 2023-12-18T10:18:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac140af1a0 con 0x7fac140ce7e0 2023-12-18T10:18:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac14158800 con 0x7fac140ce7e0 2023-12-18T10:18:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1404e850 con 0x7fac140ce7e0 2023-12-18T10:18:57.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac10ff9640 1 -- 172.21.15.133:0/3438103593 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fac0800bcf0 con 0x7fac140ce7e0 2023-12-18T10:18:57.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac10ff9640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac00065a60 0x7fac00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:57.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac10ff9640 1 -- 172.21.15.133:0/3438103593 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac08083b40 con 0x7fac140ce7e0 2023-12-18T10:18:57.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.993+0000 7fac13fff640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac00065a60 0x7fac00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:57.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.997+0000 7fac13fff640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac00065a60 0x7fac00067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac040ae000 tx=0x7fac04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:58.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:57.997+0000 7fac10ff9640 1 -- 172.21.15.133:0/3438103593 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fac080510a0 con 0x7fac140ce7e0 2023-12-18T10:18:58.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:18:58.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:18:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac140b2810 con 0x7fac140ce7e0 2023-12-18T10:18:58.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac10ff9640 1 -- 172.21.15.133:0/3438103593 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7fac080546c0 con 0x7fac140ce7e0 2023-12-18T10:18:58.156 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:18:58.156 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:18:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac00065a60 msgr2=0x7fac00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac00065a60 0x7fac00067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac040ae000 tx=0x7fac04008040 comp rx=0 tx=0).stop 2023-12-18T10:18:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce7e0 msgr2=0x7fac140ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce7e0 0x7fac140ab8a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac0800d800 tx=0x7fac0800dcc0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 shutdown_connections 2023-12-18T10:18:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac00065a60 0x7fac00067f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac14160700 0x7fac1415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac140ce7e0 0x7fac140ab8a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 --2- 172.21.15.133:0/3438103593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac140ce400 0x7fac141582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 >> 172.21.15.133:0/3438103593 conn(0x7fac14069ca0 msgr2=0x7fac140c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 shutdown_connections 2023-12-18T10:18:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.153+0000 7fac193a2640 1 -- 172.21.15.133:0/3438103593 wait complete. 2023-12-18T10:18:58.178 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:18:58.178 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:18:58.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.353+0000 7f1884e8c640 1 Processor -- start 2023-12-18T10:18:58.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.353+0000 7f1884e8c640 1 -- start start 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f1884e8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f18801582d0 0x7f18800c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f1884e8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1880070820 0x7f18800ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f1884e8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18800ce3b0 0x7f18800ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f1884e8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18800ced80 con 0x7f18800ce3b0 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f1884e8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18800c9390 con 0x7f18801582d0 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f1884e8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188015aee0 con 0x7f1880070820 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18800ce3b0 0x7f18800ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18800ce3b0 0x7f18800ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51976/0 (socket says 172.21.15.133:51976) 2023-12-18T10:18:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187ed9d640 1 -- 172.21.15.133:0/2846329260 learned_addr learned my addr 172.21.15.133:0/2846329260 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187e59c640 1 --2- 172.21.15.133:0/2846329260 >> v2:172.21.15.142:3300/0 conn(0x7f18801582d0 0x7f18800c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f1875d9b640 1 --2- 172.21.15.133:0/2846329260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1880070820 0x7f18800ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187ed9d640 1 -- 172.21.15.133:0/2846329260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1880070820 msgr2=0x7f18800ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187ed9d640 1 --2- 172.21.15.133:0/2846329260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1880070820 0x7f18800ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187ed9d640 1 -- 172.21.15.133:0/2846329260 >> v2:172.21.15.142:3300/0 conn(0x7f18801582d0 msgr2=0x7f18800c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187ed9d640 1 --2- 172.21.15.133:0/2846329260 >> v2:172.21.15.142:3300/0 conn(0x7f18801582d0 0x7f18800c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.357+0000 7f187ed9d640 1 -- 172.21.15.133:0/2846329260 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188015b1c0 con 0x7f18800ce3b0 2023-12-18T10:18:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f187ed9d640 1 --2- 172.21.15.133:0/2846329260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18800ce3b0 0x7f18800ce840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f18800cf000 tx=0x7f187801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76bafaaa007d01e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:58.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f187dd9b640 1 -- 172.21.15.133:0/2846329260 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18780a5820 con 0x7f18800ce3b0 2023-12-18T10:18:58.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f187dd9b640 1 -- 172.21.15.133:0/2846329260 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18780a5980 con 0x7f18800ce3b0 2023-12-18T10:18:58.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f187dd9b640 1 -- 172.21.15.133:0/2846329260 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18780a5d10 con 0x7f18800ce3b0 2023-12-18T10:18:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 -- 172.21.15.133:0/2846329260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18800ce3b0 msgr2=0x7f18800ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 --2- 172.21.15.133:0/2846329260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18800ce3b0 0x7f18800ce840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f18800cf000 tx=0x7f187801c9a0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 -- 172.21.15.133:0/2846329260 shutdown_connections 2023-12-18T10:18:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 --2- 172.21.15.133:0/2846329260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18800ce3b0 0x7f18800ce840 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 --2- 172.21.15.133:0/2846329260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1880070820 0x7f18800ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 --2- 172.21.15.133:0/2846329260 >> v2:172.21.15.142:3300/0 conn(0x7f18801582d0 0x7f18800c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 -- 172.21.15.133:0/2846329260 >> 172.21.15.133:0/2846329260 conn(0x7f188006a2a0 msgr2=0x7f18800aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 -- 172.21.15.133:0/2846329260 shutdown_connections 2023-12-18T10:18:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 -- 172.21.15.133:0/2846329260 wait complete. 2023-12-18T10:18:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 Processor -- start 2023-12-18T10:18:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.361+0000 7f1884e8c640 1 -- start start 2023-12-18T10:18:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880070820 0x7f18800c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18800ce3b0 0x7f18800c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18801582d0 0x7f18800c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800c6750 con 0x7f18801582d0 2023-12-18T10:18:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800c6a30 con 0x7f1880070820 2023-12-18T10:18:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800c6d10 con 0x7f18800ce3b0 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18801582d0 0x7f18800c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18801582d0 0x7f18800c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51980/0 (socket says 172.21.15.133:51980) 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 -- 172.21.15.133:0/89804693 learned_addr learned my addr 172.21.15.133:0/89804693 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1875d9b640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18800ce3b0 0x7f18800c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187e59c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880070820 0x7f18800c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 -- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18800ce3b0 msgr2=0x7f18800c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18800ce3b0 0x7f18800c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 -- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880070820 msgr2=0x7f18800c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880070820 0x7f18800c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 -- 172.21.15.133:0/89804693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1878009b30 con 0x7f18801582d0 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1875d9b640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18800ce3b0 0x7f18800c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f187ed9d640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18801582d0 0x7f18800c5f00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f187801b050 tx=0x7f1878019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f18777fe640 1 -- 172.21.15.133:0/89804693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18780b8670 con 0x7f18801582d0 2023-12-18T10:18:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18800c6ff0 con 0x7f18801582d0 2023-12-18T10:18:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f18777fe640 1 -- 172.21.15.133:0/89804693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18780b87d0 con 0x7f18801582d0 2023-12-18T10:18:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f18777fe640 1 -- 172.21.15.133:0/89804693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18780b8b60 con 0x7f18801582d0 2023-12-18T10:18:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1880151b90 con 0x7f18801582d0 2023-12-18T10:18:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18800c7510 con 0x7f18801582d0 2023-12-18T10:18:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.365+0000 7f18777fe640 1 -- 172.21.15.133:0/89804693 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f18780b8cc0 con 0x7f18801582d0 2023-12-18T10:18:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.369+0000 7f18777fe640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1860065a60 0x7f1860067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.369+0000 7f18777fe640 1 -- 172.21.15.133:0/89804693 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f187811e960 con 0x7f18801582d0 2023-12-18T10:18:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.369+0000 7f187e59c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1860065a60 0x7f1860067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.369+0000 7f187e59c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1860065a60 0x7f1860067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1870009a40 tx=0x7f1870009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.373+0000 7f18777fe640 1 -- 172.21.15.133:0/89804693 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f18800c7510 con 0x7f18801582d0 2023-12-18T10:18:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.521+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18800c7510 con 0x7f18801582d0 2023-12-18T10:18:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.521+0000 7f18777fe640 1 -- 172.21.15.133:0/89804693 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18800c7510 con 0x7f18801582d0 2023-12-18T10:18:58.525 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1860065a60 msgr2=0x7f1860067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1860065a60 0x7f1860067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1870009a40 tx=0x7f1870009190 comp rx=0 tx=0).stop 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18801582d0 msgr2=0x7f18800c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18801582d0 0x7f18800c5f00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f187801b050 tx=0x7f1878019740 comp rx=0 tx=0).stop 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 shutdown_connections 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1860065a60 0x7f1860067f20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18801582d0 0x7f18800c5f00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18800ce3b0 0x7f18800c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 --2- 172.21.15.133:0/89804693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880070820 0x7f18800c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 >> 172.21.15.133:0/89804693 conn(0x7f188006a2a0 msgr2=0x7f18801586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 shutdown_connections 2023-12-18T10:18:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.525+0000 7f1884e8c640 1 -- 172.21.15.133:0/89804693 wait complete. 2023-12-18T10:18:58.546 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:18:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa155af2640 1 Processor -- start 2023-12-18T10:18:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa155af2640 1 -- start start 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa155af2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1501582d0 0x7fa1500c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa155af2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1500ce3b0 0x7fa1500ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa155af2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500c9390 con 0x7fa150070820 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa155af2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500ced80 con 0x7fa1501582d0 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa155af2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15015aee0 con 0x7fa1500ce3b0 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa14f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1501582d0 0x7fa1500c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa147fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa150070820 0x7fa1500ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48364/0 (socket says 172.21.15.133:48364) 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa147fff640 1 -- 172.21.15.133:0/2648291770 learned_addr learned my addr 172.21.15.133:0/2648291770 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa14ffff640 1 --2- 172.21.15.133:0/2648291770 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1500ce3b0 0x7fa1500ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa14f7fe640 1 -- 172.21.15.133:0/2648291770 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1500ce3b0 msgr2=0x7fa1500ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:58.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa14f7fe640 1 --2- 172.21.15.133:0/2648291770 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1500ce3b0 0x7fa1500ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa14f7fe640 1 -- 172.21.15.133:0/2648291770 >> v1:172.21.15.133:6789/0 conn(0x7fa150070820 legacy=0x7fa1500ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa14f7fe640 1 -- 172.21.15.133:0/2648291770 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15015b1c0 con 0x7fa1501582d0 2023-12-18T10:18:58.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.685+0000 7fa14effd640 1 -- 172.21.15.133:0/2648291770 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330378868 0 0) 0x7fa1500c9390 con 0x7fa150070820 2023-12-18T10:18:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa14f7fe640 1 --2- 172.21.15.133:0/2648291770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1500c8e50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa1400097c0 tx=0x7fa14001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42292f6db32e089d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa14effd640 1 -- 172.21.15.133:0/2648291770 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400ab650 con 0x7fa1501582d0 2023-12-18T10:18:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa14effd640 1 -- 172.21.15.133:0/2648291770 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1400ab7b0 con 0x7fa1501582d0 2023-12-18T10:18:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa14effd640 1 -- 172.21.15.133:0/2648291770 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400abb40 con 0x7fa1501582d0 2023-12-18T10:18:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa155af2640 1 -- 172.21.15.133:0/2648291770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 msgr2=0x7fa1500c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa155af2640 1 --2- 172.21.15.133:0/2648291770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1500c8e50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa1400097c0 tx=0x7fa14001c450 comp rx=0 tx=0).stop 2023-12-18T10:18:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa155af2640 1 -- 172.21.15.133:0/2648291770 shutdown_connections 2023-12-18T10:18:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa155af2640 1 --2- 172.21.15.133:0/2648291770 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1500ce3b0 0x7fa1500ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa155af2640 1 --2- 172.21.15.133:0/2648291770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1500c8e50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa155af2640 1 -- 172.21.15.133:0/2648291770 >> 172.21.15.133:0/2648291770 conn(0x7fa15006a2a0 msgr2=0x7fa1500aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa155af2640 1 -- 172.21.15.133:0/2648291770 shutdown_connections 2023-12-18T10:18:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.689+0000 7fa155af2640 1 -- 172.21.15.133:0/2648291770 wait complete. 2023-12-18T10:18:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 Processor -- start 2023-12-18T10:18:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 -- start start 2023-12-18T10:18:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa150070820 0x7fa1501640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1500ce3b0 0x7fa15015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1501596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15015ee20 con 0x7fa1501582d0 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15015d3e0 con 0x7fa1500ce3b0 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15015d6c0 con 0x7fa150070820 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1501596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1501596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51986/0 (socket says 172.21.15.133:51986) 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 -- 172.21.15.133:0/4016844258 learned_addr learned my addr 172.21.15.133:0/4016844258 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14f7fe640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa150070820 0x7fa1501640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa147fff640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1500ce3b0 0x7fa15015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 -- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa150070820 msgr2=0x7fa1501640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa150070820 0x7fa1501640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 -- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1500ce3b0 msgr2=0x7fa15015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1500ce3b0 0x7fa15015dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 -- 172.21.15.133:0/4016844258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140009420 con 0x7fa1501582d0 2023-12-18T10:18:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa147fff640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1500ce3b0 0x7fa15015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14ffff640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1501596e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa148007e40 tx=0x7fa14800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14cff9640 1 -- 172.21.15.133:0/4016844258 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148014620 con 0x7fa1501582d0 2023-12-18T10:18:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14cff9640 1 -- 172.21.15.133:0/4016844258 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14800ee90 con 0x7fa1501582d0 2023-12-18T10:18:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa14cff9640 1 -- 172.21.15.133:0/4016844258 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480149e0 con 0x7fa1501582d0 2023-12-18T10:18:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15015d9a0 con 0x7fa1501582d0 2023-12-18T10:18:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1501645f0 con 0x7fa1501582d0 2023-12-18T10:18:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.693+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15004e000 con 0x7fa1501582d0 2023-12-18T10:18:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.697+0000 7fa14cff9640 1 -- 172.21.15.133:0/4016844258 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa148014b40 con 0x7fa1501582d0 2023-12-18T10:18:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.697+0000 7fa14cff9640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa130065a60 0x7fa130067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.697+0000 7fa14cff9640 1 -- 172.21.15.133:0/4016844258 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa148083e30 con 0x7fa1501582d0 2023-12-18T10:18:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.697+0000 7fa14f7fe640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa130065a60 0x7fa130067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.697+0000 7fa14f7fe640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa130065a60 0x7fa130067f20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa1400af000 tx=0x7fa1400a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.701+0000 7fa14cff9640 1 -- 172.21.15.133:0/4016844258 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa148051390 con 0x7fa1501582d0 2023-12-18T10:18:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.849+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1501652f0 con 0x7fa1501582d0 2023-12-18T10:18:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.849+0000 7fa14cff9640 1 -- 172.21.15.133:0/4016844258 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1480549b0 con 0x7fa1501582d0 2023-12-18T10:18:58.853 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa130065a60 msgr2=0x7fa130067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa130065a60 0x7fa130067f20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa1400af000 tx=0x7fa1400a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 msgr2=0x7fa1501596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1501596e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa148007e40 tx=0x7fa14800e4b0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 shutdown_connections 2023-12-18T10:18:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa130065a60 0x7fa130067f20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1501582d0 0x7fa1501596e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1500ce3b0 0x7fa15015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 --2- 172.21.15.133:0/4016844258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa150070820 0x7fa1501640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 >> 172.21.15.133:0/4016844258 conn(0x7fa15006a2a0 msgr2=0x7fa1500c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 shutdown_connections 2023-12-18T10:18:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:58.853+0000 7fa155af2640 1 -- 172.21.15.133:0/4016844258 wait complete. 2023-12-18T10:18:58.874 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:18:59.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd70a08c640 1 Processor -- start 2023-12-18T10:18:59.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd70a08c640 1 -- start start 2023-12-18T10:18:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd70a08c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7041582d0 0x7fd7040c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd70a08c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7040ce3b0 0x7fd7040ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd70a08c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7040c9390 con 0x7fd704070820 2023-12-18T10:18:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd70a08c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7040ced80 con 0x7fd7041582d0 2023-12-18T10:18:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd70a08c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70415aee0 con 0x7fd7040ce3b0 2023-12-18T10:18:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd702ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd704070820 0x7fd7040ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48376/0 (socket says 172.21.15.133:48376) 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd702ffd640 1 -- 172.21.15.133:0/3744098584 learned_addr learned my addr 172.21.15.133:0/3744098584 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd7037fe640 1 --2- 172.21.15.133:0/3744098584 >> v2:172.21.15.142:3300/0 conn(0x7fd7041582d0 0x7fd7040c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd703fff640 1 --2- 172.21.15.133:0/3744098584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7040ce3b0 0x7fd7040ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd7027fc640 1 -- 172.21.15.133:0/3744098584 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845865791 0 0) 0x7fd7040c9390 con 0x7fd704070820 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd7027fc640 1 -- 172.21.15.133:0/3744098584 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ec003530 con 0x7fd704070820 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd7037fe640 1 -- 172.21.15.133:0/3744098584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7040ce3b0 msgr2=0x7fd7040ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd7037fe640 1 --2- 172.21.15.133:0/3744098584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7040ce3b0 0x7fd7040ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd7037fe640 1 -- 172.21.15.133:0/3744098584 >> v1:172.21.15.133:6789/0 conn(0x7fd704070820 legacy=0x7fd7040ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.013+0000 7fd7037fe640 1 -- 172.21.15.133:0/3744098584 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70415b1c0 con 0x7fd7041582d0 2023-12-18T10:18:59.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd7037fe640 1 --2- 172.21.15.133:0/3744098584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 0x7fd7040c8e50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40097c0 tx=0x7fd6f401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84c5ff15b2c61073 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd7027fc640 1 -- 172.21.15.133:0/3744098584 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40ab650 con 0x7fd7041582d0 2023-12-18T10:18:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd7027fc640 1 -- 172.21.15.133:0/3744098584 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f40ab7b0 con 0x7fd7041582d0 2023-12-18T10:18:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd7027fc640 1 -- 172.21.15.133:0/3744098584 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40abb40 con 0x7fd7041582d0 2023-12-18T10:18:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd70a08c640 1 -- 172.21.15.133:0/3744098584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 msgr2=0x7fd7040c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd70a08c640 1 --2- 172.21.15.133:0/3744098584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 0x7fd7040c8e50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40097c0 tx=0x7fd6f401c450 comp rx=0 tx=0).stop 2023-12-18T10:18:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd70a08c640 1 -- 172.21.15.133:0/3744098584 shutdown_connections 2023-12-18T10:18:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd70a08c640 1 --2- 172.21.15.133:0/3744098584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7040ce3b0 0x7fd7040ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd70a08c640 1 --2- 172.21.15.133:0/3744098584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 0x7fd7040c8e50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd70a08c640 1 -- 172.21.15.133:0/3744098584 >> 172.21.15.133:0/3744098584 conn(0x7fd70406a2a0 msgr2=0x7fd7040aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd70a08c640 1 -- 172.21.15.133:0/3744098584 shutdown_connections 2023-12-18T10:18:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.017+0000 7fd70a08c640 1 -- 172.21.15.133:0/3744098584 wait complete. 2023-12-18T10:18:59.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 Processor -- start 2023-12-18T10:18:59.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 -- start start 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd704070820 0x7fd70415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7040ce3b0 0x7fd7040c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 0x7fd7040cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7040c89b0 con 0x7fd7040ce3b0 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7040c86d0 con 0x7fd7041582d0 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7040c3100 con 0x7fd704070820 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7040ce3b0 0x7fd7040c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7040ce3b0 0x7fd7040c3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51992/0 (socket says 172.21.15.133:51992) 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 -- 172.21.15.133:0/1725723291 learned_addr learned my addr 172.21.15.133:0/1725723291 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd703fff640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 0x7fd7040cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd7037fe640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd704070820 0x7fd70415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 -- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd704070820 msgr2=0x7fd70415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd704070820 0x7fd70415dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 -- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 msgr2=0x7fd7040cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 0x7fd7040cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 -- 172.21.15.133:0/1725723291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4009420 con 0x7fd7040ce3b0 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd7037fe640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd704070820 0x7fd70415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd703fff640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 0x7fd7040cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd702ffd640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7040ce3b0 0x7fd7040c3be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c450 tx=0x7fd6f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd6ebfff640 1 -- 172.21.15.133:0/1725723291 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8005cf0 con 0x7fd7040ce3b0 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd6ebfff640 1 -- 172.21.15.133:0/1725723291 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8005e50 con 0x7fd7040ce3b0 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7040c33e0 con 0x7fd7040ce3b0 2023-12-18T10:18:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd6ebfff640 1 -- 172.21.15.133:0/1725723291 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8007290 con 0x7fd7040ce3b0 2023-12-18T10:18:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.021+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70415e140 con 0x7fd7040ce3b0 2023-12-18T10:18:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.025+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70404e000 con 0x7fd7040ce3b0 2023-12-18T10:18:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.025+0000 7fd6ebfff640 1 -- 172.21.15.133:0/1725723291 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd6f80073f0 con 0x7fd7040ce3b0 2023-12-18T10:18:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.025+0000 7fd6ebfff640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6f0065a60 0x7fd6f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.025+0000 7fd6ebfff640 1 -- 172.21.15.133:0/1725723291 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd6f8082b50 con 0x7fd7040ce3b0 2023-12-18T10:18:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.025+0000 7fd7037fe640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6f0065a60 0x7fd6f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.025+0000 7fd7037fe640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6f0065a60 0x7fd6f0067f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40af000 tx=0x7fd6f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.029+0000 7fd6ebfff640 1 -- 172.21.15.133:0/1725723291 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd6f8050140 con 0x7fd7040ce3b0 2023-12-18T10:18:59.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7040c3890 con 0x7fd7040ce3b0 2023-12-18T10:18:59.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd6ebfff640 1 -- 172.21.15.133:0/1725723291 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6f8017070 con 0x7fd7040ce3b0 2023-12-18T10:18:59.187 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:18:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6f0065a60 msgr2=0x7fd6f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6f0065a60 0x7fd6f0067f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40af000 tx=0x7fd6f40a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7040ce3b0 msgr2=0x7fd7040c3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7040ce3b0 0x7fd7040c3be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800c450 tx=0x7fd6f800c910 comp rx=0 tx=0).stop 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 shutdown_connections 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6f0065a60 0x7fd6f0067f20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7041582d0 0x7fd7040cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7040ce3b0 0x7fd7040c3be0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 --2- 172.21.15.133:0/1725723291 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd704070820 0x7fd70415dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 >> 172.21.15.133:0/1725723291 conn(0x7fd70406a2a0 msgr2=0x7fd7040ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 shutdown_connections 2023-12-18T10:18:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.185+0000 7fd70a08c640 1 -- 172.21.15.133:0/1725723291 wait complete. 2023-12-18T10:18:59.208 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:18:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c86e5640 1 Processor -- start 2023-12-18T10:18:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c86e5640 1 -- start start 2023-12-18T10:18:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c86e5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31c01582d0 0x7f31c00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c86e5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f31c00ce3b0 0x7f31c00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c86e5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c00c9390 con 0x7f31c0070820 2023-12-18T10:18:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c86e5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00ced60 con 0x7f31c01582d0 2023-12-18T10:18:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c86e5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c015aee0 con 0x7f31c00ce3b0 2023-12-18T10:18:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c6481640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31c01582d0 0x7f31c00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c5c80640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f31c0070820 0x7f31c00ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48384/0 (socket says 172.21.15.133:48384) 2023-12-18T10:18:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.349+0000 7f31c5c80640 1 -- 172.21.15.133:0/4106752151 learned_addr learned my addr 172.21.15.133:0/4106752151 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c6c82640 1 --2- 172.21.15.133:0/4106752151 >> v2:172.21.15.142:3300/0 conn(0x7f31c00ce3b0 0x7f31c00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c6481640 1 -- 172.21.15.133:0/4106752151 >> v2:172.21.15.142:3300/0 conn(0x7f31c00ce3b0 msgr2=0x7f31c00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c6481640 1 --2- 172.21.15.133:0/4106752151 >> v2:172.21.15.142:3300/0 conn(0x7f31c00ce3b0 0x7f31c00ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c6481640 1 -- 172.21.15.133:0/4106752151 >> v1:172.21.15.133:6789/0 conn(0x7f31c0070820 legacy=0x7f31c00ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c6481640 1 -- 172.21.15.133:0/4106752151 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c015b1c0 con 0x7f31c01582d0 2023-12-18T10:18:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c547f640 1 -- 172.21.15.133:0/4106752151 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097852983 0 0) 0x7f31c00c9390 con 0x7f31c0070820 2023-12-18T10:18:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c6481640 1 --2- 172.21.15.133:0/4106752151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c01582d0 0x7f31c00c8e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f31c006fbb0 tx=0x7f31bc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c203b8bf7ca0bd5b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c547f640 1 -- 172.21.15.133:0/4106752151 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0a7070 con 0x7f31c01582d0 2023-12-18T10:18:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c547f640 1 -- 172.21.15.133:0/4106752151 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0ab430 con 0x7f31c01582d0 2023-12-18T10:18:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.353+0000 7f31c547f640 1 -- 172.21.15.133:0/4106752151 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0ab7c0 con 0x7f31c01582d0 2023-12-18T10:18:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- 172.21.15.133:0/4106752151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c01582d0 msgr2=0x7f31c00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 --2- 172.21.15.133:0/4106752151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c01582d0 0x7f31c00c8e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f31c006fbb0 tx=0x7f31bc01c430 comp rx=0 tx=0).stop 2023-12-18T10:18:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- 172.21.15.133:0/4106752151 shutdown_connections 2023-12-18T10:18:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 --2- 172.21.15.133:0/4106752151 >> v2:172.21.15.142:3300/0 conn(0x7f31c00ce3b0 0x7f31c00ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 --2- 172.21.15.133:0/4106752151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c01582d0 0x7f31c00c8e50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- 172.21.15.133:0/4106752151 >> 172.21.15.133:0/4106752151 conn(0x7f31c006a2a0 msgr2=0x7f31c00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- 172.21.15.133:0/4106752151 shutdown_connections 2023-12-18T10:18:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- 172.21.15.133:0/4106752151 wait complete. 2023-12-18T10:18:59.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 Processor -- start 2023-12-18T10:18:59.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- start start 2023-12-18T10:18:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c0070820 0x7f31c0143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c00ce3b0 0x7f31c00c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c01582d0 0x7f31c00c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c6730 con 0x7f31c00ce3b0 2023-12-18T10:18:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c81b0 con 0x7f31c0070820 2023-12-18T10:18:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c86e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c6980 con 0x7f31c01582d0 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c5c80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c00ce3b0 0x7f31c00c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c5c80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c00ce3b0 0x7f31c00c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52016/0 (socket says 172.21.15.133:52016) 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c5c80640 1 -- 172.21.15.133:0/2071644793 learned_addr learned my addr 172.21.15.133:0/2071644793 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c6481640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c0070820 0x7f31c0143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c6c82640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c01582d0 0x7f31c00c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c5c80640 1 -- 172.21.15.133:0/2071644793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c01582d0 msgr2=0x7f31c00c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c5c80640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c01582d0 0x7f31c00c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c5c80640 1 -- 172.21.15.133:0/2071644793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c0070820 msgr2=0x7f31c0143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c5c80640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c0070820 0x7f31c0143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.357+0000 7f31c5c80640 1 -- 172.21.15.133:0/2071644793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc009420 con 0x7f31c00ce3b0 2023-12-18T10:18:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31c5c80640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c00ce3b0 0x7f31c00c9760 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f31b00011f0 tx=0x7f31b000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31b6ffd640 1 -- 172.21.15.133:0/2071644793 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00074e0 con 0x7f31c00ce3b0 2023-12-18T10:18:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31b6ffd640 1 -- 172.21.15.133:0/2071644793 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b0007640 con 0x7f31c00ce3b0 2023-12-18T10:18:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31b6ffd640 1 -- 172.21.15.133:0/2071644793 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b0004a10 con 0x7f31c00ce3b0 2023-12-18T10:18:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c00c6c60 con 0x7f31c00ce3b0 2023-12-18T10:18:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c0143b80 con 0x7f31c00ce3b0 2023-12-18T10:18:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c00c3760 con 0x7f31c00ce3b0 2023-12-18T10:18:59.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31b6ffd640 1 -- 172.21.15.133:0/2071644793 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31b0004b70 con 0x7f31c00ce3b0 2023-12-18T10:18:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31b6ffd640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31b6ffd640 1 -- 172.21.15.133:0/2071644793 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31b00826f0 con 0x7f31c00ce3b0 2023-12-18T10:18:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.361+0000 7f31c6481640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.365+0000 7f31c6481640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0af000 tx=0x7f31bc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.365+0000 7f31b6ffd640 1 -- 172.21.15.133:0/2071644793 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f31b004fe10 con 0x7f31c00ce3b0 2023-12-18T10:18:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.513+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f31c004e000 con 0x7f31c00ce3b0 2023-12-18T10:18:59.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31b6ffd640 1 -- 172.21.15.133:0/2071644793 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f31b00180a0 con 0x7f31c00ce3b0 2023-12-18T10:18:59.652 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:18:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 msgr2=0x7f31a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0af000 tx=0x7f31bc0a7000 comp rx=0 tx=0).stop 2023-12-18T10:18:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c00ce3b0 msgr2=0x7f31c00c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c00ce3b0 0x7f31c00c9760 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f31b00011f0 tx=0x7f31b000c9b0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 shutdown_connections 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f31a4065a60 0x7f31a4067f20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f31c01582d0 0x7f31c00c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31c00ce3b0 0x7f31c00c9760 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 --2- 172.21.15.133:0/2071644793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31c0070820 0x7f31c0143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 >> 172.21.15.133:0/2071644793 conn(0x7f31c006a2a0 msgr2=0x7f31c00c1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 shutdown_connections 2023-12-18T10:18:59.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.517+0000 7f31c86e5640 1 -- 172.21.15.133:0/2071644793 wait complete. 2023-12-18T10:18:59.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:18:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e48066640 1 Processor -- start 2023-12-18T10:18:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e48066640 1 -- start start 2023-12-18T10:18:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e48066640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e40160cc0 0x7f7e400cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e48066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e400c1280 0x7f7e400cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e48066640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4006fdb0 con 0x7f7e400c17d0 2023-12-18T10:18:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e48066640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e401654a0 con 0x7f7e40160cc0 2023-12-18T10:18:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e48066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e401610a0 con 0x7f7e400c1280 2023-12-18T10:18:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e46603640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7e400c17d0 0x7f7e4006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48388/0 (socket says 172.21.15.133:48388) 2023-12-18T10:18:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e46603640 1 -- 172.21.15.133:0/3076883228 learned_addr learned my addr 172.21.15.133:0/3076883228 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:18:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e45e02640 1 --2- 172.21.15.133:0/3076883228 >> v2:172.21.15.142:3300/0 conn(0x7f7e40160cc0 0x7f7e400cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e45601640 1 --2- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e400c1280 0x7f7e400cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e44e00640 1 -- 172.21.15.133:0/3076883228 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233825628 0 0) 0x7f7e4006fdb0 con 0x7f7e400c17d0 2023-12-18T10:18:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e44e00640 1 -- 172.21.15.133:0/3076883228 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2c003530 con 0x7f7e400c17d0 2023-12-18T10:18:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e45e02640 1 -- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e400c1280 msgr2=0x7f7e400cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:18:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e45e02640 1 --2- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e400c1280 0x7f7e400cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e45e02640 1 -- 172.21.15.133:0/3076883228 >> v1:172.21.15.133:6789/0 conn(0x7f7e400c17d0 legacy=0x7f7e4006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e45e02640 1 -- 172.21.15.133:0/3076883228 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400cb6b0 con 0x7f7e40160cc0 2023-12-18T10:18:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.793+0000 7f7e45601640 1 --2- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e400c1280 0x7f7e400cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:18:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e45e02640 1 --2- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e40160cc0 0x7f7e400cac30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0097f0 tx=0x7f7e3c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b698a55be4c0a915 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e44e00640 1 -- 172.21.15.133:0/3076883228 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0ab600 con 0x7f7e40160cc0 2023-12-18T10:18:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e44e00640 1 -- 172.21.15.133:0/3076883228 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c0a7050 con 0x7f7e40160cc0 2023-12-18T10:18:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e44e00640 1 -- 172.21.15.133:0/3076883228 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0ab980 con 0x7f7e40160cc0 2023-12-18T10:18:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e48066640 1 -- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e40160cc0 msgr2=0x7f7e400cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e48066640 1 --2- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e40160cc0 0x7f7e400cac30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0097f0 tx=0x7f7e3c01c3c0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e48066640 1 -- 172.21.15.133:0/3076883228 shutdown_connections 2023-12-18T10:18:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e48066640 1 --2- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e400c1280 0x7f7e400cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e48066640 1 --2- 172.21.15.133:0/3076883228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e40160cc0 0x7f7e400cac30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e48066640 1 -- 172.21.15.133:0/3076883228 >> 172.21.15.133:0/3076883228 conn(0x7f7e4006a3e0 msgr2=0x7f7e400afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e48066640 1 -- 172.21.15.133:0/3076883228 shutdown_connections 2023-12-18T10:18:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.797+0000 7f7e48066640 1 -- 172.21.15.133:0/3076883228 wait complete. 2023-12-18T10:18:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 Processor -- start 2023-12-18T10:18:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 -- start start 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e400c1280 0x7f7e40163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e400c17d0 0x7f7e40155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e40160cc0 0x7f7e401564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40163690 con 0x7f7e400c1280 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e401fd2a0 con 0x7f7e400c17d0 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40162cf0 con 0x7f7e40160cc0 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e400c1280 0x7f7e40163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e400c1280 0x7f7e40163ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52018/0 (socket says 172.21.15.133:52018) 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 -- 172.21.15.133:0/2825663170 learned_addr learned my addr 172.21.15.133:0/2825663170 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:18:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e46603640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e40160cc0 0x7f7e401564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45601640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e400c17d0 0x7f7e40155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 -- 172.21.15.133:0/2825663170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e40160cc0 msgr2=0x7f7e401564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e40160cc0 0x7f7e401564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 -- 172.21.15.133:0/2825663170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e400c17d0 msgr2=0x7f7e40155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e400c17d0 0x7f7e40155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 -- 172.21.15.133:0/2825663170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30009420 con 0x7f7e400c1280 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e45e02640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e400c1280 0x7f7e40163ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c019ff0 tx=0x7f7e3c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e367fc640 1 -- 172.21.15.133:0/2825663170 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0b4430 con 0x7f7e400c1280 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e367fc640 1 -- 172.21.15.133:0/2825663170 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c0b45b0 con 0x7f7e400c1280 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e367fc640 1 -- 172.21.15.133:0/2825663170 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0b4960 con 0x7f7e400c1280 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c009420 con 0x7f7e400c1280 2023-12-18T10:18:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.801+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e401632b0 con 0x7f7e400c1280 2023-12-18T10:18:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.805+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e400735b0 con 0x7f7e400c1280 2023-12-18T10:18:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.805+0000 7f7e367fc640 1 -- 172.21.15.133:0/2825663170 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e3c0b2040 con 0x7f7e400c1280 2023-12-18T10:18:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.805+0000 7f7e367fc640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e24065a60 0x7f7e24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:18:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.805+0000 7f7e367fc640 1 -- 172.21.15.133:0/2825663170 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e3c11d040 con 0x7f7e400c1280 2023-12-18T10:18:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.805+0000 7f7e45601640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e24065a60 0x7f7e24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:18:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.805+0000 7f7e45601640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e24065a60 0x7f7e24067f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7e400c54e0 tx=0x7f7e30009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:18:59.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.809+0000 7f7e367fc640 1 -- 172.21.15.133:0/2825663170 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7e3c0ea760 con 0x7f7e400c1280 2023-12-18T10:18:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.969+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e40163900 con 0x7f7e400c1280 2023-12-18T10:18:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e367fc640 1 -- 172.21.15.133:0/2825663170 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e3c0edd80 con 0x7f7e400c1280 2023-12-18T10:18:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:18:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e24065a60 msgr2=0x7f7e24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e24065a60 0x7f7e24067f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7e400c54e0 tx=0x7f7e30009190 comp rx=0 tx=0).stop 2023-12-18T10:18:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e400c1280 msgr2=0x7f7e40163ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:18:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e400c1280 0x7f7e40163ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c019ff0 tx=0x7f7e3c019160 comp rx=0 tx=0).stop 2023-12-18T10:18:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 shutdown_connections 2023-12-18T10:18:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e24065a60 0x7f7e24067f20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e40160cc0 0x7f7e401564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e400c17d0 0x7f7e40155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 --2- 172.21.15.133:0/2825663170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e400c1280 0x7f7e40163ab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:18:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 >> 172.21.15.133:0/2825663170 conn(0x7f7e4006a3e0 msgr2=0x7f7e40070270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:18:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 shutdown_connections 2023-12-18T10:18:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:18:59.973+0000 7f7e48066640 1 -- 172.21.15.133:0/2825663170 wait complete. 2023-12-18T10:18:59.996 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:18:59.996 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:00.005 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f45464fc640 1 Processor -- start 2023-12-18T10:19:00.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f45464fc640 1 -- start start 2023-12-18T10:19:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f45464fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4540158c20 0x7f4540070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f45464fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f454015c800 0x7f45400caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f45464fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45400cafb0 0x7f454006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f45464fc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45400cb440 con 0x7f4540158c20 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f45464fc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540070b80 con 0x7f45400cafb0 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f45464fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4540070e60 con 0x7f454015c800 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4540158c20 0x7f4540070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4540158c20 0x7f4540070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54406/0 (socket says 172.21.15.133:54406) 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453ffff640 1 -- 172.21.15.133:0/4157101280 learned_addr learned my addr 172.21.15.133:0/4157101280 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453f7fe640 1 --2- 172.21.15.133:0/4157101280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f454015c800 0x7f45400caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f4544a99640 1 --2- 172.21.15.133:0/4157101280 >> v2:172.21.15.142:3300/0 conn(0x7f45400cafb0 0x7f454006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453ffff640 1 -- 172.21.15.133:0/4157101280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f454015c800 msgr2=0x7f45400caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453ffff640 1 --2- 172.21.15.133:0/4157101280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f454015c800 0x7f45400caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453ffff640 1 -- 172.21.15.133:0/4157101280 >> v2:172.21.15.142:3300/0 conn(0x7f45400cafb0 msgr2=0x7f454006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453ffff640 1 --2- 172.21.15.133:0/4157101280 >> v2:172.21.15.142:3300/0 conn(0x7f45400cafb0 0x7f454006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453ffff640 1 -- 172.21.15.133:0/4157101280 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540071140 con 0x7f4540158c20 2023-12-18T10:19:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f453f7fe640 1 --2- 172.21.15.133:0/4157101280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f454015c800 0x7f45400caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.185+0000 7f4544a99640 1 --2- 172.21.15.133:0/4157101280 >> v2:172.21.15.142:3300/0 conn(0x7f45400cafb0 0x7f454006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f453ffff640 1 --2- 172.21.15.133:0/4157101280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4540158c20 0x7f4540070510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45400b44d0 tx=0x7f453001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6547ae5efa932 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f453effd640 1 -- 172.21.15.133:0/4157101280 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45300a7b20 con 0x7f4540158c20 2023-12-18T10:19:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f453effd640 1 -- 172.21.15.133:0/4157101280 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45300a7c80 con 0x7f4540158c20 2023-12-18T10:19:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f453effd640 1 -- 172.21.15.133:0/4157101280 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45300af440 con 0x7f4540158c20 2023-12-18T10:19:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 -- 172.21.15.133:0/4157101280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4540158c20 msgr2=0x7f4540070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 --2- 172.21.15.133:0/4157101280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4540158c20 0x7f4540070510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f45400b44d0 tx=0x7f453001eb10 comp rx=0 tx=0).stop 2023-12-18T10:19:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 -- 172.21.15.133:0/4157101280 shutdown_connections 2023-12-18T10:19:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 --2- 172.21.15.133:0/4157101280 >> v2:172.21.15.142:3300/0 conn(0x7f45400cafb0 0x7f454006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 --2- 172.21.15.133:0/4157101280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f454015c800 0x7f45400caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 --2- 172.21.15.133:0/4157101280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4540158c20 0x7f4540070510 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 -- 172.21.15.133:0/4157101280 >> 172.21.15.133:0/4157101280 conn(0x7f454006a3e0 msgr2=0x7f45400afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 -- 172.21.15.133:0/4157101280 shutdown_connections 2023-12-18T10:19:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.189+0000 7f45464fc640 1 -- 172.21.15.133:0/4157101280 wait complete. 2023-12-18T10:19:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 Processor -- start 2023-12-18T10:19:00.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 -- start start 2023-12-18T10:19:00.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45400cafb0 0x7f4540147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4540158c20 0x7f4540157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f454015c800 0x7f454014f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4540148b50 con 0x7f454015c800 2023-12-18T10:19:00.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b3030 con 0x7f45400cafb0 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b3310 con 0x7f4540158c20 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f454015c800 0x7f454014f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f454015c800 0x7f454014f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54418/0 (socket says 172.21.15.133:54418) 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 -- 172.21.15.133:0/3779842866 learned_addr learned my addr 172.21.15.133:0/3779842866 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f453ffff640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45400cafb0 0x7f4540147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f453f7fe640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4540158c20 0x7f4540157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 -- 172.21.15.133:0/3779842866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4540158c20 msgr2=0x7f4540157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4540158c20 0x7f4540157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 -- 172.21.15.133:0/3779842866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45400cafb0 msgr2=0x7f4540147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45400cafb0 0x7f4540147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 -- 172.21.15.133:0/3779842866 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453000b770 con 0x7f454015c800 2023-12-18T10:19:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f4544a99640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f454015c800 0x7f454014f9e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4538009fa0 tx=0x7f453800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f453cff9640 1 -- 172.21.15.133:0/3779842866 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538003ba0 con 0x7f454015c800 2023-12-18T10:19:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f453cff9640 1 -- 172.21.15.133:0/3779842866 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800f040 con 0x7f454015c800 2023-12-18T10:19:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f453cff9640 1 -- 172.21.15.133:0/3779842866 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538004030 con 0x7f454015c800 2023-12-18T10:19:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45400c8800 con 0x7f454015c800 2023-12-18T10:19:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45400b38d0 con 0x7f454015c800 2023-12-18T10:19:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.193+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45400735b0 con 0x7f454015c800 2023-12-18T10:19:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.197+0000 7f453cff9640 1 -- 172.21.15.133:0/3779842866 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4538004190 con 0x7f454015c800 2023-12-18T10:19:00.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.197+0000 7f453cff9640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f452c065a60 0x7f452c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.197+0000 7f453cff9640 1 -- 172.21.15.133:0/3779842866 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4538083870 con 0x7f454015c800 2023-12-18T10:19:00.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.197+0000 7f453ffff640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f452c065a60 0x7f452c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.197+0000 7f453ffff640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f452c065a60 0x7f452c067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45300b1000 tx=0x7f45300a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.201+0000 7f453cff9640 1 -- 172.21.15.133:0/3779842866 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4538050f10 con 0x7f454015c800 2023-12-18T10:19:00.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.353+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45400c8630 con 0x7f454015c800 2023-12-18T10:19:00.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f453cff9640 1 -- 172.21.15.133:0/3779842866 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f4538054530 con 0x7f454015c800 2023-12-18T10:19:00.359 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:00.360 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:00.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f452c065a60 msgr2=0x7f452c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f452c065a60 0x7f452c067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45300b1000 tx=0x7f45300a9070 comp rx=0 tx=0).stop 2023-12-18T10:19:00.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f454015c800 msgr2=0x7f454014f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f454015c800 0x7f454014f9e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4538009fa0 tx=0x7f453800d560 comp rx=0 tx=0).stop 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 shutdown_connections 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f452c065a60 0x7f452c067f20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f454015c800 0x7f454014f9e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4540158c20 0x7f4540157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 --2- 172.21.15.133:0/3779842866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45400cafb0 0x7f4540147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 >> 172.21.15.133:0/3779842866 conn(0x7f454006a3e0 msgr2=0x7f4540151400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 shutdown_connections 2023-12-18T10:19:00.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.357+0000 7f45464fc640 1 -- 172.21.15.133:0/3779842866 wait complete. 2023-12-18T10:19:00.381 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:19:00.381 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:00.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.517+0000 7f1c80666640 1 Processor -- start 2023-12-18T10:19:00.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c80666640 1 -- start start 2023-12-18T10:19:00.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c80666640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780ceaa0 0x7f1c78070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c80666640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780c9730 con 0x7f1c781598d0 2023-12-18T10:19:00.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c80666640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780c8e00 con 0x7f1c78153020 2023-12-18T10:19:00.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c80666640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780c90e0 con 0x7f1c780ceaa0 2023-12-18T10:19:00.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7dc01640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1c781598d0 0x7f1c780ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39724/0 (socket says 172.21.15.133:39724) 2023-12-18T10:19:00.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7dc01640 1 -- 172.21.15.133:0/1951733353 learned_addr learned my addr 172.21.15.133:0/1951733353 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:00.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7ec03640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780ceaa0 0x7f1c78070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764478595 0 0) 0x7f1c780c9730 con 0x7f1c781598d0 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c64003530 con 0x7f1c781598d0 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053716351 0 0) 0x7f1c780c8e00 con 0x7f1c78153020 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c780c9730 con 0x7f1c78153020 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1323558625 0 0) 0x7f1c64003530 con 0x7f1c781598d0 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780ceaa0 msgr2=0x7f1c78070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780ceaa0 0x7f1c78070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 >> v1:172.21.15.142:6789/0 conn(0x7f1c78153020 legacy=0x7f1c780c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780c93c0 con 0x7f1c781598d0 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f1c68001680 con 0x7f1c781598d0 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 >> v1:172.21.15.133:6789/0 conn(0x7f1c781598d0 legacy=0x7f1c780ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c64003b40 0x7f1c64003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780ceaa0 0x7f1c640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64004d10 0x7f1c64005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780c90e0 con 0x7f1c64003b40 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6400bb80 con 0x7f1c64004d10 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6400bd40 con 0x7f1c780ceaa0 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7e402640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c64003b40 0x7f1c64003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7dc01640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780ceaa0 0x7f1c640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7ec03640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64004d10 0x7f1c64005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7e402640 1 -- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780ceaa0 msgr2=0x7f1c640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7e402640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780ceaa0 0x7f1c640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7e402640 1 -- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64004d10 msgr2=0x7f1c64005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7e402640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64004d10 0x7f1c64005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.521+0000 7f1c7e402640 1 -- 172.21.15.133:0/1951733353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64003530 con 0x7f1c64003b40 2023-12-18T10:19:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.525+0000 7f1c7e402640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c64003b40 0x7f1c64003f40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1c740018d0 tx=0x7f1c7401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a42f4fa3acfea6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.525+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740052d0 con 0x7f1c64003b40 2023-12-18T10:19:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.525+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74005450 con 0x7f1c64003b40 2023-12-18T10:19:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.525+0000 7f1c7d400640 1 -- 172.21.15.133:0/1951733353 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c74003840 con 0x7f1c64003b40 2023-12-18T10:19:00.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.525+0000 7f1c80666640 1 -- 172.21.15.133:0/1951733353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c64003b40 msgr2=0x7f1c64003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.525+0000 7f1c80666640 1 --2- 172.21.15.133:0/1951733353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c64003b40 0x7f1c64003f40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1c740018d0 tx=0x7f1c7401c560 comp rx=0 tx=0).stop 2023-12-18T10:19:00.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.525+0000 7f1c7ec03640 1 -- 172.21.15.133:0/1951733353 reap_dead start 2023-12-18T10:19:00.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 -- 172.21.15.133:0/1951733353 shutdown_connections 2023-12-18T10:19:00.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 -- 172.21.15.133:0/1951733353 >> 172.21.15.133:0/1951733353 conn(0x7f1c7806a2a0 msgr2=0x7f1c780aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:00.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 -- 172.21.15.133:0/1951733353 shutdown_connections 2023-12-18T10:19:00.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 -- 172.21.15.133:0/1951733353 wait complete. 2023-12-18T10:19:00.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 Processor -- start 2023-12-18T10:19:00.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 -- start start 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64003b40 0x7f1c7814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c780b2d60 0x7f1c780b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780af120 0x7f1c780af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780b3720 con 0x7f1c780b2d60 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780afae0 con 0x7f1c64003b40 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c80666640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780cde20 con 0x7f1c780af120 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7dc01640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c780b2d60 0x7f1c780b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7dc01640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c780b2d60 0x7f1c780b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54436/0 (socket says 172.21.15.133:54436) 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7dc01640 1 -- 172.21.15.133:0/974706355 learned_addr learned my addr 172.21.15.133:0/974706355 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7e402640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64003b40 0x7f1c7814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7ec03640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780af120 0x7f1c780af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7dc01640 1 -- 172.21.15.133:0/974706355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780af120 msgr2=0x7f1c780af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7dc01640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780af120 0x7f1c780af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7dc01640 1 -- 172.21.15.133:0/974706355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64003b40 msgr2=0x7f1c7814b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7dc01640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64003b40 0x7f1c7814b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.529+0000 7f1c7dc01640 1 -- 172.21.15.133:0/974706355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7814c750 con 0x7f1c780b2d60 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c7dc01640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c780b2d60 0x7f1c780b31e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1c68007310 tx=0x7f1c680077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c6effd640 1 -- 172.21.15.133:0/974706355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68001660 con 0x7f1c780b2d60 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c6effd640 1 -- 172.21.15.133:0/974706355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6800f9c0 con 0x7f1c780b2d60 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c6effd640 1 -- 172.21.15.133:0/974706355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800fd50 con 0x7f1c780b2d60 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780ce070 con 0x7f1c780b2d60 2023-12-18T10:19:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c780ce630 con 0x7f1c780b2d60 2023-12-18T10:19:00.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7804e000 con 0x7f1c780b2d60 2023-12-18T10:19:00.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c6effd640 1 -- 172.21.15.133:0/974706355 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1c6801d460 con 0x7f1c780b2d60 2023-12-18T10:19:00.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c6effd640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c5c065a60 0x7f1c5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c6effd640 1 -- 172.21.15.133:0/974706355 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c680835a0 con 0x7f1c780b2d60 2023-12-18T10:19:00.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.533+0000 7f1c7e402640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c5c065a60 0x7f1c5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.537+0000 7f1c7e402640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c5c065a60 0x7f1c5c067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c740ad000 tx=0x7f1c740a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.537+0000 7f1c6effd640 1 -- 172.21.15.133:0/974706355 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1c68050d00 con 0x7f1c780b2d60 2023-12-18T10:19:00.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c781526f0 con 0x7f1c780b2d60 2023-12-18T10:19:00.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c6effd640 1 -- 172.21.15.133:0/974706355 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c68054320 con 0x7f1c780b2d60 2023-12-18T10:19:00.692 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:00.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c5c065a60 msgr2=0x7f1c5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c5c065a60 0x7f1c5c067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c740ad000 tx=0x7f1c740a7000 comp rx=0 tx=0).stop 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c780b2d60 msgr2=0x7f1c780b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c780b2d60 0x7f1c780b31e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1c68007310 tx=0x7f1c680077d0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 shutdown_connections 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c5c065a60 0x7f1c5c067f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c780af120 0x7f1c780af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c780b2d60 0x7f1c780b31e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 --2- 172.21.15.133:0/974706355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c64003b40 0x7f1c7814b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 >> 172.21.15.133:0/974706355 conn(0x7f1c7806a2a0 msgr2=0x7f1c7815b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 shutdown_connections 2023-12-18T10:19:00.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.689+0000 7f1c80666640 1 -- 172.21.15.133:0/974706355 wait complete. 2023-12-18T10:19:00.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:19:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c55d09640 1 Processor -- start 2023-12-18T10:19:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c55d09640 1 -- start start 2023-12-18T10:19:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c55d09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c501582d0 0x7f7c500c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c55d09640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c50070820 0x7f7c500ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c55d09640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c500c9390 con 0x7f7c500ce3b0 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c55d09640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5015aee0 con 0x7f7c50070820 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c55d09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5015b1c0 con 0x7f7c501582d0 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c4effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c50070820 0x7f7c500ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c4effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c50070820 0x7f7c500ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54452/0 (socket says 172.21.15.133:54452) 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.849+0000 7f7c4effd640 1 -- 172.21.15.133:0/1470999382 learned_addr learned my addr 172.21.15.133:0/1470999382 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4f7fe640 1 --2- 172.21.15.133:0/1470999382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c501582d0 0x7f7c500c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4effd640 1 -- 172.21.15.133:0/1470999382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c501582d0 msgr2=0x7f7c500c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4effd640 1 --2- 172.21.15.133:0/1470999382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c501582d0 0x7f7c500c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4effd640 1 -- 172.21.15.133:0/1470999382 >> v1:172.21.15.142:6789/0 conn(0x7f7c500ce3b0 legacy=0x7f7c500cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4effd640 1 -- 172.21.15.133:0/1470999382 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5015b4a0 con 0x7f7c50070820 2023-12-18T10:19:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4f7fe640 1 --2- 172.21.15.133:0/1470999382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c501582d0 0x7f7c500c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4effd640 1 --2- 172.21.15.133:0/1470999382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c50070820 0x7f7c500ca5f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009870 tx=0x7f7c4401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e09b00c43e543f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4e7fc640 1 -- 172.21.15.133:0/1470999382 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440a95f0 con 0x7f7c50070820 2023-12-18T10:19:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4e7fc640 1 -- 172.21.15.133:0/1470999382 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440a9750 con 0x7f7c50070820 2023-12-18T10:19:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c4e7fc640 1 -- 172.21.15.133:0/1470999382 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440a9ae0 con 0x7f7c50070820 2023-12-18T10:19:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c55d09640 1 -- 172.21.15.133:0/1470999382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c50070820 msgr2=0x7f7c500ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.853+0000 7f7c55d09640 1 --2- 172.21.15.133:0/1470999382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c50070820 0x7f7c500ca5f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009870 tx=0x7f7c4401c510 comp rx=0 tx=0).stop 2023-12-18T10:19:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 -- 172.21.15.133:0/1470999382 shutdown_connections 2023-12-18T10:19:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 --2- 172.21.15.133:0/1470999382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c50070820 0x7f7c500ca5f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 --2- 172.21.15.133:0/1470999382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c501582d0 0x7f7c500c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 -- 172.21.15.133:0/1470999382 >> 172.21.15.133:0/1470999382 conn(0x7f7c5006a2a0 msgr2=0x7f7c500aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 -- 172.21.15.133:0/1470999382 shutdown_connections 2023-12-18T10:19:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 -- 172.21.15.133:0/1470999382 wait complete. 2023-12-18T10:19:00.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 Processor -- start 2023-12-18T10:19:00.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 -- start start 2023-12-18T10:19:00.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c50070820 0x7f7c500c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c500ce3b0 0x7f7c5015e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c501582d0 0x7f7c500c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500c5070 con 0x7f7c500ce3b0 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5015c120 con 0x7f7c501582d0 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c55d09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5015c400 con 0x7f7c50070820 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c500ce3b0 0x7f7c5015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c500ce3b0 0x7f7c5015e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54466/0 (socket says 172.21.15.133:54466) 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4effd640 1 -- 172.21.15.133:0/968886284 learned_addr learned my addr 172.21.15.133:0/968886284 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4f7fe640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c50070820 0x7f7c500c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4ffff640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c501582d0 0x7f7c500c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4effd640 1 -- 172.21.15.133:0/968886284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c50070820 msgr2=0x7f7c500c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4effd640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c50070820 0x7f7c500c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4effd640 1 -- 172.21.15.133:0/968886284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c501582d0 msgr2=0x7f7c500c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4effd640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c501582d0 0x7f7c500c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:00.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.857+0000 7f7c4effd640 1 -- 172.21.15.133:0/968886284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440094d0 con 0x7f7c500ce3b0 2023-12-18T10:19:00.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c4effd640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c500ce3b0 0x7f7c5015e830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7c440ab040 tx=0x7f7c4401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c37fff640 1 -- 172.21.15.133:0/968886284 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440a95f0 con 0x7f7c500ce3b0 2023-12-18T10:19:00.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c37fff640 1 -- 172.21.15.133:0/968886284 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440b1820 con 0x7f7c500ce3b0 2023-12-18T10:19:00.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5015c6e0 con 0x7f7c500ce3b0 2023-12-18T10:19:00.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c37fff640 1 -- 172.21.15.133:0/968886284 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440b1bd0 con 0x7f7c500ce3b0 2023-12-18T10:19:00.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5015ed70 con 0x7f7c500ce3b0 2023-12-18T10:19:00.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5015d0c0 con 0x7f7c500ce3b0 2023-12-18T10:19:00.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c37fff640 1 -- 172.21.15.133:0/968886284 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c440b1d30 con 0x7f7c500ce3b0 2023-12-18T10:19:00.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c37fff640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c3c065a60 0x7f7c3c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:00.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c37fff640 1 -- 172.21.15.133:0/968886284 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c4411e160 con 0x7f7c500ce3b0 2023-12-18T10:19:00.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c4f7fe640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c3c065a60 0x7f7c3c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:00.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.861+0000 7f7c4f7fe640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c3c065a60 0x7f7c3c067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7c40006e90 tx=0x7f7c40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:00.865+0000 7f7c37fff640 1 -- 172.21.15.133:0/968886284 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c440eb770 con 0x7f7c500ce3b0 2023-12-18T10:19:01.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.013+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c5015cee0 con 0x7f7c500ce3b0 2023-12-18T10:19:01.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.013+0000 7f7c37fff640 1 -- 172.21.15.133:0/968886284 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c5015cee0 con 0x7f7c500ce3b0 2023-12-18T10:19:01.017 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c3c065a60 msgr2=0x7f7c3c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c3c065a60 0x7f7c3c067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7c40006e90 tx=0x7f7c40008040 comp rx=0 tx=0).stop 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c500ce3b0 msgr2=0x7f7c5015e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c500ce3b0 0x7f7c5015e830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7c440ab040 tx=0x7f7c4401ad50 comp rx=0 tx=0).stop 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 shutdown_connections 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c3c065a60 0x7f7c3c067f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c501582d0 0x7f7c500c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c500ce3b0 0x7f7c5015e830 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 --2- 172.21.15.133:0/968886284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c50070820 0x7f7c500c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 >> 172.21.15.133:0/968886284 conn(0x7f7c5006a2a0 msgr2=0x7f7c500af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:01.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 shutdown_connections 2023-12-18T10:19:01.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.017+0000 7f7c55d09640 1 -- 172.21.15.133:0/968886284 wait complete. 2023-12-18T10:19:01.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:19:01.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b42b98640 1 Processor -- start 2023-12-18T10:19:01.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b42b98640 1 -- start start 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b42b98640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b3c0ca410 0x7f8b3c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b42b98640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b3c159fb0 0x7f8b3c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b42b98640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3c070df0 con 0x7f8b3c071db0 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b42b98640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c15aab0 con 0x7f8b3c0ca410 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b42b98640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c15a4f0 con 0x7f8b3c159fb0 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b40934640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b3c0ca410 0x7f8b3c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b40934640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b3c0ca410 0x7f8b3c159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54478/0 (socket says 172.21.15.133:54478) 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b40934640 1 -- 172.21.15.133:0/605418644 learned_addr learned my addr 172.21.15.133:0/605418644 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:01.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b33fff640 1 --2- 172.21.15.133:0/605418644 >> v2:172.21.15.142:3300/0 conn(0x7f8b3c159fb0 0x7f8b3c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b40934640 1 -- 172.21.15.133:0/605418644 >> v2:172.21.15.142:3300/0 conn(0x7f8b3c159fb0 msgr2=0x7f8b3c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:01.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b40934640 1 --2- 172.21.15.133:0/605418644 >> v2:172.21.15.142:3300/0 conn(0x7f8b3c159fb0 0x7f8b3c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b40934640 1 -- 172.21.15.133:0/605418644 >> v1:172.21.15.142:6789/0 conn(0x7f8b3c071db0 legacy=0x7f8b3c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.177+0000 7f8b40934640 1 -- 172.21.15.133:0/605418644 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c15a7d0 con 0x7f8b3c0ca410 2023-12-18T10:19:01.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b40934640 1 --2- 172.21.15.133:0/605418644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c0ca410 0x7f8b3c159a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0cbeb0 tx=0x7f8b3801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5a0636e136c25e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b337fe640 1 -- 172.21.15.133:0/605418644 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380a7b80 con 0x7f8b3c0ca410 2023-12-18T10:19:01.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b337fe640 1 -- 172.21.15.133:0/605418644 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b380a7ce0 con 0x7f8b3c0ca410 2023-12-18T10:19:01.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b337fe640 1 -- 172.21.15.133:0/605418644 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380af660 con 0x7f8b3c0ca410 2023-12-18T10:19:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b42b98640 1 -- 172.21.15.133:0/605418644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c0ca410 msgr2=0x7f8b3c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b42b98640 1 --2- 172.21.15.133:0/605418644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c0ca410 0x7f8b3c159a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0cbeb0 tx=0x7f8b3801eba0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b42b98640 1 -- 172.21.15.133:0/605418644 shutdown_connections 2023-12-18T10:19:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b42b98640 1 --2- 172.21.15.133:0/605418644 >> v2:172.21.15.142:3300/0 conn(0x7f8b3c159fb0 0x7f8b3c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b42b98640 1 --2- 172.21.15.133:0/605418644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c0ca410 0x7f8b3c159a70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b42b98640 1 -- 172.21.15.133:0/605418644 >> 172.21.15.133:0/605418644 conn(0x7f8b3c06a2a0 msgr2=0x7f8b3c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b42b98640 1 -- 172.21.15.133:0/605418644 shutdown_connections 2023-12-18T10:19:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.181+0000 7f8b42b98640 1 -- 172.21.15.133:0/605418644 wait complete. 2023-12-18T10:19:01.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 Processor -- start 2023-12-18T10:19:01.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 -- start start 2023-12-18T10:19:01.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3c071db0 0x7f8b3c1477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3c0ca410 0x7f8b3c152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c159fb0 0x7f8b3c152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0c6c60 con 0x7f8b3c159fb0 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0c6eb0 con 0x7f8b3c071db0 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0c7190 con 0x7f8b3c0ca410 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c159fb0 0x7f8b3c152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c159fb0 0x7f8b3c152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54488/0 (socket says 172.21.15.133:54488) 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 -- 172.21.15.133:0/2257626964 learned_addr learned my addr 172.21.15.133:0/2257626964 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b40934640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3c071db0 0x7f8b3c1477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b33fff640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3c0ca410 0x7f8b3c152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 -- 172.21.15.133:0/2257626964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3c0ca410 msgr2=0x7f8b3c152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3c0ca410 0x7f8b3c152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 -- 172.21.15.133:0/2257626964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3c071db0 msgr2=0x7f8b3c1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3c071db0 0x7f8b3c1477b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 -- 172.21.15.133:0/2257626964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3800b770 con 0x7f8b3c159fb0 2023-12-18T10:19:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b41135640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c159fb0 0x7f8b3c152980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c730 tx=0x7f8b3400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b317fa640 1 -- 172.21.15.133:0/2257626964 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34003b80 con 0x7f8b3c159fb0 2023-12-18T10:19:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b317fa640 1 -- 172.21.15.133:0/2257626964 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b34003ce0 con 0x7f8b3c159fb0 2023-12-18T10:19:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c0c7470 con 0x7f8b3c159fb0 2023-12-18T10:19:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b317fa640 1 -- 172.21.15.133:0/2257626964 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400aa30 con 0x7f8b3c159fb0 2023-12-18T10:19:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.185+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c147cf0 con 0x7f8b3c159fb0 2023-12-18T10:19:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.189+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c147eb0 con 0x7f8b3c159fb0 2023-12-18T10:19:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.189+0000 7f8b317fa640 1 -- 172.21.15.133:0/2257626964 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8b3400ab90 con 0x7f8b3c159fb0 2023-12-18T10:19:01.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.189+0000 7f8b317fa640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8b28065a90 0x7f8b28067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.189+0000 7f8b317fa640 1 -- 172.21.15.133:0/2257626964 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8b340831e0 con 0x7f8b3c159fb0 2023-12-18T10:19:01.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.189+0000 7f8b40934640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8b28065a90 0x7f8b28067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.189+0000 7f8b40934640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8b28065a90 0x7f8b28067f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8b380b1000 tx=0x7f8b380a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.193+0000 7f8b317fa640 1 -- 172.21.15.133:0/2257626964 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8b340507d0 con 0x7f8b3c159fb0 2023-12-18T10:19:01.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.345+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b3c04e000 con 0x7f8b3c159fb0 2023-12-18T10:19:01.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b317fa640 1 -- 172.21.15.133:0/2257626964 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b34053df0 con 0x7f8b3c159fb0 2023-12-18T10:19:01.351 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:19:01.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8b28065a90 msgr2=0x7f8b28067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8b28065a90 0x7f8b28067f50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8b380b1000 tx=0x7f8b380a9070 comp rx=0 tx=0).stop 2023-12-18T10:19:01.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c159fb0 msgr2=0x7f8b3c152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c159fb0 0x7f8b3c152980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c730 tx=0x7f8b3400cbf0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 shutdown_connections 2023-12-18T10:19:01.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8b28065a90 0x7f8b28067f50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b3c159fb0 0x7f8b3c152980 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b3c0ca410 0x7f8b3c152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 --2- 172.21.15.133:0/2257626964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b3c071db0 0x7f8b3c1477b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 >> 172.21.15.133:0/2257626964 conn(0x7f8b3c06a2a0 msgr2=0x7f8b3c0c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:01.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 shutdown_connections 2023-12-18T10:19:01.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.349+0000 7f8b42b98640 1 -- 172.21.15.133:0/2257626964 wait complete. 2023-12-18T10:19:01.372 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:19:01.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe7068b6640 1 Processor -- start 2023-12-18T10:19:01.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe7068b6640 1 -- start start 2023-12-18T10:19:01.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe7068b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe700071870 0x7fe700071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe7068b6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe700070df0 con 0x7fe7000cbff0 2023-12-18T10:19:01.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe7068b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70015a4f0 con 0x7fe7000ca410 2023-12-18T10:19:01.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe7068b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70015aab0 con 0x7fe700071870 2023-12-18T10:19:01.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe6ff7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe700071870 0x7fe700071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe704e53640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe7000cbff0 0x7fe7000ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39736/0 (socket says 172.21.15.133:39736) 2023-12-18T10:19:01.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe704e53640 1 -- 172.21.15.133:0/2107492885 learned_addr learned my addr 172.21.15.133:0/2107492885 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:01.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe6feffd640 1 -- 172.21.15.133:0/2107492885 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586727240 0 0) 0x7fe700070df0 con 0x7fe7000cbff0 2023-12-18T10:19:01.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe6feffd640 1 -- 172.21.15.133:0/2107492885 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6e8003530 con 0x7fe7000cbff0 2023-12-18T10:19:01.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe6ff7fe640 1 -- 172.21.15.133:0/2107492885 >> v1:172.21.15.142:6789/0 conn(0x7fe7000ca410 legacy=0x7fe700159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe6ff7fe640 1 -- 172.21.15.133:0/2107492885 >> v1:172.21.15.133:6789/0 conn(0x7fe7000cbff0 legacy=0x7fe7000ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.509+0000 7fe6ff7fe640 1 -- 172.21.15.133:0/2107492885 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70015a7d0 con 0x7fe700071870 2023-12-18T10:19:01.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe6ff7fe640 1 --2- 172.21.15.133:0/2107492885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe700071870 0x7fe700071d00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40097c0 tx=0x7fe6f401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d97a01c24eb3ef server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe6feffd640 1 -- 172.21.15.133:0/2107492885 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40ab650 con 0x7fe700071870 2023-12-18T10:19:01.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe6feffd640 1 -- 172.21.15.133:0/2107492885 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40ab7b0 con 0x7fe700071870 2023-12-18T10:19:01.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe6feffd640 1 -- 172.21.15.133:0/2107492885 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40abb40 con 0x7fe700071870 2023-12-18T10:19:01.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe7068b6640 1 -- 172.21.15.133:0/2107492885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe700071870 msgr2=0x7fe700071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe7068b6640 1 --2- 172.21.15.133:0/2107492885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe700071870 0x7fe700071d00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40097c0 tx=0x7fe6f401c450 comp rx=0 tx=0).stop 2023-12-18T10:19:01.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe7068b6640 1 -- 172.21.15.133:0/2107492885 shutdown_connections 2023-12-18T10:19:01.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe7068b6640 1 --2- 172.21.15.133:0/2107492885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe700071870 0x7fe700071d00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe7068b6640 1 -- 172.21.15.133:0/2107492885 >> 172.21.15.133:0/2107492885 conn(0x7fe70006a2a0 msgr2=0x7fe7000aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:01.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe7068b6640 1 -- 172.21.15.133:0/2107492885 shutdown_connections 2023-12-18T10:19:01.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.513+0000 7fe7068b6640 1 -- 172.21.15.133:0/2107492885 wait complete. 2023-12-18T10:19:01.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 Processor -- start 2023-12-18T10:19:01.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 -- start start 2023-12-18T10:19:01.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe700071870 0x7fe700154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7000ca410 0x7fe7000aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7000cbff0 0x7fe7000b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70014ee30 con 0x7fe7000ca410 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70014e220 con 0x7fe700071870 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70014e500 con 0x7fe7000cbff0 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7000ca410 0x7fe7000aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7000ca410 0x7fe7000aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54494/0 (socket says 172.21.15.133:54494) 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 -- 172.21.15.133:0/3899165879 learned_addr learned my addr 172.21.15.133:0/3899165879 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6fffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe700071870 0x7fe700154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe704e53640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7000cbff0 0x7fe7000b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 -- 172.21.15.133:0/3899165879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7000cbff0 msgr2=0x7fe7000b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7000cbff0 0x7fe7000b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 -- 172.21.15.133:0/3899165879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe700071870 msgr2=0x7fe700154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe700071870 0x7fe700154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 -- 172.21.15.133:0/3899165879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f4009420 con 0x7fe7000ca410 2023-12-18T10:19:01.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe704e53640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7000cbff0 0x7fe7000b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:01.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6ff7fe640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7000ca410 0x7fe7000aff70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40ad040 tx=0x7fe6f401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6fcff9640 1 -- 172.21.15.133:0/3899165879 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40bf610 con 0x7fe7000ca410 2023-12-18T10:19:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6fcff9640 1 -- 172.21.15.133:0/3899165879 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f40bf790 con 0x7fe7000ca410 2023-12-18T10:19:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe6fcff9640 1 -- 172.21.15.133:0/3899165879 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f40bfb40 con 0x7fe7000ca410 2023-12-18T10:19:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000cc960 con 0x7fe7000ca410 2023-12-18T10:19:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70014eac0 con 0x7fe7000ca410 2023-12-18T10:19:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.517+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70014ec50 con 0x7fe7000ca410 2023-12-18T10:19:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.521+0000 7fe6fcff9640 1 -- 172.21.15.133:0/3899165879 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe6f40b5400 con 0x7fe7000ca410 2023-12-18T10:19:01.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.521+0000 7fe6fcff9640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6ec065a60 0x7fe6ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.521+0000 7fe6fcff9640 1 -- 172.21.15.133:0/3899165879 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe6f411df60 con 0x7fe7000ca410 2023-12-18T10:19:01.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.521+0000 7fe6fffff640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6ec065a60 0x7fe6ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.521+0000 7fe6fffff640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6ec065a60 0x7fe6ec067f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007fd0 tx=0x7fe6f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.525+0000 7fe6fcff9640 1 -- 172.21.15.133:0/3899165879 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe6f40eb570 con 0x7fe7000ca410 2023-12-18T10:19:01.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.677+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe70004e000 con 0x7fe7000ca410 2023-12-18T10:19:01.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.677+0000 7fe6fcff9640 1 -- 172.21.15.133:0/3899165879 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe6f40eeb90 con 0x7fe7000ca410 2023-12-18T10:19:01.682 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6ec065a60 msgr2=0x7fe6ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6ec065a60 0x7fe6ec067f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007fd0 tx=0x7fe6f0009040 comp rx=0 tx=0).stop 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7000ca410 msgr2=0x7fe7000aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7000ca410 0x7fe7000aff70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40ad040 tx=0x7fe6f401ac90 comp rx=0 tx=0).stop 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 shutdown_connections 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6ec065a60 0x7fe6ec067f20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7000cbff0 0x7fe7000b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7000ca410 0x7fe7000aff70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 --2- 172.21.15.133:0/3899165879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe700071870 0x7fe700154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 >> 172.21.15.133:0/3899165879 conn(0x7fe70006a2a0 msgr2=0x7fe7000ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:01.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 shutdown_connections 2023-12-18T10:19:01.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.681+0000 7fe7068b6640 1 -- 172.21.15.133:0/3899165879 wait complete. 2023-12-18T10:19:01.703 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:19:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.837+0000 7ff0f278f640 1 Processor -- start 2023-12-18T10:19:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.837+0000 7ff0f278f640 1 -- start start 2023-12-18T10:19:01.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0f278f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec15c9d0 0x7ff0ec0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0f278f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0ec0cdd40 0x7ff0ec160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0f278f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec160690 con 0x7ff0ec161060 2023-12-18T10:19:01.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0f278f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec1603f0 con 0x7ff0ec0cdd40 2023-12-18T10:19:01.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0f278f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0b0d80 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0eb7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0ec0cdd40 0x7ff0ec160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0ebfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec15c9d0 0x7ff0ec0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0eb7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0ec0cdd40 0x7ff0ec160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:56232/0 (socket says 172.21.15.133:56232) 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0eb7fe640 1 -- 172.21.15.133:0/3927722899 learned_addr learned my addr 172.21.15.133:0/3927722899 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0eb7fe640 1 -- 172.21.15.133:0/3927722899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec15c9d0 msgr2=0x7ff0ec0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0eb7fe640 1 --2- 172.21.15.133:0/3927722899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec15c9d0 0x7ff0ec0cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0eb7fe640 1 -- 172.21.15.133:0/3927722899 >> v1:172.21.15.142:6789/0 conn(0x7ff0ec161060 legacy=0x7ff0ec06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0eb7fe640 1 -- 172.21.15.133:0/3927722899 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0ccb00 con 0x7ff0ec0cdd40 2023-12-18T10:19:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.841+0000 7ff0ebfff640 1 --2- 172.21.15.133:0/3927722899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec15c9d0 0x7ff0ec0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0eb7fe640 1 --2- 172.21.15.133:0/3927722899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 0x7ff0ec160b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009870 tx=0x7ff0e001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78bd2544b0c0d90a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0eaffd640 1 -- 172.21.15.133:0/3927722899 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00a9620 con 0x7ff0ec0cdd40 2023-12-18T10:19:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0eaffd640 1 -- 172.21.15.133:0/3927722899 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e00a9780 con 0x7ff0ec0cdd40 2023-12-18T10:19:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0eaffd640 1 -- 172.21.15.133:0/3927722899 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00a9b10 con 0x7ff0ec0cdd40 2023-12-18T10:19:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- 172.21.15.133:0/3927722899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 msgr2=0x7ff0ec160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 --2- 172.21.15.133:0/3927722899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 0x7ff0ec160b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009870 tx=0x7ff0e001c540 comp rx=0 tx=0).stop 2023-12-18T10:19:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- 172.21.15.133:0/3927722899 shutdown_connections 2023-12-18T10:19:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 --2- 172.21.15.133:0/3927722899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 0x7ff0ec160b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 --2- 172.21.15.133:0/3927722899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec15c9d0 0x7ff0ec0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- 172.21.15.133:0/3927722899 >> 172.21.15.133:0/3927722899 conn(0x7ff0ec06a3e0 msgr2=0x7ff0ec0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- 172.21.15.133:0/3927722899 shutdown_connections 2023-12-18T10:19:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- 172.21.15.133:0/3927722899 wait complete. 2023-12-18T10:19:01.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 Processor -- start 2023-12-18T10:19:01.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- start start 2023-12-18T10:19:01.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 0x7ff0ec0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec15c9d0 0x7ff0ec0aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec161060 0x7ff0ec0acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0ade00 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0ae3c0 con 0x7ff0ec0cdd40 2023-12-18T10:19:01.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.845+0000 7ff0f278f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0c80a0 con 0x7ff0ec161060 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec15c9d0 0x7ff0ec0aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec15c9d0 0x7ff0ec0aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54510/0 (socket says 172.21.15.133:54510) 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 -- 172.21.15.133:0/2748878732 learned_addr learned my addr 172.21.15.133:0/2748878732 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0ebfff640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 0x7ff0ec0c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0f0d2c640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec161060 0x7ff0ec0acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 -- 172.21.15.133:0/2748878732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec161060 msgr2=0x7ff0ec0acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec161060 0x7ff0ec0acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 -- 172.21.15.133:0/2748878732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 msgr2=0x7ff0ec0c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 0x7ff0ec0c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 -- 172.21.15.133:0/2748878732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc009420 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0eb7fe640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec15c9d0 0x7ff0ec0aca20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00ab040 tx=0x7ff0e001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0e8ff9640 1 -- 172.21.15.133:0/2748878732 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00a9e40 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0e8ff9640 1 -- 172.21.15.133:0/2748878732 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e00bc450 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0e8ff9640 1 -- 172.21.15.133:0/2748878732 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00bc7e0 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e00094d0 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec0c7d50 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec0735b0 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.849+0000 7ff0e8ff9640 1 -- 172.21.15.133:0/2748878732 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff0e00bc940 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.853+0000 7ff0e8ff9640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff0d8065a60 0x7ff0d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:01.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.853+0000 7ff0e8ff9640 1 -- 172.21.15.133:0/2748878732 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0e011dbf0 con 0x7ff0ec15c9d0 2023-12-18T10:19:01.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.853+0000 7ff0ebfff640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff0d8065a60 0x7ff0d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:01.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.853+0000 7ff0ebfff640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff0d8065a60 0x7ff0d8067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009cf0 tx=0x7ff0dc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:01.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:01.857+0000 7ff0e8ff9640 1 -- 172.21.15.133:0/2748878732 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff0e00eb300 con 0x7ff0ec15c9d0 2023-12-18T10:19:02.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.017+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff0ec0ae530 con 0x7ff0ec15c9d0 2023-12-18T10:19:02.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.017+0000 7ff0e8ff9640 1 -- 172.21.15.133:0/2748878732 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff0e00c1020 con 0x7ff0ec15c9d0 2023-12-18T10:19:02.021 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:19:02.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff0d8065a60 msgr2=0x7ff0d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff0d8065a60 0x7ff0d8067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009cf0 tx=0x7ff0dc009190 comp rx=0 tx=0).stop 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec15c9d0 msgr2=0x7ff0ec0aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec15c9d0 0x7ff0ec0aca20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00ab040 tx=0x7ff0e001ad80 comp rx=0 tx=0).stop 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 shutdown_connections 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff0d8065a60 0x7ff0d8067f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0ec161060 0x7ff0ec0acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec15c9d0 0x7ff0ec0aca20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 --2- 172.21.15.133:0/2748878732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0ec0cdd40 0x7ff0ec0c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 >> 172.21.15.133:0/2748878732 conn(0x7ff0ec06a3e0 msgr2=0x7ff0ec0717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 shutdown_connections 2023-12-18T10:19:02.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.021+0000 7ff0f278f640 1 -- 172.21.15.133:0/2748878732 wait complete. 2023-12-18T10:19:02.042 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:19:02.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:02.042 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-18T10:19:02.064 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:19:02.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:19:02.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:02.064 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-18T10:19:02.119 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:19:02.119 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:02.129 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:19:02.129 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:02.180 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76b5db3640 1 Processor -- start 2023-12-18T10:19:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76b5db3640 1 -- start start 2023-12-18T10:19:02.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76b5db3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76b00ce2c0 0x7f76b00ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76b5db3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b0160e80 con 0x7f76b00ce750 2023-12-18T10:19:02.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76b5db3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b0161160 con 0x7f76b015ceb0 2023-12-18T10:19:02.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76b5db3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b0161440 con 0x7f76b00ce2c0 2023-12-18T10:19:02.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76aeffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76b00ce2c0 0x7f76b00ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76affff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f76b00ce750 0x7f76b015d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39742/0 (socket says 172.21.15.133:39742) 2023-12-18T10:19:02.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76affff640 1 -- 172.21.15.133:0/2559960305 learned_addr learned my addr 172.21.15.133:0/2559960305 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:02.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76aeffd640 1 -- 172.21.15.133:0/2559960305 >> v1:172.21.15.142:6789/0 conn(0x7f76b015ceb0 legacy=0x7f76b006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76aeffd640 1 -- 172.21.15.133:0/2559960305 >> v1:172.21.15.133:6789/0 conn(0x7f76b00ce750 legacy=0x7f76b015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.317+0000 7f76aeffd640 1 -- 172.21.15.133:0/2559960305 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0161720 con 0x7f76b00ce2c0 2023-12-18T10:19:02.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76aeffd640 1 --2- 172.21.15.133:0/2559960305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00ceb90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097c0 tx=0x7f76a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a49b8c7331a931 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76ae7fc640 1 -- 172.21.15.133:0/2559960305 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40a8050 con 0x7f76b00ce2c0 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76ae7fc640 1 -- 172.21.15.133:0/2559960305 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b015d4a0 con 0x7f76b00ce2c0 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76ae7fc640 1 -- 172.21.15.133:0/2559960305 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40ac810 con 0x7f76b00ce2c0 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76b5db3640 1 -- 172.21.15.133:0/2559960305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 msgr2=0x7f76b00ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76b5db3640 1 --2- 172.21.15.133:0/2559960305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00ceb90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097c0 tx=0x7f76a401c480 comp rx=0 tx=0).stop 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76b5db3640 1 -- 172.21.15.133:0/2559960305 shutdown_connections 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76b5db3640 1 --2- 172.21.15.133:0/2559960305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00ceb90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76b5db3640 1 -- 172.21.15.133:0/2559960305 >> 172.21.15.133:0/2559960305 conn(0x7f76b0069ca0 msgr2=0x7f76b006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:02.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76b5db3640 1 -- 172.21.15.133:0/2559960305 shutdown_connections 2023-12-18T10:19:02.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.321+0000 7f76b5db3640 1 -- 172.21.15.133:0/2559960305 wait complete. 2023-12-18T10:19:02.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 Processor -- start 2023-12-18T10:19:02.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 -- start start 2023-12-18T10:19:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76b00ce750 0x7f76b0154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76b015ceb0 0x7f76b0153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00c3a50 con 0x7f76b00ce2c0 2023-12-18T10:19:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00c3f40 con 0x7f76b015ceb0 2023-12-18T10:19:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00b0f80 con 0x7f76b00ce750 2023-12-18T10:19:02.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54536/0 (socket says 172.21.15.133:54536) 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 -- 172.21.15.133:0/45479315 learned_addr learned my addr 172.21.15.133:0/45479315 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76aeffd640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76b00ce750 0x7f76b0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76affff640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76b015ceb0 0x7f76b0153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 -- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76b00ce750 msgr2=0x7f76b0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76b00ce750 0x7f76b0154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 -- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76b015ceb0 msgr2=0x7f76b0153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76b015ceb0 0x7f76b0153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 -- 172.21.15.133:0/45479315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009420 con 0x7f76b00ce2c0 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76affff640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76b015ceb0 0x7f76b0153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76af7fe640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00c9ff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c420 tx=0x7f76a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f7697fff640 1 -- 172.21.15.133:0/45479315 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00052d0 con 0x7f76b00ce2c0 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f7697fff640 1 -- 172.21.15.133:0/45479315 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a0005430 con 0x7f76b00ce2c0 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b00b0c50 con 0x7f76b00ce2c0 2023-12-18T10:19:02.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f7697fff640 1 -- 172.21.15.133:0/45479315 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0003840 con 0x7f76b00ce2c0 2023-12-18T10:19:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b014a950 con 0x7f76b00ce2c0 2023-12-18T10:19:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.325+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b00b0ab0 con 0x7f76b00ce2c0 2023-12-18T10:19:02.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.329+0000 7f7697fff640 1 -- 172.21.15.133:0/45479315 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f76a00039a0 con 0x7f76b00ce2c0 2023-12-18T10:19:02.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.329+0000 7f7697fff640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f769c065a90 0x7f769c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.329+0000 7f7697fff640 1 -- 172.21.15.133:0/45479315 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76a0082970 con 0x7f76b00ce2c0 2023-12-18T10:19:02.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.329+0000 7f76aeffd640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f769c065a90 0x7f769c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.329+0000 7f76aeffd640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f769c065a90 0x7f769c067f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f76a40ae000 tx=0x7f76a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.333+0000 7f7697fff640 1 -- 172.21.15.133:0/45479315 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f76b00b0ab0 con 0x7f76b00ce2c0 2023-12-18T10:19:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.481+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76b00b0ab0 con 0x7f76b00ce2c0 2023-12-18T10:19:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f7697fff640 1 -- 172.21.15.133:0/45479315 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f76b00b0ab0 con 0x7f76b00ce2c0 2023-12-18T10:19:02.488 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:02.488 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f769c065a90 msgr2=0x7f769c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f769c065a90 0x7f769c067f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f76a40ae000 tx=0x7f76a4008040 comp rx=0 tx=0).stop 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 msgr2=0x7f76b00c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00c9ff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c420 tx=0x7f76a000c8e0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 shutdown_connections 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f769c065a90 0x7f769c067f50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76b015ceb0 0x7f76b0153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76b00ce750 0x7f76b0154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 --2- 172.21.15.133:0/45479315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00ce2c0 0x7f76b00c9ff0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 >> 172.21.15.133:0/45479315 conn(0x7f76b0069ca0 msgr2=0x7f76b0151880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 shutdown_connections 2023-12-18T10:19:02.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.485+0000 7f76b5db3640 1 -- 172.21.15.133:0/45479315 wait complete. 2023-12-18T10:19:02.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:19:02.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:02.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.645+0000 7f0db2539640 1 Processor -- start 2023-12-18T10:19:02.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db2539640 1 -- start start 2023-12-18T10:19:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db2539640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0dac070820 0x7f0dac0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db2539640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0dac0ce3b0 0x7f0dac0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db2539640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0c9390 con 0x7f0dac1582d0 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db2539640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac0ced60 con 0x7f0dac070820 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db2539640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac15aee0 con 0x7f0dac0ce3b0 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0dabfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0dac1582d0 0x7f0dac0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39746/0 (socket says 172.21.15.133:39746) 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0dabfff640 1 -- 172.21.15.133:0/1005206981 learned_addr learned my addr 172.21.15.133:0/1005206981 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0dab7fe640 1 --2- 172.21.15.133:0/1005206981 >> v2:172.21.15.133:3300/0 conn(0x7f0dac070820 0x7f0dac0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db0ad6640 1 --2- 172.21.15.133:0/1005206981 >> v2:172.21.15.142:3300/0 conn(0x7f0dac0ce3b0 0x7f0dac0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0daaffd640 1 -- 172.21.15.133:0/1005206981 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358178457 0 0) 0x7f0dac0c9390 con 0x7f0dac1582d0 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0daaffd640 1 -- 172.21.15.133:0/1005206981 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d94003530 con 0x7f0dac1582d0 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db0ad6640 1 -- 172.21.15.133:0/1005206981 >> v2:172.21.15.133:3300/0 conn(0x7f0dac070820 msgr2=0x7f0dac0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db0ad6640 1 --2- 172.21.15.133:0/1005206981 >> v2:172.21.15.133:3300/0 conn(0x7f0dac070820 0x7f0dac0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db0ad6640 1 -- 172.21.15.133:0/1005206981 >> v1:172.21.15.133:6789/0 conn(0x7f0dac1582d0 legacy=0x7f0dac0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0db0ad6640 1 -- 172.21.15.133:0/1005206981 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac15b1c0 con 0x7f0dac0ce3b0 2023-12-18T10:19:02.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.649+0000 7f0dab7fe640 1 --2- 172.21.15.133:0/1005206981 >> v2:172.21.15.133:3300/0 conn(0x7f0dac070820 0x7f0dac0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db0ad6640 1 --2- 172.21.15.133:0/1005206981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 0x7f0dac0ce820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0dac06fbb0 tx=0x7f0da401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b15e77469d848f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0daaffd640 1 -- 172.21.15.133:0/1005206981 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40a59a0 con 0x7f0dac0ce3b0 2023-12-18T10:19:02.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0daaffd640 1 -- 172.21.15.133:0/1005206981 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40a5b00 con 0x7f0dac0ce3b0 2023-12-18T10:19:02.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0daaffd640 1 -- 172.21.15.133:0/1005206981 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40a5e90 con 0x7f0dac0ce3b0 2023-12-18T10:19:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 -- 172.21.15.133:0/1005206981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 msgr2=0x7f0dac0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 --2- 172.21.15.133:0/1005206981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 0x7f0dac0ce820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0dac06fbb0 tx=0x7f0da401c8e0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 -- 172.21.15.133:0/1005206981 shutdown_connections 2023-12-18T10:19:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 --2- 172.21.15.133:0/1005206981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 0x7f0dac0ce820 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 --2- 172.21.15.133:0/1005206981 >> v2:172.21.15.133:3300/0 conn(0x7f0dac070820 0x7f0dac0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 -- 172.21.15.133:0/1005206981 >> 172.21.15.133:0/1005206981 conn(0x7f0dac06a2a0 msgr2=0x7f0dac0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 -- 172.21.15.133:0/1005206981 shutdown_connections 2023-12-18T10:19:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 -- 172.21.15.133:0/1005206981 wait complete. 2023-12-18T10:19:02.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.653+0000 7f0db2539640 1 Processor -- start 2023-12-18T10:19:02.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 -- start start 2023-12-18T10:19:02.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dac070820 0x7f0dac148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 0x7f0dac0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dac1582d0 0x7f0dac151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0c3340 con 0x7f0dac070820 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac14f500 con 0x7f0dac0ce3b0 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac148a60 con 0x7f0dac1582d0 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dac070820 0x7f0dac148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dac070820 0x7f0dac148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54554/0 (socket says 172.21.15.133:54554) 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 -- 172.21.15.133:0/3139544618 learned_addr learned my addr 172.21.15.133:0/3139544618 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db0ad6640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dac1582d0 0x7f0dac151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dab7fe640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 0x7f0dac0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 -- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dac1582d0 msgr2=0x7f0dac151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dac1582d0 0x7f0dac151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 -- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 msgr2=0x7f0dac0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 0x7f0dac0c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 -- 172.21.15.133:0/3139544618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0009420 con 0x7f0dac070820 2023-12-18T10:19:02.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dab7fe640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 0x7f0dac0c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:02.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0dabfff640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dac070820 0x7f0dac148520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00c450 tx=0x7f0d9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0da8ff9640 1 -- 172.21.15.133:0/3139544618 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c005cf0 con 0x7f0dac070820 2023-12-18T10:19:02.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0da8ff9640 1 -- 172.21.15.133:0/3139544618 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c005e50 con 0x7f0dac070820 2023-12-18T10:19:02.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0da8ff9640 1 -- 172.21.15.133:0/3139544618 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c007270 con 0x7f0dac070820 2023-12-18T10:19:02.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da4009a70 con 0x7f0dac070820 2023-12-18T10:19:02.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac14ee40 con 0x7f0dac070820 2023-12-18T10:19:02.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.657+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac0ceb10 con 0x7f0dac070820 2023-12-18T10:19:02.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.661+0000 7f0da8ff9640 1 -- 172.21.15.133:0/3139544618 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d9c0073d0 con 0x7f0dac070820 2023-12-18T10:19:02.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.661+0000 7f0da8ff9640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d98065a60 0x7f0d98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.661+0000 7f0da8ff9640 1 -- 172.21.15.133:0/3139544618 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d9c0829b0 con 0x7f0dac070820 2023-12-18T10:19:02.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.661+0000 7f0dab7fe640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d98065a60 0x7f0d98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.661+0000 7f0dab7fe640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d98065a60 0x7f0d98067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0ad9a0 tx=0x7f0da0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.665+0000 7f0da8ff9640 1 -- 172.21.15.133:0/3139544618 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0d9c04ffc0 con 0x7f0dac070820 2023-12-18T10:19:02.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0dac04e000 con 0x7f0dac070820 2023-12-18T10:19:02.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0da8ff9640 1 -- 172.21.15.133:0/3139544618 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d9c0170a0 con 0x7f0dac070820 2023-12-18T10:19:02.816 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d98065a60 msgr2=0x7f0d98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d98065a60 0x7f0d98067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0ad9a0 tx=0x7f0da0008040 comp rx=0 tx=0).stop 2023-12-18T10:19:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dac070820 msgr2=0x7f0dac148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dac070820 0x7f0dac148520 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00c450 tx=0x7f0d9c00c910 comp rx=0 tx=0).stop 2023-12-18T10:19:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 shutdown_connections 2023-12-18T10:19:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d98065a60 0x7f0d98067f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0dac1582d0 0x7f0dac151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac0ce3b0 0x7f0dac0c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 --2- 172.21.15.133:0/3139544618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dac070820 0x7f0dac148520 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 >> 172.21.15.133:0/3139544618 conn(0x7f0dac06a2a0 msgr2=0x7f0dac06c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.813+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 shutdown_connections 2023-12-18T10:19:02.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.817+0000 7f0db2539640 1 -- 172.21.15.133:0/3139544618 wait complete. 2023-12-18T10:19:02.838 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:19:02.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb101560640 1 Processor -- start 2023-12-18T10:19:02.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb101560640 1 -- start start 2023-12-18T10:19:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb101560640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0fc0cde90 0x7fb0fc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb101560640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc15cec0 con 0x7fb0fc15cae0 2023-12-18T10:19:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb101560640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc0d0530 con 0x7fb0fc0cf170 2023-12-18T10:19:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb101560640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0d0810 con 0x7fb0fc0cde90 2023-12-18T10:19:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0faffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb0fc15cae0 0x7fb0fc0d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39762/0 (socket says 172.21.15.133:39762) 2023-12-18T10:19:02.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0faffd640 1 -- 172.21.15.133:0/747051302 learned_addr learned my addr 172.21.15.133:0/747051302 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:02.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799595108 0 0) 0x7fb0fc15cec0 con 0x7fb0fc15cae0 2023-12-18T10:19:02.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e8003530 con 0x7fb0fc15cae0 2023-12-18T10:19:02.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0f27fc640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0fc0cde90 0x7fb0fc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2815392468 0 0) 0x7fb0e8003530 con 0x7fb0fc15cae0 2023-12-18T10:19:02.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0fc0cde90 msgr2=0x7fb0fc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:02.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0fc0cde90 0x7fb0fc0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 >> v1:172.21.15.142:6789/0 conn(0x7fb0fc0cf170 legacy=0x7fb0fc06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0d0af0 con 0x7fb0fc15cae0 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fb0ec001800 con 0x7fb0fc15cae0 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 >> v1:172.21.15.133:6789/0 conn(0x7fb0fc15cae0 legacy=0x7fb0fc0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0fc0cde90 0x7fb0e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8003fe0 0x7fb0e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e8004d10 0x7fb0e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0d0810 con 0x7fb0e8004d10 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e800bb50 con 0x7fb0e8003fe0 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e800bd10 con 0x7fb0fc0cde90 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fb7fe640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e8004d10 0x7fb0e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0f27fc640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8003fe0 0x7fb0e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0faffd640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0fc0cde90 0x7fb0e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fb7fe640 1 -- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0fc0cde90 msgr2=0x7fb0e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fb7fe640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0fc0cde90 0x7fb0e80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fb7fe640 1 -- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8003fe0 msgr2=0x7fb0e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fb7fe640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0e8003fe0 0x7fb0e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.977+0000 7fb0fb7fe640 1 -- 172.21.15.133:0/747051302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8003530 con 0x7fb0e8004d10 2023-12-18T10:19:02.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb0fb7fe640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e8004d10 0x7fb0e8005190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4001780 tx=0x7fb0f401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1714d301d3ff5de8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40052d0 con 0x7fb0e8004d10 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f40a7050 con 0x7fb0e8004d10 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb0fa7fc640 1 -- 172.21.15.133:0/747051302 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4003600 con 0x7fb0e8004d10 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb101560640 1 -- 172.21.15.133:0/747051302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e8004d10 msgr2=0x7fb0e8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb101560640 1 --2- 172.21.15.133:0/747051302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0e8004d10 0x7fb0e8005190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4001780 tx=0x7fb0f401c400 comp rx=0 tx=0).stop 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb0fb7fe640 1 -- 172.21.15.133:0/747051302 reap_dead start 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb101560640 1 -- 172.21.15.133:0/747051302 shutdown_connections 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb101560640 1 -- 172.21.15.133:0/747051302 >> 172.21.15.133:0/747051302 conn(0x7fb0fc089fb0 msgr2=0x7fb0fc0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb101560640 1 -- 172.21.15.133:0/747051302 shutdown_connections 2023-12-18T10:19:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.981+0000 7fb101560640 1 -- 172.21.15.133:0/747051302 wait complete. 2023-12-18T10:19:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 Processor -- start 2023-12-18T10:19:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 -- start start 2023-12-18T10:19:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0e8004d10 0x7fb0fc150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc0b03c0 0x7fb0fc0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0fc0c9fa0 0x7fb0fc0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0b0d80 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc151170 con 0x7fb0fc0c9fa0 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc15d1f0 con 0x7fb0e8004d10 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc0b03c0 0x7fb0fc0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc0b03c0 0x7fb0fc0b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54570/0 (socket says 172.21.15.133:54570) 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 -- 172.21.15.133:0/1801603254 learned_addr learned my addr 172.21.15.133:0/1801603254 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0faffd640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0e8004d10 0x7fb0fc150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0fb7fe640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0fc0c9fa0 0x7fb0fc0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 -- 172.21.15.133:0/1801603254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0e8004d10 msgr2=0x7fb0fc150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0e8004d10 0x7fb0fc150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 -- 172.21.15.133:0/1801603254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0fc0c9fa0 msgr2=0x7fb0fc0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0fc0c9fa0 0x7fb0fc0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 -- 172.21.15.133:0/1801603254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc15d4d0 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f27fc640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc0b03c0 0x7fb0fc0b0840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4003fd0 tx=0x7fb0e4007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f3fff640 1 -- 172.21.15.133:0/1801603254 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4009c30 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f3fff640 1 -- 172.21.15.133:0/1801603254 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e4015420 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc15d7b0 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb0f3fff640 1 -- 172.21.15.133:0/1801603254 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40157d0 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.985+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc15dd70 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.989+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc15df30 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.989+0000 7fb0f3fff640 1 -- 172.21.15.133:0/1801603254 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb0e4015930 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.989+0000 7fb0f3fff640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb0dc065a90 0x7fb0dc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.989+0000 7fb0f3fff640 1 -- 172.21.15.133:0/1801603254 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb0e4083df0 con 0x7fb0fc0b03c0 2023-12-18T10:19:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.989+0000 7fb0faffd640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb0dc065a90 0x7fb0dc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.989+0000 7fb0faffd640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb0dc065a90 0x7fb0dc067f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc1f56d0 tx=0x7fb0ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:02.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:02.993+0000 7fb0f3fff640 1 -- 172.21.15.133:0/1801603254 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb0e4051490 con 0x7fb0fc0b03c0 2023-12-18T10:19:03.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0fc04e000 con 0x7fb0fc0b03c0 2023-12-18T10:19:03.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb0f3fff640 1 -- 172.21.15.133:0/1801603254 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0e4054ab0 con 0x7fb0fc0b03c0 2023-12-18T10:19:03.147 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb0dc065a90 msgr2=0x7fb0dc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb0dc065a90 0x7fb0dc067f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc1f56d0 tx=0x7fb0ec009040 comp rx=0 tx=0).stop 2023-12-18T10:19:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc0b03c0 msgr2=0x7fb0fc0b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc0b03c0 0x7fb0fc0b0840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4003fd0 tx=0x7fb0e4007700 comp rx=0 tx=0).stop 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 shutdown_connections 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb0dc065a90 0x7fb0dc067f50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb0fc0c9fa0 0x7fb0fc0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0fc0b03c0 0x7fb0fc0b0840 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 --2- 172.21.15.133:0/1801603254 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0e8004d10 0x7fb0fc150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 >> 172.21.15.133:0/1801603254 conn(0x7fb0fc089fb0 msgr2=0x7fb0fc0b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 shutdown_connections 2023-12-18T10:19:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.145+0000 7fb101560640 1 -- 172.21.15.133:0/1801603254 wait complete. 2023-12-18T10:19:03.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:19:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9c5a6640 1 Processor -- start 2023-12-18T10:19:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9c5a6640 1 -- start start 2023-12-18T10:19:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9c5a6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e940ca410 0x7f2e94159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9c5a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cbff0 0x7f2e940cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9c5a6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e940cc930 con 0x7f2e94159fb0 2023-12-18T10:19:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9c5a6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9415aab0 con 0x7f2e940ca410 2023-12-18T10:19:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9c5a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94070df0 con 0x7f2e940cbff0 2023-12-18T10:19:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e99b41640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e94159fb0 0x7f2e94071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39776/0 (socket says 172.21.15.133:39776) 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e99b41640 1 -- 172.21.15.133:0/505847268 learned_addr learned my addr 172.21.15.133:0/505847268 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9ab43640 1 --2- 172.21.15.133:0/505847268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cbff0 0x7f2e940cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9a342640 1 --2- 172.21.15.133:0/505847268 >> v2:172.21.15.142:3300/0 conn(0x7f2e940ca410 0x7f2e94159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e99340640 1 -- 172.21.15.133:0/505847268 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705429526 0 0) 0x7f2e940cc930 con 0x7f2e94159fb0 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e99340640 1 -- 172.21.15.133:0/505847268 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e80003530 con 0x7f2e94159fb0 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9ab43640 1 -- 172.21.15.133:0/505847268 >> v2:172.21.15.142:3300/0 conn(0x7f2e940ca410 msgr2=0x7f2e94159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9ab43640 1 --2- 172.21.15.133:0/505847268 >> v2:172.21.15.142:3300/0 conn(0x7f2e940ca410 0x7f2e94159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9ab43640 1 -- 172.21.15.133:0/505847268 >> v1:172.21.15.133:6789/0 conn(0x7f2e94159fb0 legacy=0x7f2e94071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.309+0000 7f2e9ab43640 1 -- 172.21.15.133:0/505847268 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9415a4f0 con 0x7f2e940cbff0 2023-12-18T10:19:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9ab43640 1 --2- 172.21.15.133:0/505847268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cbff0 0x7f2e940cc3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009d90 tx=0x7f2e8c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcb9d607a640c517 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e99340640 1 -- 172.21.15.133:0/505847268 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0a59e0 con 0x7f2e940cbff0 2023-12-18T10:19:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e99340640 1 -- 172.21.15.133:0/505847268 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0a5b40 con 0x7f2e940cbff0 2023-12-18T10:19:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e99340640 1 -- 172.21.15.133:0/505847268 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0ad440 con 0x7f2e940cbff0 2023-12-18T10:19:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/505847268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cbff0 msgr2=0x7f2e940cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/505847268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cbff0 0x7f2e940cc3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009d90 tx=0x7f2e8c01c920 comp rx=0 tx=0).stop 2023-12-18T10:19:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/505847268 shutdown_connections 2023-12-18T10:19:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/505847268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cbff0 0x7f2e940cc3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/505847268 >> v2:172.21.15.142:3300/0 conn(0x7f2e940ca410 0x7f2e94159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/505847268 >> 172.21.15.133:0/505847268 conn(0x7f2e9406a2a0 msgr2=0x7f2e940aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/505847268 shutdown_connections 2023-12-18T10:19:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.313+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/505847268 wait complete. 2023-12-18T10:19:03.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 Processor -- start 2023-12-18T10:19:03.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 -- start start 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e940ca410 0x7f2e9414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e940cbff0 0x7f2e9414d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e94159fb0 0x7f2e940c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e941594f0 con 0x7f2e940ca410 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94158b60 con 0x7f2e940cbff0 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940c7e80 con 0x7f2e94159fb0 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e940ca410 0x7f2e9414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e940ca410 0x7f2e9414dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54574/0 (socket says 172.21.15.133:54574) 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 -- 172.21.15.133:0/2289457801 learned_addr learned my addr 172.21.15.133:0/2289457801 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 -- 172.21.15.133:0/2289457801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e94159fb0 msgr2=0x7f2e940c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e94159fb0 0x7f2e940c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 -- 172.21.15.133:0/2289457801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e940cbff0 msgr2=0x7f2e9414d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e940cbff0 0x7f2e9414d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 -- 172.21.15.133:0/2289457801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c009a70 con 0x7f2e940ca410 2023-12-18T10:19:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9a342640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e940ca410 0x7f2e9414dfb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000e870 tx=0x7f2e9000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e8affd640 1 -- 172.21.15.133:0/2289457801 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90009510 con 0x7f2e940ca410 2023-12-18T10:19:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e8affd640 1 -- 172.21.15.133:0/2289457801 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9000eec0 con 0x7f2e940ca410 2023-12-18T10:19:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e8affd640 1 -- 172.21.15.133:0/2289457801 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000cb40 con 0x7f2e940ca410 2023-12-18T10:19:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e940c8160 con 0x7f2e940ca410 2023-12-18T10:19:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.317+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e94158e40 con 0x7f2e940ca410 2023-12-18T10:19:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.321+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e940c82f0 con 0x7f2e940ca410 2023-12-18T10:19:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.321+0000 7f2e8affd640 1 -- 172.21.15.133:0/2289457801 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2e9000cca0 con 0x7f2e940ca410 2023-12-18T10:19:03.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.321+0000 7f2e8affd640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e78065a60 0x7f2e78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.321+0000 7f2e8affd640 1 -- 172.21.15.133:0/2289457801 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2e900836b0 con 0x7f2e940ca410 2023-12-18T10:19:03.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.321+0000 7f2e99b41640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e78065a60 0x7f2e78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.321+0000 7f2e99b41640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e78065a60 0x7f2e78067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e84007fd0 tx=0x7f2e84007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.325+0000 7f2e8affd640 1 -- 172.21.15.133:0/2289457801 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2e90050ca0 con 0x7f2e940ca410 2023-12-18T10:19:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.473+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e9404e000 con 0x7f2e940ca410 2023-12-18T10:19:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.473+0000 7f2e8affd640 1 -- 172.21.15.133:0/2289457801 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e900542c0 con 0x7f2e940ca410 2023-12-18T10:19:03.477 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.473+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e78065a60 msgr2=0x7f2e78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.473+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e78065a60 0x7f2e78067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2e84007fd0 tx=0x7f2e84007940 comp rx=0 tx=0).stop 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.473+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e940ca410 msgr2=0x7f2e9414dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.473+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e940ca410 0x7f2e9414dfb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000e870 tx=0x7f2e9000ec70 comp rx=0 tx=0).stop 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.477+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 shutdown_connections 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.477+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e78065a60 0x7f2e78067f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.477+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e94159fb0 0x7f2e940c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.477+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e940cbff0 0x7f2e9414d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.477+0000 7f2e9c5a6640 1 --2- 172.21.15.133:0/2289457801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e940ca410 0x7f2e9414dfb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.477+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 >> 172.21.15.133:0/2289457801 conn(0x7f2e9406a2a0 msgr2=0x7f2e940ac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.477+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 shutdown_connections 2023-12-18T10:19:03.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.477+0000 7f2e9c5a6640 1 -- 172.21.15.133:0/2289457801 wait complete. 2023-12-18T10:19:03.498 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:19:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4dfd1bc640 1 Processor -- start 2023-12-18T10:19:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4dfd1bc640 1 -- start start 2023-12-18T10:19:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4dfd1bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80ca410 0x7f4df8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4dfd1bc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df8070df0 con 0x7f4df8159fb0 2023-12-18T10:19:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4dfd1bc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df815a4f0 con 0x7f4df80cbff0 2023-12-18T10:19:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4dfd1bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df815aab0 con 0x7f4df80ca410 2023-12-18T10:19:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df659c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4df8159fb0 0x7f4df8071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39790/0 (socket says 172.21.15.133:39790) 2023-12-18T10:19:03.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df659c640 1 -- 172.21.15.133:0/1191127183 learned_addr learned my addr 172.21.15.133:0/1191127183 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:03.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df6d9d640 1 --2- 172.21.15.133:0/1191127183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80ca410 0x7f4df8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df5d9b640 1 -- 172.21.15.133:0/1191127183 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938391462 0 0) 0x7f4df8070df0 con 0x7f4df8159fb0 2023-12-18T10:19:03.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df5d9b640 1 -- 172.21.15.133:0/1191127183 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de0003530 con 0x7f4df8159fb0 2023-12-18T10:19:03.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df5d9b640 1 -- 172.21.15.133:0/1191127183 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706017822 0 0) 0x7f4df815a4f0 con 0x7f4df80cbff0 2023-12-18T10:19:03.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df5d9b640 1 -- 172.21.15.133:0/1191127183 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df8070df0 con 0x7f4df80cbff0 2023-12-18T10:19:03.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df6d9d640 1 -- 172.21.15.133:0/1191127183 >> v1:172.21.15.142:6789/0 conn(0x7f4df80cbff0 legacy=0x7f4df80ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df6d9d640 1 -- 172.21.15.133:0/1191127183 >> v1:172.21.15.133:6789/0 conn(0x7f4df8159fb0 legacy=0x7f4df8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.637+0000 7f4df6d9d640 1 -- 172.21.15.133:0/1191127183 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df815a7d0 con 0x7f4df80ca410 2023-12-18T10:19:03.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4df6d9d640 1 --2- 172.21.15.133:0/1191127183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80ca410 0x7f4df8159a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4de80097f0 tx=0x7f4de801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0f1d8f627f1ffec server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4df5d9b640 1 -- 172.21.15.133:0/1191127183 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de80a8050 con 0x7f4df80ca410 2023-12-18T10:19:03.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4df5d9b640 1 -- 172.21.15.133:0/1191127183 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de80ac5f0 con 0x7f4df80ca410 2023-12-18T10:19:03.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4df5d9b640 1 -- 172.21.15.133:0/1191127183 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de80ac980 con 0x7f4df80ca410 2023-12-18T10:19:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/1191127183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80ca410 msgr2=0x7f4df8159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4dfd1bc640 1 --2- 172.21.15.133:0/1191127183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80ca410 0x7f4df8159a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4de80097f0 tx=0x7f4de801c490 comp rx=0 tx=0).stop 2023-12-18T10:19:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/1191127183 shutdown_connections 2023-12-18T10:19:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4dfd1bc640 1 --2- 172.21.15.133:0/1191127183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80ca410 0x7f4df8159a70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/1191127183 >> 172.21.15.133:0/1191127183 conn(0x7f4df806a2a0 msgr2=0x7f4df80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/1191127183 shutdown_connections 2023-12-18T10:19:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.641+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/1191127183 wait complete. 2023-12-18T10:19:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 Processor -- start 2023-12-18T10:19:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 -- start start 2023-12-18T10:19:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4df80ca410 0x7f4df80c3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80cbff0 0x7f4df814e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4df8159fb0 0x7f4df80c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df814ee60 con 0x7f4df8159fb0 2023-12-18T10:19:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df80c5a30 con 0x7f4df80ca410 2023-12-18T10:19:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df80c5cd0 con 0x7f4df80cbff0 2023-12-18T10:19:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4df8159fb0 0x7f4df80c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80cbff0 0x7f4df814e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4df8159fb0 0x7f4df80c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54586/0 (socket says 172.21.15.133:54586) 2023-12-18T10:19:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 -- 172.21.15.133:0/2904139580 learned_addr learned my addr 172.21.15.133:0/2904139580 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df6d9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4df80ca410 0x7f4df80c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 -- 172.21.15.133:0/2904139580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80cbff0 msgr2=0x7f4df814e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80cbff0 0x7f4df814e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 -- 172.21.15.133:0/2904139580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4df80ca410 msgr2=0x7f4df80c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4df80ca410 0x7f4df80c3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 -- 172.21.15.133:0/2904139580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8009420 con 0x7f4df8159fb0 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4df759e640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4df8159fb0 0x7f4df80c54f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c790 tx=0x7f4df000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4ddf7fe640 1 -- 172.21.15.133:0/2904139580 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000cea0 con 0x7f4df8159fb0 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4ddf7fe640 1 -- 172.21.15.133:0/2904139580 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0003b80 con 0x7f4df8159fb0 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df80c5fb0 con 0x7f4df8159fb0 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4ddf7fe640 1 -- 172.21.15.133:0/2904139580 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000a850 con 0x7f4df8159fb0 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.645+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df80c6570 con 0x7f4df8159fb0 2023-12-18T10:19:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.649+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df804e000 con 0x7f4df8159fb0 2023-12-18T10:19:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.649+0000 7f4ddf7fe640 1 -- 172.21.15.133:0/2904139580 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4df000a9b0 con 0x7f4df8159fb0 2023-12-18T10:19:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.649+0000 7f4ddf7fe640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4de4065a60 0x7f4de4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.649+0000 7f4ddf7fe640 1 -- 172.21.15.133:0/2904139580 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4df0083250 con 0x7f4df8159fb0 2023-12-18T10:19:03.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.649+0000 7f4df6d9d640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4de4065a60 0x7f4de4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.649+0000 7f4df6d9d640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4de4065a60 0x7f4de4067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4de80ae000 tx=0x7f4de8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.653+0000 7f4ddf7fe640 1 -- 172.21.15.133:0/2904139580 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4df0050970 con 0x7f4df8159fb0 2023-12-18T10:19:03.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4df80c9a60 con 0x7f4df8159fb0 2023-12-18T10:19:03.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4ddf7fe640 1 -- 172.21.15.133:0/2904139580 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4df0053f90 con 0x7f4df8159fb0 2023-12-18T10:19:03.805 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4de4065a60 msgr2=0x7f4de4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4de4065a60 0x7f4de4067f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4de80ae000 tx=0x7f4de8008040 comp rx=0 tx=0).stop 2023-12-18T10:19:03.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4df8159fb0 msgr2=0x7f4df80c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4df8159fb0 0x7f4df80c54f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c790 tx=0x7f4df000cc50 comp rx=0 tx=0).stop 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 shutdown_connections 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4de4065a60 0x7f4de4067f20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4df8159fb0 0x7f4df80c54f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4df80cbff0 0x7f4df814e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 --2- 172.21.15.133:0/2904139580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4df80ca410 0x7f4df80c3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.801+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 >> 172.21.15.133:0/2904139580 conn(0x7f4df806a2a0 msgr2=0x7f4df80aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.805+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 shutdown_connections 2023-12-18T10:19:03.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.805+0000 7f4dfd1bc640 1 -- 172.21.15.133:0/2904139580 wait complete. 2023-12-18T10:19:03.826 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:19:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb4f0c4640 1 Processor -- start 2023-12-18T10:19:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb4f0c4640 1 -- start start 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb4f0c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb481570c0 0x7fcb4806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb4f0c4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb480ca000 0x7fcb48070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb4f0c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb480c9460 con 0x7fcb4806c320 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb4f0c4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4806c7a0 con 0x7fcb480ca000 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb4f0c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb481574a0 con 0x7fcb481570c0 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb4d661640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb480ca000 0x7fcb48070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb3ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcb4806c320 0x7fcb480c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39792/0 (socket says 172.21.15.133:39792) 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.961+0000 7fcb3ffff640 1 -- 172.21.15.133:0/2281822796 learned_addr learned my addr 172.21.15.133:0/2281822796 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4ce60640 1 --2- 172.21.15.133:0/2281822796 >> v2:172.21.15.142:3300/0 conn(0x7fcb481570c0 0x7fcb4806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4d661640 1 -- 172.21.15.133:0/2281822796 >> v2:172.21.15.142:3300/0 conn(0x7fcb481570c0 msgr2=0x7fcb4806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4d661640 1 --2- 172.21.15.133:0/2281822796 >> v2:172.21.15.142:3300/0 conn(0x7fcb481570c0 0x7fcb4806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4d661640 1 -- 172.21.15.133:0/2281822796 >> v1:172.21.15.133:6789/0 conn(0x7fcb4806c320 legacy=0x7fcb480c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4d661640 1 -- 172.21.15.133:0/2281822796 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480c8b30 con 0x7fcb480ca000 2023-12-18T10:19:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb3f7fe640 1 -- 172.21.15.133:0/2281822796 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937210187 0 0) 0x7fcb480c9460 con 0x7fcb4806c320 2023-12-18T10:19:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4ce60640 1 --2- 172.21.15.133:0/2281822796 >> v2:172.21.15.142:3300/0 conn(0x7fcb481570c0 0x7fcb4806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4d661640 1 --2- 172.21.15.133:0/2281822796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb480ca000 0x7fcb48070df0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb4806e280 tx=0x7fcb4001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6889418a74e142 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb3f7fe640 1 -- 172.21.15.133:0/2281822796 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb400a5910 con 0x7fcb480ca000 2023-12-18T10:19:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb3f7fe640 1 -- 172.21.15.133:0/2281822796 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb400a5a70 con 0x7fcb480ca000 2023-12-18T10:19:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb3f7fe640 1 -- 172.21.15.133:0/2281822796 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb400a5e00 con 0x7fcb480ca000 2023-12-18T10:19:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/2281822796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb480ca000 msgr2=0x7fcb48070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.965+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/2281822796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb480ca000 0x7fcb48070df0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcb4806e280 tx=0x7fcb4001c850 comp rx=0 tx=0).stop 2023-12-18T10:19:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/2281822796 shutdown_connections 2023-12-18T10:19:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/2281822796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb480ca000 0x7fcb48070df0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/2281822796 >> v2:172.21.15.142:3300/0 conn(0x7fcb481570c0 0x7fcb4806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/2281822796 >> 172.21.15.133:0/2281822796 conn(0x7fcb4806a3e0 msgr2=0x7fcb480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/2281822796 shutdown_connections 2023-12-18T10:19:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/2281822796 wait complete. 2023-12-18T10:19:03.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 Processor -- start 2023-12-18T10:19:03.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 -- start start 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4806c320 0x7fcb4814bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb480ca000 0x7fcb48155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb481570c0 0x7fcb480cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4814c660 con 0x7fcb481570c0 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb481517b0 con 0x7fcb4806c320 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4f0c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480cbf90 con 0x7fcb480ca000 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4d661640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb481570c0 0x7fcb480cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4d661640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb481570c0 0x7fcb480cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54604/0 (socket says 172.21.15.133:54604) 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4d661640 1 -- 172.21.15.133:0/3930518829 learned_addr learned my addr 172.21.15.133:0/3930518829 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4ce60640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4806c320 0x7fcb4814bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb3ffff640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb480ca000 0x7fcb48155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4d661640 1 -- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb480ca000 msgr2=0x7fcb48155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4d661640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb480ca000 0x7fcb48155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4d661640 1 -- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4806c320 msgr2=0x7fcb4814bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4d661640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4806c320 0x7fcb4814bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4d661640 1 -- 172.21.15.133:0/3930518829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009a70 con 0x7fcb481570c0 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.969+0000 7fcb4ce60640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4806c320 0x7fcb4814bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb4d661640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb481570c0 0x7fcb480cc840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcb40019460 tx=0x7fcb400195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb3d7fa640 1 -- 172.21.15.133:0/3930518829 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb400ad950 con 0x7fcb481570c0 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb3d7fa640 1 -- 172.21.15.133:0/3930518829 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb400adad0 con 0x7fcb481570c0 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb3d7fa640 1 -- 172.21.15.133:0/3930518829 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb400ade80 con 0x7fcb481570c0 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480cc230 con 0x7fcb481570c0 2023-12-18T10:19:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb480ada80 con 0x7fcb481570c0 2023-12-18T10:19:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb480735b0 con 0x7fcb481570c0 2023-12-18T10:19:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb3d7fa640 1 -- 172.21.15.133:0/3930518829 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcb400b9450 con 0x7fcb481570c0 2023-12-18T10:19:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb3d7fa640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb34065a60 0x7fcb34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb3d7fa640 1 -- 172.21.15.133:0/3930518829 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb4011eb20 con 0x7fcb481570c0 2023-12-18T10:19:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.973+0000 7fcb4ce60640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb34065a60 0x7fcb34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.977+0000 7fcb4ce60640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb34065a60 0x7fcb34067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcb480cdde0 tx=0x7fcb44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:03.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:03.977+0000 7fcb3d7fa640 1 -- 172.21.15.133:0/3930518829 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcb400ec100 con 0x7fcb481570c0 2023-12-18T10:19:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb48151920 con 0x7fcb481570c0 2023-12-18T10:19:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb3d7fa640 1 -- 172.21.15.133:0/3930518829 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb400ef720 con 0x7fcb481570c0 2023-12-18T10:19:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:19:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb34065a60 msgr2=0x7fcb34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb34065a60 0x7fcb34067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcb480cdde0 tx=0x7fcb44008040 comp rx=0 tx=0).stop 2023-12-18T10:19:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb481570c0 msgr2=0x7fcb480cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb481570c0 0x7fcb480cc840 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcb40019460 tx=0x7fcb400195f0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 shutdown_connections 2023-12-18T10:19:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb34065a60 0x7fcb34067f20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb481570c0 0x7fcb480cc840 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb480ca000 0x7fcb48155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 --2- 172.21.15.133:0/3930518829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb4806c320 0x7fcb4814bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 >> 172.21.15.133:0/3930518829 conn(0x7fcb4806a3e0 msgr2=0x7fcb48159b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 shutdown_connections 2023-12-18T10:19:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.141+0000 7fcb4f0c4640 1 -- 172.21.15.133:0/3930518829 wait complete. 2023-12-18T10:19:04.165 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:19:04.165 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:04.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e712d1640 1 Processor -- start 2023-12-18T10:19:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e712d1640 1 -- start start 2023-12-18T10:19:04.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e712d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c15ca40 0x7f9e6c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e712d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e6c0ce3f0 0x7f9e6c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e712d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c0cfa70 con 0x7f9e6c0cf610 2023-12-18T10:19:04.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e712d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c0d11c0 con 0x7f9e6c0ce3f0 2023-12-18T10:19:04.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e712d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0d0310 con 0x7f9e6c15ca40 2023-12-18T10:19:04.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e627fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e6c0ce3f0 0x7f9e6c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e6b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9e6c0cf610 0x7f9e6c1605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39808/0 (socket says 172.21.15.133:39808) 2023-12-18T10:19:04.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e6b7fe640 1 -- 172.21.15.133:0/3130961516 learned_addr learned my addr 172.21.15.133:0/3130961516 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:04.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e6affd640 1 --2- 172.21.15.133:0/3130961516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c15ca40 0x7f9e6c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e627fc640 1 -- 172.21.15.133:0/3130961516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c15ca40 msgr2=0x7f9e6c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:04.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e627fc640 1 --2- 172.21.15.133:0/3130961516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c15ca40 0x7f9e6c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e627fc640 1 -- 172.21.15.133:0/3130961516 >> v1:172.21.15.133:6789/0 conn(0x7f9e6c0cf610 legacy=0x7f9e6c1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e627fc640 1 -- 172.21.15.133:0/3130961516 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c0d05b0 con 0x7f9e6c0ce3f0 2023-12-18T10:19:04.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.313+0000 7f9e6a7fc640 1 -- 172.21.15.133:0/3130961516 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871601076 0 0) 0x7f9e6c0cfa70 con 0x7f9e6c0cf610 2023-12-18T10:19:04.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e627fc640 1 --2- 172.21.15.133:0/3130961516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0ce3f0 0x7f9e6c0cf0d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009de0 tx=0x7f9e5401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872c5bfe45e7e79e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e6a7fc640 1 -- 172.21.15.133:0/3130961516 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540a5970 con 0x7f9e6c0ce3f0 2023-12-18T10:19:04.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e6a7fc640 1 -- 172.21.15.133:0/3130961516 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e540a5ad0 con 0x7f9e6c0ce3f0 2023-12-18T10:19:04.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e6a7fc640 1 -- 172.21.15.133:0/3130961516 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540a5e60 con 0x7f9e6c0ce3f0 2023-12-18T10:19:04.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e712d1640 1 -- 172.21.15.133:0/3130961516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0ce3f0 msgr2=0x7f9e6c0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e712d1640 1 --2- 172.21.15.133:0/3130961516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0ce3f0 0x7f9e6c0cf0d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009de0 tx=0x7f9e5401c990 comp rx=0 tx=0).stop 2023-12-18T10:19:04.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e712d1640 1 -- 172.21.15.133:0/3130961516 shutdown_connections 2023-12-18T10:19:04.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e712d1640 1 --2- 172.21.15.133:0/3130961516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0ce3f0 0x7f9e6c0cf0d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e712d1640 1 --2- 172.21.15.133:0/3130961516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c15ca40 0x7f9e6c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e712d1640 1 -- 172.21.15.133:0/3130961516 >> 172.21.15.133:0/3130961516 conn(0x7f9e6c089fb0 msgr2=0x7f9e6c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:04.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e712d1640 1 -- 172.21.15.133:0/3130961516 shutdown_connections 2023-12-18T10:19:04.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.317+0000 7f9e712d1640 1 -- 172.21.15.133:0/3130961516 wait complete. 2023-12-18T10:19:04.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 Processor -- start 2023-12-18T10:19:04.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 -- start start 2023-12-18T10:19:04.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c0ce3f0 0x7f9e6c0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0cf610 0x7f9e6c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c15ca40 0x7f9e6c06b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c153f40 con 0x7f9e6c0cf610 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c154360 con 0x7f9e6c15ca40 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0b0f30 con 0x7f9e6c0ce3f0 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0cf610 0x7f9e6c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0cf610 0x7f9e6c152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54618/0 (socket says 172.21.15.133:54618) 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 -- 172.21.15.133:0/2859650860 learned_addr learned my addr 172.21.15.133:0/2859650860 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e6affd640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c0ce3f0 0x7f9e6c0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e6b7fe640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c15ca40 0x7f9e6c06b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 -- 172.21.15.133:0/2859650860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c0ce3f0 msgr2=0x7f9e6c0b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c0ce3f0 0x7f9e6c0b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 -- 172.21.15.133:0/2859650860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c15ca40 msgr2=0x7f9e6c06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c15ca40 0x7f9e6c06b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 -- 172.21.15.133:0/2859650860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54009a70 con 0x7f9e6c0cf610 2023-12-18T10:19:04.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e627fc640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0cf610 0x7f9e6c152810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9e5401a5c0 tx=0x7f9e54019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e63fff640 1 -- 172.21.15.133:0/2859650860 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540ade60 con 0x7f9e6c0cf610 2023-12-18T10:19:04.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e63fff640 1 -- 172.21.15.133:0/2859650860 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54009450 con 0x7f9e6c0cf610 2023-12-18T10:19:04.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e63fff640 1 -- 172.21.15.133:0/2859650860 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540b9670 con 0x7f9e6c0cf610 2023-12-18T10:19:04.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c0b1210 con 0x7f9e6c0cf610 2023-12-18T10:19:04.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c153b60 con 0x7f9e6c0cf610 2023-12-18T10:19:04.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.321+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c04e000 con 0x7f9e6c0cf610 2023-12-18T10:19:04.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.325+0000 7f9e63fff640 1 -- 172.21.15.133:0/2859650860 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9e54006d50 con 0x7f9e6c0cf610 2023-12-18T10:19:04.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.325+0000 7f9e63fff640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e4c065a60 0x7f9e4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.325+0000 7f9e63fff640 1 -- 172.21.15.133:0/2859650860 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e5411ea10 con 0x7f9e6c0cf610 2023-12-18T10:19:04.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.325+0000 7f9e6affd640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e4c065a60 0x7f9e4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.325+0000 7f9e6affd640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e4c065a60 0x7f9e4c067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c006fd0 tx=0x7f9e5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.329+0000 7f9e63fff640 1 -- 172.21.15.133:0/2859650860 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9e540ebf70 con 0x7f9e6c0cf610 2023-12-18T10:19:04.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.477+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e6c0cff10 con 0x7f9e6c0cf610 2023-12-18T10:19:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e63fff640 1 -- 172.21.15.133:0/2859650860 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f9e540b2090 con 0x7f9e6c0cf610 2023-12-18T10:19:04.483 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:04.484 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e4c065a60 msgr2=0x7f9e4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e4c065a60 0x7f9e4c067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c006fd0 tx=0x7f9e5c008040 comp rx=0 tx=0).stop 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0cf610 msgr2=0x7f9e6c152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0cf610 0x7f9e6c152810 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9e5401a5c0 tx=0x7f9e54019730 comp rx=0 tx=0).stop 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 shutdown_connections 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e4c065a60 0x7f9e4c067f20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e6c15ca40 0x7f9e6c06b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6c0cf610 0x7f9e6c152810 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 --2- 172.21.15.133:0/2859650860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e6c0ce3f0 0x7f9e6c0b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 >> 172.21.15.133:0/2859650860 conn(0x7f9e6c089fb0 msgr2=0x7f9e6c0728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 shutdown_connections 2023-12-18T10:19:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.481+0000 7f9e712d1640 1 -- 172.21.15.133:0/2859650860 wait complete. 2023-12-18T10:19:04.505 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:19:04.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:04.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.641+0000 7fc3e12f9640 1 Processor -- start 2023-12-18T10:19:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.641+0000 7fc3e12f9640 1 -- start start 2023-12-18T10:19:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3e12f9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3dc15cae0 0x7fc3dc0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3e12f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cde90 0x7fc3dc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3e12f9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc3dc0cf170 0x7fc3dc0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3e12f9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc0cfb40 con 0x7fc3dc15cae0 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3e12f9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc15cec0 con 0x7fc3dc0cf170 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3e12f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0d0530 con 0x7fc3dc0cde90 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3daffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3dc15cae0 0x7fc3dc0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3daffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3dc15cae0 0x7fc3dc0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54624/0 (socket says 172.21.15.133:54624) 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3daffd640 1 -- 172.21.15.133:0/2407236184 learned_addr learned my addr 172.21.15.133:0/2407236184 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3db7fe640 1 --2- 172.21.15.133:0/2407236184 >> v2:172.21.15.142:3300/0 conn(0x7fc3dc0cf170 0x7fc3dc0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3d3fff640 1 --2- 172.21.15.133:0/2407236184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cde90 0x7fc3dc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3daffd640 1 -- 172.21.15.133:0/2407236184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cde90 msgr2=0x7fc3dc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3daffd640 1 --2- 172.21.15.133:0/2407236184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cde90 0x7fc3dc0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3daffd640 1 -- 172.21.15.133:0/2407236184 >> v2:172.21.15.142:3300/0 conn(0x7fc3dc0cf170 msgr2=0x7fc3dc0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3daffd640 1 --2- 172.21.15.133:0/2407236184 >> v2:172.21.15.142:3300/0 conn(0x7fc3dc0cf170 0x7fc3dc0cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.645+0000 7fc3daffd640 1 -- 172.21.15.133:0/2407236184 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0d0810 con 0x7fc3dc15cae0 2023-12-18T10:19:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3daffd640 1 --2- 172.21.15.133:0/2407236184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc0d12f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc160520 tx=0x7fc3cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb8f11c44da1890 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3da7fc640 1 -- 172.21.15.133:0/2407236184 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0aa5f0 con 0x7fc3dc15cae0 2023-12-18T10:19:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3da7fc640 1 -- 172.21.15.133:0/2407236184 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc0aa750 con 0x7fc3dc15cae0 2023-12-18T10:19:04.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3da7fc640 1 -- 172.21.15.133:0/2407236184 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0aaae0 con 0x7fc3dc15cae0 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- 172.21.15.133:0/2407236184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 msgr2=0x7fc3dc0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/2407236184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc0d12f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc160520 tx=0x7fc3cc01c4d0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- 172.21.15.133:0/2407236184 shutdown_connections 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/2407236184 >> v2:172.21.15.142:3300/0 conn(0x7fc3dc0cf170 0x7fc3dc0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/2407236184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cde90 0x7fc3dc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/2407236184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc0d12f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- 172.21.15.133:0/2407236184 >> 172.21.15.133:0/2407236184 conn(0x7fc3dc089fb0 msgr2=0x7fc3dc0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- 172.21.15.133:0/2407236184 shutdown_connections 2023-12-18T10:19:04.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- 172.21.15.133:0/2407236184 wait complete. 2023-12-18T10:19:04.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 Processor -- start 2023-12-18T10:19:04.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- start start 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3dc0cde90 0x7fc3dc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cf170 0x7fc3dc15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc15d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc15ee80 con 0x7fc3dc15cae0 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc15f160 con 0x7fc3dc0cde90 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.649+0000 7fc3e12f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc15f440 con 0x7fc3dc0cf170 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc15d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54640/0 (socket says 172.21.15.133:54640) 2023-12-18T10:19:04.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 -- 172.21.15.133:0/1835688496 learned_addr learned my addr 172.21.15.133:0/1835688496 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3d3fff640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cf170 0x7fc3dc15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3daffd640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3dc0cde90 0x7fc3dc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 -- 172.21.15.133:0/1835688496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cf170 msgr2=0x7fc3dc15d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cf170 0x7fc3dc15d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 -- 172.21.15.133:0/1835688496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3dc0cde90 msgr2=0x7fc3dc15dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3dc0cde90 0x7fc3dc15dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 -- 172.21.15.133:0/1835688496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc009480 con 0x7fc3dc15cae0 2023-12-18T10:19:04.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3db7fe640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc15d600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400efc0 tx=0x7fc3d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3d37fe640 1 -- 172.21.15.133:0/1835688496 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4009b10 con 0x7fc3dc15cae0 2023-12-18T10:19:04.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3d37fe640 1 -- 172.21.15.133:0/1835688496 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d400f040 con 0x7fc3dc15cae0 2023-12-18T10:19:04.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc15f720 con 0x7fc3dc15cae0 2023-12-18T10:19:04.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3d37fe640 1 -- 172.21.15.133:0/1835688496 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40146c0 con 0x7fc3dc15cae0 2023-12-18T10:19:04.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc15ff20 con 0x7fc3dc15cae0 2023-12-18T10:19:04.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc15fc40 con 0x7fc3dc15cae0 2023-12-18T10:19:04.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3d37fe640 1 -- 172.21.15.133:0/1835688496 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3d4014820 con 0x7fc3dc15cae0 2023-12-18T10:19:04.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.653+0000 7fc3d37fe640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3bc065a60 0x7fc3bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.657+0000 7fc3d37fe640 1 -- 172.21.15.133:0/1835688496 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3d4084290 con 0x7fc3dc15cae0 2023-12-18T10:19:04.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.657+0000 7fc3daffd640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3bc065a60 0x7fc3bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.657+0000 7fc3daffd640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3bc065a60 0x7fc3bc067f20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0ae000 tx=0x7fc3cc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.661+0000 7fc3d37fe640 1 -- 172.21.15.133:0/1835688496 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc3dc15fc40 con 0x7fc3dc15cae0 2023-12-18T10:19:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.805+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3dc15fc40 con 0x7fc3dc15cae0 2023-12-18T10:19:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3d37fe640 1 -- 172.21.15.133:0/1835688496 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3dc15fc40 con 0x7fc3dc15cae0 2023-12-18T10:19:04.811 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3bc065a60 msgr2=0x7fc3bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3bc065a60 0x7fc3bc067f20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0ae000 tx=0x7fc3cc0a7000 comp rx=0 tx=0).stop 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 msgr2=0x7fc3dc15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc15d600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400efc0 tx=0x7fc3d400c490 comp rx=0 tx=0).stop 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 shutdown_connections 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3bc065a60 0x7fc3bc067f20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3dc15cae0 0x7fc3dc15d600 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3dc0cf170 0x7fc3dc15d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 --2- 172.21.15.133:0/1835688496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3dc0cde90 0x7fc3dc15dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 >> 172.21.15.133:0/1835688496 conn(0x7fc3dc089fb0 msgr2=0x7fc3dc06c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 shutdown_connections 2023-12-18T10:19:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.809+0000 7fc3e12f9640 1 -- 172.21.15.133:0/1835688496 wait complete. 2023-12-18T10:19:04.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:19:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.969+0000 7f3d1cd8f640 1 Processor -- start 2023-12-18T10:19:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.969+0000 7f3d1cd8f640 1 -- start start 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d1cd8f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d180cf880 0x7f3d180ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d1cd8f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1815cec0 con 0x7f3d180cde90 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d1cd8f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d180d0530 con 0x7f3d1815cae0 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d1cd8f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d180d0810 con 0x7f3d180cf880 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d15d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3d180cde90 0x7f3d180cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39818/0 (socket says 172.21.15.133:39818) 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d15d9b640 1 -- 172.21.15.133:0/2731371266 learned_addr learned my addr 172.21.15.133:0/2731371266 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d16d9d640 1 --2- 172.21.15.133:0/2731371266 >> v2:172.21.15.142:3300/0 conn(0x7f3d180cf880 0x7f3d180ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d1559a640 1 -- 172.21.15.133:0/2731371266 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071002877 0 0) 0x7f3d1815cec0 con 0x7f3d180cde90 2023-12-18T10:19:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d1559a640 1 -- 172.21.15.133:0/2731371266 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d00003530 con 0x7f3d180cde90 2023-12-18T10:19:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d16d9d640 1 -- 172.21.15.133:0/2731371266 >> v1:172.21.15.142:6789/0 conn(0x7f3d1815cae0 legacy=0x7f3d180d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d1559a640 1 -- 172.21.15.133:0/2731371266 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834466600 0 0) 0x7f3d180d0530 con 0x7f3d1815cae0 2023-12-18T10:19:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d16d9d640 1 -- 172.21.15.133:0/2731371266 >> v1:172.21.15.133:6789/0 conn(0x7f3d180cde90 legacy=0x7f3d180cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.973+0000 7f3d16d9d640 1 -- 172.21.15.133:0/2731371266 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180d0af0 con 0x7f3d180cf880 2023-12-18T10:19:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d16d9d640 1 --2- 172.21.15.133:0/2731371266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d180cf880 0x7f3d180ce2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009d90 tx=0x7f3d1001c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a50b537c81221f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1559a640 1 -- 172.21.15.133:0/2731371266 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c001680 con 0x7f3d180cf880 2023-12-18T10:19:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1559a640 1 -- 172.21.15.133:0/2731371266 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d100a5600 con 0x7f3d180cf880 2023-12-18T10:19:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1559a640 1 -- 172.21.15.133:0/2731371266 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d100a5990 con 0x7f3d180cf880 2023-12-18T10:19:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/2731371266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d180cf880 msgr2=0x7f3d180ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 --2- 172.21.15.133:0/2731371266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d180cf880 0x7f3d180ce2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009d90 tx=0x7f3d1001c760 comp rx=0 tx=0).stop 2023-12-18T10:19:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/2731371266 shutdown_connections 2023-12-18T10:19:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 --2- 172.21.15.133:0/2731371266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d180cf880 0x7f3d180ce2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/2731371266 >> 172.21.15.133:0/2731371266 conn(0x7f3d18089fb0 msgr2=0x7f3d180d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/2731371266 shutdown_connections 2023-12-18T10:19:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/2731371266 wait complete. 2023-12-18T10:19:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 Processor -- start 2023-12-18T10:19:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.977+0000 7f3d1cd8f640 1 -- start start 2023-12-18T10:19:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d180cde90 0x7f3d18157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d180cf880 0x7f3d180cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d1815cae0 0x7f3d181556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18155260 con 0x7f3d180cf880 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180cb580 con 0x7f3d1815cae0 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180cb860 con 0x7f3d180cde90 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d180cf880 0x7f3d180cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d180cf880 0x7f3d180cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54654/0 (socket says 172.21.15.133:54654) 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d16d9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d1815cae0 0x7f3d181556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 -- 172.21.15.133:0/4180192615 learned_addr learned my addr 172.21.15.133:0/4180192615 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1659c640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d180cde90 0x7f3d18157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 -- 172.21.15.133:0/4180192615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d180cde90 msgr2=0x7f3d18157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d180cde90 0x7f3d18157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 -- 172.21.15.133:0/4180192615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d1815cae0 msgr2=0x7f3d181556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:04.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d1815cae0 0x7f3d181556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 -- 172.21.15.133:0/4180192615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10009a70 con 0x7f3d180cf880 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d15d9b640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d180cf880 0x7f3d180cae80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00c7a0 tx=0x7f3d0c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d06ffd640 1 -- 172.21.15.133:0/4180192615 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0074e0 con 0x7f3d180cf880 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d06ffd640 1 -- 172.21.15.133:0/4180192615 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c007660 con 0x7f3d180cf880 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d18154ef0 con 0x7f3d180cf880 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d06ffd640 1 -- 172.21.15.133:0/4180192615 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c004a30 con 0x7f3d180cf880 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d18155c30 con 0x7f3d180cf880 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.981+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1804e000 con 0x7f3d180cf880 2023-12-18T10:19:04.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.985+0000 7f3d06ffd640 1 -- 172.21.15.133:0/4180192615 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3d0c004c50 con 0x7f3d180cf880 2023-12-18T10:19:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.985+0000 7f3d06ffd640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf8065a60 0x7f3cf8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.985+0000 7f3d06ffd640 1 -- 172.21.15.133:0/4180192615 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3d0c082a20 con 0x7f3d180cf880 2023-12-18T10:19:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.985+0000 7f3d1659c640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf8065a60 0x7f3cf8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.985+0000 7f3d1659c640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf8065a60 0x7f3cf8067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d08000fc0 tx=0x7f3d08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:04.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:04.989+0000 7f3d06ffd640 1 -- 172.21.15.133:0/4180192615 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3d0c050160 con 0x7f3d180cf880 2023-12-18T10:19:05.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.137+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d180cff40 con 0x7f3d180cf880 2023-12-18T10:19:05.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.137+0000 7f3d06ffd640 1 -- 172.21.15.133:0/4180192615 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d0c0180a0 con 0x7f3d180cf880 2023-12-18T10:19:05.142 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf8065a60 msgr2=0x7f3cf8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf8065a60 0x7f3cf8067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d08000fc0 tx=0x7f3d08009040 comp rx=0 tx=0).stop 2023-12-18T10:19:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d180cf880 msgr2=0x7f3d180cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d180cf880 0x7f3d180cae80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00c7a0 tx=0x7f3d0c00cc60 comp rx=0 tx=0).stop 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 shutdown_connections 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf8065a60 0x7f3cf8067f20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d1815cae0 0x7f3d181556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d180cf880 0x7f3d180cae80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 --2- 172.21.15.133:0/4180192615 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d180cde90 0x7f3d18157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 >> 172.21.15.133:0/4180192615 conn(0x7f3d18089fb0 msgr2=0x7f3d180cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 shutdown_connections 2023-12-18T10:19:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.141+0000 7f3d1cd8f640 1 -- 172.21.15.133:0/4180192615 wait complete. 2023-12-18T10:19:05.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:19:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.301+0000 7ff985463640 1 Processor -- start 2023-12-18T10:19:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.301+0000 7ff985463640 1 -- start start 2023-12-18T10:19:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.301+0000 7ff985463640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff980070820 0x7ff9800c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.301+0000 7ff985463640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9800c9390 con 0x7ff9801582d0 2023-12-18T10:19:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.301+0000 7ff985463640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98015aee0 con 0x7ff9800ce3b0 2023-12-18T10:19:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.301+0000 7ff985463640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98015b1c0 con 0x7ff980070820 2023-12-18T10:19:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff9767fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff980070820 0x7ff9800c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff97effd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff9801582d0 0x7ff9800ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39828/0 (socket says 172.21.15.133:39828) 2023-12-18T10:19:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff97effd640 1 -- 172.21.15.133:0/2878944430 learned_addr learned my addr 172.21.15.133:0/2878944430 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff9767fc640 1 -- 172.21.15.133:0/2878944430 >> v1:172.21.15.142:6789/0 conn(0x7ff9800ce3b0 legacy=0x7ff9800cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff9767fc640 1 -- 172.21.15.133:0/2878944430 >> v1:172.21.15.133:6789/0 conn(0x7ff9801582d0 legacy=0x7ff9800ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff9767fc640 1 -- 172.21.15.133:0/2878944430 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98015b4a0 con 0x7ff980070820 2023-12-18T10:19:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff97e7fc640 1 -- 172.21.15.133:0/2878944430 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757871920 0 0) 0x7ff9800c9390 con 0x7ff9801582d0 2023-12-18T10:19:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff9767fc640 1 --2- 172.21.15.133:0/2878944430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff980070820 0x7ff9800c8e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff9700097c0 tx=0x7ff97001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33f8c12d5100224 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff97e7fc640 1 -- 172.21.15.133:0/2878944430 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9700ab670 con 0x7ff980070820 2023-12-18T10:19:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff97e7fc640 1 -- 172.21.15.133:0/2878944430 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9700ab7d0 con 0x7ff980070820 2023-12-18T10:19:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.305+0000 7ff97e7fc640 1 -- 172.21.15.133:0/2878944430 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9700abb60 con 0x7ff980070820 2023-12-18T10:19:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- 172.21.15.133:0/2878944430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff980070820 msgr2=0x7ff9800c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 --2- 172.21.15.133:0/2878944430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff980070820 0x7ff9800c8e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff9700097c0 tx=0x7ff97001c450 comp rx=0 tx=0).stop 2023-12-18T10:19:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- 172.21.15.133:0/2878944430 shutdown_connections 2023-12-18T10:19:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 --2- 172.21.15.133:0/2878944430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff980070820 0x7ff9800c8e50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- 172.21.15.133:0/2878944430 >> 172.21.15.133:0/2878944430 conn(0x7ff98006a2a0 msgr2=0x7ff9800aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- 172.21.15.133:0/2878944430 shutdown_connections 2023-12-18T10:19:05.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- 172.21.15.133:0/2878944430 wait complete. 2023-12-18T10:19:05.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 Processor -- start 2023-12-18T10:19:05.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- start start 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff980070820 0x7ff98015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9800ce3b0 0x7ff980154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9801582d0 0x7ff980153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c34f0 con 0x7ff9800ce3b0 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c37d0 con 0x7ff9801582d0 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff985463640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800c4870 con 0x7ff980070820 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff9767fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9800ce3b0 0x7ff980154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff9767fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9800ce3b0 0x7ff980154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54676/0 (socket says 172.21.15.133:54676) 2023-12-18T10:19:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff9767fc640 1 -- 172.21.15.133:0/2267083588 learned_addr learned my addr 172.21.15.133:0/2267083588 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff97effd640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff980070820 0x7ff98015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.309+0000 7ff97f7fe640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9801582d0 0x7ff980153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff9767fc640 1 -- 172.21.15.133:0/2267083588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff980070820 msgr2=0x7ff98015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff9767fc640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff980070820 0x7ff98015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff9767fc640 1 -- 172.21.15.133:0/2267083588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9801582d0 msgr2=0x7ff980153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff9767fc640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9801582d0 0x7ff980153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff9767fc640 1 -- 172.21.15.133:0/2267083588 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff970009420 con 0x7ff9800ce3b0 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff9767fc640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9800ce3b0 0x7ff980154350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff9700ad040 tx=0x7ff97001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff977fff640 1 -- 172.21.15.133:0/2267083588 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9700ab670 con 0x7ff9800ce3b0 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff977fff640 1 -- 172.21.15.133:0/2267083588 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9700b9070 con 0x7ff9800ce3b0 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff977fff640 1 -- 172.21.15.133:0/2267083588 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970004460 con 0x7ff9800ce3b0 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9800c4b50 con 0x7ff9800ce3b0 2023-12-18T10:19:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff980153fd0 con 0x7ff9800ce3b0 2023-12-18T10:19:05.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9800c4d40 con 0x7ff9800ce3b0 2023-12-18T10:19:05.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff977fff640 1 -- 172.21.15.133:0/2267083588 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9700b4610 con 0x7ff9800ce3b0 2023-12-18T10:19:05.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff977fff640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff960065a60 0x7ff960067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff977fff640 1 -- 172.21.15.133:0/2267083588 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff9700bb070 con 0x7ff9800ce3b0 2023-12-18T10:19:05.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.313+0000 7ff97effd640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff960065a60 0x7ff960067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.317+0000 7ff97effd640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff960065a60 0x7ff960067f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff968000f70 tx=0x7ff968007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.317+0000 7ff977fff640 1 -- 172.21.15.133:0/2267083588 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff9700eb750 con 0x7ff9800ce3b0 2023-12-18T10:19:05.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.465+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff98004e000 con 0x7ff9800ce3b0 2023-12-18T10:19:05.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff977fff640 1 -- 172.21.15.133:0/2267083588 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9700c40a0 con 0x7ff9800ce3b0 2023-12-18T10:19:05.471 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff960065a60 msgr2=0x7ff960067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff960065a60 0x7ff960067f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff968000f70 tx=0x7ff968007240 comp rx=0 tx=0).stop 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9800ce3b0 msgr2=0x7ff980154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9800ce3b0 0x7ff980154350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff9700ad040 tx=0x7ff97001ac90 comp rx=0 tx=0).stop 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 shutdown_connections 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff960065a60 0x7ff960067f20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9801582d0 0x7ff980153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9800ce3b0 0x7ff980154350 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 --2- 172.21.15.133:0/2267083588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff980070820 0x7ff98015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 >> 172.21.15.133:0/2267083588 conn(0x7ff98006a2a0 msgr2=0x7ff9800ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 shutdown_connections 2023-12-18T10:19:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.469+0000 7ff985463640 1 -- 172.21.15.133:0/2267083588 wait complete. 2023-12-18T10:19:05.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:19:05.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.629+0000 7fce0ae73640 1 Processor -- start 2023-12-18T10:19:05.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.629+0000 7fce0ae73640 1 -- start start 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce0ae73640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce04071870 0x7fce04071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce0ae73640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fce040cbff0 0x7fce040cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce0ae73640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce040cc930 con 0x7fce040ca410 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce0ae73640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0415aab0 con 0x7fce04071870 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce0ae73640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce04070df0 con 0x7fce040cbff0 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce03fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce04071870 0x7fce04071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce03fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce04071870 0x7fce04071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54680/0 (socket says 172.21.15.133:54680) 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce03fff640 1 -- 172.21.15.133:0/2498995103 learned_addr learned my addr 172.21.15.133:0/2498995103 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce09410640 1 --2- 172.21.15.133:0/2498995103 >> v2:172.21.15.142:3300/0 conn(0x7fce040cbff0 0x7fce040cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce03fff640 1 -- 172.21.15.133:0/2498995103 >> v2:172.21.15.142:3300/0 conn(0x7fce040cbff0 msgr2=0x7fce040cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce03fff640 1 --2- 172.21.15.133:0/2498995103 >> v2:172.21.15.142:3300/0 conn(0x7fce040cbff0 0x7fce040cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce03fff640 1 -- 172.21.15.133:0/2498995103 >> v1:172.21.15.142:6789/0 conn(0x7fce040ca410 legacy=0x7fce04159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce03fff640 1 -- 172.21.15.133:0/2498995103 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0415a4f0 con 0x7fce04071870 2023-12-18T10:19:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce09410640 1 --2- 172.21.15.133:0/2498995103 >> v2:172.21.15.142:3300/0 conn(0x7fce040cbff0 0x7fce040cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce03fff640 1 --2- 172.21.15.133:0/2498995103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce04071d00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fce040c1ef0 tx=0x7fcdf001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19796a9ffea90e08 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce037fe640 1 -- 172.21.15.133:0/2498995103 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00aa430 con 0x7fce04071870 2023-12-18T10:19:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.633+0000 7fce037fe640 1 -- 172.21.15.133:0/2498995103 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf00aa590 con 0x7fce04071870 2023-12-18T10:19:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce037fe640 1 -- 172.21.15.133:0/2498995103 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00aa920 con 0x7fce04071870 2023-12-18T10:19:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- 172.21.15.133:0/2498995103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 msgr2=0x7fce04071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 --2- 172.21.15.133:0/2498995103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce04071d00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fce040c1ef0 tx=0x7fcdf001c4d0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- 172.21.15.133:0/2498995103 shutdown_connections 2023-12-18T10:19:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 --2- 172.21.15.133:0/2498995103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce04071d00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 --2- 172.21.15.133:0/2498995103 >> v2:172.21.15.142:3300/0 conn(0x7fce040cbff0 0x7fce040cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- 172.21.15.133:0/2498995103 >> 172.21.15.133:0/2498995103 conn(0x7fce0406a2a0 msgr2=0x7fce040aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- 172.21.15.133:0/2498995103 shutdown_connections 2023-12-18T10:19:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- 172.21.15.133:0/2498995103 wait complete. 2023-12-18T10:19:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 Processor -- start 2023-12-18T10:19:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- start start 2023-12-18T10:19:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce040c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce040ca410 0x7fce040c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce040cbff0 0x7fce041545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce04150b80 con 0x7fce04071870 2023-12-18T10:19:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce040c5000 con 0x7fce040cbff0 2023-12-18T10:19:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce0ae73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce040c4d60 con 0x7fce040ca410 2023-12-18T10:19:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce08c0f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce040c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce08c0f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce040c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54692/0 (socket says 172.21.15.133:54692) 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce08c0f640 1 -- 172.21.15.133:0/1874985054 learned_addr learned my addr 172.21.15.133:0/1874985054 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce03fff640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce040ca410 0x7fce040c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.637+0000 7fce09410640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce040cbff0 0x7fce041545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce08c0f640 1 -- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce040ca410 msgr2=0x7fce040c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce08c0f640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce040ca410 0x7fce040c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce08c0f640 1 -- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce040cbff0 msgr2=0x7fce041545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce08c0f640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce040cbff0 0x7fce041545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce08c0f640 1 -- 172.21.15.133:0/1874985054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00094d0 con 0x7fce04071870 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce09410640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce040cbff0 0x7fce041545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce08c0f640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce040c4820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800c450 tx=0x7fcdf800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce017fa640 1 -- 172.21.15.133:0/1874985054 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80052d0 con 0x7fce04071870 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce017fa640 1 -- 172.21.15.133:0/1874985054 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf8005450 con 0x7fce04071870 2023-12-18T10:19:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce040c20f0 con 0x7fce04071870 2023-12-18T10:19:05.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce017fa640 1 -- 172.21.15.133:0/1874985054 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8003860 con 0x7fce04071870 2023-12-18T10:19:05.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce040c26b0 con 0x7fce04071870 2023-12-18T10:19:05.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0404e000 con 0x7fce04071870 2023-12-18T10:19:05.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce017fa640 1 -- 172.21.15.133:0/1874985054 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcdf80039c0 con 0x7fce04071870 2023-12-18T10:19:05.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce017fa640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde8065a60 0x7fcde8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce017fa640 1 -- 172.21.15.133:0/1874985054 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcdf8082a70 con 0x7fce04071870 2023-12-18T10:19:05.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.641+0000 7fce03fff640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde8065a60 0x7fcde8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.645+0000 7fce03fff640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde8065a60 0x7fcde8067f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00ae000 tx=0x7fcdf00b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.645+0000 7fce017fa640 1 -- 172.21.15.133:0/1874985054 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcdf8050120 con 0x7fce04071870 2023-12-18T10:19:05.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.801+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fce0415ac10 con 0x7fce04071870 2023-12-18T10:19:05.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.801+0000 7fce017fa640 1 -- 172.21.15.133:0/1874985054 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcdf8017020 con 0x7fce04071870 2023-12-18T10:19:05.805 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde8065a60 msgr2=0x7fcde8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde8065a60 0x7fcde8067f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00ae000 tx=0x7fcdf00b5040 comp rx=0 tx=0).stop 2023-12-18T10:19:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 msgr2=0x7fce040c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce040c4820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800c450 tx=0x7fcdf800c910 comp rx=0 tx=0).stop 2023-12-18T10:19:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 shutdown_connections 2023-12-18T10:19:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde8065a60 0x7fcde8067f20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce040cbff0 0x7fce041545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fce040ca410 0x7fce040c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 --2- 172.21.15.133:0/1874985054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce04071870 0x7fce040c4820 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 >> 172.21.15.133:0/1874985054 conn(0x7fce0406a2a0 msgr2=0x7fce04158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 shutdown_connections 2023-12-18T10:19:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.805+0000 7fce0ae73640 1 -- 172.21.15.133:0/1874985054 wait complete. 2023-12-18T10:19:05.827 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:19:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.961+0000 7f53ea08c640 1 Processor -- start 2023-12-18T10:19:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.961+0000 7f53ea08c640 1 -- start start 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53ea08c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53e40cac10 0x7f53e415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53ea08c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53e406fdb0 0x7f53e4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53ea08c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e415f100 con 0x7f53e415a680 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53ea08c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e4070780 con 0x7f53e40cac10 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53ea08c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e40ca7d0 con 0x7f53e406fdb0 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53e2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53e40cac10 0x7f53e415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53e2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53e40cac10 0x7f53e415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54698/0 (socket says 172.21.15.133:54698) 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53e2ffd640 1 -- 172.21.15.133:0/3238977277 learned_addr learned my addr 172.21.15.133:0/3238977277 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53e3fff640 1 --2- 172.21.15.133:0/3238977277 >> v2:172.21.15.142:3300/0 conn(0x7f53e406fdb0 0x7f53e4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53e2ffd640 1 -- 172.21.15.133:0/3238977277 >> v2:172.21.15.142:3300/0 conn(0x7f53e406fdb0 msgr2=0x7f53e4070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53e2ffd640 1 --2- 172.21.15.133:0/3238977277 >> v2:172.21.15.142:3300/0 conn(0x7f53e406fdb0 0x7f53e4070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53e2ffd640 1 -- 172.21.15.133:0/3238977277 >> v1:172.21.15.142:6789/0 conn(0x7f53e415a680 legacy=0x7f53e415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.965+0000 7f53e2ffd640 1 -- 172.21.15.133:0/3238977277 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e415e860 con 0x7f53e40cac10 2023-12-18T10:19:05.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53e2ffd640 1 --2- 172.21.15.133:0/3238977277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e415e160 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f53e4071bd0 tx=0x7f53d801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9722d308824b386 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53e27fc640 1 -- 172.21.15.133:0/3238977277 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80a7070 con 0x7f53e40cac10 2023-12-18T10:19:05.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53e27fc640 1 -- 172.21.15.133:0/3238977277 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d80ab430 con 0x7f53e40cac10 2023-12-18T10:19:05.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53e27fc640 1 -- 172.21.15.133:0/3238977277 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80ab7c0 con 0x7f53e40cac10 2023-12-18T10:19:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 -- 172.21.15.133:0/3238977277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 msgr2=0x7f53e415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 --2- 172.21.15.133:0/3238977277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e415e160 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f53e4071bd0 tx=0x7f53d801c430 comp rx=0 tx=0).stop 2023-12-18T10:19:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 -- 172.21.15.133:0/3238977277 shutdown_connections 2023-12-18T10:19:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 --2- 172.21.15.133:0/3238977277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e415e160 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 --2- 172.21.15.133:0/3238977277 >> v2:172.21.15.142:3300/0 conn(0x7f53e406fdb0 0x7f53e4070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 -- 172.21.15.133:0/3238977277 >> 172.21.15.133:0/3238977277 conn(0x7f53e406a3e0 msgr2=0x7f53e40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 -- 172.21.15.133:0/3238977277 shutdown_connections 2023-12-18T10:19:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 -- 172.21.15.133:0/3238977277 wait complete. 2023-12-18T10:19:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 Processor -- start 2023-12-18T10:19:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 -- start start 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e406fdb0 0x7f53e414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e4155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.969+0000 7f53ea08c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e415a680 0x7f53e4159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53ea08c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4150940 con 0x7f53e40cac10 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53ea08c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4150130 con 0x7f53e406fdb0 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53ea08c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e4150380 con 0x7f53e415a680 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e4155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e4155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54704/0 (socket says 172.21.15.133:54704) 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 -- 172.21.15.133:0/1461876151 learned_addr learned my addr 172.21.15.133:0/1461876151 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e37fe640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e406fdb0 0x7f53e414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e3fff640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e415a680 0x7f53e4159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 -- 172.21.15.133:0/1461876151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e415a680 msgr2=0x7f53e4159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e415a680 0x7f53e4159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 -- 172.21.15.133:0/1461876151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e406fdb0 msgr2=0x7f53e414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e406fdb0 0x7f53e414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 -- 172.21.15.133:0/1461876151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80094d0 con 0x7f53e40cac10 2023-12-18T10:19:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53e2ffd640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e4155c10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f53d801a060 tx=0x7f53d80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53cbfff640 1 -- 172.21.15.133:0/1461876151 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80b4830 con 0x7f53e40cac10 2023-12-18T10:19:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53cbfff640 1 -- 172.21.15.133:0/1461876151 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d80b4990 con 0x7f53e40cac10 2023-12-18T10:19:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53cbfff640 1 -- 172.21.15.133:0/1461876151 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d80b4d40 con 0x7f53e40cac10 2023-12-18T10:19:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e4150660 con 0x7f53e40cac10 2023-12-18T10:19:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e414fed0 con 0x7f53e40cac10 2023-12-18T10:19:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e40735b0 con 0x7f53e40cac10 2023-12-18T10:19:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.973+0000 7f53cbfff640 1 -- 172.21.15.133:0/1461876151 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f53d80b3380 con 0x7f53e40cac10 2023-12-18T10:19:05.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.977+0000 7f53cbfff640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53d0065a60 0x7f53d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:05.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.977+0000 7f53cbfff640 1 -- 172.21.15.133:0/1461876151 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f53d811d8c0 con 0x7f53e40cac10 2023-12-18T10:19:05.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.977+0000 7f53e37fe640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53d0065a60 0x7f53d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:05.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.977+0000 7f53e37fe640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53d0065a60 0x7f53d0067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f53d4007fd0 tx=0x7f53d4007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:05.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:05.981+0000 7f53cbfff640 1 -- 172.21.15.133:0/1461876151 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f53d80eb080 con 0x7f53e40cac10 2023-12-18T10:19:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53e404e000 con 0x7f53e40cac10 2023-12-18T10:19:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53cbfff640 1 -- 172.21.15.133:0/1461876151 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53d80ba080 con 0x7f53e40cac10 2023-12-18T10:19:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53d0065a60 msgr2=0x7f53d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53d0065a60 0x7f53d0067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f53d4007fd0 tx=0x7f53d4007e40 comp rx=0 tx=0).stop 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 msgr2=0x7f53e4155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e4155c10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f53d801a060 tx=0x7f53d80191d0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 shutdown_connections 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53d0065a60 0x7f53d0067f20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53e415a680 0x7f53e4159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53e40cac10 0x7f53e4155c10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.141+0000 7f53ea08c640 1 --2- 172.21.15.133:0/1461876151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53e406fdb0 0x7f53e414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.145+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 >> 172.21.15.133:0/1461876151 conn(0x7f53e406a3e0 msgr2=0x7f53e4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.145+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 shutdown_connections 2023-12-18T10:19:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.145+0000 7f53ea08c640 1 -- 172.21.15.133:0/1461876151 wait complete. 2023-12-18T10:19:06.165 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2023-12-18T10:19:06.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:06.166 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-18T10:19:06.205 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:19:06.205 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:19:06.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:06.205 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-18T10:19:06.263 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:19:06.263 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:06.272 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:19:06.272 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:06.327 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:06.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.505+0000 7f0a5ebbc640 1 Processor -- start 2023-12-18T10:19:06.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.505+0000 7f0a5ebbc640 1 -- start start 2023-12-18T10:19:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5ebbc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0a580cdd40 0x7f0a580cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5ebbc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a58160690 con 0x7f0a5806fdb0 2023-12-18T10:19:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5ebbc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a580b0d80 con 0x7f0a5815c9d0 2023-12-18T10:19:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5ebbc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a581603f0 con 0x7f0a580cdd40 2023-12-18T10:19:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5d159640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0a5806fdb0 0x7f0a580cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39832/0 (socket says 172.21.15.133:39832) 2023-12-18T10:19:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5d159640 1 -- 172.21.15.133:0/46438520 learned_addr learned my addr 172.21.15.133:0/46438520 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:06.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4ffff640 1 --2- 172.21.15.133:0/46438520 >> v2:172.21.15.142:3300/0 conn(0x7f0a580cdd40 0x7f0a580cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702067814 0 0) 0x7f0a58160690 con 0x7f0a5806fdb0 2023-12-18T10:19:06.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a40003530 con 0x7f0a5806fdb0 2023-12-18T10:19:06.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2705153782 0 0) 0x7f0a40003530 con 0x7f0a5806fdb0 2023-12-18T10:19:06.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 >> v2:172.21.15.142:3300/0 conn(0x7f0a580cdd40 msgr2=0x7f0a580cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:06.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 --2- 172.21.15.133:0/46438520 >> v2:172.21.15.142:3300/0 conn(0x7f0a580cdd40 0x7f0a580cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 >> v1:172.21.15.142:6789/0 conn(0x7f0a5815c9d0 legacy=0x7f0a58160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580ccb00 con 0x7f0a5806fdb0 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f0a50001a00 con 0x7f0a5806fdb0 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 >> v1:172.21.15.133:6789/0 conn(0x7f0a5806fdb0 legacy=0x7f0a580cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a40003980 0x7f0a40003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a40005190 0x7f0a4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a581603f0 con 0x7f0a400047d0 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4000c030 con 0x7f0a40003980 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4000c1f0 con 0x7f0a40005190 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4ffff640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5c958640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a40003980 0x7f0a40003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5d159640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a40005190 0x7f0a4000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4ffff640 1 -- 172.21.15.133:0/46438520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a40005190 msgr2=0x7f0a4000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:06.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4ffff640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a40005190 0x7f0a4000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4ffff640 1 -- 172.21.15.133:0/46438520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a40003980 msgr2=0x7f0a40003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:06.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4ffff640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a40003980 0x7f0a40003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a4ffff640 1 -- 172.21.15.133:0/46438520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40003530 con 0x7f0a400047d0 2023-12-18T10:19:06.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.509+0000 7f0a5d159640 1 -- 172.21.15.133:0/46438520 reap_dead start 2023-12-18T10:19:06.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a4ffff640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a40004c50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009ae0 tx=0x7f0a4801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296432233c9f14df server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a480a5530 con 0x7f0a400047d0 2023-12-18T10:19:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a480a5690 con 0x7f0a400047d0 2023-12-18T10:19:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a4f7fe640 1 -- 172.21.15.133:0/46438520 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a480a5a40 con 0x7f0a400047d0 2023-12-18T10:19:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/46438520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 msgr2=0x7f0a40004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a40004c50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009ae0 tx=0x7f0a4801ca50 comp rx=0 tx=0).stop 2023-12-18T10:19:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/46438520 shutdown_connections 2023-12-18T10:19:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 --2- 172.21.15.133:0/46438520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a40004c50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/46438520 >> 172.21.15.133:0/46438520 conn(0x7f0a5806a3e0 msgr2=0x7f0a580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/46438520 shutdown_connections 2023-12-18T10:19:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/46438520 wait complete. 2023-12-18T10:19:06.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 Processor -- start 2023-12-18T10:19:06.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.513+0000 7f0a5ebbc640 1 -- start start 2023-12-18T10:19:06.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a580abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a580c7f70 0x7f0a58151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a580c7080 0x7f0a581516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c6890 con 0x7f0a400047d0 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c57f0 con 0x7f0a580c7f70 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c5ad0 con 0x7f0a580c7080 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a580abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a580abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54720/0 (socket says 172.21.15.133:54720) 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 -- 172.21.15.133:0/2338252973 learned_addr learned my addr 172.21.15.133:0/2338252973 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a4ffff640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a580c7f70 0x7f0a58151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5d159640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a580c7080 0x7f0a581516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 -- 172.21.15.133:0/2338252973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a580c7080 msgr2=0x7f0a581516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a580c7080 0x7f0a581516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 -- 172.21.15.133:0/2338252973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a580c7f70 msgr2=0x7f0a58151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a580c7f70 0x7f0a58151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 -- 172.21.15.133:0/2338252973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580c5db0 con 0x7f0a400047d0 2023-12-18T10:19:06.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5c958640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a580abb00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400f7f0 tx=0x7f0a5400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:06.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a4d7fa640 1 -- 172.21.15.133:0/2338252973 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a540050d0 con 0x7f0a400047d0 2023-12-18T10:19:06.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a4d7fa640 1 -- 172.21.15.133:0/2338252973 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54005230 con 0x7f0a400047d0 2023-12-18T10:19:06.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a4d7fa640 1 -- 172.21.15.133:0/2338252973 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5400d730 con 0x7f0a400047d0 2023-12-18T10:19:06.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a580c6090 con 0x7f0a400047d0 2023-12-18T10:19:06.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a580c5430 con 0x7f0a400047d0 2023-12-18T10:19:06.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a580735b0 con 0x7f0a400047d0 2023-12-18T10:19:06.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.517+0000 7f0a4d7fa640 1 -- 172.21.15.133:0/2338252973 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0a5400d890 con 0x7f0a400047d0 2023-12-18T10:19:06.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.521+0000 7f0a4d7fa640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0a44065a90 0x7f0a44067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.521+0000 7f0a4d7fa640 1 -- 172.21.15.133:0/2338252973 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0a54083500 con 0x7f0a400047d0 2023-12-18T10:19:06.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.521+0000 7f0a4ffff640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0a44065a90 0x7f0a44067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.521+0000 7f0a4ffff640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0a44065a90 0x7f0a44067f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a480af000 tx=0x7f0a480046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.525+0000 7f0a4d7fa640 1 -- 172.21.15.133:0/2338252973 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0a54050a60 con 0x7f0a400047d0 2023-12-18T10:19:06.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.673+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a580cc380 con 0x7f0a400047d0 2023-12-18T10:19:06.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a4d7fa640 1 -- 172.21.15.133:0/2338252973 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f0a54054080 con 0x7f0a400047d0 2023-12-18T10:19:06.680 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:06.680 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0a44065a90 msgr2=0x7f0a44067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0a44065a90 0x7f0a44067f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a480af000 tx=0x7f0a480046d0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 msgr2=0x7f0a580abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a580abb00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400f7f0 tx=0x7f0a5400fcb0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 shutdown_connections 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0a44065a90 0x7f0a44067f50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0a580c7080 0x7f0a581516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a580c7f70 0x7f0a58151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 --2- 172.21.15.133:0/2338252973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a400047d0 0x7f0a580abb00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 >> 172.21.15.133:0/2338252973 conn(0x7f0a5806a3e0 msgr2=0x7f0a580af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 shutdown_connections 2023-12-18T10:19:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.677+0000 7f0a5ebbc640 1 -- 172.21.15.133:0/2338252973 wait complete. 2023-12-18T10:19:06.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:19:06.702 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:06.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4329c8c640 1 Processor -- start 2023-12-18T10:19:06.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4329c8c640 1 -- start start 2023-12-18T10:19:06.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4329c8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43240c9690 0x7f4324160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4329c8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4324142cd0 con 0x7f43240c92b0 2023-12-18T10:19:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4329c8c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43241604c0 con 0x7f43240ceac0 2023-12-18T10:19:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4329c8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4324142fb0 con 0x7f43240c9690 2023-12-18T10:19:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f43237fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f43240c92b0 0x7f43240ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39844/0 (socket says 172.21.15.133:39844) 2023-12-18T10:19:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f43237fe640 1 -- 172.21.15.133:0/547734626 learned_addr learned my addr 172.21.15.133:0/547734626 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4323fff640 1 --2- 172.21.15.133:0/547734626 >> v2:172.21.15.133:3300/0 conn(0x7f43240c9690 0x7f4324160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f43227fc640 1 -- 172.21.15.133:0/547734626 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434106323 0 0) 0x7f4324142cd0 con 0x7f43240c92b0 2023-12-18T10:19:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f43227fc640 1 -- 172.21.15.133:0/547734626 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f430c003530 con 0x7f43240c92b0 2023-12-18T10:19:06.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4323fff640 1 -- 172.21.15.133:0/547734626 >> v1:172.21.15.142:6789/0 conn(0x7f43240ceac0 legacy=0x7f4324142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4323fff640 1 -- 172.21.15.133:0/547734626 >> v1:172.21.15.133:6789/0 conn(0x7f43240c92b0 legacy=0x7f43240ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.841+0000 7f4323fff640 1 -- 172.21.15.133:0/547734626 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43241607a0 con 0x7f43240c9690 2023-12-18T10:19:06.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f4323fff640 1 --2- 172.21.15.133:0/547734626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c9690 0x7f4324160fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f431c009d90 tx=0x7f431c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d6d9860d6bbeeb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:06.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f43227fc640 1 -- 172.21.15.133:0/547734626 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c0a59a0 con 0x7f43240c9690 2023-12-18T10:19:06.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f43227fc640 1 -- 172.21.15.133:0/547734626 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431c0a5b00 con 0x7f43240c9690 2023-12-18T10:19:06.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f43227fc640 1 -- 172.21.15.133:0/547734626 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c0a5e90 con 0x7f43240c9690 2023-12-18T10:19:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f4329c8c640 1 -- 172.21.15.133:0/547734626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c9690 msgr2=0x7f4324160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f4329c8c640 1 --2- 172.21.15.133:0/547734626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c9690 0x7f4324160fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f431c009d90 tx=0x7f431c01c8c0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f4329c8c640 1 -- 172.21.15.133:0/547734626 shutdown_connections 2023-12-18T10:19:06.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f4329c8c640 1 --2- 172.21.15.133:0/547734626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c9690 0x7f4324160fa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f4329c8c640 1 -- 172.21.15.133:0/547734626 >> 172.21.15.133:0/547734626 conn(0x7f432406a2a0 msgr2=0x7f43240aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f4329c8c640 1 -- 172.21.15.133:0/547734626 shutdown_connections 2023-12-18T10:19:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.845+0000 7f4329c8c640 1 -- 172.21.15.133:0/547734626 wait complete. 2023-12-18T10:19:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 Processor -- start 2023-12-18T10:19:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 -- start start 2023-12-18T10:19:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c92b0 0x7f4324152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43240c9690 0x7f432415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43240ceac0 0x7f43241439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4324152980 con 0x7f43240c92b0 2023-12-18T10:19:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4324157a30 con 0x7f43240ceac0 2023-12-18T10:19:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4324157d10 con 0x7f43240c9690 2023-12-18T10:19:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c92b0 0x7f4324152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c92b0 0x7f4324152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54730/0 (socket says 172.21.15.133:54730) 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 -- 172.21.15.133:0/1435739081 learned_addr learned my addr 172.21.15.133:0/1435739081 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4322ffd640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43240c9690 0x7f432415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4323fff640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43240ceac0 0x7f43241439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 -- 172.21.15.133:0/1435739081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43240c9690 msgr2=0x7f432415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43240c9690 0x7f432415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 -- 172.21.15.133:0/1435739081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43240ceac0 msgr2=0x7f43241439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43240ceac0 0x7f43241439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 -- 172.21.15.133:0/1435739081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009a70 con 0x7f43240c92b0 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f43237fe640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c92b0 0x7f4324152440 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f431400c4d0 tx=0x7f431400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f430bfff640 1 -- 172.21.15.133:0/1435739081 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314005cf0 con 0x7f43240c92b0 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f430bfff640 1 -- 172.21.15.133:0/1435739081 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314005e50 con 0x7f43240c92b0 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4324157ff0 con 0x7f43240c92b0 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f430bfff640 1 -- 172.21.15.133:0/1435739081 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314007270 con 0x7f43240c92b0 2023-12-18T10:19:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43241585b0 con 0x7f43240c92b0 2023-12-18T10:19:06.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.849+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432404e000 con 0x7f43240c92b0 2023-12-18T10:19:06.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.853+0000 7f430bfff640 1 -- 172.21.15.133:0/1435739081 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f43140073d0 con 0x7f43240c92b0 2023-12-18T10:19:06.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.853+0000 7f430bfff640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4310065a60 0x7f4310067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:06.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.853+0000 7f430bfff640 1 -- 172.21.15.133:0/1435739081 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4314082ad0 con 0x7f43240c92b0 2023-12-18T10:19:06.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.853+0000 7f4322ffd640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4310065a60 0x7f4310067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:06.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.853+0000 7f4322ffd640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4310065a60 0x7f4310067f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4324144830 tx=0x7f4318009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:06.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:06.857+0000 7f430bfff640 1 -- 172.21.15.133:0/1435739081 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f43140500e0 con 0x7f43240c92b0 2023-12-18T10:19:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.005+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43240b0c00 con 0x7f43240c92b0 2023-12-18T10:19:07.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.005+0000 7f430bfff640 1 -- 172.21.15.133:0/1435739081 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43140170a0 con 0x7f43240c92b0 2023-12-18T10:19:07.010 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:07.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4310065a60 msgr2=0x7f4310067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4310065a60 0x7f4310067f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4324144830 tx=0x7f4318009040 comp rx=0 tx=0).stop 2023-12-18T10:19:07.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c92b0 msgr2=0x7f4324152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c92b0 0x7f4324152440 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f431400c4d0 tx=0x7f431400c990 comp rx=0 tx=0).stop 2023-12-18T10:19:07.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 shutdown_connections 2023-12-18T10:19:07.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4310065a60 0x7f4310067f20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43240ceac0 0x7f43241439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43240c9690 0x7f432415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 --2- 172.21.15.133:0/1435739081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43240c92b0 0x7f4324152440 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 >> 172.21.15.133:0/1435739081 conn(0x7f432406a2a0 msgr2=0x7f43240cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 shutdown_connections 2023-12-18T10:19:07.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.009+0000 7f4329c8c640 1 -- 172.21.15.133:0/1435739081 wait complete. 2023-12-18T10:19:07.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:19:07.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.169+0000 7fbec25be640 1 Processor -- start 2023-12-18T10:19:07.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.169+0000 7fbec25be640 1 -- start start 2023-12-18T10:19:07.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec25be640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc1598d0 0x7fbebc0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec25be640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbebc0ce8d0 0x7fbebc070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec25be640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc0c9730 con 0x7fbebc153020 2023-12-18T10:19:07.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec25be640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc0ced60 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec25be640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0c8e00 con 0x7fbebc1598d0 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec0b5b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbebc0ce8d0 0x7fbebc070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec0b5b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbebc0ce8d0 0x7fbebc070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54746/0 (socket says 172.21.15.133:54746) 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec0b5b640 1 -- 172.21.15.133:0/3580806928 learned_addr learned my addr 172.21.15.133:0/3580806928 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbebb7fe640 1 --2- 172.21.15.133:0/3580806928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc1598d0 0x7fbebc0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec0b5b640 1 -- 172.21.15.133:0/3580806928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc1598d0 msgr2=0x7fbebc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec0b5b640 1 --2- 172.21.15.133:0/3580806928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc1598d0 0x7fbebc0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec0b5b640 1 -- 172.21.15.133:0/3580806928 >> v1:172.21.15.142:6789/0 conn(0x7fbebc153020 legacy=0x7fbebc0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec0b5b640 1 -- 172.21.15.133:0/3580806928 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0c90e0 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbebb7fe640 1 --2- 172.21.15.133:0/3580806928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc1598d0 0x7fbebc0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbec0b5b640 1 --2- 172.21.15.133:0/3580806928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc070590 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400d150 tx=0x7fbeb401eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa95bb4fee2d061 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.173+0000 7fbebaffd640 1 -- 172.21.15.133:0/3580806928 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40a7bb0 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbebaffd640 1 -- 172.21.15.133:0/3580806928 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb40ab070 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbebaffd640 1 -- 172.21.15.133:0/3580806928 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40b1400 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- 172.21.15.133:0/3580806928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 msgr2=0x7fbebc070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 --2- 172.21.15.133:0/3580806928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc070590 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400d150 tx=0x7fbeb401eac0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- 172.21.15.133:0/3580806928 shutdown_connections 2023-12-18T10:19:07.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 --2- 172.21.15.133:0/3580806928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc070590 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 --2- 172.21.15.133:0/3580806928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc1598d0 0x7fbebc0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- 172.21.15.133:0/3580806928 >> 172.21.15.133:0/3580806928 conn(0x7fbebc06a2a0 msgr2=0x7fbebc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:07.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- 172.21.15.133:0/3580806928 shutdown_connections 2023-12-18T10:19:07.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- 172.21.15.133:0/3580806928 wait complete. 2023-12-18T10:19:07.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 Processor -- start 2023-12-18T10:19:07.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- start start 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc153020 0x7fbebc157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc1598d0 0x7fbebc1f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc1f4a60 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0afdb0 con 0x7fbebc1598d0 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbec25be640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0c1ff0 con 0x7fbebc153020 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbebbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc0af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54750/0 (socket says 172.21.15.133:54750) 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.177+0000 7fbebbfff640 1 -- 172.21.15.133:0/2706709641 learned_addr learned my addr 172.21.15.133:0/2706709641 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbebb7fe640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc153020 0x7fbebc157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbec0b5b640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc1598d0 0x7fbebc1f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbebbfff640 1 -- 172.21.15.133:0/2706709641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc153020 msgr2=0x7fbebc157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbebbfff640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc153020 0x7fbebc157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbebbfff640 1 -- 172.21.15.133:0/2706709641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc1598d0 msgr2=0x7fbebc1f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbebbfff640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc1598d0 0x7fbebc1f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbebbfff640 1 -- 172.21.15.133:0/2706709641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb400bd40 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbebbfff640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc0af870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c530 tx=0x7fbeac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbeb8ff9640 1 -- 172.21.15.133:0/2706709641 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac005220 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbeb8ff9640 1 -- 172.21.15.133:0/2706709641 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac005380 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc0c22f0 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbeb8ff9640 1 -- 172.21.15.133:0/2706709641 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac007270 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc0c2b30 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc0c24d0 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbeb8ff9640 1 -- 172.21.15.133:0/2706709641 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbeac0073d0 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbeb8ff9640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbea8065a60 0x7fbea8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbeb8ff9640 1 -- 172.21.15.133:0/2706709641 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbeac082d10 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.181+0000 7fbebb7fe640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbea8065a60 0x7fbea8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.185+0000 7fbebb7fe640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbea8065a60 0x7fbea8067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0c4bc0 tx=0x7fbeb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.185+0000 7fbeb8ff9640 1 -- 172.21.15.133:0/2706709641 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbeac088020 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.337+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbebc0c2d50 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.337+0000 7fbeb8ff9640 1 -- 172.21.15.133:0/2706709641 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbeac0503b0 con 0x7fbebc0ce8d0 2023-12-18T10:19:07.342 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:07.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbea8065a60 msgr2=0x7fbea8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbea8065a60 0x7fbea8067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0c4bc0 tx=0x7fbeb0008040 comp rx=0 tx=0).stop 2023-12-18T10:19:07.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 msgr2=0x7fbebc0af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc0af870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c530 tx=0x7fbeac00c9f0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 shutdown_connections 2023-12-18T10:19:07.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbea8065a60 0x7fbea8067f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbebc1598d0 0x7fbebc1f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbebc153020 0x7fbebc157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 --2- 172.21.15.133:0/2706709641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbebc0ce8d0 0x7fbebc0af870 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 >> 172.21.15.133:0/2706709641 conn(0x7fbebc06a2a0 msgr2=0x7fbebc15a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:07.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 shutdown_connections 2023-12-18T10:19:07.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.341+0000 7fbec25be640 1 -- 172.21.15.133:0/2706709641 wait complete. 2023-12-18T10:19:07.363 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:19:07.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf848c640 1 Processor -- start 2023-12-18T10:19:07.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf848c640 1 -- start start 2023-12-18T10:19:07.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf848c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf0071870 0x7efdf0071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf848c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdf00cbff0 0x7efdf00cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf848c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf00cc960 con 0x7efdf00ca410 2023-12-18T10:19:07.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf848c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf015aab0 con 0x7efdf00cbff0 2023-12-18T10:19:07.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf848c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0070df0 con 0x7efdf0071870 2023-12-18T10:19:07.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf6a29640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdf00cbff0 0x7efdf00cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf6a29640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdf00cbff0 0x7efdf00cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54758/0 (socket says 172.21.15.133:54758) 2023-12-18T10:19:07.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf6a29640 1 -- 172.21.15.133:0/1837788294 learned_addr learned my addr 172.21.15.133:0/1837788294 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:07.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf6a29640 1 -- 172.21.15.133:0/1837788294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf0071870 msgr2=0x7efdf0071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:07.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf5a27640 1 --2- 172.21.15.133:0/1837788294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf0071870 0x7efdf0071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf6a29640 1 --2- 172.21.15.133:0/1837788294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf0071870 0x7efdf0071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf6a29640 1 -- 172.21.15.133:0/1837788294 >> v1:172.21.15.142:6789/0 conn(0x7efdf00ca410 legacy=0x7efdf0159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:07.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf6a29640 1 -- 172.21.15.133:0/1837788294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf015a4f0 con 0x7efdf00cbff0 2023-12-18T10:19:07.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.501+0000 7efdf5a27640 1 --2- 172.21.15.133:0/1837788294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf0071870 0x7efdf0071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf6a29640 1 --2- 172.21.15.133:0/1837788294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf00cbff0 0x7efdf00cc420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efde8009e50 tx=0x7efde801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662977b1c03e1ed8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf5226640 1 -- 172.21.15.133:0/1837788294 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80a5810 con 0x7efdf00cbff0 2023-12-18T10:19:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf5226640 1 -- 172.21.15.133:0/1837788294 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde80a5970 con 0x7efdf00cbff0 2023-12-18T10:19:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf5226640 1 -- 172.21.15.133:0/1837788294 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80a5d00 con 0x7efdf00cbff0 2023-12-18T10:19:07.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf848c640 1 -- 172.21.15.133:0/1837788294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf00cbff0 msgr2=0x7efdf00cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf848c640 1 --2- 172.21.15.133:0/1837788294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf00cbff0 0x7efdf00cc420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efde8009e50 tx=0x7efde801c950 comp rx=0 tx=0).stop 2023-12-18T10:19:07.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf848c640 1 -- 172.21.15.133:0/1837788294 shutdown_connections 2023-12-18T10:19:07.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf848c640 1 --2- 172.21.15.133:0/1837788294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf00cbff0 0x7efdf00cc420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf848c640 1 --2- 172.21.15.133:0/1837788294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf0071870 0x7efdf0071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf848c640 1 -- 172.21.15.133:0/1837788294 >> 172.21.15.133:0/1837788294 conn(0x7efdf006a2a0 msgr2=0x7efdf00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:07.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf848c640 1 -- 172.21.15.133:0/1837788294 shutdown_connections 2023-12-18T10:19:07.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.505+0000 7efdf848c640 1 -- 172.21.15.133:0/1837788294 wait complete. 2023-12-18T10:19:07.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 Processor -- start 2023-12-18T10:19:07.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 -- start start 2023-12-18T10:19:07.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf0071870 0x7efdf00ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdf00ca410 0x7efdf0157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf00cbff0 0x7efdf0158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00c1020 con 0x7efdf0071870 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf01404c0 con 0x7efdf00ca410 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf0140710 con 0x7efdf00cbff0 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf0071870 0x7efdf00ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf0071870 0x7efdf00ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54764/0 (socket says 172.21.15.133:54764) 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 -- 172.21.15.133:0/1460397594 learned_addr learned my addr 172.21.15.133:0/1460397594 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf5a27640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdf00ca410 0x7efdf0157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6a29640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf00cbff0 0x7efdf0158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 -- 172.21.15.133:0/1460397594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf00cbff0 msgr2=0x7efdf0158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf00cbff0 0x7efdf0158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 -- 172.21.15.133:0/1460397594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdf00ca410 msgr2=0x7efdf0157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdf00ca410 0x7efdf0157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 -- 172.21.15.133:0/1460397594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009b30 con 0x7efdf0071870 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf6228640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf0071870 0x7efdf00ad110 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c500 tx=0x7efdec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efde6ffd640 1 -- 172.21.15.133:0/1460397594 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec005220 con 0x7efdf0071870 2023-12-18T10:19:07.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efde6ffd640 1 -- 172.21.15.133:0/1460397594 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec005380 con 0x7efdf0071870 2023-12-18T10:19:07.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf01409f0 con 0x7efdf0071870 2023-12-18T10:19:07.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efde6ffd640 1 -- 172.21.15.133:0/1460397594 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec007270 con 0x7efdf0071870 2023-12-18T10:19:07.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.509+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf0140fb0 con 0x7efdf0071870 2023-12-18T10:19:07.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.513+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf01411d0 con 0x7efdf0071870 2023-12-18T10:19:07.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.513+0000 7efde6ffd640 1 -- 172.21.15.133:0/1460397594 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efdec0073d0 con 0x7efdf0071870 2023-12-18T10:19:07.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.513+0000 7efde6ffd640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efdd4065a60 0x7efdd4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.513+0000 7efde6ffd640 1 -- 172.21.15.133:0/1460397594 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efdec082f10 con 0x7efdf0071870 2023-12-18T10:19:07.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.513+0000 7efdf5a27640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efdd4065a60 0x7efdd4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.513+0000 7efdf5a27640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efdd4065a60 0x7efdd4067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efde0006fd0 tx=0x7efde0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.517+0000 7efde6ffd640 1 -- 172.21.15.133:0/1460397594 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efdec050480 con 0x7efdf0071870 2023-12-18T10:19:07.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.665+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efdf004e000 con 0x7efdf0071870 2023-12-18T10:19:07.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.665+0000 7efde6ffd640 1 -- 172.21.15.133:0/1460397594 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdec053aa0 con 0x7efdf0071870 2023-12-18T10:19:07.669 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:19:07.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efdd4065a60 msgr2=0x7efdd4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efdd4065a60 0x7efdd4067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efde0006fd0 tx=0x7efde0008040 comp rx=0 tx=0).stop 2023-12-18T10:19:07.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf0071870 msgr2=0x7efdf00ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf0071870 0x7efdf00ad110 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efdec00c500 tx=0x7efdec00c9c0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 shutdown_connections 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efdd4065a60 0x7efdd4067f20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdf00cbff0 0x7efdf0158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdf00ca410 0x7efdf0157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 --2- 172.21.15.133:0/1460397594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdf0071870 0x7efdf00ad110 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 >> 172.21.15.133:0/1460397594 conn(0x7efdf006a2a0 msgr2=0x7efdf015c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 shutdown_connections 2023-12-18T10:19:07.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.669+0000 7efdf848c640 1 -- 172.21.15.133:0/1460397594 wait complete. 2023-12-18T10:19:07.690 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:19:07.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.825+0000 7f32a44f2640 1 Processor -- start 2023-12-18T10:19:07.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.825+0000 7f32a44f2640 1 -- start start 2023-12-18T10:19:07.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a44f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c071870 0x7f329c071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a44f2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f329c0cbff0 0x7f329c0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a44f2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c0cc960 con 0x7f329c0ca410 2023-12-18T10:19:07.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a44f2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c15aab0 con 0x7f329c0cbff0 2023-12-18T10:19:07.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a44f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c070df0 con 0x7f329c071870 2023-12-18T10:19:07.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a1a8d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c071870 0x7f329c071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a1a8d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c071870 0x7f329c071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:45136/0 (socket says 172.21.15.133:45136) 2023-12-18T10:19:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a1a8d640 1 -- 172.21.15.133:0/2062328578 learned_addr learned my addr 172.21.15.133:0/2062328578 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a2a8f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f329c0cbff0 0x7f329c0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a128c640 1 -- 172.21.15.133:0/2062328578 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337723951 0 0) 0x7f329c0cc960 con 0x7f329c0ca410 2023-12-18T10:19:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a1a8d640 1 -- 172.21.15.133:0/2062328578 >> v2:172.21.15.142:3300/0 conn(0x7f329c0cbff0 msgr2=0x7f329c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a1a8d640 1 --2- 172.21.15.133:0/2062328578 >> v2:172.21.15.142:3300/0 conn(0x7f329c0cbff0 0x7f329c0cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a1a8d640 1 -- 172.21.15.133:0/2062328578 >> v1:172.21.15.142:6789/0 conn(0x7f329c0ca410 legacy=0x7f329c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.829+0000 7f32a1a8d640 1 -- 172.21.15.133:0/2062328578 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c15a4f0 con 0x7f329c071870 2023-12-18T10:19:07.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a1a8d640 1 --2- 172.21.15.133:0/2062328578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c071870 0x7f329c071cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f328c00bb10 tx=0x7f328c01eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575307d03b0153f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a128c640 1 -- 172.21.15.133:0/2062328578 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c0a7c20 con 0x7f329c071870 2023-12-18T10:19:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a128c640 1 -- 172.21.15.133:0/2062328578 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c0a7d80 con 0x7f329c071870 2023-12-18T10:19:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a128c640 1 -- 172.21.15.133:0/2062328578 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c0af660 con 0x7f329c071870 2023-12-18T10:19:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 -- 172.21.15.133:0/2062328578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c071870 msgr2=0x7f329c071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 --2- 172.21.15.133:0/2062328578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c071870 0x7f329c071cd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f328c00bb10 tx=0x7f328c01eb50 comp rx=0 tx=0).stop 2023-12-18T10:19:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 -- 172.21.15.133:0/2062328578 shutdown_connections 2023-12-18T10:19:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 --2- 172.21.15.133:0/2062328578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c071870 0x7f329c071cd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 --2- 172.21.15.133:0/2062328578 >> v2:172.21.15.142:3300/0 conn(0x7f329c0cbff0 0x7f329c0cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 -- 172.21.15.133:0/2062328578 >> 172.21.15.133:0/2062328578 conn(0x7f329c06a2a0 msgr2=0x7f329c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 -- 172.21.15.133:0/2062328578 shutdown_connections 2023-12-18T10:19:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 -- 172.21.15.133:0/2062328578 wait complete. 2023-12-18T10:19:07.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.833+0000 7f32a44f2640 1 Processor -- start 2023-12-18T10:19:07.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 -- start start 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c071870 0x7f329c157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c0ca410 0x7f329c0af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f329c0cbff0 0x7f329c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0c0d60 con 0x7f329c071870 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c157d20 con 0x7f329c0cbff0 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c158000 con 0x7f329c0ca410 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c071870 0x7f329c157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c071870 0x7f329c157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54780/0 (socket says 172.21.15.133:54780) 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 -- 172.21.15.133:0/1457037649 learned_addr learned my addr 172.21.15.133:0/1457037649 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a1a8d640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c0ca410 0x7f329c0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a2a8f640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f329c0cbff0 0x7f329c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 -- 172.21.15.133:0/1457037649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c0ca410 msgr2=0x7f329c0af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c0ca410 0x7f329c0af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 -- 172.21.15.133:0/1457037649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f329c0cbff0 msgr2=0x7f329c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f329c0cbff0 0x7f329c158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 -- 172.21.15.133:0/1457037649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c00b770 con 0x7f329c071870 2023-12-18T10:19:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a228e640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c071870 0x7f329c157690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f329800c4d0 tx=0x7f329800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f3292ffd640 1 -- 172.21.15.133:0/1457037649 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298005480 con 0x7f329c071870 2023-12-18T10:19:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f3292ffd640 1 -- 172.21.15.133:0/1457037649 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3298003600 con 0x7f329c071870 2023-12-18T10:19:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c1582e0 con 0x7f329c071870 2023-12-18T10:19:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f3292ffd640 1 -- 172.21.15.133:0/1457037649 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32980039b0 con 0x7f329c071870 2023-12-18T10:19:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c1588a0 con 0x7f329c071870 2023-12-18T10:19:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.837+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c04e000 con 0x7f329c071870 2023-12-18T10:19:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.841+0000 7f3292ffd640 1 -- 172.21.15.133:0/1457037649 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3298003b10 con 0x7f329c071870 2023-12-18T10:19:07.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.841+0000 7f3292ffd640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3280065a90 0x7f3280067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:07.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.841+0000 7f3292ffd640 1 -- 172.21.15.133:0/1457037649 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3298082b40 con 0x7f329c071870 2023-12-18T10:19:07.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.841+0000 7f32a1a8d640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3280065a90 0x7f3280067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:07.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.841+0000 7f32a1a8d640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3280065a90 0x7f3280067f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f328c0b1000 tx=0x7f328c0a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:07.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.845+0000 7f3292ffd640 1 -- 172.21.15.133:0/1457037649 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3298050210 con 0x7f329c071870 2023-12-18T10:19:07.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.993+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f329c0ccbd0 con 0x7f329c071870 2023-12-18T10:19:07.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f3292ffd640 1 -- 172.21.15.133:0/1457037649 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3298017070 con 0x7f329c071870 2023-12-18T10:19:07.999 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3280065a90 msgr2=0x7f3280067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3280065a90 0x7f3280067f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f328c0b1000 tx=0x7f328c0a9070 comp rx=0 tx=0).stop 2023-12-18T10:19:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c071870 msgr2=0x7f329c157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c071870 0x7f329c157690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f329800c4d0 tx=0x7f329800c990 comp rx=0 tx=0).stop 2023-12-18T10:19:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 shutdown_connections 2023-12-18T10:19:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3280065a90 0x7f3280067f50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f329c0cbff0 0x7f329c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f329c0ca410 0x7f329c0af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 --2- 172.21.15.133:0/1457037649 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f329c071870 0x7f329c157690 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 >> 172.21.15.133:0/1457037649 conn(0x7f329c06a2a0 msgr2=0x7f329c0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:08.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 shutdown_connections 2023-12-18T10:19:08.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:07.997+0000 7f32a44f2640 1 -- 172.21.15.133:0/1457037649 wait complete. 2023-12-18T10:19:08.020 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:19:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.153+0000 7f0fcfa8c640 1 Processor -- start 2023-12-18T10:19:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.153+0000 7f0fcfa8c640 1 -- start start 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcfa8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fc81570c0 0x7f0fc806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcfa8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0fc806c320 0x7f0fc80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcfa8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc80c9460 con 0x7f0fc80c9e30 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcfa8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc806c7a0 con 0x7f0fc806c320 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcfa8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc81574a0 con 0x7f0fc81570c0 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcd027640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0fc806c320 0x7f0fc80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fce029640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0fc80c9e30 0x7f0fc815d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39854/0 (socket says 172.21.15.133:39854) 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcd027640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0fc806c320 0x7f0fc80c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54784/0 (socket says 172.21.15.133:54784) 2023-12-18T10:19:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fce029640 1 -- 172.21.15.133:0/3578651172 learned_addr learned my addr 172.21.15.133:0/3578651172 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:08.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcd828640 1 --2- 172.21.15.133:0/3578651172 >> v2:172.21.15.142:3300/0 conn(0x7f0fc81570c0 0x7f0fc806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcd027640 1 -- 172.21.15.133:0/3578651172 >> v2:172.21.15.142:3300/0 conn(0x7f0fc81570c0 msgr2=0x7f0fc806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:08.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcd027640 1 --2- 172.21.15.133:0/3578651172 >> v2:172.21.15.142:3300/0 conn(0x7f0fc81570c0 0x7f0fc806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcd027640 1 -- 172.21.15.133:0/3578651172 >> v1:172.21.15.133:6789/0 conn(0x7f0fc80c9e30 legacy=0x7f0fc815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.157+0000 7f0fcd027640 1 -- 172.21.15.133:0/3578651172 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc80c8b30 con 0x7f0fc806c320 2023-12-18T10:19:08.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcd027640 1 --2- 172.21.15.133:0/3578651172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc80c98f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0fc806e280 tx=0x7f0fb801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2c468fd6e8d7ac server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcc826640 1 -- 172.21.15.133:0/3578651172 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80ab600 con 0x7f0fc806c320 2023-12-18T10:19:08.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcc826640 1 -- 172.21.15.133:0/3578651172 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb80a7050 con 0x7f0fc806c320 2023-12-18T10:19:08.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcc826640 1 -- 172.21.15.133:0/3578651172 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80ab980 con 0x7f0fc806c320 2023-12-18T10:19:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/3578651172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 msgr2=0x7f0fc80c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/3578651172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc80c98f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0fc806e280 tx=0x7f0fb801c3a0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/3578651172 shutdown_connections 2023-12-18T10:19:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/3578651172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc80c98f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/3578651172 >> v2:172.21.15.142:3300/0 conn(0x7f0fc81570c0 0x7f0fc806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/3578651172 >> 172.21.15.133:0/3578651172 conn(0x7f0fc806a3e0 msgr2=0x7f0fc80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/3578651172 shutdown_connections 2023-12-18T10:19:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/3578651172 wait complete. 2023-12-18T10:19:08.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 Processor -- start 2023-12-18T10:19:08.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.161+0000 7f0fcfa8c640 1 -- start start 2023-12-18T10:19:08.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc8151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc80c9e30 0x7f0fc8153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc81570c0 0x7f0fc80cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc814f8f0 con 0x7f0fc806c320 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc8152340 con 0x7f0fc80c9e30 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc80aec70 con 0x7f0fc81570c0 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc8151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc8151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54800/0 (socket says 172.21.15.133:54800) 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 -- 172.21.15.133:0/1617072625 learned_addr learned my addr 172.21.15.133:0/1617072625 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd027640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc80c9e30 0x7f0fc8153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fce029640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc81570c0 0x7f0fc80cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 -- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc81570c0 msgr2=0x7f0fc80cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc81570c0 0x7f0fc80cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 -- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc80c9e30 msgr2=0x7f0fc8153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc80c9e30 0x7f0fc8153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 -- 172.21.15.133:0/1617072625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb8009420 con 0x7f0fc806c320 2023-12-18T10:19:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd027640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc80c9e30 0x7f0fc8153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcd828640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc8151d60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400d800 tx=0x7f0fc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fbe7fc640 1 -- 172.21.15.133:0/1617072625 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400b6c0 con 0x7f0fc806c320 2023-12-18T10:19:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fbe7fc640 1 -- 172.21.15.133:0/1617072625 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400b820 con 0x7f0fc806c320 2023-12-18T10:19:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc80aef50 con 0x7f0fc806c320 2023-12-18T10:19:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fbe7fc640 1 -- 172.21.15.133:0/1617072625 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400bb90 con 0x7f0fc806c320 2023-12-18T10:19:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc80cc740 con 0x7f0fc806c320 2023-12-18T10:19:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc80735b0 con 0x7f0fc806c320 2023-12-18T10:19:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.165+0000 7f0fbe7fc640 1 -- 172.21.15.133:0/1617072625 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0fc400bcf0 con 0x7f0fc806c320 2023-12-18T10:19:08.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.169+0000 7f0fbe7fc640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fac065a60 0x7f0fac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.169+0000 7f0fbe7fc640 1 -- 172.21.15.133:0/1617072625 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0fc4083b80 con 0x7f0fc806c320 2023-12-18T10:19:08.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.169+0000 7f0fcd027640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fac065a60 0x7f0fac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.169+0000 7f0fcd027640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fac065a60 0x7f0fac067f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80ad000 tx=0x7f0fb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.173+0000 7f0fbe7fc640 1 -- 172.21.15.133:0/1617072625 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0fc40510e0 con 0x7f0fc806c320 2023-12-18T10:19:08.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.333+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0fc80cc930 con 0x7f0fc806c320 2023-12-18T10:19:08.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.333+0000 7f0fbe7fc640 1 -- 172.21.15.133:0/1617072625 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0fc80cc930 con 0x7f0fc806c320 2023-12-18T10:19:08.338 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:19:08.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fac065a60 msgr2=0x7f0fac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fac065a60 0x7f0fac067f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80ad000 tx=0x7f0fb8008040 comp rx=0 tx=0).stop 2023-12-18T10:19:08.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 msgr2=0x7f0fc8151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc8151d60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400d800 tx=0x7f0fc400dcc0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 shutdown_connections 2023-12-18T10:19:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fac065a60 0x7f0fac067f20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc81570c0 0x7f0fc80cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc80c9e30 0x7f0fc8153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 --2- 172.21.15.133:0/1617072625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc806c320 0x7f0fc8151d60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 >> 172.21.15.133:0/1617072625 conn(0x7f0fc806a3e0 msgr2=0x7f0fc815c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 shutdown_connections 2023-12-18T10:19:08.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.337+0000 7f0fcfa8c640 1 -- 172.21.15.133:0/1617072625 wait complete. 2023-12-18T10:19:08.359 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:19:08.359 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:08.369 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:08.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.545+0000 7ffa84a2d640 1 Processor -- start 2023-12-18T10:19:08.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.545+0000 7ffa84a2d640 1 -- start start 2023-12-18T10:19:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa84a2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffa8015a680 0x7ffa8015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa84a2d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa8006fdb0 0x7ffa80070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa84a2d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8015f100 con 0x7ffa800cac10 2023-12-18T10:19:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa84a2d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa80070780 con 0x7ffa8006fdb0 2023-12-18T10:19:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa84a2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800ca7d0 con 0x7ffa8015a680 2023-12-18T10:19:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa7ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa8006fdb0 0x7ffa80070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa77fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffa800cac10 0x7ffa8015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39856/0 (socket says 172.21.15.133:39856) 2023-12-18T10:19:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa77fff640 1 -- 172.21.15.133:0/2180999630 learned_addr learned my addr 172.21.15.133:0/2180999630 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa7e59c640 1 --2- 172.21.15.133:0/2180999630 >> v2:172.21.15.142:3300/0 conn(0x7ffa8015a680 0x7ffa8015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa7ed9d640 1 -- 172.21.15.133:0/2180999630 >> v2:172.21.15.142:3300/0 conn(0x7ffa8015a680 msgr2=0x7ffa8015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa7ed9d640 1 --2- 172.21.15.133:0/2180999630 >> v2:172.21.15.142:3300/0 conn(0x7ffa8015a680 0x7ffa8015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa7ed9d640 1 -- 172.21.15.133:0/2180999630 >> v1:172.21.15.133:6789/0 conn(0x7ffa800cac10 legacy=0x7ffa8015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa7ed9d640 1 -- 172.21.15.133:0/2180999630 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8015e860 con 0x7ffa8006fdb0 2023-12-18T10:19:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.549+0000 7ffa7dd9b640 1 -- 172.21.15.133:0/2180999630 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109567403 0 0) 0x7ffa8015f100 con 0x7ffa800cac10 2023-12-18T10:19:08.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa7ed9d640 1 --2- 172.21.15.133:0/2180999630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8006fdb0 0x7ffa80070240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009d90 tx=0x7ffa7801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6f86f2764eec9e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa7dd9b640 1 -- 172.21.15.133:0/2180999630 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780a5940 con 0x7ffa8006fdb0 2023-12-18T10:19:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa7dd9b640 1 -- 172.21.15.133:0/2180999630 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa780a5aa0 con 0x7ffa8006fdb0 2023-12-18T10:19:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa7dd9b640 1 -- 172.21.15.133:0/2180999630 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780a5e30 con 0x7ffa8006fdb0 2023-12-18T10:19:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 -- 172.21.15.133:0/2180999630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8006fdb0 msgr2=0x7ffa80070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/2180999630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8006fdb0 0x7ffa80070240 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009d90 tx=0x7ffa7801c880 comp rx=0 tx=0).stop 2023-12-18T10:19:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 -- 172.21.15.133:0/2180999630 shutdown_connections 2023-12-18T10:19:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/2180999630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8006fdb0 0x7ffa80070240 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/2180999630 >> v2:172.21.15.142:3300/0 conn(0x7ffa8015a680 0x7ffa8015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 -- 172.21.15.133:0/2180999630 >> 172.21.15.133:0/2180999630 conn(0x7ffa8006a3e0 msgr2=0x7ffa800afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 -- 172.21.15.133:0/2180999630 shutdown_connections 2023-12-18T10:19:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 -- 172.21.15.133:0/2180999630 wait complete. 2023-12-18T10:19:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 Processor -- start 2023-12-18T10:19:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.553+0000 7ffa84a2d640 1 -- start start 2023-12-18T10:19:08.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa8006fdb0 0x7ffa800c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa800cac10 0x7ffa80155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8015a680 0x7ffa800c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c4020 con 0x7ffa8015a680 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80155950 con 0x7ffa800cac10 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800c3450 con 0x7ffa8006fdb0 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8015a680 0x7ffa800c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8015a680 0x7ffa800c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54808/0 (socket says 172.21.15.133:54808) 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 -- 172.21.15.133:0/1239839026 learned_addr learned my addr 172.21.15.133:0/1239839026 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa77fff640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa800cac10 0x7ffa80155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7e59c640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa8006fdb0 0x7ffa800c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 -- 172.21.15.133:0/1239839026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa8006fdb0 msgr2=0x7ffa800c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa8006fdb0 0x7ffa800c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 -- 172.21.15.133:0/1239839026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa800cac10 msgr2=0x7ffa80155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa800cac10 0x7ffa80155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 -- 172.21.15.133:0/1239839026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78009a70 con 0x7ffa8015a680 2023-12-18T10:19:08.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa7ed9d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8015a680 0x7ffa800c44b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffa78019490 tx=0x7ffa78019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa76ffd640 1 -- 172.21.15.133:0/1239839026 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780a5940 con 0x7ffa8015a680 2023-12-18T10:19:08.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa76ffd640 1 -- 172.21.15.133:0/1239839026 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78009450 con 0x7ffa8015a680 2023-12-18T10:19:08.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa76ffd640 1 -- 172.21.15.133:0/1239839026 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780b7610 con 0x7ffa8015a680 2023-12-18T10:19:08.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa800c36f0 con 0x7ffa8015a680 2023-12-18T10:19:08.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800c3cb0 con 0x7ffa8015a680 2023-12-18T10:19:08.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa800735b0 con 0x7ffa8015a680 2023-12-18T10:19:08.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.557+0000 7ffa76ffd640 1 -- 172.21.15.133:0/1239839026 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa780b4050 con 0x7ffa8015a680 2023-12-18T10:19:08.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.561+0000 7ffa76ffd640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa60065a60 0x7ffa60067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.561+0000 7ffa76ffd640 1 -- 172.21.15.133:0/1239839026 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffa7811e790 con 0x7ffa8015a680 2023-12-18T10:19:08.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.561+0000 7ffa7e59c640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa60065a60 0x7ffa60067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.561+0000 7ffa7e59c640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa60065a60 0x7ffa60067f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa70007a60 tx=0x7ffa70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.565+0000 7ffa76ffd640 1 -- 172.21.15.133:0/1239839026 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffa780ebda0 con 0x7ffa8015a680 2023-12-18T10:19:08.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.713+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa80072af0 con 0x7ffa8015a680 2023-12-18T10:19:08.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa76ffd640 1 -- 172.21.15.133:0/1239839026 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7ffa780ef3c0 con 0x7ffa8015a680 2023-12-18T10:19:08.719 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:08.719 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa60065a60 msgr2=0x7ffa60067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa60065a60 0x7ffa60067f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffa70007a60 tx=0x7ffa70008040 comp rx=0 tx=0).stop 2023-12-18T10:19:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8015a680 msgr2=0x7ffa800c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8015a680 0x7ffa800c44b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffa78019490 tx=0x7ffa78019620 comp rx=0 tx=0).stop 2023-12-18T10:19:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 shutdown_connections 2023-12-18T10:19:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa60065a60 0x7ffa60067f20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa8015a680 0x7ffa800c44b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa800cac10 0x7ffa80155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 --2- 172.21.15.133:0/1239839026 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa8006fdb0 0x7ffa800c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 >> 172.21.15.133:0/1239839026 conn(0x7ffa8006a3e0 msgr2=0x7ffa8015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 shutdown_connections 2023-12-18T10:19:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.717+0000 7ffa84a2d640 1 -- 172.21.15.133:0/1239839026 wait complete. 2023-12-18T10:19:08.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:19:08.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:08.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eb4d96640 1 Processor -- start 2023-12-18T10:19:08.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eb4d96640 1 -- start start 2023-12-18T10:19:08.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eb4d96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb0153020 0x7f0eb00c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eb4d96640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb01598d0 0x7f0eb00ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eb4d96640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0eb00ce8d0 0x7f0eb0070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eb4d96640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb00ced60 con 0x7f0eb01598d0 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eb4d96640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb00c9730 con 0x7f0eb00ce8d0 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eb4d96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00cbc80 con 0x7f0eb0153020 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0ea5d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb01598d0 0x7f0eb00ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0ea5d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb01598d0 0x7f0eb00ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54824/0 (socket says 172.21.15.133:54824) 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0ea5d9b640 1 -- 172.21.15.133:0/2416119659 learned_addr learned my addr 172.21.15.133:0/2416119659 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eae59c640 1 --2- 172.21.15.133:0/2416119659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb0153020 0x7f0eb00c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0eaed9d640 1 --2- 172.21.15.133:0/2416119659 >> v2:172.21.15.142:3300/0 conn(0x7f0eb00ce8d0 0x7f0eb0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0ea5d9b640 1 -- 172.21.15.133:0/2416119659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb0153020 msgr2=0x7f0eb00c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.877+0000 7f0ea5d9b640 1 --2- 172.21.15.133:0/2416119659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb0153020 0x7f0eb00c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0ea5d9b640 1 -- 172.21.15.133:0/2416119659 >> v2:172.21.15.142:3300/0 conn(0x7f0eb00ce8d0 msgr2=0x7f0eb0070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0ea5d9b640 1 --2- 172.21.15.133:0/2416119659 >> v2:172.21.15.142:3300/0 conn(0x7f0eb00ce8d0 0x7f0eb0070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0ea5d9b640 1 -- 172.21.15.133:0/2416119659 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb00c8e00 con 0x7f0eb01598d0 2023-12-18T10:19:08.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eaed9d640 1 --2- 172.21.15.133:0/2416119659 >> v2:172.21.15.142:3300/0 conn(0x7f0eb00ce8d0 0x7f0eb0070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:08.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0ea5d9b640 1 --2- 172.21.15.133:0/2416119659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb01598d0 0x7f0eb00ce390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00b1030 tx=0x7f0e9801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f577bf83bba1b615 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eadd9b640 1 -- 172.21.15.133:0/2416119659 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980ab600 con 0x7f0eb01598d0 2023-12-18T10:19:08.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eadd9b640 1 -- 172.21.15.133:0/2416119659 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e980a7050 con 0x7f0eb01598d0 2023-12-18T10:19:08.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eadd9b640 1 -- 172.21.15.133:0/2416119659 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980ab980 con 0x7f0eb01598d0 2023-12-18T10:19:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 -- 172.21.15.133:0/2416119659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb01598d0 msgr2=0x7f0eb00ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/2416119659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb01598d0 0x7f0eb00ce390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00b1030 tx=0x7f0e9801c3b0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 -- 172.21.15.133:0/2416119659 shutdown_connections 2023-12-18T10:19:08.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/2416119659 >> v2:172.21.15.142:3300/0 conn(0x7f0eb00ce8d0 0x7f0eb0070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/2416119659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb01598d0 0x7f0eb00ce390 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/2416119659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb0153020 0x7f0eb00c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 -- 172.21.15.133:0/2416119659 >> 172.21.15.133:0/2416119659 conn(0x7f0eb006a2a0 msgr2=0x7f0eb00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:08.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 -- 172.21.15.133:0/2416119659 shutdown_connections 2023-12-18T10:19:08.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.881+0000 7f0eb4d96640 1 -- 172.21.15.133:0/2416119659 wait complete. 2023-12-18T10:19:08.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eb4d96640 1 Processor -- start 2023-12-18T10:19:08.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eb4d96640 1 -- start start 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eb4d96640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb00ce8d0 0x7f0eb014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eb4d96640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0153020 0x7f0eb0151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eb4d96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb01598d0 0x7f0eb014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eb4d96640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0151730 con 0x7f0eb0153020 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eb4d96640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0150b20 con 0x7f0eb00ce8d0 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eb4d96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0150e00 con 0x7f0eb01598d0 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0153020 0x7f0eb0151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0153020 0x7f0eb0151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54830/0 (socket says 172.21.15.133:54830) 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 -- 172.21.15.133:0/238825001 learned_addr learned my addr 172.21.15.133:0/238825001 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eaed9d640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb01598d0 0x7f0eb014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eae59c640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb00ce8d0 0x7f0eb014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 -- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb01598d0 msgr2=0x7f0eb014d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb01598d0 0x7f0eb014d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 -- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb00ce8d0 msgr2=0x7f0eb014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:08.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb00ce8d0 0x7f0eb014f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:08.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 -- 172.21.15.133:0/238825001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980094d0 con 0x7f0eb0153020 2023-12-18T10:19:08.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eaed9d640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb01598d0 0x7f0eb014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:08.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0eae59c640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb00ce8d0 0x7f0eb014f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:08.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.885+0000 7f0ea5d9b640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0153020 0x7f0eb0151bc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ae040 tx=0x7f0e98019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0ea77fe640 1 -- 172.21.15.133:0/238825001 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980b4440 con 0x7f0eb0153020 2023-12-18T10:19:08.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0ea77fe640 1 -- 172.21.15.133:0/238825001 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e980b45a0 con 0x7f0eb0153020 2023-12-18T10:19:08.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb01510e0 con 0x7f0eb0153020 2023-12-18T10:19:08.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0ea77fe640 1 -- 172.21.15.133:0/238825001 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980b4950 con 0x7f0eb0153020 2023-12-18T10:19:08.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb014f8f0 con 0x7f0eb0153020 2023-12-18T10:19:08.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb01518a0 con 0x7f0eb0153020 2023-12-18T10:19:08.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0ea77fe640 1 -- 172.21.15.133:0/238825001 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e980b2070 con 0x7f0eb0153020 2023-12-18T10:19:08.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0ea77fe640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e90065a60 0x7f0e90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:08.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0ea77fe640 1 -- 172.21.15.133:0/238825001 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e9811d2e0 con 0x7f0eb0153020 2023-12-18T10:19:08.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0eae59c640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e90065a60 0x7f0e90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:08.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.889+0000 7f0eae59c640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e90065a60 0x7f0e90067f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009fd0 tx=0x7f0ea000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:08.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:08.893+0000 7f0ea77fe640 1 -- 172.21.15.133:0/238825001 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0e980ea970 con 0x7f0eb0153020 2023-12-18T10:19:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.041+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0eb004e000 con 0x7f0eb0153020 2023-12-18T10:19:09.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0ea77fe640 1 -- 172.21.15.133:0/238825001 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e980edf90 con 0x7f0eb0153020 2023-12-18T10:19:09.047 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e90065a60 msgr2=0x7f0e90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e90065a60 0x7f0e90067f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009fd0 tx=0x7f0ea000b040 comp rx=0 tx=0).stop 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0153020 msgr2=0x7f0eb0151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0153020 0x7f0eb0151bc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ae040 tx=0x7f0e98019150 comp rx=0 tx=0).stop 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 shutdown_connections 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e90065a60 0x7f0e90067f20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb01598d0 0x7f0eb014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0153020 0x7f0eb0151bc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 --2- 172.21.15.133:0/238825001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb00ce8d0 0x7f0eb014f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 >> 172.21.15.133:0/238825001 conn(0x7f0eb006a2a0 msgr2=0x7f0eb0152780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 shutdown_connections 2023-12-18T10:19:09.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.045+0000 7f0eb4d96640 1 -- 172.21.15.133:0/238825001 wait complete. 2023-12-18T10:19:09.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:19:09.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.205+0000 7f8d0f266640 1 Processor -- start 2023-12-18T10:19:09.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.205+0000 7f8d0f266640 1 -- start start 2023-12-18T10:19:09.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0f266640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d08070820 0x7f8d080c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0f266640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d080ce3b0 0x7f8d080ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0f266640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080c9390 con 0x7f8d081582d0 2023-12-18T10:19:09.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0f266640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080ced60 con 0x7f8d08070820 2023-12-18T10:19:09.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0f266640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0815aee0 con 0x7f8d080ce3b0 2023-12-18T10:19:09.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0c801640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d08070820 0x7f8d080c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0d002640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8d081582d0 0x7f8d080ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39864/0 (socket says 172.21.15.133:39864) 2023-12-18T10:19:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0d002640 1 -- 172.21.15.133:0/4285485155 learned_addr learned my addr 172.21.15.133:0/4285485155 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0d803640 1 --2- 172.21.15.133:0/4285485155 >> v2:172.21.15.142:3300/0 conn(0x7f8d080ce3b0 0x7f8d080ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0c801640 1 -- 172.21.15.133:0/4285485155 >> v2:172.21.15.142:3300/0 conn(0x7f8d080ce3b0 msgr2=0x7f8d080ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0c801640 1 --2- 172.21.15.133:0/4285485155 >> v2:172.21.15.142:3300/0 conn(0x7f8d080ce3b0 0x7f8d080ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0c801640 1 -- 172.21.15.133:0/4285485155 >> v1:172.21.15.133:6789/0 conn(0x7f8d081582d0 legacy=0x7f8d080ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8d0c801640 1 -- 172.21.15.133:0/4285485155 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0815b1c0 con 0x7f8d08070820 2023-12-18T10:19:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.209+0000 7f8cfffff640 1 -- 172.21.15.133:0/4285485155 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546433373 0 0) 0x7f8d080c9390 con 0x7f8d081582d0 2023-12-18T10:19:09.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0c801640 1 --2- 172.21.15.133:0/4285485155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d08070820 0x7f8d080c8e50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8d0806fbb0 tx=0x7f8cf801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98dc7bb30337a39 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8cfffff640 1 -- 172.21.15.133:0/4285485155 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80a7070 con 0x7f8d08070820 2023-12-18T10:19:09.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8cfffff640 1 -- 172.21.15.133:0/4285485155 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80ab430 con 0x7f8d08070820 2023-12-18T10:19:09.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8cfffff640 1 -- 172.21.15.133:0/4285485155 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80ab7c0 con 0x7f8d08070820 2023-12-18T10:19:09.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 -- 172.21.15.133:0/4285485155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d08070820 msgr2=0x7f8d080c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 --2- 172.21.15.133:0/4285485155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d08070820 0x7f8d080c8e50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8d0806fbb0 tx=0x7f8cf801c430 comp rx=0 tx=0).stop 2023-12-18T10:19:09.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 -- 172.21.15.133:0/4285485155 shutdown_connections 2023-12-18T10:19:09.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 --2- 172.21.15.133:0/4285485155 >> v2:172.21.15.142:3300/0 conn(0x7f8d080ce3b0 0x7f8d080ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 --2- 172.21.15.133:0/4285485155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d08070820 0x7f8d080c8e50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 -- 172.21.15.133:0/4285485155 >> 172.21.15.133:0/4285485155 conn(0x7f8d0806a2a0 msgr2=0x7f8d080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:09.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 -- 172.21.15.133:0/4285485155 shutdown_connections 2023-12-18T10:19:09.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 -- 172.21.15.133:0/4285485155 wait complete. 2023-12-18T10:19:09.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 Processor -- start 2023-12-18T10:19:09.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.213+0000 7f8d0f266640 1 -- start start 2023-12-18T10:19:09.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d08070820 0x7f8d0815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d080ce3b0 0x7f8d080c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d081582d0 0x7f8d08156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080c1fe0 con 0x7f8d081582d0 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0815d040 con 0x7f8d080ce3b0 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0815cd60 con 0x7f8d08070820 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d081582d0 0x7f8d08156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d081582d0 0x7f8d08156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54836/0 (socket says 172.21.15.133:54836) 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 -- 172.21.15.133:0/512267295 learned_addr learned my addr 172.21.15.133:0/512267295 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 -- 172.21.15.133:0/512267295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d08070820 msgr2=0x7f8d0815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d08070820 0x7f8d0815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 -- 172.21.15.133:0/512267295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d080ce3b0 msgr2=0x7f8d080c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d080ce3b0 0x7f8d080c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 -- 172.21.15.133:0/512267295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8009420 con 0x7f8d081582d0 2023-12-18T10:19:09.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0d803640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d081582d0 0x7f8d08156050 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000efc0 tx=0x7f8d0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8cfdffb640 1 -- 172.21.15.133:0/512267295 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00014480 con 0x7f8d081582d0 2023-12-18T10:19:09.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8cfdffb640 1 -- 172.21.15.133:0/512267295 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0000f040 con 0x7f8d081582d0 2023-12-18T10:19:09.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d08157370 con 0x7f8d081582d0 2023-12-18T10:19:09.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8cfdffb640 1 -- 172.21.15.133:0/512267295 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00014840 con 0x7f8d081582d0 2023-12-18T10:19:09.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0815c9f0 con 0x7f8d081582d0 2023-12-18T10:19:09.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.217+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d081571d0 con 0x7f8d081582d0 2023-12-18T10:19:09.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.221+0000 7f8cfdffb640 1 -- 172.21.15.133:0/512267295 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8d000149a0 con 0x7f8d081582d0 2023-12-18T10:19:09.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.221+0000 7f8cfdffb640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8cec065a60 0x7f8cec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.221+0000 7f8cfdffb640 1 -- 172.21.15.133:0/512267295 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8d00084180 con 0x7f8d081582d0 2023-12-18T10:19:09.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.221+0000 7f8d0d002640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8cec065a60 0x7f8cec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.221+0000 7f8d0d002640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8cec065a60 0x7f8cec067f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d040015a0 tx=0x7f8d04007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.225+0000 7f8cfdffb640 1 -- 172.21.15.133:0/512267295 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8d081571d0 con 0x7f8d081582d0 2023-12-18T10:19:09.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.381+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d081571d0 con 0x7f8d081582d0 2023-12-18T10:19:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8cfdffb640 1 -- 172.21.15.133:0/512267295 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d081571d0 con 0x7f8d081582d0 2023-12-18T10:19:09.387 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:09.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8cec065a60 msgr2=0x7f8cec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8cec065a60 0x7f8cec067f20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d040015a0 tx=0x7f8d04007970 comp rx=0 tx=0).stop 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d081582d0 msgr2=0x7f8d08156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d081582d0 0x7f8d08156050 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000efc0 tx=0x7f8d0000c490 comp rx=0 tx=0).stop 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 shutdown_connections 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8cec065a60 0x7f8cec067f20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d081582d0 0x7f8d08156050 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d080ce3b0 0x7f8d080c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 --2- 172.21.15.133:0/512267295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d08070820 0x7f8d0815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 >> 172.21.15.133:0/512267295 conn(0x7f8d0806a2a0 msgr2=0x7f8d080cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 shutdown_connections 2023-12-18T10:19:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.385+0000 7f8d0f266640 1 -- 172.21.15.133:0/512267295 wait complete. 2023-12-18T10:19:09.409 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:19:09.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.545+0000 7fc9d9c20640 1 Processor -- start 2023-12-18T10:19:09.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.545+0000 7fc9d9c20640 1 -- start start 2023-12-18T10:19:09.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d9c20640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9d40ca410 0x7fc9d4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d9c20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d4159fb0 0x7fc9d4071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d9c20640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d4070df0 con 0x7fc9d4071db0 2023-12-18T10:19:09.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d9c20640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d415aab0 con 0x7fc9d40ca410 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d9c20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d415a4f0 con 0x7fc9d4159fb0 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9d40ca410 0x7fc9d4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d3fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc9d4071db0 0x7fc9d40cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39868/0 (socket says 172.21.15.133:39868) 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d3fff640 1 -- 172.21.15.133:0/1284822326 learned_addr learned my addr 172.21.15.133:0/1284822326 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d2ffd640 1 --2- 172.21.15.133:0/1284822326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d4159fb0 0x7fc9d4071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d37fe640 1 -- 172.21.15.133:0/1284822326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d4159fb0 msgr2=0x7fc9d4071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d37fe640 1 --2- 172.21.15.133:0/1284822326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d4159fb0 0x7fc9d4071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d27fc640 1 -- 172.21.15.133:0/1284822326 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361727542 0 0) 0x7fc9d4070df0 con 0x7fc9d4071db0 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d37fe640 1 -- 172.21.15.133:0/1284822326 >> v1:172.21.15.133:6789/0 conn(0x7fc9d4071db0 legacy=0x7fc9d40cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d37fe640 1 -- 172.21.15.133:0/1284822326 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d415a7d0 con 0x7fc9d40ca410 2023-12-18T10:19:09.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d2ffd640 1 --2- 172.21.15.133:0/1284822326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d4159fb0 0x7fc9d4071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:09.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d37fe640 1 --2- 172.21.15.133:0/1284822326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d40ca410 0x7fc9d4159a70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40097c0 tx=0x7fc9c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23ced9353323d38 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d27fc640 1 -- 172.21.15.133:0/1284822326 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40ab650 con 0x7fc9d40ca410 2023-12-18T10:19:09.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d27fc640 1 -- 172.21.15.133:0/1284822326 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c40ab7b0 con 0x7fc9d40ca410 2023-12-18T10:19:09.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.549+0000 7fc9d27fc640 1 -- 172.21.15.133:0/1284822326 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40abb40 con 0x7fc9d40ca410 2023-12-18T10:19:09.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- 172.21.15.133:0/1284822326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d40ca410 msgr2=0x7fc9d4159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/1284822326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d40ca410 0x7fc9d4159a70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40097c0 tx=0x7fc9c401c450 comp rx=0 tx=0).stop 2023-12-18T10:19:09.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- 172.21.15.133:0/1284822326 shutdown_connections 2023-12-18T10:19:09.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/1284822326 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d4159fb0 0x7fc9d4071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/1284822326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d40ca410 0x7fc9d4159a70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- 172.21.15.133:0/1284822326 >> 172.21.15.133:0/1284822326 conn(0x7fc9d406a2a0 msgr2=0x7fc9d40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:09.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- 172.21.15.133:0/1284822326 shutdown_connections 2023-12-18T10:19:09.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- 172.21.15.133:0/1284822326 wait complete. 2023-12-18T10:19:09.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 Processor -- start 2023-12-18T10:19:09.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- start start 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d4071db0 0x7fc9d4135e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d40ca410 0x7fc9d40c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9d4159fb0 0x7fc9d415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d41508b0 con 0x7fc9d4071db0 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40c2b30 con 0x7fc9d4159fb0 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d9c20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40c2e10 con 0x7fc9d40ca410 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d4071db0 0x7fc9d4135e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d4071db0 0x7fc9d4135e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54854/0 (socket says 172.21.15.133:54854) 2023-12-18T10:19:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d37fe640 1 -- 172.21.15.133:0/143817165 learned_addr learned my addr 172.21.15.133:0/143817165 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:09.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.553+0000 7fc9d2ffd640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d40ca410 0x7fc9d40c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d3fff640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9d4159fb0 0x7fc9d415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d37fe640 1 -- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d40ca410 msgr2=0x7fc9d40c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d37fe640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d40ca410 0x7fc9d40c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d37fe640 1 -- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9d4159fb0 msgr2=0x7fc9d415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d37fe640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9d4159fb0 0x7fc9d415ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d37fe640 1 -- 172.21.15.133:0/143817165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4009420 con 0x7fc9d4071db0 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d2ffd640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d40ca410 0x7fc9d40c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d3fff640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9d4159fb0 0x7fc9d415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d37fe640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d4071db0 0x7fc9d4135e50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40097c0 tx=0x7fc9c401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9bbfff640 1 -- 172.21.15.133:0/143817165 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4004220 con 0x7fc9d4071db0 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9bbfff640 1 -- 172.21.15.133:0/143817165 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c40b9070 con 0x7fc9d4071db0 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d40c35f0 con 0x7fc9d4071db0 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9bbfff640 1 -- 172.21.15.133:0/143817165 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4003620 con 0x7fc9d4071db0 2023-12-18T10:19:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d40c3bb0 con 0x7fc9d4071db0 2023-12-18T10:19:09.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d404e000 con 0x7fc9d4071db0 2023-12-18T10:19:09.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9bbfff640 1 -- 172.21.15.133:0/143817165 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc9c4003780 con 0x7fc9d4071db0 2023-12-18T10:19:09.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9bbfff640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc9c0065a60 0x7fc9c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9bbfff640 1 -- 172.21.15.133:0/143817165 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc9c40bb070 con 0x7fc9d4071db0 2023-12-18T10:19:09.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.557+0000 7fc9d2ffd640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc9c0065a60 0x7fc9c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.561+0000 7fc9d2ffd640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc9c0065a60 0x7fc9c0067f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40c32c0 tx=0x7fc9c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.561+0000 7fc9bbfff640 1 -- 172.21.15.133:0/143817165 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc9c40eb6e0 con 0x7fc9d4071db0 2023-12-18T10:19:09.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9d40cb380 con 0x7fc9d4071db0 2023-12-18T10:19:09.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9bbfff640 1 -- 172.21.15.133:0/143817165 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9c40c40a0 con 0x7fc9d4071db0 2023-12-18T10:19:09.720 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:19:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc9c0065a60 msgr2=0x7fc9c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc9c0065a60 0x7fc9c0067f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40c32c0 tx=0x7fc9c8008040 comp rx=0 tx=0).stop 2023-12-18T10:19:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d4071db0 msgr2=0x7fc9d4135e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d4071db0 0x7fc9d4135e50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc9c40097c0 tx=0x7fc9c401ac90 comp rx=0 tx=0).stop 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 shutdown_connections 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc9c0065a60 0x7fc9c0067f20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9d4159fb0 0x7fc9d415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9d40ca410 0x7fc9d40c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 --2- 172.21.15.133:0/143817165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d4071db0 0x7fc9d4135e50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 >> 172.21.15.133:0/143817165 conn(0x7fc9d406a2a0 msgr2=0x7fc9d415c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 shutdown_connections 2023-12-18T10:19:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.717+0000 7fc9d9c20640 1 -- 172.21.15.133:0/143817165 wait complete. 2023-12-18T10:19:09.740 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:19:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c415b3640 1 Processor -- start 2023-12-18T10:19:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c415b3640 1 -- start start 2023-12-18T10:19:09.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c415b3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c3c0b2780 0x7f0c3c1610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c415b3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c3c0cc7f0 0x7f0c3c06b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c415b3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c0ced90 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c415b3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c0cf220 con 0x7f0c3c0cc7f0 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c415b3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c15cfb0 con 0x7f0c3c0b2780 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c3b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c3c0cc7f0 0x7f0c3c06b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c3b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c3c0cc7f0 0x7f0c3c06b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54870/0 (socket says 172.21.15.133:54870) 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c3b7fe640 1 -- 172.21.15.133:0/2396621113 learned_addr learned my addr 172.21.15.133:0/2396621113 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c327fc640 1 --2- 172.21.15.133:0/2396621113 >> v2:172.21.15.142:3300/0 conn(0x7f0c3c0b2780 0x7f0c3c1610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c3b7fe640 1 -- 172.21.15.133:0/2396621113 >> v2:172.21.15.142:3300/0 conn(0x7f0c3c0b2780 msgr2=0x7f0c3c1610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c3b7fe640 1 --2- 172.21.15.133:0/2396621113 >> v2:172.21.15.142:3300/0 conn(0x7f0c3c0b2780 0x7f0c3c1610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c3b7fe640 1 -- 172.21.15.133:0/2396621113 >> v1:172.21.15.142:6789/0 conn(0x7f0c3c15cbd0 legacy=0x7f0c3c0b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.877+0000 7f0c3b7fe640 1 -- 172.21.15.133:0/2396621113 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0ce1c0 con 0x7f0c3c0cc7f0 2023-12-18T10:19:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c3b7fe640 1 --2- 172.21.15.133:0/2396621113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c0cc7f0 0x7f0c3c06b280 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0ce170 tx=0x7f0c3401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03422537ca51682 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c3a7fc640 1 -- 172.21.15.133:0/2396621113 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340ab5f0 con 0x7f0c3c0cc7f0 2023-12-18T10:19:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c3a7fc640 1 -- 172.21.15.133:0/2396621113 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340ab750 con 0x7f0c3c0cc7f0 2023-12-18T10:19:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c3a7fc640 1 -- 172.21.15.133:0/2396621113 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340abae0 con 0x7f0c3c0cc7f0 2023-12-18T10:19:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c415b3640 1 -- 172.21.15.133:0/2396621113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c0cc7f0 msgr2=0x7f0c3c06b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2396621113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c0cc7f0 0x7f0c3c06b280 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0ce170 tx=0x7f0c3401c500 comp rx=0 tx=0).stop 2023-12-18T10:19:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c415b3640 1 -- 172.21.15.133:0/2396621113 shutdown_connections 2023-12-18T10:19:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2396621113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c0cc7f0 0x7f0c3c06b280 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2396621113 >> v2:172.21.15.142:3300/0 conn(0x7f0c3c0b2780 0x7f0c3c1610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c415b3640 1 -- 172.21.15.133:0/2396621113 >> 172.21.15.133:0/2396621113 conn(0x7f0c3c0cd070 msgr2=0x7f0c3c0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:09.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c415b3640 1 -- 172.21.15.133:0/2396621113 shutdown_connections 2023-12-18T10:19:09.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.881+0000 7f0c415b3640 1 -- 172.21.15.133:0/2396621113 wait complete. 2023-12-18T10:19:09.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 Processor -- start 2023-12-18T10:19:09.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 -- start start 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0b2780 0x7f0c3c155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0cc7f0 0x7f0c3c157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c15cbd0 0x7f0c3c1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0b4810 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c157a00 con 0x7f0c3c0cc7f0 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0b3c20 con 0x7f0c3c0b2780 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c15cbd0 0x7f0c3c1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c15cbd0 0x7f0c3c1574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54874/0 (socket says 172.21.15.133:54874) 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 -- 172.21.15.133:0/2149562778 learned_addr learned my addr 172.21.15.133:0/2149562778 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c327fc640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0cc7f0 0x7f0c3c157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3affd640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0b2780 0x7f0c3c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 -- 172.21.15.133:0/2149562778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0b2780 msgr2=0x7f0c3c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0b2780 0x7f0c3c155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 -- 172.21.15.133:0/2149562778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0cc7f0 msgr2=0x7f0c3c157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:09.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0cc7f0 0x7f0c3c157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:09.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 -- 172.21.15.133:0/2149562778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340094d0 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c3b7fe640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c15cbd0 0x7f0c3c1574c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ad040 tx=0x7f0c3401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c33fff640 1 -- 172.21.15.133:0/2149562778 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340be5f0 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c33fff640 1 -- 172.21.15.133:0/2149562778 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340be750 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.885+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c0b3e70 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.889+0000 7f0c33fff640 1 -- 172.21.15.133:0/2149562778 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340beb00 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.889+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c0b4430 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.889+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c0b4950 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.889+0000 7f0c33fff640 1 -- 172.21.15.133:0/2149562778 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c340b43f0 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.889+0000 7f0c33fff640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c1c065a60 0x7f0c1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:09.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.889+0000 7f0c33fff640 1 -- 172.21.15.133:0/2149562778 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0c340a8050 con 0x7f0c3c15cbd0 2023-12-18T10:19:09.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.889+0000 7f0c3affd640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c1c065a60 0x7f0c1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:09.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.889+0000 7f0c3affd640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c1c065a60 0x7f0c1c067f20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c167a00 tx=0x7f0c2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:09.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:09.893+0000 7f0c33fff640 1 -- 172.21.15.133:0/2149562778 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0c34121030 con 0x7f0c3c15cbd0 2023-12-18T10:19:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.045+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0c3c157c30 con 0x7f0c3c15cbd0 2023-12-18T10:19:10.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.045+0000 7f0c33fff640 1 -- 172.21.15.133:0/2149562778 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0c340f3e60 con 0x7f0c3c15cbd0 2023-12-18T10:19:10.050 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c1c065a60 msgr2=0x7f0c1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c1c065a60 0x7f0c1c067f20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c167a00 tx=0x7f0c2c009040 comp rx=0 tx=0).stop 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c15cbd0 msgr2=0x7f0c3c1574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c15cbd0 0x7f0c3c1574c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0c340ad040 tx=0x7f0c3401ad40 comp rx=0 tx=0).stop 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 shutdown_connections 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c1c065a60 0x7f0c1c067f20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c15cbd0 0x7f0c3c1574c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c3c0cc7f0 0x7f0c3c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 --2- 172.21.15.133:0/2149562778 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c3c0b2780 0x7f0c3c155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 >> 172.21.15.133:0/2149562778 conn(0x7f0c3c0cd070 msgr2=0x7f0c3c158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 shutdown_connections 2023-12-18T10:19:10.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.049+0000 7f0c415b3640 1 -- 172.21.15.133:0/2149562778 wait complete. 2023-12-18T10:19:10.071 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:19:10.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb279041640 1 Processor -- start 2023-12-18T10:19:10.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb279041640 1 -- start start 2023-12-18T10:19:10.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb279041640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2740cac10 0x7fb27415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb279041640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb27406fdb0 0x7fb274070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb279041640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27415f100 con 0x7fb27415a680 2023-12-18T10:19:10.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb279041640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2740707a0 con 0x7fb27406fdb0 2023-12-18T10:19:10.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb279041640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2740ca7d0 con 0x7fb2740cac10 2023-12-18T10:19:10.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27359e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb27406fdb0 0x7fb274070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27359e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb27406fdb0 0x7fb274070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43508/0 (socket says 172.21.15.133:43508) 2023-12-18T10:19:10.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27359e640 1 -- 172.21.15.133:0/573740508 learned_addr learned my addr 172.21.15.133:0/573740508 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:10.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27259c640 1 --2- 172.21.15.133:0/573740508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2740cac10 0x7fb27415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27359e640 1 -- 172.21.15.133:0/573740508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2740cac10 msgr2=0x7fb27415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:10.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27359e640 1 --2- 172.21.15.133:0/573740508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2740cac10 0x7fb27415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27359e640 1 -- 172.21.15.133:0/573740508 >> v1:172.21.15.142:6789/0 conn(0x7fb27415a680 legacy=0x7fb27415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:10.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27359e640 1 -- 172.21.15.133:0/573740508 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27415e860 con 0x7fb27406fdb0 2023-12-18T10:19:10.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.209+0000 7fb27259c640 1 --2- 172.21.15.133:0/573740508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2740cac10 0x7fb27415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:10.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb27359e640 1 --2- 172.21.15.133:0/573740508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27406fdb0 0x7fb274070260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009870 tx=0x7fb26c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf79824386cb4541 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:10.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb271d9b640 1 -- 172.21.15.133:0/573740508 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0aa610 con 0x7fb27406fdb0 2023-12-18T10:19:10.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb271d9b640 1 -- 172.21.15.133:0/573740508 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c0a6040 con 0x7fb27406fdb0 2023-12-18T10:19:10.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb271d9b640 1 -- 172.21.15.133:0/573740508 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0aa990 con 0x7fb27406fdb0 2023-12-18T10:19:10.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 -- 172.21.15.133:0/573740508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27406fdb0 msgr2=0x7fb274070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 --2- 172.21.15.133:0/573740508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27406fdb0 0x7fb274070260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009870 tx=0x7fb26c01c4b0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 -- 172.21.15.133:0/573740508 shutdown_connections 2023-12-18T10:19:10.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 --2- 172.21.15.133:0/573740508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27406fdb0 0x7fb274070260 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 --2- 172.21.15.133:0/573740508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb2740cac10 0x7fb27415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 -- 172.21.15.133:0/573740508 >> 172.21.15.133:0/573740508 conn(0x7fb27406a3e0 msgr2=0x7fb2740afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:10.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 -- 172.21.15.133:0/573740508 shutdown_connections 2023-12-18T10:19:10.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 -- 172.21.15.133:0/573740508 wait complete. 2023-12-18T10:19:10.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.213+0000 7fb279041640 1 Processor -- start 2023-12-18T10:19:10.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 -- start start 2023-12-18T10:19:10.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb27406fdb0 0x7fb27414eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2740cac10 0x7fb2740c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb27415a680 0x7fb274152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27414f0e0 con 0x7fb2740cac10 2023-12-18T10:19:10.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27414f690 con 0x7fb27415a680 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27414f970 con 0x7fb27406fdb0 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2740cac10 0x7fb2740c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb272d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb27406fdb0 0x7fb27414eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2740cac10 0x7fb2740c28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43520/0 (socket says 172.21.15.133:43520) 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 -- 172.21.15.133:0/293917665 learned_addr learned my addr 172.21.15.133:0/293917665 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27359e640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb27415a680 0x7fb274152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 -- 172.21.15.133:0/293917665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb27406fdb0 msgr2=0x7fb27414eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb27406fdb0 0x7fb27414eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 -- 172.21.15.133:0/293917665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb27415a680 msgr2=0x7fb274152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb27415a680 0x7fb274152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 -- 172.21.15.133:0/293917665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c0094d0 con 0x7fb2740cac10 2023-12-18T10:19:10.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb27259c640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2740cac10 0x7fb2740c28a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb26800c7f0 tx=0x7fb26800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:10.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb25b7fe640 1 -- 172.21.15.133:0/293917665 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26800cea0 con 0x7fb2740cac10 2023-12-18T10:19:10.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb25b7fe640 1 -- 172.21.15.133:0/293917665 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb268007a30 con 0x7fb2740cac10 2023-12-18T10:19:10.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb25b7fe640 1 -- 172.21.15.133:0/293917665 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268007de0 con 0x7fb2740cac10 2023-12-18T10:19:10.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27414fc50 con 0x7fb2740cac10 2023-12-18T10:19:10.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb274150210 con 0x7fb2740cac10 2023-12-18T10:19:10.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.217+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2740735b0 con 0x7fb2740cac10 2023-12-18T10:19:10.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.221+0000 7fb25b7fe640 1 -- 172.21.15.133:0/293917665 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb2680113f0 con 0x7fb2740cac10 2023-12-18T10:19:10.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.221+0000 7fb25b7fe640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb260065a60 0x7fb260067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.221+0000 7fb25b7fe640 1 -- 172.21.15.133:0/293917665 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb268083650 con 0x7fb2740cac10 2023-12-18T10:19:10.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.221+0000 7fb272d9d640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb260065a60 0x7fb260067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.221+0000 7fb272d9d640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb260065a60 0x7fb260067f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2741654c0 tx=0x7fb264009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:10.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.225+0000 7fb25b7fe640 1 -- 172.21.15.133:0/293917665 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb268050c60 con 0x7fb2740cac10 2023-12-18T10:19:10.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb27404e000 con 0x7fb2740cac10 2023-12-18T10:19:10.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb25b7fe640 1 -- 172.21.15.133:0/293917665 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb268054280 con 0x7fb2740cac10 2023-12-18T10:19:10.392 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:19:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb260065a60 msgr2=0x7fb260067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb260065a60 0x7fb260067f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb2741654c0 tx=0x7fb264009040 comp rx=0 tx=0).stop 2023-12-18T10:19:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2740cac10 msgr2=0x7fb2740c28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2740cac10 0x7fb2740c28a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb26800c7f0 tx=0x7fb26800ccb0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 shutdown_connections 2023-12-18T10:19:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb260065a60 0x7fb260067f20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb27415a680 0x7fb274152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2740cac10 0x7fb2740c28a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 --2- 172.21.15.133:0/293917665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb27406fdb0 0x7fb27414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 >> 172.21.15.133:0/293917665 conn(0x7fb27406a3e0 msgr2=0x7fb274156880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 shutdown_connections 2023-12-18T10:19:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.389+0000 7fb279041640 1 -- 172.21.15.133:0/293917665 wait complete. 2023-12-18T10:19:10.413 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:19:10.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:10.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-18T10:19:10.434 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:19:10.435 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:19:10.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:10.435 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-18T10:19:10.487 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:19:10.487 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:10.497 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:19:10.498 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:10.548 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:10.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.681+0000 7f3549fb3640 1 Processor -- start 2023-12-18T10:19:10.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.681+0000 7f3549fb3640 1 -- start start 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3549fb3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 0x7f3544070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3549fb3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f35440cb180 0x7f35440ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3549fb3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3544070b80 con 0x7f354415c800 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3549fb3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3544070e60 con 0x7f35440cb180 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3549fb3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3544071140 con 0x7f3544158c20 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3543fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f35440cb180 0x7f35440ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3543fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f35440cb180 0x7f35440ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43528/0 (socket says 172.21.15.133:43528) 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3543fff640 1 -- 172.21.15.133:0/3247007961 learned_addr learned my addr 172.21.15.133:0/3247007961 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f35437fe640 1 --2- 172.21.15.133:0/3247007961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 0x7f3544070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3543fff640 1 -- 172.21.15.133:0/3247007961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 msgr2=0x7f3544070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:10.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3543fff640 1 --2- 172.21.15.133:0/3247007961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 0x7f3544070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3543fff640 1 -- 172.21.15.133:0/3247007961 >> v1:172.21.15.142:6789/0 conn(0x7f354415c800 legacy=0x7f35440caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.685+0000 7f3543fff640 1 -- 172.21.15.133:0/3247007961 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544071420 con 0x7f35440cb180 2023-12-18T10:19:10.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3543fff640 1 --2- 172.21.15.133:0/3247007961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35440ccc10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f353c009e50 tx=0x7f353c01d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2ce28570e594c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:10.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3542ffd640 1 -- 172.21.15.133:0/3247007961 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0a5830 con 0x7f35440cb180 2023-12-18T10:19:10.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3542ffd640 1 -- 172.21.15.133:0/3247007961 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0a5990 con 0x7f35440cb180 2023-12-18T10:19:10.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3542ffd640 1 -- 172.21.15.133:0/3247007961 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0a5d20 con 0x7f35440cb180 2023-12-18T10:19:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- 172.21.15.133:0/3247007961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 msgr2=0x7f35440ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 --2- 172.21.15.133:0/3247007961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35440ccc10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f353c009e50 tx=0x7f353c01d3b0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- 172.21.15.133:0/3247007961 shutdown_connections 2023-12-18T10:19:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 --2- 172.21.15.133:0/3247007961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35440ccc10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 --2- 172.21.15.133:0/3247007961 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 0x7f3544070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- 172.21.15.133:0/3247007961 >> 172.21.15.133:0/3247007961 conn(0x7f354406a3e0 msgr2=0x7f35440afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- 172.21.15.133:0/3247007961 shutdown_connections 2023-12-18T10:19:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- 172.21.15.133:0/3247007961 wait complete. 2023-12-18T10:19:10.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 Processor -- start 2023-12-18T10:19:10.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- start start 2023-12-18T10:19:10.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35441509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 0x7f354415bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f354415c800 0x7f3544151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544150520 con 0x7f35440cb180 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354414dca0 con 0x7f354415c800 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.689+0000 7f3549fb3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354414f910 con 0x7f3544158c20 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35441509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35441509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43530/0 (socket says 172.21.15.133:43530) 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 -- 172.21.15.133:0/2592362920 learned_addr learned my addr 172.21.15.133:0/2592362920 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 -- 172.21.15.133:0/2592362920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 msgr2=0x7f354415bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 0x7f354415bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 -- 172.21.15.133:0/2592362920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f354415c800 msgr2=0x7f3544151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f354415c800 0x7f3544151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 -- 172.21.15.133:0/2592362920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c009b30 con 0x7f35440cb180 2023-12-18T10:19:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f35437fe640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35441509b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f353400d800 tx=0x7f353400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f3540ff9640 1 -- 172.21.15.133:0/2592362920 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353400b6c0 con 0x7f35440cb180 2023-12-18T10:19:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f3540ff9640 1 -- 172.21.15.133:0/2592362920 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353400b860 con 0x7f35440cb180 2023-12-18T10:19:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35440c8800 con 0x7f35440cb180 2023-12-18T10:19:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f3540ff9640 1 -- 172.21.15.133:0/2592362920 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353400bc10 con 0x7f35440cb180 2023-12-18T10:19:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354414fed0 con 0x7f35440cb180 2023-12-18T10:19:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35440735b0 con 0x7f35440cb180 2023-12-18T10:19:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f3540ff9640 1 -- 172.21.15.133:0/2592362920 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f353401e460 con 0x7f35440cb180 2023-12-18T10:19:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.693+0000 7f3540ff9640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3524065a90 0x7f3524067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.697+0000 7f3540ff9640 1 -- 172.21.15.133:0/2592362920 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3534083a70 con 0x7f35440cb180 2023-12-18T10:19:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.697+0000 7f353bfff640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3524065a90 0x7f3524067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.697+0000 7f353bfff640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3524065a90 0x7f3524067f50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f352c000f70 tx=0x7f352c0079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.697+0000 7f3540ff9640 1 -- 172.21.15.133:0/2592362920 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3534051100 con 0x7f35440cb180 2023-12-18T10:19:10.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.849+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f354404e000 con 0x7f35440cb180 2023-12-18T10:19:10.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.849+0000 7f3540ff9640 1 -- 172.21.15.133:0/2592362920 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f3534054720 con 0x7f35440cb180 2023-12-18T10:19:10.853 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:10.854 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:10.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3524065a90 msgr2=0x7f3524067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3524065a90 0x7f3524067f50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f352c000f70 tx=0x7f352c0079c0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 msgr2=0x7f35441509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35441509b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f353400d800 tx=0x7f353400dcc0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 shutdown_connections 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3524065a90 0x7f3524067f50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f354415c800 0x7f3544151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3544158c20 0x7f354415bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 --2- 172.21.15.133:0/2592362920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35440cb180 0x7f35441509b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 >> 172.21.15.133:0/2592362920 conn(0x7f354406a3e0 msgr2=0x7f35440c56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 shutdown_connections 2023-12-18T10:19:10.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:10.853+0000 7f3549fb3640 1 -- 172.21.15.133:0/2592362920 wait complete. 2023-12-18T10:19:10.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:19:10.875 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:11.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac36fe9640 1 Processor -- start 2023-12-18T10:19:11.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac36fe9640 1 -- start start 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac36fe9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac3015cae0 0x7fac300d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac36fe9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fac300cde90 0x7fac300ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac36fe9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3015cec0 con 0x7fac300cf170 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac36fe9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300d0530 con 0x7fac3015cae0 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac36fe9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300d0810 con 0x7fac300cde90 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac34d85640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac3015cae0 0x7fac300d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac35586640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fac300cf170 0x7fac3006add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37214/0 (socket says 172.21.15.133:37214) 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac35586640 1 -- 172.21.15.133:0/2242814598 learned_addr learned my addr 172.21.15.133:0/2242814598 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac2ffff640 1 --2- 172.21.15.133:0/2242814598 >> v2:172.21.15.142:3300/0 conn(0x7fac300cde90 0x7fac300ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac34d85640 1 -- 172.21.15.133:0/2242814598 >> v2:172.21.15.142:3300/0 conn(0x7fac300cde90 msgr2=0x7fac300ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:11.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac34d85640 1 --2- 172.21.15.133:0/2242814598 >> v2:172.21.15.142:3300/0 conn(0x7fac300cde90 0x7fac300ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac34d85640 1 -- 172.21.15.133:0/2242814598 >> v1:172.21.15.133:6789/0 conn(0x7fac300cf170 legacy=0x7fac3006add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac2f7fe640 1 -- 172.21.15.133:0/2242814598 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490603007 0 0) 0x7fac3015cec0 con 0x7fac300cf170 2023-12-18T10:19:11.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.013+0000 7fac34d85640 1 -- 172.21.15.133:0/2242814598 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300d0af0 con 0x7fac3015cae0 2023-12-18T10:19:11.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac34d85640 1 --2- 172.21.15.133:0/2242814598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015cae0 0x7fac300d12f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fac300b8890 tx=0x7fac2401ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e19c5d1c3b7303 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac2f7fe640 1 -- 172.21.15.133:0/2242814598 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240a7070 con 0x7fac3015cae0 2023-12-18T10:19:11.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac2f7fe640 1 -- 172.21.15.133:0/2242814598 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac240ab430 con 0x7fac3015cae0 2023-12-18T10:19:11.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac2f7fe640 1 -- 172.21.15.133:0/2242814598 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240ab7c0 con 0x7fac3015cae0 2023-12-18T10:19:11.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac36fe9640 1 -- 172.21.15.133:0/2242814598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015cae0 msgr2=0x7fac300d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac36fe9640 1 --2- 172.21.15.133:0/2242814598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015cae0 0x7fac300d12f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fac300b8890 tx=0x7fac2401ce70 comp rx=0 tx=0).stop 2023-12-18T10:19:11.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac36fe9640 1 -- 172.21.15.133:0/2242814598 shutdown_connections 2023-12-18T10:19:11.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac36fe9640 1 --2- 172.21.15.133:0/2242814598 >> v2:172.21.15.142:3300/0 conn(0x7fac300cde90 0x7fac300ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac36fe9640 1 --2- 172.21.15.133:0/2242814598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015cae0 0x7fac300d12f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac36fe9640 1 -- 172.21.15.133:0/2242814598 >> 172.21.15.133:0/2242814598 conn(0x7fac30089fb0 msgr2=0x7fac300d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:11.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac36fe9640 1 -- 172.21.15.133:0/2242814598 shutdown_connections 2023-12-18T10:19:11.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.017+0000 7fac36fe9640 1 -- 172.21.15.133:0/2242814598 wait complete. 2023-12-18T10:19:11.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 Processor -- start 2023-12-18T10:19:11.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 -- start start 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac300cde90 0x7fac3014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac300cf170 0x7fac300afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3015cae0 0x7fac300b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac30156ea0 con 0x7fac300cf170 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac30157140 con 0x7fac3015cae0 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac30157420 con 0x7fac300cde90 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac300cf170 0x7fac300afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac300cf170 0x7fac300afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43558/0 (socket says 172.21.15.133:43558) 2023-12-18T10:19:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 -- 172.21.15.133:0/1409343426 learned_addr learned my addr 172.21.15.133:0/1409343426 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 -- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac300cde90 msgr2=0x7fac3014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac34d85640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac300cde90 0x7fac3014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac35586640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3015cae0 0x7fac300b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac300cde90 0x7fac3014f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 -- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3015cae0 msgr2=0x7fac300b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3015cae0 0x7fac300b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 -- 172.21.15.133:0/1409343426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240093b0 con 0x7fac300cf170 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac34d85640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac300cde90 0x7fac3014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2ffff640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac300cf170 0x7fac300afcb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00e930 tx=0x7fac1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2d7fa640 1 -- 172.21.15.133:0/1409343426 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c009690 con 0x7fac300cf170 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2d7fa640 1 -- 172.21.15.133:0/1409343426 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c00ca00 con 0x7fac300cf170 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac2d7fa640 1 -- 172.21.15.133:0/1409343426 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00cd70 con 0x7fac300cf170 2023-12-18T10:19:11.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac30157700 con 0x7fac300cf170 2023-12-18T10:19:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.021+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac300b0b00 con 0x7fac300cf170 2023-12-18T10:19:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.025+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3004e000 con 0x7fac300cf170 2023-12-18T10:19:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.025+0000 7fac2d7fa640 1 -- 172.21.15.133:0/1409343426 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fac1c013470 con 0x7fac300cf170 2023-12-18T10:19:11.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.025+0000 7fac2d7fa640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac14065a60 0x7fac14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.025+0000 7fac2d7fa640 1 -- 172.21.15.133:0/1409343426 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fac1c0837e0 con 0x7fac300cf170 2023-12-18T10:19:11.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.025+0000 7fac34d85640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac14065a60 0x7fac14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.025+0000 7fac34d85640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac14065a60 0x7fac14067f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac240af000 tx=0x7fac24004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.029+0000 7fac2d7fa640 1 -- 172.21.15.133:0/1409343426 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fac1c050e90 con 0x7fac300cf170 2023-12-18T10:19:11.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.181+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac300cff40 con 0x7fac300cf170 2023-12-18T10:19:11.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.181+0000 7fac2d7fa640 1 -- 172.21.15.133:0/1409343426 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac1c0544b0 con 0x7fac300cf170 2023-12-18T10:19:11.185 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:11.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac14065a60 msgr2=0x7fac14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac14065a60 0x7fac14067f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac240af000 tx=0x7fac24004740 comp rx=0 tx=0).stop 2023-12-18T10:19:11.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac300cf170 msgr2=0x7fac300afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac300cf170 0x7fac300afcb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00e930 tx=0x7fac1c00edf0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 shutdown_connections 2023-12-18T10:19:11.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fac14065a60 0x7fac14067f20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac3015cae0 0x7fac300b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac300cf170 0x7fac300afcb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 --2- 172.21.15.133:0/1409343426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac300cde90 0x7fac3014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 >> 172.21.15.133:0/1409343426 conn(0x7fac30089fb0 msgr2=0x7fac300d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 shutdown_connections 2023-12-18T10:19:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.185+0000 7fac36fe9640 1 -- 172.21.15.133:0/1409343426 wait complete. 2023-12-18T10:19:11.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:19:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.345+0000 7fd423109640 1 Processor -- start 2023-12-18T10:19:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.345+0000 7fd423109640 1 -- start start 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.345+0000 7fd423109640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c0ca410 0x7fd41c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.345+0000 7fd423109640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd41c159fb0 0x7fd41c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.345+0000 7fd423109640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd41c071db0 0x7fd41c0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.345+0000 7fd423109640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c15aab0 con 0x7fd41c071db0 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.345+0000 7fd423109640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c070df0 con 0x7fd41c159fb0 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.345+0000 7fd423109640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c15a4f0 con 0x7fd41c0ca410 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd41c071db0 0x7fd41c0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd41c071db0 0x7fd41c0cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43572/0 (socket says 172.21.15.133:43572) 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 -- 172.21.15.133:0/4230463363 learned_addr learned my addr 172.21.15.133:0/4230463363 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd41bfff640 1 --2- 172.21.15.133:0/4230463363 >> v2:172.21.15.142:3300/0 conn(0x7fd41c159fb0 0x7fd41c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 -- 172.21.15.133:0/4230463363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c0ca410 msgr2=0x7fd41c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd420ea5640 1 --2- 172.21.15.133:0/4230463363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c0ca410 0x7fd41c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 --2- 172.21.15.133:0/4230463363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c0ca410 0x7fd41c159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 -- 172.21.15.133:0/4230463363 >> v2:172.21.15.142:3300/0 conn(0x7fd41c159fb0 msgr2=0x7fd41c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 --2- 172.21.15.133:0/4230463363 >> v2:172.21.15.142:3300/0 conn(0x7fd41c159fb0 0x7fd41c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 -- 172.21.15.133:0/4230463363 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c15a7d0 con 0x7fd41c071db0 2023-12-18T10:19:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd41bfff640 1 --2- 172.21.15.133:0/4230463363 >> v2:172.21.15.142:3300/0 conn(0x7fd41c159fb0 0x7fd41c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd420ea5640 1 --2- 172.21.15.133:0/4230463363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c0ca410 0x7fd41c159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:11.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd4216a6640 1 --2- 172.21.15.133:0/4230463363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c071db0 0x7fd41c0cbff0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06df10 tx=0x7fd41401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f3cf63459cf82e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd41b7fe640 1 -- 172.21.15.133:0/4230463363 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a5730 con 0x7fd41c071db0 2023-12-18T10:19:11.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd41b7fe640 1 -- 172.21.15.133:0/4230463363 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4140a5890 con 0x7fd41c071db0 2023-12-18T10:19:11.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.349+0000 7fd41b7fe640 1 -- 172.21.15.133:0/4230463363 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a5c20 con 0x7fd41c071db0 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- 172.21.15.133:0/4230463363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c071db0 msgr2=0x7fd41c0cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 --2- 172.21.15.133:0/4230463363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c071db0 0x7fd41c0cbff0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd41c06df10 tx=0x7fd41401c9a0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- 172.21.15.133:0/4230463363 shutdown_connections 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 --2- 172.21.15.133:0/4230463363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c071db0 0x7fd41c0cbff0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 --2- 172.21.15.133:0/4230463363 >> v2:172.21.15.142:3300/0 conn(0x7fd41c159fb0 0x7fd41c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 --2- 172.21.15.133:0/4230463363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c0ca410 0x7fd41c159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- 172.21.15.133:0/4230463363 >> 172.21.15.133:0/4230463363 conn(0x7fd41c06a2a0 msgr2=0x7fd41c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- 172.21.15.133:0/4230463363 shutdown_connections 2023-12-18T10:19:11.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- 172.21.15.133:0/4230463363 wait complete. 2023-12-18T10:19:11.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 Processor -- start 2023-12-18T10:19:11.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- start start 2023-12-18T10:19:11.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd41c071db0 0x7fd41c0c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c0ca410 0x7fd41c0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c159fb0 0x7fd41c0af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0af150 con 0x7fd41c0ca410 2023-12-18T10:19:11.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0aeb20 con 0x7fd41c071db0 2023-12-18T10:19:11.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd423109640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0c5c40 con 0x7fd41c159fb0 2023-12-18T10:19:11.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd41bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c0ca410 0x7fd41c0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd41bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c0ca410 0x7fd41c0c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43584/0 (socket says 172.21.15.133:43584) 2023-12-18T10:19:11.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd41bfff640 1 -- 172.21.15.133:0/358807671 learned_addr learned my addr 172.21.15.133:0/358807671 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:11.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd420ea5640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd41c071db0 0x7fd41c0c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.353+0000 7fd4216a6640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c159fb0 0x7fd41c0af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd41bfff640 1 -- 172.21.15.133:0/358807671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c159fb0 msgr2=0x7fd41c0af570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd41bfff640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c159fb0 0x7fd41c0af570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd41bfff640 1 -- 172.21.15.133:0/358807671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd41c071db0 msgr2=0x7fd41c0c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd41bfff640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd41c071db0 0x7fd41c0c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd41bfff640 1 -- 172.21.15.133:0/358807671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414009b30 con 0x7fd41c0ca410 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd41bfff640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c0ca410 0x7fd41c0c7c30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd40800c7c0 tx=0x7fd40800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd4197fa640 1 -- 172.21.15.133:0/358807671 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd408007a30 con 0x7fd41c0ca410 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd4197fa640 1 -- 172.21.15.133:0/358807671 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd408007b90 con 0x7fd41c0ca410 2023-12-18T10:19:11.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c0c5f10 con 0x7fd41c0ca410 2023-12-18T10:19:11.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd4197fa640 1 -- 172.21.15.133:0/358807671 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40800ce70 con 0x7fd41c0ca410 2023-12-18T10:19:11.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c0aed70 con 0x7fd41c0ca410 2023-12-18T10:19:11.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c0af290 con 0x7fd41c0ca410 2023-12-18T10:19:11.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.357+0000 7fd4197fa640 1 -- 172.21.15.133:0/358807671 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd4080113f0 con 0x7fd41c0ca410 2023-12-18T10:19:11.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.361+0000 7fd4197fa640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd400065a60 0x7fd400067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.361+0000 7fd4197fa640 1 -- 172.21.15.133:0/358807671 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd408083800 con 0x7fd41c0ca410 2023-12-18T10:19:11.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.361+0000 7fd420ea5640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd400065a60 0x7fd400067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.361+0000 7fd420ea5640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd400065a60 0x7fd400067f20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd41000ab60 tx=0x7fd410008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.365+0000 7fd4197fa640 1 -- 172.21.15.133:0/358807671 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd41c0af290 con 0x7fd41c0ca410 2023-12-18T10:19:11.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd41c0af290 con 0x7fd41c0ca410 2023-12-18T10:19:11.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd4197fa640 1 -- 172.21.15.133:0/358807671 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd41c0af290 con 0x7fd41c0ca410 2023-12-18T10:19:11.515 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd400065a60 msgr2=0x7fd400067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd400065a60 0x7fd400067f20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd41000ab60 tx=0x7fd410008040 comp rx=0 tx=0).stop 2023-12-18T10:19:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c0ca410 msgr2=0x7fd41c0c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c0ca410 0x7fd41c0c7c30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd40800c7c0 tx=0x7fd40800cc80 comp rx=0 tx=0).stop 2023-12-18T10:19:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 shutdown_connections 2023-12-18T10:19:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd400065a60 0x7fd400067f20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd41c159fb0 0x7fd41c0af570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd41c0ca410 0x7fd41c0c7c30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 --2- 172.21.15.133:0/358807671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd41c071db0 0x7fd41c0c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 >> 172.21.15.133:0/358807671 conn(0x7fd41c06a2a0 msgr2=0x7fd41c0c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 shutdown_connections 2023-12-18T10:19:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.513+0000 7fd423109640 1 -- 172.21.15.133:0/358807671 wait complete. 2023-12-18T10:19:11.536 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:19:11.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.673+0000 7f52a9539640 1 Processor -- start 2023-12-18T10:19:11.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.673+0000 7f52a9539640 1 -- start start 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.673+0000 7f52a9539640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52a415cbd0 0x7f52a41610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.673+0000 7f52a9539640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f52a40cc7f0 0x7f52a40b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.673+0000 7f52a9539640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 0x7f52a406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.673+0000 7f52a9539640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40b2a40 con 0x7f52a415cbd0 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.673+0000 7f52a9539640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40ced90 con 0x7f52a40cc7f0 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.673+0000 7f52a9539640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40cf220 con 0x7f52a40b25b0 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52a415cbd0 0x7f52a41610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52a415cbd0 0x7f52a41610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43588/0 (socket says 172.21.15.133:43588) 2023-12-18T10:19:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 -- 172.21.15.133:0/2256547445 learned_addr learned my addr 172.21.15.133:0/2256547445 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f529bfff640 1 --2- 172.21.15.133:0/2256547445 >> v2:172.21.15.142:3300/0 conn(0x7f52a40cc7f0 0x7f52a40b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a37fe640 1 --2- 172.21.15.133:0/2256547445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 0x7f52a406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 -- 172.21.15.133:0/2256547445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 msgr2=0x7f52a406ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 --2- 172.21.15.133:0/2256547445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 0x7f52a406ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 -- 172.21.15.133:0/2256547445 >> v2:172.21.15.142:3300/0 conn(0x7f52a40cc7f0 msgr2=0x7f52a40b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 --2- 172.21.15.133:0/2256547445 >> v2:172.21.15.142:3300/0 conn(0x7f52a40cc7f0 0x7f52a40b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 -- 172.21.15.133:0/2256547445 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a415cfb0 con 0x7f52a415cbd0 2023-12-18T10:19:11.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.677+0000 7f52a2ffd640 1 --2- 172.21.15.133:0/2256547445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a415cbd0 0x7f52a41610f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f52a40ce170 tx=0x7f529401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f744b9dfa4ff2a86 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a27fc640 1 -- 172.21.15.133:0/2256547445 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940ab600 con 0x7f52a415cbd0 2023-12-18T10:19:11.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a27fc640 1 -- 172.21.15.133:0/2256547445 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52940a7050 con 0x7f52a415cbd0 2023-12-18T10:19:11.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a27fc640 1 -- 172.21.15.133:0/2256547445 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940ab980 con 0x7f52a415cbd0 2023-12-18T10:19:11.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- 172.21.15.133:0/2256547445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a415cbd0 msgr2=0x7f52a41610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 --2- 172.21.15.133:0/2256547445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a415cbd0 0x7f52a41610f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f52a40ce170 tx=0x7f529401c240 comp rx=0 tx=0).stop 2023-12-18T10:19:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- 172.21.15.133:0/2256547445 shutdown_connections 2023-12-18T10:19:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 --2- 172.21.15.133:0/2256547445 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 0x7f52a406ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 --2- 172.21.15.133:0/2256547445 >> v2:172.21.15.142:3300/0 conn(0x7f52a40cc7f0 0x7f52a40b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 --2- 172.21.15.133:0/2256547445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a415cbd0 0x7f52a41610f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- 172.21.15.133:0/2256547445 >> 172.21.15.133:0/2256547445 conn(0x7f52a40cd070 msgr2=0x7f52a40cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- 172.21.15.133:0/2256547445 shutdown_connections 2023-12-18T10:19:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- 172.21.15.133:0/2256547445 wait complete. 2023-12-18T10:19:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 Processor -- start 2023-12-18T10:19:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- start start 2023-12-18T10:19:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 0x7f52a40c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a40cc7f0 0x7f52a40b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a415cbd0 0x7f52a40b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4154920 con 0x7f52a40cc7f0 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4154b30 con 0x7f52a415cbd0 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f52a9539640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4154e10 con 0x7f52a40b25b0 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f529bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a40cc7f0 0x7f52a40b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f529bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a40cc7f0 0x7f52a40b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43598/0 (socket says 172.21.15.133:43598) 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.681+0000 7f529bfff640 1 -- 172.21.15.133:0/3541478661 learned_addr learned my addr 172.21.15.133:0/3541478661 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f52a2ffd640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 0x7f52a40c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f52a37fe640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a415cbd0 0x7f52a40b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529bfff640 1 -- 172.21.15.133:0/3541478661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 msgr2=0x7f52a40c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529bfff640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 0x7f52a40c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529bfff640 1 -- 172.21.15.133:0/3541478661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a415cbd0 msgr2=0x7f52a40b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529bfff640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a415cbd0 0x7f52a40b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529bfff640 1 -- 172.21.15.133:0/3541478661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294009480 con 0x7f52a40cc7f0 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529bfff640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a40cc7f0 0x7f52a40b3bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f528c00e930 tx=0x7f528c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529b7fe640 1 -- 172.21.15.133:0/3541478661 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c009690 con 0x7f52a40cc7f0 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529b7fe640 1 -- 172.21.15.133:0/3541478661 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c00ca00 con 0x7f52a40cc7f0 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529b7fe640 1 -- 172.21.15.133:0/3541478661 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00cd70 con 0x7f52a40cc7f0 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a41550f0 con 0x7f52a40cc7f0 2023-12-18T10:19:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a41556b0 con 0x7f52a40cc7f0 2023-12-18T10:19:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a404e000 con 0x7f52a40cc7f0 2023-12-18T10:19:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529b7fe640 1 -- 172.21.15.133:0/3541478661 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f528c013470 con 0x7f52a40cc7f0 2023-12-18T10:19:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529b7fe640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5284065a90 0x7f5284067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f529b7fe640 1 -- 172.21.15.133:0/3541478661 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f528c083780 con 0x7f52a40cc7f0 2023-12-18T10:19:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.685+0000 7f52a2ffd640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5284065a90 0x7f5284067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.689+0000 7f52a2ffd640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5284065a90 0x7f5284067f50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f52940ad000 tx=0x7f52940a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.689+0000 7f529b7fe640 1 -- 172.21.15.133:0/3541478661 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f528c050e50 con 0x7f52a40cc7f0 2023-12-18T10:19:11.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.841+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52a40b6570 con 0x7f52a40cc7f0 2023-12-18T10:19:11.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.841+0000 7f529b7fe640 1 -- 172.21.15.133:0/3541478661 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f528c054470 con 0x7f52a40cc7f0 2023-12-18T10:19:11.845 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5284065a90 msgr2=0x7f5284067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5284065a90 0x7f5284067f50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f52940ad000 tx=0x7f52940a6000 comp rx=0 tx=0).stop 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a40cc7f0 msgr2=0x7f52a40b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a40cc7f0 0x7f52a40b3bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f528c00e930 tx=0x7f528c00edf0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 shutdown_connections 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5284065a90 0x7f5284067f50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52a415cbd0 0x7f52a40b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52a40cc7f0 0x7f52a40b3bf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 --2- 172.21.15.133:0/3541478661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52a40b25b0 0x7f52a40c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 >> 172.21.15.133:0/3541478661 conn(0x7f52a40cd070 msgr2=0x7f52a406b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:11.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 shutdown_connections 2023-12-18T10:19:11.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:11.845+0000 7f52a9539640 1 -- 172.21.15.133:0/3541478661 wait complete. 2023-12-18T10:19:11.866 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:19:12.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.001+0000 7fe44bdb3640 1 Processor -- start 2023-12-18T10:19:12.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.001+0000 7fe44bdb3640 1 -- start start 2023-12-18T10:19:12.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44bdb3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4440ceac0 0x7fe4440c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44bdb3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4440c9390 con 0x7fe444070820 2023-12-18T10:19:12.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44bdb3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe44415aee0 con 0x7fe4441582d0 2023-12-18T10:19:12.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44bdb3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44415b1c0 con 0x7fe4440ceac0 2023-12-18T10:19:12.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44934e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe444070820 0x7fe4440ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37218/0 (socket says 172.21.15.133:37218) 2023-12-18T10:19:12.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44a350640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4440ceac0 0x7fe4440c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44934e640 1 -- 172.21.15.133:0/1976060650 learned_addr learned my addr 172.21.15.133:0/1976060650 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:12.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44a350640 1 -- 172.21.15.133:0/1976060650 >> v1:172.21.15.142:6789/0 conn(0x7fe4441582d0 legacy=0x7fe4440ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44a350640 1 -- 172.21.15.133:0/1976060650 >> v1:172.21.15.133:6789/0 conn(0x7fe444070820 legacy=0x7fe4440ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe44a350640 1 -- 172.21.15.133:0/1976060650 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44415b4a0 con 0x7fe4440ceac0 2023-12-18T10:19:12.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.005+0000 7fe448b4d640 1 -- 172.21.15.133:0/1976060650 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098287124 0 0) 0x7fe4440c9390 con 0x7fe444070820 2023-12-18T10:19:12.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44a350640 1 --2- 172.21.15.133:0/1976060650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4440ceac0 0x7fe4440c8e50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009d90 tx=0x7fe43c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd5e560aa370b66 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe448b4d640 1 -- 172.21.15.133:0/1976060650 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0a5a00 con 0x7fe4440ceac0 2023-12-18T10:19:12.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe448b4d640 1 -- 172.21.15.133:0/1976060650 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c0a5b60 con 0x7fe4440ceac0 2023-12-18T10:19:12.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe448b4d640 1 -- 172.21.15.133:0/1976060650 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0ad440 con 0x7fe4440ceac0 2023-12-18T10:19:12.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1976060650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4440ceac0 msgr2=0x7fe4440c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 --2- 172.21.15.133:0/1976060650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4440ceac0 0x7fe4440c8e50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009d90 tx=0x7fe43c01c920 comp rx=0 tx=0).stop 2023-12-18T10:19:12.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1976060650 shutdown_connections 2023-12-18T10:19:12.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 --2- 172.21.15.133:0/1976060650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4440ceac0 0x7fe4440c8e50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1976060650 >> 172.21.15.133:0/1976060650 conn(0x7fe44406a2a0 msgr2=0x7fe4440aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:12.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1976060650 shutdown_connections 2023-12-18T10:19:12.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1976060650 wait complete. 2023-12-18T10:19:12.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 Processor -- start 2023-12-18T10:19:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.009+0000 7fe44bdb3640 1 -- start start 2023-12-18T10:19:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe444070820 0x7fe4440c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4440ceac0 0x7fe4440c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4441582d0 0x7fe444155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440c2080 con 0x7fe444070820 2023-12-18T10:19:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440c2360 con 0x7fe4441582d0 2023-12-18T10:19:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440c2640 con 0x7fe4440ceac0 2023-12-18T10:19:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe444070820 0x7fe4440c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe444070820 0x7fe4440c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43622/0 (socket says 172.21.15.133:43622) 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 -- 172.21.15.133:0/1211446134 learned_addr learned my addr 172.21.15.133:0/1211446134 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44a350640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4441582d0 0x7fe444155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44934e640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4440ceac0 0x7fe4440c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 -- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4440ceac0 msgr2=0x7fe4440c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4440ceac0 0x7fe4440c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 -- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4441582d0 msgr2=0x7fe444155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4441582d0 0x7fe444155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 -- 172.21.15.133:0/1211446134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c009a70 con 0x7fe444070820 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44934e640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4440ceac0 0x7fe4440c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe449b4f640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe444070820 0x7fe4440c7170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe44000c500 tx=0x7fe44000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe43a7fc640 1 -- 172.21.15.133:0/1211446134 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440005220 con 0x7fe444070820 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe43a7fc640 1 -- 172.21.15.133:0/1211446134 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe440005380 con 0x7fe444070820 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4440c2920 con 0x7fe444070820 2023-12-18T10:19:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe43a7fc640 1 -- 172.21.15.133:0/1211446134 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440007270 con 0x7fe444070820 2023-12-18T10:19:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4440c76b0 con 0x7fe444070820 2023-12-18T10:19:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44404e000 con 0x7fe444070820 2023-12-18T10:19:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.013+0000 7fe43a7fc640 1 -- 172.21.15.133:0/1211446134 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe4400073d0 con 0x7fe444070820 2023-12-18T10:19:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.017+0000 7fe43a7fc640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe428065a90 0x7fe428067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.017+0000 7fe43a7fc640 1 -- 172.21.15.133:0/1211446134 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe440082e80 con 0x7fe444070820 2023-12-18T10:19:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.017+0000 7fe44934e640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe428065a90 0x7fe428067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.017+0000 7fe44934e640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe428065a90 0x7fe428067f50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4440c4450 tx=0x7fe434009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.021+0000 7fe43a7fc640 1 -- 172.21.15.133:0/1211446134 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe4400503f0 con 0x7fe444070820 2023-12-18T10:19:12.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe444166300 con 0x7fe444070820 2023-12-18T10:19:12.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe43a7fc640 1 -- 172.21.15.133:0/1211446134 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe440053a10 con 0x7fe444070820 2023-12-18T10:19:12.172 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:12.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe428065a90 msgr2=0x7fe428067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe428065a90 0x7fe428067f50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4440c4450 tx=0x7fe434009040 comp rx=0 tx=0).stop 2023-12-18T10:19:12.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe444070820 msgr2=0x7fe4440c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe444070820 0x7fe4440c7170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe44000c500 tx=0x7fe44000c9c0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 shutdown_connections 2023-12-18T10:19:12.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe428065a90 0x7fe428067f50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe4441582d0 0x7fe444155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe4440ceac0 0x7fe4440c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 --2- 172.21.15.133:0/1211446134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe444070820 0x7fe4440c7170 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 >> 172.21.15.133:0/1211446134 conn(0x7fe44406a2a0 msgr2=0x7fe4440cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:12.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 shutdown_connections 2023-12-18T10:19:12.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.169+0000 7fe44bdb3640 1 -- 172.21.15.133:0/1211446134 wait complete. 2023-12-18T10:19:12.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:19:12.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.329+0000 7f26196e5640 1 Processor -- start 2023-12-18T10:19:12.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.329+0000 7f26196e5640 1 -- start start 2023-12-18T10:19:12.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.329+0000 7f26196e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 0x7f2614070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.329+0000 7f26196e5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26140cb180 0x7f26140ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.329+0000 7f26196e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2614070b80 con 0x7f261415c800 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.329+0000 7f26196e5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2614070e60 con 0x7f26140cb180 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.329+0000 7f26196e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2614071140 con 0x7f2614158c20 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26137fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26140cb180 0x7f26140ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26137fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26140cb180 0x7f26140ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43632/0 (socket says 172.21.15.133:43632) 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26137fe640 1 -- 172.21.15.133:0/3285865381 learned_addr learned my addr 172.21.15.133:0/3285865381 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f2612ffd640 1 --2- 172.21.15.133:0/3285865381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 0x7f2614070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26137fe640 1 -- 172.21.15.133:0/3285865381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 msgr2=0x7f2614070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26137fe640 1 --2- 172.21.15.133:0/3285865381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 0x7f2614070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26137fe640 1 -- 172.21.15.133:0/3285865381 >> v1:172.21.15.142:6789/0 conn(0x7f261415c800 legacy=0x7f26140caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26137fe640 1 -- 172.21.15.133:0/3285865381 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2614071420 con 0x7f26140cb180 2023-12-18T10:19:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26137fe640 1 --2- 172.21.15.133:0/3285865381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cb180 0x7f26140ccc10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f260c009870 tx=0x7f260c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147eb0e1c1231e01 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26127fc640 1 -- 172.21.15.133:0/3285865381 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0ac640 con 0x7f26140cb180 2023-12-18T10:19:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26127fc640 1 -- 172.21.15.133:0/3285865381 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0ac7a0 con 0x7f26140cb180 2023-12-18T10:19:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.333+0000 7f26127fc640 1 -- 172.21.15.133:0/3285865381 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0acb30 con 0x7f26140cb180 2023-12-18T10:19:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- 172.21.15.133:0/3285865381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cb180 msgr2=0x7f26140ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 --2- 172.21.15.133:0/3285865381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cb180 0x7f26140ccc10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f260c009870 tx=0x7f260c01cee0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- 172.21.15.133:0/3285865381 shutdown_connections 2023-12-18T10:19:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 --2- 172.21.15.133:0/3285865381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cb180 0x7f26140ccc10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 --2- 172.21.15.133:0/3285865381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 0x7f2614070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- 172.21.15.133:0/3285865381 >> 172.21.15.133:0/3285865381 conn(0x7f261406a3e0 msgr2=0x7f26140afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- 172.21.15.133:0/3285865381 shutdown_connections 2023-12-18T10:19:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- 172.21.15.133:0/3285865381 wait complete. 2023-12-18T10:19:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 Processor -- start 2023-12-18T10:19:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- start start 2023-12-18T10:19:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cb180 0x7f2614149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 0x7f261414a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261415c800 0x7f2614156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261415a5a0 con 0x7f261415c800 2023-12-18T10:19:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261415c090 con 0x7f26140cb180 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26196e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261415a840 con 0x7f2614158c20 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26137fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261415c800 0x7f2614156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26137fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261415c800 0x7f2614156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43634/0 (socket says 172.21.15.133:43634) 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26137fe640 1 -- 172.21.15.133:0/2886126531 learned_addr learned my addr 172.21.15.133:0/2886126531 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f2612ffd640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cb180 0x7f2614149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f260a7fc640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 0x7f261414a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26137fe640 1 -- 172.21.15.133:0/2886126531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 msgr2=0x7f261414a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26137fe640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 0x7f261414a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26137fe640 1 -- 172.21.15.133:0/2886126531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cb180 msgr2=0x7f2614149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26137fe640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cb180 0x7f2614149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.337+0000 7f26137fe640 1 -- 172.21.15.133:0/2886126531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0094d0 con 0x7f261415c800 2023-12-18T10:19:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f26137fe640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261415c800 0x7f2614156220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f260c01a0b0 tx=0x7f260c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f260bfff640 1 -- 172.21.15.133:0/2886126531 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0b5640 con 0x7f261415c800 2023-12-18T10:19:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f260bfff640 1 -- 172.21.15.133:0/2886126531 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0b57a0 con 0x7f261415c800 2023-12-18T10:19:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26140c8800 con 0x7f261415c800 2023-12-18T10:19:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f260bfff640 1 -- 172.21.15.133:0/2886126531 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0b5b10 con 0x7f261415c800 2023-12-18T10:19:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261415ae00 con 0x7f261415c800 2023-12-18T10:19:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26140735b0 con 0x7f261415c800 2023-12-18T10:19:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f260bfff640 1 -- 172.21.15.133:0/2886126531 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f260c0b3070 con 0x7f261415c800 2023-12-18T10:19:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f260bfff640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f4065a60 0x7f25f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.341+0000 7f260bfff640 1 -- 172.21.15.133:0/2886126531 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f260c11d4d0 con 0x7f261415c800 2023-12-18T10:19:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.345+0000 7f2612ffd640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f4065a60 0x7f25f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.345+0000 7f2612ffd640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f4065a60 0x7f25f4067f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2614157cb0 tx=0x7f260400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.345+0000 7f260bfff640 1 -- 172.21.15.133:0/2886126531 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f260c0eab60 con 0x7f261415c800 2023-12-18T10:19:12.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.509+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f261404e000 con 0x7f261415c800 2023-12-18T10:19:12.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.509+0000 7f260bfff640 1 -- 172.21.15.133:0/2886126531 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f260c0ee180 con 0x7f261415c800 2023-12-18T10:19:12.513 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f4065a60 msgr2=0x7f25f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f4065a60 0x7f25f4067f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2614157cb0 tx=0x7f260400b040 comp rx=0 tx=0).stop 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261415c800 msgr2=0x7f2614156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261415c800 0x7f2614156220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f260c01a0b0 tx=0x7f260c019220 comp rx=0 tx=0).stop 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 shutdown_connections 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f4065a60 0x7f25f4067f20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261415c800 0x7f2614156220 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2614158c20 0x7f261414a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 --2- 172.21.15.133:0/2886126531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cb180 0x7f2614149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 >> 172.21.15.133:0/2886126531 conn(0x7f261406a3e0 msgr2=0x7f261414dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:12.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 shutdown_connections 2023-12-18T10:19:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.513+0000 7f26196e5640 1 -- 172.21.15.133:0/2886126531 wait complete. 2023-12-18T10:19:12.535 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:19:12.535 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:19:12.545 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:12.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe978466640 1 Processor -- start 2023-12-18T10:19:12.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe978466640 1 -- start start 2023-12-18T10:19:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe978466640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe97015a680 0x7fe97015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe978466640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9700cac10 0x7fe97015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe978466640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97015f100 con 0x7fe97015afa0 2023-12-18T10:19:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe978466640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9700ca7d0 con 0x7fe9700cac10 2023-12-18T10:19:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe978466640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015e860 con 0x7fe97015a680 2023-12-18T10:19:12.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe976a03640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe97015afa0 0x7fe97006fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37224/0 (socket says 172.21.15.133:37224) 2023-12-18T10:19:12.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe976a03640 1 -- 172.21.15.133:0/4070084797 learned_addr learned my addr 172.21.15.133:0/4070084797 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe975a01640 1 --2- 172.21.15.133:0/4070084797 >> v2:172.21.15.142:3300/0 conn(0x7fe9700cac10 0x7fe97015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe976202640 1 --2- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe97015a680 0x7fe97015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe975200640 1 -- 172.21.15.133:0/4070084797 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51492482 0 0) 0x7fe97015f100 con 0x7fe97015afa0 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe975200640 1 -- 172.21.15.133:0/4070084797 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe95c003530 con 0x7fe97015afa0 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe975a01640 1 -- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe97015a680 msgr2=0x7fe97015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe975a01640 1 --2- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe97015a680 0x7fe97015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe975200640 1 -- 172.21.15.133:0/4070084797 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902279590 0 0) 0x7fe95c003530 con 0x7fe97015afa0 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe975a01640 1 -- 172.21.15.133:0/4070084797 >> v1:172.21.15.133:6789/0 conn(0x7fe97015afa0 legacy=0x7fe97006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe975a01640 1 -- 172.21.15.133:0/4070084797 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97015eb40 con 0x7fe9700cac10 2023-12-18T10:19:12.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.681+0000 7fe976202640 1 --2- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe97015a680 0x7fe97015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.685+0000 7fe975a01640 1 --2- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9700cac10 0x7fe97015aa60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9600097c0 tx=0x7fe96001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1fa39b4fe09e46 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.685+0000 7fe975200640 1 -- 172.21.15.133:0/4070084797 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968001a00 con 0x7fe9700cac10 2023-12-18T10:19:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.685+0000 7fe975200640 1 -- 172.21.15.133:0/4070084797 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9600a7050 con 0x7fe9700cac10 2023-12-18T10:19:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.685+0000 7fe975200640 1 -- 172.21.15.133:0/4070084797 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600ab620 con 0x7fe9700cac10 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9700cac10 msgr2=0x7fe97015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 --2- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9700cac10 0x7fe97015aa60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9600097c0 tx=0x7fe96001c310 comp rx=0 tx=0).stop 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- 172.21.15.133:0/4070084797 shutdown_connections 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 --2- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9700cac10 0x7fe97015aa60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 --2- 172.21.15.133:0/4070084797 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe97015a680 0x7fe97015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- 172.21.15.133:0/4070084797 >> 172.21.15.133:0/4070084797 conn(0x7fe97006a3e0 msgr2=0x7fe9700afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- 172.21.15.133:0/4070084797 shutdown_connections 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- 172.21.15.133:0/4070084797 wait complete. 2023-12-18T10:19:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 Processor -- start 2023-12-18T10:19:12.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- start start 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9700cac10 0x7fe9700cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97015a680 0x7fe9700ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe97015afa0 0x7fe9700b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970164170 con 0x7fe97015afa0 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970164450 con 0x7fe97015a680 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe978466640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe970164730 con 0x7fe9700cac10 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe976a03640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe97015afa0 0x7fe9700b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe976a03640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe97015afa0 0x7fe9700b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43638/0 (socket says 172.21.15.133:43638) 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe976a03640 1 -- 172.21.15.133:0/3720854422 learned_addr learned my addr 172.21.15.133:0/3720854422 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe976202640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9700cac10 0x7fe9700cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe975a01640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97015a680 0x7fe9700ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe976a03640 1 -- 172.21.15.133:0/3720854422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9700cac10 msgr2=0x7fe9700cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe976a03640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9700cac10 0x7fe9700cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe976a03640 1 -- 172.21.15.133:0/3720854422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97015a680 msgr2=0x7fe9700ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.689+0000 7fe976a03640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97015a680 0x7fe9700ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe976a03640 1 -- 172.21.15.133:0/3720854422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c009420 con 0x7fe97015afa0 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe976a03640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe97015afa0 0x7fe9700b2e10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe96800cb90 tx=0x7fe96800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe966ffd640 1 -- 172.21.15.133:0/3720854422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800ad40 con 0x7fe97015afa0 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe966ffd640 1 -- 172.21.15.133:0/3720854422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe968012400 con 0x7fe97015afa0 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe960009420 con 0x7fe97015afa0 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe966ffd640 1 -- 172.21.15.133:0/3720854422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800aea0 con 0x7fe97015afa0 2023-12-18T10:19:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9700cdeb0 con 0x7fe97015afa0 2023-12-18T10:19:12.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9700735b0 con 0x7fe97015afa0 2023-12-18T10:19:12.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe966ffd640 1 -- 172.21.15.133:0/3720854422 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe968007070 con 0x7fe97015afa0 2023-12-18T10:19:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe966ffd640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe954065a60 0x7fe954067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe966ffd640 1 -- 172.21.15.133:0/3720854422 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe9680835a0 con 0x7fe97015afa0 2023-12-18T10:19:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.693+0000 7fe976202640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe954065a60 0x7fe954067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:12.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.697+0000 7fe976202640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe954065a60 0x7fe954067f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9700cccf0 tx=0x7fe96c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:12.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.697+0000 7fe966ffd640 1 -- 172.21.15.133:0/3720854422 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe968050c50 con 0x7fe97015afa0 2023-12-18T10:19:12.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.849+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe970164c50 con 0x7fe97015afa0 2023-12-18T10:19:12.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.849+0000 7fe966ffd640 1 -- 172.21.15.133:0/3720854422 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7fe970164c50 con 0x7fe97015afa0 2023-12-18T10:19:12.854 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:12.854 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe954065a60 msgr2=0x7fe954067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe954065a60 0x7fe954067f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe9700cccf0 tx=0x7fe96c009190 comp rx=0 tx=0).stop 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe97015afa0 msgr2=0x7fe9700b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe97015afa0 0x7fe9700b2e10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe96800cb90 tx=0x7fe96800a430 comp rx=0 tx=0).stop 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 shutdown_connections 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe954065a60 0x7fe954067f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe97015afa0 0x7fe9700b2e10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe97015a680 0x7fe9700ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 --2- 172.21.15.133:0/3720854422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9700cac10 0x7fe9700cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 >> 172.21.15.133:0/3720854422 conn(0x7fe97006a3e0 msgr2=0x7fe970159780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 shutdown_connections 2023-12-18T10:19:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:12.853+0000 7fe978466640 1 -- 172.21.15.133:0/3720854422 wait complete. 2023-12-18T10:19:12.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:19:12.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.013+0000 7f4df14a7640 1 Processor -- start 2023-12-18T10:19:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.013+0000 7f4df14a7640 1 -- start start 2023-12-18T10:19:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df14a7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0c87e0 0x7f4dec0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df14a7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4dec0afc10 0x7f4dec0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df14a7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec0b0580 con 0x7f4dec158a30 2023-12-18T10:19:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df14a7640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec0c91a0 con 0x7f4dec0afc10 2023-12-18T10:19:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df14a7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec15d5f0 con 0x7f4dec0c87e0 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4debfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4dec158a30 0x7f4dec070ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37228/0 (socket says 172.21.15.133:37228) 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4debfff640 1 -- 172.21.15.133:0/583801108 learned_addr learned my addr 172.21.15.133:0/583801108 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df0ca6640 1 --2- 172.21.15.133:0/583801108 >> v2:172.21.15.133:3300/0 conn(0x7f4dec0afc10 0x7f4dec0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4deb7fe640 1 --2- 172.21.15.133:0/583801108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0c87e0 0x7f4dec0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df0ca6640 1 -- 172.21.15.133:0/583801108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0c87e0 msgr2=0x7f4dec0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df0ca6640 1 --2- 172.21.15.133:0/583801108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0c87e0 0x7f4dec0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df0ca6640 1 -- 172.21.15.133:0/583801108 >> v1:172.21.15.133:6789/0 conn(0x7f4dec158a30 legacy=0x7f4dec070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4df0ca6640 1 -- 172.21.15.133:0/583801108 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0715d0 con 0x7f4dec0afc10 2023-12-18T10:19:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.017+0000 7f4deaffd640 1 -- 172.21.15.133:0/583801108 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303845130 0 0) 0x7f4dec0b0580 con 0x7f4dec158a30 2023-12-18T10:19:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df0ca6640 1 --2- 172.21.15.133:0/583801108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec0afc10 0x7f4dec0b0040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0717c0 tx=0x7f4de401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e651951a52eb8f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4deaffd640 1 -- 172.21.15.133:0/583801108 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40a59f0 con 0x7f4dec0afc10 2023-12-18T10:19:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4deaffd640 1 -- 172.21.15.133:0/583801108 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40a5b50 con 0x7f4dec0afc10 2023-12-18T10:19:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4deaffd640 1 -- 172.21.15.133:0/583801108 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40ad440 con 0x7f4dec0afc10 2023-12-18T10:19:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- 172.21.15.133:0/583801108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec0afc10 msgr2=0x7f4dec0b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 --2- 172.21.15.133:0/583801108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec0afc10 0x7f4dec0b0040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0717c0 tx=0x7f4de401c930 comp rx=0 tx=0).stop 2023-12-18T10:19:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- 172.21.15.133:0/583801108 shutdown_connections 2023-12-18T10:19:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 --2- 172.21.15.133:0/583801108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec0afc10 0x7f4dec0b0040 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 --2- 172.21.15.133:0/583801108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0c87e0 0x7f4dec0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- 172.21.15.133:0/583801108 >> 172.21.15.133:0/583801108 conn(0x7f4dec06a2a0 msgr2=0x7f4dec0cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- 172.21.15.133:0/583801108 shutdown_connections 2023-12-18T10:19:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- 172.21.15.133:0/583801108 wait complete. 2023-12-18T10:19:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 Processor -- start 2023-12-18T10:19:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- start start 2023-12-18T10:19:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0afc10 0x7f4dec1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dec0c87e0 0x7f4dec150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec158a30 0x7f4dec0ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec1f4020 con 0x7f4dec158a30 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec1f33a0 con 0x7f4dec0c87e0 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.021+0000 7f4df14a7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec1f3680 con 0x7f4dec0afc10 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec158a30 0x7f4dec0ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec158a30 0x7f4dec0ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43664/0 (socket says 172.21.15.133:43664) 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 -- 172.21.15.133:0/3237781490 learned_addr learned my addr 172.21.15.133:0/3237781490 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4debfff640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0afc10 0x7f4dec1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4deb7fe640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dec0c87e0 0x7f4dec150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 -- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0afc10 msgr2=0x7f4dec1f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0afc10 0x7f4dec1f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 -- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dec0c87e0 msgr2=0x7f4dec150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dec0c87e0 0x7f4dec150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 -- 172.21.15.133:0/3237781490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009a70 con 0x7f4dec158a30 2023-12-18T10:19:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4deb7fe640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dec0c87e0 0x7f4dec150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df0ca6640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec158a30 0x7f4dec0ae7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4de401a560 tx=0x7f4de40196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4de8ff9640 1 -- 172.21.15.133:0/3237781490 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40add70 con 0x7f4dec158a30 2023-12-18T10:19:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4de8ff9640 1 -- 172.21.15.133:0/3237781490 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4009450 con 0x7f4dec158a30 2023-12-18T10:19:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec1f3960 con 0x7f4dec158a30 2023-12-18T10:19:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4de8ff9640 1 -- 172.21.15.133:0/3237781490 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40b7650 con 0x7f4dec158a30 2023-12-18T10:19:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec1f64a0 con 0x7f4dec158a30 2023-12-18T10:19:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec1f4160 con 0x7f4dec158a30 2023-12-18T10:19:13.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4de8ff9640 1 -- 172.21.15.133:0/3237781490 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4de40b4050 con 0x7f4dec158a30 2023-12-18T10:19:13.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4de8ff9640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4dd8065a60 0x7f4dd8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.025+0000 7f4de8ff9640 1 -- 172.21.15.133:0/3237781490 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4de411eb90 con 0x7f4dec158a30 2023-12-18T10:19:13.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.029+0000 7f4debfff640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4dd8065a60 0x7f4dd8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.029+0000 7f4debfff640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4dd8065a60 0x7f4dd8067f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc000f70 tx=0x7f4ddc007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.029+0000 7f4de8ff9640 1 -- 172.21.15.133:0/3237781490 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4dec1f4160 con 0x7f4dec158a30 2023-12-18T10:19:13.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4dec1f4160 con 0x7f4dec158a30 2023-12-18T10:19:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4de8ff9640 1 -- 172.21.15.133:0/3237781490 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4dec1f4160 con 0x7f4dec158a30 2023-12-18T10:19:13.185 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4dd8065a60 msgr2=0x7f4dd8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4dd8065a60 0x7f4dd8067f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc000f70 tx=0x7f4ddc007c10 comp rx=0 tx=0).stop 2023-12-18T10:19:13.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec158a30 msgr2=0x7f4dec0ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec158a30 0x7f4dec0ae7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4de401a560 tx=0x7f4de40196d0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 shutdown_connections 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4dd8065a60 0x7f4dd8067f20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dec158a30 0x7f4dec0ae7a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dec0c87e0 0x7f4dec150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 --2- 172.21.15.133:0/3237781490 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dec0afc10 0x7f4dec1f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.181+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 >> 172.21.15.133:0/3237781490 conn(0x7f4dec06a2a0 msgr2=0x7f4dec149560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.185+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 shutdown_connections 2023-12-18T10:19:13.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.185+0000 7f4df14a7640 1 -- 172.21.15.133:0/3237781490 wait complete. 2023-12-18T10:19:13.206 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:19:13.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a3f25640 1 Processor -- start 2023-12-18T10:19:13.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a3f25640 1 -- start start 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a3f25640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f419c160a60 0x7f419c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a3f25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a3f25640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f419c164e60 0x7f419c0cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a3f25640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c0ced50 con 0x7f419c164e60 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a3f25640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c0cc980 con 0x7f419c160a60 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a3f25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0cc090 con 0x7f419c0ce8f0 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a24c2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f419c164e60 0x7f419c0cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a24c2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f419c164e60 0x7f419c0cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43674/0 (socket says 172.21.15.133:43674) 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a24c2640 1 -- 172.21.15.133:0/135934870 learned_addr learned my addr 172.21.15.133:0/135934870 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a14c0640 1 --2- 172.21.15.133:0/135934870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a1cc1640 1 --2- 172.21.15.133:0/135934870 >> v2:172.21.15.142:3300/0 conn(0x7f419c160a60 0x7f419c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a24c2640 1 -- 172.21.15.133:0/135934870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 msgr2=0x7f419c164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:13.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a24c2640 1 --2- 172.21.15.133:0/135934870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a24c2640 1 -- 172.21.15.133:0/135934870 >> v2:172.21.15.142:3300/0 conn(0x7f419c160a60 msgr2=0x7f419c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:13.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a24c2640 1 --2- 172.21.15.133:0/135934870 >> v2:172.21.15.142:3300/0 conn(0x7f419c160a60 0x7f419c0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a24c2640 1 -- 172.21.15.133:0/135934870 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0cc330 con 0x7f419c164e60 2023-12-18T10:19:13.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.345+0000 7f41a14c0640 1 --2- 172.21.15.133:0/135934870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a24c2640 1 --2- 172.21.15.133:0/135934870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c0cad30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f419c0b07c0 tx=0x7f419401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44028107f0c1b0ac server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a0cbf640 1 -- 172.21.15.133:0/135934870 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41940a5840 con 0x7f419c164e60 2023-12-18T10:19:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a0cbf640 1 -- 172.21.15.133:0/135934870 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41940a59a0 con 0x7f419c164e60 2023-12-18T10:19:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a0cbf640 1 -- 172.21.15.133:0/135934870 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41940a5d30 con 0x7f419c164e60 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 -- 172.21.15.133:0/135934870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 msgr2=0x7f419c0cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 --2- 172.21.15.133:0/135934870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c0cad30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f419c0b07c0 tx=0x7f419401c9a0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 -- 172.21.15.133:0/135934870 shutdown_connections 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 --2- 172.21.15.133:0/135934870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c0cad30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 --2- 172.21.15.133:0/135934870 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 --2- 172.21.15.133:0/135934870 >> v2:172.21.15.142:3300/0 conn(0x7f419c160a60 0x7f419c0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 -- 172.21.15.133:0/135934870 >> 172.21.15.133:0/135934870 conn(0x7f419c06a2a0 msgr2=0x7f419c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 -- 172.21.15.133:0/135934870 shutdown_connections 2023-12-18T10:19:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.349+0000 7f41a3f25640 1 -- 172.21.15.133:0/135934870 wait complete. 2023-12-18T10:19:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 Processor -- start 2023-12-18T10:19:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 -- start start 2023-12-18T10:19:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c160a60 0x7f419c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c15d7c0 con 0x7f419c164e60 2023-12-18T10:19:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c15daa0 con 0x7f419c160a60 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c15dd80 con 0x7f419c0ce8f0 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43682/0 (socket says 172.21.15.133:43682) 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 -- 172.21.15.133:0/779487663 learned_addr learned my addr 172.21.15.133:0/779487663 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a1cc1640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a14c0640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c160a60 0x7f419c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 -- 172.21.15.133:0/779487663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 msgr2=0x7f419c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 -- 172.21.15.133:0/779487663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c160a60 msgr2=0x7f419c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c160a60 0x7f419c157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 -- 172.21.15.133:0/779487663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194009b30 con 0x7f419c164e60 2023-12-18T10:19:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a24c2640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c157e40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f41940af040 tx=0x7f4194019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41927fc640 1 -- 172.21.15.133:0/779487663 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41940b8670 con 0x7f419c164e60 2023-12-18T10:19:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41927fc640 1 -- 172.21.15.133:0/779487663 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41940b87f0 con 0x7f419c164e60 2023-12-18T10:19:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419c15e060 con 0x7f419c164e60 2023-12-18T10:19:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41927fc640 1 -- 172.21.15.133:0/779487663 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41940b8ba0 con 0x7f419c164e60 2023-12-18T10:19:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.353+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c15e620 con 0x7f419c164e60 2023-12-18T10:19:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.357+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c15e810 con 0x7f419c164e60 2023-12-18T10:19:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.357+0000 7f41927fc640 1 -- 172.21.15.133:0/779487663 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f41940b8d00 con 0x7f419c164e60 2023-12-18T10:19:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.357+0000 7f41927fc640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4180065a60 0x7f4180067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.357+0000 7f41927fc640 1 -- 172.21.15.133:0/779487663 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f419411eb50 con 0x7f419c164e60 2023-12-18T10:19:13.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.357+0000 7f41a1cc1640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4180065a60 0x7f4180067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.357+0000 7f41a1cc1640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4180065a60 0x7f4180067f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f41980079e0 tx=0x7f4198008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.361+0000 7f41927fc640 1 -- 172.21.15.133:0/779487663 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f41940ec340 con 0x7f419c164e60 2023-12-18T10:19:13.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.509+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f419c04e000 con 0x7f419c164e60 2023-12-18T10:19:13.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.509+0000 7f41927fc640 1 -- 172.21.15.133:0/779487663 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41940ef960 con 0x7f419c164e60 2023-12-18T10:19:13.514 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4180065a60 msgr2=0x7f4180067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4180065a60 0x7f4180067f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f41980079e0 tx=0x7f4198008040 comp rx=0 tx=0).stop 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 msgr2=0x7f419c157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c157e40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f41940af040 tx=0x7f4194019740 comp rx=0 tx=0).stop 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 shutdown_connections 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4180065a60 0x7f4180067f20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f419c164e60 0x7f419c157e40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f419c160a60 0x7f419c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 --2- 172.21.15.133:0/779487663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f419c0ce8f0 0x7f419c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 >> 172.21.15.133:0/779487663 conn(0x7f419c06a2a0 msgr2=0x7f419c0c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 shutdown_connections 2023-12-18T10:19:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.513+0000 7f41a3f25640 1 -- 172.21.15.133:0/779487663 wait complete. 2023-12-18T10:19:13.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:19:13.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.673+0000 7fb8e5e11640 1 Processor -- start 2023-12-18T10:19:13.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.673+0000 7fb8e5e11640 1 -- start start 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e5e11640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8e00cf270 0x7fb8e00b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e5e11640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8e01602d0 0x7fb8e00cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e5e11640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e00d0b10 con 0x7fb8e00b3bf0 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e5e11640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00d1650 con 0x7fb8e01602d0 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e5e11640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00d0db0 con 0x7fb8e00cf270 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8dffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb8e00b3bf0 0x7fb8e015fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37232/0 (socket says 172.21.15.133:37232) 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8dffff640 1 -- 172.21.15.133:0/1625372366 learned_addr learned my addr 172.21.15.133:0/1625372366 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e4e0f640 1 --2- 172.21.15.133:0/1625372366 >> v2:172.21.15.142:3300/0 conn(0x7fb8e00cf270 0x7fb8e00b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e5610640 1 --2- 172.21.15.133:0/1625372366 >> v2:172.21.15.133:3300/0 conn(0x7fb8e01602d0 0x7fb8e00cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8df7fe640 1 -- 172.21.15.133:0/1625372366 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746158362 0 0) 0x7fb8e00d0b10 con 0x7fb8e00b3bf0 2023-12-18T10:19:13.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e4e0f640 1 -- 172.21.15.133:0/1625372366 >> v2:172.21.15.133:3300/0 conn(0x7fb8e01602d0 msgr2=0x7fb8e00cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:13.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e4e0f640 1 --2- 172.21.15.133:0/1625372366 >> v2:172.21.15.133:3300/0 conn(0x7fb8e01602d0 0x7fb8e00cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e4e0f640 1 -- 172.21.15.133:0/1625372366 >> v1:172.21.15.133:6789/0 conn(0x7fb8e00b3bf0 legacy=0x7fb8e015fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.677+0000 7fb8e4e0f640 1 -- 172.21.15.133:0/1625372366 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e00d1090 con 0x7fb8e00cf270 2023-12-18T10:19:13.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e4e0f640 1 --2- 172.21.15.133:0/1625372366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e00cf270 0x7fb8e00b1260 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb8e008a4a0 tx=0x7fb8d401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc2e62a0a21ce36 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8df7fe640 1 -- 172.21.15.133:0/1625372366 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40a7070 con 0x7fb8e00cf270 2023-12-18T10:19:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8df7fe640 1 -- 172.21.15.133:0/1625372366 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e00b1b50 con 0x7fb8e00cf270 2023-12-18T10:19:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8df7fe640 1 -- 172.21.15.133:0/1625372366 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40ab650 con 0x7fb8e00cf270 2023-12-18T10:19:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1625372366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e00cf270 msgr2=0x7fb8e00b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1625372366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e00cf270 0x7fb8e00b1260 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb8e008a4a0 tx=0x7fb8d401c410 comp rx=0 tx=0).stop 2023-12-18T10:19:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1625372366 shutdown_connections 2023-12-18T10:19:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1625372366 >> v2:172.21.15.133:3300/0 conn(0x7fb8e01602d0 0x7fb8e00cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1625372366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e00cf270 0x7fb8e00b1260 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1625372366 >> 172.21.15.133:0/1625372366 conn(0x7fb8e009b930 msgr2=0x7fb8e00d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1625372366 shutdown_connections 2023-12-18T10:19:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1625372366 wait complete. 2023-12-18T10:19:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 Processor -- start 2023-12-18T10:19:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.681+0000 7fb8e5e11640 1 -- start start 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e00b3bf0 0x7fb8e00c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8e00cf270 0x7fb8e015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e01602d0 0x7fb8e00cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0157860 con 0x7fb8e00cf270 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0157330 con 0x7fb8e01602d0 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0155f60 con 0x7fb8e00b3bf0 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8e00cf270 0x7fb8e015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8e00cf270 0x7fb8e015dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43710/0 (socket says 172.21.15.133:43710) 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 -- 172.21.15.133:0/1591628724 learned_addr learned my addr 172.21.15.133:0/1591628724 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e4e0f640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e00b3bf0 0x7fb8e00c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5610640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e01602d0 0x7fb8e00cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 -- 172.21.15.133:0/1591628724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e00b3bf0 msgr2=0x7fb8e00c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e00b3bf0 0x7fb8e00c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 -- 172.21.15.133:0/1591628724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e01602d0 msgr2=0x7fb8e00cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e01602d0 0x7fb8e00cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 -- 172.21.15.133:0/1591628724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d40093b0 con 0x7fb8e00cf270 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dffff640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8e00cf270 0x7fb8e015dd10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0011f0 tx=0x7fb8cc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dd7fa640 1 -- 172.21.15.133:0/1591628724 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc0074e0 con 0x7fb8e00cf270 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dd7fa640 1 -- 172.21.15.133:0/1591628724 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc007640 con 0x7fb8e00cf270 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e0157580 con 0x7fb8e00cf270 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dd7fa640 1 -- 172.21.15.133:0/1591628724 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc004a10 con 0x7fb8e00cf270 2023-12-18T10:19:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e0158040 con 0x7fb8e00cf270 2023-12-18T10:19:13.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e0157bc0 con 0x7fb8e00cf270 2023-12-18T10:19:13.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.685+0000 7fb8dd7fa640 1 -- 172.21.15.133:0/1591628724 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8cc004b70 con 0x7fb8e00cf270 2023-12-18T10:19:13.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.689+0000 7fb8dd7fa640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb8c4065a60 0x7fb8c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:13.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.689+0000 7fb8dd7fa640 1 -- 172.21.15.133:0/1591628724 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb8cc082b10 con 0x7fb8e00cf270 2023-12-18T10:19:13.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.689+0000 7fb8e4e0f640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb8c4065a60 0x7fb8c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:13.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.689+0000 7fb8e4e0f640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb8c4065a60 0x7fb8c4067f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40af000 tx=0x7fb8d40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:13.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.689+0000 7fb8dd7fa640 1 -- 172.21.15.133:0/1591628724 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb8e0157bc0 con 0x7fb8e00cf270 2023-12-18T10:19:13.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.841+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8e0157bc0 con 0x7fb8e00cf270 2023-12-18T10:19:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8dd7fa640 1 -- 172.21.15.133:0/1591628724 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8e0157bc0 con 0x7fb8e00cf270 2023-12-18T10:19:13.847 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb8c4065a60 msgr2=0x7fb8c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb8c4065a60 0x7fb8c4067f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40af000 tx=0x7fb8d40a7000 comp rx=0 tx=0).stop 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8e00cf270 msgr2=0x7fb8e015dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8e00cf270 0x7fb8e015dd10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0011f0 tx=0x7fb8cc00c9b0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 shutdown_connections 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb8c4065a60 0x7fb8c4067f20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8e01602d0 0x7fb8e00cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8e00cf270 0x7fb8e015dd10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 --2- 172.21.15.133:0/1591628724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8e00b3bf0 0x7fb8e00c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 >> 172.21.15.133:0/1591628724 conn(0x7fb8e009b930 msgr2=0x7fb8e015f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 shutdown_connections 2023-12-18T10:19:13.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:13.845+0000 7fb8e5e11640 1 -- 172.21.15.133:0/1591628724 wait complete. 2023-12-18T10:19:13.868 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:19:14.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7160f39640 1 Processor -- start 2023-12-18T10:19:14.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7160f39640 1 -- start start 2023-12-18T10:19:14.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7160f39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f715c15cae0 0x7f715c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7160f39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7160f39640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715c15cec0 con 0x7f715c0cf170 2023-12-18T10:19:14.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7160f39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0d0530 con 0x7f715c15cae0 2023-12-18T10:19:14.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7160f39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0d0810 con 0x7f715c0cde90 2023-12-18T10:19:14.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f715ad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f715c0cf170 0x7f715c06add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37244/0 (socket says 172.21.15.133:37244) 2023-12-18T10:19:14.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f715ad9d640 1 -- 172.21.15.133:0/856049371 learned_addr learned my addr 172.21.15.133:0/856049371 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:14.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7151d9b640 1 --2- 172.21.15.133:0/856049371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f715a59c640 1 --2- 172.21.15.133:0/856049371 >> v2:172.21.15.142:3300/0 conn(0x7f715c15cae0 0x7f715c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7159d9b640 1 -- 172.21.15.133:0/856049371 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080854822 0 0) 0x7f715c15cec0 con 0x7f715c0cf170 2023-12-18T10:19:14.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7159d9b640 1 -- 172.21.15.133:0/856049371 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7148003530 con 0x7f715c0cf170 2023-12-18T10:19:14.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7151d9b640 1 -- 172.21.15.133:0/856049371 >> v2:172.21.15.142:3300/0 conn(0x7f715c15cae0 msgr2=0x7f715c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:14.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7151d9b640 1 --2- 172.21.15.133:0/856049371 >> v2:172.21.15.142:3300/0 conn(0x7f715c15cae0 0x7f715c0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7159d9b640 1 -- 172.21.15.133:0/856049371 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110671185 0 0) 0x7f7148003530 con 0x7f715c0cf170 2023-12-18T10:19:14.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7151d9b640 1 -- 172.21.15.133:0/856049371 >> v1:172.21.15.133:6789/0 conn(0x7f715c0cf170 legacy=0x7f715c06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.005+0000 7f7151d9b640 1 -- 172.21.15.133:0/856049371 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c0d0af0 con 0x7f715c0cde90 2023-12-18T10:19:14.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7151d9b640 1 --2- 172.21.15.133:0/856049371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c0ce2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7144009d90 tx=0x7f714401d2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3740f9a2b8874e18 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7159d9b640 1 -- 172.21.15.133:0/856049371 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154001680 con 0x7f715c0cde90 2023-12-18T10:19:14.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7159d9b640 1 -- 172.21.15.133:0/856049371 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71440a5660 con 0x7f715c0cde90 2023-12-18T10:19:14.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7159d9b640 1 -- 172.21.15.133:0/856049371 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440a59f0 con 0x7f715c0cde90 2023-12-18T10:19:14.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7160f39640 1 -- 172.21.15.133:0/856049371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 msgr2=0x7f715c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7160f39640 1 --2- 172.21.15.133:0/856049371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c0ce2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7144009d90 tx=0x7f714401d2a0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7160f39640 1 -- 172.21.15.133:0/856049371 shutdown_connections 2023-12-18T10:19:14.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7160f39640 1 --2- 172.21.15.133:0/856049371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c0ce2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7160f39640 1 --2- 172.21.15.133:0/856049371 >> v2:172.21.15.142:3300/0 conn(0x7f715c15cae0 0x7f715c0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7160f39640 1 -- 172.21.15.133:0/856049371 >> 172.21.15.133:0/856049371 conn(0x7f715c089fb0 msgr2=0x7f715c0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:14.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7160f39640 1 -- 172.21.15.133:0/856049371 shutdown_connections 2023-12-18T10:19:14.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.009+0000 7f7160f39640 1 -- 172.21.15.133:0/856049371 wait complete. 2023-12-18T10:19:14.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 Processor -- start 2023-12-18T10:19:14.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 -- start start 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0cf170 0x7f715c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f715c15cae0 0x7f715c0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c15dfb0 con 0x7f715c0cf170 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c15d3a0 con 0x7f715c15cae0 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c15d680 con 0x7f715c0cde90 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0cf170 0x7f715c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0cf170 0x7f715c15e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43712/0 (socket says 172.21.15.133:43712) 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 -- 172.21.15.133:0/2648399920 learned_addr learned my addr 172.21.15.133:0/2648399920 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f715a59c640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f715ad9d640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f715c15cae0 0x7f715c0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 -- 172.21.15.133:0/2648399920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 msgr2=0x7f715c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 -- 172.21.15.133:0/2648399920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f715c15cae0 msgr2=0x7f715c0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f715c15cae0 0x7f715c0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 -- 172.21.15.133:0/2648399920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7144009a70 con 0x7f715c0cf170 2023-12-18T10:19:14.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7151d9b640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0cf170 0x7f715c15e7f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f714401aef0 tx=0x7f71440195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f71537fe640 1 -- 172.21.15.133:0/2648399920 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440ad850 con 0x7f715c0cf170 2023-12-18T10:19:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f71537fe640 1 -- 172.21.15.133:0/2648399920 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71440ad9d0 con 0x7f715c0cf170 2023-12-18T10:19:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.013+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c15d960 con 0x7f715c0cf170 2023-12-18T10:19:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.017+0000 7f71537fe640 1 -- 172.21.15.133:0/2648399920 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440add80 con 0x7f715c0cf170 2023-12-18T10:19:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.017+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c15ed30 con 0x7f715c0cf170 2023-12-18T10:19:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.017+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c15ef20 con 0x7f715c0cf170 2023-12-18T10:19:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.017+0000 7f71537fe640 1 -- 172.21.15.133:0/2648399920 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f71440b4040 con 0x7f715c0cf170 2023-12-18T10:19:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.017+0000 7f71537fe640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f713c065a90 0x7f713c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.017+0000 7f71537fe640 1 -- 172.21.15.133:0/2648399920 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f714411df70 con 0x7f715c0cf170 2023-12-18T10:19:14.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.017+0000 7f715a59c640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f713c065a90 0x7f713c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.021+0000 7f715a59c640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f713c065a90 0x7f713c067f50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f715c0c8ef0 tx=0x7f714c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.021+0000 7f71537fe640 1 -- 172.21.15.133:0/2648399920 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f71440eb680 con 0x7f715c0cf170 2023-12-18T10:19:14.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f715c04e000 con 0x7f715c0cf170 2023-12-18T10:19:14.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f71537fe640 1 -- 172.21.15.133:0/2648399920 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7144009450 con 0x7f715c0cf170 2023-12-18T10:19:14.176 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:14.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f713c065a90 msgr2=0x7f713c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f713c065a90 0x7f713c067f50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f715c0c8ef0 tx=0x7f714c008040 comp rx=0 tx=0).stop 2023-12-18T10:19:14.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0cf170 msgr2=0x7f715c15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0cf170 0x7f715c15e7f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f714401aef0 tx=0x7f71440195e0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 shutdown_connections 2023-12-18T10:19:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f713c065a90 0x7f713c067f50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f715c15cae0 0x7f715c0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0cf170 0x7f715c15e7f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 --2- 172.21.15.133:0/2648399920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f715c0cde90 0x7f715c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 >> 172.21.15.133:0/2648399920 conn(0x7f715c089fb0 msgr2=0x7f715c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 shutdown_connections 2023-12-18T10:19:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.173+0000 7f7160f39640 1 -- 172.21.15.133:0/2648399920 wait complete. 2023-12-18T10:19:14.197 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:19:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdf676d640 1 Processor -- start 2023-12-18T10:19:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdf676d640 1 -- start start 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdf676d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbdf006c4f0 0x7fbdf00c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdf676d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00c9460 con 0x7fbdf00c9e30 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdf676d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf01574a0 con 0x7fbdf01570c0 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdf676d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00c8b30 con 0x7fbdf006c4f0 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdef7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbdf006c4f0 0x7fbdf00c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdf4d0a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbdf00c9e30 0x7fbdf0070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37254/0 (socket says 172.21.15.133:37254) 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdf4d0a640 1 -- 172.21.15.133:0/4056908451 learned_addr learned my addr 172.21.15.133:0/4056908451 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdef7fe640 1 -- 172.21.15.133:0/4056908451 >> v1:172.21.15.142:6789/0 conn(0x7fbdf01570c0 legacy=0x7fbdf006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdef7fe640 1 -- 172.21.15.133:0/4056908451 >> v1:172.21.15.133:6789/0 conn(0x7fbdf00c9e30 legacy=0x7fbdf0070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdef7fe640 1 -- 172.21.15.133:0/4056908451 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00c8e10 con 0x7fbdf006c4f0 2023-12-18T10:19:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.333+0000 7fbdeeffd640 1 -- 172.21.15.133:0/4056908451 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128389961 0 0) 0x7fbdf00c9460 con 0x7fbdf00c9e30 2023-12-18T10:19:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdef7fe640 1 --2- 172.21.15.133:0/4056908451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf006c4f0 0x7fbdf00c98f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbde40097c0 tx=0x7fbde401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5c77c25805f62d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdeeffd640 1 -- 172.21.15.133:0/4056908451 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40ab600 con 0x7fbdf006c4f0 2023-12-18T10:19:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdeeffd640 1 -- 172.21.15.133:0/4056908451 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde40a7050 con 0x7fbdf006c4f0 2023-12-18T10:19:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdeeffd640 1 -- 172.21.15.133:0/4056908451 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40ab980 con 0x7fbdf006c4f0 2023-12-18T10:19:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdf676d640 1 -- 172.21.15.133:0/4056908451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf006c4f0 msgr2=0x7fbdf00c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdf676d640 1 --2- 172.21.15.133:0/4056908451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf006c4f0 0x7fbdf00c98f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbde40097c0 tx=0x7fbde401c380 comp rx=0 tx=0).stop 2023-12-18T10:19:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdf676d640 1 -- 172.21.15.133:0/4056908451 shutdown_connections 2023-12-18T10:19:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdf676d640 1 --2- 172.21.15.133:0/4056908451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf006c4f0 0x7fbdf00c98f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdf676d640 1 -- 172.21.15.133:0/4056908451 >> 172.21.15.133:0/4056908451 conn(0x7fbdf006a3e0 msgr2=0x7fbdf00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdf676d640 1 -- 172.21.15.133:0/4056908451 shutdown_connections 2023-12-18T10:19:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.337+0000 7fbdf676d640 1 -- 172.21.15.133:0/4056908451 wait complete. 2023-12-18T10:19:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 Processor -- start 2023-12-18T10:19:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 -- start start 2023-12-18T10:19:14.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdf006c4f0 0x7fbdf00c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf00c9e30 0x7fbdf0149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf01570c0 0x7fbdf00c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c65f0 con 0x7fbdf01570c0 2023-12-18T10:19:14.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c2a60 con 0x7fbdf00c9e30 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c2d40 con 0x7fbdf006c4f0 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf01570c0 0x7fbdf00c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf01570c0 0x7fbdf00c3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43730/0 (socket says 172.21.15.133:43730) 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 -- 172.21.15.133:0/2175214260 learned_addr learned my addr 172.21.15.133:0/2175214260 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdeffff640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdf006c4f0 0x7fbdf00c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdef7fe640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf00c9e30 0x7fbdf0149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 -- 172.21.15.133:0/2175214260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdf006c4f0 msgr2=0x7fbdf00c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdf006c4f0 0x7fbdf00c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 -- 172.21.15.133:0/2175214260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf00c9e30 msgr2=0x7fbdf0149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf00c9e30 0x7fbdf0149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 -- 172.21.15.133:0/2175214260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4009420 con 0x7fbdf01570c0 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf4d0a640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf01570c0 0x7fbdf00c3820 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c7a0 tx=0x7fbde800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdecff9640 1 -- 172.21.15.133:0/2175214260 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800a640 con 0x7fbdf01570c0 2023-12-18T10:19:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdecff9640 1 -- 172.21.15.133:0/2175214260 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800a7a0 con 0x7fbdf01570c0 2023-12-18T10:19:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdecff9640 1 -- 172.21.15.133:0/2175214260 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800abd0 con 0x7fbdf01570c0 2023-12-18T10:19:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf00c3020 con 0x7fbdf01570c0 2023-12-18T10:19:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf0149b90 con 0x7fbdf01570c0 2023-12-18T10:19:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.341+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf00735b0 con 0x7fbdf01570c0 2023-12-18T10:19:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.345+0000 7fbdecff9640 1 -- 172.21.15.133:0/2175214260 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbde800ad30 con 0x7fbdf01570c0 2023-12-18T10:19:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.345+0000 7fbdecff9640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbddc065a60 0x7fbddc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.345+0000 7fbdecff9640 1 -- 172.21.15.133:0/2175214260 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbde8082a10 con 0x7fbdf01570c0 2023-12-18T10:19:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.345+0000 7fbdeffff640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbddc065a60 0x7fbddc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.345+0000 7fbdeffff640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbddc065a60 0x7fbddc067f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbde0007fd0 tx=0x7fbde0007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.349+0000 7fbdecff9640 1 -- 172.21.15.133:0/2175214260 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbde80500c0 con 0x7fbdf01570c0 2023-12-18T10:19:14.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbdf00c3540 con 0x7fbdf01570c0 2023-12-18T10:19:14.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdecff9640 1 -- 172.21.15.133:0/2175214260 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbdf00c3540 con 0x7fbdf01570c0 2023-12-18T10:19:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbddc065a60 msgr2=0x7fbddc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbddc065a60 0x7fbddc067f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbde0007fd0 tx=0x7fbde0007e40 comp rx=0 tx=0).stop 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf01570c0 msgr2=0x7fbdf00c3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf01570c0 0x7fbdf00c3820 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c7a0 tx=0x7fbde800cc60 comp rx=0 tx=0).stop 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 shutdown_connections 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbddc065a60 0x7fbddc067f20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdf01570c0 0x7fbdf00c3820 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf00c9e30 0x7fbdf0149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 --2- 172.21.15.133:0/2175214260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbdf006c4f0 0x7fbdf00c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 >> 172.21.15.133:0/2175214260 conn(0x7fbdf006a3e0 msgr2=0x7fbdf01576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 shutdown_connections 2023-12-18T10:19:14.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.513+0000 7fbdf676d640 1 -- 172.21.15.133:0/2175214260 wait complete. 2023-12-18T10:19:14.536 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi142.front.sepia.ceph.com... 2023-12-18T10:19:14.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:14.537 DEBUG:teuthology.orchestra.run.smithi142:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-18T10:19:14.560 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:19:14.561 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:19:14.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:14.561 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-18T10:19:14.617 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-18T10:19:14.617 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:14.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.757+0000 7f1efabcb640 1 Processor -- start 2023-12-18T10:19:14.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.757+0000 7f1efabcb640 1 -- start start 2023-12-18T10:19:14.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1efabcb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ef40cea00 0x7f1ef40cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1efabcb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1ef40cd3a0 0x7f1ef40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1efabcb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef415cb10 con 0x7f1ef415c730 2023-12-18T10:19:14.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1efabcb640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef40b65c0 con 0x7f1ef40cea00 2023-12-18T10:19:14.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1efabcb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef40cd960 con 0x7f1ef40cd3a0 2023-12-18T10:19:14.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef93c8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ef40cea00 0x7f1ef40cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef9bc9640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1ef415c730 0x7f1ef40b7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37268/0 (socket says 172.21.15.133:37268) 2023-12-18T10:19:14.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef9bc9640 1 -- 172.21.15.133:0/4269793150 learned_addr learned my addr 172.21.15.133:0/4269793150 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:14.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef93c8640 1 -- 172.21.15.133:0/4269793150 >> v2:172.21.15.142:3300/0 conn(0x7f1ef40cd3a0 msgr2=0x7f1ef40cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:14.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef93c8640 1 --2- 172.21.15.133:0/4269793150 >> v2:172.21.15.142:3300/0 conn(0x7f1ef40cd3a0 0x7f1ef40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef93c8640 1 -- 172.21.15.133:0/4269793150 >> v1:172.21.15.133:6789/0 conn(0x7f1ef415c730 legacy=0x7f1ef40b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef93c8640 1 -- 172.21.15.133:0/4269793150 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef40cdc40 con 0x7f1ef40cea00 2023-12-18T10:19:14.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef8bc7640 1 -- 172.21.15.133:0/4269793150 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320918418 0 0) 0x7f1ef415cb10 con 0x7f1ef415c730 2023-12-18T10:19:14.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.761+0000 7f1ef93c8640 1 --2- 172.21.15.133:0/4269793150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef40cea00 0x7f1ef40cef60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40cce80 tx=0x7f1ee401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7996f1e4e36be029 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1ef8bc7640 1 -- 172.21.15.133:0/4269793150 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40a8950 con 0x7f1ef40cea00 2023-12-18T10:19:14.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1ef8bc7640 1 -- 172.21.15.133:0/4269793150 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee40a8ab0 con 0x7f1ef40cea00 2023-12-18T10:19:14.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1ef8bc7640 1 -- 172.21.15.133:0/4269793150 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40a8e40 con 0x7f1ef40cea00 2023-12-18T10:19:14.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- 172.21.15.133:0/4269793150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef40cea00 msgr2=0x7f1ef40cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 --2- 172.21.15.133:0/4269793150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef40cea00 0x7f1ef40cef60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40cce80 tx=0x7f1ee401ec50 comp rx=0 tx=0).stop 2023-12-18T10:19:14.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- 172.21.15.133:0/4269793150 shutdown_connections 2023-12-18T10:19:14.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 --2- 172.21.15.133:0/4269793150 >> v2:172.21.15.142:3300/0 conn(0x7f1ef40cd3a0 0x7f1ef40cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 --2- 172.21.15.133:0/4269793150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef40cea00 0x7f1ef40cef60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- 172.21.15.133:0/4269793150 >> 172.21.15.133:0/4269793150 conn(0x7f1ef406b120 msgr2=0x7f1ef406b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:14.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- 172.21.15.133:0/4269793150 shutdown_connections 2023-12-18T10:19:14.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- 172.21.15.133:0/4269793150 wait complete. 2023-12-18T10:19:14.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 Processor -- start 2023-12-18T10:19:14.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- start start 2023-12-18T10:19:14.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef40cd3a0 0x7f1ef40c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef40cea00 0x7f1ef40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef415c730 0x7f1ef40c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef415f8a0 con 0x7f1ef415c730 2023-12-18T10:19:14.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef40c8e50 con 0x7f1ef40cea00 2023-12-18T10:19:14.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efabcb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef415ec20 con 0x7f1ef40cd3a0 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efa3ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef415c730 0x7f1ef40c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efa3ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef415c730 0x7f1ef40c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43738/0 (socket says 172.21.15.133:43738) 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.765+0000 7f1efa3ca640 1 -- 172.21.15.133:0/3221735062 learned_addr learned my addr 172.21.15.133:0/3221735062 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1ef93c8640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef40cea00 0x7f1ef40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1ef9bc9640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef40cd3a0 0x7f1ef40c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efa3ca640 1 -- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef40cd3a0 msgr2=0x7f1ef40c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efa3ca640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef40cd3a0 0x7f1ef40c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efa3ca640 1 -- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef40cea00 msgr2=0x7f1ef40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efa3ca640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef40cea00 0x7f1ef40c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efa3ca640 1 -- 172.21.15.133:0/3221735062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee4009420 con 0x7f1ef415c730 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1ef9bc9640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef40cd3a0 0x7f1ef40c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efa3ca640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef415c730 0x7f1ef40c8910 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00b970 tx=0x7f1eec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1eea7fc640 1 -- 172.21.15.133:0/3221735062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec00cb40 con 0x7f1ef415c730 2023-12-18T10:19:14.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1eea7fc640 1 -- 172.21.15.133:0/3221735062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec00ccc0 con 0x7f1ef415c730 2023-12-18T10:19:14.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1eea7fc640 1 -- 172.21.15.133:0/3221735062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec014680 con 0x7f1ef415c730 2023-12-18T10:19:14.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef415ef00 con 0x7f1ef415c730 2023-12-18T10:19:14.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef415f4c0 con 0x7f1ef415c730 2023-12-18T10:19:14.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef415f9e0 con 0x7f1ef415c730 2023-12-18T10:19:14.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1eea7fc640 1 -- 172.21.15.133:0/3221735062 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1eec01d3b0 con 0x7f1ef415c730 2023-12-18T10:19:14.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1eea7fc640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ed8065a60 0x7f1ed8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:14.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1eea7fc640 1 -- 172.21.15.133:0/3221735062 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1eec083420 con 0x7f1ef415c730 2023-12-18T10:19:14.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.769+0000 7f1ef9bc9640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ed8065a60 0x7f1ed8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:14.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.773+0000 7f1ef9bc9640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ed8065a60 0x7f1ed8067f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0007fd0 tx=0x7f1ef0007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:14.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.773+0000 7f1eea7fc640 1 -- 172.21.15.133:0/3221735062 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1eec050ac0 con 0x7f1ef415c730 2023-12-18T10:19:14.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.957+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ef4066c50 con 0x7f1ef415c730 2023-12-18T10:19:14.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.957+0000 7f1eea7fc640 1 -- 172.21.15.133:0/3221735062 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f1eec0540e0 con 0x7f1ef415c730 2023-12-18T10:19:14.961 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:14.961 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:28.930501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-18T10:19:14.961 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 9 2023-12-18T10:19:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ed8065a60 msgr2=0x7f1ed8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ed8065a60 0x7f1ed8067f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0007fd0 tx=0x7f1ef0007c20 comp rx=0 tx=0).stop 2023-12-18T10:19:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef415c730 msgr2=0x7f1ef40c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef415c730 0x7f1ef40c8910 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00b970 tx=0x7f1eec00be30 comp rx=0 tx=0).stop 2023-12-18T10:19:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 shutdown_connections 2023-12-18T10:19:14.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ed8065a60 0x7f1ed8067f20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ef415c730 0x7f1ef40c8910 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ef40cea00 0x7f1ef40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 --2- 172.21.15.133:0/3221735062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ef40cd3a0 0x7f1ef40c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:14.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 >> 172.21.15.133:0/3221735062 conn(0x7f1ef406b120 msgr2=0x7f1ef40b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:14.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 shutdown_connections 2023-12-18T10:19:14.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:14.961+0000 7f1efabcb640 1 -- 172.21.15.133:0/3221735062 wait complete. 2023-12-18T10:19:14.982 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:15.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348458f640 1 Processor -- start 2023-12-18T10:19:15.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348458f640 1 -- start start 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348458f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f347c15a680 0x7f347c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348458f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f347c0cac10 0x7f347c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348458f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348458f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347c15f100 con 0x7f347c15a680 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348458f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347c0ca7d0 con 0x7f347c0cac10 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348458f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c15e860 con 0x7f347c15afa0 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348232b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f347c15a680 0x7f347c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348232b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f347c15a680 0x7f347c15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43740/0 (socket says 172.21.15.133:43740) 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348232b640 1 -- 172.21.15.133:0/647328068 learned_addr learned my addr 172.21.15.133:0/647328068 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f3481b2a640 1 --2- 172.21.15.133:0/647328068 >> v2:172.21.15.142:3300/0 conn(0x7f347c0cac10 0x7f347c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f3482b2c640 1 --2- 172.21.15.133:0/647328068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348232b640 1 -- 172.21.15.133:0/647328068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 msgr2=0x7f347c06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348232b640 1 --2- 172.21.15.133:0/647328068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c06fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348232b640 1 -- 172.21.15.133:0/647328068 >> v2:172.21.15.142:3300/0 conn(0x7f347c0cac10 msgr2=0x7f347c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348232b640 1 --2- 172.21.15.133:0/647328068 >> v2:172.21.15.142:3300/0 conn(0x7f347c0cac10 0x7f347c15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f348232b640 1 -- 172.21.15.133:0/647328068 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c15eb40 con 0x7f347c15a680 2023-12-18T10:19:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f3482b2c640 1 --2- 172.21.15.133:0/647328068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.117+0000 7f3481b2a640 1 --2- 172.21.15.133:0/647328068 >> v2:172.21.15.142:3300/0 conn(0x7f347c0cac10 0x7f347c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348232b640 1 --2- 172.21.15.133:0/647328068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c15e160 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3478009870 tx=0x7f347801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386b032f1190b5d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f3481329640 1 -- 172.21.15.133:0/647328068 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780ab600 con 0x7f347c15a680 2023-12-18T10:19:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f3481329640 1 -- 172.21.15.133:0/647328068 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34780a7050 con 0x7f347c15a680 2023-12-18T10:19:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f3481329640 1 -- 172.21.15.133:0/647328068 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34780ab980 con 0x7f347c15a680 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 -- 172.21.15.133:0/647328068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 msgr2=0x7f347c15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 --2- 172.21.15.133:0/647328068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c15e160 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3478009870 tx=0x7f347801c470 comp rx=0 tx=0).stop 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 -- 172.21.15.133:0/647328068 shutdown_connections 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 --2- 172.21.15.133:0/647328068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 --2- 172.21.15.133:0/647328068 >> v2:172.21.15.142:3300/0 conn(0x7f347c0cac10 0x7f347c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 --2- 172.21.15.133:0/647328068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c15e160 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 -- 172.21.15.133:0/647328068 >> 172.21.15.133:0/647328068 conn(0x7f347c06a3e0 msgr2=0x7f347c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 -- 172.21.15.133:0/647328068 shutdown_connections 2023-12-18T10:19:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.121+0000 7f348458f640 1 -- 172.21.15.133:0/647328068 wait complete. 2023-12-18T10:19:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 Processor -- start 2023-12-18T10:19:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 -- start start 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c0cac10 0x7f347c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c0c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c0c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c157bd0 con 0x7f347c15a680 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0c41c0 con 0x7f347c0cac10 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0c66e0 con 0x7f347c15afa0 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c0c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c0c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43756/0 (socket says 172.21.15.133:43756) 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 -- 172.21.15.133:0/4028287923 learned_addr learned my addr 172.21.15.133:0/4028287923 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348232b640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c0cac10 0x7f347c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3482b2c640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c0c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 -- 172.21.15.133:0/4028287923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 msgr2=0x7f347c0c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c0c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 -- 172.21.15.133:0/4028287923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c0cac10 msgr2=0x7f347c155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c0cac10 0x7f347c155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 -- 172.21.15.133:0/4028287923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34780094d0 con 0x7f347c15a680 2023-12-18T10:19:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3481b2a640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c0c3600 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f346c00e810 tx=0x7f346c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3472ffd640 1 -- 172.21.15.133:0/4028287923 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c00c8d0 con 0x7f347c15a680 2023-12-18T10:19:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3472ffd640 1 -- 172.21.15.133:0/4028287923 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c00ca30 con 0x7f347c15a680 2023-12-18T10:19:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f3472ffd640 1 -- 172.21.15.133:0/4028287923 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c00cde0 con 0x7f347c15a680 2023-12-18T10:19:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347c0c69c0 con 0x7f347c15a680 2023-12-18T10:19:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.125+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c0c44a0 con 0x7f347c15a680 2023-12-18T10:19:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.129+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c0735b0 con 0x7f347c15a680 2023-12-18T10:19:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.129+0000 7f3472ffd640 1 -- 172.21.15.133:0/4028287923 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f346c013410 con 0x7f347c15a680 2023-12-18T10:19:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.129+0000 7f3472ffd640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3460065a60 0x7f3460067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.129+0000 7f3472ffd640 1 -- 172.21.15.133:0/4028287923 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f346c083260 con 0x7f347c15a680 2023-12-18T10:19:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.129+0000 7f348232b640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3460065a60 0x7f3460067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.129+0000 7f348232b640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3460065a60 0x7f3460067f20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f347c06ce40 tx=0x7f34780a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.133+0000 7f3472ffd640 1 -- 172.21.15.133:0/4028287923 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f346c0509a0 con 0x7f347c15a680 2023-12-18T10:19:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f347c04e000 con 0x7f347c15a680 2023-12-18T10:19:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f3472ffd640 1 -- 172.21.15.133:0/4028287923 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f346c053fc0 con 0x7f347c15a680 2023-12-18T10:19:15.293 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:15.293 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:15.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3460065a60 msgr2=0x7f3460067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3460065a60 0x7f3460067f20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f347c06ce40 tx=0x7f34780a6000 comp rx=0 tx=0).stop 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 msgr2=0x7f347c0c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c0c3600 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f346c00e810 tx=0x7f346c00ecd0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 shutdown_connections 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3460065a60 0x7f3460067f20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f347c15afa0 0x7f347c0c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f347c15a680 0x7f347c0c3600 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 --2- 172.21.15.133:0/4028287923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347c0cac10 0x7f347c155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.289+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 >> 172.21.15.133:0/4028287923 conn(0x7f347c06a3e0 msgr2=0x7f347c06c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.293+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 shutdown_connections 2023-12-18T10:19:15.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.293+0000 7f348458f640 1 -- 172.21.15.133:0/4028287923 wait complete. 2023-12-18T10:19:15.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:18:03.308063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:18:04.599689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-18T10:18:07.671885+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-18T10:19:15.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.453+0000 7f7f8359e640 1 Processor -- start 2023-12-18T10:19:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.453+0000 7f7f8359e640 1 -- start start 2023-12-18T10:19:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f8359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 0x7f7f8415e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f8359e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f8406ca30 0x7f7f8406bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f8359e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f84160620 con 0x7f7f840ce3b0 2023-12-18T10:19:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f8359e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8406c190 con 0x7f7f8406ca30 2023-12-18T10:19:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f8359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84160870 con 0x7f7f840cdfd0 2023-12-18T10:19:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f79d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f8406ca30 0x7f7f8406bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f79d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f8406ca30 0x7f7f8406bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:35918/0 (socket says 172.21.15.133:35918) 2023-12-18T10:19:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f79d9b640 1 -- 172.21.15.133:0/1034470688 learned_addr learned my addr 172.21.15.133:0/1034470688 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f8259c640 1 --2- 172.21.15.133:0/1034470688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 0x7f7f8415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f82d9d640 1 --1- 172.21.15.133:0/1034470688 >> v1:172.21.15.142:6789/0 conn(0x7f7f840ce3b0 0x7f7f840d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:58188/0 (socket says 172.21.15.133:58188) 2023-12-18T10:19:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f79d9b640 1 -- 172.21.15.133:0/1034470688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 msgr2=0x7f7f8415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f79d9b640 1 --2- 172.21.15.133:0/1034470688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 0x7f7f8415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f79d9b640 1 -- 172.21.15.133:0/1034470688 >> v1:172.21.15.142:6789/0 conn(0x7f7f840ce3b0 legacy=0x7f7f840d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.457+0000 7f7f79d9b640 1 -- 172.21.15.133:0/1034470688 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f84160b50 con 0x7f7f8406ca30 2023-12-18T10:19:15.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f79d9b640 1 --2- 172.21.15.133:0/1034470688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 0x7f7f8406bc50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009870 tx=0x7f7f6c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8ba9c7f64094608 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f81d9b640 1 -- 172.21.15.133:0/1034470688 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0ab650 con 0x7f7f8406ca30 2023-12-18T10:19:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f81d9b640 1 -- 172.21.15.133:0/1034470688 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c0ab7b0 con 0x7f7f8406ca30 2023-12-18T10:19:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f81d9b640 1 -- 172.21.15.133:0/1034470688 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0abb40 con 0x7f7f8406ca30 2023-12-18T10:19:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 -- 172.21.15.133:0/1034470688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 msgr2=0x7f7f8406bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 --2- 172.21.15.133:0/1034470688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 0x7f7f8406bc50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009870 tx=0x7f7f6c01c540 comp rx=0 tx=0).stop 2023-12-18T10:19:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 -- 172.21.15.133:0/1034470688 shutdown_connections 2023-12-18T10:19:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 --2- 172.21.15.133:0/1034470688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 0x7f7f8406bc50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 --2- 172.21.15.133:0/1034470688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 0x7f7f8415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 -- 172.21.15.133:0/1034470688 >> 172.21.15.133:0/1034470688 conn(0x7f7f84069ca0 msgr2=0x7f7f8406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 -- 172.21.15.133:0/1034470688 shutdown_connections 2023-12-18T10:19:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 -- 172.21.15.133:0/1034470688 wait complete. 2023-12-18T10:19:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 Processor -- start 2023-12-18T10:19:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 -- start start 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.461+0000 7f7f8359e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 0x7f7f8415d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8359e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 0x7f7f841f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f840ce3b0 0x7f7f84154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8359e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84154790 con 0x7f7f840ce3b0 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8359e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f841f5bd0 con 0x7f7f8406ca30 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8359e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f841f55a0 con 0x7f7f840cdfd0 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f840ce3b0 0x7f7f84154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 0x7f7f8415d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f840ce3b0 0x7f7f84154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43762/0 (socket says 172.21.15.133:43762) 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 -- 172.21.15.133:0/2616323227 learned_addr learned my addr 172.21.15.133:0/2616323227 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f79d9b640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 0x7f7f841f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 -- 172.21.15.133:0/2616323227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 msgr2=0x7f7f841f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 0x7f7f841f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 -- 172.21.15.133:0/2616323227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 msgr2=0x7f7f8415d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 0x7f7f8415d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 -- 172.21.15.133:0/2616323227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0094d0 con 0x7f7f840ce3b0 2023-12-18T10:19:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f82d9d640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f840ce3b0 0x7f7f84154250 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c410 tx=0x7f7f7c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f7b7fe640 1 -- 172.21.15.133:0/2616323227 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0074e0 con 0x7f7f840ce3b0 2023-12-18T10:19:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f7b7fe640 1 -- 172.21.15.133:0/2616323227 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c007640 con 0x7f7f840ce3b0 2023-12-18T10:19:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f7b7fe640 1 -- 172.21.15.133:0/2616323227 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c004a10 con 0x7f7f840ce3b0 2023-12-18T10:19:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f840c6440 con 0x7f7f840ce3b0 2023-12-18T10:19:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f841f5860 con 0x7f7f840ce3b0 2023-12-18T10:19:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f841f5d40 con 0x7f7f840ce3b0 2023-12-18T10:19:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.465+0000 7f7f7b7fe640 1 -- 172.21.15.133:0/2616323227 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f7c004b70 con 0x7f7f840ce3b0 2023-12-18T10:19:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.469+0000 7f7f7b7fe640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f64065a60 0x7f7f64067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.469+0000 7f7f7b7fe640 1 -- 172.21.15.133:0/2616323227 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7f7c082e50 con 0x7f7f840ce3b0 2023-12-18T10:19:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.469+0000 7f7f8259c640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f64065a60 0x7f7f64067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.469+0000 7f7f8259c640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f64065a60 0x7f7f64067f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f740113e0 tx=0x7f7f7400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.473+0000 7f7f7b7fe640 1 -- 172.21.15.133:0/2616323227 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7f7c0504f0 con 0x7f7f840ce3b0 2023-12-18T10:19:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.617+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f8404e850 con 0x7f7f840ce3b0 2023-12-18T10:19:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f7b7fe640 1 -- 172.21.15.133:0/2616323227 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f7c053b10 con 0x7f7f840ce3b0 2023-12-18T10:19:15.623 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f64065a60 msgr2=0x7f7f64067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f64065a60 0x7f7f64067f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f740113e0 tx=0x7f7f7400b040 comp rx=0 tx=0).stop 2023-12-18T10:19:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f840ce3b0 msgr2=0x7f7f84154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f840ce3b0 0x7f7f84154250 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00c410 tx=0x7f7f7c00c8d0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 shutdown_connections 2023-12-18T10:19:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f64065a60 0x7f7f64067f20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f840ce3b0 0x7f7f84154250 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f840cdfd0 0x7f7f841f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 --2- 172.21.15.133:0/2616323227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f8406ca30 0x7f7f8415d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 >> 172.21.15.133:0/2616323227 conn(0x7f7f84069ca0 msgr2=0x7f7f840afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 shutdown_connections 2023-12-18T10:19:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.621+0000 7f7f8359e640 1 -- 172.21.15.133:0/2616323227 wait complete. 2023-12-18T10:19:15.644 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:19:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facee2f9640 1 Processor -- start 2023-12-18T10:19:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facee2f9640 1 -- start start 2023-12-18T10:19:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facee2f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facee2f9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7face80ce3b0 0x7face80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facee2f9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face80c9390 con 0x7face8070820 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facee2f9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80ced80 con 0x7face80ce3b0 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facee2f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face815aee0 con 0x7face81582d0 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facec896640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7face80ce3b0 0x7face80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facec896640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7face80ce3b0 0x7face80ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43772/0 (socket says 172.21.15.133:43772) 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.781+0000 7facec896640 1 -- 172.21.15.133:0/1518932309 learned_addr learned my addr 172.21.15.133:0/1518932309 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7face7fff640 1 --2- 172.21.15.133:0/1518932309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7facec896640 1 -- 172.21.15.133:0/1518932309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 msgr2=0x7face80c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7facec896640 1 --2- 172.21.15.133:0/1518932309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face80c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7facec896640 1 -- 172.21.15.133:0/1518932309 >> v1:172.21.15.142:6789/0 conn(0x7face8070820 legacy=0x7face80ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7facec896640 1 -- 172.21.15.133:0/1518932309 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face815b1c0 con 0x7face80ce3b0 2023-12-18T10:19:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7face7fff640 1 --2- 172.21.15.133:0/1518932309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face80c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7facec896640 1 --2- 172.21.15.133:0/1518932309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face80ce3b0 0x7face80ce840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7face0009e50 tx=0x7face001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae99878988bf4a88 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7face6ffd640 1 -- 172.21.15.133:0/1518932309 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face00a58a0 con 0x7face80ce3b0 2023-12-18T10:19:15.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7face6ffd640 1 -- 172.21.15.133:0/1518932309 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face00a5a00 con 0x7face80ce3b0 2023-12-18T10:19:15.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7face6ffd640 1 -- 172.21.15.133:0/1518932309 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face00a5d90 con 0x7face80ce3b0 2023-12-18T10:19:15.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7facee2f9640 1 -- 172.21.15.133:0/1518932309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face80ce3b0 msgr2=0x7face80ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.785+0000 7facee2f9640 1 --2- 172.21.15.133:0/1518932309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face80ce3b0 0x7face80ce840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7face0009e50 tx=0x7face001c9e0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 -- 172.21.15.133:0/1518932309 shutdown_connections 2023-12-18T10:19:15.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 --2- 172.21.15.133:0/1518932309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face80ce3b0 0x7face80ce840 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 --2- 172.21.15.133:0/1518932309 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face80c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 -- 172.21.15.133:0/1518932309 >> 172.21.15.133:0/1518932309 conn(0x7face806a2a0 msgr2=0x7face80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:15.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 -- 172.21.15.133:0/1518932309 shutdown_connections 2023-12-18T10:19:15.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 -- 172.21.15.133:0/1518932309 wait complete. 2023-12-18T10:19:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 Processor -- start 2023-12-18T10:19:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 -- start start 2023-12-18T10:19:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face8070820 0x7face80c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7face80ce3b0 0x7face8151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80cd8a0 con 0x7face8070820 2023-12-18T10:19:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80ccc90 con 0x7face80ce3b0 2023-12-18T10:19:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facee2f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80ccf70 con 0x7face81582d0 2023-12-18T10:19:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face8070820 0x7face80c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face8070820 0x7face80c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43782/0 (socket says 172.21.15.133:43782) 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 -- 172.21.15.133:0/2578609973 learned_addr learned my addr 172.21.15.133:0/2578609973 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face77fe640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7face80ce3b0 0x7face8151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7facec896640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 -- 172.21.15.133:0/2578609973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 msgr2=0x7face8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face8151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 -- 172.21.15.133:0/2578609973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7face80ce3b0 msgr2=0x7face8151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7face80ce3b0 0x7face8151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 -- 172.21.15.133:0/2578609973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0009b30 con 0x7face8070820 2023-12-18T10:19:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.789+0000 7face7fff640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face8070820 0x7face80c2a30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7facd800d800 tx=0x7facd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7face4ff9640 1 -- 172.21.15.133:0/2578609973 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd800b6c0 con 0x7face8070820 2023-12-18T10:19:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7face4ff9640 1 -- 172.21.15.133:0/2578609973 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd800b820 con 0x7face8070820 2023-12-18T10:19:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face80cd250 con 0x7face8070820 2023-12-18T10:19:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7face4ff9640 1 -- 172.21.15.133:0/2578609973 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd800bbd0 con 0x7face8070820 2023-12-18T10:19:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face80cdd30 con 0x7face8070820 2023-12-18T10:19:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face804e000 con 0x7face8070820 2023-12-18T10:19:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7face4ff9640 1 -- 172.21.15.133:0/2578609973 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7facd800bd30 con 0x7face8070820 2023-12-18T10:19:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7face4ff9640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7facd4065a60 0x7facd4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7face4ff9640 1 -- 172.21.15.133:0/2578609973 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7facd8083ad0 con 0x7face8070820 2023-12-18T10:19:15.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.793+0000 7face77fe640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7facd4065a60 0x7facd4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:15.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.797+0000 7face77fe640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7facd4065a60 0x7facd4067f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7face80c4260 tx=0x7facdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:15.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.797+0000 7face4ff9640 1 -- 172.21.15.133:0/2578609973 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7facd8051030 con 0x7face8070820 2023-12-18T10:19:15.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7face80b0c00 con 0x7face8070820 2023-12-18T10:19:15.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7face4ff9640 1 -- 172.21.15.133:0/2578609973 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7facd8054650 con 0x7face8070820 2023-12-18T10:19:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:15.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7facd4065a60 msgr2=0x7facd4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7facd4065a60 0x7facd4067f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7face80c4260 tx=0x7facdc009040 comp rx=0 tx=0).stop 2023-12-18T10:19:15.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face8070820 msgr2=0x7face80c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:15.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face8070820 0x7face80c2a30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7facd800d800 tx=0x7facd800dcc0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 shutdown_connections 2023-12-18T10:19:15.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7facd4065a60 0x7facd4067f20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7face81582d0 0x7face8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7face80ce3b0 0x7face8151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 --2- 172.21.15.133:0/2578609973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7face8070820 0x7face80c2a30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:15.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 >> 172.21.15.133:0/2578609973 conn(0x7face806a2a0 msgr2=0x7face80aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:15.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 shutdown_connections 2023-12-18T10:19:15.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:15.949+0000 7facee2f9640 1 -- 172.21.15.133:0/2578609973 wait complete. 2023-12-18T10:19:15.972 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:19:16.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6258e640 1 Processor -- start 2023-12-18T10:19:16.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6258e640 1 -- start start 2023-12-18T10:19:16.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6258e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 0x7f5e5c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6258e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5e5c0b3bf0 0x7f5e5c0cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6258e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c0d0b10 con 0x7f5e5c0cf270 2023-12-18T10:19:16.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6258e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c0d1650 con 0x7f5e5c0b3bf0 2023-12-18T10:19:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6258e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0d0db0 con 0x7f5e5c1602d0 2023-12-18T10:19:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6158c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5e5c0cf270 0x7f5e5c15fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37272/0 (socket says 172.21.15.133:37272) 2023-12-18T10:19:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e6158c640 1 -- 172.21.15.133:0/2432808605 learned_addr learned my addr 172.21.15.133:0/2432808605 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e60d8b640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 0x7f5e5c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e61d8d640 1 --2- 172.21.15.133:0/2432808605 >> v2:172.21.15.142:3300/0 conn(0x7f5e5c0b3bf0 0x7f5e5c0cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038157737 0 0) 0x7f5e5c0d0b10 con 0x7f5e5c0cf270 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e48003530 con 0x7f5e5c0cf270 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153762899 0 0) 0x7f5e48003530 con 0x7f5e5c0cf270 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 msgr2=0x7f5e5c0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 0x7f5e5c0b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 >> v2:172.21.15.142:3300/0 conn(0x7f5e5c0b3bf0 msgr2=0x7f5e5c0cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 --2- 172.21.15.133:0/2432808605 >> v2:172.21.15.142:3300/0 conn(0x7f5e5c0b3bf0 0x7f5e5c0cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0d1090 con 0x7f5e5c0cf270 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f5e58001800 con 0x7f5e5c0cf270 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 >> v1:172.21.15.133:6789/0 conn(0x7f5e5c0cf270 legacy=0x7f5e5c15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e48003980 0x7f5e48003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 0x7f5e48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0d1650 con 0x7f5e480047d0 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0d0db0 con 0x7f5e48003980 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.109+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4800b990 con 0x7f5e5c1602d0 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e60d8b640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e6158c640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e48003980 0x7f5e48003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e61d8d640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 0x7f5e48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e60d8b640 1 -- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 msgr2=0x7f5e48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e60d8b640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 0x7f5e48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e60d8b640 1 -- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e48003980 msgr2=0x7f5e48003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e60d8b640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e48003980 0x7f5e48003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e60d8b640 1 -- 172.21.15.133:0/2432808605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48003530 con 0x7f5e480047d0 2023-12-18T10:19:16.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e61d8d640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1602d0 0x7f5e48005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:16.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e60d8b640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e48004c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ae0 tx=0x7f5e4c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e505c6e6287a430 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0a6460 con 0x7f5e480047d0 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c0a65c0 con 0x7f5e480047d0 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.113+0000 7f5e53fff640 1 -- 172.21.15.133:0/2432808605 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0a6970 con 0x7f5e480047d0 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- 172.21.15.133:0/2432808605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 msgr2=0x7f5e48004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 --2- 172.21.15.133:0/2432808605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e48004c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009ae0 tx=0x7f5e4c01ca50 comp rx=0 tx=0).stop 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e61d8d640 1 -- 172.21.15.133:0/2432808605 reap_dead start 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- 172.21.15.133:0/2432808605 shutdown_connections 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- 172.21.15.133:0/2432808605 >> 172.21.15.133:0/2432808605 conn(0x7f5e5c09b930 msgr2=0x7f5e5c0d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- 172.21.15.133:0/2432808605 shutdown_connections 2023-12-18T10:19:16.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- 172.21.15.133:0/2432808605 wait complete. 2023-12-18T10:19:16.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 Processor -- start 2023-12-18T10:19:16.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- start start 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e5c15d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0ca120 0x7f5e5c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1e69b0 0x7f5e5c1e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c1e7380 con 0x7f5e480047d0 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0caac0 con 0x7f5e5c0ca120 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6258e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c153a80 con 0x7f5e5c1e69b0 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e5c15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e5c15d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43794/0 (socket says 172.21.15.133:43794) 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 -- 172.21.15.133:0/662850213 learned_addr learned my addr 172.21.15.133:0/662850213 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:16.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e60d8b640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0ca120 0x7f5e5c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e61d8d640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1e69b0 0x7f5e5c1e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 -- 172.21.15.133:0/662850213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1e69b0 msgr2=0x7f5e5c1e6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1e69b0 0x7f5e5c1e6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 -- 172.21.15.133:0/662850213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0ca120 msgr2=0x7f5e5c0ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0ca120 0x7f5e5c0ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 -- 172.21.15.133:0/662850213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c153cd0 con 0x7f5e480047d0 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.117+0000 7f5e6158c640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e5c15d750 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5e58007920 tx=0x7f5e580129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e51ffb640 1 -- 172.21.15.133:0/662850213 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58014810 con 0x7f5e480047d0 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e51ffb640 1 -- 172.21.15.133:0/662850213 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e58014970 con 0x7f5e480047d0 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e51ffb640 1 -- 172.21.15.133:0/662850213 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58014d20 con 0x7f5e480047d0 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c153fb0 con 0x7f5e480047d0 2023-12-18T10:19:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c154570 con 0x7f5e480047d0 2023-12-18T10:19:16.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c04e850 con 0x7f5e480047d0 2023-12-18T10:19:16.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e51ffb640 1 -- 172.21.15.133:0/662850213 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5e580153e0 con 0x7f5e480047d0 2023-12-18T10:19:16.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e51ffb640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5e40065a60 0x7f5e40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e51ffb640 1 -- 172.21.15.133:0/662850213 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e58085de0 con 0x7f5e480047d0 2023-12-18T10:19:16.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.121+0000 7f5e60d8b640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5e40065a60 0x7f5e40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.125+0000 7f5e60d8b640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5e40065a60 0x7f5e40067f20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0ad000 tx=0x7f5e4c0b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.125+0000 7f5e51ffb640 1 -- 172.21.15.133:0/662850213 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5e580533e0 con 0x7f5e480047d0 2023-12-18T10:19:16.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e5c08a080 con 0x7f5e480047d0 2023-12-18T10:19:16.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e51ffb640 1 -- 172.21.15.133:0/662850213 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e5801c0a0 con 0x7f5e480047d0 2023-12-18T10:19:16.280 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5e40065a60 msgr2=0x7f5e40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5e40065a60 0x7f5e40067f20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0ad000 tx=0x7f5e4c0b2040 comp rx=0 tx=0).stop 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 msgr2=0x7f5e5c15d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e5c15d750 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5e58007920 tx=0x7f5e580129a0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 shutdown_connections 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5e40065a60 0x7f5e40067f20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e5c1e69b0 0x7f5e5c1e6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e5c0ca120 0x7f5e5c0ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 --2- 172.21.15.133:0/662850213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e480047d0 0x7f5e5c15d750 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 >> 172.21.15.133:0/662850213 conn(0x7f5e5c09b930 msgr2=0x7f5e5c0c8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:16.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 shutdown_connections 2023-12-18T10:19:16.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.277+0000 7f5e6258e640 1 -- 172.21.15.133:0/662850213 wait complete. 2023-12-18T10:19:16.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-18T10:19:16.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a24a95640 1 Processor -- start 2023-12-18T10:19:16.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a24a95640 1 -- start start 2023-12-18T10:19:16.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a24a95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a2015cae0 0x7f1a200d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a24a95640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2015cec0 con 0x7f1a200cde90 2023-12-18T10:19:16.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a24a95640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a200d0530 con 0x7f1a200cf880 2023-12-18T10:19:16.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a24a95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200d0810 con 0x7f1a2015cae0 2023-12-18T10:19:16.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a15d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1a200cde90 0x7f1a200cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37286/0 (socket says 172.21.15.133:37286) 2023-12-18T10:19:16.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a15d9b640 1 -- 172.21.15.133:0/2619577075 learned_addr learned my addr 172.21.15.133:0/2619577075 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:16.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a1e59c640 1 --2- 172.21.15.133:0/2619577075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a2015cae0 0x7f1a200d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a1dd9b640 1 -- 172.21.15.133:0/2619577075 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578539565 0 0) 0x7f1a2015cec0 con 0x7f1a200cde90 2023-12-18T10:19:16.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a1dd9b640 1 -- 172.21.15.133:0/2619577075 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a0c003530 con 0x7f1a200cde90 2023-12-18T10:19:16.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a1dd9b640 1 -- 172.21.15.133:0/2619577075 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1065498323 0 0) 0x7f1a0c003530 con 0x7f1a200cde90 2023-12-18T10:19:16.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a1e59c640 1 -- 172.21.15.133:0/2619577075 >> v1:172.21.15.142:6789/0 conn(0x7f1a200cf880 legacy=0x7f1a2006add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a1e59c640 1 -- 172.21.15.133:0/2619577075 >> v1:172.21.15.133:6789/0 conn(0x7f1a200cde90 legacy=0x7f1a200cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.441+0000 7f1a1e59c640 1 -- 172.21.15.133:0/2619577075 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200d0af0 con 0x7f1a2015cae0 2023-12-18T10:19:16.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a1e59c640 1 --2- 172.21.15.133:0/2619577075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a2015cae0 0x7f1a200d12f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009e10 tx=0x7f1a1001c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b651361e43ca22 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a1dd9b640 1 -- 172.21.15.133:0/2619577075 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08001680 con 0x7f1a2015cae0 2023-12-18T10:19:16.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a1dd9b640 1 -- 172.21.15.133:0/2619577075 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100a5600 con 0x7f1a2015cae0 2023-12-18T10:19:16.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a1dd9b640 1 -- 172.21.15.133:0/2619577075 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100a5970 con 0x7f1a2015cae0 2023-12-18T10:19:16.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a24a95640 1 -- 172.21.15.133:0/2619577075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a2015cae0 msgr2=0x7f1a200d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a24a95640 1 --2- 172.21.15.133:0/2619577075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a2015cae0 0x7f1a200d12f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009e10 tx=0x7f1a1001c7a0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a24a95640 1 -- 172.21.15.133:0/2619577075 shutdown_connections 2023-12-18T10:19:16.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a24a95640 1 --2- 172.21.15.133:0/2619577075 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a2015cae0 0x7f1a200d12f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a24a95640 1 -- 172.21.15.133:0/2619577075 >> 172.21.15.133:0/2619577075 conn(0x7f1a20089fb0 msgr2=0x7f1a200d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:16.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a24a95640 1 -- 172.21.15.133:0/2619577075 shutdown_connections 2023-12-18T10:19:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.445+0000 7f1a24a95640 1 -- 172.21.15.133:0/2619577075 wait complete. 2023-12-18T10:19:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a24a95640 1 Processor -- start 2023-12-18T10:19:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a24a95640 1 -- start start 2023-12-18T10:19:16.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a24a95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200cde90 0x7f1a200c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a24a95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a200cf880 0x7f1a201f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a24a95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2015cae0 0x7f1a201f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a24a95640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c7f20 con 0x7f1a200cde90 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a24a95640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c72a0 con 0x7f1a2015cae0 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a24a95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c7580 con 0x7f1a200cf880 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200cde90 0x7f1a200c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200cde90 0x7f1a200c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43796/0 (socket says 172.21.15.133:43796) 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 -- 172.21.15.133:0/1080789343 learned_addr learned my addr 172.21.15.133:0/1080789343 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a15d9b640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a200cf880 0x7f1a201f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1ed9d640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2015cae0 0x7f1a201f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 -- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a200cf880 msgr2=0x7f1a201f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a200cf880 0x7f1a201f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 -- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2015cae0 msgr2=0x7f1a201f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2015cae0 0x7f1a201f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 -- 172.21.15.133:0/1080789343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10009a70 con 0x7f1a200cde90 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1ed9d640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2015cae0 0x7f1a201f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a1e59c640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200cde90 0x7f1a200c6cb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1a1001ae50 tx=0x7f1a10019540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.449+0000 7f1a177fe640 1 -- 172.21.15.133:0/1080789343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10007000 con 0x7f1a200cde90 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a177fe640 1 -- 172.21.15.133:0/1080789343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10009450 con 0x7f1a200cde90 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a177fe640 1 -- 172.21.15.133:0/1080789343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100adcc0 con 0x7f1a200cde90 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a200c7860 con 0x7f1a200cde90 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a200cbef0 con 0x7f1a200cde90 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a200c8060 con 0x7f1a200cde90 2023-12-18T10:19:16.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a177fe640 1 -- 172.21.15.133:0/1080789343 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a10006d50 con 0x7f1a200cde90 2023-12-18T10:19:16.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a177fe640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a00065a60 0x7f1a00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a177fe640 1 -- 172.21.15.133:0/1080789343 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1a1011e710 con 0x7f1a200cde90 2023-12-18T10:19:16.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a15d9b640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a00065a60 0x7f1a00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.453+0000 7f1a15d9b640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a00065a60 0x7f1a00067f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1a08001ec0 tx=0x7f1a080015e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.457+0000 7f1a177fe640 1 -- 172.21.15.133:0/1080789343 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1a100ebd00 con 0x7f1a200cde90 2023-12-18T10:19:16.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.605+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1a2004e000 con 0x7f1a200cde90 2023-12-18T10:19:16.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.605+0000 7f1a177fe640 1 -- 172.21.15.133:0/1080789343 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1a100ef320 con 0x7f1a200cde90 2023-12-18T10:19:16.610 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:19:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a00065a60 msgr2=0x7f1a00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a00065a60 0x7f1a00067f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1a08001ec0 tx=0x7f1a080015e0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200cde90 msgr2=0x7f1a200c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200cde90 0x7f1a200c6cb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1a1001ae50 tx=0x7f1a10019540 comp rx=0 tx=0).stop 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 shutdown_connections 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a00065a60 0x7f1a00067f20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2015cae0 0x7f1a201f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a200cf880 0x7f1a201f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 --2- 172.21.15.133:0/1080789343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200cde90 0x7f1a200c6cb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 >> 172.21.15.133:0/1080789343 conn(0x7f1a20089fb0 msgr2=0x7f1a200af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 shutdown_connections 2023-12-18T10:19:16.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.609+0000 7f1a24a95640 1 -- 172.21.15.133:0/1080789343 wait complete. 2023-12-18T10:19:16.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:16.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bfdbc640 1 Processor -- start 2023-12-18T10:19:16.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bfdbc640 1 -- start start 2023-12-18T10:19:16.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bfdbc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3b815ca40 0x7ff3b80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bfdbc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff3b80cf7e0 0x7ff3b81668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bfdbc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b80d11c0 con 0x7ff3b80ce3f0 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bfdbc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b80d0310 con 0x7ff3b815ca40 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bfdbc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b80d05b0 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bdb58640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3b815ca40 0x7ff3b80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bd357640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff3b80ce3f0 0x7ff3b80cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37292/0 (socket says 172.21.15.133:37292) 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bd357640 1 -- 172.21.15.133:0/2510851793 learned_addr learned my addr 172.21.15.133:0/2510851793 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3be359640 1 --2- 172.21.15.133:0/2510851793 >> v2:172.21.15.142:3300/0 conn(0x7ff3b80cf7e0 0x7ff3b81668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bdb58640 1 -- 172.21.15.133:0/2510851793 >> v2:172.21.15.142:3300/0 conn(0x7ff3b80cf7e0 msgr2=0x7ff3b81668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bdb58640 1 --2- 172.21.15.133:0/2510851793 >> v2:172.21.15.142:3300/0 conn(0x7ff3b80cf7e0 0x7ff3b81668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bdb58640 1 -- 172.21.15.133:0/2510851793 >> v1:172.21.15.133:6789/0 conn(0x7ff3b80ce3f0 legacy=0x7ff3b80cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.765+0000 7ff3bdb58640 1 -- 172.21.15.133:0/2510851793 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80d0890 con 0x7ff3b815ca40 2023-12-18T10:19:16.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bdb58640 1 --2- 172.21.15.133:0/2510851793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b815ca40 0x7ff3b80cdeb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80ccd20 tx=0x7ff3b401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41fff7830fdec69 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bcb56640 1 -- 172.21.15.133:0/2510851793 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40ab640 con 0x7ff3b815ca40 2023-12-18T10:19:16.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bcb56640 1 -- 172.21.15.133:0/2510851793 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b40a7070 con 0x7ff3b815ca40 2023-12-18T10:19:16.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bcb56640 1 -- 172.21.15.133:0/2510851793 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40ab9c0 con 0x7ff3b815ca40 2023-12-18T10:19:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/2510851793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b815ca40 msgr2=0x7ff3b80cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/2510851793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b815ca40 0x7ff3b80cdeb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80ccd20 tx=0x7ff3b401c440 comp rx=0 tx=0).stop 2023-12-18T10:19:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/2510851793 shutdown_connections 2023-12-18T10:19:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/2510851793 >> v2:172.21.15.142:3300/0 conn(0x7ff3b80cf7e0 0x7ff3b81668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/2510851793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b815ca40 0x7ff3b80cdeb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/2510851793 >> 172.21.15.133:0/2510851793 conn(0x7ff3b8089fb0 msgr2=0x7ff3b80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/2510851793 shutdown_connections 2023-12-18T10:19:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.769+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/2510851793 wait complete. 2023-12-18T10:19:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 Processor -- start 2023-12-18T10:19:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 -- start start 2023-12-18T10:19:16.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3b80ce3f0 0x7ff3b80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80cf7e0 0x7ff3b8154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3b815ca40 0x7ff3b81f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b81550a0 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b81f67d0 con 0x7ff3b80ce3f0 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80caf30 con 0x7ff3b815ca40 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80cf7e0 0x7ff3b8154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80cf7e0 0x7ff3b8154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43812/0 (socket says 172.21.15.133:43812) 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 -- 172.21.15.133:0/3649996449 learned_addr learned my addr 172.21.15.133:0/3649996449 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bdb58640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3b80ce3f0 0x7ff3b80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3be359640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3b815ca40 0x7ff3b81f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 -- 172.21.15.133:0/3649996449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3b815ca40 msgr2=0x7ff3b81f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3b815ca40 0x7ff3b81f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 -- 172.21.15.133:0/3649996449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3b80ce3f0 msgr2=0x7ff3b80c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3b80ce3f0 0x7ff3b80c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 -- 172.21.15.133:0/3649996449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b40093b0 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bd357640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80cf7e0 0x7ff3b8154b60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800c4d0 tx=0x7ff3a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3ae7fc640 1 -- 172.21.15.133:0/3649996449 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8007480 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3ae7fc640 1 -- 172.21.15.133:0/3649996449 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a80075e0 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b80d17d0 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3ae7fc640 1 -- 172.21.15.133:0/3649996449 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80059b0 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.773+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b80ca600 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.777+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b80d1630 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.777+0000 7ff3ae7fc640 1 -- 172.21.15.133:0/3649996449 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff3a8005b10 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.777+0000 7ff3ae7fc640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff39c065a60 0x7ff39c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:16.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.777+0000 7ff3ae7fc640 1 -- 172.21.15.133:0/3649996449 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff3a80829a0 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.777+0000 7ff3bdb58640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff39c065a60 0x7ff39c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:16.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.777+0000 7ff3bdb58640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff39c065a60 0x7ff39c067f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40af000 tx=0x7ff3b40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:16.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.781+0000 7ff3ae7fc640 1 -- 172.21.15.133:0/3649996449 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff3b80d1630 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.961+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3b80d1630 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3ae7fc640 1 -- 172.21.15.133:0/3649996449 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7ff3b80d1630 con 0x7ff3b80cf7e0 2023-12-18T10:19:16.967 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:16.967 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:28.930501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-18T10:19:16.967 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 9 2023-12-18T10:19:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff39c065a60 msgr2=0x7ff39c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff39c065a60 0x7ff39c067f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40af000 tx=0x7ff3b40a7000 comp rx=0 tx=0).stop 2023-12-18T10:19:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80cf7e0 msgr2=0x7ff3b8154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80cf7e0 0x7ff3b8154b60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800c4d0 tx=0x7ff3a800c990 comp rx=0 tx=0).stop 2023-12-18T10:19:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 shutdown_connections 2023-12-18T10:19:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff39c065a60 0x7ff39c067f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3b815ca40 0x7ff3b81f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80cf7e0 0x7ff3b8154b60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 --2- 172.21.15.133:0/3649996449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3b80ce3f0 0x7ff3b80c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 >> 172.21.15.133:0/3649996449 conn(0x7ff3b8089fb0 msgr2=0x7ff3b80ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 shutdown_connections 2023-12-18T10:19:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:16.965+0000 7ff3bfdbc640 1 -- 172.21.15.133:0/3649996449 wait complete. 2023-12-18T10:19:16.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.121+0000 7f0b00996640 1 Processor -- start 2023-12-18T10:19:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.121+0000 7f0b00996640 1 -- start start 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0b00996640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0afc15a680 0x7f0afc15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0b00996640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0afc06fdb0 0x7f0afc070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0b00996640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc15f100 con 0x7f0afc0cac10 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0b00996640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc070780 con 0x7f0afc06fdb0 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0b00996640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc0ca7d0 con 0x7f0afc15a680 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0afad9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0afc06fdb0 0x7f0afc070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0afad9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0afc06fdb0 0x7f0afc070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43824/0 (socket says 172.21.15.133:43824) 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0afad9d640 1 -- 172.21.15.133:0/1934076586 learned_addr learned my addr 172.21.15.133:0/1934076586 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0afa59c640 1 --2- 172.21.15.133:0/1934076586 >> v2:172.21.15.142:3300/0 conn(0x7f0afc15a680 0x7f0afc15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0afad9d640 1 -- 172.21.15.133:0/1934076586 >> v2:172.21.15.142:3300/0 conn(0x7f0afc15a680 msgr2=0x7f0afc15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0afad9d640 1 --2- 172.21.15.133:0/1934076586 >> v2:172.21.15.142:3300/0 conn(0x7f0afc15a680 0x7f0afc15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0afad9d640 1 -- 172.21.15.133:0/1934076586 >> v1:172.21.15.142:6789/0 conn(0x7f0afc0cac10 legacy=0x7f0afc15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:17.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.125+0000 7f0afad9d640 1 -- 172.21.15.133:0/1934076586 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc15e860 con 0x7f0afc06fdb0 2023-12-18T10:19:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0afad9d640 1 --2- 172.21.15.133:0/1934076586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc06fdb0 0x7f0afc070240 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009e50 tx=0x7f0af401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ef6a77f8b2f993 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0af959a640 1 -- 172.21.15.133:0/1934076586 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40a57c0 con 0x7f0afc06fdb0 2023-12-18T10:19:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0af959a640 1 -- 172.21.15.133:0/1934076586 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af40a5920 con 0x7f0afc06fdb0 2023-12-18T10:19:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0af959a640 1 -- 172.21.15.133:0/1934076586 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40a5cb0 con 0x7f0afc06fdb0 2023-12-18T10:19:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 -- 172.21.15.133:0/1934076586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc06fdb0 msgr2=0x7f0afc070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 --2- 172.21.15.133:0/1934076586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc06fdb0 0x7f0afc070240 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009e50 tx=0x7f0af401c900 comp rx=0 tx=0).stop 2023-12-18T10:19:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 -- 172.21.15.133:0/1934076586 shutdown_connections 2023-12-18T10:19:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 --2- 172.21.15.133:0/1934076586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc06fdb0 0x7f0afc070240 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 --2- 172.21.15.133:0/1934076586 >> v2:172.21.15.142:3300/0 conn(0x7f0afc15a680 0x7f0afc15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 -- 172.21.15.133:0/1934076586 >> 172.21.15.133:0/1934076586 conn(0x7f0afc06a3e0 msgr2=0x7f0afc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 -- 172.21.15.133:0/1934076586 shutdown_connections 2023-12-18T10:19:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 -- 172.21.15.133:0/1934076586 wait complete. 2023-12-18T10:19:17.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 Processor -- start 2023-12-18T10:19:17.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.129+0000 7f0b00996640 1 -- start start 2023-12-18T10:19:17.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0afc06fdb0 0x7f0afc1f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0cac10 0x7f0afc1f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc15a680 0x7f0afc0c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0c4af0 con 0x7f0afc15a680 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0c3010 con 0x7f0afc0cac10 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1f5540 con 0x7f0afc06fdb0 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc15a680 0x7f0afc0c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc15a680 0x7f0afc0c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43826/0 (socket says 172.21.15.133:43826) 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 -- 172.21.15.133:0/2678658164 learned_addr learned my addr 172.21.15.133:0/2678658164 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afa59c640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0afc06fdb0 0x7f0afc1f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0af9d9b640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0cac10 0x7f0afc1f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 -- 172.21.15.133:0/2678658164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0afc06fdb0 msgr2=0x7f0afc1f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0afc06fdb0 0x7f0afc1f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 -- 172.21.15.133:0/2678658164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0cac10 msgr2=0x7f0afc1f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0cac10 0x7f0afc1f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 -- 172.21.15.133:0/2678658164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4009b30 con 0x7f0afc15a680 2023-12-18T10:19:17.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0afad9d640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc15a680 0x7f0afc0c6df0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0af40af040 tx=0x7f0af40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0aeaffd640 1 -- 172.21.15.133:0/2678658164 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40b8670 con 0x7f0afc15a680 2023-12-18T10:19:17.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0aeaffd640 1 -- 172.21.15.133:0/2678658164 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af40b87d0 con 0x7f0afc15a680 2023-12-18T10:19:17.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc1f5820 con 0x7f0afc15a680 2023-12-18T10:19:17.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0aeaffd640 1 -- 172.21.15.133:0/2678658164 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40b8b60 con 0x7f0afc15a680 2023-12-18T10:19:17.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc1f5de0 con 0x7f0afc15a680 2023-12-18T10:19:17.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc0735b0 con 0x7f0afc15a680 2023-12-18T10:19:17.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.133+0000 7f0aeaffd640 1 -- 172.21.15.133:0/2678658164 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0af40b8cc0 con 0x7f0afc15a680 2023-12-18T10:19:17.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.137+0000 7f0aeaffd640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0adc065a60 0x7f0adc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.137+0000 7f0aeaffd640 1 -- 172.21.15.133:0/2678658164 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0af411e850 con 0x7f0afc15a680 2023-12-18T10:19:17.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.137+0000 7f0afa59c640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0adc065a60 0x7f0adc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.137+0000 7f0afa59c640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0adc065a60 0x7f0adc067f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0aee90 tx=0x7f0aec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.141+0000 7f0aeaffd640 1 -- 172.21.15.133:0/2678658164 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0af40ebef0 con 0x7f0afc15a680 2023-12-18T10:19:17.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.293+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0afc0c3180 con 0x7f0afc15a680 2023-12-18T10:19:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.293+0000 7f0aeaffd640 1 -- 172.21.15.133:0/2678658164 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f0af40ef510 con 0x7f0afc15a680 2023-12-18T10:19:17.297 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:17.297 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:17.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0adc065a60 msgr2=0x7f0adc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0adc065a60 0x7f0adc067f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0aee90 tx=0x7f0aec008040 comp rx=0 tx=0).stop 2023-12-18T10:19:17.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc15a680 msgr2=0x7f0afc0c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc15a680 0x7f0afc0c6df0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0af40af040 tx=0x7f0af40196a0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 shutdown_connections 2023-12-18T10:19:17.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0adc065a60 0x7f0adc067f20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0afc15a680 0x7f0afc0c6df0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0afc0cac10 0x7f0afc1f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 --2- 172.21.15.133:0/2678658164 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0afc06fdb0 0x7f0afc1f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 >> 172.21.15.133:0/2678658164 conn(0x7f0afc06a3e0 msgr2=0x7f0afc0cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:17.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 shutdown_connections 2023-12-18T10:19:17.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.297+0000 7f0b00996640 1 -- 172.21.15.133:0/2678658164 wait complete. 2023-12-18T10:19:17.318 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-18T10:19:17.318 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.453+0000 7f0f411e9640 1 Processor -- start 2023-12-18T10:19:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.453+0000 7f0f411e9640 1 -- start start 2023-12-18T10:19:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f411e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c1570c0 0x7f0f3c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f411e9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c0c9460 con 0x7f0f3c0ca000 2023-12-18T10:19:17.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f411e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c1574a0 con 0x7f0f3c06c320 2023-12-18T10:19:17.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f411e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c06c7a0 con 0x7f0f3c1570c0 2023-12-18T10:19:17.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3b59e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0f3c0ca000 0x7f0f3c070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37306/0 (socket says 172.21.15.133:37306) 2023-12-18T10:19:17.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3b59e640 1 -- 172.21.15.133:0/504815604 learned_addr learned my addr 172.21.15.133:0/504815604 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:17.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3ad9d640 1 --2- 172.21.15.133:0/504815604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c1570c0 0x7f0f3c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3a59c640 1 -- 172.21.15.133:0/504815604 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237417538 0 0) 0x7f0f3c0c9460 con 0x7f0f3c0ca000 2023-12-18T10:19:17.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3a59c640 1 -- 172.21.15.133:0/504815604 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f28003530 con 0x7f0f3c0ca000 2023-12-18T10:19:17.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3a59c640 1 -- 172.21.15.133:0/504815604 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381839279 0 0) 0x7f0f3c1574a0 con 0x7f0f3c06c320 2023-12-18T10:19:17.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3a59c640 1 -- 172.21.15.133:0/504815604 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f3c0c9460 con 0x7f0f3c06c320 2023-12-18T10:19:17.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3a59c640 1 -- 172.21.15.133:0/504815604 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057120181 0 0) 0x7f0f28003530 con 0x7f0f3c0ca000 2023-12-18T10:19:17.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3ad9d640 1 -- 172.21.15.133:0/504815604 >> v1:172.21.15.142:6789/0 conn(0x7f0f3c06c320 legacy=0x7f0f3c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3ad9d640 1 -- 172.21.15.133:0/504815604 >> v1:172.21.15.133:6789/0 conn(0x7f0f3c0ca000 legacy=0x7f0f3c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.457+0000 7f0f3ad9d640 1 -- 172.21.15.133:0/504815604 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0c8b30 con 0x7f0f3c1570c0 2023-12-18T10:19:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f3ad9d640 1 --2- 172.21.15.133:0/504815604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c1570c0 0x7f0f3c06bde0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0097f0 tx=0x7f0f2c01c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=330452f675b4d662 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f3a59c640 1 -- 172.21.15.133:0/504815604 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34001a00 con 0x7f0f3c1570c0 2023-12-18T10:19:17.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f3a59c640 1 -- 172.21.15.133:0/504815604 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c0a7050 con 0x7f0f3c1570c0 2023-12-18T10:19:17.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f3a59c640 1 -- 172.21.15.133:0/504815604 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0ab620 con 0x7f0f3c1570c0 2023-12-18T10:19:17.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f411e9640 1 -- 172.21.15.133:0/504815604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c1570c0 msgr2=0x7f0f3c06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f411e9640 1 --2- 172.21.15.133:0/504815604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c1570c0 0x7f0f3c06bde0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0097f0 tx=0x7f0f2c01c320 comp rx=0 tx=0).stop 2023-12-18T10:19:17.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f411e9640 1 -- 172.21.15.133:0/504815604 shutdown_connections 2023-12-18T10:19:17.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f411e9640 1 --2- 172.21.15.133:0/504815604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c1570c0 0x7f0f3c06bde0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f411e9640 1 -- 172.21.15.133:0/504815604 >> 172.21.15.133:0/504815604 conn(0x7f0f3c06a3e0 msgr2=0x7f0f3c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:17.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f411e9640 1 -- 172.21.15.133:0/504815604 shutdown_connections 2023-12-18T10:19:17.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f411e9640 1 -- 172.21.15.133:0/504815604 wait complete. 2023-12-18T10:19:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.461+0000 7f0f411e9640 1 Processor -- start 2023-12-18T10:19:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 -- start start 2023-12-18T10:19:17.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c06c320 0x7f0f3c157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c0ca000 0x7f0f3c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c1570c0 0x7f0f3c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15a4e0 con 0x7f0f3c1570c0 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0c2b50 con 0x7f0f3c0ca000 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0c2e30 con 0x7f0f3c06c320 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c1570c0 0x7f0f3c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3ad9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c06c320 0x7f0f3c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c1570c0 0x7f0f3c159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43836/0 (socket says 172.21.15.133:43836) 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 -- 172.21.15.133:0/2907467348 learned_addr learned my addr 172.21.15.133:0/2907467348 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f33fff640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c0ca000 0x7f0f3c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 -- 172.21.15.133:0/2907467348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c06c320 msgr2=0x7f0f3c157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c06c320 0x7f0f3c157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 -- 172.21.15.133:0/2907467348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c0ca000 msgr2=0x7f0f3c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c0ca000 0x7f0f3c1596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 -- 172.21.15.133:0/2907467348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c009420 con 0x7f0f3c1570c0 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f3b59e640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c1570c0 0x7f0f3c159bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0f34002010 tx=0x7f0f3400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f337fe640 1 -- 172.21.15.133:0/2907467348 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34012400 con 0x7f0f3c1570c0 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f337fe640 1 -- 172.21.15.133:0/2907467348 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f34012580 con 0x7f0f3c1570c0 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f337fe640 1 -- 172.21.15.133:0/2907467348 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34012970 con 0x7f0f3c1570c0 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c0c3110 con 0x7f0f3c1570c0 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c15a130 con 0x7f0f3c1570c0 2023-12-18T10:19:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.465+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c0735b0 con 0x7f0f3c1570c0 2023-12-18T10:19:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.469+0000 7f0f337fe640 1 -- 172.21.15.133:0/2907467348 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0f34012ad0 con 0x7f0f3c1570c0 2023-12-18T10:19:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.469+0000 7f0f337fe640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f1c065a60 0x7f0f1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.469+0000 7f0f337fe640 1 -- 172.21.15.133:0/2907467348 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f34083d20 con 0x7f0f3c1570c0 2023-12-18T10:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.469+0000 7f0f3ad9d640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f1c065a60 0x7f0f1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.469+0000 7f0f3ad9d640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f1c065a60 0x7f0f1c067f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0ad000 tx=0x7f0f2c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.473+0000 7f0f337fe640 1 -- 172.21.15.133:0/2907467348 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0f340512a0 con 0x7f0f3c1570c0 2023-12-18T10:19:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.657+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f3c04e000 con 0x7f0f3c1570c0 2023-12-18T10:19:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.657+0000 7f0f337fe640 1 -- 172.21.15.133:0/2907467348 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f0f340548c0 con 0x7f0f3c1570c0 2023-12-18T10:19:17.661 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:17.661 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:28.930501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-18T10:19:17.661 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 9 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f1c065a60 msgr2=0x7f0f1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f1c065a60 0x7f0f1c067f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0ad000 tx=0x7f0f2c0a6000 comp rx=0 tx=0).stop 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c1570c0 msgr2=0x7f0f3c159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c1570c0 0x7f0f3c159bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0f34002010 tx=0x7f0f3400a430 comp rx=0 tx=0).stop 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 shutdown_connections 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f1c065a60 0x7f0f1c067f20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c1570c0 0x7f0f3c159bf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f3c0ca000 0x7f0f3c1596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 --2- 172.21.15.133:0/2907467348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f3c06c320 0x7f0f3c157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 >> 172.21.15.133:0/2907467348 conn(0x7f0f3c06a3e0 msgr2=0x7f0f3c14e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 shutdown_connections 2023-12-18T10:19:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.661+0000 7f0f411e9640 1 -- 172.21.15.133:0/2907467348 wait complete. 2023-12-18T10:19:17.682 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62cc552640 1 Processor -- start 2023-12-18T10:19:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62cc552640 1 -- start start 2023-12-18T10:19:17.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62cc552640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 0x7f62c406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62cc552640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62c406c320 0x7f62c40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62cc552640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40c9460 con 0x7f62c40c9e30 2023-12-18T10:19:17.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62cc552640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c406c7a0 con 0x7f62c406c320 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62cc552640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41574a0 con 0x7f62c41570c0 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62c9aed640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62c406c320 0x7f62c40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62c9aed640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62c406c320 0x7f62c40c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43852/0 (socket says 172.21.15.133:43852) 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62c9aed640 1 -- 172.21.15.133:0/306495957 learned_addr learned my addr 172.21.15.133:0/306495957 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62ca2ee640 1 --2- 172.21.15.133:0/306495957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 0x7f62c406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62c9aed640 1 -- 172.21.15.133:0/306495957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 msgr2=0x7f62c406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62c9aed640 1 --2- 172.21.15.133:0/306495957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 0x7f62c406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62c9aed640 1 -- 172.21.15.133:0/306495957 >> v1:172.21.15.142:6789/0 conn(0x7f62c40c9e30 legacy=0x7f62c415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.817+0000 7f62c9aed640 1 -- 172.21.15.133:0/306495957 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40c8b30 con 0x7f62c406c320 2023-12-18T10:19:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62c9aed640 1 --2- 172.21.15.133:0/306495957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c406c320 0x7f62c40c98f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009870 tx=0x7f62b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15222eca99fd087 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62c92ec640 1 -- 172.21.15.133:0/306495957 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40ad640 con 0x7f62c406c320 2023-12-18T10:19:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62c92ec640 1 -- 172.21.15.133:0/306495957 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b40ad7a0 con 0x7f62c406c320 2023-12-18T10:19:17.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62c92ec640 1 -- 172.21.15.133:0/306495957 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40adb30 con 0x7f62c406c320 2023-12-18T10:19:17.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62cc552640 1 -- 172.21.15.133:0/306495957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c406c320 msgr2=0x7f62c40c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62cc552640 1 --2- 172.21.15.133:0/306495957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c406c320 0x7f62c40c98f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009870 tx=0x7f62b401c480 comp rx=0 tx=0).stop 2023-12-18T10:19:17.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62cc552640 1 -- 172.21.15.133:0/306495957 shutdown_connections 2023-12-18T10:19:17.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62cc552640 1 --2- 172.21.15.133:0/306495957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c406c320 0x7f62c40c98f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62cc552640 1 --2- 172.21.15.133:0/306495957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 0x7f62c406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62cc552640 1 -- 172.21.15.133:0/306495957 >> 172.21.15.133:0/306495957 conn(0x7f62c406a3e0 msgr2=0x7f62c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:17.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62cc552640 1 -- 172.21.15.133:0/306495957 shutdown_connections 2023-12-18T10:19:17.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.821+0000 7f62cc552640 1 -- 172.21.15.133:0/306495957 wait complete. 2023-12-18T10:19:17.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 Processor -- start 2023-12-18T10:19:17.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 -- start start 2023-12-18T10:19:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c406c320 0x7f62c414c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c40c9e30 0x7f62c4154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 0x7f62c40c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4158da0 con 0x7f62c40c9e30 2023-12-18T10:19:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4154fe0 con 0x7f62c406c320 2023-12-18T10:19:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41552c0 con 0x7f62c41570c0 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c40c9e30 0x7f62c4154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c40c9e30 0x7f62c4154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43868/0 (socket says 172.21.15.133:43868) 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 -- 172.21.15.133:0/3928283187 learned_addr learned my addr 172.21.15.133:0/3928283187 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62ca2ee640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c406c320 0x7f62c414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62caaef640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 0x7f62c40c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 -- 172.21.15.133:0/3928283187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 msgr2=0x7f62c40c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 0x7f62c40c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 -- 172.21.15.133:0/3928283187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c406c320 msgr2=0x7f62c414c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c406c320 0x7f62c414c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 -- 172.21.15.133:0/3928283187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40094d0 con 0x7f62c40c9e30 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62c9aed640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c40c9e30 0x7f62c4154670 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f62b40b0040 tx=0x7f62b4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62baffd640 1 -- 172.21.15.133:0/3928283187 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40bc070 con 0x7f62c40c9e30 2023-12-18T10:19:17.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62baffd640 1 -- 172.21.15.133:0/3928283187 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b40a6040 con 0x7f62c40c9e30 2023-12-18T10:19:17.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62baffd640 1 -- 172.21.15.133:0/3928283187 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40b7850 con 0x7f62c40c9e30 2023-12-18T10:19:17.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c41555a0 con 0x7f62c40c9e30 2023-12-18T10:19:17.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.825+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c414cac0 con 0x7f62c40c9e30 2023-12-18T10:19:17.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.829+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c40735b0 con 0x7f62c40c9e30 2023-12-18T10:19:17.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.829+0000 7f62baffd640 1 -- 172.21.15.133:0/3928283187 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f62b40b79b0 con 0x7f62c40c9e30 2023-12-18T10:19:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.829+0000 7f62baffd640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62a8065a60 0x7f62a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.829+0000 7f62baffd640 1 -- 172.21.15.133:0/3928283187 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f62b411d8e0 con 0x7f62c40c9e30 2023-12-18T10:19:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.829+0000 7f62ca2ee640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62a8065a60 0x7f62a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.829+0000 7f62ca2ee640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62a8065a60 0x7f62a8067f20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62c0007a60 tx=0x7f62c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:17.833+0000 7f62baffd640 1 -- 172.21.15.133:0/3928283187 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f62b40eaed0 con 0x7f62c40c9e30 2023-12-18T10:19:18.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62c404e000 con 0x7f62c40c9e30 2023-12-18T10:19:18.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62baffd640 1 -- 172.21.15.133:0/3928283187 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4711 (secure 0 0 0) 0x7f62b40ee4f0 con 0x7f62c40c9e30 2023-12-18T10:19:18.020 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:18.020 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/980712572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":980712572},{"type":"v1","addr":"172.21.15.142:6834","nonce":980712572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2566661469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2566661469},{"type":"v1","addr":"172.21.15.133:6836","nonce":2566661469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2500561014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2500561014},{"type":"v1","addr":"172.21.15.133:6837","nonce":2500561014}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:18:05.604323+0000","modified":"2023-12-18T10:18:28.930501+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/229940980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":229940980},{"type":"v1","addr":"172.21.15.142:6835","nonce":229940980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-18T10:19:18.020 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 9 2023-12-18T10:19:18.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62a8065a60 msgr2=0x7f62a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62a8065a60 0x7f62a8067f20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62c0007a60 tx=0x7f62c0008040 comp rx=0 tx=0).stop 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c40c9e30 msgr2=0x7f62c4154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c40c9e30 0x7f62c4154670 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f62b40b0040 tx=0x7f62b4019220 comp rx=0 tx=0).stop 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 shutdown_connections 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62a8065a60 0x7f62a8067f20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62c41570c0 0x7f62c40c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c40c9e30 0x7f62c4154670 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 --2- 172.21.15.133:0/3928283187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62c406c320 0x7f62c414c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 >> 172.21.15.133:0/3928283187 conn(0x7f62c406a3e0 msgr2=0x7f62c40c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 shutdown_connections 2023-12-18T10:19:18.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.017+0000 7f62cc552640 1 -- 172.21.15.133:0/3928283187 wait complete. 2023-12-18T10:19:18.041 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:18.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.173+0000 7f73863a2640 1 Processor -- start 2023-12-18T10:19:18.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f73863a2640 1 -- start start 2023-12-18T10:19:18.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f73863a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73800afd10 0x7f73800b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f73863a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f738006fb60 0x7f738006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f73863a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73800cbc70 con 0x7f73800cc6c0 2023-12-18T10:19:18.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f73863a2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73800b0630 con 0x7f738006fb60 2023-12-18T10:19:18.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f73863a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73800c3bb0 con 0x7f73800afd10 2023-12-18T10:19:18.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7385ba1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f73800cc6c0 0x7f73800c2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37322/0 (socket says 172.21.15.133:37322) 2023-12-18T10:19:18.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7385ba1640 1 -- 172.21.15.133:0/3214488416 learned_addr learned my addr 172.21.15.133:0/3214488416 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:18.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707788729 0 0) 0x7f73800cbc70 con 0x7f73800cc6c0 2023-12-18T10:19:18.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f73853a0640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73800afd10 0x7f73800b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f736c003530 con 0x7f73800cc6c0 2023-12-18T10:19:18.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7384b9f640 1 --2- 172.21.15.133:0/3214488416 >> v2:172.21.15.142:3300/0 conn(0x7f738006fb60 0x7f738006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3039771629 0 0) 0x7f736c003530 con 0x7f73800cc6c0 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73800afd10 msgr2=0x7f73800b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73800afd10 0x7f73800b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 >> v2:172.21.15.142:3300/0 conn(0x7f738006fb60 msgr2=0x7f738006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 --2- 172.21.15.133:0/3214488416 >> v2:172.21.15.142:3300/0 conn(0x7f738006fb60 0x7f738006ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73800c3e90 con 0x7f73800cc6c0 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f7378001a00 con 0x7f73800cc6c0 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 >> v1:172.21.15.133:6789/0 conn(0x7f73800cc6c0 legacy=0x7f73800c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c003980 0x7f736c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0047d0 0x7f736c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73800afd10 0x7f736c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73800b0630 con 0x7f736c0047d0 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73800c3bb0 con 0x7f736c003980 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c00b990 con 0x7f73800afd10 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7384b9f640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0047d0 0x7f736c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7385ba1640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73800afd10 0x7f736c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f73853a0640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c003980 0x7f736c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7384b9f640 1 -- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73800afd10 msgr2=0x7f736c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7384b9f640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73800afd10 0x7f736c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7384b9f640 1 -- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c003980 msgr2=0x7f736c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7384b9f640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c003980 0x7f736c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.177+0000 7f7384b9f640 1 -- 172.21.15.133:0/3214488416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c003530 con 0x7f736c0047d0 2023-12-18T10:19:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f7384b9f640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0047d0 0x7f736c004c50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7370009ae0 tx=0x7f737001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b866ab54575c8e44 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700a64a0 con 0x7f736c0047d0 2023-12-18T10:19:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73700a6600 con 0x7f736c0047d0 2023-12-18T10:19:18.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f7377fff640 1 -- 172.21.15.133:0/3214488416 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700a69b0 con 0x7f736c0047d0 2023-12-18T10:19:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f73863a2640 1 -- 172.21.15.133:0/3214488416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0047d0 msgr2=0x7f736c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f73863a2640 1 --2- 172.21.15.133:0/3214488416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0047d0 0x7f736c004c50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7370009ae0 tx=0x7f737001ca90 comp rx=0 tx=0).stop 2023-12-18T10:19:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f7385ba1640 1 -- 172.21.15.133:0/3214488416 reap_dead start 2023-12-18T10:19:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f73863a2640 1 -- 172.21.15.133:0/3214488416 shutdown_connections 2023-12-18T10:19:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f73863a2640 1 -- 172.21.15.133:0/3214488416 >> 172.21.15.133:0/3214488416 conn(0x7f73800ce130 msgr2=0x7f73800ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f73863a2640 1 -- 172.21.15.133:0/3214488416 shutdown_connections 2023-12-18T10:19:18.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.181+0000 7f73863a2640 1 -- 172.21.15.133:0/3214488416 wait complete. 2023-12-18T10:19:18.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 Processor -- start 2023-12-18T10:19:18.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 -- start start 2023-12-18T10:19:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c0047d0 0x7f7380129220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73800b1860 0x7f7380158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f738013d2c0 0x7f73800c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7380127d10 con 0x7f73800b1860 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7380127100 con 0x7f736c0047d0 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73801273e0 con 0x7f738013d2c0 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73800b1860 0x7f7380158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73800b1860 0x7f7380158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43892/0 (socket says 172.21.15.133:43892) 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 -- 172.21.15.133:0/202360006 learned_addr learned my addr 172.21.15.133:0/202360006 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73853a0640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c0047d0 0x7f7380129220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 -- 172.21.15.133:0/202360006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f738013d2c0 msgr2=0x7f73800c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f738013d2c0 0x7f73800c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 -- 172.21.15.133:0/202360006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c0047d0 msgr2=0x7f7380129220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c0047d0 0x7f7380129220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 -- 172.21.15.133:0/202360006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73801276c0 con 0x7f73800b1860 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73853a0640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c0047d0 0x7f7380129220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7384b9f640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73800b1860 0x7f7380158dd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f737001c8c0 tx=0x7f736c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7375ffb640 1 -- 172.21.15.133:0/202360006 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700b5070 con 0x7f73800b1860 2023-12-18T10:19:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7375ffb640 1 -- 172.21.15.133:0/202360006 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73700a6770 con 0x7f73800b1860 2023-12-18T10:19:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73801279a0 con 0x7f73800b1860 2023-12-18T10:19:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f7375ffb640 1 -- 172.21.15.133:0/202360006 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700a76a0 con 0x7f73800b1860 2023-12-18T10:19:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.185+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7380159310 con 0x7f73800b1860 2023-12-18T10:19:18.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.189+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7380127b60 con 0x7f73800b1860 2023-12-18T10:19:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.189+0000 7f7375ffb640 1 -- 172.21.15.133:0/202360006 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f73700b9070 con 0x7f73800b1860 2023-12-18T10:19:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.189+0000 7f7375ffb640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7364065a20 0x7f7364067ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.189+0000 7f7375ffb640 1 -- 172.21.15.133:0/202360006 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f737011d5a0 con 0x7f73800b1860 2023-12-18T10:19:18.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.189+0000 7f73853a0640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7364065a20 0x7f7364067ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.189+0000 7f73853a0640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7364065a20 0x7f7364067ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f737c009a00 tx=0x7f737c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.193+0000 7f7375ffb640 1 -- 172.21.15.133:0/202360006 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f73700eab00 con 0x7f73800b1860 2023-12-18T10:19:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.345+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f738004e850 con 0x7f73800b1860 2023-12-18T10:19:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.345+0000 7f7375ffb640 1 -- 172.21.15.133:0/202360006 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18315 (secure 0 0 0) 0x7f73700ee120 con 0x7f73800b1860 2023-12-18T10:19:18.350 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:18.350 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:18:46.925684+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:18:03.308063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-18T10:18:04.599689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-18T10:18:07.671885+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7364065a20 msgr2=0x7f7364067ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7364065a20 0x7f7364067ee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f737c009a00 tx=0x7f737c008040 comp rx=0 tx=0).stop 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73800b1860 msgr2=0x7f7380158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73800b1860 0x7f7380158dd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f737001c8c0 tx=0x7f736c005800 comp rx=0 tx=0).stop 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 shutdown_connections 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7364065a20 0x7f7364067ee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f738013d2c0 0x7f73800c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73800b1860 0x7f7380158dd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 --2- 172.21.15.133:0/202360006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f736c0047d0 0x7f7380129220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 >> 172.21.15.133:0/202360006 conn(0x7f73800ce130 msgr2=0x7f73800c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 shutdown_connections 2023-12-18T10:19:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.349+0000 7f73863a2640 1 -- 172.21.15.133:0/202360006 wait complete. 2023-12-18T10:19:18.371 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-18T10:19:18.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.505+0000 7fd534da2640 1 Processor -- start 2023-12-18T10:19:18.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.505+0000 7fd534da2640 1 -- start start 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd534da2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd530143f50 0x7fd5300c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd534da2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5300afd10 0x7fd5300b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd534da2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5300c36c0 con 0x7fd53006bea0 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd534da2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53006ca40 con 0x7fd530143f50 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd534da2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300b06d0 con 0x7fd5300afd10 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd53006bea0 0x7fd53006c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37324/0 (socket says 172.21.15.133:37324) 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52ffff640 1 -- 172.21.15.133:0/162442717 learned_addr learned my addr 172.21.15.133:0/162442717 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52effd640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5300afd10 0x7fd5300b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/162442717 >> v2:172.21.15.142:3300/0 conn(0x7fd530143f50 0x7fd5300c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712485625 0 0) 0x7fd5300c36c0 con 0x7fd53006bea0 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd518003530 con 0x7fd53006bea0 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 545530446 0 0) 0x7fd518003530 con 0x7fd53006bea0 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5300afd10 msgr2=0x7fd5300b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5300afd10 0x7fd5300b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 >> v2:172.21.15.142:3300/0 conn(0x7fd530143f50 msgr2=0x7fd5300c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 --2- 172.21.15.133:0/162442717 >> v2:172.21.15.142:3300/0 conn(0x7fd530143f50 0x7fd5300c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300c39a0 con 0x7fd53006bea0 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fd528001a00 con 0x7fd53006bea0 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 >> v1:172.21.15.133:6789/0 conn(0x7fd53006bea0 legacy=0x7fd53006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd518003980 0x7fd518003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5180047d0 0x7fd518004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5300afd10 0x7fd518005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53006ca40 con 0x7fd518003980 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300b06d0 con 0x7fd5180047d0 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51800b990 con 0x7fd5300afd10 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/162442717 >> v2:172.21.15.142:3300/0 conn(0x7fd530143f50 0x7fd5300c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd518003980 0x7fd518003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52ffff640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5300afd10 0x7fd518005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52effd640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5180047d0 0x7fd518004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52f7fe640 1 -- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5300afd10 msgr2=0x7fd518005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5300afd10 0x7fd518005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52f7fe640 1 -- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5180047d0 msgr2=0x7fd518004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5180047d0 0x7fd518004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52f7fe640 1 -- 172.21.15.133:0/162442717 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518003530 con 0x7fd518003980 2023-12-18T10:19:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.509+0000 7fd52effd640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5180047d0 0x7fd518004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd518003980 0x7fd518003da0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd520009c90 tx=0x7fd52001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70efd6c16064e2e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520004020 con 0x7fd518003980 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd520004180 con 0x7fd518003980 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd52e7fc640 1 -- 172.21.15.133:0/162442717 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5200a5830 con 0x7fd518003980 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd534da2640 1 -- 172.21.15.133:0/162442717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd518003980 msgr2=0x7fd518003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd534da2640 1 --2- 172.21.15.133:0/162442717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd518003980 0x7fd518003da0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd520009c90 tx=0x7fd52001cc50 comp rx=0 tx=0).stop 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd52ffff640 1 -- 172.21.15.133:0/162442717 reap_dead start 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd534da2640 1 -- 172.21.15.133:0/162442717 shutdown_connections 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd534da2640 1 -- 172.21.15.133:0/162442717 >> 172.21.15.133:0/162442717 conn(0x7fd5300ce130 msgr2=0x7fd5300ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd534da2640 1 -- 172.21.15.133:0/162442717 shutdown_connections 2023-12-18T10:19:18.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd534da2640 1 -- 172.21.15.133:0/162442717 wait complete. 2023-12-18T10:19:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.513+0000 7fd534da2640 1 Processor -- start 2023-12-18T10:19:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 -- start start 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd518003980 0x7fd5301f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd53013fa40 0x7fd53013ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53015ba10 0x7fd5301596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301411e0 con 0x7fd53013fa40 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301f3d80 con 0x7fd518003980 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53015bf40 con 0x7fd53015ba10 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd53013fa40 0x7fd53013ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd53013fa40 0x7fd53013ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43900/0 (socket says 172.21.15.133:43900) 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 -- 172.21.15.133:0/4259296890 learned_addr learned my addr 172.21.15.133:0/4259296890 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd518003980 0x7fd5301f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52ffff640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53015ba10 0x7fd5301596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 -- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53015ba10 msgr2=0x7fd5301596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53015ba10 0x7fd5301596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 -- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd518003980 msgr2=0x7fd5301f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd518003980 0x7fd5301f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 -- 172.21.15.133:0/4259296890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53015c220 con 0x7fd53013fa40 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd518003980 0x7fd5301f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd52effd640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd53013fa40 0x7fd53013ee00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd524009160 tx=0x7fd524011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd517fff640 1 -- 172.21.15.133:0/4259296890 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524004220 con 0x7fd53013fa40 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd517fff640 1 -- 172.21.15.133:0/4259296890 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524004380 con 0x7fd53013fa40 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd517fff640 1 -- 172.21.15.133:0/4259296890 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524015890 con 0x7fd53013fa40 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53015c500 con 0x7fd53013fa40 2023-12-18T10:19:18.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53013f340 con 0x7fd53013fa40 2023-12-18T10:19:18.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.517+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53015c9b0 con 0x7fd53013fa40 2023-12-18T10:19:18.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.521+0000 7fd517fff640 1 -- 172.21.15.133:0/4259296890 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd5240159f0 con 0x7fd53013fa40 2023-12-18T10:19:18.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.521+0000 7fd517fff640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd51c065a60 0x7fd51c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.521+0000 7fd517fff640 1 -- 172.21.15.133:0/4259296890 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd524083a50 con 0x7fd53013fa40 2023-12-18T10:19:18.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.521+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd51c065a60 0x7fd51c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.521+0000 7fd52f7fe640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd51c065a60 0x7fd51c067f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd5200ae000 tx=0x7fd5200046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.525+0000 7fd517fff640 1 -- 172.21.15.133:0/4259296890 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd524051060 con 0x7fd53013fa40 2023-12-18T10:19:18.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.705+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd53004e850 con 0x7fd53013fa40 2023-12-18T10:19:18.709 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:19:18.705+0000 7f3ba99e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-18T10:19:18.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.713+0000 7fd517fff640 1 -- 172.21.15.133:0/4259296890 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd524054680 con 0x7fd53013fa40 2023-12-18T10:19:18.717 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd51c065a60 msgr2=0x7fd51c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd51c065a60 0x7fd51c067f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd5200ae000 tx=0x7fd5200046d0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd53013fa40 msgr2=0x7fd53013ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd53013fa40 0x7fd53013ee00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd524009160 tx=0x7fd524011a60 comp rx=0 tx=0).stop 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 shutdown_connections 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd51c065a60 0x7fd51c067f20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd53015ba10 0x7fd5301596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd53013fa40 0x7fd53013ee00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 --2- 172.21.15.133:0/4259296890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd518003980 0x7fd5301f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 >> 172.21.15.133:0/4259296890 conn(0x7fd5300ce130 msgr2=0x7fd53013db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 shutdown_connections 2023-12-18T10:19:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.717+0000 7fd534da2640 1 -- 172.21.15.133:0/4259296890 wait complete. 2023-12-18T10:19:18.728 INFO:tasks.ceph.mds.b.smithi142.stderr: -4231> 2023-12-18T10:18:09.686+0000 7f94f7564640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:19:18.738 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-18T10:19:18.780 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:19:18.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0ecc95640 1 Processor -- start 2023-12-18T10:19:18.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0ecc95640 1 -- start start 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0ecc95640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0e8070820 0x7fe0e80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0ecc95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0ecc95640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80c9390 con 0x7fe0e81582d0 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0ecc95640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e80ced80 con 0x7fe0e8070820 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0ecc95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e815aee0 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0e5d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0e8070820 0x7fe0e80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0e5d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0e8070820 0x7fe0e80c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43916/0 (socket says 172.21.15.133:43916) 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0e5d9b640 1 -- 172.21.15.133:0/565104750 learned_addr learned my addr 172.21.15.133:0/565104750 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0e6d9d640 1 --2- 172.21.15.133:0/565104750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0e5d9b640 1 -- 172.21.15.133:0/565104750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 msgr2=0x7fe0e80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:18.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0e5d9b640 1 --2- 172.21.15.133:0/565104750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e80ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0e5d9b640 1 -- 172.21.15.133:0/565104750 >> v1:172.21.15.142:6789/0 conn(0x7fe0e81582d0 legacy=0x7fe0e80ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.877+0000 7fe0e5d9b640 1 -- 172.21.15.133:0/565104750 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e815b1c0 con 0x7fe0e8070820 2023-12-18T10:19:18.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0e5d9b640 1 --2- 172.21.15.133:0/565104750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e8070820 0x7fe0e80c8e50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009870 tx=0x7fe0dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb41274d17f8381 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0e559a640 1 -- 172.21.15.133:0/565104750 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0aa670 con 0x7fe0e8070820 2023-12-18T10:19:18.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0e559a640 1 -- 172.21.15.133:0/565104750 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0aa7d0 con 0x7fe0e8070820 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0e559a640 1 -- 172.21.15.133:0/565104750 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0aab60 con 0x7fe0e8070820 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0ecc95640 1 -- 172.21.15.133:0/565104750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e8070820 msgr2=0x7fe0e80c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/565104750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e8070820 0x7fe0e80c8e50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009870 tx=0x7fe0dc01c510 comp rx=0 tx=0).stop 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0ecc95640 1 -- 172.21.15.133:0/565104750 shutdown_connections 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/565104750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/565104750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e8070820 0x7fe0e80c8e50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0ecc95640 1 -- 172.21.15.133:0/565104750 >> 172.21.15.133:0/565104750 conn(0x7fe0e806a2a0 msgr2=0x7fe0e80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0ecc95640 1 -- 172.21.15.133:0/565104750 shutdown_connections 2023-12-18T10:19:18.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.881+0000 7fe0ecc95640 1 -- 172.21.15.133:0/565104750 wait complete. 2023-12-18T10:19:18.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 Processor -- start 2023-12-18T10:19:18.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 -- start start 2023-12-18T10:19:18.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e8070820 0x7fe0e8146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e8153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e81582d0 0x7fe0e8164820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8152260 con 0x7fe0e81582d0 2023-12-18T10:19:18.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80cbff0 con 0x7fe0e8070820 2023-12-18T10:19:18.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80cc290 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e81582d0 0x7fe0e8164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e8070820 0x7fe0e8146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e5d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e8153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e81582d0 0x7fe0e8164820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43918/0 (socket says 172.21.15.133:43918) 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e6d9d640 1 -- 172.21.15.133:0/2451654267 learned_addr learned my addr 172.21.15.133:0/2451654267 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e8070820 0x7fe0e8146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:36078/0 (socket says 172.21.15.133:36078) 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e5d9b640 1 -- 172.21.15.133:0/2451654267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e8070820 msgr2=0x7fe0e8146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e5d9b640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e8070820 0x7fe0e8146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e5d9b640 1 -- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e81582d0 msgr2=0x7fe0e8164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e5d9b640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e81582d0 0x7fe0e8164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e5d9b640 1 -- 172.21.15.133:0/2451654267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0094d0 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0e5d9b640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e8153220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0ab000 tx=0x7fe0dc01ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0d6ffd640 1 -- 172.21.15.133:0/2451654267 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0b3800 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0d6ffd640 1 -- 172.21.15.133:0/2451654267 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0b3960 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e80cc570 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0d6ffd640 1 -- 172.21.15.133:0/2451654267 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0b3d10 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e80ccb30 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.885+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e804e000 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.889+0000 7fe0d6ffd640 1 -- 172.21.15.133:0/2451654267 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe0dc0bd3f0 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.889+0000 7fe0d6ffd640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe0c8065a60 0x7fe0c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:18.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.889+0000 7fe0d6ffd640 1 -- 172.21.15.133:0/2451654267 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fe0dc11e340 con 0x7fe0e80ce3b0 2023-12-18T10:19:18.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.889+0000 7fe0e659c640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe0c8065a60 0x7fe0c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:18.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.889+0000 7fe0e659c640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe0c8065a60 0x7fe0c8067f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe0e814e840 tx=0x7fe0d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:18.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:18.893+0000 7fe0d6ffd640 1 -- 172.21.15.133:0/2451654267 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe0dc0eba10 con 0x7fe0e80ce3b0 2023-12-18T10:19:19.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.073+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe0e81590a0 con 0x7fe0e80ce3b0 2023-12-18T10:19:19.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.721+0000 7fe0d6ffd640 1 -- 172.21.15.133:0/2451654267 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe0dc0ef030 con 0x7fe0e80ce3b0 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe0c8065a60 msgr2=0x7fe0c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe0c8065a60 0x7fe0c8067f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe0e814e840 tx=0x7fe0d8009040 comp rx=0 tx=0).stop 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 msgr2=0x7fe0e8153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e8153220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0ab000 tx=0x7fe0dc01ad50 comp rx=0 tx=0).stop 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 shutdown_connections 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe0c8065a60 0x7fe0c8067f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e81582d0 0x7fe0e8164820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0e80ce3b0 0x7fe0e8153220 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 --2- 172.21.15.133:0/2451654267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e8070820 0x7fe0e8146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 >> 172.21.15.133:0/2451654267 conn(0x7fe0e806a2a0 msgr2=0x7fe0e8159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 shutdown_connections 2023-12-18T10:19:19.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.725+0000 7fe0ecc95640 1 -- 172.21.15.133:0/2451654267 wait complete. 2023-12-18T10:19:19.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-18T10:19:19.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.885+0000 7fe9688c4640 1 Processor -- start 2023-12-18T10:19:19.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.885+0000 7fe9688c4640 1 -- start start 2023-12-18T10:19:19.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe9688c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe96406d440 0x7fe96406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe9688c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9640ab190 0x7fe9640ab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe9688c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640b28a0 con 0x7fe9640ce5d0 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe9688c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96415ab30 con 0x7fe96406d440 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe9688c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640b1c90 con 0x7fe9640ab190 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe96259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe9640ce5d0 0x7fe9640ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54154/0 (socket says 172.21.15.133:54154) 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe96259c640 1 -- 172.21.15.133:0/4069692019 learned_addr learned my addr 172.21.15.133:0/4069692019 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9640ab190 0x7fe9640ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe95bfff640 1 --2- 172.21.15.133:0/4069692019 >> v2:172.21.15.142:3300/0 conn(0x7fe96406d440 0x7fe96406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883371285 0 0) 0x7fe9640b28a0 con 0x7fe9640ce5d0 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe950003530 con 0x7fe9640ce5d0 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 25777635 0 0) 0x7fe950003530 con 0x7fe9640ce5d0 2023-12-18T10:19:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9640ab190 msgr2=0x7fe9640ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9640ab190 0x7fe9640ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 >> v2:172.21.15.142:3300/0 conn(0x7fe96406d440 msgr2=0x7fe96406d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 --2- 172.21.15.133:0/4069692019 >> v2:172.21.15.142:3300/0 conn(0x7fe96406d440 0x7fe96406d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640b1f70 con 0x7fe9640ce5d0 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fe954001680 con 0x7fe9640ce5d0 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 >> v1:172.21.15.133:6789/0 conn(0x7fe9640ce5d0 legacy=0x7fe9640ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950003980 0x7fe950003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9500047d0 0x7fe950004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe950005190 0x7fe95000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96415ab30 con 0x7fe950005190 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640b1c90 con 0x7fe950003980 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95000bed0 con 0x7fe9500047d0 2023-12-18T10:19:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9640ab190 0x7fe9640ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe95bfff640 1 --2- 172.21.15.133:0/4069692019 >> v2:172.21.15.142:3300/0 conn(0x7fe96406d440 0x7fe96406d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe950005190 0x7fe95000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe96259c640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950003980 0x7fe950003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe95bfff640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9500047d0 0x7fe950004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe962d9d640 1 -- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9500047d0 msgr2=0x7fe950004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9500047d0 0x7fe950004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe962d9d640 1 -- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950003980 msgr2=0x7fe950003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950003980 0x7fe950003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.889+0000 7fe962d9d640 1 -- 172.21.15.133:0/4069692019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe950003530 con 0x7fe950005190 2023-12-18T10:19:19.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe950005190 0x7fe95000b990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00e1f0 tx=0x7fe95c01cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd9ae0ebb01705d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:19.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0a5d50 con 0x7fe950005190 2023-12-18T10:19:19.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c00f040 con 0x7fe950005190 2023-12-18T10:19:19.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe961d9b640 1 -- 172.21.15.133:0/4069692019 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c003bc0 con 0x7fe950005190 2023-12-18T10:19:19.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe9688c4640 1 -- 172.21.15.133:0/4069692019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe950005190 msgr2=0x7fe95000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe9688c4640 1 --2- 172.21.15.133:0/4069692019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe950005190 0x7fe95000b990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00e1f0 tx=0x7fe95c01cd00 comp rx=0 tx=0).stop 2023-12-18T10:19:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe962d9d640 1 -- 172.21.15.133:0/4069692019 reap_dead start 2023-12-18T10:19:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe9688c4640 1 -- 172.21.15.133:0/4069692019 shutdown_connections 2023-12-18T10:19:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe9688c4640 1 -- 172.21.15.133:0/4069692019 >> 172.21.15.133:0/4069692019 conn(0x7fe964069e70 msgr2=0x7fe96406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe9688c4640 1 -- 172.21.15.133:0/4069692019 shutdown_connections 2023-12-18T10:19:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.893+0000 7fe9688c4640 1 -- 172.21.15.133:0/4069692019 wait complete. 2023-12-18T10:19:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 Processor -- start 2023-12-18T10:19:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 -- start start 2023-12-18T10:19:19.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950005190 0x7fe964151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe964154ca0 0x7fe9641f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640c7640 0x7fe9640c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640c8000 con 0x7fe9640c7640 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe964152790 con 0x7fe950005190 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641524b0 con 0x7fe964154ca0 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640c7640 0x7fe9640c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640c7640 0x7fe9640c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40540/0 (socket says 172.21.15.133:40540) 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 -- 172.21.15.133:0/4261110764 learned_addr learned my addr 172.21.15.133:0/4261110764 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe96259c640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950005190 0x7fe964151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe95bfff640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe964154ca0 0x7fe9641f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 -- 172.21.15.133:0/4261110764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe964154ca0 msgr2=0x7fe9641f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe964154ca0 0x7fe9641f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 -- 172.21.15.133:0/4261110764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950005190 msgr2=0x7fe964151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950005190 0x7fe964151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 -- 172.21.15.133:0/4261110764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96408a050 con 0x7fe9640c7640 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe962d9d640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640c7640 0x7fe9640c7ac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe95c01cb30 tx=0x7fe95c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe95affd640 1 -- 172.21.15.133:0/4261110764 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0bc070 con 0x7fe9640c7640 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe95affd640 1 -- 172.21.15.133:0/4261110764 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c003e60 con 0x7fe9640c7640 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96408a330 con 0x7fe9640c7640 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe95affd640 1 -- 172.21.15.133:0/4261110764 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c0a5d50 con 0x7fe9640c7640 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9641521a0 con 0x7fe9640c7640 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.897+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9641521a0 con 0x7fe9640c7640 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.901+0000 7fe95affd640 1 -- 172.21.15.133:0/4261110764 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe95c004030 con 0x7fe9640c7640 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.901+0000 7fe95affd640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe944065a60 0x7fe944067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.901+0000 7fe95affd640 1 -- 172.21.15.133:0/4261110764 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fe95c11e510 con 0x7fe9640c7640 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.901+0000 7fe96259c640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe944065a60 0x7fe944067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.901+0000 7fe96259c640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe944065a60 0x7fe944067f20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe954000c10 tx=0x7fe954007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:19.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:19.905+0000 7fe95affd640 1 -- 172.21.15.133:0/4261110764 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe95c0ebb60 con 0x7fe9640c7640 2023-12-18T10:19:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.061+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9641521a0 con 0x7fe9640c7640 2023-12-18T10:19:20.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.933+0000 7fe95affd640 1 -- 172.21.15.133:0/4261110764 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe95c0ef180 con 0x7fe9640c7640 2023-12-18T10:19:20.936 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe944065a60 msgr2=0x7fe944067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe944065a60 0x7fe944067f20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe954000c10 tx=0x7fe954007900 comp rx=0 tx=0).stop 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640c7640 msgr2=0x7fe9640c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640c7640 0x7fe9640c7ac0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe95c01cb30 tx=0x7fe95c009750 comp rx=0 tx=0).stop 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 shutdown_connections 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe944065a60 0x7fe944067f20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9640c7640 0x7fe9640c7ac0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe964154ca0 0x7fe9641f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 --2- 172.21.15.133:0/4261110764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe950005190 0x7fe964151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 >> 172.21.15.133:0/4261110764 conn(0x7fe964069e70 msgr2=0x7fe9640cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 shutdown_connections 2023-12-18T10:19:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:20.937+0000 7fe9688c4640 1 -- 172.21.15.133:0/4261110764 wait complete. 2023-12-18T10:19:20.965 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-18T10:19:21.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbf473640 1 Processor -- start 2023-12-18T10:19:21.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbf473640 1 -- start start 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbf473640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ca200 0x7fccb80ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbf473640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fccb80c89f0 0x7fccb80c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbf473640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb80ad6e0 con 0x7fccb80ce6a0 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbf473640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb8159b20 con 0x7fccb80c89f0 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbf473640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb80ad9c0 con 0x7fccb80ca200 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbd20f640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fccb80ce6a0 0x7fccb80cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54162/0 (socket says 172.21.15.133:54162) 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbd20f640 1 -- 172.21.15.133:0/525800303 learned_addr learned my addr 172.21.15.133:0/525800303 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbca0e640 1 --2- 172.21.15.133:0/525800303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ca200 0x7fccb80ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbda10640 1 --2- 172.21.15.133:0/525800303 >> v2:172.21.15.133:3300/0 conn(0x7fccb80c89f0 0x7fccb80c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccaffff640 1 -- 172.21.15.133:0/525800303 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264821927 0 0) 0x7fccb80ad6e0 con 0x7fccb80ce6a0 2023-12-18T10:19:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccaffff640 1 -- 172.21.15.133:0/525800303 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcca4003530 con 0x7fccb80ce6a0 2023-12-18T10:19:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbda10640 1 -- 172.21.15.133:0/525800303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ca200 msgr2=0x7fccb80ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbda10640 1 --2- 172.21.15.133:0/525800303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ca200 0x7fccb80ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbda10640 1 -- 172.21.15.133:0/525800303 >> v1:172.21.15.133:6789/0 conn(0x7fccb80ce6a0 legacy=0x7fccb80cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbda10640 1 -- 172.21.15.133:0/525800303 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb806be20 con 0x7fccb80c89f0 2023-12-18T10:19:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.121+0000 7fccbca0e640 1 --2- 172.21.15.133:0/525800303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ca200 0x7fccb80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:21.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbda10640 1 --2- 172.21.15.133:0/525800303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80c89f0 0x7fccb80c8e80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009d90 tx=0x7fccb001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adaac2c015074ad4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:21.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccaffff640 1 -- 172.21.15.133:0/525800303 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb00a5a00 con 0x7fccb80c89f0 2023-12-18T10:19:21.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccaffff640 1 -- 172.21.15.133:0/525800303 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb00a5b60 con 0x7fccb80c89f0 2023-12-18T10:19:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccaffff640 1 -- 172.21.15.133:0/525800303 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb00ad440 con 0x7fccb80c89f0 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbf473640 1 -- 172.21.15.133:0/525800303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80c89f0 msgr2=0x7fccb80c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbf473640 1 --2- 172.21.15.133:0/525800303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80c89f0 0x7fccb80c8e80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009d90 tx=0x7fccb001c920 comp rx=0 tx=0).stop 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbf473640 1 -- 172.21.15.133:0/525800303 shutdown_connections 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbf473640 1 --2- 172.21.15.133:0/525800303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80c89f0 0x7fccb80c8e80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbf473640 1 --2- 172.21.15.133:0/525800303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ca200 0x7fccb80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbf473640 1 -- 172.21.15.133:0/525800303 >> 172.21.15.133:0/525800303 conn(0x7fccb8069e70 msgr2=0x7fccb806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbf473640 1 -- 172.21.15.133:0/525800303 shutdown_connections 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.125+0000 7fccbf473640 1 -- 172.21.15.133:0/525800303 wait complete. 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbf473640 1 Processor -- start 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbf473640 1 -- start start 2023-12-18T10:19:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbf473640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80c89f0 0x7fccb8097940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbf473640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80ca200 0x7fccb8157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbf473640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ce6a0 0x7fccb8158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbf473640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb815a8c0 con 0x7fccb80ca200 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbf473640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb8097e80 con 0x7fccb80c89f0 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbf473640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb8150e80 con 0x7fccb80ce6a0 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80ca200 0x7fccb8157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80ca200 0x7fccb8157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40550/0 (socket says 172.21.15.133:40550) 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 -- 172.21.15.133:0/1150389625 learned_addr learned my addr 172.21.15.133:0/1150389625 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbd20f640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80c89f0 0x7fccb8097940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbda10640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ce6a0 0x7fccb8158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 -- 172.21.15.133:0/1150389625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ce6a0 msgr2=0x7fccb8158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ce6a0 0x7fccb8158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 -- 172.21.15.133:0/1150389625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80c89f0 msgr2=0x7fccb8097940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80c89f0 0x7fccb8097940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 -- 172.21.15.133:0/1150389625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca8009420 con 0x7fccb80ca200 2023-12-18T10:19:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccbca0e640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80ca200 0x7fccb8157d50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcca800ebe0 tx=0x7fcca800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.129+0000 7fccadffb640 1 -- 172.21.15.133:0/1150389625 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca800eee0 con 0x7fccb80ca200 2023-12-18T10:19:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccadffb640 1 -- 172.21.15.133:0/1150389625 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca800cc30 con 0x7fccb80ca200 2023-12-18T10:19:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb0009a70 con 0x7fccb80ca200 2023-12-18T10:19:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccadffb640 1 -- 172.21.15.133:0/1150389625 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8013470 con 0x7fccb80ca200 2023-12-18T10:19:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb806cd60 con 0x7fccb80ca200 2023-12-18T10:19:21.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb8151360 con 0x7fccb80ca200 2023-12-18T10:19:21.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccadffb640 1 -- 172.21.15.133:0/1150389625 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcca80135d0 con 0x7fccb80ca200 2023-12-18T10:19:21.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccadffb640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc9c065a60 0x7fcc9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:21.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccadffb640 1 -- 172.21.15.133:0/1150389625 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fcca8083660 con 0x7fccb80ca200 2023-12-18T10:19:21.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccbd20f640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc9c065a60 0x7fcc9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:21.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.133+0000 7fccbd20f640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc9c065a60 0x7fcc9c067f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fccb40011f0 tx=0x7fccb4007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:21.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.137+0000 7fccadffb640 1 -- 172.21.15.133:0/1150389625 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcca8050e70 con 0x7fccb80ca200 2023-12-18T10:19:21.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.289+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fccb804e070 con 0x7fccb80ca200 2023-12-18T10:19:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.949+0000 7fccadffb640 1 -- 172.21.15.133:0/1150389625 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcca8054490 con 0x7fccb80ca200 2023-12-18T10:19:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-18T10:19:21.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc9c065a60 msgr2=0x7fcc9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:21.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc9c065a60 0x7fcc9c067f20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fccb40011f0 tx=0x7fccb4007d40 comp rx=0 tx=0).stop 2023-12-18T10:19:21.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80ca200 msgr2=0x7fccb8157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:21.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80ca200 0x7fccb8157d50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcca800ebe0 tx=0x7fcca800c520 comp rx=0 tx=0).stop 2023-12-18T10:19:21.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 shutdown_connections 2023-12-18T10:19:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc9c065a60 0x7fcc9c067f20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fccb80ce6a0 0x7fccb8158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb80ca200 0x7fccb8157d50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 --2- 172.21.15.133:0/1150389625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb80c89f0 0x7fccb8097940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.957+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 >> 172.21.15.133:0/1150389625 conn(0x7fccb8069e70 msgr2=0x7fccb80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:21.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.961+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 shutdown_connections 2023-12-18T10:19:21.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:21.969+0000 7fccbf473640 1 -- 172.21.15.133:0/1150389625 wait complete. 2023-12-18T10:19:22.005 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-18T10:19:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c54255640 1 Processor -- start 2023-12-18T10:19:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c54255640 1 -- start start 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c54255640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c0ce5d0 0x7f7c4c0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c54255640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c4c06d440 0x7f7c4c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c54255640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c4c15e2d0 0x7f7c4c15e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c54255640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b28a0 con 0x7f7c4c06d440 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c54255640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c0ceef0 con 0x7f7c4c15e2d0 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c54255640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c15ab30 con 0x7f7c4c0ce5d0 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c517f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c4c06d440 0x7f7c4c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c517f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c4c06d440 0x7f7c4c06d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40556/0 (socket says 172.21.15.133:40556) 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c517f0640 1 -- 172.21.15.133:0/61612671 learned_addr learned my addr 172.21.15.133:0/61612671 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c527f2640 1 --2- 172.21.15.133:0/61612671 >> v2:172.21.15.142:3300/0 conn(0x7f7c4c15e2d0 0x7f7c4c15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.145+0000 7f7c51ff1640 1 --2- 172.21.15.133:0/61612671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c0ce5d0 0x7f7c4c0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c517f0640 1 -- 172.21.15.133:0/61612671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c0ce5d0 msgr2=0x7f7c4c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c517f0640 1 --2- 172.21.15.133:0/61612671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c0ce5d0 0x7f7c4c0ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c517f0640 1 -- 172.21.15.133:0/61612671 >> v2:172.21.15.142:3300/0 conn(0x7f7c4c15e2d0 msgr2=0x7f7c4c15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c517f0640 1 --2- 172.21.15.133:0/61612671 >> v2:172.21.15.142:3300/0 conn(0x7f7c4c15e2d0 0x7f7c4c15e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c517f0640 1 -- 172.21.15.133:0/61612671 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0b1c90 con 0x7f7c4c06d440 2023-12-18T10:19:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c527f2640 1 --2- 172.21.15.133:0/61612671 >> v2:172.21.15.142:3300/0 conn(0x7f7c4c15e2d0 0x7f7c4c15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c517f0640 1 --2- 172.21.15.133:0/61612671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c06d8a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0c5400 tx=0x7f7c3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c140f02617c0345 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c50fef640 1 -- 172.21.15.133:0/61612671 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0aa5f0 con 0x7f7c4c06d440 2023-12-18T10:19:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c50fef640 1 -- 172.21.15.133:0/61612671 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0aa750 con 0x7f7c4c06d440 2023-12-18T10:19:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.149+0000 7f7c50fef640 1 -- 172.21.15.133:0/61612671 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0aaae0 con 0x7f7c4c06d440 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- 172.21.15.133:0/61612671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 msgr2=0x7f7c4c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 --2- 172.21.15.133:0/61612671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c06d8a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0c5400 tx=0x7f7c3c01c4d0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- 172.21.15.133:0/61612671 shutdown_connections 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 --2- 172.21.15.133:0/61612671 >> v2:172.21.15.142:3300/0 conn(0x7f7c4c15e2d0 0x7f7c4c15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 --2- 172.21.15.133:0/61612671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c06d8a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 --2- 172.21.15.133:0/61612671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c0ce5d0 0x7f7c4c0ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- 172.21.15.133:0/61612671 >> 172.21.15.133:0/61612671 conn(0x7f7c4c069e70 msgr2=0x7f7c4c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- 172.21.15.133:0/61612671 shutdown_connections 2023-12-18T10:19:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- 172.21.15.133:0/61612671 wait complete. 2023-12-18T10:19:22.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 Processor -- start 2023-12-18T10:19:22.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- start start 2023-12-18T10:19:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c0979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c0ce5d0 0x7f7c4c164e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c15e2d0 0x7f7c4c152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c097f10 con 0x7f7c4c06d440 2023-12-18T10:19:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c164990 con 0x7f7c4c0ce5d0 2023-12-18T10:19:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c54255640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c163d80 con 0x7f7c4c15e2d0 2023-12-18T10:19:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c51ff1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c0979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c51ff1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c0979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40570/0 (socket says 172.21.15.133:40570) 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c51ff1640 1 -- 172.21.15.133:0/2838551795 learned_addr learned my addr 172.21.15.133:0/2838551795 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c527f2640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c15e2d0 0x7f7c4c152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c517f0640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c0ce5d0 0x7f7c4c164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c51ff1640 1 -- 172.21.15.133:0/2838551795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c15e2d0 msgr2=0x7f7c4c152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c51ff1640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c15e2d0 0x7f7c4c152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c51ff1640 1 -- 172.21.15.133:0/2838551795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c0ce5d0 msgr2=0x7f7c4c164e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c51ff1640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c0ce5d0 0x7f7c4c164e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.153+0000 7f7c51ff1640 1 -- 172.21.15.133:0/2838551795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0094d0 con 0x7f7c4c06d440 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c51ff1640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c0979d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7c48007e90 tx=0x7f7c4800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c427fc640 1 -- 172.21.15.133:0/2838551795 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48014420 con 0x7f7c4c06d440 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c427fc640 1 -- 172.21.15.133:0/2838551795 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c48014580 con 0x7f7c4c06d440 2023-12-18T10:19:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c427fc640 1 -- 172.21.15.133:0/2838551795 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48014910 con 0x7f7c4c06d440 2023-12-18T10:19:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c164060 con 0x7f7c4c06d440 2023-12-18T10:19:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c164620 con 0x7f7c4c06d440 2023-12-18T10:19:22.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c04e070 con 0x7f7c4c06d440 2023-12-18T10:19:22.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c427fc640 1 -- 172.21.15.133:0/2838551795 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c48014a70 con 0x7f7c4c06d440 2023-12-18T10:19:22.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c427fc640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c30065a60 0x7f7c30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:22.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c427fc640 1 -- 172.21.15.133:0/2838551795 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f7c48083a60 con 0x7f7c4c06d440 2023-12-18T10:19:22.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.157+0000 7f7c517f0640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c30065a60 0x7f7c30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:22.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.161+0000 7f7c517f0640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c30065a60 0x7f7c30067f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0ae000 tx=0x7f7c3c0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:22.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.161+0000 7f7c427fc640 1 -- 172.21.15.133:0/2838551795 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c480513e0 con 0x7f7c4c06d440 2023-12-18T10:19:22.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.313+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c4c06c630 con 0x7f7c4c06d440 2023-12-18T10:19:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.945+0000 7f7c427fc640 1 -- 172.21.15.133:0/2838551795 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f7c48054a00 con 0x7f7c4c06d440 2023-12-18T10:19:22.948 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data_ec' removed 2023-12-18T10:19:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c30065a60 msgr2=0x7f7c30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c30065a60 0x7f7c30067f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0ae000 tx=0x7f7c3c0b5040 comp rx=0 tx=0).stop 2023-12-18T10:19:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 msgr2=0x7f7c4c0979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c0979d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7c48007e90 tx=0x7f7c4800e4b0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 shutdown_connections 2023-12-18T10:19:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c30065a60 0x7f7c30067f20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c4c15e2d0 0x7f7c4c152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c4c0ce5d0 0x7f7c4c164e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 --2- 172.21.15.133:0/2838551795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c4c06d440 0x7f7c4c0979d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 >> 172.21.15.133:0/2838551795 conn(0x7f7c4c069e70 msgr2=0x7f7c4c06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 shutdown_connections 2023-12-18T10:19:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:22.949+0000 7f7c54255640 1 -- 172.21.15.133:0/2838551795 wait complete. 2023-12-18T10:19:22.975 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-18T10:19:22.975 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-18T10:19:22.975 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-18T10:19:22.976 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:19:22.976 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-18T10:19:22.976 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-18T10:19:22.976 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-18T10:19:22.976 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:19:22.976 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-18T10:19:22.976 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-18T10:19:22.977 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-18T10:19:22.977 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:19:22.977 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-18T10:19:22.977 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-18T10:19:22.977 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-18T10:19:22.977 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:19:22.991 INFO:tasks.ceph.mds.b:Stopped 2023-12-18T10:19:22.992 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-18T10:19:22.993 INFO:tasks.ceph.mds.a:Stopped 2023-12-18T10:19:22.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-18T10:19:22.994 INFO:tasks.ceph.mds.d:Stopped 2023-12-18T10:19:22.994 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-18T10:19:22.995 INFO:tasks.ceph.mds.c:Stopped 2023-12-18T10:19:22.995 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-18T10:19:23.037 INFO:tasks.ceph.mds.a:Started 2023-12-18T10:19:23.037 DEBUG:teuthology.parallel:result is None 2023-12-18T10:19:23.039 INFO:tasks.ceph.mds.c:Started 2023-12-18T10:19:23.039 DEBUG:teuthology.parallel:result is None 2023-12-18T10:19:23.042 INFO:tasks.ceph.mds.b:Started 2023-12-18T10:19:23.042 DEBUG:teuthology.parallel:result is None 2023-12-18T10:19:23.044 INFO:tasks.ceph.mds.d:Started 2023-12-18T10:19:23.045 DEBUG:teuthology.parallel:result is None 2023-12-18T10:19:23.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-18T10:19:23.128 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:19:23.128 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:19:23.132 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:19:23.133 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:19:23.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87eb98f640 1 Processor -- start 2023-12-18T10:19:23.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87eb98f640 1 -- start start 2023-12-18T10:19:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87eb98f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e4158c70 0x7f87e415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87eb98f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f87e406e500 0x7f87e40ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87eb98f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e406e070 con 0x7f87e415c7e0 2023-12-18T10:19:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87eb98f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e40cea00 con 0x7f87e406e500 2023-12-18T10:19:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87eb98f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e406d4a0 con 0x7f87e4158c70 2023-12-18T10:19:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87e9f2c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f87e415c7e0 0x7f87e4069ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54180/0 (socket says 172.21.15.133:54180) 2023-12-18T10:19:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87e9f2c640 1 -- 172.21.15.133:0/2070923845 learned_addr learned my addr 172.21.15.133:0/2070923845 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87e8f2a640 1 --2- 172.21.15.133:0/2070923845 >> v2:172.21.15.142:3300/0 conn(0x7f87e406e500 0x7f87e40ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87e972b640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e4158c70 0x7f87e415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241578468 0 0) 0x7f87e406e070 con 0x7f87e415c7e0 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d0003530 con 0x7f87e415c7e0 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773374616 0 0) 0x7f87d0003530 con 0x7f87e415c7e0 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e4158c70 msgr2=0x7f87e415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e4158c70 0x7f87e415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 >> v2:172.21.15.142:3300/0 conn(0x7f87e406e500 msgr2=0x7f87e40ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 --2- 172.21.15.133:0/2070923845 >> v2:172.21.15.142:3300/0 conn(0x7f87e406e500 0x7f87e40ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e4159050 con 0x7f87e415c7e0 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f87dc001a00 con 0x7f87e415c7e0 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.213+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 >> v1:172.21.15.133:6789/0 conn(0x7f87e415c7e0 legacy=0x7f87e4069ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e4158c70 0x7f87d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87d0004d10 0x7f87d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40cea00 con 0x7f87d0003980 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e406d4a0 con 0x7f87d0004d10 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d000b990 con 0x7f87e4158c70 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e8f2a640 1 --2- 172.21.15.133:0/2070923845 >> v2:172.21.15.142:3300/0 conn(0x7f87e406e500 0x7f87e40ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e972b640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e9f2c640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87d0004d10 0x7f87d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e8f2a640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e4158c70 0x7f87d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e972b640 1 -- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e4158c70 msgr2=0x7f87d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e972b640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e4158c70 0x7f87d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e972b640 1 -- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87d0004d10 msgr2=0x7f87d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e972b640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87d0004d10 0x7f87d0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:23.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e972b640 1 -- 172.21.15.133:0/2070923845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0003530 con 0x7f87d0003980 2023-12-18T10:19:23.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87e972b640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87d0003da0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009ae0 tx=0x7f87e001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5942977160c03d77 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00a6510 con 0x7f87d0003980 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e00a6670 con 0x7f87d0003980 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.217+0000 7f87dbfff640 1 -- 172.21.15.133:0/2070923845 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00a6a20 con 0x7f87d0003980 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- 172.21.15.133:0/2070923845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 msgr2=0x7f87d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 --2- 172.21.15.133:0/2070923845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87d0003da0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009ae0 tx=0x7f87e001ca20 comp rx=0 tx=0).stop 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e9f2c640 1 -- 172.21.15.133:0/2070923845 reap_dead start 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- 172.21.15.133:0/2070923845 shutdown_connections 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- 172.21.15.133:0/2070923845 >> 172.21.15.133:0/2070923845 conn(0x7f87e40cb610 msgr2=0x7f87e40cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- 172.21.15.133:0/2070923845 shutdown_connections 2023-12-18T10:19:23.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- 172.21.15.133:0/2070923845 wait complete. 2023-12-18T10:19:23.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 Processor -- start 2023-12-18T10:19:23.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- start start 2023-12-18T10:19:23.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87e41583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e41559b0 0x7f87e40c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87e40ca130 0x7f87e40ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40caaf0 con 0x7f87d0003980 2023-12-18T10:19:23.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40c30a0 con 0x7f87e40ca130 2023-12-18T10:19:23.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87eb98f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4155f00 con 0x7f87e41559b0 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e972b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87e41583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e972b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87e41583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40616/0 (socket says 172.21.15.133:40616) 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e972b640 1 -- 172.21.15.133:0/1880736300 learned_addr learned my addr 172.21.15.133:0/1880736300 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e8f2a640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e41559b0 0x7f87e40c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e9f2c640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87e40ca130 0x7f87e40ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e972b640 1 -- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e41559b0 msgr2=0x7f87e40c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e972b640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e41559b0 0x7f87e40c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e972b640 1 -- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87e40ca130 msgr2=0x7f87e40ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.221+0000 7f87e972b640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87e40ca130 0x7f87e40ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87e972b640 1 -- 172.21.15.133:0/1880736300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e41561e0 con 0x7f87d0003980 2023-12-18T10:19:23.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87e8f2a640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e41559b0 0x7f87e40c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87e972b640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87e41583e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f87e001c850 tx=0x7f87d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87d9ffb640 1 -- 172.21.15.133:0/1880736300 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000f0c0 con 0x7f87d0003980 2023-12-18T10:19:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87d9ffb640 1 -- 172.21.15.133:0/1880736300 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e00a67e0 con 0x7f87d0003980 2023-12-18T10:19:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e41564c0 con 0x7f87d0003980 2023-12-18T10:19:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87d9ffb640 1 -- 172.21.15.133:0/1880736300 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00a6b90 con 0x7f87d0003980 2023-12-18T10:19:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e40c5350 con 0x7f87d0003980 2023-12-18T10:19:23.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e404e000 con 0x7f87d0003980 2023-12-18T10:19:23.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.225+0000 7f87d9ffb640 1 -- 172.21.15.133:0/1880736300 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f87e00a6cf0 con 0x7f87d0003980 2023-12-18T10:19:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.229+0000 7f87d9ffb640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f87c8065a60 0x7f87c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.229+0000 7f87d9ffb640 1 -- 172.21.15.133:0/1880736300 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f87e00aa070 con 0x7f87d0003980 2023-12-18T10:19:23.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.229+0000 7f87e8f2a640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f87c8065a60 0x7f87c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:23.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.229+0000 7f87e8f2a640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f87c8065a60 0x7f87c8067f20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f87e41520c0 tx=0x7f87d4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:23.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.233+0000 7f87d9ffb640 1 -- 172.21.15.133:0/1880736300 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f87e00eb810 con 0x7f87d0003980 2023-12-18T10:19:23.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:23.397+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f87e40b4b10 con 0x7f87d0003980 2023-12-18T10:19:24.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.165+0000 7f87d9ffb640 1 -- 172.21.15.133:0/1880736300 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f87e00eee30 con 0x7f87d0003980 2023-12-18T10:19:24.170 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f87c8065a60 msgr2=0x7f87c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f87c8065a60 0x7f87c8067f20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f87e41520c0 tx=0x7f87d4009190 comp rx=0 tx=0).stop 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 msgr2=0x7f87e41583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87e41583e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f87e001c850 tx=0x7f87d0005800 comp rx=0 tx=0).stop 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 shutdown_connections 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f87c8065a60 0x7f87c8067f20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87e40ca130 0x7f87e40ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f87e41559b0 0x7f87e40c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 --2- 172.21.15.133:0/1880736300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87d0003980 0x7f87e41583e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 >> 172.21.15.133:0/1880736300 conn(0x7f87e40cb610 msgr2=0x7f87e4154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:24.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 shutdown_connections 2023-12-18T10:19:24.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.169+0000 7f87eb98f640 1 -- 172.21.15.133:0/1880736300 wait complete. 2023-12-18T10:19:24.197 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-18T10:19:24.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41d0d7640 1 Processor -- start 2023-12-18T10:19:24.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41d0d7640 1 -- start start 2023-12-18T10:19:24.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41d0d7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4180cf670 0x7fa418167280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41d0d7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4180b65c0 con 0x7fa41815c730 2023-12-18T10:19:24.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41d0d7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41815cb10 con 0x7fa4180cea00 2023-12-18T10:19:24.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41d0d7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4180cd960 con 0x7fa4180cf670 2023-12-18T10:19:24.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa417fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa41815c730 0x7fa4180b7f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54194/0 (socket says 172.21.15.133:54194) 2023-12-18T10:19:24.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa417fff640 1 -- 172.21.15.133:0/964558990 learned_addr learned my addr 172.21.15.133:0/964558990 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:24.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41c8d6640 1 --2- 172.21.15.133:0/964558990 >> v2:172.21.15.142:3300/0 conn(0x7fa4180cf670 0x7fa418167280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa416ffd640 1 -- 172.21.15.133:0/964558990 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415794886 0 0) 0x7fa4180b65c0 con 0x7fa41815c730 2023-12-18T10:19:24.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa416ffd640 1 -- 172.21.15.133:0/964558990 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa400003530 con 0x7fa41815c730 2023-12-18T10:19:24.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41c8d6640 1 -- 172.21.15.133:0/964558990 >> v1:172.21.15.142:6789/0 conn(0x7fa4180cea00 legacy=0x7fa4180cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41c8d6640 1 -- 172.21.15.133:0/964558990 >> v1:172.21.15.133:6789/0 conn(0x7fa41815c730 legacy=0x7fa4180b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.337+0000 7fa41c8d6640 1 -- 172.21.15.133:0/964558990 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4180cdc40 con 0x7fa4180cf670 2023-12-18T10:19:24.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa41c8d6640 1 --2- 172.21.15.133:0/964558990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 0x7fa418167280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa410009d90 tx=0x7fa41001f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63b4d60fdbd17d7f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:24.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa416ffd640 1 -- 172.21.15.133:0/964558990 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100af600 con 0x7fa4180cf670 2023-12-18T10:19:24.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa416ffd640 1 -- 172.21.15.133:0/964558990 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4100ab050 con 0x7fa4180cf670 2023-12-18T10:19:24.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa416ffd640 1 -- 172.21.15.133:0/964558990 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100af980 con 0x7fa4180cf670 2023-12-18T10:19:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa41d0d7640 1 -- 172.21.15.133:0/964558990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 msgr2=0x7fa418167280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa41d0d7640 1 --2- 172.21.15.133:0/964558990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 0x7fa418167280 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa410009d90 tx=0x7fa41001f130 comp rx=0 tx=0).stop 2023-12-18T10:19:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa41d0d7640 1 -- 172.21.15.133:0/964558990 shutdown_connections 2023-12-18T10:19:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa41d0d7640 1 --2- 172.21.15.133:0/964558990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 0x7fa418167280 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa41d0d7640 1 -- 172.21.15.133:0/964558990 >> 172.21.15.133:0/964558990 conn(0x7fa41806b120 msgr2=0x7fa41806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa41d0d7640 1 -- 172.21.15.133:0/964558990 shutdown_connections 2023-12-18T10:19:24.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.341+0000 7fa41d0d7640 1 -- 172.21.15.133:0/964558990 wait complete. 2023-12-18T10:19:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 Processor -- start 2023-12-18T10:19:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 -- start start 2023-12-18T10:19:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4180cea00 0x7fa41815d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 0x7fa41815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41815c730 0x7fa41815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41815cd20 con 0x7fa41815c730 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180c86f0 con 0x7fa4180cf670 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180c89b0 con 0x7fa4180cea00 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41815c730 0x7fa41815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41815c730 0x7fa41815df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40626/0 (socket says 172.21.15.133:40626) 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 -- 172.21.15.133:0/2634465795 learned_addr learned my addr 172.21.15.133:0/2634465795 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:24.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa4177fe640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 0x7fa41815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa417fff640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4180cea00 0x7fa41815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 -- 172.21.15.133:0/2634465795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4180cea00 msgr2=0x7fa41815d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4180cea00 0x7fa41815d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 -- 172.21.15.133:0/2634465795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 msgr2=0x7fa41815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 0x7fa41815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 -- 172.21.15.133:0/2634465795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410009a70 con 0x7fa41815c730 2023-12-18T10:19:24.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41c8d6640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41815c730 0x7fa41815df10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa4100b2040 tx=0x7fa41001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa414ff9640 1 -- 172.21.15.133:0/2634465795 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410009450 con 0x7fa41815c730 2023-12-18T10:19:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa414ff9640 1 -- 172.21.15.133:0/2634465795 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4100b9410 con 0x7fa41815c730 2023-12-18T10:19:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa414ff9640 1 -- 172.21.15.133:0/2634465795 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100b97c0 con 0x7fa41815c730 2023-12-18T10:19:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4180c8c90 con 0x7fa41815c730 2023-12-18T10:19:24.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4180c83b0 con 0x7fa41815c730 2023-12-18T10:19:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.345+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa418066c50 con 0x7fa41815c730 2023-12-18T10:19:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.349+0000 7fa414ff9640 1 -- 172.21.15.133:0/2634465795 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa4100b6050 con 0x7fa41815c730 2023-12-18T10:19:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.349+0000 7fa414ff9640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa404065a60 0x7fa404067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.349+0000 7fa414ff9640 1 -- 172.21.15.133:0/2634465795 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa410121540 con 0x7fa41815c730 2023-12-18T10:19:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.349+0000 7fa417fff640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa404065a60 0x7fa404067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.349+0000 7fa417fff640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa404065a60 0x7fa404067f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa408005890 tx=0x7fa408009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:24.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.353+0000 7fa414ff9640 1 -- 172.21.15.133:0/2634465795 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa4100ef1b0 con 0x7fa41815c730 2023-12-18T10:19:24.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.553+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa41804e850 con 0x7fa41815c730 2023-12-18T10:19:24.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa414ff9640 1 -- 172.21.15.133:0/2634465795 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa4100f27d0 con 0x7fa41815c730 2023-12-18T10:19:24.558 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlq/3QHRAAeGrWPAL1IMuRSsb9HM8t0Q==", 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBleUoUKhAA7KQ881Hp59b6BfYF5Mc8Rw==", 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlsRoJJRAAYgbCztPYO/qzR7wJgYhPqQ==", 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:19:24.560 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlr0paMRAAUlbr607Vw8Yc0/S1EvLUUA==", 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.561 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAgHIBlbTjYDhAA2KUnOrWIaGtzxXx9T64djw==", 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjHIBlr8a1FhAAGRT54akJvp65F8xxu9Mw1g==", 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:19:24.562 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAmHIBlv+HSHBAAxDHSTox1AtpTMfCNbatjzA==", 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.563 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApHIBlj5xPIxAAkZglsOO2rg+8kXVIb+JK+w==", 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAvHIBlhQRmKxAAahzzO4gYz5LHWhvFvZlOAA==", 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.564 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyHIBlatiUMhAAk0X1zO+dYOu5hMZvGBJNkQ==", 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-18T10:19:24.565 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1HIBl86v0OBAA70FwnvAugWtLupto+cbBjg==", 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA5HIBlZAYVBBAAa0V4jDTdYV8TBoNR7SenjQ==", 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.566 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlugNkNRAADsDapfYnOr+gcvgQ4394aA==", 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlM7J1AxAAgoKo5xm3Wz4xWjPX4Mpn0A==", 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlrzVcOxAAwwd6eFzNGehg/4chJq1qJA==", 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:19:24.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlRgxmCRAAN/aEmPSonvc17SvLB1GdXQ==", 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAbHIBlJHzPORAAQupFGwV6/izxeyNlnyeMSA==", 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mds", 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBEHIBlVXP1BRAAw8hOsLSlXpSx83NAbCmCEg==", 2023-12-18T10:19:24.570 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mds" 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mgr", 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBEHIBlSX31BRAA/ANwJieS60W9OEjxACxeoQ==", 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-osd", 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBEHIBlY4b1BRAAe+u0HFqaizZNIYo9Kk/lNA==", 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.571 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-osd" 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd", 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBEHIBlmo/1BRAAakEVAbEtscV8mTkNT1m8ZA==", 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBEHIBlgZj1BRAA/QXXbwT6G2BiEkhYAFYOag==", 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.572 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rgw", 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBEHIBlO6b1BRAAkqNwxDezKyffjabzxMl0cQ==", 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlDP4UFhAA8KB7vRFpeBSRad2GRiKh/A==", 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.573 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBl+lIiEhAAx9zNJbwPBf7oGsFzDJKxEw==", 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:24.574 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-18T10:19:24.575 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa404065a60 msgr2=0x7fa404067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa404065a60 0x7fa404067f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa408005890 tx=0x7fa408009040 comp rx=0 tx=0).stop 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41815c730 msgr2=0x7fa41815df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41815c730 0x7fa41815df10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa4100b2040 tx=0x7fa41001bed0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 shutdown_connections 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa404065a60 0x7fa404067f20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41815c730 0x7fa41815df10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4180cf670 0x7fa41815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 --2- 172.21.15.133:0/2634465795 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4180cea00 0x7fa41815d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 >> 172.21.15.133:0/2634465795 conn(0x7fa41806b120 msgr2=0x7fa41815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 shutdown_connections 2023-12-18T10:19:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.557+0000 7fa41d0d7640 1 -- 172.21.15.133:0/2634465795 wait complete. 2023-12-18T10:19:24.580 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-18T10:19:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cb4a41640 1 Processor -- start 2023-12-18T10:19:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cb4a41640 1 -- start start 2023-12-18T10:19:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cb4a41640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1cb00704c0 0x7f1cb015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cb4a41640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb015f100 con 0x7f1cb00cac10 2023-12-18T10:19:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cb4a41640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb00ca7d0 con 0x7f1cb015a680 2023-12-18T10:19:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cb4a41640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb015e860 con 0x7f1cb00704c0 2023-12-18T10:19:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1caed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1cb00704c0 0x7f1cb015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cadd9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1cb00cac10 0x7f1cb006fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54198/0 (socket says 172.21.15.133:54198) 2023-12-18T10:19:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cadd9b640 1 -- 172.21.15.133:0/3867651465 learned_addr learned my addr 172.21.15.133:0/3867651465 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1caed9d640 1 -- 172.21.15.133:0/3867651465 >> v1:172.21.15.142:6789/0 conn(0x7f1cb015a680 legacy=0x7f1cb015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1caed9d640 1 -- 172.21.15.133:0/3867651465 >> v1:172.21.15.133:6789/0 conn(0x7f1cb00cac10 legacy=0x7f1cb006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1cad59a640 1 -- 172.21.15.133:0/3867651465 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370910595 0 0) 0x7f1cb015f100 con 0x7f1cb00cac10 2023-12-18T10:19:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.717+0000 7f1caed9d640 1 -- 172.21.15.133:0/3867651465 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb015eb40 con 0x7f1cb00704c0 2023-12-18T10:19:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1caed9d640 1 --2- 172.21.15.133:0/3867651465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb015e160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80097c0 tx=0x7f1ca801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e63e29ac5d6edc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cad59a640 1 -- 172.21.15.133:0/3867651465 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80ab5f0 con 0x7f1cb00704c0 2023-12-18T10:19:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cad59a640 1 -- 172.21.15.133:0/3867651465 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca80ab750 con 0x7f1cb00704c0 2023-12-18T10:19:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cad59a640 1 -- 172.21.15.133:0/3867651465 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80abae0 con 0x7f1cb00704c0 2023-12-18T10:19:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cb4a41640 1 -- 172.21.15.133:0/3867651465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 msgr2=0x7f1cb015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cb4a41640 1 --2- 172.21.15.133:0/3867651465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb015e160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80097c0 tx=0x7f1ca801c3f0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cb4a41640 1 -- 172.21.15.133:0/3867651465 shutdown_connections 2023-12-18T10:19:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cb4a41640 1 --2- 172.21.15.133:0/3867651465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb015e160 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cb4a41640 1 -- 172.21.15.133:0/3867651465 >> 172.21.15.133:0/3867651465 conn(0x7f1cb006a3e0 msgr2=0x7f1cb00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cb4a41640 1 -- 172.21.15.133:0/3867651465 shutdown_connections 2023-12-18T10:19:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.721+0000 7f1cb4a41640 1 -- 172.21.15.133:0/3867651465 wait complete. 2023-12-18T10:19:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cb4a41640 1 Processor -- start 2023-12-18T10:19:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cb4a41640 1 -- start start 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cb4a41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb00c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cb4a41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb0158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cb4a41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb0158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cb4a41640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00cd210 con 0x7f1cb00704c0 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cb4a41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00c81d0 con 0x7f1cb015a680 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cb4a41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00c7d40 con 0x7f1cb00cac10 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb00c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1caed9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb0158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb00c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40646/0 (socket says 172.21.15.133:40646) 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 -- 172.21.15.133:0/622062744 learned_addr learned my addr 172.21.15.133:0/622062744 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cadd9b640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb0158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 -- 172.21.15.133:0/622062744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 msgr2=0x7f1cb0158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb0158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 -- 172.21.15.133:0/622062744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 msgr2=0x7f1cb0158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb0158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 -- 172.21.15.133:0/622062744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca8009420 con 0x7f1cb00704c0 2023-12-18T10:19:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.725+0000 7f1cae59c640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb00c6930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000c7d0 tx=0x7f1ca000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1c9effd640 1 -- 172.21.15.133:0/622062744 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0003b80 con 0x7f1cb00704c0 2023-12-18T10:19:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1c9effd640 1 -- 172.21.15.133:0/622062744 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca0003ce0 con 0x7f1cb00704c0 2023-12-18T10:19:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1c9effd640 1 -- 172.21.15.133:0/622062744 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca000aa30 con 0x7f1cb00704c0 2023-12-18T10:19:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb00c6e70 con 0x7f1cb00704c0 2023-12-18T10:19:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb00c7410 con 0x7f1cb00704c0 2023-12-18T10:19:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb00735b0 con 0x7f1cb00704c0 2023-12-18T10:19:24.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1c9effd640 1 -- 172.21.15.133:0/622062744 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ca000ab90 con 0x7f1cb00704c0 2023-12-18T10:19:24.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1c9effd640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c90065a60 0x7f1c90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:24.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1c9effd640 1 -- 172.21.15.133:0/622062744 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1ca0082be0 con 0x7f1cb00704c0 2023-12-18T10:19:24.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.729+0000 7f1cadd9b640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c90065a60 0x7f1c90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:24.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.733+0000 7f1cadd9b640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c90065a60 0x7f1c90067f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00cd3c0 tx=0x7f1ca4007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:24.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.733+0000 7f1c9effd640 1 -- 172.21.15.133:0/622062744 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1ca0050860 con 0x7f1cb00704c0 2023-12-18T10:19:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.937+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f1cb004e000 con 0x7f1cb00704c0 2023-12-18T10:19:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.945+0000 7f1c9effd640 1 -- 172.21.15.133:0/622062744 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1ca0053e80 con 0x7f1cb00704c0 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c90065a60 msgr2=0x7f1c90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c90065a60 0x7f1c90067f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00cd3c0 tx=0x7f1ca4007240 comp rx=0 tx=0).stop 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 msgr2=0x7f1cb00c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb00c6930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1ca000c7d0 tx=0x7f1ca000cc90 comp rx=0 tx=0).stop 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 shutdown_connections 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c90065a60 0x7f1c90067f20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1cb015a680 0x7f1cb0158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1cb00cac10 0x7f1cb0158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 --2- 172.21.15.133:0/622062744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00704c0 0x7f1cb00c6930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 >> 172.21.15.133:0/622062744 conn(0x7f1cb006a3e0 msgr2=0x7f1cb006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 shutdown_connections 2023-12-18T10:19:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:24.949+0000 7f1cb4a41640 1 -- 172.21.15.133:0/622062744 wait complete. 2023-12-18T10:19:24.971 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-18T10:19:25.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.105+0000 7f7c223a2640 1 Processor -- start 2023-12-18T10:19:25.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.105+0000 7f7c223a2640 1 -- start start 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c223a2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c1c0cd480 0x7f7c1c167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c223a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c1608d0 con 0x7f7c1c0ce400 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c223a2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c160ba0 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c223a2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1c161160 con 0x7f7c1c0cd480 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c21ba1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c1c0cd480 0x7f7c1c167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c213a0640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7c1c0ce400 0x7f7c1c1601c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54202/0 (socket says 172.21.15.133:54202) 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c213a0640 1 -- 172.21.15.133:0/672076723 learned_addr learned my addr 172.21.15.133:0/672076723 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c21ba1640 1 -- 172.21.15.133:0/672076723 >> v1:172.21.15.142:6789/0 conn(0x7f7c1c0ce7e0 legacy=0x7f7c1c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c21ba1640 1 -- 172.21.15.133:0/672076723 >> v1:172.21.15.133:6789/0 conn(0x7f7c1c0ce400 legacy=0x7f7c1c1601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c21ba1640 1 -- 172.21.15.133:0/672076723 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c160e80 con 0x7f7c1c0cd480 2023-12-18T10:19:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c21ba1640 1 --2- 172.21.15.133:0/672076723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0cd480 0x7f7c1c167550 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009d90 tx=0x7f7c1401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94842d6f117752f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c13fff640 1 -- 172.21.15.133:0/672076723 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140a5950 con 0x7f7c1c0cd480 2023-12-18T10:19:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c13fff640 1 -- 172.21.15.133:0/672076723 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c140a5ab0 con 0x7f7c1c0cd480 2023-12-18T10:19:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.109+0000 7f7c13fff640 1 -- 172.21.15.133:0/672076723 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140a5e40 con 0x7f7c1c0cd480 2023-12-18T10:19:25.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- 172.21.15.133:0/672076723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0cd480 msgr2=0x7f7c1c167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 --2- 172.21.15.133:0/672076723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0cd480 0x7f7c1c167550 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009d90 tx=0x7f7c1401c890 comp rx=0 tx=0).stop 2023-12-18T10:19:25.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- 172.21.15.133:0/672076723 shutdown_connections 2023-12-18T10:19:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 --2- 172.21.15.133:0/672076723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0cd480 0x7f7c1c167550 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- 172.21.15.133:0/672076723 >> 172.21.15.133:0/672076723 conn(0x7f7c1c069ca0 msgr2=0x7f7c1c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- 172.21.15.133:0/672076723 shutdown_connections 2023-12-18T10:19:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- 172.21.15.133:0/672076723 wait complete. 2023-12-18T10:19:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 Processor -- start 2023-12-18T10:19:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- start start 2023-12-18T10:19:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c0cd480 0x7f7c1c156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c0ce400 0x7f7c1c0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0ce7e0 0x7f7c1c0abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c0c6140 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c0ac5f0 con 0x7f7c1c0cd480 2023-12-18T10:19:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c223a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c0af310 con 0x7f7c1c0ce400 2023-12-18T10:19:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c21ba1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0ce7e0 0x7f7c1c0abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c21ba1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0ce7e0 0x7f7c1c0abde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40664/0 (socket says 172.21.15.133:40664) 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c21ba1640 1 -- 172.21.15.133:0/2242339057 learned_addr learned my addr 172.21.15.133:0/2242339057 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c213a0640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c0cd480 0x7f7c1c156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c21ba1640 1 -- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c0ce400 msgr2=0x7f7c1c0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.113+0000 7f7c20b9f640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c0ce400 0x7f7c1c0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c21ba1640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c0ce400 0x7f7c1c0ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c21ba1640 1 -- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c0cd480 msgr2=0x7f7c1c156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c21ba1640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c0cd480 0x7f7c1c156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c21ba1640 1 -- 172.21.15.133:0/2242339057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14009a70 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c213a0640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c0cd480 0x7f7c1c156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c20b9f640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c0ce400 0x7f7c1c0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c21ba1640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0ce7e0 0x7f7c1c0abde0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7c1401a4c0 tx=0x7f7c14019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c11ffb640 1 -- 172.21.15.133:0/2242339057 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140addc0 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c11ffb640 1 -- 172.21.15.133:0/2242339057 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c140b9450 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1c0c5810 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c11ffb640 1 -- 172.21.15.133:0/2242339057 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140b97e0 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1c0c5dd0 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1c0c62b0 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c11ffb640 1 -- 172.21.15.133:0/2242339057 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c140b9940 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c11ffb640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c00065a60 0x7f7c00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c11ffb640 1 -- 172.21.15.133:0/2242339057 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7c1411e8b0 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.117+0000 7f7c213a0640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c00065a60 0x7f7c00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.121+0000 7f7c213a0640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c00065a60 0x7f7c00067f20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005890 tx=0x7f7c18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.125+0000 7f7c11ffb640 1 -- 172.21.15.133:0/2242339057 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c140ec3e0 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.329+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7c1c04e850 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c11ffb640 1 -- 172.21.15.133:0/2242339057 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c140efa00 con 0x7f7c1c0ce7e0 2023-12-18T10:19:25.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c00065a60 msgr2=0x7f7c00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c00065a60 0x7f7c00067f20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005890 tx=0x7f7c18009040 comp rx=0 tx=0).stop 2023-12-18T10:19:25.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0ce7e0 msgr2=0x7f7c1c0abde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0ce7e0 0x7f7c1c0abde0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7c1401a4c0 tx=0x7f7c14019630 comp rx=0 tx=0).stop 2023-12-18T10:19:25.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 shutdown_connections 2023-12-18T10:19:25.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7c00065a60 0x7f7c00067f20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c1c0ce7e0 0x7f7c1c0abde0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c0ce400 0x7f7c1c0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 --2- 172.21.15.133:0/2242339057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c0cd480 0x7f7c1c156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 >> 172.21.15.133:0/2242339057 conn(0x7f7c1c069ca0 msgr2=0x7f7c1c159620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:25.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 shutdown_connections 2023-12-18T10:19:25.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.337+0000 7f7c223a2640 1 -- 172.21.15.133:0/2242339057 wait complete. 2023-12-18T10:19:25.359 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-18T10:19:25.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.493+0000 7f47a968c640 1 Processor -- start 2023-12-18T10:19:25.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.493+0000 7f47a968c640 1 -- start start 2023-12-18T10:19:25.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a968c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f47a4157080 0x7f47a40ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a968c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40cd730 0x7f47a40ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a968c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a40d05b0 0x7f47a40d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a968c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a4157460 con 0x7f47a40d05b0 2023-12-18T10:19:25.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a968c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40d1320 con 0x7f47a4157080 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a968c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40cc970 con 0x7f47a40cd730 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a40d05b0 0x7f47a40d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a40d05b0 0x7f47a40d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40678/0 (socket says 172.21.15.133:40678) 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 -- 172.21.15.133:0/1508362739 learned_addr learned my addr 172.21.15.133:0/1508362739 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a27fc640 1 --2- 172.21.15.133:0/1508362739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40cd730 0x7f47a40ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a2ffd640 1 --2- 172.21.15.133:0/1508362739 >> v2:172.21.15.142:3300/0 conn(0x7f47a4157080 0x7f47a40ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 -- 172.21.15.133:0/1508362739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40cd730 msgr2=0x7f47a40ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 --2- 172.21.15.133:0/1508362739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40cd730 0x7f47a40ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 -- 172.21.15.133:0/1508362739 >> v2:172.21.15.142:3300/0 conn(0x7f47a4157080 msgr2=0x7f47a40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 --2- 172.21.15.133:0/1508362739 >> v2:172.21.15.142:3300/0 conn(0x7f47a4157080 0x7f47a40ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 -- 172.21.15.133:0/1508362739 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a40ccc50 con 0x7f47a40d05b0 2023-12-18T10:19:25.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.497+0000 7f47a37fe640 1 --2- 172.21.15.133:0/1508362739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40d05b0 0x7f47a40d0a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f47a40cdee0 tx=0x7f479c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d76b573434308c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a1ffb640 1 -- 172.21.15.133:0/1508362739 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0a5820 con 0x7f47a40d05b0 2023-12-18T10:19:25.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a1ffb640 1 -- 172.21.15.133:0/1508362739 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c0a5980 con 0x7f47a40d05b0 2023-12-18T10:19:25.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a1ffb640 1 -- 172.21.15.133:0/1508362739 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0a5d10 con 0x7f47a40d05b0 2023-12-18T10:19:25.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- 172.21.15.133:0/1508362739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40d05b0 msgr2=0x7f47a40d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 --2- 172.21.15.133:0/1508362739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40d05b0 0x7f47a40d0a60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f47a40cdee0 tx=0x7f479c01c9a0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- 172.21.15.133:0/1508362739 shutdown_connections 2023-12-18T10:19:25.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 --2- 172.21.15.133:0/1508362739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40d05b0 0x7f47a40d0a60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 --2- 172.21.15.133:0/1508362739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40cd730 0x7f47a40ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 --2- 172.21.15.133:0/1508362739 >> v2:172.21.15.142:3300/0 conn(0x7f47a4157080 0x7f47a40ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- 172.21.15.133:0/1508362739 >> 172.21.15.133:0/1508362739 conn(0x7f47a4069ca0 msgr2=0x7f47a406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:25.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- 172.21.15.133:0/1508362739 shutdown_connections 2023-12-18T10:19:25.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- 172.21.15.133:0/1508362739 wait complete. 2023-12-18T10:19:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 Processor -- start 2023-12-18T10:19:25.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- start start 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a40cd730 0x7f47a414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40d05b0 0x7f47a415dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a4157080 0x7f47a415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a415fed0 con 0x7f47a4157080 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a414bb90 con 0x7f47a40cd730 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.501+0000 7f47a968c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a415fbf0 con 0x7f47a40d05b0 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a4157080 0x7f47a415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a2ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a40cd730 0x7f47a414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a2ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a40cd730 0x7f47a414b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:58022/0 (socket says 172.21.15.133:58022) 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a4157080 0x7f47a415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40688/0 (socket says 172.21.15.133:40688) 2023-12-18T10:19:25.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a2ffd640 1 -- 172.21.15.133:0/2739930186 learned_addr learned my addr 172.21.15.133:0/2739930186 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:25.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a27fc640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40d05b0 0x7f47a415dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a37fe640 1 -- 172.21.15.133:0/2739930186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40d05b0 msgr2=0x7f47a415dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a37fe640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40d05b0 0x7f47a415dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a37fe640 1 -- 172.21.15.133:0/2739930186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a40cd730 msgr2=0x7f47a414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a37fe640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a40cd730 0x7f47a414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a37fe640 1 -- 172.21.15.133:0/2739930186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c009b30 con 0x7f47a4157080 2023-12-18T10:19:25.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a37fe640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a4157080 0x7f47a415e520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f479c0ab000 tx=0x7f479c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f478b7fe640 1 -- 172.21.15.133:0/2739930186 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0b8670 con 0x7f47a4157080 2023-12-18T10:19:25.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f478b7fe640 1 -- 172.21.15.133:0/2739930186 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c0b87d0 con 0x7f47a4157080 2023-12-18T10:19:25.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a415edb0 con 0x7f47a4157080 2023-12-18T10:19:25.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f478b7fe640 1 -- 172.21.15.133:0/2739930186 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0b8b80 con 0x7f47a4157080 2023-12-18T10:19:25.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a415f370 con 0x7f47a4157080 2023-12-18T10:19:25.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a40d0d40 con 0x7f47a4157080 2023-12-18T10:19:25.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f478b7fe640 1 -- 172.21.15.133:0/2739930186 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f479c0b8ce0 con 0x7f47a4157080 2023-12-18T10:19:25.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.505+0000 7f478b7fe640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4790065a60 0x7f4790067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.509+0000 7f478b7fe640 1 -- 172.21.15.133:0/2739930186 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f479c11e3d0 con 0x7f47a4157080 2023-12-18T10:19:25.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.509+0000 7f47a2ffd640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4790065a60 0x7f4790067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.509+0000 7f47a2ffd640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4790065a60 0x7f4790067f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4794009b80 tx=0x7f4794009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.509+0000 7f478b7fe640 1 -- 172.21.15.133:0/2739930186 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f479c0ec0d0 con 0x7f47a4157080 2023-12-18T10:19:25.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.713+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f47a404e000 con 0x7f47a4157080 2023-12-18T10:19:25.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f478b7fe640 1 -- 172.21.15.133:0/2739930186 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f479c0ef6f0 con 0x7f47a4157080 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4790065a60 msgr2=0x7f4790067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4790065a60 0x7f4790067f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4794009b80 tx=0x7f4794009190 comp rx=0 tx=0).stop 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a4157080 msgr2=0x7f47a415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a4157080 0x7f47a415e520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f479c0ab000 tx=0x7f479c019740 comp rx=0 tx=0).stop 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 shutdown_connections 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4790065a60 0x7f4790067f20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a4157080 0x7f47a415e520 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47a40d05b0 0x7f47a415dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 --2- 172.21.15.133:0/2739930186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47a40cd730 0x7f47a414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 >> 172.21.15.133:0/2739930186 conn(0x7f47a4069ca0 msgr2=0x7f47a406b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:25.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 shutdown_connections 2023-12-18T10:19:25.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.721+0000 7f47a968c640 1 -- 172.21.15.133:0/2739930186 wait complete. 2023-12-18T10:19:25.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-18T10:19:25.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dcd88c640 1 Processor -- start 2023-12-18T10:19:25.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dcd88c640 1 -- start start 2023-12-18T10:19:25.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dcd88c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dc80cdd40 0x7f6dc80cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dcd88c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6dc806fdb0 0x7f6dc8070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dcd88c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc8160690 con 0x7f6dc815c9d0 2023-12-18T10:19:25.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dcd88c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc81603f0 con 0x7f6dc80cdd40 2023-12-18T10:19:25.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dcd88c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc8070740 con 0x7f6dc806fdb0 2023-12-18T10:19:25.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dbe7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dc80cdd40 0x7f6dc80cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dbe7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dc80cdd40 0x7f6dc80cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40696/0 (socket says 172.21.15.133:40696) 2023-12-18T10:19:25.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dbe7fc640 1 -- 172.21.15.133:0/3492912243 learned_addr learned my addr 172.21.15.133:0/3492912243 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:25.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dc77fe640 1 --2- 172.21.15.133:0/3492912243 >> v2:172.21.15.142:3300/0 conn(0x7f6dc806fdb0 0x7f6dc8070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dbe7fc640 1 -- 172.21.15.133:0/3492912243 >> v2:172.21.15.142:3300/0 conn(0x7f6dc806fdb0 msgr2=0x7f6dc8070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:25.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dbe7fc640 1 --2- 172.21.15.133:0/3492912243 >> v2:172.21.15.142:3300/0 conn(0x7f6dc806fdb0 0x7f6dc8070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dbe7fc640 1 -- 172.21.15.133:0/3492912243 >> v1:172.21.15.142:6789/0 conn(0x7f6dc815c9d0 legacy=0x7f6dc8160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dbe7fc640 1 -- 172.21.15.133:0/3492912243 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80b0d80 con 0x7f6dc80cdd40 2023-12-18T10:19:25.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.881+0000 7f6dc77fe640 1 --2- 172.21.15.133:0/3492912243 >> v2:172.21.15.142:3300/0 conn(0x7f6dc806fdb0 0x7f6dc8070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:25.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dbe7fc640 1 --2- 172.21.15.133:0/3492912243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80cc400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80c8a40 tx=0x7f6db001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e55f7a7e2aa8a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dc67fc640 1 -- 172.21.15.133:0/3492912243 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db00aa680 con 0x7f6dc80cdd40 2023-12-18T10:19:25.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dc67fc640 1 -- 172.21.15.133:0/3492912243 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db00aa7e0 con 0x7f6dc80cdd40 2023-12-18T10:19:25.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dc67fc640 1 -- 172.21.15.133:0/3492912243 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db00aab70 con 0x7f6dc80cdd40 2023-12-18T10:19:25.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3492912243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 msgr2=0x7f6dc80cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3492912243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80cc400 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80c8a40 tx=0x7f6db001c500 comp rx=0 tx=0).stop 2023-12-18T10:19:25.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3492912243 shutdown_connections 2023-12-18T10:19:25.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3492912243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80cc400 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3492912243 >> v2:172.21.15.142:3300/0 conn(0x7f6dc806fdb0 0x7f6dc8070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3492912243 >> 172.21.15.133:0/3492912243 conn(0x7f6dc806a3e0 msgr2=0x7f6dc80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:25.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3492912243 shutdown_connections 2023-12-18T10:19:25.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.885+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3492912243 wait complete. 2023-12-18T10:19:25.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 Processor -- start 2023-12-18T10:19:25.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 -- start start 2023-12-18T10:19:25.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc806fdb0 0x7f6dc80c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc815c9d0 0x7f6dc80c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8155ea0 con 0x7f6dc80cdd40 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8158530 con 0x7f6dc806fdb0 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8157490 con 0x7f6dc815c9d0 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40698/0 (socket says 172.21.15.133:40698) 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 -- 172.21.15.133:0/3230191716 learned_addr learned my addr 172.21.15.133:0/3230191716 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dc6ffd640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc806fdb0 0x7f6dc80c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dc77fe640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc815c9d0 0x7f6dc80c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 -- 172.21.15.133:0/3230191716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc815c9d0 msgr2=0x7f6dc80c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc815c9d0 0x7f6dc80c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 -- 172.21.15.133:0/3230191716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc806fdb0 msgr2=0x7f6dc80c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:25.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc806fdb0 0x7f6dc80c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:25.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 -- 172.21.15.133:0/3230191716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00094d0 con 0x7f6dc80cdd40 2023-12-18T10:19:25.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dbe7fc640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80c5eb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6db00ac040 tx=0x7f6db001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dc4ff9640 1 -- 172.21.15.133:0/3230191716 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db00b3800 con 0x7f6dc80cdd40 2023-12-18T10:19:25.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dc4ff9640 1 -- 172.21.15.133:0/3230191716 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db00b3980 con 0x7f6dc80cdd40 2023-12-18T10:19:25.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dc4ff9640 1 -- 172.21.15.133:0/3230191716 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db00b3d30 con 0x7f6dc80cdd40 2023-12-18T10:19:25.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc81613b0 con 0x7f6dc80cdd40 2023-12-18T10:19:25.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.889+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc8157a50 con 0x7f6dc80cdd40 2023-12-18T10:19:25.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.893+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc80735b0 con 0x7f6dc80cdd40 2023-12-18T10:19:25.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.893+0000 7f6dc4ff9640 1 -- 172.21.15.133:0/3230191716 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6db00b2380 con 0x7f6dc80cdd40 2023-12-18T10:19:25.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.893+0000 7f6dc4ff9640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6da8065a60 0x7f6da8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:25.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.893+0000 7f6dc4ff9640 1 -- 172.21.15.133:0/3230191716 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6db011d720 con 0x7f6dc80cdd40 2023-12-18T10:19:25.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.893+0000 7f6dc6ffd640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6da8065a60 0x7f6da8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:25.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.893+0000 7f6dc6ffd640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6da8065a60 0x7f6da8067f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6db8007fd0 tx=0x7f6db8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:25.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:25.897+0000 7f6dc4ff9640 1 -- 172.21.15.133:0/3230191716 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6db00eb420 con 0x7f6dc80cdd40 2023-12-18T10:19:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.101+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6dc804e000 con 0x7f6dc80cdd40 2023-12-18T10:19:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dc4ff9640 1 -- 172.21.15.133:0/3230191716 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6db00eea40 con 0x7f6dc80cdd40 2023-12-18T10:19:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6da8065a60 msgr2=0x7f6da8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6da8065a60 0x7f6da8067f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6db8007fd0 tx=0x7f6db8009040 comp rx=0 tx=0).stop 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 msgr2=0x7f6dc80c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80c5eb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6db00ac040 tx=0x7f6db001ad40 comp rx=0 tx=0).stop 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 shutdown_connections 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6da8065a60 0x7f6da8067f20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc815c9d0 0x7f6dc80c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc80cdd40 0x7f6dc80c5eb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 --2- 172.21.15.133:0/3230191716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc806fdb0 0x7f6dc80c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 >> 172.21.15.133:0/3230191716 conn(0x7f6dc806a3e0 msgr2=0x7f6dc80ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 shutdown_connections 2023-12-18T10:19:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.109+0000 7f6dcd88c640 1 -- 172.21.15.133:0/3230191716 wait complete. 2023-12-18T10:19:26.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-18T10:19:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f6a90640 1 Processor -- start 2023-12-18T10:19:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f6a90640 1 -- start start 2023-12-18T10:19:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f6a90640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f98f00cea00 0x7f98f00cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f6a90640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f015cb10 con 0x7f98f00cd3a0 2023-12-18T10:19:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f6a90640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f00cd960 con 0x7f98f015c730 2023-12-18T10:19:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f6a90640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f00cdc40 con 0x7f98f00cea00 2023-12-18T10:19:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f628f640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f98f00cd3a0 0x7f98f00b55b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54214/0 (socket says 172.21.15.133:54214) 2023-12-18T10:19:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f628f640 1 -- 172.21.15.133:0/4257147204 learned_addr learned my addr 172.21.15.133:0/4257147204 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f528d640 1 --2- 172.21.15.133:0/4257147204 >> v2:172.21.15.142:3300/0 conn(0x7f98f00cea00 0x7f98f00cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f4a8c640 1 -- 172.21.15.133:0/4257147204 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579369426 0 0) 0x7f98f015cb10 con 0x7f98f00cd3a0 2023-12-18T10:19:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f4a8c640 1 -- 172.21.15.133:0/4257147204 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98dc003530 con 0x7f98f00cd3a0 2023-12-18T10:19:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f528d640 1 -- 172.21.15.133:0/4257147204 >> v1:172.21.15.142:6789/0 conn(0x7f98f015c730 legacy=0x7f98f00b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f528d640 1 -- 172.21.15.133:0/4257147204 >> v1:172.21.15.133:6789/0 conn(0x7f98f00cd3a0 legacy=0x7f98f00b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.269+0000 7f98f528d640 1 -- 172.21.15.133:0/4257147204 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00cdf20 con 0x7f98f00cea00 2023-12-18T10:19:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f528d640 1 --2- 172.21.15.133:0/4257147204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f00cea00 0x7f98f00cef60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98e00097c0 tx=0x7f98e001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed8cda18be555a62 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f4a8c640 1 -- 172.21.15.133:0/4257147204 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00a8970 con 0x7f98f00cea00 2023-12-18T10:19:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f4a8c640 1 -- 172.21.15.133:0/4257147204 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e00a8ad0 con 0x7f98f00cea00 2023-12-18T10:19:26.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f4a8c640 1 -- 172.21.15.133:0/4257147204 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00a8e60 con 0x7f98f00cea00 2023-12-18T10:19:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f6a90640 1 -- 172.21.15.133:0/4257147204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f00cea00 msgr2=0x7f98f00cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f6a90640 1 --2- 172.21.15.133:0/4257147204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f00cea00 0x7f98f00cef60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98e00097c0 tx=0x7f98e001ec70 comp rx=0 tx=0).stop 2023-12-18T10:19:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f6a90640 1 -- 172.21.15.133:0/4257147204 shutdown_connections 2023-12-18T10:19:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f6a90640 1 --2- 172.21.15.133:0/4257147204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f00cea00 0x7f98f00cef60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f6a90640 1 -- 172.21.15.133:0/4257147204 >> 172.21.15.133:0/4257147204 conn(0x7f98f006b120 msgr2=0x7f98f006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f6a90640 1 -- 172.21.15.133:0/4257147204 shutdown_connections 2023-12-18T10:19:26.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.273+0000 7f98f6a90640 1 -- 172.21.15.133:0/4257147204 wait complete. 2023-12-18T10:19:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 Processor -- start 2023-12-18T10:19:26.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 -- start start 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f00cd3a0 0x7f98f015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98f00cea00 0x7f98f00c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f015c730 0x7f98f015f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0156e80 con 0x7f98f00cea00 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f015bc20 con 0x7f98f015c730 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00c6e70 con 0x7f98f00cd3a0 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98f00cea00 0x7f98f00c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98f00cea00 0x7f98f00c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40712/0 (socket says 172.21.15.133:40712) 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 -- 172.21.15.133:0/1428639848 learned_addr learned my addr 172.21.15.133:0/1428639848 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f5a8e640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f00cd3a0 0x7f98f015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f628f640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f015c730 0x7f98f015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 -- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f00cd3a0 msgr2=0x7f98f015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f00cd3a0 0x7f98f015b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 -- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f015c730 msgr2=0x7f98f015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f015c730 0x7f98f015f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 -- 172.21.15.133:0/1428639848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009420 con 0x7f98f00cea00 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f5a8e640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f00cd3a0 0x7f98f015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f528d640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98f00cea00 0x7f98f00c81b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f98e00b3040 tx=0x7f98e001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98e67fc640 1 -- 172.21.15.133:0/1428639848 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00b9630 con 0x7f98f00cea00 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98e67fc640 1 -- 172.21.15.133:0/1428639848 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e00b97b0 con 0x7f98f00cea00 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f00c86f0 con 0x7f98f00cea00 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98e67fc640 1 -- 172.21.15.133:0/1428639848 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00b9b60 con 0x7f98f00cea00 2023-12-18T10:19:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.277+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f00c73f0 con 0x7f98f00cea00 2023-12-18T10:19:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.281+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f0066c50 con 0x7f98f00cea00 2023-12-18T10:19:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.281+0000 7f98e67fc640 1 -- 172.21.15.133:0/1428639848 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98e00b7040 con 0x7f98f00cea00 2023-12-18T10:19:26.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.281+0000 7f98e67fc640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98d4065a60 0x7f98d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.281+0000 7f98e67fc640 1 -- 172.21.15.133:0/1428639848 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f98e0120fb0 con 0x7f98f00cea00 2023-12-18T10:19:26.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.281+0000 7f98f5a8e640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98d4065a60 0x7f98d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.281+0000 7f98f5a8e640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98d4065a60 0x7f98d4067f20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f98ec000f70 tx=0x7f98ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.285+0000 7f98e67fc640 1 -- 172.21.15.133:0/1428639848 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f98e00eeae0 con 0x7f98f00cea00 2023-12-18T10:19:26.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.485+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f98f004e850 con 0x7f98f00cea00 2023-12-18T10:19:26.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.493+0000 7f98e67fc640 1 -- 172.21.15.133:0/1428639848 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f98e00b5070 con 0x7f98f00cea00 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98d4065a60 msgr2=0x7f98d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98d4065a60 0x7f98d4067f20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f98ec000f70 tx=0x7f98ec009040 comp rx=0 tx=0).stop 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98f00cea00 msgr2=0x7f98f00c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98f00cea00 0x7f98f00c81b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f98e00b3040 tx=0x7f98e001ba10 comp rx=0 tx=0).stop 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 shutdown_connections 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98d4065a60 0x7f98d4067f20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98f015c730 0x7f98f015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98f00cea00 0x7f98f00c81b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 --2- 172.21.15.133:0/1428639848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98f00cd3a0 0x7f98f015b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 >> 172.21.15.133:0/1428639848 conn(0x7f98f006b120 msgr2=0x7f98f0153a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 shutdown_connections 2023-12-18T10:19:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.497+0000 7f98f6a90640 1 -- 172.21.15.133:0/1428639848 wait complete. 2023-12-18T10:19:26.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-18T10:19:26.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.653+0000 7fda0472c640 1 Processor -- start 2023-12-18T10:19:26.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.653+0000 7fda0472c640 1 -- start start 2023-12-18T10:19:26.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.653+0000 7fda0472c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc1570c0 0x7fd9fc06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.653+0000 7fda0472c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc0c9460 con 0x7fd9fc0ca000 2023-12-18T10:19:26.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.653+0000 7fda0472c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc1574a0 con 0x7fd9fc06c320 2023-12-18T10:19:26.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.653+0000 7fda0472c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc06c7a0 con 0x7fd9fc1570c0 2023-12-18T10:19:26.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda02cc9640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd9fc0ca000 0x7fd9fc070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54216/0 (socket says 172.21.15.133:54216) 2023-12-18T10:19:26.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda02cc9640 1 -- 172.21.15.133:0/1811426762 learned_addr learned my addr 172.21.15.133:0/1811426762 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:26.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda024c8640 1 --2- 172.21.15.133:0/1811426762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc1570c0 0x7fd9fc06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda014c6640 1 -- 172.21.15.133:0/1811426762 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202784831 0 0) 0x7fd9fc0c9460 con 0x7fd9fc0ca000 2023-12-18T10:19:26.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda014c6640 1 -- 172.21.15.133:0/1811426762 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9e8005740 con 0x7fd9fc0ca000 2023-12-18T10:19:26.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda014c6640 1 -- 172.21.15.133:0/1811426762 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611964134 0 0) 0x7fd9fc1574a0 con 0x7fd9fc06c320 2023-12-18T10:19:26.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda014c6640 1 -- 172.21.15.133:0/1811426762 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9fc0c9460 con 0x7fd9fc06c320 2023-12-18T10:19:26.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda024c8640 1 -- 172.21.15.133:0/1811426762 >> v1:172.21.15.142:6789/0 conn(0x7fd9fc06c320 legacy=0x7fd9fc0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda024c8640 1 -- 172.21.15.133:0/1811426762 >> v1:172.21.15.133:6789/0 conn(0x7fd9fc0ca000 legacy=0x7fd9fc070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda024c8640 1 -- 172.21.15.133:0/1811426762 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0c8b30 con 0x7fd9fc1570c0 2023-12-18T10:19:26.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.657+0000 7fda024c8640 1 --2- 172.21.15.133:0/1811426762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc1570c0 0x7fd9fc06bde0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80097f0 tx=0x7fd9f801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84c85ece6a71254a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:26.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda014c6640 1 -- 172.21.15.133:0/1811426762 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80ab600 con 0x7fd9fc1570c0 2023-12-18T10:19:26.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda014c6640 1 -- 172.21.15.133:0/1811426762 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f80ab760 con 0x7fd9fc1570c0 2023-12-18T10:19:26.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda014c6640 1 -- 172.21.15.133:0/1811426762 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80abad0 con 0x7fd9fc1570c0 2023-12-18T10:19:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- 172.21.15.133:0/1811426762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc1570c0 msgr2=0x7fd9fc06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 --2- 172.21.15.133:0/1811426762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc1570c0 0x7fd9fc06bde0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80097f0 tx=0x7fd9f801c400 comp rx=0 tx=0).stop 2023-12-18T10:19:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- 172.21.15.133:0/1811426762 shutdown_connections 2023-12-18T10:19:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 --2- 172.21.15.133:0/1811426762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc1570c0 0x7fd9fc06bde0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- 172.21.15.133:0/1811426762 >> 172.21.15.133:0/1811426762 conn(0x7fd9fc06a3e0 msgr2=0x7fd9fc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- 172.21.15.133:0/1811426762 shutdown_connections 2023-12-18T10:19:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- 172.21.15.133:0/1811426762 wait complete. 2023-12-18T10:19:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 Processor -- start 2023-12-18T10:19:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- start start 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc06c320 0x7fd9fc159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9fc0ca000 0x7fd9fc15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9fc1570c0 0x7fd9fc15c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0cbe20 con 0x7fd9fc1570c0 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0cc050 con 0x7fd9fc0ca000 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda0472c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0cc330 con 0x7fd9fc06c320 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda02cc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9fc1570c0 0x7fd9fc15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda02cc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9fc1570c0 0x7fd9fc15c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40718/0 (socket says 172.21.15.133:40718) 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.661+0000 7fda02cc9640 1 -- 172.21.15.133:0/939606943 learned_addr learned my addr 172.21.15.133:0/939606943 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda024c8640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc06c320 0x7fd9fc159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda01cc7640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9fc0ca000 0x7fd9fc15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda02cc9640 1 -- 172.21.15.133:0/939606943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc06c320 msgr2=0x7fd9fc159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda02cc9640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc06c320 0x7fd9fc159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda02cc9640 1 -- 172.21.15.133:0/939606943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9fc0ca000 msgr2=0x7fd9fc15c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda02cc9640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9fc0ca000 0x7fd9fc15c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda02cc9640 1 -- 172.21.15.133:0/939606943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8009420 con 0x7fd9fc1570c0 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda02cc9640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9fc1570c0 0x7fd9fc15c810 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400cb40 tx=0x7fd9f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fd9f2ffd640 1 -- 172.21.15.133:0/939606943 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400aca0 con 0x7fd9fc1570c0 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fd9f2ffd640 1 -- 172.21.15.133:0/939606943 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400ae20 con 0x7fd9fc1570c0 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc0cc610 con 0x7fd9fc1570c0 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fd9f2ffd640 1 -- 172.21.15.133:0/939606943 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4012640 con 0x7fd9fc1570c0 2023-12-18T10:19:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc0ccbd0 con 0x7fd9fc1570c0 2023-12-18T10:19:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc0735b0 con 0x7fd9fc1570c0 2023-12-18T10:19:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fd9f2ffd640 1 -- 172.21.15.133:0/939606943 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd9f4007070 con 0x7fd9fc1570c0 2023-12-18T10:19:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fd9f2ffd640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd9e0065a90 0x7fd9e0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.665+0000 7fd9f2ffd640 1 -- 172.21.15.133:0/939606943 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd9f4082fd0 con 0x7fd9fc1570c0 2023-12-18T10:19:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.669+0000 7fda024c8640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd9e0065a90 0x7fd9e0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.669+0000 7fda024c8640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd9e0065a90 0x7fd9e0067f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80af000 tx=0x7fd9f80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:26.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.669+0000 7fd9f2ffd640 1 -- 172.21.15.133:0/939606943 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd9f4050b20 con 0x7fd9fc1570c0 2023-12-18T10:19:26.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.877+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd9fc04e000 con 0x7fd9fc1570c0 2023-12-18T10:19:26.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.881+0000 7fd9f2ffd640 1 -- 172.21.15.133:0/939606943 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd9f4017070 con 0x7fd9fc1570c0 2023-12-18T10:19:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd9e0065a90 msgr2=0x7fd9e0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd9e0065a90 0x7fd9e0067f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80af000 tx=0x7fd9f80a7000 comp rx=0 tx=0).stop 2023-12-18T10:19:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9fc1570c0 msgr2=0x7fd9fc15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9fc1570c0 0x7fd9fc15c810 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400cb40 tx=0x7fd9f400a060 comp rx=0 tx=0).stop 2023-12-18T10:19:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 shutdown_connections 2023-12-18T10:19:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd9e0065a90 0x7fd9e0067f50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9fc1570c0 0x7fd9fc15c810 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9fc0ca000 0x7fd9fc15c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 --2- 172.21.15.133:0/939606943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd9fc06c320 0x7fd9fc159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 >> 172.21.15.133:0/939606943 conn(0x7fd9fc06a3e0 msgr2=0x7fd9fc15ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 shutdown_connections 2023-12-18T10:19:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:26.885+0000 7fda0472c640 1 -- 172.21.15.133:0/939606943 wait complete. 2023-12-18T10:19:26.906 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd95d295640 1 Processor -- start 2023-12-18T10:19:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd95d295640 1 -- start start 2023-12-18T10:19:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd95d295640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd9580cf530 0x7fd958168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd95d295640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9580d11c0 con 0x7fd9580cf0d0 2023-12-18T10:19:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd95d295640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9580d0310 con 0x7fd95815ca40 2023-12-18T10:19:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd95d295640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9580d05b0 con 0x7fd9580cf530 2023-12-18T10:19:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd94e7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd9580cf0d0 0x7fd9581648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54218/0 (socket says 172.21.15.133:54218) 2023-12-18T10:19:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd94e7fc640 1 -- 172.21.15.133:0/2373731963 learned_addr learned my addr 172.21.15.133:0/2373731963 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd9577fe640 1 --2- 172.21.15.133:0/2373731963 >> v2:172.21.15.133:3300/0 conn(0x7fd9580cf530 0x7fd958168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.041+0000 7fd9567fc640 1 -- 172.21.15.133:0/2373731963 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229190658 0 0) 0x7fd9580d11c0 con 0x7fd9580cf0d0 2023-12-18T10:19:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd9567fc640 1 -- 172.21.15.133:0/2373731963 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd944003530 con 0x7fd9580cf0d0 2023-12-18T10:19:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd9577fe640 1 -- 172.21.15.133:0/2373731963 >> v1:172.21.15.142:6789/0 conn(0x7fd95815ca40 legacy=0x7fd9580cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd9577fe640 1 -- 172.21.15.133:0/2373731963 >> v1:172.21.15.133:6789/0 conn(0x7fd9580cf0d0 legacy=0x7fd9581648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd9577fe640 1 -- 172.21.15.133:0/2373731963 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9580d0890 con 0x7fd9580cf530 2023-12-18T10:19:27.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd9577fe640 1 --2- 172.21.15.133:0/2373731963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd958168000 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd9500097c0 tx=0x7fd95001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec1b17dc1d292b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd9567fc640 1 -- 172.21.15.133:0/2373731963 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500ab650 con 0x7fd9580cf530 2023-12-18T10:19:27.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd9567fc640 1 -- 172.21.15.133:0/2373731963 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9500ab7b0 con 0x7fd9580cf530 2023-12-18T10:19:27.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd9567fc640 1 -- 172.21.15.133:0/2373731963 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500abb40 con 0x7fd9580cf530 2023-12-18T10:19:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd95d295640 1 -- 172.21.15.133:0/2373731963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 msgr2=0x7fd958168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd95d295640 1 --2- 172.21.15.133:0/2373731963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd958168000 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd9500097c0 tx=0x7fd95001c450 comp rx=0 tx=0).stop 2023-12-18T10:19:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd95d295640 1 -- 172.21.15.133:0/2373731963 shutdown_connections 2023-12-18T10:19:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd95d295640 1 --2- 172.21.15.133:0/2373731963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd958168000 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd95d295640 1 -- 172.21.15.133:0/2373731963 >> 172.21.15.133:0/2373731963 conn(0x7fd958089fb0 msgr2=0x7fd9580d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd95d295640 1 -- 172.21.15.133:0/2373731963 shutdown_connections 2023-12-18T10:19:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.045+0000 7fd95d295640 1 -- 172.21.15.133:0/2373731963 wait complete. 2023-12-18T10:19:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd95d295640 1 Processor -- start 2023-12-18T10:19:27.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd95d295640 1 -- start start 2023-12-18T10:19:27.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd95d295640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9580cf0d0 0x7fd958150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd95d295640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd9580cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd95d295640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd95815ca40 0x7fd9580cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd95d295640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958155610 con 0x7fd9580cf530 2023-12-18T10:19:27.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd95d295640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580cc590 con 0x7fd9580cf0d0 2023-12-18T10:19:27.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd95d295640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd958154ce0 con 0x7fd95815ca40 2023-12-18T10:19:27.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd9580cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd9580cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40740/0 (socket says 172.21.15.133:40740) 2023-12-18T10:19:27.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 -- 172.21.15.133:0/2997039242 learned_addr learned my addr 172.21.15.133:0/2997039242 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:27.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd9577fe640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd95815ca40 0x7fd9580cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd956ffd640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9580cf0d0 0x7fd958150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 -- 172.21.15.133:0/2997039242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd95815ca40 msgr2=0x7fd9580cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd95815ca40 0x7fd9580cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 -- 172.21.15.133:0/2997039242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9580cf0d0 msgr2=0x7fd958150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9580cf0d0 0x7fd958150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 -- 172.21.15.133:0/2997039242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd950009420 con 0x7fd9580cf530 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94e7fc640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd9580cbb10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd940001270 tx=0x7fd94000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94ffff640 1 -- 172.21.15.133:0/2997039242 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400074e0 con 0x7fd9580cf530 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94ffff640 1 -- 172.21.15.133:0/2997039242 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940007640 con 0x7fd9580cf530 2023-12-18T10:19:27.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.049+0000 7fd94ffff640 1 -- 172.21.15.133:0/2997039242 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400059b0 con 0x7fd9580cf530 2023-12-18T10:19:27.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.053+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd958154fc0 con 0x7fd9580cf530 2023-12-18T10:19:27.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.053+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd958153020 con 0x7fd9580cf530 2023-12-18T10:19:27.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.053+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95804e000 con 0x7fd9580cf530 2023-12-18T10:19:27.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.053+0000 7fd94ffff640 1 -- 172.21.15.133:0/2997039242 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd940005b10 con 0x7fd9580cf530 2023-12-18T10:19:27.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.053+0000 7fd94ffff640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd938065a60 0x7fd938067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.053+0000 7fd94ffff640 1 -- 172.21.15.133:0/2997039242 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd940082580 con 0x7fd9580cf530 2023-12-18T10:19:27.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.053+0000 7fd956ffd640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd938065a60 0x7fd938067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.057+0000 7fd956ffd640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd938065a60 0x7fd938067f20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd948001340 tx=0x7fd948009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.057+0000 7fd94ffff640 1 -- 172.21.15.133:0/2997039242 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd940050160 con 0x7fd9580cf530 2023-12-18T10:19:27.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.209+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9580b1320 con 0x7fd9580cf530 2023-12-18T10:19:27.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd94ffff640 1 -- 172.21.15.133:0/2997039242 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12642 (secure 0 0 0) 0x7fd940017020 con 0x7fd9580cf530 2023-12-18T10:19:27.215 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:27.215 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":35,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:19:24.164237+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:27.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd938065a60 msgr2=0x7fd938067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd938065a60 0x7fd938067f20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd948001340 tx=0x7fd948009040 comp rx=0 tx=0).stop 2023-12-18T10:19:27.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 msgr2=0x7fd9580cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd9580cbb10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd940001270 tx=0x7fd94000c8e0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 shutdown_connections 2023-12-18T10:19:27.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd938065a60 0x7fd938067f20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd95815ca40 0x7fd9580cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9580cf530 0x7fd9580cbb10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 --2- 172.21.15.133:0/2997039242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9580cf0d0 0x7fd958150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 >> 172.21.15.133:0/2997039242 conn(0x7fd958089fb0 msgr2=0x7fd95806c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:27.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 shutdown_connections 2023-12-18T10:19:27.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.213+0000 7fd95d295640 1 -- 172.21.15.133:0/2997039242 wait complete. 2023-12-18T10:19:27.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:19:27.236 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:19:27.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.373+0000 7fb33452c640 1 Processor -- start 2023-12-18T10:19:27.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.373+0000 7fb33452c640 1 -- start start 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.373+0000 7fb33452c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.373+0000 7fb33452c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb32c070820 0x7fb32c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.373+0000 7fb33452c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32c0c9390 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.373+0000 7fb33452c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32c15aee0 con 0x7fb32c070820 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.373+0000 7fb33452c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c15b1c0 con 0x7fb32c1582d0 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb331ac7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb32c070820 0x7fb32c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb331ac7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb32c070820 0x7fb32c0ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40746/0 (socket says 172.21.15.133:40746) 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb331ac7640 1 -- 172.21.15.133:0/3941481453 learned_addr learned my addr 172.21.15.133:0/3941481453 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb3322c8640 1 --2- 172.21.15.133:0/3941481453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb331ac7640 1 -- 172.21.15.133:0/3941481453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 msgr2=0x7fb32c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:27.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb331ac7640 1 --2- 172.21.15.133:0/3941481453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb331ac7640 1 -- 172.21.15.133:0/3941481453 >> v1:172.21.15.142:6789/0 conn(0x7fb32c0ce3b0 legacy=0x7fb32c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb331ac7640 1 -- 172.21.15.133:0/3941481453 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c15b4a0 con 0x7fb32c070820 2023-12-18T10:19:27.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb3322c8640 1 --2- 172.21.15.133:0/3941481453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:27.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb331ac7640 1 --2- 172.21.15.133:0/3941481453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c070820 0x7fb32c0ca5f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009870 tx=0x7fb31c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe881f623b6c5132 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb3312c6640 1 -- 172.21.15.133:0/3941481453 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0a95f0 con 0x7fb32c070820 2023-12-18T10:19:27.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb3312c6640 1 -- 172.21.15.133:0/3941481453 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0a9750 con 0x7fb32c070820 2023-12-18T10:19:27.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.377+0000 7fb3312c6640 1 -- 172.21.15.133:0/3941481453 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0a9ae0 con 0x7fb32c070820 2023-12-18T10:19:27.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- 172.21.15.133:0/3941481453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c070820 msgr2=0x7fb32c0ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 --2- 172.21.15.133:0/3941481453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c070820 0x7fb32c0ca5f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009870 tx=0x7fb31c01c510 comp rx=0 tx=0).stop 2023-12-18T10:19:27.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- 172.21.15.133:0/3941481453 shutdown_connections 2023-12-18T10:19:27.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 --2- 172.21.15.133:0/3941481453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c070820 0x7fb32c0ca5f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 --2- 172.21.15.133:0/3941481453 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- 172.21.15.133:0/3941481453 >> 172.21.15.133:0/3941481453 conn(0x7fb32c06a2a0 msgr2=0x7fb32c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:27.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- 172.21.15.133:0/3941481453 shutdown_connections 2023-12-18T10:19:27.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- 172.21.15.133:0/3941481453 wait complete. 2023-12-18T10:19:27.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 Processor -- start 2023-12-18T10:19:27.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- start start 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c070820 0x7fb32c0c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c0ce3b0 0x7fb32c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c0c5070 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c15c120 con 0x7fb32c070820 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb33452c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c15c400 con 0x7fb32c1582d0 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb331ac7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c0ce3b0 0x7fb32c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb331ac7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c0ce3b0 0x7fb32c15e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40752/0 (socket says 172.21.15.133:40752) 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb331ac7640 1 -- 172.21.15.133:0/2784732327 learned_addr learned my addr 172.21.15.133:0/2784732327 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb3322c8640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c070820 0x7fb32c0c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.381+0000 7fb332ac9640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb331ac7640 1 -- 172.21.15.133:0/2784732327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 msgr2=0x7fb32c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb331ac7640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb331ac7640 1 -- 172.21.15.133:0/2784732327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c070820 msgr2=0x7fb32c0c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb331ac7640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c070820 0x7fb32c0c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb331ac7640 1 -- 172.21.15.133:0/2784732327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0094d0 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb331ac7640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c0ce3b0 0x7fb32c15e830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0ab040 tx=0x7fb31c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb322ffd640 1 -- 172.21.15.133:0/2784732327 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0a95f0 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb322ffd640 1 -- 172.21.15.133:0/2784732327 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0b1820 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb322ffd640 1 -- 172.21.15.133:0/2784732327 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0b1bd0 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c15c6e0 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c15ed70 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c15d0c0 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb322ffd640 1 -- 172.21.15.133:0/2784732327 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb31c0b1d30 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb322ffd640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.385+0000 7fb322ffd640 1 -- 172.21.15.133:0/2784732327 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb31c11d8d0 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.389+0000 7fb3322c8640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.389+0000 7fb3322c8640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb328006e90 tx=0x7fb328008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.389+0000 7fb322ffd640 1 -- 172.21.15.133:0/2784732327 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb31c0eb4b0 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb32c15ef60 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb322ffd640 1 -- 172.21.15.133:0/2784732327 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb32c15ef60 con 0x7fb32c0ce3b0 2023-12-18T10:19:27.544 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 msgr2=0x7fb310067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb328006e90 tx=0x7fb328008040 comp rx=0 tx=0).stop 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c0ce3b0 msgr2=0x7fb32c15e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c0ce3b0 0x7fb32c15e830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0ab040 tx=0x7fb31c01ad50 comp rx=0 tx=0).stop 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 shutdown_connections 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32c1582d0 0x7fb32c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb32c0ce3b0 0x7fb32c15e830 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 --2- 172.21.15.133:0/2784732327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32c070820 0x7fb32c0c4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 >> 172.21.15.133:0/2784732327 conn(0x7fb32c06a2a0 msgr2=0x7fb32c0af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 shutdown_connections 2023-12-18T10:19:27.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.541+0000 7fb33452c640 1 -- 172.21.15.133:0/2784732327 wait complete. 2023-12-18T10:19:27.564 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-18T10:19:27.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b6620640 1 Processor -- start 2023-12-18T10:19:27.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b6620640 1 -- start start 2023-12-18T10:19:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b6620640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b00c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b6620640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04b00c9e30 0x7f04b0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b6620640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00c9460 con 0x7f04b01570c0 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b6620640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b01574a0 con 0x7f04b00c9e30 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b6620640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00c8b30 con 0x7f04b006c4f0 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04affff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f04b01570c0 0x7f04b006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54232/0 (socket says 172.21.15.133:54232) 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04affff640 1 -- 172.21.15.133:0/887511590 learned_addr learned my addr 172.21.15.133:0/887511590 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b4bbd640 1 --2- 172.21.15.133:0/887511590 >> v2:172.21.15.133:3300/0 conn(0x7f04b00c9e30 0x7f04b0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04af7fe640 1 --2- 172.21.15.133:0/887511590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b00c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04aeffd640 1 -- 172.21.15.133:0/887511590 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929707169 0 0) 0x7f04b00c9460 con 0x7f04b01570c0 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b4bbd640 1 -- 172.21.15.133:0/887511590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 msgr2=0x7f04b00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b4bbd640 1 --2- 172.21.15.133:0/887511590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b00c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b4bbd640 1 -- 172.21.15.133:0/887511590 >> v1:172.21.15.133:6789/0 conn(0x7f04b01570c0 legacy=0x7f04b006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04b4bbd640 1 -- 172.21.15.133:0/887511590 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00c8e10 con 0x7f04b00c9e30 2023-12-18T10:19:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.701+0000 7f04af7fe640 1 --2- 172.21.15.133:0/887511590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b00c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b4bbd640 1 --2- 172.21.15.133:0/887511590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b00c9e30 0x7f04b0070df0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557662a548b4929a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04aeffd640 1 -- 172.21.15.133:0/887511590 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80a5a10 con 0x7f04b00c9e30 2023-12-18T10:19:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04aeffd640 1 -- 172.21.15.133:0/887511590 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a80a5b70 con 0x7f04b00c9e30 2023-12-18T10:19:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04aeffd640 1 -- 172.21.15.133:0/887511590 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80ad440 con 0x7f04b00c9e30 2023-12-18T10:19:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 -- 172.21.15.133:0/887511590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b00c9e30 msgr2=0x7f04b0070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 --2- 172.21.15.133:0/887511590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b00c9e30 0x7f04b0070df0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009d90 tx=0x7f04a801c950 comp rx=0 tx=0).stop 2023-12-18T10:19:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 -- 172.21.15.133:0/887511590 shutdown_connections 2023-12-18T10:19:27.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 --2- 172.21.15.133:0/887511590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b00c9e30 0x7f04b0070df0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 --2- 172.21.15.133:0/887511590 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b00c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 -- 172.21.15.133:0/887511590 >> 172.21.15.133:0/887511590 conn(0x7f04b006a3e0 msgr2=0x7f04b00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:27.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 -- 172.21.15.133:0/887511590 shutdown_connections 2023-12-18T10:19:27.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 -- 172.21.15.133:0/887511590 wait complete. 2023-12-18T10:19:27.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 Processor -- start 2023-12-18T10:19:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.705+0000 7f04b6620640 1 -- start start 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b0166ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04b00c9e30 0x7f04b014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b01570c0 0x7f04b01498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b014ab40 con 0x7f04b01570c0 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0158ce0 con 0x7f04b00c9e30 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b014ad30 con 0x7f04b006c4f0 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b01570c0 0x7f04b01498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b01570c0 0x7f04b01498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40782/0 (socket says 172.21.15.133:40782) 2023-12-18T10:19:27.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 -- 172.21.15.133:0/2342705045 learned_addr learned my addr 172.21.15.133:0/2342705045 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04affff640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b0166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04af7fe640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04b00c9e30 0x7f04b014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 -- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 msgr2=0x7f04b0166ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b0166ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 -- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04b00c9e30 msgr2=0x7f04b014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04b00c9e30 0x7f04b014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 -- 172.21.15.133:0/2342705045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a8009a70 con 0x7f04b01570c0 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04af7fe640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04b00c9e30 0x7f04b014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b4bbd640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b01570c0 0x7f04b01498a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f04a801a580 tx=0x7f04a80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04acff9640 1 -- 172.21.15.133:0/2342705045 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8003ba0 con 0x7f04b01570c0 2023-12-18T10:19:27.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04acff9640 1 -- 172.21.15.133:0/2342705045 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8003d00 con 0x7f04b01570c0 2023-12-18T10:19:27.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04acff9640 1 -- 172.21.15.133:0/2342705045 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8004230 con 0x7f04b01570c0 2023-12-18T10:19:27.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b014b010 con 0x7f04b01570c0 2023-12-18T10:19:27.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b0158900 con 0x7f04b01570c0 2023-12-18T10:19:27.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b00735b0 con 0x7f04b01570c0 2023-12-18T10:19:27.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.709+0000 7f04acff9640 1 -- 172.21.15.133:0/2342705045 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f04a80b4050 con 0x7f04b01570c0 2023-12-18T10:19:27.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.713+0000 7f04acff9640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f049c065a60 0x7f049c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:27.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.713+0000 7f04acff9640 1 -- 172.21.15.133:0/2342705045 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f04a811e2f0 con 0x7f04b01570c0 2023-12-18T10:19:27.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.713+0000 7f04affff640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f049c065a60 0x7f049c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:27.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.713+0000 7f04affff640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f049c065a60 0x7f049c067f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000f70 tx=0x7f04a0007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:27.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.717+0000 7f04acff9640 1 -- 172.21.15.133:0/2342705045 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f04a80ebec0 con 0x7f04b01570c0 2023-12-18T10:19:27.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f04b004e000 con 0x7f04b01570c0 2023-12-18T10:19:27.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04acff9640 1 -- 172.21.15.133:0/2342705045 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f04a8009450 con 0x7f04b01570c0 2023-12-18T10:19:27.872 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:27.872 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:19:27.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:19:27.872 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-18T10:19:27.872 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-18T10:19:27.872 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:27.872 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f049c065a60 msgr2=0x7f049c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f049c065a60 0x7f049c067f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000f70 tx=0x7f04a0007df0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b01570c0 msgr2=0x7f04b01498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b01570c0 0x7f04b01498a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f04a801a580 tx=0x7f04a80196f0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 shutdown_connections 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f049c065a60 0x7f049c067f20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04b01570c0 0x7f04b01498a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04b00c9e30 0x7f04b014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 --2- 172.21.15.133:0/2342705045 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04b006c4f0 0x7f04b0166ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 >> 172.21.15.133:0/2342705045 conn(0x7f04b006a3e0 msgr2=0x7f04b00caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 shutdown_connections 2023-12-18T10:19:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:27.869+0000 7f04b6620640 1 -- 172.21.15.133:0/2342705045 wait complete. 2023-12-18T10:19:27.893 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-18T10:19:27.893 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-18T10:19:28.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc44b6640 1 Processor -- start 2023-12-18T10:19:28.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc44b6640 1 -- start start 2023-12-18T10:19:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc44b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8bbc0ce6a0 0x7f8bbc0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc44b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8bbc0ca200 0x7f8bbc0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc44b6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc0c9a00 con 0x7f8bbc15d180 2023-12-18T10:19:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc44b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc159b20 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc44b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc0cefc0 con 0x7f8bbc0ca200 2023-12-18T10:19:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc2252640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8bbc0ce6a0 0x7f8bbc0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc2a53640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8bbc15d180 0x7f8bbc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54246/0 (socket says 172.21.15.133:54246) 2023-12-18T10:19:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc2252640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8bbc0ce6a0 0x7f8bbc0ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40794/0 (socket says 172.21.15.133:40794) 2023-12-18T10:19:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc2a53640 1 -- 172.21.15.133:0/306333883 learned_addr learned my addr 172.21.15.133:0/306333883 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc1a51640 1 --2- 172.21.15.133:0/306333883 >> v2:172.21.15.142:3300/0 conn(0x7f8bbc0ca200 0x7f8bbc0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc2252640 1 -- 172.21.15.133:0/306333883 >> v2:172.21.15.142:3300/0 conn(0x7f8bbc0ca200 msgr2=0x7f8bbc0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc2252640 1 --2- 172.21.15.133:0/306333883 >> v2:172.21.15.142:3300/0 conn(0x7f8bbc0ca200 0x7f8bbc0cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc2252640 1 -- 172.21.15.133:0/306333883 >> v1:172.21.15.133:6789/0 conn(0x7f8bbc15d180 legacy=0x7f8bbc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc2252640 1 -- 172.21.15.133:0/306333883 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0ad6e0 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.037+0000 7f8bc1250640 1 -- 172.21.15.133:0/306333883 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886780799 0 0) 0x7f8bbc0c9a00 con 0x7f8bbc15d180 2023-12-18T10:19:28.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc2252640 1 --2- 172.21.15.133:0/306333883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0ca730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80097c0 tx=0x7f8bb801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615eaebe98cbaab0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:28.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc1250640 1 -- 172.21.15.133:0/306333883 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80ab610 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc1250640 1 -- 172.21.15.133:0/306333883 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb80ab770 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc1250640 1 -- 172.21.15.133:0/306333883 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb80abb00 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc44b6640 1 -- 172.21.15.133:0/306333883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 msgr2=0x7f8bbc0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/306333883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0ca730 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80097c0 tx=0x7f8bb801c410 comp rx=0 tx=0).stop 2023-12-18T10:19:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc44b6640 1 -- 172.21.15.133:0/306333883 shutdown_connections 2023-12-18T10:19:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/306333883 >> v2:172.21.15.142:3300/0 conn(0x7f8bbc0ca200 0x7f8bbc0cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/306333883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0ca730 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc44b6640 1 -- 172.21.15.133:0/306333883 >> 172.21.15.133:0/306333883 conn(0x7f8bbc069e70 msgr2=0x7f8bbc06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc44b6640 1 -- 172.21.15.133:0/306333883 shutdown_connections 2023-12-18T10:19:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.041+0000 7f8bc44b6640 1 -- 172.21.15.133:0/306333883 wait complete. 2023-12-18T10:19:28.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 Processor -- start 2023-12-18T10:19:28.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 -- start start 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bbc0ca200 0x7f8bbc097a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bbc15d180 0x7f8bbc0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0ab190 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0ab3e0 con 0x7f8bbc0ca200 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0ab6c0 con 0x7f8bbc15d180 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40796/0 (socket says 172.21.15.133:40796) 2023-12-18T10:19:28.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 -- 172.21.15.133:0/1830214345 learned_addr learned my addr 172.21.15.133:0/1830214345 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:28.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc2252640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bbc0ca200 0x7f8bbc097a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:28.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc2a53640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bbc15d180 0x7f8bbc0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:28.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 -- 172.21.15.133:0/1830214345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bbc15d180 msgr2=0x7f8bbc0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:28.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bbc15d180 0x7f8bbc0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 -- 172.21.15.133:0/1830214345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bbc0ca200 msgr2=0x7f8bbc097a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:28.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bbc0ca200 0x7f8bbc097a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 -- 172.21.15.133:0/1830214345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8009420 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc1a51640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0c7b00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00d5f0 tx=0x7f8bac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:28.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bb2ffd640 1 -- 172.21.15.133:0/1830214345 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac0125f0 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bb2ffd640 1 -- 172.21.15.133:0/1830214345 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac012750 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc0ab9a0 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bb2ffd640 1 -- 172.21.15.133:0/1830214345 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac012ae0 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc0abf60 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.045+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc0ac120 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.049+0000 7f8bb2ffd640 1 -- 172.21.15.133:0/1830214345 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8bac012c40 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.049+0000 7f8bb2ffd640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ba0065a60 0x7f8ba0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:28.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.049+0000 7f8bb2ffd640 1 -- 172.21.15.133:0/1830214345 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8bac0832e0 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.049+0000 7f8bc2252640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ba0065a60 0x7f8ba0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:28.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.049+0000 7f8bc2252640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ba0065a60 0x7f8ba0067f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80af000 tx=0x7f8bb80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:28.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.053+0000 7f8bb2ffd640 1 -- 172.21.15.133:0/1830214345 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8bac050f50 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:19:28.176 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:19:28.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.205+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8bbc04e070 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.981+0000 7f8bb2ffd640 1 -- 172.21.15.133:0/1830214345 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8bac054570 con 0x7f8bbc0ce6a0 2023-12-18T10:19:28.986 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-18T10:19:28.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ba0065a60 msgr2=0x7f8ba0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:28.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ba0065a60 0x7f8ba0067f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80af000 tx=0x7f8bb80a7000 comp rx=0 tx=0).stop 2023-12-18T10:19:28.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 msgr2=0x7f8bbc0c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:28.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0c7b00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00d5f0 tx=0x7f8bac00dab0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 shutdown_connections 2023-12-18T10:19:28.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ba0065a60 0x7f8ba0067f20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8bbc15d180 0x7f8bbc0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0ce6a0 0x7f8bbc0c7b00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 --2- 172.21.15.133:0/1830214345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8bbc0ca200 0x7f8bbc097a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:28.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 >> 172.21.15.133:0/1830214345 conn(0x7f8bbc069e70 msgr2=0x7f8bbc15d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:28.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 shutdown_connections 2023-12-18T10:19:28.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:28.985+0000 7f8bc44b6640 1 -- 172.21.15.133:0/1830214345 wait complete. 2023-12-18T10:19:29.015 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-18T10:19:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.157+0000 7fbe32318640 1 Processor -- start 2023-12-18T10:19:29.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.157+0000 7fbe32318640 1 -- start start 2023-12-18T10:19:29.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe32318640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe2c15a590 0x7fbe2c15eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:29.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe32318640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:29.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe32318640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c070b30 con 0x7fbe2c15a970 2023-12-18T10:19:29.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe32318640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2c15bd90 con 0x7fbe2c15a590 2023-12-18T10:19:29.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe32318640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c15ae00 con 0x7fbe2c0ce9c0 2023-12-18T10:19:29.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe2bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe2c15a590 0x7fbe2c15eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:29.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe308b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe308b5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c15b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:46676/0 (socket says 172.21.15.133:46676) 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe2bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbe2c15a590 0x7fbe2c15eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:58104/0 (socket says 172.21.15.133:58104) 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe308b5640 1 -- 172.21.15.133:0/1858628671 learned_addr learned my addr 172.21.15.133:0/1858628671 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe2b7fe640 1 --1- 172.21.15.133:0/1858628671 >> v1:172.21.15.142:6789/0 conn(0x7fbe2c15a970 0x7fbe2c0ce2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:57018/0 (socket says 172.21.15.133:57018) 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe308b5640 1 -- 172.21.15.133:0/1858628671 >> v2:172.21.15.142:3300/0 conn(0x7fbe2c15a590 msgr2=0x7fbe2c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe308b5640 1 --2- 172.21.15.133:0/1858628671 >> v2:172.21.15.142:3300/0 conn(0x7fbe2c15a590 0x7fbe2c15eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe308b5640 1 -- 172.21.15.133:0/1858628671 >> v1:172.21.15.142:6789/0 conn(0x7fbe2c15a970 legacy=0x7fbe2c0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe2affd640 1 -- 172.21.15.133:0/1858628671 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229887025 0 0) 0x7fbe2c070b30 con 0x7fbe2c15a970 2023-12-18T10:19:29.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.161+0000 7fbe308b5640 1 -- 172.21.15.133:0/1858628671 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c070570 con 0x7fbe2c0ce9c0 2023-12-18T10:19:29.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe308b5640 1 --2- 172.21.15.133:0/1858628671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c15b850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009e50 tx=0x7fbe2401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec8fef1308f59948 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:29.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe2affd640 1 -- 172.21.15.133:0/1858628671 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240a58a0 con 0x7fbe2c0ce9c0 2023-12-18T10:19:29.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe2affd640 1 -- 172.21.15.133:0/1858628671 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240a5a00 con 0x7fbe2c0ce9c0 2023-12-18T10:19:29.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe2affd640 1 -- 172.21.15.133:0/1858628671 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240a5d90 con 0x7fbe2c0ce9c0 2023-12-18T10:19:29.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 -- 172.21.15.133:0/1858628671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 msgr2=0x7fbe2c15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:29.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 --2- 172.21.15.133:0/1858628671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c15b850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009e50 tx=0x7fbe2401c9e0 comp rx=0 tx=0).stop 2023-12-18T10:19:29.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 -- 172.21.15.133:0/1858628671 shutdown_connections 2023-12-18T10:19:29.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 --2- 172.21.15.133:0/1858628671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c15b850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:29.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 --2- 172.21.15.133:0/1858628671 >> v2:172.21.15.142:3300/0 conn(0x7fbe2c15a590 0x7fbe2c15eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:29.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 -- 172.21.15.133:0/1858628671 >> 172.21.15.133:0/1858628671 conn(0x7fbe2c06a2a0 msgr2=0x7fbe2c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:29.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 -- 172.21.15.133:0/1858628671 shutdown_connections 2023-12-18T10:19:29.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 -- 172.21.15.133:0/1858628671 wait complete. 2023-12-18T10:19:29.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 Processor -- start 2023-12-18T10:19:29.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 -- start start 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.165+0000 7fbe32318640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c1651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe32318640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe2c15a590 0x7fbe2c15d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe32318640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2c15a970 0x7fbe2c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe32318640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0cc6c0 con 0x7fbe2c15a970 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe32318640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c15d7b0 con 0x7fbe2c15a590 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe32318640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c15cec0 con 0x7fbe2c0ce9c0 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2c15a970 0x7fbe2c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe2bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c1651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2c15a970 0x7fbe2c15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40798/0 (socket says 172.21.15.133:40798) 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 -- 172.21.15.133:0/769200905 learned_addr learned my addr 172.21.15.133:0/769200905 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe2b7fe640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe2c15a590 0x7fbe2c15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:29.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 -- 172.21.15.133:0/769200905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 msgr2=0x7fbe2c1651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c1651a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 -- 172.21.15.133:0/769200905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe2c15a590 msgr2=0x7fbe2c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe2c15a590 0x7fbe2c15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 -- 172.21.15.133:0/769200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24009b30 con 0x7fbe2c15a970 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe308b5640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2c15a970 0x7fbe2c15c980 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbe240af040 tx=0x7fbe24019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe28ff9640 1 -- 172.21.15.133:0/769200905 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240b6640 con 0x7fbe2c15a970 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe28ff9640 1 -- 172.21.15.133:0/769200905 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240b67c0 con 0x7fbe2c15a970 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe28ff9640 1 -- 172.21.15.133:0/769200905 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240b6b70 con 0x7fbe2c15a970 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c15bf30 con 0x7fbe2c15a970 2023-12-18T10:19:29.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c0cc3e0 con 0x7fbe2c15a970 2023-12-18T10:19:29.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.169+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c04e000 con 0x7fbe2c15a970 2023-12-18T10:19:29.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.173+0000 7fbe28ff9640 1 -- 172.21.15.133:0/769200905 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe240b6cd0 con 0x7fbe2c15a970 2023-12-18T10:19:29.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.173+0000 7fbe28ff9640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe18065a60 0x7fbe18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:29.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.173+0000 7fbe28ff9640 1 -- 172.21.15.133:0/769200905 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fbe2411e890 con 0x7fbe2c15a970 2023-12-18T10:19:29.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.173+0000 7fbe2bfff640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe18065a60 0x7fbe18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:29.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.173+0000 7fbe2bfff640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe18065a60 0x7fbe18067f20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009b60 tx=0x7fbe1c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:29.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.177+0000 7fbe28ff9640 1 -- 172.21.15.133:0/769200905 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbe240ec530 con 0x7fbe2c15a970 2023-12-18T10:19:29.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.325+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbe2c0b0cd0 con 0x7fbe2c15a970 2023-12-18T10:19:29.997 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-18T10:19:29.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:29.993+0000 7fbe28ff9640 1 -- 172.21.15.133:0/769200905 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbe240efb50 con 0x7fbe2c15a970 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe18065a60 msgr2=0x7fbe18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe18065a60 0x7fbe18067f20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009b60 tx=0x7fbe1c009190 comp rx=0 tx=0).stop 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2c15a970 msgr2=0x7fbe2c15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2c15a970 0x7fbe2c15c980 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbe240af040 tx=0x7fbe24019780 comp rx=0 tx=0).stop 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 shutdown_connections 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbe18065a60 0x7fbe18067f20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2c15a970 0x7fbe2c15c980 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbe2c15a590 0x7fbe2c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 --2- 172.21.15.133:0/769200905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbe2c0ce9c0 0x7fbe2c1651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 >> 172.21.15.133:0/769200905 conn(0x7fbe2c06a2a0 msgr2=0x7fbe2c15ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:30.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 shutdown_connections 2023-12-18T10:19:30.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.005+0000 7fbe32318640 1 -- 172.21.15.133:0/769200905 wait complete. 2023-12-18T10:19:30.037 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-18T10:19:30.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa6777b3640 1 Processor -- start 2023-12-18T10:19:30.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa6777b3640 1 -- start start 2023-12-18T10:19:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa6777b3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6700ca410 0x7fa670159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa6777b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700cbff0 0x7fa6700cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa6777b3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6700cc930 con 0x7fa670159fb0 2023-12-18T10:19:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa6777b3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67015aab0 con 0x7fa6700ca410 2023-12-18T10:19:30.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa6777b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa670070df0 con 0x7fa6700cbff0 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa674d4e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa670159fb0 0x7fa670071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41994/0 (socket says 172.21.15.133:41994) 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa674d4e640 1 -- 172.21.15.133:0/3958099297 learned_addr learned my addr 172.21.15.133:0/3958099297 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa67554f640 1 --2- 172.21.15.133:0/3958099297 >> v2:172.21.15.133:3300/0 conn(0x7fa6700ca410 0x7fa670159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.177+0000 7fa675d50640 1 --2- 172.21.15.133:0/3958099297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700cbff0 0x7fa6700cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa67554f640 1 -- 172.21.15.133:0/3958099297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700cbff0 msgr2=0x7fa6700cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa67554f640 1 --2- 172.21.15.133:0/3958099297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700cbff0 0x7fa6700cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa67554f640 1 -- 172.21.15.133:0/3958099297 >> v1:172.21.15.133:6789/0 conn(0x7fa670159fb0 legacy=0x7fa670071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa67554f640 1 -- 172.21.15.133:0/3958099297 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67015a4f0 con 0x7fa6700ca410 2023-12-18T10:19:30.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa667fff640 1 -- 172.21.15.133:0/3958099297 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066565444 0 0) 0x7fa6700cc930 con 0x7fa670159fb0 2023-12-18T10:19:30.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa67554f640 1 --2- 172.21.15.133:0/3958099297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700ca410 0x7fa670159a70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0097c0 tx=0x7fa66c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14ee5ea6078dc79 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa667fff640 1 -- 172.21.15.133:0/3958099297 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0ab650 con 0x7fa6700ca410 2023-12-18T10:19:30.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa667fff640 1 -- 172.21.15.133:0/3958099297 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0ab7b0 con 0x7fa6700ca410 2023-12-18T10:19:30.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa667fff640 1 -- 172.21.15.133:0/3958099297 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0abb40 con 0x7fa6700ca410 2023-12-18T10:19:30.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa6777b3640 1 -- 172.21.15.133:0/3958099297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700ca410 msgr2=0x7fa670159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.181+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3958099297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700ca410 0x7fa670159a70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0097c0 tx=0x7fa66c01c450 comp rx=0 tx=0).stop 2023-12-18T10:19:30.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 -- 172.21.15.133:0/3958099297 shutdown_connections 2023-12-18T10:19:30.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3958099297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700cbff0 0x7fa6700cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3958099297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700ca410 0x7fa670159a70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 -- 172.21.15.133:0/3958099297 >> 172.21.15.133:0/3958099297 conn(0x7fa67006a2a0 msgr2=0x7fa6700aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:30.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 -- 172.21.15.133:0/3958099297 shutdown_connections 2023-12-18T10:19:30.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 -- 172.21.15.133:0/3958099297 wait complete. 2023-12-18T10:19:30.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 Processor -- start 2023-12-18T10:19:30.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 -- start start 2023-12-18T10:19:30.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700ca410 0x7fa670151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700cbff0 0x7fa67015c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa670159fb0 0x7fa6700c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa670153050 con 0x7fa6700cbff0 2023-12-18T10:19:30.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700c4d50 con 0x7fa670159fb0 2023-12-18T10:19:30.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa6777b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6701515e0 con 0x7fa6700ca410 2023-12-18T10:19:30.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700cbff0 0x7fa67015c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700cbff0 0x7fa67015c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59704/0 (socket says 172.21.15.133:59704) 2023-12-18T10:19:30.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 -- 172.21.15.133:0/3269233872 learned_addr learned my addr 172.21.15.133:0/3269233872 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa67554f640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700ca410 0x7fa670151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa675d50640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa670159fb0 0x7fa6700c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 -- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700ca410 msgr2=0x7fa670151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700ca410 0x7fa670151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 -- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa670159fb0 msgr2=0x7fa6700c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa670159fb0 0x7fa6700c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 -- 172.21.15.133:0/3269233872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009420 con 0x7fa6700cbff0 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa67554f640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700ca410 0x7fa670151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:30.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa675d50640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa670159fb0 0x7fa6700c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa674d4e640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700cbff0 0x7fa67015c500 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c520 tx=0x7fa66000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.185+0000 7fa665ffb640 1 -- 172.21.15.133:0/3269233872 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660005cf0 con 0x7fa6700cbff0 2023-12-18T10:19:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa665ffb640 1 -- 172.21.15.133:0/3269233872 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660005e70 con 0x7fa6700cbff0 2023-12-18T10:19:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa665ffb640 1 -- 172.21.15.133:0/3269233872 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660007310 con 0x7fa6700cbff0 2023-12-18T10:19:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6701518c0 con 0x7fa6700cbff0 2023-12-18T10:19:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa670151e80 con 0x7fa6700cbff0 2023-12-18T10:19:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67004e000 con 0x7fa6700cbff0 2023-12-18T10:19:30.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa665ffb640 1 -- 172.21.15.133:0/3269233872 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa660007470 con 0x7fa6700cbff0 2023-12-18T10:19:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa665ffb640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa654065a60 0x7fa654067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa665ffb640 1 -- 172.21.15.133:0/3269233872 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fa6600828b0 con 0x7fa6700cbff0 2023-12-18T10:19:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.189+0000 7fa67554f640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa654065a60 0x7fa654067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.193+0000 7fa67554f640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa654065a60 0x7fa654067f20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af000 tx=0x7fa66c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.197+0000 7fa665ffb640 1 -- 172.21.15.133:0/3269233872 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa660050180 con 0x7fa6700cbff0 2023-12-18T10:19:30.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.377+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa670153660 con 0x7fa6700cbff0 2023-12-18T10:19:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.389+0000 7fa665ffb640 1 -- 172.21.15.133:0/3269233872 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa660017020 con 0x7fa6700cbff0 2023-12-18T10:19:30.391 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 5 and data pool 6 2023-12-18T10:19:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa654065a60 msgr2=0x7fa654067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa654065a60 0x7fa654067f20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0af000 tx=0x7fa66c008040 comp rx=0 tx=0).stop 2023-12-18T10:19:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700cbff0 msgr2=0x7fa67015c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700cbff0 0x7fa67015c500 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c520 tx=0x7fa66000c9e0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 shutdown_connections 2023-12-18T10:19:30.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa654065a60 0x7fa654067f20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa670159fb0 0x7fa6700c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6700cbff0 0x7fa67015c500 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 --2- 172.21.15.133:0/3269233872 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6700ca410 0x7fa670151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.393+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 >> 172.21.15.133:0/3269233872 conn(0x7fa67006a2a0 msgr2=0x7fa6700aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:30.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.397+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 shutdown_connections 2023-12-18T10:19:30.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.397+0000 7fa6777b3640 1 -- 172.21.15.133:0/3269233872 wait complete. 2023-12-18T10:19:30.433 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:30.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffbaa22d640 1 Processor -- start 2023-12-18T10:19:30.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffbaa22d640 1 -- start start 2023-12-18T10:19:30.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffbaa22d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffba415cc40 0x7ffba40d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffbaa22d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba40ce250 0x7ffba40d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffbaa22d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba40cddc0 con 0x7ffba415c860 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffbaa22d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba40cffa0 con 0x7ffba415cc40 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffbaa22d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40cd770 con 0x7ffba40ce250 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba37fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffba415c860 0x7ffba40cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42006/0 (socket says 172.21.15.133:42006) 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba37fe640 1 -- 172.21.15.133:0/1312188549 learned_addr learned my addr 172.21.15.133:0/1312188549 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba2ffd640 1 --2- 172.21.15.133:0/1312188549 >> v2:172.21.15.142:3300/0 conn(0x7ffba415cc40 0x7ffba40d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba3fff640 1 --2- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba40ce250 0x7ffba40d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba27fc640 1 -- 172.21.15.133:0/1312188549 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278042914 0 0) 0x7ffba40cddc0 con 0x7ffba415c860 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba27fc640 1 -- 172.21.15.133:0/1312188549 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb8c003530 con 0x7ffba415c860 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba2ffd640 1 -- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba40ce250 msgr2=0x7ffba40d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:30.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba2ffd640 1 --2- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba40ce250 0x7ffba40d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba2ffd640 1 -- 172.21.15.133:0/1312188549 >> v1:172.21.15.133:6789/0 conn(0x7ffba415c860 legacy=0x7ffba40cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba2ffd640 1 -- 172.21.15.133:0/1312188549 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba40cda50 con 0x7ffba415cc40 2023-12-18T10:19:30.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.569+0000 7ffba3fff640 1 --2- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba40ce250 0x7ffba40d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:30.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffba2ffd640 1 --2- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415cc40 0x7ffba40d2da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb980097c0 tx=0x7ffb9801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b9ec7095bf465a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffba27fc640 1 -- 172.21.15.133:0/1312188549 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980a8970 con 0x7ffba415cc40 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffba27fc640 1 -- 172.21.15.133:0/1312188549 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb980a8ad0 con 0x7ffba415cc40 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffba27fc640 1 -- 172.21.15.133:0/1312188549 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb980a8e40 con 0x7ffba415cc40 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffbaa22d640 1 -- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415cc40 msgr2=0x7ffba40d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415cc40 0x7ffba40d2da0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb980097c0 tx=0x7ffb9801ec70 comp rx=0 tx=0).stop 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffbaa22d640 1 -- 172.21.15.133:0/1312188549 shutdown_connections 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba40ce250 0x7ffba40d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/1312188549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415cc40 0x7ffba40d2da0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffbaa22d640 1 -- 172.21.15.133:0/1312188549 >> 172.21.15.133:0/1312188549 conn(0x7ffba4089fb0 msgr2=0x7ffba409baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffbaa22d640 1 -- 172.21.15.133:0/1312188549 shutdown_connections 2023-12-18T10:19:30.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.573+0000 7ffbaa22d640 1 -- 172.21.15.133:0/1312188549 wait complete. 2023-12-18T10:19:30.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 Processor -- start 2023-12-18T10:19:30.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 -- start start 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba40ce250 0x7ffba40b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415c860 0x7ffba40b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba415cc40 0x7ffba4159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40b65e0 con 0x7ffba40ce250 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40b68c0 con 0x7ffba415c860 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba40b6ba0 con 0x7ffba415cc40 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba40ce250 0x7ffba40b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba40ce250 0x7ffba40b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59710/0 (socket says 172.21.15.133:59710) 2023-12-18T10:19:30.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 -- 172.21.15.133:0/2321348616 learned_addr learned my addr 172.21.15.133:0/2321348616 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba3fff640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba415cc40 0x7ffba4159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba2ffd640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415c860 0x7ffba40b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 -- 172.21.15.133:0/2321348616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba415cc40 msgr2=0x7ffba4159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba415cc40 0x7ffba4159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 -- 172.21.15.133:0/2321348616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415c860 msgr2=0x7ffba40b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415c860 0x7ffba40b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 -- 172.21.15.133:0/2321348616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c009a70 con 0x7ffba40ce250 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffba37fe640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba40ce250 0x7ffba40b7170 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400c700 tx=0x7ffb9400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffb8bfff640 1 -- 172.21.15.133:0/2321348616 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94007270 con 0x7ffba40ce250 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffb8bfff640 1 -- 172.21.15.133:0/2321348616 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb940073d0 con 0x7ffba40ce250 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb98009420 con 0x7ffba40ce250 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffb8bfff640 1 -- 172.21.15.133:0/2321348616 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94001d50 con 0x7ffba40ce250 2023-12-18T10:19:30.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.577+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba41f23f0 con 0x7ffba40ce250 2023-12-18T10:19:30.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.581+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba41f2610 con 0x7ffba40ce250 2023-12-18T10:19:30.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.581+0000 7ffb8bfff640 1 -- 172.21.15.133:0/2321348616 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb940057b0 con 0x7ffba40ce250 2023-12-18T10:19:30.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.581+0000 7ffb8bfff640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb90065a60 0x7ffb90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.581+0000 7ffb8bfff640 1 -- 172.21.15.133:0/2321348616 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ffb94082850 con 0x7ffba40ce250 2023-12-18T10:19:30.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.581+0000 7ffba2ffd640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb90065a60 0x7ffb90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.581+0000 7ffba2ffd640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb90065a60 0x7ffb90067f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb980b2000 tx=0x7ffb980aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.585+0000 7ffb8bfff640 1 -- 172.21.15.133:0/2321348616 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb940500f0 con 0x7ffba40ce250 2023-12-18T10:19:30.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.737+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffba404e000 con 0x7ffba40ce250 2023-12-18T10:19:30.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.737+0000 7ffb8bfff640 1 -- 172.21.15.133:0/2321348616 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16367 (secure 0 0 0) 0x7ffb94053710 con 0x7ffba40ce250 2023-12-18T10:19:30.742 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:30.742 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:19:30.379940+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:19:28.252118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-18T10:19:29.371748+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb90065a60 msgr2=0x7ffb90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb90065a60 0x7ffb90067f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb980b2000 tx=0x7ffb980aa070 comp rx=0 tx=0).stop 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba40ce250 msgr2=0x7ffba40b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba40ce250 0x7ffba40b7170 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400c700 tx=0x7ffb9400cbc0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 shutdown_connections 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffb90065a60 0x7ffb90067f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffba415cc40 0x7ffba4159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffba415c860 0x7ffba40b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 --2- 172.21.15.133:0/2321348616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffba40ce250 0x7ffba40b7170 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 >> 172.21.15.133:0/2321348616 conn(0x7ffba4089fb0 msgr2=0x7ffba406b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 shutdown_connections 2023-12-18T10:19:30.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.741+0000 7ffbaa22d640 1 -- 172.21.15.133:0/2321348616 wait complete. 2023-12-18T10:19:30.763 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab9368c640 1 Processor -- start 2023-12-18T10:19:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab9368c640 1 -- start start 2023-12-18T10:19:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab9368c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab8c0cdc20 0x7fab8c0717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab9368c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0ccde0 con 0x7fab8c069ca0 2023-12-18T10:19:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab9368c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0cc820 con 0x7fab8c15caf0 2023-12-18T10:19:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab9368c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c0cc600 con 0x7fab8c0cdc20 2023-12-18T10:19:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab91428640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fab8c069ca0 0x7fab8c06a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42012/0 (socket says 172.21.15.133:42012) 2023-12-18T10:19:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab91428640 1 -- 172.21.15.133:0/4233000896 learned_addr learned my addr 172.21.15.133:0/4233000896 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab91c29640 1 --2- 172.21.15.133:0/4233000896 >> v2:172.21.15.142:3300/0 conn(0x7fab8c0cdc20 0x7fab8c0717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab83fff640 1 -- 172.21.15.133:0/4233000896 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077541715 0 0) 0x7fab8c0ccde0 con 0x7fab8c069ca0 2023-12-18T10:19:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab83fff640 1 -- 172.21.15.133:0/4233000896 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab78003530 con 0x7fab8c069ca0 2023-12-18T10:19:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab91c29640 1 -- 172.21.15.133:0/4233000896 >> v1:172.21.15.142:6789/0 conn(0x7fab8c15caf0 legacy=0x7fab8c0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab91c29640 1 -- 172.21.15.133:0/4233000896 >> v1:172.21.15.133:6789/0 conn(0x7fab8c069ca0 legacy=0x7fab8c06a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.897+0000 7fab91c29640 1 -- 172.21.15.133:0/4233000896 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0ccb00 con 0x7fab8c0cdc20 2023-12-18T10:19:30.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab91c29640 1 --2- 172.21.15.133:0/4233000896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0717f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab84009d90 tx=0x7fab8401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=723f692c7927e9cc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab83fff640 1 -- 172.21.15.133:0/4233000896 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840a59e0 con 0x7fab8c0cdc20 2023-12-18T10:19:30.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab83fff640 1 -- 172.21.15.133:0/4233000896 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab840a5b40 con 0x7fab8c0cdc20 2023-12-18T10:19:30.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab83fff640 1 -- 172.21.15.133:0/4233000896 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab840ad440 con 0x7fab8c0cdc20 2023-12-18T10:19:30.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab9368c640 1 -- 172.21.15.133:0/4233000896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c0cdc20 msgr2=0x7fab8c0717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab9368c640 1 --2- 172.21.15.133:0/4233000896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0717f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab84009d90 tx=0x7fab8401c920 comp rx=0 tx=0).stop 2023-12-18T10:19:30.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab9368c640 1 -- 172.21.15.133:0/4233000896 shutdown_connections 2023-12-18T10:19:30.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab9368c640 1 --2- 172.21.15.133:0/4233000896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0717f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.901+0000 7fab9368c640 1 -- 172.21.15.133:0/4233000896 >> 172.21.15.133:0/4233000896 conn(0x7fab8c06cf80 msgr2=0x7fab8c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:30.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 -- 172.21.15.133:0/4233000896 shutdown_connections 2023-12-18T10:19:30.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 -- 172.21.15.133:0/4233000896 wait complete. 2023-12-18T10:19:30.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 Processor -- start 2023-12-18T10:19:30.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 -- start start 2023-12-18T10:19:30.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c069ca0 0x7fab8c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab8c15caf0 0x7fab8c15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0c3fd0 con 0x7fab8c0cdc20 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0c33c0 con 0x7fab8c069ca0 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0c36a0 con 0x7fab8c15caf0 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59724/0 (socket says 172.21.15.133:59724) 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 -- 172.21.15.133:0/1732333126 learned_addr learned my addr 172.21.15.133:0/1732333126 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab91428640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c069ca0 0x7fab8c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab91c29640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab8c15caf0 0x7fab8c15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 -- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab8c15caf0 msgr2=0x7fab8c15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab8c15caf0 0x7fab8c15b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 -- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c069ca0 msgr2=0x7fab8c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c069ca0 0x7fab8c0c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 -- 172.21.15.133:0/1732333126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009a70 con 0x7fab8c0cdc20 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab91c29640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab8c15caf0 0x7fab8c15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:30.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab91428640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c069ca0 0x7fab8c0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:30.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab90c27640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0ae230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c390 tx=0x7fab7c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab81ffb640 1 -- 172.21.15.133:0/1732333126 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0052d0 con 0x7fab8c0cdc20 2023-12-18T10:19:30.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab81ffb640 1 -- 172.21.15.133:0/1732333126 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c005430 con 0x7fab8c0cdc20 2023-12-18T10:19:30.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab81ffb640 1 -- 172.21.15.133:0/1732333126 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c003820 con 0x7fab8c0cdc20 2023-12-18T10:19:30.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.905+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c0c3980 con 0x7fab8c0cdc20 2023-12-18T10:19:30.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.909+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c0ae770 con 0x7fab8c0cdc20 2023-12-18T10:19:30.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.909+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c04e000 con 0x7fab8c0cdc20 2023-12-18T10:19:30.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.909+0000 7fab81ffb640 1 -- 172.21.15.133:0/1732333126 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fab7c003980 con 0x7fab8c0cdc20 2023-12-18T10:19:30.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.909+0000 7fab81ffb640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fab70065a60 0x7fab70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:30.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.909+0000 7fab81ffb640 1 -- 172.21.15.133:0/1732333126 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fab7c0828c0 con 0x7fab8c0cdc20 2023-12-18T10:19:30.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.909+0000 7fab91428640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fab70065a60 0x7fab70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:30.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.909+0000 7fab91428640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fab70065a60 0x7fab70067f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab880011f0 tx=0x7fab88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:30.913+0000 7fab81ffb640 1 -- 172.21.15.133:0/1732333126 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fab7c0500a0 con 0x7fab8c0cdc20 2023-12-18T10:19:31.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.069+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab8c0b10e0 con 0x7fab8c0cdc20 2023-12-18T10:19:31.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab81ffb640 1 -- 172.21.15.133:0/1732333126 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16367 (secure 0 0 0) 0x7fab7c017090 con 0x7fab8c0cdc20 2023-12-18T10:19:31.075 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:31.075 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:19:30.379940+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:19:28.252118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-18T10:19:29.371748+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fab70065a60 msgr2=0x7fab70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fab70065a60 0x7fab70067f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab880011f0 tx=0x7fab88009040 comp rx=0 tx=0).stop 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab8c0cdc20 msgr2=0x7fab8c0ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0ae230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c390 tx=0x7fab7c00c850 comp rx=0 tx=0).stop 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 shutdown_connections 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fab70065a60 0x7fab70067f20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab8c15caf0 0x7fab8c15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab8c0cdc20 0x7fab8c0ae230 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 --2- 172.21.15.133:0/1732333126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab8c069ca0 0x7fab8c0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 >> 172.21.15.133:0/1732333126 conn(0x7fab8c06cf80 msgr2=0x7fab8c0af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 shutdown_connections 2023-12-18T10:19:31.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.073+0000 7fab9368c640 1 -- 172.21.15.133:0/1732333126 wait complete. 2023-12-18T10:19:31.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-18T10:19:31.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.233+0000 7fe905796640 1 Processor -- start 2023-12-18T10:19:31.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.233+0000 7fe905796640 1 -- start start 2023-12-18T10:19:31.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe905796640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe900153020 0x7fe9000c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:31.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe905796640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 0x7fe9000ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe905796640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9000c9730 con 0x7fe9000ce8d0 2023-12-18T10:19:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe905796640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9000ced60 con 0x7fe900153020 2023-12-18T10:19:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe905796640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c8e00 con 0x7fe9001598d0 2023-12-18T10:19:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8feffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe900153020 0x7fe9000c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8ff7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe9000ce8d0 0x7fe900070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42016/0 (socket says 172.21.15.133:42016) 2023-12-18T10:19:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8ff7fe640 1 -- 172.21.15.133:0/206199357 learned_addr learned my addr 172.21.15.133:0/206199357 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8f7fff640 1 --2- 172.21.15.133:0/206199357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 0x7fe9000ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8feffd640 1 -- 172.21.15.133:0/206199357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 msgr2=0x7fe9000ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8feffd640 1 --2- 172.21.15.133:0/206199357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 0x7fe9000ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8feffd640 1 -- 172.21.15.133:0/206199357 >> v1:172.21.15.133:6789/0 conn(0x7fe9000ce8d0 legacy=0x7fe900070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8feffd640 1 -- 172.21.15.133:0/206199357 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000c90e0 con 0x7fe900153020 2023-12-18T10:19:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.237+0000 7fe8fe7fc640 1 -- 172.21.15.133:0/206199357 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371546890 0 0) 0x7fe9000c9730 con 0x7fe9000ce8d0 2023-12-18T10:19:31.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe8feffd640 1 --2- 172.21.15.133:0/206199357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9000c9bc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000a960 tx=0x7fe8f001d700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cad8d4839b29cc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:31.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe8fe7fc640 1 -- 172.21.15.133:0/206199357 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00a6790 con 0x7fe900153020 2023-12-18T10:19:31.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe8fe7fc640 1 -- 172.21.15.133:0/206199357 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f00a68f0 con 0x7fe900153020 2023-12-18T10:19:31.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe8fe7fc640 1 -- 172.21.15.133:0/206199357 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00a6c80 con 0x7fe900153020 2023-12-18T10:19:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 -- 172.21.15.133:0/206199357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 msgr2=0x7fe9000c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 --2- 172.21.15.133:0/206199357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9000c9bc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000a960 tx=0x7fe8f001d700 comp rx=0 tx=0).stop 2023-12-18T10:19:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 -- 172.21.15.133:0/206199357 shutdown_connections 2023-12-18T10:19:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 --2- 172.21.15.133:0/206199357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 0x7fe9000ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 --2- 172.21.15.133:0/206199357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9000c9bc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 -- 172.21.15.133:0/206199357 >> 172.21.15.133:0/206199357 conn(0x7fe90006a2a0 msgr2=0x7fe9000aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:31.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 -- 172.21.15.133:0/206199357 shutdown_connections 2023-12-18T10:19:31.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 -- 172.21.15.133:0/206199357 wait complete. 2023-12-18T10:19:31.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 Processor -- start 2023-12-18T10:19:31.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.241+0000 7fe905796640 1 -- start start 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9000ce8d0 0x7fe9000af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9001478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 0x7fe900157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000afc30 con 0x7fe900153020 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90015b4e0 con 0x7fe9000ce8d0 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90015b7c0 con 0x7fe9001598d0 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9001478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9001478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59754/0 (socket says 172.21.15.133:59754) 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 -- 172.21.15.133:0/1727365128 learned_addr learned my addr 172.21.15.133:0/1727365128 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8ff7fe640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 0x7fe900157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8feffd640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9000ce8d0 0x7fe9000af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 -- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 msgr2=0x7fe900157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:31.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 0x7fe900157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 -- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9000ce8d0 msgr2=0x7fe9000af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9000ce8d0 0x7fe9000af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 -- 172.21.15.133:0/1727365128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f000a5c0 con 0x7fe900153020 2023-12-18T10:19:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8feffd640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9000ce8d0 0x7fe9000af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:31.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f7fff640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9001478b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800e870 tx=0x7fe8e800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:31.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f77fe640 1 -- 172.21.15.133:0/1727365128 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8009510 con 0x7fe900153020 2023-12-18T10:19:31.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f77fe640 1 -- 172.21.15.133:0/1727365128 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e800eec0 con 0x7fe900153020 2023-12-18T10:19:31.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f77fe640 1 -- 172.21.15.133:0/1727365128 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800cb40 con 0x7fe900153020 2023-12-18T10:19:31.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90015baa0 con 0x7fe900153020 2023-12-18T10:19:31.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe900147df0 con 0x7fe900153020 2023-12-18T10:19:31.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9000b1180 con 0x7fe900153020 2023-12-18T10:19:31.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.245+0000 7fe8f77fe640 1 -- 172.21.15.133:0/1727365128 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8e800cca0 con 0x7fe900153020 2023-12-18T10:19:31.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.249+0000 7fe8f77fe640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe8e0065a90 0x7fe8e0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:31.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.249+0000 7fe8f77fe640 1 -- 172.21.15.133:0/1727365128 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe8e8083350 con 0x7fe900153020 2023-12-18T10:19:31.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.249+0000 7fe8feffd640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe8e0065a90 0x7fe8e0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:31.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.249+0000 7fe8feffd640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe8e0065a90 0x7fe8e0067f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00b0000 tx=0x7fe8f00a8070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:31.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.253+0000 7fe8f77fe640 1 -- 172.21.15.133:0/1727365128 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe9000b1180 con 0x7fe900153020 2023-12-18T10:19:31.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:31.433+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe9000b1180 con 0x7fe900153020 2023-12-18T10:19:32.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.397+0000 7fe8f77fe640 1 -- 172.21.15.133:0/1727365128 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe9000b1180 con 0x7fe900153020 2023-12-18T10:19:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe8e0065a90 msgr2=0x7fe8e0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe8e0065a90 0x7fe8e0067f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00b0000 tx=0x7fe8f00a8070 comp rx=0 tx=0).stop 2023-12-18T10:19:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 msgr2=0x7fe9001478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9001478b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800e870 tx=0x7fe8e800ec70 comp rx=0 tx=0).stop 2023-12-18T10:19:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 shutdown_connections 2023-12-18T10:19:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe8e0065a90 0x7fe8e0067f50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:32.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9001598d0 0x7fe900157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe900153020 0x7fe9001478b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 --2- 172.21.15.133:0/1727365128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9000ce8d0 0x7fe9000af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 >> 172.21.15.133:0/1727365128 conn(0x7fe90006a2a0 msgr2=0x7fe9000cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 shutdown_connections 2023-12-18T10:19:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.401+0000 7fe905796640 1 -- 172.21.15.133:0/1727365128 wait complete. 2023-12-18T10:19:32.426 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-18T10:19:32.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-18T10:19:32.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.565+0000 7f2f8cdce640 1 Processor -- start 2023-12-18T10:19:32.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.565+0000 7f2f8cdce640 1 -- start start 2023-12-18T10:19:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f8cdce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f880cc700 0x7f2f88071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f8cdce640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f88070df0 con 0x7f2f88071870 2023-12-18T10:19:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f8cdce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8815a4f0 con 0x7f2f880ca410 2023-12-18T10:19:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f8cdce640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8815aab0 con 0x7f2f880cc700 2023-12-18T10:19:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f86d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f880cc700 0x7f2f88071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f85d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2f88071870 0x7f2f880cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42024/0 (socket says 172.21.15.133:42024) 2023-12-18T10:19:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f85d9b640 1 -- 172.21.15.133:0/2532153176 learned_addr learned my addr 172.21.15.133:0/2532153176 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f86d9d640 1 -- 172.21.15.133:0/2532153176 >> v1:172.21.15.142:6789/0 conn(0x7f2f880ca410 legacy=0x7f2f88159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f86d9d640 1 -- 172.21.15.133:0/2532153176 >> v1:172.21.15.133:6789/0 conn(0x7f2f88071870 legacy=0x7f2f880cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f86d9d640 1 -- 172.21.15.133:0/2532153176 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8815a7d0 con 0x7f2f880cc700 2023-12-18T10:19:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.569+0000 7f2f8559a640 1 -- 172.21.15.133:0/2532153176 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501748352 0 0) 0x7f2f88070df0 con 0x7f2f88071870 2023-12-18T10:19:32.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f86d9d640 1 --2- 172.21.15.133:0/2532153176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880cc700 0x7f2f88071d00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f800097c0 tx=0x7f2f8001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8addb7d8992d4811 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:32.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8559a640 1 -- 172.21.15.133:0/2532153176 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800ab650 con 0x7f2f880cc700 2023-12-18T10:19:32.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8559a640 1 -- 172.21.15.133:0/2532153176 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f800ab7b0 con 0x7f2f880cc700 2023-12-18T10:19:32.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8559a640 1 -- 172.21.15.133:0/2532153176 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f800abb40 con 0x7f2f880cc700 2023-12-18T10:19:32.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 -- 172.21.15.133:0/2532153176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880cc700 msgr2=0x7f2f88071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 --2- 172.21.15.133:0/2532153176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880cc700 0x7f2f88071d00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f800097c0 tx=0x7f2f8001c450 comp rx=0 tx=0).stop 2023-12-18T10:19:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 -- 172.21.15.133:0/2532153176 shutdown_connections 2023-12-18T10:19:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 --2- 172.21.15.133:0/2532153176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880cc700 0x7f2f88071d00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 -- 172.21.15.133:0/2532153176 >> 172.21.15.133:0/2532153176 conn(0x7f2f8806a2a0 msgr2=0x7f2f880aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 -- 172.21.15.133:0/2532153176 shutdown_connections 2023-12-18T10:19:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 -- 172.21.15.133:0/2532153176 wait complete. 2023-12-18T10:19:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 Processor -- start 2023-12-18T10:19:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.573+0000 7f2f8cdce640 1 -- start start 2023-12-18T10:19:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f88071870 0x7f2f8815c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880ca410 0x7f2f8814cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f8814e530 0x7f2f88147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8814e9f0 con 0x7f2f880ca410 2023-12-18T10:19:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880aecc0 con 0x7f2f88071870 2023-12-18T10:19:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880aefa0 con 0x7f2f8814e530 2023-12-18T10:19:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880ca410 0x7f2f8814cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880ca410 0x7f2f8814cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59782/0 (socket says 172.21.15.133:59782) 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 -- 172.21.15.133:0/807959358 learned_addr learned my addr 172.21.15.133:0/807959358 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8659c640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f88071870 0x7f2f8815c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f86d9d640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f8814e530 0x7f2f88147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 -- 172.21.15.133:0/807959358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f8814e530 msgr2=0x7f2f88147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f8814e530 0x7f2f88147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 -- 172.21.15.133:0/807959358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f88071870 msgr2=0x7f2f8815c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f88071870 0x7f2f8815c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 -- 172.21.15.133:0/807959358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80009420 con 0x7f2f880ca410 2023-12-18T10:19:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f85d9b640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880ca410 0x7f2f8814cd10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c410 tx=0x7f2f7c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f76ffd640 1 -- 172.21.15.133:0/807959358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0074e0 con 0x7f2f880ca410 2023-12-18T10:19:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f76ffd640 1 -- 172.21.15.133:0/807959358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c007640 con 0x7f2f880ca410 2023-12-18T10:19:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f880af280 con 0x7f2f880ca410 2023-12-18T10:19:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f76ffd640 1 -- 172.21.15.133:0/807959358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c004a30 con 0x7f2f880ca410 2023-12-18T10:19:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f880c2110 con 0x7f2f880ca410 2023-12-18T10:19:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.577+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8804e000 con 0x7f2f880ca410 2023-12-18T10:19:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.581+0000 7f2f76ffd640 1 -- 172.21.15.133:0/807959358 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2f7c004b90 con 0x7f2f880ca410 2023-12-18T10:19:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.581+0000 7f2f76ffd640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f68065a60 0x7f2f68067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.581+0000 7f2f76ffd640 1 -- 172.21.15.133:0/807959358 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2f7c082f70 con 0x7f2f880ca410 2023-12-18T10:19:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.581+0000 7f2f8659c640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f68065a60 0x7f2f68067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.581+0000 7f2f8659c640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f68065a60 0x7f2f68067f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f780012f0 tx=0x7f2f78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:32.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.585+0000 7f2f76ffd640 1 -- 172.21.15.133:0/807959358 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2f7c050890 con 0x7f2f880ca410 2023-12-18T10:19:32.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:32.765+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2f88152100 con 0x7f2f880ca410 2023-12-18T10:19:33.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f76ffd640 1 -- 172.21.15.133:0/807959358 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f7c053eb0 con 0x7f2f880ca410 2023-12-18T10:19:33.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f68065a60 msgr2=0x7f2f68067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f68065a60 0x7f2f68067f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f780012f0 tx=0x7f2f78009040 comp rx=0 tx=0).stop 2023-12-18T10:19:33.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880ca410 msgr2=0x7f2f8814cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880ca410 0x7f2f8814cd10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c410 tx=0x7f2f7c00c8d0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 shutdown_connections 2023-12-18T10:19:33.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f68065a60 0x7f2f68067f20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f8814e530 0x7f2f88147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f880ca410 0x7f2f8814cd10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 --2- 172.21.15.133:0/807959358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f88071870 0x7f2f8815c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 >> 172.21.15.133:0/807959358 conn(0x7f2f8806a2a0 msgr2=0x7f2f88158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:33.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 shutdown_connections 2023-12-18T10:19:33.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.401+0000 7f2f8cdce640 1 -- 172.21.15.133:0/807959358 wait complete. 2023-12-18T10:19:33.426 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-18T10:19:33.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:33.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5be63640 1 Processor -- start 2023-12-18T10:19:33.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5be63640 1 -- start start 2023-12-18T10:19:33.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5be63640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae5406d200 0x7fae5406a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5be63640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae5406c880 0x7fae5406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5be63640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5406aba0 con 0x7fae540c7dd0 2023-12-18T10:19:33.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5be63640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae541613d0 con 0x7fae5406c880 2023-12-18T10:19:33.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5be63640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540cd500 con 0x7fae5406d200 2023-12-18T10:19:33.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae593fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae5406c880 0x7fae5406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5a400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae540c7dd0 0x7fae540c8200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42040/0 (socket says 172.21.15.133:42040) 2023-12-18T10:19:33.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae5a400640 1 -- 172.21.15.133:0/2992571411 learned_addr learned my addr 172.21.15.133:0/2992571411 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:33.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae59bff640 1 --2- 172.21.15.133:0/2992571411 >> v2:172.21.15.142:3300/0 conn(0x7fae5406d200 0x7fae5406a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae593fe640 1 -- 172.21.15.133:0/2992571411 >> v2:172.21.15.142:3300/0 conn(0x7fae5406d200 msgr2=0x7fae5406a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:33.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae593fe640 1 --2- 172.21.15.133:0/2992571411 >> v2:172.21.15.142:3300/0 conn(0x7fae5406d200 0x7fae5406a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae593fe640 1 -- 172.21.15.133:0/2992571411 >> v1:172.21.15.133:6789/0 conn(0x7fae540c7dd0 legacy=0x7fae540c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae593fe640 1 -- 172.21.15.133:0/2992571411 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5415d770 con 0x7fae5406c880 2023-12-18T10:19:33.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.565+0000 7fae58bfd640 1 -- 172.21.15.133:0/2992571411 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960698102 0 0) 0x7fae4c0014a0 con 0x7fae540c7dd0 2023-12-18T10:19:33.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae593fe640 1 --2- 172.21.15.133:0/2992571411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae5406c880 0x7fae5406d5e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fae540701b0 tx=0x7fae4401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a492bbe0ab69f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:33.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae58bfd640 1 -- 172.21.15.133:0/2992571411 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440ab660 con 0x7fae5406c880 2023-12-18T10:19:33.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae58bfd640 1 -- 172.21.15.133:0/2992571411 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae440ab7c0 con 0x7fae5406c880 2023-12-18T10:19:33.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae58bfd640 1 -- 172.21.15.133:0/2992571411 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440abb50 con 0x7fae5406c880 2023-12-18T10:19:33.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae5be63640 1 -- 172.21.15.133:0/2992571411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae5406c880 msgr2=0x7fae5406d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae5be63640 1 --2- 172.21.15.133:0/2992571411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae5406c880 0x7fae5406d5e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fae540701b0 tx=0x7fae4401c460 comp rx=0 tx=0).stop 2023-12-18T10:19:33.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae5be63640 1 -- 172.21.15.133:0/2992571411 shutdown_connections 2023-12-18T10:19:33.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae5be63640 1 --2- 172.21.15.133:0/2992571411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae5406c880 0x7fae5406d5e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae5be63640 1 --2- 172.21.15.133:0/2992571411 >> v2:172.21.15.142:3300/0 conn(0x7fae5406d200 0x7fae5406a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae5be63640 1 -- 172.21.15.133:0/2992571411 >> 172.21.15.133:0/2992571411 conn(0x7fae540cb540 msgr2=0x7fae540cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:33.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae5be63640 1 -- 172.21.15.133:0/2992571411 shutdown_connections 2023-12-18T10:19:33.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.569+0000 7fae5be63640 1 -- 172.21.15.133:0/2992571411 wait complete. 2023-12-18T10:19:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 Processor -- start 2023-12-18T10:19:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 -- start start 2023-12-18T10:19:33.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae5406c880 0x7fae5414e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5406d200 0x7fae5415e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae540c7dd0 0x7fae5414a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5414ee60 con 0x7fae540c7dd0 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5415fae0 con 0x7fae5406c880 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5415ef60 con 0x7fae5406d200 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae540c7dd0 0x7fae5414a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae540c7dd0 0x7fae5414a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59802/0 (socket says 172.21.15.133:59802) 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 -- 172.21.15.133:0/4152125792 learned_addr learned my addr 172.21.15.133:0/4152125792 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae59bff640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae5406c880 0x7fae5414e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae593fe640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5406d200 0x7fae5415e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 -- 172.21.15.133:0/4152125792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5406d200 msgr2=0x7fae5415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5406d200 0x7fae5415e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 -- 172.21.15.133:0/4152125792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae5406c880 msgr2=0x7fae5414e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae5406c880 0x7fae5414e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 -- 172.21.15.133:0/4152125792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae44009420 con 0x7fae540c7dd0 2023-12-18T10:19:33.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5a400640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae540c7dd0 0x7fae5414a620 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c780 tx=0x7fae4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae4a7fc640 1 -- 172.21.15.133:0/4152125792 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00ce90 con 0x7fae540c7dd0 2023-12-18T10:19:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae4a7fc640 1 -- 172.21.15.133:0/4152125792 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c00a640 con 0x7fae540c7dd0 2023-12-18T10:19:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae4a7fc640 1 -- 172.21.15.133:0/4152125792 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00a9d0 con 0x7fae540c7dd0 2023-12-18T10:19:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5415f240 con 0x7fae540c7dd0 2023-12-18T10:19:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5415f800 con 0x7fae540c7dd0 2023-12-18T10:19:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.573+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5414cbe0 con 0x7fae540c7dd0 2023-12-18T10:19:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.577+0000 7fae4a7fc640 1 -- 172.21.15.133:0/4152125792 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae4c00ab30 con 0x7fae540c7dd0 2023-12-18T10:19:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.577+0000 7fae4a7fc640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae38065a90 0x7fae38067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.577+0000 7fae4a7fc640 1 -- 172.21.15.133:0/4152125792 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fae4c0824d0 con 0x7fae540c7dd0 2023-12-18T10:19:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.577+0000 7fae59bff640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae38065a90 0x7fae38067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.577+0000 7fae59bff640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae38065a90 0x7fae38067f50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae50007a60 tx=0x7fae50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:33.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.581+0000 7fae4a7fc640 1 -- 172.21.15.133:0/4152125792 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fae5414cbe0 con 0x7fae540c7dd0 2023-12-18T10:19:33.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.761+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae5406aba0 con 0x7fae540c7dd0 2023-12-18T10:19:33.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.761+0000 7fae4a7fc640 1 -- 172.21.15.133:0/4152125792 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4715 (secure 0 0 0) 0x7fae5406aba0 con 0x7fae540c7dd0 2023-12-18T10:19:33.765 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:33.766 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:33.397943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:19:33.766 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 17 2023-12-18T10:19:33.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae38065a90 msgr2=0x7fae38067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae38065a90 0x7fae38067f50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae50007a60 tx=0x7fae50008040 comp rx=0 tx=0).stop 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae540c7dd0 msgr2=0x7fae5414a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae540c7dd0 0x7fae5414a620 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c780 tx=0x7fae4c00cc40 comp rx=0 tx=0).stop 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 shutdown_connections 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae38065a90 0x7fae38067f50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae540c7dd0 0x7fae5414a620 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae5406d200 0x7fae5415e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 --2- 172.21.15.133:0/4152125792 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae5406c880 0x7fae5414e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 >> 172.21.15.133:0/4152125792 conn(0x7fae540cb540 msgr2=0x7fae5415c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 shutdown_connections 2023-12-18T10:19:33.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.765+0000 7fae5be63640 1 -- 172.21.15.133:0/4152125792 wait complete. 2023-12-18T10:19:33.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:19:33.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.921+0000 7f87909a5640 1 Processor -- start 2023-12-18T10:19:33.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.921+0000 7f87909a5640 1 -- start start 2023-12-18T10:19:33.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.921+0000 7f87909a5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f878c070510 0x7f878c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.921+0000 7f87909a5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c070b80 con 0x7f878c0caa70 2023-12-18T10:19:33.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.921+0000 7f87909a5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c070e60 con 0x7f878c15c800 2023-12-18T10:19:33.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.921+0000 7f87909a5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c0709a0 con 0x7f878c070510 2023-12-18T10:19:33.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8781d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f878c070510 0x7f878c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f878ad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f878c0caa70 0x7f878c0caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42050/0 (socket says 172.21.15.133:42050) 2023-12-18T10:19:33.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f878ad9d640 1 -- 172.21.15.133:0/1624018921 learned_addr learned my addr 172.21.15.133:0/1624018921 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:33.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8781d9b640 1 -- 172.21.15.133:0/1624018921 >> v1:172.21.15.142:6789/0 conn(0x7f878c15c800 legacy=0x7f878c0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8781d9b640 1 -- 172.21.15.133:0/1624018921 >> v1:172.21.15.133:6789/0 conn(0x7f878c0caa70 legacy=0x7f878c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8781d9b640 1 -- 172.21.15.133:0/1624018921 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c071140 con 0x7f878c070510 2023-12-18T10:19:33.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8789d9b640 1 -- 172.21.15.133:0/1624018921 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292828471 0 0) 0x7f878c070b80 con 0x7f878c0caa70 2023-12-18T10:19:33.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8781d9b640 1 --2- 172.21.15.133:0/1624018921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c158c20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f87740097c0 tx=0x7f877401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fbeb8e705cbb50 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:33.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8789d9b640 1 -- 172.21.15.133:0/1624018921 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740a8050 con 0x7f878c070510 2023-12-18T10:19:33.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8789d9b640 1 -- 172.21.15.133:0/1624018921 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87740ac5f0 con 0x7f878c070510 2023-12-18T10:19:33.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.925+0000 7f8789d9b640 1 -- 172.21.15.133:0/1624018921 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87740ac980 con 0x7f878c070510 2023-12-18T10:19:33.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- 172.21.15.133:0/1624018921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 msgr2=0x7f878c158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 --2- 172.21.15.133:0/1624018921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c158c20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f87740097c0 tx=0x7f877401c480 comp rx=0 tx=0).stop 2023-12-18T10:19:33.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- 172.21.15.133:0/1624018921 shutdown_connections 2023-12-18T10:19:33.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 --2- 172.21.15.133:0/1624018921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c158c20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- 172.21.15.133:0/1624018921 >> 172.21.15.133:0/1624018921 conn(0x7f878c06a3e0 msgr2=0x7f878c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:33.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- 172.21.15.133:0/1624018921 shutdown_connections 2023-12-18T10:19:33.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- 172.21.15.133:0/1624018921 wait complete. 2023-12-18T10:19:33.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 Processor -- start 2023-12-18T10:19:33.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- start start 2023-12-18T10:19:33.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c0b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878c0caa70 0x7f878c1f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f878c15c800 0x7f878c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b3790 con 0x7f878c070510 2023-12-18T10:19:33.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c153740 con 0x7f878c15c800 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f87909a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1f61c0 con 0x7f878c0caa70 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f878a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c0b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f878a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c0b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59810/0 (socket says 172.21.15.133:59810) 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f878a59c640 1 -- 172.21.15.133:0/1592094280 learned_addr learned my addr 172.21.15.133:0/1592094280 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f878ad9d640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f878c15c800 0x7f878c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.929+0000 7f8781d9b640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878c0caa70 0x7f878c1f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f878a59c640 1 -- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878c0caa70 msgr2=0x7f878c1f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f878a59c640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878c0caa70 0x7f878c1f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f878a59c640 1 -- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f878c15c800 msgr2=0x7f878c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f878a59c640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f878c15c800 0x7f878c0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f878a59c640 1 -- 172.21.15.133:0/1592094280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774009420 con 0x7f878c070510 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f8781d9b640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878c0caa70 0x7f878c1f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:33.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f878a59c640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c0b3250 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c800 tx=0x7f877c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:33.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87837fe640 1 -- 172.21.15.133:0/1592094280 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c003b80 con 0x7f878c070510 2023-12-18T10:19:33.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87837fe640 1 -- 172.21.15.133:0/1592094280 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c003ce0 con 0x7f878c070510 2023-12-18T10:19:33.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c0c8800 con 0x7f878c070510 2023-12-18T10:19:33.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87837fe640 1 -- 172.21.15.133:0/1592094280 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c00aa90 con 0x7f878c070510 2023-12-18T10:19:33.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c152e10 con 0x7f878c070510 2023-12-18T10:19:33.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c0735b0 con 0x7f878c070510 2023-12-18T10:19:33.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87837fe640 1 -- 172.21.15.133:0/1592094280 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f877c00abf0 con 0x7f878c070510 2023-12-18T10:19:33.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87837fe640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f876c065a60 0x7f876c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:33.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f87837fe640 1 -- 172.21.15.133:0/1592094280 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f877c0831a0 con 0x7f878c070510 2023-12-18T10:19:33.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.933+0000 7f8781d9b640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f876c065a60 0x7f876c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:33.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.937+0000 7f8781d9b640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f876c065a60 0x7f876c067f20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87740ae000 tx=0x7f87740a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:33.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:33.937+0000 7f87837fe640 1 -- 172.21.15.133:0/1592094280 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f877c050980 con 0x7f878c070510 2023-12-18T10:19:33.961 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-18T10:19:33.957+0000 7f3aeadba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:19:34.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.089+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f878c04e000 con 0x7f878c070510 2023-12-18T10:19:34.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87837fe640 1 -- 172.21.15.133:0/1592094280 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16354 (secure 0 0 0) 0x7f877c053fa0 con 0x7f878c070510 2023-12-18T10:19:34.095 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:34.095 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":39,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:19:31.385303+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:19:28.252118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-18T10:19:29.371748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f876c065a60 msgr2=0x7f876c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f876c065a60 0x7f876c067f20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87740ae000 tx=0x7f87740a7000 comp rx=0 tx=0).stop 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 msgr2=0x7f878c0b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c0b3250 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c800 tx=0x7f877c00ccc0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 shutdown_connections 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f876c065a60 0x7f876c067f20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f878c15c800 0x7f878c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f878c0caa70 0x7f878c1f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 --2- 172.21.15.133:0/1592094280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f878c070510 0x7f878c0b3250 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 >> 172.21.15.133:0/1592094280 conn(0x7f878c06a3e0 msgr2=0x7f878c0c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 shutdown_connections 2023-12-18T10:19:34.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.093+0000 7f87909a5640 1 -- 172.21.15.133:0/1592094280 wait complete. 2023-12-18T10:19:34.116 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-18T10:19:34.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:19:34.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.249+0000 7f993208c640 1 Processor -- start 2023-12-18T10:19:34.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.249+0000 7f993208c640 1 -- start start 2023-12-18T10:19:34.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f993208c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f992c158c20 0x7f992c070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f993208c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f992c0cb180 0x7f992c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f993208c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992c070b80 con 0x7f992c15c800 2023-12-18T10:19:34.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f993208c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c070e60 con 0x7f992c158c20 2023-12-18T10:19:34.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f993208c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c071140 con 0x7f992c0cb180 2023-12-18T10:19:34.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f992b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f992c158c20 0x7f992c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f992b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f992c158c20 0x7f992c070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59812/0 (socket says 172.21.15.133:59812) 2023-12-18T10:19:34.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f992b7fe640 1 -- 172.21.15.133:0/243320820 learned_addr learned my addr 172.21.15.133:0/243320820 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:34.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f992b7fe640 1 -- 172.21.15.133:0/243320820 >> v2:172.21.15.142:3300/0 conn(0x7f992c0cb180 msgr2=0x7f992c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:34.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f992b7fe640 1 --2- 172.21.15.133:0/243320820 >> v2:172.21.15.142:3300/0 conn(0x7f992c0cb180 0x7f992c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f992b7fe640 1 -- 172.21.15.133:0/243320820 >> v1:172.21.15.142:6789/0 conn(0x7f992c15c800 legacy=0x7f992c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:34.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f992b7fe640 1 -- 172.21.15.133:0/243320820 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c071420 con 0x7f992c158c20 2023-12-18T10:19:34.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.253+0000 7f992b7fe640 1 --2- 172.21.15.133:0/243320820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c158c20 0x7f992c070510 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f992c0c53c0 tx=0x7f991c01f080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34360a03bebfaa03 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:34.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f992a7fc640 1 -- 172.21.15.133:0/243320820 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0b2600 con 0x7f992c158c20 2023-12-18T10:19:34.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f992a7fc640 1 -- 172.21.15.133:0/243320820 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c0b2760 con 0x7f992c158c20 2023-12-18T10:19:34.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f992a7fc640 1 -- 172.21.15.133:0/243320820 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0b2af0 con 0x7f992c158c20 2023-12-18T10:19:34.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- 172.21.15.133:0/243320820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c158c20 msgr2=0x7f992c070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 --2- 172.21.15.133:0/243320820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c158c20 0x7f992c070510 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f992c0c53c0 tx=0x7f991c01f080 comp rx=0 tx=0).stop 2023-12-18T10:19:34.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- 172.21.15.133:0/243320820 shutdown_connections 2023-12-18T10:19:34.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 --2- 172.21.15.133:0/243320820 >> v2:172.21.15.142:3300/0 conn(0x7f992c0cb180 0x7f992c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 --2- 172.21.15.133:0/243320820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c158c20 0x7f992c070510 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- 172.21.15.133:0/243320820 >> 172.21.15.133:0/243320820 conn(0x7f992c06a3e0 msgr2=0x7f992c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:34.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- 172.21.15.133:0/243320820 shutdown_connections 2023-12-18T10:19:34.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- 172.21.15.133:0/243320820 wait complete. 2023-12-18T10:19:34.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 Processor -- start 2023-12-18T10:19:34.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- start start 2023-12-18T10:19:34.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f992c0cb180 0x7f992c1f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f992c158c20 0x7f992c14aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c15c800 0x7f992c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c14afa0 con 0x7f992c15c800 2023-12-18T10:19:34.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c14b930 con 0x7f992c158c20 2023-12-18T10:19:34.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f993208c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c14bc10 con 0x7f992c0cb180 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.257+0000 7f992bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c15c800 0x7f992c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c15c800 0x7f992c0c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59820/0 (socket says 172.21.15.133:59820) 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992bfff640 1 -- 172.21.15.133:0/4036539704 learned_addr learned my addr 172.21.15.133:0/4036539704 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992b7fe640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f992c0cb180 0x7f992c1f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992affd640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f992c158c20 0x7f992c14aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992bfff640 1 -- 172.21.15.133:0/4036539704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f992c0cb180 msgr2=0x7f992c1f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992bfff640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f992c0cb180 0x7f992c1f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992bfff640 1 -- 172.21.15.133:0/4036539704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f992c158c20 msgr2=0x7f992c14aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992bfff640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f992c158c20 0x7f992c14aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992bfff640 1 -- 172.21.15.133:0/4036539704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0094d0 con 0x7f992c15c800 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f992bfff640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c15c800 0x7f992c0c8d00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f992400b970 tx=0x7f992400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f9913fff640 1 -- 172.21.15.133:0/4036539704 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400cb40 con 0x7f992c15c800 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f9913fff640 1 -- 172.21.15.133:0/4036539704 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992400ccc0 con 0x7f992c15c800 2023-12-18T10:19:34.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f9913fff640 1 -- 172.21.15.133:0/4036539704 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924014680 con 0x7f992c15c800 2023-12-18T10:19:34.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c0c8800 con 0x7f992c15c800 2023-12-18T10:19:34.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c14c1d0 con 0x7f992c15c800 2023-12-18T10:19:34.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c0735b0 con 0x7f992c15c800 2023-12-18T10:19:34.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.261+0000 7f9913fff640 1 -- 172.21.15.133:0/4036539704 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f992401d3b0 con 0x7f992c15c800 2023-12-18T10:19:34.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.265+0000 7f9913fff640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9918065a60 0x7f9918067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.265+0000 7f9913fff640 1 -- 172.21.15.133:0/4036539704 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9924083220 con 0x7f992c15c800 2023-12-18T10:19:34.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.265+0000 7f992b7fe640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9918065a60 0x7f9918067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.265+0000 7f992b7fe640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9918065a60 0x7f9918067f20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f991c0b1000 tx=0x7f991c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:34.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.269+0000 7f9913fff640 1 -- 172.21.15.133:0/4036539704 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9924050a90 con 0x7f992c15c800 2023-12-18T10:19:34.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.413+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f992c14baa0 con 0x7f9918065a60 2023-12-18T10:19:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.421+0000 7f9913fff640 1 -- 172.21.15.133:0/4036539704 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289038 (secure 0 0 0) 0x7f992c14baa0 con 0x7f9918065a60 2023-12-18T10:19:34.427 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:34.429 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:19:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9918065a60 msgr2=0x7f9918067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9918065a60 0x7f9918067f20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f991c0b1000 tx=0x7f991c008040 comp rx=0 tx=0).stop 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c15c800 msgr2=0x7f992c0c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c15c800 0x7f992c0c8d00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f992400b970 tx=0x7f992400be30 comp rx=0 tx=0).stop 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 shutdown_connections 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9918065a60 0x7f9918067f20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f992c15c800 0x7f992c0c8d00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f992c158c20 0x7f992c14aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 --2- 172.21.15.133:0/4036539704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f992c0cb180 0x7f992c1f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 >> 172.21.15.133:0/4036539704 conn(0x7f992c06a3e0 msgr2=0x7f992c14ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 shutdown_connections 2023-12-18T10:19:34.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.425+0000 7f993208c640 1 -- 172.21.15.133:0/4036539704 wait complete. 2023-12-18T10:19:34.447 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-12-18T10:19:33.112651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220336,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754384,"statfs":{"total":773094113280,"available":772868489216,"internally_reserved":0,"allocated":4833280,"data_stored":2725076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.129416"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401158+0000","last_change":"2023-12-18T10:19:30.414530+0000","last_active":"2023-12-18T10:19:31.401158+0000","last_peered":"2023-12-18T10:19:31.401158+0000","last_clean":"2023-12-18T10:19:31.401158+0000","last_became_active":"2023-12-18T10:19:30.414100+0000","last_became_peered":"2023-12-18T10:19:30.414100+0000","last_unstale":"2023-12-18T10:19:31.401158+0000","last_undegraded":"2023-12-18T10:19:31.401158+0000","last_fullsized":"2023-12-18T10:19:31.401158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:44:05.868319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401077+0000","last_change":"2023-12-18T10:19:30.414694+0000","last_active":"2023-12-18T10:19:31.401077+0000","last_peered":"2023-12-18T10:19:31.401077+0000","last_clean":"2023-12-18T10:19:31.401077+0000","last_became_active":"2023-12-18T10:19:30.414458+0000","last_became_peered":"2023-12-18T10:19:30.414458+0000","last_unstale":"2023-12-18T10:19:31.401077+0000","last_undegraded":"2023-12-18T10:19:31.401077+0000","last_fullsized":"2023-12-18T10:19:31.401077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:09:29.974767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.417867+0000","last_change":"2023-12-18T10:19:30.409060+0000","last_active":"2023-12-18T10:19:30.417867+0000","last_peered":"2023-12-18T10:19:30.417867+0000","last_clean":"2023-12-18T10:19:30.417867+0000","last_became_active":"2023-12-18T10:19:30.408800+0000","last_became_peered":"2023-12-18T10:19:30.408800+0000","last_unstale":"2023-12-18T10:19:30.417867+0000","last_undegraded":"2023-12-18T10:19:30.417867+0000","last_fullsized":"2023-12-18T10:19:30.417867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:23:22.476075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677045+0000","last_change":"2023-12-18T10:19:30.408658+0000","last_active":"2023-12-18T10:19:31.677045+0000","last_peered":"2023-12-18T10:19:31.677045+0000","last_clean":"2023-12-18T10:19:31.677045+0000","last_became_active":"2023-12-18T10:19:30.408160+0000","last_became_peered":"2023-12-18T10:19:30.408160+0000","last_unstale":"2023-12-18T10:19:31.677045+0000","last_undegraded":"2023-12-18T10:19:31.677045+0000","last_fullsized":"2023-12-18T10:19:31.677045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:48:02.772382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676947+0000","last_change":"2023-12-18T10:19:30.406932+0000","last_active":"2023-12-18T10:19:31.676947+0000","last_peered":"2023-12-18T10:19:31.676947+0000","last_clean":"2023-12-18T10:19:31.676947+0000","last_became_active":"2023-12-18T10:19:30.406674+0000","last_became_peered":"2023-12-18T10:19:30.406674+0000","last_unstale":"2023-12-18T10:19:31.676947+0000","last_undegraded":"2023-12-18T10:19:31.676947+0000","last_fullsized":"2023-12-18T10:19:31.676947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:21.684380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400427+0000","last_change":"2023-12-18T10:19:30.417814+0000","last_active":"2023-12-18T10:19:31.400427+0000","last_peered":"2023-12-18T10:19:31.400427+0000","last_clean":"2023-12-18T10:19:31.400427+0000","last_became_active":"2023-12-18T10:19:30.417491+0000","last_became_peered":"2023-12-18T10:19:30.417491+0000","last_unstale":"2023-12-18T10:19:31.400427+0000","last_undegraded":"2023-12-18T10:19:31.400427+0000","last_fullsized":"2023-12-18T10:19:31.400427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:30.358527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032704+0000","last_change":"2023-12-18T10:19:30.420040+0000","last_active":"2023-12-18T10:19:32.032704+0000","last_peered":"2023-12-18T10:19:32.032704+0000","last_clean":"2023-12-18T10:19:32.032704+0000","last_became_active":"2023-12-18T10:19:30.419745+0000","last_became_peered":"2023-12-18T10:19:30.419745+0000","last_unstale":"2023-12-18T10:19:32.032704+0000","last_undegraded":"2023-12-18T10:19:32.032704+0000","last_fullsized":"2023-12-18T10:19:32.032704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:52:59.703706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400638+0000","last_change":"2023-12-18T10:19:30.411804+0000","last_active":"2023-12-18T10:19:31.400638+0000","last_peered":"2023-12-18T10:19:31.400638+0000","last_clean":"2023-12-18T10:19:31.400638+0000","last_became_active":"2023-12-18T10:19:30.411546+0000","last_became_peered":"2023-12-18T10:19:30.411546+0000","last_unstale":"2023-12-18T10:19:31.400638+0000","last_undegraded":"2023-12-18T10:19:31.400638+0000","last_fullsized":"2023-12-18T10:19:31.400638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:29:59.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.417838+0000","last_change":"2023-12-18T10:19:30.407901+0000","last_active":"2023-12-18T10:19:30.417838+0000","last_peered":"2023-12-18T10:19:30.417838+0000","last_clean":"2023-12-18T10:19:30.417838+0000","last_became_active":"2023-12-18T10:19:30.407636+0000","last_became_peered":"2023-12-18T10:19:30.407636+0000","last_unstale":"2023-12-18T10:19:30.417838+0000","last_undegraded":"2023-12-18T10:19:30.417838+0000","last_fullsized":"2023-12-18T10:19:30.417838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:53.439003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032803+0000","last_change":"2023-12-18T10:19:30.426754+0000","last_active":"2023-12-18T10:19:32.032803+0000","last_peered":"2023-12-18T10:19:32.032803+0000","last_clean":"2023-12-18T10:19:32.032803+0000","last_became_active":"2023-12-18T10:19:30.426479+0000","last_became_peered":"2023-12-18T10:19:30.426479+0000","last_unstale":"2023-12-18T10:19:32.032803+0000","last_undegraded":"2023-12-18T10:19:32.032803+0000","last_fullsized":"2023-12-18T10:19:32.032803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:11:12.537073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032784+0000","last_change":"2023-12-18T10:19:30.418271+0000","last_active":"2023-12-18T10:19:32.032784+0000","last_peered":"2023-12-18T10:19:32.032784+0000","last_clean":"2023-12-18T10:19:32.032784+0000","last_became_active":"2023-12-18T10:19:30.418031+0000","last_became_peered":"2023-12-18T10:19:30.418031+0000","last_unstale":"2023-12-18T10:19:32.032784+0000","last_undegraded":"2023-12-18T10:19:32.032784+0000","last_fullsized":"2023-12-18T10:19:32.032784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:38:14.599677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.417696+0000","last_change":"2023-12-18T10:19:30.409511+0000","last_active":"2023-12-18T10:19:30.417696+0000","last_peered":"2023-12-18T10:19:30.417696+0000","last_clean":"2023-12-18T10:19:30.417696+0000","last_became_active":"2023-12-18T10:19:30.409207+0000","last_became_peered":"2023-12-18T10:19:30.409207+0000","last_unstale":"2023-12-18T10:19:30.417696+0000","last_undegraded":"2023-12-18T10:19:30.417696+0000","last_fullsized":"2023-12-18T10:19:30.417696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:51:03.656560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032541+0000","last_change":"2023-12-18T10:19:30.422097+0000","last_active":"2023-12-18T10:19:32.032541+0000","last_peered":"2023-12-18T10:19:32.032541+0000","last_clean":"2023-12-18T10:19:32.032541+0000","last_became_active":"2023-12-18T10:19:30.421806+0000","last_became_peered":"2023-12-18T10:19:30.421806+0000","last_unstale":"2023-12-18T10:19:32.032541+0000","last_undegraded":"2023-12-18T10:19:32.032541+0000","last_fullsized":"2023-12-18T10:19:32.032541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:24.519539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.431935+0000","last_change":"2023-12-18T10:19:30.415234+0000","last_active":"2023-12-18T10:19:30.431935+0000","last_peered":"2023-12-18T10:19:30.431935+0000","last_clean":"2023-12-18T10:19:30.431935+0000","last_became_active":"2023-12-18T10:19:30.414927+0000","last_became_peered":"2023-12-18T10:19:30.414927+0000","last_unstale":"2023-12-18T10:19:30.431935+0000","last_undegraded":"2023-12-18T10:19:30.431935+0000","last_fullsized":"2023-12-18T10:19:30.431935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:06:00.480550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032760+0000","last_change":"2023-12-18T10:19:30.409779+0000","last_active":"2023-12-18T10:19:32.032760+0000","last_peered":"2023-12-18T10:19:32.032760+0000","last_clean":"2023-12-18T10:19:32.032760+0000","last_became_active":"2023-12-18T10:19:30.409507+0000","last_became_peered":"2023-12-18T10:19:30.409507+0000","last_unstale":"2023-12-18T10:19:32.032760+0000","last_undegraded":"2023-12-18T10:19:32.032760+0000","last_fullsized":"2023-12-18T10:19:32.032760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:30.358527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714074+0000","last_change":"2023-12-18T10:19:30.431621+0000","last_active":"2023-12-18T10:19:31.714074+0000","last_peered":"2023-12-18T10:19:31.714074+0000","last_clean":"2023-12-18T10:19:31.714074+0000","last_became_active":"2023-12-18T10:19:30.428868+0000","last_became_peered":"2023-12-18T10:19:30.428868+0000","last_unstale":"2023-12-18T10:19:31.714074+0000","last_undegraded":"2023-12-18T10:19:31.714074+0000","last_fullsized":"2023-12-18T10:19:31.714074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:22:04.983729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714480+0000","last_change":"2023-12-18T10:19:30.433376+0000","last_active":"2023-12-18T10:19:31.714480+0000","last_peered":"2023-12-18T10:19:31.714480+0000","last_clean":"2023-12-18T10:19:31.714480+0000","last_became_active":"2023-12-18T10:19:30.432925+0000","last_became_peered":"2023-12-18T10:19:30.432925+0000","last_unstale":"2023-12-18T10:19:31.714480+0000","last_undegraded":"2023-12-18T10:19:31.714480+0000","last_fullsized":"2023-12-18T10:19:31.714480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:11:12.537073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938712+0000","last_change":"2023-12-18T10:19:30.403847+0000","last_active":"2023-12-18T10:19:31.938712+0000","last_peered":"2023-12-18T10:19:31.938712+0000","last_clean":"2023-12-18T10:19:31.938712+0000","last_became_active":"2023-12-18T10:19:30.403545+0000","last_became_peered":"2023-12-18T10:19:30.403545+0000","last_unstale":"2023-12-18T10:19:31.938712+0000","last_undegraded":"2023-12-18T10:19:31.938712+0000","last_fullsized":"2023-12-18T10:19:31.938712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:52:57.839827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677092+0000","last_change":"2023-12-18T10:19:30.403395+0000","last_active":"2023-12-18T10:19:31.677092+0000","last_peered":"2023-12-18T10:19:31.677092+0000","last_clean":"2023-12-18T10:19:31.677092+0000","last_became_active":"2023-12-18T10:19:30.403049+0000","last_became_peered":"2023-12-18T10:19:30.403049+0000","last_unstale":"2023-12-18T10:19:31.677092+0000","last_undegraded":"2023-12-18T10:19:31.677092+0000","last_fullsized":"2023-12-18T10:19:31.677092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:18.377777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938671+0000","last_change":"2023-12-18T10:19:30.413140+0000","last_active":"2023-12-18T10:19:31.938671+0000","last_peered":"2023-12-18T10:19:31.938671+0000","last_clean":"2023-12-18T10:19:31.938671+0000","last_became_active":"2023-12-18T10:19:30.412874+0000","last_became_peered":"2023-12-18T10:19:30.412874+0000","last_unstale":"2023-12-18T10:19:31.938671+0000","last_undegraded":"2023-12-18T10:19:31.938671+0000","last_fullsized":"2023-12-18T10:19:31.938671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:06:16.731005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032566+0000","last_change":"2023-12-18T10:19:30.411084+0000","last_active":"2023-12-18T10:19:32.032566+0000","last_peered":"2023-12-18T10:19:32.032566+0000","last_clean":"2023-12-18T10:19:32.032566+0000","last_became_active":"2023-12-18T10:19:30.410774+0000","last_became_peered":"2023-12-18T10:19:30.410774+0000","last_unstale":"2023-12-18T10:19:32.032566+0000","last_undegraded":"2023-12-18T10:19:32.032566+0000","last_fullsized":"2023-12-18T10:19:32.032566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:19:12.827991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.431955+0000","last_change":"2023-12-18T10:19:30.416889+0000","last_active":"2023-12-18T10:19:30.431955+0000","last_peered":"2023-12-18T10:19:30.431955+0000","last_clean":"2023-12-18T10:19:30.431955+0000","last_became_active":"2023-12-18T10:19:30.416575+0000","last_became_peered":"2023-12-18T10:19:30.416575+0000","last_unstale":"2023-12-18T10:19:30.431955+0000","last_undegraded":"2023-12-18T10:19:30.431955+0000","last_fullsized":"2023-12-18T10:19:30.431955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:34:46.837951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714060+0000","last_change":"2023-12-18T10:19:30.425107+0000","last_active":"2023-12-18T10:19:31.714060+0000","last_peered":"2023-12-18T10:19:31.714060+0000","last_clean":"2023-12-18T10:19:31.714060+0000","last_became_active":"2023-12-18T10:19:30.424863+0000","last_became_peered":"2023-12-18T10:19:30.424863+0000","last_unstale":"2023-12-18T10:19:31.714060+0000","last_undegraded":"2023-12-18T10:19:31.714060+0000","last_fullsized":"2023-12-18T10:19:31.714060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:48.326152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676883+0000","last_change":"2023-12-18T10:19:30.424926+0000","last_active":"2023-12-18T10:19:31.676883+0000","last_peered":"2023-12-18T10:19:31.676883+0000","last_clean":"2023-12-18T10:19:31.676883+0000","last_became_active":"2023-12-18T10:19:30.424613+0000","last_became_peered":"2023-12-18T10:19:30.424613+0000","last_unstale":"2023-12-18T10:19:31.676883+0000","last_undegraded":"2023-12-18T10:19:31.676883+0000","last_fullsized":"2023-12-18T10:19:31.676883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:46.557434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938761+0000","last_change":"2023-12-18T10:19:30.408998+0000","last_active":"2023-12-18T10:19:31.938761+0000","last_peered":"2023-12-18T10:19:31.938761+0000","last_clean":"2023-12-18T10:19:31.938761+0000","last_became_active":"2023-12-18T10:19:30.408674+0000","last_became_peered":"2023-12-18T10:19:30.408674+0000","last_unstale":"2023-12-18T10:19:31.938761+0000","last_undegraded":"2023-12-18T10:19:31.938761+0000","last_fullsized":"2023-12-18T10:19:31.938761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:21.684380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400971+0000","last_change":"2023-12-18T10:19:30.410031+0000","last_active":"2023-12-18T10:19:31.400971+0000","last_peered":"2023-12-18T10:19:31.400971+0000","last_clean":"2023-12-18T10:19:31.400971+0000","last_became_active":"2023-12-18T10:19:30.409753+0000","last_became_peered":"2023-12-18T10:19:30.409753+0000","last_unstale":"2023-12-18T10:19:31.400971+0000","last_undegraded":"2023-12-18T10:19:31.400971+0000","last_fullsized":"2023-12-18T10:19:31.400971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:38:14.599677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938718+0000","last_change":"2023-12-18T10:19:30.400749+0000","last_active":"2023-12-18T10:19:31.938718+0000","last_peered":"2023-12-18T10:19:31.938718+0000","last_clean":"2023-12-18T10:19:31.938718+0000","last_became_active":"2023-12-18T10:19:30.400462+0000","last_became_peered":"2023-12-18T10:19:30.400462+0000","last_unstale":"2023-12-18T10:19:31.938718+0000","last_undegraded":"2023-12-18T10:19:31.938718+0000","last_fullsized":"2023-12-18T10:19:31.938718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:44:54.089740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032721+0000","last_change":"2023-12-18T10:19:30.419372+0000","last_active":"2023-12-18T10:19:32.032721+0000","last_peered":"2023-12-18T10:19:32.032721+0000","last_clean":"2023-12-18T10:19:32.032721+0000","last_became_active":"2023-12-18T10:19:30.419074+0000","last_became_peered":"2023-12-18T10:19:30.419074+0000","last_unstale":"2023-12-18T10:19:32.032721+0000","last_undegraded":"2023-12-18T10:19:32.032721+0000","last_fullsized":"2023-12-18T10:19:32.032721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:40.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938719+0000","last_change":"2023-12-18T10:19:30.413730+0000","last_active":"2023-12-18T10:19:31.938719+0000","last_peered":"2023-12-18T10:19:31.938719+0000","last_clean":"2023-12-18T10:19:31.938719+0000","last_became_active":"2023-12-18T10:19:30.413353+0000","last_became_peered":"2023-12-18T10:19:30.413353+0000","last_unstale":"2023-12-18T10:19:31.938719+0000","last_undegraded":"2023-12-18T10:19:31.938719+0000","last_fullsized":"2023-12-18T10:19:31.938719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:58:25.279015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938550+0000","last_change":"2023-12-18T10:19:30.418541+0000","last_active":"2023-12-18T10:19:31.938550+0000","last_peered":"2023-12-18T10:19:31.938550+0000","last_clean":"2023-12-18T10:19:31.938550+0000","last_became_active":"2023-12-18T10:19:30.418255+0000","last_became_peered":"2023-12-18T10:19:30.418255+0000","last_unstale":"2023-12-18T10:19:31.938550+0000","last_undegraded":"2023-12-18T10:19:31.938550+0000","last_fullsized":"2023-12-18T10:19:31.938550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:48:02.772382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714213+0000","last_change":"2023-12-18T10:19:30.424685+0000","last_active":"2023-12-18T10:19:31.714213+0000","last_peered":"2023-12-18T10:19:31.714213+0000","last_clean":"2023-12-18T10:19:31.714213+0000","last_became_active":"2023-12-18T10:19:30.424270+0000","last_became_peered":"2023-12-18T10:19:30.424270+0000","last_unstale":"2023-12-18T10:19:31.714213+0000","last_undegraded":"2023-12-18T10:19:31.714213+0000","last_fullsized":"2023-12-18T10:19:31.714213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:52:59.703706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400319+0000","last_change":"2023-12-18T10:19:30.404581+0000","last_active":"2023-12-18T10:19:31.400319+0000","last_peered":"2023-12-18T10:19:31.400319+0000","last_clean":"2023-12-18T10:19:31.400319+0000","last_became_active":"2023-12-18T10:19:30.404227+0000","last_became_peered":"2023-12-18T10:19:30.404227+0000","last_unstale":"2023-12-18T10:19:31.400319+0000","last_undegraded":"2023-12-18T10:19:31.400319+0000","last_fullsized":"2023-12-18T10:19:31.400319+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:48.326152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714311+0000","last_change":"2023-12-18T10:19:30.431556+0000","last_active":"2023-12-18T10:19:31.714311+0000","last_peered":"2023-12-18T10:19:31.714311+0000","last_clean":"2023-12-18T10:19:31.714311+0000","last_became_active":"2023-12-18T10:19:30.431286+0000","last_became_peered":"2023-12-18T10:19:30.431286+0000","last_unstale":"2023-12-18T10:19:31.714311+0000","last_undegraded":"2023-12-18T10:19:31.714311+0000","last_fullsized":"2023-12-18T10:19:31.714311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:40.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938814+0000","last_change":"2023-12-18T10:19:30.025463+0000","last_active":"2023-12-18T10:19:31.938814+0000","last_peered":"2023-12-18T10:19:31.938814+0000","last_clean":"2023-12-18T10:19:31.938814+0000","last_became_active":"2023-12-18T10:19:30.024942+0000","last_became_peered":"2023-12-18T10:19:30.024942+0000","last_unstale":"2023-12-18T10:19:31.938814+0000","last_undegraded":"2023-12-18T10:19:31.938814+0000","last_fullsized":"2023-12-18T10:19:31.938814+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:17:01.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401103+0000","last_change":"2023-12-18T10:19:30.421697+0000","last_active":"2023-12-18T10:19:31.401103+0000","last_peered":"2023-12-18T10:19:31.401103+0000","last_clean":"2023-12-18T10:19:31.401103+0000","last_became_active":"2023-12-18T10:19:30.421392+0000","last_became_peered":"2023-12-18T10:19:30.421392+0000","last_unstale":"2023-12-18T10:19:31.401103+0000","last_undegraded":"2023-12-18T10:19:31.401103+0000","last_fullsized":"2023-12-18T10:19:31.401103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:19:52.222961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.414684+0000","last_change":"2023-12-18T10:19:30.013945+0000","last_active":"2023-12-18T10:19:30.414684+0000","last_peered":"2023-12-18T10:19:30.414684+0000","last_clean":"2023-12-18T10:19:30.414684+0000","last_became_active":"2023-12-18T10:19:30.013614+0000","last_became_peered":"2023-12-18T10:19:30.013614+0000","last_unstale":"2023-12-18T10:19:30.414684+0000","last_undegraded":"2023-12-18T10:19:30.414684+0000","last_fullsized":"2023-12-18T10:19:30.414684+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:17.368853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.429357+0000","last_change":"2023-12-18T10:19:30.413847+0000","last_active":"2023-12-18T10:19:30.429357+0000","last_peered":"2023-12-18T10:19:30.429357+0000","last_clean":"2023-12-18T10:19:30.429357+0000","last_became_active":"2023-12-18T10:19:30.413506+0000","last_became_peered":"2023-12-18T10:19:30.413506+0000","last_unstale":"2023-12-18T10:19:30.429357+0000","last_undegraded":"2023-12-18T10:19:30.429357+0000","last_fullsized":"2023-12-18T10:19:30.429357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:11:20.266538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401247+0000","last_change":"2023-12-18T10:19:30.016976+0000","last_active":"2023-12-18T10:19:31.401247+0000","last_peered":"2023-12-18T10:19:31.401247+0000","last_clean":"2023-12-18T10:19:31.401247+0000","last_became_active":"2023-12-18T10:19:30.016589+0000","last_became_peered":"2023-12-18T10:19:30.016589+0000","last_unstale":"2023-12-18T10:19:31.401247+0000","last_undegraded":"2023-12-18T10:19:31.401247+0000","last_fullsized":"2023-12-18T10:19:31.401247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:38:49.823143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401100+0000","last_change":"2023-12-18T10:19:30.414563+0000","last_active":"2023-12-18T10:19:31.401100+0000","last_peered":"2023-12-18T10:19:31.401100+0000","last_clean":"2023-12-18T10:19:31.401100+0000","last_became_active":"2023-12-18T10:19:30.414204+0000","last_became_peered":"2023-12-18T10:19:30.414204+0000","last_unstale":"2023-12-18T10:19:31.401100+0000","last_undegraded":"2023-12-18T10:19:31.401100+0000","last_fullsized":"2023-12-18T10:19:31.401100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:30:35.780905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.421578+0000","last_change":"2023-12-18T10:19:30.015064+0000","last_active":"2023-12-18T10:19:30.421578+0000","last_peered":"2023-12-18T10:19:30.421578+0000","last_clean":"2023-12-18T10:19:30.421578+0000","last_became_active":"2023-12-18T10:19:30.014740+0000","last_became_peered":"2023-12-18T10:19:30.014740+0000","last_unstale":"2023-12-18T10:19:30.421578+0000","last_undegraded":"2023-12-18T10:19:30.421578+0000","last_fullsized":"2023-12-18T10:19:30.421578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:51.543741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.418486+0000","last_change":"2023-12-18T10:19:30.405231+0000","last_active":"2023-12-18T10:19:30.418486+0000","last_peered":"2023-12-18T10:19:30.418486+0000","last_clean":"2023-12-18T10:19:30.418486+0000","last_became_active":"2023-12-18T10:19:30.404983+0000","last_became_peered":"2023-12-18T10:19:30.404983+0000","last_unstale":"2023-12-18T10:19:30.418486+0000","last_undegraded":"2023-12-18T10:19:30.418486+0000","last_fullsized":"2023-12-18T10:19:30.418486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:11:12.537073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032716+0000","last_change":"2023-12-18T10:19:30.005923+0000","last_active":"2023-12-18T10:19:32.032716+0000","last_peered":"2023-12-18T10:19:32.032716+0000","last_clean":"2023-12-18T10:19:32.032716+0000","last_became_active":"2023-12-18T10:19:30.005617+0000","last_became_peered":"2023-12-18T10:19:30.005617+0000","last_unstale":"2023-12-18T10:19:32.032716+0000","last_undegraded":"2023-12-18T10:19:32.032716+0000","last_fullsized":"2023-12-18T10:19:32.032716+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:17.368853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032854+0000","last_change":"2023-12-18T10:19:30.404436+0000","last_active":"2023-12-18T10:19:32.032854+0000","last_peered":"2023-12-18T10:19:32.032854+0000","last_clean":"2023-12-18T10:19:32.032854+0000","last_became_active":"2023-12-18T10:19:30.404086+0000","last_became_peered":"2023-12-18T10:19:30.404086+0000","last_unstale":"2023-12-18T10:19:32.032854+0000","last_undegraded":"2023-12-18T10:19:32.032854+0000","last_fullsized":"2023-12-18T10:19:32.032854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:19:52.222961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714102+0000","last_change":"2023-12-18T10:19:30.022059+0000","last_active":"2023-12-18T10:19:31.714102+0000","last_peered":"2023-12-18T10:19:31.714102+0000","last_clean":"2023-12-18T10:19:31.714102+0000","last_became_active":"2023-12-18T10:19:30.021609+0000","last_became_peered":"2023-12-18T10:19:30.021609+0000","last_unstale":"2023-12-18T10:19:31.714102+0000","last_undegraded":"2023-12-18T10:19:31.714102+0000","last_fullsized":"2023-12-18T10:19:31.714102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:44:53.080816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.431988+0000","last_change":"2023-12-18T10:19:30.428549+0000","last_active":"2023-12-18T10:19:30.431988+0000","last_peered":"2023-12-18T10:19:30.431988+0000","last_clean":"2023-12-18T10:19:30.431988+0000","last_became_active":"2023-12-18T10:19:30.428262+0000","last_became_peered":"2023-12-18T10:19:30.428262+0000","last_unstale":"2023-12-18T10:19:30.431988+0000","last_undegraded":"2023-12-18T10:19:30.431988+0000","last_fullsized":"2023-12-18T10:19:30.431988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:00.398251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400393+0000","last_change":"2023-12-18T10:19:30.011932+0000","last_active":"2023-12-18T10:19:31.400393+0000","last_peered":"2023-12-18T10:19:31.400393+0000","last_clean":"2023-12-18T10:19:31.400393+0000","last_became_active":"2023-12-18T10:19:30.011635+0000","last_became_peered":"2023-12-18T10:19:30.011635+0000","last_unstale":"2023-12-18T10:19:31.400393+0000","last_undegraded":"2023-12-18T10:19:31.400393+0000","last_fullsized":"2023-12-18T10:19:31.400393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:06:15.722080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400780+0000","last_change":"2023-12-18T10:19:30.425712+0000","last_active":"2023-12-18T10:19:31.400780+0000","last_peered":"2023-12-18T10:19:31.400780+0000","last_clean":"2023-12-18T10:19:31.400780+0000","last_became_active":"2023-12-18T10:19:30.425388+0000","last_became_peered":"2023-12-18T10:19:30.425388+0000","last_unstale":"2023-12-18T10:19:31.400780+0000","last_undegraded":"2023-12-18T10:19:31.400780+0000","last_fullsized":"2023-12-18T10:19:31.400780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:43:49.033213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.398535+0000","last_change":"2023-12-18T10:19:30.020135+0000","last_active":"2023-12-18T10:19:30.398535+0000","last_peered":"2023-12-18T10:19:30.398535+0000","last_clean":"2023-12-18T10:19:30.398535+0000","last_became_active":"2023-12-18T10:19:30.019261+0000","last_became_peered":"2023-12-18T10:19:30.019261+0000","last_unstale":"2023-12-18T10:19:30.398535+0000","last_undegraded":"2023-12-18T10:19:30.398535+0000","last_fullsized":"2023-12-18T10:19:30.398535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:18:09.425934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677079+0000","last_change":"2023-12-18T10:19:30.408461+0000","last_active":"2023-12-18T10:19:31.677079+0000","last_peered":"2023-12-18T10:19:31.677079+0000","last_clean":"2023-12-18T10:19:31.677079+0000","last_became_active":"2023-12-18T10:19:30.407810+0000","last_became_peered":"2023-12-18T10:19:30.407810+0000","last_unstale":"2023-12-18T10:19:31.677079+0000","last_undegraded":"2023-12-18T10:19:31.677079+0000","last_fullsized":"2023-12-18T10:19:31.677079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:44:54.089740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401182+0000","last_change":"2023-12-18T10:19:30.017533+0000","last_active":"2023-12-18T10:19:31.401182+0000","last_peered":"2023-12-18T10:19:31.401182+0000","last_clean":"2023-12-18T10:19:31.401182+0000","last_became_active":"2023-12-18T10:19:30.017265+0000","last_became_peered":"2023-12-18T10:19:30.017265+0000","last_unstale":"2023-12-18T10:19:31.401182+0000","last_undegraded":"2023-12-18T10:19:31.401182+0000","last_fullsized":"2023-12-18T10:19:31.401182+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:22:03.974805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714403+0000","last_change":"2023-12-18T10:19:30.426723+0000","last_active":"2023-12-18T10:19:31.714403+0000","last_peered":"2023-12-18T10:19:31.714403+0000","last_clean":"2023-12-18T10:19:31.714403+0000","last_became_active":"2023-12-18T10:19:30.426464+0000","last_became_peered":"2023-12-18T10:19:30.426464+0000","last_unstale":"2023-12-18T10:19:31.714403+0000","last_undegraded":"2023-12-18T10:19:31.714403+0000","last_fullsized":"2023-12-18T10:19:31.714403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:30.358527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.033030+0000","last_change":"2023-12-18T10:19:30.014660+0000","last_active":"2023-12-18T10:19:32.033030+0000","last_peered":"2023-12-18T10:19:32.033030+0000","last_clean":"2023-12-18T10:19:32.033030+0000","last_became_active":"2023-12-18T10:19:30.014404+0000","last_became_peered":"2023-12-18T10:19:30.014404+0000","last_unstale":"2023-12-18T10:19:32.033030+0000","last_undegraded":"2023-12-18T10:19:32.033030+0000","last_fullsized":"2023-12-18T10:19:32.033030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:48:01.763457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.427984+0000","last_change":"2023-12-18T10:19:30.424398+0000","last_active":"2023-12-18T10:19:30.427984+0000","last_peered":"2023-12-18T10:19:30.427984+0000","last_clean":"2023-12-18T10:19:30.427984+0000","last_became_active":"2023-12-18T10:19:30.423814+0000","last_became_peered":"2023-12-18T10:19:30.423814+0000","last_unstale":"2023-12-18T10:19:30.427984+0000","last_undegraded":"2023-12-18T10:19:30.427984+0000","last_fullsized":"2023-12-18T10:19:30.427984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:48.326152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032895+0000","last_change":"2023-12-18T10:19:30.021599+0000","last_active":"2023-12-18T10:19:32.032895+0000","last_peered":"2023-12-18T10:19:32.032895+0000","last_clean":"2023-12-18T10:19:32.032895+0000","last_became_active":"2023-12-18T10:19:30.021291+0000","last_became_peered":"2023-12-18T10:19:30.021291+0000","last_unstale":"2023-12-18T10:19:32.032895+0000","last_undegraded":"2023-12-18T10:19:32.032895+0000","last_fullsized":"2023-12-18T10:19:32.032895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:45.548510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.422384+0000","last_change":"2023-12-18T10:19:30.410750+0000","last_active":"2023-12-18T10:19:30.422384+0000","last_peered":"2023-12-18T10:19:30.422384+0000","last_clean":"2023-12-18T10:19:30.422384+0000","last_became_active":"2023-12-18T10:19:30.410427+0000","last_became_peered":"2023-12-18T10:19:30.410427+0000","last_unstale":"2023-12-18T10:19:30.422384+0000","last_undegraded":"2023-12-18T10:19:30.422384+0000","last_fullsized":"2023-12-18T10:19:30.422384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:23:37.024860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401423+0000","last_change":"2023-12-18T10:19:30.012042+0000","last_active":"2023-12-18T10:19:31.401423+0000","last_peered":"2023-12-18T10:19:31.401423+0000","last_clean":"2023-12-18T10:19:31.401423+0000","last_became_active":"2023-12-18T10:19:30.011666+0000","last_became_peered":"2023-12-18T10:19:30.011666+0000","last_unstale":"2023-12-18T10:19:31.401423+0000","last_undegraded":"2023-12-18T10:19:31.401423+0000","last_fullsized":"2023-12-18T10:19:31.401423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:52.430078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.418505+0000","last_change":"2023-12-18T10:19:30.408414+0000","last_active":"2023-12-18T10:19:30.418505+0000","last_peered":"2023-12-18T10:19:30.418505+0000","last_clean":"2023-12-18T10:19:30.418505+0000","last_became_active":"2023-12-18T10:19:30.408119+0000","last_became_peered":"2023-12-18T10:19:30.408119+0000","last_unstale":"2023-12-18T10:19:30.418505+0000","last_undegraded":"2023-12-18T10:19:30.418505+0000","last_fullsized":"2023-12-18T10:19:30.418505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:34:25.459099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400963+0000","last_change":"2023-12-18T10:19:30.008717+0000","last_active":"2023-12-18T10:19:31.400963+0000","last_peered":"2023-12-18T10:19:31.400963+0000","last_clean":"2023-12-18T10:19:31.400963+0000","last_became_active":"2023-12-18T10:19:30.008195+0000","last_became_peered":"2023-12-18T10:19:30.008195+0000","last_unstale":"2023-12-18T10:19:31.400963+0000","last_undegraded":"2023-12-18T10:19:31.400963+0000","last_fullsized":"2023-12-18T10:19:31.400963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:34:24.450174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400767+0000","last_change":"2023-12-18T10:19:30.415734+0000","last_active":"2023-12-18T10:19:31.400767+0000","last_peered":"2023-12-18T10:19:31.400767+0000","last_clean":"2023-12-18T10:19:31.400767+0000","last_became_active":"2023-12-18T10:19:30.414897+0000","last_became_peered":"2023-12-18T10:19:30.414897+0000","last_unstale":"2023-12-18T10:19:31.400767+0000","last_undegraded":"2023-12-18T10:19:31.400767+0000","last_fullsized":"2023-12-18T10:19:31.400767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:17.473834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400478+0000","last_change":"2023-12-18T10:19:30.015694+0000","last_active":"2023-12-18T10:19:31.400478+0000","last_peered":"2023-12-18T10:19:31.400478+0000","last_clean":"2023-12-18T10:19:31.400478+0000","last_became_active":"2023-12-18T10:19:30.015408+0000","last_became_peered":"2023-12-18T10:19:30.015408+0000","last_unstale":"2023-12-18T10:19:31.400478+0000","last_undegraded":"2023-12-18T10:19:31.400478+0000","last_fullsized":"2023-12-18T10:19:31.400478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:45:17.984194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714075+0000","last_change":"2023-12-18T10:19:30.425278+0000","last_active":"2023-12-18T10:19:31.714075+0000","last_peered":"2023-12-18T10:19:31.714075+0000","last_clean":"2023-12-18T10:19:31.714075+0000","last_became_active":"2023-12-18T10:19:30.424261+0000","last_became_peered":"2023-12-18T10:19:30.424261+0000","last_unstale":"2023-12-18T10:19:31.714075+0000","last_undegraded":"2023-12-18T10:19:31.714075+0000","last_fullsized":"2023-12-18T10:19:31.714075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:24.519539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938479+0000","last_change":"2023-12-18T10:19:30.025243+0000","last_active":"2023-12-18T10:19:31.938479+0000","last_peered":"2023-12-18T10:19:31.938479+0000","last_clean":"2023-12-18T10:19:31.938479+0000","last_became_active":"2023-12-18T10:19:30.024923+0000","last_became_peered":"2023-12-18T10:19:30.024923+0000","last_unstale":"2023-12-18T10:19:31.938479+0000","last_undegraded":"2023-12-18T10:19:31.938479+0000","last_fullsized":"2023-12-18T10:19:31.938479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:39:11.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400872+0000","last_change":"2023-12-18T10:19:30.414172+0000","last_active":"2023-12-18T10:19:31.400872+0000","last_peered":"2023-12-18T10:19:31.400872+0000","last_clean":"2023-12-18T10:19:31.400872+0000","last_became_active":"2023-12-18T10:19:30.413892+0000","last_became_peered":"2023-12-18T10:19:30.413892+0000","last_unstale":"2023-12-18T10:19:31.400872+0000","last_undegraded":"2023-12-18T10:19:31.400872+0000","last_fullsized":"2023-12-18T10:19:31.400872+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:52.552665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714187+0000","last_change":"2023-12-18T10:19:30.021074+0000","last_active":"2023-12-18T10:19:31.714187+0000","last_peered":"2023-12-18T10:19:31.714187+0000","last_clean":"2023-12-18T10:19:31.714187+0000","last_became_active":"2023-12-18T10:19:30.020796+0000","last_became_peered":"2023-12-18T10:19:30.020796+0000","last_unstale":"2023-12-18T10:19:31.714187+0000","last_undegraded":"2023-12-18T10:19:31.714187+0000","last_fullsized":"2023-12-18T10:19:31.714187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:20.675456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401360+0000","last_change":"2023-12-18T10:19:30.415550+0000","last_active":"2023-12-18T10:19:31.401360+0000","last_peered":"2023-12-18T10:19:31.401360+0000","last_clean":"2023-12-18T10:19:31.401360+0000","last_became_active":"2023-12-18T10:19:30.415322+0000","last_became_peered":"2023-12-18T10:19:30.415322+0000","last_unstale":"2023-12-18T10:19:31.401360+0000","last_undegraded":"2023-12-18T10:19:31.401360+0000","last_fullsized":"2023-12-18T10:19:31.401360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:42:57.831301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.033009+0000","last_change":"2023-12-18T10:19:30.015612+0000","last_active":"2023-12-18T10:19:32.033009+0000","last_peered":"2023-12-18T10:19:32.033009+0000","last_clean":"2023-12-18T10:19:32.033009+0000","last_became_active":"2023-12-18T10:19:30.015311+0000","last_became_peered":"2023-12-18T10:19:30.015311+0000","last_unstale":"2023-12-18T10:19:32.033009+0000","last_undegraded":"2023-12-18T10:19:32.033009+0000","last_fullsized":"2023-12-18T10:19:32.033009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:44:53.080816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032791+0000","last_change":"2023-12-18T10:19:30.417544+0000","last_active":"2023-12-18T10:19:32.032791+0000","last_peered":"2023-12-18T10:19:32.032791+0000","last_clean":"2023-12-18T10:19:32.032791+0000","last_became_active":"2023-12-18T10:19:30.411570+0000","last_became_peered":"2023-12-18T10:19:30.411570+0000","last_unstale":"2023-12-18T10:19:32.032791+0000","last_undegraded":"2023-12-18T10:19:32.032791+0000","last_fullsized":"2023-12-18T10:19:32.032791+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:08:20.316469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.430720+0000","last_change":"2023-12-18T10:19:30.011948+0000","last_active":"2023-12-18T10:19:30.430720+0000","last_peered":"2023-12-18T10:19:30.430720+0000","last_clean":"2023-12-18T10:19:30.430720+0000","last_became_active":"2023-12-18T10:19:30.011329+0000","last_became_peered":"2023-12-18T10:19:30.011329+0000","last_unstale":"2023-12-18T10:19:30.430720+0000","last_undegraded":"2023-12-18T10:19:30.430720+0000","last_fullsized":"2023-12-18T10:19:30.430720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:29:58.661037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.422389+0000","last_change":"2023-12-18T10:19:30.411492+0000","last_active":"2023-12-18T10:19:30.422389+0000","last_peered":"2023-12-18T10:19:30.422389+0000","last_clean":"2023-12-18T10:19:30.422389+0000","last_became_active":"2023-12-18T10:19:30.411180+0000","last_became_peered":"2023-12-18T10:19:30.411180+0000","last_unstale":"2023-12-18T10:19:30.422389+0000","last_undegraded":"2023-12-18T10:19:30.422389+0000","last_fullsized":"2023-12-18T10:19:30.422389+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:30:54.345168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677145+0000","last_change":"2023-12-18T10:19:30.013139+0000","last_active":"2023-12-18T10:19:31.677145+0000","last_peered":"2023-12-18T10:19:31.677145+0000","last_clean":"2023-12-18T10:19:31.677145+0000","last_became_active":"2023-12-18T10:19:30.012952+0000","last_became_peered":"2023-12-18T10:19:30.012952+0000","last_unstale":"2023-12-18T10:19:31.677145+0000","last_undegraded":"2023-12-18T10:19:31.677145+0000","last_fullsized":"2023-12-18T10:19:31.677145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:45:54.854750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677178+0000","last_change":"2023-12-18T10:19:30.417293+0000","last_active":"2023-12-18T10:19:31.677178+0000","last_peered":"2023-12-18T10:19:31.677178+0000","last_clean":"2023-12-18T10:19:31.677178+0000","last_became_active":"2023-12-18T10:19:30.417123+0000","last_became_peered":"2023-12-18T10:19:30.417123+0000","last_unstale":"2023-12-18T10:19:31.677178+0000","last_undegraded":"2023-12-18T10:19:31.677178+0000","last_fullsized":"2023-12-18T10:19:31.677178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:58:25.279015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400623+0000","last_change":"2023-12-18T10:19:30.014584+0000","last_active":"2023-12-18T10:19:31.400623+0000","last_peered":"2023-12-18T10:19:31.400623+0000","last_clean":"2023-12-18T10:19:31.400623+0000","last_became_active":"2023-12-18T10:19:30.014248+0000","last_became_peered":"2023-12-18T10:19:30.014248+0000","last_unstale":"2023-12-18T10:19:31.400623+0000","last_undegraded":"2023-12-18T10:19:31.400623+0000","last_fullsized":"2023-12-18T10:19:31.400623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:25.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714216+0000","last_change":"2023-12-18T10:19:30.425042+0000","last_active":"2023-12-18T10:19:31.714216+0000","last_peered":"2023-12-18T10:19:31.714216+0000","last_clean":"2023-12-18T10:19:31.714216+0000","last_became_active":"2023-12-18T10:19:30.424731+0000","last_became_peered":"2023-12-18T10:19:30.424731+0000","last_unstale":"2023-12-18T10:19:31.714216+0000","last_undegraded":"2023-12-18T10:19:31.714216+0000","last_fullsized":"2023-12-18T10:19:31.714216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:53.439003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676985+0000","last_change":"2023-12-18T10:19:30.004776+0000","last_active":"2023-12-18T10:19:31.676985+0000","last_peered":"2023-12-18T10:19:31.676985+0000","last_clean":"2023-12-18T10:19:31.676985+0000","last_became_active":"2023-12-18T10:19:30.004462+0000","last_became_peered":"2023-12-18T10:19:30.004462+0000","last_unstale":"2023-12-18T10:19:31.676985+0000","last_undegraded":"2023-12-18T10:19:31.676985+0000","last_fullsized":"2023-12-18T10:19:31.676985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:04:43.870339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.434808+0000","last_change":"2023-12-18T10:19:30.434069+0000","last_active":"2023-12-18T10:19:30.434808+0000","last_peered":"2023-12-18T10:19:30.434808+0000","last_clean":"2023-12-18T10:19:30.434808+0000","last_became_active":"2023-12-18T10:19:30.433834+0000","last_became_peered":"2023-12-18T10:19:30.433834+0000","last_unstale":"2023-12-18T10:19:30.434808+0000","last_undegraded":"2023-12-18T10:19:30.434808+0000","last_fullsized":"2023-12-18T10:19:30.434808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:22:04.983729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676912+0000","last_change":"2023-12-18T10:19:30.015431+0000","last_active":"2023-12-18T10:19:31.676912+0000","last_peered":"2023-12-18T10:19:31.676912+0000","last_clean":"2023-12-18T10:19:31.676912+0000","last_became_active":"2023-12-18T10:19:30.015155+0000","last_became_peered":"2023-12-18T10:19:30.015155+0000","last_unstale":"2023-12-18T10:19:31.676912+0000","last_undegraded":"2023-12-18T10:19:31.676912+0000","last_fullsized":"2023-12-18T10:19:31.676912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:07:46.795842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032599+0000","last_change":"2023-12-18T10:19:30.416980+0000","last_active":"2023-12-18T10:19:32.032599+0000","last_peered":"2023-12-18T10:19:32.032599+0000","last_clean":"2023-12-18T10:19:32.032599+0000","last_became_active":"2023-12-18T10:19:30.416501+0000","last_became_peered":"2023-12-18T10:19:30.416501+0000","last_unstale":"2023-12-18T10:19:32.032599+0000","last_undegraded":"2023-12-18T10:19:32.032599+0000","last_fullsized":"2023-12-18T10:19:32.032599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:18:10.434859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714184+0000","last_change":"2023-12-18T10:19:30.020580+0000","last_active":"2023-12-18T10:19:31.714184+0000","last_peered":"2023-12-18T10:19:31.714184+0000","last_clean":"2023-12-18T10:19:31.714184+0000","last_became_active":"2023-12-18T10:19:30.020287+0000","last_became_peered":"2023-12-18T10:19:30.020287+0000","last_unstale":"2023-12-18T10:19:31.714184+0000","last_undegraded":"2023-12-18T10:19:31.714184+0000","last_fullsized":"2023-12-18T10:19:31.714184+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:17.368853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401201+0000","last_change":"2023-12-18T10:19:30.425583+0000","last_active":"2023-12-18T10:19:31.401201+0000","last_peered":"2023-12-18T10:19:31.401201+0000","last_clean":"2023-12-18T10:19:31.401201+0000","last_became_active":"2023-12-18T10:19:30.425079+0000","last_became_peered":"2023-12-18T10:19:30.425079+0000","last_unstale":"2023-12-18T10:19:31.401201+0000","last_undegraded":"2023-12-18T10:19:31.401201+0000","last_fullsized":"2023-12-18T10:19:31.401201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:15:16.244124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676904+0000","last_change":"2023-12-18T10:19:30.002240+0000","last_active":"2023-12-18T10:19:31.676904+0000","last_peered":"2023-12-18T10:19:31.676904+0000","last_clean":"2023-12-18T10:19:31.676904+0000","last_became_active":"2023-12-18T10:19:30.002001+0000","last_became_peered":"2023-12-18T10:19:30.002001+0000","last_unstale":"2023-12-18T10:19:31.676904+0000","last_undegraded":"2023-12-18T10:19:31.676904+0000","last_fullsized":"2023-12-18T10:19:31.676904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:08:36.527712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400542+0000","last_change":"2023-12-18T10:19:30.421695+0000","last_active":"2023-12-18T10:19:31.400542+0000","last_peered":"2023-12-18T10:19:31.400542+0000","last_clean":"2023-12-18T10:19:31.400542+0000","last_became_active":"2023-12-18T10:19:30.421391+0000","last_became_peered":"2023-12-18T10:19:30.421391+0000","last_unstale":"2023-12-18T10:19:31.400542+0000","last_undegraded":"2023-12-18T10:19:31.400542+0000","last_fullsized":"2023-12-18T10:19:31.400542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:11:12.537073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.033056+0000","last_change":"2023-12-18T10:19:30.021462+0000","last_active":"2023-12-18T10:19:32.033056+0000","last_peered":"2023-12-18T10:19:32.033056+0000","last_clean":"2023-12-18T10:19:32.033056+0000","last_became_active":"2023-12-18T10:19:30.021178+0000","last_became_peered":"2023-12-18T10:19:30.021178+0000","last_unstale":"2023-12-18T10:19:32.033056+0000","last_undegraded":"2023-12-18T10:19:32.033056+0000","last_fullsized":"2023-12-18T10:19:32.033056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:20.675456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714376+0000","last_change":"2023-12-18T10:19:30.427248+0000","last_active":"2023-12-18T10:19:31.714376+0000","last_peered":"2023-12-18T10:19:31.714376+0000","last_clean":"2023-12-18T10:19:31.714376+0000","last_became_active":"2023-12-18T10:19:30.426922+0000","last_became_peered":"2023-12-18T10:19:30.426922+0000","last_unstale":"2023-12-18T10:19:31.714376+0000","last_undegraded":"2023-12-18T10:19:31.714376+0000","last_fullsized":"2023-12-18T10:19:31.714376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:19:52.222961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677179+0000","last_change":"2023-12-18T10:19:30.009444+0000","last_active":"2023-12-18T10:19:31.677179+0000","last_peered":"2023-12-18T10:19:31.677179+0000","last_clean":"2023-12-18T10:19:31.677179+0000","last_became_active":"2023-12-18T10:19:30.009153+0000","last_became_peered":"2023-12-18T10:19:30.009153+0000","last_unstale":"2023-12-18T10:19:31.677179+0000","last_undegraded":"2023-12-18T10:19:31.677179+0000","last_fullsized":"2023-12-18T10:19:31.677179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:01:32.871177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401127+0000","last_change":"2023-12-18T10:19:30.414218+0000","last_active":"2023-12-18T10:19:31.401127+0000","last_peered":"2023-12-18T10:19:31.401127+0000","last_clean":"2023-12-18T10:19:31.401127+0000","last_became_active":"2023-12-18T10:19:30.413947+0000","last_became_peered":"2023-12-18T10:19:30.413947+0000","last_unstale":"2023-12-18T10:19:31.401127+0000","last_undegraded":"2023-12-18T10:19:31.401127+0000","last_fullsized":"2023-12-18T10:19:31.401127+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:59:44.253773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.394166+0000","last_change":"2023-12-18T10:19:30.020761+0000","last_active":"2023-12-18T10:19:30.394166+0000","last_peered":"2023-12-18T10:19:30.394166+0000","last_clean":"2023-12-18T10:19:30.394166+0000","last_became_active":"2023-12-18T10:19:30.020478+0000","last_became_peered":"2023-12-18T10:19:30.020478+0000","last_unstale":"2023-12-18T10:19:30.394166+0000","last_undegraded":"2023-12-18T10:19:30.394166+0000","last_fullsized":"2023-12-18T10:19:30.394166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:20.675456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.419570+0000","last_change":"2023-12-18T10:19:30.415951+0000","last_active":"2023-12-18T10:19:30.419570+0000","last_peered":"2023-12-18T10:19:30.419570+0000","last_clean":"2023-12-18T10:19:30.419570+0000","last_became_active":"2023-12-18T10:19:30.415665+0000","last_became_peered":"2023-12-18T10:19:30.415665+0000","last_unstale":"2023-12-18T10:19:30.419570+0000","last_undegraded":"2023-12-18T10:19:30.419570+0000","last_fullsized":"2023-12-18T10:19:30.419570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:52:59.703706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.393961+0000","last_change":"2023-12-18T10:19:30.016174+0000","last_active":"2023-12-18T10:19:30.393961+0000","last_peered":"2023-12-18T10:19:30.393961+0000","last_clean":"2023-12-18T10:19:30.393961+0000","last_became_active":"2023-12-18T10:19:30.015875+0000","last_became_peered":"2023-12-18T10:19:30.015875+0000","last_unstale":"2023-12-18T10:19:30.393961+0000","last_undegraded":"2023-12-18T10:19:30.393961+0000","last_fullsized":"2023-12-18T10:19:30.393961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:45.548510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400422+0000","last_change":"2023-12-18T10:19:30.406948+0000","last_active":"2023-12-18T10:19:31.400422+0000","last_peered":"2023-12-18T10:19:31.400422+0000","last_clean":"2023-12-18T10:19:31.400422+0000","last_became_active":"2023-12-18T10:19:30.406658+0000","last_became_peered":"2023-12-18T10:19:30.406658+0000","last_unstale":"2023-12-18T10:19:31.400422+0000","last_undegraded":"2023-12-18T10:19:31.400422+0000","last_fullsized":"2023-12-18T10:19:31.400422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:40.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938546+0000","last_change":"2023-12-18T10:19:30.017575+0000","last_active":"2023-12-18T10:19:31.938546+0000","last_peered":"2023-12-18T10:19:31.938546+0000","last_clean":"2023-12-18T10:19:31.938546+0000","last_became_active":"2023-12-18T10:19:30.017311+0000","last_became_peered":"2023-12-18T10:19:30.017311+0000","last_unstale":"2023-12-18T10:19:31.938546+0000","last_undegraded":"2023-12-18T10:19:31.938546+0000","last_fullsized":"2023-12-18T10:19:31.938546+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:45:54.854750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.431973+0000","last_change":"2023-12-18T10:19:30.422770+0000","last_active":"2023-12-18T10:19:30.431973+0000","last_peered":"2023-12-18T10:19:30.431973+0000","last_clean":"2023-12-18T10:19:30.431973+0000","last_became_active":"2023-12-18T10:19:30.422459+0000","last_became_peered":"2023-12-18T10:19:30.422459+0000","last_unstale":"2023-12-18T10:19:30.431973+0000","last_undegraded":"2023-12-18T10:19:30.431973+0000","last_fullsized":"2023-12-18T10:19:30.431973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:56:24.790752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.399559+0000","last_change":"2023-12-18T10:19:30.012623+0000","last_active":"2023-12-18T10:19:30.399559+0000","last_peered":"2023-12-18T10:19:30.399559+0000","last_clean":"2023-12-18T10:19:30.399559+0000","last_became_active":"2023-12-18T10:19:30.012273+0000","last_became_peered":"2023-12-18T10:19:30.012273+0000","last_unstale":"2023-12-18T10:19:30.399559+0000","last_undegraded":"2023-12-18T10:19:30.399559+0000","last_fullsized":"2023-12-18T10:19:30.399559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:16.464910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.715042+0000","last_change":"2023-12-18T10:19:30.424371+0000","last_active":"2023-12-18T10:19:31.715042+0000","last_peered":"2023-12-18T10:19:31.715042+0000","last_clean":"2023-12-18T10:19:31.715042+0000","last_became_active":"2023-12-18T10:19:30.424026+0000","last_became_peered":"2023-12-18T10:19:30.424026+0000","last_unstale":"2023-12-18T10:19:31.715042+0000","last_undegraded":"2023-12-18T10:19:31.715042+0000","last_fullsized":"2023-12-18T10:19:31.715042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:38:14.599677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400720+0000","last_change":"2023-12-18T10:19:30.010994+0000","last_active":"2023-12-18T10:19:31.400720+0000","last_peered":"2023-12-18T10:19:31.400720+0000","last_clean":"2023-12-18T10:19:31.400720+0000","last_became_active":"2023-12-18T10:19:30.010722+0000","last_became_peered":"2023-12-18T10:19:30.010722+0000","last_unstale":"2023-12-18T10:19:31.400720+0000","last_undegraded":"2023-12-18T10:19:31.400720+0000","last_fullsized":"2023-12-18T10:19:31.400720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:51:02.647635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032933+0000","last_change":"2023-12-18T10:19:30.419334+0000","last_active":"2023-12-18T10:19:32.032933+0000","last_peered":"2023-12-18T10:19:32.032933+0000","last_clean":"2023-12-18T10:19:32.032933+0000","last_became_active":"2023-12-18T10:19:30.419061+0000","last_became_peered":"2023-12-18T10:19:30.419061+0000","last_unstale":"2023-12-18T10:19:32.032933+0000","last_undegraded":"2023-12-18T10:19:32.032933+0000","last_fullsized":"2023-12-18T10:19:32.032933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:48.326152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714411+0000","last_change":"2023-12-18T10:19:30.018030+0000","last_active":"2023-12-18T10:19:31.714411+0000","last_peered":"2023-12-18T10:19:31.714411+0000","last_clean":"2023-12-18T10:19:31.714411+0000","last_became_active":"2023-12-18T10:19:30.017744+0000","last_became_peered":"2023-12-18T10:19:30.017744+0000","last_unstale":"2023-12-18T10:19:31.714411+0000","last_undegraded":"2023-12-18T10:19:31.714411+0000","last_fullsized":"2023-12-18T10:19:31.714411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:45.548510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.416878+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:19:30.416878+0000","last_peered":"2023-12-18T10:19:30.416878+0000","last_clean":"2023-12-18T10:19:30.416878+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:19:30.416878+0000","last_undegraded":"2023-12-18T10:19:30.416878+0000","last_fullsized":"2023-12-18T10:19:30.416878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":786109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64700000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.625}]},{"osd":2,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.77700000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68200000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.3760000000000003,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.73199999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.751},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":4.524,"5min":4.524,"15min":4.524},"last":0.77600000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.80900000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.3079999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.82299999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.623}]},{"osd":5,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.79200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":194219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.497},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.7949999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.83999999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.2730000000000001,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":8.9740000000000002,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":188091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.72299999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.749}]},{"osd":3,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.628}]},{"osd":5,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52800000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":195705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.754}]},{"osd":5,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.82399999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.85699999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.80800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39500000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.372},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.432},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.498}]},{"osd":3,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.2440000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":4.1859999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.70999999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.748},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.3529999999999998,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.77600000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":1036288,"data_stored":777889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.34599999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":0.39900000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.308},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.443}]},{"osd":4,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.63900000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:19:34.453 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:19:34.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dc7ce640 1 Processor -- start 2023-12-18T10:19:34.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dc7ce640 1 -- start start 2023-12-18T10:19:34.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dc7ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 0x7f85d40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dc7ce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f85d40c9e30 0x7f85d4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dc7ce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d40c9460 con 0x7f85d41570c0 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dc7ce640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d41574a0 con 0x7f85d40c9e30 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dc7ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40c8b30 con 0x7f85d406c4f0 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dad6b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f85d40c9e30 0x7f85d4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dad6b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f85d40c9e30 0x7f85d4070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59832/0 (socket says 172.21.15.133:59832) 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85d9d69640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 0x7f85d40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85dad6b640 1 -- 172.21.15.133:0/980735907 learned_addr learned my addr 172.21.15.133:0/980735907 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.629+0000 7f85da56a640 1 --1- 172.21.15.133:0/980735907 >> v1:172.21.15.142:6789/0 conn(0x7f85d41570c0 0x7f85d406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:54872/0 (socket says 172.21.15.133:54872) 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85dad6b640 1 -- 172.21.15.133:0/980735907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 msgr2=0x7f85d40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85dad6b640 1 --2- 172.21.15.133:0/980735907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 0x7f85d40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85dad6b640 1 -- 172.21.15.133:0/980735907 >> v1:172.21.15.142:6789/0 conn(0x7f85d41570c0 legacy=0x7f85d406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85dad6b640 1 -- 172.21.15.133:0/980735907 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d40c8e10 con 0x7f85d40c9e30 2023-12-18T10:19:34.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85dad6b640 1 --2- 172.21.15.133:0/980735907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d40c9e30 0x7f85d4070df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009e50 tx=0x7f85cc01ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39184e39f143dc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:34.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85d9568640 1 -- 172.21.15.133:0/980735907 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0a7af0 con 0x7f85d40c9e30 2023-12-18T10:19:34.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85d9568640 1 -- 172.21.15.133:0/980735907 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc0a7c50 con 0x7f85d40c9e30 2023-12-18T10:19:34.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85d9568640 1 -- 172.21.15.133:0/980735907 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0af3f0 con 0x7f85d40c9e30 2023-12-18T10:19:34.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85dc7ce640 1 -- 172.21.15.133:0/980735907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d40c9e30 msgr2=0x7f85d4070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.633+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/980735907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d40c9e30 0x7f85d4070df0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009e50 tx=0x7f85cc01ec20 comp rx=0 tx=0).stop 2023-12-18T10:19:34.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- 172.21.15.133:0/980735907 shutdown_connections 2023-12-18T10:19:34.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/980735907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d40c9e30 0x7f85d4070df0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/980735907 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 0x7f85d40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- 172.21.15.133:0/980735907 >> 172.21.15.133:0/980735907 conn(0x7f85d406a3e0 msgr2=0x7f85d40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:34.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- 172.21.15.133:0/980735907 shutdown_connections 2023-12-18T10:19:34.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- 172.21.15.133:0/980735907 wait complete. 2023-12-18T10:19:34.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 Processor -- start 2023-12-18T10:19:34.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- start start 2023-12-18T10:19:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 0x7f85d41597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d40c9e30 0x7f85d414a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d41570c0 0x7f85d414ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d414ab30 con 0x7f85d41570c0 2023-12-18T10:19:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d41587c0 con 0x7f85d40c9e30 2023-12-18T10:19:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4158a30 con 0x7f85d406c4f0 2023-12-18T10:19:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d41570c0 0x7f85d414ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d41570c0 0x7f85d414ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59842/0 (socket says 172.21.15.133:59842) 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 -- 172.21.15.133:0/3619185552 learned_addr learned my addr 172.21.15.133:0/3619185552 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85da56a640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 0x7f85d41597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85d9d69640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d40c9e30 0x7f85d414a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 -- 172.21.15.133:0/3619185552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 msgr2=0x7f85d41597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 0x7f85d41597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 -- 172.21.15.133:0/3619185552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d40c9e30 msgr2=0x7f85d414a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d40c9e30 0x7f85d414a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 -- 172.21.15.133:0/3619185552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc009b30 con 0x7f85d41570c0 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dad6b640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d41570c0 0x7f85d414ee30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0b1040 tx=0x7f85cc01b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85caffd640 1 -- 172.21.15.133:0/3619185552 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0a7af0 con 0x7f85d41570c0 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85caffd640 1 -- 172.21.15.133:0/3619185552 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00e150 con 0x7f85d41570c0 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d4158d10 con 0x7f85d41570c0 2023-12-18T10:19:34.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85caffd640 1 -- 172.21.15.133:0/3619185552 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc009510 con 0x7f85d41570c0 2023-12-18T10:19:34.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.637+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d41592d0 con 0x7f85d41570c0 2023-12-18T10:19:34.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.641+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d40735b0 con 0x7f85d41570c0 2023-12-18T10:19:34.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.641+0000 7f85caffd640 1 -- 172.21.15.133:0/3619185552 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f85cc0af3f0 con 0x7f85d41570c0 2023-12-18T10:19:34.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.641+0000 7f85caffd640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85b8065a60 0x7f85b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:34.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.641+0000 7f85caffd640 1 -- 172.21.15.133:0/3619185552 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f85cc11d8d0 con 0x7f85d41570c0 2023-12-18T10:19:34.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.641+0000 7f85da56a640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85b8065a60 0x7f85b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:34.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.641+0000 7f85da56a640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85b8065a60 0x7f85b8067f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f85d0000f70 tx=0x7f85d0007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:34.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.645+0000 7f85caffd640 1 -- 172.21.15.133:0/3619185552 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f85cc0eb200 con 0x7f85d41570c0 2023-12-18T10:19:34.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.793+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85d40ca8a0 con 0x7f85b8065a60 2023-12-18T10:19:34.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.801+0000 7f85caffd640 1 -- 172.21.15.133:0/3619185552 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289038 (secure 0 0 0) 0x7f85d0005a60 con 0x7f85b8065a60 2023-12-18T10:19:34.806 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:34.808 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85b8065a60 msgr2=0x7f85b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85b8065a60 0x7f85b8067f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f85d0000f70 tx=0x7f85d0007c90 comp rx=0 tx=0).stop 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d41570c0 msgr2=0x7f85d414ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d41570c0 0x7f85d414ee30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0b1040 tx=0x7f85cc01b9c0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 shutdown_connections 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85b8065a60 0x7f85b8067f20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d41570c0 0x7f85d414ee30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f85d40c9e30 0x7f85d414a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 --2- 172.21.15.133:0/3619185552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f85d406c4f0 0x7f85d41597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:34.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 >> 172.21.15.133:0/3619185552 conn(0x7f85d406a3e0 msgr2=0x7f85d415bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:34.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 shutdown_connections 2023-12-18T10:19:34.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:34.805+0000 7f85dc7ce640 1 -- 172.21.15.133:0/3619185552 wait complete. 2023-12-18T10:19:34.826 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-12-18T10:19:33.112651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220336,"kb_used_data":4720,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754384,"statfs":{"total":773094113280,"available":772868489216,"internally_reserved":0,"allocated":4833280,"data_stored":2725076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.129416"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401158+0000","last_change":"2023-12-18T10:19:30.414530+0000","last_active":"2023-12-18T10:19:31.401158+0000","last_peered":"2023-12-18T10:19:31.401158+0000","last_clean":"2023-12-18T10:19:31.401158+0000","last_became_active":"2023-12-18T10:19:30.414100+0000","last_became_peered":"2023-12-18T10:19:30.414100+0000","last_unstale":"2023-12-18T10:19:31.401158+0000","last_undegraded":"2023-12-18T10:19:31.401158+0000","last_fullsized":"2023-12-18T10:19:31.401158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:44:05.868319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401077+0000","last_change":"2023-12-18T10:19:30.414694+0000","last_active":"2023-12-18T10:19:31.401077+0000","last_peered":"2023-12-18T10:19:31.401077+0000","last_clean":"2023-12-18T10:19:31.401077+0000","last_became_active":"2023-12-18T10:19:30.414458+0000","last_became_peered":"2023-12-18T10:19:30.414458+0000","last_unstale":"2023-12-18T10:19:31.401077+0000","last_undegraded":"2023-12-18T10:19:31.401077+0000","last_fullsized":"2023-12-18T10:19:31.401077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:09:29.974767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.417867+0000","last_change":"2023-12-18T10:19:30.409060+0000","last_active":"2023-12-18T10:19:30.417867+0000","last_peered":"2023-12-18T10:19:30.417867+0000","last_clean":"2023-12-18T10:19:30.417867+0000","last_became_active":"2023-12-18T10:19:30.408800+0000","last_became_peered":"2023-12-18T10:19:30.408800+0000","last_unstale":"2023-12-18T10:19:30.417867+0000","last_undegraded":"2023-12-18T10:19:30.417867+0000","last_fullsized":"2023-12-18T10:19:30.417867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:23:22.476075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677045+0000","last_change":"2023-12-18T10:19:30.408658+0000","last_active":"2023-12-18T10:19:31.677045+0000","last_peered":"2023-12-18T10:19:31.677045+0000","last_clean":"2023-12-18T10:19:31.677045+0000","last_became_active":"2023-12-18T10:19:30.408160+0000","last_became_peered":"2023-12-18T10:19:30.408160+0000","last_unstale":"2023-12-18T10:19:31.677045+0000","last_undegraded":"2023-12-18T10:19:31.677045+0000","last_fullsized":"2023-12-18T10:19:31.677045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:48:02.772382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676947+0000","last_change":"2023-12-18T10:19:30.406932+0000","last_active":"2023-12-18T10:19:31.676947+0000","last_peered":"2023-12-18T10:19:31.676947+0000","last_clean":"2023-12-18T10:19:31.676947+0000","last_became_active":"2023-12-18T10:19:30.406674+0000","last_became_peered":"2023-12-18T10:19:30.406674+0000","last_unstale":"2023-12-18T10:19:31.676947+0000","last_undegraded":"2023-12-18T10:19:31.676947+0000","last_fullsized":"2023-12-18T10:19:31.676947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:21.684380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400427+0000","last_change":"2023-12-18T10:19:30.417814+0000","last_active":"2023-12-18T10:19:31.400427+0000","last_peered":"2023-12-18T10:19:31.400427+0000","last_clean":"2023-12-18T10:19:31.400427+0000","last_became_active":"2023-12-18T10:19:30.417491+0000","last_became_peered":"2023-12-18T10:19:30.417491+0000","last_unstale":"2023-12-18T10:19:31.400427+0000","last_undegraded":"2023-12-18T10:19:31.400427+0000","last_fullsized":"2023-12-18T10:19:31.400427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:30.358527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032704+0000","last_change":"2023-12-18T10:19:30.420040+0000","last_active":"2023-12-18T10:19:32.032704+0000","last_peered":"2023-12-18T10:19:32.032704+0000","last_clean":"2023-12-18T10:19:32.032704+0000","last_became_active":"2023-12-18T10:19:30.419745+0000","last_became_peered":"2023-12-18T10:19:30.419745+0000","last_unstale":"2023-12-18T10:19:32.032704+0000","last_undegraded":"2023-12-18T10:19:32.032704+0000","last_fullsized":"2023-12-18T10:19:32.032704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:52:59.703706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400638+0000","last_change":"2023-12-18T10:19:30.411804+0000","last_active":"2023-12-18T10:19:31.400638+0000","last_peered":"2023-12-18T10:19:31.400638+0000","last_clean":"2023-12-18T10:19:31.400638+0000","last_became_active":"2023-12-18T10:19:30.411546+0000","last_became_peered":"2023-12-18T10:19:30.411546+0000","last_unstale":"2023-12-18T10:19:31.400638+0000","last_undegraded":"2023-12-18T10:19:31.400638+0000","last_fullsized":"2023-12-18T10:19:31.400638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:29:59.669961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.417838+0000","last_change":"2023-12-18T10:19:30.407901+0000","last_active":"2023-12-18T10:19:30.417838+0000","last_peered":"2023-12-18T10:19:30.417838+0000","last_clean":"2023-12-18T10:19:30.417838+0000","last_became_active":"2023-12-18T10:19:30.407636+0000","last_became_peered":"2023-12-18T10:19:30.407636+0000","last_unstale":"2023-12-18T10:19:30.417838+0000","last_undegraded":"2023-12-18T10:19:30.417838+0000","last_fullsized":"2023-12-18T10:19:30.417838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:53.439003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032803+0000","last_change":"2023-12-18T10:19:30.426754+0000","last_active":"2023-12-18T10:19:32.032803+0000","last_peered":"2023-12-18T10:19:32.032803+0000","last_clean":"2023-12-18T10:19:32.032803+0000","last_became_active":"2023-12-18T10:19:30.426479+0000","last_became_peered":"2023-12-18T10:19:30.426479+0000","last_unstale":"2023-12-18T10:19:32.032803+0000","last_undegraded":"2023-12-18T10:19:32.032803+0000","last_fullsized":"2023-12-18T10:19:32.032803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:11:12.537073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032784+0000","last_change":"2023-12-18T10:19:30.418271+0000","last_active":"2023-12-18T10:19:32.032784+0000","last_peered":"2023-12-18T10:19:32.032784+0000","last_clean":"2023-12-18T10:19:32.032784+0000","last_became_active":"2023-12-18T10:19:30.418031+0000","last_became_peered":"2023-12-18T10:19:30.418031+0000","last_unstale":"2023-12-18T10:19:32.032784+0000","last_undegraded":"2023-12-18T10:19:32.032784+0000","last_fullsized":"2023-12-18T10:19:32.032784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:38:14.599677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.417696+0000","last_change":"2023-12-18T10:19:30.409511+0000","last_active":"2023-12-18T10:19:30.417696+0000","last_peered":"2023-12-18T10:19:30.417696+0000","last_clean":"2023-12-18T10:19:30.417696+0000","last_became_active":"2023-12-18T10:19:30.409207+0000","last_became_peered":"2023-12-18T10:19:30.409207+0000","last_unstale":"2023-12-18T10:19:30.417696+0000","last_undegraded":"2023-12-18T10:19:30.417696+0000","last_fullsized":"2023-12-18T10:19:30.417696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:51:03.656560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032541+0000","last_change":"2023-12-18T10:19:30.422097+0000","last_active":"2023-12-18T10:19:32.032541+0000","last_peered":"2023-12-18T10:19:32.032541+0000","last_clean":"2023-12-18T10:19:32.032541+0000","last_became_active":"2023-12-18T10:19:30.421806+0000","last_became_peered":"2023-12-18T10:19:30.421806+0000","last_unstale":"2023-12-18T10:19:32.032541+0000","last_undegraded":"2023-12-18T10:19:32.032541+0000","last_fullsized":"2023-12-18T10:19:32.032541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:24.519539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.431935+0000","last_change":"2023-12-18T10:19:30.415234+0000","last_active":"2023-12-18T10:19:30.431935+0000","last_peered":"2023-12-18T10:19:30.431935+0000","last_clean":"2023-12-18T10:19:30.431935+0000","last_became_active":"2023-12-18T10:19:30.414927+0000","last_became_peered":"2023-12-18T10:19:30.414927+0000","last_unstale":"2023-12-18T10:19:30.431935+0000","last_undegraded":"2023-12-18T10:19:30.431935+0000","last_fullsized":"2023-12-18T10:19:30.431935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:06:00.480550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032760+0000","last_change":"2023-12-18T10:19:30.409779+0000","last_active":"2023-12-18T10:19:32.032760+0000","last_peered":"2023-12-18T10:19:32.032760+0000","last_clean":"2023-12-18T10:19:32.032760+0000","last_became_active":"2023-12-18T10:19:30.409507+0000","last_became_peered":"2023-12-18T10:19:30.409507+0000","last_unstale":"2023-12-18T10:19:32.032760+0000","last_undegraded":"2023-12-18T10:19:32.032760+0000","last_fullsized":"2023-12-18T10:19:32.032760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:30.358527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714074+0000","last_change":"2023-12-18T10:19:30.431621+0000","last_active":"2023-12-18T10:19:31.714074+0000","last_peered":"2023-12-18T10:19:31.714074+0000","last_clean":"2023-12-18T10:19:31.714074+0000","last_became_active":"2023-12-18T10:19:30.428868+0000","last_became_peered":"2023-12-18T10:19:30.428868+0000","last_unstale":"2023-12-18T10:19:31.714074+0000","last_undegraded":"2023-12-18T10:19:31.714074+0000","last_fullsized":"2023-12-18T10:19:31.714074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:22:04.983729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714480+0000","last_change":"2023-12-18T10:19:30.433376+0000","last_active":"2023-12-18T10:19:31.714480+0000","last_peered":"2023-12-18T10:19:31.714480+0000","last_clean":"2023-12-18T10:19:31.714480+0000","last_became_active":"2023-12-18T10:19:30.432925+0000","last_became_peered":"2023-12-18T10:19:30.432925+0000","last_unstale":"2023-12-18T10:19:31.714480+0000","last_undegraded":"2023-12-18T10:19:31.714480+0000","last_fullsized":"2023-12-18T10:19:31.714480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:11:12.537073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938712+0000","last_change":"2023-12-18T10:19:30.403847+0000","last_active":"2023-12-18T10:19:31.938712+0000","last_peered":"2023-12-18T10:19:31.938712+0000","last_clean":"2023-12-18T10:19:31.938712+0000","last_became_active":"2023-12-18T10:19:30.403545+0000","last_became_peered":"2023-12-18T10:19:30.403545+0000","last_unstale":"2023-12-18T10:19:31.938712+0000","last_undegraded":"2023-12-18T10:19:31.938712+0000","last_fullsized":"2023-12-18T10:19:31.938712+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:52:57.839827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677092+0000","last_change":"2023-12-18T10:19:30.403395+0000","last_active":"2023-12-18T10:19:31.677092+0000","last_peered":"2023-12-18T10:19:31.677092+0000","last_clean":"2023-12-18T10:19:31.677092+0000","last_became_active":"2023-12-18T10:19:30.403049+0000","last_became_peered":"2023-12-18T10:19:30.403049+0000","last_unstale":"2023-12-18T10:19:31.677092+0000","last_undegraded":"2023-12-18T10:19:31.677092+0000","last_fullsized":"2023-12-18T10:19:31.677092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:18.377777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938671+0000","last_change":"2023-12-18T10:19:30.413140+0000","last_active":"2023-12-18T10:19:31.938671+0000","last_peered":"2023-12-18T10:19:31.938671+0000","last_clean":"2023-12-18T10:19:31.938671+0000","last_became_active":"2023-12-18T10:19:30.412874+0000","last_became_peered":"2023-12-18T10:19:30.412874+0000","last_unstale":"2023-12-18T10:19:31.938671+0000","last_undegraded":"2023-12-18T10:19:31.938671+0000","last_fullsized":"2023-12-18T10:19:31.938671+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:06:16.731005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032566+0000","last_change":"2023-12-18T10:19:30.411084+0000","last_active":"2023-12-18T10:19:32.032566+0000","last_peered":"2023-12-18T10:19:32.032566+0000","last_clean":"2023-12-18T10:19:32.032566+0000","last_became_active":"2023-12-18T10:19:30.410774+0000","last_became_peered":"2023-12-18T10:19:30.410774+0000","last_unstale":"2023-12-18T10:19:32.032566+0000","last_undegraded":"2023-12-18T10:19:32.032566+0000","last_fullsized":"2023-12-18T10:19:32.032566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:19:12.827991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.431955+0000","last_change":"2023-12-18T10:19:30.416889+0000","last_active":"2023-12-18T10:19:30.431955+0000","last_peered":"2023-12-18T10:19:30.431955+0000","last_clean":"2023-12-18T10:19:30.431955+0000","last_became_active":"2023-12-18T10:19:30.416575+0000","last_became_peered":"2023-12-18T10:19:30.416575+0000","last_unstale":"2023-12-18T10:19:30.431955+0000","last_undegraded":"2023-12-18T10:19:30.431955+0000","last_fullsized":"2023-12-18T10:19:30.431955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:34:46.837951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714060+0000","last_change":"2023-12-18T10:19:30.425107+0000","last_active":"2023-12-18T10:19:31.714060+0000","last_peered":"2023-12-18T10:19:31.714060+0000","last_clean":"2023-12-18T10:19:31.714060+0000","last_became_active":"2023-12-18T10:19:30.424863+0000","last_became_peered":"2023-12-18T10:19:30.424863+0000","last_unstale":"2023-12-18T10:19:31.714060+0000","last_undegraded":"2023-12-18T10:19:31.714060+0000","last_fullsized":"2023-12-18T10:19:31.714060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:48.326152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676883+0000","last_change":"2023-12-18T10:19:30.424926+0000","last_active":"2023-12-18T10:19:31.676883+0000","last_peered":"2023-12-18T10:19:31.676883+0000","last_clean":"2023-12-18T10:19:31.676883+0000","last_became_active":"2023-12-18T10:19:30.424613+0000","last_became_peered":"2023-12-18T10:19:30.424613+0000","last_unstale":"2023-12-18T10:19:31.676883+0000","last_undegraded":"2023-12-18T10:19:31.676883+0000","last_fullsized":"2023-12-18T10:19:31.676883+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:46.557434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938761+0000","last_change":"2023-12-18T10:19:30.408998+0000","last_active":"2023-12-18T10:19:31.938761+0000","last_peered":"2023-12-18T10:19:31.938761+0000","last_clean":"2023-12-18T10:19:31.938761+0000","last_became_active":"2023-12-18T10:19:30.408674+0000","last_became_peered":"2023-12-18T10:19:30.408674+0000","last_unstale":"2023-12-18T10:19:31.938761+0000","last_undegraded":"2023-12-18T10:19:31.938761+0000","last_fullsized":"2023-12-18T10:19:31.938761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:21.684380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400971+0000","last_change":"2023-12-18T10:19:30.410031+0000","last_active":"2023-12-18T10:19:31.400971+0000","last_peered":"2023-12-18T10:19:31.400971+0000","last_clean":"2023-12-18T10:19:31.400971+0000","last_became_active":"2023-12-18T10:19:30.409753+0000","last_became_peered":"2023-12-18T10:19:30.409753+0000","last_unstale":"2023-12-18T10:19:31.400971+0000","last_undegraded":"2023-12-18T10:19:31.400971+0000","last_fullsized":"2023-12-18T10:19:31.400971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:38:14.599677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938718+0000","last_change":"2023-12-18T10:19:30.400749+0000","last_active":"2023-12-18T10:19:31.938718+0000","last_peered":"2023-12-18T10:19:31.938718+0000","last_clean":"2023-12-18T10:19:31.938718+0000","last_became_active":"2023-12-18T10:19:30.400462+0000","last_became_peered":"2023-12-18T10:19:30.400462+0000","last_unstale":"2023-12-18T10:19:31.938718+0000","last_undegraded":"2023-12-18T10:19:31.938718+0000","last_fullsized":"2023-12-18T10:19:31.938718+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:44:54.089740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032721+0000","last_change":"2023-12-18T10:19:30.419372+0000","last_active":"2023-12-18T10:19:32.032721+0000","last_peered":"2023-12-18T10:19:32.032721+0000","last_clean":"2023-12-18T10:19:32.032721+0000","last_became_active":"2023-12-18T10:19:30.419074+0000","last_became_peered":"2023-12-18T10:19:30.419074+0000","last_unstale":"2023-12-18T10:19:32.032721+0000","last_undegraded":"2023-12-18T10:19:32.032721+0000","last_fullsized":"2023-12-18T10:19:32.032721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:40.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938719+0000","last_change":"2023-12-18T10:19:30.413730+0000","last_active":"2023-12-18T10:19:31.938719+0000","last_peered":"2023-12-18T10:19:31.938719+0000","last_clean":"2023-12-18T10:19:31.938719+0000","last_became_active":"2023-12-18T10:19:30.413353+0000","last_became_peered":"2023-12-18T10:19:30.413353+0000","last_unstale":"2023-12-18T10:19:31.938719+0000","last_undegraded":"2023-12-18T10:19:31.938719+0000","last_fullsized":"2023-12-18T10:19:31.938719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:58:25.279015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938550+0000","last_change":"2023-12-18T10:19:30.418541+0000","last_active":"2023-12-18T10:19:31.938550+0000","last_peered":"2023-12-18T10:19:31.938550+0000","last_clean":"2023-12-18T10:19:31.938550+0000","last_became_active":"2023-12-18T10:19:30.418255+0000","last_became_peered":"2023-12-18T10:19:30.418255+0000","last_unstale":"2023-12-18T10:19:31.938550+0000","last_undegraded":"2023-12-18T10:19:31.938550+0000","last_fullsized":"2023-12-18T10:19:31.938550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:48:02.772382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714213+0000","last_change":"2023-12-18T10:19:30.424685+0000","last_active":"2023-12-18T10:19:31.714213+0000","last_peered":"2023-12-18T10:19:31.714213+0000","last_clean":"2023-12-18T10:19:31.714213+0000","last_became_active":"2023-12-18T10:19:30.424270+0000","last_became_peered":"2023-12-18T10:19:30.424270+0000","last_unstale":"2023-12-18T10:19:31.714213+0000","last_undegraded":"2023-12-18T10:19:31.714213+0000","last_fullsized":"2023-12-18T10:19:31.714213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:52:59.703706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400319+0000","last_change":"2023-12-18T10:19:30.404581+0000","last_active":"2023-12-18T10:19:31.400319+0000","last_peered":"2023-12-18T10:19:31.400319+0000","last_clean":"2023-12-18T10:19:31.400319+0000","last_became_active":"2023-12-18T10:19:30.404227+0000","last_became_peered":"2023-12-18T10:19:30.404227+0000","last_unstale":"2023-12-18T10:19:31.400319+0000","last_undegraded":"2023-12-18T10:19:31.400319+0000","last_fullsized":"2023-12-18T10:19:31.400319+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:48.326152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714311+0000","last_change":"2023-12-18T10:19:30.431556+0000","last_active":"2023-12-18T10:19:31.714311+0000","last_peered":"2023-12-18T10:19:31.714311+0000","last_clean":"2023-12-18T10:19:31.714311+0000","last_became_active":"2023-12-18T10:19:30.431286+0000","last_became_peered":"2023-12-18T10:19:30.431286+0000","last_unstale":"2023-12-18T10:19:31.714311+0000","last_undegraded":"2023-12-18T10:19:31.714311+0000","last_fullsized":"2023-12-18T10:19:31.714311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:40.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938814+0000","last_change":"2023-12-18T10:19:30.025463+0000","last_active":"2023-12-18T10:19:31.938814+0000","last_peered":"2023-12-18T10:19:31.938814+0000","last_clean":"2023-12-18T10:19:31.938814+0000","last_became_active":"2023-12-18T10:19:30.024942+0000","last_became_peered":"2023-12-18T10:19:30.024942+0000","last_unstale":"2023-12-18T10:19:31.938814+0000","last_undegraded":"2023-12-18T10:19:31.938814+0000","last_fullsized":"2023-12-18T10:19:31.938814+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:17:01.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401103+0000","last_change":"2023-12-18T10:19:30.421697+0000","last_active":"2023-12-18T10:19:31.401103+0000","last_peered":"2023-12-18T10:19:31.401103+0000","last_clean":"2023-12-18T10:19:31.401103+0000","last_became_active":"2023-12-18T10:19:30.421392+0000","last_became_peered":"2023-12-18T10:19:30.421392+0000","last_unstale":"2023-12-18T10:19:31.401103+0000","last_undegraded":"2023-12-18T10:19:31.401103+0000","last_fullsized":"2023-12-18T10:19:31.401103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:19:52.222961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.414684+0000","last_change":"2023-12-18T10:19:30.013945+0000","last_active":"2023-12-18T10:19:30.414684+0000","last_peered":"2023-12-18T10:19:30.414684+0000","last_clean":"2023-12-18T10:19:30.414684+0000","last_became_active":"2023-12-18T10:19:30.013614+0000","last_became_peered":"2023-12-18T10:19:30.013614+0000","last_unstale":"2023-12-18T10:19:30.414684+0000","last_undegraded":"2023-12-18T10:19:30.414684+0000","last_fullsized":"2023-12-18T10:19:30.414684+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:17.368853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.429357+0000","last_change":"2023-12-18T10:19:30.413847+0000","last_active":"2023-12-18T10:19:30.429357+0000","last_peered":"2023-12-18T10:19:30.429357+0000","last_clean":"2023-12-18T10:19:30.429357+0000","last_became_active":"2023-12-18T10:19:30.413506+0000","last_became_peered":"2023-12-18T10:19:30.413506+0000","last_unstale":"2023-12-18T10:19:30.429357+0000","last_undegraded":"2023-12-18T10:19:30.429357+0000","last_fullsized":"2023-12-18T10:19:30.429357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:11:20.266538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401247+0000","last_change":"2023-12-18T10:19:30.016976+0000","last_active":"2023-12-18T10:19:31.401247+0000","last_peered":"2023-12-18T10:19:31.401247+0000","last_clean":"2023-12-18T10:19:31.401247+0000","last_became_active":"2023-12-18T10:19:30.016589+0000","last_became_peered":"2023-12-18T10:19:30.016589+0000","last_unstale":"2023-12-18T10:19:31.401247+0000","last_undegraded":"2023-12-18T10:19:31.401247+0000","last_fullsized":"2023-12-18T10:19:31.401247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:38:49.823143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401100+0000","last_change":"2023-12-18T10:19:30.414563+0000","last_active":"2023-12-18T10:19:31.401100+0000","last_peered":"2023-12-18T10:19:31.401100+0000","last_clean":"2023-12-18T10:19:31.401100+0000","last_became_active":"2023-12-18T10:19:30.414204+0000","last_became_peered":"2023-12-18T10:19:30.414204+0000","last_unstale":"2023-12-18T10:19:31.401100+0000","last_undegraded":"2023-12-18T10:19:31.401100+0000","last_fullsized":"2023-12-18T10:19:31.401100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:30:35.780905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.421578+0000","last_change":"2023-12-18T10:19:30.015064+0000","last_active":"2023-12-18T10:19:30.421578+0000","last_peered":"2023-12-18T10:19:30.421578+0000","last_clean":"2023-12-18T10:19:30.421578+0000","last_became_active":"2023-12-18T10:19:30.014740+0000","last_became_peered":"2023-12-18T10:19:30.014740+0000","last_unstale":"2023-12-18T10:19:30.421578+0000","last_undegraded":"2023-12-18T10:19:30.421578+0000","last_fullsized":"2023-12-18T10:19:30.421578+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:51.543741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.418486+0000","last_change":"2023-12-18T10:19:30.405231+0000","last_active":"2023-12-18T10:19:30.418486+0000","last_peered":"2023-12-18T10:19:30.418486+0000","last_clean":"2023-12-18T10:19:30.418486+0000","last_became_active":"2023-12-18T10:19:30.404983+0000","last_became_peered":"2023-12-18T10:19:30.404983+0000","last_unstale":"2023-12-18T10:19:30.418486+0000","last_undegraded":"2023-12-18T10:19:30.418486+0000","last_fullsized":"2023-12-18T10:19:30.418486+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:11:12.537073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032716+0000","last_change":"2023-12-18T10:19:30.005923+0000","last_active":"2023-12-18T10:19:32.032716+0000","last_peered":"2023-12-18T10:19:32.032716+0000","last_clean":"2023-12-18T10:19:32.032716+0000","last_became_active":"2023-12-18T10:19:30.005617+0000","last_became_peered":"2023-12-18T10:19:30.005617+0000","last_unstale":"2023-12-18T10:19:32.032716+0000","last_undegraded":"2023-12-18T10:19:32.032716+0000","last_fullsized":"2023-12-18T10:19:32.032716+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:17.368853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032854+0000","last_change":"2023-12-18T10:19:30.404436+0000","last_active":"2023-12-18T10:19:32.032854+0000","last_peered":"2023-12-18T10:19:32.032854+0000","last_clean":"2023-12-18T10:19:32.032854+0000","last_became_active":"2023-12-18T10:19:30.404086+0000","last_became_peered":"2023-12-18T10:19:30.404086+0000","last_unstale":"2023-12-18T10:19:32.032854+0000","last_undegraded":"2023-12-18T10:19:32.032854+0000","last_fullsized":"2023-12-18T10:19:32.032854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:19:52.222961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714102+0000","last_change":"2023-12-18T10:19:30.022059+0000","last_active":"2023-12-18T10:19:31.714102+0000","last_peered":"2023-12-18T10:19:31.714102+0000","last_clean":"2023-12-18T10:19:31.714102+0000","last_became_active":"2023-12-18T10:19:30.021609+0000","last_became_peered":"2023-12-18T10:19:30.021609+0000","last_unstale":"2023-12-18T10:19:31.714102+0000","last_undegraded":"2023-12-18T10:19:31.714102+0000","last_fullsized":"2023-12-18T10:19:31.714102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:44:53.080816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.431988+0000","last_change":"2023-12-18T10:19:30.428549+0000","last_active":"2023-12-18T10:19:30.431988+0000","last_peered":"2023-12-18T10:19:30.431988+0000","last_clean":"2023-12-18T10:19:30.431988+0000","last_became_active":"2023-12-18T10:19:30.428262+0000","last_became_peered":"2023-12-18T10:19:30.428262+0000","last_unstale":"2023-12-18T10:19:30.431988+0000","last_undegraded":"2023-12-18T10:19:30.431988+0000","last_fullsized":"2023-12-18T10:19:30.431988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:00.398251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400393+0000","last_change":"2023-12-18T10:19:30.011932+0000","last_active":"2023-12-18T10:19:31.400393+0000","last_peered":"2023-12-18T10:19:31.400393+0000","last_clean":"2023-12-18T10:19:31.400393+0000","last_became_active":"2023-12-18T10:19:30.011635+0000","last_became_peered":"2023-12-18T10:19:30.011635+0000","last_unstale":"2023-12-18T10:19:31.400393+0000","last_undegraded":"2023-12-18T10:19:31.400393+0000","last_fullsized":"2023-12-18T10:19:31.400393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:06:15.722080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400780+0000","last_change":"2023-12-18T10:19:30.425712+0000","last_active":"2023-12-18T10:19:31.400780+0000","last_peered":"2023-12-18T10:19:31.400780+0000","last_clean":"2023-12-18T10:19:31.400780+0000","last_became_active":"2023-12-18T10:19:30.425388+0000","last_became_peered":"2023-12-18T10:19:30.425388+0000","last_unstale":"2023-12-18T10:19:31.400780+0000","last_undegraded":"2023-12-18T10:19:31.400780+0000","last_fullsized":"2023-12-18T10:19:31.400780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:43:49.033213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.398535+0000","last_change":"2023-12-18T10:19:30.020135+0000","last_active":"2023-12-18T10:19:30.398535+0000","last_peered":"2023-12-18T10:19:30.398535+0000","last_clean":"2023-12-18T10:19:30.398535+0000","last_became_active":"2023-12-18T10:19:30.019261+0000","last_became_peered":"2023-12-18T10:19:30.019261+0000","last_unstale":"2023-12-18T10:19:30.398535+0000","last_undegraded":"2023-12-18T10:19:30.398535+0000","last_fullsized":"2023-12-18T10:19:30.398535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:18:09.425934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677079+0000","last_change":"2023-12-18T10:19:30.408461+0000","last_active":"2023-12-18T10:19:31.677079+0000","last_peered":"2023-12-18T10:19:31.677079+0000","last_clean":"2023-12-18T10:19:31.677079+0000","last_became_active":"2023-12-18T10:19:30.407810+0000","last_became_peered":"2023-12-18T10:19:30.407810+0000","last_unstale":"2023-12-18T10:19:31.677079+0000","last_undegraded":"2023-12-18T10:19:31.677079+0000","last_fullsized":"2023-12-18T10:19:31.677079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:44:54.089740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401182+0000","last_change":"2023-12-18T10:19:30.017533+0000","last_active":"2023-12-18T10:19:31.401182+0000","last_peered":"2023-12-18T10:19:31.401182+0000","last_clean":"2023-12-18T10:19:31.401182+0000","last_became_active":"2023-12-18T10:19:30.017265+0000","last_became_peered":"2023-12-18T10:19:30.017265+0000","last_unstale":"2023-12-18T10:19:31.401182+0000","last_undegraded":"2023-12-18T10:19:31.401182+0000","last_fullsized":"2023-12-18T10:19:31.401182+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:22:03.974805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714403+0000","last_change":"2023-12-18T10:19:30.426723+0000","last_active":"2023-12-18T10:19:31.714403+0000","last_peered":"2023-12-18T10:19:31.714403+0000","last_clean":"2023-12-18T10:19:31.714403+0000","last_became_active":"2023-12-18T10:19:30.426464+0000","last_became_peered":"2023-12-18T10:19:30.426464+0000","last_unstale":"2023-12-18T10:19:31.714403+0000","last_undegraded":"2023-12-18T10:19:31.714403+0000","last_fullsized":"2023-12-18T10:19:31.714403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:30.358527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.033030+0000","last_change":"2023-12-18T10:19:30.014660+0000","last_active":"2023-12-18T10:19:32.033030+0000","last_peered":"2023-12-18T10:19:32.033030+0000","last_clean":"2023-12-18T10:19:32.033030+0000","last_became_active":"2023-12-18T10:19:30.014404+0000","last_became_peered":"2023-12-18T10:19:30.014404+0000","last_unstale":"2023-12-18T10:19:32.033030+0000","last_undegraded":"2023-12-18T10:19:32.033030+0000","last_fullsized":"2023-12-18T10:19:32.033030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:48:01.763457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.427984+0000","last_change":"2023-12-18T10:19:30.424398+0000","last_active":"2023-12-18T10:19:30.427984+0000","last_peered":"2023-12-18T10:19:30.427984+0000","last_clean":"2023-12-18T10:19:30.427984+0000","last_became_active":"2023-12-18T10:19:30.423814+0000","last_became_peered":"2023-12-18T10:19:30.423814+0000","last_unstale":"2023-12-18T10:19:30.427984+0000","last_undegraded":"2023-12-18T10:19:30.427984+0000","last_fullsized":"2023-12-18T10:19:30.427984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:48.326152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032895+0000","last_change":"2023-12-18T10:19:30.021599+0000","last_active":"2023-12-18T10:19:32.032895+0000","last_peered":"2023-12-18T10:19:32.032895+0000","last_clean":"2023-12-18T10:19:32.032895+0000","last_became_active":"2023-12-18T10:19:30.021291+0000","last_became_peered":"2023-12-18T10:19:30.021291+0000","last_unstale":"2023-12-18T10:19:32.032895+0000","last_undegraded":"2023-12-18T10:19:32.032895+0000","last_fullsized":"2023-12-18T10:19:32.032895+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:45.548510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.422384+0000","last_change":"2023-12-18T10:19:30.410750+0000","last_active":"2023-12-18T10:19:30.422384+0000","last_peered":"2023-12-18T10:19:30.422384+0000","last_clean":"2023-12-18T10:19:30.422384+0000","last_became_active":"2023-12-18T10:19:30.410427+0000","last_became_peered":"2023-12-18T10:19:30.410427+0000","last_unstale":"2023-12-18T10:19:30.422384+0000","last_undegraded":"2023-12-18T10:19:30.422384+0000","last_fullsized":"2023-12-18T10:19:30.422384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:23:37.024860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401423+0000","last_change":"2023-12-18T10:19:30.012042+0000","last_active":"2023-12-18T10:19:31.401423+0000","last_peered":"2023-12-18T10:19:31.401423+0000","last_clean":"2023-12-18T10:19:31.401423+0000","last_became_active":"2023-12-18T10:19:30.011666+0000","last_became_peered":"2023-12-18T10:19:30.011666+0000","last_unstale":"2023-12-18T10:19:31.401423+0000","last_undegraded":"2023-12-18T10:19:31.401423+0000","last_fullsized":"2023-12-18T10:19:31.401423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:52.430078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.418505+0000","last_change":"2023-12-18T10:19:30.408414+0000","last_active":"2023-12-18T10:19:30.418505+0000","last_peered":"2023-12-18T10:19:30.418505+0000","last_clean":"2023-12-18T10:19:30.418505+0000","last_became_active":"2023-12-18T10:19:30.408119+0000","last_became_peered":"2023-12-18T10:19:30.408119+0000","last_unstale":"2023-12-18T10:19:30.418505+0000","last_undegraded":"2023-12-18T10:19:30.418505+0000","last_fullsized":"2023-12-18T10:19:30.418505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:34:25.459099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400963+0000","last_change":"2023-12-18T10:19:30.008717+0000","last_active":"2023-12-18T10:19:31.400963+0000","last_peered":"2023-12-18T10:19:31.400963+0000","last_clean":"2023-12-18T10:19:31.400963+0000","last_became_active":"2023-12-18T10:19:30.008195+0000","last_became_peered":"2023-12-18T10:19:30.008195+0000","last_unstale":"2023-12-18T10:19:31.400963+0000","last_undegraded":"2023-12-18T10:19:31.400963+0000","last_fullsized":"2023-12-18T10:19:31.400963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:34:24.450174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400767+0000","last_change":"2023-12-18T10:19:30.415734+0000","last_active":"2023-12-18T10:19:31.400767+0000","last_peered":"2023-12-18T10:19:31.400767+0000","last_clean":"2023-12-18T10:19:31.400767+0000","last_became_active":"2023-12-18T10:19:30.414897+0000","last_became_peered":"2023-12-18T10:19:30.414897+0000","last_unstale":"2023-12-18T10:19:31.400767+0000","last_undegraded":"2023-12-18T10:19:31.400767+0000","last_fullsized":"2023-12-18T10:19:31.400767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:17.473834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400478+0000","last_change":"2023-12-18T10:19:30.015694+0000","last_active":"2023-12-18T10:19:31.400478+0000","last_peered":"2023-12-18T10:19:31.400478+0000","last_clean":"2023-12-18T10:19:31.400478+0000","last_became_active":"2023-12-18T10:19:30.015408+0000","last_became_peered":"2023-12-18T10:19:30.015408+0000","last_unstale":"2023-12-18T10:19:31.400478+0000","last_undegraded":"2023-12-18T10:19:31.400478+0000","last_fullsized":"2023-12-18T10:19:31.400478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:45:17.984194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714075+0000","last_change":"2023-12-18T10:19:30.425278+0000","last_active":"2023-12-18T10:19:31.714075+0000","last_peered":"2023-12-18T10:19:31.714075+0000","last_clean":"2023-12-18T10:19:31.714075+0000","last_became_active":"2023-12-18T10:19:30.424261+0000","last_became_peered":"2023-12-18T10:19:30.424261+0000","last_unstale":"2023-12-18T10:19:31.714075+0000","last_undegraded":"2023-12-18T10:19:31.714075+0000","last_fullsized":"2023-12-18T10:19:31.714075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:24.519539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938479+0000","last_change":"2023-12-18T10:19:30.025243+0000","last_active":"2023-12-18T10:19:31.938479+0000","last_peered":"2023-12-18T10:19:31.938479+0000","last_clean":"2023-12-18T10:19:31.938479+0000","last_became_active":"2023-12-18T10:19:30.024923+0000","last_became_peered":"2023-12-18T10:19:30.024923+0000","last_unstale":"2023-12-18T10:19:31.938479+0000","last_undegraded":"2023-12-18T10:19:31.938479+0000","last_fullsized":"2023-12-18T10:19:31.938479+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:39:11.443832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400872+0000","last_change":"2023-12-18T10:19:30.414172+0000","last_active":"2023-12-18T10:19:31.400872+0000","last_peered":"2023-12-18T10:19:31.400872+0000","last_clean":"2023-12-18T10:19:31.400872+0000","last_became_active":"2023-12-18T10:19:30.413892+0000","last_became_peered":"2023-12-18T10:19:30.413892+0000","last_unstale":"2023-12-18T10:19:31.400872+0000","last_undegraded":"2023-12-18T10:19:31.400872+0000","last_fullsized":"2023-12-18T10:19:31.400872+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:52.552665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714187+0000","last_change":"2023-12-18T10:19:30.021074+0000","last_active":"2023-12-18T10:19:31.714187+0000","last_peered":"2023-12-18T10:19:31.714187+0000","last_clean":"2023-12-18T10:19:31.714187+0000","last_became_active":"2023-12-18T10:19:30.020796+0000","last_became_peered":"2023-12-18T10:19:30.020796+0000","last_unstale":"2023-12-18T10:19:31.714187+0000","last_undegraded":"2023-12-18T10:19:31.714187+0000","last_fullsized":"2023-12-18T10:19:31.714187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:20.675456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401360+0000","last_change":"2023-12-18T10:19:30.415550+0000","last_active":"2023-12-18T10:19:31.401360+0000","last_peered":"2023-12-18T10:19:31.401360+0000","last_clean":"2023-12-18T10:19:31.401360+0000","last_became_active":"2023-12-18T10:19:30.415322+0000","last_became_peered":"2023-12-18T10:19:30.415322+0000","last_unstale":"2023-12-18T10:19:31.401360+0000","last_undegraded":"2023-12-18T10:19:31.401360+0000","last_fullsized":"2023-12-18T10:19:31.401360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:42:57.831301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.033009+0000","last_change":"2023-12-18T10:19:30.015612+0000","last_active":"2023-12-18T10:19:32.033009+0000","last_peered":"2023-12-18T10:19:32.033009+0000","last_clean":"2023-12-18T10:19:32.033009+0000","last_became_active":"2023-12-18T10:19:30.015311+0000","last_became_peered":"2023-12-18T10:19:30.015311+0000","last_unstale":"2023-12-18T10:19:32.033009+0000","last_undegraded":"2023-12-18T10:19:32.033009+0000","last_fullsized":"2023-12-18T10:19:32.033009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:44:53.080816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032791+0000","last_change":"2023-12-18T10:19:30.417544+0000","last_active":"2023-12-18T10:19:32.032791+0000","last_peered":"2023-12-18T10:19:32.032791+0000","last_clean":"2023-12-18T10:19:32.032791+0000","last_became_active":"2023-12-18T10:19:30.411570+0000","last_became_peered":"2023-12-18T10:19:30.411570+0000","last_unstale":"2023-12-18T10:19:32.032791+0000","last_undegraded":"2023-12-18T10:19:32.032791+0000","last_fullsized":"2023-12-18T10:19:32.032791+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:08:20.316469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.430720+0000","last_change":"2023-12-18T10:19:30.011948+0000","last_active":"2023-12-18T10:19:30.430720+0000","last_peered":"2023-12-18T10:19:30.430720+0000","last_clean":"2023-12-18T10:19:30.430720+0000","last_became_active":"2023-12-18T10:19:30.011329+0000","last_became_peered":"2023-12-18T10:19:30.011329+0000","last_unstale":"2023-12-18T10:19:30.430720+0000","last_undegraded":"2023-12-18T10:19:30.430720+0000","last_fullsized":"2023-12-18T10:19:30.430720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:29:58.661037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.422389+0000","last_change":"2023-12-18T10:19:30.411492+0000","last_active":"2023-12-18T10:19:30.422389+0000","last_peered":"2023-12-18T10:19:30.422389+0000","last_clean":"2023-12-18T10:19:30.422389+0000","last_became_active":"2023-12-18T10:19:30.411180+0000","last_became_peered":"2023-12-18T10:19:30.411180+0000","last_unstale":"2023-12-18T10:19:30.422389+0000","last_undegraded":"2023-12-18T10:19:30.422389+0000","last_fullsized":"2023-12-18T10:19:30.422389+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:30:54.345168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677145+0000","last_change":"2023-12-18T10:19:30.013139+0000","last_active":"2023-12-18T10:19:31.677145+0000","last_peered":"2023-12-18T10:19:31.677145+0000","last_clean":"2023-12-18T10:19:31.677145+0000","last_became_active":"2023-12-18T10:19:30.012952+0000","last_became_peered":"2023-12-18T10:19:30.012952+0000","last_unstale":"2023-12-18T10:19:31.677145+0000","last_undegraded":"2023-12-18T10:19:31.677145+0000","last_fullsized":"2023-12-18T10:19:31.677145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:45:54.854750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677178+0000","last_change":"2023-12-18T10:19:30.417293+0000","last_active":"2023-12-18T10:19:31.677178+0000","last_peered":"2023-12-18T10:19:31.677178+0000","last_clean":"2023-12-18T10:19:31.677178+0000","last_became_active":"2023-12-18T10:19:30.417123+0000","last_became_peered":"2023-12-18T10:19:30.417123+0000","last_unstale":"2023-12-18T10:19:31.677178+0000","last_undegraded":"2023-12-18T10:19:31.677178+0000","last_fullsized":"2023-12-18T10:19:31.677178+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:58:25.279015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400623+0000","last_change":"2023-12-18T10:19:30.014584+0000","last_active":"2023-12-18T10:19:31.400623+0000","last_peered":"2023-12-18T10:19:31.400623+0000","last_clean":"2023-12-18T10:19:31.400623+0000","last_became_active":"2023-12-18T10:19:30.014248+0000","last_became_peered":"2023-12-18T10:19:30.014248+0000","last_unstale":"2023-12-18T10:19:31.400623+0000","last_undegraded":"2023-12-18T10:19:31.400623+0000","last_fullsized":"2023-12-18T10:19:31.400623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:25.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714216+0000","last_change":"2023-12-18T10:19:30.425042+0000","last_active":"2023-12-18T10:19:31.714216+0000","last_peered":"2023-12-18T10:19:31.714216+0000","last_clean":"2023-12-18T10:19:31.714216+0000","last_became_active":"2023-12-18T10:19:30.424731+0000","last_became_peered":"2023-12-18T10:19:30.424731+0000","last_unstale":"2023-12-18T10:19:31.714216+0000","last_undegraded":"2023-12-18T10:19:31.714216+0000","last_fullsized":"2023-12-18T10:19:31.714216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:53.439003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676985+0000","last_change":"2023-12-18T10:19:30.004776+0000","last_active":"2023-12-18T10:19:31.676985+0000","last_peered":"2023-12-18T10:19:31.676985+0000","last_clean":"2023-12-18T10:19:31.676985+0000","last_became_active":"2023-12-18T10:19:30.004462+0000","last_became_peered":"2023-12-18T10:19:30.004462+0000","last_unstale":"2023-12-18T10:19:31.676985+0000","last_undegraded":"2023-12-18T10:19:31.676985+0000","last_fullsized":"2023-12-18T10:19:31.676985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:04:43.870339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.434808+0000","last_change":"2023-12-18T10:19:30.434069+0000","last_active":"2023-12-18T10:19:30.434808+0000","last_peered":"2023-12-18T10:19:30.434808+0000","last_clean":"2023-12-18T10:19:30.434808+0000","last_became_active":"2023-12-18T10:19:30.433834+0000","last_became_peered":"2023-12-18T10:19:30.433834+0000","last_unstale":"2023-12-18T10:19:30.434808+0000","last_undegraded":"2023-12-18T10:19:30.434808+0000","last_fullsized":"2023-12-18T10:19:30.434808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:22:04.983729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676912+0000","last_change":"2023-12-18T10:19:30.015431+0000","last_active":"2023-12-18T10:19:31.676912+0000","last_peered":"2023-12-18T10:19:31.676912+0000","last_clean":"2023-12-18T10:19:31.676912+0000","last_became_active":"2023-12-18T10:19:30.015155+0000","last_became_peered":"2023-12-18T10:19:30.015155+0000","last_unstale":"2023-12-18T10:19:31.676912+0000","last_undegraded":"2023-12-18T10:19:31.676912+0000","last_fullsized":"2023-12-18T10:19:31.676912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:07:46.795842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032599+0000","last_change":"2023-12-18T10:19:30.416980+0000","last_active":"2023-12-18T10:19:32.032599+0000","last_peered":"2023-12-18T10:19:32.032599+0000","last_clean":"2023-12-18T10:19:32.032599+0000","last_became_active":"2023-12-18T10:19:30.416501+0000","last_became_peered":"2023-12-18T10:19:30.416501+0000","last_unstale":"2023-12-18T10:19:32.032599+0000","last_undegraded":"2023-12-18T10:19:32.032599+0000","last_fullsized":"2023-12-18T10:19:32.032599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:18:10.434859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714184+0000","last_change":"2023-12-18T10:19:30.020580+0000","last_active":"2023-12-18T10:19:31.714184+0000","last_peered":"2023-12-18T10:19:31.714184+0000","last_clean":"2023-12-18T10:19:31.714184+0000","last_became_active":"2023-12-18T10:19:30.020287+0000","last_became_peered":"2023-12-18T10:19:30.020287+0000","last_unstale":"2023-12-18T10:19:31.714184+0000","last_undegraded":"2023-12-18T10:19:31.714184+0000","last_fullsized":"2023-12-18T10:19:31.714184+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:17.368853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401201+0000","last_change":"2023-12-18T10:19:30.425583+0000","last_active":"2023-12-18T10:19:31.401201+0000","last_peered":"2023-12-18T10:19:31.401201+0000","last_clean":"2023-12-18T10:19:31.401201+0000","last_became_active":"2023-12-18T10:19:30.425079+0000","last_became_peered":"2023-12-18T10:19:30.425079+0000","last_unstale":"2023-12-18T10:19:31.401201+0000","last_undegraded":"2023-12-18T10:19:31.401201+0000","last_fullsized":"2023-12-18T10:19:31.401201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:15:16.244124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.676904+0000","last_change":"2023-12-18T10:19:30.002240+0000","last_active":"2023-12-18T10:19:31.676904+0000","last_peered":"2023-12-18T10:19:31.676904+0000","last_clean":"2023-12-18T10:19:31.676904+0000","last_became_active":"2023-12-18T10:19:30.002001+0000","last_became_peered":"2023-12-18T10:19:30.002001+0000","last_unstale":"2023-12-18T10:19:31.676904+0000","last_undegraded":"2023-12-18T10:19:31.676904+0000","last_fullsized":"2023-12-18T10:19:31.676904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:08:36.527712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400542+0000","last_change":"2023-12-18T10:19:30.421695+0000","last_active":"2023-12-18T10:19:31.400542+0000","last_peered":"2023-12-18T10:19:31.400542+0000","last_clean":"2023-12-18T10:19:31.400542+0000","last_became_active":"2023-12-18T10:19:30.421391+0000","last_became_peered":"2023-12-18T10:19:30.421391+0000","last_unstale":"2023-12-18T10:19:31.400542+0000","last_undegraded":"2023-12-18T10:19:31.400542+0000","last_fullsized":"2023-12-18T10:19:31.400542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:11:12.537073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.033056+0000","last_change":"2023-12-18T10:19:30.021462+0000","last_active":"2023-12-18T10:19:32.033056+0000","last_peered":"2023-12-18T10:19:32.033056+0000","last_clean":"2023-12-18T10:19:32.033056+0000","last_became_active":"2023-12-18T10:19:30.021178+0000","last_became_peered":"2023-12-18T10:19:30.021178+0000","last_unstale":"2023-12-18T10:19:32.033056+0000","last_undegraded":"2023-12-18T10:19:32.033056+0000","last_fullsized":"2023-12-18T10:19:32.033056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:20.675456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714376+0000","last_change":"2023-12-18T10:19:30.427248+0000","last_active":"2023-12-18T10:19:31.714376+0000","last_peered":"2023-12-18T10:19:31.714376+0000","last_clean":"2023-12-18T10:19:31.714376+0000","last_became_active":"2023-12-18T10:19:30.426922+0000","last_became_peered":"2023-12-18T10:19:30.426922+0000","last_unstale":"2023-12-18T10:19:31.714376+0000","last_undegraded":"2023-12-18T10:19:31.714376+0000","last_fullsized":"2023-12-18T10:19:31.714376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:19:52.222961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.677179+0000","last_change":"2023-12-18T10:19:30.009444+0000","last_active":"2023-12-18T10:19:31.677179+0000","last_peered":"2023-12-18T10:19:31.677179+0000","last_clean":"2023-12-18T10:19:31.677179+0000","last_became_active":"2023-12-18T10:19:30.009153+0000","last_became_peered":"2023-12-18T10:19:30.009153+0000","last_unstale":"2023-12-18T10:19:31.677179+0000","last_undegraded":"2023-12-18T10:19:31.677179+0000","last_fullsized":"2023-12-18T10:19:31.677179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:01:32.871177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.401127+0000","last_change":"2023-12-18T10:19:30.414218+0000","last_active":"2023-12-18T10:19:31.401127+0000","last_peered":"2023-12-18T10:19:31.401127+0000","last_clean":"2023-12-18T10:19:31.401127+0000","last_became_active":"2023-12-18T10:19:30.413947+0000","last_became_peered":"2023-12-18T10:19:30.413947+0000","last_unstale":"2023-12-18T10:19:31.401127+0000","last_undegraded":"2023-12-18T10:19:31.401127+0000","last_fullsized":"2023-12-18T10:19:31.401127+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:59:44.253773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.394166+0000","last_change":"2023-12-18T10:19:30.020761+0000","last_active":"2023-12-18T10:19:30.394166+0000","last_peered":"2023-12-18T10:19:30.394166+0000","last_clean":"2023-12-18T10:19:30.394166+0000","last_became_active":"2023-12-18T10:19:30.020478+0000","last_became_peered":"2023-12-18T10:19:30.020478+0000","last_unstale":"2023-12-18T10:19:30.394166+0000","last_undegraded":"2023-12-18T10:19:30.394166+0000","last_fullsized":"2023-12-18T10:19:30.394166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:28:20.675456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.419570+0000","last_change":"2023-12-18T10:19:30.415951+0000","last_active":"2023-12-18T10:19:30.419570+0000","last_peered":"2023-12-18T10:19:30.419570+0000","last_clean":"2023-12-18T10:19:30.419570+0000","last_became_active":"2023-12-18T10:19:30.415665+0000","last_became_peered":"2023-12-18T10:19:30.415665+0000","last_unstale":"2023-12-18T10:19:30.419570+0000","last_undegraded":"2023-12-18T10:19:30.419570+0000","last_fullsized":"2023-12-18T10:19:30.419570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:52:59.703706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.393961+0000","last_change":"2023-12-18T10:19:30.016174+0000","last_active":"2023-12-18T10:19:30.393961+0000","last_peered":"2023-12-18T10:19:30.393961+0000","last_clean":"2023-12-18T10:19:30.393961+0000","last_became_active":"2023-12-18T10:19:30.015875+0000","last_became_peered":"2023-12-18T10:19:30.015875+0000","last_unstale":"2023-12-18T10:19:30.393961+0000","last_undegraded":"2023-12-18T10:19:30.393961+0000","last_fullsized":"2023-12-18T10:19:30.393961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:45.548510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400422+0000","last_change":"2023-12-18T10:19:30.406948+0000","last_active":"2023-12-18T10:19:31.400422+0000","last_peered":"2023-12-18T10:19:31.400422+0000","last_clean":"2023-12-18T10:19:31.400422+0000","last_became_active":"2023-12-18T10:19:30.406658+0000","last_became_peered":"2023-12-18T10:19:30.406658+0000","last_unstale":"2023-12-18T10:19:31.400422+0000","last_undegraded":"2023-12-18T10:19:31.400422+0000","last_fullsized":"2023-12-18T10:19:31.400422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:40.480038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.938546+0000","last_change":"2023-12-18T10:19:30.017575+0000","last_active":"2023-12-18T10:19:31.938546+0000","last_peered":"2023-12-18T10:19:31.938546+0000","last_clean":"2023-12-18T10:19:31.938546+0000","last_became_active":"2023-12-18T10:19:30.017311+0000","last_became_peered":"2023-12-18T10:19:30.017311+0000","last_unstale":"2023-12-18T10:19:31.938546+0000","last_undegraded":"2023-12-18T10:19:31.938546+0000","last_fullsized":"2023-12-18T10:19:31.938546+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:45:54.854750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.431973+0000","last_change":"2023-12-18T10:19:30.422770+0000","last_active":"2023-12-18T10:19:30.431973+0000","last_peered":"2023-12-18T10:19:30.431973+0000","last_clean":"2023-12-18T10:19:30.431973+0000","last_became_active":"2023-12-18T10:19:30.422459+0000","last_became_peered":"2023-12-18T10:19:30.422459+0000","last_unstale":"2023-12-18T10:19:30.431973+0000","last_undegraded":"2023-12-18T10:19:30.431973+0000","last_fullsized":"2023-12-18T10:19:30.431973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:56:24.790752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.399559+0000","last_change":"2023-12-18T10:19:30.012623+0000","last_active":"2023-12-18T10:19:30.399559+0000","last_peered":"2023-12-18T10:19:30.399559+0000","last_clean":"2023-12-18T10:19:30.399559+0000","last_became_active":"2023-12-18T10:19:30.012273+0000","last_became_peered":"2023-12-18T10:19:30.012273+0000","last_unstale":"2023-12-18T10:19:30.399559+0000","last_undegraded":"2023-12-18T10:19:30.399559+0000","last_fullsized":"2023-12-18T10:19:30.399559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:58:16.464910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.715042+0000","last_change":"2023-12-18T10:19:30.424371+0000","last_active":"2023-12-18T10:19:31.715042+0000","last_peered":"2023-12-18T10:19:31.715042+0000","last_clean":"2023-12-18T10:19:31.715042+0000","last_became_active":"2023-12-18T10:19:30.424026+0000","last_became_peered":"2023-12-18T10:19:30.424026+0000","last_unstale":"2023-12-18T10:19:31.715042+0000","last_undegraded":"2023-12-18T10:19:31.715042+0000","last_fullsized":"2023-12-18T10:19:31.715042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:38:14.599677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.400720+0000","last_change":"2023-12-18T10:19:30.010994+0000","last_active":"2023-12-18T10:19:31.400720+0000","last_peered":"2023-12-18T10:19:31.400720+0000","last_clean":"2023-12-18T10:19:31.400720+0000","last_became_active":"2023-12-18T10:19:30.010722+0000","last_became_peered":"2023-12-18T10:19:30.010722+0000","last_unstale":"2023-12-18T10:19:31.400720+0000","last_undegraded":"2023-12-18T10:19:31.400720+0000","last_fullsized":"2023-12-18T10:19:31.400720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:51:02.647635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:32.032933+0000","last_change":"2023-12-18T10:19:30.419334+0000","last_active":"2023-12-18T10:19:32.032933+0000","last_peered":"2023-12-18T10:19:32.032933+0000","last_clean":"2023-12-18T10:19:32.032933+0000","last_became_active":"2023-12-18T10:19:30.419061+0000","last_became_peered":"2023-12-18T10:19:30.419061+0000","last_unstale":"2023-12-18T10:19:32.032933+0000","last_undegraded":"2023-12-18T10:19:32.032933+0000","last_fullsized":"2023-12-18T10:19:32.032933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:29.983292+0000","last_clean_scrub_stamp":"2023-12-18T10:19:29.983292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:37:48.326152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-18T10:19:31.714411+0000","last_change":"2023-12-18T10:19:30.018030+0000","last_active":"2023-12-18T10:19:31.714411+0000","last_peered":"2023-12-18T10:19:31.714411+0000","last_clean":"2023-12-18T10:19:31.714411+0000","last_became_active":"2023-12-18T10:19:30.017744+0000","last_became_peered":"2023-12-18T10:19:30.017744+0000","last_unstale":"2023-12-18T10:19:31.714411+0000","last_undegraded":"2023-12-18T10:19:31.714411+0000","last_fullsized":"2023-12-18T10:19:31.714411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:19:28.974368+0000","last_clean_scrub_stamp":"2023-12-18T10:19:28.974368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:04:45.548510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-18T10:19:30.416878+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:19:30.416878+0000","last_peered":"2023-12-18T10:19:30.416878+0000","last_clean":"2023-12-18T10:19:30.416878+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:19:30.416878+0000","last_undegraded":"2023-12-18T10:19:30.416878+0000","last_fullsized":"2023-12-18T10:19:30.416878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":786109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64700000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.625}]},{"osd":2,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.77700000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68200000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.72099999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":4.3760000000000003,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.73199999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.751},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":4.524,"5min":4.524,"15min":4.524},"last":0.77600000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.80900000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.3079999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.82299999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.623}]},{"osd":5,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.70599999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.79200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":194219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.497},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.7949999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.83999999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.2730000000000001,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.61799999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":8.9740000000000002,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.9060000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.79900000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.88700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":188091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.72299999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.749}]},{"osd":3,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.628}]},{"osd":5,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.52800000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":195705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.754}]},{"osd":5,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.82399999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.85699999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.80800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.39500000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.372},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.432},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.51900000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":3.976,"5min":3.976,"15min":3.976},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.498}]},{"osd":3,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.6400000000000001,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.2440000000000002,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":4.1859999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.70999999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.748},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":4.3529999999999998,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.77600000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":1036288,"data_stored":777889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.34599999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":0.39900000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.308},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.443}]},{"osd":4,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.63900000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:19:34.831 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-18T10:19:34.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-18T10:19:35.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7bcd1640 1 Processor -- start 2023-12-18T10:19:35.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7bcd1640 1 -- start start 2023-12-18T10:19:35.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7bcd1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdd7415ca20 0x7fdd740d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7bcd1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd740cdf60 0x7fdd740d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7bcd1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd740d15d0 0x7fdd740cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7bcd1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7415ce00 con 0x7fdd740cdf60 2023-12-18T10:19:35.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7bcd1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd740d0360 con 0x7fdd7415ca20 2023-12-18T10:19:35.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7bcd1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740d0c00 con 0x7fdd740d15d0 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7926c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd740cdf60 0x7fdd740d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7926c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd740cdf60 0x7fdd740d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59852/0 (socket says 172.21.15.133:59852) 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7926c640 1 -- 172.21.15.133:0/2150624437 learned_addr learned my addr 172.21.15.133:0/2150624437 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd79a6d640 1 --2- 172.21.15.133:0/2150624437 >> v2:172.21.15.142:3300/0 conn(0x7fdd7415ca20 0x7fdd740d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7a26e640 1 --2- 172.21.15.133:0/2150624437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd740d15d0 0x7fdd740cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7926c640 1 -- 172.21.15.133:0/2150624437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd740d15d0 msgr2=0x7fdd740cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7926c640 1 --2- 172.21.15.133:0/2150624437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd740d15d0 0x7fdd740cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7926c640 1 -- 172.21.15.133:0/2150624437 >> v2:172.21.15.142:3300/0 conn(0x7fdd7415ca20 msgr2=0x7fdd740d32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7926c640 1 --2- 172.21.15.133:0/2150624437 >> v2:172.21.15.142:3300/0 conn(0x7fdd7415ca20 0x7fdd740d32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd7926c640 1 -- 172.21.15.133:0/2150624437 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740ce6d0 con 0x7fdd740cdf60 2023-12-18T10:19:35.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.017+0000 7fdd79a6d640 1 --2- 172.21.15.133:0/2150624437 >> v2:172.21.15.142:3300/0 conn(0x7fdd7415ca20 0x7fdd740d32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:35.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7926c640 1 --2- 172.21.15.133:0/2150624437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd740d1090 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdd740c5ea0 tx=0x7fdd6401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee0773e29e99005 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:35.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd78a6b640 1 -- 172.21.15.133:0/2150624437 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd640ac640 con 0x7fdd740cdf60 2023-12-18T10:19:35.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd78a6b640 1 -- 172.21.15.133:0/2150624437 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd640ac7a0 con 0x7fdd740cdf60 2023-12-18T10:19:35.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd78a6b640 1 -- 172.21.15.133:0/2150624437 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd640acb30 con 0x7fdd740cdf60 2023-12-18T10:19:35.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2150624437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 msgr2=0x7fdd740d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2150624437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd740d1090 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdd740c5ea0 tx=0x7fdd6401c440 comp rx=0 tx=0).stop 2023-12-18T10:19:35.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2150624437 shutdown_connections 2023-12-18T10:19:35.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2150624437 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd740d15d0 0x7fdd740cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2150624437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd740d1090 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2150624437 >> v2:172.21.15.142:3300/0 conn(0x7fdd7415ca20 0x7fdd740d32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2150624437 >> 172.21.15.133:0/2150624437 conn(0x7fdd74089fb0 msgr2=0x7fdd740d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:35.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2150624437 shutdown_connections 2023-12-18T10:19:35.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.021+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2150624437 wait complete. 2023-12-18T10:19:35.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 Processor -- start 2023-12-18T10:19:35.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 -- start start 2023-12-18T10:19:35.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd74160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd7415ca20 0x7fdd740b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd740b5860 0x7fdd7415ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7415fa10 con 0x7fdd740cdf60 2023-12-18T10:19:35.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7415fcf0 con 0x7fdd740b5860 2023-12-18T10:19:35.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740ca910 con 0x7fdd7415ca20 2023-12-18T10:19:35.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd74160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd74160c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59868/0 (socket says 172.21.15.133:59868) 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 -- 172.21.15.133:0/2279387320 learned_addr learned my addr 172.21.15.133:0/2279387320 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7a26e640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd740b5860 0x7fdd7415ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7926c640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd7415ca20 0x7fdd740b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 -- 172.21.15.133:0/2279387320 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd7415ca20 msgr2=0x7fdd740b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd7415ca20 0x7fdd740b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 -- 172.21.15.133:0/2279387320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd740b5860 msgr2=0x7fdd7415ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd740b5860 0x7fdd7415ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 -- 172.21.15.133:0/2279387320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640094d0 con 0x7fdd740cdf60 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd79a6d640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd74160c30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000d7d0 tx=0x7fdd7000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd6a7fc640 1 -- 172.21.15.133:0/2279387320 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd700059a0 con 0x7fdd740cdf60 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd6a7fc640 1 -- 172.21.15.133:0/2279387320 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70005b00 con 0x7fdd740cdf60 2023-12-18T10:19:35.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd6a7fc640 1 -- 172.21.15.133:0/2279387320 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70005e90 con 0x7fdd740cdf60 2023-12-18T10:19:35.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd740cabf0 con 0x7fdd740cdf60 2023-12-18T10:19:35.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd74154ec0 con 0x7fdd740cdf60 2023-12-18T10:19:35.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.025+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7404e000 con 0x7fdd740cdf60 2023-12-18T10:19:35.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.029+0000 7fdd6a7fc640 1 -- 172.21.15.133:0/2279387320 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdd70004030 con 0x7fdd740cdf60 2023-12-18T10:19:35.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.029+0000 7fdd6a7fc640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdd58065a60 0x7fdd58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.029+0000 7fdd6a7fc640 1 -- 172.21.15.133:0/2279387320 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdd70083140 con 0x7fdd740cdf60 2023-12-18T10:19:35.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.029+0000 7fdd7926c640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdd58065a60 0x7fdd58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.029+0000 7fdd7926c640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdd58065a60 0x7fdd58067f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd640ae000 tx=0x7fdd64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:35.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.033+0000 7fdd6a7fc640 1 -- 172.21.15.133:0/2279387320 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdd70050a60 con 0x7fdd740cdf60 2023-12-18T10:19:35.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.237+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdd740cfe10 con 0x7fdd740cdf60 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd6a7fc640 1 -- 172.21.15.133:0/2279387320 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdd70054080 con 0x7fdd740cdf60 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdd58065a60 msgr2=0x7fdd58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdd58065a60 0x7fdd58067f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd640ae000 tx=0x7fdd64008040 comp rx=0 tx=0).stop 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 msgr2=0x7fdd74160c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd74160c30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000d7d0 tx=0x7fdd7000dc90 comp rx=0 tx=0).stop 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 shutdown_connections 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdd58065a60 0x7fdd58067f20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd740b5860 0x7fdd7415ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdd7415ca20 0x7fdd740b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 --2- 172.21.15.133:0/2279387320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd740cdf60 0x7fdd74160c30 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 >> 172.21.15.133:0/2279387320 conn(0x7fdd74089fb0 msgr2=0x7fdd740b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:35.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 shutdown_connections 2023-12-18T10:19:35.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.245+0000 7fdd7bcd1640 1 -- 172.21.15.133:0/2279387320 wait complete. 2023-12-18T10:19:35.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:35.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.401+0000 7f676737b640 1 Processor -- start 2023-12-18T10:19:35.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.401+0000 7f676737b640 1 -- start start 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.401+0000 7f676737b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6760160cc0 0x7f67600cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.401+0000 7f676737b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67600c1280 0x7f67600cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f676737b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676006fdb0 con 0x7f67600c17d0 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f676737b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67601654a0 con 0x7f67600c1280 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f676737b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67601610a0 con 0x7f6760160cc0 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6764916640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67600c1280 0x7f67600cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6764916640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67600c1280 0x7f67600cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59878/0 (socket says 172.21.15.133:59878) 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6764916640 1 -- 172.21.15.133:0/4057454186 learned_addr learned my addr 172.21.15.133:0/4057454186 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6765117640 1 --2- 172.21.15.133:0/4057454186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6760160cc0 0x7f67600cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6764916640 1 -- 172.21.15.133:0/4057454186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6760160cc0 msgr2=0x7f67600cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6764916640 1 --2- 172.21.15.133:0/4057454186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6760160cc0 0x7f67600cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6764916640 1 -- 172.21.15.133:0/4057454186 >> v1:172.21.15.142:6789/0 conn(0x7f67600c17d0 legacy=0x7f676006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6764916640 1 -- 172.21.15.133:0/4057454186 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67600cb6b0 con 0x7f67600c1280 2023-12-18T10:19:35.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6764916640 1 --2- 172.21.15.133:0/4057454186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f67600cb170 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f67500098a0 tx=0x7f675001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bde3e1f482ea78 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:35.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6757fff640 1 -- 172.21.15.133:0/4057454186 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500ac600 con 0x7f67600c1280 2023-12-18T10:19:35.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6757fff640 1 -- 172.21.15.133:0/4057454186 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67500a8050 con 0x7f67600c1280 2023-12-18T10:19:35.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.405+0000 7f6757fff640 1 -- 172.21.15.133:0/4057454186 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500ac980 con 0x7f67600c1280 2023-12-18T10:19:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- 172.21.15.133:0/4057454186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 msgr2=0x7f67600cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 --2- 172.21.15.133:0/4057454186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f67600cb170 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f67500098a0 tx=0x7f675001c460 comp rx=0 tx=0).stop 2023-12-18T10:19:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- 172.21.15.133:0/4057454186 shutdown_connections 2023-12-18T10:19:35.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 --2- 172.21.15.133:0/4057454186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f67600cb170 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 --2- 172.21.15.133:0/4057454186 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6760160cc0 0x7f67600cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- 172.21.15.133:0/4057454186 >> 172.21.15.133:0/4057454186 conn(0x7f676006a3e0 msgr2=0x7f67600afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- 172.21.15.133:0/4057454186 shutdown_connections 2023-12-18T10:19:35.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- 172.21.15.133:0/4057454186 wait complete. 2023-12-18T10:19:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 Processor -- start 2023-12-18T10:19:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- start start 2023-12-18T10:19:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f6760153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67600c17d0 0x7f67600c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6760160cc0 0x7f67600b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760154190 con 0x7f67600c1280 2023-12-18T10:19:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760154ff0 con 0x7f6760160cc0 2023-12-18T10:19:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f676737b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6760155a10 con 0x7f67600c17d0 2023-12-18T10:19:35.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f6765117640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f6760153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f6765117640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f6760153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59880/0 (socket says 172.21.15.133:59880) 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f6765117640 1 -- 172.21.15.133:0/4020714630 learned_addr learned my addr 172.21.15.133:0/4020714630 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.409+0000 7f6764916640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67600c17d0 0x7f67600c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6765918640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6760160cc0 0x7f67600b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6765117640 1 -- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67600c17d0 msgr2=0x7f67600c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6765117640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67600c17d0 0x7f67600c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6765117640 1 -- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6760160cc0 msgr2=0x7f67600b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6765117640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6760160cc0 0x7f67600b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6765117640 1 -- 172.21.15.133:0/4020714630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500094d0 con 0x7f67600c1280 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6765918640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6760160cc0 0x7f67600b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6765117640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f6760153a60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f675c00d620 tx=0x7f675c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6755ffb640 1 -- 172.21.15.133:0/4020714630 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00b620 con 0x7f67600c1280 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6755ffb640 1 -- 172.21.15.133:0/4020714630 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c00b780 con 0x7f67600c1280 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6760153fa0 con 0x7f67600c1280 2023-12-18T10:19:35.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6755ffb640 1 -- 172.21.15.133:0/4020714630 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00bb10 con 0x7f67600c1280 2023-12-18T10:19:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67601546c0 con 0x7f67600c1280 2023-12-18T10:19:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67600735b0 con 0x7f67600c1280 2023-12-18T10:19:35.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6755ffb640 1 -- 172.21.15.133:0/4020714630 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f675c00bc70 con 0x7f67600c1280 2023-12-18T10:19:35.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6755ffb640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6744065a60 0x7f6744067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:35.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6755ffb640 1 -- 172.21.15.133:0/4020714630 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f675c083750 con 0x7f67600c1280 2023-12-18T10:19:35.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.413+0000 7f6764916640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6744065a60 0x7f6744067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:35.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.417+0000 7f6764916640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6744065a60 0x7f6744067f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f67500ae000 tx=0x7f67500a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:35.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.417+0000 7f6755ffb640 1 -- 172.21.15.133:0/4020714630 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f675c050fd0 con 0x7f67600c1280 2023-12-18T10:19:35.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f676004e000 con 0x7f67600c1280 2023-12-18T10:19:35.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f6755ffb640 1 -- 172.21.15.133:0/4020714630 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f675c0545f0 con 0x7f67600c1280 2023-12-18T10:19:35.604 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:35.604 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:33.397943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:19:35.604 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 17 2023-12-18T10:19:35.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6744065a60 msgr2=0x7f6744067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6744065a60 0x7f6744067f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f67500ae000 tx=0x7f67500a7000 comp rx=0 tx=0).stop 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 msgr2=0x7f6760153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f6760153a60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f675c00d620 tx=0x7f675c00dae0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 shutdown_connections 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6744065a60 0x7f6744067f20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6760160cc0 0x7f67600b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67600c17d0 0x7f67600c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 --2- 172.21.15.133:0/4020714630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67600c1280 0x7f6760153a60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 >> 172.21.15.133:0/4020714630 conn(0x7f676006a3e0 msgr2=0x7f67600705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 shutdown_connections 2023-12-18T10:19:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:35.601+0000 7f676737b640 1 -- 172.21.15.133:0/4020714630 wait complete. 2023-12-18T10:19:36.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:19:30.380308+0000', 'modified': '2023-12-18T10:19:33.397943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5508': {'gid': 5508, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/979808628', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 979808628}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 979808628}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:19:36.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-18T10:19:36.027 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-18T10:19:36.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2f197b640 1 Processor -- start 2023-12-18T10:19:36.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2f197b640 1 -- start start 2023-12-18T10:19:36.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2f197b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2ec06c4f0 0x7fd2ec0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2f197b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0c9e30 0x7fd2ec070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2f197b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec0c9460 con 0x7fd2ec1570c0 2023-12-18T10:19:36.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2f197b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec1574a0 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2f197b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c8b30 con 0x7fd2ec0c9e30 2023-12-18T10:19:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2e27fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2ec06c4f0 0x7fd2ec0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0c9e30 0x7fd2ec070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2eaffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd2ec1570c0 0x7fd2ec06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:54900/0 (socket says 172.21.15.133:54900) 2023-12-18T10:19:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2e27fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2ec06c4f0 0x7fd2ec0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:33772/0 (socket says 172.21.15.133:33772) 2023-12-18T10:19:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2eaffd640 1 -- 172.21.15.133:0/2991993327 learned_addr learned my addr 172.21.15.133:0/2991993327 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/2991993327 >> v2:172.21.15.142:3300/0 conn(0x7fd2ec06c4f0 msgr2=0x7fd2ec0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/2991993327 >> v2:172.21.15.142:3300/0 conn(0x7fd2ec06c4f0 0x7fd2ec0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/2991993327 >> v1:172.21.15.142:6789/0 conn(0x7fd2ec1570c0 legacy=0x7fd2ec06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/2991993327 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0c8e10 con 0x7fd2ec0c9e30 2023-12-18T10:19:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/2991993327 >> v2:172.21.15.142:3300/0 conn(0x7fd2ec06c4f0 0x7fd2ec0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.165+0000 7fd2ea7fc640 1 -- 172.21.15.133:0/2991993327 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031606438 0 0) 0x7fd2ec0c9460 con 0x7fd2ec1570c0 2023-12-18T10:19:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.169+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/2991993327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0c9e30 0x7fd2ec070df0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097c0 tx=0x7fd2e401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5adfee48dbab9fea server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.169+0000 7fd2ea7fc640 1 -- 172.21.15.133:0/2991993327 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40ab680 con 0x7fd2ec0c9e30 2023-12-18T10:19:36.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.169+0000 7fd2ea7fc640 1 -- 172.21.15.133:0/2991993327 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e40ab7e0 con 0x7fd2ec0c9e30 2023-12-18T10:19:36.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.169+0000 7fd2ea7fc640 1 -- 172.21.15.133:0/2991993327 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40abb70 con 0x7fd2ec0c9e30 2023-12-18T10:19:36.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.169+0000 7fd2f197b640 1 -- 172.21.15.133:0/2991993327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0c9e30 msgr2=0x7fd2ec070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.169+0000 7fd2f197b640 1 --2- 172.21.15.133:0/2991993327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0c9e30 0x7fd2ec070df0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097c0 tx=0x7fd2e401c480 comp rx=0 tx=0).stop 2023-12-18T10:19:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 -- 172.21.15.133:0/2991993327 shutdown_connections 2023-12-18T10:19:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 --2- 172.21.15.133:0/2991993327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec0c9e30 0x7fd2ec070df0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 --2- 172.21.15.133:0/2991993327 >> v2:172.21.15.142:3300/0 conn(0x7fd2ec06c4f0 0x7fd2ec0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 -- 172.21.15.133:0/2991993327 >> 172.21.15.133:0/2991993327 conn(0x7fd2ec06a3e0 msgr2=0x7fd2ec0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 -- 172.21.15.133:0/2991993327 shutdown_connections 2023-12-18T10:19:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 -- 172.21.15.133:0/2991993327 wait complete. 2023-12-18T10:19:36.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 Processor -- start 2023-12-18T10:19:36.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 -- start start 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec06c4f0 0x7fd2ec0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0c9e30 0x7fd2ec14c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1570c0 0x7fd2ec14c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c5430 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c2030 con 0x7fd2ec0c9e30 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2f197b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c5c00 con 0x7fd2ec1570c0 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec06c4f0 0x7fd2ec0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec06c4f0 0x7fd2ec0c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59886/0 (socket says 172.21.15.133:59886) 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 -- 172.21.15.133:0/1259302542 learned_addr learned my addr 172.21.15.133:0/1259302542 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0c9e30 0x7fd2ec14c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1570c0 0x7fd2ec14c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 -- 172.21.15.133:0/1259302542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1570c0 msgr2=0x7fd2ec14c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1570c0 0x7fd2ec14c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 -- 172.21.15.133:0/1259302542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0c9e30 msgr2=0x7fd2ec14c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0c9e30 0x7fd2ec14c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 -- 172.21.15.133:0/1259302542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d4009420 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.173+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec06c4f0 0x7fd2ec0c7bb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c7c0 tx=0x7fd2dc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2e8ff9640 1 -- 172.21.15.133:0/1259302542 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc00a640 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2e8ff9640 1 -- 172.21.15.133:0/1259302542 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc00a7c0 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2e8ff9640 1 -- 172.21.15.133:0/1259302542 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc00ab70 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2f197b640 1 -- 172.21.15.133:0/1259302542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e4009420 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2f197b640 1 -- 172.21.15.133:0/1259302542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec0c5920 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2e8ff9640 1 -- 172.21.15.133:0/1259302542 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd2dc00acd0 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2e8ff9640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2cc065a60 0x7fd2cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2e8ff9640 1 -- 172.21.15.133:0/1259302542 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd2dc082880 con 0x7fd2ec06c4f0 2023-12-18T10:19:36.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2cc065a60 0x7fd2cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.177+0000 7fd2f4cdc000 1 Processor -- start 2023-12-18T10:19:36.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2cc065a60 0x7fd2cc067f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec146920 tx=0x7fd2d4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- start start 2023-12-18T10:19:36.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6b070 0x559c6db6b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db20c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db211c0 0x559c6db215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6d944c90 con 0x559c6db6b990 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6d976220 con 0x559c6db211c0 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c6d9737f0 con 0x559c6db6b070 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db20c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db20c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59896/0 (socket says 172.21.15.133:59896) 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 -- 172.21.15.133:0/3705632903 learned_addr learned my addr 172.21.15.133:0/3705632903 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6b070 0x559c6db6b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db211c0 0x559c6db215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 -- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6b070 msgr2=0x559c6db6b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6b070 0x559c6db6b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 -- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db211c0 msgr2=0x559c6db215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db211c0 0x559c6db215a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 -- 172.21.15.133:0/3705632903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c6d66b890 con 0x559c6db6b990 2023-12-18T10:19:36.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6b070 0x559c6db6b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:36.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db20c80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009a60 tx=0x7fd2d4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e2989149949eb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e17fa640 1 -- 172.21.15.133:0/3705632903 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4014e10 con 0x559c6db6b990 2023-12-18T10:19:36.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e17fa640 1 -- 172.21.15.133:0/3705632903 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d40213f0 con 0x559c6db6b990 2023-12-18T10:19:36.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2e17fa640 1 -- 172.21.15.133:0/3705632903 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4021760 con 0x559c6db6b990 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3705632903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 msgr2=0x559c6db20c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db20c80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009a60 tx=0x7fd2d4014000 comp rx=0 tx=0).stop 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3705632903 shutdown_connections 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db211c0 0x559c6db215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db20c80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/3705632903 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6b070 0x559c6db6b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3705632903 >> 172.21.15.133:0/3705632903 conn(0x559c6db27950 msgr2=0x559c6db1f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3705632903 shutdown_connections 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3705632903 wait complete. 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.181+0000 7fd2f4cdc000 1 -- start start 2023-12-18T10:19:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 Processor -- start 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6db727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db6b070 0x559c6db72d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db59030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6d96f0e0 con 0x559c6db6b990 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6d90e310 con 0x559c6db6b070 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c6d92c770 con 0x559c6db211c0 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 10 client.0 _ll_register_callbacks cb 0x559c6db0cb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db59030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db59030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59910/0 (socket says 172.21.15.133:59910) 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/1209009109 learned_addr learned my addr 172.21.15.133:0/1209009109 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6db727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db6b070 0x559c6db72d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 msgr2=0x559c6db727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6db727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db6b070 msgr2=0x559c6db72d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db6b070 0x559c6db72d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/1209009109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec0c5920 con 0x559c6db6b990 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6db727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db59030 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097c0 tx=0x7fd2e40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8152cfb0c239aab7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1209009109 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40bf600 con 0x559c6db6b990 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1209009109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c6d93ec10 con 0x559c6db6b990 2023-12-18T10:19:36.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1209009109 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd2e40ba070 con 0x559c6db6b990 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1209009109 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2e40bf760 con 0x559c6db6b990 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 10 client.5688 fetch_fsmap learned FSMap version 17 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1209009109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7fd2d4009cf0 con 0x559c6db6b990 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1209009109 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c6d93ec10 con 0x559c6db6b990 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1209009109 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd2e40bf8c0 con 0x559c6db6b990 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 10 client.5688 fetch_fsmap finished waiting for FSMap version 17 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 10 client.5688 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 20 client.5688 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559c6db59d70 0x559c6db5a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 4 client.5688 mds_command: new command op to 5508 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1209009109 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c6d96da30 con 0x559c6db59d70 2023-12-18T10:19:36.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.185+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559c6db59d70 0x559c6db5a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559c6db59d70 0x559c6db5a150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cd3a46fe2539a11 server_cookie=77c0fc92df09fe93 in_seq=0 out_seq=0 2023-12-18T10:19:36.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2ca7fc640 10 client.5688 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:36.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1209009109 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559c6d96da30 con 0x559c6db59d70 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2ca7fc640 10 client.5688 handle_command_reply: tid=0 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 client.5688 shutdown 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1209009109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 msgr2=0x559c6db59030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db59030 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097c0 tx=0x7fd2e40046d0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1209009109 shutdown_connections 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6b990 0x559c6db59030 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db6b070 0x559c6db72d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559c6db59d70 0x559c6db5a150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1209009109 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6db727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2ca7fc640 0 client.5688 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1209009109 >> 172.21.15.133:0/1209009109 conn(0x559c6db27950 msgr2=0x559c6db1fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1209009109 shutdown_connections 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1209009109 wait complete. 2023-12-18T10:19:36.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.189+0000 7fd2f4cdc000 20 client.5688 trim_cache size 0 max 16384 2023-12-18T10:19:36.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 Processor -- start 2023-12-18T10:19:36.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- start start 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6ac90 0x559c6dbcbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db211c0 0x559c6dbcc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6d62c940 con 0x559c6db211c0 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6d96c8f0 con 0x559c6db27950 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c6d9b2ce0 con 0x559c6db6ac90 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db211c0 0x559c6dbcc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db211c0 0x559c6dbcc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59918/0 (socket says 172.21.15.133:59918) 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/3263758241 learned_addr learned my addr 172.21.15.133:0/3263758241 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6ac90 0x559c6dbcbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6ac90 msgr2=0x559c6dbcbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6ac90 0x559c6dbcbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 msgr2=0x559c6dbcc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/3263758241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c6d934260 con 0x559c6db211c0 2023-12-18T10:19:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6ac90 0x559c6dbcbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db211c0 0x559c6dbcc9a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd2e401a0b0 tx=0x7fd2e4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3bf617d846dd55 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2e1ffb640 1 -- 172.21.15.133:0/3263758241 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40b5400 con 0x559c6db211c0 2023-12-18T10:19:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2e1ffb640 1 -- 172.21.15.133:0/3263758241 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e40b5560 con 0x559c6db211c0 2023-12-18T10:19:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2e1ffb640 1 -- 172.21.15.133:0/3263758241 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4004240 con 0x559c6db211c0 2023-12-18T10:19:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3263758241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db211c0 msgr2=0x559c6dbcc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db211c0 0x559c6dbcc9a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd2e401a0b0 tx=0x7fd2e4009190 comp rx=0 tx=0).stop 2023-12-18T10:19:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3263758241 shutdown_connections 2023-12-18T10:19:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db211c0 0x559c6dbcc9a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/3263758241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db6ac90 0x559c6dbcbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3263758241 >> 172.21.15.133:0/3263758241 conn(0x559c6db6a790 msgr2=0x559c6db56180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3263758241 shutdown_connections 2023-12-18T10:19:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.205+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/3263758241 wait complete. 2023-12-18T10:19:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 -- start start 2023-12-18T10:19:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 Processor -- start 2023-12-18T10:19:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6dbcc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6ac90 0x559c6dbcb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6db24860 con 0x559c6db6ac90 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6da30eb0 con 0x559c6db27950 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c6d96bcf0 con 0x559c6db211c0 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 10 client.0 _ll_register_callbacks cb 0x559c6d91d640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6ac90 0x559c6dbcb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6ac90 0x559c6dbcb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59926/0 (socket says 172.21.15.133:59926) 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eaffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6dbcc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/1389985100 learned_addr learned my addr 172.21.15.133:0/1389985100 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 msgr2=0x559c6dbcc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6dbcc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 msgr2=0x559c6dbcb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 -- 172.21.15.133:0/1389985100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d4009cf0 con 0x559c6db6ac90 2023-12-18T10:19:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2e27fc640 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eb7fe640 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6ac90 0x559c6dbcb800 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097c0 tx=0x7fd2e401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a98939543a293d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1389985100 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40b5400 con 0x559c6db6ac90 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1389985100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c6d934e00 con 0x559c6db6ac90 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1389985100 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd2e40d9c50 con 0x559c6db6ac90 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1389985100 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2e40d9e10 con 0x559c6db6ac90 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 10 client.5694 fetch_fsmap learned FSMap version 17 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1389985100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559c6d91a3b0 con 0x559c6db6ac90 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1389985100 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c6d934e00 con 0x559c6db6ac90 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1389985100 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd2e40df020 con 0x559c6db6ac90 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 10 client.5694 fetch_fsmap finished waiting for FSMap version 17 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 10 client.5694 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 20 client.5694 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559c6db6b070 0x559c6dbcd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 4 client.5694 mds_command: new command op to 5508 tid=0[{"prefix": "status"}] 2023-12-18T10:19:36.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1389985100 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559c6d968160 con 0x559c6db6b070 2023-12-18T10:19:36.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.209+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559c6db6b070 0x559c6dbcd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2eaffd640 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559c6db6b070 0x559c6dbcd180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3584023a054f9d8 server_cookie=25a5a1c8a3ab075f in_seq=0 out_seq=0 2023-12-18T10:19:36.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2ca7fc640 10 client.5694 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2ca7fc640 1 -- 172.21.15.133:0/1389985100 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559c6d968160 con 0x559c6db6b070 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2ca7fc640 10 client.5694 handle_command_reply: tid=0 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 client.5694 shutdown 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1389985100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6ac90 msgr2=0x559c6dbcb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6ac90 0x559c6dbcb800 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40097c0 tx=0x7fd2e401acc0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1389985100 shutdown_connections 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c6db6ac90 0x559c6dbcb800 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c6db27950 0x559c6dbcb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559c6db6b070 0x559c6dbcd180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 --2- 172.21.15.133:0/1389985100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c6db211c0 0x559c6dbcc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2ca7fc640 0 client.5694 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1389985100 >> 172.21.15.133:0/1389985100 conn(0x559c6db6a790 msgr2=0x559c6db56a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1389985100 shutdown_connections 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 1 -- 172.21.15.133:0/1389985100 wait complete. 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f4cdc000 20 client.5694 trim_cache size 0 max 16384 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5508, 2023-12-18T10:19:36.219 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:19:36.220 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:19:36.220 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:19:36.220 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 5.8291880049999998, 2023-12-18T10:19:36.220 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 17, 2023-12-18T10:19:36.220 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 39, 2023-12-18T10:19:36.220 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 39, 2023-12-18T10:19:36.220 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 13.078571252 2023-12-18T10:19:36.220 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 -- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2cc065a60 msgr2=0x7fd2cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2cc065a60 0x7fd2cc067f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec146920 tx=0x7fd2d4009190 comp rx=0 tx=0).stop 2023-12-18T10:19:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 -- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec06c4f0 msgr2=0x7fd2ec0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec06c4f0 0x7fd2ec0c7bb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c7c0 tx=0x7fd2dc00cc80 comp rx=0 tx=0).stop 2023-12-18T10:19:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 -- 172.21.15.133:0/1259302542 shutdown_connections 2023-12-18T10:19:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2cc065a60 0x7fd2cc067f20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ec1570c0 0x7fd2ec14c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ec0c9e30 0x7fd2ec14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 --2- 172.21.15.133:0/1259302542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2ec06c4f0 0x7fd2ec0c7bb0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 -- 172.21.15.133:0/1259302542 >> 172.21.15.133:0/1259302542 conn(0x7fd2ec06a3e0 msgr2=0x7fd2ec15ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 -- 172.21.15.133:0/1259302542 shutdown_connections 2023-12-18T10:19:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.213+0000 7fd2f197b640 1 -- 172.21.15.133:0/1259302542 wait complete. 2023-12-18T10:19:36.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:19:36.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff990725640 1 Processor -- start 2023-12-18T10:19:36.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff990725640 1 -- start start 2023-12-18T10:19:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff990725640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9880cf0d0 0x7ff9880cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff990725640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9881648d0 0x7ff988166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff990725640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9880cfa70 con 0x7ff98815ca40 2023-12-18T10:19:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff990725640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880d11c0 con 0x7ff9880cf0d0 2023-12-18T10:19:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff990725640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880d0310 con 0x7ff9881648d0 2023-12-18T10:19:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98e4c1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff98815ca40 0x7ff9880cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42056/0 (socket says 172.21.15.133:42056) 2023-12-18T10:19:36.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98e4c1640 1 -- 172.21.15.133:0/2954900808 learned_addr learned my addr 172.21.15.133:0/2954900808 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:36.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98dcc0640 1 --2- 172.21.15.133:0/2954900808 >> v2:172.21.15.133:3300/0 conn(0x7ff9880cf0d0 0x7ff9880cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98ecc2640 1 --2- 172.21.15.133:0/2954900808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9881648d0 0x7ff988166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98d4bf640 1 -- 172.21.15.133:0/2954900808 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626524436 0 0) 0x7ff9880cfa70 con 0x7ff98815ca40 2023-12-18T10:19:36.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98d4bf640 1 -- 172.21.15.133:0/2954900808 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff974003530 con 0x7ff98815ca40 2023-12-18T10:19:36.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98dcc0640 1 -- 172.21.15.133:0/2954900808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9881648d0 msgr2=0x7ff988166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:36.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98dcc0640 1 --2- 172.21.15.133:0/2954900808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9881648d0 0x7ff988166cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98dcc0640 1 -- 172.21.15.133:0/2954900808 >> v1:172.21.15.133:6789/0 conn(0x7ff98815ca40 legacy=0x7ff9880cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.369+0000 7ff98dcc0640 1 -- 172.21.15.133:0/2954900808 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9880d05b0 con 0x7ff9880cf0d0 2023-12-18T10:19:36.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff98dcc0640 1 --2- 172.21.15.133:0/2954900808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9880cf0d0 0x7ff9880cf530 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff9780097a0 tx=0x7ff97801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85c2d36f5cdd36 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff98d4bf640 1 -- 172.21.15.133:0/2954900808 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9780a7070 con 0x7ff9880cf0d0 2023-12-18T10:19:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff98d4bf640 1 -- 172.21.15.133:0/2954900808 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9780ab430 con 0x7ff9880cf0d0 2023-12-18T10:19:36.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff98d4bf640 1 -- 172.21.15.133:0/2954900808 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9780ab7a0 con 0x7ff9880cf0d0 2023-12-18T10:19:36.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff990725640 1 -- 172.21.15.133:0/2954900808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9880cf0d0 msgr2=0x7ff9880cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff990725640 1 --2- 172.21.15.133:0/2954900808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9880cf0d0 0x7ff9880cf530 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff9780097a0 tx=0x7ff97801c430 comp rx=0 tx=0).stop 2023-12-18T10:19:36.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff990725640 1 -- 172.21.15.133:0/2954900808 shutdown_connections 2023-12-18T10:19:36.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff990725640 1 --2- 172.21.15.133:0/2954900808 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9881648d0 0x7ff988166cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff990725640 1 --2- 172.21.15.133:0/2954900808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9880cf0d0 0x7ff9880cf530 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff990725640 1 -- 172.21.15.133:0/2954900808 >> 172.21.15.133:0/2954900808 conn(0x7ff988089fb0 msgr2=0x7ff9880d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff990725640 1 -- 172.21.15.133:0/2954900808 shutdown_connections 2023-12-18T10:19:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.373+0000 7ff990725640 1 -- 172.21.15.133:0/2954900808 wait complete. 2023-12-18T10:19:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 Processor -- start 2023-12-18T10:19:36.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 -- start start 2023-12-18T10:19:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9880cf0d0 0x7ff988157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff98815ca40 0x7ff988166860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9881648d0 0x7ff9880b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98815d0d0 con 0x7ff9881648d0 2023-12-18T10:19:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98815d3b0 con 0x7ff9880cf0d0 2023-12-18T10:19:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98815d690 con 0x7ff98815ca40 2023-12-18T10:19:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9881648d0 0x7ff9880b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9881648d0 0x7ff9880b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59938/0 (socket says 172.21.15.133:59938) 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 -- 172.21.15.133:0/1753179997 learned_addr learned my addr 172.21.15.133:0/1753179997 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98dcc0640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff98815ca40 0x7ff988166860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98e4c1640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9880cf0d0 0x7ff988157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 -- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff98815ca40 msgr2=0x7ff988166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff98815ca40 0x7ff988166860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 -- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9880cf0d0 msgr2=0x7ff988157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9880cf0d0 0x7ff988157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 -- 172.21.15.133:0/1753179997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9780093b0 con 0x7ff9881648d0 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98e4c1640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9880cf0d0 0x7ff988157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff98ecc2640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9881648d0 0x7ff9880b0360 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff980007d80 tx=0x7ff98000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff97effd640 1 -- 172.21.15.133:0/1753179997 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980014420 con 0x7ff9881648d0 2023-12-18T10:19:36.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff97effd640 1 -- 172.21.15.133:0/1753179997 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980014580 con 0x7ff9881648d0 2023-12-18T10:19:36.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff97effd640 1 -- 172.21.15.133:0/1753179997 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980014930 con 0x7ff9881648d0 2023-12-18T10:19:36.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98815d970 con 0x7ff9881648d0 2023-12-18T10:19:36.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.377+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff988158260 con 0x7ff9881648d0 2023-12-18T10:19:36.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.381+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98804e000 con 0x7ff9881648d0 2023-12-18T10:19:36.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.381+0000 7ff97effd640 1 -- 172.21.15.133:0/1753179997 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff980014a90 con 0x7ff9881648d0 2023-12-18T10:19:36.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.381+0000 7ff97effd640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff96c065a60 0x7ff96c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:36.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.381+0000 7ff97effd640 1 -- 172.21.15.133:0/1753179997 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff980083c10 con 0x7ff9881648d0 2023-12-18T10:19:36.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.381+0000 7ff98e4c1640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff96c065a60 0x7ff96c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:36.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.381+0000 7ff98e4c1640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff96c065a60 0x7ff96c067f20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff984001370 tx=0x7ff984009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:36.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.385+0000 7ff97effd640 1 -- 172.21.15.133:0/1753179997 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff980051480 con 0x7ff9881648d0 2023-12-18T10:19:36.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff98815de20 con 0x7ff9881648d0 2023-12-18T10:19:36.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff97effd640 1 -- 172.21.15.133:0/1753179997 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff980054aa0 con 0x7ff9881648d0 2023-12-18T10:19:36.572 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff96c065a60 msgr2=0x7ff96c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff96c065a60 0x7ff96c067f20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff984001370 tx=0x7ff984009040 comp rx=0 tx=0).stop 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9881648d0 msgr2=0x7ff9880b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9881648d0 0x7ff9880b0360 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff980007d80 tx=0x7ff98000e4b0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 shutdown_connections 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff96c065a60 0x7ff96c067f20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9881648d0 0x7ff9880b0360 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff98815ca40 0x7ff988166860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 --2- 172.21.15.133:0/1753179997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9880cf0d0 0x7ff988157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:36.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 >> 172.21.15.133:0/1753179997 conn(0x7ff988089fb0 msgr2=0x7ff98815bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:36.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 shutdown_connections 2023-12-18T10:19:36.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:36.569+0000 7ff990725640 1 -- 172.21.15.133:0/1753179997 wait complete. 2023-12-18T10:19:36.592 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:19:36.593 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:19:36.593 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:19:36.593 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-18T10:19:36.593 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-18T10:19:36.593 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:19:36.593 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:19:36.593 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:19:36.593 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:19:36.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:36.593 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:19:36.603 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:19:36.603 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:19:36.604 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42060sec preferred_lft 42060sec 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-18T10:19:36.605 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:19:36.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:36.607 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:19:36.665 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:19:36.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:36.667 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:19:36.721 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:19:36.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:36.722 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:19:36.722 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:19:36.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:19:36.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:19:36.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:19:36.722 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:19:36.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:36.813 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:19:36.822 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-18T10:19:36.822 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-18T10:19:36.822 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:19:36.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:36.823 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-18T10:19:36.890 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-18T10:19:36.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:19:36.891 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-18T10:19:36.942 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:19:36.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:19:36.943 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:19:36.998 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:19:37.063 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:19:37.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:19:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:19:37.126 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:19:37.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:37.127 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:19:37.178 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:19:37.178 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-18T10:19:37.225 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:19:37.246 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:19:37.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:19:37.309 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:19:37.310 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:19:37.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:37.311 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:19:37.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:2023-12-18T10:19:37.317+0000 7f66a7b93580 -1 init, newargv = 0x563c6f07ef30 newargc=15 2023-12-18T10:19:37.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[49612]: starting ceph client 2023-12-18T10:19:37.328 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[49612]: starting fuse 2023-12-18T10:19:37.329 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:19:37.330 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:37.330 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.0")) 2023-12-18T10:19:37.331 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:19:37.448 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.0.49612.asok 2023-12-18T10:19:37.633 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49612.asok 2023-12-18T10:19:37.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:37.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49612.asok status 2023-12-18T10:19:37.805 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "0", 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "49612", 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5709, 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:19:37.806 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 5709 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2316812962 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2316812962 2023-12-18T10:19:37.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.5709 192.168.0.1:0/2316812962", 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/2316812962", 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 17, 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 39, 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:19:37.808 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:37.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:37.821 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:19:37.821 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-18T10:19:37.831 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:19:37.831 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-18T10:19:37.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:37.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:19:37.895 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-18T10:19:38.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f513d9f0640 1 Processor -- start 2023-12-18T10:19:38.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f513d9f0640 1 -- start start 2023-12-18T10:19:38.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f513d9f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5138071870 0x7f5138071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f513d9f0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51380cbff0 0x7f51380cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f513d9f0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380cc960 con 0x7f51380ca410 2023-12-18T10:19:38.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f513d9f0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513815aab0 con 0x7f51380cbff0 2023-12-18T10:19:38.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f513d9f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5138070df0 con 0x7f5138071870 2023-12-18T10:19:38.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f5136ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f51380ca410 0x7f5138159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42072/0 (socket says 172.21.15.133:42072) 2023-12-18T10:19:38.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f5136ffd640 1 -- 172.21.15.133:0/1923588298 learned_addr learned my addr 172.21.15.133:0/1923588298 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:38.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f512e7fc640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5138071870 0x7f5138071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:38.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51377fe640 1 --2- 172.21.15.133:0/1923588298 >> v2:172.21.15.142:3300/0 conn(0x7f51380cbff0 0x7f51380cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:38.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948759926 0 0) 0x7f51380cc960 con 0x7f51380ca410 2023-12-18T10:19:38.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5124003530 con 0x7f51380ca410 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3132738933 0 0) 0x7f5124003530 con 0x7f51380ca410 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5138071870 msgr2=0x7f5138071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5138071870 0x7f5138071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 >> v2:172.21.15.142:3300/0 conn(0x7f51380cbff0 msgr2=0x7f51380cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 --2- 172.21.15.133:0/1923588298 >> v2:172.21.15.142:3300/0 conn(0x7f51380cbff0 0x7f51380cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513815a4f0 con 0x7f51380ca410 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f5128001680 con 0x7f51380ca410 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 >> v1:172.21.15.133:6789/0 conn(0x7f51380ca410 legacy=0x7f5138159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5124003980 0x7f5124003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51240047d0 0x7f5124004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5138071870 0x7f5124005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513815aab0 con 0x7f5124003980 2023-12-18T10:19:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138070df0 con 0x7f51240047d0 2023-12-18T10:19:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512400dbd0 con 0x7f5138071870 2023-12-18T10:19:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f5136ffd640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5124003980 0x7f5124003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f512e7fc640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51240047d0 0x7f5124004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f5136ffd640 1 -- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5138071870 msgr2=0x7f5124005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f5136ffd640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5138071870 0x7f5124005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f5136ffd640 1 -- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51240047d0 msgr2=0x7f5124004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f5136ffd640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51240047d0 0x7f5124004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.081+0000 7f5136ffd640 1 -- 172.21.15.133:0/1923588298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5124003530 con 0x7f5124003980 2023-12-18T10:19:38.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f5136ffd640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5124003980 0x7f5124003da0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f512800c240 tx=0x7f512801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a156a191f85601 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:38.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51280058e0 con 0x7f5124003980 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5128005a40 con 0x7f5124003980 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f51367fc640 1 -- 172.21.15.133:0/1923588298 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128005dd0 con 0x7f5124003980 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f513d9f0640 1 -- 172.21.15.133:0/1923588298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5124003980 msgr2=0x7f5124003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f513d9f0640 1 --2- 172.21.15.133:0/1923588298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5124003980 0x7f5124003da0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f512800c240 tx=0x7f512801cbd0 comp rx=0 tx=0).stop 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f51377fe640 1 -- 172.21.15.133:0/1923588298 reap_dead start 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f513d9f0640 1 -- 172.21.15.133:0/1923588298 shutdown_connections 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f513d9f0640 1 -- 172.21.15.133:0/1923588298 >> 172.21.15.133:0/1923588298 conn(0x7f513806a2a0 msgr2=0x7f51380aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f513d9f0640 1 -- 172.21.15.133:0/1923588298 shutdown_connections 2023-12-18T10:19:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.085+0000 7f513d9f0640 1 -- 172.21.15.133:0/1923588298 wait complete. 2023-12-18T10:19:38.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 Processor -- start 2023-12-18T10:19:38.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 -- start start 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5124003980 0x7f51380c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51381f4520 0x7f51380c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51381f87c0 0x7f51381f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138155400 con 0x7f51381f4520 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513815f760 con 0x7f51381f87c0 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513815fa40 con 0x7f5124003980 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51381f4520 0x7f51380c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51381f4520 0x7f51380c2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59960/0 (socket says 172.21.15.133:59960) 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 -- 172.21.15.133:0/2396944243 learned_addr learned my addr 172.21.15.133:0/2396944243 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f5136ffd640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5124003980 0x7f51380c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f51377fe640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51381f87c0 0x7f51381f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 -- 172.21.15.133:0/2396944243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5124003980 msgr2=0x7f51380c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5124003980 0x7f51380c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 -- 172.21.15.133:0/2396944243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51381f87c0 msgr2=0x7f51381f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51381f87c0 0x7f51381f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 -- 172.21.15.133:0/2396944243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513815fd20 con 0x7f51381f4520 2023-12-18T10:19:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f512e7fc640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51381f4520 0x7f51380c2960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5120009f90 tx=0x7f512000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f5134ff9640 1 -- 172.21.15.133:0/2396944243 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512000e040 con 0x7f51381f4520 2023-12-18T10:19:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f5134ff9640 1 -- 172.21.15.133:0/2396944243 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512000f040 con 0x7f51381f4520 2023-12-18T10:19:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f5134ff9640 1 -- 172.21.15.133:0/2396944243 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5120015870 con 0x7f51381f4520 2023-12-18T10:19:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51381f82a0 con 0x7f51381f4520 2023-12-18T10:19:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.089+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51380c2ea0 con 0x7f51381f4520 2023-12-18T10:19:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.093+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513804e000 con 0x7f51381f4520 2023-12-18T10:19:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.093+0000 7f5134ff9640 1 -- 172.21.15.133:0/2396944243 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51200159d0 con 0x7f51381f4520 2023-12-18T10:19:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.093+0000 7f5134ff9640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5118065a60 0x7f5118067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.093+0000 7f5134ff9640 1 -- 172.21.15.133:0/2396944243 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5120084090 con 0x7f51381f4520 2023-12-18T10:19:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.093+0000 7f5136ffd640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5118065a60 0x7f5118067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.093+0000 7f5136ffd640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5118065a60 0x7f5118067f20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f51280aa000 tx=0x7f5128001a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:38.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.097+0000 7f5134ff9640 1 -- 172.21.15.133:0/2396944243 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5120051870 con 0x7f51381f4520 2023-12-18T10:19:38.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:38.281+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f513815fb80 con 0x7f51381f4520 2023-12-18T10:19:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f5134ff9640 1 -- 172.21.15.133:0/2396944243 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f513815fb80 con 0x7f51381f4520 2023-12-18T10:19:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5118065a60 msgr2=0x7f5118067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5118065a60 0x7f5118067f20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f51280aa000 tx=0x7f5128001a80 comp rx=0 tx=0).stop 2023-12-18T10:19:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51381f4520 msgr2=0x7f51380c2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51381f4520 0x7f51380c2960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5120009f90 tx=0x7f512000f580 comp rx=0 tx=0).stop 2023-12-18T10:19:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 shutdown_connections 2023-12-18T10:19:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5118065a60 0x7f5118067f20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51381f87c0 0x7f51381f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51381f4520 0x7f51380c2960 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 --2- 172.21.15.133:0/2396944243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5124003980 0x7f51380c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.037+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 >> 172.21.15.133:0/2396944243 conn(0x7f513806a2a0 msgr2=0x7f5138156960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.041+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 shutdown_connections 2023-12-18T10:19:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.041+0000 7f513d9f0640 1 -- 172.21.15.133:0/2396944243 wait complete. 2023-12-18T10:19:39.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ee04640 1 Processor -- start 2023-12-18T10:19:39.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ee04640 1 -- start start 2023-12-18T10:19:39.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ee04640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5480d0070 0x7fb5480d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:39.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ee04640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54815ca80 con 0x7fb54815c6a0 2023-12-18T10:19:39.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ee04640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5480b8480 con 0x7fb5480d0f50 2023-12-18T10:19:39.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ee04640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5480d07e0 con 0x7fb5480d0070 2023-12-18T10:19:39.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54de02640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb54815c6a0 0x7fb5480cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42080/0 (socket says 172.21.15.133:42080) 2023-12-18T10:19:39.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54de02640 1 -- 172.21.15.133:0/2066711469 learned_addr learned my addr 172.21.15.133:0/2066711469 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:39.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54d601640 1 --2- 172.21.15.133:0/2066711469 >> v2:172.21.15.133:3300/0 conn(0x7fb5480d0070 0x7fb5480d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:39.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ce00640 1 -- 172.21.15.133:0/2066711469 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412275667 0 0) 0x7fb54815ca80 con 0x7fb54815c6a0 2023-12-18T10:19:39.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ce00640 1 -- 172.21.15.133:0/2066711469 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb534003530 con 0x7fb54815c6a0 2023-12-18T10:19:39.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ce00640 1 -- 172.21.15.133:0/2066711469 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92588575 0 0) 0x7fb5480b8480 con 0x7fb5480d0f50 2023-12-18T10:19:39.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ce00640 1 -- 172.21.15.133:0/2066711469 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb54815ca80 con 0x7fb5480d0f50 2023-12-18T10:19:39.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54d601640 1 -- 172.21.15.133:0/2066711469 >> v1:172.21.15.142:6789/0 conn(0x7fb5480d0f50 legacy=0x7fb5480b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54ce00640 1 -- 172.21.15.133:0/2066711469 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3634635801 0 0) 0x7fb534003530 con 0x7fb54815c6a0 2023-12-18T10:19:39.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54d601640 1 -- 172.21.15.133:0/2066711469 >> v1:172.21.15.133:6789/0 conn(0x7fb54815c6a0 legacy=0x7fb5480cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.213+0000 7fb54d601640 1 -- 172.21.15.133:0/2066711469 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5480d0500 con 0x7fb5480d0070 2023-12-18T10:19:39.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54d601640 1 --2- 172.21.15.133:0/2066711469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5480d0070 0x7fb5480d0a10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb5380097c0 tx=0x7fb53801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb507b1a347d4cc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:39.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ce00640 1 -- 172.21.15.133:0/2066711469 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544001680 con 0x7fb5480d0070 2023-12-18T10:19:39.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ce00640 1 -- 172.21.15.133:0/2066711469 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5380a7050 con 0x7fb5480d0070 2023-12-18T10:19:39.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ce00640 1 -- 172.21.15.133:0/2066711469 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5380ab620 con 0x7fb5480d0070 2023-12-18T10:19:39.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ee04640 1 -- 172.21.15.133:0/2066711469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5480d0070 msgr2=0x7fb5480d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ee04640 1 --2- 172.21.15.133:0/2066711469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5480d0070 0x7fb5480d0a10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb5380097c0 tx=0x7fb53801c2e0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ee04640 1 -- 172.21.15.133:0/2066711469 shutdown_connections 2023-12-18T10:19:39.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ee04640 1 --2- 172.21.15.133:0/2066711469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5480d0070 0x7fb5480d0a10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ee04640 1 -- 172.21.15.133:0/2066711469 >> 172.21.15.133:0/2066711469 conn(0x7fb5480717d0 msgr2=0x7fb548071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:39.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ee04640 1 -- 172.21.15.133:0/2066711469 shutdown_connections 2023-12-18T10:19:39.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.217+0000 7fb54ee04640 1 -- 172.21.15.133:0/2066711469 wait complete. 2023-12-18T10:19:39.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 Processor -- start 2023-12-18T10:19:39.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 -- start start 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480d0f50 0x7fb5480cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54815c6a0 0x7fb5480c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480c8a50 0x7fb5480c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54815f280 con 0x7fb54815c6a0 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54815fa70 con 0x7fb5480c8a50 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54815f4b0 con 0x7fb5480d0f50 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54815c6a0 0x7fb5480c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54815c6a0 0x7fb5480c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59990/0 (socket says 172.21.15.133:59990) 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 -- 172.21.15.133:0/2375668568 learned_addr learned my addr 172.21.15.133:0/2375668568 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:39.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54de02640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480d0f50 0x7fb5480cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:39.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54e603640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480c8a50 0x7fb5480c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:39.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 -- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480d0f50 msgr2=0x7fb5480cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480d0f50 0x7fb5480cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 -- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480c8a50 msgr2=0x7fb5480c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480c8a50 0x7fb5480c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 -- 172.21.15.133:0/2375668568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538009420 con 0x7fb54815c6a0 2023-12-18T10:19:39.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54de02640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480d0f50 0x7fb5480cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:39.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54d601640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54815c6a0 0x7fb5480c97d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb5380ae040 tx=0x7fb538019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:39.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb53e7fc640 1 -- 172.21.15.133:0/2375668568 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538004020 con 0x7fb54815c6a0 2023-12-18T10:19:39.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb53e7fc640 1 -- 172.21.15.133:0/2375668568 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb538004180 con 0x7fb54815c6a0 2023-12-18T10:19:39.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb53e7fc640 1 -- 172.21.15.133:0/2375668568 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5380044f0 con 0x7fb54815c6a0 2023-12-18T10:19:39.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54815f790 con 0x7fb54815c6a0 2023-12-18T10:19:39.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.221+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb548151ef0 con 0x7fb54815c6a0 2023-12-18T10:19:39.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.225+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5481520e0 con 0x7fb54815c6a0 2023-12-18T10:19:39.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.225+0000 7fb53e7fc640 1 -- 172.21.15.133:0/2375668568 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb5380b2040 con 0x7fb54815c6a0 2023-12-18T10:19:39.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.225+0000 7fb53e7fc640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb52c065a60 0x7fb52c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:39.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.225+0000 7fb53e7fc640 1 -- 172.21.15.133:0/2375668568 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb53811d160 con 0x7fb54815c6a0 2023-12-18T10:19:39.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.225+0000 7fb54de02640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb52c065a60 0x7fb52c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:39.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.225+0000 7fb54de02640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb52c065a60 0x7fb52c067f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb544000f70 tx=0x7fb544009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:39.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.229+0000 7fb53e7fc640 1 -- 172.21.15.133:0/2375668568 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb5380ea9f0 con 0x7fb54815c6a0 2023-12-18T10:19:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.413+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb54804e850 con 0x7fb54815c6a0 2023-12-18T10:19:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.413+0000 7fb53e7fc640 1 -- 172.21.15.133:0/2375668568 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4731 (secure 0 0 0) 0x7fb5380f4030 con 0x7fb54815c6a0 2023-12-18T10:19:39.417 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:39.417 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5054,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:39.038827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":5508,"mds_1":5499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5499":{"gid":5499,"name":"c","rank":1,"incarnation":19,"state":"up:creating","state_seq":1,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:19:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 19 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb52c065a60 msgr2=0x7fb52c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb52c065a60 0x7fb52c067f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb544000f70 tx=0x7fb544009040 comp rx=0 tx=0).stop 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54815c6a0 msgr2=0x7fb5480c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54815c6a0 0x7fb5480c97d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb5380ae040 tx=0x7fb538019080 comp rx=0 tx=0).stop 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 shutdown_connections 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb52c065a60 0x7fb52c067f20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5480c8a50 0x7fb5480c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54815c6a0 0x7fb5480c97d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 --2- 172.21.15.133:0/2375668568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5480d0f50 0x7fb5480cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 >> 172.21.15.133:0/2375668568 conn(0x7fb5480717d0 msgr2=0x7fb548071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 shutdown_connections 2023-12-18T10:19:39.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:39.417+0000 7fb54ee04640 1 -- 172.21.15.133:0/2375668568 wait complete. 2023-12-18T10:19:39.840 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:19:30.380308+0000', 'modified': '2023-12-18T10:19:39.038827+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 5508, 'mds_1': 5499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5499': {'gid': 5499, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.133:6836/3060654272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 3060654272}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 3060654272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5508': {'gid': 5508, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/979808628', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 979808628}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 979808628}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:19:39.840 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5499:up:creating 2023-12-18T10:19:40.841 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.985+0000 7f2b5fef9640 1 Processor -- start 2023-12-18T10:19:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.985+0000 7f2b5fef9640 1 -- start start 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5fef9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b580c1280 0x7f2b580cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5fef9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b580cb340 0x7f2b580cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5fef9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5806fdb0 con 0x7f2b58160cc0 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5fef9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b581654a0 con 0x7f2b580cb340 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5fef9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b581610a0 con 0x7f2b580c1280 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5e496640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b580cb340 0x7f2b580cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5e496640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b580cb340 0x7f2b580cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47450/0 (socket says 172.21.15.133:47450) 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5e496640 1 -- 172.21.15.133:0/886878226 learned_addr learned my addr 172.21.15.133:0/886878226 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5d494640 1 --2- 172.21.15.133:0/886878226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b580c1280 0x7f2b580cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5e496640 1 -- 172.21.15.133:0/886878226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b580c1280 msgr2=0x7f2b580cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5e496640 1 --2- 172.21.15.133:0/886878226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b580c1280 0x7f2b580cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5e496640 1 -- 172.21.15.133:0/886878226 >> v1:172.21.15.142:6789/0 conn(0x7f2b58160cc0 legacy=0x7f2b580cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:40.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.989+0000 7f2b5e496640 1 -- 172.21.15.133:0/886878226 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58164820 con 0x7f2b580cb340 2023-12-18T10:19:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5e496640 1 --2- 172.21.15.133:0/886878226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b580cc940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009e80 tx=0x7f2b5001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dbccfd8972584c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5cc93640 1 -- 172.21.15.133:0/886878226 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500a5670 con 0x7f2b580cb340 2023-12-18T10:19:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5cc93640 1 -- 172.21.15.133:0/886878226 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500a57d0 con 0x7f2b580cb340 2023-12-18T10:19:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5cc93640 1 -- 172.21.15.133:0/886878226 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500a5b60 con 0x7f2b580cb340 2023-12-18T10:19:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 -- 172.21.15.133:0/886878226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 msgr2=0x7f2b580cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/886878226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b580cc940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009e80 tx=0x7f2b5001c8a0 comp rx=0 tx=0).stop 2023-12-18T10:19:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 -- 172.21.15.133:0/886878226 shutdown_connections 2023-12-18T10:19:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/886878226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b580cc940 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/886878226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b580c1280 0x7f2b580cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 -- 172.21.15.133:0/886878226 >> 172.21.15.133:0/886878226 conn(0x7f2b5806a3e0 msgr2=0x7f2b580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 -- 172.21.15.133:0/886878226 shutdown_connections 2023-12-18T10:19:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 -- 172.21.15.133:0/886878226 wait complete. 2023-12-18T10:19:40.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 Processor -- start 2023-12-18T10:19:40.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.993+0000 7f2b5fef9640 1 -- start start 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b580c1280 0x7f2b58163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b5815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b58160cc0 0x7f2b580c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580b2190 con 0x7f2b580cb340 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580b1580 con 0x7f2b580c1280 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580b1860 con 0x7f2b58160cc0 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b5815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b5815b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47458/0 (socket says 172.21.15.133:47458) 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 -- 172.21.15.133:0/843598055 learned_addr learned my addr 172.21.15.133:0/843598055 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5dc95640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b580c1280 0x7f2b58163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5e496640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b58160cc0 0x7f2b580c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 -- 172.21.15.133:0/843598055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b58160cc0 msgr2=0x7f2b580c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b58160cc0 0x7f2b580c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 -- 172.21.15.133:0/843598055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b580c1280 msgr2=0x7f2b58163ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b580c1280 0x7f2b58163ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 -- 172.21.15.133:0/843598055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009b30 con 0x7f2b580cb340 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5d494640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b5815b9c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800d800 tx=0x7f2b4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b4e7fc640 1 -- 172.21.15.133:0/843598055 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800b6c0 con 0x7f2b580cb340 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b4e7fc640 1 -- 172.21.15.133:0/843598055 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800b820 con 0x7f2b580cb340 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b580b1b40 con 0x7f2b580cb340 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b4e7fc640 1 -- 172.21.15.133:0/843598055 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800bb90 con 0x7f2b580cb340 2023-12-18T10:19:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b581643e0 con 0x7f2b580cb340 2023-12-18T10:19:41.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b580735b0 con 0x7f2b580cb340 2023-12-18T10:19:41.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:40.997+0000 7f2b4e7fc640 1 -- 172.21.15.133:0/843598055 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b4800bcf0 con 0x7f2b580cb340 2023-12-18T10:19:41.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.001+0000 7f2b4e7fc640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b3c065a90 0x7f2b3c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.001+0000 7f2b4e7fc640 1 -- 172.21.15.133:0/843598055 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2b48083680 con 0x7f2b580cb340 2023-12-18T10:19:41.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.001+0000 7f2b5dc95640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b3c065a90 0x7f2b3c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.001+0000 7f2b5dc95640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b3c065a90 0x7f2b3c067f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2b580c8c00 tx=0x7f2b54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.005+0000 7f2b4e7fc640 1 -- 172.21.15.133:0/843598055 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2b48050fa0 con 0x7f2b580cb340 2023-12-18T10:19:41.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b580cf2a0 con 0x7f2b580cb340 2023-12-18T10:19:41.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b4e7fc640 1 -- 172.21.15.133:0/843598055 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f2b480545c0 con 0x7f2b580cb340 2023-12-18T10:19:41.196 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:41.196 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:41.052757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5508,"mds_1":5499,"mds_2":5054},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5054":{"gid":5054,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5499":{"gid":5499,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:19:41.196 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b3c065a90 msgr2=0x7f2b3c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b3c065a90 0x7f2b3c067f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2b580c8c00 tx=0x7f2b54009040 comp rx=0 tx=0).stop 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 msgr2=0x7f2b5815b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b5815b9c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800d800 tx=0x7f2b4800dcc0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 shutdown_connections 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b3c065a90 0x7f2b3c067f50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b58160cc0 0x7f2b580c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b580cb340 0x7f2b5815b9c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 --2- 172.21.15.133:0/843598055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b580c1280 0x7f2b58163ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 >> 172.21.15.133:0/843598055 conn(0x7f2b5806a3e0 msgr2=0x7f2b5815d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 shutdown_connections 2023-12-18T10:19:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.193+0000 7f2b5fef9640 1 -- 172.21.15.133:0/843598055 wait complete. 2023-12-18T10:19:41.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:19:30.380308+0000', 'modified': '2023-12-18T10:19:41.052757+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 5508, 'mds_1': 5499, 'mds_2': 5054}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5054': {'gid': 5054, 'name': 'b', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.142:6834/898789604', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 898789604}, {'type': 'v1', 'addr': '172.21.15.142:6834', 'nonce': 898789604}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5499': {'gid': 5499, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6836/3060654272', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 3060654272}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 3060654272}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5508': {'gid': 5508, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/979808628', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 979808628}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 979808628}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:19:41.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-18T10:19:41.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-18T10:19:41.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f685b8c4640 1 Processor -- start 2023-12-18T10:19:41.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f685b8c4640 1 -- start start 2023-12-18T10:19:41.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f685b8c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 0x7f68540cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f685b8c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f68540c1280 0x7f68540cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f685b8c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685406fdb0 con 0x7f68540c17d0 2023-12-18T10:19:41.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f685b8c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68541654a0 con 0x7f68540c1280 2023-12-18T10:19:41.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f685b8c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68541610a0 con 0x7f6854160cc0 2023-12-18T10:19:41.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859e61640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f68540c17d0 0x7f685406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60416/0 (socket says 172.21.15.133:60416) 2023-12-18T10:19:41.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859e61640 1 -- 172.21.15.133:0/4133931904 learned_addr learned my addr 172.21.15.133:0/4133931904 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:41.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6858e5f640 1 --2- 172.21.15.133:0/4133931904 >> v2:172.21.15.142:3300/0 conn(0x7f68540c1280 0x7f68540cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510976804 0 0) 0x7f685406fdb0 con 0x7f68540c17d0 2023-12-18T10:19:41.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6840003530 con 0x7f68540c17d0 2023-12-18T10:19:41.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859660640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 0x7f68540cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3033234408 0 0) 0x7f6840003530 con 0x7f68540c17d0 2023-12-18T10:19:41.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 msgr2=0x7f68540cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 0x7f68540cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 >> v2:172.21.15.142:3300/0 conn(0x7f68540c1280 msgr2=0x7f68540cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 --2- 172.21.15.133:0/4133931904 >> v2:172.21.15.142:3300/0 conn(0x7f68540c1280 0x7f68540cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540cb6b0 con 0x7f68540c17d0 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f684c001a00 con 0x7f68540c17d0 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 >> v1:172.21.15.133:6789/0 conn(0x7f68540c17d0 legacy=0x7f685406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6840003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68400047d0 0x7f6840004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 0x7f6840005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68541654a0 con 0x7f6840003980 2023-12-18T10:19:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68541610a0 con 0x7f68400047d0 2023-12-18T10:19:41.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684000b990 con 0x7f6854160cc0 2023-12-18T10:19:41.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859660640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6840003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859e61640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 0x7f6840005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6858e5f640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68400047d0 0x7f6840004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859660640 1 -- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 msgr2=0x7f6840005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859660640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 0x7f6840005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859660640 1 -- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68400047d0 msgr2=0x7f6840004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859660640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68400047d0 0x7f6840004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859660640 1 -- 172.21.15.133:0/4133931904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840003530 con 0x7f6840003980 2023-12-18T10:19:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6859e61640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6854160cc0 0x7f6840005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.757+0000 7f6858e5f640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f68400047d0 0x7f6840004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:41.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f6859660640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6840003da0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6850009b10 tx=0x7f685001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84252f813a39d78 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500a5530 con 0x7f6840003980 2023-12-18T10:19:41.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68500a5690 con 0x7f6840003980 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f684bfff640 1 -- 172.21.15.133:0/4133931904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500a5a40 con 0x7f6840003980 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f685b8c4640 1 -- 172.21.15.133:0/4133931904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 msgr2=0x7f6840003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f685b8c4640 1 --2- 172.21.15.133:0/4133931904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6840003da0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6850009b10 tx=0x7f685001ca20 comp rx=0 tx=0).stop 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f6859e61640 1 -- 172.21.15.133:0/4133931904 reap_dead start 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f685b8c4640 1 -- 172.21.15.133:0/4133931904 shutdown_connections 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f685b8c4640 1 -- 172.21.15.133:0/4133931904 >> 172.21.15.133:0/4133931904 conn(0x7f685406a3e0 msgr2=0x7f68540afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f685b8c4640 1 -- 172.21.15.133:0/4133931904 shutdown_connections 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.761+0000 7f685b8c4640 1 -- 172.21.15.133:0/4133931904 wait complete. 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 Processor -- start 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 -- start start 2023-12-18T10:19:41.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6854159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6854159bf0 0x7f68540c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685415a070 0x7f68540c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6854162d30 con 0x7f6840003980 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6854159990 con 0x7f6854159bf0 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68540c3190 con 0x7f685415a070 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6854159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6854159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47478/0 (socket says 172.21.15.133:47478) 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 -- 172.21.15.133:0/2500877886 learned_addr learned my addr 172.21.15.133:0/2500877886 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6854159bf0 0x7f68540c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859e61640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685415a070 0x7f68540c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 -- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685415a070 msgr2=0x7f68540c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685415a070 0x7f68540c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 -- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6854159bf0 msgr2=0x7f68540c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6854159bf0 0x7f68540c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 -- 172.21.15.133:0/2500877886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540c3470 con 0x7f6840003980 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6854159bf0 0x7f68540c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6859660640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6854159450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f685001c850 tx=0x7f6840005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6849ffb640 1 -- 172.21.15.133:0/2500877886 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500be070 con 0x7f6840003980 2023-12-18T10:19:41.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6849ffb640 1 -- 172.21.15.133:0/2500877886 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68500a5e20 con 0x7f6840003980 2023-12-18T10:19:41.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f6849ffb640 1 -- 172.21.15.133:0/2500877886 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850004020 con 0x7f6840003980 2023-12-18T10:19:41.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 -- 172.21.15.133:0/2500877886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68540c3750 con 0x7f6840003980 2023-12-18T10:19:41.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.765+0000 7f685b8c4640 1 -- 172.21.15.133:0/2500877886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68540c2d20 con 0x7f6840003980 2023-12-18T10:19:41.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.769+0000 7f6849ffb640 1 -- 172.21.15.133:0/2500877886 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f68500b4040 con 0x7f6840003980 2023-12-18T10:19:41.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.769+0000 7f6849ffb640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6838065a90 0x7f6838067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.769+0000 7f6849ffb640 1 -- 172.21.15.133:0/2500877886 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f685011ca90 con 0x7f6840003980 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.769+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6838065a90 0x7f6838067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.769+0000 7f685ec25000 1 Processor -- start 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.769+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6838065a90 0x7f6838067f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f685406c4c0 tx=0x7f6844008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.769+0000 7f685ec25000 1 -- start start 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173df1c070 0x56173df1c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 0x56173ded1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173ded21c0 0x56173ded25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173dcf5c90 con 0x56173ded21c0 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173dd27220 con 0x56173df1c070 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56173dd247f0 con 0x56173df1c990 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173ded21c0 0x56173ded25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173ded21c0 0x56173ded25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47480/0 (socket says 172.21.15.133:47480) 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 -- 172.21.15.133:0/3223113468 learned_addr learned my addr 172.21.15.133:0/3223113468 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859660640 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173df1c070 0x56173df1c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6858e5f640 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 0x56173ded1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 -- 172.21.15.133:0/3223113468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 msgr2=0x56173ded1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 0x56173ded1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 -- 172.21.15.133:0/3223113468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173df1c070 msgr2=0x56173df1c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173df1c070 0x56173df1c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 -- 172.21.15.133:0/3223113468 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56173da1c890 con 0x56173ded21c0 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6859e61640 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173ded21c0 0x56173ded25a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f685406ce80 tx=0x7f684c005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571b246211780a46 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6836ffd640 1 -- 172.21.15.133:0/3223113468 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c007760 con 0x56173ded21c0 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6836ffd640 1 -- 172.21.15.133:0/3223113468 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c0078c0 con 0x56173ded21c0 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f6836ffd640 1 -- 172.21.15.133:0/3223113468 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c014400 con 0x56173ded21c0 2023-12-18T10:19:41.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- 172.21.15.133:0/3223113468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173ded21c0 msgr2=0x56173ded25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173ded21c0 0x56173ded25a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f685406ce80 tx=0x7f684c005f50 comp rx=0 tx=0).stop 2023-12-18T10:19:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- 172.21.15.133:0/3223113468 shutdown_connections 2023-12-18T10:19:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173ded21c0 0x56173ded25a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 0x56173ded1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 --2- 172.21.15.133:0/3223113468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173df1c070 0x56173df1c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- 172.21.15.133:0/3223113468 >> 172.21.15.133:0/3223113468 conn(0x56173ded8950 msgr2=0x56173ded0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- 172.21.15.133:0/3223113468 shutdown_connections 2023-12-18T10:19:41.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- 172.21.15.133:0/3223113468 wait complete. 2023-12-18T10:19:41.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 -- start start 2023-12-18T10:19:41.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.773+0000 7f685ec25000 1 Processor -- start 2023-12-18T10:19:41.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173ded7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 0x56173dede080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173dede5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173dd200e0 con 0x56173df1c990 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173dcbf310 con 0x56173ded21c0 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56173dcdd770 con 0x56173df1c070 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 10 client.0 _ll_register_callbacks cb 0x56173debdb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173dede5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859660640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173ded7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173dede5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47496/0 (socket says 172.21.15.133:47496) 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 -- 172.21.15.133:0/2464521756 learned_addr learned my addr 172.21.15.133:0/2464521756 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 0x56173dede080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 -- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 msgr2=0x56173dede080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 0x56173dede080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 -- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 msgr2=0x56173ded7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173ded7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 -- 172.21.15.133:0/2464521756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c00f040 con 0x56173df1c990 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859e61640 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173dede5c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f684c009010 tx=0x7f684c001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479c303b9fd5b3c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 1 -- 172.21.15.133:0/2464521756 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c001e20 con 0x56173df1c990 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 1 -- 172.21.15.133:0/2464521756 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f684c001f80 con 0x56173df1c990 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 -- 172.21.15.133:0/2464521756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56173dcefc10 con 0x56173df1c990 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 1 -- 172.21.15.133:0/2464521756 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f684c0149c0 con 0x56173df1c990 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 10 client.5742 fetch_fsmap learned FSMap version 22 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 -- 172.21.15.133:0/2464521756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56173dce5260 con 0x56173df1c990 2023-12-18T10:19:41.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 1 -- 172.21.15.133:0/2464521756 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56173dcefc10 con 0x56173df1c990 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 1 -- 172.21.15.133:0/2464521756 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f684c01b070 con 0x56173df1c990 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 10 client.5742 fetch_fsmap finished waiting for FSMap version 22 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 10 client.5742 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 20 client.5742 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x56173df238d0 0x56173df23cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 4 client.5742 mds_command: new command op to 5054 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 -- 172.21.15.133:0/2464521756 --> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56173dd1ea30 con 0x56173df238d0 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859660640 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x56173df238d0 0x56173df23cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f6859660640 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x56173df238d0 0x56173df23cb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eaee1ffec3383e2e server_cookie=de9b550fd5713b74 in_seq=0 out_seq=0 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 10 client.5742 ms_handle_connect on v2:172.21.15.142:6832/898789604 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 1 -- 172.21.15.133:0/2464521756 <== mds.2 v2:172.21.15.142:6832/898789604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56173dd1ea30 con 0x56173df238d0 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f682ffff640 10 client.5742 handle_command_reply: tid=0 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 client.5742 shutdown 2023-12-18T10:19:41.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 -- 172.21.15.133:0/2464521756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 msgr2=0x56173dede5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173dede5c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f684c009010 tx=0x7f684c001d90 comp rx=0 tx=0).stop 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 -- 172.21.15.133:0/2464521756 shutdown_connections 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x56173df238d0 0x56173df23cb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173dede5c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 0x56173dede080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.777+0000 7f685ec25000 1 --2- 172.21.15.133:0/2464521756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173ded7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.781+0000 7f685ec25000 1 -- 172.21.15.133:0/2464521756 >> 172.21.15.133:0/2464521756 conn(0x56173ded8950 msgr2=0x56173ded0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.781+0000 7f682ffff640 0 client.5742 ms_handle_reset on v2:172.21.15.142:6832/898789604 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.781+0000 7f685ec25000 1 -- 172.21.15.133:0/2464521756 shutdown_connections 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.781+0000 7f685ec25000 1 -- 172.21.15.133:0/2464521756 wait complete. 2023-12-18T10:19:41.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.781+0000 7f685ec25000 20 client.5742 trim_cache size 0 max 16384 2023-12-18T10:19:41.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.793+0000 7f685ec25000 1 Processor -- start 2023-12-18T10:19:41.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.793+0000 7f685ec25000 1 -- start start 2023-12-18T10:19:41.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.793+0000 7f685ec25000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173deddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.793+0000 7f685ec25000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c070 0x56173dede510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.793+0000 7f685ec25000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 0x56173df1a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173d9dd940 con 0x56173df1c070 2023-12-18T10:19:41.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173ddf0b30 con 0x56173ded21c0 2023-12-18T10:19:41.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56173dcc8860 con 0x56173df1c990 2023-12-18T10:19:41.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c070 0x56173dede510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c070 0x56173dede510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47512/0 (socket says 172.21.15.133:47512) 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 -- 172.21.15.133:0/2121366866 learned_addr learned my addr 172.21.15.133:0/2121366866 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6859e61640 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 0x56173df1a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6859660640 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173deddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 -- 172.21.15.133:0/2121366866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 msgr2=0x56173df1a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 0x56173df1a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 -- 172.21.15.133:0/2121366866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 msgr2=0x56173deddfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173deddfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 -- 172.21.15.133:0/2121366866 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56173dccb3b0 con 0x56173df1c070 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c070 0x56173dede510 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6844013fb0 tx=0x7f6844016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a46db89dae6ac3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f68377fe640 1 -- 172.21.15.133:0/2121366866 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684402e640 con 0x56173df1c070 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f68377fe640 1 -- 172.21.15.133:0/2121366866 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684402e7a0 con 0x56173df1c070 2023-12-18T10:19:41.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f68377fe640 1 -- 172.21.15.133:0/2121366866 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684402eb50 con 0x56173df1c070 2023-12-18T10:19:41.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- 172.21.15.133:0/2121366866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c070 msgr2=0x56173dede510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c070 0x56173dede510 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6844013fb0 tx=0x7f6844016000 comp rx=0 tx=0).stop 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- 172.21.15.133:0/2121366866 shutdown_connections 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c990 0x56173df1a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c070 0x56173dede510 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 --2- 172.21.15.133:0/2121366866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173deddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- 172.21.15.133:0/2121366866 >> 172.21.15.133:0/2121366866 conn(0x56173ded8950 msgr2=0x56173dedd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- 172.21.15.133:0/2121366866 shutdown_connections 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- 172.21.15.133:0/2121366866 wait complete. 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- start start 2023-12-18T10:19:41.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 Processor -- start 2023-12-18T10:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173df78ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 0x56173df79420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173df5cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173dcc5770 con 0x56173df1c990 2023-12-18T10:19:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173df22fd0 con 0x56173ded21c0 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56173ded4d70 con 0x56173df1c070 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.797+0000 7f685ec25000 10 client.0 _ll_register_callbacks cb 0x56173dcce640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173df5cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173df5cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47516/0 (socket says 172.21.15.133:47516) 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859660640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173df78ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 -- 172.21.15.133:0/2026619074 learned_addr learned my addr 172.21.15.133:0/2026619074 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6858e5f640 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 0x56173df79420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 -- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 msgr2=0x56173df79420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 0x56173df79420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 -- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 msgr2=0x56173df78ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173df78ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 -- 172.21.15.133:0/2026619074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6844013c90 con 0x56173df1c990 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859e61640 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173df5cb50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f684c001be0 tx=0x7f684c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b906fdb20ff6ef1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:41.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 1 -- 172.21.15.133:0/2026619074 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c0149c0 con 0x56173df1c990 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 1 -- 172.21.15.133:0/2026619074 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f684c0288d0 con 0x56173df1c990 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 -- 172.21.15.133:0/2026619074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56173dce5e00 con 0x56173df1c990 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 1 -- 172.21.15.133:0/2026619074 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f684c028a90 con 0x56173df1c990 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 10 client.5748 fetch_fsmap learned FSMap version 22 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 -- 172.21.15.133:0/2026619074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56173da1ccc0 con 0x56173df1c990 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 1 -- 172.21.15.133:0/2026619074 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56173dce5e00 con 0x56173df1c990 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 1 -- 172.21.15.133:0/2026619074 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f684c028bf0 con 0x56173df1c990 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 10 client.5748 fetch_fsmap finished waiting for FSMap version 22 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 10 client.5748 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 20 client.5748 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x56173df5d090 0x56173df5d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 4 client.5748 mds_command: new command op to 5054 tid=0[{"prefix": "status"}] 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 -- 172.21.15.133:0/2026619074 --> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56173dd19160 con 0x56173df5d090 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859660640 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x56173df5d090 0x56173df5d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f6859660640 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x56173df5d090 0x56173df5d470 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=527445d55559cb64 server_cookie=690c294896a5bc74 in_seq=0 out_seq=0 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 10 client.5748 ms_handle_connect on v2:172.21.15.142:6832/898789604 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 1 -- 172.21.15.133:0/2026619074 <== mds.2 v2:172.21.15.142:6832/898789604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56173dd19160 con 0x56173df5d090 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 10 client.5748 handle_command_reply: tid=0 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 client.5748 shutdown 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 -- 172.21.15.133:0/2026619074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 msgr2=0x56173df5cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173df5cb50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f684c001be0 tx=0x7f684c009040 comp rx=0 tx=0).stop 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 -- 172.21.15.133:0/2026619074 shutdown_connections 2023-12-18T10:19:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x56173df5d090 0x56173df5d470 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56173df1c990 0x56173df5cb50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56173df1c070 0x56173df79420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f682ffff640 0 client.5748 ms_handle_reset on v2:172.21.15.142:6832/898789604 2023-12-18T10:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 --2- 172.21.15.133:0/2026619074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56173ded21c0 0x56173df78ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 -- 172.21.15.133:0/2026619074 >> 172.21.15.133:0/2026619074 conn(0x56173ded8950 msgr2=0x56173dedd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 -- 172.21.15.133:0/2026619074 shutdown_connections 2023-12-18T10:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 1 -- 172.21.15.133:0/2026619074 wait complete. 2023-12-18T10:19:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.801+0000 7f685ec25000 20 client.5748 trim_cache size 0 max 16384 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 2, 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5054, 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 1.7520361950000001, 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 22, 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 39, 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 39, 2023-12-18T10:19:41.811 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 18.669498293 2023-12-18T10:19:41.812 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:41.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 -- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6838065a90 msgr2=0x7f6838067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6838065a90 0x7f6838067f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f685406c4c0 tx=0x7f6844008040 comp rx=0 tx=0).stop 2023-12-18T10:19:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 -- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 msgr2=0x7f6854159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6854159450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f685001c850 tx=0x7f6840005800 comp rx=0 tx=0).stop 2023-12-18T10:19:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 -- 172.21.15.133:0/2500877886 shutdown_connections 2023-12-18T10:19:41.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6838065a90 0x7f6838067f50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f685415a070 0x7f68540c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6854159bf0 0x7f68540c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 --2- 172.21.15.133:0/2500877886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6840003980 0x7f6854159450 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 -- 172.21.15.133:0/2500877886 >> 172.21.15.133:0/2500877886 conn(0x7f685406a3e0 msgr2=0x7f6854070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 -- 172.21.15.133:0/2500877886 shutdown_connections 2023-12-18T10:19:41.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.805+0000 7f685b8c4640 1 -- 172.21.15.133:0/2500877886 wait complete. 2023-12-18T10:19:41.825 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-18T10:19:41.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8223e20640 1 Processor -- start 2023-12-18T10:19:41.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8223e20640 1 -- start start 2023-12-18T10:19:41.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8223e20640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f821c0c1280 0x7f821c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8223e20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0cb340 0x7f821c0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8223e20640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c06fdb0 con 0x7f821c160cc0 2023-12-18T10:19:41.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8223e20640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c1654a0 con 0x7f821c0c1280 2023-12-18T10:19:41.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8223e20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c1610a0 con 0x7f821c0cb340 2023-12-18T10:19:41.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8221bbc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f821c160cc0 0x7f821c0cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60420/0 (socket says 172.21.15.133:60420) 2023-12-18T10:19:41.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8221bbc640 1 -- 172.21.15.133:0/2198527620 learned_addr learned my addr 172.21.15.133:0/2198527620 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:41.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f82213bb640 1 --2- 172.21.15.133:0/2198527620 >> v2:172.21.15.133:3300/0 conn(0x7f821c0c1280 0x7f821c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f82223bd640 1 --2- 172.21.15.133:0/2198527620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0cb340 0x7f821c0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f82213bb640 1 -- 172.21.15.133:0/2198527620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0cb340 msgr2=0x7f821c0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f82213bb640 1 --2- 172.21.15.133:0/2198527620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0cb340 0x7f821c0cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f82213bb640 1 -- 172.21.15.133:0/2198527620 >> v1:172.21.15.133:6789/0 conn(0x7f821c160cc0 legacy=0x7f821c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f82213bb640 1 -- 172.21.15.133:0/2198527620 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c164820 con 0x7f821c0c1280 2023-12-18T10:19:41.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f8220bba640 1 -- 172.21.15.133:0/2198527620 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846314673 0 0) 0x7f821c06fdb0 con 0x7f821c160cc0 2023-12-18T10:19:41.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.961+0000 7f82223bd640 1 --2- 172.21.15.133:0/2198527620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0cb340 0x7f821c0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f82213bb640 1 --2- 172.21.15.133:0/2198527620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0c1280 0x7f821c0cc400 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f820c0097c0 tx=0x7f820c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e01a93ae61ce28 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8220bba640 1 -- 172.21.15.133:0/2198527620 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0ab600 con 0x7f821c0c1280 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8220bba640 1 -- 172.21.15.133:0/2198527620 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c0a7050 con 0x7f821c0c1280 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8220bba640 1 -- 172.21.15.133:0/2198527620 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0ab980 con 0x7f821c0c1280 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8223e20640 1 -- 172.21.15.133:0/2198527620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0c1280 msgr2=0x7f821c0cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8223e20640 1 --2- 172.21.15.133:0/2198527620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0c1280 0x7f821c0cc400 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f820c0097c0 tx=0x7f820c01c330 comp rx=0 tx=0).stop 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8223e20640 1 -- 172.21.15.133:0/2198527620 shutdown_connections 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8223e20640 1 --2- 172.21.15.133:0/2198527620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0cb340 0x7f821c0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8223e20640 1 --2- 172.21.15.133:0/2198527620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c0c1280 0x7f821c0cc400 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8223e20640 1 -- 172.21.15.133:0/2198527620 >> 172.21.15.133:0/2198527620 conn(0x7f821c06a3e0 msgr2=0x7f821c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8223e20640 1 -- 172.21.15.133:0/2198527620 shutdown_connections 2023-12-18T10:19:41.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.965+0000 7f8223e20640 1 -- 172.21.15.133:0/2198527620 wait complete. 2023-12-18T10:19:41.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 Processor -- start 2023-12-18T10:19:41.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 -- start start 2023-12-18T10:19:41.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0c1280 0x7f821c15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821c0cb340 0x7f821c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c160cc0 0x7f821c0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c4590 con 0x7f821c160cc0 2023-12-18T10:19:41.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c15b5b0 con 0x7f821c0cb340 2023-12-18T10:19:41.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0c55d0 con 0x7f821c0c1280 2023-12-18T10:19:41.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c160cc0 0x7f821c0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c160cc0 0x7f821c0b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47542/0 (socket says 172.21.15.133:47542) 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 -- 172.21.15.133:0/3041302607 learned_addr learned my addr 172.21.15.133:0/3041302607 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8221bbc640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0c1280 0x7f821c15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82213bb640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821c0cb340 0x7f821c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 -- 172.21.15.133:0/3041302607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0c1280 msgr2=0x7f821c15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0c1280 0x7f821c15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 -- 172.21.15.133:0/3041302607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821c0cb340 msgr2=0x7f821c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821c0cb340 0x7f821c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 -- 172.21.15.133:0/3041302607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c009420 con 0x7f821c160cc0 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82223bd640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c160cc0 0x7f821c0b0df0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f821400cef0 tx=0x7f821400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82127fc640 1 -- 172.21.15.133:0/3041302607 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821400d840 con 0x7f821c160cc0 2023-12-18T10:19:41.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82127fc640 1 -- 172.21.15.133:0/3041302607 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821400d9c0 con 0x7f821c160cc0 2023-12-18T10:19:41.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f82127fc640 1 -- 172.21.15.133:0/3041302607 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821400dd70 con 0x7f821c160cc0 2023-12-18T10:19:41.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 -- 172.21.15.133:0/3041302607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0c58b0 con 0x7f821c160cc0 2023-12-18T10:19:41.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.969+0000 7f8223e20640 1 -- 172.21.15.133:0/3041302607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c0c5e70 con 0x7f821c160cc0 2023-12-18T10:19:41.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.973+0000 7f82127fc640 1 -- 172.21.15.133:0/3041302607 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f821401e3b0 con 0x7f821c160cc0 2023-12-18T10:19:41.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.973+0000 7f82127fc640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8200065a90 0x7f8200067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.973+0000 7f82127fc640 1 -- 172.21.15.133:0/3041302607 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8214083cb0 con 0x7f821c160cc0 2023-12-18T10:19:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.973+0000 7f8221bbc640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8200065a90 0x7f8200067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.973+0000 7f8227182000 1 Processor -- start 2023-12-18T10:19:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- start start 2023-12-18T10:19:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8221bbc640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8200065a90 0x7f8200067f50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8218000f70 tx=0x7f8218007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe070 0x55c3610fe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe990 0x55c3610b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3610b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360ed7c90 con 0x55c3610fe990 2023-12-18T10:19:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360f09220 con 0x55c3610fe070 2023-12-18T10:19:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c360f067f0 con 0x55c3610b41c0 2023-12-18T10:19:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe990 0x55c3610b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe990 0x55c3610b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47550/0 (socket says 172.21.15.133:47550) 2023-12-18T10:19:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 -- 172.21.15.133:0/108980423 learned_addr learned my addr 172.21.15.133:0/108980423 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82223bd640 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3610b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8221bbc640 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe070 0x55c3610fe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 -- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 msgr2=0x55c3610b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3610b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 -- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe070 msgr2=0x55c3610fe450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe070 0x55c3610fe450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 -- 172.21.15.133:0/108980423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c360bfe890 con 0x55c3610fe990 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82223bd640 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3610b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f82213bb640 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe990 0x55c3610b3c80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f820c019f60 tx=0x7f820c0a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b68c0bfa6fff03 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f81ff7fe640 1 -- 172.21.15.133:0/108980423 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0ab800 con 0x55c3610fe990 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f81ff7fe640 1 -- 172.21.15.133:0/108980423 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c0ab960 con 0x55c3610fe990 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f81ff7fe640 1 -- 172.21.15.133:0/108980423 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0abcf0 con 0x55c3610fe990 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- 172.21.15.133:0/108980423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe990 msgr2=0x55c3610b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe990 0x55c3610b3c80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f820c019f60 tx=0x7f820c0a6000 comp rx=0 tx=0).stop 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- 172.21.15.133:0/108980423 shutdown_connections 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3610b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe990 0x55c3610b3c80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 --2- 172.21.15.133:0/108980423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe070 0x55c3610fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- 172.21.15.133:0/108980423 >> 172.21.15.133:0/108980423 conn(0x55c3610ba950 msgr2=0x55c3610b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- 172.21.15.133:0/108980423 shutdown_connections 2023-12-18T10:19:41.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- 172.21.15.133:0/108980423 wait complete. 2023-12-18T10:19:41.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 -- start start 2023-12-18T10:19:41.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.977+0000 7f8227182000 1 Processor -- start 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3611057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe070 0x55c361105d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe990 0x55c3610ec030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360f020e0 con 0x55c3610fe070 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360ea1310 con 0x55c3610fe990 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c360ebf770 con 0x55c3610b41c0 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 10 client.0 _ll_register_callbacks cb 0x55c36109fb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe070 0x55c361105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe070 0x55c361105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47564/0 (socket says 172.21.15.133:47564) 2023-12-18T10:19:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82223bd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe990 0x55c3610ec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 -- 172.21.15.133:0/263400393 learned_addr learned my addr 172.21.15.133:0/263400393 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8221bbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3611057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 -- 172.21.15.133:0/263400393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 msgr2=0x55c3611057f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3611057f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 -- 172.21.15.133:0/263400393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe990 msgr2=0x55c3610ec030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe990 0x55c3610ec030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 -- 172.21.15.133:0/263400393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c0c5e70 con 0x55c3610fe070 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f82213bb640 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe070 0x55c361105d30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f820c008010 tx=0x7f820c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6f4357fda02f4a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f81fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f81fcff9640 1 -- 172.21.15.133:0/263400393 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c006a30 con 0x55c3610fe070 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f81fcff9640 1 -- 172.21.15.133:0/263400393 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f820c0c7480 con 0x55c3610fe070 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 -- 172.21.15.133:0/263400393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c360ed1c10 con 0x55c3610fe070 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f81fcff9640 1 -- 172.21.15.133:0/263400393 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820c0c7640 con 0x55c3610fe070 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 10 client.5763 fetch_fsmap learned FSMap version 22 2023-12-18T10:19:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 -- 172.21.15.133:0/263400393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7f821c164820 con 0x55c3610fe070 2023-12-18T10:19:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f81fcff9640 1 -- 172.21.15.133:0/263400393 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c360ed1c10 con 0x55c3610fe070 2023-12-18T10:19:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f81fcff9640 1 -- 172.21.15.133:0/263400393 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f820c0c77a0 con 0x55c3610fe070 2023-12-18T10:19:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 10 client.5763 fetch_fsmap finished waiting for FSMap version 22 2023-12-18T10:19:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 10 client.5763 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:19:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 20 client.5763 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x55c3610ecdd0 0x55c3610ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 4 client.5763 mds_command: new command op to 5499 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8227182000 1 -- 172.21.15.133:0/263400393 --> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c360f00a30 con 0x55c3610ecdd0 2023-12-18T10:19:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8221bbc640 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x55c3610ecdd0 0x55c3610ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f8221bbc640 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x55c3610ecdd0 0x55c3610ed1b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f2034999a3a7482 server_cookie=bf1d01f916680fd9 in_seq=0 out_seq=0 2023-12-18T10:19:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.981+0000 7f81fcff9640 10 client.5763 ms_handle_connect on v2:172.21.15.133:6834/3060654272 2023-12-18T10:19:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f81fcff9640 1 -- 172.21.15.133:0/263400393 <== mds.1 v2:172.21.15.133:6834/3060654272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c360f00a30 con 0x55c3610ecdd0 2023-12-18T10:19:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f81fcff9640 10 client.5763 handle_command_reply: tid=0 2023-12-18T10:19:41.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 client.5763 shutdown 2023-12-18T10:19:41.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 -- 172.21.15.133:0/263400393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe070 msgr2=0x55c361105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe070 0x55c361105d30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f820c008010 tx=0x7f820c0046d0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 -- 172.21.15.133:0/263400393 shutdown_connections 2023-12-18T10:19:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x55c3610ecdd0 0x55c3610ed1b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610fe990 0x55c3610ec030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610fe070 0x55c361105d30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 --2- 172.21.15.133:0/263400393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610b41c0 0x55c3611057f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f81fcff9640 0 client.5763 ms_handle_reset on v2:172.21.15.133:6834/3060654272 2023-12-18T10:19:41.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 -- 172.21.15.133:0/263400393 >> 172.21.15.133:0/263400393 conn(0x55c3610ba950 msgr2=0x55c3610b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:41.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 -- 172.21.15.133:0/263400393 shutdown_connections 2023-12-18T10:19:41.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 1 -- 172.21.15.133:0/263400393 wait complete. 2023-12-18T10:19:41.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:41.985+0000 7f8227182000 20 client.5763 trim_cache size 0 max 16384 2023-12-18T10:19:42.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 Processor -- start 2023-12-18T10:19:42.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- start start 2023-12-18T10:19:42.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610ba950 0x55c361156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610b41c0 0x55c361156a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 0x55c361156f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360bbf940 con 0x55c3610b41c0 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360f45ce0 con 0x55c3610ba950 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c360f03670 con 0x55c3610fe070 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610b41c0 0x55c361156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610b41c0 0x55c361156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47568/0 (socket says 172.21.15.133:47568) 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 -- 172.21.15.133:0/2808592357 learned_addr learned my addr 172.21.15.133:0/2808592357 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82223bd640 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 0x55c361156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8221bbc640 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610ba950 0x55c361156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 -- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 msgr2=0x55c361156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 0x55c361156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 -- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610ba950 msgr2=0x55c361156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610ba950 0x55c361156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 -- 172.21.15.133:0/2808592357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c360ec7260 con 0x55c3610b41c0 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8221bbc640 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610ba950 0x55c361156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f82213bb640 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610b41c0 0x55c361156a40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f820c01c370 tx=0x7f820c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e30229fdba763e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f81fffff640 1 -- 172.21.15.133:0/2808592357 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c006a30 con 0x55c3610b41c0 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f81fffff640 1 -- 172.21.15.133:0/2808592357 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c0c7cb0 con 0x55c3610b41c0 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f81fffff640 1 -- 172.21.15.133:0/2808592357 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c0c7480 con 0x55c3610b41c0 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- 172.21.15.133:0/2808592357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610b41c0 msgr2=0x55c361156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610b41c0 0x55c361156a40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f820c01c370 tx=0x7f820c009190 comp rx=0 tx=0).stop 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- 172.21.15.133:0/2808592357 shutdown_connections 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 0x55c361156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610b41c0 0x55c361156a40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 --2- 172.21.15.133:0/2808592357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610ba950 0x55c361156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- 172.21.15.133:0/2808592357 >> 172.21.15.133:0/2808592357 conn(0x55c3610fd7f0 msgr2=0x55c3610e9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- 172.21.15.133:0/2808592357 shutdown_connections 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- 172.21.15.133:0/2808592357 wait complete. 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 -- start start 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.001+0000 7f8227182000 1 Processor -- start 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610b41c0 0x55c36115af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610ba950 0x55c36115b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 0x55c361110e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360efda50 con 0x55c3610ba950 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360ecfa80 con 0x55c3610b41c0 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c360eaa860 con 0x55c3610fe070 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 10 client.0 _ll_register_callbacks cb 0x55c360eb0640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610ba950 0x55c36115b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610ba950 0x55c36115b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47574/0 (socket says 172.21.15.133:47574) 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 -- 172.21.15.133:0/626766422 learned_addr learned my addr 172.21.15.133:0/626766422 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8221bbc640 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610b41c0 0x55c36115af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82223bd640 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 0x55c361110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 -- 172.21.15.133:0/626766422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 msgr2=0x55c361110e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 0x55c361110e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 -- 172.21.15.133:0/626766422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610b41c0 msgr2=0x55c36115af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610b41c0 0x55c36115af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 -- 172.21.15.133:0/626766422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c164820 con 0x55c3610ba950 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f82213bb640 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610ba950 0x55c36115b470 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f820c0c0010 tx=0x7f820c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fbb6b5574421a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 1 -- 172.21.15.133:0/626766422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c004250 con 0x55c3610ba950 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 1 -- 172.21.15.133:0/626766422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f820c0043b0 con 0x55c3610ba950 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- 172.21.15.133:0/626766422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3610b8b70 con 0x55c3610ba950 2023-12-18T10:19:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 1 -- 172.21.15.133:0/626766422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820c0059a0 con 0x55c3610ba950 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 10 client.5769 fetch_fsmap learned FSMap version 22 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- 172.21.15.133:0/626766422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55c360ead3b0 con 0x55c3610ba950 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 1 -- 172.21.15.133:0/626766422 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c3610b8b70 con 0x55c3610ba950 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 1 -- 172.21.15.133:0/626766422 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f820c0e4070 con 0x55c3610ba950 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 10 client.5769 fetch_fsmap finished waiting for FSMap version 22 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 10 client.5769 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 20 client.5769 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x55c3610fe990 0x55c361111810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 4 client.5769 mds_command: new command op to 5499 tid=0[{"prefix": "status"}] 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- 172.21.15.133:0/626766422 --> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c360ec7e00 con 0x55c3610fe990 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8221bbc640 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x55c3610fe990 0x55c361111810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8221bbc640 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x55c3610fe990 0x55c361111810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9e53b3d69975a55 server_cookie=498b80ea254c53ad in_seq=0 out_seq=0 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 10 client.5769 ms_handle_connect on v2:172.21.15.133:6834/3060654272 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 1 -- 172.21.15.133:0/626766422 <== mds.1 v2:172.21.15.133:6834/3060654272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c360ec7e00 con 0x55c3610fe990 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 10 client.5769 handle_command_reply: tid=0 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 client.5769 shutdown 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- 172.21.15.133:0/626766422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610ba950 msgr2=0x55c36115b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610ba950 0x55c36115b470 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f820c0c0010 tx=0x7f820c01ab70 comp rx=0 tx=0).stop 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- 172.21.15.133:0/626766422 shutdown_connections 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x55c3610fe990 0x55c361111810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c3610fe070 0x55c361110e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c3610ba950 0x55c36115b470 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 --2- 172.21.15.133:0/626766422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c3610b41c0 0x55c36115af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f81fcff9640 0 client.5769 ms_handle_reset on v2:172.21.15.133:6834/3060654272 2023-12-18T10:19:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.005+0000 7f8227182000 1 -- 172.21.15.133:0/626766422 >> 172.21.15.133:0/626766422 conn(0x55c3610fd7f0 msgr2=0x55c3610e9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8227182000 1 -- 172.21.15.133:0/626766422 shutdown_connections 2023-12-18T10:19:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8227182000 1 -- 172.21.15.133:0/626766422 wait complete. 2023-12-18T10:19:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8227182000 20 client.5769 trim_cache size 0 max 16384 2023-12-18T10:19:42.019 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 1, 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5499, 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 2.968261692, 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 22, 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 39, 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 39, 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 18.878808553999999 2023-12-18T10:19:42.020 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:42.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 -- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8200065a90 msgr2=0x7f8200067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8200065a90 0x7f8200067f50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8218000f70 tx=0x7f8218007c10 comp rx=0 tx=0).stop 2023-12-18T10:19:42.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 -- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c160cc0 msgr2=0x7f821c0b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c160cc0 0x7f821c0b0df0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f821400cef0 tx=0x7f821400a710 comp rx=0 tx=0).stop 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 -- 172.21.15.133:0/3041302607 shutdown_connections 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8200065a90 0x7f8200067f50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f821c160cc0 0x7f821c0b0df0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f821c0cb340 0x7f821c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 --2- 172.21.15.133:0/3041302607 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f821c0c1280 0x7f821c15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 -- 172.21.15.133:0/3041302607 >> 172.21.15.133:0/3041302607 conn(0x7f821c06a3e0 msgr2=0x7f821c0af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 -- 172.21.15.133:0/3041302607 shutdown_connections 2023-12-18T10:19:42.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.009+0000 7f8223e20640 1 -- 172.21.15.133:0/3041302607 wait complete. 2023-12-18T10:19:42.029 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-18T10:19:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.165+0000 7fe941c8c640 1 Processor -- start 2023-12-18T10:19:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe941c8c640 1 -- start start 2023-12-18T10:19:42.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe941c8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe93c158c20 0x7fe93c070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe941c8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c15c800 0x7fe93c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe941c8c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93c0cb440 con 0x7fe93c0cafb0 2023-12-18T10:19:42.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe941c8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c070b80 con 0x7fe93c158c20 2023-12-18T10:19:42.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe941c8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c070e60 con 0x7fe93c15c800 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93b7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe93c158c20 0x7fe93c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93affd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c15c800 0x7fe93c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93bfff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe93c0cafb0 0x7fe93c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:52844/0 (socket says 172.21.15.133:52844) 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93b7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe93c158c20 0x7fe93c070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:39106/0 (socket says 172.21.15.133:39106) 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93bfff640 1 -- 172.21.15.133:0/409457916 learned_addr learned my addr 172.21.15.133:0/409457916 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93b7fe640 1 -- 172.21.15.133:0/409457916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c15c800 msgr2=0x7fe93c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/409457916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c15c800 0x7fe93c0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93b7fe640 1 -- 172.21.15.133:0/409457916 >> v1:172.21.15.142:6789/0 conn(0x7fe93c0cafb0 legacy=0x7fe93c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93b7fe640 1 -- 172.21.15.133:0/409457916 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c071140 con 0x7fe93c158c20 2023-12-18T10:19:42.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.169+0000 7fe93a7fc640 1 -- 172.21.15.133:0/409457916 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265439163 0 0) 0x7fe93c0cb440 con 0x7fe93c0cafb0 2023-12-18T10:19:42.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/409457916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c158c20 0x7fe93c070510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00b870 tx=0x7fe92c01c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7096d746bbc5099c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe93a7fc640 1 -- 172.21.15.133:0/409457916 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0a58c0 con 0x7fe93c158c20 2023-12-18T10:19:42.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe93a7fc640 1 -- 172.21.15.133:0/409457916 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c0a5a20 con 0x7fe93c158c20 2023-12-18T10:19:42.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe93a7fc640 1 -- 172.21.15.133:0/409457916 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0a5db0 con 0x7fe93c158c20 2023-12-18T10:19:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 -- 172.21.15.133:0/409457916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c158c20 msgr2=0x7fe93c070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 --2- 172.21.15.133:0/409457916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c158c20 0x7fe93c070510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00b870 tx=0x7fe92c01c880 comp rx=0 tx=0).stop 2023-12-18T10:19:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 -- 172.21.15.133:0/409457916 shutdown_connections 2023-12-18T10:19:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 --2- 172.21.15.133:0/409457916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c15c800 0x7fe93c0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 --2- 172.21.15.133:0/409457916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c158c20 0x7fe93c070510 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 -- 172.21.15.133:0/409457916 >> 172.21.15.133:0/409457916 conn(0x7fe93c06a3e0 msgr2=0x7fe93c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 -- 172.21.15.133:0/409457916 shutdown_connections 2023-12-18T10:19:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 -- 172.21.15.133:0/409457916 wait complete. 2023-12-18T10:19:42.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.173+0000 7fe941c8c640 1 Processor -- start 2023-12-18T10:19:42.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 -- start start 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0cafb0 0x7fe93c0b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c158c20 0x7fe93c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c15c800 0x7fe93c0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c14c730 con 0x7fe93c0cafb0 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c1480d0 con 0x7fe93c15c800 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c14bab0 con 0x7fe93c158c20 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0cafb0 0x7fe93c0b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0cafb0 0x7fe93c0b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47588/0 (socket says 172.21.15.133:47588) 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 -- 172.21.15.133:0/2178607946 learned_addr learned my addr 172.21.15.133:0/2178607946 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93affd640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c158c20 0x7fe93c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93bfff640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c15c800 0x7fe93c0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 -- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c158c20 msgr2=0x7fe93c0c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c158c20 0x7fe93c0c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 -- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c15c800 msgr2=0x7fe93c0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c15c800 0x7fe93c0c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 -- 172.21.15.133:0/2178607946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c00b4d0 con 0x7fe93c0cafb0 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93bfff640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c15c800 0x7fe93c0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0cafb0 0x7fe93c0b3950 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00b870 tx=0x7fe92c019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe923fff640 1 -- 172.21.15.133:0/2178607946 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0ad910 con 0x7fe93c0cafb0 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe923fff640 1 -- 172.21.15.133:0/2178607946 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c0ada70 con 0x7fe93c0cafb0 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe923fff640 1 -- 172.21.15.133:0/2178607946 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0ade20 con 0x7fe93c0cafb0 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 -- 172.21.15.133:0/2178607946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c0c8800 con 0x7fe93c0cafb0 2023-12-18T10:19:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.177+0000 7fe941c8c640 1 -- 172.21.15.133:0/2178607946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c14c070 con 0x7fe93c0cafb0 2023-12-18T10:19:42.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe923fff640 1 -- 172.21.15.133:0/2178607946 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe92c0b4050 con 0x7fe93c0cafb0 2023-12-18T10:19:42.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe923fff640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe928065a60 0x7fe928067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe923fff640 1 -- 172.21.15.133:0/2178607946 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe92c11e180 con 0x7fe93c0cafb0 2023-12-18T10:19:42.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe93affd640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe928065a60 0x7fe928067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe944ffb000 1 Processor -- start 2023-12-18T10:19:42.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe93affd640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe928065a60 0x7fe928067f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0c50b0 tx=0x7fe93000f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe944ffb000 1 -- start start 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f033d5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 0x559f0338ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f0338b1c0 0x559f0338b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe944ffb000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f031aec90 con 0x559f0338b1c0 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe944ffb000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f031e0220 con 0x559f033d5990 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe944ffb000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f031dd7f0 con 0x559f033d5070 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe93bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f0338b1c0 0x559f0338b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe93bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f0338b1c0 0x559f0338b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47604/0 (socket says 172.21.15.133:47604) 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe93b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f033d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe93bfff640 1 -- 172.21.15.133:0/2300526752 learned_addr learned my addr 172.21.15.133:0/2300526752 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:42.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.181+0000 7fe93affd640 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 0x559f0338ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93bfff640 1 -- 172.21.15.133:0/2300526752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 msgr2=0x559f033d5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93bfff640 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f033d5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93bfff640 1 -- 172.21.15.133:0/2300526752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 msgr2=0x559f0338ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93bfff640 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 0x559f0338ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93bfff640 1 -- 172.21.15.133:0/2300526752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f02ed5890 con 0x559f0338b1c0 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f033d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93bfff640 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f0338b1c0 0x559f0338b5a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe934001f00 tx=0x7fe93400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb578e5d752cd37a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe9217fa640 1 -- 172.21.15.133:0/2300526752 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934002110 con 0x559f0338b1c0 2023-12-18T10:19:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe9217fa640 1 -- 172.21.15.133:0/2300526752 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934004d70 con 0x559f0338b1c0 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe9217fa640 1 -- 172.21.15.133:0/2300526752 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340072d0 con 0x559f0338b1c0 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- 172.21.15.133:0/2300526752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f0338b1c0 msgr2=0x559f0338b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f0338b1c0 0x559f0338b5a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe934001f00 tx=0x7fe93400d520 comp rx=0 tx=0).stop 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- 172.21.15.133:0/2300526752 shutdown_connections 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f0338b1c0 0x559f0338b5a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 0x559f0338ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2300526752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f033d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- 172.21.15.133:0/2300526752 >> 172.21.15.133:0/2300526752 conn(0x559f03391950 msgr2=0x559f03389560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- 172.21.15.133:0/2300526752 shutdown_connections 2023-12-18T10:19:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- 172.21.15.133:0/2300526752 wait complete. 2023-12-18T10:19:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- start start 2023-12-18T10:19:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 Processor -- start 2023-12-18T10:19:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 0x559f03390780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03397080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5990 0x559f033975c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f031d90e0 con 0x559f033d5070 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f03178310 con 0x559f0338b1c0 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f03196770 con 0x559f033d5990 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe944ffb000 10 client.0 _ll_register_callbacks cb 0x559f03376b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03397080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03397080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47614/0 (socket says 172.21.15.133:47614) 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93affd640 1 -- 172.21.15.133:0/182061066 learned_addr learned my addr 172.21.15.133:0/182061066 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 0x559f03390780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.185+0000 7fe93bfff640 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5990 0x559f033975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe93affd640 1 -- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5990 msgr2=0x559f033975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe93affd640 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5990 0x559f033975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe93affd640 1 -- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 msgr2=0x559f03390780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe93affd640 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 0x559f03390780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe93affd640 1 -- 172.21.15.133:0/182061066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c14c070 con 0x559f033d5070 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe93affd640 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03397080 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe930019b10 tx=0x7fe9300046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b3d70a9b084462 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 1 -- 172.21.15.133:0/182061066 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930012050 con 0x559f033d5070 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 -- 172.21.15.133:0/182061066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f031a8c10 con 0x559f033d5070 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 1 -- 172.21.15.133:0/182061066 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe93001a9c0 con 0x559f033d5070 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 1 -- 172.21.15.133:0/182061066 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe93000bbb0 con 0x559f033d5070 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 10 client.5778 fetch_fsmap learned FSMap version 22 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 -- 172.21.15.133:0/182061066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7fe934001b30 con 0x559f033d5070 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 1 -- 172.21.15.133:0/182061066 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f031a8c10 con 0x559f033d5070 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 1 -- 172.21.15.133:0/182061066 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fe93001abd0 con 0x559f033d5070 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 10 client.5778 fetch_fsmap finished waiting for FSMap version 22 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 10 client.5778 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 20 client.5778 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559f033dc8d0 0x559f033dccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 4 client.5778 mds_command: new command op to 5508 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:42.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 -- 172.21.15.133:0/182061066 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f031d7a30 con 0x559f033dc8d0 2023-12-18T10:19:42.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559f033dc8d0 0x559f033dccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559f033dc8d0 0x559f033dccb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5061a56eb3e2b67d server_cookie=52233be9c5d96a7e in_seq=0 out_seq=0 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 10 client.5778 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 1 -- 172.21.15.133:0/182061066 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559f031d7a30 con 0x559f033dc8d0 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 10 client.5778 handle_command_reply: tid=0 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 client.5778 shutdown 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 -- 172.21.15.133:0/182061066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 msgr2=0x559f03397080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03397080 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe930019b10 tx=0x7fe9300046d0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 -- 172.21.15.133:0/182061066 shutdown_connections 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559f033dc8d0 0x559f033dccb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5990 0x559f033975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03397080 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe91a7fc640 0 client.5778 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 --2- 172.21.15.133:0/182061066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 0x559f03390780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 -- 172.21.15.133:0/182061066 >> 172.21.15.133:0/182061066 conn(0x559f03391950 msgr2=0x559f03389c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 -- 172.21.15.133:0/182061066 shutdown_connections 2023-12-18T10:19:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 1 -- 172.21.15.133:0/182061066 wait complete. 2023-12-18T10:19:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.189+0000 7fe944ffb000 20 client.5778 trim_cache size 0 max 16384 2023-12-18T10:19:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe944ffb000 1 Processor -- start 2023-12-18T10:19:42.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe944ffb000 1 -- start start 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 0x559f0342ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f0342d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5990 0x559f0342d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe944ffb000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f02e96940 con 0x559f033d5990 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe944ffb000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f031a6a80 con 0x559f0338b1c0 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe944ffb000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f0317e570 con 0x559f033d5070 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe93bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5990 0x559f0342d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe93bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5990 0x559f0342d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47628/0 (socket says 172.21.15.133:47628) 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe93bfff640 1 -- 172.21.15.133:0/3604542476 learned_addr learned my addr 172.21.15.133:0/3604542476 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:42.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.205+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 0x559f0342ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93affd640 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f0342d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93bfff640 1 -- 172.21.15.133:0/3604542476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 msgr2=0x559f0342d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93bfff640 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f0342d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93bfff640 1 -- 172.21.15.133:0/3604542476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 msgr2=0x559f0342ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93bfff640 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 0x559f0342ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93bfff640 1 -- 172.21.15.133:0/3604542476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f0319e260 con 0x559f033d5990 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93bfff640 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5990 0x559f0342d950 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe934011000 tx=0x7fe934006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc3c9997ec2872a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe921ffb640 1 -- 172.21.15.133:0/3604542476 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934002110 con 0x559f033d5990 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe921ffb640 1 -- 172.21.15.133:0/3604542476 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934007cf0 con 0x559f033d5990 2023-12-18T10:19:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe921ffb640 1 -- 172.21.15.133:0/3604542476 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934004b70 con 0x559f033d5990 2023-12-18T10:19:42.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- 172.21.15.133:0/3604542476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5990 msgr2=0x559f0342d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5990 0x559f0342d950 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe934011000 tx=0x7fe934006000 comp rx=0 tx=0).stop 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- 172.21.15.133:0/3604542476 shutdown_connections 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5990 0x559f0342d950 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f033d5070 0x559f0342d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 --2- 172.21.15.133:0/3604542476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f0338b1c0 0x559f0342ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- 172.21.15.133:0/3604542476 >> 172.21.15.133:0/3604542476 conn(0x559f03391950 msgr2=0x559f03396f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- 172.21.15.133:0/3604542476 shutdown_connections 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- 172.21.15.133:0/3604542476 wait complete. 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- start start 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 Processor -- start 2023-12-18T10:19:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f0338b1c0 0x559f03415b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03416090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 0x559f034165d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f0338dd70 con 0x559f033d5070 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f031d70b0 con 0x559f033d5990 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f031a0850 con 0x559f0338b1c0 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe944ffb000 10 client.0 _ll_register_callbacks cb 0x559f03187640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03416090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03416090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47642/0 (socket says 172.21.15.133:47642) 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93affd640 1 -- 172.21.15.133:0/2709968334 learned_addr learned my addr 172.21.15.133:0/2709968334 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f0338b1c0 0x559f03415b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.209+0000 7fe93bfff640 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 0x559f034165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93affd640 1 -- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f0338b1c0 msgr2=0x559f03415b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93affd640 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f0338b1c0 0x559f03415b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93affd640 1 -- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 msgr2=0x559f034165d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93affd640 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 0x559f034165d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93affd640 1 -- 172.21.15.133:0/2709968334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f02ed5890 con 0x559f033d5070 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f0338b1c0 0x559f03415b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93affd640 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03416090 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe930019b10 tx=0x7fe930019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ce2548caae8de7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 1 -- 172.21.15.133:0/2709968334 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93003e070 con 0x559f033d5070 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 1 -- 172.21.15.133:0/2709968334 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe93002f4e0 con 0x559f033d5070 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 -- 172.21.15.133:0/2709968334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f0319ee00 con 0x559f033d5070 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 1 -- 172.21.15.133:0/2709968334 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe930012040 con 0x559f033d5070 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 10 client.5784 fetch_fsmap learned FSMap version 22 2023-12-18T10:19:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 -- 172.21.15.133:0/2709968334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x559f031843b0 con 0x559f033d5070 2023-12-18T10:19:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 1 -- 172.21.15.133:0/2709968334 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559f0319ee00 con 0x559f033d5070 2023-12-18T10:19:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 1 -- 172.21.15.133:0/2709968334 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fe93001a7c0 con 0x559f033d5070 2023-12-18T10:19:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 10 client.5784 fetch_fsmap finished waiting for FSMap version 22 2023-12-18T10:19:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 10 client.5784 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:19:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 20 client.5784 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559f03416b10 0x559f03416ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 4 client.5784 mds_command: new command op to 5508 tid=0[{"prefix": "status"}] 2023-12-18T10:19:42.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 -- 172.21.15.133:0/2709968334 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f031d2160 con 0x559f03416b10 2023-12-18T10:19:42.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559f03416b10 0x559f03416ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 10 client.5784 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe93b7fe640 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559f03416b10 0x559f03416ef0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c251c6210409805a server_cookie=dfe4a540b8ab7df0 in_seq=0 out_seq=0 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 1 -- 172.21.15.133:0/2709968334 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559f031d2160 con 0x559f03416b10 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 10 client.5784 handle_command_reply: tid=0 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 client.5784 shutdown 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 -- 172.21.15.133:0/2709968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 msgr2=0x559f03416090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03416090 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe930019b10 tx=0x7fe930019000 comp rx=0 tx=0).stop 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 -- 172.21.15.133:0/2709968334 shutdown_connections 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559f033d5990 0x559f034165d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559f033d5070 0x559f03416090 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x559f03416b10 0x559f03416ef0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 --2- 172.21.15.133:0/2709968334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559f0338b1c0 0x559f03415b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe91a7fc640 0 client.5784 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 -- 172.21.15.133:0/2709968334 >> 172.21.15.133:0/2709968334 conn(0x559f03391950 msgr2=0x559f033d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 -- 172.21.15.133:0/2709968334 shutdown_connections 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 1 -- 172.21.15.133:0/2709968334 wait complete. 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe944ffb000 20 client.5784 trim_cache size 0 max 16384 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:19:42.222 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5508, 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 11.831235731, 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 22, 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 39, 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 39, 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 19.080620400000001 2023-12-18T10:19:42.223 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 -- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe928065a60 msgr2=0x7fe928067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe928065a60 0x7fe928067f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe93c0c50b0 tx=0x7fe93000f040 comp rx=0 tx=0).stop 2023-12-18T10:19:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 -- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0cafb0 msgr2=0x7fe93c0b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0cafb0 0x7fe93c0b3950 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe92c00b870 tx=0x7fe92c019620 comp rx=0 tx=0).stop 2023-12-18T10:19:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 -- 172.21.15.133:0/2178607946 shutdown_connections 2023-12-18T10:19:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe928065a60 0x7fe928067f20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe93c15c800 0x7fe93c0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe93c158c20 0x7fe93c0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 --2- 172.21.15.133:0/2178607946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe93c0cafb0 0x7fe93c0b3950 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 -- 172.21.15.133:0/2178607946 >> 172.21.15.133:0/2178607946 conn(0x7fe93c06a3e0 msgr2=0x7fe93c150b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.213+0000 7fe941c8c640 1 -- 172.21.15.133:0/2178607946 shutdown_connections 2023-12-18T10:19:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.217+0000 7fe941c8c640 1 -- 172.21.15.133:0/2178607946 wait complete. 2023-12-18T10:19:42.236 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:19:42.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.369+0000 7fedc92e5640 1 Processor -- start 2023-12-18T10:19:42.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.369+0000 7fedc92e5640 1 -- start start 2023-12-18T10:19:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc92e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc406c4f0 0x7fedc40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc92e5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fedc40c9e30 0x7fedc4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc92e5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40c9460 con 0x7fedc41570c0 2023-12-18T10:19:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc92e5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc41574a0 con 0x7fedc40c9e30 2023-12-18T10:19:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc92e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40c8b30 con 0x7fedc406c4f0 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc2ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fedc41570c0 0x7fedc406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60428/0 (socket says 172.21.15.133:60428) 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc2ffd640 1 -- 172.21.15.133:0/3182885553 learned_addr learned my addr 172.21.15.133:0/3182885553 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedba7fc640 1 --2- 172.21.15.133:0/3182885553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc406c4f0 0x7fedc40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc37fe640 1 --2- 172.21.15.133:0/3182885553 >> v2:172.21.15.142:3300/0 conn(0x7fedc40c9e30 0x7fedc4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc27fc640 1 -- 172.21.15.133:0/3182885553 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082177525 0 0) 0x7fedc40c9460 con 0x7fedc41570c0 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedc27fc640 1 -- 172.21.15.133:0/3182885553 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb0003530 con 0x7fedc41570c0 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedba7fc640 1 -- 172.21.15.133:0/3182885553 >> v2:172.21.15.142:3300/0 conn(0x7fedc40c9e30 msgr2=0x7fedc4070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedba7fc640 1 --2- 172.21.15.133:0/3182885553 >> v2:172.21.15.142:3300/0 conn(0x7fedc40c9e30 0x7fedc4070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedba7fc640 1 -- 172.21.15.133:0/3182885553 >> v1:172.21.15.133:6789/0 conn(0x7fedc41570c0 legacy=0x7fedc406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.373+0000 7fedba7fc640 1 -- 172.21.15.133:0/3182885553 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40c8e10 con 0x7fedc406c4f0 2023-12-18T10:19:42.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedba7fc640 1 --2- 172.21.15.133:0/3182885553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc406c4f0 0x7fedc40c98f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fedac009d90 tx=0x7fedac01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5107399e1e93db62 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc27fc640 1 -- 172.21.15.133:0/3182885553 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0a5860 con 0x7fedc406c4f0 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc27fc640 1 -- 172.21.15.133:0/3182885553 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0a59c0 con 0x7fedc406c4f0 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc27fc640 1 -- 172.21.15.133:0/3182885553 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0a5d50 con 0x7fedc406c4f0 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- 172.21.15.133:0/3182885553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc406c4f0 msgr2=0x7fedc40c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 --2- 172.21.15.133:0/3182885553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc406c4f0 0x7fedc40c98f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fedac009d90 tx=0x7fedac01c890 comp rx=0 tx=0).stop 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- 172.21.15.133:0/3182885553 shutdown_connections 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 --2- 172.21.15.133:0/3182885553 >> v2:172.21.15.142:3300/0 conn(0x7fedc40c9e30 0x7fedc4070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 --2- 172.21.15.133:0/3182885553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc406c4f0 0x7fedc40c98f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- 172.21.15.133:0/3182885553 >> 172.21.15.133:0/3182885553 conn(0x7fedc406a3e0 msgr2=0x7fedc40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- 172.21.15.133:0/3182885553 shutdown_connections 2023-12-18T10:19:42.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- 172.21.15.133:0/3182885553 wait complete. 2023-12-18T10:19:42.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 Processor -- start 2023-12-18T10:19:42.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- start start 2023-12-18T10:19:42.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc406c4f0 0x7fedc4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c9e30 0x7fedc415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc41570c0 0x7fedc4148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40cdca0 con 0x7fedc40c9e30 2023-12-18T10:19:42.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc415a5f0 con 0x7fedc406c4f0 2023-12-18T10:19:42.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedc92e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4159c90 con 0x7fedc41570c0 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.377+0000 7fedba7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c9e30 0x7fedc415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedba7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c9e30 0x7fedc415a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47646/0 (socket says 172.21.15.133:47646) 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedba7fc640 1 -- 172.21.15.133:0/1540213169 learned_addr learned my addr 172.21.15.133:0/1540213169 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedc2ffd640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc406c4f0 0x7fedc4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedc37fe640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc41570c0 0x7fedc4148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedba7fc640 1 -- 172.21.15.133:0/1540213169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc41570c0 msgr2=0x7fedc4148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedba7fc640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc41570c0 0x7fedc4148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedba7fc640 1 -- 172.21.15.133:0/1540213169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc406c4f0 msgr2=0x7fedc4148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedba7fc640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc406c4f0 0x7fedc4148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedba7fc640 1 -- 172.21.15.133:0/1540213169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009a70 con 0x7fedc40c9e30 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedba7fc640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c9e30 0x7fedc415a0b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fedac0b0040 tx=0x7fedac019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedbbfff640 1 -- 172.21.15.133:0/1540213169 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0b9650 con 0x7fedc40c9e30 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedbbfff640 1 -- 172.21.15.133:0/1540213169 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0b97b0 con 0x7fedc40c9e30 2023-12-18T10:19:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedbbfff640 1 -- 172.21.15.133:0/1540213169 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0b9b20 con 0x7fedc40c9e30 2023-12-18T10:19:42.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc4159940 con 0x7fedc40c9e30 2023-12-18T10:19:42.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc40cb260 con 0x7fedc40c9e30 2023-12-18T10:19:42.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc40735b0 con 0x7fedc40c9e30 2023-12-18T10:19:42.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedbbfff640 1 -- 172.21.15.133:0/1540213169 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fedac0b9c80 con 0x7fedc40c9e30 2023-12-18T10:19:42.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedbbfff640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feda4065a60 0x7feda4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:42.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedbbfff640 1 -- 172.21.15.133:0/1540213169 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fedac11e500 con 0x7fedc40c9e30 2023-12-18T10:19:42.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.381+0000 7fedc2ffd640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feda4065a60 0x7feda4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:42.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.385+0000 7fedc2ffd640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feda4065a60 0x7feda4067f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedb40011f0 tx=0x7fedb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:42.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.385+0000 7fedbbfff640 1 -- 172.21.15.133:0/1540213169 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fedac0ebd70 con 0x7fedc40c9e30 2023-12-18T10:19:42.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedc40ce040 con 0x7fedc40c9e30 2023-12-18T10:19:42.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedbbfff640 1 -- 172.21.15.133:0/1540213169 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fedac0ef390 con 0x7fedc40c9e30 2023-12-18T10:19:42.572 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:19:42.572 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:41.052757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5508,"mds_1":5499,"mds_2":5054},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5054":{"gid":5054,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5499":{"gid":5499,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:19:42.572 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feda4065a60 msgr2=0x7feda4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feda4065a60 0x7feda4067f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedb40011f0 tx=0x7fedb4009040 comp rx=0 tx=0).stop 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c9e30 msgr2=0x7fedc415a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c9e30 0x7fedc415a0b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fedac0b0040 tx=0x7fedac019630 comp rx=0 tx=0).stop 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 shutdown_connections 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feda4065a60 0x7feda4067f20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedc41570c0 0x7fedc4148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c9e30 0x7fedc415a0b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 --2- 172.21.15.133:0/1540213169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedc406c4f0 0x7fedc4148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 >> 172.21.15.133:0/1540213169 conn(0x7fedc406a3e0 msgr2=0x7fedc40c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 shutdown_connections 2023-12-18T10:19:42.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:42.568+0000 7fedc92e5640 1 -- 172.21.15.133:0/1540213169 wait complete. 2023-12-18T10:19:42.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:42.593 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:19:42.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:42.631 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:19:42.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:42.707 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-12-18T10:19:42.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:42.765 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-12-18T10:19:42.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:42.817 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-12-18T10:19:42.870 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:19:43.036 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:19:43.036 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:19:43.037 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:19:45.037 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:19:45.203 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:19:45.203 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:19:45.203 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:19:47.204 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:19:47.370 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:19:47.370 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:19:47.371 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:19:49.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:19:49.539 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-12-18T10:19:49.539 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:19:49.539 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:19:49.540 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:19:49.707 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:19:49.708 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:19:49.708 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:19:51.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:19:51.875 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:19:51.876 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:19:51.876 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:19:53.877 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:19:54.046 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-12-18T10:19:54.047 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:19:54.047 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:19:54.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:19:54.212 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:19:54.213 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:19:54.213 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:19:54.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 flush journal 2023-12-18T10:19:54.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.348+0000 7f81e25bc640 1 Processor -- start 2023-12-18T10:19:54.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.348+0000 7f81e25bc640 1 -- start start 2023-12-18T10:19:54.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e25bc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81dc0ceac0 0x7f81dc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e25bc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc0c9390 con 0x7f81dc070820 2023-12-18T10:19:54.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e25bc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc15aee0 con 0x7f81dc1582d0 2023-12-18T10:19:54.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e25bc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc15b1c0 con 0x7f81dc0ceac0 2023-12-18T10:19:54.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e0b59640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81dc0ceac0 0x7f81dc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e0b59640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81dc0ceac0 0x7f81dc0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35040/0 (socket says 172.21.15.133:35040) 2023-12-18T10:19:54.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e0b59640 1 -- 172.21.15.133:0/3907787188 learned_addr learned my addr 172.21.15.133:0/3907787188 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81db7fe640 1 --1- 172.21.15.133:0/3907787188 >> v1:172.21.15.133:6789/0 conn(0x7f81dc070820 0x7f81dc0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40156/0 (socket says 172.21.15.133:40156) 2023-12-18T10:19:54.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e0b59640 1 -- 172.21.15.133:0/3907787188 >> v1:172.21.15.142:6789/0 conn(0x7f81dc1582d0 legacy=0x7f81dc0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e0b59640 1 -- 172.21.15.133:0/3907787188 >> v1:172.21.15.133:6789/0 conn(0x7f81dc070820 legacy=0x7f81dc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.352+0000 7f81e0b59640 1 -- 172.21.15.133:0/3907787188 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc15b4a0 con 0x7f81dc0ceac0 2023-12-18T10:19:54.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e0b59640 1 --2- 172.21.15.133:0/3907787188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc0ceac0 0x7f81dc0c8e50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009e50 tx=0x7f81d401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7901c5f5e2d1df7a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81daffd640 1 -- 172.21.15.133:0/3907787188 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40a58d0 con 0x7f81dc0ceac0 2023-12-18T10:19:54.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81daffd640 1 -- 172.21.15.133:0/3907787188 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d40a5a30 con 0x7f81dc0ceac0 2023-12-18T10:19:54.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81daffd640 1 -- 172.21.15.133:0/3907787188 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40a5dc0 con 0x7f81dc0ceac0 2023-12-18T10:19:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 -- 172.21.15.133:0/3907787188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc0ceac0 msgr2=0x7f81dc0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 --2- 172.21.15.133:0/3907787188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc0ceac0 0x7f81dc0c8e50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009e50 tx=0x7f81d401c9e0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 -- 172.21.15.133:0/3907787188 shutdown_connections 2023-12-18T10:19:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 --2- 172.21.15.133:0/3907787188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc0ceac0 0x7f81dc0c8e50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 -- 172.21.15.133:0/3907787188 >> 172.21.15.133:0/3907787188 conn(0x7f81dc06a2a0 msgr2=0x7f81dc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 -- 172.21.15.133:0/3907787188 shutdown_connections 2023-12-18T10:19:54.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 -- 172.21.15.133:0/3907787188 wait complete. 2023-12-18T10:19:54.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 Processor -- start 2023-12-18T10:19:54.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.356+0000 7f81e25bc640 1 -- start start 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81e25bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc070820 0x7f81dc150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81e25bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81dc0ceac0 0x7f81dc06c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81e25bc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81dc1582d0 0x7f81dc151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81e25bc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc156920 con 0x7f81dc070820 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81e25bc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc155820 con 0x7f81dc1582d0 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81e25bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc155b00 con 0x7f81dc0ceac0 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc070820 0x7f81dc150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc070820 0x7f81dc150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35046/0 (socket says 172.21.15.133:35046) 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 -- 172.21.15.133:0/410382022 learned_addr learned my addr 172.21.15.133:0/410382022 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 -- 172.21.15.133:0/410382022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81dc0ceac0 msgr2=0x7f81dc06c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81dc0ceac0 0x7f81dc06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 -- 172.21.15.133:0/410382022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81dc1582d0 msgr2=0x7f81dc151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81dc1582d0 0x7f81dc151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 -- 172.21.15.133:0/410382022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4009b30 con 0x7f81dc070820 2023-12-18T10:19:54.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81dbfff640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc070820 0x7f81dc150470 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c3c0 tx=0x7f81cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81d8ff9640 1 -- 172.21.15.133:0/410382022 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0052d0 con 0x7f81dc070820 2023-12-18T10:19:54.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81d8ff9640 1 -- 172.21.15.133:0/410382022 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc005430 con 0x7f81dc070820 2023-12-18T10:19:54.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81d8ff9640 1 -- 172.21.15.133:0/410382022 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc003840 con 0x7f81dc070820 2023-12-18T10:19:54.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81e25bc640 1 -- 172.21.15.133:0/410382022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc156360 con 0x7f81dc070820 2023-12-18T10:19:54.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81e25bc640 1 -- 172.21.15.133:0/410382022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc0c3a80 con 0x7f81dc070820 2023-12-18T10:19:54.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.360+0000 7f81d8ff9640 1 -- 172.21.15.133:0/410382022 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f81cc0039a0 con 0x7f81dc070820 2023-12-18T10:19:54.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81d8ff9640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81c8065a60 0x7f81c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81d8ff9640 1 -- 172.21.15.133:0/410382022 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f81cc0828d0 con 0x7f81dc070820 2023-12-18T10:19:54.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81db7fe640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81c8065a60 0x7f81c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 Processor -- start 2023-12-18T10:19:54.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- start start 2023-12-18T10:19:54.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81db7fe640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81c8065a60 0x7f81c8067f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0ac780 tx=0x7f81d00079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 0x5653fbbc3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbb78a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbb793a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fba41430 con 0x5653fbb78fc0 2023-12-18T10:19:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fb9cf460 con 0x5653fbbc35a0 2023-12-18T10:19:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653fb9cca30 con 0x5653fbbc2c80 2023-12-18T10:19:54.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbb793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbb793a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35050/0 (socket says 172.21.15.133:35050) 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 -- 172.21.15.133:0/3370752767 learned_addr learned my addr 172.21.15.133:0/3370752767 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81db7fe640 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbb78a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81dbfff640 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 0x5653fbbc3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 -- 172.21.15.133:0/3370752767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 msgr2=0x5653fbbc3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 0x5653fbbc3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 -- 172.21.15.133:0/3370752767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 msgr2=0x5653fbb78a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbb78a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 -- 172.21.15.133:0/3370752767 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653fb6c4e20 con 0x5653fbb78fc0 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e0b59640 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbb793a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f81d40195f0 tx=0x7f81d4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84a2556368cd8bb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81c1ffb640 1 -- 172.21.15.133:0/3370752767 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4009150 con 0x5653fbb78fc0 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81c1ffb640 1 -- 172.21.15.133:0/3370752767 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d40a5ba0 con 0x5653fbb78fc0 2023-12-18T10:19:54.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81c1ffb640 1 -- 172.21.15.133:0/3370752767 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40092b0 con 0x5653fbb78fc0 2023-12-18T10:19:54.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- 172.21.15.133:0/3370752767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 msgr2=0x5653fbb793a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbb793a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f81d40195f0 tx=0x7f81d4004a50 comp rx=0 tx=0).stop 2023-12-18T10:19:54.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- 172.21.15.133:0/3370752767 shutdown_connections 2023-12-18T10:19:54.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbb793a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbb78a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 --2- 172.21.15.133:0/3370752767 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 0x5653fbbc3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- 172.21.15.133:0/3370752767 >> 172.21.15.133:0/3370752767 conn(0x5653fb977910 msgr2=0x5653fbb77360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- 172.21.15.133:0/3370752767 shutdown_connections 2023-12-18T10:19:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.364+0000 7f81e5913000 1 -- 172.21.15.133:0/3370752767 wait complete. 2023-12-18T10:19:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 -- start start 2023-12-18T10:19:54.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 Processor -- start 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbbc24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 0x5653fbbc3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbbc3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fb9c8320 con 0x5653fbb78fc0 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fb9674f0 con 0x5653fbbc35a0 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653fb9856e0 con 0x5653fbbc2c80 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 10 client.0 _ll_register_callbacks cb 0x5653fbb64980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbbc24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbbc24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35052/0 (socket says 172.21.15.133:35052) 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 -- 172.21.15.133:0/162593747 learned_addr learned my addr 172.21.15.133:0/162593747 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81db7fe640 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 0x5653fbbc3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e0b59640 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbbc3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 -- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 msgr2=0x5653fbbc3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 0x5653fbbc3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 -- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 msgr2=0x5653fbbc3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbbc3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 -- 172.21.15.133:0/162593747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc15b4a0 con 0x5653fbb78fc0 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e0b59640 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbbc3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81dbfff640 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbbc24b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f81cc053ce0 tx=0x7f81cc053ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8f03cefa4ac947 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81baffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81baffd640 1 -- 172.21.15.133:0/162593747 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc06b380 con 0x5653fbb78fc0 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 -- 172.21.15.133:0/162593747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653fb985120 con 0x5653fbb78fc0 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81baffd640 1 -- 172.21.15.133:0/162593747 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f81cc0521b0 con 0x5653fbb78fc0 2023-12-18T10:19:54.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81baffd640 1 -- 172.21.15.133:0/162593747 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81cc05b8a0 con 0x5653fbb78fc0 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 10 client.5805 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 -- 172.21.15.133:0/162593747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5653fb98d250 con 0x5653fbb78fc0 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81baffd640 1 -- 172.21.15.133:0/162593747 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc06f070 con 0x5653fbb78fc0 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81baffd640 1 -- 172.21.15.133:0/162593747 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f81cc04fb40 con 0x5653fbb78fc0 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 10 client.5805 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 10 client.5805 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 20 client.5805 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5653fbbc4c30 0x5653fbbd4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 4 client.5805 mds_command: new command op to 5508 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81e5913000 1 -- 172.21.15.133:0/162593747 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653fb9c6c70 con 0x5653fbbc4c30 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.368+0000 7f81db7fe640 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5653fbbc4c30 0x5653fbbd4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81db7fe640 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5653fbbc4c30 0x5653fbbd4f10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32add08a17f59d2c server_cookie=55ef65dad853e10d in_seq=0 out_seq=0 2023-12-18T10:19:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81baffd640 10 client.5805 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81baffd640 1 -- 172.21.15.133:0/162593747 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5653fb9c6c70 con 0x5653fbbc4c30 2023-12-18T10:19:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81baffd640 10 client.5805 handle_command_reply: tid=0 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 client.5805 shutdown 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 -- 172.21.15.133:0/162593747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 msgr2=0x5653fbbc24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbbc24b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f81cc053ce0 tx=0x7f81cc053ea0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 -- 172.21.15.133:0/162593747 shutdown_connections 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc35a0 0x5653fbbc3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5653fbbc4c30 0x5653fbbd4f10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc2c80 0x5653fbbc3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 --2- 172.21.15.133:0/162593747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbbc24b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81baffd640 0 client.5805 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 -- 172.21.15.133:0/162593747 >> 172.21.15.133:0/162593747 conn(0x5653fb977910 msgr2=0x5653fbb77a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 -- 172.21.15.133:0/162593747 shutdown_connections 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 1 -- 172.21.15.133:0/162593747 wait complete. 2023-12-18T10:19:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.372+0000 7f81e5913000 20 client.5805 trim_cache size 0 max 16384 2023-12-18T10:19:54.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e5913000 1 Processor -- start 2023-12-18T10:19:54.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e5913000 1 -- start start 2023-12-18T10:19:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e5913000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbb78fc0 0x5653fbbd5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e5913000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 0x5653fbbd6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e5913000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbbc35a0 0x5653fbbbc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e5913000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fb685aa0 con 0x5653fbbc35a0 2023-12-18T10:19:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e5913000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fb986480 con 0x5653fbbc2c80 2023-12-18T10:19:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e5913000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653fb96d820 con 0x5653fbb78fc0 2023-12-18T10:19:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e0b59640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbbc35a0 0x5653fbbbc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e0b59640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbbc35a0 0x5653fbbbc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35054/0 (socket says 172.21.15.133:35054) 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e0b59640 1 -- 172.21.15.133:0/3792377810 learned_addr learned my addr 172.21.15.133:0/3792377810 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81dbfff640 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbb78fc0 0x5653fbbd5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81db7fe640 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 0x5653fbbd6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e0b59640 1 -- 172.21.15.133:0/3792377810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbb78fc0 msgr2=0x5653fbbd5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e0b59640 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbb78fc0 0x5653fbbd5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e0b59640 1 -- 172.21.15.133:0/3792377810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 msgr2=0x5653fbbd6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e0b59640 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 0x5653fbbd6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.384+0000 7f81e0b59640 1 -- 172.21.15.133:0/3792377810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653fb9735a0 con 0x5653fbbc35a0 2023-12-18T10:19:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e0b59640 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbbc35a0 0x5653fbbbc010 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f81d40195f0 tx=0x7f81d40a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc355651529a0a04 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81c27fc640 1 -- 172.21.15.133:0/3792377810 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40a5da0 con 0x5653fbbc35a0 2023-12-18T10:19:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81c27fc640 1 -- 172.21.15.133:0/3792377810 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d40c6070 con 0x5653fbbc35a0 2023-12-18T10:19:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81c27fc640 1 -- 172.21.15.133:0/3792377810 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4003be0 con 0x5653fbbc35a0 2023-12-18T10:19:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- 172.21.15.133:0/3792377810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbbc35a0 msgr2=0x5653fbbbc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbbc35a0 0x5653fbbbc010 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f81d40195f0 tx=0x7f81d40a7070 comp rx=0 tx=0).stop 2023-12-18T10:19:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- 172.21.15.133:0/3792377810 shutdown_connections 2023-12-18T10:19:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbbc35a0 0x5653fbbbc010 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 0x5653fbbd6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 --2- 172.21.15.133:0/3792377810 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbb78fc0 0x5653fbbd5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- 172.21.15.133:0/3792377810 >> 172.21.15.133:0/3792377810 conn(0x5653fb977910 msgr2=0x5653fbb7e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- 172.21.15.133:0/3792377810 shutdown_connections 2023-12-18T10:19:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- 172.21.15.133:0/3792377810 wait complete. 2023-12-18T10:19:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- start start 2023-12-18T10:19:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 Processor -- start 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbc21560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 0x5653fbc21aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc35a0 0x5653fbbbec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fbb78ae0 con 0x5653fbb78fc0 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653fb9c5720 con 0x5653fbbc2c80 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653fbbcf2c0 con 0x5653fbbc35a0 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e5913000 10 client.0 _ll_register_callbacks cb 0x5653fb97f710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbc21560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbc21560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35066/0 (socket says 172.21.15.133:35066) 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81dbfff640 1 -- 172.21.15.133:0/3647900329 learned_addr learned my addr 172.21.15.133:0/3647900329 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81e0b59640 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc35a0 0x5653fbbbec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81db7fe640 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 0x5653fbc21aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81dbfff640 1 -- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc35a0 msgr2=0x5653fbbbec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81dbfff640 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc35a0 0x5653fbbbec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81dbfff640 1 -- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 msgr2=0x5653fbc21aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81dbfff640 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 0x5653fbc21aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.388+0000 7f81dbfff640 1 -- 172.21.15.133:0/3647900329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653fb6c4e20 con 0x5653fbb78fc0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81dbfff640 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbc21560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f81cc05b800 tx=0x7f81cc080ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46623a399c318fea server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81baffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81baffd640 1 -- 172.21.15.133:0/3647900329 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc05baa0 con 0x5653fbb78fc0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81baffd640 1 -- 172.21.15.133:0/3647900329 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f81cc0521b0 con 0x5653fbb78fc0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 1 -- 172.21.15.133:0/3647900329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653fbb7c940 con 0x5653fbb78fc0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81baffd640 1 -- 172.21.15.133:0/3647900329 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81cc00e040 con 0x5653fbb78fc0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 10 client.5811 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 1 -- 172.21.15.133:0/3647900329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5653fb967110 con 0x5653fbb78fc0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81baffd640 1 -- 172.21.15.133:0/3647900329 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653fbb7c940 con 0x5653fbb78fc0 2023-12-18T10:19:54.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81baffd640 1 -- 172.21.15.133:0/3647900329 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f81cc052cb0 con 0x5653fbb78fc0 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 10 client.5811 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 10 client.5811 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 20 client.5811 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5653fbbc4230 0x5653fbbbf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 4 client.5811 mds_command: new command op to 5508 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81e5913000 1 -- 172.21.15.133:0/3647900329 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5653fb9916a0 con 0x5653fbbc4230 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81db7fe640 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5653fbbc4230 0x5653fbbbf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81db7fe640 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5653fbbc4230 0x5653fbbbf190 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35252a2d61543377 server_cookie=a247b10518516e18 in_seq=0 out_seq=0 2023-12-18T10:19:54.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.392+0000 7f81baffd640 10 client.5811 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.404+0000 7f81baffd640 1 -- 172.21.15.133:0/3647900329 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5653fb9916a0 con 0x5653fbbc4230 2023-12-18T10:19:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.404+0000 7f81baffd640 10 client.5811 handle_command_reply: tid=0 2023-12-18T10:19:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 client.5811 shutdown 2023-12-18T10:19:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 -- 172.21.15.133:0/3647900329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 msgr2=0x5653fbc21560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbc21560 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f81cc05b800 tx=0x7f81cc080ad0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 -- 172.21.15.133:0/3647900329 shutdown_connections 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5653fbbc4230 0x5653fbbbf190 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5653fbbc35a0 0x5653fbbbec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5653fbbc2c80 0x5653fbc21aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 --2- 172.21.15.133:0/3647900329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5653fbb78fc0 0x5653fbc21560 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 -- 172.21.15.133:0/3647900329 >> 172.21.15.133:0/3647900329 conn(0x5653fb977910 msgr2=0x5653fbbd4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81baffd640 0 client.5811 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 -- 172.21.15.133:0/3647900329 shutdown_connections 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 1 -- 172.21.15.133:0/3647900329 wait complete. 2023-12-18T10:19:54.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e5913000 20 client.5811 trim_cache size 0 max 16384 2023-12-18T10:19:54.413 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:54.413 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:19:54.413 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:19:54.413 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 -- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81c8065a60 msgr2=0x7f81c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81c8065a60 0x7f81c8067f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0ac780 tx=0x7f81d00079d0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 -- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc070820 msgr2=0x7f81dc150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc070820 0x7f81dc150470 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00c3c0 tx=0x7f81cc00c880 comp rx=0 tx=0).stop 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 -- 172.21.15.133:0/410382022 shutdown_connections 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81c8065a60 0x7f81c8067f20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81dc1582d0 0x7f81dc151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81dc0ceac0 0x7f81dc06c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 --2- 172.21.15.133:0/410382022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81dc070820 0x7f81dc150470 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 -- 172.21.15.133:0/410382022 >> 172.21.15.133:0/410382022 conn(0x7f81dc06a2a0 msgr2=0x7f81dc0acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 -- 172.21.15.133:0/410382022 shutdown_connections 2023-12-18T10:19:54.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.408+0000 7f81e25bc640 1 -- 172.21.15.133:0/410382022 wait complete. 2023-12-18T10:19:54.432 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:1 flush journal 2023-12-18T10:19:54.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd85e9640 1 Processor -- start 2023-12-18T10:19:54.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd85e9640 1 -- start start 2023-12-18T10:19:54.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd85e9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcd015cb60 0x7efcd00ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd85e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd00cb6d0 0x7efcd0160c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd85e9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd00cd4f0 con 0x7efcd01607a0 2023-12-18T10:19:54.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd85e9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd00ac680 con 0x7efcd015cb60 2023-12-18T10:19:54.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd85e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0161310 con 0x7efcd00cb6d0 2023-12-18T10:19:54.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd5b84640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efcd01607a0 0x7efcd00cafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40166/0 (socket says 172.21.15.133:40166) 2023-12-18T10:19:54.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd5b84640 1 -- 172.21.15.133:0/2733977238 learned_addr learned my addr 172.21.15.133:0/2733977238 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:54.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd6385640 1 --2- 172.21.15.133:0/2733977238 >> v2:172.21.15.142:3300/0 conn(0x7efcd015cb60 0x7efcd00ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd00cb6d0 0x7efcd0160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd5383640 1 -- 172.21.15.133:0/2733977238 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494042897 0 0) 0x7efcd00cd4f0 con 0x7efcd01607a0 2023-12-18T10:19:54.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd5383640 1 -- 172.21.15.133:0/2733977238 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcbc003530 con 0x7efcd01607a0 2023-12-18T10:19:54.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd6385640 1 -- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd00cb6d0 msgr2=0x7efcd0160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd6385640 1 --2- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd00cb6d0 0x7efcd0160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd6385640 1 -- 172.21.15.133:0/2733977238 >> v1:172.21.15.133:6789/0 conn(0x7efcd01607a0 legacy=0x7efcd00cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd6385640 1 -- 172.21.15.133:0/2733977238 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd01615f0 con 0x7efcd015cb60 2023-12-18T10:19:54.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.568+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd00cb6d0 0x7efcd0160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:54.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd6385640 1 --2- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcd015cb60 0x7efcd00ac140 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efccc0097c0 tx=0x7efccc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e97dcdb2e04404 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd5383640 1 -- 172.21.15.133:0/2733977238 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0ab600 con 0x7efcd015cb60 2023-12-18T10:19:54.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd5383640 1 -- 172.21.15.133:0/2733977238 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc0a7050 con 0x7efcd015cb60 2023-12-18T10:19:54.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd5383640 1 -- 172.21.15.133:0/2733977238 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0ab980 con 0x7efcd015cb60 2023-12-18T10:19:54.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd85e9640 1 -- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcd015cb60 msgr2=0x7efcd00ac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcd015cb60 0x7efcd00ac140 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efccc0097c0 tx=0x7efccc01c480 comp rx=0 tx=0).stop 2023-12-18T10:19:54.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd85e9640 1 -- 172.21.15.133:0/2733977238 shutdown_connections 2023-12-18T10:19:54.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd00cb6d0 0x7efcd0160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2733977238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcd015cb60 0x7efcd00ac140 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd85e9640 1 -- 172.21.15.133:0/2733977238 >> 172.21.15.133:0/2733977238 conn(0x7efcd00b0380 msgr2=0x7efcd00b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd85e9640 1 -- 172.21.15.133:0/2733977238 shutdown_connections 2023-12-18T10:19:54.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.572+0000 7efcd85e9640 1 -- 172.21.15.133:0/2733977238 wait complete. 2023-12-18T10:19:54.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 Processor -- start 2023-12-18T10:19:54.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 -- start start 2023-12-18T10:19:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcd00cb6d0 0x7efcd014b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd015cb60 0x7efcd00c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd01607a0 0x7efcd01537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0158290 con 0x7efcd01607a0 2023-12-18T10:19:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0156390 con 0x7efcd00cb6d0 2023-12-18T10:19:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0156670 con 0x7efcd015cb60 2023-12-18T10:19:54.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd01607a0 0x7efcd01537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd01607a0 0x7efcd01537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35074/0 (socket says 172.21.15.133:35074) 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 -- 172.21.15.133:0/2607909582 learned_addr learned my addr 172.21.15.133:0/2607909582 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd5b84640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd015cb60 0x7efcd00c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 -- 172.21.15.133:0/2607909582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd015cb60 msgr2=0x7efcd00c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd015cb60 0x7efcd00c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 -- 172.21.15.133:0/2607909582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcd00cb6d0 msgr2=0x7efcd014b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcd00cb6d0 0x7efcd014b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 -- 172.21.15.133:0/2607909582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8009a70 con 0x7efcd01607a0 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd01607a0 0x7efcd01537e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efcc800ef90 tx=0x7efcc8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcc6ffd640 1 -- 172.21.15.133:0/2607909582 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8009d70 con 0x7efcd01607a0 2023-12-18T10:19:54.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcc6ffd640 1 -- 172.21.15.133:0/2607909582 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc800f040 con 0x7efcd01607a0 2023-12-18T10:19:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 -- 172.21.15.133:0/2607909582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc009420 con 0x7efcd01607a0 2023-12-18T10:19:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcc6ffd640 1 -- 172.21.15.133:0/2607909582 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80146c0 con 0x7efcd01607a0 2023-12-18T10:19:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.576+0000 7efcd85e9640 1 -- 172.21.15.133:0/2607909582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd0156c30 con 0x7efcd01607a0 2023-12-18T10:19:54.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.580+0000 7efcc6ffd640 1 -- 172.21.15.133:0/2607909582 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efcc8014820 con 0x7efcd01607a0 2023-12-18T10:19:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.580+0000 7efcc6ffd640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcb4065a60 0x7efcb4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.580+0000 7efcc6ffd640 1 -- 172.21.15.133:0/2607909582 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efcc8084430 con 0x7efcd01607a0 2023-12-18T10:19:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.580+0000 7efcd6385640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcb4065a60 0x7efcb4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.580+0000 7efcdb942000 1 Processor -- start 2023-12-18T10:19:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- start start 2023-12-18T10:19:54.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd6385640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcb4065a60 0x7efcb4067f20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efccc0ad000 tx=0x7efccc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 0x561bf181c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf17d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf17d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bf169a430 con 0x561bf181c5a0 2023-12-18T10:19:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bf1628460 con 0x561bf17d1fc0 2023-12-18T10:19:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bf1625a30 con 0x561bf181bc80 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf17d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd6385640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 0x561bf181c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd6b86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf17d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf17d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35086/0 (socket says 172.21.15.133:35086) 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 -- 172.21.15.133:0/1464891343 learned_addr learned my addr 172.21.15.133:0/1464891343 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 -- 172.21.15.133:0/1464891343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 msgr2=0x561bf181c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 --2- 172.21.15.133:0/1464891343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 0x561bf181c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 -- 172.21.15.133:0/1464891343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 msgr2=0x561bf17d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 --2- 172.21.15.133:0/1464891343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf17d23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 -- 172.21.15.133:0/1464891343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bf131de20 con 0x561bf181c5a0 2023-12-18T10:19:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcd5b84640 1 --2- 172.21.15.133:0/1464891343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf17d1a80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efcc00014a0 tx=0x7efcc0001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39324648c2806a12 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcb3fff640 1 -- 172.21.15.133:0/1464891343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000b070 con 0x561bf181c5a0 2023-12-18T10:19:54.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcb3fff640 1 -- 172.21.15.133:0/1464891343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0005cf0 con 0x561bf181c5a0 2023-12-18T10:19:54.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcb3fff640 1 -- 172.21.15.133:0/1464891343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00072d0 con 0x561bf181c5a0 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- 172.21.15.133:0/1464891343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 msgr2=0x561bf17d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 --2- 172.21.15.133:0/1464891343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf17d1a80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efcc00014a0 tx=0x7efcc0001960 comp rx=0 tx=0).stop 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- 172.21.15.133:0/1464891343 shutdown_connections 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 --2- 172.21.15.133:0/1464891343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf17d23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 --2- 172.21.15.133:0/1464891343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf17d1a80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 --2- 172.21.15.133:0/1464891343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 0x561bf181c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- 172.21.15.133:0/1464891343 >> 172.21.15.133:0/1464891343 conn(0x561bf15d0910 msgr2=0x561bf17d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- 172.21.15.133:0/1464891343 shutdown_connections 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- 172.21.15.133:0/1464891343 wait complete. 2023-12-18T10:19:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.584+0000 7efcdb942000 1 -- start start 2023-12-18T10:19:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 Processor -- start 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf17d1fc0 0x561bf181b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 0x561bf181c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181c5a0 0x561bf181cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bf1621320 con 0x561bf17d1fc0 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bf15c04f0 con 0x561bf181c5a0 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bf15de6e0 con 0x561bf181bc80 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 10 client.0 _ll_register_callbacks cb 0x561bf17bd980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf17d1fc0 0x561bf181b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf17d1fc0 0x561bf181b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35092/0 (socket says 172.21.15.133:35092) 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 -- 172.21.15.133:0/2554950968 learned_addr learned my addr 172.21.15.133:0/2554950968 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd5b84640 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 0x561bf181c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181c5a0 0x561bf181cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 -- 172.21.15.133:0/2554950968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 msgr2=0x561bf181c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 0x561bf181c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 -- 172.21.15.133:0/2554950968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181c5a0 msgr2=0x561bf181cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181c5a0 0x561bf181cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 -- 172.21.15.133:0/2554950968 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc003530 con 0x561bf17d1fc0 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd6385640 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf17d1fc0 0x561bf181b4e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efccc0097c0 tx=0x7efccc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb44fa4a6e3947d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcb17fa640 1 -- 172.21.15.133:0/2554950968 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc0bc050 con 0x561bf17d1fc0 2023-12-18T10:19:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcb17fa640 1 -- 172.21.15.133:0/2554950968 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efccc0abdc0 con 0x561bf17d1fc0 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 -- 172.21.15.133:0/2554950968 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bf15de120 con 0x561bf17d1fc0 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcb17fa640 1 -- 172.21.15.133:0/2554950968 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efccc0b7430 con 0x561bf17d1fc0 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 10 client.5823 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 -- 172.21.15.133:0/2554950968 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x561bf15e6250 con 0x561bf17d1fc0 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcb17fa640 1 -- 172.21.15.133:0/2554950968 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561bf15de120 con 0x561bf17d1fc0 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcb17fa640 1 -- 172.21.15.133:0/2554950968 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7efccc0b7590 con 0x561bf17d1fc0 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 10 client.5823 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 10 client.5823 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.c 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 20 client.5823 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x561bf181d8d0 0x561bf181dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 4 client.5823 mds_command: new command op to 5499 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcdb942000 1 -- 172.21.15.133:0/2554950968 --> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bf161fc70 con 0x561bf181d8d0 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.588+0000 7efcd5b84640 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x561bf181d8d0 0x561bf181dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcd5b84640 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x561bf181d8d0 0x561bf181dce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2760770dbecefe17 server_cookie=666824cf64f2421f in_seq=0 out_seq=0 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcb17fa640 10 client.5823 ms_handle_connect on v2:172.21.15.133:6834/3060654272 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcb17fa640 1 -- 172.21.15.133:0/2554950968 <== mds.1 v2:172.21.15.133:6834/3060654272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561bf161fc70 con 0x561bf181d8d0 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcb17fa640 10 client.5823 handle_command_reply: tid=0 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 client.5823 shutdown 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 -- 172.21.15.133:0/2554950968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf17d1fc0 msgr2=0x561bf181b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf17d1fc0 0x561bf181b4e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efccc0097c0 tx=0x7efccc0046d0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 -- 172.21.15.133:0/2554950968 shutdown_connections 2023-12-18T10:19:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x561bf181d8d0 0x561bf181dce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181c5a0 0x561bf181cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181bc80 0x561bf181c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcb17fa640 0 client.5823 ms_handle_reset on v2:172.21.15.133:6834/3060654272 2023-12-18T10:19:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 --2- 172.21.15.133:0/2554950968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf17d1fc0 0x561bf181b4e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 -- 172.21.15.133:0/2554950968 >> 172.21.15.133:0/2554950968 conn(0x561bf15d0910 msgr2=0x561bf17d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 -- 172.21.15.133:0/2554950968 shutdown_connections 2023-12-18T10:19:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 1 -- 172.21.15.133:0/2554950968 wait complete. 2023-12-18T10:19:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.592+0000 7efcdb942000 20 client.5823 trim_cache size 0 max 16384 2023-12-18T10:19:54.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcdb942000 1 Processor -- start 2023-12-18T10:19:54.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcdb942000 1 -- start start 2023-12-18T10:19:54.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcdb942000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf17d1fc0 0x561bf181a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcdb942000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181bc80 0x561bf181a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcdb942000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf182be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcdb942000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bf12deaa0 con 0x561bf181c5a0 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcdb942000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bf15c6820 con 0x561bf181bc80 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcdb942000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bf161e720 con 0x561bf17d1fc0 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf182be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf182be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35108/0 (socket says 172.21.15.133:35108) 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 -- 172.21.15.133:0/2268802495 learned_addr learned my addr 172.21.15.133:0/2268802495 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd5b84640 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181bc80 0x561bf181a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6385640 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf17d1fc0 0x561bf181a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 -- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf17d1fc0 msgr2=0x561bf181a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf17d1fc0 0x561bf181a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 -- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181bc80 msgr2=0x561bf181a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181bc80 0x561bf181a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 -- 172.21.15.133:0/2268802495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bf15cc5a0 con 0x561bf181c5a0 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6385640 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf17d1fc0 0x561bf181a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd5b84640 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181bc80 0x561bf181a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcd6b86640 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf182be00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efcc800c920 tx=0x7efcc8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cfc2ab60ae7a9f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcc4ff9640 1 -- 172.21.15.133:0/2268802495 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80840d0 con 0x561bf181c5a0 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcc4ff9640 1 -- 172.21.15.133:0/2268802495 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc8084230 con 0x561bf181c5a0 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.604+0000 7efcc4ff9640 1 -- 172.21.15.133:0/2268802495 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80822c0 con 0x561bf181c5a0 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- 172.21.15.133:0/2268802495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 msgr2=0x561bf182be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf182be00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7efcc800c920 tx=0x7efcc8016040 comp rx=0 tx=0).stop 2023-12-18T10:19:54.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- 172.21.15.133:0/2268802495 shutdown_connections 2023-12-18T10:19:54.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181c5a0 0x561bf182be00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf181bc80 0x561bf181a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 --2- 172.21.15.133:0/2268802495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf17d1fc0 0x561bf181a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- 172.21.15.133:0/2268802495 >> 172.21.15.133:0/2268802495 conn(0x561bf15d0910 msgr2=0x561bf17d7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- 172.21.15.133:0/2268802495 shutdown_connections 2023-12-18T10:19:54.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- 172.21.15.133:0/2268802495 wait complete. 2023-12-18T10:19:54.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- start start 2023-12-18T10:19:54.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 Processor -- start 2023-12-18T10:19:54.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf1875f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181bc80 0x561bf182ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181c5a0 0x561bf182ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bf15df480 con 0x561bf181bc80 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bf16644d0 con 0x561bf17d1fc0 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561bf1623e80 con 0x561bf181c5a0 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 10 client.0 _ll_register_callbacks cb 0x561bf15d8710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181bc80 0x561bf182ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181bc80 0x561bf182ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35116/0 (socket says 172.21.15.133:35116) 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 -- 172.21.15.133:0/1402082964 learned_addr learned my addr 172.21.15.133:0/1402082964 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd6385640 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf1875f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd6b86640 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181c5a0 0x561bf182ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 -- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181c5a0 msgr2=0x561bf182ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181c5a0 0x561bf182ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 -- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 msgr2=0x561bf1875f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf1875f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 -- 172.21.15.133:0/1402082964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd0156c30 con 0x561bf181bc80 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd6385640 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf1875f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcd5b84640 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181bc80 0x561bf182ea40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009010 tx=0x7efcc0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b5922c084c2c51 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcb17fa640 1 -- 172.21.15.133:0/1402082964 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0025040 con 0x561bf181bc80 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcb17fa640 1 -- 172.21.15.133:0/1402082964 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efcc00079e0 con 0x561bf181bc80 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcdb942000 1 -- 172.21.15.133:0/1402082964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bf17d5940 con 0x561bf181bc80 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.608+0000 7efcb17fa640 1 -- 172.21.15.133:0/1402082964 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcc0026240 con 0x561bf181bc80 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcdb942000 10 client.5829 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcdb942000 1 -- 172.21.15.133:0/1402082964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x561bf15c0110 con 0x561bf181bc80 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcb17fa640 1 -- 172.21.15.133:0/1402082964 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561bf17d5940 con 0x561bf181bc80 2023-12-18T10:19:54.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcb17fa640 1 -- 172.21.15.133:0/1402082964 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7efcc00070d0 con 0x561bf181bc80 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcdb942000 10 client.5829 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcdb942000 10 client.5829 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.c 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcdb942000 20 client.5829 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcdb942000 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x561bf182f4c0 0x561bf182f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcdb942000 4 client.5829 mds_command: new command op to 5499 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcdb942000 1 -- 172.21.15.133:0/1402082964 --> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561bf15ea6a0 con 0x561bf182f4c0 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcd6385640 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x561bf182f4c0 0x561bf182f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcb17fa640 10 client.5829 ms_handle_connect on v2:172.21.15.133:6834/3060654272 2023-12-18T10:19:54.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.612+0000 7efcd6385640 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x561bf182f4c0 0x561bf182f8d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=547ed7a55505a55 server_cookie=f6278659e130b2a5 in_seq=0 out_seq=0 2023-12-18T10:19:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcb17fa640 1 -- 172.21.15.133:0/1402082964 <== mds.1 v2:172.21.15.133:6834/3060654272 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561bf15ea6a0 con 0x561bf182f4c0 2023-12-18T10:19:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcb17fa640 10 client.5829 handle_command_reply: tid=0 2023-12-18T10:19:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 client.5829 shutdown 2023-12-18T10:19:54.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 -- 172.21.15.133:0/1402082964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181bc80 msgr2=0x561bf182ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181bc80 0x561bf182ea40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009010 tx=0x7efcc0010000 comp rx=0 tx=0).stop 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 -- 172.21.15.133:0/1402082964 shutdown_connections 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.133:6834/3060654272,v1:172.21.15.133:6836/3060654272] conn(0x561bf182f4c0 0x561bf182f8d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561bf181c5a0 0x561bf182ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561bf181bc80 0x561bf182ea40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 --2- 172.21.15.133:0/1402082964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561bf17d1fc0 0x561bf1875f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcb17fa640 0 client.5829 ms_handle_reset on v2:172.21.15.133:6834/3060654272 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.620+0000 7efcdb942000 1 -- 172.21.15.133:0/1402082964 >> 172.21.15.133:0/1402082964 conn(0x561bf15d0910 msgr2=0x561bf181a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcdb942000 1 -- 172.21.15.133:0/1402082964 shutdown_connections 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcdb942000 1 -- 172.21.15.133:0/1402082964 wait complete. 2023-12-18T10:19:54.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcdb942000 20 client.5829 trim_cache size 0 max 16384 2023-12-18T10:19:54.628 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:54.628 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:19:54.628 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:19:54.628 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 -- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcb4065a60 msgr2=0x7efcb4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcb4065a60 0x7efcb4067f20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efccc0ad000 tx=0x7efccc008040 comp rx=0 tx=0).stop 2023-12-18T10:19:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 -- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd01607a0 msgr2=0x7efcd01537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd01607a0 0x7efcd01537e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efcc800ef90 tx=0x7efcc8009f90 comp rx=0 tx=0).stop 2023-12-18T10:19:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 -- 172.21.15.133:0/2607909582 shutdown_connections 2023-12-18T10:19:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcb4065a60 0x7efcb4067f20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd01607a0 0x7efcd01537e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcd015cb60 0x7efcd00c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 --2- 172.21.15.133:0/2607909582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcd00cb6d0 0x7efcd014b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 -- 172.21.15.133:0/2607909582 >> 172.21.15.133:0/2607909582 conn(0x7efcd00b0380 msgr2=0x7efcd00af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 -- 172.21.15.133:0/2607909582 shutdown_connections 2023-12-18T10:19:54.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.624+0000 7efcd85e9640 1 -- 172.21.15.133:0/2607909582 wait complete. 2023-12-18T10:19:54.645 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:2 flush journal 2023-12-18T10:19:54.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f7104b0a640 1 Processor -- start 2023-12-18T10:19:54.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f7104b0a640 1 -- start start 2023-12-18T10:19:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f7104b0a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71000ce390 0x7f71000ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f7104b0a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000c9730 con 0x7f7100153020 2023-12-18T10:19:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f7104b0a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000cbc80 con 0x7f71001598d0 2023-12-18T10:19:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f7104b0a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000ced60 con 0x7f71000ce390 2023-12-18T10:19:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f70fe59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7100153020 0x7f71000c9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40180/0 (socket says 172.21.15.133:40180) 2023-12-18T10:19:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f70fe59c640 1 -- 172.21.15.133:0/3781748794 learned_addr learned my addr 172.21.15.133:0/3781748794 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f70fed9d640 1 --2- 172.21.15.133:0/3781748794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71000ce390 0x7f71000ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f70fdd9b640 1 -- 172.21.15.133:0/3781748794 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58148228 0 0) 0x7f71000c9730 con 0x7f7100153020 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.780+0000 7f70fdd9b640 1 -- 172.21.15.133:0/3781748794 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec003530 con 0x7f7100153020 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fdd9b640 1 -- 172.21.15.133:0/3781748794 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507490136 0 0) 0x7f71000cbc80 con 0x7f71001598d0 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fdd9b640 1 -- 172.21.15.133:0/3781748794 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71000c9730 con 0x7f71001598d0 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fed9d640 1 -- 172.21.15.133:0/3781748794 >> v1:172.21.15.142:6789/0 conn(0x7f71001598d0 legacy=0x7f71000b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fdd9b640 1 -- 172.21.15.133:0/3781748794 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4229419627 0 0) 0x7f70ec003530 con 0x7f7100153020 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fed9d640 1 -- 172.21.15.133:0/3781748794 >> v1:172.21.15.133:6789/0 conn(0x7f7100153020 legacy=0x7f71000c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fed9d640 1 -- 172.21.15.133:0/3781748794 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000c8e00 con 0x7f71000ce390 2023-12-18T10:19:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fed9d640 1 --2- 172.21.15.133:0/3781748794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71000ce390 0x7f71000ce820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009dc0 tx=0x7f70f801c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=551f3baa9690dcb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fdd9b640 1 -- 172.21.15.133:0/3781748794 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0001680 con 0x7f71000ce390 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fdd9b640 1 -- 172.21.15.133:0/3781748794 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f80a64b0 con 0x7f71000ce390 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f70fdd9b640 1 -- 172.21.15.133:0/3781748794 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80a6840 con 0x7f71000ce390 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f7104b0a640 1 -- 172.21.15.133:0/3781748794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71000ce390 msgr2=0x7f71000ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f7104b0a640 1 --2- 172.21.15.133:0/3781748794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71000ce390 0x7f71000ce820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009dc0 tx=0x7f70f801c770 comp rx=0 tx=0).stop 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f7104b0a640 1 -- 172.21.15.133:0/3781748794 shutdown_connections 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f7104b0a640 1 --2- 172.21.15.133:0/3781748794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71000ce390 0x7f71000ce820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.784+0000 7f7104b0a640 1 -- 172.21.15.133:0/3781748794 >> 172.21.15.133:0/3781748794 conn(0x7f710006a2a0 msgr2=0x7f71000aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 -- 172.21.15.133:0/3781748794 shutdown_connections 2023-12-18T10:19:54.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 -- 172.21.15.133:0/3781748794 wait complete. 2023-12-18T10:19:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 Processor -- start 2023-12-18T10:19:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 -- start start 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71000ce390 0x7f7100151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7100153020 0x7f71000cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71001598d0 0x7f71000cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c74f0 con 0x7f7100153020 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c6870 con 0x7f71000ce390 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f7104b0a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000c6b50 con 0x7f71001598d0 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70f5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7100153020 0x7f71000cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70f5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7100153020 0x7f71000cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35120/0 (socket says 172.21.15.133:35120) 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3472413430 learned_addr learned my addr 172.21.15.133:0/3472413430 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70fe59c640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71000ce390 0x7f7100151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70fed9d640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71001598d0 0x7f71000cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3472413430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71001598d0 msgr2=0x7f71000cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71001598d0 0x7f71000cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3472413430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71000ce390 msgr2=0x7f7100151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71000ce390 0x7f7100151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.788+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3472413430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8009a70 con 0x7f7100153020 2023-12-18T10:19:54.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7100153020 0x7f71000cab70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c490 tx=0x7f70e800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f70f77fe640 1 -- 172.21.15.133:0/3472413430 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e80052d0 con 0x7f7100153020 2023-12-18T10:19:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f70f77fe640 1 -- 172.21.15.133:0/3472413430 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8005430 con 0x7f7100153020 2023-12-18T10:19:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f7104b0a640 1 -- 172.21.15.133:0/3472413430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71000c6e30 con 0x7f7100153020 2023-12-18T10:19:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f70f77fe640 1 -- 172.21.15.133:0/3472413430 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8012870 con 0x7f7100153020 2023-12-18T10:19:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f7104b0a640 1 -- 172.21.15.133:0/3472413430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71000c6570 con 0x7f7100153020 2023-12-18T10:19:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f70f77fe640 1 -- 172.21.15.133:0/3472413430 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f70e80129d0 con 0x7f7100153020 2023-12-18T10:19:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f70f77fe640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f70e0065a60 0x7f70e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f70f77fe640 1 -- 172.21.15.133:0/3472413430 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70e8082d80 con 0x7f7100153020 2023-12-18T10:19:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.792+0000 7f70fe59c640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f70e0065a60 0x7f70e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70fe59c640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f70e0065a60 0x7f70e0067f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f70f0001ec0 tx=0x7f70f0001a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 Processor -- start 2023-12-18T10:19:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- start start 2023-12-18T10:19:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5773c80 0x562fa5774060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa57745a0 0x562fa5729a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa572a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fa55f2430 con 0x562fa57745a0 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fa5580460 con 0x562fa5729fc0 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fa557da30 con 0x562fa5773c80 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa57745a0 0x562fa5729a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa57745a0 0x562fa5729a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35128/0 (socket says 172.21.15.133:35128) 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3327355162 learned_addr learned my addr 172.21.15.133:0/3327355162 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70fe59c640 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5773c80 0x562fa5774060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70fed9d640 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa572a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3327355162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5773c80 msgr2=0x562fa5774060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5773c80 0x562fa5774060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3327355162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 msgr2=0x562fa572a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa572a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3327355162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fa5275e20 con 0x562fa57745a0 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa57745a0 0x562fa5729a80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f70e805bd40 tx=0x7f70e8054480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335f1bc184b2c26d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70dffff640 1 -- 172.21.15.133:0/3327355162 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e806b070 con 0x562fa57745a0 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70dffff640 1 -- 172.21.15.133:0/3327355162 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e8052480 con 0x562fa57745a0 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f70dffff640 1 -- 172.21.15.133:0/3327355162 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e805a0c0 con 0x562fa57745a0 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- 172.21.15.133:0/3327355162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa57745a0 msgr2=0x562fa5729a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa57745a0 0x562fa5729a80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f70e805bd40 tx=0x7f70e8054480 comp rx=0 tx=0).stop 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- 172.21.15.133:0/3327355162 shutdown_connections 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa572a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa57745a0 0x562fa5729a80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 --2- 172.21.15.133:0/3327355162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5773c80 0x562fa5774060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- 172.21.15.133:0/3327355162 >> 172.21.15.133:0/3327355162 conn(0x562fa5528910 msgr2=0x562fa5728360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- 172.21.15.133:0/3327355162 shutdown_connections 2023-12-18T10:19:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.796+0000 7f7107e71000 1 -- 172.21.15.133:0/3327355162 wait complete. 2023-12-18T10:19:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 -- start start 2023-12-18T10:19:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 Processor -- start 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5729fc0 0x562fa57733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5773c80 0x562fa5774980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa57745a0 0x562fa5774ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fa5579320 con 0x562fa5729fc0 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fa55184f0 con 0x562fa5773c80 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fa55366e0 con 0x562fa57745a0 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 10 client.0 _ll_register_callbacks cb 0x562fa5715980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5729fc0 0x562fa57733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5729fc0 0x562fa57733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35134/0 (socket says 172.21.15.133:35134) 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 -- 172.21.15.133:0/2615411094 learned_addr learned my addr 172.21.15.133:0/2615411094 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fed9d640 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa57745a0 0x562fa5774ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5773c80 0x562fa5774980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 -- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa57745a0 msgr2=0x562fa5774ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa57745a0 0x562fa5774ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 -- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5773c80 msgr2=0x562fa5774980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5773c80 0x562fa5774980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 -- 172.21.15.133:0/2615411094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71000c6570 con 0x562fa5729fc0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5773c80 0x562fa5774980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70fe59c640 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5729fc0 0x562fa57733d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f70f0001390 tx=0x7f70f0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b51c5853db80f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70dd7fa640 1 -- 172.21.15.133:0/2615411094 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0026030 con 0x562fa5729fc0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70dd7fa640 1 -- 172.21.15.133:0/2615411094 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70f0027070 con 0x562fa5729fc0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 -- 172.21.15.133:0/2615411094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fa5536120 con 0x562fa5729fc0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70dd7fa640 1 -- 172.21.15.133:0/2615411094 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f0013600 con 0x562fa5729fc0 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 10 client.5841 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 -- 172.21.15.133:0/2615411094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x562fa553e250 con 0x562fa5729fc0 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70dd7fa640 1 -- 172.21.15.133:0/2615411094 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0031020 con 0x562fa5729fc0 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70dd7fa640 1 -- 172.21.15.133:0/2615411094 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f70f0012070 con 0x562fa5729fc0 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 10 client.5841 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 10 client.5841 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.b 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 20 client.5841 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x562fa57758d0 0x562fa5775cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 4 client.5841 mds_command: new command op to 5054 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f7107e71000 1 -- 172.21.15.133:0/2615411094 --> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fa5577c70 con 0x562fa57758d0 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.800+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x562fa57758d0 0x562fa5775cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x562fa57758d0 0x562fa5775cb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=211fc2085378d396 server_cookie=eb0a40c2301dc14e in_seq=0 out_seq=0 2023-12-18T10:19:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f70dd7fa640 10 client.5841 ms_handle_connect on v2:172.21.15.142:6832/898789604 2023-12-18T10:19:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f70dd7fa640 1 -- 172.21.15.133:0/2615411094 <== mds.2 v2:172.21.15.142:6832/898789604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x562fa5577c70 con 0x562fa57758d0 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f70dd7fa640 10 client.5841 handle_command_reply: tid=0 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 client.5841 shutdown 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 -- 172.21.15.133:0/2615411094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5729fc0 msgr2=0x562fa57733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5729fc0 0x562fa57733d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f70f0001390 tx=0x7f70f0005800 comp rx=0 tx=0).stop 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 -- 172.21.15.133:0/2615411094 shutdown_connections 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x562fa57758d0 0x562fa5775cb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa57745a0 0x562fa5774ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5773c80 0x562fa5774980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f70dd7fa640 0 client.5841 ms_handle_reset on v2:172.21.15.142:6832/898789604 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 --2- 172.21.15.133:0/2615411094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5729fc0 0x562fa57733d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 -- 172.21.15.133:0/2615411094 >> 172.21.15.133:0/2615411094 conn(0x562fa5528910 msgr2=0x562fa5728a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 -- 172.21.15.133:0/2615411094 shutdown_connections 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 1 -- 172.21.15.133:0/2615411094 wait complete. 2023-12-18T10:19:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.804+0000 7f7107e71000 20 client.5841 trim_cache size 0 max 16384 2023-12-18T10:19:54.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f7107e71000 1 Processor -- start 2023-12-18T10:19:54.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f7107e71000 1 -- start start 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f7107e71000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5528910 0x562fa5772040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f7107e71000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5729fc0 0x562fa5772580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f7107e71000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5783fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f7107e71000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fa5236aa0 con 0x562fa5773c80 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f7107e71000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fa551e820 con 0x562fa5528910 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f7107e71000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fa55738a0 con 0x562fa5729fc0 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5783fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5528910 0x562fa5772040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5783fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35136/0 (socket says 172.21.15.133:35136) 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70f5d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5729fc0 0x562fa5772580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 -- 172.21.15.133:0/2190979864 learned_addr learned my addr 172.21.15.133:0/2190979864 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 -- 172.21.15.133:0/2190979864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5729fc0 msgr2=0x562fa5772580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 --2- 172.21.15.133:0/2190979864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5729fc0 0x562fa5772580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 -- 172.21.15.133:0/2190979864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5528910 msgr2=0x562fa5772040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 --2- 172.21.15.133:0/2190979864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5528910 0x562fa5772040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 -- 172.21.15.133:0/2190979864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fa55245a0 con 0x562fa5773c80 2023-12-18T10:19:54.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.816+0000 7f70fed9d640 1 --2- 172.21.15.133:0/2190979864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5783fa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f70f80b0040 tx=0x7f70f8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0cf12c6f2b42ae server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70f4d99640 1 -- 172.21.15.133:0/2190979864 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80bf070 con 0x562fa5773c80 2023-12-18T10:19:54.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70f4d99640 1 -- 172.21.15.133:0/2190979864 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f8003d40 con 0x562fa5773c80 2023-12-18T10:19:54.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70f4d99640 1 -- 172.21.15.133:0/2190979864 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8004240 con 0x562fa5773c80 2023-12-18T10:19:54.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- 172.21.15.133:0/2190979864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 msgr2=0x562fa5783fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 --2- 172.21.15.133:0/2190979864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5783fa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f70f80b0040 tx=0x7f70f8004ac0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- 172.21.15.133:0/2190979864 shutdown_connections 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 --2- 172.21.15.133:0/2190979864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5783fa0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 --2- 172.21.15.133:0/2190979864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5729fc0 0x562fa5772580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 --2- 172.21.15.133:0/2190979864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5528910 0x562fa5772040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- 172.21.15.133:0/2190979864 >> 172.21.15.133:0/2190979864 conn(0x562fa572fac0 msgr2=0x562fa5780c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- 172.21.15.133:0/2190979864 shutdown_connections 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- 172.21.15.133:0/2190979864 wait complete. 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- start start 2023-12-18T10:19:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 Processor -- start 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5528910 0x562fa57d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa57d2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5786be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fa55781b0 con 0x562fa5773c80 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fa55816f0 con 0x562fa5729fc0 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fa55bc4d0 con 0x562fa5528910 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f7107e71000 10 client.0 _ll_register_callbacks cb 0x562fa5530710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70fed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5786be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70f5d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa57d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70fe59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5528910 0x562fa57d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70f5d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa57d2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:35698/0 (socket says 172.21.15.133:35698) 2023-12-18T10:19:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70f5d9b640 1 -- 172.21.15.133:0/3803865331 learned_addr learned my addr 172.21.15.133:0/3803865331 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70fed9d640 1 -- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5528910 msgr2=0x562fa57d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70fed9d640 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5528910 0x562fa57d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70fed9d640 1 -- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 msgr2=0x562fa57d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70fed9d640 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa57d2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70fed9d640 1 -- 172.21.15.133:0/3803865331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71000c8e00 con 0x562fa5773c80 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.820+0000 7f70f5d9b640 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa57d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70fed9d640 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5786be0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f70f801a3a0 tx=0x7f70f801afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cc974e20920213 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70dd7fa640 1 -- 172.21.15.133:0/3803865331 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80a6d70 con 0x562fa5773c80 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 1 -- 172.21.15.133:0/3803865331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fa572d940 con 0x562fa5773c80 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70dd7fa640 1 -- 172.21.15.133:0/3803865331 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70f80aa070 con 0x562fa5773c80 2023-12-18T10:19:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70dd7fa640 1 -- 172.21.15.133:0/3803865331 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70f8003eb0 con 0x562fa5773c80 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 10 client.5847 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 1 -- 172.21.15.133:0/3803865331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x562fa5518110 con 0x562fa5773c80 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70dd7fa640 1 -- 172.21.15.133:0/3803865331 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562fa572d940 con 0x562fa5773c80 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70dd7fa640 1 -- 172.21.15.133:0/3803865331 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f70f80d5020 con 0x562fa5773c80 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 10 client.5847 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 10 client.5847 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.b 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 20 client.5847 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x562fa57745a0 0x562fa5787120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 4 client.5847 mds_command: new command op to 5054 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f7107e71000 1 -- 172.21.15.133:0/3803865331 --> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562fa55426a0 con 0x562fa57745a0 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70fe59c640 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x562fa57745a0 0x562fa5787120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70fe59c640 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x562fa57745a0 0x562fa5787120 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a57cb19f24f26be6 server_cookie=6f6c69bc2f737ee1 in_seq=0 out_seq=0 2023-12-18T10:19:54.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.824+0000 7f70dd7fa640 10 client.5847 ms_handle_connect on v2:172.21.15.142:6832/898789604 2023-12-18T10:19:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f70dd7fa640 1 -- 172.21.15.133:0/3803865331 <== mds.2 v2:172.21.15.142:6832/898789604 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562fa55426a0 con 0x562fa57745a0 2023-12-18T10:19:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f70dd7fa640 10 client.5847 handle_command_reply: tid=0 2023-12-18T10:19:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 client.5847 shutdown 2023-12-18T10:19:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 -- 172.21.15.133:0/3803865331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 msgr2=0x562fa5786be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5786be0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f70f801a3a0 tx=0x7f70f801afb0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 -- 172.21.15.133:0/3803865331 shutdown_connections 2023-12-18T10:19:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:6832/898789604,v1:172.21.15.142:6834/898789604] conn(0x562fa57745a0 0x562fa5787120 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562fa5773c80 0x562fa5786be0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562fa5729fc0 0x562fa57d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f70dd7fa640 0 client.5847 ms_handle_reset on v2:172.21.15.142:6832/898789604 2023-12-18T10:19:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 --2- 172.21.15.133:0/3803865331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562fa5528910 0x562fa57d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 -- 172.21.15.133:0/3803865331 >> 172.21.15.133:0/3803865331 conn(0x562fa572fac0 msgr2=0x562fa5771030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 -- 172.21.15.133:0/3803865331 shutdown_connections 2023-12-18T10:19:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 1 -- 172.21.15.133:0/3803865331 wait complete. 2023-12-18T10:19:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.832+0000 7f7107e71000 20 client.5847 trim_cache size 0 max 16384 2023-12-18T10:19:54.839 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:19:54.839 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:19:54.839 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 -- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f70e0065a60 msgr2=0x7f70e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f70e0065a60 0x7f70e0067f20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f70f0001ec0 tx=0x7f70f0001a60 comp rx=0 tx=0).stop 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 -- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7100153020 msgr2=0x7f71000cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7100153020 0x7f71000cab70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c490 tx=0x7f70e800c950 comp rx=0 tx=0).stop 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 -- 172.21.15.133:0/3472413430 shutdown_connections 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f70e0065a60 0x7f70e0067f20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71001598d0 0x7f71000cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7100153020 0x7f71000cab70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 --2- 172.21.15.133:0/3472413430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71000ce390 0x7f7100151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 -- 172.21.15.133:0/3472413430 >> 172.21.15.133:0/3472413430 conn(0x7f710006a2a0 msgr2=0x7f7100158400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 -- 172.21.15.133:0/3472413430 shutdown_connections 2023-12-18T10:19:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:54.836+0000 7f7104b0a640 1 -- 172.21.15.133:0/3472413430 wait complete. 2023-12-18T10:19:54.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:19:54.857 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-12-18T10:19:54.892 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/ 2023-12-18T10:19:54.892 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4 2023-12-18T10:19:54.892 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5 2023-12-18T10:19:54.892 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6 2023-12-18T10:19:54.893 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7 2023-12-18T10:19:54.893 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-12-18T10:19:54.894 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:19:54.894 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:19:54.894 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:19:54.894 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:54.894 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-12-18T10:19:54.894 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:19:54.997 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627778 2023-12-18T10:19:55.186 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:19:55.186 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:19:55.187 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:19:55.187 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:55.187 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-12-18T10:19:55.187 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:19:55.296 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627779 2023-12-18T10:19:55.486 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:19:55.486 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:19:55.486 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:19:55.486 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:55.486 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-12-18T10:19:55.486 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:19:55.594 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627780 2023-12-18T10:19:55.783 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:19:55.783 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:19:55.783 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:19:55.783 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:55.783 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-12-18T10:19:55.783 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:19:55.895 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627781 2023-12-18T10:19:56.084 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:19:56.084 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:19:56.085 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:19:56.085 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:56.085 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-12-18T10:19:56.085 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:19:56.190 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627782 2023-12-18T10:19:56.379 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:19:56.379 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:19:56.379 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:19:56.380 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:19:56.380 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-12-18T10:19:56.380 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:19:56.486 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627783 2023-12-18T10:19:56.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 tag path /d1/d2/d3 tag123 2023-12-18T10:19:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.856+0000 7fe12142a640 1 Processor -- start 2023-12-18T10:19:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.856+0000 7fe12142a640 1 -- start start 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe12142a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe11c0c8ed0 0x7fe11c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe12142a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c070a10 con 0x7fe11c070ea0 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe12142a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c15d590 con 0x7fe11c153200 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe12142a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c071d60 con 0x7fe11c0c8ed0 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe11b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe11c070ea0 0x7fe11c0c87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40194/0 (socket says 172.21.15.133:40194) 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe11b7fe640 1 -- 172.21.15.133:0/3472147713 learned_addr learned my addr 172.21.15.133:0/3472147713 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe120c29640 1 --2- 172.21.15.133:0/3472147713 >> v2:172.21.15.133:3300/0 conn(0x7fe11c0c8ed0 0x7fe11c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe120c29640 1 -- 172.21.15.133:0/3472147713 >> v1:172.21.15.142:6789/0 conn(0x7fe11c153200 legacy=0x7fe11c0b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe120c29640 1 -- 172.21.15.133:0/3472147713 >> v1:172.21.15.133:6789/0 conn(0x7fe11c070ea0 legacy=0x7fe11c0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe120c29640 1 -- 172.21.15.133:0/3472147713 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c15d2b0 con 0x7fe11c0c8ed0 2023-12-18T10:19:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.860+0000 7fe11affd640 1 -- 172.21.15.133:0/3472147713 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219966668 0 0) 0x7fe11c070a10 con 0x7fe11c070ea0 2023-12-18T10:19:56.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe120c29640 1 --2- 172.21.15.133:0/3472147713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c0c8ed0 0x7fe11c15c660 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe114009d90 tx=0x7fe11401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373c867a70504ade server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:56.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe11affd640 1 -- 172.21.15.133:0/3472147713 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5810 con 0x7fe11c0c8ed0 2023-12-18T10:19:56.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe11affd640 1 -- 172.21.15.133:0/3472147713 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1140a5970 con 0x7fe11c0c8ed0 2023-12-18T10:19:56.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe11affd640 1 -- 172.21.15.133:0/3472147713 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140a5d00 con 0x7fe11c0c8ed0 2023-12-18T10:19:56.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 -- 172.21.15.133:0/3472147713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c0c8ed0 msgr2=0x7fe11c15c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 --2- 172.21.15.133:0/3472147713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c0c8ed0 0x7fe11c15c660 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe114009d90 tx=0x7fe11401c950 comp rx=0 tx=0).stop 2023-12-18T10:19:56.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 -- 172.21.15.133:0/3472147713 shutdown_connections 2023-12-18T10:19:56.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 --2- 172.21.15.133:0/3472147713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c0c8ed0 0x7fe11c15c660 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 -- 172.21.15.133:0/3472147713 >> 172.21.15.133:0/3472147713 conn(0x7fe11c06a2a0 msgr2=0x7fe11c0afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:56.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 -- 172.21.15.133:0/3472147713 shutdown_connections 2023-12-18T10:19:56.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 -- 172.21.15.133:0/3472147713 wait complete. 2023-12-18T10:19:56.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 Processor -- start 2023-12-18T10:19:56.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.864+0000 7fe12142a640 1 -- start start 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe12142a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c070ea0 0x7fe11c0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe12142a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0c8ed0 0x7fe11c14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe12142a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c153200 0x7fe11c150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe12142a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c149c10 con 0x7fe11c070ea0 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe12142a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c148f90 con 0x7fe11c0c8ed0 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe12142a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c149270 con 0x7fe11c153200 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c070ea0 0x7fe11c0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c070ea0 0x7fe11c0b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35168/0 (socket says 172.21.15.133:35168) 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 -- 172.21.15.133:0/168479147 learned_addr learned my addr 172.21.15.133:0/168479147 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0c8ed0 0x7fe11c14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe120c29640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c153200 0x7fe11c150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 -- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c153200 msgr2=0x7fe11c150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c153200 0x7fe11c150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 -- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0c8ed0 msgr2=0x7fe11c14a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0c8ed0 0x7fe11c14a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 -- 172.21.15.133:0/168479147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe114009a70 con 0x7fe11c070ea0 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0c8ed0 0x7fe11c14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe11bfff640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c070ea0 0x7fe11c0b0d50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c3c0 tx=0x7fe10c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe118ff9640 1 -- 172.21.15.133:0/168479147 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0052d0 con 0x7fe11c070ea0 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe118ff9640 1 -- 172.21.15.133:0/168479147 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c005430 con 0x7fe11c070ea0 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe12142a640 1 -- 172.21.15.133:0/168479147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c149550 con 0x7fe11c070ea0 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe118ff9640 1 -- 172.21.15.133:0/168479147 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c003840 con 0x7fe11c070ea0 2023-12-18T10:19:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.868+0000 7fe12142a640 1 -- 172.21.15.133:0/168479147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c148c20 con 0x7fe11c070ea0 2023-12-18T10:19:56.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe118ff9640 1 -- 172.21.15.133:0/168479147 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe10c0039a0 con 0x7fe11c070ea0 2023-12-18T10:19:56.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe118ff9640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe108065a60 0x7fe108067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe118ff9640 1 -- 172.21.15.133:0/168479147 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe10c082840 con 0x7fe11c070ea0 2023-12-18T10:19:56.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe108065a60 0x7fe108067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe1259f8000 1 Processor -- start 2023-12-18T10:19:56.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe108065a60 0x7fe108067f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe110007fd0 tx=0x7fe110007c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:56.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe1259f8000 1 -- start start 2023-12-18T10:19:56.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756300 0x55ed147566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756c20 0x55ed1470c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed1470c880 0x55ed1470cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe1259f8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed145d3480 con 0x55ed14756c20 2023-12-18T10:19:56.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe1259f8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed14561330 con 0x55ed1470c880 2023-12-18T10:19:56.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe1259f8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed1455e900 con 0x55ed14756300 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756c20 0x55ed1470c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756300 0x55ed147566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756c20 0x55ed1470c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35174/0 (socket says 172.21.15.133:35174) 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe120c29640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed1470c880 0x55ed1470cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 -- 172.21.15.133:0/2742951678 learned_addr learned my addr 172.21.15.133:0/2742951678 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 -- 172.21.15.133:0/2742951678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756300 msgr2=0x55ed147566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/2742951678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756300 0x55ed147566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 -- 172.21.15.133:0/2742951678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed1470c880 msgr2=0x55ed1470cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/2742951678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed1470c880 0x55ed1470cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 -- 172.21.15.133:0/2742951678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed14257000 con 0x55ed14756c20 2023-12-18T10:19:56.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/2742951678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756c20 0x55ed1470c340 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe110005d90 tx=0x7fe110012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ac134eff9fa6a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:56.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe101ffb640 1 -- 172.21.15.133:0/2742951678 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110015110 con 0x55ed14756c20 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe101ffb640 1 -- 172.21.15.133:0/2742951678 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe110015270 con 0x55ed14756c20 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.872+0000 7fe101ffb640 1 -- 172.21.15.133:0/2742951678 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110015bc0 con 0x55ed14756c20 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- 172.21.15.133:0/2742951678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756c20 msgr2=0x55ed1470c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 --2- 172.21.15.133:0/2742951678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756c20 0x55ed1470c340 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe110005d90 tx=0x7fe110012000 comp rx=0 tx=0).stop 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- 172.21.15.133:0/2742951678 shutdown_connections 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 --2- 172.21.15.133:0/2742951678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed1470c880 0x55ed1470cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 --2- 172.21.15.133:0/2742951678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756c20 0x55ed1470c340 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 --2- 172.21.15.133:0/2742951678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756300 0x55ed147566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- 172.21.15.133:0/2742951678 >> 172.21.15.133:0/2742951678 conn(0x55ed14708830 msgr2=0x55ed1470ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- 172.21.15.133:0/2742951678 shutdown_connections 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- 172.21.15.133:0/2742951678 wait complete. 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- start start 2023-12-18T10:19:56.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 Processor -- start 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 0x55ed14755be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 0x55ed14711620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1455a1f0 con 0x55ed14756300 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed144fa0e0 con 0x55ed14756c20 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed144f9d80 con 0x55ed1470c880 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe1259f8000 10 client.0 _ll_register_callbacks cb 0x55ed146f7be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147110e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35186/0 (socket says 172.21.15.133:35186) 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 -- 172.21.15.133:0/3255466179 learned_addr learned my addr 172.21.15.133:0/3255466179 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11bfff640 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 0x55ed14755be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe120c29640 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 0x55ed14711620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 -- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 msgr2=0x55ed14755be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:56.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 0x55ed14755be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 -- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 msgr2=0x55ed14711620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 0x55ed14711620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 -- 172.21.15.133:0/3255466179 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11000f040 con 0x55ed14756300 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe120c29640 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 0x55ed14711620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147110e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe110000c10 tx=0x7fe110007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e89a9de45de4ad server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe0faffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.876+0000 7fe0faffd640 1 -- 172.21.15.133:0/3255466179 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110028070 con 0x55ed14756300 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 -- 172.21.15.133:0/3255466179 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed14509b20 con 0x55ed14756300 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe0faffd640 1 -- 172.21.15.133:0/3255466179 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe110015bd0 con 0x55ed14756300 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe0faffd640 1 -- 172.21.15.133:0/3255466179 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe110015d90 con 0x55ed14756300 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 10 client.5862 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 -- 172.21.15.133:0/3255466179 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55ed1451f0a0 con 0x55ed14756300 2023-12-18T10:19:56.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe0faffd640 1 -- 172.21.15.133:0/3255466179 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed14509b20 con 0x55ed14756300 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe0faffd640 1 -- 172.21.15.133:0/3255466179 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fe110021450 con 0x55ed14756300 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 10 client.5862 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 10 client.5862 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 20 client.5862 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x55ed14757a40 0x55ed14767c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 4 client.5862 mds_command: new command op to 5508 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 -- 172.21.15.133:0/3255466179 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed14558b40 con 0x55ed14757a40 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe11bfff640 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x55ed14757a40 0x55ed14767c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe11bfff640 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x55ed14757a40 0x55ed14767c60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20e784d67be68ce8 server_cookie=e1c4bf0470a1fcdf in_seq=0 out_seq=0 2023-12-18T10:19:56.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe0faffd640 10 client.5862 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:56.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe0faffd640 1 -- 172.21.15.133:0/3255466179 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ed14558b40 con 0x55ed14757a40 2023-12-18T10:19:56.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe0faffd640 10 client.5862 handle_command_reply: tid=0 2023-12-18T10:19:56.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 client.5862 shutdown 2023-12-18T10:19:56.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 -- 172.21.15.133:0/3255466179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 msgr2=0x55ed147110e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147110e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe110000c10 tx=0x7fe110007a20 comp rx=0 tx=0).stop 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 -- 172.21.15.133:0/3255466179 shutdown_connections 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 0x55ed14711620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147110e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x55ed14757a40 0x55ed14767c60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 --2- 172.21.15.133:0/3255466179 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 0x55ed14755be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 -- 172.21.15.133:0/3255466179 >> 172.21.15.133:0/3255466179 conn(0x55ed14708830 msgr2=0x55ed1470b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe0faffd640 0 client.5862 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 -- 172.21.15.133:0/3255466179 shutdown_connections 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 1 -- 172.21.15.133:0/3255466179 wait complete. 2023-12-18T10:19:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.880+0000 7fe1259f8000 20 client.5862 trim_cache size 0 max 16384 2023-12-18T10:19:56.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe1259f8000 1 Processor -- start 2023-12-18T10:19:56.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe1259f8000 1 -- start start 2023-12-18T10:19:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 0x55ed14710cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147111f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 0x55ed14753290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe1259f8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed14217c80 con 0x55ed14756300 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe1259f8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed14559080 con 0x55ed14756c20 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe1259f8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed147081d0 con 0x55ed1470c880 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147111f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35190/0 (socket says 172.21.15.133:35190) 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 -- 172.21.15.133:0/4270579536 learned_addr learned my addr 172.21.15.133:0/4270579536 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 -- 172.21.15.133:0/4270579536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 msgr2=0x55ed14710cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/4270579536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 0x55ed14710cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 -- 172.21.15.133:0/4270579536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 msgr2=0x55ed14753290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/4270579536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 0x55ed14753290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 -- 172.21.15.133:0/4270579536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0b3820 con 0x55ed14756300 2023-12-18T10:19:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.896+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/4270579536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147111f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe110007fa0 tx=0x7fe110028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03dfef8cb683303 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1027fc640 1 -- 172.21.15.133:0/4270579536 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110021910 con 0x55ed14756300 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1027fc640 1 -- 172.21.15.133:0/4270579536 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11000b070 con 0x55ed14756300 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1027fc640 1 -- 172.21.15.133:0/4270579536 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110015270 con 0x55ed14756300 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- 172.21.15.133:0/4270579536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 msgr2=0x55ed147111f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 --2- 172.21.15.133:0/4270579536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147111f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe110007fa0 tx=0x7fe110028000 comp rx=0 tx=0).stop 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- 172.21.15.133:0/4270579536 shutdown_connections 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 --2- 172.21.15.133:0/4270579536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756c20 0x55ed14753290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 --2- 172.21.15.133:0/4270579536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed14756300 0x55ed147111f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 --2- 172.21.15.133:0/4270579536 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed1470c880 0x55ed14710cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- 172.21.15.133:0/4270579536 >> 172.21.15.133:0/4270579536 conn(0x55ed14708830 msgr2=0x55ed1470bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- 172.21.15.133:0/4270579536 shutdown_connections 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- 172.21.15.133:0/4270579536 wait complete. 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- start start 2023-12-18T10:19:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 Processor -- start 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed1470c880 0x55ed147b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756300 0x55ed147b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756c20 0x55ed14758e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1455b780 con 0x55ed1470c880 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed14557a00 con 0x55ed14756300 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed1455e1f0 con 0x55ed14756c20 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 10 client.0 _ll_register_callbacks cb 0x7fe110007270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed1470c880 0x55ed147b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed1470c880 0x55ed147b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35202/0 (socket says 172.21.15.133:35202) 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 -- 172.21.15.133:0/363161708 learned_addr learned my addr 172.21.15.133:0/363161708 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 -- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756c20 msgr2=0x55ed14758e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756c20 0x55ed14758e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 -- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756300 msgr2=0x55ed147b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756300 0x55ed147b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 -- 172.21.15.133:0/363161708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed1451f0a0 con 0x55ed1470c880 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe11bfff640 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed1470c880 0x55ed147b3fe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe10c050250 tx=0x7fe10c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443d461c94982655 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe0faffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe0faffd640 1 -- 172.21.15.133:0/363161708 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c050460 con 0x55ed1470c880 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe0faffd640 1 -- 172.21.15.133:0/363161708 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe10c0505c0 con 0x55ed1470c880 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- 172.21.15.133:0/363161708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed14517560 con 0x55ed1470c880 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe0faffd640 1 -- 172.21.15.133:0/363161708 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe10c05b8a0 con 0x55ed1470c880 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 10 client.5868 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe1259f8000 1 -- 172.21.15.133:0/363161708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55ed145053f0 con 0x55ed1470c880 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe0faffd640 1 -- 172.21.15.133:0/363161708 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed14517560 con 0x55ed1470c880 2023-12-18T10:19:56.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.900+0000 7fe0faffd640 1 -- 172.21.15.133:0/363161708 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fe10c04fb40 con 0x55ed1470c880 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 10 client.5868 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 10 client.5868 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 20 client.5868 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x55ed147593b0 0x55ed14759790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 4 client.5868 mds_command: new command op to 5508 tid=0[{"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}] 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 -- 172.21.15.133:0/363161708 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}) v1 -- 0x55ed14553270 con 0x55ed147593b0 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x55ed147593b0 0x55ed14759790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe11b7fe640 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x55ed147593b0 0x55ed14759790 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84585257f3ad28bc server_cookie=1a82587d5cf6299f in_seq=0 out_seq=0 2023-12-18T10:19:56.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe0faffd640 10 client.5868 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:56.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe0faffd640 1 -- 172.21.15.133:0/363161708 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+80 (crc 0 0 0) 0x55ed14553270 con 0x55ed147593b0 2023-12-18T10:19:56.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe0faffd640 10 client.5868 handle_command_reply: tid=0 2023-12-18T10:19:56.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 client.5868 shutdown 2023-12-18T10:19:56.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 -- 172.21.15.133:0/363161708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed1470c880 msgr2=0x55ed147b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed1470c880 0x55ed147b3fe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe10c050250 tx=0x7fe10c005040 comp rx=0 tx=0).stop 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 -- 172.21.15.133:0/363161708 shutdown_connections 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x55ed147593b0 0x55ed14759790 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ed14756c20 0x55ed14758e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed14756300 0x55ed147b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 --2- 172.21.15.133:0/363161708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ed1470c880 0x55ed147b3fe0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 -- 172.21.15.133:0/363161708 >> 172.21.15.133:0/363161708 conn(0x55ed14708830 msgr2=0x55ed14710530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe0faffd640 0 client.5868 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 -- 172.21.15.133:0/363161708 shutdown_connections 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 1 -- 172.21.15.133:0/363161708 wait complete. 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.904+0000 7fe1259f8000 20 client.5868 trim_cache size 0 max 16384 2023-12-18T10:19:56.911 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:56.912 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2023-12-18T10:19:56.912 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_tag": "tag123", 2023-12-18T10:19:56.912 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": "asynchronous" 2023-12-18T10:19:56.912 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:56.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 -- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe108065a60 msgr2=0x7fe108067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe108065a60 0x7fe108067f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe110007fd0 tx=0x7fe110007c80 comp rx=0 tx=0).stop 2023-12-18T10:19:56.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 -- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c070ea0 msgr2=0x7fe11c0b0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c070ea0 0x7fe11c0b0d50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c3c0 tx=0x7fe10c00c880 comp rx=0 tx=0).stop 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 -- 172.21.15.133:0/168479147 shutdown_connections 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe108065a60 0x7fe108067f20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe11c153200 0x7fe11c150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe11c0c8ed0 0x7fe11c14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 --2- 172.21.15.133:0/168479147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe11c070ea0 0x7fe11c0b0d50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 -- 172.21.15.133:0/168479147 >> 172.21.15.133:0/168479147 conn(0x7fe11c06a2a0 msgr2=0x7fe11c0c3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 -- 172.21.15.133:0/168479147 shutdown_connections 2023-12-18T10:19:56.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:56.908+0000 7fe12142a640 1 -- 172.21.15.133:0/168479147 wait complete. 2023-12-18T10:19:56.930 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-12-18T10:19:57.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.064+0000 7fc10e98f640 1 Processor -- start 2023-12-18T10:19:57.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.064+0000 7fc10e98f640 1 -- start start 2023-12-18T10:19:57.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc10e98f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc1080ca410 0x7fc108159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc10e98f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc108070df0 con 0x7fc108159fb0 2023-12-18T10:19:57.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc10e98f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10815a4f0 con 0x7fc1080cbff0 2023-12-18T10:19:57.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc10e98f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10815aab0 con 0x7fc1080ca410 2023-12-18T10:19:57.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc1077fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc108159fb0 0x7fc108071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40196/0 (socket says 172.21.15.133:40196) 2023-12-18T10:19:57.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc1077fe640 1 -- 172.21.15.133:0/235962491 learned_addr learned my addr 172.21.15.133:0/235962491 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:19:57.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc107fff640 1 --2- 172.21.15.133:0/235962491 >> v2:172.21.15.142:3300/0 conn(0x7fc1080ca410 0x7fc108159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc106ffd640 1 -- 172.21.15.133:0/235962491 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220522404 0 0) 0x7fc108070df0 con 0x7fc108159fb0 2023-12-18T10:19:57.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc106ffd640 1 -- 172.21.15.133:0/235962491 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f0005740 con 0x7fc108159fb0 2023-12-18T10:19:57.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc106ffd640 1 -- 172.21.15.133:0/235962491 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810521805 0 0) 0x7fc10815a4f0 con 0x7fc1080cbff0 2023-12-18T10:19:57.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc106ffd640 1 -- 172.21.15.133:0/235962491 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc108070df0 con 0x7fc1080cbff0 2023-12-18T10:19:57.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc107fff640 1 -- 172.21.15.133:0/235962491 >> v1:172.21.15.142:6789/0 conn(0x7fc1080cbff0 legacy=0x7fc1080ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc107fff640 1 -- 172.21.15.133:0/235962491 >> v1:172.21.15.133:6789/0 conn(0x7fc108159fb0 legacy=0x7fc108071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.068+0000 7fc107fff640 1 -- 172.21.15.133:0/235962491 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10815a7d0 con 0x7fc1080ca410 2023-12-18T10:19:57.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc107fff640 1 --2- 172.21.15.133:0/235962491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080ca410 0x7fc108159a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097c0 tx=0x7fc0f801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f637451f746fe25 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:57.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc106ffd640 1 -- 172.21.15.133:0/235962491 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8004230 con 0x7fc1080ca410 2023-12-18T10:19:57.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc106ffd640 1 -- 172.21.15.133:0/235962491 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f80a7050 con 0x7fc1080ca410 2023-12-18T10:19:57.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc106ffd640 1 -- 172.21.15.133:0/235962491 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8003620 con 0x7fc1080ca410 2023-12-18T10:19:57.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 -- 172.21.15.133:0/235962491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080ca410 msgr2=0x7fc108159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 --2- 172.21.15.133:0/235962491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080ca410 0x7fc108159a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097c0 tx=0x7fc0f801c450 comp rx=0 tx=0).stop 2023-12-18T10:19:57.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 -- 172.21.15.133:0/235962491 shutdown_connections 2023-12-18T10:19:57.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 --2- 172.21.15.133:0/235962491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080ca410 0x7fc108159a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 -- 172.21.15.133:0/235962491 >> 172.21.15.133:0/235962491 conn(0x7fc10806a2a0 msgr2=0x7fc1080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:57.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 -- 172.21.15.133:0/235962491 shutdown_connections 2023-12-18T10:19:57.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 -- 172.21.15.133:0/235962491 wait complete. 2023-12-18T10:19:57.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 Processor -- start 2023-12-18T10:19:57.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.072+0000 7fc10e98f640 1 -- start start 2023-12-18T10:19:57.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10e98f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080ca410 0x7fc108146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10e98f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080cbff0 0x7fc10814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10e98f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc108159fb0 0x7fc1081504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10e98f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108147090 con 0x7fc108159fb0 2023-12-18T10:19:57.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10e98f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10814c090 con 0x7fc1080cbff0 2023-12-18T10:19:57.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10e98f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10814c2e0 con 0x7fc1080ca410 2023-12-18T10:19:57.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc108159fb0 0x7fc1081504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc108159fb0 0x7fc1081504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35208/0 (socket says 172.21.15.133:35208) 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 -- 172.21.15.133:0/3300660380 learned_addr learned my addr 172.21.15.133:0/3300660380 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc107fff640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080ca410 0x7fc108146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc1077fe640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080cbff0 0x7fc10814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 -- 172.21.15.133:0/3300660380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080ca410 msgr2=0x7fc108146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080ca410 0x7fc108146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 -- 172.21.15.133:0/3300660380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080cbff0 msgr2=0x7fc10814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080cbff0 0x7fc10814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 -- 172.21.15.133:0/3300660380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8009420 con 0x7fc108159fb0 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc108159fb0 0x7fc1081504e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c7c0 tx=0x7fc10000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc104ff9640 1 -- 172.21.15.133:0/3300660380 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100003b80 con 0x7fc108159fb0 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc104ff9640 1 -- 172.21.15.133:0/3300660380 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100003ce0 con 0x7fc108159fb0 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc104ff9640 1 -- 172.21.15.133:0/3300660380 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000a9f0 con 0x7fc108159fb0 2023-12-18T10:19:57.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10e98f640 1 -- 172.21.15.133:0/3300660380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1080cc960 con 0x7fc108159fb0 2023-12-18T10:19:57.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.076+0000 7fc10e98f640 1 -- 172.21.15.133:0/3300660380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10814c8a0 con 0x7fc108159fb0 2023-12-18T10:19:57.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc104ff9640 1 -- 172.21.15.133:0/3300660380 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc10000ab50 con 0x7fc108159fb0 2023-12-18T10:19:57.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc104ff9640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0f4065a90 0x7fc0f4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc104ff9640 1 -- 172.21.15.133:0/3300660380 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc100082fd0 con 0x7fc108159fb0 2023-12-18T10:19:57.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc107fff640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0f4065a90 0x7fc0f4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc111cef000 1 Processor -- start 2023-12-18T10:19:57.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc111cef000 1 -- start start 2023-12-18T10:19:57.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc107fff640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0f4065a90 0x7fc0f4067f50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ad000 tx=0x7fc0f80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:57.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc111cef000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d9fc80 0x5636c8da0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc111cef000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8d55a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc111cef000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d55fc0 0x5636c8d563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc111cef000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c8c1e430 con 0x5636c8da05a0 2023-12-18T10:19:57.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc111cef000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c8bac460 con 0x5636c8d55fc0 2023-12-18T10:19:57.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc111cef000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636c8ba9a30 con 0x5636c8d9fc80 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8d55a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8d55a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35214/0 (socket says 172.21.15.133:35214) 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 -- 172.21.15.133:0/2967131974 learned_addr learned my addr 172.21.15.133:0/2967131974 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc107fff640 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d9fc80 0x5636c8da0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d55fc0 0x5636c8d563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 -- 172.21.15.133:0/2967131974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d9fc80 msgr2=0x5636c8da0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d9fc80 0x5636c8da0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 -- 172.21.15.133:0/2967131974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d55fc0 msgr2=0x5636c8d563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d55fc0 0x5636c8d563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 -- 172.21.15.133:0/2967131974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636c88a1e20 con 0x5636c8da05a0 2023-12-18T10:19:57.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc1077fe640 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8d55a80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc007fd0 tx=0x7fc0fc007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7450efdb0a2425dc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:57.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc0edffb640 1 -- 172.21.15.133:0/2967131974 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc007750 con 0x5636c8da05a0 2023-12-18T10:19:57.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc0edffb640 1 -- 172.21.15.133:0/2967131974 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc0018b0 con 0x5636c8da05a0 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.080+0000 7fc0edffb640 1 -- 172.21.15.133:0/2967131974 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc001c20 con 0x5636c8da05a0 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- 172.21.15.133:0/2967131974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 msgr2=0x5636c8d55a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8d55a80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc007fd0 tx=0x7fc0fc007410 comp rx=0 tx=0).stop 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- 172.21.15.133:0/2967131974 shutdown_connections 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d55fc0 0x5636c8d563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8d55a80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 --2- 172.21.15.133:0/2967131974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d9fc80 0x5636c8da0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- 172.21.15.133:0/2967131974 >> 172.21.15.133:0/2967131974 conn(0x5636c8b54910 msgr2=0x5636c8d54360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- 172.21.15.133:0/2967131974 shutdown_connections 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- 172.21.15.133:0/2967131974 wait complete. 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- start start 2023-12-18T10:19:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 Processor -- start 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8da0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 0x5636c8da12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8da17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c8ba5320 con 0x5636c8da05a0 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c8b444f0 con 0x5636c8d9fc80 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636c8b626e0 con 0x5636c8d55fc0 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 10 client.0 _ll_register_callbacks cb 0x5636c8d41980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8da17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8da17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35226/0 (socket says 172.21.15.133:35226) 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 -- 172.21.15.133:0/401651736 learned_addr learned my addr 172.21.15.133:0/401651736 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc1077fe640 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 0x5636c8da12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc107fff640 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8da0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 -- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 msgr2=0x5636c8da0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8da0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 -- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 msgr2=0x5636c8da12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 0x5636c8da12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 -- 172.21.15.133:0/401651736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f0005740 con 0x5636c8da05a0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8da17f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc100054530 tx=0x7fc100058460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0a5e21f52e1c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc0e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/401651736 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000ae80 con 0x5636c8da05a0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/401651736 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc10007ccf0 con 0x5636c8da05a0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- 172.21.15.133:0/401651736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636c8b62120 con 0x5636c8da05a0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/401651736 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc10005c040 con 0x5636c8da05a0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 10 client.5880 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.084+0000 7fc111cef000 1 -- 172.21.15.133:0/401651736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5636c8b6a250 con 0x5636c8da05a0 2023-12-18T10:19:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/401651736 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636c8b62120 con 0x5636c8da05a0 2023-12-18T10:19:57.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/401651736 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fc100019020 con 0x5636c8da05a0 2023-12-18T10:19:57.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 10 client.5880 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:57.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 10 client.5880 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-18T10:19:57.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 20 client.5880 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:57.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5636c8da20c0 0x5636c8db5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 4 client.5880 mds_command: new command op to 5508 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:19:57.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 -- 172.21.15.133:0/401651736 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636c8ba3c70 con 0x5636c8da20c0 2023-12-18T10:19:57.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc107fff640 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5636c8da20c0 0x5636c8db5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc107fff640 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5636c8da20c0 0x5636c8db5af0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed852d26ce9dc80c server_cookie=620b7750356019f0 in_seq=0 out_seq=0 2023-12-18T10:19:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc0e6ffd640 10 client.5880 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/401651736 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5636c8ba3c70 con 0x5636c8da20c0 2023-12-18T10:19:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc0e6ffd640 10 client.5880 handle_command_reply: tid=0 2023-12-18T10:19:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 client.5880 shutdown 2023-12-18T10:19:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 -- 172.21.15.133:0/401651736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 msgr2=0x5636c8da17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8da17f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fc100054530 tx=0x7fc100058460 comp rx=0 tx=0).stop 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 -- 172.21.15.133:0/401651736 shutdown_connections 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8da17f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 0x5636c8da12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5636c8da20c0 0x5636c8db5af0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 --2- 172.21.15.133:0/401651736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8da0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc0e6ffd640 0 client.5880 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 -- 172.21.15.133:0/401651736 >> 172.21.15.133:0/401651736 conn(0x5636c8b54910 msgr2=0x5636c8d54a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 -- 172.21.15.133:0/401651736 shutdown_connections 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 1 -- 172.21.15.133:0/401651736 wait complete. 2023-12-18T10:19:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.088+0000 7fc111cef000 20 client.5880 trim_cache size 0 max 16384 2023-12-18T10:19:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 Processor -- start 2023-12-18T10:19:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- start start 2023-12-18T10:19:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8db0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8d9fc80 0x5636c8d549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8da05a0 0x5636c8d54f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c8862aa0 con 0x5636c8d9fc80 2023-12-18T10:19:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c8be84d0 con 0x5636c8da05a0 2023-12-18T10:19:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636c8c74140 con 0x5636c8d55fc0 2023-12-18T10:19:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8d9fc80 0x5636c8d549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8d9fc80 0x5636c8d549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35242/0 (socket says 172.21.15.133:35242) 2023-12-18T10:19:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 -- 172.21.15.133:0/4035688243 learned_addr learned my addr 172.21.15.133:0/4035688243 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:57.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 -- 172.21.15.133:0/4035688243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 msgr2=0x5636c8db0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:57.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 --2- 172.21.15.133:0/4035688243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8db0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 -- 172.21.15.133:0/4035688243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8da05a0 msgr2=0x5636c8d54f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 --2- 172.21.15.133:0/4035688243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8da05a0 0x5636c8d54f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 -- 172.21.15.133:0/4035688243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636c8b505a0 con 0x5636c8d9fc80 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc1077fe640 1 --2- 172.21.15.133:0/4035688243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8d9fc80 0x5636c8d549e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc015040 tx=0x7fc0fc00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347c4f3a487a8f8c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc0ee7fc640 1 -- 172.21.15.133:0/4035688243 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc024030 con 0x5636c8d9fc80 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc0ee7fc640 1 -- 172.21.15.133:0/4035688243 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc00b040 con 0x5636c8d9fc80 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc0ee7fc640 1 -- 172.21.15.133:0/4035688243 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc001ab0 con 0x5636c8d9fc80 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- 172.21.15.133:0/4035688243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8d9fc80 msgr2=0x5636c8d549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 --2- 172.21.15.133:0/4035688243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8d9fc80 0x5636c8d549e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc015040 tx=0x7fc0fc00c000 comp rx=0 tx=0).stop 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- 172.21.15.133:0/4035688243 shutdown_connections 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 --2- 172.21.15.133:0/4035688243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8da05a0 0x5636c8d54f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 --2- 172.21.15.133:0/4035688243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8d9fc80 0x5636c8d549e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 --2- 172.21.15.133:0/4035688243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8db0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- 172.21.15.133:0/4035688243 >> 172.21.15.133:0/4035688243 conn(0x5636c8b54910 msgr2=0x5636c8d9f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- 172.21.15.133:0/4035688243 shutdown_connections 2023-12-18T10:19:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.104+0000 7fc111cef000 1 -- 172.21.15.133:0/4035688243 wait complete. 2023-12-18T10:19:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 -- start start 2023-12-18T10:19:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 Processor -- start 2023-12-18T10:19:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8db01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 0x5636c8dfda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8dfdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c8ba0c90 con 0x5636c8da05a0 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636c8b4a820 con 0x5636c8d9fc80 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636c8ba2720 con 0x5636c8d55fc0 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 10 client.0 _ll_register_callbacks cb 0x5636c8b5c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8dfdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8dfdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35248/0 (socket says 172.21.15.133:35248) 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 -- 172.21.15.133:0/1855225270 learned_addr learned my addr 172.21.15.133:0/1855225270 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc107fff640 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8db01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc1077fe640 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 0x5636c8dfda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 -- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 msgr2=0x5636c8db01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8db01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 -- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 msgr2=0x5636c8dfda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 0x5636c8dfda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 -- 172.21.15.133:0/1855225270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636c88a1e20 con 0x5636c8da05a0 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc10cf2c640 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8dfdf90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc10000a430 tx=0x7fc100001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b5476609f02d67 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:19:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc0e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/1855225270 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000540e0 con 0x5636c8da05a0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/1855225270 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc100053860 con 0x5636c8da05a0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 -- 172.21.15.133:0/1855225270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636c8b6e6a0 con 0x5636c8da05a0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/1855225270 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1000508e0 con 0x5636c8da05a0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 10 client.5886 fetch_fsmap learned FSMap version 24 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 -- 172.21.15.133:0/1855225270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5636c8b44110 con 0x5636c8da05a0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/1855225270 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636c8b6e6a0 con 0x5636c8da05a0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/1855225270 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fc100019040 con 0x5636c8da05a0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 10 client.5886 fetch_fsmap finished waiting for FSMap version 24 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 10 client.5886 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 20 client.5886 populate_metadata read hostname 'smithi133' 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5636c8dad5b0 0x5636c8dad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 4 client.5886 mds_command: new command op to 5508 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc111cef000 1 -- 172.21.15.133:0/1855225270 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5636c8b9e3a0 con 0x5636c8dad5b0 2023-12-18T10:19:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc107fff640 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5636c8dad5b0 0x5636c8dad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc107fff640 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5636c8dad5b0 0x5636c8dad9c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=199009dd98af8e66 server_cookie=95f25d325dc22d73 in_seq=0 out_seq=0 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.108+0000 7fc0e6ffd640 10 client.5886 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc0e6ffd640 1 -- 172.21.15.133:0/1855225270 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+207 (crc 0 0 0) 0x5636c8b9e3a0 con 0x5636c8dad5b0 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc0e6ffd640 10 client.5886 handle_command_reply: tid=0 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 client.5886 shutdown 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 -- 172.21.15.133:0/1855225270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 msgr2=0x5636c8dfdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8dfdf90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc10000a430 tx=0x7fc100001260 comp rx=0 tx=0).stop 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 -- 172.21.15.133:0/1855225270 shutdown_connections 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636c8da05a0 0x5636c8dfdf90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636c8d9fc80 0x5636c8dfda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x5636c8dad5b0 0x5636c8dad9c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 --2- 172.21.15.133:0/1855225270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636c8d55fc0 0x5636c8db01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc0e6ffd640 0 client.5886 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:19:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 -- 172.21.15.133:0/1855225270 >> 172.21.15.133:0/1855225270 conn(0x5636c8b54910 msgr2=0x5636c8d9f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 -- 172.21.15.133:0/1855225270 shutdown_connections 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 1 -- 172.21.15.133:0/1855225270 wait complete. 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc111cef000 20 client.5886 trim_cache size 0 max 16384 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: "tag123": { 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "tag123", 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:19:57.119 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:19:57.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 -- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0f4065a90 msgr2=0x7fc0f4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0f4065a90 0x7fc0f4067f50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ad000 tx=0x7fc0f80a6000 comp rx=0 tx=0).stop 2023-12-18T10:19:57.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 -- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc108159fb0 msgr2=0x7fc1081504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:19:57.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc108159fb0 0x7fc1081504e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c7c0 tx=0x7fc10000cc80 comp rx=0 tx=0).stop 2023-12-18T10:19:57.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 -- 172.21.15.133:0/3300660380 shutdown_connections 2023-12-18T10:19:57.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0f4065a90 0x7fc0f4067f50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc108159fb0 0x7fc1081504e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1080cbff0 0x7fc10814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 --2- 172.21.15.133:0/3300660380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080ca410 0x7fc108146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:19:57.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 -- 172.21.15.133:0/3300660380 >> 172.21.15.133:0/3300660380 conn(0x7fc10806a2a0 msgr2=0x7fc1080c8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:19:57.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 -- 172.21.15.133:0/3300660380 shutdown_connections 2023-12-18T10:19:57.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:19:57.112+0000 7fc10e98f640 1 -- 172.21.15.133:0/3300660380 wait complete. 2023-12-18T10:19:57.134 INFO:tasks.cephfs.filesystem:scrub status for tag:tag123 - {'path': '/d1/d2/d3', 'tag': 'tag123', 'options': 'recursive,force'} 2023-12-18T10:19:58.229 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:19:58.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:20:27.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-12-18T10:20:27.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21e48e5640 1 Processor -- start 2023-12-18T10:20:27.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21e48e5640 1 -- start start 2023-12-18T10:20:27.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21e48e5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21e01598d0 0x7f21e00ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21e48e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e00ce8d0 0x7f21e0070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21e48e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00c9730 con 0x7f21e0153020 2023-12-18T10:20:27.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21e48e5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e00ced60 con 0x7f21e01598d0 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21e48e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00c8e00 con 0x7f21e00ce8d0 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21d7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21e01598d0 0x7f21e00ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21d7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21e01598d0 0x7f21e00ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50850/0 (socket says 172.21.15.133:50850) 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21d7fff640 1 -- 172.21.15.133:0/645270838 learned_addr learned my addr 172.21.15.133:0/645270838 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21ded9d640 1 --2- 172.21.15.133:0/645270838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e00ce8d0 0x7f21e0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21d7fff640 1 -- 172.21.15.133:0/645270838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e00ce8d0 msgr2=0x7f21e0070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21d7fff640 1 --2- 172.21.15.133:0/645270838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e00ce8d0 0x7f21e0070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21d7fff640 1 -- 172.21.15.133:0/645270838 >> v1:172.21.15.142:6789/0 conn(0x7f21e0153020 legacy=0x7f21e00c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21d7fff640 1 -- 172.21.15.133:0/645270838 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00c90e0 con 0x7f21e01598d0 2023-12-18T10:20:27.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.284+0000 7f21ddd9b640 1 -- 172.21.15.133:0/645270838 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988028244 0 0) 0x7f21e00c9730 con 0x7f21e0153020 2023-12-18T10:20:27.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21d7fff640 1 --2- 172.21.15.133:0/645270838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e01598d0 0x7f21e00ce390 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009870 tx=0x7f21c801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4393856285e741e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21ddd9b640 1 -- 172.21.15.133:0/645270838 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80ad640 con 0x7f21e01598d0 2023-12-18T10:20:27.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21ddd9b640 1 -- 172.21.15.133:0/645270838 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c80ad7a0 con 0x7f21e01598d0 2023-12-18T10:20:27.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21ddd9b640 1 -- 172.21.15.133:0/645270838 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80adb30 con 0x7f21e01598d0 2023-12-18T10:20:27.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21e48e5640 1 -- 172.21.15.133:0/645270838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e01598d0 msgr2=0x7f21e00ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21e48e5640 1 --2- 172.21.15.133:0/645270838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e01598d0 0x7f21e00ce390 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009870 tx=0x7f21c801c3f0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21e48e5640 1 -- 172.21.15.133:0/645270838 shutdown_connections 2023-12-18T10:20:27.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21e48e5640 1 --2- 172.21.15.133:0/645270838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e00ce8d0 0x7f21e0070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21e48e5640 1 --2- 172.21.15.133:0/645270838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e01598d0 0x7f21e00ce390 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21e48e5640 1 -- 172.21.15.133:0/645270838 >> 172.21.15.133:0/645270838 conn(0x7f21e006a2a0 msgr2=0x7f21e00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21e48e5640 1 -- 172.21.15.133:0/645270838 shutdown_connections 2023-12-18T10:20:27.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.288+0000 7f21e48e5640 1 -- 172.21.15.133:0/645270838 wait complete. 2023-12-18T10:20:27.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 Processor -- start 2023-12-18T10:20:27.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 -- start start 2023-12-18T10:20:27.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e00ce8d0 0x7f21e0166f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e0153020 0x7f21e014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21e01598d0 0x7f21e0156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0165d90 con 0x7f21e00ce8d0 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0166070 con 0x7f21e01598d0 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0166350 con 0x7f21e0153020 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e00ce8d0 0x7f21e0166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e00ce8d0 0x7f21e0166f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50856/0 (socket says 172.21.15.133:50856) 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 -- 172.21.15.133:0/2540973789 learned_addr learned my addr 172.21.15.133:0/2540973789 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21ded9d640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21e01598d0 0x7f21e0156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21d7fff640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e0153020 0x7f21e014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 -- 172.21.15.133:0/2540973789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e0153020 msgr2=0x7f21e014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e0153020 0x7f21e014d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 -- 172.21.15.133:0/2540973789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21e01598d0 msgr2=0x7f21e0156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21e01598d0 0x7f21e0156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 -- 172.21.15.133:0/2540973789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c80094d0 con 0x7f21e00ce8d0 2023-12-18T10:20:27.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21de59c640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e00ce8d0 0x7f21e0166f60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21d000c4d0 tx=0x7f21d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21d6ffd640 1 -- 172.21.15.133:0/2540973789 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0005480 con 0x7f21e00ce8d0 2023-12-18T10:20:27.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21d6ffd640 1 -- 172.21.15.133:0/2540973789 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0003600 con 0x7f21e00ce8d0 2023-12-18T10:20:27.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21d6ffd640 1 -- 172.21.15.133:0/2540973789 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00039b0 con 0x7f21e00ce8d0 2023-12-18T10:20:27.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 -- 172.21.15.133:0/2540973789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e0166630 con 0x7f21e00ce8d0 2023-12-18T10:20:27.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.292+0000 7f21e48e5640 1 -- 172.21.15.133:0/2540973789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e014d760 con 0x7f21e00ce8d0 2023-12-18T10:20:27.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21d6ffd640 1 -- 172.21.15.133:0/2540973789 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f21d0003b10 con 0x7f21e00ce8d0 2023-12-18T10:20:27.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21d6ffd640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f21c0065a90 0x7f21c0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21d6ffd640 1 -- 172.21.15.133:0/2540973789 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21d00828c0 con 0x7f21e00ce8d0 2023-12-18T10:20:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21d7fff640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f21c0065a90 0x7f21c0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21e7c38000 1 Processor -- start 2023-12-18T10:20:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21e7c38000 1 -- start start 2023-12-18T10:20:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21d7fff640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f21c0065a90 0x7f21c0067f50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f21c80af000 tx=0x7f21c80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181736060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x5641816eba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x5641816ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21e7c38000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641815b4430 con 0x5641817365a0 2023-12-18T10:20:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21e7c38000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564181542460 con 0x564181735c80 2023-12-18T10:20:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.296+0000 7f21e7c38000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56418153fa30 con 0x5641816ebfc0 2023-12-18T10:20:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x5641816eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x5641816eba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50872/0 (socket says 172.21.15.133:50872) 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 -- 172.21.15.133:0/3517868462 learned_addr learned my addr 172.21.15.133:0/3517868462 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21de59c640 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181736060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21ded9d640 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x5641816ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 -- 172.21.15.133:0/3517868462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 msgr2=0x5641816ec3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x5641816ec3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 -- 172.21.15.133:0/3517868462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 msgr2=0x564181736060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181736060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 -- 172.21.15.133:0/3517868462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564181237e20 con 0x5641817365a0 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21d7fff640 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x5641816eba80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000c10 tx=0x7f21c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d846a6c8abe539 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21bffff640 1 -- 172.21.15.133:0/3517868462 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80bd070 con 0x5641817365a0 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21bffff640 1 -- 172.21.15.133:0/3517868462 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c80a6040 con 0x5641817365a0 2023-12-18T10:20:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21bffff640 1 -- 172.21.15.133:0/3517868462 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80b77d0 con 0x5641817365a0 2023-12-18T10:20:27.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 -- 172.21.15.133:0/3517868462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 msgr2=0x5641816eba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x5641816eba80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21c8000c10 tx=0x7f21c8004740 comp rx=0 tx=0).stop 2023-12-18T10:20:27.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 -- 172.21.15.133:0/3517868462 shutdown_connections 2023-12-18T10:20:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x5641816ec3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x5641816eba80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3517868462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181736060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 -- 172.21.15.133:0/3517868462 >> 172.21.15.133:0/3517868462 conn(0x5641814ea910 msgr2=0x5641816ea360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 -- 172.21.15.133:0/3517868462 shutdown_connections 2023-12-18T10:20:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 -- 172.21.15.133:0/3517868462 wait complete. 2023-12-18T10:20:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 -- start start 2023-12-18T10:20:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.300+0000 7f21e7c38000 1 Processor -- start 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x564181736980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181736ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641817365a0 0x564181737400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56418153b320 con 0x564181735c80 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641814da4f0 con 0x5641817365a0 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641814f86e0 con 0x5641816ebfc0 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 10 client.0 _ll_register_callbacks cb 0x5641816d7980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181736ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181736ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50878/0 (socket says 172.21.15.133:50878) 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 -- 172.21.15.133:0/3392102576 learned_addr learned my addr 172.21.15.133:0/3392102576 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21de59c640 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x564181736980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21ded9d640 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641817365a0 0x564181737400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 -- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 msgr2=0x564181736980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x564181736980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 -- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641817365a0 msgr2=0x564181737400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641817365a0 0x564181737400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 -- 172.21.15.133:0/3392102576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e00c90e0 con 0x564181735c80 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21d7fff640 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181736ec0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f21c801aaa0 tx=0x7f21c801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e2ec9b1aaf6770 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 1 -- 172.21.15.133:0/3392102576 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80bd070 con 0x564181735c80 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 1 -- 172.21.15.133:0/3392102576 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21c80b7dd0 con 0x564181735c80 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- 172.21.15.133:0/3392102576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641814f8120 con 0x564181735c80 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 1 -- 172.21.15.133:0/3392102576 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21c80bb070 con 0x564181735c80 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 10 client.5898 fetch_fsmap learned FSMap version 25 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- 172.21.15.133:0/3392102576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x564181500250 con 0x564181735c80 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 1 -- 172.21.15.133:0/3392102576 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641814f8120 con 0x564181735c80 2023-12-18T10:20:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 1 -- 172.21.15.133:0/3392102576 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f21c80d3020 con 0x564181735c80 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 10 client.5898 fetch_fsmap finished waiting for FSMap version 25 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 10 client.5898 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 20 client.5898 populate_metadata read hostname 'smithi133' 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x564181737e10 0x564181747850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 4 client.5898 mds_command: new command op to 5508 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- 172.21.15.133:0/3392102576 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564181539c70 con 0x564181737e10 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21de59c640 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x564181737e10 0x564181747850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21de59c640 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x564181737e10 0x564181747850 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cec4d94f001da26b server_cookie=c3f83ba62c4a897d in_seq=0 out_seq=0 2023-12-18T10:20:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 10 client.5898 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:20:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 1 -- 172.21.15.133:0/3392102576 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x564181539c70 con 0x564181737e10 2023-12-18T10:20:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 10 client.5898 handle_command_reply: tid=0 2023-12-18T10:20:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 client.5898 shutdown 2023-12-18T10:20:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- 172.21.15.133:0/3392102576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 msgr2=0x564181736ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181736ec0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f21c801aaa0 tx=0x7f21c801ac30 comp rx=0 tx=0).stop 2023-12-18T10:20:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- 172.21.15.133:0/3392102576 shutdown_connections 2023-12-18T10:20:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641817365a0 0x564181737400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181736ec0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x564181737e10 0x564181747850 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 --2- 172.21.15.133:0/3392102576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x564181736980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21bd7fa640 0 client.5898 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:20:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.304+0000 7f21e7c38000 1 -- 172.21.15.133:0/3392102576 >> 172.21.15.133:0/3392102576 conn(0x5641814ea910 msgr2=0x5641816eaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.308+0000 7f21e7c38000 1 -- 172.21.15.133:0/3392102576 shutdown_connections 2023-12-18T10:20:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.308+0000 7f21e7c38000 1 -- 172.21.15.133:0/3392102576 wait complete. 2023-12-18T10:20:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.308+0000 7f21e7c38000 20 client.5898 trim_cache size 0 max 16384 2023-12-18T10:20:27.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21e7c38000 1 Processor -- start 2023-12-18T10:20:27.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21e7c38000 1 -- start start 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x564181748860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181748da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x56418172f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21e7c38000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641811f8aa0 con 0x5641817365a0 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21e7c38000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641815436f0 con 0x564181735c80 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21e7c38000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564181742470 con 0x5641816ebfc0 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x56418172f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x56418172f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50886/0 (socket says 172.21.15.133:50886) 2023-12-18T10:20:27.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 -- 172.21.15.133:0/1232189997 learned_addr learned my addr 172.21.15.133:0/1232189997 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21de59c640 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x564181748860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21d7fff640 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181748da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 -- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 msgr2=0x564181748860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x564181748860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 -- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 msgr2=0x564181748da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181748da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 -- 172.21.15.133:0/1232189997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641814e65a0 con 0x5641817365a0 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21d7fff640 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181748da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.320+0000 7f21ded9d640 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x56418172f010 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f21d8003cc0 tx=0x7f21d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99429c32633166d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d4ff9640 1 -- 172.21.15.133:0/1232189997 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d800e040 con 0x5641817365a0 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d4ff9640 1 -- 172.21.15.133:0/1232189997 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d800f040 con 0x5641817365a0 2023-12-18T10:20:27.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d4ff9640 1 -- 172.21.15.133:0/1232189997 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8017a60 con 0x5641817365a0 2023-12-18T10:20:27.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- 172.21.15.133:0/1232189997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 msgr2=0x56418172f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x56418172f010 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f21d8003cc0 tx=0x7f21d8009750 comp rx=0 tx=0).stop 2023-12-18T10:20:27.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- 172.21.15.133:0/1232189997 shutdown_connections 2023-12-18T10:20:27.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641817365a0 0x56418172f010 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564181735c80 0x564181748da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 --2- 172.21.15.133:0/1232189997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641816ebfc0 0x564181748860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- 172.21.15.133:0/1232189997 >> 172.21.15.133:0/1232189997 conn(0x5641814ea910 msgr2=0x5641816f1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- 172.21.15.133:0/1232189997 shutdown_connections 2023-12-18T10:20:27.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- 172.21.15.133:0/1232189997 wait complete. 2023-12-18T10:20:27.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- start start 2023-12-18T10:20:27.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 Processor -- start 2023-12-18T10:20:27.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641816ebfc0 0x5641817938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181793e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641817365a0 0x5641817321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641817431a0 con 0x564181735c80 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56418160a140 con 0x5641816ebfc0 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564181538b30 con 0x5641817365a0 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21e7c38000 10 client.0 _ll_register_callbacks cb 0x5641814f2710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181793e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181793e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50902/0 (socket says 172.21.15.133:50902) 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 -- 172.21.15.133:0/2957135411 learned_addr learned my addr 172.21.15.133:0/2957135411 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21ded9d640 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641817365a0 0x5641817321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21de59c640 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641816ebfc0 0x5641817938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 -- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641817365a0 msgr2=0x5641817321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641817365a0 0x5641817321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 -- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641816ebfc0 msgr2=0x5641817938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641816ebfc0 0x5641817938f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 -- 172.21.15.133:0/2957135411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d80039a0 con 0x564181735c80 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21d7fff640 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181793e30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f21c801c220 tx=0x7f21c80a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f543b4c68d94a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.324+0000 7f21bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 1 -- 172.21.15.133:0/2957135411 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80c38e0 con 0x564181735c80 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 -- 172.21.15.133:0/2957135411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641816ef940 con 0x564181735c80 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 1 -- 172.21.15.133:0/2957135411 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21c80cdc10 con 0x564181735c80 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 1 -- 172.21.15.133:0/2957135411 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21c80cddd0 con 0x564181735c80 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 10 client.5904 fetch_fsmap learned FSMap version 25 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 -- 172.21.15.133:0/2957135411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5641814da110 con 0x564181735c80 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 1 -- 172.21.15.133:0/2957135411 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641816ef940 con 0x564181735c80 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 1 -- 172.21.15.133:0/2957135411 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 25) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f21c80d3030 con 0x564181735c80 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 10 client.5904 fetch_fsmap finished waiting for FSMap version 25 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 10 client.5904 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 20 client.5904 populate_metadata read hostname 'smithi133' 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x564181732730 0x564181732b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 4 client.5904 mds_command: new command op to 5508 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:20:27.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 -- 172.21.15.133:0/2957135411 --> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5641815046a0 con 0x564181732730 2023-12-18T10:20:27.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21de59c640 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x564181732730 0x564181732b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 10 client.5904 ms_handle_connect on v2:172.21.15.142:6833/979808628 2023-12-18T10:20:27.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21de59c640 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x564181732730 0x564181732b10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=601973cc4d9e87c9 server_cookie=80d1da371f558894 in_seq=0 out_seq=0 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 1 -- 172.21.15.133:0/2957135411 <== mds.0 v2:172.21.15.142:6833/979808628 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5641815046a0 con 0x564181732730 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 10 client.5904 handle_command_reply: tid=0 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 client.5904 shutdown 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 -- 172.21.15.133:0/2957135411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 msgr2=0x564181793e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181793e30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f21c801c220 tx=0x7f21c80a7000 comp rx=0 tx=0).stop 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 -- 172.21.15.133:0/2957135411 shutdown_connections 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:6833/979808628,v1:172.21.15.142:6835/979808628] conn(0x564181732730 0x564181732b10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641817365a0 0x5641817321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564181735c80 0x564181793e30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 --2- 172.21.15.133:0/2957135411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641816ebfc0 0x5641817938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21bd7fa640 0 client.5904 ms_handle_reset on v2:172.21.15.142:6833/979808628 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 -- 172.21.15.133:0/2957135411 >> 172.21.15.133:0/2957135411 conn(0x5641814ea910 msgr2=0x564181747850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 -- 172.21.15.133:0/2957135411 shutdown_connections 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 1 -- 172.21.15.133:0/2957135411 wait complete. 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e7c38000 20 client.5904 trim_cache size 0 max 16384 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "no active scrubs running", 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": {} 2023-12-18T10:20:27.336 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:20:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 -- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f21c0065a90 msgr2=0x7f21c0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f21c0065a90 0x7f21c0067f50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f21c80af000 tx=0x7f21c80a7070 comp rx=0 tx=0).stop 2023-12-18T10:20:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 -- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e00ce8d0 msgr2=0x7f21e0166f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e00ce8d0 0x7f21e0166f60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21d000c4d0 tx=0x7f21d000c990 comp rx=0 tx=0).stop 2023-12-18T10:20:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 -- 172.21.15.133:0/2540973789 shutdown_connections 2023-12-18T10:20:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f21c0065a90 0x7f21c0067f50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21e01598d0 0x7f21e0156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f21e0153020 0x7f21e014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 --2- 172.21.15.133:0/2540973789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e00ce8d0 0x7f21e0166f60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 -- 172.21.15.133:0/2540973789 >> 172.21.15.133:0/2540973789 conn(0x7f21e006a2a0 msgr2=0x7f21e015a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 -- 172.21.15.133:0/2540973789 shutdown_connections 2023-12-18T10:20:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.328+0000 7f21e48e5640 1 -- 172.21.15.133:0/2540973789 wait complete. 2023-12-18T10:20:27.352 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:20:27.352 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000002.00000000 scrub_tag 2023-12-18T10:20:27.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 Processor -- start 2023-12-18T10:20:27.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- start start 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 0x56158aedb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158ada85f0 0x56158aedabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158adc2a30 0x56158ae4f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158acbf4d0 con 0x56158ada85f0 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158acbf1d0 con 0x56158ada8210 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56158acb5e40 con 0x56158adc2a30 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158ada85f0 0x56158aedabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158ada85f0 0x56158aedabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50914/0 (socket says 172.21.15.133:50914) 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 -- 172.21.15.133:0/1881641770 learned_addr learned my addr 172.21.15.133:0/1881641770 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875998640 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 0x56158aedb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2876199640 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158adc2a30 0x56158ae4f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 -- 172.21.15.133:0/1881641770 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158adc2a30 msgr2=0x56158ae4f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158adc2a30 0x56158ae4f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 -- 172.21.15.133:0/1881641770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 msgr2=0x56158aedb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 0x56158aedb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 -- 172.21.15.133:0/1881641770 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868005d30 con 0x56158ada85f0 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2875197640 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158ada85f0 0x56158aedabc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f286c001c40 tx=0x7f286c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f198e1fb11de737 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2867fff640 1 -- 172.21.15.133:0/1881641770 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00e480 con 0x56158ada85f0 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2867fff640 1 -- 172.21.15.133:0/1881641770 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c00e5e0 con 0x56158ada85f0 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2867fff640 1 -- 172.21.15.133:0/1881641770 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c00e990 con 0x56158ada85f0 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- 172.21.15.133:0/1881641770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158ada85f0 msgr2=0x56158aedabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158ada85f0 0x56158aedabc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f286c001c40 tx=0x7f286c00b6d0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- 172.21.15.133:0/1881641770 shutdown_connections 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158adc2a30 0x56158ae4f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158ada85f0 0x56158aedabc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 --2- 172.21.15.133:0/1881641770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 0x56158aedb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- 172.21.15.133:0/1881641770 >> 172.21.15.133:0/1881641770 conn(0x56158ad76b50 msgr2=0x56158ada9100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- 172.21.15.133:0/1881641770 shutdown_connections 2023-12-18T10:20:27.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- 172.21.15.133:0/1881641770 wait complete. 2023-12-18T10:20:27.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 Processor -- start 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.396+0000 7f2877e7e080 1 -- start start 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2877e7e080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 0x56158ae35cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2877e7e080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158ada85f0 0x56158ada9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2877e7e080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158adc2a30 0x56158ada9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2877e7e080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158adbb590 con 0x56158adc2a30 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2877e7e080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158adbb830 con 0x56158ada8210 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2877e7e080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56158adbbad0 con 0x56158ada85f0 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158adc2a30 0x56158ada9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158adc2a30 0x56158ada9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50928/0 (socket says 172.21.15.133:50928) 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 -- 172.21.15.133:0/784415568 learned_addr learned my addr 172.21.15.133:0/784415568 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2875998640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 0x56158ae35cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2875197640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158ada85f0 0x56158ada9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 -- 172.21.15.133:0/784415568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158ada85f0 msgr2=0x56158ada9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158ada85f0 0x56158ada9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 -- 172.21.15.133:0/784415568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 msgr2=0x56158ae35cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56158ada8210 0x56158ae35cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 -- 172.21.15.133:0/784415568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860001e20 con 0x56158adc2a30 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2875197640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56158ada85f0 0x56158ada9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2876199640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158adc2a30 0x56158ada9640 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f287000f840 tx=0x7f287000fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2866ffd640 1 -- 172.21.15.133:0/784415568 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000d730 con 0x56158adc2a30 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2866ffd640 1 -- 172.21.15.133:0/784415568 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287000d890 con 0x56158adc2a30 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2866ffd640 1 -- 172.21.15.133:0/784415568 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000dc40 con 0x56158adc2a30 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56158acce070 con 0x56158adc2a30 2023-12-18T10:20:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56158acc14b0 con 0x56158adc2a30 2023-12-18T10:20:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.400+0000 7f2866ffd640 1 -- 172.21.15.133:0/784415568 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2870015480 con 0x56158adc2a30 2023-12-18T10:20:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2866ffd640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2858064410 0x7f28580668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2866ffd640 1 -- 172.21.15.133:0/784415568 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2870082910 con 0x56158adc2a30 2023-12-18T10:20:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2875998640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2858064410 0x7f28580668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x56158ae52270 0x56158adc0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 --> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x56158adc0990 con 0x56158ae52270 2023-12-18T10:20:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2875197640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x56158ae52270 0x56158adc0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2875998640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2858064410 0x7f28580668d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28680b1000 tx=0x7f28680a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2875197640 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x56158ae52270 0x56158adc0450 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2875197640 1 -- 172.21.15.133:0/784415568 <== osd.1 v2:172.21.15.133:6800/38184 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (10) out=10b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f286c021040 con 0x56158ae52270 2023-12-18T10:20:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x56158ae52270 msgr2=0x56158adc0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x56158ae52270 0x56158adc0450 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2858064410 msgr2=0x7f28580668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2858064410 0x7f28580668d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f28680b1000 tx=0x7f28680a9070 comp rx=0 tx=0).stop 2023-12-18T10:20:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158adc2a30 msgr2=0x56158ada9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 --2- 172.21.15.133:0/784415568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56158adc2a30 0x56158ada9640 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f287000f840 tx=0x7f287000fd00 comp rx=0 tx=0).stop 2023-12-18T10:20:27.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2876199640 1 -- 172.21.15.133:0/784415568 reap_dead start 2023-12-18T10:20:27.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 shutdown_connections 2023-12-18T10:20:27.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 >> 172.21.15.133:0/784415568 conn(0x56158ad76b50 msgr2=0x56158ae528c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 shutdown_connections 2023-12-18T10:20:27.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.404+0000 7f2877e7e080 1 -- 172.21.15.133:0/784415568 wait complete. 2023-12-18T10:20:27.412 INFO:teuthology.orchestra.run.smithi133.stdout:tag123 2023-12-18T10:20:27.413 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000003.00000000 scrub_tag 2023-12-18T10:20:27.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b7e03080 1 Processor -- start 2023-12-18T10:20:27.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b7e03080 1 -- start start 2023-12-18T10:20:27.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b7e03080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559765125220 0x5597651caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b7e03080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765127190 0x5597651c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b7e03080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597651cd2b0 0x5597650fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b7e03080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55976503f1d0 con 0x5597651cd2b0 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b7e03080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559765035e40 con 0x559765127190 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b7e03080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55976513a870 con 0x559765125220 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597651cd2b0 0x5597650fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b591d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559765125220 0x5597651caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597651cd2b0 0x5597650fa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50954/0 (socket says 172.21.15.133:50954) 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 -- 172.21.15.133:0/4096863143 learned_addr learned my addr 172.21.15.133:0/4096863143 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b511c640 1 --2- 172.21.15.133:0/4096863143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765127190 0x5597651c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 -- 172.21.15.133:0/4096863143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559765125220 msgr2=0x5597651caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 --2- 172.21.15.133:0/4096863143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559765125220 0x5597651caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 -- 172.21.15.133:0/4096863143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765127190 msgr2=0x5597651c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 --2- 172.21.15.133:0/4096863143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765127190 0x5597651c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 -- 172.21.15.133:0/4096863143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8005df0 con 0x5597651cd2b0 2023-12-18T10:20:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95b611e640 1 --2- 172.21.15.133:0/4096863143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597651cd2b0 0x5597650fa3b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c450 tx=0x7f95b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59eb12c948cba08 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95a7fff640 1 -- 172.21.15.133:0/4096863143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b00115f0 con 0x5597651cd2b0 2023-12-18T10:20:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95a7fff640 1 -- 172.21.15.133:0/4096863143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b0011750 con 0x5597651cd2b0 2023-12-18T10:20:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.496+0000 7f95a7fff640 1 -- 172.21.15.133:0/4096863143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0011b00 con 0x5597651cd2b0 2023-12-18T10:20:27.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- 172.21.15.133:0/4096863143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597651cd2b0 msgr2=0x5597650fa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 --2- 172.21.15.133:0/4096863143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597651cd2b0 0x5597650fa3b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c450 tx=0x7f95b000c910 comp rx=0 tx=0).stop 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- 172.21.15.133:0/4096863143 shutdown_connections 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 --2- 172.21.15.133:0/4096863143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597651cd2b0 0x5597650fa3b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 --2- 172.21.15.133:0/4096863143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765127190 0x5597651c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 --2- 172.21.15.133:0/4096863143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559765125220 0x5597651caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- 172.21.15.133:0/4096863143 >> 172.21.15.133:0/4096863143 conn(0x559765123e00 msgr2=0x5597651ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- 172.21.15.133:0/4096863143 shutdown_connections 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- 172.21.15.133:0/4096863143 wait complete. 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 Processor -- start 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- start start 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765125220 0x559765139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559765127190 0x55976513f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597651cd2b0 0x55976513f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597651cae10 con 0x559765127190 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597651cb0b0 con 0x559765125220 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597651235a0 con 0x5597651cd2b0 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559765127190 0x55976513f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559765127190 0x55976513f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50962/0 (socket says 172.21.15.133:50962) 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 -- 172.21.15.133:0/237573781 learned_addr learned my addr 172.21.15.133:0/237573781 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b591d640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765125220 0x559765139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b611e640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597651cd2b0 0x55976513f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 -- 172.21.15.133:0/237573781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597651cd2b0 msgr2=0x55976513f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597651cd2b0 0x55976513f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 -- 172.21.15.133:0/237573781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765125220 msgr2=0x559765139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559765125220 0x559765139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 -- 172.21.15.133:0/237573781 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b000d040 con 0x559765127190 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b511c640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559765127190 0x55976513f080 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0087e0 tx=0x7f95ac008ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95a6ffd640 1 -- 172.21.15.133:0/237573781 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00f050 con 0x559765127190 2023-12-18T10:20:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95a6ffd640 1 -- 172.21.15.133:0/237573781 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac010040 con 0x559765127190 2023-12-18T10:20:27.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95a6ffd640 1 -- 172.21.15.133:0/237573781 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac015460 con 0x559765127190 2023-12-18T10:20:27.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559765068210 con 0x559765127190 2023-12-18T10:20:27.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.500+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55976504e070 con 0x559765127190 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95a6ffd640 1 -- 172.21.15.133:0/237573781 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f95ac0155c0 con 0x559765127190 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95a6ffd640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9598064440 0x7f9598066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95a6ffd640 1 -- 172.21.15.133:0/237573781 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f95ac082810 con 0x559765127190 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b591d640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9598064440 0x7f9598066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55976513a2e0 0x55976513b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 --> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] -- osd_op(unknown.0.0:1 5.12 5:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55976513ba70 con 0x55976513a2e0 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b611e640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55976513a2e0 0x55976513b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b591d640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9598064440 0x7f9598066900 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f95a80ac000 tx=0x7f95a80a5000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b611e640 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55976513a2e0 0x55976513b530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b611e640 1 -- 172.21.15.133:0/237573781 <== osd.1 v2:172.21.15.133:6800/38184 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr (10) out=10b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f95b0018020 con 0x55976513a2e0 2023-12-18T10:20:27.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55976513a2e0 msgr2=0x55976513b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55976513a2e0 0x55976513b530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9598064440 msgr2=0x7f9598066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9598064440 0x7f9598066900 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f95a80ac000 tx=0x7f95a80a5000 comp rx=0 tx=0).stop 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559765127190 msgr2=0x55976513f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 --2- 172.21.15.133:0/237573781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559765127190 0x55976513f080 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0087e0 tx=0x7f95ac008ca0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b611e640 1 -- 172.21.15.133:0/237573781 reap_dead start 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 shutdown_connections 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 >> 172.21.15.133:0/237573781 conn(0x559765123e00 msgr2=0x5597651c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 shutdown_connections 2023-12-18T10:20:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.504+0000 7f95b7e03080 1 -- 172.21.15.133:0/237573781 wait complete. 2023-12-18T10:20:27.514 INFO:teuthology.orchestra.run.smithi133.stdout:tag123 2023-12-18T10:20:27.514 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000004.00000000 scrub_tag 2023-12-18T10:20:27.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f6886e43080 1 Processor -- start 2023-12-18T10:20:27.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f6886e43080 1 -- start start 2023-12-18T10:20:27.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f6886e43080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174bc220 0x55b4174925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f6886e43080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174be190 0x55b417492f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f6886e43080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b417561ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f6886e43080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4173d64d0 con 0x55b4175642b0 2023-12-18T10:20:27.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f6886e43080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4173d61d0 con 0x55b4174bc220 2023-12-18T10:20:27.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f6886e43080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4173cce40 con 0x55b4174be190 2023-12-18T10:20:27.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b417561ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688495d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174bc220 0x55b4174925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b417561ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50968/0 (socket says 172.21.15.133:50968) 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 -- 172.21.15.133:0/1237355270 learned_addr learned my addr 172.21.15.133:0/1237355270 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f687ffff640 1 --2- 172.21.15.133:0/1237355270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174be190 0x55b417492f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 -- 172.21.15.133:0/1237355270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174be190 msgr2=0x55b417492f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 --2- 172.21.15.133:0/1237355270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174be190 0x55b417492f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 -- 172.21.15.133:0/1237355270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174bc220 msgr2=0x55b4174925d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 --2- 172.21.15.133:0/1237355270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174bc220 0x55b4174925d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 -- 172.21.15.133:0/1237355270 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870005df0 con 0x55b4175642b0 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.556+0000 7f688515e640 1 --2- 172.21.15.133:0/1237355270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b417561ad0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f68800026f0 tx=0x7f6880002bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948a63ca4113dbf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f687effd640 1 -- 172.21.15.133:0/1237355270 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000f6f0 con 0x55b4175642b0 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f687effd640 1 -- 172.21.15.133:0/1237355270 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688000f850 con 0x55b4175642b0 2023-12-18T10:20:27.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f687effd640 1 -- 172.21.15.133:0/1237355270 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000fbe0 con 0x55b4175642b0 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- 172.21.15.133:0/1237355270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 msgr2=0x55b417561ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 --2- 172.21.15.133:0/1237355270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b417561ad0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f68800026f0 tx=0x7f6880002bb0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- 172.21.15.133:0/1237355270 shutdown_connections 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 --2- 172.21.15.133:0/1237355270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b417561ad0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 --2- 172.21.15.133:0/1237355270 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174be190 0x55b417492f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 --2- 172.21.15.133:0/1237355270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174bc220 0x55b4174925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- 172.21.15.133:0/1237355270 >> 172.21.15.133:0/1237355270 conn(0x55b4174bae00 msgr2=0x55b417560e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- 172.21.15.133:0/1237355270 shutdown_connections 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- 172.21.15.133:0/1237355270 wait complete. 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 Processor -- start 2023-12-18T10:20:27.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- start start 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174bc220 0x55b41748ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174be190 0x55b4174b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b4175f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4175f8090 con 0x55b4175642b0 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b41755e360 con 0x55b4174be190 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4175f82c0 con 0x55b4174bc220 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b4175f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b4175f6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50984/0 (socket says 172.21.15.133:50984) 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 -- 172.21.15.133:0/4036405595 learned_addr learned my addr 172.21.15.133:0/4036405595 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688495d640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174bc220 0x55b41748ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f687ffff640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174be190 0x55b4174b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 -- 172.21.15.133:0/4036405595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174bc220 msgr2=0x55b41748ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b4174bc220 0x55b41748ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 -- 172.21.15.133:0/4036405595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174be190 msgr2=0x55b4174b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4174be190 0x55b4174b9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 -- 172.21.15.133:0/4036405595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6880006da0 con 0x55b4175642b0 2023-12-18T10:20:27.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f688515e640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b4175f6e70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6880007fd0 tx=0x7f6880002370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f687dffb640 1 -- 172.21.15.133:0/4036405595 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800063f0 con 0x55b4175642b0 2023-12-18T10:20:27.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f687dffb640 1 -- 172.21.15.133:0/4036405595 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688000fbd0 con 0x55b4175642b0 2023-12-18T10:20:27.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b4173e5070 con 0x55b4175642b0 2023-12-18T10:20:27.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f687dffb640 1 -- 172.21.15.133:0/4036405595 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880012480 con 0x55b4175642b0 2023-12-18T10:20:27.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.560+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4173d84b0 con 0x55b4175642b0 2023-12-18T10:20:27.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f687dffb640 1 -- 172.21.15.133:0/4036405595 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f68800125e0 con 0x55b4175642b0 2023-12-18T10:20:27.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f687dffb640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6868064440 0x7f6868066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f687dffb640 1 -- 172.21.15.133:0/4036405595 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f68800835f0 con 0x55b4175642b0 2023-12-18T10:20:27.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f688495d640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6868064440 0x7f6868066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f6886e43080 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b41748f200 0x55b4175f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 5.5 5:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55b4174d01e0 con 0x55b41748f200 2023-12-18T10:20:27.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f687ffff640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b41748f200 0x55b4175f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f688495d640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6868064440 0x7f6868066900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f68780097b0 tx=0x7f687800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f687ffff640 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b41748f200 0x55b4175f78c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f687ffff640 1 -- 172.21.15.133:0/4036405595 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f68700aa8d0 con 0x55b41748f200 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b41748f200 msgr2=0x55b4175f78c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.564+0000 7f6886e43080 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b41748f200 0x55b4175f78c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6868064440 msgr2=0x7f6868066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f6886e43080 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6868064440 0x7f6868066900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f68780097b0 tx=0x7f687800d040 comp rx=0 tx=0).stop 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 msgr2=0x55b4175f6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f6886e43080 1 --2- 172.21.15.133:0/4036405595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b4175642b0 0x55b4175f6e70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6880007fd0 tx=0x7f6880002370 comp rx=0 tx=0).stop 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f688515e640 1 -- 172.21.15.133:0/4036405595 reap_dead start 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 shutdown_connections 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 >> 172.21.15.133:0/4036405595 conn(0x55b4174bae00 msgr2=0x55b41748fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 shutdown_connections 2023-12-18T10:20:27.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.568+0000 7f6886e43080 1 -- 172.21.15.133:0/4036405595 wait complete. 2023-12-18T10:20:27.574 INFO:teuthology.orchestra.run.smithi133.stdout:tag123 2023-12-18T10:20:27.575 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000005.00000000 scrub_tag 2023-12-18T10:20:27.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 Processor -- start 2023-12-18T10:20:27.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- start start 2023-12-18T10:20:27.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0b9220 0x55a0ba0906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0bb190 0x55a0ba0d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 0x55a0ba0d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b9fd31d0 con 0x55a0ba0b9220 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b9fc9e40 con 0x55a0ba1612b0 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0ba0d5a60 con 0x55a0ba0bb190 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0b9220 0x55a0ba0906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0b9220 0x55a0ba0906b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51012/0 (socket says 172.21.15.133:51012) 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 -- 172.21.15.133:0/2803062947 learned_addr learned my addr 172.21.15.133:0/2803062947 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf197bd640 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 0x55a0ba0d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf13fff640 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0bb190 0x55a0ba0d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 -- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0bb190 msgr2=0x55a0ba0d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0bb190 0x55a0ba0d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 -- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 msgr2=0x55a0ba0d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 0x55a0ba0d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 -- 172.21.15.133:0/2803062947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1400a1c0 con 0x55a0ba0b9220 2023-12-18T10:20:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf13fff640 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0bb190 0x55a0ba0d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf197bd640 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 0x55a0ba0d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf18fbc640 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0b9220 0x55a0ba0906b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00a7b0 tx=0x7fdf0c00ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313d0b0c784d4ceb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf12ffd640 1 -- 172.21.15.133:0/2803062947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00f070 con 0x55a0ba0b9220 2023-12-18T10:20:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf12ffd640 1 -- 172.21.15.133:0/2803062947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c00ada0 con 0x55a0ba0b9220 2023-12-18T10:20:27.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf12ffd640 1 -- 172.21.15.133:0/2803062947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c008bb0 con 0x55a0ba0b9220 2023-12-18T10:20:27.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- 172.21.15.133:0/2803062947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0b9220 msgr2=0x55a0ba0906b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0b9220 0x55a0ba0906b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00a7b0 tx=0x7fdf0c00ac70 comp rx=0 tx=0).stop 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- 172.21.15.133:0/2803062947 shutdown_connections 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 0x55a0ba0d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0bb190 0x55a0ba0d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 --2- 172.21.15.133:0/2803062947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0b9220 0x55a0ba0906b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- 172.21.15.133:0/2803062947 >> 172.21.15.133:0/2803062947 conn(0x55a0ba0b7e00 msgr2=0x55a0ba0d4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- 172.21.15.133:0/2803062947 shutdown_connections 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 -- 172.21.15.133:0/2803062947 wait complete. 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.664+0000 7fdf1c049080 1 Processor -- start 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 -- start start 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0b9220 0x55a0ba08c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0bb190 0x55a0ba0d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 0x55a0ba150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ba08cf10 con 0x55a0ba0bb190 2023-12-18T10:20:27.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0ba08d150 con 0x55a0ba1612b0 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0ba08d3f0 con 0x55a0ba0b9220 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0bb190 0x55a0ba0d4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0bb190 0x55a0ba0d4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51024/0 (socket says 172.21.15.133:51024) 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 -- 172.21.15.133:0/2434452921 learned_addr learned my addr 172.21.15.133:0/2434452921 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf18fbc640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0b9220 0x55a0ba08c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf197bd640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 0x55a0ba150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 -- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0b9220 msgr2=0x55a0ba08c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a0ba0b9220 0x55a0ba08c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 -- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 msgr2=0x55a0ba150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a0ba1612b0 0x55a0ba150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 -- 172.21.15.133:0/2434452921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c00a430 con 0x55a0ba0bb190 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf13fff640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0bb190 0x55a0ba0d4f10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdf04008a00 tx=0x7fdf04008ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf11ffb640 1 -- 172.21.15.133:0/2434452921 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04018070 con 0x55a0ba0bb190 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf11ffb640 1 -- 172.21.15.133:0/2434452921 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04010040 con 0x55a0ba0bb190 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0b9ffc210 con 0x55a0ba0bb190 2023-12-18T10:20:27.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf11ffb640 1 -- 172.21.15.133:0/2434452921 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04006d80 con 0x55a0ba0bb190 2023-12-18T10:20:27.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.668+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0b9fe2070 con 0x55a0ba0bb190 2023-12-18T10:20:27.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf11ffb640 1 -- 172.21.15.133:0/2434452921 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdf0401d410 con 0x55a0ba0bb190 2023-12-18T10:20:27.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf11ffb640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdefc064410 0x7fdefc0668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf11ffb640 1 -- 172.21.15.133:0/2434452921 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf04082210 con 0x55a0ba0bb190 2023-12-18T10:20:27.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf18fbc640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdefc064410 0x7fdefc0668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55a0ba0d5450 0x55a0ba1f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 --> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] -- osd_op(unknown.0.0:1 5.9 5:9258b67d:::10000000005.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55a0ba156e90 con 0x55a0ba0d5450 2023-12-18T10:20:27.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf197bd640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55a0ba0d5450 0x55a0ba1f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf18fbc640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdefc064410 0x7fdefc0668d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c018040 tx=0x7fdf0c012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf197bd640 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55a0ba0d5450 0x55a0ba1f36b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf197bd640 1 -- 172.21.15.133:0/2434452921 <== osd.7 v2:172.21.15.142:6816/38355 1 ==== osd_op_reply(1 10000000005.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7fdf140a8070 con 0x55a0ba0d5450 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55a0ba0d5450 msgr2=0x55a0ba1f36b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55a0ba0d5450 0x55a0ba1f36b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdefc064410 msgr2=0x7fdefc0668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdefc064410 0x7fdefc0668d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c018040 tx=0x7fdf0c012000 comp rx=0 tx=0).stop 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0bb190 msgr2=0x55a0ba0d4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 --2- 172.21.15.133:0/2434452921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a0ba0bb190 0x55a0ba0d4f10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdf04008a00 tx=0x7fdf04008ec0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf197bd640 1 -- 172.21.15.133:0/2434452921 reap_dead start 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 shutdown_connections 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 >> 172.21.15.133:0/2434452921 conn(0x55a0ba0b7e00 msgr2=0x55a0ba08bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 shutdown_connections 2023-12-18T10:20:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.672+0000 7fdf1c049080 1 -- 172.21.15.133:0/2434452921 wait complete. 2023-12-18T10:20:27.681 INFO:teuthology.orchestra.run.smithi133.stdout:tag123 2023-12-18T10:20:27.682 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000006.00000000 scrub_tag 2023-12-18T10:20:27.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b06736080 1 Processor -- start 2023-12-18T10:20:27.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b06736080 1 -- start start 2023-12-18T10:20:27.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b06736080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b39ef210 0x5581b3a03500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b06736080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a81680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b06736080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b3a09a30 0x5581b3a05230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b06736080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b39064d0 con 0x5581b3a09a30 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b06736080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b39061d0 con 0x5581b39ef5f0 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b06736080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581b38fce40 con 0x5581b39ef210 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b3a09a30 0x5581b3a05230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b3a09a30 0x5581b3a05230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51030/0 (socket says 172.21.15.133:51030) 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 -- 172.21.15.133:0/1287184838 learned_addr learned my addr 172.21.15.133:0/1287184838 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b03a4f640 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a81680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04250640 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b39ef210 0x5581b3a03500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 -- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b39ef210 msgr2=0x5581b3a03500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b39ef210 0x5581b3a03500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 -- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 msgr2=0x5581b3a81680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a81680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 -- 172.21.15.133:0/1287184838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc00a100 con 0x5581b3a09a30 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b03a4f640 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a81680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b04a51640 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b3a09a30 0x5581b3a05230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9afc09a110 tx=0x7f9afc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11df36bfe38a677c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.724+0000 7f9b02a4d640 1 -- 172.21.15.133:0/1287184838 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0aab30 con 0x5581b3a09a30 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b02a4d640 1 -- 172.21.15.133:0/1287184838 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc0aac90 con 0x5581b3a09a30 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b02a4d640 1 -- 172.21.15.133:0/1287184838 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0aa5e0 con 0x5581b3a09a30 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- 172.21.15.133:0/1287184838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b3a09a30 msgr2=0x5581b3a05230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b3a09a30 0x5581b3a05230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9afc09a110 tx=0x7f9afc0033b0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- 172.21.15.133:0/1287184838 shutdown_connections 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b3a09a30 0x5581b3a05230 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a81680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 --2- 172.21.15.133:0/1287184838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b39ef210 0x5581b3a03500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- 172.21.15.133:0/1287184838 >> 172.21.15.133:0/1287184838 conn(0x5581b39bdb50 msgr2=0x5581b39f0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- 172.21.15.133:0/1287184838 shutdown_connections 2023-12-18T10:20:27.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- 172.21.15.133:0/1287184838 wait complete. 2023-12-18T10:20:27.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 Processor -- start 2023-12-18T10:20:27.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- start start 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b39ef210 0x5581b3a7d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a07c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b3a09a30 0x5581b3a94d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b3b1d700 con 0x5581b39ef210 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581b3a08e50 con 0x5581b39ef5f0 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581b3a08670 con 0x5581b3a09a30 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b39ef210 0x5581b3a7d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b39ef210 0x5581b3a7d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51040/0 (socket says 172.21.15.133:51040) 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 -- 172.21.15.133:0/1520246023 learned_addr learned my addr 172.21.15.133:0/1520246023 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04a51640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b3a09a30 0x5581b3a94d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b03a4f640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a07c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 -- 172.21.15.133:0/1520246023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b3a09a30 msgr2=0x5581b3a94d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b3a09a30 0x5581b3a94d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 -- 172.21.15.133:0/1520246023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 msgr2=0x5581b3a07c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a07c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 -- 172.21.15.133:0/1520246023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581b392f210 con 0x5581b39ef210 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04a51640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5581b3a09a30 0x5581b3a94d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b03a4f640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581b39ef5f0 0x5581b3a07c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b04250640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b39ef210 0x5581b3a7d910 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9af4008850 tx=0x7f9af4008d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b01a4b640 1 -- 172.21.15.133:0/1520246023 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af400f050 con 0x5581b39ef210 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b01a4b640 1 -- 172.21.15.133:0/1520246023 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4010040 con 0x5581b39ef210 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b01a4b640 1 -- 172.21.15.133:0/1520246023 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4015460 con 0x5581b39ef210 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5581b3915070 con 0x5581b39ef210 2023-12-18T10:20:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.728+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581b39084b0 con 0x5581b39ef210 2023-12-18T10:20:27.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b01a4b640 1 -- 172.21.15.133:0/1520246023 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9af40155c0 con 0x5581b39ef210 2023-12-18T10:20:27.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b01a4b640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0064440 0x7f9af0066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b01a4b640 1 -- 172.21.15.133:0/1520246023 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9af4082a90 con 0x5581b39ef210 2023-12-18T10:20:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b03a4f640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0064440 0x7f9af0066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b06736080 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x5581b3a08150 0x5581b3b1e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 5.5 5:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x5581b3a7de50 con 0x5581b3a08150 2023-12-18T10:20:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b04a51640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x5581b3a08150 0x5581b3b1e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b03a4f640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0064440 0x7f9af0066900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9af8004180 tx=0x7f9af8000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.732+0000 7f9b04a51640 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x5581b3a08150 0x5581b3b1e2a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b04a51640 1 -- 172.21.15.133:0/1520246023 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f9afc0c6040 con 0x5581b3a08150 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x5581b3a08150 msgr2=0x5581b3b1e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x5581b3a08150 0x5581b3b1e2a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0064440 msgr2=0x7f9af0066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0064440 0x7f9af0066900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9af8004180 tx=0x7f9af8000bd0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b39ef210 msgr2=0x5581b3a7d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 --2- 172.21.15.133:0/1520246023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5581b39ef210 0x5581b3a7d910 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9af4008850 tx=0x7f9af4008d10 comp rx=0 tx=0).stop 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b04a51640 1 -- 172.21.15.133:0/1520246023 reap_dead start 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 shutdown_connections 2023-12-18T10:20:27.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 >> 172.21.15.133:0/1520246023 conn(0x5581b39bdb50 msgr2=0x5581b39f20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 shutdown_connections 2023-12-18T10:20:27.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.736+0000 7f9b06736080 1 -- 172.21.15.133:0/1520246023 wait complete. 2023-12-18T10:20:27.742 INFO:teuthology.orchestra.run.smithi133.stdout:tag123 2023-12-18T10:20:27.743 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000007.00000000 scrub_tag 2023-12-18T10:20:27.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 Processor -- start 2023-12-18T10:20:27.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- start start 2023-12-18T10:20:27.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0b930 0x55f4f2e0a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4f2e0d190 0x55f4f2e21760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f4f2eb32b0 0x55f4f2f482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f2d899c0 con 0x55f4f2e0b930 2023-12-18T10:20:27.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f2d254d0 con 0x55f4f2e0d190 2023-12-18T10:20:27.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4f2d251d0 con 0x55f4f2eb32b0 2023-12-18T10:20:27.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0b930 0x55f4f2e0a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0b930 0x55f4f2e0a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51044/0 (socket says 172.21.15.133:51044) 2023-12-18T10:20:27.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 -- 172.21.15.133:0/4179385816 learned_addr learned my addr 172.21.15.133:0/4179385816 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 -- 172.21.15.133:0/4179385816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f4f2eb32b0 msgr2=0x55f4f2f482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 --2- 172.21.15.133:0/4179385816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f4f2eb32b0 0x55f4f2f482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 -- 172.21.15.133:0/4179385816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4f2e0d190 msgr2=0x55f4f2e21760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 --2- 172.21.15.133:0/4179385816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4f2e0d190 0x55f4f2e21760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 -- 172.21.15.133:0/4179385816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18005d30 con 0x55f4f2e0b930 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc253b5640 1 --2- 172.21.15.133:0/4179385816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0b930 0x55f4f2e0a450 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbc180ad040 tx=0x7fbc18003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6cb1824243812b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc177fe640 1 -- 172.21.15.133:0/4179385816 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800a300 con 0x55f4f2e0b930 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc177fe640 1 -- 172.21.15.133:0/4179385816 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc18009420 con 0x55f4f2e0b930 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc177fe640 1 -- 172.21.15.133:0/4179385816 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180097b0 con 0x55f4f2e0b930 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- 172.21.15.133:0/4179385816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0b930 msgr2=0x55f4f2e0a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 --2- 172.21.15.133:0/4179385816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0b930 0x55f4f2e0a450 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbc180ad040 tx=0x7fbc18003030 comp rx=0 tx=0).stop 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- 172.21.15.133:0/4179385816 shutdown_connections 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 --2- 172.21.15.133:0/4179385816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f4f2eb32b0 0x55f4f2f482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 --2- 172.21.15.133:0/4179385816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4f2e0d190 0x55f4f2e21760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 --2- 172.21.15.133:0/4179385816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0b930 0x55f4f2e0a450 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- 172.21.15.133:0/4179385816 >> 172.21.15.133:0/4179385816 conn(0x55f4f2e09e00 msgr2=0x55f4f2eb0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- 172.21.15.133:0/4179385816 shutdown_connections 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.832+0000 7fbc2789b080 1 -- 172.21.15.133:0/4179385816 wait complete. 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 Processor -- start 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 -- start start 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f4f2e0b930 0x55f4f2ea8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0d190 0x55f4f2eafe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4f2eb32b0 0x55f4f2e24600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f2d1be40 con 0x55f4f2e0d190 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4f2eae910 con 0x55f4f2eb32b0 2023-12-18T10:20:27.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4f2e236e0 con 0x55f4f2e0b930 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0d190 0x55f4f2eafe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0d190 0x55f4f2eafe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51046/0 (socket says 172.21.15.133:51046) 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 -- 172.21.15.133:0/1593329842 learned_addr learned my addr 172.21.15.133:0/1593329842 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc25bb6640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4f2eb32b0 0x55f4f2e24600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc253b5640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f4f2e0b930 0x55f4f2ea8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 -- 172.21.15.133:0/1593329842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f4f2e0b930 msgr2=0x55f4f2ea8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f4f2e0b930 0x55f4f2ea8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 -- 172.21.15.133:0/1593329842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4f2eb32b0 msgr2=0x55f4f2e24600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4f2eb32b0 0x55f4f2e24600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 -- 172.21.15.133:0/1593329842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4f2d34070 con 0x55f4f2e0d190 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc24bb4640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0d190 0x55f4f2eafe70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c001ed0 tx=0x7fbc1c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc167fc640 1 -- 172.21.15.133:0/1593329842 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00e690 con 0x55f4f2e0d190 2023-12-18T10:20:27.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc167fc640 1 -- 172.21.15.133:0/1593329842 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c00e7f0 con 0x55f4f2e0d190 2023-12-18T10:20:27.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc167fc640 1 -- 172.21.15.133:0/1593329842 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00eba0 con 0x55f4f2e0d190 2023-12-18T10:20:27.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f4f2d274b0 con 0x55f4f2e0d190 2023-12-18T10:20:27.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.836+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4f2d26f10 con 0x55f4f2e0d190 2023-12-18T10:20:27.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc167fc640 1 -- 172.21.15.133:0/1593329842 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc1c00a040 con 0x55f4f2e0d190 2023-12-18T10:20:27.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc167fc640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc08064410 0x7fbc080668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc167fc640 1 -- 172.21.15.133:0/1593329842 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc1c082050 con 0x55f4f2e0d190 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc253b5640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc08064410 0x7fbc080668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55f4f2eb03b0 0x55f4f2e24b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 --> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] -- osd_op(unknown.0.0:1 5.1d 5:bbf5850a:::10000000007.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55f4f2ea9180 con 0x55f4f2eb03b0 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc25bb6640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55f4f2eb03b0 0x55f4f2e24b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc253b5640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc08064410 0x7fbc080668d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbc180b5000 tx=0x7fbc180be040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc25bb6640 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55f4f2eb03b0 0x55f4f2e24b40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc25bb6640 1 -- 172.21.15.133:0/1593329842 <== osd.1 v2:172.21.15.133:6800/38184 1 ==== osd_op_reply(1 10000000007.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7fbc200028a0 con 0x55f4f2eb03b0 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55f4f2eb03b0 msgr2=0x55f4f2e24b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x55f4f2eb03b0 0x55f4f2e24b40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc08064410 msgr2=0x7fbc080668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc08064410 0x7fbc080668d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbc180b5000 tx=0x7fbc180be040 comp rx=0 tx=0).stop 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0d190 msgr2=0x55f4f2eafe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 --2- 172.21.15.133:0/1593329842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f4f2e0d190 0x55f4f2eafe70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c001ed0 tx=0x7fbc1c009710 comp rx=0 tx=0).stop 2023-12-18T10:20:27.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc25bb6640 1 -- 172.21.15.133:0/1593329842 reap_dead start 2023-12-18T10:20:27.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 shutdown_connections 2023-12-18T10:20:27.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 >> 172.21.15.133:0/1593329842 conn(0x55f4f2e09e00 msgr2=0x55f4f2f45fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:27.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 shutdown_connections 2023-12-18T10:20:27.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:27.840+0000 7fbc2789b080 1 -- 172.21.15.133:0/1593329842 wait complete. 2023-12-18T10:20:27.850 INFO:teuthology.orchestra.run.smithi133.stdout:tag123 2023-12-18T10:20:27.850 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:20:27.850 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:20:27.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:20:28.069 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:20:28.070 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:20:28.070 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:20:28.079 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:20:28.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb329118640 1 Processor -- start 2023-12-18T10:20:28.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb329118640 1 -- start start 2023-12-18T10:20:28.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb329118640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3241570c0 0x7fb32406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb329118640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32406c320 0x7fb3240c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb329118640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240c9460 con 0x7fb3240c9e30 2023-12-18T10:20:28.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb329118640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32406c7a0 con 0x7fb3241570c0 2023-12-18T10:20:28.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb329118640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3241574a0 con 0x7fb32406c320 2023-12-18T10:20:28.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb322d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3241570c0 0x7fb32406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb322d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3241570c0 0x7fb32406bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51060/0 (socket says 172.21.15.133:51060) 2023-12-18T10:20:28.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb322d9d640 1 -- 172.21.15.133:0/1613850764 learned_addr learned my addr 172.21.15.133:0/1613850764 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:28.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb322d9d640 1 -- 172.21.15.133:0/1613850764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32406c320 msgr2=0x7fb3240c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:28.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb32259c640 1 --2- 172.21.15.133:0/1613850764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32406c320 0x7fb3240c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb322d9d640 1 --2- 172.21.15.133:0/1613850764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32406c320 0x7fb3240c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb322d9d640 1 -- 172.21.15.133:0/1613850764 >> v1:172.21.15.142:6789/0 conn(0x7fb3240c9e30 legacy=0x7fb32415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:28.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb322d9d640 1 -- 172.21.15.133:0/1613850764 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240c8b30 con 0x7fb3241570c0 2023-12-18T10:20:28.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.260+0000 7fb32259c640 1 --2- 172.21.15.133:0/1613850764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32406c320 0x7fb3240c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb322d9d640 1 --2- 172.21.15.133:0/1613850764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3241570c0 0x7fb32406bde0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb31400bb10 tx=0x7fb31401ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65292009c949cf41 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb321d9b640 1 -- 172.21.15.133:0/1613850764 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140a7c60 con 0x7fb3241570c0 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb321d9b640 1 -- 172.21.15.133:0/1613850764 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3140a7dc0 con 0x7fb3241570c0 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb321d9b640 1 -- 172.21.15.133:0/1613850764 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140af660 con 0x7fb3241570c0 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb329118640 1 -- 172.21.15.133:0/1613850764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3241570c0 msgr2=0x7fb32406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb329118640 1 --2- 172.21.15.133:0/1613850764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3241570c0 0x7fb32406bde0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fb31400bb10 tx=0x7fb31401ebd0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb329118640 1 -- 172.21.15.133:0/1613850764 shutdown_connections 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb329118640 1 --2- 172.21.15.133:0/1613850764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb32406c320 0x7fb3240c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb329118640 1 --2- 172.21.15.133:0/1613850764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3241570c0 0x7fb32406bde0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb329118640 1 -- 172.21.15.133:0/1613850764 >> 172.21.15.133:0/1613850764 conn(0x7fb32406a3e0 msgr2=0x7fb3240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb329118640 1 -- 172.21.15.133:0/1613850764 shutdown_connections 2023-12-18T10:20:28.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.264+0000 7fb329118640 1 -- 172.21.15.133:0/1613850764 wait complete. 2023-12-18T10:20:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 Processor -- start 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 -- start start 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32406c320 0x7fb3240cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3240c9e30 0x7fb3240c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3241570c0 0x7fb3240c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240c3520 con 0x7fb3240c9e30 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324154b20 con 0x7fb32406c320 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3241f0700 con 0x7fb3241570c0 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3240c9e30 0x7fb3240c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3240c9e30 0x7fb3240c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51064/0 (socket says 172.21.15.133:51064) 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 -- 172.21.15.133:0/1726848105 learned_addr learned my addr 172.21.15.133:0/1726848105 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb322d9d640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32406c320 0x7fb3240cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32359e640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3241570c0 0x7fb3240c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 -- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3241570c0 msgr2=0x7fb3240c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3241570c0 0x7fb3240c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 -- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32406c320 msgr2=0x7fb3240cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32406c320 0x7fb3240cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 -- 172.21.15.133:0/1726848105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31400b770 con 0x7fb3240c9e30 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb322d9d640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32406c320 0x7fb3240cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb32259c640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3240c9e30 0x7fb3240c2230 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c820 tx=0x7fb31800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb30b7fe640 1 -- 172.21.15.133:0/1726848105 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb318007a30 con 0x7fb3240c9e30 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb30b7fe640 1 -- 172.21.15.133:0/1726848105 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb318007b90 con 0x7fb3240c9e30 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb30b7fe640 1 -- 172.21.15.133:0/1726848105 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31800ce10 con 0x7fb3240c9e30 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3240c2c80 con 0x7fb3240c9e30 2023-12-18T10:20:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb324154d70 con 0x7fb3240c9e30 2023-12-18T10:20:28.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.268+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3240735b0 con 0x7fb3240c9e30 2023-12-18T10:20:28.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.272+0000 7fb30b7fe640 1 -- 172.21.15.133:0/1726848105 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb3180113f0 con 0x7fb3240c9e30 2023-12-18T10:20:28.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.272+0000 7fb30b7fe640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.272+0000 7fb30b7fe640 1 -- 172.21.15.133:0/1726848105 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb318083390 con 0x7fb3240c9e30 2023-12-18T10:20:28.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.272+0000 7fb322d9d640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.272+0000 7fb322d9d640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb3140b1000 tx=0x7fb3140a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.276+0000 7fb30b7fe640 1 -- 172.21.15.133:0/1726848105 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb318050c00 con 0x7fb3240c9e30 2023-12-18T10:20:28.284 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:20:28.287 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:20:28.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.428+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb324154f90 con 0x7fb3240c9e30 2023-12-18T10:20:28.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.428+0000 7fb30b7fe640 1 -- 172.21.15.133:0/1726848105 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16403 (secure 0 0 0) 0x7fb318054220 con 0x7fb3240c9e30 2023-12-18T10:20:28.433 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:28.434 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":41,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:19:47.948169+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:19:28.252118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-18T10:19:29.371748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:20:28.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 msgr2=0x7fb310067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb3140b1000 tx=0x7fb3140a9070 comp rx=0 tx=0).stop 2023-12-18T10:20:28.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3240c9e30 msgr2=0x7fb3240c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3240c9e30 0x7fb3240c2230 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c820 tx=0x7fb31800cce0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 shutdown_connections 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb310065a60 0x7fb310067f20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb3241570c0 0x7fb3240c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3240c9e30 0x7fb3240c2230 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 --2- 172.21.15.133:0/1726848105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb32406c320 0x7fb3240cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 >> 172.21.15.133:0/1726848105 conn(0x7fb32406a3e0 msgr2=0x7fb32415c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 shutdown_connections 2023-12-18T10:20:28.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.432+0000 7fb329118640 1 -- 172.21.15.133:0/1726848105 wait complete. 2023-12-18T10:20:28.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:19:28.252118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:19:29.371748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:20:28.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:20:28.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.592+0000 7f0cb2a73640 1 Processor -- start 2023-12-18T10:20:28.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb2a73640 1 -- start start 2023-12-18T10:20:28.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb2a73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac0ca410 0x7f0cac159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb2a73640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cac070df0 con 0x7f0cac159fb0 2023-12-18T10:20:28.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb2a73640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cac15a4f0 con 0x7f0cac0cbff0 2023-12-18T10:20:28.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb2a73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac15aab0 con 0x7f0cac0ca410 2023-12-18T10:20:28.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cabfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0cac159fb0 0x7f0cac071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45990/0 (socket says 172.21.15.133:45990) 2023-12-18T10:20:28.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cabfff640 1 -- 172.21.15.133:0/1472572107 learned_addr learned my addr 172.21.15.133:0/1472572107 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:28.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac0ca410 0x7f0cac159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48814988 0 0) 0x7f0cac070df0 con 0x7f0cac159fb0 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c9c003530 con 0x7f0cac159fb0 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741554337 0 0) 0x7f0cac15a4f0 con 0x7f0cac0cbff0 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cac070df0 con 0x7f0cac0cbff0 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118351168 0 0) 0x7f0c9c003530 con 0x7f0cac159fb0 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac0ca410 msgr2=0x7f0cac159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac0ca410 0x7f0cac159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 >> v1:172.21.15.142:6789/0 conn(0x7f0cac0cbff0 legacy=0x7f0cac0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac15a7d0 con 0x7f0cac159fb0 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f0c98001680 con 0x7f0cac159fb0 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 >> v1:172.21.15.133:6789/0 conn(0x7f0cac159fb0 legacy=0x7f0cac071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0c9c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0047d0 0x7f0c9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c005190 0x7f0c9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac15aab0 con 0x7f0c9c003b40 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c00bf80 con 0x7f0c9c005190 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c00c140 con 0x7f0c9c0047d0 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac0ca410 0x7f0cac159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0c9c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cabfff640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0047d0 0x7f0c9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb1010640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c005190 0x7f0c9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb080f640 1 -- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0047d0 msgr2=0x7f0c9c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c9c0047d0 0x7f0c9c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb080f640 1 -- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c005190 msgr2=0x7f0c9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:28.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c005190 0x7f0c9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb080f640 1 -- 172.21.15.133:0/1472572107 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c003530 con 0x7f0c9c003b40 2023-12-18T10:20:28.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.596+0000 7f0cb1010640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9c005190 0x7f0c9c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0c9c003f40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0cac06dee0 tx=0x7f0ca001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1408786a21d163 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0004030 con 0x7f0c9c003b40 2023-12-18T10:20:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0004190 con 0x7f0c9c003b40 2023-12-18T10:20:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cab7fe640 1 -- 172.21.15.133:0/1472572107 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0004520 con 0x7f0c9c003b40 2023-12-18T10:20:28.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1472572107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 msgr2=0x7f0c9c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cb2a73640 1 --2- 172.21.15.133:0/1472572107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0c9c003f40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0cac06dee0 tx=0x7f0ca001ca60 comp rx=0 tx=0).stop 2023-12-18T10:20:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cb1010640 1 -- 172.21.15.133:0/1472572107 reap_dead start 2023-12-18T10:20:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1472572107 shutdown_connections 2023-12-18T10:20:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1472572107 >> 172.21.15.133:0/1472572107 conn(0x7f0cac06a2a0 msgr2=0x7f0cac0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1472572107 shutdown_connections 2023-12-18T10:20:28.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.600+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1472572107 wait complete. 2023-12-18T10:20:28.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 Processor -- start 2023-12-18T10:20:28.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 -- start start 2023-12-18T10:20:28.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0cac163db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cac0c2e90 0x7f0cac0ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac15b5d0 0x7f0cac152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac0c2a00 con 0x7f0c9c003b40 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac0cead0 con 0x7f0cac0c2e90 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cac0c20d0 con 0x7f0cac15b5d0 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0cac163db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0cac163db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51086/0 (socket says 172.21.15.133:51086) 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 -- 172.21.15.133:0/1308995711 learned_addr learned my addr 172.21.15.133:0/1308995711 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb1010640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac15b5d0 0x7f0cac152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cabfff640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cac0c2e90 0x7f0cac0ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 -- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac15b5d0 msgr2=0x7f0cac152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac15b5d0 0x7f0cac152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 -- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cac0c2e90 msgr2=0x7f0cac0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cac0c2e90 0x7f0cac0ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 -- 172.21.15.133:0/1308995711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cac0c23b0 con 0x7f0c9c003b40 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cabfff640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cac0c2e90 0x7f0cac0ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb080f640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0cac163db0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0ca001caa0 tx=0x7f0c9c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0ca97fa640 1 -- 172.21.15.133:0/1308995711 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000f0c0 con 0x7f0c9c003b40 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0ca97fa640 1 -- 172.21.15.133:0/1308995711 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0004300 con 0x7f0c9c003b40 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0ca97fa640 1 -- 172.21.15.133:0/1308995711 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca00a5540 con 0x7f0c9c003b40 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cac0c2690 con 0x7f0c9c003b40 2023-12-18T10:20:28.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.604+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cac15bc50 con 0x7f0c9c003b40 2023-12-18T10:20:28.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.608+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cac04e000 con 0x7f0c9c003b40 2023-12-18T10:20:28.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.608+0000 7f0ca97fa640 1 -- 172.21.15.133:0/1308995711 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0ca00a56a0 con 0x7f0c9c003b40 2023-12-18T10:20:28.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.608+0000 7f0ca97fa640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c90065a90 0x7f0c90067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.608+0000 7f0ca97fa640 1 -- 172.21.15.133:0/1308995711 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ca011cbc0 con 0x7f0c9c003b40 2023-12-18T10:20:28.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.608+0000 7f0cabfff640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c90065a90 0x7f0c90067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.608+0000 7f0cabfff640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c90065a90 0x7f0c90067f50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0c98000c10 tx=0x7f0c98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.612+0000 7f0ca97fa640 1 -- 172.21.15.133:0/1308995711 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0ca00ea4b0 con 0x7f0c9c003b40 2023-12-18T10:20:28.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.760+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cac04e000 con 0x7f0c9c003b40 2023-12-18T10:20:28.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0ca97fa640 1 -- 172.21.15.133:0/1308995711 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ca00edad0 con 0x7f0c9c003b40 2023-12-18T10:20:28.766 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c90065a90 msgr2=0x7f0c90067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c90065a90 0x7f0c90067f50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0c98000c10 tx=0x7f0c98009040 comp rx=0 tx=0).stop 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 msgr2=0x7f0cac163db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0cac163db0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0ca001caa0 tx=0x7f0c9c005800 comp rx=0 tx=0).stop 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 shutdown_connections 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c90065a90 0x7f0c90067f50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0cac15b5d0 0x7f0cac152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cac0c2e90 0x7f0cac0ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 --2- 172.21.15.133:0/1308995711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c9c003b40 0x7f0cac163db0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 >> 172.21.15.133:0/1308995711 conn(0x7f0cac06a2a0 msgr2=0x7f0cac1532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 shutdown_connections 2023-12-18T10:20:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.764+0000 7f0cb2a73640 1 -- 172.21.15.133:0/1308995711 wait complete. 2023-12-18T10:20:28.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:20:28.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a8b96640 1 Processor -- start 2023-12-18T10:20:28.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a8b96640 1 -- start start 2023-12-18T10:20:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a8b96640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6a4070820 0x7fa6a40c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a8b96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a40ce3b0 0x7fa6a40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a8b96640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a40c9390 con 0x7fa6a41582d0 2023-12-18T10:20:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a8b96640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a40ced80 con 0x7fa6a4070820 2023-12-18T10:20:28.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a8b96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a415aee0 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a1d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6a4070820 0x7fa6a40c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a2d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a40ce3b0 0x7fa6a40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a259c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa6a41582d0 0x7fa6a40ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:56644/0 (socket says 172.21.15.133:56644) 2023-12-18T10:20:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a1d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa6a4070820 0x7fa6a40c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:46530/0 (socket says 172.21.15.133:46530) 2023-12-18T10:20:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a259c640 1 -- 172.21.15.133:0/2085976922 learned_addr learned my addr 172.21.15.133:0/2085976922 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a159a640 1 -- 172.21.15.133:0/2085976922 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077433857 0 0) 0x7fa6a40c9390 con 0x7fa6a41582d0 2023-12-18T10:20:28.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a159a640 1 -- 172.21.15.133:0/2085976922 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa68c003530 con 0x7fa6a41582d0 2023-12-18T10:20:28.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a1d9b640 1 -- 172.21.15.133:0/2085976922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a40ce3b0 msgr2=0x7fa6a40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:28.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a1d9b640 1 --2- 172.21.15.133:0/2085976922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a40ce3b0 0x7fa6a40ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a1d9b640 1 -- 172.21.15.133:0/2085976922 >> v1:172.21.15.142:6789/0 conn(0x7fa6a41582d0 legacy=0x7fa6a40ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a1d9b640 1 -- 172.21.15.133:0/2085976922 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a415b1c0 con 0x7fa6a4070820 2023-12-18T10:20:28.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.924+0000 7fa6a2d9d640 1 --2- 172.21.15.133:0/2085976922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a40ce3b0 0x7fa6a40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:28.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a1d9b640 1 --2- 172.21.15.133:0/2085976922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a4070820 0x7fa6a40c8e50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa6980097c0 tx=0x7fa69801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fc639d3bee5ac88 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a159a640 1 -- 172.21.15.133:0/2085976922 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980ab650 con 0x7fa6a4070820 2023-12-18T10:20:28.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a159a640 1 -- 172.21.15.133:0/2085976922 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6980ab7b0 con 0x7fa6a4070820 2023-12-18T10:20:28.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a159a640 1 -- 172.21.15.133:0/2085976922 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980abb40 con 0x7fa6a4070820 2023-12-18T10:20:28.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a8b96640 1 -- 172.21.15.133:0/2085976922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a4070820 msgr2=0x7fa6a40c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/2085976922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a4070820 0x7fa6a40c8e50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa6980097c0 tx=0x7fa69801c450 comp rx=0 tx=0).stop 2023-12-18T10:20:28.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a8b96640 1 -- 172.21.15.133:0/2085976922 shutdown_connections 2023-12-18T10:20:28.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/2085976922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a40ce3b0 0x7fa6a40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/2085976922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a4070820 0x7fa6a40c8e50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a8b96640 1 -- 172.21.15.133:0/2085976922 >> 172.21.15.133:0/2085976922 conn(0x7fa6a406a2a0 msgr2=0x7fa6a40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:28.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a8b96640 1 -- 172.21.15.133:0/2085976922 shutdown_connections 2023-12-18T10:20:28.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.928+0000 7fa6a8b96640 1 -- 172.21.15.133:0/2085976922 wait complete. 2023-12-18T10:20:28.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 Processor -- start 2023-12-18T10:20:28.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 -- start start 2023-12-18T10:20:28.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a4070820 0x7fa6a41556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a40ce3b0 0x7fa6a40b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a41582d0 0x7fa6a40cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a40b1df0 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a415c620 con 0x7fa6a41582d0 2023-12-18T10:20:28.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a40b11e0 con 0x7fa6a4070820 2023-12-18T10:20:28.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a40ce3b0 0x7fa6a40b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a40ce3b0 0x7fa6a40b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51096/0 (socket says 172.21.15.133:51096) 2023-12-18T10:20:28.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 -- 172.21.15.133:0/1563374655 learned_addr learned my addr 172.21.15.133:0/1563374655 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a259c640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a4070820 0x7fa6a41556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a2d9d640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a41582d0 0x7fa6a40cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 -- 172.21.15.133:0/1563374655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a4070820 msgr2=0x7fa6a41556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a4070820 0x7fa6a41556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 -- 172.21.15.133:0/1563374655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a41582d0 msgr2=0x7fa6a40cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a41582d0 0x7fa6a40cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 -- 172.21.15.133:0/1563374655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c009a70 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a1d9b640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a40ce3b0 0x7fa6a40b2ba0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa6980ad040 tx=0x7fa69801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa692ffd640 1 -- 172.21.15.133:0/1563374655 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980bf610 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa692ffd640 1 -- 172.21.15.133:0/1563374655 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6980bf770 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa692ffd640 1 -- 172.21.15.133:0/1563374655 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980bfb20 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa698009420 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.932+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a40b17a0 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.936+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a404e000 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.936+0000 7fa692ffd640 1 -- 172.21.15.133:0/1563374655 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa6980bfc80 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.936+0000 7fa692ffd640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa684065a60 0x7fa684067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.936+0000 7fa692ffd640 1 -- 172.21.15.133:0/1563374655 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa69811e060 con 0x7fa6a40ce3b0 2023-12-18T10:20:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.936+0000 7fa6a259c640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa684065a60 0x7fa684067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:28.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.936+0000 7fa6a259c640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa684065a60 0x7fa684067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa6940011f0 tx=0x7fa694009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:28.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:28.940+0000 7fa692ffd640 1 -- 172.21.15.133:0/1563374655 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa6980eb950 con 0x7fa6a40ce3b0 2023-12-18T10:20:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.092+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6a4157200 con 0x7fa6a40ce3b0 2023-12-18T10:20:29.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.092+0000 7fa692ffd640 1 -- 172.21.15.133:0/1563374655 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6980eef70 con 0x7fa6a40ce3b0 2023-12-18T10:20:29.097 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa684065a60 msgr2=0x7fa684067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa684065a60 0x7fa684067f20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa6940011f0 tx=0x7fa694009040 comp rx=0 tx=0).stop 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a40ce3b0 msgr2=0x7fa6a40b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a40ce3b0 0x7fa6a40b2ba0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa6980ad040 tx=0x7fa69801ac90 comp rx=0 tx=0).stop 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 shutdown_connections 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa684065a60 0x7fa684067f20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a41582d0 0x7fa6a40cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a40ce3b0 0x7fa6a40b2ba0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 --2- 172.21.15.133:0/1563374655 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6a4070820 0x7fa6a41556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 >> 172.21.15.133:0/1563374655 conn(0x7fa6a406a2a0 msgr2=0x7fa6a4157520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 shutdown_connections 2023-12-18T10:20:29.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.096+0000 7fa6a8b96640 1 -- 172.21.15.133:0/1563374655 wait complete. 2023-12-18T10:20:29.117 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:20:29.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.252+0000 7f1fb102d640 1 Processor -- start 2023-12-18T10:20:29.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1fb102d640 1 -- start start 2023-12-18T10:20:29.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1fb102d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac1582d0 0x7f1fac0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1fb102d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0c9390 con 0x7f1fac070820 2023-12-18T10:20:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1fb102d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac15aee0 con 0x7f1fac0ce3b0 2023-12-18T10:20:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1fb102d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac15b1c0 con 0x7f1fac1582d0 2023-12-18T10:20:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1fa3fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1fac070820 0x7f1fac0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46002/0 (socket says 172.21.15.133:46002) 2023-12-18T10:20:29.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1fa3fff640 1 -- 172.21.15.133:0/3020286451 learned_addr learned my addr 172.21.15.133:0/3020286451 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:29.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1faad9d640 1 --2- 172.21.15.133:0/3020286451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac1582d0 0x7f1fac0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1faa59c640 1 -- 172.21.15.133:0/3020286451 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91125465 0 0) 0x7f1fac0c9390 con 0x7f1fac070820 2023-12-18T10:20:29.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1faa59c640 1 -- 172.21.15.133:0/3020286451 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f98003530 con 0x7f1fac070820 2023-12-18T10:20:29.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1faa59c640 1 -- 172.21.15.133:0/3020286451 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080486454 0 0) 0x7f1fac15aee0 con 0x7f1fac0ce3b0 2023-12-18T10:20:29.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1faa59c640 1 -- 172.21.15.133:0/3020286451 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fac0c9390 con 0x7f1fac0ce3b0 2023-12-18T10:20:29.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1faad9d640 1 -- 172.21.15.133:0/3020286451 >> v1:172.21.15.142:6789/0 conn(0x7f1fac0ce3b0 legacy=0x7f1fac0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1faad9d640 1 -- 172.21.15.133:0/3020286451 >> v1:172.21.15.133:6789/0 conn(0x7f1fac070820 legacy=0x7f1fac0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.256+0000 7f1faad9d640 1 -- 172.21.15.133:0/3020286451 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac15b4a0 con 0x7f1fac1582d0 2023-12-18T10:20:29.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1faad9d640 1 --2- 172.21.15.133:0/3020286451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac1582d0 0x7f1fac0c8e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0097f0 tx=0x7f1f9c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=561421652eea387 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:29.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1faa59c640 1 -- 172.21.15.133:0/3020286451 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0aa610 con 0x7f1fac1582d0 2023-12-18T10:20:29.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1faa59c640 1 -- 172.21.15.133:0/3020286451 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c0a6040 con 0x7f1fac1582d0 2023-12-18T10:20:29.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1faa59c640 1 -- 172.21.15.133:0/3020286451 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0aa990 con 0x7f1fac1582d0 2023-12-18T10:20:29.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1fb102d640 1 -- 172.21.15.133:0/3020286451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac1582d0 msgr2=0x7f1fac0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1fb102d640 1 --2- 172.21.15.133:0/3020286451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac1582d0 0x7f1fac0c8e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0097f0 tx=0x7f1f9c01c490 comp rx=0 tx=0).stop 2023-12-18T10:20:29.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1fb102d640 1 -- 172.21.15.133:0/3020286451 shutdown_connections 2023-12-18T10:20:29.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1fb102d640 1 --2- 172.21.15.133:0/3020286451 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac1582d0 0x7f1fac0c8e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1fb102d640 1 -- 172.21.15.133:0/3020286451 >> 172.21.15.133:0/3020286451 conn(0x7f1fac06a2a0 msgr2=0x7f1fac0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:29.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1fb102d640 1 -- 172.21.15.133:0/3020286451 shutdown_connections 2023-12-18T10:20:29.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.260+0000 7f1fb102d640 1 -- 172.21.15.133:0/3020286451 wait complete. 2023-12-18T10:20:29.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 Processor -- start 2023-12-18T10:20:29.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 -- start start 2023-12-18T10:20:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac070820 0x7f1fac1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fac0ce3b0 0x7f1fac152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac1582d0 0x7f1fac152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac150d20 con 0x7f1fac1582d0 2023-12-18T10:20:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac151c80 con 0x7f1fac0ce3b0 2023-12-18T10:20:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac1534c0 con 0x7f1fac070820 2023-12-18T10:20:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac1582d0 0x7f1fac152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac1582d0 0x7f1fac152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51110/0 (socket says 172.21.15.133:51110) 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 -- 172.21.15.133:0/1422348153 learned_addr learned my addr 172.21.15.133:0/1422348153 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fa3fff640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fac0ce3b0 0x7f1fac152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1faad9d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac070820 0x7f1fac1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 -- 172.21.15.133:0/1422348153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac070820 msgr2=0x7f1fac1501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac070820 0x7f1fac1501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 -- 172.21.15.133:0/1422348153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fac0ce3b0 msgr2=0x7f1fac152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fac0ce3b0 0x7f1fac152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 -- 172.21.15.133:0/1422348153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c009420 con 0x7f1fac1582d0 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fab59e640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac1582d0 0x7f1fac152e60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400c790 tx=0x7f1fa400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fa37fe640 1 -- 172.21.15.133:0/1422348153 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400cea0 con 0x7f1fac1582d0 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fa37fe640 1 -- 172.21.15.133:0/1422348153 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa4003b80 con 0x7f1fac1582d0 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac151350 con 0x7f1fac1582d0 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fa37fe640 1 -- 172.21.15.133:0/1422348153 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400a850 con 0x7f1fac1582d0 2023-12-18T10:20:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.264+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac151910 con 0x7f1fac1582d0 2023-12-18T10:20:29.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.268+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac151df0 con 0x7f1fac1582d0 2023-12-18T10:20:29.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.268+0000 7f1fa37fe640 1 -- 172.21.15.133:0/1422348153 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1fa400a9b0 con 0x7f1fac1582d0 2023-12-18T10:20:29.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.268+0000 7f1fa37fe640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f8c065a60 0x7f1f8c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.268+0000 7f1fa37fe640 1 -- 172.21.15.133:0/1422348153 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1fa40831d0 con 0x7f1fac1582d0 2023-12-18T10:20:29.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.268+0000 7f1faad9d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f8c065a60 0x7f1f8c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.268+0000 7f1faad9d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f8c065a60 0x7f1f8c067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0ae000 tx=0x7f1f9c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.272+0000 7f1fa37fe640 1 -- 172.21.15.133:0/1422348153 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1fa4050a20 con 0x7f1fac1582d0 2023-12-18T10:20:29.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.420+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fac04e000 con 0x7f1fac1582d0 2023-12-18T10:20:29.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.420+0000 7f1fa37fe640 1 -- 172.21.15.133:0/1422348153 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fa4054040 con 0x7f1fac1582d0 2023-12-18T10:20:29.425 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f8c065a60 msgr2=0x7f1f8c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f8c065a60 0x7f1f8c067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0ae000 tx=0x7f1f9c0a7000 comp rx=0 tx=0).stop 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac1582d0 msgr2=0x7f1fac152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac1582d0 0x7f1fac152e60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400c790 tx=0x7f1fa400cc50 comp rx=0 tx=0).stop 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 shutdown_connections 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f8c065a60 0x7f1f8c067f20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac1582d0 0x7f1fac152e60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1fac0ce3b0 0x7f1fac152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 --2- 172.21.15.133:0/1422348153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1fac070820 0x7f1fac1501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 >> 172.21.15.133:0/1422348153 conn(0x7f1fac06a2a0 msgr2=0x7f1fac0ac5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 shutdown_connections 2023-12-18T10:20:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.424+0000 7f1fb102d640 1 -- 172.21.15.133:0/1422348153 wait complete. 2023-12-18T10:20:29.446 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:20:29.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.584+0000 7f4bf02e5640 1 Processor -- start 2023-12-18T10:20:29.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.584+0000 7f4bf02e5640 1 -- start start 2023-12-18T10:20:29.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.584+0000 7f4bf02e5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4be8158c20 0x7f4be8070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.584+0000 7f4bf02e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be80cb180 0x7f4be80ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.584+0000 7f4bf02e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be8070b80 con 0x7f4be815c800 2023-12-18T10:20:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.584+0000 7f4bf02e5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be8070e60 con 0x7f4be8158c20 2023-12-18T10:20:29.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.584+0000 7f4bf02e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be8071140 con 0x7f4be80cb180 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee882640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be80cb180 0x7f4be80ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee081640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4be8158c20 0x7f4be8070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee882640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be80cb180 0x7f4be80ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:43064/0 (socket says 172.21.15.133:43064) 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee882640 1 -- 172.21.15.133:0/925696700 learned_addr learned my addr 172.21.15.133:0/925696700 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee081640 1 -- 172.21.15.133:0/925696700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be80cb180 msgr2=0x7f4be80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee081640 1 --2- 172.21.15.133:0/925696700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be80cb180 0x7f4be80ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee081640 1 -- 172.21.15.133:0/925696700 >> v1:172.21.15.142:6789/0 conn(0x7f4be815c800 legacy=0x7f4be80caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee081640 1 -- 172.21.15.133:0/925696700 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8071420 con 0x7f4be8158c20 2023-12-18T10:20:29.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee882640 1 --2- 172.21.15.133:0/925696700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be80cb180 0x7f4be80ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:29.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bee081640 1 --2- 172.21.15.133:0/925696700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 0x7f4be8070510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4be40097c0 tx=0x7f4be401ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14225c21674f9af server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:29.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bed07f640 1 -- 172.21.15.133:0/925696700 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40ab600 con 0x7f4be8158c20 2023-12-18T10:20:29.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bed07f640 1 -- 172.21.15.133:0/925696700 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be40a7050 con 0x7f4be8158c20 2023-12-18T10:20:29.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.588+0000 7f4bed07f640 1 -- 172.21.15.133:0/925696700 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40ab980 con 0x7f4be8158c20 2023-12-18T10:20:29.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- 172.21.15.133:0/925696700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 msgr2=0x7f4be8070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/925696700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 0x7f4be8070510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4be40097c0 tx=0x7f4be401ce20 comp rx=0 tx=0).stop 2023-12-18T10:20:29.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- 172.21.15.133:0/925696700 shutdown_connections 2023-12-18T10:20:29.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/925696700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be80cb180 0x7f4be80ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/925696700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 0x7f4be8070510 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- 172.21.15.133:0/925696700 >> 172.21.15.133:0/925696700 conn(0x7f4be806a3e0 msgr2=0x7f4be80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:29.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- 172.21.15.133:0/925696700 shutdown_connections 2023-12-18T10:20:29.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- 172.21.15.133:0/925696700 wait complete. 2023-12-18T10:20:29.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 Processor -- start 2023-12-18T10:20:29.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- start start 2023-12-18T10:20:29.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4be80cb180 0x7f4be814a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 0x7f4be80c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be815c800 0x7f4be80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be815bcb0 con 0x7f4be80cb180 2023-12-18T10:20:29.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be815b0a0 con 0x7f4be8158c20 2023-12-18T10:20:29.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bf02e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be815b380 con 0x7f4be815c800 2023-12-18T10:20:29.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bee081640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4be80cb180 0x7f4be814a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bee081640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4be80cb180 0x7f4be814a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51122/0 (socket says 172.21.15.133:51122) 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bee081640 1 -- 172.21.15.133:0/3607567458 learned_addr learned my addr 172.21.15.133:0/3607567458 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bed880640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 0x7f4be80c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.592+0000 7f4bee882640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be815c800 0x7f4be80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bee081640 1 -- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be815c800 msgr2=0x7f4be80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bee081640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be815c800 0x7f4be80ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bee081640 1 -- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 msgr2=0x7f4be80c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bee081640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 0x7f4be80c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bee081640 1 -- 172.21.15.133:0/3607567458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0009b30 con 0x7f4be80cb180 2023-12-18T10:20:29.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bed880640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 0x7f4be80c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:29.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bee081640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4be80cb180 0x7f4be814a940 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4be4019ff0 tx=0x7f4be401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:29.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bdeffd640 1 -- 172.21.15.133:0/3607567458 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40b7450 con 0x7f4be80cb180 2023-12-18T10:20:29.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bdeffd640 1 -- 172.21.15.133:0/3607567458 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be40b75b0 con 0x7f4be80cb180 2023-12-18T10:20:29.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bdeffd640 1 -- 172.21.15.133:0/3607567458 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40b7960 con 0x7f4be80cb180 2023-12-18T10:20:29.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be4009420 con 0x7f4be80cb180 2023-12-18T10:20:29.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be80c8800 con 0x7f4be80cb180 2023-12-18T10:20:29.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be80735b0 con 0x7f4be80cb180 2023-12-18T10:20:29.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bdeffd640 1 -- 172.21.15.133:0/3607567458 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4be40b7ac0 con 0x7f4be80cb180 2023-12-18T10:20:29.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bdeffd640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bcc065a90 0x7f4bcc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:29.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bdeffd640 1 -- 172.21.15.133:0/3607567458 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4be411d8b0 con 0x7f4be80cb180 2023-12-18T10:20:29.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.596+0000 7f4bed880640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bcc065a90 0x7f4bcc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:29.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.600+0000 7f4bed880640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bcc065a90 0x7f4bcc067f50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4be80ceeb0 tx=0x7f4bd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:29.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.600+0000 7f4bdeffd640 1 -- 172.21.15.133:0/3607567458 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4be40eb100 con 0x7f4be80cb180 2023-12-18T10:20:29.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.760+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4be804e000 con 0x7f4be80cb180 2023-12-18T10:20:29.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.760+0000 7f4bdeffd640 1 -- 172.21.15.133:0/3607567458 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4be40bb080 con 0x7f4be80cb180 2023-12-18T10:20:29.766 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:20:29.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bcc065a90 msgr2=0x7f4bcc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bcc065a90 0x7f4bcc067f50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4be80ceeb0 tx=0x7f4bd8009040 comp rx=0 tx=0).stop 2023-12-18T10:20:29.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4be80cb180 msgr2=0x7f4be814a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:29.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4be80cb180 0x7f4be814a940 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4be4019ff0 tx=0x7f4be401ac00 comp rx=0 tx=0).stop 2023-12-18T10:20:29.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 shutdown_connections 2023-12-18T10:20:29.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bcc065a90 0x7f4bcc067f50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4be815c800 0x7f4be80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4be8158c20 0x7f4be80c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 --2- 172.21.15.133:0/3607567458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4be80cb180 0x7f4be814a940 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 >> 172.21.15.133:0/3607567458 conn(0x7f4be806a3e0 msgr2=0x7f4be8150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 shutdown_connections 2023-12-18T10:20:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:29.764+0000 7f4bf02e5640 1 -- 172.21.15.133:0/3607567458 wait complete. 2023-12-18T10:20:29.787 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:20:29.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:29.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-18T10:20:29.805 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[49612]: fuse finished with error 0 and tester_r 0 2023-12-18T10:20:29.809 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:20:29.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:29.809 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-18T10:20:29.971 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:20:29.971 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:20:29.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:20:29.982 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:20:29.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:29.982 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-18T10:20:30.031 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-18T10:20:30.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:20:30.032 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:20:30.032 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:20:30.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:20:30.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:20:30.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:30.041 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-18T10:20:30.090 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-18T10:20:30.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:20:30.091 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:20:30.091 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:20:30.102 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:20:30.102 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:20:30.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:30.102 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-18T10:20:30.155 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-18T10:20:30.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:20:30.156 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:30.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e9c919640 1 Processor -- start 2023-12-18T10:20:30.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e9c919640 1 -- start start 2023-12-18T10:20:30.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e9c919640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e9806bdd0 0x7f8e980c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e9c919640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980ccf90 con 0x7f8e9806c1b0 2023-12-18T10:20:30.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e9c919640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980cd270 con 0x7f8e980cc970 2023-12-18T10:20:30.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e9c919640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e980caa70 con 0x7f8e9806bdd0 2023-12-18T10:20:30.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e8ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8e9806c1b0 0x7f8e980cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48456/0 (socket says 172.21.15.133:48456) 2023-12-18T10:20:30.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e8ffff640 1 -- 172.21.15.133:0/1208656951 learned_addr learned my addr 172.21.15.133:0/1208656951 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:30.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e977fe640 1 --2- 172.21.15.133:0/1208656951 >> v2:172.21.15.142:3300/0 conn(0x7f8e9806bdd0 0x7f8e980c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e96ffd640 1 -- 172.21.15.133:0/1208656951 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783947715 0 0) 0x7f8e980ccf90 con 0x7f8e9806c1b0 2023-12-18T10:20:30.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e96ffd640 1 -- 172.21.15.133:0/1208656951 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e84005740 con 0x7f8e9806c1b0 2023-12-18T10:20:30.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e977fe640 1 -- 172.21.15.133:0/1208656951 >> v1:172.21.15.142:6789/0 conn(0x7f8e980cc970 legacy=0x7f8e9814f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e977fe640 1 -- 172.21.15.133:0/1208656951 >> v1:172.21.15.133:6789/0 conn(0x7f8e9806c1b0 legacy=0x7f8e980cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.292+0000 7f8e977fe640 1 -- 172.21.15.133:0/1208656951 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980c9260 con 0x7f8e9806bdd0 2023-12-18T10:20:30.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e977fe640 1 --2- 172.21.15.133:0/1208656951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806bdd0 0x7f8e980c45d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e880097c0 tx=0x7f8e8801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8714a7a71dc54160 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e96ffd640 1 -- 172.21.15.133:0/1208656951 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880ab600 con 0x7f8e9806bdd0 2023-12-18T10:20:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e96ffd640 1 -- 172.21.15.133:0/1208656951 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880a7050 con 0x7f8e9806bdd0 2023-12-18T10:20:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e96ffd640 1 -- 172.21.15.133:0/1208656951 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880ab980 con 0x7f8e9806bdd0 2023-12-18T10:20:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e9c919640 1 -- 172.21.15.133:0/1208656951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806bdd0 msgr2=0x7f8e980c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e9c919640 1 --2- 172.21.15.133:0/1208656951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806bdd0 0x7f8e980c45d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e880097c0 tx=0x7f8e8801c480 comp rx=0 tx=0).stop 2023-12-18T10:20:30.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e9c919640 1 -- 172.21.15.133:0/1208656951 shutdown_connections 2023-12-18T10:20:30.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e9c919640 1 --2- 172.21.15.133:0/1208656951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806bdd0 0x7f8e980c45d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e9c919640 1 -- 172.21.15.133:0/1208656951 >> 172.21.15.133:0/1208656951 conn(0x7f8e980ce130 msgr2=0x7f8e980ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:30.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e9c919640 1 -- 172.21.15.133:0/1208656951 shutdown_connections 2023-12-18T10:20:30.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.296+0000 7f8e9c919640 1 -- 172.21.15.133:0/1208656951 wait complete. 2023-12-18T10:20:30.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 Processor -- start 2023-12-18T10:20:30.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 -- start start 2023-12-18T10:20:30.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e9806bdd0 0x7f8e9815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806c1b0 0x7f8e980b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cc970 0x7f8e9814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9814cf40 con 0x7f8e980cc970 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98151940 con 0x7f8e9806c1b0 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b21a0 con 0x7f8e9806bdd0 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cc970 0x7f8e9814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cc970 0x7f8e9814ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48780/0 (socket says 172.21.15.133:48780) 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 -- 172.21.15.133:0/2277948218 learned_addr learned my addr 172.21.15.133:0/2277948218 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e8ffff640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806c1b0 0x7f8e980b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e977fe640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e9806bdd0 0x7f8e9815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 -- 172.21.15.133:0/2277948218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e9806bdd0 msgr2=0x7f8e9815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e9806bdd0 0x7f8e9815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 -- 172.21.15.133:0/2277948218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806c1b0 msgr2=0x7f8e980b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806c1b0 0x7f8e980b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 -- 172.21.15.133:0/2277948218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88009420 con 0x7f8e980cc970 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e97fff640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cc970 0x7f8e9814ca00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000c770 tx=0x7f8e9000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e94ff9640 1 -- 172.21.15.133:0/2277948218 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90003b80 con 0x7f8e980cc970 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e94ff9640 1 -- 172.21.15.133:0/2277948218 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e90003ce0 con 0x7f8e980cc970 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e94ff9640 1 -- 172.21.15.133:0/2277948218 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000aa90 con 0x7f8e980cc970 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e980b3960 con 0x7f8e980cc970 2023-12-18T10:20:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e981515d0 con 0x7f8e980cc970 2023-12-18T10:20:30.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.300+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9804e850 con 0x7f8e980cc970 2023-12-18T10:20:30.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.304+0000 7f8e94ff9640 1 -- 172.21.15.133:0/2277948218 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e9000abf0 con 0x7f8e980cc970 2023-12-18T10:20:30.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.304+0000 7f8e94ff9640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e78065a60 0x7f8e78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.304+0000 7f8e94ff9640 1 -- 172.21.15.133:0/2277948218 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e900831c0 con 0x7f8e980cc970 2023-12-18T10:20:30.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.304+0000 7f8e977fe640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e78065a60 0x7f8e78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.304+0000 7f8e977fe640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e78065a60 0x7f8e78067f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ad000 tx=0x7f8e88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:30.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.308+0000 7f8e94ff9640 1 -- 172.21.15.133:0/2277948218 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8e90050980 con 0x7f8e980cc970 2023-12-18T10:20:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e98151a80 con 0x7f8e980cc970 2023-12-18T10:20:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e94ff9640 1 -- 172.21.15.133:0/2277948218 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4749 (secure 0 0 0) 0x7f8e90053fa0 con 0x7f8e980cc970 2023-12-18T10:20:30.492 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:30.492 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:58.187712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5508,"mds_1":5499,"mds_2":5054},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5054":{"gid":5054,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5499":{"gid":5499,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:20:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 25 2023-12-18T10:20:30.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e78065a60 msgr2=0x7f8e78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e78065a60 0x7f8e78067f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ad000 tx=0x7f8e88008040 comp rx=0 tx=0).stop 2023-12-18T10:20:30.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cc970 msgr2=0x7f8e9814ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cc970 0x7f8e9814ca00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000c770 tx=0x7f8e9000cc30 comp rx=0 tx=0).stop 2023-12-18T10:20:30.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 shutdown_connections 2023-12-18T10:20:30.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e78065a60 0x7f8e78067f20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e980cc970 0x7f8e9814ca00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e9806c1b0 0x7f8e980b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 --2- 172.21.15.133:0/2277948218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e9806bdd0 0x7f8e9815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 >> 172.21.15.133:0/2277948218 conn(0x7f8e980ce130 msgr2=0x7f8e980cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 shutdown_connections 2023-12-18T10:20:30.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.488+0000 7f8e9c919640 1 -- 172.21.15.133:0/2277948218 wait complete. 2023-12-18T10:20:30.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:20:30.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.648+0000 7f3538d09640 1 Processor -- start 2023-12-18T10:20:30.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.648+0000 7f3538d09640 1 -- start start 2023-12-18T10:20:30.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.648+0000 7f3538d09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 0x7f353415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.648+0000 7f3538d09640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353415f100 con 0x7f353406fdb0 2023-12-18T10:20:30.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.648+0000 7f3538d09640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340ca7d0 con 0x7f353415a680 2023-12-18T10:20:30.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.648+0000 7f3538d09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353415e860 con 0x7f35340cac10 2023-12-18T10:20:30.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.648+0000 7f3532d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f353406fdb0 0x7f35340c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48468/0 (socket says 172.21.15.133:48468) 2023-12-18T10:20:30.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.648+0000 7f3532d9d640 1 -- 172.21.15.133:0/1789338107 learned_addr learned my addr 172.21.15.133:0/1789338107 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:30.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3529d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 0x7f353415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780747371 0 0) 0x7f353415f100 con 0x7f353406fdb0 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3520003530 con 0x7f353406fdb0 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2040686749 0 0) 0x7f3520003530 con 0x7f353406fdb0 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 msgr2=0x7f353415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 0x7f353415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 >> v1:172.21.15.142:6789/0 conn(0x7f353415a680 legacy=0x7f353415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353415eb40 con 0x7f353406fdb0 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f352c001680 con 0x7f353406fdb0 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 >> v1:172.21.15.133:6789/0 conn(0x7f353406fdb0 legacy=0x7f35340c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200039b0 0x7f3520003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35200047d0 0x7f3520004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 0x7f35200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353415e860 con 0x7f35200047d0 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352000baf0 con 0x7f35200039b0 2023-12-18T10:20:30.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352000bcb0 con 0x7f35340cac10 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3529d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35200047d0 0x7f3520004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f353259c640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200039b0 0x7f3520003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3532d9d640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 0x7f35200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3529d9b640 1 -- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 msgr2=0x7f35200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3529d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 0x7f35200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3529d9b640 1 -- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200039b0 msgr2=0x7f3520003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3529d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200039b0 0x7f3520003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3529d9b640 1 -- 172.21.15.133:0/1789338107 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520003530 con 0x7f35200047d0 2023-12-18T10:20:30.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.652+0000 7f3532d9d640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35340cac10 0x7f35200051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3529d9b640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35200047d0 0x7f3520004c50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f351c009f90 tx=0x7f351c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9ed7cfee5b2751 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0a5be0 con 0x7f35200047d0 2023-12-18T10:20:30.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c00f040 con 0x7f35200047d0 2023-12-18T10:20:30.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3531d9b640 1 -- 172.21.15.133:0/1789338107 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0ad440 con 0x7f35200047d0 2023-12-18T10:20:30.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3538d09640 1 -- 172.21.15.133:0/1789338107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35200047d0 msgr2=0x7f3520004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3538d09640 1 --2- 172.21.15.133:0/1789338107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35200047d0 0x7f3520004c50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f351c009f90 tx=0x7f351c01cbf0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3532d9d640 1 -- 172.21.15.133:0/1789338107 reap_dead start 2023-12-18T10:20:30.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3538d09640 1 -- 172.21.15.133:0/1789338107 shutdown_connections 2023-12-18T10:20:30.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3538d09640 1 -- 172.21.15.133:0/1789338107 >> 172.21.15.133:0/1789338107 conn(0x7f353406a3e0 msgr2=0x7f35340afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:30.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3538d09640 1 -- 172.21.15.133:0/1789338107 shutdown_connections 2023-12-18T10:20:30.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3538d09640 1 -- 172.21.15.133:0/1789338107 wait complete. 2023-12-18T10:20:30.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3538d09640 1 Processor -- start 2023-12-18T10:20:30.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.656+0000 7f3538d09640 1 -- start start 2023-12-18T10:20:30.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200047d0 0x7f35341535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35341582d0 0x7f35341509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3534160190 0x7f3534155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534159380 con 0x7f3534160190 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534160610 con 0x7f35200047d0 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3534158800 con 0x7f35341582d0 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3534160190 0x7f3534155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3534160190 0x7f3534155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48794/0 (socket says 172.21.15.133:48794) 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 -- 172.21.15.133:0/643241400 learned_addr learned my addr 172.21.15.133:0/643241400 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f353259c640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200047d0 0x7f35341535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3529d9b640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35341582d0 0x7f35341509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 -- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35341582d0 msgr2=0x7f35341509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35341582d0 0x7f35341509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 -- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200047d0 msgr2=0x7f35341535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200047d0 0x7f35341535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 -- 172.21.15.133:0/643241400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534158ae0 con 0x7f3534160190 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3529d9b640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35341582d0 0x7f35341509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3532d9d640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3534160190 0x7f3534155e80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f35340ce140 tx=0x7f352c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f352b7fe640 1 -- 172.21.15.133:0/643241400 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00c610 con 0x7f3534160190 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f352b7fe640 1 -- 172.21.15.133:0/643241400 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c00c770 con 0x7f3534160190 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3534158dc0 con 0x7f3534160190 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f352b7fe640 1 -- 172.21.15.133:0/643241400 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00cb20 con 0x7f3534160190 2023-12-18T10:20:30.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3534161040 con 0x7f3534160190 2023-12-18T10:20:30.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35340735b0 con 0x7f3534160190 2023-12-18T10:20:30.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.660+0000 7f352b7fe640 1 -- 172.21.15.133:0/643241400 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f352c00cc80 con 0x7f3534160190 2023-12-18T10:20:30.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.664+0000 7f352b7fe640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3514065a60 0x7f3514067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.664+0000 7f352b7fe640 1 -- 172.21.15.133:0/643241400 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f352c083150 con 0x7f3534160190 2023-12-18T10:20:30.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.664+0000 7f353259c640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3514065a60 0x7f3514067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.664+0000 7f353259c640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3514065a60 0x7f3514067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3524007fd0 tx=0x7f3524009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:30.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.664+0000 7f352b7fe640 1 -- 172.21.15.133:0/643241400 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f352c050880 con 0x7f3534160190 2023-12-18T10:20:30.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.816+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f353404e000 con 0x7f3534160190 2023-12-18T10:20:30.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.816+0000 7f352b7fe640 1 -- 172.21.15.133:0/643241400 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16403 (secure 0 0 0) 0x7f352c053ea0 con 0x7f3534160190 2023-12-18T10:20:30.822 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:30.822 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":41,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:19:47.948169+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:19:28.252118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-18T10:19:29.371748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:20:30.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3514065a60 msgr2=0x7f3514067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3514065a60 0x7f3514067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3524007fd0 tx=0x7f3524009040 comp rx=0 tx=0).stop 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3534160190 msgr2=0x7f3534155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3534160190 0x7f3534155e80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f35340ce140 tx=0x7f352c00eb90 comp rx=0 tx=0).stop 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 shutdown_connections 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3514065a60 0x7f3514067f20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3534160190 0x7f3534155e80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35341582d0 0x7f35341509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 --2- 172.21.15.133:0/643241400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35200047d0 0x7f35341535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 >> 172.21.15.133:0/643241400 conn(0x7f353406a3e0 msgr2=0x7f3534156a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 shutdown_connections 2023-12-18T10:20:30.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.820+0000 7f3538d09640 1 -- 172.21.15.133:0/643241400 wait complete. 2023-12-18T10:20:30.844 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:19:28.252118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:19:29.371748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:20:30.844 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:20:30.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.980+0000 7f07419a6640 1 Processor -- start 2023-12-18T10:20:30.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.980+0000 7f07419a6640 1 -- start start 2023-12-18T10:20:30.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07419a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f073c071870 0x7f073c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07419a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0cbff0 0x7f073c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07419a6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0cc930 con 0x7f073c0ca410 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07419a6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c15aab0 con 0x7f073c071870 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07419a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c070df0 con 0x7f073c0cbff0 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07327fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f073c071870 0x7f073c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f073affd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f073c0ca410 0x7f073c159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48476/0 (socket says 172.21.15.133:48476) 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f073affd640 1 -- 172.21.15.133:0/1623335358 learned_addr learned my addr 172.21.15.133:0/1623335358 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f073b7fe640 1 --2- 172.21.15.133:0/1623335358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0cbff0 0x7f073c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07327fc640 1 -- 172.21.15.133:0/1623335358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0cbff0 msgr2=0x7f073c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07327fc640 1 --2- 172.21.15.133:0/1623335358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0cbff0 0x7f073c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07327fc640 1 -- 172.21.15.133:0/1623335358 >> v1:172.21.15.133:6789/0 conn(0x7f073c0ca410 legacy=0x7f073c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07327fc640 1 -- 172.21.15.133:0/1623335358 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c15a4f0 con 0x7f073c071870 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f073a7fc640 1 -- 172.21.15.133:0/1623335358 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429681441 0 0) 0x7f073c0cc930 con 0x7f073c0ca410 2023-12-18T10:20:30.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f073b7fe640 1 --2- 172.21.15.133:0/1623335358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0cbff0 0x7f073c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:30.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f07327fc640 1 --2- 172.21.15.133:0/1623335358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c071870 0x7f073c071d00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f07240097c0 tx=0x7f072401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16077f0bb42e35b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:30.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.984+0000 7f073a7fc640 1 -- 172.21.15.133:0/1623335358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240ab650 con 0x7f073c071870 2023-12-18T10:20:30.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f073a7fc640 1 -- 172.21.15.133:0/1623335358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07240ab7b0 con 0x7f073c071870 2023-12-18T10:20:30.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f073a7fc640 1 -- 172.21.15.133:0/1623335358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07240abb40 con 0x7f073c071870 2023-12-18T10:20:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- 172.21.15.133:0/1623335358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c071870 msgr2=0x7f073c071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 --2- 172.21.15.133:0/1623335358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c071870 0x7f073c071d00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f07240097c0 tx=0x7f072401c450 comp rx=0 tx=0).stop 2023-12-18T10:20:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- 172.21.15.133:0/1623335358 shutdown_connections 2023-12-18T10:20:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 --2- 172.21.15.133:0/1623335358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0cbff0 0x7f073c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 --2- 172.21.15.133:0/1623335358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c071870 0x7f073c071d00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- 172.21.15.133:0/1623335358 >> 172.21.15.133:0/1623335358 conn(0x7f073c06a2a0 msgr2=0x7f073c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- 172.21.15.133:0/1623335358 shutdown_connections 2023-12-18T10:20:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- 172.21.15.133:0/1623335358 wait complete. 2023-12-18T10:20:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 Processor -- start 2023-12-18T10:20:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- start start 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c071870 0x7f073c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0ca410 0x7f073c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c0cbff0 0x7f073c1f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c150200 con 0x7f073c0cbff0 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1593d0 con 0x7f073c071870 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f07419a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c14feb0 con 0x7f073c0ca410 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f073b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c0cbff0 0x7f073c1f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f073b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c0cbff0 0x7f073c1f8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48812/0 (socket says 172.21.15.133:48812) 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.988+0000 7f073b7fe640 1 -- 172.21.15.133:0/461097188 learned_addr learned my addr 172.21.15.133:0/461097188 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f073affd640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c071870 0x7f073c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f07327fc640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0ca410 0x7f073c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f073b7fe640 1 -- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0ca410 msgr2=0x7f073c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f073b7fe640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0ca410 0x7f073c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f073b7fe640 1 -- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c071870 msgr2=0x7f073c14e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f073b7fe640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c071870 0x7f073c14e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f073b7fe640 1 -- 172.21.15.133:0/461097188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724009420 con 0x7f073c0cbff0 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f07327fc640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0ca410 0x7f073c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f073b7fe640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c0cbff0 0x7f073c1f8670 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f073400c7f0 tx=0x7f073400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f0738ff9640 1 -- 172.21.15.133:0/461097188 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734007820 con 0x7f073c0cbff0 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f0738ff9640 1 -- 172.21.15.133:0/461097188 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07340079c0 con 0x7f073c0cbff0 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f0738ff9640 1 -- 172.21.15.133:0/461097188 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734007d70 con 0x7f073c0cbff0 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c158350 con 0x7f073c0cbff0 2023-12-18T10:20:30.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c158910 con 0x7f073c0cbff0 2023-12-18T10:20:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c150340 con 0x7f073c0cbff0 2023-12-18T10:20:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f0738ff9640 1 -- 172.21.15.133:0/461097188 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f07340113f0 con 0x7f073c0cbff0 2023-12-18T10:20:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f0738ff9640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f071c065a30 0x7f071c067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f0738ff9640 1 -- 172.21.15.133:0/461097188 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f07340836c0 con 0x7f073c0cbff0 2023-12-18T10:20:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.992+0000 7f073affd640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f071c065a30 0x7f071c067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.996+0000 7f073affd640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f071c065a30 0x7f071c067ef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f072c0012f0 tx=0x7f072c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:30.996+0000 7f0738ff9640 1 -- 172.21.15.133:0/461097188 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f073c150340 con 0x7f073c0cbff0 2023-12-18T10:20:31.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f073c150340 con 0x7f073c0cbff0 2023-12-18T10:20:31.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f0738ff9640 1 -- 172.21.15.133:0/461097188 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f073c150340 con 0x7f073c0cbff0 2023-12-18T10:20:31.156 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f071c065a30 msgr2=0x7f071c067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f071c065a30 0x7f071c067ef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f072c0012f0 tx=0x7f072c009040 comp rx=0 tx=0).stop 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c0cbff0 msgr2=0x7f073c1f8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c0cbff0 0x7f073c1f8670 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f073400c7f0 tx=0x7f073400ccb0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 shutdown_connections 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f071c065a30 0x7f071c067ef0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c0cbff0 0x7f073c1f8670 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f073c0ca410 0x7f073c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 --2- 172.21.15.133:0/461097188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c071870 0x7f073c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 >> 172.21.15.133:0/461097188 conn(0x7f073c06a2a0 msgr2=0x7f073c0c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:31.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 shutdown_connections 2023-12-18T10:20:31.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.152+0000 7f07419a6640 1 -- 172.21.15.133:0/461097188 wait complete. 2023-12-18T10:20:31.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:20:31.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.312+0000 7feb6ded1640 1 Processor -- start 2023-12-18T10:20:31.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.312+0000 7feb6ded1640 1 -- start start 2023-12-18T10:20:31.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.312+0000 7feb6ded1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb680ca410 0x7feb68159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.312+0000 7feb6ded1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb68070df0 con 0x7feb680cbff0 2023-12-18T10:20:31.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.312+0000 7feb6ded1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6815a4f0 con 0x7feb68159fb0 2023-12-18T10:20:31.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.312+0000 7feb6ded1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6815aab0 con 0x7feb680ca410 2023-12-18T10:20:31.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb677fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb680ca410 0x7feb68159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb67fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feb680cbff0 0x7feb680ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48490/0 (socket says 172.21.15.133:48490) 2023-12-18T10:20:31.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb67fff640 1 -- 172.21.15.133:0/4144183121 learned_addr learned my addr 172.21.15.133:0/4144183121 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:31.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb677fe640 1 -- 172.21.15.133:0/4144183121 >> v1:172.21.15.142:6789/0 conn(0x7feb68159fb0 legacy=0x7feb68071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb677fe640 1 -- 172.21.15.133:0/4144183121 >> v1:172.21.15.133:6789/0 conn(0x7feb680cbff0 legacy=0x7feb680ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb677fe640 1 -- 172.21.15.133:0/4144183121 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6815a7d0 con 0x7feb680ca410 2023-12-18T10:20:31.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb667fc640 1 -- 172.21.15.133:0/4144183121 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83507270 0 0) 0x7feb68070df0 con 0x7feb680cbff0 2023-12-18T10:20:31.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb677fe640 1 --2- 172.21.15.133:0/4144183121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb680ca410 0x7feb68159a70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feb580097c0 tx=0x7feb5801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce5ee432364e050 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb667fc640 1 -- 172.21.15.133:0/4144183121 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580ab650 con 0x7feb680ca410 2023-12-18T10:20:31.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb667fc640 1 -- 172.21.15.133:0/4144183121 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb580ab7b0 con 0x7feb680ca410 2023-12-18T10:20:31.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.316+0000 7feb667fc640 1 -- 172.21.15.133:0/4144183121 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580abb40 con 0x7feb680ca410 2023-12-18T10:20:31.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- 172.21.15.133:0/4144183121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb680ca410 msgr2=0x7feb68159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 --2- 172.21.15.133:0/4144183121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb680ca410 0x7feb68159a70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feb580097c0 tx=0x7feb5801c450 comp rx=0 tx=0).stop 2023-12-18T10:20:31.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- 172.21.15.133:0/4144183121 shutdown_connections 2023-12-18T10:20:31.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 --2- 172.21.15.133:0/4144183121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb680ca410 0x7feb68159a70 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- 172.21.15.133:0/4144183121 >> 172.21.15.133:0/4144183121 conn(0x7feb6806a2a0 msgr2=0x7feb680aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:31.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- 172.21.15.133:0/4144183121 shutdown_connections 2023-12-18T10:20:31.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- 172.21.15.133:0/4144183121 wait complete. 2023-12-18T10:20:31.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 Processor -- start 2023-12-18T10:20:31.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- start start 2023-12-18T10:20:31.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680ca410 0x7feb681553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680cbff0 0x7feb6814d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb68159fb0 0x7feb680aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c3ab0 con 0x7feb68159fb0 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c2ea0 con 0x7feb680cbff0 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb6ded1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680c3180 con 0x7feb680ca410 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb67fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb68159fb0 0x7feb680aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb67fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb68159fb0 0x7feb680aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48828/0 (socket says 172.21.15.133:48828) 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb67fff640 1 -- 172.21.15.133:0/2815693600 learned_addr learned my addr 172.21.15.133:0/2815693600 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb677fe640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680ca410 0x7feb681553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb66ffd640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680cbff0 0x7feb6814d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb67fff640 1 -- 172.21.15.133:0/2815693600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680ca410 msgr2=0x7feb681553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb67fff640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680ca410 0x7feb681553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb67fff640 1 -- 172.21.15.133:0/2815693600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680cbff0 msgr2=0x7feb6814d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb67fff640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680cbff0 0x7feb6814d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.320+0000 7feb67fff640 1 -- 172.21.15.133:0/2815693600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58009420 con 0x7feb68159fb0 2023-12-18T10:20:31.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb67fff640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb68159fb0 0x7feb680aeb20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7feb60001570 tx=0x7feb6000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb4ffff640 1 -- 172.21.15.133:0/2815693600 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000a640 con 0x7feb68159fb0 2023-12-18T10:20:31.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb4ffff640 1 -- 172.21.15.133:0/2815693600 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000a7c0 con 0x7feb68159fb0 2023-12-18T10:20:31.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb680cc960 con 0x7feb68159fb0 2023-12-18T10:20:31.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb4ffff640 1 -- 172.21.15.133:0/2815693600 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000ab70 con 0x7feb68159fb0 2023-12-18T10:20:31.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb680c3740 con 0x7feb68159fb0 2023-12-18T10:20:31.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb680c3c20 con 0x7feb68159fb0 2023-12-18T10:20:31.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb4ffff640 1 -- 172.21.15.133:0/2815693600 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb6000acd0 con 0x7feb68159fb0 2023-12-18T10:20:31.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb4ffff640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb4ffff640 1 -- 172.21.15.133:0/2815693600 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feb60082b50 con 0x7feb68159fb0 2023-12-18T10:20:31.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.324+0000 7feb677fe640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.328+0000 7feb677fe640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb580af000 tx=0x7feb580a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.328+0000 7feb4ffff640 1 -- 172.21.15.133:0/2815693600 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feb600503c0 con 0x7feb68159fb0 2023-12-18T10:20:31.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.480+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb6804e000 con 0x7feb68159fb0 2023-12-18T10:20:31.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.480+0000 7feb4ffff640 1 -- 172.21.15.133:0/2815693600 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb60018020 con 0x7feb68159fb0 2023-12-18T10:20:31.484 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:20:31.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 msgr2=0x7feb54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb580af000 tx=0x7feb580a7000 comp rx=0 tx=0).stop 2023-12-18T10:20:31.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb68159fb0 msgr2=0x7feb680aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb68159fb0 0x7feb680aeb20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7feb60001570 tx=0x7feb6000cca0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 shutdown_connections 2023-12-18T10:20:31.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb68159fb0 0x7feb680aeb20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb680cbff0 0x7feb6814d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 --2- 172.21.15.133:0/2815693600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb680ca410 0x7feb681553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 >> 172.21.15.133:0/2815693600 conn(0x7feb6806a2a0 msgr2=0x7feb680cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:31.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 shutdown_connections 2023-12-18T10:20:31.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.484+0000 7feb6ded1640 1 -- 172.21.15.133:0/2815693600 wait complete. 2023-12-18T10:20:31.506 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:20:31.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.640+0000 7f28cf866640 1 Processor -- start 2023-12-18T10:20:31.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.640+0000 7f28cf866640 1 -- start start 2023-12-18T10:20:31.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cf866640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80ceac0 0x7f28c80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cf866640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80c9390 con 0x7f28c81582d0 2023-12-18T10:20:31.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cf866640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c815aee0 con 0x7f28c8070820 2023-12-18T10:20:31.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cf866640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c815b1c0 con 0x7f28c80ceac0 2023-12-18T10:20:31.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cd602640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28c81582d0 0x7f28c80ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48504/0 (socket says 172.21.15.133:48504) 2023-12-18T10:20:31.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cd602640 1 -- 172.21.15.133:0/4072217088 learned_addr learned my addr 172.21.15.133:0/4072217088 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cde03640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80ceac0 0x7f28c80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425034764 0 0) 0x7f28c80c9390 con 0x7f28c81582d0 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b4003530 con 0x7f28c81582d0 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833575738 0 0) 0x7f28c815aee0 con 0x7f28c8070820 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c80c9390 con 0x7f28c8070820 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939000383 0 0) 0x7f28b4003530 con 0x7f28c81582d0 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80ceac0 msgr2=0x7f28c80c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80ceac0 0x7f28c80c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 >> v1:172.21.15.142:6789/0 conn(0x7f28c8070820 legacy=0x7f28c80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c815b4a0 con 0x7f28c81582d0 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f28c4001680 con 0x7f28c81582d0 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 >> v1:172.21.15.133:6789/0 conn(0x7f28c81582d0 legacy=0x7f28c80ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28b4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28b40047d0 0x7f28b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80ceac0 0x7f28b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c815b1c0 con 0x7f28b4003b40 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b400ba40 con 0x7f28b40047d0 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b400bc00 con 0x7f28c80ceac0 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cd602640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28b4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cde03640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80ceac0 0x7f28b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cce01640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28b40047d0 0x7f28b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cd602640 1 -- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80ceac0 msgr2=0x7f28b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cd602640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80ceac0 0x7f28b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cd602640 1 -- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28b40047d0 msgr2=0x7f28b4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cd602640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28b40047d0 0x7f28b4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.644+0000 7f28cd602640 1 -- 172.21.15.133:0/4072217088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4003530 con 0x7f28b4003b40 2023-12-18T10:20:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28cd602640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28b4003f40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f28c4001ec0 tx=0x7f28c401cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61b7caa74c0b4e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40058e0 con 0x7f28b4003b40 2023-12-18T10:20:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4005a60 con 0x7f28b4003b40 2023-12-18T10:20:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28bffff640 1 -- 172.21.15.133:0/4072217088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4005e10 con 0x7f28b4003b40 2023-12-18T10:20:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28cf866640 1 -- 172.21.15.133:0/4072217088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 msgr2=0x7f28b4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28cf866640 1 --2- 172.21.15.133:0/4072217088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28b4003f40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f28c4001ec0 tx=0x7f28c401cb50 comp rx=0 tx=0).stop 2023-12-18T10:20:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28cde03640 1 -- 172.21.15.133:0/4072217088 reap_dead start 2023-12-18T10:20:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28cf866640 1 -- 172.21.15.133:0/4072217088 shutdown_connections 2023-12-18T10:20:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28cf866640 1 -- 172.21.15.133:0/4072217088 >> 172.21.15.133:0/4072217088 conn(0x7f28c806a2a0 msgr2=0x7f28c80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28cf866640 1 -- 172.21.15.133:0/4072217088 shutdown_connections 2023-12-18T10:20:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.648+0000 7f28cf866640 1 -- 172.21.15.133:0/4072217088 wait complete. 2023-12-18T10:20:31.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 Processor -- start 2023-12-18T10:20:31.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 -- start start 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28c815d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80c6630 0x7f28c8151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80aee50 0x7f28c80af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80af810 con 0x7f28b4003b40 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c815e6a0 con 0x7f28c80aee50 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c815eb30 con 0x7f28c80c6630 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28c815d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28c815d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48844/0 (socket says 172.21.15.133:48844) 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 -- 172.21.15.133:0/3204647221 learned_addr learned my addr 172.21.15.133:0/3204647221 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cde03640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80aee50 0x7f28c80af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cce01640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80c6630 0x7f28c8151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 -- 172.21.15.133:0/3204647221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80c6630 msgr2=0x7f28c8151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80c6630 0x7f28c8151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 -- 172.21.15.133:0/3204647221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80aee50 msgr2=0x7f28c80af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80aee50 0x7f28c80af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 -- 172.21.15.133:0/3204647221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c815da90 con 0x7f28b4003b40 2023-12-18T10:20:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cd602640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28c815d380 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f28c4007040 tx=0x7f28b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28bdffb640 1 -- 172.21.15.133:0/3204647221 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40047f0 con 0x7f28b4003b40 2023-12-18T10:20:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28bdffb640 1 -- 172.21.15.133:0/3204647221 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4004950 con 0x7f28b4003b40 2023-12-18T10:20:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28bdffb640 1 -- 172.21.15.133:0/3204647221 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4004cc0 con 0x7f28b4003b40 2023-12-18T10:20:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c815dd70 con 0x7f28b4003b40 2023-12-18T10:20:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.652+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c815e330 con 0x7f28b4003b40 2023-12-18T10:20:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.656+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c804e000 con 0x7f28b4003b40 2023-12-18T10:20:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.656+0000 7f28bdffb640 1 -- 172.21.15.133:0/3204647221 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f28c40070d0 con 0x7f28b4003b40 2023-12-18T10:20:31.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.656+0000 7f28bdffb640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f28ac065a90 0x7f28ac067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.656+0000 7f28bdffb640 1 -- 172.21.15.133:0/3204647221 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f28c411c5a0 con 0x7f28b4003b40 2023-12-18T10:20:31.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.656+0000 7f28cce01640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f28ac065a90 0x7f28ac067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.656+0000 7f28cce01640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f28ac065a90 0x7f28ac067f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f28c8159f80 tx=0x7f28b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.660+0000 7f28bdffb640 1 -- 172.21.15.133:0/3204647221 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f28c40e9d60 con 0x7f28b4003b40 2023-12-18T10:20:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.808+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28c80b0c00 con 0x7f28b4003b40 2023-12-18T10:20:31.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.808+0000 7f28bdffb640 1 -- 172.21.15.133:0/3204647221 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28c40ed380 con 0x7f28b4003b40 2023-12-18T10:20:31.813 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f28ac065a90 msgr2=0x7f28ac067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f28ac065a90 0x7f28ac067f50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f28c8159f80 tx=0x7f28b8009040 comp rx=0 tx=0).stop 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 msgr2=0x7f28c815d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28c815d380 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f28c4007040 tx=0x7f28b4005800 comp rx=0 tx=0).stop 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 shutdown_connections 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f28ac065a90 0x7f28ac067f50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28c80aee50 0x7f28c80af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28c80c6630 0x7f28c8151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 --2- 172.21.15.133:0/3204647221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b40 0x7f28c815d380 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 >> 172.21.15.133:0/3204647221 conn(0x7f28c806a2a0 msgr2=0x7f28c8154360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 shutdown_connections 2023-12-18T10:20:31.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.812+0000 7f28cf866640 1 -- 172.21.15.133:0/3204647221 wait complete. 2023-12-18T10:20:31.835 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:31.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b762d640 1 Processor -- start 2023-12-18T10:20:31.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b762d640 1 -- start start 2023-12-18T10:20:31.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b762d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f12b015b070 0x7f12b015e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b762d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b015ef60 con 0x7f12b00cd670 2023-12-18T10:20:31.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b762d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b015f240 con 0x7f12b015ac90 2023-12-18T10:20:31.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b762d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b015f520 con 0x7f12b015b070 2023-12-18T10:20:31.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b5bca640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f12b00cd670 0x7f12b00ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48520/0 (socket says 172.21.15.133:48520) 2023-12-18T10:20:31.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b5bca640 1 -- 172.21.15.133:0/3629866422 learned_addr learned my addr 172.21.15.133:0/3629866422 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:31.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b4bc8640 1 --2- 172.21.15.133:0/3629866422 >> v2:172.21.15.142:3300/0 conn(0x7f12b015b070 0x7f12b015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12a7fff640 1 -- 172.21.15.133:0/3629866422 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466782661 0 0) 0x7f12b015ef60 con 0x7f12b00cd670 2023-12-18T10:20:31.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12a7fff640 1 -- 172.21.15.133:0/3629866422 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f129c003530 con 0x7f12b00cd670 2023-12-18T10:20:31.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12a7fff640 1 -- 172.21.15.133:0/3629866422 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692399705 0 0) 0x7f12b015f240 con 0x7f12b015ac90 2023-12-18T10:20:31.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12a7fff640 1 -- 172.21.15.133:0/3629866422 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12b015ef60 con 0x7f12b015ac90 2023-12-18T10:20:31.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b4bc8640 1 -- 172.21.15.133:0/3629866422 >> v1:172.21.15.142:6789/0 conn(0x7f12b015ac90 legacy=0x7f12b00ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b4bc8640 1 -- 172.21.15.133:0/3629866422 >> v1:172.21.15.133:6789/0 conn(0x7f12b00cd670 legacy=0x7f12b00ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12a7fff640 1 -- 172.21.15.133:0/3629866422 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2726121737 0 0) 0x7f129c003530 con 0x7f12b00cd670 2023-12-18T10:20:31.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.968+0000 7f12b4bc8640 1 -- 172.21.15.133:0/3629866422 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b015f800 con 0x7f12b015b070 2023-12-18T10:20:31.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12b4bc8640 1 --2- 172.21.15.133:0/3629866422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 0x7f12b015e980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f12a00097c0 tx=0x7f12a001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f905a68a5fded51b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12a7fff640 1 -- 172.21.15.133:0/3629866422 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8001a00 con 0x7f12b015b070 2023-12-18T10:20:31.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12a7fff640 1 -- 172.21.15.133:0/3629866422 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a00ac440 con 0x7f12b015b070 2023-12-18T10:20:31.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12a7fff640 1 -- 172.21.15.133:0/3629866422 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a00ac7b0 con 0x7f12b015b070 2023-12-18T10:20:31.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12b762d640 1 -- 172.21.15.133:0/3629866422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 msgr2=0x7f12b015e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12b762d640 1 --2- 172.21.15.133:0/3629866422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 0x7f12b015e980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f12a00097c0 tx=0x7f12a001c370 comp rx=0 tx=0).stop 2023-12-18T10:20:31.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12b762d640 1 -- 172.21.15.133:0/3629866422 shutdown_connections 2023-12-18T10:20:31.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12b762d640 1 --2- 172.21.15.133:0/3629866422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 0x7f12b015e980 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.972+0000 7f12b762d640 1 -- 172.21.15.133:0/3629866422 >> 172.21.15.133:0/3629866422 conn(0x7f12b0069ca0 msgr2=0x7f12b006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:31.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 -- 172.21.15.133:0/3629866422 shutdown_connections 2023-12-18T10:20:31.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 -- 172.21.15.133:0/3629866422 wait complete. 2023-12-18T10:20:31.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 Processor -- start 2023-12-18T10:20:31.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 -- start start 2023-12-18T10:20:31.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12b00cd670 0x7f12b0157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b015ac90 0x7f12b015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 0x7f12b00b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015d1b0 con 0x7f12b015ac90 2023-12-18T10:20:31.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015c9b0 con 0x7f12b015b070 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b762d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b015b910 con 0x7f12b00cd670 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b015ac90 0x7f12b015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b015ac90 0x7f12b015dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48858/0 (socket says 172.21.15.133:48858) 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 -- 172.21.15.133:0/2262216146 learned_addr learned my addr 172.21.15.133:0/2262216146 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b5bca640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 0x7f12b00b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b53c9640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12b00cd670 0x7f12b0157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 -- 172.21.15.133:0/2262216146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12b00cd670 msgr2=0x7f12b0157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12b00cd670 0x7f12b0157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 -- 172.21.15.133:0/2262216146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 msgr2=0x7f12b00b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 0x7f12b00b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:31.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 -- 172.21.15.133:0/2262216146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a0009420 con 0x7f12b015ac90 2023-12-18T10:20:31.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.976+0000 7f12b4bc8640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b015ac90 0x7f12b015dd10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f12a0000c10 tx=0x7f12a0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12a5ffb640 1 -- 172.21.15.133:0/2262216146 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a00bb070 con 0x7f12b015ac90 2023-12-18T10:20:31.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12a5ffb640 1 -- 172.21.15.133:0/2262216146 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a00b5400 con 0x7f12b015ac90 2023-12-18T10:20:31.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12a5ffb640 1 -- 172.21.15.133:0/2262216146 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a00acea0 con 0x7f12b015ac90 2023-12-18T10:20:31.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b015bbf0 con 0x7f12b015ac90 2023-12-18T10:20:31.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b015c1b0 con 0x7f12b015ac90 2023-12-18T10:20:31.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b004e000 con 0x7f12b015ac90 2023-12-18T10:20:31.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12a5ffb640 1 -- 172.21.15.133:0/2262216146 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f12a00b3040 con 0x7f12b015ac90 2023-12-18T10:20:31.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12a5ffb640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1294065a90 0x7f1294067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:31.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12a5ffb640 1 -- 172.21.15.133:0/2262216146 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f12a011c980 con 0x7f12b015ac90 2023-12-18T10:20:31.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.980+0000 7f12b53c9640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1294065a90 0x7f1294067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:31.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.984+0000 7f12b53c9640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1294065a90 0x7f1294067f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0011f0 tx=0x7f12ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:31.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:31.984+0000 7f12a5ffb640 1 -- 172.21.15.133:0/2262216146 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f12a00ea1d0 con 0x7f12b015ac90 2023-12-18T10:20:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12b006aae0 con 0x7f12b015ac90 2023-12-18T10:20:32.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12a5ffb640 1 -- 172.21.15.133:0/2262216146 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4749 (secure 0 0 0) 0x7f12a00ed7f0 con 0x7f12b015ac90 2023-12-18T10:20:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:32.172 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:58.187712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5508,"mds_1":5499,"mds_2":5054},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5054":{"gid":5054,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5499":{"gid":5499,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:20:32.172 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 25 2023-12-18T10:20:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1294065a90 msgr2=0x7f1294067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1294065a90 0x7f1294067f50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0011f0 tx=0x7f12ac009040 comp rx=0 tx=0).stop 2023-12-18T10:20:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b015ac90 msgr2=0x7f12b015dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b015ac90 0x7f12b015dd10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f12a0000c10 tx=0x7f12a0019110 comp rx=0 tx=0).stop 2023-12-18T10:20:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 shutdown_connections 2023-12-18T10:20:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1294065a90 0x7f1294067f50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12b015b070 0x7f12b00b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12b015ac90 0x7f12b015dd10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.168+0000 7f12b762d640 1 --2- 172.21.15.133:0/2262216146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f12b00cd670 0x7f12b0157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.172+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 >> 172.21.15.133:0/2262216146 conn(0x7f12b0069ca0 msgr2=0x7f12b0158290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.172+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 shutdown_connections 2023-12-18T10:20:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.172+0000 7f12b762d640 1 -- 172.21.15.133:0/2262216146 wait complete. 2023-12-18T10:20:32.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:20:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.328+0000 7f53ca9ce640 1 Processor -- start 2023-12-18T10:20:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.328+0000 7f53ca9ce640 1 -- start start 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.328+0000 7f53ca9ce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53c4158c20 0x7f53c4070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53ca9ce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f53c415c800 0x7f53c40caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53ca9ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53ca9ce640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c40cb440 con 0x7f53c4158c20 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53ca9ce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c4070b80 con 0x7f53c415c800 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53ca9ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c4070e60 con 0x7f53c40cafb0 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53c4158c20 0x7f53c4070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53c4158c20 0x7f53c4070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48872/0 (socket says 172.21.15.133:48872) 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 -- 172.21.15.133:0/2539008608 learned_addr learned my addr 172.21.15.133:0/2539008608 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c37fe640 1 --2- 172.21.15.133:0/2539008608 >> v2:172.21.15.142:3300/0 conn(0x7f53c415c800 0x7f53c40caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c8f6b640 1 --2- 172.21.15.133:0/2539008608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 -- 172.21.15.133:0/2539008608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 msgr2=0x7f53c406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 --2- 172.21.15.133:0/2539008608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 -- 172.21.15.133:0/2539008608 >> v2:172.21.15.142:3300/0 conn(0x7f53c415c800 msgr2=0x7f53c40caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 --2- 172.21.15.133:0/2539008608 >> v2:172.21.15.142:3300/0 conn(0x7f53c415c800 0x7f53c40caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 -- 172.21.15.133:0/2539008608 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c4071140 con 0x7f53c4158c20 2023-12-18T10:20:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c8f6b640 1 --2- 172.21.15.133:0/2539008608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:32.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c3fff640 1 --2- 172.21.15.133:0/2539008608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c4158c20 0x7f53c4070510 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f53c40cbc00 tx=0x7f53b401e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8052b6336c5da0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c2ffd640 1 -- 172.21.15.133:0/2539008608 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40ab660 con 0x7f53c4158c20 2023-12-18T10:20:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c2ffd640 1 -- 172.21.15.133:0/2539008608 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40ab7c0 con 0x7f53c4158c20 2023-12-18T10:20:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.332+0000 7f53c2ffd640 1 -- 172.21.15.133:0/2539008608 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40abb50 con 0x7f53c4158c20 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- 172.21.15.133:0/2539008608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c4158c20 msgr2=0x7f53c4070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/2539008608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c4158c20 0x7f53c4070510 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f53c40cbc00 tx=0x7f53b401e650 comp rx=0 tx=0).stop 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- 172.21.15.133:0/2539008608 shutdown_connections 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/2539008608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/2539008608 >> v2:172.21.15.142:3300/0 conn(0x7f53c415c800 0x7f53c40caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/2539008608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c4158c20 0x7f53c4070510 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- 172.21.15.133:0/2539008608 >> 172.21.15.133:0/2539008608 conn(0x7f53c406a3e0 msgr2=0x7f53c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- 172.21.15.133:0/2539008608 shutdown_connections 2023-12-18T10:20:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- 172.21.15.133:0/2539008608 wait complete. 2023-12-18T10:20:32.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 Processor -- start 2023-12-18T10:20:32.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- start start 2023-12-18T10:20:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c40c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53c4158c20 0x7f53c414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c415c800 0x7f53c40c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c414e6b0 con 0x7f53c415c800 2023-12-18T10:20:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c414eb70 con 0x7f53c4158c20 2023-12-18T10:20:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53ca9ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40c30b0 con 0x7f53c40cafb0 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.336+0000 7f53c8f6b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c415c800 0x7f53c40c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c40c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c8f6b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c415c800 0x7f53c40c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48880/0 (socket says 172.21.15.133:48880) 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c8f6b640 1 -- 172.21.15.133:0/1653929385 learned_addr learned my addr 172.21.15.133:0/1653929385 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c37fe640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53c4158c20 0x7f53c414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c8f6b640 1 -- 172.21.15.133:0/1653929385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 msgr2=0x7f53c40c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c8f6b640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c40c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c8f6b640 1 -- 172.21.15.133:0/1653929385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53c4158c20 msgr2=0x7f53c414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c8f6b640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53c4158c20 0x7f53c414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c8f6b640 1 -- 172.21.15.133:0/1653929385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b40094d0 con 0x7f53c415c800 2023-12-18T10:20:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c8f6b640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c415c800 0x7f53c40c5e40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00cef0 tx=0x7f53bc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c0ff9640 1 -- 172.21.15.133:0/1653929385 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00d840 con 0x7f53c415c800 2023-12-18T10:20:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c0ff9640 1 -- 172.21.15.133:0/1653929385 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00d9c0 con 0x7f53c415c800 2023-12-18T10:20:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c40c8800 con 0x7f53c415c800 2023-12-18T10:20:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c0ff9640 1 -- 172.21.15.133:0/1653929385 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00dd70 con 0x7f53c415c800 2023-12-18T10:20:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c40c3630 con 0x7f53c415c800 2023-12-18T10:20:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c40735b0 con 0x7f53c415c800 2023-12-18T10:20:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c0ff9640 1 -- 172.21.15.133:0/1653929385 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f53bc01e3b0 con 0x7f53c415c800 2023-12-18T10:20:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c0ff9640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53b0065a60 0x7f53b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.340+0000 7f53c0ff9640 1 -- 172.21.15.133:0/1653929385 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f53bc083cc0 con 0x7f53c415c800 2023-12-18T10:20:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.344+0000 7f53c3fff640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53b0065a60 0x7f53b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.344+0000 7f53c3fff640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53b0065a60 0x7f53b0067f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b0000 tx=0x7f53b40b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:32.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.344+0000 7f53c0ff9640 1 -- 172.21.15.133:0/1653929385 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f53bc051690 con 0x7f53c415c800 2023-12-18T10:20:32.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.500+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53c404e000 con 0x7f53c415c800 2023-12-18T10:20:32.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.500+0000 7f53c0ff9640 1 -- 172.21.15.133:0/1653929385 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16403 (secure 0 0 0) 0x7f53bc01a090 con 0x7f53c415c800 2023-12-18T10:20:32.504 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:32.504 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":41,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:19:47.948169+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:19:28.252118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-18T10:19:29.371748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:20:32.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53b0065a60 msgr2=0x7f53b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53b0065a60 0x7f53b0067f20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b0000 tx=0x7f53b40b5040 comp rx=0 tx=0).stop 2023-12-18T10:20:32.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c415c800 msgr2=0x7f53c40c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c415c800 0x7f53c40c5e40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00cef0 tx=0x7f53bc00a710 comp rx=0 tx=0).stop 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 shutdown_connections 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f53b0065a60 0x7f53b0067f20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53c415c800 0x7f53c40c5e40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f53c4158c20 0x7f53c414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 --2- 172.21.15.133:0/1653929385 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f53c40cafb0 0x7f53c40c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 >> 172.21.15.133:0/1653929385 conn(0x7f53c406a3e0 msgr2=0x7f53c40c9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 shutdown_connections 2023-12-18T10:20:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.504+0000 7f53ca9ce640 1 -- 172.21.15.133:0/1653929385 wait complete. 2023-12-18T10:20:32.526 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-18T10:20:32.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:32.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff715118640 1 Processor -- start 2023-12-18T10:20:32.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff715118640 1 -- start start 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff715118640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff71006c4f0 0x7ff7100c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff715118640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7100c9e30 0x7ff7100ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff715118640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7100c9460 con 0x7ff7101570c0 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff715118640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7101574a0 con 0x7ff71006c4f0 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff715118640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7100c8b30 con 0x7ff7100c9e30 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff71006c4f0 0x7ff7100c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70ed9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff7101570c0 0x7ff71006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48536/0 (socket says 172.21.15.133:48536) 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70ed9d640 1 -- 172.21.15.133:0/2020166004 learned_addr learned my addr 172.21.15.133:0/2020166004 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70f59e640 1 --2- 172.21.15.133:0/2020166004 >> v2:172.21.15.142:3300/0 conn(0x7ff7100c9e30 0x7ff7100ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70e59c640 1 -- 172.21.15.133:0/2020166004 >> v2:172.21.15.142:3300/0 conn(0x7ff7100c9e30 msgr2=0x7ff7100ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70e59c640 1 --2- 172.21.15.133:0/2020166004 >> v2:172.21.15.142:3300/0 conn(0x7ff7100c9e30 0x7ff7100ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70e59c640 1 -- 172.21.15.133:0/2020166004 >> v1:172.21.15.133:6789/0 conn(0x7ff7101570c0 legacy=0x7ff71006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70dd9b640 1 -- 172.21.15.133:0/2020166004 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610784042 0 0) 0x7ff7100c9460 con 0x7ff7101570c0 2023-12-18T10:20:32.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.660+0000 7ff70e59c640 1 -- 172.21.15.133:0/2020166004 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7100c8e10 con 0x7ff71006c4f0 2023-12-18T10:20:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff70e59c640 1 --2- 172.21.15.133:0/2020166004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71006c4f0 0x7ff7100c98f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff71006fb70 tx=0x7ff70401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab05ce70e8543c48 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff70dd9b640 1 -- 172.21.15.133:0/2020166004 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7040ad660 con 0x7ff71006c4f0 2023-12-18T10:20:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff70dd9b640 1 -- 172.21.15.133:0/2020166004 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7040ad7c0 con 0x7ff71006c4f0 2023-12-18T10:20:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff70dd9b640 1 -- 172.21.15.133:0/2020166004 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7040adb50 con 0x7ff71006c4f0 2023-12-18T10:20:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff715118640 1 -- 172.21.15.133:0/2020166004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71006c4f0 msgr2=0x7ff7100c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff715118640 1 --2- 172.21.15.133:0/2020166004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71006c4f0 0x7ff7100c98f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff71006fb70 tx=0x7ff70401c3a0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff715118640 1 -- 172.21.15.133:0/2020166004 shutdown_connections 2023-12-18T10:20:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff715118640 1 --2- 172.21.15.133:0/2020166004 >> v2:172.21.15.142:3300/0 conn(0x7ff7100c9e30 0x7ff7100ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff715118640 1 --2- 172.21.15.133:0/2020166004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71006c4f0 0x7ff7100c98f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff715118640 1 -- 172.21.15.133:0/2020166004 >> 172.21.15.133:0/2020166004 conn(0x7ff71006a3e0 msgr2=0x7ff7100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff715118640 1 -- 172.21.15.133:0/2020166004 shutdown_connections 2023-12-18T10:20:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.664+0000 7ff715118640 1 -- 172.21.15.133:0/2020166004 wait complete. 2023-12-18T10:20:32.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 Processor -- start 2023-12-18T10:20:32.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 -- start start 2023-12-18T10:20:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71006c4f0 0x7ff7101f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7100c9e30 0x7ff7100c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7101570c0 0x7ff7100c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100c8050 con 0x7ff7101570c0 2023-12-18T10:20:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101f4cd0 con 0x7ff7100c9e30 2023-12-18T10:20:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7100c7d70 con 0x7ff71006c4f0 2023-12-18T10:20:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7101570c0 0x7ff7100c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7101570c0 0x7ff7100c2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48896/0 (socket says 172.21.15.133:48896) 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 -- 172.21.15.133:0/3830723348 learned_addr learned my addr 172.21.15.133:0/3830723348 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 -- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71006c4f0 msgr2=0x7ff7101f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70ed9d640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71006c4f0 0x7ff7101f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70e59c640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7100c9e30 0x7ff7100c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71006c4f0 0x7ff7101f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 -- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7100c9e30 msgr2=0x7ff7100c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7100c9e30 0x7ff7100c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 -- 172.21.15.133:0/3830723348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff704009420 con 0x7ff7101570c0 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70e59c640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7100c9e30 0x7ff7100c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70ed9d640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71006c4f0 0x7ff7101f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff70f59e640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7101570c0 0x7ff7100c2ee0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff708009dd0 tx=0x7ff70800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff6f77fe640 1 -- 172.21.15.133:0/3830723348 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708014480 con 0x7ff7101570c0 2023-12-18T10:20:32.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff6f77fe640 1 -- 172.21.15.133:0/3830723348 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70800f040 con 0x7ff7101570c0 2023-12-18T10:20:32.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff6f77fe640 1 -- 172.21.15.133:0/3830723348 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708014840 con 0x7ff7101570c0 2023-12-18T10:20:32.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71015ae00 con 0x7ff7101570c0 2023-12-18T10:20:32.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.668+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71015b3c0 con 0x7ff7101570c0 2023-12-18T10:20:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.672+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7100735b0 con 0x7ff7101570c0 2023-12-18T10:20:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.672+0000 7ff6f77fe640 1 -- 172.21.15.133:0/3830723348 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff7080149a0 con 0x7ff7101570c0 2023-12-18T10:20:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.672+0000 7ff6f77fe640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6fc065a30 0x7ff6fc067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.672+0000 7ff6f77fe640 1 -- 172.21.15.133:0/3830723348 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff708083f50 con 0x7ff7101570c0 2023-12-18T10:20:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.672+0000 7ff70ed9d640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6fc065a30 0x7ff6fc067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.672+0000 7ff70ed9d640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6fc065a30 0x7ff6fc067ef0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff700007fd0 tx=0x7ff700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:32.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.676+0000 7ff6f77fe640 1 -- 172.21.15.133:0/3830723348 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff708051710 con 0x7ff7101570c0 2023-12-18T10:20:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.856+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff71015ac60 con 0x7ff7101570c0 2023-12-18T10:20:32.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff6f77fe640 1 -- 172.21.15.133:0/3830723348 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4749 (secure 0 0 0) 0x7ff71015ac60 con 0x7ff7101570c0 2023-12-18T10:20:32.863 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:32.863 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:58.187712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5508,"mds_1":5499,"mds_2":5054},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5054":{"gid":5054,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5499":{"gid":5499,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:20:32.865 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 25 2023-12-18T10:20:32.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6fc065a30 msgr2=0x7ff6fc067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6fc065a30 0x7ff6fc067ef0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff700007fd0 tx=0x7ff700009040 comp rx=0 tx=0).stop 2023-12-18T10:20:32.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7101570c0 msgr2=0x7ff7100c2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7101570c0 0x7ff7100c2ee0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff708009dd0 tx=0x7ff70800c490 comp rx=0 tx=0).stop 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 shutdown_connections 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6fc065a30 0x7ff6fc067ef0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7101570c0 0x7ff7100c2ee0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7100c9e30 0x7ff7100c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 --2- 172.21.15.133:0/3830723348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff71006c4f0 0x7ff7101f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 >> 172.21.15.133:0/3830723348 conn(0x7ff71006a3e0 msgr2=0x7ff71014f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 shutdown_connections 2023-12-18T10:20:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:32.860+0000 7ff715118640 1 -- 172.21.15.133:0/3830723348 wait complete. 2023-12-18T10:20:32.884 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:33.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.016+0000 7f985f939640 1 Processor -- start 2023-12-18T10:20:33.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985f939640 1 -- start start 2023-12-18T10:20:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985f939640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98581570c0 0x7f985806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985f939640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f98580ca000 0x7f9858070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985f939640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580c9460 con 0x7f985806c320 2023-12-18T10:20:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985f939640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985806c7a0 con 0x7f98580ca000 2023-12-18T10:20:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985f939640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98581574a0 con 0x7f98581570c0 2023-12-18T10:20:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985d6d5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98581570c0 0x7f985806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985ded6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f98580ca000 0x7f9858070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985d6d5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98581570c0 0x7f985806bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:55476/0 (socket says 172.21.15.133:55476) 2023-12-18T10:20:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985d6d5640 1 -- 172.21.15.133:0/2002119761 learned_addr learned my addr 172.21.15.133:0/2002119761 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985ded6640 1 -- 172.21.15.133:0/2002119761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98581570c0 msgr2=0x7f985806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:33.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985ded6640 1 --2- 172.21.15.133:0/2002119761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98581570c0 0x7f985806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985ded6640 1 -- 172.21.15.133:0/2002119761 >> v1:172.21.15.142:6789/0 conn(0x7f985806c320 legacy=0x7f98580c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.020+0000 7f985ded6640 1 -- 172.21.15.133:0/2002119761 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580c8b30 con 0x7f98580ca000 2023-12-18T10:20:33.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985ded6640 1 --2- 172.21.15.133:0/2002119761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 0x7f9858070df0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f985001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa3575268e694c69 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f984ffff640 1 -- 172.21.15.133:0/2002119761 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98500a5950 con 0x7f98580ca000 2023-12-18T10:20:33.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f984ffff640 1 -- 172.21.15.133:0/2002119761 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98500a5ab0 con 0x7f98580ca000 2023-12-18T10:20:33.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f984ffff640 1 -- 172.21.15.133:0/2002119761 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98500a5e40 con 0x7f98580ca000 2023-12-18T10:20:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 -- 172.21.15.133:0/2002119761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 msgr2=0x7f9858070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 --2- 172.21.15.133:0/2002119761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 0x7f9858070df0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9850009d90 tx=0x7f985001c890 comp rx=0 tx=0).stop 2023-12-18T10:20:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 -- 172.21.15.133:0/2002119761 shutdown_connections 2023-12-18T10:20:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 --2- 172.21.15.133:0/2002119761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 0x7f9858070df0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 --2- 172.21.15.133:0/2002119761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98581570c0 0x7f985806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 -- 172.21.15.133:0/2002119761 >> 172.21.15.133:0/2002119761 conn(0x7f985806a3e0 msgr2=0x7f98580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 -- 172.21.15.133:0/2002119761 shutdown_connections 2023-12-18T10:20:33.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 -- 172.21.15.133:0/2002119761 wait complete. 2023-12-18T10:20:33.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 Processor -- start 2023-12-18T10:20:33.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.024+0000 7f985f939640 1 -- start start 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985806c320 0x7f98580c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 0x7f98580c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98581570c0 0x7f98580c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9858154270 con 0x7f98581570c0 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9858154550 con 0x7f98580ca000 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9858154830 con 0x7f985806c320 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985ded6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98581570c0 0x7f98580c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985806c320 0x7f98580c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985806c320 0x7f98580c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:55488/0 (socket says 172.21.15.133:55488) 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 -- 172.21.15.133:0/3376353855 learned_addr learned my addr 172.21.15.133:0/3376353855 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985ded6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98581570c0 0x7f98580c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48902/0 (socket says 172.21.15.133:48902) 2023-12-18T10:20:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985ced4640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 0x7f98580c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 -- 172.21.15.133:0/3376353855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 msgr2=0x7f98580c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 0x7f98580c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 -- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98581570c0 msgr2=0x7f98580c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98581570c0 0x7f98580c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 -- 172.21.15.133:0/3376353855 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850009a70 con 0x7f985806c320 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985ded6640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98581570c0 0x7f98580c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985d6d5640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985806c320 0x7f98580c3770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f985400e890 tx=0x7f985400ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f984dffb640 1 -- 172.21.15.133:0/3376353855 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854009620 con 0x7f985806c320 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f984dffb640 1 -- 172.21.15.133:0/3376353855 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400c940 con 0x7f985806c320 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f984dffb640 1 -- 172.21.15.133:0/3376353855 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400ccf0 con 0x7f985806c320 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9858154b10 con 0x7f985806c320 2023-12-18T10:20:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98580c3cb0 con 0x7f985806c320 2023-12-18T10:20:33.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.028+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98580735b0 con 0x7f985806c320 2023-12-18T10:20:33.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.032+0000 7f984dffb640 1 -- 172.21.15.133:0/3376353855 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9854013470 con 0x7f985806c320 2023-12-18T10:20:33.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.032+0000 7f984dffb640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f983c065a90 0x7f983c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.032+0000 7f984dffb640 1 -- 172.21.15.133:0/3376353855 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9854083870 con 0x7f985806c320 2023-12-18T10:20:33.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.032+0000 7f985ced4640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f983c065a90 0x7f983c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.032+0000 7f985ced4640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f983c065a90 0x7f983c067f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9848007fd0 tx=0x7f9848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.036+0000 7f984dffb640 1 -- 172.21.15.133:0/3376353855 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9854051060 con 0x7f985806c320 2023-12-18T10:20:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.220+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f985804e000 con 0x7f985806c320 2023-12-18T10:20:33.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.220+0000 7f984dffb640 1 -- 172.21.15.133:0/3376353855 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4749 (secure 0 0 0) 0x7f9854054680 con 0x7f985806c320 2023-12-18T10:20:33.225 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:33.226 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:19:30.380308+0000","modified":"2023-12-18T10:19:58.187712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5508,"mds_1":5499,"mds_2":5054},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5054":{"gid":5054,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/898789604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":898789604},{"type":"v1","addr":"172.21.15.142:6834","nonce":898789604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5499":{"gid":5499,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/3060654272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3060654272},{"type":"v1","addr":"172.21.15.133:6836","nonce":3060654272}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5508":{"gid":5508,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/979808628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":979808628},{"type":"v1","addr":"172.21.15.142:6835","nonce":979808628}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-18T10:20:33.226 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 25 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f983c065a90 msgr2=0x7f983c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f983c065a90 0x7f983c067f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9848007fd0 tx=0x7f9848009040 comp rx=0 tx=0).stop 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985806c320 msgr2=0x7f98580c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985806c320 0x7f98580c3770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f985400e890 tx=0x7f985400ed50 comp rx=0 tx=0).stop 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 shutdown_connections 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f983c065a90 0x7f983c067f50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98581570c0 0x7f98580c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98580ca000 0x7f98580c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 --2- 172.21.15.133:0/3376353855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f985806c320 0x7f98580c3770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 >> 172.21.15.133:0/3376353855 conn(0x7f985806a3e0 msgr2=0x7f98580c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 shutdown_connections 2023-12-18T10:20:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.224+0000 7f985f939640 1 -- 172.21.15.133:0/3376353855 wait complete. 2023-12-18T10:20:33.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:20:33.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4fa1d7b640 1 Processor -- start 2023-12-18T10:20:33.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4fa1d7b640 1 -- start start 2023-12-18T10:20:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4fa1d7b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f9c069ca0 0x7f4f9c06a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4fa1d7b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c0ccde0 con 0x7f4f9c15caf0 2023-12-18T10:20:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4fa1d7b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c06a5c0 con 0x7f4f9c0cdc20 2023-12-18T10:20:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4fa1d7b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c0cc600 con 0x7f4f9c069ca0 2023-12-18T10:20:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4f9b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f9c069ca0 0x7f4f9c06a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4f9affd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4f9c15caf0 0x7f4f9c0cbef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48544/0 (socket says 172.21.15.133:48544) 2023-12-18T10:20:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4f9affd640 1 -- 172.21.15.133:0/2935769057 learned_addr learned my addr 172.21.15.133:0/2935769057 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4f9b7fe640 1 -- 172.21.15.133:0/2935769057 >> v1:172.21.15.142:6789/0 conn(0x7f4f9c0cdc20 legacy=0x7f4f9c0717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4f9b7fe640 1 -- 172.21.15.133:0/2935769057 >> v1:172.21.15.133:6789/0 conn(0x7f4f9c15caf0 legacy=0x7f4f9c0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4f9b7fe640 1 -- 172.21.15.133:0/2935769057 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c0cc820 con 0x7f4f9c069ca0 2023-12-18T10:20:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.380+0000 7f4f9a7fc640 1 -- 172.21.15.133:0/2935769057 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639416526 0 0) 0x7f4f9c0ccde0 con 0x7f4f9c15caf0 2023-12-18T10:20:33.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4f9b7fe640 1 --2- 172.21.15.133:0/2935769057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c069ca0 0x7f4f9c06a080 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0097c0 tx=0x7f4f8c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dde79541a72931 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4f9a7fc640 1 -- 172.21.15.133:0/2935769057 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0ab650 con 0x7f4f9c069ca0 2023-12-18T10:20:33.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4f9a7fc640 1 -- 172.21.15.133:0/2935769057 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c0ab7b0 con 0x7f4f9c069ca0 2023-12-18T10:20:33.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4f9a7fc640 1 -- 172.21.15.133:0/2935769057 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0abb40 con 0x7f4f9c069ca0 2023-12-18T10:20:33.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/2935769057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c069ca0 msgr2=0x7f4f9c06a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4fa1d7b640 1 --2- 172.21.15.133:0/2935769057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c069ca0 0x7f4f9c06a080 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0097c0 tx=0x7f4f8c01c450 comp rx=0 tx=0).stop 2023-12-18T10:20:33.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/2935769057 shutdown_connections 2023-12-18T10:20:33.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4fa1d7b640 1 --2- 172.21.15.133:0/2935769057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c069ca0 0x7f4f9c06a080 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/2935769057 >> 172.21.15.133:0/2935769057 conn(0x7f4f9c06cf80 msgr2=0x7f4f9c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:33.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/2935769057 shutdown_connections 2023-12-18T10:20:33.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.384+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/2935769057 wait complete. 2023-12-18T10:20:33.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 Processor -- start 2023-12-18T10:20:33.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 -- start start 2023-12-18T10:20:33.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f9c069ca0 0x7f4f9c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f9c0cdc20 0x7f4f9c158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c15caf0 0x7f4f9c0c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c153fc0 con 0x7f4f9c15caf0 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c0ae050 con 0x7f4f9c069ca0 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c0ae330 con 0x7f4f9c0cdc20 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c15caf0 0x7f4f9c0c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c15caf0 0x7f4f9c0c3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48908/0 (socket says 172.21.15.133:48908) 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 -- 172.21.15.133:0/1869629417 learned_addr learned my addr 172.21.15.133:0/1869629417 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9b7fe640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f9c069ca0 0x7f4f9c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9affd640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f9c0cdc20 0x7f4f9c158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 -- 172.21.15.133:0/1869629417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f9c0cdc20 msgr2=0x7f4f9c158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f9c0cdc20 0x7f4f9c158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 -- 172.21.15.133:0/1869629417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f9c069ca0 msgr2=0x7f4f9c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f9c069ca0 0x7f4f9c153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 -- 172.21.15.133:0/1869629417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c009420 con 0x7f4f9c15caf0 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f9bfff640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c15caf0 0x7f4f9c0c3050 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400c770 tx=0x7f4f9400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f83fff640 1 -- 172.21.15.133:0/1869629417 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94003b80 con 0x7f4f9c15caf0 2023-12-18T10:20:33.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f83fff640 1 -- 172.21.15.133:0/1869629417 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94003ce0 con 0x7f4f9c15caf0 2023-12-18T10:20:33.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4f83fff640 1 -- 172.21.15.133:0/1869629417 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400aa90 con 0x7f4f9c15caf0 2023-12-18T10:20:33.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c0ae610 con 0x7f4f9c15caf0 2023-12-18T10:20:33.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.388+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c156070 con 0x7f4f9c15caf0 2023-12-18T10:20:33.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.392+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c04e000 con 0x7f4f9c15caf0 2023-12-18T10:20:33.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.392+0000 7f4f83fff640 1 -- 172.21.15.133:0/1869629417 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4f9400abf0 con 0x7f4f9c15caf0 2023-12-18T10:20:33.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.392+0000 7f4f83fff640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4f88065a60 0x7f4f88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.392+0000 7f4f83fff640 1 -- 172.21.15.133:0/1869629417 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f94082f40 con 0x7f4f9c15caf0 2023-12-18T10:20:33.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.392+0000 7f4f9b7fe640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4f88065a60 0x7f4f88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.392+0000 7f4f9b7fe640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4f88065a60 0x7f4f88067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0af000 tx=0x7f4f8c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.396+0000 7f4f83fff640 1 -- 172.21.15.133:0/1869629417 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4f940508e0 con 0x7f4f9c15caf0 2023-12-18T10:20:33.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.548+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f9c0b10e0 con 0x7f4f9c15caf0 2023-12-18T10:20:33.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.548+0000 7f4f83fff640 1 -- 172.21.15.133:0/1869629417 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16403 (secure 0 0 0) 0x7f4f94053f00 con 0x7f4f9c15caf0 2023-12-18T10:20:33.554 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:33.554 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":41,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:19:47.948169+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:19:28.252118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-18T10:19:29.371748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:20:33.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4f88065a60 msgr2=0x7f4f88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4f88065a60 0x7f4f88067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0af000 tx=0x7f4f8c0a7000 comp rx=0 tx=0).stop 2023-12-18T10:20:33.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c15caf0 msgr2=0x7f4f9c0c3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c15caf0 0x7f4f9c0c3050 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400c770 tx=0x7f4f9400cc30 comp rx=0 tx=0).stop 2023-12-18T10:20:33.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 shutdown_connections 2023-12-18T10:20:33.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4f88065a60 0x7f4f88067f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f9c15caf0 0x7f4f9c0c3050 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f9c0cdc20 0x7f4f9c158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 --2- 172.21.15.133:0/1869629417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f9c069ca0 0x7f4f9c153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 >> 172.21.15.133:0/1869629417 conn(0x7f4f9c06cf80 msgr2=0x7f4f9c15fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:33.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 shutdown_connections 2023-12-18T10:20:33.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.552+0000 7f4fa1d7b640 1 -- 172.21.15.133:0/1869629417 wait complete. 2023-12-18T10:20:33.575 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-18T10:20:33.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.708+0000 7fa41f1bc640 1 Processor -- start 2023-12-18T10:20:33.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.708+0000 7fa41f1bc640 1 -- start start 2023-12-18T10:20:33.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.708+0000 7fa41f1bc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa41806c4f0 0x7fa4180c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa41f1bc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4180c9460 con 0x7fa4180c9e30 2023-12-18T10:20:33.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa41f1bc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4181574a0 con 0x7fa4181570c0 2023-12-18T10:20:33.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa41f1bc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4180c8b30 con 0x7fa41806c4f0 2023-12-18T10:20:33.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa417fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa41806c4f0 0x7fa4180c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa41d759640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa4180c9e30 0x7fa418070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48556/0 (socket says 172.21.15.133:48556) 2023-12-18T10:20:33.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa41d759640 1 -- 172.21.15.133:0/2328700874 learned_addr learned my addr 172.21.15.133:0/2328700874 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:33.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa417fff640 1 -- 172.21.15.133:0/2328700874 >> v1:172.21.15.142:6789/0 conn(0x7fa4181570c0 legacy=0x7fa41806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa417fff640 1 -- 172.21.15.133:0/2328700874 >> v1:172.21.15.133:6789/0 conn(0x7fa4180c9e30 legacy=0x7fa418070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa417fff640 1 -- 172.21.15.133:0/2328700874 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4180c8e10 con 0x7fa41806c4f0 2023-12-18T10:20:33.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa417fff640 1 --2- 172.21.15.133:0/2328700874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41806c4f0 0x7fa4180c98f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa4040097c0 tx=0x7fa40401e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfee57a471dcc58 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa4177fe640 1 -- 172.21.15.133:0/2328700874 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040a8660 con 0x7fa41806c4f0 2023-12-18T10:20:33.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa4177fe640 1 -- 172.21.15.133:0/2328700874 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4040a87c0 con 0x7fa41806c4f0 2023-12-18T10:20:33.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.712+0000 7fa4177fe640 1 -- 172.21.15.133:0/2328700874 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040a8b50 con 0x7fa41806c4f0 2023-12-18T10:20:33.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- 172.21.15.133:0/2328700874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41806c4f0 msgr2=0x7fa4180c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 --2- 172.21.15.133:0/2328700874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41806c4f0 0x7fa4180c98f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa4040097c0 tx=0x7fa40401e690 comp rx=0 tx=0).stop 2023-12-18T10:20:33.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- 172.21.15.133:0/2328700874 shutdown_connections 2023-12-18T10:20:33.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 --2- 172.21.15.133:0/2328700874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa41806c4f0 0x7fa4180c98f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- 172.21.15.133:0/2328700874 >> 172.21.15.133:0/2328700874 conn(0x7fa41806a3e0 msgr2=0x7fa4180afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:33.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- 172.21.15.133:0/2328700874 shutdown_connections 2023-12-18T10:20:33.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- 172.21.15.133:0/2328700874 wait complete. 2023-12-18T10:20:33.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 Processor -- start 2023-12-18T10:20:33.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- start start 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41806c4f0 0x7fa418149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4180c9e30 0x7fa4181595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4181570c0 0x7fa418159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41814cad0 con 0x7fa4180c9e30 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4180c1fc0 con 0x7fa4181570c0 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa41f1bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41815a1b0 con 0x7fa41806c4f0 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa417fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4180c9e30 0x7fa4181595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa417fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4180c9e30 0x7fa4181595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48936/0 (socket says 172.21.15.133:48936) 2023-12-18T10:20:33.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.716+0000 7fa417fff640 1 -- 172.21.15.133:0/3470657774 learned_addr learned my addr 172.21.15.133:0/3470657774 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa41d759640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4181570c0 0x7fa418159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa41cf58640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41806c4f0 0x7fa418149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa417fff640 1 -- 172.21.15.133:0/3470657774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41806c4f0 msgr2=0x7fa418149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa417fff640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41806c4f0 0x7fa418149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa417fff640 1 -- 172.21.15.133:0/3470657774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4181570c0 msgr2=0x7fa418159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa417fff640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4181570c0 0x7fa418159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa417fff640 1 -- 172.21.15.133:0/3470657774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009420 con 0x7fa4180c9e30 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa417fff640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4180c9e30 0x7fa4181595d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa40401b2a0 tx=0x7fa40401ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa4157fa640 1 -- 172.21.15.133:0/3470657774 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040a99d0 con 0x7fa4180c9e30 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa4157fa640 1 -- 172.21.15.133:0/3470657774 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4040a9b50 con 0x7fa4180c9e30 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa4157fa640 1 -- 172.21.15.133:0/3470657774 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040ba420 con 0x7fa4180c9e30 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4180c2260 con 0x7fa4180c9e30 2023-12-18T10:20:33.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41815a490 con 0x7fa4180c9e30 2023-12-18T10:20:33.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4180735b0 con 0x7fa4180c9e30 2023-12-18T10:20:33.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa4157fa640 1 -- 172.21.15.133:0/3470657774 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa4040ba580 con 0x7fa4180c9e30 2023-12-18T10:20:33.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa4157fa640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa3fc065a60 0x7fa3fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:33.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa4157fa640 1 -- 172.21.15.133:0/3470657774 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa4041202b0 con 0x7fa4180c9e30 2023-12-18T10:20:33.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.720+0000 7fa41cf58640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa3fc065a60 0x7fa3fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:33.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.724+0000 7fa41cf58640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa3fc065a60 0x7fa3fc067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa40c000f70 tx=0x7fa40c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:33.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.724+0000 7fa4157fa640 1 -- 172.21.15.133:0/3470657774 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa4040edb10 con 0x7fa4180c9e30 2023-12-18T10:20:33.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.908+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa41804e000 con 0x7fa4180c9e30 2023-12-18T10:20:33.912 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:20:33.908+0000 7f3ba99e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-18T10:20:33.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.916+0000 7fa4157fa640 1 -- 172.21.15.133:0/3470657774 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa4040f1130 con 0x7fa4180c9e30 2023-12-18T10:20:33.920 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa3fc065a60 msgr2=0x7fa3fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa3fc065a60 0x7fa3fc067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa40c000f70 tx=0x7fa40c009040 comp rx=0 tx=0).stop 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4180c9e30 msgr2=0x7fa4181595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4180c9e30 0x7fa4181595d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa40401b2a0 tx=0x7fa40401ced0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 shutdown_connections 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa3fc065a60 0x7fa3fc067f20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4181570c0 0x7fa418159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4180c9e30 0x7fa4181595d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 --2- 172.21.15.133:0/3470657774 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa41806c4f0 0x7fa418149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 >> 172.21.15.133:0/3470657774 conn(0x7fa41806a3e0 msgr2=0x7fa41814a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:33.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 shutdown_connections 2023-12-18T10:20:33.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:33.920+0000 7fa41f1bc640 1 -- 172.21.15.133:0/3470657774 wait complete. 2023-12-18T10:20:33.943 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-18T10:20:33.980 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:20:33.981 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:20:33.993 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:20:34.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.084+0000 7f34232e5640 1 Processor -- start 2023-12-18T10:20:34.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.084+0000 7f34232e5640 1 -- start start 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f34232e5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f341c1582d0 0x7f341c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f34232e5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f341c0ce3b0 0x7f341c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f34232e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341c0c9390 con 0x7f341c070820 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f34232e5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c0ced60 con 0x7f341c1582d0 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f34232e5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c15aee0 con 0x7f341c0ce3b0 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421081640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f341c1582d0 0x7f341c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421081640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f341c1582d0 0x7f341c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48956/0 (socket says 172.21.15.133:48956) 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421081640 1 -- 172.21.15.133:0/2527693846 learned_addr learned my addr 172.21.15.133:0/2527693846 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:34.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421882640 1 --2- 172.21.15.133:0/2527693846 >> v2:172.21.15.142:3300/0 conn(0x7f341c0ce3b0 0x7f341c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:34.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421081640 1 -- 172.21.15.133:0/2527693846 >> v2:172.21.15.142:3300/0 conn(0x7f341c0ce3b0 msgr2=0x7f341c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:34.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421081640 1 --2- 172.21.15.133:0/2527693846 >> v2:172.21.15.142:3300/0 conn(0x7f341c0ce3b0 0x7f341c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421081640 1 -- 172.21.15.133:0/2527693846 >> v1:172.21.15.142:6789/0 conn(0x7f341c070820 legacy=0x7f341c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:34.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421081640 1 -- 172.21.15.133:0/2527693846 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c15b1c0 con 0x7f341c1582d0 2023-12-18T10:20:34.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.088+0000 7f3421081640 1 --2- 172.21.15.133:0/2527693846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c0c8e50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f341c06fbb0 tx=0x7f341801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cbd8287c8dd8e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:34.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3413fff640 1 -- 172.21.15.133:0/2527693846 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180aa430 con 0x7f341c1582d0 2023-12-18T10:20:34.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3413fff640 1 -- 172.21.15.133:0/2527693846 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34180aa590 con 0x7f341c1582d0 2023-12-18T10:20:34.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3413fff640 1 -- 172.21.15.133:0/2527693846 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180aa920 con 0x7f341c1582d0 2023-12-18T10:20:34.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- 172.21.15.133:0/2527693846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 msgr2=0x7f341c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:34.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 --2- 172.21.15.133:0/2527693846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c0c8e50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f341c06fbb0 tx=0x7f341801c4d0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- 172.21.15.133:0/2527693846 shutdown_connections 2023-12-18T10:20:34.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 --2- 172.21.15.133:0/2527693846 >> v2:172.21.15.142:3300/0 conn(0x7f341c0ce3b0 0x7f341c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 --2- 172.21.15.133:0/2527693846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c0c8e50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- 172.21.15.133:0/2527693846 >> 172.21.15.133:0/2527693846 conn(0x7f341c06a2a0 msgr2=0x7f341c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:34.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- 172.21.15.133:0/2527693846 shutdown_connections 2023-12-18T10:20:34.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- 172.21.15.133:0/2527693846 wait complete. 2023-12-18T10:20:34.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 Processor -- start 2023-12-18T10:20:34.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- start start 2023-12-18T10:20:34.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f341c070820 0x7f341c14a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f341c0ce3b0 0x7f341c1f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c15d0c0 con 0x7f341c1582d0 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c15dee0 con 0x7f341c070820 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f34232e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c15d2d0 con 0x7f341c0ce3b0 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3421882640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3421081640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f341c070820 0x7f341c14a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3421081640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f341c070820 0x7f341c14a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:34154/0 (socket says 172.21.15.133:34154) 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3421882640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c1f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48964/0 (socket says 172.21.15.133:48964) 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3421081640 1 -- 172.21.15.133:0/2971260025 learned_addr learned my addr 172.21.15.133:0/2971260025 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.092+0000 7f3420880640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f341c0ce3b0 0x7f341c1f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:34.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3421081640 1 -- 172.21.15.133:0/2971260025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f341c0ce3b0 msgr2=0x7f341c1f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:34.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3421081640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f341c0ce3b0 0x7f341c1f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3421081640 1 -- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 msgr2=0x7f341c1f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:34.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3421081640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c1f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3421081640 1 -- 172.21.15.133:0/2971260025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180094d0 con 0x7f341c070820 2023-12-18T10:20:34.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3421882640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:34.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3421081640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f341c070820 0x7f341c14a800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f34180190e0 tx=0x7f341801ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:34.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3411ffb640 1 -- 172.21.15.133:0/2971260025 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180aa430 con 0x7f341c070820 2023-12-18T10:20:34.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3411ffb640 1 -- 172.21.15.133:0/2971260025 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34180b3820 con 0x7f341c070820 2023-12-18T10:20:34.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3411ffb640 1 -- 172.21.15.133:0/2971260025 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180b3bd0 con 0x7f341c070820 2023-12-18T10:20:34.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c15d5b0 con 0x7f341c070820 2023-12-18T10:20:34.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c15db70 con 0x7f341c070820 2023-12-18T10:20:34.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c04e000 con 0x7f341c070820 2023-12-18T10:20:34.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.096+0000 7f3411ffb640 1 -- 172.21.15.133:0/2971260025 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34180b3d30 con 0x7f341c070820 2023-12-18T10:20:34.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.100+0000 7f3411ffb640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3400065a60 0x7f3400067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:34.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.100+0000 7f3411ffb640 1 -- 172.21.15.133:0/2971260025 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f341811dbb0 con 0x7f341c070820 2023-12-18T10:20:34.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.100+0000 7f3420880640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3400065a60 0x7f3400067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:34.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.100+0000 7f3420880640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3400065a60 0x7f3400067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f341c0b41e0 tx=0x7f340c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:34.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.100+0000 7f3411ffb640 1 -- 172.21.15.133:0/2971260025 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f34180eb460 con 0x7f341c070820 2023-12-18T10:20:34.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.284+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f341c0b0c00 con 0x7f341c070820 2023-12-18T10:20:34.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.920+0000 7f3411ffb640 1 -- 172.21.15.133:0/2971260025 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f34180eea80 con 0x7f341c070820 2023-12-18T10:20:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3400065a60 msgr2=0x7f3400067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3400065a60 0x7f3400067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f341c0b41e0 tx=0x7f340c009040 comp rx=0 tx=0).stop 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f341c070820 msgr2=0x7f341c14a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f341c070820 0x7f341c14a800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f34180190e0 tx=0x7f341801ad10 comp rx=0 tx=0).stop 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 shutdown_connections 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3400065a60 0x7f3400067f20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341c1582d0 0x7f341c1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f341c0ce3b0 0x7f341c1f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 --2- 172.21.15.133:0/2971260025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f341c070820 0x7f341c14a800 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 >> 172.21.15.133:0/2971260025 conn(0x7f341c06a2a0 msgr2=0x7f341c15e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 shutdown_connections 2023-12-18T10:20:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:34.924+0000 7f34232e5640 1 -- 172.21.15.133:0/2971260025 wait complete. 2023-12-18T10:20:34.949 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-18T10:20:35.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3f596640 1 Processor -- start 2023-12-18T10:20:35.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3f596640 1 -- start start 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3f596640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d3806be20 0x7f7d380c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3f596640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d380c18b0 0x7f7d380cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3f596640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d380c1cb0 con 0x7f7d38160e90 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3f596640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380b20a0 con 0x7f7d380c18b0 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3f596640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380b2380 con 0x7f7d3806be20 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3d332640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7d38160e90 0x7f7d38165130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48574/0 (socket says 172.21.15.133:48574) 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3d332640 1 -- 172.21.15.133:0/3136751294 learned_addr learned my addr 172.21.15.133:0/3136751294 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3db33640 1 --2- 172.21.15.133:0/3136751294 >> v2:172.21.15.133:3300/0 conn(0x7f7d380c18b0 0x7f7d380cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:35.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3cb31640 1 --2- 172.21.15.133:0/3136751294 >> v2:172.21.15.142:3300/0 conn(0x7f7d3806be20 0x7f7d380c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:35.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3db33640 1 -- 172.21.15.133:0/3136751294 >> v2:172.21.15.142:3300/0 conn(0x7f7d3806be20 msgr2=0x7f7d380c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:35.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3db33640 1 --2- 172.21.15.133:0/3136751294 >> v2:172.21.15.142:3300/0 conn(0x7f7d3806be20 0x7f7d380c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3db33640 1 -- 172.21.15.133:0/3136751294 >> v1:172.21.15.133:6789/0 conn(0x7f7d38160e90 legacy=0x7f7d38165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:35.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3db33640 1 -- 172.21.15.133:0/3136751294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d380cc5b0 con 0x7f7d380c18b0 2023-12-18T10:20:35.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d2ffff640 1 -- 172.21.15.133:0/3136751294 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496101549 0 0) 0x7f7d380c1cb0 con 0x7f7d38160e90 2023-12-18T10:20:35.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.128+0000 7f7d3cb31640 1 --2- 172.21.15.133:0/3136751294 >> v2:172.21.15.142:3300/0 conn(0x7f7d3806be20 0x7f7d380c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:35.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3db33640 1 --2- 172.21.15.133:0/3136751294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d380cd090 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7d380b3470 tx=0x7f7d3001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2d58fecfa903e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:35.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d2ffff640 1 -- 172.21.15.133:0/3136751294 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300a58c0 con 0x7f7d380c18b0 2023-12-18T10:20:35.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d2ffff640 1 -- 172.21.15.133:0/3136751294 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d300a5a20 con 0x7f7d380c18b0 2023-12-18T10:20:35.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d2ffff640 1 -- 172.21.15.133:0/3136751294 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300a5db0 con 0x7f7d380c18b0 2023-12-18T10:20:35.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3f596640 1 -- 172.21.15.133:0/3136751294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 msgr2=0x7f7d380cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:35.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3f596640 1 --2- 172.21.15.133:0/3136751294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d380cd090 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7d380b3470 tx=0x7f7d3001c910 comp rx=0 tx=0).stop 2023-12-18T10:20:35.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3f596640 1 -- 172.21.15.133:0/3136751294 shutdown_connections 2023-12-18T10:20:35.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3f596640 1 --2- 172.21.15.133:0/3136751294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d380cd090 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3f596640 1 --2- 172.21.15.133:0/3136751294 >> v2:172.21.15.142:3300/0 conn(0x7f7d3806be20 0x7f7d380c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3f596640 1 -- 172.21.15.133:0/3136751294 >> 172.21.15.133:0/3136751294 conn(0x7f7d38069e70 msgr2=0x7f7d3806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:35.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3f596640 1 -- 172.21.15.133:0/3136751294 shutdown_connections 2023-12-18T10:20:35.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.132+0000 7f7d3f596640 1 -- 172.21.15.133:0/3136751294 wait complete. 2023-12-18T10:20:35.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 Processor -- start 2023-12-18T10:20:35.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 -- start start 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3806be20 0x7f7d3815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d3815e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d38160e90 0x7f7d38153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38160350 con 0x7f7d380c18b0 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38160a70 con 0x7f7d3806be20 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38160790 con 0x7f7d38160e90 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d3815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d3815e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48978/0 (socket says 172.21.15.133:48978) 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 -- 172.21.15.133:0/477510308 learned_addr learned my addr 172.21.15.133:0/477510308 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:35.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3d332640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3806be20 0x7f7d3815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3db33640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d38160e90 0x7f7d38153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 -- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d38160e90 msgr2=0x7f7d38153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d38160e90 0x7f7d38153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 -- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3806be20 msgr2=0x7f7d3815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3806be20 0x7f7d3815e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 -- 172.21.15.133:0/477510308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30009a70 con 0x7f7d380c18b0 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3d332640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3806be20 0x7f7d3815e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3db33640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d38160e90 0x7f7d38153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3cb31640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d3815e600 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c7f0 tx=0x7f7d2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d2dffb640 1 -- 172.21.15.133:0/477510308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28007820 con 0x7f7d380c18b0 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d2dffb640 1 -- 172.21.15.133:0/477510308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d28007980 con 0x7f7d380c18b0 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d2dffb640 1 -- 172.21.15.133:0/477510308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28007d30 con 0x7f7d380c18b0 2023-12-18T10:20:35.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.136+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d38160070 con 0x7f7d380c18b0 2023-12-18T10:20:35.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.140+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d38070fb0 con 0x7f7d380c18b0 2023-12-18T10:20:35.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.140+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d380c1e80 con 0x7f7d380c18b0 2023-12-18T10:20:35.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.140+0000 7f7d2dffb640 1 -- 172.21.15.133:0/477510308 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d280113f0 con 0x7f7d380c18b0 2023-12-18T10:20:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.140+0000 7f7d2dffb640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d1c065a60 0x7f7d1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.140+0000 7f7d2dffb640 1 -- 172.21.15.133:0/477510308 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f7d280837a0 con 0x7f7d380c18b0 2023-12-18T10:20:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.140+0000 7f7d3d332640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d1c065a60 0x7f7d1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:35.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.140+0000 7f7d3d332640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d1c065a60 0x7f7d1c067f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d34000f70 tx=0x7f7d34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:35.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.144+0000 7f7d2dffb640 1 -- 172.21.15.133:0/477510308 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d380c1e80 con 0x7f7d380c18b0 2023-12-18T10:20:35.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.296+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7d380c1e80 con 0x7f7d380c18b0 2023-12-18T10:20:35.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.956+0000 7f7d2dffb640 1 -- 172.21.15.133:0/477510308 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7d380c1e80 con 0x7f7d380c18b0 2023-12-18T10:20:35.960 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-18T10:20:35.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d1c065a60 msgr2=0x7f7d1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:35.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d1c065a60 0x7f7d1c067f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d34000f70 tx=0x7f7d34009040 comp rx=0 tx=0).stop 2023-12-18T10:20:35.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 msgr2=0x7f7d3815e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d3815e600 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c7f0 tx=0x7f7d2800ccb0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 shutdown_connections 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d1c065a60 0x7f7d1c067f20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d38160e90 0x7f7d38153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380c18b0 0x7f7d3815e600 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 --2- 172.21.15.133:0/477510308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3806be20 0x7f7d3815e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 >> 172.21.15.133:0/477510308 conn(0x7f7d38069e70 msgr2=0x7f7d38165130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 shutdown_connections 2023-12-18T10:20:35.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:35.960+0000 7f7d3f596640 1 -- 172.21.15.133:0/477510308 wait complete. 2023-12-18T10:20:35.997 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-18T10:20:36.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.136+0000 7f16d9eb6640 1 Processor -- start 2023-12-18T10:20:36.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.136+0000 7f16d9eb6640 1 -- start start 2023-12-18T10:20:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d9eb6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16d40ce5d0 0x7f16d40ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d9eb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d8a0 0x7f16d415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d9eb6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d40b28a0 con 0x7f16d406d440 2023-12-18T10:20:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d9eb6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d40ac1a0 con 0x7f16d40ce5d0 2023-12-18T10:20:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d9eb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40ceef0 con 0x7f16d406d8a0 2023-12-18T10:20:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d2ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f16d406d440 0x7f16d415e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48586/0 (socket says 172.21.15.133:48586) 2023-12-18T10:20:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d2ffd640 1 -- 172.21.15.133:0/2913175861 learned_addr learned my addr 172.21.15.133:0/2913175861 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d37fe640 1 --2- 172.21.15.133:0/2913175861 >> v2:172.21.15.142:3300/0 conn(0x7f16d40ce5d0 0x7f16d40ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d3fff640 1 --2- 172.21.15.133:0/2913175861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d8a0 0x7f16d415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d27fc640 1 -- 172.21.15.133:0/2913175861 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077061088 0 0) 0x7f16d40b28a0 con 0x7f16d406d440 2023-12-18T10:20:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d27fc640 1 -- 172.21.15.133:0/2913175861 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16bc003530 con 0x7f16d406d440 2023-12-18T10:20:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d3fff640 1 -- 172.21.15.133:0/2913175861 >> v2:172.21.15.142:3300/0 conn(0x7f16d40ce5d0 msgr2=0x7f16d40ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d3fff640 1 --2- 172.21.15.133:0/2913175861 >> v2:172.21.15.142:3300/0 conn(0x7f16d40ce5d0 0x7f16d40ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d3fff640 1 -- 172.21.15.133:0/2913175861 >> v1:172.21.15.133:6789/0 conn(0x7f16d406d440 legacy=0x7f16d415e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d3fff640 1 -- 172.21.15.133:0/2913175861 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d415ab30 con 0x7f16d406d8a0 2023-12-18T10:20:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.140+0000 7f16d37fe640 1 --2- 172.21.15.133:0/2913175861 >> v2:172.21.15.142:3300/0 conn(0x7f16d40ce5d0 0x7f16d40ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:36.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d3fff640 1 --2- 172.21.15.133:0/2913175861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d8a0 0x7f16d415e9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009d90 tx=0x7f16cc01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef0f3b3b65ba590d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:36.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d27fc640 1 -- 172.21.15.133:0/2913175861 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0a5900 con 0x7f16d406d8a0 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d27fc640 1 -- 172.21.15.133:0/2913175861 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc0a5a60 con 0x7f16d406d8a0 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d27fc640 1 -- 172.21.15.133:0/2913175861 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0a5dd0 con 0x7f16d406d8a0 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 -- 172.21.15.133:0/2913175861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d8a0 msgr2=0x7f16d415e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/2913175861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d8a0 0x7f16d415e9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009d90 tx=0x7f16cc01c950 comp rx=0 tx=0).stop 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 -- 172.21.15.133:0/2913175861 shutdown_connections 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/2913175861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d8a0 0x7f16d415e9e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/2913175861 >> v2:172.21.15.142:3300/0 conn(0x7f16d40ce5d0 0x7f16d40ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 -- 172.21.15.133:0/2913175861 >> 172.21.15.133:0/2913175861 conn(0x7f16d4069e70 msgr2=0x7f16d406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 -- 172.21.15.133:0/2913175861 shutdown_connections 2023-12-18T10:20:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 -- 172.21.15.133:0/2913175861 wait complete. 2023-12-18T10:20:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 Processor -- start 2023-12-18T10:20:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.144+0000 7f16d9eb6640 1 -- start start 2023-12-18T10:20:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d440 0x7f16d415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16d406d8a0 0x7f16d40b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16d40ce5d0 0x7f16d40aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4164220 con 0x7f16d406d8a0 2023-12-18T10:20:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4164da0 con 0x7f16d40ce5d0 2023-12-18T10:20:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4164470 con 0x7f16d406d440 2023-12-18T10:20:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16d406d8a0 0x7f16d40b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16d406d8a0 0x7f16d40b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48990/0 (socket says 172.21.15.133:48990) 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 -- 172.21.15.133:0/1562548837 learned_addr learned my addr 172.21.15.133:0/1562548837 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d3fff640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16d40ce5d0 0x7f16d40aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d37fe640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d440 0x7f16d415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 -- 172.21.15.133:0/1562548837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d440 msgr2=0x7f16d415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d440 0x7f16d415a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 -- 172.21.15.133:0/1562548837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16d40ce5d0 msgr2=0x7f16d40aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16d40ce5d0 0x7f16d40aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 -- 172.21.15.133:0/1562548837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4009420 con 0x7f16d406d8a0 2023-12-18T10:20:36.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d2ffd640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16d406d8a0 0x7f16d40b0d30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f16c800c3c0 tx=0x7f16c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16bbfff640 1 -- 172.21.15.133:0/1562548837 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8005cf0 con 0x7f16d406d8a0 2023-12-18T10:20:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16bbfff640 1 -- 172.21.15.133:0/1562548837 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c8005e50 con 0x7f16d406d8a0 2023-12-18T10:20:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc009a70 con 0x7f16d406d8a0 2023-12-18T10:20:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16bbfff640 1 -- 172.21.15.133:0/1562548837 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c80072f0 con 0x7f16d406d8a0 2023-12-18T10:20:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d4164a30 con 0x7f16d406d8a0 2023-12-18T10:20:36.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d4164f10 con 0x7f16d406d8a0 2023-12-18T10:20:36.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.148+0000 7f16bbfff640 1 -- 172.21.15.133:0/1562548837 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f16c8007450 con 0x7f16d406d8a0 2023-12-18T10:20:36.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.152+0000 7f16bbfff640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16c0065a60 0x7f16c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:36.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.152+0000 7f16bbfff640 1 -- 172.21.15.133:0/1562548837 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f16c8082810 con 0x7f16d406d8a0 2023-12-18T10:20:36.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.152+0000 7f16d37fe640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16c0065a60 0x7f16c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:36.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.152+0000 7f16d37fe640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16c0065a60 0x7f16c0067f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009c50 tx=0x7f16c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:36.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.156+0000 7f16bbfff640 1 -- 172.21.15.133:0/1562548837 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f16c8050130 con 0x7f16d406d8a0 2023-12-18T10:20:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.308+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f16d4165210 con 0x7f16d406d8a0 2023-12-18T10:20:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.964+0000 7f16bbfff640 1 -- 172.21.15.133:0/1562548837 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f16c8017020 con 0x7f16d406d8a0 2023-12-18T10:20:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-18T10:20:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16c0065a60 msgr2=0x7f16c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16c0065a60 0x7f16c0067f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009c50 tx=0x7f16c4009190 comp rx=0 tx=0).stop 2023-12-18T10:20:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16d406d8a0 msgr2=0x7f16d40b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16d406d8a0 0x7f16d40b0d30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f16c800c3c0 tx=0x7f16c800c880 comp rx=0 tx=0).stop 2023-12-18T10:20:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 shutdown_connections 2023-12-18T10:20:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f16c0065a60 0x7f16c0067f20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f16d40ce5d0 0x7f16d40aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16d406d8a0 0x7f16d40b0d30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 --2- 172.21.15.133:0/1562548837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16d406d440 0x7f16d415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 >> 172.21.15.133:0/1562548837 conn(0x7f16d4069e70 msgr2=0x7f16d4070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 shutdown_connections 2023-12-18T10:20:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:36.968+0000 7f16d9eb6640 1 -- 172.21.15.133:0/1562548837 wait complete. 2023-12-18T10:20:36.996 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-18T10:20:37.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae3dbc640 1 Processor -- start 2023-12-18T10:20:37.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae3dbc640 1 -- start start 2023-12-18T10:20:37.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae3dbc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3adc071870 0x7f3adc071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae3dbc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc070df0 con 0x7f3adc0cbff0 2023-12-18T10:20:37.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae3dbc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc15a4f0 con 0x7f3adc0ca410 2023-12-18T10:20:37.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae3dbc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc15aab0 con 0x7f3adc071870 2023-12-18T10:20:37.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae2359640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3adc0cbff0 0x7f3adc0ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48594/0 (socket says 172.21.15.133:48594) 2023-12-18T10:20:37.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae2359640 1 -- 172.21.15.133:0/1073579908 learned_addr learned my addr 172.21.15.133:0/1073579908 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:37.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.136+0000 7f3ae1357640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3adc071870 0x7f3adc071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae1357640 1 -- 172.21.15.133:0/1073579908 >> v1:172.21.15.142:6789/0 conn(0x7f3adc0ca410 legacy=0x7f3adc159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae1357640 1 -- 172.21.15.133:0/1073579908 >> v1:172.21.15.133:6789/0 conn(0x7f3adc0cbff0 legacy=0x7f3adc0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae1357640 1 -- 172.21.15.133:0/1073579908 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc15a7d0 con 0x7f3adc071870 2023-12-18T10:20:37.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae0b56640 1 -- 172.21.15.133:0/1073579908 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861946720 0 0) 0x7f3adc070df0 con 0x7f3adc0cbff0 2023-12-18T10:20:37.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae1357640 1 --2- 172.21.15.133:0/1073579908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc071d00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0097c0 tx=0x7f3acc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6482e47c08c3f43 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:37.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae0b56640 1 -- 172.21.15.133:0/1073579908 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0ab650 con 0x7f3adc071870 2023-12-18T10:20:37.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae0b56640 1 -- 172.21.15.133:0/1073579908 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc0ab7b0 con 0x7f3adc071870 2023-12-18T10:20:37.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae0b56640 1 -- 172.21.15.133:0/1073579908 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0abb40 con 0x7f3adc071870 2023-12-18T10:20:37.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/1073579908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 msgr2=0x7f3adc071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae3dbc640 1 --2- 172.21.15.133:0/1073579908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc071d00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0097c0 tx=0x7f3acc01c450 comp rx=0 tx=0).stop 2023-12-18T10:20:37.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/1073579908 shutdown_connections 2023-12-18T10:20:37.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae3dbc640 1 --2- 172.21.15.133:0/1073579908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc071d00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/1073579908 >> 172.21.15.133:0/1073579908 conn(0x7f3adc06a2a0 msgr2=0x7f3adc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:37.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.140+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/1073579908 shutdown_connections 2023-12-18T10:20:37.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/1073579908 wait complete. 2023-12-18T10:20:37.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 Processor -- start 2023-12-18T10:20:37.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 -- start start 2023-12-18T10:20:37.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc1426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0ca410 0x7f3adc0c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3adc0cbff0 0x7f3adc0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc143090 con 0x7f3adc071870 2023-12-18T10:20:37.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0c4bc0 con 0x7f3adc0cbff0 2023-12-18T10:20:37.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0c4600 con 0x7f3adc0ca410 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc1426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc1426b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49012/0 (socket says 172.21.15.133:49012) 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 -- 172.21.15.133:0/3716007669 learned_addr learned my addr 172.21.15.133:0/3716007669 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae2359640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3adc0cbff0 0x7f3adc0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1357640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0ca410 0x7f3adc0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 -- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0ca410 msgr2=0x7f3adc0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0ca410 0x7f3adc0c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 -- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3adc0cbff0 msgr2=0x7f3adc0c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3adc0cbff0 0x7f3adc0c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 -- 172.21.15.133:0/3716007669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc009420 con 0x7f3adc071870 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae2359640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3adc0cbff0 0x7f3adc0c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1357640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0ca410 0x7f3adc0c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae1b58640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc1426b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c500 tx=0x7f3ad800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:37.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ad27fc640 1 -- 172.21.15.133:0/3716007669 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8005220 con 0x7f3adc071870 2023-12-18T10:20:37.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ad27fc640 1 -- 172.21.15.133:0/3716007669 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8005380 con 0x7f3adc071870 2023-12-18T10:20:37.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc0cc960 con 0x7f3adc071870 2023-12-18T10:20:37.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.144+0000 7f3ad27fc640 1 -- 172.21.15.133:0/3716007669 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8007270 con 0x7f3adc071870 2023-12-18T10:20:37.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.148+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc0c5690 con 0x7f3adc071870 2023-12-18T10:20:37.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.148+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc0c54d0 con 0x7f3adc071870 2023-12-18T10:20:37.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.148+0000 7f3ad27fc640 1 -- 172.21.15.133:0/3716007669 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ad80073d0 con 0x7f3adc071870 2023-12-18T10:20:37.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.148+0000 7f3ad27fc640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ac0065a60 0x7f3ac0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.148+0000 7f3ad27fc640 1 -- 172.21.15.133:0/3716007669 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f3ad8082a40 con 0x7f3adc071870 2023-12-18T10:20:37.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.148+0000 7f3ae1357640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ac0065a60 0x7f3ac0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.148+0000 7f3ae1357640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ac0065a60 0x7f3ac0067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0af000 tx=0x7f3acc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:37.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.152+0000 7f3ad27fc640 1 -- 172.21.15.133:0/3716007669 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3ad8050480 con 0x7f3adc071870 2023-12-18T10:20:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.300+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3adc04e000 con 0x7f3adc071870 2023-12-18T10:20:37.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ad27fc640 1 -- 172.21.15.133:0/3716007669 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3ad8053aa0 con 0x7f3adc071870 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ac0065a60 msgr2=0x7f3ac0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ac0065a60 0x7f3ac0067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0af000 tx=0x7f3acc0a7000 comp rx=0 tx=0).stop 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 msgr2=0x7f3adc1426b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc1426b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c500 tx=0x7f3ad800c9c0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 shutdown_connections 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ac0065a60 0x7f3ac0067f20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3adc0cbff0 0x7f3adc0c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3adc0ca410 0x7f3adc0c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 --2- 172.21.15.133:0/3716007669 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc071870 0x7f3adc1426b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 >> 172.21.15.133:0/3716007669 conn(0x7f3adc06a2a0 msgr2=0x7f3adc15b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:37.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 shutdown_connections 2023-12-18T10:20:37.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.308+0000 7f3ae3dbc640 1 -- 172.21.15.133:0/3716007669 wait complete. 2023-12-18T10:20:37.331 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2023-12-18T10:20:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.464+0000 7f86c8da6640 1 Processor -- start 2023-12-18T10:20:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.464+0000 7f86c8da6640 1 -- start start 2023-12-18T10:20:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c8da6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c8da6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86c40c9e30 0x7f86c4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c8da6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c40c9460 con 0x7f86c41570c0 2023-12-18T10:20:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c8da6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c41574a0 con 0x7f86c40c9e30 2023-12-18T10:20:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c8da6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c8b30 con 0x7f86c406c4f0 2023-12-18T10:20:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c2d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86c40c9e30 0x7f86c4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86c41570c0 0x7f86c406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48600/0 (socket says 172.21.15.133:48600) 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c259c640 1 -- 172.21.15.133:0/3085349236 learned_addr learned my addr 172.21.15.133:0/3085349236 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86b9d9b640 1 --2- 172.21.15.133:0/3085349236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c2d9d640 1 -- 172.21.15.133:0/3085349236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 msgr2=0x7f86c40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c2d9d640 1 --2- 172.21.15.133:0/3085349236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c2d9d640 1 -- 172.21.15.133:0/3085349236 >> v1:172.21.15.133:6789/0 conn(0x7f86c41570c0 legacy=0x7f86c406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c2d9d640 1 -- 172.21.15.133:0/3085349236 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40c8e10 con 0x7f86c40c9e30 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c1d9b640 1 -- 172.21.15.133:0/3085349236 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725083503 0 0) 0x7f86c40c9460 con 0x7f86c41570c0 2023-12-18T10:20:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86b9d9b640 1 --2- 172.21.15.133:0/3085349236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.468+0000 7f86c2d9d640 1 --2- 172.21.15.133:0/3085349236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c4070df0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009d90 tx=0x7f86bc01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1ec987800a6f7e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c1d9b640 1 -- 172.21.15.133:0/3085349236 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0a5860 con 0x7f86c40c9e30 2023-12-18T10:20:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c1d9b640 1 -- 172.21.15.133:0/3085349236 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0a59c0 con 0x7f86c40c9e30 2023-12-18T10:20:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c1d9b640 1 -- 172.21.15.133:0/3085349236 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0a5d50 con 0x7f86c40c9e30 2023-12-18T10:20:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 -- 172.21.15.133:0/3085349236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 msgr2=0x7f86c4070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3085349236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c4070df0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009d90 tx=0x7f86bc01c890 comp rx=0 tx=0).stop 2023-12-18T10:20:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 -- 172.21.15.133:0/3085349236 shutdown_connections 2023-12-18T10:20:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3085349236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c4070df0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3085349236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 -- 172.21.15.133:0/3085349236 >> 172.21.15.133:0/3085349236 conn(0x7f86c406a3e0 msgr2=0x7f86c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:37.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 -- 172.21.15.133:0/3085349236 shutdown_connections 2023-12-18T10:20:37.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 -- 172.21.15.133:0/3085349236 wait complete. 2023-12-18T10:20:37.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 Processor -- start 2023-12-18T10:20:37.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 -- start start 2023-12-18T10:20:37.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c4153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c41575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.472+0000 7f86c8da6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c41570c0 0x7f86c4147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c8da6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c7060 con 0x7f86c40c9e30 2023-12-18T10:20:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c8da6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c4b80 con 0x7f86c41570c0 2023-12-18T10:20:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c8da6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c40c66c0 con 0x7f86c406c4f0 2023-12-18T10:20:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c41575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c41575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49030/0 (socket says 172.21.15.133:49030) 2023-12-18T10:20:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 -- 172.21.15.133:0/3284701495 learned_addr learned my addr 172.21.15.133:0/3284701495 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c2d9d640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c41570c0 0x7f86c4147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c259c640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c4153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 -- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 msgr2=0x7f86c4153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c4153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 -- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c41570c0 msgr2=0x7f86c4147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c41570c0 0x7f86c4147550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 -- 172.21.15.133:0/3284701495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc009a70 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c2d9d640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c41570c0 0x7f86c4147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86b9d9b640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c41575e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f86b400c7f0 tx=0x7f86b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3284701495 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4007820 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3284701495 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4007980 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c40c69a0 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3284701495 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4007d30 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c4147a90 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c40735b0 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.476+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3284701495 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86b40113f0 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.480+0000 7f86bb7fe640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a60 0x7f86a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.480+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3284701495 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f86b4083400 con 0x7f86c40c9e30 2023-12-18T10:20:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.480+0000 7f86c259c640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a60 0x7f86a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:37.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.480+0000 7f86c259c640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a60 0x7f86a4067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86ac000f70 tx=0x7f86ac007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:37.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.484+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3284701495 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86b4050e30 con 0x7f86c40c9e30 2023-12-18T10:20:37.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.684+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) v1 -- 0x7f86c404e000 con 0x7f86c40c9e30 2023-12-18T10:20:37.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3284701495 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v153) v1 ==== 136+0+0 (secure 0 0 0) 0x7f86b4054450 con 0x7f86c40c9e30 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a60 msgr2=0x7f86a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a60 0x7f86a4067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86ac000f70 tx=0x7f86ac007b80 comp rx=0 tx=0).stop 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 msgr2=0x7f86c41575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c41575e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f86b400c7f0 tx=0x7f86b400ccb0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 shutdown_connections 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a60 0x7f86a4067f20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c41570c0 0x7f86c4147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c41575e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 --2- 172.21.15.133:0/3284701495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c4153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 >> 172.21.15.133:0/3284701495 conn(0x7f86c406a3e0 msgr2=0x7f86c415ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:37.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 shutdown_connections 2023-12-18T10:20:37.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:37.972+0000 7f86c8da6640 1 -- 172.21.15.133:0/3284701495 wait complete. 2023-12-18T10:20:37.997 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-12-18T10:20:37.997 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-12-18T10:20:37.998 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2023-12-18T10:20:38.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb93909640 1 Processor -- start 2023-12-18T10:20:38.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb93909640 1 -- start start 2023-12-18T10:20:38.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb93909640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feb8c15ca40 0x7feb8c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:38.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb93909640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0d11c0 con 0x7feb8c0ce3f0 2023-12-18T10:20:38.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb93909640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0d0310 con 0x7feb8c0cf7e0 2023-12-18T10:20:38.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb93909640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c0d05b0 con 0x7feb8c15ca40 2023-12-18T10:20:38.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb90ea4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feb8c0ce3f0 0x7feb8c0cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48614/0 (socket says 172.21.15.133:48614) 2023-12-18T10:20:38.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb90ea4640 1 -- 172.21.15.133:0/3801173145 learned_addr learned my addr 172.21.15.133:0/3801173145 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb916a5640 1 --2- 172.21.15.133:0/3801173145 >> v2:172.21.15.142:3300/0 conn(0x7feb8c15ca40 0x7feb8c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572001291 0 0) 0x7feb8c0d11c0 con 0x7feb8c0ce3f0 2023-12-18T10:20:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb78003530 con 0x7feb8c0ce3f0 2023-12-18T10:20:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390307127 0 0) 0x7feb8c0d0310 con 0x7feb8c0cf7e0 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb8c0d11c0 con 0x7feb8c0cf7e0 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3942054411 0 0) 0x7feb78003530 con 0x7feb8c0ce3f0 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 >> v2:172.21.15.142:3300/0 conn(0x7feb8c15ca40 msgr2=0x7feb8c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 --2- 172.21.15.133:0/3801173145 >> v2:172.21.15.142:3300/0 conn(0x7feb8c15ca40 0x7feb8c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 >> v1:172.21.15.142:6789/0 conn(0x7feb8c0cf7e0 legacy=0x7feb8c1668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0d0890 con 0x7feb8c0ce3f0 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7feb7c001800 con 0x7feb8c0ce3f0 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 >> v1:172.21.15.133:6789/0 conn(0x7feb8c0ce3f0 legacy=0x7feb8c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb78003b10 0x7feb78003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb78005190 0x7feb7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.132+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0d05b0 con 0x7feb780047d0 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7800c010 con 0x7feb78003b10 2023-12-18T10:20:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7800c1d0 con 0x7feb78005190 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb90ea4640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb916a5640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb78003b10 0x7feb78003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb91ea6640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb78005190 0x7feb7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb90ea4640 1 -- 172.21.15.133:0/3801173145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb78005190 msgr2=0x7feb7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb90ea4640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb78005190 0x7feb7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb90ea4640 1 -- 172.21.15.133:0/3801173145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb78003b10 msgr2=0x7feb78003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb90ea4640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb78003b10 0x7feb78003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb90ea4640 1 -- 172.21.15.133:0/3801173145 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78003530 con 0x7feb780047d0 2023-12-18T10:20:38.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb91ea6640 1 -- 172.21.15.133:0/3801173145 reap_dead start 2023-12-18T10:20:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb90ea4640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb78004c50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00c190 tx=0x7feb7c01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a926b757b505807d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0070d0 con 0x7feb780047d0 2023-12-18T10:20:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c007230 con 0x7feb780047d0 2023-12-18T10:20:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.136+0000 7feb83fff640 1 -- 172.21.15.133:0/3801173145 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c007640 con 0x7feb780047d0 2023-12-18T10:20:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- 172.21.15.133:0/3801173145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 msgr2=0x7feb78004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb78004c50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00c190 tx=0x7feb7c01cba0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- 172.21.15.133:0/3801173145 shutdown_connections 2023-12-18T10:20:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 --2- 172.21.15.133:0/3801173145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb78004c50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- 172.21.15.133:0/3801173145 >> 172.21.15.133:0/3801173145 conn(0x7feb8c089fb0 msgr2=0x7feb8c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- 172.21.15.133:0/3801173145 shutdown_connections 2023-12-18T10:20:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- 172.21.15.133:0/3801173145 wait complete. 2023-12-18T10:20:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 Processor -- start 2023-12-18T10:20:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- start start 2023-12-18T10:20:38.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb8c0b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:38.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb8c0b6d80 0x7feb8c1f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:38.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb8c15a850 0x7feb8c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:38.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0c64d0 con 0x7feb780047d0 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c15b210 con 0x7feb8c15a850 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb93909640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c15eae0 con 0x7feb8c0b6d80 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb916a5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb8c0b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb916a5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb8c0b7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49060/0 (socket says 172.21.15.133:49060) 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb916a5640 1 -- 172.21.15.133:0/1315876894 learned_addr learned my addr 172.21.15.133:0/1315876894 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb91ea6640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb8c15a850 0x7feb8c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb90ea4640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb8c0b6d80 0x7feb8c1f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb916a5640 1 -- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb8c0b6d80 msgr2=0x7feb8c1f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb916a5640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb8c0b6d80 0x7feb8c1f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb916a5640 1 -- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb8c15a850 msgr2=0x7feb8c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb916a5640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb8c15a850 0x7feb8c15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb916a5640 1 -- 172.21.15.133:0/1315876894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c15edc0 con 0x7feb780047d0 2023-12-18T10:20:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.140+0000 7feb91ea6640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb8c15a850 0x7feb8c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb916a5640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb8c0b7e10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7feb88011890 tx=0x7feb88011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb81ffb640 1 -- 172.21.15.133:0/1315876894 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88005bb0 con 0x7feb780047d0 2023-12-18T10:20:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb81ffb640 1 -- 172.21.15.133:0/1315876894 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88005d10 con 0x7feb780047d0 2023-12-18T10:20:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c15f0a0 con 0x7feb780047d0 2023-12-18T10:20:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb81ffb640 1 -- 172.21.15.133:0/1315876894 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800fa60 con 0x7feb780047d0 2023-12-18T10:20:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c15f660 con 0x7feb780047d0 2023-12-18T10:20:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c04e000 con 0x7feb780047d0 2023-12-18T10:20:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb81ffb640 1 -- 172.21.15.133:0/1315876894 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb8800fbc0 con 0x7feb780047d0 2023-12-18T10:20:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb81ffb640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb70065a90 0x7feb70067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb81ffb640 1 -- 172.21.15.133:0/1315876894 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7feb88083650 con 0x7feb780047d0 2023-12-18T10:20:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.144+0000 7feb90ea4640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb70065a90 0x7feb70067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:38.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.148+0000 7feb90ea4640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb70065a90 0x7feb70067f50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0aa000 tx=0x7feb7c0b0040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:38.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.148+0000 7feb81ffb640 1 -- 172.21.15.133:0/1315876894 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feb880511b0 con 0x7feb780047d0 2023-12-18T10:20:38.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.360+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) v1 -- 0x7feb8c0d1650 con 0x7feb780047d0 2023-12-18T10:20:38.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.972+0000 7feb81ffb640 1 -- 172.21.15.133:0/1315876894 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v154) v1 ==== 146+0+0 (secure 0 0 0) 0x7feb880547d0 con 0x7feb780047d0 2023-12-18T10:20:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb70065a90 msgr2=0x7feb70067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb70065a90 0x7feb70067f50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0aa000 tx=0x7feb7c0b0040 comp rx=0 tx=0).stop 2023-12-18T10:20:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 msgr2=0x7feb8c0b7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb8c0b7e10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7feb88011890 tx=0x7feb88011d50 comp rx=0 tx=0).stop 2023-12-18T10:20:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 shutdown_connections 2023-12-18T10:20:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb70065a90 0x7feb70067f50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb8c15a850 0x7feb8c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb8c0b6d80 0x7feb8c1f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 --2- 172.21.15.133:0/1315876894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb780047d0 0x7feb8c0b7e10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:38.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 >> 172.21.15.133:0/1315876894 conn(0x7feb8c089fb0 msgr2=0x7feb8c06af60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:38.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 shutdown_connections 2023-12-18T10:20:38.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:38.976+0000 7feb93909640 1 -- 172.21.15.133:0/1315876894 wait complete. 2023-12-18T10:20:39.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-18T10:20:39.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7ec1c0640 1 Processor -- start 2023-12-18T10:20:39.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7ec1c0640 1 -- start start 2023-12-18T10:20:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7ec1c0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7e4160a60 0x7fd7e40ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7ec1c0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7e40ce8f0 0x7fd7e4164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7ec1c0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e40ced50 con 0x7fd7e4164e60 2023-12-18T10:20:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7ec1c0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40cc980 con 0x7fd7e4160a60 2023-12-18T10:20:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7ec1c0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e40cc090 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7e9f5c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7e4160a60 0x7fd7e40ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7e9f5c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7e4160a60 0x7fd7e40ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49070/0 (socket says 172.21.15.133:49070) 2023-12-18T10:20:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7e9f5c640 1 -- 172.21.15.133:0/516252013 learned_addr learned my addr 172.21.15.133:0/516252013 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:39.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7e9f5c640 1 -- 172.21.15.133:0/516252013 >> v2:172.21.15.142:3300/0 conn(0x7fd7e40ce8f0 msgr2=0x7fd7e4164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:39.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7e9f5c640 1 --2- 172.21.15.133:0/516252013 >> v2:172.21.15.142:3300/0 conn(0x7fd7e40ce8f0 0x7fd7e4164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7e9f5c640 1 -- 172.21.15.133:0/516252013 >> v1:172.21.15.142:6789/0 conn(0x7fd7e4164e60 legacy=0x7fd7e40cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:39.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.144+0000 7fd7e9f5c640 1 -- 172.21.15.133:0/516252013 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e40cc330 con 0x7fd7e4160a60 2023-12-18T10:20:39.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7e9f5c640 1 --2- 172.21.15.133:0/516252013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e4160a60 0x7fd7e40ce3b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd7e406dfa0 tx=0x7fd7e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9de8e81dd615ce server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7e8f5a640 1 -- 172.21.15.133:0/516252013 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00aa610 con 0x7fd7e4160a60 2023-12-18T10:20:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7e8f5a640 1 -- 172.21.15.133:0/516252013 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e00a6040 con 0x7fd7e4160a60 2023-12-18T10:20:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7e8f5a640 1 -- 172.21.15.133:0/516252013 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00aa990 con 0x7fd7e4160a60 2023-12-18T10:20:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/516252013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e4160a60 msgr2=0x7fd7e40ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/516252013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e4160a60 0x7fd7e40ce3b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd7e406dfa0 tx=0x7fd7e001c490 comp rx=0 tx=0).stop 2023-12-18T10:20:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/516252013 shutdown_connections 2023-12-18T10:20:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/516252013 >> v2:172.21.15.142:3300/0 conn(0x7fd7e40ce8f0 0x7fd7e4164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/516252013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e4160a60 0x7fd7e40ce3b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/516252013 >> 172.21.15.133:0/516252013 conn(0x7fd7e406a2a0 msgr2=0x7fd7e40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:39.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/516252013 shutdown_connections 2023-12-18T10:20:39.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.148+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/516252013 wait complete. 2023-12-18T10:20:39.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 Processor -- start 2023-12-18T10:20:39.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 -- start start 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e40ce8f0 0x7fd7e4154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4160a60 0x7fd7e4161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e4164e60 0x7fd7e40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e40b21b0 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4154970 con 0x7fd7e4160a60 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4161a50 con 0x7fd7e4164e60 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e40ce8f0 0x7fd7e4154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e40ce8f0 0x7fd7e4154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49072/0 (socket says 172.21.15.133:49072) 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 -- 172.21.15.133:0/751369138 learned_addr learned my addr 172.21.15.133:0/751369138 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:39.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ea75d640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e4164e60 0x7fd7e40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e975b640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4160a60 0x7fd7e4161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 -- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e4164e60 msgr2=0x7fd7e40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e4164e60 0x7fd7e40b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 -- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4160a60 msgr2=0x7fd7e4161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4160a60 0x7fd7e4161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 -- 172.21.15.133:0/751369138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e00094d0 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e975b640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4160a60 0x7fd7e4161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7e9f5c640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e40ce8f0 0x7fd7e4154430 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00ac040 tx=0x7fd7e001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7da7fc640 1 -- 172.21.15.133:0/751369138 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00b3800 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7da7fc640 1 -- 172.21.15.133:0/751369138 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e00b3980 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e4165450 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7da7fc640 1 -- 172.21.15.133:0/751369138 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00b3d30 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e40b1bf0 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.152+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e404e000 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.156+0000 7fd7da7fc640 1 -- 172.21.15.133:0/751369138 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd7e00c6440 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.156+0000 7fd7da7fc640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7c8065a90 0x7fd7c8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.156+0000 7fd7da7fc640 1 -- 172.21.15.133:0/751369138 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fd7e011dc00 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.156+0000 7fd7e975b640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7c8065a90 0x7fd7c8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.156+0000 7fd7e975b640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7c8065a90 0x7fd7c8067f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4006fd0 tx=0x7fd7d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:39.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.160+0000 7fd7da7fc640 1 -- 172.21.15.133:0/751369138 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd7e00eb770 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.308+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd7e40c2710 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.312+0000 7fd7da7fc640 1 -- 172.21.15.133:0/751369138 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd7e00eed90 con 0x7fd7e40ce8f0 2023-12-18T10:20:39.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7c8065a90 msgr2=0x7fd7c8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7c8065a90 0x7fd7c8067f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4006fd0 tx=0x7fd7d4008040 comp rx=0 tx=0).stop 2023-12-18T10:20:39.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e40ce8f0 msgr2=0x7fd7e4154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e40ce8f0 0x7fd7e4154430 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00ac040 tx=0x7fd7e001acd0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 shutdown_connections 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd7c8065a90 0x7fd7c8067f50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7e4164e60 0x7fd7e40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e4160a60 0x7fd7e4161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 --2- 172.21.15.133:0/751369138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7e40ce8f0 0x7fd7e4154430 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 >> 172.21.15.133:0/751369138 conn(0x7fd7e406a2a0 msgr2=0x7fd7e4071020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 shutdown_connections 2023-12-18T10:20:39.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.316+0000 7fd7ec1c0640 1 -- 172.21.15.133:0/751369138 wait complete. 2023-12-18T10:20:39.339 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:20:39.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:20:39.413 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:20:39.462 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:20:39.462 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:20:39.462 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:20:39.471 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:20:39.472 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:20:39.472 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:20:39.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:20:39.481 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:20:39.481 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:20:39.522 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:20:39.522 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:20:39.523 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:20:39.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:20:39.535 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-18T10:20:39.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:39.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcfa598640 1 Processor -- start 2023-12-18T10:20:39.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcfa598640 1 -- start start 2023-12-18T10:20:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcfa598640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcf406c4f0 0x7efcf40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcfa598640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efcf40c9e30 0x7efcf40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcfa598640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40c9460 con 0x7efcf41570c0 2023-12-18T10:20:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcfa598640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf41574a0 con 0x7efcf406c4f0 2023-12-18T10:20:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcfa598640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf40c8b30 con 0x7efcf40c9e30 2023-12-18T10:20:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcf406c4f0 0x7efcf40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf3fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efcf41570c0 0x7efcf406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48620/0 (socket says 172.21.15.133:48620) 2023-12-18T10:20:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf3fff640 1 -- 172.21.15.133:0/3123641056 learned_addr learned my addr 172.21.15.133:0/3123641056 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:39.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf37fe640 1 -- 172.21.15.133:0/3123641056 >> v2:172.21.15.142:3300/0 conn(0x7efcf40c9e30 msgr2=0x7efcf40ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:39.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf8b35640 1 --2- 172.21.15.133:0/3123641056 >> v2:172.21.15.142:3300/0 conn(0x7efcf40c9e30 0x7efcf40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf2ffd640 1 -- 172.21.15.133:0/3123641056 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544655922 0 0) 0x7efcf40c9460 con 0x7efcf41570c0 2023-12-18T10:20:39.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf37fe640 1 --2- 172.21.15.133:0/3123641056 >> v2:172.21.15.142:3300/0 conn(0x7efcf40c9e30 0x7efcf40ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf37fe640 1 -- 172.21.15.133:0/3123641056 >> v1:172.21.15.133:6789/0 conn(0x7efcf41570c0 legacy=0x7efcf406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf37fe640 1 -- 172.21.15.133:0/3123641056 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40c8e10 con 0x7efcf406c4f0 2023-12-18T10:20:39.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.700+0000 7efcf8b35640 1 --2- 172.21.15.133:0/3123641056 >> v2:172.21.15.142:3300/0 conn(0x7efcf40c9e30 0x7efcf40ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:39.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcf37fe640 1 --2- 172.21.15.133:0/3123641056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf406c4f0 0x7efcf40c98f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efcf406fb70 tx=0x7efce801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78211b5daa94c6a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:39.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcf2ffd640 1 -- 172.21.15.133:0/3123641056 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce80ad660 con 0x7efcf406c4f0 2023-12-18T10:20:39.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcf2ffd640 1 -- 172.21.15.133:0/3123641056 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce80ad7c0 con 0x7efcf406c4f0 2023-12-18T10:20:39.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcf2ffd640 1 -- 172.21.15.133:0/3123641056 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce80adb50 con 0x7efcf406c4f0 2023-12-18T10:20:39.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcfa598640 1 -- 172.21.15.133:0/3123641056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf406c4f0 msgr2=0x7efcf40c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcfa598640 1 --2- 172.21.15.133:0/3123641056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf406c4f0 0x7efcf40c98f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efcf406fb70 tx=0x7efce801c3a0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcfa598640 1 -- 172.21.15.133:0/3123641056 shutdown_connections 2023-12-18T10:20:39.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcfa598640 1 --2- 172.21.15.133:0/3123641056 >> v2:172.21.15.142:3300/0 conn(0x7efcf40c9e30 0x7efcf40ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcfa598640 1 --2- 172.21.15.133:0/3123641056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf406c4f0 0x7efcf40c98f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcfa598640 1 -- 172.21.15.133:0/3123641056 >> 172.21.15.133:0/3123641056 conn(0x7efcf406a3e0 msgr2=0x7efcf40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcfa598640 1 -- 172.21.15.133:0/3123641056 shutdown_connections 2023-12-18T10:20:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.704+0000 7efcfa598640 1 -- 172.21.15.133:0/3123641056 wait complete. 2023-12-18T10:20:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 Processor -- start 2023-12-18T10:20:39.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 -- start start 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf406c4f0 0x7efcf4149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf40c9e30 0x7efcf415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf41570c0 0x7efcf4155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415ccc0 con 0x7efcf41570c0 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415bc20 con 0x7efcf40c9e30 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415bf00 con 0x7efcf406c4f0 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf41570c0 0x7efcf4155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf41570c0 0x7efcf4155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49090/0 (socket says 172.21.15.133:49090) 2023-12-18T10:20:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 -- 172.21.15.133:0/2114113067 learned_addr learned my addr 172.21.15.133:0/2114113067 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf37fe640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf40c9e30 0x7efcf415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf3fff640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf406c4f0 0x7efcf4149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 -- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf406c4f0 msgr2=0x7efcf4149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf406c4f0 0x7efcf4149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 -- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf40c9e30 msgr2=0x7efcf415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf40c9e30 0x7efcf415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 -- 172.21.15.133:0/2114113067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8009420 con 0x7efcf41570c0 2023-12-18T10:20:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf3fff640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf406c4f0 0x7efcf4149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf8b35640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf41570c0 0x7efcf4155000 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efcec00cef0 tx=0x7efcec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf0ff9640 1 -- 172.21.15.133:0/2114113067 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00d840 con 0x7efcf41570c0 2023-12-18T10:20:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf0ff9640 1 -- 172.21.15.133:0/2114113067 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec00d9c0 con 0x7efcf41570c0 2023-12-18T10:20:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcf0ff9640 1 -- 172.21.15.133:0/2114113067 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00dd70 con 0x7efcf41570c0 2023-12-18T10:20:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf415c1e0 con 0x7efcf41570c0 2023-12-18T10:20:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.707+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf415c7a0 con 0x7efcf41570c0 2023-12-18T10:20:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.711+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40735b0 con 0x7efcf41570c0 2023-12-18T10:20:39.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.711+0000 7efcf0ff9640 1 -- 172.21.15.133:0/2114113067 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efcec01e3b0 con 0x7efcf41570c0 2023-12-18T10:20:39.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.711+0000 7efcf0ff9640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efce0065a60 0x7efce0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:39.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.711+0000 7efcf0ff9640 1 -- 172.21.15.133:0/2114113067 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7efcec083ba0 con 0x7efcf41570c0 2023-12-18T10:20:39.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.711+0000 7efcf3fff640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efce0065a60 0x7efce0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:39.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.711+0000 7efcf3fff640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efce0065a60 0x7efce0067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efce4007fd0 tx=0x7efce4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:39.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.715+0000 7efcf0ff9640 1 -- 172.21.15.133:0/2114113067 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efcec051690 con 0x7efcf41570c0 2023-12-18T10:20:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcf415c990 con 0x7efcf41570c0 2023-12-18T10:20:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcf0ff9640 1 -- 172.21.15.133:0/2114113067 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3538 (secure 0 0 0) 0x7efcec01a090 con 0x7efcf41570c0 2023-12-18T10:20:39.904 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:39.904 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5051,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3673716891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3673716891},{"type":"v1","addr":"172.21.15.133:6837","nonce":3673716891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5453,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/692881666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":692881666},{"type":"v1","addr":"172.21.15.142:6833","nonce":692881666}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5815,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1911259433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":1911259433},{"type":"v1","addr":"172.21.15.142:6835","nonce":1911259433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2515971222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2515971222},{"type":"v1","addr":"172.21.15.133:6836","nonce":2515971222}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2023-12-18T10:20:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 27 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efce0065a60 msgr2=0x7efce0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efce0065a60 0x7efce0067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efce4007fd0 tx=0x7efce4009040 comp rx=0 tx=0).stop 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf41570c0 msgr2=0x7efcf4155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf41570c0 0x7efcf4155000 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efcec00cef0 tx=0x7efcec00a710 comp rx=0 tx=0).stop 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 shutdown_connections 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efce0065a60 0x7efce0067f20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf41570c0 0x7efcf4155000 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcf40c9e30 0x7efcf415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 --2- 172.21.15.133:0/2114113067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcf406c4f0 0x7efcf4149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 >> 172.21.15.133:0/2114113067 conn(0x7efcf406a3e0 msgr2=0x7efcf40cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 shutdown_connections 2023-12-18T10:20:39.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:39.899+0000 7efcfa598640 1 -- 172.21.15.133:0/2114113067 wait complete. 2023-12-18T10:20:39.926 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-18T10:20:39.926 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-18T10:20:39.926 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-18T10:20:39.926 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:20:39.926 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-18T10:20:39.926 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-18T10:20:39.926 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-18T10:20:39.926 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:20:39.927 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-18T10:20:39.927 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-18T10:20:39.927 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-18T10:20:39.927 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:20:39.927 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-18T10:20:39.927 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-18T10:20:39.927 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-18T10:20:39.928 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:20:39.939 INFO:tasks.ceph.mds.a:Stopped 2023-12-18T10:20:39.939 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-18T10:20:39.940 INFO:tasks.ceph.mds.c:Stopped 2023-12-18T10:20:39.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-18T10:20:39.945 INFO:tasks.ceph.mds.b:Stopped 2023-12-18T10:20:39.945 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-18T10:20:39.946 INFO:tasks.ceph.mds.d:Stopped 2023-12-18T10:20:39.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-18T10:20:39.985 INFO:tasks.ceph.mds.a:Started 2023-12-18T10:20:39.985 DEBUG:teuthology.parallel:result is None 2023-12-18T10:20:39.987 INFO:tasks.ceph.mds.c:Started 2023-12-18T10:20:39.987 DEBUG:teuthology.parallel:result is None 2023-12-18T10:20:39.989 INFO:tasks.ceph.mds.b:Started 2023-12-18T10:20:39.989 DEBUG:teuthology.parallel:result is None 2023-12-18T10:20:39.991 INFO:tasks.ceph.mds.d:Started 2023-12-18T10:20:39.991 DEBUG:teuthology.parallel:result is None 2023-12-18T10:20:39.992 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-18T10:20:40.073 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:20:40.073 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:20:40.081 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:20:40.082 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:20:40.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae352c640 1 Processor -- start 2023-12-18T10:20:40.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae352c640 1 -- start start 2023-12-18T10:20:40.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae352c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc15a680 0x7faadc15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:40.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae352c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faadc0cac10 0x7faadc15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:40.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae352c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faadc15afa0 0x7faadc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:40.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae352c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc15f100 con 0x7faadc0cac10 2023-12-18T10:20:40.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae352c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0ca7d0 con 0x7faadc15afa0 2023-12-18T10:20:40.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae352c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15e860 con 0x7faadc15a680 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae0ac7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faadc0cac10 0x7faadc15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae0ac7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faadc0cac10 0x7faadc15aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56176/0 (socket says 172.21.15.133:56176) 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae0ac7640 1 -- 172.21.15.133:0/3036175393 learned_addr learned my addr 172.21.15.133:0/3036175393 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae1ac9640 1 --2- 172.21.15.133:0/3036175393 >> v2:172.21.15.142:3300/0 conn(0x7faadc15afa0 0x7faadc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.143+0000 7faae12c8640 1 --2- 172.21.15.133:0/3036175393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc15a680 0x7faadc15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae0ac7640 1 -- 172.21.15.133:0/3036175393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc15a680 msgr2=0x7faadc15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae0ac7640 1 --2- 172.21.15.133:0/3036175393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc15a680 0x7faadc15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae0ac7640 1 -- 172.21.15.133:0/3036175393 >> v2:172.21.15.142:3300/0 conn(0x7faadc15afa0 msgr2=0x7faadc06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae0ac7640 1 --2- 172.21.15.133:0/3036175393 >> v2:172.21.15.142:3300/0 conn(0x7faadc15afa0 0x7faadc06fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae0ac7640 1 -- 172.21.15.133:0/3036175393 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc15eb40 con 0x7faadc0cac10 2023-12-18T10:20:40.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae1ac9640 1 --2- 172.21.15.133:0/3036175393 >> v2:172.21.15.142:3300/0 conn(0x7faadc15afa0 0x7faadc06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:40.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae0ac7640 1 --2- 172.21.15.133:0/3036175393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc0cac10 0x7faadc15aa60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7faadc0add90 tx=0x7faacc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e3a0832cf218e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:40.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faad3fff640 1 -- 172.21.15.133:0/3036175393 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0ab600 con 0x7faadc0cac10 2023-12-18T10:20:40.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faad3fff640 1 -- 172.21.15.133:0/3036175393 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc0a7050 con 0x7faadc0cac10 2023-12-18T10:20:40.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faad3fff640 1 -- 172.21.15.133:0/3036175393 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0ab980 con 0x7faadc0cac10 2023-12-18T10:20:40.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae352c640 1 -- 172.21.15.133:0/3036175393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc0cac10 msgr2=0x7faadc15aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:40.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae352c640 1 --2- 172.21.15.133:0/3036175393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc0cac10 0x7faadc15aa60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7faadc0add90 tx=0x7faacc01c470 comp rx=0 tx=0).stop 2023-12-18T10:20:40.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae352c640 1 -- 172.21.15.133:0/3036175393 shutdown_connections 2023-12-18T10:20:40.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae352c640 1 --2- 172.21.15.133:0/3036175393 >> v2:172.21.15.142:3300/0 conn(0x7faadc15afa0 0x7faadc06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:40.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae352c640 1 --2- 172.21.15.133:0/3036175393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc0cac10 0x7faadc15aa60 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:40.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae352c640 1 --2- 172.21.15.133:0/3036175393 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc15a680 0x7faadc15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:40.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.147+0000 7faae352c640 1 -- 172.21.15.133:0/3036175393 >> 172.21.15.133:0/3036175393 conn(0x7faadc06a3e0 msgr2=0x7faadc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:40.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 -- 172.21.15.133:0/3036175393 shutdown_connections 2023-12-18T10:20:40.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 -- 172.21.15.133:0/3036175393 wait complete. 2023-12-18T10:20:40.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 Processor -- start 2023-12-18T10:20:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 -- start start 2023-12-18T10:20:40.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc0cac10 0x7faadc1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:40.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faadc15a680 0x7faadc0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:40.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc15afa0 0x7faadc0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:40.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0ac8b0 con 0x7faadc15afa0 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0ccdc0 con 0x7faadc15a680 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0ac5d0 con 0x7faadc0cac10 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc15afa0 0x7faadc0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc15afa0 0x7faadc0cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56188/0 (socket says 172.21.15.133:56188) 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 -- 172.21.15.133:0/1673232029 learned_addr learned my addr 172.21.15.133:0/1673232029 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae0ac7640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faadc15a680 0x7faadc0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae12c8640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc0cac10 0x7faadc1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 -- 172.21.15.133:0/1673232029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc0cac10 msgr2=0x7faadc1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc0cac10 0x7faadc1594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 -- 172.21.15.133:0/1673232029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faadc15a680 msgr2=0x7faadc0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faadc15a680 0x7faadc0cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 -- 172.21.15.133:0/1673232029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc0094d0 con 0x7faadc15afa0 2023-12-18T10:20:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae1ac9640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc15afa0 0x7faadc0cc880 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7faad4007e70 tx=0x7faad400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faad1ffb640 1 -- 172.21.15.133:0/1673232029 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4003ba0 con 0x7faadc15afa0 2023-12-18T10:20:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faad1ffb640 1 -- 172.21.15.133:0/1673232029 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400f040 con 0x7faadc15afa0 2023-12-18T10:20:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc0c3010 con 0x7faadc15afa0 2023-12-18T10:20:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.151+0000 7faad1ffb640 1 -- 172.21.15.133:0/1673232029 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400de80 con 0x7faadc15afa0 2023-12-18T10:20:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.155+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0c35d0 con 0x7faadc15afa0 2023-12-18T10:20:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.155+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc0735b0 con 0x7faadc15afa0 2023-12-18T10:20:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.155+0000 7faad1ffb640 1 -- 172.21.15.133:0/1673232029 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faad4004030 con 0x7faadc15afa0 2023-12-18T10:20:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.155+0000 7faad1ffb640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faac0065ab0 0x7faac0067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.155+0000 7faad1ffb640 1 -- 172.21.15.133:0/1673232029 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5435+0+0 (secure 0 0 0) 0x7faad40832e0 con 0x7faadc15afa0 2023-12-18T10:20:40.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.155+0000 7faae12c8640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faac0065ab0 0x7faac0067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:40.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.155+0000 7faae12c8640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faac0065ab0 0x7faac0067f70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faad8007a60 tx=0x7faad8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.159+0000 7faad1ffb640 1 -- 172.21.15.133:0/1673232029 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faad4050ed0 con 0x7faadc15afa0 2023-12-18T10:20:40.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:40.319+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7faadc04e000 con 0x7faadc15afa0 2023-12-18T10:20:41.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.119+0000 7faad1ffb640 1 -- 172.21.15.133:0/1673232029 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v49) v1 ==== 97+0+0 (secure 0 0 0) 0x7faad40544f0 con 0x7faadc15afa0 2023-12-18T10:20:41.124 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faac0065ab0 msgr2=0x7faac0067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faac0065ab0 0x7faac0067f70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faad8007a60 tx=0x7faad8008040 comp rx=0 tx=0).stop 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc15afa0 msgr2=0x7faadc0cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc15afa0 0x7faadc0cc880 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7faad4007e70 tx=0x7faad400d4a0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 shutdown_connections 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faac0065ab0 0x7faac0067f70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faadc15afa0 0x7faadc0cc880 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faadc15a680 0x7faadc0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 --2- 172.21.15.133:0/1673232029 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faadc0cac10 0x7faadc1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 >> 172.21.15.133:0/1673232029 conn(0x7faadc06a3e0 msgr2=0x7faadc15c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 shutdown_connections 2023-12-18T10:20:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.123+0000 7faae352c640 1 -- 172.21.15.133:0/1673232029 wait complete. 2023-12-18T10:20:41.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-18T10:20:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.279+0000 7fb538e83640 1 Processor -- start 2023-12-18T10:20:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.279+0000 7fb538e83640 1 -- start start 2023-12-18T10:20:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb538e83640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5340c4ce0 0x7fb5340cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb538e83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406c1b0 0x7fb5340cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb538e83640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5340ccce0 con 0x7fb53406bdd0 2023-12-18T10:20:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb538e83640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5340caa70 con 0x7fb5340c4ce0 2023-12-18T10:20:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb538e83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340cd550 con 0x7fb53406c1b0 2023-12-18T10:20:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb52bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5340c4ce0 0x7fb5340cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb533fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406c1b0 0x7fb5340cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb5337fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb53406bdd0 0x7fb5340c45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:37160/0 (socket says 172.21.15.133:37160) 2023-12-18T10:20:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb5337fe640 1 -- 172.21.15.133:0/11708891 learned_addr learned my addr 172.21.15.133:0/11708891 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb532ffd640 1 -- 172.21.15.133:0/11708891 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658966159 0 0) 0x7fb5340ccce0 con 0x7fb53406bdd0 2023-12-18T10:20:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb532ffd640 1 -- 172.21.15.133:0/11708891 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb520003530 con 0x7fb53406bdd0 2023-12-18T10:20:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb52bfff640 1 -- 172.21.15.133:0/11708891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406c1b0 msgr2=0x7fb5340cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb52bfff640 1 --2- 172.21.15.133:0/11708891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406c1b0 0x7fb5340cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb52bfff640 1 -- 172.21.15.133:0/11708891 >> v1:172.21.15.142:6789/0 conn(0x7fb53406bdd0 legacy=0x7fb5340c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.283+0000 7fb52bfff640 1 -- 172.21.15.133:0/11708891 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5340ccf90 con 0x7fb5340c4ce0 2023-12-18T10:20:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb52bfff640 1 --2- 172.21.15.133:0/11708891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 0x7fb5340cc260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0097c0 tx=0x7fb51c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a7244707e3293d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb532ffd640 1 -- 172.21.15.133:0/11708891 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0ac630 con 0x7fb5340c4ce0 2023-12-18T10:20:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb532ffd640 1 -- 172.21.15.133:0/11708891 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c0ac790 con 0x7fb5340c4ce0 2023-12-18T10:20:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb532ffd640 1 -- 172.21.15.133:0/11708891 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0acb20 con 0x7fb5340c4ce0 2023-12-18T10:20:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb538e83640 1 -- 172.21.15.133:0/11708891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 msgr2=0x7fb5340cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb538e83640 1 --2- 172.21.15.133:0/11708891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 0x7fb5340cc260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0097c0 tx=0x7fb51c01c450 comp rx=0 tx=0).stop 2023-12-18T10:20:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb538e83640 1 -- 172.21.15.133:0/11708891 shutdown_connections 2023-12-18T10:20:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb538e83640 1 --2- 172.21.15.133:0/11708891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406c1b0 0x7fb5340cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb538e83640 1 --2- 172.21.15.133:0/11708891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 0x7fb5340cc260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb538e83640 1 -- 172.21.15.133:0/11708891 >> 172.21.15.133:0/11708891 conn(0x7fb5340ce130 msgr2=0x7fb5340ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb538e83640 1 -- 172.21.15.133:0/11708891 shutdown_connections 2023-12-18T10:20:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.287+0000 7fb538e83640 1 -- 172.21.15.133:0/11708891 wait complete. 2023-12-18T10:20:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 Processor -- start 2023-12-18T10:20:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 -- start start 2023-12-18T10:20:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406bdd0 0x7fb534158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb53406c1b0 0x7fb534142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 0x7fb534143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53413f4a0 con 0x7fb53406c1b0 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb534169640 con 0x7fb5340c4ce0 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5341588c0 con 0x7fb53406bdd0 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb53406c1b0 0x7fb534142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb53406c1b0 0x7fb534142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56200/0 (socket says 172.21.15.133:56200) 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 -- 172.21.15.133:0/1194330830 learned_addr learned my addr 172.21.15.133:0/1194330830 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb5337fe640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406bdd0 0x7fb534158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb533fff640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 0x7fb534143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 -- 172.21.15.133:0/1194330830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406bdd0 msgr2=0x7fb534158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406bdd0 0x7fb534158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 -- 172.21.15.133:0/1194330830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 msgr2=0x7fb534143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 0x7fb534143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 -- 172.21.15.133:0/1194330830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c009420 con 0x7fb53406c1b0 2023-12-18T10:20:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb52bfff640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb53406c1b0 0x7fb534142d50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb51c019060 tx=0x7fb51c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb530ff9640 1 -- 172.21.15.133:0/1194330830 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0b5600 con 0x7fb53406c1b0 2023-12-18T10:20:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb530ff9640 1 -- 172.21.15.133:0/1194330830 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c0b5760 con 0x7fb53406c1b0 2023-12-18T10:20:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb530ff9640 1 -- 172.21.15.133:0/1194330830 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0b5b10 con 0x7fb53406c1b0 2023-12-18T10:20:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb534168a30 con 0x7fb53406c1b0 2023-12-18T10:20:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb534168ff0 con 0x7fb53406c1b0 2023-12-18T10:20:41.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.291+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5341697d0 con 0x7fb53406c1b0 2023-12-18T10:20:41.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.295+0000 7fb530ff9640 1 -- 172.21.15.133:0/1194330830 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb51c0b3040 con 0x7fb53406c1b0 2023-12-18T10:20:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.295+0000 7fb530ff9640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb514065a60 0x7fb514067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.295+0000 7fb530ff9640 1 -- 172.21.15.133:0/1194330830 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb51c11cc50 con 0x7fb53406c1b0 2023-12-18T10:20:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.295+0000 7fb5337fe640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb514065a60 0x7fb514067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.295+0000 7fb5337fe640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb514065a60 0x7fb514067f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb524005890 tx=0x7fb524009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:41.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.299+0000 7fb530ff9640 1 -- 172.21.15.133:0/1194330830 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb51c0ea820 con 0x7fb53406c1b0 2023-12-18T10:20:41.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.499+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb53404e850 con 0x7fb53406c1b0 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.499+0000 7fb530ff9640 1 -- 172.21.15.133:0/1194330830 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb51c0ede40 con 0x7fb53406c1b0 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlq/3QHRAAeGrWPAL1IMuRSsb9HM8t0Q==", 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:20:41.506 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBleUoUKhAA7KQ881Hp59b6BfYF5Mc8Rw==", 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.507 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlsRoJJRAAYgbCztPYO/qzR7wJgYhPqQ==", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlr0paMRAAUlbr607Vw8Yc0/S1EvLUUA==", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:20:41.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAgHIBlbTjYDhAA2KUnOrWIaGtzxXx9T64djw==", 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.509 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjHIBlr8a1FhAAGRT54akJvp65F8xxu9Mw1g==", 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAmHIBlv+HSHBAAxDHSTox1AtpTMfCNbatjzA==", 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:20:41.510 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApHIBlj5xPIxAAkZglsOO2rg+8kXVIb+JK+w==", 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAvHIBlhQRmKxAAahzzO4gYz5LHWhvFvZlOAA==", 2023-12-18T10:20:41.511 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyHIBlatiUMhAAk0X1zO+dYOu5hMZvGBJNkQ==", 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1HIBl86v0OBAA70FwnvAugWtLupto+cbBjg==", 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA5HIBlZAYVBBAAa0V4jDTdYV8TBoNR7SenjQ==", 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:20:41.513 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlugNkNRAADsDapfYnOr+gcvgQ4394aA==", 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-18T10:20:41.514 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlM7J1AxAAgoKo5xm3Wz4xWjPX4Mpn0A==", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlrzVcOxAAwwd6eFzNGehg/4chJq1qJA==", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:20:41.515 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlRgxmCRAAN/aEmPSonvc17SvLB1GdXQ==", 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-18T10:20:41.516 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAbHIBlJHzPORAAQupFGwV6/izxeyNlnyeMSA==", 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlDP4UFhAA8KB7vRFpeBSRad2GRiKh/A==", 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.517 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBl+lIiEhAAx9zNJbwPBf7oGsFzDJKxEw==", 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-18T10:20:41.518 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:20:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb514065a60 msgr2=0x7fb514067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb514065a60 0x7fb514067f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb524005890 tx=0x7fb524009040 comp rx=0 tx=0).stop 2023-12-18T10:20:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb53406c1b0 msgr2=0x7fb534142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb53406c1b0 0x7fb534142d50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb51c019060 tx=0x7fb51c0191f0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 shutdown_connections 2023-12-18T10:20:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb514065a60 0x7fb514067f20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5340c4ce0 0x7fb534143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb53406c1b0 0x7fb534142d50 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 --2- 172.21.15.133:0/1194330830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb53406bdd0 0x7fb534158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 >> 172.21.15.133:0/1194330830 conn(0x7fb5340ce130 msgr2=0x7fb5340c3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 shutdown_connections 2023-12-18T10:20:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.503+0000 7fb538e83640 1 -- 172.21.15.133:0/1194330830 wait complete. 2023-12-18T10:20:41.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:20:41.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.659+0000 7f1f4616d640 1 Processor -- start 2023-12-18T10:20:41.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.659+0000 7f1f4616d640 1 -- start start 2023-12-18T10:20:41.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f4616d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f400cb180 0x7f1f40070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f4616d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f40070b80 con 0x7f1f4015c800 2023-12-18T10:20:41.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f4616d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f40070e60 con 0x7f1f40158c20 2023-12-18T10:20:41.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f4616d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f40071140 con 0x7f1f400cb180 2023-12-18T10:20:41.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f3effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f400cb180 0x7f1f40070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f3ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1f4015c800 0x7f1f400ccc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56724/0 (socket says 172.21.15.133:56724) 2023-12-18T10:20:41.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f3ffff640 1 -- 172.21.15.133:0/3733786695 learned_addr learned my addr 172.21.15.133:0/3733786695 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:41.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f3effd640 1 -- 172.21.15.133:0/3733786695 >> v1:172.21.15.142:6789/0 conn(0x7f1f40158c20 legacy=0x7f1f400caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f3effd640 1 -- 172.21.15.133:0/3733786695 >> v1:172.21.15.133:6789/0 conn(0x7f1f4015c800 legacy=0x7f1f400ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f3effd640 1 -- 172.21.15.133:0/3733786695 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40071420 con 0x7f1f400cb180 2023-12-18T10:20:41.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.663+0000 7f1f3e7fc640 1 -- 172.21.15.133:0/3733786695 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111728659 0 0) 0x7f1f40070b80 con 0x7f1f4015c800 2023-12-18T10:20:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f3effd640 1 --2- 172.21.15.133:0/3733786695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f400cb180 0x7f1f40070510 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1f340097c0 tx=0x7f1f3401ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3cd2f5fd8a966e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f3e7fc640 1 -- 172.21.15.133:0/3733786695 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340ac640 con 0x7f1f400cb180 2023-12-18T10:20:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f3e7fc640 1 -- 172.21.15.133:0/3733786695 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f340ac7a0 con 0x7f1f400cb180 2023-12-18T10:20:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f3e7fc640 1 -- 172.21.15.133:0/3733786695 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340acb30 con 0x7f1f400cb180 2023-12-18T10:20:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f4616d640 1 -- 172.21.15.133:0/3733786695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f400cb180 msgr2=0x7f1f40070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f4616d640 1 --2- 172.21.15.133:0/3733786695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f400cb180 0x7f1f40070510 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1f340097c0 tx=0x7f1f3401ce20 comp rx=0 tx=0).stop 2023-12-18T10:20:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f4616d640 1 -- 172.21.15.133:0/3733786695 shutdown_connections 2023-12-18T10:20:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f4616d640 1 --2- 172.21.15.133:0/3733786695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f400cb180 0x7f1f40070510 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f4616d640 1 -- 172.21.15.133:0/3733786695 >> 172.21.15.133:0/3733786695 conn(0x7f1f4006a3e0 msgr2=0x7f1f400afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f4616d640 1 -- 172.21.15.133:0/3733786695 shutdown_connections 2023-12-18T10:20:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.667+0000 7f1f4616d640 1 -- 172.21.15.133:0/3733786695 wait complete. 2023-12-18T10:20:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 Processor -- start 2023-12-18T10:20:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 -- start start 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f400cb180 0x7f1f4014b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f40158c20 0x7f1f4014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4015c800 0x7f1f4014cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4014e380 con 0x7f1f4015c800 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4014be90 con 0x7f1f400cb180 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400c6c80 con 0x7f1f40158c20 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4015c800 0x7f1f4014cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4015c800 0x7f1f4014cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56226/0 (socket says 172.21.15.133:56226) 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 -- 172.21.15.133:0/3041239058 learned_addr learned my addr 172.21.15.133:0/3041239058 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3f7fe640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f400cb180 0x7f1f4014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3effd640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f40158c20 0x7f1f4014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 -- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f40158c20 msgr2=0x7f1f4014f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f40158c20 0x7f1f4014f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 -- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f400cb180 msgr2=0x7f1f4014b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f400cb180 0x7f1f4014b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 -- 172.21.15.133:0/3041239058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34009420 con 0x7f1f4015c800 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3f7fe640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f400cb180 0x7f1f4014b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3effd640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f40158c20 0x7f1f4014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f3ffff640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4015c800 0x7f1f4014cf40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800c780 tx=0x7f1f3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f27fff640 1 -- 172.21.15.133:0/3041239058 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800ce90 con 0x7f1f4015c800 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f27fff640 1 -- 172.21.15.133:0/3041239058 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3800a640 con 0x7f1f4015c800 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f400c8800 con 0x7f1f4015c800 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f27fff640 1 -- 172.21.15.133:0/3041239058 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800a9d0 con 0x7f1f4015c800 2023-12-18T10:20:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4014ddc0 con 0x7f1f4015c800 2023-12-18T10:20:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.671+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f400735b0 con 0x7f1f4015c800 2023-12-18T10:20:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.675+0000 7f1f27fff640 1 -- 172.21.15.133:0/3041239058 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f3800ab30 con 0x7f1f4015c800 2023-12-18T10:20:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.675+0000 7f1f27fff640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f2c065a60 0x7f1f2c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:41.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.675+0000 7f1f27fff640 1 -- 172.21.15.133:0/3041239058 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1f38082890 con 0x7f1f4015c800 2023-12-18T10:20:41.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.675+0000 7f1f3f7fe640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f2c065a60 0x7f1f2c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:41.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.675+0000 7f1f3f7fe640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f2c065a60 0x7f1f2c067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1f30000f70 tx=0x7f1f30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:41.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.679+0000 7f1f27fff640 1 -- 172.21.15.133:0/3041239058 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1f380503c0 con 0x7f1f4015c800 2023-12-18T10:20:41.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f4004e000 con 0x7f1f4015c800 2023-12-18T10:20:41.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f27fff640 1 -- 172.21.15.133:0/3041239058 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+12642 (secure 0 0 0) 0x7f1f380539e0 con 0x7f1f4015c800 2023-12-18T10:20:41.836 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:41.836 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:20:41.115663+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:20:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f2c065a60 msgr2=0x7f1f2c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f2c065a60 0x7f1f2c067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1f30000f70 tx=0x7f1f30009040 comp rx=0 tx=0).stop 2023-12-18T10:20:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4015c800 msgr2=0x7f1f4014cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4015c800 0x7f1f4014cf40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800c780 tx=0x7f1f3800cc40 comp rx=0 tx=0).stop 2023-12-18T10:20:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 shutdown_connections 2023-12-18T10:20:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1f2c065a60 0x7f1f2c067f20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4015c800 0x7f1f4014cf40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f40158c20 0x7f1f4014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 --2- 172.21.15.133:0/3041239058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f400cb180 0x7f1f4014b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:41.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 >> 172.21.15.133:0/3041239058 conn(0x7f1f4006a3e0 msgr2=0x7f1f400ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:41.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 shutdown_connections 2023-12-18T10:20:41.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.831+0000 7f1f4616d640 1 -- 172.21.15.133:0/3041239058 wait complete. 2023-12-18T10:20:41.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:20:41.858 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:20:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.991+0000 7f81a7f52640 1 Processor -- start 2023-12-18T10:20:41.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a7f52640 1 -- start start 2023-12-18T10:20:42.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a7f52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0160a60 0x7f81a00ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a7f52640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81a00ce8f0 0x7f81a0164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a7f52640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a00ced50 con 0x7f81a0164e60 2023-12-18T10:20:42.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a7f52640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a00cc980 con 0x7f81a00ce8f0 2023-12-18T10:20:42.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a7f52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00cc090 con 0x7f81a0160a60 2023-12-18T10:20:42.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a5cee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0160a60 0x7f81a00ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a54ed640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f81a00ce8f0 0x7f81a0164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a5cee640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0160a60 0x7f81a00ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:49754/0 (socket says 172.21.15.133:49754) 2023-12-18T10:20:42.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a5cee640 1 -- 172.21.15.133:0/139440047 learned_addr learned my addr 172.21.15.133:0/139440047 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:42.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a5cee640 1 -- 172.21.15.133:0/139440047 >> v2:172.21.15.142:3300/0 conn(0x7f81a00ce8f0 msgr2=0x7f81a0164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:42.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a5cee640 1 --2- 172.21.15.133:0/139440047 >> v2:172.21.15.142:3300/0 conn(0x7f81a00ce8f0 0x7f81a0164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a5cee640 1 -- 172.21.15.133:0/139440047 >> v1:172.21.15.142:6789/0 conn(0x7f81a0164e60 legacy=0x7f81a00cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a5cee640 1 -- 172.21.15.133:0/139440047 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00cc330 con 0x7f81a0160a60 2023-12-18T10:20:42.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.995+0000 7f81a54ed640 1 --2- 172.21.15.133:0/139440047 >> v2:172.21.15.142:3300/0 conn(0x7f81a00ce8f0 0x7f81a0164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:42.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a5cee640 1 --2- 172.21.15.133:0/139440047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0160a60 0x7f81a00ce3b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f819c009870 tx=0x7f819c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d7523d3f5323726 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a4cec640 1 -- 172.21.15.133:0/139440047 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0a95f0 con 0x7f81a0160a60 2023-12-18T10:20:42.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a4cec640 1 -- 172.21.15.133:0/139440047 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c0a9750 con 0x7f81a0160a60 2023-12-18T10:20:42.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a4cec640 1 -- 172.21.15.133:0/139440047 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0a9ae0 con 0x7f81a0160a60 2023-12-18T10:20:42.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a7f52640 1 -- 172.21.15.133:0/139440047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0160a60 msgr2=0x7f81a00ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a7f52640 1 --2- 172.21.15.133:0/139440047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0160a60 0x7f81a00ce3b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f819c009870 tx=0x7f819c01c510 comp rx=0 tx=0).stop 2023-12-18T10:20:42.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a7f52640 1 -- 172.21.15.133:0/139440047 shutdown_connections 2023-12-18T10:20:42.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a7f52640 1 --2- 172.21.15.133:0/139440047 >> v2:172.21.15.142:3300/0 conn(0x7f81a00ce8f0 0x7f81a0164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a7f52640 1 --2- 172.21.15.133:0/139440047 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0160a60 0x7f81a00ce3b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a7f52640 1 -- 172.21.15.133:0/139440047 >> 172.21.15.133:0/139440047 conn(0x7f81a006a2a0 msgr2=0x7f81a00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:42.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a7f52640 1 -- 172.21.15.133:0/139440047 shutdown_connections 2023-12-18T10:20:42.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:41.999+0000 7f81a7f52640 1 -- 172.21.15.133:0/139440047 wait complete. 2023-12-18T10:20:42.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 Processor -- start 2023-12-18T10:20:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 -- start start 2023-12-18T10:20:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a00ce8f0 0x7f81a015da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0160a60 0x7f81a015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0164e60 0x7f81a015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a0150060 con 0x7f81a0160a60 2023-12-18T10:20:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00b2420 con 0x7f81a00ce8f0 2023-12-18T10:20:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a015e040 con 0x7f81a0164e60 2023-12-18T10:20:42.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0160a60 0x7f81a015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0160a60 0x7f81a015bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56236/0 (socket says 172.21.15.133:56236) 2023-12-18T10:20:42.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 -- 172.21.15.133:0/1755474238 learned_addr learned my addr 172.21.15.133:0/1755474238 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:42.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a5cee640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a00ce8f0 0x7f81a015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a64ef640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0164e60 0x7f81a015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 -- 172.21.15.133:0/1755474238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0164e60 msgr2=0x7f81a015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0164e60 0x7f81a015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 -- 172.21.15.133:0/1755474238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a00ce8f0 msgr2=0x7f81a015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a00ce8f0 0x7f81a015da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 -- 172.21.15.133:0/1755474238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190009420 con 0x7f81a0160a60 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a54ed640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0160a60 0x7f81a015bad0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f819000e980 tx=0x7f819000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81967fc640 1 -- 172.21.15.133:0/1755474238 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000ca00 con 0x7f81a0160a60 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81967fc640 1 -- 172.21.15.133:0/1755474238 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819000cb60 con 0x7f81a0160a60 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c0094d0 con 0x7f81a0160a60 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81967fc640 1 -- 172.21.15.133:0/1755474238 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190013470 con 0x7f81a0160a60 2023-12-18T10:20:42.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a015e600 con 0x7f81a0160a60 2023-12-18T10:20:42.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.003+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a004e000 con 0x7f81a0160a60 2023-12-18T10:20:42.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.007+0000 7f81967fc640 1 -- 172.21.15.133:0/1755474238 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f81900135d0 con 0x7f81a0160a60 2023-12-18T10:20:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.007+0000 7f81967fc640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8184065a60 0x7f8184067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.007+0000 7f81967fc640 1 -- 172.21.15.133:0/1755474238 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f81900831b0 con 0x7f81a0160a60 2023-12-18T10:20:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.007+0000 7f81a5cee640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8184065a60 0x7f8184067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.007+0000 7f81a5cee640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8184065a60 0x7f8184067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f819c0ae000 tx=0x7f819c0b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.011+0000 7f81967fc640 1 -- 172.21.15.133:0/1755474238 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8190050d90 con 0x7f81a0160a60 2023-12-18T10:20:42.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81a00b0c00 con 0x7f81a0160a60 2023-12-18T10:20:42.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81967fc640 1 -- 172.21.15.133:0/1755474238 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81900543b0 con 0x7f81a0160a60 2023-12-18T10:20:42.167 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:20:42.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8184065a60 msgr2=0x7f8184067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8184065a60 0x7f8184067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f819c0ae000 tx=0x7f819c0b3040 comp rx=0 tx=0).stop 2023-12-18T10:20:42.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0160a60 msgr2=0x7f81a015bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0160a60 0x7f81a015bad0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f819000e980 tx=0x7f819000ee40 comp rx=0 tx=0).stop 2023-12-18T10:20:42.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 shutdown_connections 2023-12-18T10:20:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8184065a60 0x7f8184067f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f81a0164e60 0x7f81a015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0160a60 0x7f81a015bad0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 --2- 172.21.15.133:0/1755474238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81a00ce8f0 0x7f81a015da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 >> 172.21.15.133:0/1755474238 conn(0x7f81a006a2a0 msgr2=0x7f81a00c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 shutdown_connections 2023-12-18T10:20:42.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.163+0000 7f81a7f52640 1 -- 172.21.15.133:0/1755474238 wait complete. 2023-12-18T10:20:42.189 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-18T10:20:42.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e8810a640 1 Processor -- start 2023-12-18T10:20:42.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e8810a640 1 -- start start 2023-12-18T10:20:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e8810a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e801570c0 0x7f9e8006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e8810a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e80070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e8810a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e800c9460 con 0x7f9e8006c320 2023-12-18T10:20:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e8810a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8006c7a0 con 0x7f9e801570c0 2023-12-18T10:20:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e8810a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e801574a0 con 0x7f9e800ca000 2023-12-18T10:20:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e856a5640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9e8006c320 0x7f9e800c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56736/0 (socket says 172.21.15.133:56736) 2023-12-18T10:20:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e856a5640 1 -- 172.21.15.133:0/3913114347 learned_addr learned my addr 172.21.15.133:0/3913114347 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e866a7640 1 --2- 172.21.15.133:0/3913114347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e80070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e85ea6640 1 --2- 172.21.15.133:0/3913114347 >> v2:172.21.15.142:3300/0 conn(0x7f9e801570c0 0x7f9e8006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e84ea4640 1 -- 172.21.15.133:0/3913114347 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288377691 0 0) 0x7f9e800c9460 con 0x7f9e8006c320 2023-12-18T10:20:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e84ea4640 1 -- 172.21.15.133:0/3913114347 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e6c003530 con 0x7f9e8006c320 2023-12-18T10:20:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e866a7640 1 -- 172.21.15.133:0/3913114347 >> v2:172.21.15.142:3300/0 conn(0x7f9e801570c0 msgr2=0x7f9e8006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e866a7640 1 --2- 172.21.15.133:0/3913114347 >> v2:172.21.15.142:3300/0 conn(0x7f9e801570c0 0x7f9e8006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e866a7640 1 -- 172.21.15.133:0/3913114347 >> v1:172.21.15.133:6789/0 conn(0x7f9e8006c320 legacy=0x7f9e800c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e866a7640 1 -- 172.21.15.133:0/3913114347 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800c8b30 con 0x7f9e800ca000 2023-12-18T10:20:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.323+0000 7f9e85ea6640 1 --2- 172.21.15.133:0/3913114347 >> v2:172.21.15.142:3300/0 conn(0x7f9e801570c0 0x7f9e8006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e866a7640 1 --2- 172.21.15.133:0/3913114347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e80070df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009d90 tx=0x7f9e7801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31cff2864f37a4c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e84ea4640 1 -- 172.21.15.133:0/3913114347 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780a5950 con 0x7f9e800ca000 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e84ea4640 1 -- 172.21.15.133:0/3913114347 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e780a5ab0 con 0x7f9e800ca000 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e84ea4640 1 -- 172.21.15.133:0/3913114347 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780a5e40 con 0x7f9e800ca000 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e8810a640 1 -- 172.21.15.133:0/3913114347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 msgr2=0x7f9e80070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3913114347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e80070df0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009d90 tx=0x7f9e7801c890 comp rx=0 tx=0).stop 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e8810a640 1 -- 172.21.15.133:0/3913114347 shutdown_connections 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3913114347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e80070df0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3913114347 >> v2:172.21.15.142:3300/0 conn(0x7f9e801570c0 0x7f9e8006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e8810a640 1 -- 172.21.15.133:0/3913114347 >> 172.21.15.133:0/3913114347 conn(0x7f9e8006a3e0 msgr2=0x7f9e800afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e8810a640 1 -- 172.21.15.133:0/3913114347 shutdown_connections 2023-12-18T10:20:42.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.327+0000 7f9e8810a640 1 -- 172.21.15.133:0/3913114347 wait complete. 2023-12-18T10:20:42.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 Processor -- start 2023-12-18T10:20:42.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 -- start start 2023-12-18T10:20:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8006c320 0x7f9e800c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e8014aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e801570c0 0x7f9e80158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800cd5e0 con 0x7f9e8006c320 2023-12-18T10:20:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8014cb90 con 0x7f9e801570c0 2023-12-18T10:20:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800c8800 con 0x7f9e800ca000 2023-12-18T10:20:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8006c320 0x7f9e800c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8006c320 0x7f9e800c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56250/0 (socket says 172.21.15.133:56250) 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 -- 172.21.15.133:0/3472185180 learned_addr learned my addr 172.21.15.133:0/3472185180 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e866a7640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e801570c0 0x7f9e80158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e856a5640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e8014aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 -- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 msgr2=0x7f9e8014aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e8014aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 -- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e801570c0 msgr2=0x7f9e80158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e801570c0 0x7f9e80158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 -- 172.21.15.133:0/3472185180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c009420 con 0x7f9e8006c320 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e866a7640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e801570c0 0x7f9e80158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e856a5640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e8014aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e85ea6640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8006c320 0x7f9e800c7a40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00ebe0 tx=0x7f9e7c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e767fc640 1 -- 172.21.15.133:0/3472185180 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c00eee0 con 0x7f9e8006c320 2023-12-18T10:20:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e767fc640 1 -- 172.21.15.133:0/3472185180 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c00cbd0 con 0x7f9e8006c320 2023-12-18T10:20:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e767fc640 1 -- 172.21.15.133:0/3472185180 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c013470 con 0x7f9e8006c320 2023-12-18T10:20:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e78009a70 con 0x7f9e8006c320 2023-12-18T10:20:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.331+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e800c8520 con 0x7f9e8006c320 2023-12-18T10:20:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.335+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e800735b0 con 0x7f9e8006c320 2023-12-18T10:20:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.335+0000 7f9e767fc640 1 -- 172.21.15.133:0/3472185180 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9e7c0135d0 con 0x7f9e8006c320 2023-12-18T10:20:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.335+0000 7f9e767fc640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e64065a60 0x7f9e64067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.335+0000 7f9e767fc640 1 -- 172.21.15.133:0/3472185180 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9e7c083230 con 0x7f9e8006c320 2023-12-18T10:20:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.335+0000 7f9e856a5640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e64065a60 0x7f9e64067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.335+0000 7f9e856a5640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e64065a60 0x7f9e64067f20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9e800c1c10 tx=0x7f9e70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.339+0000 7f9e767fc640 1 -- 172.21.15.133:0/3472185180 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9e7c050df0 con 0x7f9e8006c320 2023-12-18T10:20:42.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.491+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9e8015a9b0 con 0x7f9e8006c320 2023-12-18T10:20:42.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.491+0000 7f9e767fc640 1 -- 172.21.15.133:0/3472185180 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9e7c054410 con 0x7f9e8006c320 2023-12-18T10:20:42.498 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:42.498 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:20:42.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:20:42.499 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-18T10:20:42.499 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-18T10:20:42.499 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:42.499 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:20:42.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e64065a60 msgr2=0x7f9e64067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e64065a60 0x7f9e64067f20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9e800c1c10 tx=0x7f9e70009040 comp rx=0 tx=0).stop 2023-12-18T10:20:42.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8006c320 msgr2=0x7f9e800c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8006c320 0x7f9e800c7a40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00ebe0 tx=0x7f9e7c00c520 comp rx=0 tx=0).stop 2023-12-18T10:20:42.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 shutdown_connections 2023-12-18T10:20:42.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9e64065a60 0x7f9e64067f20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e801570c0 0x7f9e80158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e800ca000 0x7f9e8014aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 --2- 172.21.15.133:0/3472185180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8006c320 0x7f9e800c7a40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 >> 172.21.15.133:0/3472185180 conn(0x7f9e8006a3e0 msgr2=0x7f9e800c3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:42.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 shutdown_connections 2023-12-18T10:20:42.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.495+0000 7f9e8810a640 1 -- 172.21.15.133:0/3472185180 wait complete. 2023-12-18T10:20:42.518 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-18T10:20:42.519 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-18T10:20:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.655+0000 7fe812a63640 1 Processor -- start 2023-12-18T10:20:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.655+0000 7fe812a63640 1 -- start start 2023-12-18T10:20:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.655+0000 7fe812a63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c160e90 0x7fe80c165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.655+0000 7fe812a63640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe80c06be20 0x7fe80c0c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.655+0000 7fe812a63640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0c1d00 con 0x7fe80c0c18b0 2023-12-18T10:20:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.655+0000 7fe812a63640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0b20a0 con 0x7fe80c06be20 2023-12-18T10:20:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.655+0000 7fe812a63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0b2380 con 0x7fe80c160e90 2023-12-18T10:20:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe811000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe80c0c18b0 0x7fe80c0cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56740/0 (socket says 172.21.15.133:56740) 2023-12-18T10:20:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe811000640 1 -- 172.21.15.133:0/3180264618 learned_addr learned my addr 172.21.15.133:0/3180264618 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe8037fe640 1 --2- 172.21.15.133:0/3180264618 >> v2:172.21.15.142:3300/0 conn(0x7fe80c06be20 0x7fe80c0c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80bfff640 1 --2- 172.21.15.133:0/3180264618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c160e90 0x7fe80c165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80b7fe640 1 -- 172.21.15.133:0/3180264618 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951041712 0 0) 0x7fe8040014a0 con 0x7fe80c0c18b0 2023-12-18T10:20:42.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80b7fe640 1 -- 172.21.15.133:0/3180264618 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f8003530 con 0x7fe80c0c18b0 2023-12-18T10:20:42.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80bfff640 1 -- 172.21.15.133:0/3180264618 >> v2:172.21.15.142:3300/0 conn(0x7fe80c06be20 msgr2=0x7fe80c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:42.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80bfff640 1 --2- 172.21.15.133:0/3180264618 >> v2:172.21.15.142:3300/0 conn(0x7fe80c06be20 0x7fe80c0c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80bfff640 1 -- 172.21.15.133:0/3180264618 >> v1:172.21.15.133:6789/0 conn(0x7fe80c0c18b0 legacy=0x7fe80c0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80bfff640 1 -- 172.21.15.133:0/3180264618 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0cc5b0 con 0x7fe80c160e90 2023-12-18T10:20:42.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe8037fe640 1 --2- 172.21.15.133:0/3180264618 >> v2:172.21.15.142:3300/0 conn(0x7fe80c06be20 0x7fe80c0c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80bfff640 1 --2- 172.21.15.133:0/3180264618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c160e90 0x7fe80c165130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40097c0 tx=0x7fe7f401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=722f6fc4c7e9db51 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80b7fe640 1 -- 172.21.15.133:0/3180264618 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40ab600 con 0x7fe80c160e90 2023-12-18T10:20:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80b7fe640 1 -- 172.21.15.133:0/3180264618 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f40a7050 con 0x7fe80c160e90 2023-12-18T10:20:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.659+0000 7fe80b7fe640 1 -- 172.21.15.133:0/3180264618 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40ab960 con 0x7fe80c160e90 2023-12-18T10:20:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- 172.21.15.133:0/3180264618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c160e90 msgr2=0x7fe80c165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 --2- 172.21.15.133:0/3180264618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c160e90 0x7fe80c165130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40097c0 tx=0x7fe7f401c480 comp rx=0 tx=0).stop 2023-12-18T10:20:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- 172.21.15.133:0/3180264618 shutdown_connections 2023-12-18T10:20:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 --2- 172.21.15.133:0/3180264618 >> v2:172.21.15.142:3300/0 conn(0x7fe80c06be20 0x7fe80c0c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 --2- 172.21.15.133:0/3180264618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c160e90 0x7fe80c165130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- 172.21.15.133:0/3180264618 >> 172.21.15.133:0/3180264618 conn(0x7fe80c069e70 msgr2=0x7fe80c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- 172.21.15.133:0/3180264618 shutdown_connections 2023-12-18T10:20:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- 172.21.15.133:0/3180264618 wait complete. 2023-12-18T10:20:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 Processor -- start 2023-12-18T10:20:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- start start 2023-12-18T10:20:42.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c06be20 0x7fe80c15c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80c0c18b0 0x7fe80c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c160e90 0x7fe80c159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0aca10 con 0x7fe80c160e90 2023-12-18T10:20:42.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0ac200 con 0x7fe80c0c18b0 2023-12-18T10:20:42.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe812a63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0ac450 con 0x7fe80c06be20 2023-12-18T10:20:42.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe811000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c160e90 0x7fe80c159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe811000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c160e90 0x7fe80c159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56252/0 (socket says 172.21.15.133:56252) 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe811000640 1 -- 172.21.15.133:0/1234640389 learned_addr learned my addr 172.21.15.133:0/1234640389 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.663+0000 7fe8037fe640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80c0c18b0 0x7fe80c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe80bfff640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c06be20 0x7fe80c15c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe811000640 1 -- 172.21.15.133:0/1234640389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c06be20 msgr2=0x7fe80c15c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe811000640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c06be20 0x7fe80c15c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe811000640 1 -- 172.21.15.133:0/1234640389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80c0c18b0 msgr2=0x7fe80c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe811000640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80c0c18b0 0x7fe80c159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe811000640 1 -- 172.21.15.133:0/1234640389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc009420 con 0x7fe80c160e90 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe811000640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c160e90 0x7fe80c159a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe80400cae0 tx=0x7fe80400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe8097fa640 1 -- 172.21.15.133:0/1234640389 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400ac40 con 0x7fe80c160e90 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe8097fa640 1 -- 172.21.15.133:0/1234640389 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80400ada0 con 0x7fe80c160e90 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe8097fa640 1 -- 172.21.15.133:0/1234640389 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804012620 con 0x7fe80c160e90 2023-12-18T10:20:42.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f4009420 con 0x7fe80c160e90 2023-12-18T10:20:42.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c15ce30 con 0x7fe80c160e90 2023-12-18T10:20:42.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c15cc90 con 0x7fe80c160e90 2023-12-18T10:20:42.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe8097fa640 1 -- 172.21.15.133:0/1234640389 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe804007070 con 0x7fe80c160e90 2023-12-18T10:20:42.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe8097fa640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe7ec065a90 0x7fe7ec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:42.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.667+0000 7fe8097fa640 1 -- 172.21.15.133:0/1234640389 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe804082ca0 con 0x7fe80c160e90 2023-12-18T10:20:42.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.671+0000 7fe80bfff640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe7ec065a90 0x7fe7ec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:42.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.671+0000 7fe80bfff640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe7ec065a90 0x7fe7ec067f50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40ad000 tx=0x7fe7f40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.671+0000 7fe8097fa640 1 -- 172.21.15.133:0/1234640389 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe80c15cc90 con 0x7fe80c160e90 2023-12-18T10:20:42.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:42.827+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe80c0c1d00 con 0x7fe80c160e90 2023-12-18T10:20:43.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.131+0000 7fe8097fa640 1 -- 172.21.15.133:0/1234640389 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe80c0c1d00 con 0x7fe80c160e90 2023-12-18T10:20:43.137 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-18T10:20:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe7ec065a90 msgr2=0x7fe7ec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe7ec065a90 0x7fe7ec067f50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40ad000 tx=0x7fe7f40a6000 comp rx=0 tx=0).stop 2023-12-18T10:20:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c160e90 msgr2=0x7fe80c159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:43.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c160e90 0x7fe80c159a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe80400cae0 tx=0x7fe80400a060 comp rx=0 tx=0).stop 2023-12-18T10:20:43.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 shutdown_connections 2023-12-18T10:20:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe7ec065a90 0x7fe7ec067f50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c160e90 0x7fe80c159a00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80c0c18b0 0x7fe80c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 --2- 172.21.15.133:0/1234640389 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe80c06be20 0x7fe80c15c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.135+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 >> 172.21.15.133:0/1234640389 conn(0x7fe80c069e70 msgr2=0x7fe80c0726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:43.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.139+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 shutdown_connections 2023-12-18T10:20:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.139+0000 7fe812a63640 1 -- 172.21.15.133:0/1234640389 wait complete. 2023-12-18T10:20:43.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-18T10:20:43.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f7a8f2640 1 Processor -- start 2023-12-18T10:20:43.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f7a8f2640 1 -- start start 2023-12-18T10:20:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f7a8f2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f740cf750 0x7f7f740b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f7a8f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 0x7f7f740d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f7a8f2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740b24a0 con 0x7f7f741611c0 2023-12-18T10:20:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f7a8f2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f741615a0 con 0x7f7f740cf750 2023-12-18T10:20:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f7a8f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740b2780 con 0x7f7f740b34e0 2023-12-18T10:20:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f737fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f740cf750 0x7f7f740b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f737fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f740cf750 0x7f7f740b1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56254/0 (socket says 172.21.15.133:56254) 2023-12-18T10:20:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f737fe640 1 -- 172.21.15.133:0/447590624 learned_addr learned my addr 172.21.15.133:0/447590624 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f78e8f640 1 --2- 172.21.15.133:0/447590624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 0x7f7f740d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f737fe640 1 -- 172.21.15.133:0/447590624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 msgr2=0x7f7f740d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f737fe640 1 --2- 172.21.15.133:0/447590624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 0x7f7f740d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f737fe640 1 -- 172.21.15.133:0/447590624 >> v1:172.21.15.142:6789/0 conn(0x7f7f741611c0 legacy=0x7f7f740cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.303+0000 7f7f737fe640 1 -- 172.21.15.133:0/447590624 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f740b2a60 con 0x7f7f740cf750 2023-12-18T10:20:43.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f737fe640 1 --2- 172.21.15.133:0/447590624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f740cf750 0x7f7f740b1ec0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009870 tx=0x7f7f6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c508d48ef955f8ef server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:43.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f72ffd640 1 -- 172.21.15.133:0/447590624 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680ac600 con 0x7f7f740cf750 2023-12-18T10:20:43.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f72ffd640 1 -- 172.21.15.133:0/447590624 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f680a8050 con 0x7f7f740cf750 2023-12-18T10:20:43.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f72ffd640 1 -- 172.21.15.133:0/447590624 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680ac980 con 0x7f7f740cf750 2023-12-18T10:20:43.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/447590624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f740cf750 msgr2=0x7f7f740b1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:43.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/447590624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f740cf750 0x7f7f740b1ec0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009870 tx=0x7f7f6801c4d0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/447590624 shutdown_connections 2023-12-18T10:20:43.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/447590624 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 0x7f7f740d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/447590624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f740cf750 0x7f7f740b1ec0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/447590624 >> 172.21.15.133:0/447590624 conn(0x7f7f74089fb0 msgr2=0x7f7f740d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:43.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/447590624 shutdown_connections 2023-12-18T10:20:43.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.307+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/447590624 wait complete. 2023-12-18T10:20:43.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 Processor -- start 2023-12-18T10:20:43.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 -- start start 2023-12-18T10:20:43.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 0x7f7f740b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f740cf750 0x7f7f741fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f741611c0 0x7f7f741f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740b58b0 con 0x7f7f741611c0 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f741fa350 con 0x7f7f740cf750 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f741fc800 con 0x7f7f740b34e0 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f741611c0 0x7f7f741f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f741611c0 0x7f7f741f9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56264/0 (socket says 172.21.15.133:56264) 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 -- 172.21.15.133:0/172918522 learned_addr learned my addr 172.21.15.133:0/172918522 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f73fff640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 0x7f7f740b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:43.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f737fe640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f740cf750 0x7f7f741fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 -- 172.21.15.133:0/172918522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 msgr2=0x7f7f740b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 0x7f7f740b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 -- 172.21.15.133:0/172918522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f740cf750 msgr2=0x7f7f741fc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f740cf750 0x7f7f741fc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 -- 172.21.15.133:0/172918522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f680094d0 con 0x7f7f741611c0 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f78e8f640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f741611c0 0x7f7f741f9450 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c007e40 tx=0x7f7f6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f70ff9640 1 -- 172.21.15.133:0/172918522 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c014620 con 0x7f7f741611c0 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f70ff9640 1 -- 172.21.15.133:0/172918522 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c00ee90 con 0x7f7f741611c0 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f740af2e0 con 0x7f7f741611c0 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f70ff9640 1 -- 172.21.15.133:0/172918522 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0149e0 con 0x7f7f741611c0 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.311+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f740b8060 con 0x7f7f741611c0 2023-12-18T10:20:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.315+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f740b5120 con 0x7f7f741611c0 2023-12-18T10:20:43.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.315+0000 7f7f70ff9640 1 -- 172.21.15.133:0/172918522 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f6c014b40 con 0x7f7f741611c0 2023-12-18T10:20:43.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.315+0000 7f7f70ff9640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f60065a30 0x7f7f60067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:43.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.315+0000 7f7f70ff9640 1 -- 172.21.15.133:0/172918522 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f7f6c083970 con 0x7f7f741611c0 2023-12-18T10:20:43.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.315+0000 7f7f73fff640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f60065a30 0x7f7f60067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:43.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.315+0000 7f7f73fff640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f60065a30 0x7f7f60067ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7f740c6010 tx=0x7f7f64009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:43.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.319+0000 7f7f70ff9640 1 -- 172.21.15.133:0/172918522 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7f6c051470 con 0x7f7f741611c0 2023-12-18T10:20:43.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:43.471+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7f7404e000 con 0x7f7f741611c0 2023-12-18T10:20:44.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.135+0000 7f7f70ff9640 1 -- 172.21.15.133:0/172918522 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v51) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7f6c054a90 con 0x7f7f741611c0 2023-12-18T10:20:44.141 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f60065a30 msgr2=0x7f7f60067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f60065a30 0x7f7f60067ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7f740c6010 tx=0x7f7f64009060 comp rx=0 tx=0).stop 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f741611c0 msgr2=0x7f7f741f9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f741611c0 0x7f7f741f9450 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c007e40 tx=0x7f7f6c00e4b0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 shutdown_connections 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f60065a30 0x7f7f60067ef0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f741611c0 0x7f7f741f9450 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f740cf750 0x7f7f741fc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 --2- 172.21.15.133:0/172918522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f740b34e0 0x7f7f740b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.139+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 >> 172.21.15.133:0/172918522 conn(0x7f7f74089fb0 msgr2=0x7f7f74156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:44.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.143+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 shutdown_connections 2023-12-18T10:20:44.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.143+0000 7f7f7a8f2640 1 -- 172.21.15.133:0/172918522 wait complete. 2023-12-18T10:20:44.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-18T10:20:44.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e688c640 1 Processor -- start 2023-12-18T10:20:44.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e688c640 1 -- start start 2023-12-18T10:20:44.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e688c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5e00ceac0 0x7fa5e00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e688c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e00c9390 con 0x7fa5e0070820 2023-12-18T10:20:44.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e688c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e015aee0 con 0x7fa5e01582d0 2023-12-18T10:20:44.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e688c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e015b1c0 con 0x7fa5e00ceac0 2023-12-18T10:20:44.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e4e29640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5e00ceac0 0x7fa5e00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e4e29640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5e00ceac0 0x7fa5e00c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56270/0 (socket says 172.21.15.133:56270) 2023-12-18T10:20:44.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e4e29640 1 -- 172.21.15.133:0/2882828764 learned_addr learned my addr 172.21.15.133:0/2882828764 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:44.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5df7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa5e0070820 0x7fa5e00ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56752/0 (socket says 172.21.15.133:56752) 2023-12-18T10:20:44.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e4e29640 1 -- 172.21.15.133:0/2882828764 >> v1:172.21.15.142:6789/0 conn(0x7fa5e01582d0 legacy=0x7fa5e00ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e4e29640 1 -- 172.21.15.133:0/2882828764 >> v1:172.21.15.133:6789/0 conn(0x7fa5e0070820 legacy=0x7fa5e00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5e4e29640 1 -- 172.21.15.133:0/2882828764 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e015b4a0 con 0x7fa5e00ceac0 2023-12-18T10:20:44.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.319+0000 7fa5deffd640 1 -- 172.21.15.133:0/2882828764 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916729980 0 0) 0x7fa5e00c9390 con 0x7fa5e0070820 2023-12-18T10:20:44.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5e4e29640 1 --2- 172.21.15.133:0/2882828764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e00ceac0 0x7fa5e00c8e50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009e50 tx=0x7fa5d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746add42d61efe07 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5deffd640 1 -- 172.21.15.133:0/2882828764 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80a58d0 con 0x7fa5e00ceac0 2023-12-18T10:20:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5deffd640 1 -- 172.21.15.133:0/2882828764 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d80a5a30 con 0x7fa5e00ceac0 2023-12-18T10:20:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5deffd640 1 -- 172.21.15.133:0/2882828764 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80a5dc0 con 0x7fa5e00ceac0 2023-12-18T10:20:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5e688c640 1 -- 172.21.15.133:0/2882828764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e00ceac0 msgr2=0x7fa5e00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5e688c640 1 --2- 172.21.15.133:0/2882828764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e00ceac0 0x7fa5e00c8e50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009e50 tx=0x7fa5d801c9e0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5e688c640 1 -- 172.21.15.133:0/2882828764 shutdown_connections 2023-12-18T10:20:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5e688c640 1 --2- 172.21.15.133:0/2882828764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e00ceac0 0x7fa5e00c8e50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5e688c640 1 -- 172.21.15.133:0/2882828764 >> 172.21.15.133:0/2882828764 conn(0x7fa5e006a2a0 msgr2=0x7fa5e00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:44.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5e688c640 1 -- 172.21.15.133:0/2882828764 shutdown_connections 2023-12-18T10:20:44.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.323+0000 7fa5e688c640 1 -- 172.21.15.133:0/2882828764 wait complete. 2023-12-18T10:20:44.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 Processor -- start 2023-12-18T10:20:44.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 -- start start 2023-12-18T10:20:44.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0070820 0x7fa5e00c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e00ceac0 0x7fa5e0151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e01582d0 0x7fa5e00c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00c4df0 con 0x7fa5e0070820 2023-12-18T10:20:44.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00c2f50 con 0x7fa5e00ceac0 2023-12-18T10:20:44.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00c76a0 con 0x7fa5e01582d0 2023-12-18T10:20:44.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0070820 0x7fa5e00c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0070820 0x7fa5e00c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56284/0 (socket says 172.21.15.133:56284) 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 -- 172.21.15.133:0/1693319721 learned_addr learned my addr 172.21.15.133:0/1693319721 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5df7fe640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e00ceac0 0x7fa5e0151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e4e29640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e01582d0 0x7fa5e00c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 -- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e01582d0 msgr2=0x7fa5e00c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e01582d0 0x7fa5e00c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 -- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e00ceac0 msgr2=0x7fa5e0151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e00ceac0 0x7fa5e0151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 -- 172.21.15.133:0/1693319721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d8009b30 con 0x7fa5e0070820 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e4e29640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e01582d0 0x7fa5e00c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dffff640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0070820 0x7fa5e00c54f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c3c0 tx=0x7fa5d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:44.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dcff9640 1 -- 172.21.15.133:0/1693319721 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00052d0 con 0x7fa5e0070820 2023-12-18T10:20:44.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dcff9640 1 -- 172.21.15.133:0/1693319721 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d0005430 con 0x7fa5e0070820 2023-12-18T10:20:44.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5dcff9640 1 -- 172.21.15.133:0/1693319721 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d0003840 con 0x7fa5e0070820 2023-12-18T10:20:44.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e00c7980 con 0x7fa5e0070820 2023-12-18T10:20:44.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.327+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e0152510 con 0x7fa5e0070820 2023-12-18T10:20:44.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.331+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e00c2db0 con 0x7fa5e0070820 2023-12-18T10:20:44.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.331+0000 7fa5dcff9640 1 -- 172.21.15.133:0/1693319721 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa5d00039a0 con 0x7fa5e0070820 2023-12-18T10:20:44.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.331+0000 7fa5dcff9640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5cc065a60 0x7fa5cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.331+0000 7fa5dcff9640 1 -- 172.21.15.133:0/1693319721 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fa5d0082850 con 0x7fa5e0070820 2023-12-18T10:20:44.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.331+0000 7fa5df7fe640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5cc065a60 0x7fa5cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.331+0000 7fa5df7fe640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5cc065a60 0x7fa5cc067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0153060 tx=0x7fa5d4007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:44.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.335+0000 7fa5dcff9640 1 -- 172.21.15.133:0/1693319721 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa5e00c2db0 con 0x7fa5e0070820 2023-12-18T10:20:44.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.515+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa5e00c2db0 con 0x7fa5e0070820 2023-12-18T10:20:44.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.527+0000 7fa5dcff9640 1 -- 172.21.15.133:0/1693319721 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa5e00c2db0 con 0x7fa5e0070820 2023-12-18T10:20:44.534 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 7 and data pool 8 2023-12-18T10:20:44.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.531+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5cc065a60 msgr2=0x7fa5cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.531+0000 7fa5e688c640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5cc065a60 0x7fa5cc067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0153060 tx=0x7fa5d4007b80 comp rx=0 tx=0).stop 2023-12-18T10:20:44.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.531+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0070820 msgr2=0x7fa5e00c54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.531+0000 7fa5e688c640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0070820 0x7fa5e00c54f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000c3c0 tx=0x7fa5d000c880 comp rx=0 tx=0).stop 2023-12-18T10:20:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.539+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 shutdown_connections 2023-12-18T10:20:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.539+0000 7fa5e688c640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5cc065a60 0x7fa5cc067f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.539+0000 7fa5e688c640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5e01582d0 0x7fa5e00c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.539+0000 7fa5e688c640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5e00ceac0 0x7fa5e0151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.539+0000 7fa5e688c640 1 --2- 172.21.15.133:0/1693319721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0070820 0x7fa5e00c54f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.539+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 >> 172.21.15.133:0/1693319721 conn(0x7fa5e006a2a0 msgr2=0x7fa5e0153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:44.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.547+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 shutdown_connections 2023-12-18T10:20:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.547+0000 7fa5e688c640 1 -- 172.21.15.133:0/1693319721 wait complete. 2023-12-18T10:20:44.586 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:20:44.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.719+0000 7f9f800e5640 1 Processor -- start 2023-12-18T10:20:44.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.719+0000 7f9f800e5640 1 -- start start 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f800e5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f7815a680 0x7f9f7815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f800e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f7815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f800e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7815f100 con 0x7f9f7815afa0 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f800e5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f780ca7d0 con 0x7f9f7815a680 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f800e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7815e860 con 0x7f9f780cac10 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7de81640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f7815a680 0x7f9f7815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7de81640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f7815a680 0x7f9f7815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56298/0 (socket says 172.21.15.133:56298) 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7de81640 1 -- 172.21.15.133:0/4056424366 learned_addr learned my addr 172.21.15.133:0/4056424366 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7d680640 1 --2- 172.21.15.133:0/4056424366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f7815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7de81640 1 -- 172.21.15.133:0/4056424366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 msgr2=0x7f9f7815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:44.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7de81640 1 --2- 172.21.15.133:0/4056424366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f7815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7de81640 1 -- 172.21.15.133:0/4056424366 >> v1:172.21.15.142:6789/0 conn(0x7f9f7815afa0 legacy=0x7f9f7806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:44.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7de81640 1 -- 172.21.15.133:0/4056424366 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7815eb40 con 0x7f9f7815a680 2023-12-18T10:20:44.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7d680640 1 --2- 172.21.15.133:0/4056424366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f7815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:44.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.723+0000 7f9f7de81640 1 --2- 172.21.15.133:0/4056424366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815e160 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009870 tx=0x7f9f7401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb5f4de1ee8087d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:44.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f7ce7f640 1 -- 172.21.15.133:0/4056424366 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740a7070 con 0x7f9f7815a680 2023-12-18T10:20:44.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f7ce7f640 1 -- 172.21.15.133:0/4056424366 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f740ab430 con 0x7f9f7815a680 2023-12-18T10:20:44.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f7ce7f640 1 -- 172.21.15.133:0/4056424366 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740ab7c0 con 0x7f9f7815a680 2023-12-18T10:20:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- 172.21.15.133:0/4056424366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 msgr2=0x7f9f7815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 --2- 172.21.15.133:0/4056424366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815e160 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009870 tx=0x7f9f7401c470 comp rx=0 tx=0).stop 2023-12-18T10:20:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- 172.21.15.133:0/4056424366 shutdown_connections 2023-12-18T10:20:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 --2- 172.21.15.133:0/4056424366 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f7815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 --2- 172.21.15.133:0/4056424366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815e160 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- 172.21.15.133:0/4056424366 >> 172.21.15.133:0/4056424366 conn(0x7f9f7806a3e0 msgr2=0x7f9f780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:44.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- 172.21.15.133:0/4056424366 shutdown_connections 2023-12-18T10:20:44.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- 172.21.15.133:0/4056424366 wait complete. 2023-12-18T10:20:44.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 Processor -- start 2023-12-18T10:20:44.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- start start 2023-12-18T10:20:44.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f78155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f7815afa0 0x7f9f780c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780c84b0 con 0x7f9f7815a680 2023-12-18T10:20:44.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f781f4f80 con 0x7f9f7815afa0 2023-12-18T10:20:44.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.727+0000 7f9f800e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f781f5260 con 0x7f9f780cac10 2023-12-18T10:20:44.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56304/0 (socket says 172.21.15.133:56304) 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 -- 172.21.15.133:0/2166364549 learned_addr learned my addr 172.21.15.133:0/2166364549 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7de81640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f78155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7e682640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f7815afa0 0x7f9f780c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 -- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 msgr2=0x7f9f78155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f78155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 -- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f7815afa0 msgr2=0x7f9f780c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f7815afa0 0x7f9f780c2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 -- 172.21.15.133:0/2166364549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740094d0 con 0x7f9f7815a680 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7de81640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f78155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7e682640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f7815afa0 0x7f9f780c2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f7d680640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815cac0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800c7c0 tx=0x7f9f6800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/2166364549 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f68007a30 con 0x7f9f7815a680 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/2166364549 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f68007b90 con 0x7f9f7815a680 2023-12-18T10:20:44.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/2166364549 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800ce70 con 0x7f9f7815a680 2023-12-18T10:20:44.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f781f5540 con 0x7f9f7815a680 2023-12-18T10:20:44.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f78155950 con 0x7f9f7815a680 2023-12-18T10:20:44.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f780735b0 con 0x7f9f7815a680 2023-12-18T10:20:44.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/2166364549 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9f680113f0 con 0x7f9f7815a680 2023-12-18T10:20:44.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f6e7fc640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f5c065a60 0x7f9f5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:44.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.731+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/2166364549 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9f68083710 con 0x7f9f7815a680 2023-12-18T10:20:44.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.735+0000 7f9f7de81640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f5c065a60 0x7f9f5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:44.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.735+0000 7f9f7de81640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f5c065a60 0x7f9f5c067f20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9f740af000 tx=0x7f9f74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:44.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.735+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/2166364549 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9f68051020 con 0x7f9f7815a680 2023-12-18T10:20:44.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.887+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f7804e000 con 0x7f9f7815a680 2023-12-18T10:20:44.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/2166364549 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16367 (secure 0 0 0) 0x7f9f68054640 con 0x7f9f7815a680 2023-12-18T10:20:44.896 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:44.896 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":52,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:20:44.521855+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:20:42.874010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-18T10:20:43.517857+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:20:44.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f5c065a60 msgr2=0x7f9f5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f5c065a60 0x7f9f5c067f20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9f740af000 tx=0x7f9f74008040 comp rx=0 tx=0).stop 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 msgr2=0x7f9f7815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815cac0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800c7c0 tx=0x7f9f6800cc80 comp rx=0 tx=0).stop 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 shutdown_connections 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f5c065a60 0x7f9f5c067f20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f7815afa0 0x7f9f780c2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f7815a680 0x7f9f7815cac0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 --2- 172.21.15.133:0/2166364549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9f780cac10 0x7f9f78155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 >> 172.21.15.133:0/2166364549 conn(0x7f9f7806a3e0 msgr2=0x7f9f780ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 shutdown_connections 2023-12-18T10:20:44.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:44.891+0000 7f9f800e5640 1 -- 172.21.15.133:0/2166364549 wait complete. 2023-12-18T10:20:44.917 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:20:45.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7fefc640 1 Processor -- start 2023-12-18T10:20:45.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7fefc640 1 -- start start 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7fefc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8c78160cc0 0x7f8c780cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7fefc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c780c17d0 0x7f8c780cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7fefc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7806fdb0 con 0x7f8c780c1280 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7fefc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c781654a0 con 0x7f8c780c17d0 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7fefc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c781610a0 con 0x7f8c78160cc0 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7e499640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c780c17d0 0x7f8c780cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7e499640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c780c17d0 0x7f8c780cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56314/0 (socket says 172.21.15.133:56314) 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7e499640 1 -- 172.21.15.133:0/1096969327 learned_addr learned my addr 172.21.15.133:0/1096969327 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:45.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.051+0000 7f8c7dc98640 1 --2- 172.21.15.133:0/1096969327 >> v2:172.21.15.142:3300/0 conn(0x7f8c78160cc0 0x7f8c780cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7e499640 1 -- 172.21.15.133:0/1096969327 >> v2:172.21.15.142:3300/0 conn(0x7f8c78160cc0 msgr2=0x7f8c780cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:45.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7e499640 1 --2- 172.21.15.133:0/1096969327 >> v2:172.21.15.142:3300/0 conn(0x7f8c78160cc0 0x7f8c780cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7e499640 1 -- 172.21.15.133:0/1096969327 >> v1:172.21.15.142:6789/0 conn(0x7f8c780c1280 legacy=0x7f8c7806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7e499640 1 -- 172.21.15.133:0/1096969327 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780cb6b0 con 0x7f8c780c17d0 2023-12-18T10:20:45.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7e499640 1 --2- 172.21.15.133:0/1096969327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c780c17d0 0x7f8c780cb170 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8c7806ce80 tx=0x7f8c7001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5060737a96fa69f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:45.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7cc96640 1 -- 172.21.15.133:0/1096969327 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700a56f0 con 0x7f8c780c17d0 2023-12-18T10:20:45.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7cc96640 1 -- 172.21.15.133:0/1096969327 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c700a5850 con 0x7f8c780c17d0 2023-12-18T10:20:45.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7cc96640 1 -- 172.21.15.133:0/1096969327 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700a5be0 con 0x7f8c780c17d0 2023-12-18T10:20:45.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7fefc640 1 -- 172.21.15.133:0/1096969327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c780c17d0 msgr2=0x7f8c780cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.055+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/1096969327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c780c17d0 0x7f8c780cb170 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8c7806ce80 tx=0x7f8c7001c910 comp rx=0 tx=0).stop 2023-12-18T10:20:45.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 -- 172.21.15.133:0/1096969327 shutdown_connections 2023-12-18T10:20:45.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/1096969327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c780c17d0 0x7f8c780cb170 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/1096969327 >> v2:172.21.15.142:3300/0 conn(0x7f8c78160cc0 0x7f8c780cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 -- 172.21.15.133:0/1096969327 >> 172.21.15.133:0/1096969327 conn(0x7f8c7806a3e0 msgr2=0x7f8c780afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:45.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 -- 172.21.15.133:0/1096969327 shutdown_connections 2023-12-18T10:20:45.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 -- 172.21.15.133:0/1096969327 wait complete. 2023-12-18T10:20:45.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 Processor -- start 2023-12-18T10:20:45.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 -- start start 2023-12-18T10:20:45.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c1280 0x7f8c7815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c780c17d0 0x7f8c781579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c78160cc0 0x7f8c78155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78156b10 con 0x7f8c78160cc0 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780b16b0 con 0x7f8c780c17d0 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7fefc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78156830 con 0x7f8c780c1280 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7e499640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c78160cc0 0x7f8c78155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7dc98640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c1280 0x7f8c7815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7e499640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c78160cc0 0x7f8c78155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56320/0 (socket says 172.21.15.133:56320) 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7d497640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c780c17d0 0x7f8c781579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7e499640 1 -- 172.21.15.133:0/3074818487 learned_addr learned my addr 172.21.15.133:0/3074818487 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7e499640 1 -- 172.21.15.133:0/3074818487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c1280 msgr2=0x7f8c7815fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7e499640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c1280 0x7f8c7815fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7e499640 1 -- 172.21.15.133:0/3074818487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c780c17d0 msgr2=0x7f8c781579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7e499640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c780c17d0 0x7f8c781579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.059+0000 7f8c7e499640 1 -- 172.21.15.133:0/3074818487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70009b30 con 0x7f8c78160cc0 2023-12-18T10:20:45.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c7e499640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c78160cc0 0x7f8c78155790 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8c700af040 tx=0x7f8c700196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:45.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c6e7fc640 1 -- 172.21.15.133:0/3074818487 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700b8670 con 0x7f8c78160cc0 2023-12-18T10:20:45.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c6e7fc640 1 -- 172.21.15.133:0/3074818487 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c700b87d0 con 0x7f8c78160cc0 2023-12-18T10:20:45.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c6e7fc640 1 -- 172.21.15.133:0/3074818487 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c700b8b80 con 0x7f8c78160cc0 2023-12-18T10:20:45.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c780b1060 con 0x7f8c78160cc0 2023-12-18T10:20:45.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c78160420 con 0x7f8c78160cc0 2023-12-18T10:20:45.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c780735b0 con 0x7f8c78160cc0 2023-12-18T10:20:45.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c6e7fc640 1 -- 172.21.15.133:0/3074818487 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8c700b8ce0 con 0x7f8c78160cc0 2023-12-18T10:20:45.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c6e7fc640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c5c065a60 0x7f8c5c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c6e7fc640 1 -- 172.21.15.133:0/3074818487 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8c7011e520 con 0x7f8c78160cc0 2023-12-18T10:20:45.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c7dc98640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c5c065a60 0x7f8c5c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.063+0000 7f8c7dc98640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c5c065a60 0x7f8c5c067f20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009ac0 tx=0x7f8c74009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:45.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.067+0000 7f8c6e7fc640 1 -- 172.21.15.133:0/3074818487 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8c700ebe80 con 0x7f8c78160cc0 2023-12-18T10:20:45.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.227+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c7804e000 con 0x7f8c78160cc0 2023-12-18T10:20:45.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.227+0000 7f8c6e7fc640 1 -- 172.21.15.133:0/3074818487 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16367 (secure 0 0 0) 0x7f8c70009510 con 0x7f8c78160cc0 2023-12-18T10:20:45.233 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:45.233 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":52,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:20:44.521855+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:20:42.874010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-18T10:20:43.517857+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c5c065a60 msgr2=0x7f8c5c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c5c065a60 0x7f8c5c067f20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009ac0 tx=0x7f8c74009190 comp rx=0 tx=0).stop 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c78160cc0 msgr2=0x7f8c78155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c78160cc0 0x7f8c78155790 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8c700af040 tx=0x7f8c700196b0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 shutdown_connections 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c5c065a60 0x7f8c5c067f20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c78160cc0 0x7f8c78155790 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c780c17d0 0x7f8c781579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 --2- 172.21.15.133:0/3074818487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c780c1280 0x7f8c7815fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 >> 172.21.15.133:0/3074818487 conn(0x7f8c7806a3e0 msgr2=0x7f8c780adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:45.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 shutdown_connections 2023-12-18T10:20:45.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.231+0000 7f8c7fefc640 1 -- 172.21.15.133:0/3074818487 wait complete. 2023-12-18T10:20:45.254 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-18T10:20:45.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed3ae2d640 1 Processor -- start 2023-12-18T10:20:45.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed3ae2d640 1 -- start start 2023-12-18T10:20:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed3ae2d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed34071870 0x7fed34071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed3ae2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fed340cbff0 0x7fed340cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed3ae2d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed340cc930 con 0x7fed340ca410 2023-12-18T10:20:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed3ae2d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3415aab0 con 0x7fed34071870 2023-12-18T10:20:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed3ae2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed34070df0 con 0x7fed340cbff0 2023-12-18T10:20:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed2bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed34071870 0x7fed34071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed2bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed34071870 0x7fed34071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56332/0 (socket says 172.21.15.133:56332) 2023-12-18T10:20:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed2bfff640 1 -- 172.21.15.133:0/85549943 learned_addr learned my addr 172.21.15.133:0/85549943 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed393ca640 1 --2- 172.21.15.133:0/85549943 >> v2:172.21.15.142:3300/0 conn(0x7fed340cbff0 0x7fed340cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed2bfff640 1 -- 172.21.15.133:0/85549943 >> v2:172.21.15.142:3300/0 conn(0x7fed340cbff0 msgr2=0x7fed340cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed2bfff640 1 --2- 172.21.15.133:0/85549943 >> v2:172.21.15.142:3300/0 conn(0x7fed340cbff0 0x7fed340cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed2bfff640 1 -- 172.21.15.133:0/85549943 >> v1:172.21.15.142:6789/0 conn(0x7fed340ca410 legacy=0x7fed34159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.391+0000 7fed2bfff640 1 -- 172.21.15.133:0/85549943 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3415a4f0 con 0x7fed34071870 2023-12-18T10:20:45.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed2bfff640 1 --2- 172.21.15.133:0/85549943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed34071d00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fed340cbeb0 tx=0x7fed2401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ed9e7adccbd54b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:45.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed2b7fe640 1 -- 172.21.15.133:0/85549943 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240ab670 con 0x7fed34071870 2023-12-18T10:20:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed2b7fe640 1 -- 172.21.15.133:0/85549943 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed240ab7d0 con 0x7fed34071870 2023-12-18T10:20:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed2b7fe640 1 -- 172.21.15.133:0/85549943 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240abb60 con 0x7fed34071870 2023-12-18T10:20:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed3ae2d640 1 -- 172.21.15.133:0/85549943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 msgr2=0x7fed34071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/85549943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed34071d00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fed340cbeb0 tx=0x7fed2401c470 comp rx=0 tx=0).stop 2023-12-18T10:20:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed3ae2d640 1 -- 172.21.15.133:0/85549943 shutdown_connections 2023-12-18T10:20:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/85549943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed34071d00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/85549943 >> v2:172.21.15.142:3300/0 conn(0x7fed340cbff0 0x7fed340cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed3ae2d640 1 -- 172.21.15.133:0/85549943 >> 172.21.15.133:0/85549943 conn(0x7fed3406a2a0 msgr2=0x7fed340aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed3ae2d640 1 -- 172.21.15.133:0/85549943 shutdown_connections 2023-12-18T10:20:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.395+0000 7fed3ae2d640 1 -- 172.21.15.133:0/85549943 wait complete. 2023-12-18T10:20:45.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 Processor -- start 2023-12-18T10:20:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 -- start start 2023-12-18T10:20:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed340acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed340ca410 0x7fed341580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed340cbff0 0x7fed341f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed341585e0 con 0x7fed34071870 2023-12-18T10:20:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340c3ac0 con 0x7fed340cbff0 2023-12-18T10:20:45.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340c3d60 con 0x7fed340ca410 2023-12-18T10:20:45.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed340acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed340acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56346/0 (socket says 172.21.15.133:56346) 2023-12-18T10:20:45.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 -- 172.21.15.133:0/3625443123 learned_addr learned my addr 172.21.15.133:0/3625443123 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:45.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed2bfff640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed340ca410 0x7fed341580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed393ca640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed340cbff0 0x7fed341f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 -- 172.21.15.133:0/3625443123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed340ca410 msgr2=0x7fed341580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed340ca410 0x7fed341580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 -- 172.21.15.133:0/3625443123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed340cbff0 msgr2=0x7fed341f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:45.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed340cbff0 0x7fed341f44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:45.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 -- 172.21.15.133:0/3625443123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240094d0 con 0x7fed34071870 2023-12-18T10:20:45.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed38bc9640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed340acfc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c450 tx=0x7fed3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:45.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed297fa640 1 -- 172.21.15.133:0/3625443123 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30012830 con 0x7fed34071870 2023-12-18T10:20:45.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed297fa640 1 -- 172.21.15.133:0/3625443123 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed300129b0 con 0x7fed34071870 2023-12-18T10:20:45.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed340c4040 con 0x7fed34071870 2023-12-18T10:20:45.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed297fa640 1 -- 172.21.15.133:0/3625443123 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30012d60 con 0x7fed34071870 2023-12-18T10:20:45.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.399+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed340ad5a0 con 0x7fed34071870 2023-12-18T10:20:45.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.403+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3404e000 con 0x7fed34071870 2023-12-18T10:20:45.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.403+0000 7fed297fa640 1 -- 172.21.15.133:0/3625443123 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fed3001c460 con 0x7fed34071870 2023-12-18T10:20:45.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.403+0000 7fed297fa640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fed20065a60 0x7fed20067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:45.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.403+0000 7fed297fa640 1 -- 172.21.15.133:0/3625443123 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fed30082fc0 con 0x7fed34071870 2023-12-18T10:20:45.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.403+0000 7fed2bfff640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fed20065a60 0x7fed20067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:45.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.403+0000 7fed2bfff640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fed20065a60 0x7fed20067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fed240af000 tx=0x7fed240b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:45.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.407+0000 7fed297fa640 1 -- 172.21.15.133:0/3625443123 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fed300b40a0 con 0x7fed34071870 2023-12-18T10:20:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:45.591+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fed340b0d00 con 0x7fed34071870 2023-12-18T10:20:45.995 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:20:45.991+0000 7fdb104c0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:20:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed297fa640 1 -- 172.21.15.133:0/3625443123 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fed300508d0 con 0x7fed34071870 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fed20065a60 msgr2=0x7fed20067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fed20065a60 0x7fed20067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fed240af000 tx=0x7fed240b6040 comp rx=0 tx=0).stop 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 msgr2=0x7fed340acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed340acfc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fed3000c450 tx=0x7fed3000c910 comp rx=0 tx=0).stop 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 shutdown_connections 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fed20065a60 0x7fed20067f20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fed340cbff0 0x7fed341f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fed340ca410 0x7fed341580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 --2- 172.21.15.133:0/3625443123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed34071870 0x7fed340acfc0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 >> 172.21.15.133:0/3625443123 conn(0x7fed3406a2a0 msgr2=0x7fed340cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 shutdown_connections 2023-12-18T10:20:46.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.527+0000 7fed3ae2d640 1 -- 172.21.15.133:0/3625443123 wait complete. 2023-12-18T10:20:46.555 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-18T10:20:46.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-18T10:20:46.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.691+0000 7f5187b52640 1 Processor -- start 2023-12-18T10:20:46.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.691+0000 7f5187b52640 1 -- start start 2023-12-18T10:20:46.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f5187b52640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5180153020 0x7f51800c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:46.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f5187b52640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f51800ceaa0 0x7f5180070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:46.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f5187b52640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51800c9730 con 0x7f51801598d0 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f5187b52640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800c8e00 con 0x7f5180153020 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f5187b52640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800c90e0 con 0x7f51800ceaa0 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51858ee640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5180153020 0x7f51800c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51858ee640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5180153020 0x7f51800c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56362/0 (socket says 172.21.15.133:56362) 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51850ed640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f51801598d0 0x7f51800ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56764/0 (socket says 172.21.15.133:56764) 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51858ee640 1 -- 172.21.15.133:0/724679225 learned_addr learned my addr 172.21.15.133:0/724679225 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51860ef640 1 --2- 172.21.15.133:0/724679225 >> v2:172.21.15.142:3300/0 conn(0x7f51800ceaa0 0x7f5180070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51858ee640 1 -- 172.21.15.133:0/724679225 >> v2:172.21.15.142:3300/0 conn(0x7f51800ceaa0 msgr2=0x7f5180070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51858ee640 1 --2- 172.21.15.133:0/724679225 >> v2:172.21.15.142:3300/0 conn(0x7f51800ceaa0 0x7f5180070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51858ee640 1 -- 172.21.15.133:0/724679225 >> v1:172.21.15.133:6789/0 conn(0x7f51801598d0 legacy=0x7f51800ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51858ee640 1 -- 172.21.15.133:0/724679225 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51800c93c0 con 0x7f5180153020 2023-12-18T10:20:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.695+0000 7f51848ec640 1 -- 172.21.15.133:0/724679225 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898505650 0 0) 0x7f51800c9730 con 0x7f51801598d0 2023-12-18T10:20:46.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f51858ee640 1 --2- 172.21.15.133:0/724679225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51800c9bc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f51800ca6e0 tx=0x7f517c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7511f7680908b93 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:46.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f51848ec640 1 -- 172.21.15.133:0/724679225 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0ab600 con 0x7f5180153020 2023-12-18T10:20:46.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f51848ec640 1 -- 172.21.15.133:0/724679225 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c0a7050 con 0x7f5180153020 2023-12-18T10:20:46.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f51848ec640 1 -- 172.21.15.133:0/724679225 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0ab980 con 0x7f5180153020 2023-12-18T10:20:46.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 -- 172.21.15.133:0/724679225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 msgr2=0x7f51800c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:46.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 --2- 172.21.15.133:0/724679225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51800c9bc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f51800ca6e0 tx=0x7f517c01c380 comp rx=0 tx=0).stop 2023-12-18T10:20:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 -- 172.21.15.133:0/724679225 shutdown_connections 2023-12-18T10:20:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 --2- 172.21.15.133:0/724679225 >> v2:172.21.15.142:3300/0 conn(0x7f51800ceaa0 0x7f5180070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 --2- 172.21.15.133:0/724679225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51800c9bc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 -- 172.21.15.133:0/724679225 >> 172.21.15.133:0/724679225 conn(0x7f518006a2a0 msgr2=0x7f51800aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 -- 172.21.15.133:0/724679225 shutdown_connections 2023-12-18T10:20:46.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 -- 172.21.15.133:0/724679225 wait complete. 2023-12-18T10:20:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 Processor -- start 2023-12-18T10:20:46.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 -- start start 2023-12-18T10:20:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.699+0000 7f5187b52640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51800ceaa0 0x7f51800cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f5187b52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51801525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f5187b52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51801598d0 0x7f5180165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f5187b52640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518014dbd0 con 0x7f5180153020 2023-12-18T10:20:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f5187b52640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518014cce0 con 0x7f51800ceaa0 2023-12-18T10:20:46.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f5187b52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518014cfc0 con 0x7f51801598d0 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51801525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51801525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56376/0 (socket says 172.21.15.133:56376) 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 -- 172.21.15.133:0/1681396671 learned_addr learned my addr 172.21.15.133:0/1681396671 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51858ee640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51800ceaa0 0x7f51800cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51860ef640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51801598d0 0x7f5180165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 -- 172.21.15.133:0/1681396671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51801598d0 msgr2=0x7f5180165d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51801598d0 0x7f5180165d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 -- 172.21.15.133:0/1681396671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51800ceaa0 msgr2=0x7f51800cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51800ceaa0 0x7f51800cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 -- 172.21.15.133:0/1681396671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0094d0 con 0x7f5180153020 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51850ed640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51801525b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f51700011f0 tx=0x7f517000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51767fc640 1 -- 172.21.15.133:0/1681396671 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51700074e0 con 0x7f5180153020 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51767fc640 1 -- 172.21.15.133:0/1681396671 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5170007640 con 0x7f5180153020 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51767fc640 1 -- 172.21.15.133:0/1681396671 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170004a10 con 0x7f5180153020 2023-12-18T10:20:46.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518014d2a0 con 0x7f5180153020 2023-12-18T10:20:46.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518014d860 con 0x7f5180153020 2023-12-18T10:20:46.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518014dd80 con 0x7f5180153020 2023-12-18T10:20:46.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.703+0000 7f51767fc640 1 -- 172.21.15.133:0/1681396671 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5170004b70 con 0x7f5180153020 2023-12-18T10:20:46.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.707+0000 7f51767fc640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5164065a90 0x7f5164067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:46.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.707+0000 7f51767fc640 1 -- 172.21.15.133:0/1681396671 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f51700823d0 con 0x7f5180153020 2023-12-18T10:20:46.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.707+0000 7f51858ee640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5164065a90 0x7f5164067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:46.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.707+0000 7f51858ee640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5164065a90 0x7f5164067f50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f517c0ad000 tx=0x7f517c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:46.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.707+0000 7f51767fc640 1 -- 172.21.15.133:0/1681396671 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f517004fcf0 con 0x7f5180153020 2023-12-18T10:20:46.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:46.891+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f518004e000 con 0x7f5180153020 2023-12-18T10:20:47.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.535+0000 7f51767fc640 1 -- 172.21.15.133:0/1681396671 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5170053310 con 0x7f5180153020 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5164065a90 msgr2=0x7f5164067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5164065a90 0x7f5164067f50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f517c0ad000 tx=0x7f517c0a6000 comp rx=0 tx=0).stop 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 msgr2=0x7f51801525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51801525b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f51700011f0 tx=0x7f517000c9b0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 shutdown_connections 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5164065a90 0x7f5164067f50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f51801598d0 0x7f5180165d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5180153020 0x7f51801525b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 --2- 172.21.15.133:0/1681396671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f51800ceaa0 0x7f51800cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 >> 172.21.15.133:0/1681396671 conn(0x7f518006a2a0 msgr2=0x7f5180159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:47.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 shutdown_connections 2023-12-18T10:20:47.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.539+0000 7f5187b52640 1 -- 172.21.15.133:0/1681396671 wait complete. 2023-12-18T10:20:47.565 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-18T10:20:47.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:47.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.699+0000 7f98b3266640 1 Processor -- start 2023-12-18T10:20:47.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.699+0000 7f98b3266640 1 -- start start 2023-12-18T10:20:47.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b3266640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98ac15a680 0x7f98ac15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:47.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b3266640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f98ac06fdb0 0x7f98ac070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:47.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b3266640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac15f100 con 0x7f98ac0cac10 2023-12-18T10:20:47.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b3266640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac070780 con 0x7f98ac15a680 2023-12-18T10:20:47.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b3266640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0ca7d0 con 0x7f98ac06fdb0 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b0801640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f98ac0cac10 0x7f98ac15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:37238/0 (socket says 172.21.15.133:37238) 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b0801640 1 -- 172.21.15.133:0/2598818764 learned_addr learned my addr 172.21.15.133:0/2598818764 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b1002640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98ac15a680 0x7f98ac15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b1803640 1 --2- 172.21.15.133:0/2598818764 >> v2:172.21.15.142:3300/0 conn(0x7f98ac06fdb0 0x7f98ac070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98a3fff640 1 -- 172.21.15.133:0/2598818764 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306186032 0 0) 0x7f98ac15f100 con 0x7f98ac0cac10 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98a3fff640 1 -- 172.21.15.133:0/2598818764 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9898003530 con 0x7f98ac0cac10 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b1002640 1 -- 172.21.15.133:0/2598818764 >> v2:172.21.15.142:3300/0 conn(0x7f98ac06fdb0 msgr2=0x7f98ac070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b1002640 1 --2- 172.21.15.133:0/2598818764 >> v2:172.21.15.142:3300/0 conn(0x7f98ac06fdb0 0x7f98ac070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b1002640 1 -- 172.21.15.133:0/2598818764 >> v1:172.21.15.142:6789/0 conn(0x7f98ac0cac10 legacy=0x7f98ac15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b1002640 1 -- 172.21.15.133:0/2598818764 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac15e860 con 0x7f98ac15a680 2023-12-18T10:20:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.703+0000 7f98b1803640 1 --2- 172.21.15.133:0/2598818764 >> v2:172.21.15.142:3300/0 conn(0x7f98ac06fdb0 0x7f98ac070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b1002640 1 --2- 172.21.15.133:0/2598818764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 0x7f98ac15e160 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f98a80097c0 tx=0x7f98a801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea06f59435b17af8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98a3fff640 1 -- 172.21.15.133:0/2598818764 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80ac410 con 0x7f98ac15a680 2023-12-18T10:20:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98a3fff640 1 -- 172.21.15.133:0/2598818764 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a80ac570 con 0x7f98ac15a680 2023-12-18T10:20:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98a3fff640 1 -- 172.21.15.133:0/2598818764 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80ac900 con 0x7f98ac15a680 2023-12-18T10:20:47.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 -- 172.21.15.133:0/2598818764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 msgr2=0x7f98ac15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 --2- 172.21.15.133:0/2598818764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 0x7f98ac15e160 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f98a80097c0 tx=0x7f98a801c3b0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 -- 172.21.15.133:0/2598818764 shutdown_connections 2023-12-18T10:20:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 --2- 172.21.15.133:0/2598818764 >> v2:172.21.15.142:3300/0 conn(0x7f98ac06fdb0 0x7f98ac070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 --2- 172.21.15.133:0/2598818764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 0x7f98ac15e160 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 -- 172.21.15.133:0/2598818764 >> 172.21.15.133:0/2598818764 conn(0x7f98ac06a3e0 msgr2=0x7f98ac0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 -- 172.21.15.133:0/2598818764 shutdown_connections 2023-12-18T10:20:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 -- 172.21.15.133:0/2598818764 wait complete. 2023-12-18T10:20:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 Processor -- start 2023-12-18T10:20:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.707+0000 7f98b3266640 1 -- start start 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac06fdb0 0x7f98ac0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0cac10 0x7f98ac151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 0x7f98ac0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0c8010 con 0x7f98ac15a680 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0c74e0 con 0x7f98ac0cac10 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0c77c0 con 0x7f98ac06fdb0 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 0x7f98ac0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1002640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac06fdb0 0x7f98ac0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1002640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac06fdb0 0x7f98ac0c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:49868/0 (socket says 172.21.15.133:49868) 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b0801640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0cac10 0x7f98ac151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:47.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1002640 1 -- 172.21.15.133:0/2501041465 learned_addr learned my addr 172.21.15.133:0/2501041465 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1803640 1 -- 172.21.15.133:0/2501041465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac06fdb0 msgr2=0x7f98ac0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:47.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1803640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac06fdb0 0x7f98ac0c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1803640 1 -- 172.21.15.133:0/2501041465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0cac10 msgr2=0x7f98ac151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1803640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0cac10 0x7f98ac151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1803640 1 -- 172.21.15.133:0/2501041465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a4009a70 con 0x7f98ac15a680 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b1803640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 0x7f98ac0aee30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f98a400efc0 tx=0x7f98a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98a1ffb640 1 -- 172.21.15.133:0/2501041465 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400cd30 con 0x7f98ac15a680 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98a1ffb640 1 -- 172.21.15.133:0/2501041465 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400f040 con 0x7f98ac15a680 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98a1ffb640 1 -- 172.21.15.133:0/2501041465 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4003be0 con 0x7f98ac15a680 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a8009420 con 0x7f98ac15a680 2023-12-18T10:20:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac153330 con 0x7f98ac15a680 2023-12-18T10:20:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac0735b0 con 0x7f98ac15a680 2023-12-18T10:20:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.711+0000 7f98a1ffb640 1 -- 172.21.15.133:0/2501041465 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98a4014480 con 0x7f98ac15a680 2023-12-18T10:20:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.715+0000 7f98a1ffb640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9890065a90 0x7f9890067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.715+0000 7f98a1ffb640 1 -- 172.21.15.133:0/2501041465 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f98a4083cc0 con 0x7f98ac15a680 2023-12-18T10:20:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.715+0000 7f98b1002640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9890065a90 0x7f9890067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.715+0000 7f98b1002640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9890065a90 0x7f9890067f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98a8019fe0 tx=0x7f98a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.719+0000 7f98a1ffb640 1 -- 172.21.15.133:0/2501041465 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f98a4051590 con 0x7f98ac15a680 2023-12-18T10:20:47.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98ac04e000 con 0x7f98ac15a680 2023-12-18T10:20:47.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98a1ffb640 1 -- 172.21.15.133:0/2501041465 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f98a4054bb0 con 0x7f98ac15a680 2023-12-18T10:20:47.903 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:47.903 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6162,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:20:47.529769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:20:47.904 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 32 2023-12-18T10:20:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9890065a90 msgr2=0x7f9890067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9890065a90 0x7f9890067f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f98a8019fe0 tx=0x7f98a8008040 comp rx=0 tx=0).stop 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 msgr2=0x7f98ac0aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 0x7f98ac0aee30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f98a400efc0 tx=0x7f98a400c490 comp rx=0 tx=0).stop 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 shutdown_connections 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9890065a90 0x7f9890067f50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98ac15a680 0x7f98ac0aee30 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0cac10 0x7f98ac151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 --2- 172.21.15.133:0/2501041465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac06fdb0 0x7f98ac0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 >> 172.21.15.133:0/2501041465 conn(0x7f98ac06a3e0 msgr2=0x7f98ac06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 shutdown_connections 2023-12-18T10:20:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:47.899+0000 7f98b3266640 1 -- 172.21.15.133:0/2501041465 wait complete. 2023-12-18T10:20:47.926 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:20:48.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdfa5f3640 1 Processor -- start 2023-12-18T10:20:48.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdfa5f3640 1 -- start start 2023-12-18T10:20:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdfa5f3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcdf41570c0 0x7fcdf406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdfa5f3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcdf406c320 0x7fcdf40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdfa5f3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf40c9460 con 0x7fcdf40c9e30 2023-12-18T10:20:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdfa5f3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf406c7a0 con 0x7fcdf41570c0 2023-12-18T10:20:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdfa5f3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf41574a0 con 0x7fcdf406c320 2023-12-18T10:20:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdf3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcdf41570c0 0x7fcdf406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdf8b90640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcdf40c9e30 0x7fcdf415d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56778/0 (socket says 172.21.15.133:56778) 2023-12-18T10:20:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdf8b90640 1 -- 172.21.15.133:0/2929109043 learned_addr learned my addr 172.21.15.133:0/2929109043 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.059+0000 7fcdf37fe640 1 --2- 172.21.15.133:0/2929109043 >> v2:172.21.15.142:3300/0 conn(0x7fcdf406c320 0x7fcdf40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf3fff640 1 -- 172.21.15.133:0/2929109043 >> v2:172.21.15.142:3300/0 conn(0x7fcdf406c320 msgr2=0x7fcdf40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:48.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf3fff640 1 --2- 172.21.15.133:0/2929109043 >> v2:172.21.15.142:3300/0 conn(0x7fcdf406c320 0x7fcdf40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf3fff640 1 -- 172.21.15.133:0/2929109043 >> v1:172.21.15.133:6789/0 conn(0x7fcdf40c9e30 legacy=0x7fcdf415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf3fff640 1 -- 172.21.15.133:0/2929109043 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40c8b30 con 0x7fcdf41570c0 2023-12-18T10:20:48.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf2ffd640 1 -- 172.21.15.133:0/2929109043 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400708229 0 0) 0x7fcdf40c9460 con 0x7fcdf40c9e30 2023-12-18T10:20:48.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf3fff640 1 --2- 172.21.15.133:0/2929109043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf41570c0 0x7fcdf406bde0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40ce330 tx=0x7fcde401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559b620cc2185d2b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf2ffd640 1 -- 172.21.15.133:0/2929109043 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde40ab600 con 0x7fcdf41570c0 2023-12-18T10:20:48.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf2ffd640 1 -- 172.21.15.133:0/2929109043 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde40a7050 con 0x7fcdf41570c0 2023-12-18T10:20:48.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdf2ffd640 1 -- 172.21.15.133:0/2929109043 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde40ab980 con 0x7fcdf41570c0 2023-12-18T10:20:48.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/2929109043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf41570c0 msgr2=0x7fcdf406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.063+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/2929109043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf41570c0 0x7fcdf406bde0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40ce330 tx=0x7fcde401c3a0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/2929109043 shutdown_connections 2023-12-18T10:20:48.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/2929109043 >> v2:172.21.15.142:3300/0 conn(0x7fcdf406c320 0x7fcdf40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/2929109043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf41570c0 0x7fcdf406bde0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/2929109043 >> 172.21.15.133:0/2929109043 conn(0x7fcdf406a3e0 msgr2=0x7fcdf40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:48.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/2929109043 shutdown_connections 2023-12-18T10:20:48.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/2929109043 wait complete. 2023-12-18T10:20:48.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 Processor -- start 2023-12-18T10:20:48.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 -- start start 2023-12-18T10:20:48.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf406c320 0x7fcdf40c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf40c9e30 0x7fcdf40c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdf41570c0 0x7fcdf41575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40c7b00 con 0x7fcdf40c9e30 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40c2f10 con 0x7fcdf406c320 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdfa5f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40c31f0 con 0x7fcdf41570c0 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf40c9e30 0x7fcdf40c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf40c9e30 0x7fcdf40c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56404/0 (socket says 172.21.15.133:56404) 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 -- 172.21.15.133:0/1865609008 learned_addr learned my addr 172.21.15.133:0/1865609008 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf3fff640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf406c320 0x7fcdf40c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf8b90640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdf41570c0 0x7fcdf41575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 -- 172.21.15.133:0/1865609008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdf41570c0 msgr2=0x7fcdf41575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdf41570c0 0x7fcdf41575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 -- 172.21.15.133:0/1865609008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf406c320 msgr2=0x7fcdf40c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf406c320 0x7fcdf40c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 -- 172.21.15.133:0/1865609008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4009420 con 0x7fcdf40c9e30 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.067+0000 7fcdf37fe640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf40c9e30 0x7fcdf40c7f00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcde800e870 tx=0x7fcde800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdf0ff9640 1 -- 172.21.15.133:0/1865609008 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8009510 con 0x7fcdf40c9e30 2023-12-18T10:20:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdf0ff9640 1 -- 172.21.15.133:0/1865609008 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde800eec0 con 0x7fcdf40c9e30 2023-12-18T10:20:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdf0ff9640 1 -- 172.21.15.133:0/1865609008 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800cb40 con 0x7fcdf40c9e30 2023-12-18T10:20:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf40c34d0 con 0x7fcdf40c9e30 2023-12-18T10:20:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf40c3a90 con 0x7fcdf40c9e30 2023-12-18T10:20:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf40c3c50 con 0x7fcdf40c9e30 2023-12-18T10:20:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdf0ff9640 1 -- 172.21.15.133:0/1865609008 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcde800cca0 con 0x7fcdf40c9e30 2023-12-18T10:20:48.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdf0ff9640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde0065a90 0x7fcde0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdf0ff9640 1 -- 172.21.15.133:0/1865609008 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcde80832f0 con 0x7fcdf40c9e30 2023-12-18T10:20:48.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.071+0000 7fcdf3fff640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde0065a90 0x7fcde0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.075+0000 7fcdf3fff640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde0065a90 0x7fcde0067f50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcde40ad000 tx=0x7fcde4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.075+0000 7fcdf0ff9640 1 -- 172.21.15.133:0/1865609008 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcde8050c10 con 0x7fcdf40c9e30 2023-12-18T10:20:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdf40735b0 con 0x7fcdf40c9e30 2023-12-18T10:20:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdf0ff9640 1 -- 172.21.15.133:0/1865609008 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16354 (secure 0 0 0) 0x7fcde8054230 con 0x7fcdf40c9e30 2023-12-18T10:20:48.236 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:48.236 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:20:45.524788+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:20:42.874010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-18T10:20:43.517857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde0065a90 msgr2=0x7fcde0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde0065a90 0x7fcde0067f50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcde40ad000 tx=0x7fcde4008040 comp rx=0 tx=0).stop 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf40c9e30 msgr2=0x7fcdf40c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf40c9e30 0x7fcdf40c7f00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcde800e870 tx=0x7fcde800ec70 comp rx=0 tx=0).stop 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 shutdown_connections 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcde0065a90 0x7fcde0067f50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcdf41570c0 0x7fcdf41575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf40c9e30 0x7fcdf40c7f00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 --2- 172.21.15.133:0/1865609008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdf406c320 0x7fcdf40c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 >> 172.21.15.133:0/1865609008 conn(0x7fcdf406a3e0 msgr2=0x7fcdf415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 shutdown_connections 2023-12-18T10:20:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.231+0000 7fcdfa5f3640 1 -- 172.21.15.133:0/1865609008 wait complete. 2023-12-18T10:20:48.258 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-18T10:20:48.258 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:20:48.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8628ce5640 1 Processor -- start 2023-12-18T10:20:48.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8628ce5640 1 -- start start 2023-12-18T10:20:48.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8628ce5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f862415ca40 0x7f86240cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8628ce5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240cf7e0 0x7f86241668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8628ce5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86240d11c0 con 0x7f86240ce3f0 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8628ce5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240d0310 con 0x7f862415ca40 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8628ce5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86240d05b0 con 0x7f86240cf7e0 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8621d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86240ce3f0 0x7f86240cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56790/0 (socket says 172.21.15.133:56790) 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8621d9b640 1 -- 172.21.15.133:0/4135394617 learned_addr learned my addr 172.21.15.133:0/4135394617 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f862259c640 1 --2- 172.21.15.133:0/4135394617 >> v2:172.21.15.142:3300/0 conn(0x7f862415ca40 0x7f86240cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f8622d9d640 1 --2- 172.21.15.133:0/4135394617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240cf7e0 0x7f86241668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f862159a640 1 -- 172.21.15.133:0/4135394617 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581497235 0 0) 0x7f86240d11c0 con 0x7f86240ce3f0 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f862159a640 1 -- 172.21.15.133:0/4135394617 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f860c003530 con 0x7f86240ce3f0 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f862259c640 1 -- 172.21.15.133:0/4135394617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240cf7e0 msgr2=0x7f86241668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f862259c640 1 --2- 172.21.15.133:0/4135394617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240cf7e0 0x7f86241668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f862259c640 1 -- 172.21.15.133:0/4135394617 >> v1:172.21.15.133:6789/0 conn(0x7f86240ce3f0 legacy=0x7f86240cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.391+0000 7f862259c640 1 -- 172.21.15.133:0/4135394617 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240d0890 con 0x7f862415ca40 2023-12-18T10:20:48.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f862259c640 1 --2- 172.21.15.133:0/4135394617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f862415ca40 0x7f86240cdeb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86140097a0 tx=0x7f861401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ead3b2703586f64 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f862159a640 1 -- 172.21.15.133:0/4135394617 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140ab660 con 0x7f862415ca40 2023-12-18T10:20:48.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f862159a640 1 -- 172.21.15.133:0/4135394617 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86140ab7c0 con 0x7f862415ca40 2023-12-18T10:20:48.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f862159a640 1 -- 172.21.15.133:0/4135394617 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140abb50 con 0x7f862415ca40 2023-12-18T10:20:48.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f8628ce5640 1 -- 172.21.15.133:0/4135394617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f862415ca40 msgr2=0x7f86240cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f8628ce5640 1 --2- 172.21.15.133:0/4135394617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f862415ca40 0x7f86240cdeb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86140097a0 tx=0x7f861401c460 comp rx=0 tx=0).stop 2023-12-18T10:20:48.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f8628ce5640 1 -- 172.21.15.133:0/4135394617 shutdown_connections 2023-12-18T10:20:48.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f8628ce5640 1 --2- 172.21.15.133:0/4135394617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240cf7e0 0x7f86241668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f8628ce5640 1 --2- 172.21.15.133:0/4135394617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f862415ca40 0x7f86240cdeb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f8628ce5640 1 -- 172.21.15.133:0/4135394617 >> 172.21.15.133:0/4135394617 conn(0x7f8624089fb0 msgr2=0x7f86240d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:48.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f8628ce5640 1 -- 172.21.15.133:0/4135394617 shutdown_connections 2023-12-18T10:20:48.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.395+0000 7f8628ce5640 1 -- 172.21.15.133:0/4135394617 wait complete. 2023-12-18T10:20:48.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8628ce5640 1 Processor -- start 2023-12-18T10:20:48.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8628ce5640 1 -- start start 2023-12-18T10:20:48.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8628ce5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240ce3f0 0x7f86240c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8628ce5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240cf7e0 0x7f86240b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8628ce5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862415ca40 0x7f8624152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8628ce5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240b0230 con 0x7f862415ca40 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8628ce5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240af620 con 0x7f86240cf7e0 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8628ce5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86240af900 con 0x7f86240ce3f0 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862415ca40 0x7f8624152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862415ca40 0x7f8624152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56406/0 (socket says 172.21.15.133:56406) 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 -- 172.21.15.133:0/3683095663 learned_addr learned my addr 172.21.15.133:0/3683095663 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8621d9b640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240cf7e0 0x7f86240b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f862259c640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240ce3f0 0x7f86240c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 -- 172.21.15.133:0/3683095663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240ce3f0 msgr2=0x7f86240c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240ce3f0 0x7f86240c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 -- 172.21.15.133:0/3683095663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240cf7e0 msgr2=0x7f86240b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240cf7e0 0x7f86240b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 -- 172.21.15.133:0/3683095663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86140093b0 con 0x7f862415ca40 2023-12-18T10:20:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8622d9d640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862415ca40 0x7f8624152eb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f861c00efc0 tx=0x7f861c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.399+0000 7f8612ffd640 1 -- 172.21.15.133:0/3683095663 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c009b10 con 0x7f862415ca40 2023-12-18T10:20:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f8612ffd640 1 -- 172.21.15.133:0/3683095663 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c00f040 con 0x7f862415ca40 2023-12-18T10:20:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f8612ffd640 1 -- 172.21.15.133:0/3683095663 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c0146c0 con 0x7f862415ca40 2023-12-18T10:20:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86240d17d0 con 0x7f862415ca40 2023-12-18T10:20:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86240afec0 con 0x7f862415ca40 2023-12-18T10:20:48.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86240d1630 con 0x7f862415ca40 2023-12-18T10:20:48.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f8612ffd640 1 -- 172.21.15.133:0/3683095663 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f861c014820 con 0x7f862415ca40 2023-12-18T10:20:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f8612ffd640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8604065a90 0x7f8604067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f8612ffd640 1 -- 172.21.15.133:0/3683095663 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f861c083f40 con 0x7f862415ca40 2023-12-18T10:20:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f862259c640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8604065a90 0x7f8604067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.403+0000 7f862259c640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8604065a90 0x7f8604067f50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f86140af000 tx=0x7f86140a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.407+0000 7f8612ffd640 1 -- 172.21.15.133:0/3683095663 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86240d1630 con 0x7f862415ca40 2023-12-18T10:20:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.555+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f862415ce20 con 0x7f8604065a90 2023-12-18T10:20:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.563+0000 7f8612ffd640 1 -- 172.21.15.133:0/3683095663 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274673 (secure 0 0 0) 0x7f86140ab560 con 0x7f8604065a90 2023-12-18T10:20:48.571 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:48.573 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:20:48.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8604065a90 msgr2=0x7f8604067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8604065a90 0x7f8604067f50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f86140af000 tx=0x7f86140a7000 comp rx=0 tx=0).stop 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862415ca40 msgr2=0x7f8624152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862415ca40 0x7f8624152eb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f861c00efc0 tx=0x7f861c00c490 comp rx=0 tx=0).stop 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 shutdown_connections 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8604065a90 0x7f8604067f50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f862415ca40 0x7f8624152eb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86240cf7e0 0x7f86240b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 --2- 172.21.15.133:0/3683095663 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86240ce3f0 0x7f86240c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 >> 172.21.15.133:0/3683095663 conn(0x7f8624089fb0 msgr2=0x7f86240ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 shutdown_connections 2023-12-18T10:20:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.567+0000 7f8628ce5640 1 -- 172.21.15.133:0/3683095663 wait complete. 2023-12-18T10:20:48.591 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-12-18T10:20:47.128375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221308,"kb_used_data":5692,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753412,"statfs":{"total":773094113280,"available":772867493888,"internally_reserved":0,"allocated":5828608,"data_stored":3208421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000746"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-18T10:20:41.024248+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:20:41.024248+0000","last_peered":"2023-12-18T10:20:41.024248+0000","last_clean":"2023-12-18T10:20:41.024248+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:20:41.024248+0000","last_undegraded":"2023-12-18T10:20:41.024248+0000","last_fullsized":"2023-12-18T10:20:41.024248+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1175552,"data_stored":844527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.47599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.88600000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58799999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84899999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69199999999999995,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71299999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.83599999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85699999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.505,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.871}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":248572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.84399999999999997,"15min":0.877},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.81899999999999995,"5min":1.845,"15min":1.845},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.86599999999999999,"15min":0.89600000000000002},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81200000000000006,"5min":4.524,"15min":4.524},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86499999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.497},"max":{"1min":0.873,"5min":1.925,"15min":1.925},"last":0.88500000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91300000000000003,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90300000000000002,"15min":0.92900000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85399999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.628}]},{"osd":4,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83999999999999997,"5min":1.054,"15min":1.054},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.101,"15min":1.101},"last":0.92900000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.284,"15min":1.284},"last":0.67800000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.745,"15min":0.754},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88300000000000001,"5min":1.129,"15min":1.129},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84499999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66500000000000004,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93999999999999995,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88400000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.44900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72299999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.99399999999999999,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91200000000000003,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93500000000000005,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.625},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83099999999999996,"15min":0.85299999999999998},"min":{"1min":0.51600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0189999999999999,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.76000000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.98499999999999999,"15min":1.038},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0109999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93200000000000005,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.042,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89900000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83699999999999997,"15min":0.85599999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.131,"15min":1.131},"last":0.748},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94699999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.92300000000000004,"5min":1.032,"15min":1.032},"last":0.70199999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.999,"15min":0.999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.624}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91700000000000004,"5min":1.073,"15min":1.073},"last":0.64400000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.75900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55900000000000005,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.372}]},{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.54900000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.61899999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41399999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63100000000000001,"5min":1.254,"15min":1.254},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73999999999999999,"5min":1.772,"15min":1.772},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98099999999999998,"5min":1.01,"15min":1.01},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.82399999999999995,"5min":1.181,"15min":1.181},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.81299999999999994,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.53000000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.069},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.622},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0629999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.746}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":1.127,"15min":1.127},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94299999999999995,"5min":1.139,"15min":1.139},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.436,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56799999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.501,"15min":0.51300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.436}]},{"osd":1,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.623,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65100000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.698,"15min":1.698},"last":0.62},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94399999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60099999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96099999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.997,"5min":1.341,"15min":1.341},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.91900000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.78300000000000003,"15min":0.80000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.032,"5min":1.282,"15min":1.282},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58799999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98199999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.58899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.61099999999999999,"15min":0.63900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.7150000000000001,"5min":3.976,"15min":3.976},"last":0.315},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.52000000000000002,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.46300000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.2370000000000001,"5min":3.786,"15min":3.786},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.1589999999999998,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.9399999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.54500000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.52900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7889999999999999,"5min":1.851,"15min":1.851},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.92700000000000005,"15min":0.96099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6539999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.55500000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.90800000000000003,"15min":0.93600000000000005},"min":{"1min":0.54400000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.6100000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.823,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.94099999999999995,"15min":0.97399999999999998},"min":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.83099999999999996,"15min":0.84399999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8799999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1175552,"data_stored":844527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.66700000000000004,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.54100000000000004,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":1.456,"15min":1.456},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":1.595,"15min":1.595},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.58299999999999996,"15min":0.60899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.624,"5min":2.464,"15min":2.464},"last":0.622}]},{"osd":3,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":1.859,"15min":1.859},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":1.903,"15min":1.903},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94699999999999995,"5min":1.494,"15min":1.494},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94499999999999995,"5min":1.544,"15min":1.544},"last":0.65500000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80200000000000005,"15min":0.82099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93200000000000005,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.89000000000000001,"5min":1.53,"15min":1.53},"last":0.67200000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79200000000000004,"15min":0.81000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.81299999999999994,"5min":1.556,"15min":1.556},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.77700000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90000000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:20:48.597 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:20:48.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.763+0000 7f937668c640 1 Processor -- start 2023-12-18T10:20:48.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f937668c640 1 -- start start 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f937668c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93701570c0 0x7f937006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f937668c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f937006c320 0x7f93700c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f937668c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93700c9e30 0x7f93700ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f937668c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937006c7a0 con 0x7f93701570c0 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f937668c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93700c9460 con 0x7f937006c320 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f937668c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93701574a0 con 0x7f93700c9e30 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93701570c0 0x7f937006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93701570c0 0x7f937006bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56420/0 (socket says 172.21.15.133:56420) 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936ffff640 1 -- 172.21.15.133:0/2522145461 learned_addr learned my addr 172.21.15.133:0/2522145461 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:48.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f9374c29640 1 --2- 172.21.15.133:0/2522145461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93700c9e30 0x7f93700ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936f7fe640 1 --2- 172.21.15.133:0/2522145461 >> v2:172.21.15.142:3300/0 conn(0x7f937006c320 0x7f93700c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936ffff640 1 -- 172.21.15.133:0/2522145461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93700c9e30 msgr2=0x7f93700ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:48.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936ffff640 1 --2- 172.21.15.133:0/2522145461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93700c9e30 0x7f93700ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936ffff640 1 -- 172.21.15.133:0/2522145461 >> v2:172.21.15.142:3300/0 conn(0x7f937006c320 msgr2=0x7f93700c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:48.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936ffff640 1 --2- 172.21.15.133:0/2522145461 >> v2:172.21.15.142:3300/0 conn(0x7f937006c320 0x7f93700c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936ffff640 1 -- 172.21.15.133:0/2522145461 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93700c8b30 con 0x7f93701570c0 2023-12-18T10:20:48.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f9374c29640 1 --2- 172.21.15.133:0/2522145461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93700c9e30 0x7f93700ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:48.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.767+0000 7f936f7fe640 1 --2- 172.21.15.133:0/2522145461 >> v2:172.21.15.142:3300/0 conn(0x7f937006c320 0x7f93700c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:48.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f936ffff640 1 --2- 172.21.15.133:0/2522145461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f937006bde0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f93700ce330 tx=0x7f936001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82b76f8fa759fac server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f936effd640 1 -- 172.21.15.133:0/2522145461 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93600ab600 con 0x7f93701570c0 2023-12-18T10:20:48.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f936effd640 1 -- 172.21.15.133:0/2522145461 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93600ab760 con 0x7f93701570c0 2023-12-18T10:20:48.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f936effd640 1 -- 172.21.15.133:0/2522145461 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93600abaf0 con 0x7f93701570c0 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 -- 172.21.15.133:0/2522145461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 msgr2=0x7f937006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 --2- 172.21.15.133:0/2522145461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f937006bde0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f93700ce330 tx=0x7f936001c440 comp rx=0 tx=0).stop 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 -- 172.21.15.133:0/2522145461 shutdown_connections 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 --2- 172.21.15.133:0/2522145461 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93700c9e30 0x7f93700ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 --2- 172.21.15.133:0/2522145461 >> v2:172.21.15.142:3300/0 conn(0x7f937006c320 0x7f93700c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 --2- 172.21.15.133:0/2522145461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f937006bde0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 -- 172.21.15.133:0/2522145461 >> 172.21.15.133:0/2522145461 conn(0x7f937006a3e0 msgr2=0x7f93700afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 -- 172.21.15.133:0/2522145461 shutdown_connections 2023-12-18T10:20:48.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 -- 172.21.15.133:0/2522145461 wait complete. 2023-12-18T10:20:48.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 Processor -- start 2023-12-18T10:20:48.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.771+0000 7f937668c640 1 -- start start 2023-12-18T10:20:48.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f937006c320 0x7f937014ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93700c9e30 0x7f937014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f93700c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93700c2760 con 0x7f93701570c0 2023-12-18T10:20:48.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937014b7e0 con 0x7f93700c9e30 2023-12-18T10:20:48.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93700c54d0 con 0x7f937006c320 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f93700c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f93700c2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56426/0 (socket says 172.21.15.133:56426) 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 -- 172.21.15.133:0/366006316 learned_addr learned my addr 172.21.15.133:0/366006316 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f936f7fe640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93700c9e30 0x7f937014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f936ffff640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f937006c320 0x7f937014ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 -- 172.21.15.133:0/366006316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f937006c320 msgr2=0x7f937014ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f937006c320 0x7f937014ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 -- 172.21.15.133:0/366006316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93700c9e30 msgr2=0x7f937014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93700c9e30 0x7f937014ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 -- 172.21.15.133:0/366006316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93600094d0 con 0x7f93701570c0 2023-12-18T10:20:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f9374c29640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f93700c2220 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9368009fa0 tx=0x7f936800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f936cff9640 1 -- 172.21.15.133:0/366006316 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368003ba0 con 0x7f93701570c0 2023-12-18T10:20:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f936cff9640 1 -- 172.21.15.133:0/366006316 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800f040 con 0x7f93701570c0 2023-12-18T10:20:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93700c57b0 con 0x7f93701570c0 2023-12-18T10:20:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f936cff9640 1 -- 172.21.15.133:0/366006316 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368004030 con 0x7f93701570c0 2023-12-18T10:20:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93700c5d70 con 0x7f93701570c0 2023-12-18T10:20:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93700735b0 con 0x7f93701570c0 2023-12-18T10:20:48.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.775+0000 7f936cff9640 1 -- 172.21.15.133:0/366006316 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9368004190 con 0x7f93701570c0 2023-12-18T10:20:48.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.779+0000 7f936cff9640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f935c065a60 0x7f935c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:48.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.779+0000 7f936cff9640 1 -- 172.21.15.133:0/366006316 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93680835e0 con 0x7f93701570c0 2023-12-18T10:20:48.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.779+0000 7f936ffff640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f935c065a60 0x7f935c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:48.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.779+0000 7f936ffff640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f935c065a60 0x7f935c067f20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f93600af000 tx=0x7f93600b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:48.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.783+0000 7f936cff9640 1 -- 172.21.15.133:0/366006316 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9368050f10 con 0x7f93701570c0 2023-12-18T10:20:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.927+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f937004e000 con 0x7f935c065a60 2023-12-18T10:20:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.935+0000 7f936cff9640 1 -- 172.21.15.133:0/366006316 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274673 (secure 0 0 0) 0x7f937004e000 con 0x7f935c065a60 2023-12-18T10:20:48.943 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:48.945 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f935c065a60 msgr2=0x7f935c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f935c065a60 0x7f935c067f20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f93600af000 tx=0x7f93600b6040 comp rx=0 tx=0).stop 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 msgr2=0x7f93700c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f93700c2220 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9368009fa0 tx=0x7f936800d560 comp rx=0 tx=0).stop 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 shutdown_connections 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f935c065a60 0x7f935c067f20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93701570c0 0x7f93700c2220 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93700c9e30 0x7f937014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 --2- 172.21.15.133:0/366006316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f937006c320 0x7f937014ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 >> 172.21.15.133:0/366006316 conn(0x7f937006a3e0 msgr2=0x7f937015c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 shutdown_connections 2023-12-18T10:20:48.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:48.939+0000 7f937668c640 1 -- 172.21.15.133:0/366006316 wait complete. 2023-12-18T10:20:48.963 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-12-18T10:20:47.128375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221308,"kb_used_data":5692,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753412,"statfs":{"total":773094113280,"available":772867493888,"internally_reserved":0,"allocated":5828608,"data_stored":3208421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000746"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:44.134478+0000","last_change":"2023-12-18T10:20:44.134478+0000","last_active":"2023-12-18T10:20:44.134478+0000","last_peered":"2023-12-18T10:20:44.134478+0000","last_clean":"2023-12-18T10:20:44.134478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:44.134478+0000","last_undegraded":"2023-12-18T10:20:44.134478+0000","last_fullsized":"2023-12-18T10:20:44.134478+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:20:43.123507+0000","last_change":"2023-12-18T10:20:43.123507+0000","last_active":"2023-12-18T10:20:43.123507+0000","last_peered":"2023-12-18T10:20:43.123507+0000","last_clean":"2023-12-18T10:20:43.123507+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:20:43.123507+0000","last_undegraded":"2023-12-18T10:20:43.123507+0000","last_fullsized":"2023-12-18T10:20:43.123507+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":48,"state":"active+clean","last_fresh":"2023-12-18T10:20:41.024248+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:20:41.024248+0000","last_peered":"2023-12-18T10:20:41.024248+0000","last_clean":"2023-12-18T10:20:41.024248+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:20:41.024248+0000","last_undegraded":"2023-12-18T10:20:41.024248+0000","last_fullsized":"2023-12-18T10:20:41.024248+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1175552,"data_stored":844527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.47599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.88600000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58799999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84899999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69199999999999995,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71299999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.83599999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85699999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54200000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.505,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.871}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27508,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":569344,"data_stored":248572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.84399999999999997,"15min":0.877},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.81899999999999995,"5min":1.845,"15min":1.845},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.86599999999999999,"15min":0.89600000000000002},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81200000000000006,"5min":4.524,"15min":4.524},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86499999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.497},"max":{"1min":0.873,"5min":1.925,"15min":1.925},"last":0.88500000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91300000000000003,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90300000000000002,"15min":0.92900000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85399999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.628}]},{"osd":4,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83999999999999997,"5min":1.054,"15min":1.054},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.101,"15min":1.101},"last":0.92900000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.284,"15min":1.284},"last":0.67800000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.745,"15min":0.754},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88300000000000001,"5min":1.129,"15min":1.129},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84499999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.56899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66500000000000004,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93999999999999995,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88400000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.44900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.72299999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.99399999999999999,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91200000000000003,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93500000000000005,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.625},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83099999999999996,"15min":0.85299999999999998},"min":{"1min":0.51600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0189999999999999,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.76000000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.98499999999999999,"15min":1.038},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0109999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93200000000000005,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.042,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89900000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83699999999999997,"15min":0.85599999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.131,"15min":1.131},"last":0.748},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94699999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.92300000000000004,"5min":1.032,"15min":1.032},"last":0.70199999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.999,"15min":0.999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58599999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.624}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91700000000000004,"5min":1.073,"15min":1.073},"last":0.64400000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.75900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55900000000000005,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.372}]},{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.54900000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.61899999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41399999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63100000000000001,"5min":1.254,"15min":1.254},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73999999999999999,"5min":1.772,"15min":1.772},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98099999999999998,"5min":1.01,"15min":1.01},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.82399999999999995,"5min":1.181,"15min":1.181},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.81299999999999994,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.53000000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.069},"last":0.54300000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.622},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0629999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.746}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":1.127,"15min":1.127},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94299999999999995,"5min":1.139,"15min":1.139},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.436,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56799999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.501,"15min":0.51300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.436}]},{"osd":1,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.623,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65100000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.698,"15min":1.698},"last":0.62},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94399999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.60099999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96099999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.997,"5min":1.341,"15min":1.341},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.91900000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.78300000000000003,"15min":0.80000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.032,"5min":1.282,"15min":1.282},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58799999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98199999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.58899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":581632,"data_stored":254159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.61099999999999999,"15min":0.63900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.7150000000000001,"5min":3.976,"15min":3.976},"last":0.315},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.52000000000000002,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.46300000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.2370000000000001,"5min":3.786,"15min":3.786},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.1589999999999998,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.9399999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.54500000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.52900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7889999999999999,"5min":1.851,"15min":1.851},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.92700000000000005,"15min":0.96099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6539999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.55500000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.90800000000000003,"15min":0.93600000000000005},"min":{"1min":0.54400000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.6100000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.823,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.94099999999999995,"15min":0.97399999999999998},"min":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.58199999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.83099999999999996,"15min":0.84399999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8799999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1148,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1175552,"data_stored":844527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.66700000000000004,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.54100000000000004,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":1.456,"15min":1.456},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":1.595,"15min":1.595},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.58299999999999996,"15min":0.60899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.624,"5min":2.464,"15min":2.464},"last":0.622}]},{"osd":3,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":1.859,"15min":1.859},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":1.903,"15min":1.903},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94699999999999995,"5min":1.494,"15min":1.494},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94499999999999995,"5min":1.544,"15min":1.544},"last":0.65500000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80200000000000005,"15min":0.82099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93200000000000005,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.89000000000000001,"5min":1.53,"15min":1.53},"last":0.67200000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79200000000000004,"15min":0.81000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.81299999999999994,"5min":1.556,"15min":1.556},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.77700000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90000000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:20:48.968 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:20:49.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bfd0a640 1 Processor -- start 2023-12-18T10:20:49.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bfd0a640 1 -- start start 2023-12-18T10:20:49.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bfd0a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60b815ceb0 0x7f60b806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bfd0a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bfd0a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b8160e80 con 0x7f60b80ce2c0 2023-12-18T10:20:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bfd0a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b8161160 con 0x7f60b815ceb0 2023-12-18T10:20:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bfd0a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b8161440 con 0x7f60b80cf2a0 2023-12-18T10:20:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bd2a5640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f60b80ce2c0 0x7f60b80ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56794/0 (socket says 172.21.15.133:56794) 2023-12-18T10:20:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bd2a5640 1 -- 172.21.15.133:0/1105118647 learned_addr learned my addr 172.21.15.133:0/1105118647 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bdaa6640 1 --2- 172.21.15.133:0/1105118647 >> v2:172.21.15.142:3300/0 conn(0x7f60b815ceb0 0x7f60b806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60be2a7640 1 --2- 172.21.15.133:0/1105118647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bcaa4640 1 -- 172.21.15.133:0/1105118647 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150866023 0 0) 0x7f60b8160e80 con 0x7f60b80ce2c0 2023-12-18T10:20:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bcaa4640 1 -- 172.21.15.133:0/1105118647 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a4003530 con 0x7f60b80ce2c0 2023-12-18T10:20:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60be2a7640 1 -- 172.21.15.133:0/1105118647 >> v2:172.21.15.142:3300/0 conn(0x7f60b815ceb0 msgr2=0x7f60b806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60be2a7640 1 --2- 172.21.15.133:0/1105118647 >> v2:172.21.15.142:3300/0 conn(0x7f60b815ceb0 0x7f60b806b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60be2a7640 1 -- 172.21.15.133:0/1105118647 >> v1:172.21.15.133:6789/0 conn(0x7f60b80ce2c0 legacy=0x7f60b80ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60be2a7640 1 -- 172.21.15.133:0/1105118647 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8161720 con 0x7f60b80cf2a0 2023-12-18T10:20:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.139+0000 7f60bdaa6640 1 --2- 172.21.15.133:0/1105118647 >> v2:172.21.15.142:3300/0 conn(0x7f60b815ceb0 0x7f60b806b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:49.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60be2a7640 1 --2- 172.21.15.133:0/1105118647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b815d8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f60b0009d90 tx=0x7f60b001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58113f14c8455c01 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bcaa4640 1 -- 172.21.15.133:0/1105118647 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00a5a30 con 0x7f60b80cf2a0 2023-12-18T10:20:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bcaa4640 1 -- 172.21.15.133:0/1105118647 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b815d4a0 con 0x7f60b80cf2a0 2023-12-18T10:20:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bcaa4640 1 -- 172.21.15.133:0/1105118647 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00a5db0 con 0x7f60b80cf2a0 2023-12-18T10:20:49.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bfd0a640 1 -- 172.21.15.133:0/1105118647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 msgr2=0x7f60b815d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/1105118647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b815d8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f60b0009d90 tx=0x7f60b001c950 comp rx=0 tx=0).stop 2023-12-18T10:20:49.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bfd0a640 1 -- 172.21.15.133:0/1105118647 shutdown_connections 2023-12-18T10:20:49.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/1105118647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b815d8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/1105118647 >> v2:172.21.15.142:3300/0 conn(0x7f60b815ceb0 0x7f60b806b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bfd0a640 1 -- 172.21.15.133:0/1105118647 >> 172.21.15.133:0/1105118647 conn(0x7f60b8069ca0 msgr2=0x7f60b806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:49.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bfd0a640 1 -- 172.21.15.133:0/1105118647 shutdown_connections 2023-12-18T10:20:49.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.143+0000 7f60bfd0a640 1 -- 172.21.15.133:0/1105118647 wait complete. 2023-12-18T10:20:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 Processor -- start 2023-12-18T10:20:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 -- start start 2023-12-18T10:20:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b80ce2c0 0x7f60b8148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b80afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60b815ceb0 0x7f60b8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80b29f0 con 0x7f60b815ceb0 2023-12-18T10:20:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80c48f0 con 0x7f60b80ce2c0 2023-12-18T10:20:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80b2710 con 0x7f60b80cf2a0 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60b815ceb0 0x7f60b8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60b815ceb0 0x7f60b8150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56428/0 (socket says 172.21.15.133:56428) 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 -- 172.21.15.133:0/3906194472 learned_addr learned my addr 172.21.15.133:0/3906194472 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bd2a5640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b80afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bdaa6640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b80ce2c0 0x7f60b8148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 -- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 msgr2=0x7f60b80afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b80afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 -- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b80ce2c0 msgr2=0x7f60b8148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b80ce2c0 0x7f60b8148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 -- 172.21.15.133:0/3906194472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4009420 con 0x7f60b815ceb0 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bd2a5640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b80afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60be2a7640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60b815ceb0 0x7f60b8150cf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f60b00b0040 tx=0x7f60b00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60ae7fc640 1 -- 172.21.15.133:0/3906194472 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00b9860 con 0x7f60b815ceb0 2023-12-18T10:20:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60ae7fc640 1 -- 172.21.15.133:0/3906194472 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b00b99c0 con 0x7f60b815ceb0 2023-12-18T10:20:49.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b0009a70 con 0x7f60b815ceb0 2023-12-18T10:20:49.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.147+0000 7f60ae7fc640 1 -- 172.21.15.133:0/3906194472 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00b9d70 con 0x7f60b815ceb0 2023-12-18T10:20:49.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.151+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b80c4580 con 0x7f60b815ceb0 2023-12-18T10:20:49.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.151+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b80c4100 con 0x7f60b815ceb0 2023-12-18T10:20:49.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.151+0000 7f60ae7fc640 1 -- 172.21.15.133:0/3906194472 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f60b00c4460 con 0x7f60b815ceb0 2023-12-18T10:20:49.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.151+0000 7f60ae7fc640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f609c065a60 0x7f609c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.151+0000 7f60ae7fc640 1 -- 172.21.15.133:0/3906194472 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f60b011e5c0 con 0x7f60b815ceb0 2023-12-18T10:20:49.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.151+0000 7f60bdaa6640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f609c065a60 0x7f609c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.151+0000 7f60bdaa6640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f609c065a60 0x7f609c067f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009cf0 tx=0x7f60b4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.155+0000 7f60ae7fc640 1 -- 172.21.15.133:0/3906194472 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f60b80c4100 con 0x7f60b815ceb0 2023-12-18T10:20:49.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.303+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60b80c4100 con 0x7f609c065a60 2023-12-18T10:20:49.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.311+0000 7f60ae7fc640 1 -- 172.21.15.133:0/3906194472 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289440 (secure 0 0 0) 0x7f60b80c4100 con 0x7f609c065a60 2023-12-18T10:20:49.319 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:49.320 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:20:49.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f609c065a60 msgr2=0x7f609c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f609c065a60 0x7f609c067f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009cf0 tx=0x7f60b4009190 comp rx=0 tx=0).stop 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60b815ceb0 msgr2=0x7f60b8150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60b815ceb0 0x7f60b8150cf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f60b00b0040 tx=0x7f60b00196f0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 shutdown_connections 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f609c065a60 0x7f609c067f20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60b815ceb0 0x7f60b8150cf0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60b80cf2a0 0x7f60b80afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 --2- 172.21.15.133:0/3906194472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b80ce2c0 0x7f60b8148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 >> 172.21.15.133:0/3906194472 conn(0x7f60b8069ca0 msgr2=0x7f60b815e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 shutdown_connections 2023-12-18T10:20:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.315+0000 7f60bfd0a640 1 -- 172.21.15.133:0/3906194472 wait complete. 2023-12-18T10:20:49.339 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-12-18T10:20:49.128677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221768,"kb_used_data":6152,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752952,"statfs":{"total":773094113280,"available":772867022848,"internally_reserved":0,"allocated":6299648,"data_stored":3430308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.993502"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665419+0000","last_change":"2023-12-18T10:20:44.541569+0000","last_active":"2023-12-18T10:20:46.665419+0000","last_peered":"2023-12-18T10:20:46.665419+0000","last_clean":"2023-12-18T10:20:46.665419+0000","last_became_active":"2023-12-18T10:20:44.541324+0000","last_became_peered":"2023-12-18T10:20:44.541324+0000","last_unstale":"2023-12-18T10:20:46.665419+0000","last_undegraded":"2023-12-18T10:20:46.665419+0000","last_fullsized":"2023-12-18T10:20:46.665419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625815+0000","last_change":"2023-12-18T10:20:44.553416+0000","last_active":"2023-12-18T10:20:45.625815+0000","last_peered":"2023-12-18T10:20:45.625815+0000","last_clean":"2023-12-18T10:20:45.625815+0000","last_became_active":"2023-12-18T10:20:44.552973+0000","last_became_peered":"2023-12-18T10:20:44.552973+0000","last_unstale":"2023-12-18T10:20:45.625815+0000","last_undegraded":"2023-12-18T10:20:45.625815+0000","last_fullsized":"2023-12-18T10:20:45.625815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529957+0000","last_change":"2023-12-18T10:20:44.552612+0000","last_active":"2023-12-18T10:20:45.529957+0000","last_peered":"2023-12-18T10:20:45.529957+0000","last_clean":"2023-12-18T10:20:45.529957+0000","last_became_active":"2023-12-18T10:20:44.552325+0000","last_became_peered":"2023-12-18T10:20:44.552325+0000","last_unstale":"2023-12-18T10:20:45.529957+0000","last_undegraded":"2023-12-18T10:20:45.529957+0000","last_fullsized":"2023-12-18T10:20:45.529957+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:11.129841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625701+0000","last_change":"2023-12-18T10:20:44.569713+0000","last_active":"2023-12-18T10:20:45.625701+0000","last_peered":"2023-12-18T10:20:45.625701+0000","last_clean":"2023-12-18T10:20:45.625701+0000","last_became_active":"2023-12-18T10:20:44.569384+0000","last_became_peered":"2023-12-18T10:20:44.569384+0000","last_unstale":"2023-12-18T10:20:45.625701+0000","last_undegraded":"2023-12-18T10:20:45.625701+0000","last_fullsized":"2023-12-18T10:20:45.625701+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007306+0000","last_change":"2023-12-18T10:20:44.558135+0000","last_active":"2023-12-18T10:20:46.007306+0000","last_peered":"2023-12-18T10:20:46.007306+0000","last_clean":"2023-12-18T10:20:46.007306+0000","last_became_active":"2023-12-18T10:20:44.557879+0000","last_became_peered":"2023-12-18T10:20:44.557879+0000","last_unstale":"2023-12-18T10:20:46.007306+0000","last_undegraded":"2023-12-18T10:20:46.007306+0000","last_fullsized":"2023-12-18T10:20:46.007306+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:02:46.177659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665108+0000","last_change":"2023-12-18T10:20:44.548956+0000","last_active":"2023-12-18T10:20:46.665108+0000","last_peered":"2023-12-18T10:20:46.665108+0000","last_clean":"2023-12-18T10:20:46.665108+0000","last_became_active":"2023-12-18T10:20:44.548647+0000","last_became_peered":"2023-12-18T10:20:44.548647+0000","last_unstale":"2023-12-18T10:20:46.665108+0000","last_undegraded":"2023-12-18T10:20:46.665108+0000","last_fullsized":"2023-12-18T10:20:46.665108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529716+0000","last_change":"2023-12-18T10:20:44.549880+0000","last_active":"2023-12-18T10:20:45.529716+0000","last_peered":"2023-12-18T10:20:45.529716+0000","last_clean":"2023-12-18T10:20:45.529716+0000","last_became_active":"2023-12-18T10:20:44.549668+0000","last_became_peered":"2023-12-18T10:20:44.549668+0000","last_unstale":"2023-12-18T10:20:45.529716+0000","last_undegraded":"2023-12-18T10:20:45.529716+0000","last_fullsized":"2023-12-18T10:20:45.529716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:30:04.771313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972789+0000","last_change":"2023-12-18T10:20:44.555231+0000","last_active":"2023-12-18T10:20:46.972789+0000","last_peered":"2023-12-18T10:20:46.972789+0000","last_clean":"2023-12-18T10:20:46.972789+0000","last_became_active":"2023-12-18T10:20:44.554996+0000","last_became_peered":"2023-12-18T10:20:44.554996+0000","last_unstale":"2023-12-18T10:20:46.972789+0000","last_undegraded":"2023-12-18T10:20:46.972789+0000","last_fullsized":"2023-12-18T10:20:46.972789+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:49.088008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973606+0000","last_change":"2023-12-18T10:20:44.565493+0000","last_active":"2023-12-18T10:20:46.973606+0000","last_peered":"2023-12-18T10:20:46.973606+0000","last_clean":"2023-12-18T10:20:46.973606+0000","last_became_active":"2023-12-18T10:20:44.563184+0000","last_became_peered":"2023-12-18T10:20:44.563184+0000","last_unstale":"2023-12-18T10:20:46.973606+0000","last_undegraded":"2023-12-18T10:20:46.973606+0000","last_fullsized":"2023-12-18T10:20:46.973606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:01:21.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665356+0000","last_change":"2023-12-18T10:20:44.553920+0000","last_active":"2023-12-18T10:20:46.665356+0000","last_peered":"2023-12-18T10:20:46.665356+0000","last_clean":"2023-12-18T10:20:46.665356+0000","last_became_active":"2023-12-18T10:20:44.553433+0000","last_became_peered":"2023-12-18T10:20:44.553433+0000","last_unstale":"2023-12-18T10:20:46.665356+0000","last_undegraded":"2023-12-18T10:20:46.665356+0000","last_fullsized":"2023-12-18T10:20:46.665356+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:27.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972955+0000","last_change":"2023-12-18T10:20:44.550904+0000","last_active":"2023-12-18T10:20:46.972955+0000","last_peered":"2023-12-18T10:20:46.972955+0000","last_clean":"2023-12-18T10:20:46.972955+0000","last_became_active":"2023-12-18T10:20:44.550655+0000","last_became_peered":"2023-12-18T10:20:44.550655+0000","last_unstale":"2023-12-18T10:20:46.972955+0000","last_undegraded":"2023-12-18T10:20:46.972955+0000","last_fullsized":"2023-12-18T10:20:46.972955+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:30:24.371002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973397+0000","last_change":"2023-12-18T10:20:44.567970+0000","last_active":"2023-12-18T10:20:46.973397+0000","last_peered":"2023-12-18T10:20:46.973397+0000","last_clean":"2023-12-18T10:20:46.973397+0000","last_became_active":"2023-12-18T10:20:44.567702+0000","last_became_peered":"2023-12-18T10:20:44.567702+0000","last_unstale":"2023-12-18T10:20:46.973397+0000","last_undegraded":"2023-12-18T10:20:46.973397+0000","last_fullsized":"2023-12-18T10:20:46.973397+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:31:01.041735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665206+0000","last_change":"2023-12-18T10:20:44.554022+0000","last_active":"2023-12-18T10:20:46.665206+0000","last_peered":"2023-12-18T10:20:46.665206+0000","last_clean":"2023-12-18T10:20:46.665206+0000","last_became_active":"2023-12-18T10:20:44.553454+0000","last_became_peered":"2023-12-18T10:20:44.553454+0000","last_unstale":"2023-12-18T10:20:46.665206+0000","last_undegraded":"2023-12-18T10:20:46.665206+0000","last_fullsized":"2023-12-18T10:20:46.665206+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529665+0000","last_change":"2023-12-18T10:20:44.541694+0000","last_active":"2023-12-18T10:20:45.529665+0000","last_peered":"2023-12-18T10:20:45.529665+0000","last_clean":"2023-12-18T10:20:45.529665+0000","last_became_active":"2023-12-18T10:20:44.541458+0000","last_became_peered":"2023-12-18T10:20:44.541458+0000","last_unstale":"2023-12-18T10:20:45.529665+0000","last_undegraded":"2023-12-18T10:20:45.529665+0000","last_fullsized":"2023-12-18T10:20:45.529665+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:00:38.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625439+0000","last_change":"2023-12-18T10:20:44.547669+0000","last_active":"2023-12-18T10:20:45.625439+0000","last_peered":"2023-12-18T10:20:45.625439+0000","last_clean":"2023-12-18T10:20:45.625439+0000","last_became_active":"2023-12-18T10:20:44.546946+0000","last_became_peered":"2023-12-18T10:20:44.546946+0000","last_unstale":"2023-12-18T10:20:45.625439+0000","last_undegraded":"2023-12-18T10:20:45.625439+0000","last_fullsized":"2023-12-18T10:20:45.625439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:25:44.473810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665078+0000","last_change":"2023-12-18T10:20:44.557923+0000","last_active":"2023-12-18T10:20:46.665078+0000","last_peered":"2023-12-18T10:20:46.665078+0000","last_clean":"2023-12-18T10:20:46.665078+0000","last_became_active":"2023-12-18T10:20:44.557008+0000","last_became_peered":"2023-12-18T10:20:44.557008+0000","last_unstale":"2023-12-18T10:20:46.665078+0000","last_undegraded":"2023-12-18T10:20:46.665078+0000","last_fullsized":"2023-12-18T10:20:46.665078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530226+0000","last_change":"2023-12-18T10:20:44.546518+0000","last_active":"2023-12-18T10:20:45.530226+0000","last_peered":"2023-12-18T10:20:45.530226+0000","last_clean":"2023-12-18T10:20:45.530226+0000","last_became_active":"2023-12-18T10:20:44.539262+0000","last_became_peered":"2023-12-18T10:20:44.539262+0000","last_unstale":"2023-12-18T10:20:45.530226+0000","last_undegraded":"2023-12-18T10:20:45.530226+0000","last_fullsized":"2023-12-18T10:20:45.530226+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:55:23.232484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625902+0000","last_change":"2023-12-18T10:20:44.553236+0000","last_active":"2023-12-18T10:20:45.625902+0000","last_peered":"2023-12-18T10:20:45.625902+0000","last_clean":"2023-12-18T10:20:45.625902+0000","last_became_active":"2023-12-18T10:20:44.552604+0000","last_became_peered":"2023-12-18T10:20:44.552604+0000","last_unstale":"2023-12-18T10:20:45.625902+0000","last_undegraded":"2023-12-18T10:20:45.625902+0000","last_fullsized":"2023-12-18T10:20:45.625902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530022+0000","last_change":"2023-12-18T10:20:44.557941+0000","last_active":"2023-12-18T10:20:45.530022+0000","last_peered":"2023-12-18T10:20:45.530022+0000","last_clean":"2023-12-18T10:20:45.530022+0000","last_became_active":"2023-12-18T10:20:44.557359+0000","last_became_peered":"2023-12-18T10:20:44.557359+0000","last_unstale":"2023-12-18T10:20:45.530022+0000","last_undegraded":"2023-12-18T10:20:45.530022+0000","last_fullsized":"2023-12-18T10:20:45.530022+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:26:41.602183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974628+0000","last_change":"2023-12-18T10:20:44.551079+0000","last_active":"2023-12-18T10:20:46.974628+0000","last_peered":"2023-12-18T10:20:46.974628+0000","last_clean":"2023-12-18T10:20:46.974628+0000","last_became_active":"2023-12-18T10:20:44.550795+0000","last_became_peered":"2023-12-18T10:20:44.550795+0000","last_unstale":"2023-12-18T10:20:46.974628+0000","last_undegraded":"2023-12-18T10:20:46.974628+0000","last_fullsized":"2023-12-18T10:20:46.974628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:36.622165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974634+0000","last_change":"2023-12-18T10:20:44.550722+0000","last_active":"2023-12-18T10:20:46.974634+0000","last_peered":"2023-12-18T10:20:46.974634+0000","last_clean":"2023-12-18T10:20:46.974634+0000","last_became_active":"2023-12-18T10:20:44.550447+0000","last_became_peered":"2023-12-18T10:20:44.550447+0000","last_unstale":"2023-12-18T10:20:46.974634+0000","last_undegraded":"2023-12-18T10:20:46.974634+0000","last_fullsized":"2023-12-18T10:20:46.974634+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:35.924957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973124+0000","last_change":"2023-12-18T10:20:44.559291+0000","last_active":"2023-12-18T10:20:46.973124+0000","last_peered":"2023-12-18T10:20:46.973124+0000","last_clean":"2023-12-18T10:20:46.973124+0000","last_became_active":"2023-12-18T10:20:44.558639+0000","last_became_peered":"2023-12-18T10:20:44.558639+0000","last_unstale":"2023-12-18T10:20:46.973124+0000","last_undegraded":"2023-12-18T10:20:46.973124+0000","last_fullsized":"2023-12-18T10:20:46.973124+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:01.381067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972986+0000","last_change":"2023-12-18T10:20:44.547921+0000","last_active":"2023-12-18T10:20:46.972986+0000","last_peered":"2023-12-18T10:20:46.972986+0000","last_clean":"2023-12-18T10:20:46.972986+0000","last_became_active":"2023-12-18T10:20:44.547680+0000","last_became_peered":"2023-12-18T10:20:44.547680+0000","last_unstale":"2023-12-18T10:20:46.972986+0000","last_undegraded":"2023-12-18T10:20:46.972986+0000","last_fullsized":"2023-12-18T10:20:46.972986+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:52:01.892725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529487+0000","last_change":"2023-12-18T10:20:44.541085+0000","last_active":"2023-12-18T10:20:45.529487+0000","last_peered":"2023-12-18T10:20:45.529487+0000","last_clean":"2023-12-18T10:20:45.529487+0000","last_became_active":"2023-12-18T10:20:44.540880+0000","last_became_peered":"2023-12-18T10:20:44.540880+0000","last_unstale":"2023-12-18T10:20:45.529487+0000","last_undegraded":"2023-12-18T10:20:45.529487+0000","last_fullsized":"2023-12-18T10:20:45.529487+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:19:08.205983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530435+0000","last_change":"2023-12-18T10:20:44.560740+0000","last_active":"2023-12-18T10:20:45.530435+0000","last_peered":"2023-12-18T10:20:45.530435+0000","last_clean":"2023-12-18T10:20:45.530435+0000","last_became_active":"2023-12-18T10:20:44.559929+0000","last_became_peered":"2023-12-18T10:20:44.559929+0000","last_unstale":"2023-12-18T10:20:45.530435+0000","last_undegraded":"2023-12-18T10:20:45.530435+0000","last_fullsized":"2023-12-18T10:20:45.530435+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:14:56.044092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973464+0000","last_change":"2023-12-18T10:20:44.562617+0000","last_active":"2023-12-18T10:20:46.973464+0000","last_peered":"2023-12-18T10:20:46.973464+0000","last_clean":"2023-12-18T10:20:46.973464+0000","last_became_active":"2023-12-18T10:20:44.559094+0000","last_became_peered":"2023-12-18T10:20:44.559094+0000","last_unstale":"2023-12-18T10:20:46.973464+0000","last_undegraded":"2023-12-18T10:20:46.973464+0000","last_fullsized":"2023-12-18T10:20:46.973464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:11.129841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665445+0000","last_change":"2023-12-18T10:20:44.548054+0000","last_active":"2023-12-18T10:20:46.665445+0000","last_peered":"2023-12-18T10:20:46.665445+0000","last_clean":"2023-12-18T10:20:46.665445+0000","last_became_active":"2023-12-18T10:20:44.546099+0000","last_became_peered":"2023-12-18T10:20:44.546099+0000","last_unstale":"2023-12-18T10:20:46.665445+0000","last_undegraded":"2023-12-18T10:20:46.665445+0000","last_fullsized":"2023-12-18T10:20:46.665445+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:07.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974706+0000","last_change":"2023-12-18T10:20:44.549776+0000","last_active":"2023-12-18T10:20:46.974706+0000","last_peered":"2023-12-18T10:20:46.974706+0000","last_clean":"2023-12-18T10:20:46.974706+0000","last_became_active":"2023-12-18T10:20:44.549390+0000","last_became_peered":"2023-12-18T10:20:44.549390+0000","last_unstale":"2023-12-18T10:20:46.974706+0000","last_undegraded":"2023-12-18T10:20:46.974706+0000","last_fullsized":"2023-12-18T10:20:46.974706+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:26.177941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529592+0000","last_change":"2023-12-18T10:20:44.543084+0000","last_active":"2023-12-18T10:20:45.529592+0000","last_peered":"2023-12-18T10:20:45.529592+0000","last_clean":"2023-12-18T10:20:45.529592+0000","last_became_active":"2023-12-18T10:20:44.542832+0000","last_became_peered":"2023-12-18T10:20:44.542832+0000","last_unstale":"2023-12-18T10:20:45.529592+0000","last_undegraded":"2023-12-18T10:20:45.529592+0000","last_fullsized":"2023-12-18T10:20:45.529592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:02:47.834572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625577+0000","last_change":"2023-12-18T10:20:44.559683+0000","last_active":"2023-12-18T10:20:45.625577+0000","last_peered":"2023-12-18T10:20:45.625577+0000","last_clean":"2023-12-18T10:20:45.625577+0000","last_became_active":"2023-12-18T10:20:44.559405+0000","last_became_peered":"2023-12-18T10:20:44.559405+0000","last_unstale":"2023-12-18T10:20:45.625577+0000","last_undegraded":"2023-12-18T10:20:45.625577+0000","last_fullsized":"2023-12-18T10:20:45.625577+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:17.717007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529658+0000","last_change":"2023-12-18T10:20:44.541587+0000","last_active":"2023-12-18T10:20:45.529658+0000","last_peered":"2023-12-18T10:20:45.529658+0000","last_clean":"2023-12-18T10:20:45.529658+0000","last_became_active":"2023-12-18T10:20:44.541354+0000","last_became_peered":"2023-12-18T10:20:44.541354+0000","last_unstale":"2023-12-18T10:20:45.529658+0000","last_undegraded":"2023-12-18T10:20:45.529658+0000","last_fullsized":"2023-12-18T10:20:45.529658+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:23:09.477926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533840+0000","last_change":"2023-12-18T10:20:44.557322+0000","last_active":"2023-12-18T10:20:45.533840+0000","last_peered":"2023-12-18T10:20:45.533840+0000","last_clean":"2023-12-18T10:20:45.533840+0000","last_became_active":"2023-12-18T10:20:44.556856+0000","last_became_peered":"2023-12-18T10:20:44.556856+0000","last_unstale":"2023-12-18T10:20:45.533840+0000","last_undegraded":"2023-12-18T10:20:45.533840+0000","last_fullsized":"2023-12-18T10:20:45.533840+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625253+0000","last_change":"2023-12-18T10:20:44.547880+0000","last_active":"2023-12-18T10:20:45.625253+0000","last_peered":"2023-12-18T10:20:45.625253+0000","last_clean":"2023-12-18T10:20:45.625253+0000","last_became_active":"2023-12-18T10:20:44.547584+0000","last_became_peered":"2023-12-18T10:20:44.547584+0000","last_unstale":"2023-12-18T10:20:45.625253+0000","last_undegraded":"2023-12-18T10:20:45.625253+0000","last_fullsized":"2023-12-18T10:20:45.625253+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"52'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974618+0000","last_change":"2023-12-18T10:20:44.162825+0000","last_active":"2023-12-18T10:20:46.974618+0000","last_peered":"2023-12-18T10:20:46.974618+0000","last_clean":"2023-12-18T10:20:46.974618+0000","last_became_active":"2023-12-18T10:20:44.162537+0000","last_became_peered":"2023-12-18T10:20:44.162537+0000","last_unstale":"2023-12-18T10:20:46.974618+0000","last_undegraded":"2023-12-18T10:20:46.974618+0000","last_fullsized":"2023-12-18T10:20:46.974618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:04:00.914247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533856+0000","last_change":"2023-12-18T10:20:44.543554+0000","last_active":"2023-12-18T10:20:45.533856+0000","last_peered":"2023-12-18T10:20:45.533856+0000","last_clean":"2023-12-18T10:20:45.533856+0000","last_became_active":"2023-12-18T10:20:44.543259+0000","last_became_peered":"2023-12-18T10:20:44.543259+0000","last_unstale":"2023-12-18T10:20:45.533856+0000","last_undegraded":"2023-12-18T10:20:45.533856+0000","last_fullsized":"2023-12-18T10:20:45.533856+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665359+0000","last_change":"2023-12-18T10:20:44.156837+0000","last_active":"2023-12-18T10:20:46.665359+0000","last_peered":"2023-12-18T10:20:46.665359+0000","last_clean":"2023-12-18T10:20:46.665359+0000","last_became_active":"2023-12-18T10:20:44.156616+0000","last_became_peered":"2023-12-18T10:20:44.156616+0000","last_unstale":"2023-12-18T10:20:46.665359+0000","last_undegraded":"2023-12-18T10:20:46.665359+0000","last_fullsized":"2023-12-18T10:20:46.665359+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:25.166970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974823+0000","last_change":"2023-12-18T10:20:44.554271+0000","last_active":"2023-12-18T10:20:46.974823+0000","last_peered":"2023-12-18T10:20:46.974823+0000","last_clean":"2023-12-18T10:20:46.974823+0000","last_became_active":"2023-12-18T10:20:44.551042+0000","last_became_peered":"2023-12-18T10:20:44.551042+0000","last_unstale":"2023-12-18T10:20:46.974823+0000","last_undegraded":"2023-12-18T10:20:46.974823+0000","last_fullsized":"2023-12-18T10:20:46.974823+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:45.276234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665437+0000","last_change":"2023-12-18T10:20:44.165356+0000","last_active":"2023-12-18T10:20:46.665437+0000","last_peered":"2023-12-18T10:20:46.665437+0000","last_clean":"2023-12-18T10:20:46.665437+0000","last_became_active":"2023-12-18T10:20:44.164855+0000","last_became_peered":"2023-12-18T10:20:44.164855+0000","last_unstale":"2023-12-18T10:20:46.665437+0000","last_undegraded":"2023-12-18T10:20:46.665437+0000","last_fullsized":"2023-12-18T10:20:46.665437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973111+0000","last_change":"2023-12-18T10:20:44.562589+0000","last_active":"2023-12-18T10:20:46.973111+0000","last_peered":"2023-12-18T10:20:46.973111+0000","last_clean":"2023-12-18T10:20:46.973111+0000","last_became_active":"2023-12-18T10:20:44.562357+0000","last_became_peered":"2023-12-18T10:20:44.562357+0000","last_unstale":"2023-12-18T10:20:46.973111+0000","last_undegraded":"2023-12-18T10:20:46.973111+0000","last_fullsized":"2023-12-18T10:20:46.973111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:19:08.205983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533943+0000","last_change":"2023-12-18T10:20:44.165232+0000","last_active":"2023-12-18T10:20:45.533943+0000","last_peered":"2023-12-18T10:20:45.533943+0000","last_clean":"2023-12-18T10:20:45.533943+0000","last_became_active":"2023-12-18T10:20:44.164930+0000","last_became_peered":"2023-12-18T10:20:44.164930+0000","last_unstale":"2023-12-18T10:20:45.533943+0000","last_undegraded":"2023-12-18T10:20:45.533943+0000","last_fullsized":"2023-12-18T10:20:45.533943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007488+0000","last_change":"2023-12-18T10:20:44.559015+0000","last_active":"2023-12-18T10:20:46.007488+0000","last_peered":"2023-12-18T10:20:46.007488+0000","last_clean":"2023-12-18T10:20:46.007488+0000","last_became_active":"2023-12-18T10:20:44.557410+0000","last_became_peered":"2023-12-18T10:20:44.557410+0000","last_unstale":"2023-12-18T10:20:46.007488+0000","last_undegraded":"2023-12-18T10:20:46.007488+0000","last_fullsized":"2023-12-18T10:20:46.007488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529810+0000","last_change":"2023-12-18T10:20:44.169502+0000","last_active":"2023-12-18T10:20:45.529810+0000","last_peered":"2023-12-18T10:20:45.529810+0000","last_clean":"2023-12-18T10:20:45.529810+0000","last_became_active":"2023-12-18T10:20:44.169239+0000","last_became_peered":"2023-12-18T10:20:44.169239+0000","last_unstale":"2023-12-18T10:20:45.529810+0000","last_undegraded":"2023-12-18T10:20:45.529810+0000","last_fullsized":"2023-12-18T10:20:45.529810+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:41:04.766861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625670+0000","last_change":"2023-12-18T10:20:44.559775+0000","last_active":"2023-12-18T10:20:45.625670+0000","last_peered":"2023-12-18T10:20:45.625670+0000","last_clean":"2023-12-18T10:20:45.625670+0000","last_became_active":"2023-12-18T10:20:44.559484+0000","last_became_peered":"2023-12-18T10:20:44.559484+0000","last_unstale":"2023-12-18T10:20:45.625670+0000","last_undegraded":"2023-12-18T10:20:45.625670+0000","last_fullsized":"2023-12-18T10:20:45.625670+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007191+0000","last_change":"2023-12-18T10:20:44.155223+0000","last_active":"2023-12-18T10:20:46.007191+0000","last_peered":"2023-12-18T10:20:46.007191+0000","last_clean":"2023-12-18T10:20:46.007191+0000","last_became_active":"2023-12-18T10:20:44.154919+0000","last_became_peered":"2023-12-18T10:20:44.154919+0000","last_unstale":"2023-12-18T10:20:46.007191+0000","last_undegraded":"2023-12-18T10:20:46.007191+0000","last_fullsized":"2023-12-18T10:20:46.007191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:18.073237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973513+0000","last_change":"2023-12-18T10:20:44.555178+0000","last_active":"2023-12-18T10:20:46.973513+0000","last_peered":"2023-12-18T10:20:46.973513+0000","last_clean":"2023-12-18T10:20:46.973513+0000","last_became_active":"2023-12-18T10:20:44.552676+0000","last_became_peered":"2023-12-18T10:20:44.552676+0000","last_unstale":"2023-12-18T10:20:46.973513+0000","last_undegraded":"2023-12-18T10:20:46.973513+0000","last_fullsized":"2023-12-18T10:20:46.973513+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974437+0000","last_change":"2023-12-18T10:20:44.163586+0000","last_active":"2023-12-18T10:20:46.974437+0000","last_peered":"2023-12-18T10:20:46.974437+0000","last_clean":"2023-12-18T10:20:46.974437+0000","last_became_active":"2023-12-18T10:20:44.163063+0000","last_became_peered":"2023-12-18T10:20:44.163063+0000","last_unstale":"2023-12-18T10:20:46.974437+0000","last_undegraded":"2023-12-18T10:20:46.974437+0000","last_fullsized":"2023-12-18T10:20:46.974437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:44:52.499992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625675+0000","last_change":"2023-12-18T10:20:44.553548+0000","last_active":"2023-12-18T10:20:45.625675+0000","last_peered":"2023-12-18T10:20:45.625675+0000","last_clean":"2023-12-18T10:20:45.625675+0000","last_became_active":"2023-12-18T10:20:44.553132+0000","last_became_peered":"2023-12-18T10:20:44.553132+0000","last_unstale":"2023-12-18T10:20:45.625675+0000","last_undegraded":"2023-12-18T10:20:45.625675+0000","last_fullsized":"2023-12-18T10:20:45.625675+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:27.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529565+0000","last_change":"2023-12-18T10:20:44.162413+0000","last_active":"2023-12-18T10:20:45.529565+0000","last_peered":"2023-12-18T10:20:45.529565+0000","last_clean":"2023-12-18T10:20:45.529565+0000","last_became_active":"2023-12-18T10:20:44.162072+0000","last_became_peered":"2023-12-18T10:20:44.162072+0000","last_unstale":"2023-12-18T10:20:45.529565+0000","last_undegraded":"2023-12-18T10:20:45.529565+0000","last_fullsized":"2023-12-18T10:20:45.529565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:29.295023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007200+0000","last_change":"2023-12-18T10:20:44.554437+0000","last_active":"2023-12-18T10:20:46.007200+0000","last_peered":"2023-12-18T10:20:46.007200+0000","last_clean":"2023-12-18T10:20:46.007200+0000","last_became_active":"2023-12-18T10:20:44.554152+0000","last_became_peered":"2023-12-18T10:20:44.554152+0000","last_unstale":"2023-12-18T10:20:46.007200+0000","last_undegraded":"2023-12-18T10:20:46.007200+0000","last_fullsized":"2023-12-18T10:20:46.007200+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:02:47.834572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625670+0000","last_change":"2023-12-18T10:20:44.157327+0000","last_active":"2023-12-18T10:20:45.625670+0000","last_peered":"2023-12-18T10:20:45.625670+0000","last_clean":"2023-12-18T10:20:45.625670+0000","last_became_active":"2023-12-18T10:20:44.157049+0000","last_became_peered":"2023-12-18T10:20:44.157049+0000","last_unstale":"2023-12-18T10:20:45.625670+0000","last_undegraded":"2023-12-18T10:20:45.625670+0000","last_fullsized":"2023-12-18T10:20:45.625670+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:44.265262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533813+0000","last_change":"2023-12-18T10:20:44.560201+0000","last_active":"2023-12-18T10:20:45.533813+0000","last_peered":"2023-12-18T10:20:45.533813+0000","last_clean":"2023-12-18T10:20:45.533813+0000","last_became_active":"2023-12-18T10:20:44.559244+0000","last_became_peered":"2023-12-18T10:20:44.559244+0000","last_unstale":"2023-12-18T10:20:45.533813+0000","last_undegraded":"2023-12-18T10:20:45.533813+0000","last_fullsized":"2023-12-18T10:20:45.533813+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:25:44.473810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007444+0000","last_change":"2023-12-18T10:20:44.167242+0000","last_active":"2023-12-18T10:20:46.007444+0000","last_peered":"2023-12-18T10:20:46.007444+0000","last_clean":"2023-12-18T10:20:46.007444+0000","last_became_active":"2023-12-18T10:20:44.166853+0000","last_became_peered":"2023-12-18T10:20:44.166853+0000","last_unstale":"2023-12-18T10:20:46.007444+0000","last_undegraded":"2023-12-18T10:20:46.007444+0000","last_fullsized":"2023-12-18T10:20:46.007444+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:24:20.559813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529762+0000","last_change":"2023-12-18T10:20:44.551734+0000","last_active":"2023-12-18T10:20:45.529762+0000","last_peered":"2023-12-18T10:20:45.529762+0000","last_clean":"2023-12-18T10:20:45.529762+0000","last_became_active":"2023-12-18T10:20:44.545973+0000","last_became_peered":"2023-12-18T10:20:44.545973+0000","last_unstale":"2023-12-18T10:20:45.529762+0000","last_undegraded":"2023-12-18T10:20:45.529762+0000","last_fullsized":"2023-12-18T10:20:45.529762+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:02:46.177659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"52'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625770+0000","last_change":"2023-12-18T10:20:44.168519+0000","last_active":"2023-12-18T10:20:45.625770+0000","last_peered":"2023-12-18T10:20:45.625770+0000","last_clean":"2023-12-18T10:20:45.625770+0000","last_became_active":"2023-12-18T10:20:44.168162+0000","last_became_peered":"2023-12-18T10:20:44.168162+0000","last_unstale":"2023-12-18T10:20:45.625770+0000","last_undegraded":"2023-12-18T10:20:45.625770+0000","last_fullsized":"2023-12-18T10:20:45.625770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007479+0000","last_change":"2023-12-18T10:20:44.553336+0000","last_active":"2023-12-18T10:20:46.007479+0000","last_peered":"2023-12-18T10:20:46.007479+0000","last_clean":"2023-12-18T10:20:46.007479+0000","last_became_active":"2023-12-18T10:20:44.553058+0000","last_became_peered":"2023-12-18T10:20:44.553058+0000","last_unstale":"2023-12-18T10:20:46.007479+0000","last_undegraded":"2023-12-18T10:20:46.007479+0000","last_fullsized":"2023-12-18T10:20:46.007479+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:42:05.275947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973472+0000","last_change":"2023-12-18T10:20:44.157054+0000","last_active":"2023-12-18T10:20:46.973472+0000","last_peered":"2023-12-18T10:20:46.973472+0000","last_clean":"2023-12-18T10:20:46.973472+0000","last_became_active":"2023-12-18T10:20:44.155959+0000","last_became_peered":"2023-12-18T10:20:44.155959+0000","last_unstale":"2023-12-18T10:20:46.973472+0000","last_undegraded":"2023-12-18T10:20:46.973472+0000","last_fullsized":"2023-12-18T10:20:46.973472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:16.706036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533754+0000","last_change":"2023-12-18T10:20:44.544356+0000","last_active":"2023-12-18T10:20:45.533754+0000","last_peered":"2023-12-18T10:20:45.533754+0000","last_clean":"2023-12-18T10:20:45.533754+0000","last_became_active":"2023-12-18T10:20:44.544088+0000","last_became_peered":"2023-12-18T10:20:44.544088+0000","last_unstale":"2023-12-18T10:20:45.533754+0000","last_undegraded":"2023-12-18T10:20:45.533754+0000","last_fullsized":"2023-12-18T10:20:45.533754+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529885+0000","last_change":"2023-12-18T10:20:44.164064+0000","last_active":"2023-12-18T10:20:45.529885+0000","last_peered":"2023-12-18T10:20:45.529885+0000","last_clean":"2023-12-18T10:20:45.529885+0000","last_became_active":"2023-12-18T10:20:44.163795+0000","last_became_peered":"2023-12-18T10:20:44.163795+0000","last_unstale":"2023-12-18T10:20:45.529885+0000","last_undegraded":"2023-12-18T10:20:45.529885+0000","last_fullsized":"2023-12-18T10:20:45.529885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:24:57.538958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530059+0000","last_change":"2023-12-18T10:20:44.557971+0000","last_active":"2023-12-18T10:20:45.530059+0000","last_peered":"2023-12-18T10:20:45.530059+0000","last_clean":"2023-12-18T10:20:45.530059+0000","last_became_active":"2023-12-18T10:20:44.557422+0000","last_became_peered":"2023-12-18T10:20:44.557422+0000","last_unstale":"2023-12-18T10:20:45.530059+0000","last_undegraded":"2023-12-18T10:20:45.530059+0000","last_fullsized":"2023-12-18T10:20:45.530059+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:27:23.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974803+0000","last_change":"2023-12-18T10:20:44.164320+0000","last_active":"2023-12-18T10:20:46.974803+0000","last_peered":"2023-12-18T10:20:46.974803+0000","last_clean":"2023-12-18T10:20:46.974803+0000","last_became_active":"2023-12-18T10:20:44.163409+0000","last_became_peered":"2023-12-18T10:20:44.163409+0000","last_unstale":"2023-12-18T10:20:46.974803+0000","last_undegraded":"2023-12-18T10:20:46.974803+0000","last_fullsized":"2023-12-18T10:20:46.974803+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:34:08.030810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973450+0000","last_change":"2023-12-18T10:20:44.554995+0000","last_active":"2023-12-18T10:20:46.973450+0000","last_peered":"2023-12-18T10:20:46.973450+0000","last_clean":"2023-12-18T10:20:46.973450+0000","last_became_active":"2023-12-18T10:20:44.552286+0000","last_became_peered":"2023-12-18T10:20:44.552286+0000","last_unstale":"2023-12-18T10:20:46.973450+0000","last_undegraded":"2023-12-18T10:20:46.973450+0000","last_fullsized":"2023-12-18T10:20:46.973450+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:55:21.229790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625932+0000","last_change":"2023-12-18T10:20:44.164101+0000","last_active":"2023-12-18T10:20:45.625932+0000","last_peered":"2023-12-18T10:20:45.625932+0000","last_clean":"2023-12-18T10:20:45.625932+0000","last_became_active":"2023-12-18T10:20:44.163821+0000","last_became_peered":"2023-12-18T10:20:44.163821+0000","last_unstale":"2023-12-18T10:20:45.625932+0000","last_undegraded":"2023-12-18T10:20:45.625932+0000","last_fullsized":"2023-12-18T10:20:45.625932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:25.166970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530434+0000","last_change":"2023-12-18T10:20:44.551091+0000","last_active":"2023-12-18T10:20:45.530434+0000","last_peered":"2023-12-18T10:20:45.530434+0000","last_clean":"2023-12-18T10:20:45.530434+0000","last_became_active":"2023-12-18T10:20:44.539298+0000","last_became_peered":"2023-12-18T10:20:44.539298+0000","last_unstale":"2023-12-18T10:20:45.530434+0000","last_undegraded":"2023-12-18T10:20:45.530434+0000","last_fullsized":"2023-12-18T10:20:45.530434+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:53:45.035923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972927+0000","last_change":"2023-12-18T10:20:44.157364+0000","last_active":"2023-12-18T10:20:46.972927+0000","last_peered":"2023-12-18T10:20:46.972927+0000","last_clean":"2023-12-18T10:20:46.972927+0000","last_became_active":"2023-12-18T10:20:44.156619+0000","last_became_peered":"2023-12-18T10:20:44.156619+0000","last_unstale":"2023-12-18T10:20:46.972927+0000","last_undegraded":"2023-12-18T10:20:46.972927+0000","last_fullsized":"2023-12-18T10:20:46.972927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:18.073237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972874+0000","last_change":"2023-12-18T10:20:44.555678+0000","last_active":"2023-12-18T10:20:46.972874+0000","last_peered":"2023-12-18T10:20:46.972874+0000","last_clean":"2023-12-18T10:20:46.972874+0000","last_became_active":"2023-12-18T10:20:44.555362+0000","last_became_peered":"2023-12-18T10:20:44.555362+0000","last_unstale":"2023-12-18T10:20:46.972874+0000","last_undegraded":"2023-12-18T10:20:46.972874+0000","last_fullsized":"2023-12-18T10:20:46.972874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:43:28.833198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530498+0000","last_change":"2023-12-18T10:20:44.167688+0000","last_active":"2023-12-18T10:20:45.530498+0000","last_peered":"2023-12-18T10:20:45.530498+0000","last_clean":"2023-12-18T10:20:45.530498+0000","last_became_active":"2023-12-18T10:20:44.167355+0000","last_became_peered":"2023-12-18T10:20:44.167355+0000","last_unstale":"2023-12-18T10:20:45.530498+0000","last_undegraded":"2023-12-18T10:20:45.530498+0000","last_fullsized":"2023-12-18T10:20:45.530498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:50:09.229493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665076+0000","last_change":"2023-12-18T10:20:44.557736+0000","last_active":"2023-12-18T10:20:46.665076+0000","last_peered":"2023-12-18T10:20:46.665076+0000","last_clean":"2023-12-18T10:20:46.665076+0000","last_became_active":"2023-12-18T10:20:44.557460+0000","last_became_peered":"2023-12-18T10:20:44.557460+0000","last_unstale":"2023-12-18T10:20:46.665076+0000","last_undegraded":"2023-12-18T10:20:46.665076+0000","last_fullsized":"2023-12-18T10:20:46.665076+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:19.084208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973112+0000","last_change":"2023-12-18T10:20:44.151881+0000","last_active":"2023-12-18T10:20:46.973112+0000","last_peered":"2023-12-18T10:20:46.973112+0000","last_clean":"2023-12-18T10:20:46.973112+0000","last_became_active":"2023-12-18T10:20:44.151632+0000","last_became_peered":"2023-12-18T10:20:44.151632+0000","last_unstale":"2023-12-18T10:20:46.973112+0000","last_undegraded":"2023-12-18T10:20:46.973112+0000","last_fullsized":"2023-12-18T10:20:46.973112+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:49:34.977000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007240+0000","last_change":"2023-12-18T10:20:44.561781+0000","last_active":"2023-12-18T10:20:46.007240+0000","last_peered":"2023-12-18T10:20:46.007240+0000","last_clean":"2023-12-18T10:20:46.007240+0000","last_became_active":"2023-12-18T10:20:44.560974+0000","last_became_peered":"2023-12-18T10:20:44.560974+0000","last_unstale":"2023-12-18T10:20:46.007240+0000","last_undegraded":"2023-12-18T10:20:46.007240+0000","last_fullsized":"2023-12-18T10:20:46.007240+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:00:38.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974671+0000","last_change":"2023-12-18T10:20:44.170979+0000","last_active":"2023-12-18T10:20:46.974671+0000","last_peered":"2023-12-18T10:20:46.974671+0000","last_clean":"2023-12-18T10:20:46.974671+0000","last_became_active":"2023-12-18T10:20:44.170626+0000","last_became_peered":"2023-12-18T10:20:44.170626+0000","last_unstale":"2023-12-18T10:20:46.974671+0000","last_undegraded":"2023-12-18T10:20:46.974671+0000","last_fullsized":"2023-12-18T10:20:46.974671+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:53:23.769325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665228+0000","last_change":"2023-12-18T10:20:44.548267+0000","last_active":"2023-12-18T10:20:46.665228+0000","last_peered":"2023-12-18T10:20:46.665228+0000","last_clean":"2023-12-18T10:20:46.665228+0000","last_became_active":"2023-12-18T10:20:44.547627+0000","last_became_peered":"2023-12-18T10:20:44.547627+0000","last_unstale":"2023-12-18T10:20:46.665228+0000","last_undegraded":"2023-12-18T10:20:46.665228+0000","last_fullsized":"2023-12-18T10:20:46.665228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974791+0000","last_change":"2023-12-18T10:20:44.166174+0000","last_active":"2023-12-18T10:20:46.974791+0000","last_peered":"2023-12-18T10:20:46.974791+0000","last_clean":"2023-12-18T10:20:46.974791+0000","last_became_active":"2023-12-18T10:20:44.165054+0000","last_became_peered":"2023-12-18T10:20:44.165054+0000","last_unstale":"2023-12-18T10:20:46.974791+0000","last_undegraded":"2023-12-18T10:20:46.974791+0000","last_fullsized":"2023-12-18T10:20:46.974791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:44:06.990219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533963+0000","last_change":"2023-12-18T10:20:44.553504+0000","last_active":"2023-12-18T10:20:45.533963+0000","last_peered":"2023-12-18T10:20:45.533963+0000","last_clean":"2023-12-18T10:20:45.533963+0000","last_became_active":"2023-12-18T10:20:44.553232+0000","last_became_peered":"2023-12-18T10:20:44.553232+0000","last_unstale":"2023-12-18T10:20:45.533963+0000","last_undegraded":"2023-12-18T10:20:45.533963+0000","last_fullsized":"2023-12-18T10:20:45.533963+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:56.149679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665294+0000","last_change":"2023-12-18T10:20:44.152396+0000","last_active":"2023-12-18T10:20:46.665294+0000","last_peered":"2023-12-18T10:20:46.665294+0000","last_clean":"2023-12-18T10:20:46.665294+0000","last_became_active":"2023-12-18T10:20:44.152118+0000","last_became_peered":"2023-12-18T10:20:44.152118+0000","last_unstale":"2023-12-18T10:20:46.665294+0000","last_undegraded":"2023-12-18T10:20:46.665294+0000","last_fullsized":"2023-12-18T10:20:46.665294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:34.913986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974549+0000","last_change":"2023-12-18T10:20:44.558747+0000","last_active":"2023-12-18T10:20:46.974549+0000","last_peered":"2023-12-18T10:20:46.974549+0000","last_clean":"2023-12-18T10:20:46.974549+0000","last_became_active":"2023-12-18T10:20:44.558132+0000","last_became_peered":"2023-12-18T10:20:44.558132+0000","last_unstale":"2023-12-18T10:20:46.974549+0000","last_undegraded":"2023-12-18T10:20:46.974549+0000","last_fullsized":"2023-12-18T10:20:46.974549+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:30.305994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973210+0000","last_change":"2023-12-18T10:20:44.157131+0000","last_active":"2023-12-18T10:20:46.973210+0000","last_peered":"2023-12-18T10:20:46.973210+0000","last_clean":"2023-12-18T10:20:46.973210+0000","last_became_active":"2023-12-18T10:20:44.155719+0000","last_became_peered":"2023-12-18T10:20:44.155719+0000","last_unstale":"2023-12-18T10:20:46.973210+0000","last_undegraded":"2023-12-18T10:20:46.973210+0000","last_fullsized":"2023-12-18T10:20:46.973210+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:06.923115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530230+0000","last_change":"2023-12-18T10:20:44.553001+0000","last_active":"2023-12-18T10:20:45.530230+0000","last_peered":"2023-12-18T10:20:45.530230+0000","last_clean":"2023-12-18T10:20:45.530230+0000","last_became_active":"2023-12-18T10:20:44.551969+0000","last_became_peered":"2023-12-18T10:20:44.551969+0000","last_unstale":"2023-12-18T10:20:45.530230+0000","last_undegraded":"2023-12-18T10:20:45.530230+0000","last_fullsized":"2023-12-18T10:20:45.530230+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:42:05.275947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529743+0000","last_change":"2023-12-18T10:20:44.168499+0000","last_active":"2023-12-18T10:20:45.529743+0000","last_peered":"2023-12-18T10:20:45.529743+0000","last_clean":"2023-12-18T10:20:45.529743+0000","last_became_active":"2023-12-18T10:20:44.168258+0000","last_became_peered":"2023-12-18T10:20:44.168258+0000","last_unstale":"2023-12-18T10:20:45.529743+0000","last_undegraded":"2023-12-18T10:20:45.529743+0000","last_fullsized":"2023-12-18T10:20:45.529743+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665415+0000","last_change":"2023-12-18T10:20:44.553780+0000","last_active":"2023-12-18T10:20:46.665415+0000","last_peered":"2023-12-18T10:20:46.665415+0000","last_clean":"2023-12-18T10:20:46.665415+0000","last_became_active":"2023-12-18T10:20:44.553492+0000","last_became_peered":"2023-12-18T10:20:44.553492+0000","last_unstale":"2023-12-18T10:20:46.665415+0000","last_undegraded":"2023-12-18T10:20:46.665415+0000","last_fullsized":"2023-12-18T10:20:46.665415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:24:21.570784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972778+0000","last_change":"2023-12-18T10:20:44.158923+0000","last_active":"2023-12-18T10:20:46.972778+0000","last_peered":"2023-12-18T10:20:46.972778+0000","last_clean":"2023-12-18T10:20:46.972778+0000","last_became_active":"2023-12-18T10:20:44.158643+0000","last_became_peered":"2023-12-18T10:20:44.158643+0000","last_unstale":"2023-12-18T10:20:46.972778+0000","last_undegraded":"2023-12-18T10:20:46.972778+0000","last_fullsized":"2023-12-18T10:20:46.972778+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:20:05.856413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.534016+0000","last_change":"2023-12-18T10:20:44.557128+0000","last_active":"2023-12-18T10:20:45.534016+0000","last_peered":"2023-12-18T10:20:45.534016+0000","last_clean":"2023-12-18T10:20:45.534016+0000","last_became_active":"2023-12-18T10:20:44.556447+0000","last_became_peered":"2023-12-18T10:20:44.556447+0000","last_unstale":"2023-12-18T10:20:45.534016+0000","last_undegraded":"2023-12-18T10:20:45.534016+0000","last_fullsized":"2023-12-18T10:20:45.534016+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974732+0000","last_change":"2023-12-18T10:20:44.168330+0000","last_active":"2023-12-18T10:20:46.974732+0000","last_peered":"2023-12-18T10:20:46.974732+0000","last_clean":"2023-12-18T10:20:46.974732+0000","last_became_active":"2023-12-18T10:20:44.167960+0000","last_became_peered":"2023-12-18T10:20:44.167960+0000","last_unstale":"2023-12-18T10:20:46.974732+0000","last_undegraded":"2023-12-18T10:20:46.974732+0000","last_fullsized":"2023-12-18T10:20:46.974732+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:17.767330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665157+0000","last_change":"2023-12-18T10:20:44.549359+0000","last_active":"2023-12-18T10:20:46.665157+0000","last_peered":"2023-12-18T10:20:46.665157+0000","last_clean":"2023-12-18T10:20:46.665157+0000","last_became_active":"2023-12-18T10:20:44.549060+0000","last_became_peered":"2023-12-18T10:20:44.549060+0000","last_unstale":"2023-12-18T10:20:46.665157+0000","last_undegraded":"2023-12-18T10:20:46.665157+0000","last_fullsized":"2023-12-18T10:20:46.665157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:17.717007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625785+0000","last_change":"2023-12-18T10:20:44.161537+0000","last_active":"2023-12-18T10:20:45.625785+0000","last_peered":"2023-12-18T10:20:45.625785+0000","last_clean":"2023-12-18T10:20:45.625785+0000","last_became_active":"2023-12-18T10:20:44.161261+0000","last_became_peered":"2023-12-18T10:20:44.161261+0000","last_unstale":"2023-12-18T10:20:45.625785+0000","last_undegraded":"2023-12-18T10:20:45.625785+0000","last_fullsized":"2023-12-18T10:20:45.625785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:34.913986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973211+0000","last_change":"2023-12-18T10:20:44.557727+0000","last_active":"2023-12-18T10:20:46.973211+0000","last_peered":"2023-12-18T10:20:46.973211+0000","last_clean":"2023-12-18T10:20:46.973211+0000","last_became_active":"2023-12-18T10:20:44.557468+0000","last_became_peered":"2023-12-18T10:20:44.557468+0000","last_unstale":"2023-12-18T10:20:46.973211+0000","last_undegraded":"2023-12-18T10:20:46.973211+0000","last_fullsized":"2023-12-18T10:20:46.973211+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:30:04.771313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530069+0000","last_change":"2023-12-18T10:20:44.163185+0000","last_active":"2023-12-18T10:20:45.530069+0000","last_peered":"2023-12-18T10:20:45.530069+0000","last_clean":"2023-12-18T10:20:45.530069+0000","last_became_active":"2023-12-18T10:20:44.162922+0000","last_became_peered":"2023-12-18T10:20:44.162922+0000","last_unstale":"2023-12-18T10:20:45.530069+0000","last_undegraded":"2023-12-18T10:20:45.530069+0000","last_fullsized":"2023-12-18T10:20:45.530069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:15:49.482034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529991+0000","last_change":"2023-12-18T10:20:44.568455+0000","last_active":"2023-12-18T10:20:45.529991+0000","last_peered":"2023-12-18T10:20:45.529991+0000","last_clean":"2023-12-18T10:20:45.529991+0000","last_became_active":"2023-12-18T10:20:44.568102+0000","last_became_peered":"2023-12-18T10:20:44.568102+0000","last_unstale":"2023-12-18T10:20:45.529991+0000","last_undegraded":"2023-12-18T10:20:45.529991+0000","last_fullsized":"2023-12-18T10:20:45.529991+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:28:24.655696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973294+0000","last_change":"2023-12-18T10:20:44.157348+0000","last_active":"2023-12-18T10:20:46.973294+0000","last_peered":"2023-12-18T10:20:46.973294+0000","last_clean":"2023-12-18T10:20:46.973294+0000","last_became_active":"2023-12-18T10:20:44.155951+0000","last_became_peered":"2023-12-18T10:20:44.155951+0000","last_unstale":"2023-12-18T10:20:46.973294+0000","last_undegraded":"2023-12-18T10:20:46.973294+0000","last_fullsized":"2023-12-18T10:20:46.973294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:26.271325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533827+0000","last_change":"2023-12-18T10:20:44.543651+0000","last_active":"2023-12-18T10:20:45.533827+0000","last_peered":"2023-12-18T10:20:45.533827+0000","last_clean":"2023-12-18T10:20:45.533827+0000","last_became_active":"2023-12-18T10:20:44.543355+0000","last_became_peered":"2023-12-18T10:20:44.543355+0000","last_unstale":"2023-12-18T10:20:45.533827+0000","last_undegraded":"2023-12-18T10:20:45.533827+0000","last_fullsized":"2023-12-18T10:20:45.533827+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973239+0000","last_change":"2023-12-18T10:20:44.158356+0000","last_active":"2023-12-18T10:20:46.973239+0000","last_peered":"2023-12-18T10:20:46.973239+0000","last_clean":"2023-12-18T10:20:46.973239+0000","last_became_active":"2023-12-18T10:20:44.158092+0000","last_became_peered":"2023-12-18T10:20:44.158092+0000","last_unstale":"2023-12-18T10:20:46.973239+0000","last_undegraded":"2023-12-18T10:20:46.973239+0000","last_fullsized":"2023-12-18T10:20:46.973239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:00.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530141+0000","last_change":"2023-12-18T10:20:44.540778+0000","last_active":"2023-12-18T10:20:45.530141+0000","last_peered":"2023-12-18T10:20:45.530141+0000","last_clean":"2023-12-18T10:20:45.530141+0000","last_became_active":"2023-12-18T10:20:44.540505+0000","last_became_peered":"2023-12-18T10:20:44.540505+0000","last_unstale":"2023-12-18T10:20:45.530141+0000","last_undegraded":"2023-12-18T10:20:45.530141+0000","last_fullsized":"2023-12-18T10:20:45.530141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007168+0000","last_change":"2023-12-18T10:20:44.161346+0000","last_active":"2023-12-18T10:20:46.007168+0000","last_peered":"2023-12-18T10:20:46.007168+0000","last_clean":"2023-12-18T10:20:46.007168+0000","last_became_active":"2023-12-18T10:20:44.160893+0000","last_became_peered":"2023-12-18T10:20:44.160893+0000","last_unstale":"2023-12-18T10:20:46.007168+0000","last_undegraded":"2023-12-18T10:20:46.007168+0000","last_fullsized":"2023-12-18T10:20:46.007168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:06.923115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973636+0000","last_change":"2023-12-18T10:20:44.550615+0000","last_active":"2023-12-18T10:20:46.973636+0000","last_peered":"2023-12-18T10:20:46.973636+0000","last_clean":"2023-12-18T10:20:46.973636+0000","last_became_active":"2023-12-18T10:20:44.550378+0000","last_became_peered":"2023-12-18T10:20:44.550378+0000","last_unstale":"2023-12-18T10:20:46.973636+0000","last_undegraded":"2023-12-18T10:20:46.973636+0000","last_fullsized":"2023-12-18T10:20:46.973636+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:27:23.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533988+0000","last_change":"2023-12-18T10:20:44.169257+0000","last_active":"2023-12-18T10:20:45.533988+0000","last_peered":"2023-12-18T10:20:45.533988+0000","last_clean":"2023-12-18T10:20:45.533988+0000","last_became_active":"2023-12-18T10:20:44.168986+0000","last_became_peered":"2023-12-18T10:20:44.168986+0000","last_unstale":"2023-12-18T10:20:45.533988+0000","last_undegraded":"2023-12-18T10:20:45.533988+0000","last_fullsized":"2023-12-18T10:20:45.533988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:29.295023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974499+0000","last_change":"2023-12-18T10:20:44.555391+0000","last_active":"2023-12-18T10:20:46.974499+0000","last_peered":"2023-12-18T10:20:46.974499+0000","last_clean":"2023-12-18T10:20:46.974499+0000","last_became_active":"2023-12-18T10:20:44.552659+0000","last_became_peered":"2023-12-18T10:20:44.552659+0000","last_unstale":"2023-12-18T10:20:46.974499+0000","last_undegraded":"2023-12-18T10:20:46.974499+0000","last_fullsized":"2023-12-18T10:20:46.974499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:08:58.576387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530308+0000","last_change":"2023-12-18T10:20:44.165658+0000","last_active":"2023-12-18T10:20:45.530308+0000","last_peered":"2023-12-18T10:20:45.530308+0000","last_clean":"2023-12-18T10:20:45.530308+0000","last_became_active":"2023-12-18T10:20:44.165389+0000","last_became_peered":"2023-12-18T10:20:44.165389+0000","last_unstale":"2023-12-18T10:20:45.530308+0000","last_undegraded":"2023-12-18T10:20:45.530308+0000","last_fullsized":"2023-12-18T10:20:45.530308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:59.882047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-18T10:20:44.538185+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:20:44.538185+0000","last_peered":"2023-12-18T10:20:44.538185+0000","last_clean":"2023-12-18T10:20:44.538185+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:20:44.538185+0000","last_undegraded":"2023-12-18T10:20:44.538185+0000","last_fullsized":"2023-12-18T10:20:44.538185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1232896,"data_stored":871098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.47599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.88600000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61899999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84899999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69199999999999995,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85699999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.505,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":638976,"data_stored":281258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.84399999999999997,"15min":0.877},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.495},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.81899999999999995,"5min":1.845,"15min":1.845},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.86599999999999999,"15min":0.89600000000000002},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81200000000000006,"5min":4.524,"15min":4.524},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86499999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.497},"max":{"1min":0.873,"5min":1.925,"15min":1.925},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91300000000000003,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90300000000000002,"15min":0.92900000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85399999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83999999999999997,"5min":1.054,"15min":1.054},"last":0.747},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.101,"15min":1.101},"last":0.71299999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.284,"15min":1.284},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.745,"15min":0.754},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88300000000000001,"5min":1.129,"15min":1.129},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84499999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":630784,"data_stored":280606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66500000000000004,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93999999999999995,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88400000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.44900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.99399999999999999,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91200000000000003,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.66600000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93500000000000005,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83099999999999996,"15min":0.85299999999999998},"min":{"1min":0.51600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0189999999999999,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.98499999999999999,"15min":1.038},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.499},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0109999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93200000000000005,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.042,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.55900000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89900000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83699999999999997,"15min":0.85599999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":634880,"data_stored":281188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.749}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.131,"15min":1.131},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94699999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.92300000000000004,"5min":1.032,"15min":1.032},"last":0.622}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.999,"15min":0.999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66100000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91700000000000004,"5min":1.073,"15min":1.073},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":647168,"data_stored":282192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55900000000000005,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.54900000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.61899999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44400000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63100000000000001,"5min":1.254,"15min":1.254},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73999999999999999,"5min":1.772,"15min":1.772},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98099999999999998,"5min":1.01,"15min":1.01},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.82399999999999995,"5min":1.181,"15min":1.181},"last":0.79300000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.81299999999999994,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.53000000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.069},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.872},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0629999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":1.127,"15min":1.127},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94299999999999995,"5min":1.139,"15min":1.139},"last":0.82299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":643072,"data_stored":282170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.436,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56799999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.501,"15min":0.51300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.32900000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.623,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65100000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.698,"15min":1.698},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94399999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96099999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.997,"5min":1.341,"15min":1.341},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.91900000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.78300000000000003,"15min":0.80000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.032,"5min":1.282,"15min":1.282},"last":0.627},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58799999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98199999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":638976,"data_stored":280766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.61099999999999999,"15min":0.63900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.7150000000000001,"5min":3.976,"15min":3.976},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.52000000000000002,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.2370000000000001,"5min":3.786,"15min":3.786},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.1589999999999998,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.9399999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.52900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7889999999999999,"5min":1.851,"15min":1.851},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.92700000000000005,"15min":0.96099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6539999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.90800000000000003,"15min":0.93600000000000005},"min":{"1min":0.54400000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.6100000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.823,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.94099999999999995,"15min":0.97399999999999998},"min":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.83099999999999996,"15min":0.84399999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8799999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.85099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1232896,"data_stored":871030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.66700000000000004,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.54100000000000004,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":1.456,"15min":1.456},"last":0.375}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":1.595,"15min":1.595},"last":0.435},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.58299999999999996,"15min":0.60899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.624,"5min":2.464,"15min":2.464},"last":0.30599999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":1.859,"15min":1.859},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":1.903,"15min":1.903},"last":0.52400000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94699999999999995,"5min":1.494,"15min":1.494},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94499999999999995,"5min":1.544,"15min":1.544},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80200000000000005,"15min":0.82099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93200000000000005,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.746},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.89000000000000001,"5min":1.53,"15min":1.53},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79200000000000004,"15min":0.81000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.81299999999999994,"5min":1.556,"15min":1.556},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.77700000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90000000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:20:49.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:20:49.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f7970041640 1 Processor -- start 2023-12-18T10:20:49.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f7970041640 1 -- start start 2023-12-18T10:20:49.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f7970041640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f796815ca40 0x7f79680cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f7970041640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79680ce3f0 0x7f79680cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f7970041640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79680d11c0 con 0x7f79680cf610 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f7970041640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680cfaa0 con 0x7f79680ce3f0 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f7970041640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680d0310 con 0x7f796815ca40 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f796d5dc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79680ce3f0 0x7f79680cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f796d5dc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79680ce3f0 0x7f79680cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56442/0 (socket says 172.21.15.133:56442) 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f796d5dc640 1 -- 172.21.15.133:0/689323955 learned_addr learned my addr 172.21.15.133:0/689323955 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f796dddd640 1 --2- 172.21.15.133:0/689323955 >> v2:172.21.15.142:3300/0 conn(0x7f796815ca40 0x7f79680cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f796d5dc640 1 -- 172.21.15.133:0/689323955 >> v2:172.21.15.142:3300/0 conn(0x7f796815ca40 msgr2=0x7f79680cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f796d5dc640 1 --2- 172.21.15.133:0/689323955 >> v2:172.21.15.142:3300/0 conn(0x7f796815ca40 0x7f79680cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f796d5dc640 1 -- 172.21.15.133:0/689323955 >> v1:172.21.15.142:6789/0 conn(0x7f79680cf610 legacy=0x7f79681605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.515+0000 7f796d5dc640 1 -- 172.21.15.133:0/689323955 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680d05b0 con 0x7f79680ce3f0 2023-12-18T10:20:49.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f796d5dc640 1 --2- 172.21.15.133:0/689323955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680cf0d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f79680736e0 tx=0x7f795801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2357d52029a45d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f796cddb640 1 -- 172.21.15.133:0/689323955 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580ab620 con 0x7f79680ce3f0 2023-12-18T10:20:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f796cddb640 1 -- 172.21.15.133:0/689323955 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79580ab780 con 0x7f79680ce3f0 2023-12-18T10:20:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f796cddb640 1 -- 172.21.15.133:0/689323955 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580abb10 con 0x7f79680ce3f0 2023-12-18T10:20:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 -- 172.21.15.133:0/689323955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 msgr2=0x7f79680cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 --2- 172.21.15.133:0/689323955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680cf0d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f79680736e0 tx=0x7f795801c500 comp rx=0 tx=0).stop 2023-12-18T10:20:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 -- 172.21.15.133:0/689323955 shutdown_connections 2023-12-18T10:20:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 --2- 172.21.15.133:0/689323955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680cf0d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 --2- 172.21.15.133:0/689323955 >> v2:172.21.15.142:3300/0 conn(0x7f796815ca40 0x7f79680cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 -- 172.21.15.133:0/689323955 >> 172.21.15.133:0/689323955 conn(0x7f7968089fb0 msgr2=0x7f79680d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 -- 172.21.15.133:0/689323955 shutdown_connections 2023-12-18T10:20:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 -- 172.21.15.133:0/689323955 wait complete. 2023-12-18T10:20:49.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 Processor -- start 2023-12-18T10:20:49.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.519+0000 7f7970041640 1 -- start start 2023-12-18T10:20:49.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79680cf610 0x7f79680b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f796815ca40 0x7f79680b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796815a6a0 con 0x7f79680ce3f0 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7968159ab0 con 0x7f796815ca40 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796815aac0 con 0x7f79680cf610 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56450/0 (socket says 172.21.15.133:56450) 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 -- 172.21.15.133:0/2821968941 learned_addr learned my addr 172.21.15.133:0/2821968941 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796d5dc640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79680cf610 0x7f79680b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796e5de640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f796815ca40 0x7f79680b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 -- 172.21.15.133:0/2821968941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79680cf610 msgr2=0x7f79680b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79680cf610 0x7f79680b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 -- 172.21.15.133:0/2821968941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f796815ca40 msgr2=0x7f79680b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f796815ca40 0x7f79680b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 -- 172.21.15.133:0/2821968941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958009470 con 0x7f79680ce3f0 2023-12-18T10:20:49.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f796dddd640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680b5a00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f796400d7d0 tx=0x7f796400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f795e7fc640 1 -- 172.21.15.133:0/2821968941 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400b6c0 con 0x7f79680ce3f0 2023-12-18T10:20:49.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f795e7fc640 1 -- 172.21.15.133:0/2821968941 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796400b820 con 0x7f79680ce3f0 2023-12-18T10:20:49.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f795e7fc640 1 -- 172.21.15.133:0/2821968941 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400bbd0 con 0x7f79680ce3f0 2023-12-18T10:20:49.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7968159d00 con 0x7f79680ce3f0 2023-12-18T10:20:49.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796815a2c0 con 0x7f79680ce3f0 2023-12-18T10:20:49.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.523+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796815a910 con 0x7f79680ce3f0 2023-12-18T10:20:49.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.527+0000 7f795e7fc640 1 -- 172.21.15.133:0/2821968941 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f796400bd30 con 0x7f79680ce3f0 2023-12-18T10:20:49.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.527+0000 7f795e7fc640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f794c065a60 0x7f794c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.527+0000 7f795e7fc640 1 -- 172.21.15.133:0/2821968941 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7964083700 con 0x7f79680ce3f0 2023-12-18T10:20:49.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.527+0000 7f796d5dc640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f794c065a60 0x7f794c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.527+0000 7f796d5dc640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f794c065a60 0x7f794c067f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f79580af000 tx=0x7f79580b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.531+0000 7f795e7fc640 1 -- 172.21.15.133:0/2821968941 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7964050f70 con 0x7f79680ce3f0 2023-12-18T10:20:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f796804e000 con 0x7f79680ce3f0 2023-12-18T10:20:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f795e7fc640 1 -- 172.21.15.133:0/2821968941 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1432 (secure 0 0 0) 0x7f7964054590 con 0x7f79680ce3f0 2023-12-18T10:20:49.743 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:49.743 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":189,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592730,"bytes_used":227090432,"bytes_avail":772867022848,"bytes_total":773094113280,"write_bytes_sec":2391,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":32,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":6165}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-12-18T10:20:25.124059+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:20:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f794c065a60 msgr2=0x7f794c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f794c065a60 0x7f794c067f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f79580af000 tx=0x7f79580b6040 comp rx=0 tx=0).stop 2023-12-18T10:20:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 msgr2=0x7f79680b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680b5a00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f796400d7d0 tx=0x7f796400dc90 comp rx=0 tx=0).stop 2023-12-18T10:20:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 shutdown_connections 2023-12-18T10:20:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f794c065a60 0x7f794c067f20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f796815ca40 0x7f79680b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79680cf610 0x7f79680b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 --2- 172.21.15.133:0/2821968941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79680ce3f0 0x7f79680b5a00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 >> 172.21.15.133:0/2821968941 conn(0x7f7968089fb0 msgr2=0x7f79680d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 shutdown_connections 2023-12-18T10:20:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.739+0000 7f7970041640 1 -- 172.21.15.133:0/2821968941 wait complete. 2023-12-18T10:20:49.764 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-18T10:20:49.764 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:20:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b7855640 1 Processor -- start 2023-12-18T10:20:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b7855640 1 -- start start 2023-12-18T10:20:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b7855640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50b015ca40 0x7f50b00cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b7855640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b00d11c0 con 0x7f50b00cf7e0 2023-12-18T10:20:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b7855640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b00d0310 con 0x7f50b00ce3f0 2023-12-18T10:20:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b7855640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b00d05b0 con 0x7f50b015ca40 2023-12-18T10:20:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b5df2640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f50b00cf7e0 0x7f50b01668e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50810/0 (socket says 172.21.15.133:50810) 2023-12-18T10:20:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b5df2640 1 -- 172.21.15.133:0/3193781194 learned_addr learned my addr 172.21.15.133:0/3193781194 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:49.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b55f1640 1 --2- 172.21.15.133:0/3193781194 >> v2:172.21.15.142:3300/0 conn(0x7f50b015ca40 0x7f50b00cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50a7fff640 1 -- 172.21.15.133:0/3193781194 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266877064 0 0) 0x7f50b00d11c0 con 0x7f50b00cf7e0 2023-12-18T10:20:49.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50a7fff640 1 -- 172.21.15.133:0/3193781194 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f509c003530 con 0x7f50b00cf7e0 2023-12-18T10:20:49.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b55f1640 1 -- 172.21.15.133:0/3193781194 >> v1:172.21.15.142:6789/0 conn(0x7f50b00ce3f0 legacy=0x7f50b00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50a7fff640 1 -- 172.21.15.133:0/3193781194 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268942877 0 0) 0x7f50b00d0310 con 0x7f50b00ce3f0 2023-12-18T10:20:49.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b55f1640 1 -- 172.21.15.133:0/3193781194 >> v1:172.21.15.133:6789/0 conn(0x7f50b00cf7e0 legacy=0x7f50b01668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.899+0000 7f50b55f1640 1 -- 172.21.15.133:0/3193781194 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00d0890 con 0x7f50b015ca40 2023-12-18T10:20:49.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50b55f1640 1 --2- 172.21.15.133:0/3193781194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b015ca40 0x7f50b00cdeb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0097a0 tx=0x7f50ac01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd19a232c76c4e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50a7fff640 1 -- 172.21.15.133:0/3193781194 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0ab600 con 0x7f50b015ca40 2023-12-18T10:20:49.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50a7fff640 1 -- 172.21.15.133:0/3193781194 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac0a7050 con 0x7f50b015ca40 2023-12-18T10:20:49.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50a7fff640 1 -- 172.21.15.133:0/3193781194 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0ab980 con 0x7f50b015ca40 2023-12-18T10:20:49.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50b7855640 1 -- 172.21.15.133:0/3193781194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b015ca40 msgr2=0x7f50b00cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50b7855640 1 --2- 172.21.15.133:0/3193781194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b015ca40 0x7f50b00cdeb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0097a0 tx=0x7f50ac01c380 comp rx=0 tx=0).stop 2023-12-18T10:20:49.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50b7855640 1 -- 172.21.15.133:0/3193781194 shutdown_connections 2023-12-18T10:20:49.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50b7855640 1 --2- 172.21.15.133:0/3193781194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b015ca40 0x7f50b00cdeb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50b7855640 1 -- 172.21.15.133:0/3193781194 >> 172.21.15.133:0/3193781194 conn(0x7f50b0089fb0 msgr2=0x7f50b00d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:49.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50b7855640 1 -- 172.21.15.133:0/3193781194 shutdown_connections 2023-12-18T10:20:49.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.903+0000 7f50b7855640 1 -- 172.21.15.133:0/3193781194 wait complete. 2023-12-18T10:20:49.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 Processor -- start 2023-12-18T10:20:49.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 -- start start 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50b00ce3f0 0x7f50b015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b00cf7e0 0x7f50b015f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b015ca40 0x7f50b0156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b015fec0 con 0x7f50b00ce3f0 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b015fbf0 con 0x7f50b00cf7e0 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b01512c0 con 0x7f50b015ca40 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50b00ce3f0 0x7f50b015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50b00ce3f0 0x7f50b015d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60880/0 (socket says 172.21.15.133:60880) 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 -- 172.21.15.133:0/3867938849 learned_addr learned my addr 172.21.15.133:0/3867938849 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b4df0640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b00cf7e0 0x7f50b015f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b5df2640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b015ca40 0x7f50b0156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 -- 172.21.15.133:0/3867938849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b015ca40 msgr2=0x7f50b0156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b015ca40 0x7f50b0156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 -- 172.21.15.133:0/3867938849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b00cf7e0 msgr2=0x7f50b015f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b00cf7e0 0x7f50b015f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 -- 172.21.15.133:0/3867938849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ac0093b0 con 0x7f50b00ce3f0 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b55f1640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50b00ce3f0 0x7f50b015d2d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0ae040 tx=0x7f50ac01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50a5ffb640 1 -- 172.21.15.133:0/3867938849 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0059a0 con 0x7f50b00ce3f0 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50a5ffb640 1 -- 172.21.15.133:0/3867938849 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac005b00 con 0x7f50b00ce3f0 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b00d17d0 con 0x7f50b00ce3f0 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50a5ffb640 1 -- 172.21.15.133:0/3867938849 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac005e70 con 0x7f50b00ce3f0 2023-12-18T10:20:49.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.907+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b0151880 con 0x7f50b00ce3f0 2023-12-18T10:20:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.911+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b004e000 con 0x7f50b00ce3f0 2023-12-18T10:20:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.911+0000 7f50a5ffb640 1 -- 172.21.15.133:0/3867938849 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f50ac006020 con 0x7f50b00ce3f0 2023-12-18T10:20:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.911+0000 7f50a5ffb640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5094065a60 0x7f5094067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.911+0000 7f50a5ffb640 1 -- 172.21.15.133:0/3867938849 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f50ac11c9c0 con 0x7f50b00ce3f0 2023-12-18T10:20:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.911+0000 7f50b4df0640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5094065a60 0x7f5094067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:49.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.911+0000 7f50b4df0640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5094065a60 0x7f5094067f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f50b0167d40 tx=0x7f50a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:49.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:49.915+0000 7f50a5ffb640 1 -- 172.21.15.133:0/3867938849 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f50ac0ea240 con 0x7f50b00ce3f0 2023-12-18T10:20:50.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.063+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50b00d1650 con 0x7f5094065a60 2023-12-18T10:20:50.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.071+0000 7f50a5ffb640 1 -- 172.21.15.133:0/3867938849 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289440 (secure 0 0 0) 0x7f50a0001d30 con 0x7f5094065a60 2023-12-18T10:20:50.080 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:50.082 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5094065a60 msgr2=0x7f5094067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5094065a60 0x7f5094067f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f50b0167d40 tx=0x7f50a0009040 comp rx=0 tx=0).stop 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50b00ce3f0 msgr2=0x7f50b015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50b00ce3f0 0x7f50b015d2d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0ae040 tx=0x7f50ac01abc0 comp rx=0 tx=0).stop 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 shutdown_connections 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5094065a60 0x7f5094067f20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50b015ca40 0x7f50b0156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f50b00cf7e0 0x7f50b015f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 --2- 172.21.15.133:0/3867938849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50b00ce3f0 0x7f50b015d2d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 >> 172.21.15.133:0/3867938849 conn(0x7f50b0089fb0 msgr2=0x7f50b00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:50.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 shutdown_connections 2023-12-18T10:20:50.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:50.075+0000 7f50b7855640 1 -- 172.21.15.133:0/3867938849 wait complete. 2023-12-18T10:20:50.101 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-12-18T10:20:49.128677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221768,"kb_used_data":6152,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752952,"statfs":{"total":773094113280,"available":772867022848,"internally_reserved":0,"allocated":6299648,"data_stored":3430308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.993502"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665419+0000","last_change":"2023-12-18T10:20:44.541569+0000","last_active":"2023-12-18T10:20:46.665419+0000","last_peered":"2023-12-18T10:20:46.665419+0000","last_clean":"2023-12-18T10:20:46.665419+0000","last_became_active":"2023-12-18T10:20:44.541324+0000","last_became_peered":"2023-12-18T10:20:44.541324+0000","last_unstale":"2023-12-18T10:20:46.665419+0000","last_undegraded":"2023-12-18T10:20:46.665419+0000","last_fullsized":"2023-12-18T10:20:46.665419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625815+0000","last_change":"2023-12-18T10:20:44.553416+0000","last_active":"2023-12-18T10:20:45.625815+0000","last_peered":"2023-12-18T10:20:45.625815+0000","last_clean":"2023-12-18T10:20:45.625815+0000","last_became_active":"2023-12-18T10:20:44.552973+0000","last_became_peered":"2023-12-18T10:20:44.552973+0000","last_unstale":"2023-12-18T10:20:45.625815+0000","last_undegraded":"2023-12-18T10:20:45.625815+0000","last_fullsized":"2023-12-18T10:20:45.625815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529957+0000","last_change":"2023-12-18T10:20:44.552612+0000","last_active":"2023-12-18T10:20:45.529957+0000","last_peered":"2023-12-18T10:20:45.529957+0000","last_clean":"2023-12-18T10:20:45.529957+0000","last_became_active":"2023-12-18T10:20:44.552325+0000","last_became_peered":"2023-12-18T10:20:44.552325+0000","last_unstale":"2023-12-18T10:20:45.529957+0000","last_undegraded":"2023-12-18T10:20:45.529957+0000","last_fullsized":"2023-12-18T10:20:45.529957+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:11.129841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625701+0000","last_change":"2023-12-18T10:20:44.569713+0000","last_active":"2023-12-18T10:20:45.625701+0000","last_peered":"2023-12-18T10:20:45.625701+0000","last_clean":"2023-12-18T10:20:45.625701+0000","last_became_active":"2023-12-18T10:20:44.569384+0000","last_became_peered":"2023-12-18T10:20:44.569384+0000","last_unstale":"2023-12-18T10:20:45.625701+0000","last_undegraded":"2023-12-18T10:20:45.625701+0000","last_fullsized":"2023-12-18T10:20:45.625701+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007306+0000","last_change":"2023-12-18T10:20:44.558135+0000","last_active":"2023-12-18T10:20:46.007306+0000","last_peered":"2023-12-18T10:20:46.007306+0000","last_clean":"2023-12-18T10:20:46.007306+0000","last_became_active":"2023-12-18T10:20:44.557879+0000","last_became_peered":"2023-12-18T10:20:44.557879+0000","last_unstale":"2023-12-18T10:20:46.007306+0000","last_undegraded":"2023-12-18T10:20:46.007306+0000","last_fullsized":"2023-12-18T10:20:46.007306+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:02:46.177659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665108+0000","last_change":"2023-12-18T10:20:44.548956+0000","last_active":"2023-12-18T10:20:46.665108+0000","last_peered":"2023-12-18T10:20:46.665108+0000","last_clean":"2023-12-18T10:20:46.665108+0000","last_became_active":"2023-12-18T10:20:44.548647+0000","last_became_peered":"2023-12-18T10:20:44.548647+0000","last_unstale":"2023-12-18T10:20:46.665108+0000","last_undegraded":"2023-12-18T10:20:46.665108+0000","last_fullsized":"2023-12-18T10:20:46.665108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529716+0000","last_change":"2023-12-18T10:20:44.549880+0000","last_active":"2023-12-18T10:20:45.529716+0000","last_peered":"2023-12-18T10:20:45.529716+0000","last_clean":"2023-12-18T10:20:45.529716+0000","last_became_active":"2023-12-18T10:20:44.549668+0000","last_became_peered":"2023-12-18T10:20:44.549668+0000","last_unstale":"2023-12-18T10:20:45.529716+0000","last_undegraded":"2023-12-18T10:20:45.529716+0000","last_fullsized":"2023-12-18T10:20:45.529716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:30:04.771313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972789+0000","last_change":"2023-12-18T10:20:44.555231+0000","last_active":"2023-12-18T10:20:46.972789+0000","last_peered":"2023-12-18T10:20:46.972789+0000","last_clean":"2023-12-18T10:20:46.972789+0000","last_became_active":"2023-12-18T10:20:44.554996+0000","last_became_peered":"2023-12-18T10:20:44.554996+0000","last_unstale":"2023-12-18T10:20:46.972789+0000","last_undegraded":"2023-12-18T10:20:46.972789+0000","last_fullsized":"2023-12-18T10:20:46.972789+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:49.088008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973606+0000","last_change":"2023-12-18T10:20:44.565493+0000","last_active":"2023-12-18T10:20:46.973606+0000","last_peered":"2023-12-18T10:20:46.973606+0000","last_clean":"2023-12-18T10:20:46.973606+0000","last_became_active":"2023-12-18T10:20:44.563184+0000","last_became_peered":"2023-12-18T10:20:44.563184+0000","last_unstale":"2023-12-18T10:20:46.973606+0000","last_undegraded":"2023-12-18T10:20:46.973606+0000","last_fullsized":"2023-12-18T10:20:46.973606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:01:21.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665356+0000","last_change":"2023-12-18T10:20:44.553920+0000","last_active":"2023-12-18T10:20:46.665356+0000","last_peered":"2023-12-18T10:20:46.665356+0000","last_clean":"2023-12-18T10:20:46.665356+0000","last_became_active":"2023-12-18T10:20:44.553433+0000","last_became_peered":"2023-12-18T10:20:44.553433+0000","last_unstale":"2023-12-18T10:20:46.665356+0000","last_undegraded":"2023-12-18T10:20:46.665356+0000","last_fullsized":"2023-12-18T10:20:46.665356+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:27.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972955+0000","last_change":"2023-12-18T10:20:44.550904+0000","last_active":"2023-12-18T10:20:46.972955+0000","last_peered":"2023-12-18T10:20:46.972955+0000","last_clean":"2023-12-18T10:20:46.972955+0000","last_became_active":"2023-12-18T10:20:44.550655+0000","last_became_peered":"2023-12-18T10:20:44.550655+0000","last_unstale":"2023-12-18T10:20:46.972955+0000","last_undegraded":"2023-12-18T10:20:46.972955+0000","last_fullsized":"2023-12-18T10:20:46.972955+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:30:24.371002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973397+0000","last_change":"2023-12-18T10:20:44.567970+0000","last_active":"2023-12-18T10:20:46.973397+0000","last_peered":"2023-12-18T10:20:46.973397+0000","last_clean":"2023-12-18T10:20:46.973397+0000","last_became_active":"2023-12-18T10:20:44.567702+0000","last_became_peered":"2023-12-18T10:20:44.567702+0000","last_unstale":"2023-12-18T10:20:46.973397+0000","last_undegraded":"2023-12-18T10:20:46.973397+0000","last_fullsized":"2023-12-18T10:20:46.973397+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:31:01.041735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665206+0000","last_change":"2023-12-18T10:20:44.554022+0000","last_active":"2023-12-18T10:20:46.665206+0000","last_peered":"2023-12-18T10:20:46.665206+0000","last_clean":"2023-12-18T10:20:46.665206+0000","last_became_active":"2023-12-18T10:20:44.553454+0000","last_became_peered":"2023-12-18T10:20:44.553454+0000","last_unstale":"2023-12-18T10:20:46.665206+0000","last_undegraded":"2023-12-18T10:20:46.665206+0000","last_fullsized":"2023-12-18T10:20:46.665206+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529665+0000","last_change":"2023-12-18T10:20:44.541694+0000","last_active":"2023-12-18T10:20:45.529665+0000","last_peered":"2023-12-18T10:20:45.529665+0000","last_clean":"2023-12-18T10:20:45.529665+0000","last_became_active":"2023-12-18T10:20:44.541458+0000","last_became_peered":"2023-12-18T10:20:44.541458+0000","last_unstale":"2023-12-18T10:20:45.529665+0000","last_undegraded":"2023-12-18T10:20:45.529665+0000","last_fullsized":"2023-12-18T10:20:45.529665+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:00:38.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625439+0000","last_change":"2023-12-18T10:20:44.547669+0000","last_active":"2023-12-18T10:20:45.625439+0000","last_peered":"2023-12-18T10:20:45.625439+0000","last_clean":"2023-12-18T10:20:45.625439+0000","last_became_active":"2023-12-18T10:20:44.546946+0000","last_became_peered":"2023-12-18T10:20:44.546946+0000","last_unstale":"2023-12-18T10:20:45.625439+0000","last_undegraded":"2023-12-18T10:20:45.625439+0000","last_fullsized":"2023-12-18T10:20:45.625439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:25:44.473810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665078+0000","last_change":"2023-12-18T10:20:44.557923+0000","last_active":"2023-12-18T10:20:46.665078+0000","last_peered":"2023-12-18T10:20:46.665078+0000","last_clean":"2023-12-18T10:20:46.665078+0000","last_became_active":"2023-12-18T10:20:44.557008+0000","last_became_peered":"2023-12-18T10:20:44.557008+0000","last_unstale":"2023-12-18T10:20:46.665078+0000","last_undegraded":"2023-12-18T10:20:46.665078+0000","last_fullsized":"2023-12-18T10:20:46.665078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530226+0000","last_change":"2023-12-18T10:20:44.546518+0000","last_active":"2023-12-18T10:20:45.530226+0000","last_peered":"2023-12-18T10:20:45.530226+0000","last_clean":"2023-12-18T10:20:45.530226+0000","last_became_active":"2023-12-18T10:20:44.539262+0000","last_became_peered":"2023-12-18T10:20:44.539262+0000","last_unstale":"2023-12-18T10:20:45.530226+0000","last_undegraded":"2023-12-18T10:20:45.530226+0000","last_fullsized":"2023-12-18T10:20:45.530226+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:55:23.232484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625902+0000","last_change":"2023-12-18T10:20:44.553236+0000","last_active":"2023-12-18T10:20:45.625902+0000","last_peered":"2023-12-18T10:20:45.625902+0000","last_clean":"2023-12-18T10:20:45.625902+0000","last_became_active":"2023-12-18T10:20:44.552604+0000","last_became_peered":"2023-12-18T10:20:44.552604+0000","last_unstale":"2023-12-18T10:20:45.625902+0000","last_undegraded":"2023-12-18T10:20:45.625902+0000","last_fullsized":"2023-12-18T10:20:45.625902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530022+0000","last_change":"2023-12-18T10:20:44.557941+0000","last_active":"2023-12-18T10:20:45.530022+0000","last_peered":"2023-12-18T10:20:45.530022+0000","last_clean":"2023-12-18T10:20:45.530022+0000","last_became_active":"2023-12-18T10:20:44.557359+0000","last_became_peered":"2023-12-18T10:20:44.557359+0000","last_unstale":"2023-12-18T10:20:45.530022+0000","last_undegraded":"2023-12-18T10:20:45.530022+0000","last_fullsized":"2023-12-18T10:20:45.530022+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:26:41.602183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974628+0000","last_change":"2023-12-18T10:20:44.551079+0000","last_active":"2023-12-18T10:20:46.974628+0000","last_peered":"2023-12-18T10:20:46.974628+0000","last_clean":"2023-12-18T10:20:46.974628+0000","last_became_active":"2023-12-18T10:20:44.550795+0000","last_became_peered":"2023-12-18T10:20:44.550795+0000","last_unstale":"2023-12-18T10:20:46.974628+0000","last_undegraded":"2023-12-18T10:20:46.974628+0000","last_fullsized":"2023-12-18T10:20:46.974628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:36.622165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974634+0000","last_change":"2023-12-18T10:20:44.550722+0000","last_active":"2023-12-18T10:20:46.974634+0000","last_peered":"2023-12-18T10:20:46.974634+0000","last_clean":"2023-12-18T10:20:46.974634+0000","last_became_active":"2023-12-18T10:20:44.550447+0000","last_became_peered":"2023-12-18T10:20:44.550447+0000","last_unstale":"2023-12-18T10:20:46.974634+0000","last_undegraded":"2023-12-18T10:20:46.974634+0000","last_fullsized":"2023-12-18T10:20:46.974634+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:35.924957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973124+0000","last_change":"2023-12-18T10:20:44.559291+0000","last_active":"2023-12-18T10:20:46.973124+0000","last_peered":"2023-12-18T10:20:46.973124+0000","last_clean":"2023-12-18T10:20:46.973124+0000","last_became_active":"2023-12-18T10:20:44.558639+0000","last_became_peered":"2023-12-18T10:20:44.558639+0000","last_unstale":"2023-12-18T10:20:46.973124+0000","last_undegraded":"2023-12-18T10:20:46.973124+0000","last_fullsized":"2023-12-18T10:20:46.973124+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:01.381067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972986+0000","last_change":"2023-12-18T10:20:44.547921+0000","last_active":"2023-12-18T10:20:46.972986+0000","last_peered":"2023-12-18T10:20:46.972986+0000","last_clean":"2023-12-18T10:20:46.972986+0000","last_became_active":"2023-12-18T10:20:44.547680+0000","last_became_peered":"2023-12-18T10:20:44.547680+0000","last_unstale":"2023-12-18T10:20:46.972986+0000","last_undegraded":"2023-12-18T10:20:46.972986+0000","last_fullsized":"2023-12-18T10:20:46.972986+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:52:01.892725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529487+0000","last_change":"2023-12-18T10:20:44.541085+0000","last_active":"2023-12-18T10:20:45.529487+0000","last_peered":"2023-12-18T10:20:45.529487+0000","last_clean":"2023-12-18T10:20:45.529487+0000","last_became_active":"2023-12-18T10:20:44.540880+0000","last_became_peered":"2023-12-18T10:20:44.540880+0000","last_unstale":"2023-12-18T10:20:45.529487+0000","last_undegraded":"2023-12-18T10:20:45.529487+0000","last_fullsized":"2023-12-18T10:20:45.529487+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:19:08.205983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530435+0000","last_change":"2023-12-18T10:20:44.560740+0000","last_active":"2023-12-18T10:20:45.530435+0000","last_peered":"2023-12-18T10:20:45.530435+0000","last_clean":"2023-12-18T10:20:45.530435+0000","last_became_active":"2023-12-18T10:20:44.559929+0000","last_became_peered":"2023-12-18T10:20:44.559929+0000","last_unstale":"2023-12-18T10:20:45.530435+0000","last_undegraded":"2023-12-18T10:20:45.530435+0000","last_fullsized":"2023-12-18T10:20:45.530435+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:14:56.044092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973464+0000","last_change":"2023-12-18T10:20:44.562617+0000","last_active":"2023-12-18T10:20:46.973464+0000","last_peered":"2023-12-18T10:20:46.973464+0000","last_clean":"2023-12-18T10:20:46.973464+0000","last_became_active":"2023-12-18T10:20:44.559094+0000","last_became_peered":"2023-12-18T10:20:44.559094+0000","last_unstale":"2023-12-18T10:20:46.973464+0000","last_undegraded":"2023-12-18T10:20:46.973464+0000","last_fullsized":"2023-12-18T10:20:46.973464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:11.129841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665445+0000","last_change":"2023-12-18T10:20:44.548054+0000","last_active":"2023-12-18T10:20:46.665445+0000","last_peered":"2023-12-18T10:20:46.665445+0000","last_clean":"2023-12-18T10:20:46.665445+0000","last_became_active":"2023-12-18T10:20:44.546099+0000","last_became_peered":"2023-12-18T10:20:44.546099+0000","last_unstale":"2023-12-18T10:20:46.665445+0000","last_undegraded":"2023-12-18T10:20:46.665445+0000","last_fullsized":"2023-12-18T10:20:46.665445+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:07.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974706+0000","last_change":"2023-12-18T10:20:44.549776+0000","last_active":"2023-12-18T10:20:46.974706+0000","last_peered":"2023-12-18T10:20:46.974706+0000","last_clean":"2023-12-18T10:20:46.974706+0000","last_became_active":"2023-12-18T10:20:44.549390+0000","last_became_peered":"2023-12-18T10:20:44.549390+0000","last_unstale":"2023-12-18T10:20:46.974706+0000","last_undegraded":"2023-12-18T10:20:46.974706+0000","last_fullsized":"2023-12-18T10:20:46.974706+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:26.177941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529592+0000","last_change":"2023-12-18T10:20:44.543084+0000","last_active":"2023-12-18T10:20:45.529592+0000","last_peered":"2023-12-18T10:20:45.529592+0000","last_clean":"2023-12-18T10:20:45.529592+0000","last_became_active":"2023-12-18T10:20:44.542832+0000","last_became_peered":"2023-12-18T10:20:44.542832+0000","last_unstale":"2023-12-18T10:20:45.529592+0000","last_undegraded":"2023-12-18T10:20:45.529592+0000","last_fullsized":"2023-12-18T10:20:45.529592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:02:47.834572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625577+0000","last_change":"2023-12-18T10:20:44.559683+0000","last_active":"2023-12-18T10:20:45.625577+0000","last_peered":"2023-12-18T10:20:45.625577+0000","last_clean":"2023-12-18T10:20:45.625577+0000","last_became_active":"2023-12-18T10:20:44.559405+0000","last_became_peered":"2023-12-18T10:20:44.559405+0000","last_unstale":"2023-12-18T10:20:45.625577+0000","last_undegraded":"2023-12-18T10:20:45.625577+0000","last_fullsized":"2023-12-18T10:20:45.625577+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:17.717007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529658+0000","last_change":"2023-12-18T10:20:44.541587+0000","last_active":"2023-12-18T10:20:45.529658+0000","last_peered":"2023-12-18T10:20:45.529658+0000","last_clean":"2023-12-18T10:20:45.529658+0000","last_became_active":"2023-12-18T10:20:44.541354+0000","last_became_peered":"2023-12-18T10:20:44.541354+0000","last_unstale":"2023-12-18T10:20:45.529658+0000","last_undegraded":"2023-12-18T10:20:45.529658+0000","last_fullsized":"2023-12-18T10:20:45.529658+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:23:09.477926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533840+0000","last_change":"2023-12-18T10:20:44.557322+0000","last_active":"2023-12-18T10:20:45.533840+0000","last_peered":"2023-12-18T10:20:45.533840+0000","last_clean":"2023-12-18T10:20:45.533840+0000","last_became_active":"2023-12-18T10:20:44.556856+0000","last_became_peered":"2023-12-18T10:20:44.556856+0000","last_unstale":"2023-12-18T10:20:45.533840+0000","last_undegraded":"2023-12-18T10:20:45.533840+0000","last_fullsized":"2023-12-18T10:20:45.533840+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625253+0000","last_change":"2023-12-18T10:20:44.547880+0000","last_active":"2023-12-18T10:20:45.625253+0000","last_peered":"2023-12-18T10:20:45.625253+0000","last_clean":"2023-12-18T10:20:45.625253+0000","last_became_active":"2023-12-18T10:20:44.547584+0000","last_became_peered":"2023-12-18T10:20:44.547584+0000","last_unstale":"2023-12-18T10:20:45.625253+0000","last_undegraded":"2023-12-18T10:20:45.625253+0000","last_fullsized":"2023-12-18T10:20:45.625253+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"52'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974618+0000","last_change":"2023-12-18T10:20:44.162825+0000","last_active":"2023-12-18T10:20:46.974618+0000","last_peered":"2023-12-18T10:20:46.974618+0000","last_clean":"2023-12-18T10:20:46.974618+0000","last_became_active":"2023-12-18T10:20:44.162537+0000","last_became_peered":"2023-12-18T10:20:44.162537+0000","last_unstale":"2023-12-18T10:20:46.974618+0000","last_undegraded":"2023-12-18T10:20:46.974618+0000","last_fullsized":"2023-12-18T10:20:46.974618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:04:00.914247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533856+0000","last_change":"2023-12-18T10:20:44.543554+0000","last_active":"2023-12-18T10:20:45.533856+0000","last_peered":"2023-12-18T10:20:45.533856+0000","last_clean":"2023-12-18T10:20:45.533856+0000","last_became_active":"2023-12-18T10:20:44.543259+0000","last_became_peered":"2023-12-18T10:20:44.543259+0000","last_unstale":"2023-12-18T10:20:45.533856+0000","last_undegraded":"2023-12-18T10:20:45.533856+0000","last_fullsized":"2023-12-18T10:20:45.533856+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665359+0000","last_change":"2023-12-18T10:20:44.156837+0000","last_active":"2023-12-18T10:20:46.665359+0000","last_peered":"2023-12-18T10:20:46.665359+0000","last_clean":"2023-12-18T10:20:46.665359+0000","last_became_active":"2023-12-18T10:20:44.156616+0000","last_became_peered":"2023-12-18T10:20:44.156616+0000","last_unstale":"2023-12-18T10:20:46.665359+0000","last_undegraded":"2023-12-18T10:20:46.665359+0000","last_fullsized":"2023-12-18T10:20:46.665359+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:25.166970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974823+0000","last_change":"2023-12-18T10:20:44.554271+0000","last_active":"2023-12-18T10:20:46.974823+0000","last_peered":"2023-12-18T10:20:46.974823+0000","last_clean":"2023-12-18T10:20:46.974823+0000","last_became_active":"2023-12-18T10:20:44.551042+0000","last_became_peered":"2023-12-18T10:20:44.551042+0000","last_unstale":"2023-12-18T10:20:46.974823+0000","last_undegraded":"2023-12-18T10:20:46.974823+0000","last_fullsized":"2023-12-18T10:20:46.974823+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:45.276234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665437+0000","last_change":"2023-12-18T10:20:44.165356+0000","last_active":"2023-12-18T10:20:46.665437+0000","last_peered":"2023-12-18T10:20:46.665437+0000","last_clean":"2023-12-18T10:20:46.665437+0000","last_became_active":"2023-12-18T10:20:44.164855+0000","last_became_peered":"2023-12-18T10:20:44.164855+0000","last_unstale":"2023-12-18T10:20:46.665437+0000","last_undegraded":"2023-12-18T10:20:46.665437+0000","last_fullsized":"2023-12-18T10:20:46.665437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973111+0000","last_change":"2023-12-18T10:20:44.562589+0000","last_active":"2023-12-18T10:20:46.973111+0000","last_peered":"2023-12-18T10:20:46.973111+0000","last_clean":"2023-12-18T10:20:46.973111+0000","last_became_active":"2023-12-18T10:20:44.562357+0000","last_became_peered":"2023-12-18T10:20:44.562357+0000","last_unstale":"2023-12-18T10:20:46.973111+0000","last_undegraded":"2023-12-18T10:20:46.973111+0000","last_fullsized":"2023-12-18T10:20:46.973111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:19:08.205983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533943+0000","last_change":"2023-12-18T10:20:44.165232+0000","last_active":"2023-12-18T10:20:45.533943+0000","last_peered":"2023-12-18T10:20:45.533943+0000","last_clean":"2023-12-18T10:20:45.533943+0000","last_became_active":"2023-12-18T10:20:44.164930+0000","last_became_peered":"2023-12-18T10:20:44.164930+0000","last_unstale":"2023-12-18T10:20:45.533943+0000","last_undegraded":"2023-12-18T10:20:45.533943+0000","last_fullsized":"2023-12-18T10:20:45.533943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007488+0000","last_change":"2023-12-18T10:20:44.559015+0000","last_active":"2023-12-18T10:20:46.007488+0000","last_peered":"2023-12-18T10:20:46.007488+0000","last_clean":"2023-12-18T10:20:46.007488+0000","last_became_active":"2023-12-18T10:20:44.557410+0000","last_became_peered":"2023-12-18T10:20:44.557410+0000","last_unstale":"2023-12-18T10:20:46.007488+0000","last_undegraded":"2023-12-18T10:20:46.007488+0000","last_fullsized":"2023-12-18T10:20:46.007488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529810+0000","last_change":"2023-12-18T10:20:44.169502+0000","last_active":"2023-12-18T10:20:45.529810+0000","last_peered":"2023-12-18T10:20:45.529810+0000","last_clean":"2023-12-18T10:20:45.529810+0000","last_became_active":"2023-12-18T10:20:44.169239+0000","last_became_peered":"2023-12-18T10:20:44.169239+0000","last_unstale":"2023-12-18T10:20:45.529810+0000","last_undegraded":"2023-12-18T10:20:45.529810+0000","last_fullsized":"2023-12-18T10:20:45.529810+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:41:04.766861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625670+0000","last_change":"2023-12-18T10:20:44.559775+0000","last_active":"2023-12-18T10:20:45.625670+0000","last_peered":"2023-12-18T10:20:45.625670+0000","last_clean":"2023-12-18T10:20:45.625670+0000","last_became_active":"2023-12-18T10:20:44.559484+0000","last_became_peered":"2023-12-18T10:20:44.559484+0000","last_unstale":"2023-12-18T10:20:45.625670+0000","last_undegraded":"2023-12-18T10:20:45.625670+0000","last_fullsized":"2023-12-18T10:20:45.625670+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007191+0000","last_change":"2023-12-18T10:20:44.155223+0000","last_active":"2023-12-18T10:20:46.007191+0000","last_peered":"2023-12-18T10:20:46.007191+0000","last_clean":"2023-12-18T10:20:46.007191+0000","last_became_active":"2023-12-18T10:20:44.154919+0000","last_became_peered":"2023-12-18T10:20:44.154919+0000","last_unstale":"2023-12-18T10:20:46.007191+0000","last_undegraded":"2023-12-18T10:20:46.007191+0000","last_fullsized":"2023-12-18T10:20:46.007191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:18.073237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973513+0000","last_change":"2023-12-18T10:20:44.555178+0000","last_active":"2023-12-18T10:20:46.973513+0000","last_peered":"2023-12-18T10:20:46.973513+0000","last_clean":"2023-12-18T10:20:46.973513+0000","last_became_active":"2023-12-18T10:20:44.552676+0000","last_became_peered":"2023-12-18T10:20:44.552676+0000","last_unstale":"2023-12-18T10:20:46.973513+0000","last_undegraded":"2023-12-18T10:20:46.973513+0000","last_fullsized":"2023-12-18T10:20:46.973513+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974437+0000","last_change":"2023-12-18T10:20:44.163586+0000","last_active":"2023-12-18T10:20:46.974437+0000","last_peered":"2023-12-18T10:20:46.974437+0000","last_clean":"2023-12-18T10:20:46.974437+0000","last_became_active":"2023-12-18T10:20:44.163063+0000","last_became_peered":"2023-12-18T10:20:44.163063+0000","last_unstale":"2023-12-18T10:20:46.974437+0000","last_undegraded":"2023-12-18T10:20:46.974437+0000","last_fullsized":"2023-12-18T10:20:46.974437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:44:52.499992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625675+0000","last_change":"2023-12-18T10:20:44.553548+0000","last_active":"2023-12-18T10:20:45.625675+0000","last_peered":"2023-12-18T10:20:45.625675+0000","last_clean":"2023-12-18T10:20:45.625675+0000","last_became_active":"2023-12-18T10:20:44.553132+0000","last_became_peered":"2023-12-18T10:20:44.553132+0000","last_unstale":"2023-12-18T10:20:45.625675+0000","last_undegraded":"2023-12-18T10:20:45.625675+0000","last_fullsized":"2023-12-18T10:20:45.625675+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:27.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529565+0000","last_change":"2023-12-18T10:20:44.162413+0000","last_active":"2023-12-18T10:20:45.529565+0000","last_peered":"2023-12-18T10:20:45.529565+0000","last_clean":"2023-12-18T10:20:45.529565+0000","last_became_active":"2023-12-18T10:20:44.162072+0000","last_became_peered":"2023-12-18T10:20:44.162072+0000","last_unstale":"2023-12-18T10:20:45.529565+0000","last_undegraded":"2023-12-18T10:20:45.529565+0000","last_fullsized":"2023-12-18T10:20:45.529565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:29.295023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007200+0000","last_change":"2023-12-18T10:20:44.554437+0000","last_active":"2023-12-18T10:20:46.007200+0000","last_peered":"2023-12-18T10:20:46.007200+0000","last_clean":"2023-12-18T10:20:46.007200+0000","last_became_active":"2023-12-18T10:20:44.554152+0000","last_became_peered":"2023-12-18T10:20:44.554152+0000","last_unstale":"2023-12-18T10:20:46.007200+0000","last_undegraded":"2023-12-18T10:20:46.007200+0000","last_fullsized":"2023-12-18T10:20:46.007200+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:02:47.834572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625670+0000","last_change":"2023-12-18T10:20:44.157327+0000","last_active":"2023-12-18T10:20:45.625670+0000","last_peered":"2023-12-18T10:20:45.625670+0000","last_clean":"2023-12-18T10:20:45.625670+0000","last_became_active":"2023-12-18T10:20:44.157049+0000","last_became_peered":"2023-12-18T10:20:44.157049+0000","last_unstale":"2023-12-18T10:20:45.625670+0000","last_undegraded":"2023-12-18T10:20:45.625670+0000","last_fullsized":"2023-12-18T10:20:45.625670+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:44.265262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533813+0000","last_change":"2023-12-18T10:20:44.560201+0000","last_active":"2023-12-18T10:20:45.533813+0000","last_peered":"2023-12-18T10:20:45.533813+0000","last_clean":"2023-12-18T10:20:45.533813+0000","last_became_active":"2023-12-18T10:20:44.559244+0000","last_became_peered":"2023-12-18T10:20:44.559244+0000","last_unstale":"2023-12-18T10:20:45.533813+0000","last_undegraded":"2023-12-18T10:20:45.533813+0000","last_fullsized":"2023-12-18T10:20:45.533813+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:25:44.473810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007444+0000","last_change":"2023-12-18T10:20:44.167242+0000","last_active":"2023-12-18T10:20:46.007444+0000","last_peered":"2023-12-18T10:20:46.007444+0000","last_clean":"2023-12-18T10:20:46.007444+0000","last_became_active":"2023-12-18T10:20:44.166853+0000","last_became_peered":"2023-12-18T10:20:44.166853+0000","last_unstale":"2023-12-18T10:20:46.007444+0000","last_undegraded":"2023-12-18T10:20:46.007444+0000","last_fullsized":"2023-12-18T10:20:46.007444+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:24:20.559813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529762+0000","last_change":"2023-12-18T10:20:44.551734+0000","last_active":"2023-12-18T10:20:45.529762+0000","last_peered":"2023-12-18T10:20:45.529762+0000","last_clean":"2023-12-18T10:20:45.529762+0000","last_became_active":"2023-12-18T10:20:44.545973+0000","last_became_peered":"2023-12-18T10:20:44.545973+0000","last_unstale":"2023-12-18T10:20:45.529762+0000","last_undegraded":"2023-12-18T10:20:45.529762+0000","last_fullsized":"2023-12-18T10:20:45.529762+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:02:46.177659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"52'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625770+0000","last_change":"2023-12-18T10:20:44.168519+0000","last_active":"2023-12-18T10:20:45.625770+0000","last_peered":"2023-12-18T10:20:45.625770+0000","last_clean":"2023-12-18T10:20:45.625770+0000","last_became_active":"2023-12-18T10:20:44.168162+0000","last_became_peered":"2023-12-18T10:20:44.168162+0000","last_unstale":"2023-12-18T10:20:45.625770+0000","last_undegraded":"2023-12-18T10:20:45.625770+0000","last_fullsized":"2023-12-18T10:20:45.625770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007479+0000","last_change":"2023-12-18T10:20:44.553336+0000","last_active":"2023-12-18T10:20:46.007479+0000","last_peered":"2023-12-18T10:20:46.007479+0000","last_clean":"2023-12-18T10:20:46.007479+0000","last_became_active":"2023-12-18T10:20:44.553058+0000","last_became_peered":"2023-12-18T10:20:44.553058+0000","last_unstale":"2023-12-18T10:20:46.007479+0000","last_undegraded":"2023-12-18T10:20:46.007479+0000","last_fullsized":"2023-12-18T10:20:46.007479+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:42:05.275947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973472+0000","last_change":"2023-12-18T10:20:44.157054+0000","last_active":"2023-12-18T10:20:46.973472+0000","last_peered":"2023-12-18T10:20:46.973472+0000","last_clean":"2023-12-18T10:20:46.973472+0000","last_became_active":"2023-12-18T10:20:44.155959+0000","last_became_peered":"2023-12-18T10:20:44.155959+0000","last_unstale":"2023-12-18T10:20:46.973472+0000","last_undegraded":"2023-12-18T10:20:46.973472+0000","last_fullsized":"2023-12-18T10:20:46.973472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:16.706036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533754+0000","last_change":"2023-12-18T10:20:44.544356+0000","last_active":"2023-12-18T10:20:45.533754+0000","last_peered":"2023-12-18T10:20:45.533754+0000","last_clean":"2023-12-18T10:20:45.533754+0000","last_became_active":"2023-12-18T10:20:44.544088+0000","last_became_peered":"2023-12-18T10:20:44.544088+0000","last_unstale":"2023-12-18T10:20:45.533754+0000","last_undegraded":"2023-12-18T10:20:45.533754+0000","last_fullsized":"2023-12-18T10:20:45.533754+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529885+0000","last_change":"2023-12-18T10:20:44.164064+0000","last_active":"2023-12-18T10:20:45.529885+0000","last_peered":"2023-12-18T10:20:45.529885+0000","last_clean":"2023-12-18T10:20:45.529885+0000","last_became_active":"2023-12-18T10:20:44.163795+0000","last_became_peered":"2023-12-18T10:20:44.163795+0000","last_unstale":"2023-12-18T10:20:45.529885+0000","last_undegraded":"2023-12-18T10:20:45.529885+0000","last_fullsized":"2023-12-18T10:20:45.529885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:24:57.538958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530059+0000","last_change":"2023-12-18T10:20:44.557971+0000","last_active":"2023-12-18T10:20:45.530059+0000","last_peered":"2023-12-18T10:20:45.530059+0000","last_clean":"2023-12-18T10:20:45.530059+0000","last_became_active":"2023-12-18T10:20:44.557422+0000","last_became_peered":"2023-12-18T10:20:44.557422+0000","last_unstale":"2023-12-18T10:20:45.530059+0000","last_undegraded":"2023-12-18T10:20:45.530059+0000","last_fullsized":"2023-12-18T10:20:45.530059+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:27:23.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974803+0000","last_change":"2023-12-18T10:20:44.164320+0000","last_active":"2023-12-18T10:20:46.974803+0000","last_peered":"2023-12-18T10:20:46.974803+0000","last_clean":"2023-12-18T10:20:46.974803+0000","last_became_active":"2023-12-18T10:20:44.163409+0000","last_became_peered":"2023-12-18T10:20:44.163409+0000","last_unstale":"2023-12-18T10:20:46.974803+0000","last_undegraded":"2023-12-18T10:20:46.974803+0000","last_fullsized":"2023-12-18T10:20:46.974803+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:34:08.030810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973450+0000","last_change":"2023-12-18T10:20:44.554995+0000","last_active":"2023-12-18T10:20:46.973450+0000","last_peered":"2023-12-18T10:20:46.973450+0000","last_clean":"2023-12-18T10:20:46.973450+0000","last_became_active":"2023-12-18T10:20:44.552286+0000","last_became_peered":"2023-12-18T10:20:44.552286+0000","last_unstale":"2023-12-18T10:20:46.973450+0000","last_undegraded":"2023-12-18T10:20:46.973450+0000","last_fullsized":"2023-12-18T10:20:46.973450+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:55:21.229790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625932+0000","last_change":"2023-12-18T10:20:44.164101+0000","last_active":"2023-12-18T10:20:45.625932+0000","last_peered":"2023-12-18T10:20:45.625932+0000","last_clean":"2023-12-18T10:20:45.625932+0000","last_became_active":"2023-12-18T10:20:44.163821+0000","last_became_peered":"2023-12-18T10:20:44.163821+0000","last_unstale":"2023-12-18T10:20:45.625932+0000","last_undegraded":"2023-12-18T10:20:45.625932+0000","last_fullsized":"2023-12-18T10:20:45.625932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:25.166970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530434+0000","last_change":"2023-12-18T10:20:44.551091+0000","last_active":"2023-12-18T10:20:45.530434+0000","last_peered":"2023-12-18T10:20:45.530434+0000","last_clean":"2023-12-18T10:20:45.530434+0000","last_became_active":"2023-12-18T10:20:44.539298+0000","last_became_peered":"2023-12-18T10:20:44.539298+0000","last_unstale":"2023-12-18T10:20:45.530434+0000","last_undegraded":"2023-12-18T10:20:45.530434+0000","last_fullsized":"2023-12-18T10:20:45.530434+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:53:45.035923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972927+0000","last_change":"2023-12-18T10:20:44.157364+0000","last_active":"2023-12-18T10:20:46.972927+0000","last_peered":"2023-12-18T10:20:46.972927+0000","last_clean":"2023-12-18T10:20:46.972927+0000","last_became_active":"2023-12-18T10:20:44.156619+0000","last_became_peered":"2023-12-18T10:20:44.156619+0000","last_unstale":"2023-12-18T10:20:46.972927+0000","last_undegraded":"2023-12-18T10:20:46.972927+0000","last_fullsized":"2023-12-18T10:20:46.972927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:18.073237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972874+0000","last_change":"2023-12-18T10:20:44.555678+0000","last_active":"2023-12-18T10:20:46.972874+0000","last_peered":"2023-12-18T10:20:46.972874+0000","last_clean":"2023-12-18T10:20:46.972874+0000","last_became_active":"2023-12-18T10:20:44.555362+0000","last_became_peered":"2023-12-18T10:20:44.555362+0000","last_unstale":"2023-12-18T10:20:46.972874+0000","last_undegraded":"2023-12-18T10:20:46.972874+0000","last_fullsized":"2023-12-18T10:20:46.972874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:43:28.833198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530498+0000","last_change":"2023-12-18T10:20:44.167688+0000","last_active":"2023-12-18T10:20:45.530498+0000","last_peered":"2023-12-18T10:20:45.530498+0000","last_clean":"2023-12-18T10:20:45.530498+0000","last_became_active":"2023-12-18T10:20:44.167355+0000","last_became_peered":"2023-12-18T10:20:44.167355+0000","last_unstale":"2023-12-18T10:20:45.530498+0000","last_undegraded":"2023-12-18T10:20:45.530498+0000","last_fullsized":"2023-12-18T10:20:45.530498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:50:09.229493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665076+0000","last_change":"2023-12-18T10:20:44.557736+0000","last_active":"2023-12-18T10:20:46.665076+0000","last_peered":"2023-12-18T10:20:46.665076+0000","last_clean":"2023-12-18T10:20:46.665076+0000","last_became_active":"2023-12-18T10:20:44.557460+0000","last_became_peered":"2023-12-18T10:20:44.557460+0000","last_unstale":"2023-12-18T10:20:46.665076+0000","last_undegraded":"2023-12-18T10:20:46.665076+0000","last_fullsized":"2023-12-18T10:20:46.665076+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:19.084208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973112+0000","last_change":"2023-12-18T10:20:44.151881+0000","last_active":"2023-12-18T10:20:46.973112+0000","last_peered":"2023-12-18T10:20:46.973112+0000","last_clean":"2023-12-18T10:20:46.973112+0000","last_became_active":"2023-12-18T10:20:44.151632+0000","last_became_peered":"2023-12-18T10:20:44.151632+0000","last_unstale":"2023-12-18T10:20:46.973112+0000","last_undegraded":"2023-12-18T10:20:46.973112+0000","last_fullsized":"2023-12-18T10:20:46.973112+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:49:34.977000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007240+0000","last_change":"2023-12-18T10:20:44.561781+0000","last_active":"2023-12-18T10:20:46.007240+0000","last_peered":"2023-12-18T10:20:46.007240+0000","last_clean":"2023-12-18T10:20:46.007240+0000","last_became_active":"2023-12-18T10:20:44.560974+0000","last_became_peered":"2023-12-18T10:20:44.560974+0000","last_unstale":"2023-12-18T10:20:46.007240+0000","last_undegraded":"2023-12-18T10:20:46.007240+0000","last_fullsized":"2023-12-18T10:20:46.007240+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:00:38.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974671+0000","last_change":"2023-12-18T10:20:44.170979+0000","last_active":"2023-12-18T10:20:46.974671+0000","last_peered":"2023-12-18T10:20:46.974671+0000","last_clean":"2023-12-18T10:20:46.974671+0000","last_became_active":"2023-12-18T10:20:44.170626+0000","last_became_peered":"2023-12-18T10:20:44.170626+0000","last_unstale":"2023-12-18T10:20:46.974671+0000","last_undegraded":"2023-12-18T10:20:46.974671+0000","last_fullsized":"2023-12-18T10:20:46.974671+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:53:23.769325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665228+0000","last_change":"2023-12-18T10:20:44.548267+0000","last_active":"2023-12-18T10:20:46.665228+0000","last_peered":"2023-12-18T10:20:46.665228+0000","last_clean":"2023-12-18T10:20:46.665228+0000","last_became_active":"2023-12-18T10:20:44.547627+0000","last_became_peered":"2023-12-18T10:20:44.547627+0000","last_unstale":"2023-12-18T10:20:46.665228+0000","last_undegraded":"2023-12-18T10:20:46.665228+0000","last_fullsized":"2023-12-18T10:20:46.665228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974791+0000","last_change":"2023-12-18T10:20:44.166174+0000","last_active":"2023-12-18T10:20:46.974791+0000","last_peered":"2023-12-18T10:20:46.974791+0000","last_clean":"2023-12-18T10:20:46.974791+0000","last_became_active":"2023-12-18T10:20:44.165054+0000","last_became_peered":"2023-12-18T10:20:44.165054+0000","last_unstale":"2023-12-18T10:20:46.974791+0000","last_undegraded":"2023-12-18T10:20:46.974791+0000","last_fullsized":"2023-12-18T10:20:46.974791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:44:06.990219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533963+0000","last_change":"2023-12-18T10:20:44.553504+0000","last_active":"2023-12-18T10:20:45.533963+0000","last_peered":"2023-12-18T10:20:45.533963+0000","last_clean":"2023-12-18T10:20:45.533963+0000","last_became_active":"2023-12-18T10:20:44.553232+0000","last_became_peered":"2023-12-18T10:20:44.553232+0000","last_unstale":"2023-12-18T10:20:45.533963+0000","last_undegraded":"2023-12-18T10:20:45.533963+0000","last_fullsized":"2023-12-18T10:20:45.533963+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:56.149679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665294+0000","last_change":"2023-12-18T10:20:44.152396+0000","last_active":"2023-12-18T10:20:46.665294+0000","last_peered":"2023-12-18T10:20:46.665294+0000","last_clean":"2023-12-18T10:20:46.665294+0000","last_became_active":"2023-12-18T10:20:44.152118+0000","last_became_peered":"2023-12-18T10:20:44.152118+0000","last_unstale":"2023-12-18T10:20:46.665294+0000","last_undegraded":"2023-12-18T10:20:46.665294+0000","last_fullsized":"2023-12-18T10:20:46.665294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:34.913986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974549+0000","last_change":"2023-12-18T10:20:44.558747+0000","last_active":"2023-12-18T10:20:46.974549+0000","last_peered":"2023-12-18T10:20:46.974549+0000","last_clean":"2023-12-18T10:20:46.974549+0000","last_became_active":"2023-12-18T10:20:44.558132+0000","last_became_peered":"2023-12-18T10:20:44.558132+0000","last_unstale":"2023-12-18T10:20:46.974549+0000","last_undegraded":"2023-12-18T10:20:46.974549+0000","last_fullsized":"2023-12-18T10:20:46.974549+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:30.305994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973210+0000","last_change":"2023-12-18T10:20:44.157131+0000","last_active":"2023-12-18T10:20:46.973210+0000","last_peered":"2023-12-18T10:20:46.973210+0000","last_clean":"2023-12-18T10:20:46.973210+0000","last_became_active":"2023-12-18T10:20:44.155719+0000","last_became_peered":"2023-12-18T10:20:44.155719+0000","last_unstale":"2023-12-18T10:20:46.973210+0000","last_undegraded":"2023-12-18T10:20:46.973210+0000","last_fullsized":"2023-12-18T10:20:46.973210+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:06.923115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530230+0000","last_change":"2023-12-18T10:20:44.553001+0000","last_active":"2023-12-18T10:20:45.530230+0000","last_peered":"2023-12-18T10:20:45.530230+0000","last_clean":"2023-12-18T10:20:45.530230+0000","last_became_active":"2023-12-18T10:20:44.551969+0000","last_became_peered":"2023-12-18T10:20:44.551969+0000","last_unstale":"2023-12-18T10:20:45.530230+0000","last_undegraded":"2023-12-18T10:20:45.530230+0000","last_fullsized":"2023-12-18T10:20:45.530230+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:42:05.275947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529743+0000","last_change":"2023-12-18T10:20:44.168499+0000","last_active":"2023-12-18T10:20:45.529743+0000","last_peered":"2023-12-18T10:20:45.529743+0000","last_clean":"2023-12-18T10:20:45.529743+0000","last_became_active":"2023-12-18T10:20:44.168258+0000","last_became_peered":"2023-12-18T10:20:44.168258+0000","last_unstale":"2023-12-18T10:20:45.529743+0000","last_undegraded":"2023-12-18T10:20:45.529743+0000","last_fullsized":"2023-12-18T10:20:45.529743+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665415+0000","last_change":"2023-12-18T10:20:44.553780+0000","last_active":"2023-12-18T10:20:46.665415+0000","last_peered":"2023-12-18T10:20:46.665415+0000","last_clean":"2023-12-18T10:20:46.665415+0000","last_became_active":"2023-12-18T10:20:44.553492+0000","last_became_peered":"2023-12-18T10:20:44.553492+0000","last_unstale":"2023-12-18T10:20:46.665415+0000","last_undegraded":"2023-12-18T10:20:46.665415+0000","last_fullsized":"2023-12-18T10:20:46.665415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:24:21.570784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972778+0000","last_change":"2023-12-18T10:20:44.158923+0000","last_active":"2023-12-18T10:20:46.972778+0000","last_peered":"2023-12-18T10:20:46.972778+0000","last_clean":"2023-12-18T10:20:46.972778+0000","last_became_active":"2023-12-18T10:20:44.158643+0000","last_became_peered":"2023-12-18T10:20:44.158643+0000","last_unstale":"2023-12-18T10:20:46.972778+0000","last_undegraded":"2023-12-18T10:20:46.972778+0000","last_fullsized":"2023-12-18T10:20:46.972778+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:20:05.856413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.534016+0000","last_change":"2023-12-18T10:20:44.557128+0000","last_active":"2023-12-18T10:20:45.534016+0000","last_peered":"2023-12-18T10:20:45.534016+0000","last_clean":"2023-12-18T10:20:45.534016+0000","last_became_active":"2023-12-18T10:20:44.556447+0000","last_became_peered":"2023-12-18T10:20:44.556447+0000","last_unstale":"2023-12-18T10:20:45.534016+0000","last_undegraded":"2023-12-18T10:20:45.534016+0000","last_fullsized":"2023-12-18T10:20:45.534016+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974732+0000","last_change":"2023-12-18T10:20:44.168330+0000","last_active":"2023-12-18T10:20:46.974732+0000","last_peered":"2023-12-18T10:20:46.974732+0000","last_clean":"2023-12-18T10:20:46.974732+0000","last_became_active":"2023-12-18T10:20:44.167960+0000","last_became_peered":"2023-12-18T10:20:44.167960+0000","last_unstale":"2023-12-18T10:20:46.974732+0000","last_undegraded":"2023-12-18T10:20:46.974732+0000","last_fullsized":"2023-12-18T10:20:46.974732+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:17.767330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665157+0000","last_change":"2023-12-18T10:20:44.549359+0000","last_active":"2023-12-18T10:20:46.665157+0000","last_peered":"2023-12-18T10:20:46.665157+0000","last_clean":"2023-12-18T10:20:46.665157+0000","last_became_active":"2023-12-18T10:20:44.549060+0000","last_became_peered":"2023-12-18T10:20:44.549060+0000","last_unstale":"2023-12-18T10:20:46.665157+0000","last_undegraded":"2023-12-18T10:20:46.665157+0000","last_fullsized":"2023-12-18T10:20:46.665157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:17.717007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625785+0000","last_change":"2023-12-18T10:20:44.161537+0000","last_active":"2023-12-18T10:20:45.625785+0000","last_peered":"2023-12-18T10:20:45.625785+0000","last_clean":"2023-12-18T10:20:45.625785+0000","last_became_active":"2023-12-18T10:20:44.161261+0000","last_became_peered":"2023-12-18T10:20:44.161261+0000","last_unstale":"2023-12-18T10:20:45.625785+0000","last_undegraded":"2023-12-18T10:20:45.625785+0000","last_fullsized":"2023-12-18T10:20:45.625785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:34.913986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973211+0000","last_change":"2023-12-18T10:20:44.557727+0000","last_active":"2023-12-18T10:20:46.973211+0000","last_peered":"2023-12-18T10:20:46.973211+0000","last_clean":"2023-12-18T10:20:46.973211+0000","last_became_active":"2023-12-18T10:20:44.557468+0000","last_became_peered":"2023-12-18T10:20:44.557468+0000","last_unstale":"2023-12-18T10:20:46.973211+0000","last_undegraded":"2023-12-18T10:20:46.973211+0000","last_fullsized":"2023-12-18T10:20:46.973211+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:30:04.771313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530069+0000","last_change":"2023-12-18T10:20:44.163185+0000","last_active":"2023-12-18T10:20:45.530069+0000","last_peered":"2023-12-18T10:20:45.530069+0000","last_clean":"2023-12-18T10:20:45.530069+0000","last_became_active":"2023-12-18T10:20:44.162922+0000","last_became_peered":"2023-12-18T10:20:44.162922+0000","last_unstale":"2023-12-18T10:20:45.530069+0000","last_undegraded":"2023-12-18T10:20:45.530069+0000","last_fullsized":"2023-12-18T10:20:45.530069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:15:49.482034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529991+0000","last_change":"2023-12-18T10:20:44.568455+0000","last_active":"2023-12-18T10:20:45.529991+0000","last_peered":"2023-12-18T10:20:45.529991+0000","last_clean":"2023-12-18T10:20:45.529991+0000","last_became_active":"2023-12-18T10:20:44.568102+0000","last_became_peered":"2023-12-18T10:20:44.568102+0000","last_unstale":"2023-12-18T10:20:45.529991+0000","last_undegraded":"2023-12-18T10:20:45.529991+0000","last_fullsized":"2023-12-18T10:20:45.529991+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:28:24.655696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973294+0000","last_change":"2023-12-18T10:20:44.157348+0000","last_active":"2023-12-18T10:20:46.973294+0000","last_peered":"2023-12-18T10:20:46.973294+0000","last_clean":"2023-12-18T10:20:46.973294+0000","last_became_active":"2023-12-18T10:20:44.155951+0000","last_became_peered":"2023-12-18T10:20:44.155951+0000","last_unstale":"2023-12-18T10:20:46.973294+0000","last_undegraded":"2023-12-18T10:20:46.973294+0000","last_fullsized":"2023-12-18T10:20:46.973294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:26.271325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533827+0000","last_change":"2023-12-18T10:20:44.543651+0000","last_active":"2023-12-18T10:20:45.533827+0000","last_peered":"2023-12-18T10:20:45.533827+0000","last_clean":"2023-12-18T10:20:45.533827+0000","last_became_active":"2023-12-18T10:20:44.543355+0000","last_became_peered":"2023-12-18T10:20:44.543355+0000","last_unstale":"2023-12-18T10:20:45.533827+0000","last_undegraded":"2023-12-18T10:20:45.533827+0000","last_fullsized":"2023-12-18T10:20:45.533827+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973239+0000","last_change":"2023-12-18T10:20:44.158356+0000","last_active":"2023-12-18T10:20:46.973239+0000","last_peered":"2023-12-18T10:20:46.973239+0000","last_clean":"2023-12-18T10:20:46.973239+0000","last_became_active":"2023-12-18T10:20:44.158092+0000","last_became_peered":"2023-12-18T10:20:44.158092+0000","last_unstale":"2023-12-18T10:20:46.973239+0000","last_undegraded":"2023-12-18T10:20:46.973239+0000","last_fullsized":"2023-12-18T10:20:46.973239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:00.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530141+0000","last_change":"2023-12-18T10:20:44.540778+0000","last_active":"2023-12-18T10:20:45.530141+0000","last_peered":"2023-12-18T10:20:45.530141+0000","last_clean":"2023-12-18T10:20:45.530141+0000","last_became_active":"2023-12-18T10:20:44.540505+0000","last_became_peered":"2023-12-18T10:20:44.540505+0000","last_unstale":"2023-12-18T10:20:45.530141+0000","last_undegraded":"2023-12-18T10:20:45.530141+0000","last_fullsized":"2023-12-18T10:20:45.530141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007168+0000","last_change":"2023-12-18T10:20:44.161346+0000","last_active":"2023-12-18T10:20:46.007168+0000","last_peered":"2023-12-18T10:20:46.007168+0000","last_clean":"2023-12-18T10:20:46.007168+0000","last_became_active":"2023-12-18T10:20:44.160893+0000","last_became_peered":"2023-12-18T10:20:44.160893+0000","last_unstale":"2023-12-18T10:20:46.007168+0000","last_undegraded":"2023-12-18T10:20:46.007168+0000","last_fullsized":"2023-12-18T10:20:46.007168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:06.923115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973636+0000","last_change":"2023-12-18T10:20:44.550615+0000","last_active":"2023-12-18T10:20:46.973636+0000","last_peered":"2023-12-18T10:20:46.973636+0000","last_clean":"2023-12-18T10:20:46.973636+0000","last_became_active":"2023-12-18T10:20:44.550378+0000","last_became_peered":"2023-12-18T10:20:44.550378+0000","last_unstale":"2023-12-18T10:20:46.973636+0000","last_undegraded":"2023-12-18T10:20:46.973636+0000","last_fullsized":"2023-12-18T10:20:46.973636+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:27:23.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533988+0000","last_change":"2023-12-18T10:20:44.169257+0000","last_active":"2023-12-18T10:20:45.533988+0000","last_peered":"2023-12-18T10:20:45.533988+0000","last_clean":"2023-12-18T10:20:45.533988+0000","last_became_active":"2023-12-18T10:20:44.168986+0000","last_became_peered":"2023-12-18T10:20:44.168986+0000","last_unstale":"2023-12-18T10:20:45.533988+0000","last_undegraded":"2023-12-18T10:20:45.533988+0000","last_fullsized":"2023-12-18T10:20:45.533988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:29.295023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974499+0000","last_change":"2023-12-18T10:20:44.555391+0000","last_active":"2023-12-18T10:20:46.974499+0000","last_peered":"2023-12-18T10:20:46.974499+0000","last_clean":"2023-12-18T10:20:46.974499+0000","last_became_active":"2023-12-18T10:20:44.552659+0000","last_became_peered":"2023-12-18T10:20:44.552659+0000","last_unstale":"2023-12-18T10:20:46.974499+0000","last_undegraded":"2023-12-18T10:20:46.974499+0000","last_fullsized":"2023-12-18T10:20:46.974499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:08:58.576387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530308+0000","last_change":"2023-12-18T10:20:44.165658+0000","last_active":"2023-12-18T10:20:45.530308+0000","last_peered":"2023-12-18T10:20:45.530308+0000","last_clean":"2023-12-18T10:20:45.530308+0000","last_became_active":"2023-12-18T10:20:44.165389+0000","last_became_peered":"2023-12-18T10:20:44.165389+0000","last_unstale":"2023-12-18T10:20:45.530308+0000","last_undegraded":"2023-12-18T10:20:45.530308+0000","last_fullsized":"2023-12-18T10:20:45.530308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:59.882047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-18T10:20:44.538185+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:20:44.538185+0000","last_peered":"2023-12-18T10:20:44.538185+0000","last_clean":"2023-12-18T10:20:44.538185+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:20:44.538185+0000","last_undegraded":"2023-12-18T10:20:44.538185+0000","last_fullsized":"2023-12-18T10:20:44.538185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1232896,"data_stored":871098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.47599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.88600000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61899999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84899999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69199999999999995,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85699999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.505,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":638976,"data_stored":281258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.84399999999999997,"15min":0.877},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.495},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.81899999999999995,"5min":1.845,"15min":1.845},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.86599999999999999,"15min":0.89600000000000002},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81200000000000006,"5min":4.524,"15min":4.524},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86499999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.497},"max":{"1min":0.873,"5min":1.925,"15min":1.925},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91300000000000003,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90300000000000002,"15min":0.92900000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85399999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83999999999999997,"5min":1.054,"15min":1.054},"last":0.747},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.101,"15min":1.101},"last":0.71299999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.284,"15min":1.284},"last":0.63800000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.745,"15min":0.754},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88300000000000001,"5min":1.129,"15min":1.129},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84499999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":630784,"data_stored":280606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66500000000000004,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93999999999999995,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88400000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.44900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.99399999999999999,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91200000000000003,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.66600000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93500000000000005,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83099999999999996,"15min":0.85299999999999998},"min":{"1min":0.51600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0189999999999999,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.98499999999999999,"15min":1.038},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.499},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0109999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93200000000000005,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.042,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.55900000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89900000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83699999999999997,"15min":0.85599999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":634880,"data_stored":281188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.749}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.131,"15min":1.131},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94699999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.92300000000000004,"5min":1.032,"15min":1.032},"last":0.622}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.999,"15min":0.999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.66100000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91700000000000004,"5min":1.073,"15min":1.073},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":647168,"data_stored":282192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55900000000000005,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.54900000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.61899999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44400000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63100000000000001,"5min":1.254,"15min":1.254},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73999999999999999,"5min":1.772,"15min":1.772},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98099999999999998,"5min":1.01,"15min":1.01},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.82399999999999995,"5min":1.181,"15min":1.181},"last":0.79300000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.81299999999999994,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.53000000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.069},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.872},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0629999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.85599999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":1.127,"15min":1.127},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94299999999999995,"5min":1.139,"15min":1.139},"last":0.82299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":643072,"data_stored":282170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.436,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56799999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.501,"15min":0.51300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.32900000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.623,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65100000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.438},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.698,"15min":1.698},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94399999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96099999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.997,"5min":1.341,"15min":1.341},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.91900000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.78300000000000003,"15min":0.80000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.032,"5min":1.282,"15min":1.282},"last":0.627},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58799999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98199999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":638976,"data_stored":280766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.61099999999999999,"15min":0.63900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.7150000000000001,"5min":3.976,"15min":3.976},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.52000000000000002,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.2370000000000001,"5min":3.786,"15min":3.786},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.1589999999999998,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.9399999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.52900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7889999999999999,"5min":1.851,"15min":1.851},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.92700000000000005,"15min":0.96099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6539999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.74199999999999999}]},{"osd":5,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.90800000000000003,"15min":0.93600000000000005},"min":{"1min":0.54400000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.6100000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.823,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.94099999999999995,"15min":0.97399999999999998},"min":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.83099999999999996,"15min":0.84399999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8799999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.85099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1232896,"data_stored":871030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.66700000000000004,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.54100000000000004,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":1.456,"15min":1.456},"last":0.375}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":1.595,"15min":1.595},"last":0.435},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.58299999999999996,"15min":0.60899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.624,"5min":2.464,"15min":2.464},"last":0.30599999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":1.859,"15min":1.859},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":1.903,"15min":1.903},"last":0.52400000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94699999999999995,"5min":1.494,"15min":1.494},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67300000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94499999999999995,"5min":1.544,"15min":1.544},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80200000000000005,"15min":0.82099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93200000000000005,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.746},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.89000000000000001,"5min":1.53,"15min":1.53},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79200000000000004,"15min":0.81000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.81299999999999994,"5min":1.556,"15min":1.556},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.77700000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90000000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:20:53.108 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:20:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.251+0000 7fb7aa0f2640 1 Processor -- start 2023-12-18T10:20:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.251+0000 7fb7aa0f2640 1 -- start start 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb7aa0f2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7a40c1280 0x7fb7a40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb7aa0f2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7a40cb340 0x7fb7a40cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb7aa0f2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a406fdb0 con 0x7fb7a4160cc0 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb7aa0f2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a41654a0 con 0x7fb7a40c1280 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb7aa0f2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a41610a0 con 0x7fb7a40cb340 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb79bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7a40c1280 0x7fb7a40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb79bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7a40c1280 0x7fb7a40cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60890/0 (socket says 172.21.15.133:60890) 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb79bfff640 1 -- 172.21.15.133:0/589594881 learned_addr learned my addr 172.21.15.133:0/589594881 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb7a3fff640 1 --2- 172.21.15.133:0/589594881 >> v2:172.21.15.142:3300/0 conn(0x7fb7a40cb340 0x7fb7a40cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb79bfff640 1 -- 172.21.15.133:0/589594881 >> v2:172.21.15.142:3300/0 conn(0x7fb7a40cb340 msgr2=0x7fb7a40cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb79bfff640 1 --2- 172.21.15.133:0/589594881 >> v2:172.21.15.142:3300/0 conn(0x7fb7a40cb340 0x7fb7a40cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb79bfff640 1 -- 172.21.15.133:0/589594881 >> v1:172.21.15.142:6789/0 conn(0x7fb7a4160cc0 legacy=0x7fb7a40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.255+0000 7fb79bfff640 1 -- 172.21.15.133:0/589594881 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a4164820 con 0x7fb7a40c1280 2023-12-18T10:20:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb79bfff640 1 --2- 172.21.15.133:0/589594881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a40cc400 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40c1e40 tx=0x7fb78c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df48c687c8a470d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7a2ffd640 1 -- 172.21.15.133:0/589594881 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c0ab600 con 0x7fb7a40c1280 2023-12-18T10:20:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7a2ffd640 1 -- 172.21.15.133:0/589594881 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c0a7050 con 0x7fb7a40c1280 2023-12-18T10:20:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7a2ffd640 1 -- 172.21.15.133:0/589594881 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c0ab980 con 0x7fb7a40c1280 2023-12-18T10:20:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/589594881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 msgr2=0x7fb7a40cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/589594881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a40cc400 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40c1e40 tx=0x7fb78c01c440 comp rx=0 tx=0).stop 2023-12-18T10:20:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/589594881 shutdown_connections 2023-12-18T10:20:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/589594881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a40cc400 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/589594881 >> v2:172.21.15.142:3300/0 conn(0x7fb7a40cb340 0x7fb7a40cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/589594881 >> 172.21.15.133:0/589594881 conn(0x7fb7a406a3e0 msgr2=0x7fb7a40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/589594881 shutdown_connections 2023-12-18T10:20:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/589594881 wait complete. 2023-12-18T10:20:53.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 Processor -- start 2023-12-18T10:20:53.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.259+0000 7fb7aa0f2640 1 -- start start 2023-12-18T10:20:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a4158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40cb340 0x7fb7a4158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a4160cc0 0x7fb7a4161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4159220 con 0x7fb7a40c1280 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4161be0 con 0x7fb7a4160cc0 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a4161ec0 con 0x7fb7a40cb340 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a4158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a4158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60898/0 (socket says 172.21.15.133:60898) 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 -- 172.21.15.133:0/3471198854 learned_addr learned my addr 172.21.15.133:0/3471198854 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a3fff640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a4160cc0 0x7fb7a4161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb79bfff640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40cb340 0x7fb7a4158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 -- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40cb340 msgr2=0x7fb7a4158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40cb340 0x7fb7a4158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 -- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a4160cc0 msgr2=0x7fb7a4161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a4160cc0 0x7fb7a4161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 -- 172.21.15.133:0/3471198854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0094d0 con 0x7fb7a40c1280 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a3fff640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a4160cc0 0x7fb7a4161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb79bfff640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40cb340 0x7fb7a4158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a37fe640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a4158ce0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb79400c3c0 tx=0x7fb79400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a0ff9640 1 -- 172.21.15.133:0/3471198854 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7940052d0 con 0x7fb7a40c1280 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a0ff9640 1 -- 172.21.15.133:0/3471198854 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb794005430 con 0x7fb7a40c1280 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a0ff9640 1 -- 172.21.15.133:0/3471198854 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794003840 con 0x7fb7a40c1280 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a41621a0 con 0x7fb7a40c1280 2023-12-18T10:20:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a4158980 con 0x7fb7a40c1280 2023-12-18T10:20:53.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a40735b0 con 0x7fb7a40c1280 2023-12-18T10:20:53.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.263+0000 7fb7a0ff9640 1 -- 172.21.15.133:0/3471198854 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb7940039a0 con 0x7fb7a40c1280 2023-12-18T10:20:53.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.267+0000 7fb7a0ff9640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb784065a60 0x7fb784067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.267+0000 7fb7a0ff9640 1 -- 172.21.15.133:0/3471198854 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb794082820 con 0x7fb7a40c1280 2023-12-18T10:20:53.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.267+0000 7fb79bfff640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb784065a60 0x7fb784067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.267+0000 7fb79bfff640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb784065a60 0x7fb784067f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0ad000 tx=0x7fb78c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:53.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.271+0000 7fb7a0ff9640 1 -- 172.21.15.133:0/3471198854 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb794050090 con 0x7fb7a40c1280 2023-12-18T10:20:53.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.419+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7a4162030 con 0x7fb784065a60 2023-12-18T10:20:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7a0ff9640 1 -- 172.21.15.133:0/3471198854 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289331 (secure 0 0 0) 0x7fb7a4162030 con 0x7fb784065a60 2023-12-18T10:20:53.433 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:20:53.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb784065a60 msgr2=0x7fb784067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb784065a60 0x7fb784067f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0ad000 tx=0x7fb78c008040 comp rx=0 tx=0).stop 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 msgr2=0x7fb7a4158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a4158ce0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb79400c3c0 tx=0x7fb79400c880 comp rx=0 tx=0).stop 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 shutdown_connections 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb784065a60 0x7fb784067f20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7a4160cc0 0x7fb7a4161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7a40cb340 0x7fb7a4158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 --2- 172.21.15.133:0/3471198854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a40c1280 0x7fb7a4158ce0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 >> 172.21.15.133:0/3471198854 conn(0x7fb7a406a3e0 msgr2=0x7fb7a4070660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 shutdown_connections 2023-12-18T10:20:53.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.427+0000 7fb7aa0f2640 1 -- 172.21.15.133:0/3471198854 wait complete. 2023-12-18T10:20:53.453 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-12-18T10:20:53.129572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221768,"kb_used_data":6152,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754752952,"statfs":{"total":773094113280,"available":772867022848,"internally_reserved":0,"allocated":6299648,"data_stored":3430308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.603838"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665419+0000","last_change":"2023-12-18T10:20:44.541569+0000","last_active":"2023-12-18T10:20:46.665419+0000","last_peered":"2023-12-18T10:20:46.665419+0000","last_clean":"2023-12-18T10:20:46.665419+0000","last_became_active":"2023-12-18T10:20:44.541324+0000","last_became_peered":"2023-12-18T10:20:44.541324+0000","last_unstale":"2023-12-18T10:20:46.665419+0000","last_undegraded":"2023-12-18T10:20:46.665419+0000","last_fullsized":"2023-12-18T10:20:46.665419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625815+0000","last_change":"2023-12-18T10:20:44.553416+0000","last_active":"2023-12-18T10:20:45.625815+0000","last_peered":"2023-12-18T10:20:45.625815+0000","last_clean":"2023-12-18T10:20:45.625815+0000","last_became_active":"2023-12-18T10:20:44.552973+0000","last_became_peered":"2023-12-18T10:20:44.552973+0000","last_unstale":"2023-12-18T10:20:45.625815+0000","last_undegraded":"2023-12-18T10:20:45.625815+0000","last_fullsized":"2023-12-18T10:20:45.625815+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529957+0000","last_change":"2023-12-18T10:20:44.552612+0000","last_active":"2023-12-18T10:20:45.529957+0000","last_peered":"2023-12-18T10:20:45.529957+0000","last_clean":"2023-12-18T10:20:45.529957+0000","last_became_active":"2023-12-18T10:20:44.552325+0000","last_became_peered":"2023-12-18T10:20:44.552325+0000","last_unstale":"2023-12-18T10:20:45.529957+0000","last_undegraded":"2023-12-18T10:20:45.529957+0000","last_fullsized":"2023-12-18T10:20:45.529957+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:11.129841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625701+0000","last_change":"2023-12-18T10:20:44.569713+0000","last_active":"2023-12-18T10:20:45.625701+0000","last_peered":"2023-12-18T10:20:45.625701+0000","last_clean":"2023-12-18T10:20:45.625701+0000","last_became_active":"2023-12-18T10:20:44.569384+0000","last_became_peered":"2023-12-18T10:20:44.569384+0000","last_unstale":"2023-12-18T10:20:45.625701+0000","last_undegraded":"2023-12-18T10:20:45.625701+0000","last_fullsized":"2023-12-18T10:20:45.625701+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007306+0000","last_change":"2023-12-18T10:20:44.558135+0000","last_active":"2023-12-18T10:20:46.007306+0000","last_peered":"2023-12-18T10:20:46.007306+0000","last_clean":"2023-12-18T10:20:46.007306+0000","last_became_active":"2023-12-18T10:20:44.557879+0000","last_became_peered":"2023-12-18T10:20:44.557879+0000","last_unstale":"2023-12-18T10:20:46.007306+0000","last_undegraded":"2023-12-18T10:20:46.007306+0000","last_fullsized":"2023-12-18T10:20:46.007306+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:02:46.177659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665108+0000","last_change":"2023-12-18T10:20:44.548956+0000","last_active":"2023-12-18T10:20:46.665108+0000","last_peered":"2023-12-18T10:20:46.665108+0000","last_clean":"2023-12-18T10:20:46.665108+0000","last_became_active":"2023-12-18T10:20:44.548647+0000","last_became_peered":"2023-12-18T10:20:44.548647+0000","last_unstale":"2023-12-18T10:20:46.665108+0000","last_undegraded":"2023-12-18T10:20:46.665108+0000","last_fullsized":"2023-12-18T10:20:46.665108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529716+0000","last_change":"2023-12-18T10:20:44.549880+0000","last_active":"2023-12-18T10:20:45.529716+0000","last_peered":"2023-12-18T10:20:45.529716+0000","last_clean":"2023-12-18T10:20:45.529716+0000","last_became_active":"2023-12-18T10:20:44.549668+0000","last_became_peered":"2023-12-18T10:20:44.549668+0000","last_unstale":"2023-12-18T10:20:45.529716+0000","last_undegraded":"2023-12-18T10:20:45.529716+0000","last_fullsized":"2023-12-18T10:20:45.529716+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:30:04.771313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972789+0000","last_change":"2023-12-18T10:20:44.555231+0000","last_active":"2023-12-18T10:20:46.972789+0000","last_peered":"2023-12-18T10:20:46.972789+0000","last_clean":"2023-12-18T10:20:46.972789+0000","last_became_active":"2023-12-18T10:20:44.554996+0000","last_became_peered":"2023-12-18T10:20:44.554996+0000","last_unstale":"2023-12-18T10:20:46.972789+0000","last_undegraded":"2023-12-18T10:20:46.972789+0000","last_fullsized":"2023-12-18T10:20:46.972789+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:49.088008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973606+0000","last_change":"2023-12-18T10:20:44.565493+0000","last_active":"2023-12-18T10:20:46.973606+0000","last_peered":"2023-12-18T10:20:46.973606+0000","last_clean":"2023-12-18T10:20:46.973606+0000","last_became_active":"2023-12-18T10:20:44.563184+0000","last_became_peered":"2023-12-18T10:20:44.563184+0000","last_unstale":"2023-12-18T10:20:46.973606+0000","last_undegraded":"2023-12-18T10:20:46.973606+0000","last_fullsized":"2023-12-18T10:20:46.973606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:01:21.084905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665356+0000","last_change":"2023-12-18T10:20:44.553920+0000","last_active":"2023-12-18T10:20:46.665356+0000","last_peered":"2023-12-18T10:20:46.665356+0000","last_clean":"2023-12-18T10:20:46.665356+0000","last_became_active":"2023-12-18T10:20:44.553433+0000","last_became_peered":"2023-12-18T10:20:44.553433+0000","last_unstale":"2023-12-18T10:20:46.665356+0000","last_undegraded":"2023-12-18T10:20:46.665356+0000","last_fullsized":"2023-12-18T10:20:46.665356+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:27.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972955+0000","last_change":"2023-12-18T10:20:44.550904+0000","last_active":"2023-12-18T10:20:46.972955+0000","last_peered":"2023-12-18T10:20:46.972955+0000","last_clean":"2023-12-18T10:20:46.972955+0000","last_became_active":"2023-12-18T10:20:44.550655+0000","last_became_peered":"2023-12-18T10:20:44.550655+0000","last_unstale":"2023-12-18T10:20:46.972955+0000","last_undegraded":"2023-12-18T10:20:46.972955+0000","last_fullsized":"2023-12-18T10:20:46.972955+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:30:24.371002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973397+0000","last_change":"2023-12-18T10:20:44.567970+0000","last_active":"2023-12-18T10:20:46.973397+0000","last_peered":"2023-12-18T10:20:46.973397+0000","last_clean":"2023-12-18T10:20:46.973397+0000","last_became_active":"2023-12-18T10:20:44.567702+0000","last_became_peered":"2023-12-18T10:20:44.567702+0000","last_unstale":"2023-12-18T10:20:46.973397+0000","last_undegraded":"2023-12-18T10:20:46.973397+0000","last_fullsized":"2023-12-18T10:20:46.973397+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:31:01.041735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665206+0000","last_change":"2023-12-18T10:20:44.554022+0000","last_active":"2023-12-18T10:20:46.665206+0000","last_peered":"2023-12-18T10:20:46.665206+0000","last_clean":"2023-12-18T10:20:46.665206+0000","last_became_active":"2023-12-18T10:20:44.553454+0000","last_became_peered":"2023-12-18T10:20:44.553454+0000","last_unstale":"2023-12-18T10:20:46.665206+0000","last_undegraded":"2023-12-18T10:20:46.665206+0000","last_fullsized":"2023-12-18T10:20:46.665206+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529665+0000","last_change":"2023-12-18T10:20:44.541694+0000","last_active":"2023-12-18T10:20:45.529665+0000","last_peered":"2023-12-18T10:20:45.529665+0000","last_clean":"2023-12-18T10:20:45.529665+0000","last_became_active":"2023-12-18T10:20:44.541458+0000","last_became_peered":"2023-12-18T10:20:44.541458+0000","last_unstale":"2023-12-18T10:20:45.529665+0000","last_undegraded":"2023-12-18T10:20:45.529665+0000","last_fullsized":"2023-12-18T10:20:45.529665+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:00:38.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625439+0000","last_change":"2023-12-18T10:20:44.547669+0000","last_active":"2023-12-18T10:20:45.625439+0000","last_peered":"2023-12-18T10:20:45.625439+0000","last_clean":"2023-12-18T10:20:45.625439+0000","last_became_active":"2023-12-18T10:20:44.546946+0000","last_became_peered":"2023-12-18T10:20:44.546946+0000","last_unstale":"2023-12-18T10:20:45.625439+0000","last_undegraded":"2023-12-18T10:20:45.625439+0000","last_fullsized":"2023-12-18T10:20:45.625439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:25:44.473810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665078+0000","last_change":"2023-12-18T10:20:44.557923+0000","last_active":"2023-12-18T10:20:46.665078+0000","last_peered":"2023-12-18T10:20:46.665078+0000","last_clean":"2023-12-18T10:20:46.665078+0000","last_became_active":"2023-12-18T10:20:44.557008+0000","last_became_peered":"2023-12-18T10:20:44.557008+0000","last_unstale":"2023-12-18T10:20:46.665078+0000","last_undegraded":"2023-12-18T10:20:46.665078+0000","last_fullsized":"2023-12-18T10:20:46.665078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530226+0000","last_change":"2023-12-18T10:20:44.546518+0000","last_active":"2023-12-18T10:20:45.530226+0000","last_peered":"2023-12-18T10:20:45.530226+0000","last_clean":"2023-12-18T10:20:45.530226+0000","last_became_active":"2023-12-18T10:20:44.539262+0000","last_became_peered":"2023-12-18T10:20:44.539262+0000","last_unstale":"2023-12-18T10:20:45.530226+0000","last_undegraded":"2023-12-18T10:20:45.530226+0000","last_fullsized":"2023-12-18T10:20:45.530226+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:55:23.232484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625902+0000","last_change":"2023-12-18T10:20:44.553236+0000","last_active":"2023-12-18T10:20:45.625902+0000","last_peered":"2023-12-18T10:20:45.625902+0000","last_clean":"2023-12-18T10:20:45.625902+0000","last_became_active":"2023-12-18T10:20:44.552604+0000","last_became_peered":"2023-12-18T10:20:44.552604+0000","last_unstale":"2023-12-18T10:20:45.625902+0000","last_undegraded":"2023-12-18T10:20:45.625902+0000","last_fullsized":"2023-12-18T10:20:45.625902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530022+0000","last_change":"2023-12-18T10:20:44.557941+0000","last_active":"2023-12-18T10:20:45.530022+0000","last_peered":"2023-12-18T10:20:45.530022+0000","last_clean":"2023-12-18T10:20:45.530022+0000","last_became_active":"2023-12-18T10:20:44.557359+0000","last_became_peered":"2023-12-18T10:20:44.557359+0000","last_unstale":"2023-12-18T10:20:45.530022+0000","last_undegraded":"2023-12-18T10:20:45.530022+0000","last_fullsized":"2023-12-18T10:20:45.530022+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:26:41.602183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974628+0000","last_change":"2023-12-18T10:20:44.551079+0000","last_active":"2023-12-18T10:20:46.974628+0000","last_peered":"2023-12-18T10:20:46.974628+0000","last_clean":"2023-12-18T10:20:46.974628+0000","last_became_active":"2023-12-18T10:20:44.550795+0000","last_became_peered":"2023-12-18T10:20:44.550795+0000","last_unstale":"2023-12-18T10:20:46.974628+0000","last_undegraded":"2023-12-18T10:20:46.974628+0000","last_fullsized":"2023-12-18T10:20:46.974628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:36.622165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974634+0000","last_change":"2023-12-18T10:20:44.550722+0000","last_active":"2023-12-18T10:20:46.974634+0000","last_peered":"2023-12-18T10:20:46.974634+0000","last_clean":"2023-12-18T10:20:46.974634+0000","last_became_active":"2023-12-18T10:20:44.550447+0000","last_became_peered":"2023-12-18T10:20:44.550447+0000","last_unstale":"2023-12-18T10:20:46.974634+0000","last_undegraded":"2023-12-18T10:20:46.974634+0000","last_fullsized":"2023-12-18T10:20:46.974634+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:35.924957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973124+0000","last_change":"2023-12-18T10:20:44.559291+0000","last_active":"2023-12-18T10:20:46.973124+0000","last_peered":"2023-12-18T10:20:46.973124+0000","last_clean":"2023-12-18T10:20:46.973124+0000","last_became_active":"2023-12-18T10:20:44.558639+0000","last_became_peered":"2023-12-18T10:20:44.558639+0000","last_unstale":"2023-12-18T10:20:46.973124+0000","last_undegraded":"2023-12-18T10:20:46.973124+0000","last_fullsized":"2023-12-18T10:20:46.973124+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:01.381067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972986+0000","last_change":"2023-12-18T10:20:44.547921+0000","last_active":"2023-12-18T10:20:46.972986+0000","last_peered":"2023-12-18T10:20:46.972986+0000","last_clean":"2023-12-18T10:20:46.972986+0000","last_became_active":"2023-12-18T10:20:44.547680+0000","last_became_peered":"2023-12-18T10:20:44.547680+0000","last_unstale":"2023-12-18T10:20:46.972986+0000","last_undegraded":"2023-12-18T10:20:46.972986+0000","last_fullsized":"2023-12-18T10:20:46.972986+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:52:01.892725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529487+0000","last_change":"2023-12-18T10:20:44.541085+0000","last_active":"2023-12-18T10:20:45.529487+0000","last_peered":"2023-12-18T10:20:45.529487+0000","last_clean":"2023-12-18T10:20:45.529487+0000","last_became_active":"2023-12-18T10:20:44.540880+0000","last_became_peered":"2023-12-18T10:20:44.540880+0000","last_unstale":"2023-12-18T10:20:45.529487+0000","last_undegraded":"2023-12-18T10:20:45.529487+0000","last_fullsized":"2023-12-18T10:20:45.529487+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:19:08.205983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530435+0000","last_change":"2023-12-18T10:20:44.560740+0000","last_active":"2023-12-18T10:20:45.530435+0000","last_peered":"2023-12-18T10:20:45.530435+0000","last_clean":"2023-12-18T10:20:45.530435+0000","last_became_active":"2023-12-18T10:20:44.559929+0000","last_became_peered":"2023-12-18T10:20:44.559929+0000","last_unstale":"2023-12-18T10:20:45.530435+0000","last_undegraded":"2023-12-18T10:20:45.530435+0000","last_fullsized":"2023-12-18T10:20:45.530435+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:14:56.044092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973464+0000","last_change":"2023-12-18T10:20:44.562617+0000","last_active":"2023-12-18T10:20:46.973464+0000","last_peered":"2023-12-18T10:20:46.973464+0000","last_clean":"2023-12-18T10:20:46.973464+0000","last_became_active":"2023-12-18T10:20:44.559094+0000","last_became_peered":"2023-12-18T10:20:44.559094+0000","last_unstale":"2023-12-18T10:20:46.973464+0000","last_undegraded":"2023-12-18T10:20:46.973464+0000","last_fullsized":"2023-12-18T10:20:46.973464+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:11.129841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665445+0000","last_change":"2023-12-18T10:20:44.548054+0000","last_active":"2023-12-18T10:20:46.665445+0000","last_peered":"2023-12-18T10:20:46.665445+0000","last_clean":"2023-12-18T10:20:46.665445+0000","last_became_active":"2023-12-18T10:20:44.546099+0000","last_became_peered":"2023-12-18T10:20:44.546099+0000","last_unstale":"2023-12-18T10:20:46.665445+0000","last_undegraded":"2023-12-18T10:20:46.665445+0000","last_fullsized":"2023-12-18T10:20:46.665445+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:07.934086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974706+0000","last_change":"2023-12-18T10:20:44.549776+0000","last_active":"2023-12-18T10:20:46.974706+0000","last_peered":"2023-12-18T10:20:46.974706+0000","last_clean":"2023-12-18T10:20:46.974706+0000","last_became_active":"2023-12-18T10:20:44.549390+0000","last_became_peered":"2023-12-18T10:20:44.549390+0000","last_unstale":"2023-12-18T10:20:46.974706+0000","last_undegraded":"2023-12-18T10:20:46.974706+0000","last_fullsized":"2023-12-18T10:20:46.974706+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:26.177941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529592+0000","last_change":"2023-12-18T10:20:44.543084+0000","last_active":"2023-12-18T10:20:45.529592+0000","last_peered":"2023-12-18T10:20:45.529592+0000","last_clean":"2023-12-18T10:20:45.529592+0000","last_became_active":"2023-12-18T10:20:44.542832+0000","last_became_peered":"2023-12-18T10:20:44.542832+0000","last_unstale":"2023-12-18T10:20:45.529592+0000","last_undegraded":"2023-12-18T10:20:45.529592+0000","last_fullsized":"2023-12-18T10:20:45.529592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:02:47.834572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625577+0000","last_change":"2023-12-18T10:20:44.559683+0000","last_active":"2023-12-18T10:20:45.625577+0000","last_peered":"2023-12-18T10:20:45.625577+0000","last_clean":"2023-12-18T10:20:45.625577+0000","last_became_active":"2023-12-18T10:20:44.559405+0000","last_became_peered":"2023-12-18T10:20:44.559405+0000","last_unstale":"2023-12-18T10:20:45.625577+0000","last_undegraded":"2023-12-18T10:20:45.625577+0000","last_fullsized":"2023-12-18T10:20:45.625577+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:17.717007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529658+0000","last_change":"2023-12-18T10:20:44.541587+0000","last_active":"2023-12-18T10:20:45.529658+0000","last_peered":"2023-12-18T10:20:45.529658+0000","last_clean":"2023-12-18T10:20:45.529658+0000","last_became_active":"2023-12-18T10:20:44.541354+0000","last_became_peered":"2023-12-18T10:20:44.541354+0000","last_unstale":"2023-12-18T10:20:45.529658+0000","last_undegraded":"2023-12-18T10:20:45.529658+0000","last_fullsized":"2023-12-18T10:20:45.529658+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:23:09.477926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533840+0000","last_change":"2023-12-18T10:20:44.557322+0000","last_active":"2023-12-18T10:20:45.533840+0000","last_peered":"2023-12-18T10:20:45.533840+0000","last_clean":"2023-12-18T10:20:45.533840+0000","last_became_active":"2023-12-18T10:20:44.556856+0000","last_became_peered":"2023-12-18T10:20:44.556856+0000","last_unstale":"2023-12-18T10:20:45.533840+0000","last_undegraded":"2023-12-18T10:20:45.533840+0000","last_fullsized":"2023-12-18T10:20:45.533840+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625253+0000","last_change":"2023-12-18T10:20:44.547880+0000","last_active":"2023-12-18T10:20:45.625253+0000","last_peered":"2023-12-18T10:20:45.625253+0000","last_clean":"2023-12-18T10:20:45.625253+0000","last_became_active":"2023-12-18T10:20:44.547584+0000","last_became_peered":"2023-12-18T10:20:44.547584+0000","last_unstale":"2023-12-18T10:20:45.625253+0000","last_undegraded":"2023-12-18T10:20:45.625253+0000","last_fullsized":"2023-12-18T10:20:45.625253+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"52'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974618+0000","last_change":"2023-12-18T10:20:44.162825+0000","last_active":"2023-12-18T10:20:46.974618+0000","last_peered":"2023-12-18T10:20:46.974618+0000","last_clean":"2023-12-18T10:20:46.974618+0000","last_became_active":"2023-12-18T10:20:44.162537+0000","last_became_peered":"2023-12-18T10:20:44.162537+0000","last_unstale":"2023-12-18T10:20:46.974618+0000","last_undegraded":"2023-12-18T10:20:46.974618+0000","last_fullsized":"2023-12-18T10:20:46.974618+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:04:00.914247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533856+0000","last_change":"2023-12-18T10:20:44.543554+0000","last_active":"2023-12-18T10:20:45.533856+0000","last_peered":"2023-12-18T10:20:45.533856+0000","last_clean":"2023-12-18T10:20:45.533856+0000","last_became_active":"2023-12-18T10:20:44.543259+0000","last_became_peered":"2023-12-18T10:20:44.543259+0000","last_unstale":"2023-12-18T10:20:45.533856+0000","last_undegraded":"2023-12-18T10:20:45.533856+0000","last_fullsized":"2023-12-18T10:20:45.533856+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665359+0000","last_change":"2023-12-18T10:20:44.156837+0000","last_active":"2023-12-18T10:20:46.665359+0000","last_peered":"2023-12-18T10:20:46.665359+0000","last_clean":"2023-12-18T10:20:46.665359+0000","last_became_active":"2023-12-18T10:20:44.156616+0000","last_became_peered":"2023-12-18T10:20:44.156616+0000","last_unstale":"2023-12-18T10:20:46.665359+0000","last_undegraded":"2023-12-18T10:20:46.665359+0000","last_fullsized":"2023-12-18T10:20:46.665359+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:25.166970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974823+0000","last_change":"2023-12-18T10:20:44.554271+0000","last_active":"2023-12-18T10:20:46.974823+0000","last_peered":"2023-12-18T10:20:46.974823+0000","last_clean":"2023-12-18T10:20:46.974823+0000","last_became_active":"2023-12-18T10:20:44.551042+0000","last_became_peered":"2023-12-18T10:20:44.551042+0000","last_unstale":"2023-12-18T10:20:46.974823+0000","last_undegraded":"2023-12-18T10:20:46.974823+0000","last_fullsized":"2023-12-18T10:20:46.974823+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:45.276234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665437+0000","last_change":"2023-12-18T10:20:44.165356+0000","last_active":"2023-12-18T10:20:46.665437+0000","last_peered":"2023-12-18T10:20:46.665437+0000","last_clean":"2023-12-18T10:20:46.665437+0000","last_became_active":"2023-12-18T10:20:44.164855+0000","last_became_peered":"2023-12-18T10:20:44.164855+0000","last_unstale":"2023-12-18T10:20:46.665437+0000","last_undegraded":"2023-12-18T10:20:46.665437+0000","last_fullsized":"2023-12-18T10:20:46.665437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973111+0000","last_change":"2023-12-18T10:20:44.562589+0000","last_active":"2023-12-18T10:20:46.973111+0000","last_peered":"2023-12-18T10:20:46.973111+0000","last_clean":"2023-12-18T10:20:46.973111+0000","last_became_active":"2023-12-18T10:20:44.562357+0000","last_became_peered":"2023-12-18T10:20:44.562357+0000","last_unstale":"2023-12-18T10:20:46.973111+0000","last_undegraded":"2023-12-18T10:20:46.973111+0000","last_fullsized":"2023-12-18T10:20:46.973111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:19:08.205983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533943+0000","last_change":"2023-12-18T10:20:44.165232+0000","last_active":"2023-12-18T10:20:45.533943+0000","last_peered":"2023-12-18T10:20:45.533943+0000","last_clean":"2023-12-18T10:20:45.533943+0000","last_became_active":"2023-12-18T10:20:44.164930+0000","last_became_peered":"2023-12-18T10:20:44.164930+0000","last_unstale":"2023-12-18T10:20:45.533943+0000","last_undegraded":"2023-12-18T10:20:45.533943+0000","last_fullsized":"2023-12-18T10:20:45.533943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007488+0000","last_change":"2023-12-18T10:20:44.559015+0000","last_active":"2023-12-18T10:20:46.007488+0000","last_peered":"2023-12-18T10:20:46.007488+0000","last_clean":"2023-12-18T10:20:46.007488+0000","last_became_active":"2023-12-18T10:20:44.557410+0000","last_became_peered":"2023-12-18T10:20:44.557410+0000","last_unstale":"2023-12-18T10:20:46.007488+0000","last_undegraded":"2023-12-18T10:20:46.007488+0000","last_fullsized":"2023-12-18T10:20:46.007488+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529810+0000","last_change":"2023-12-18T10:20:44.169502+0000","last_active":"2023-12-18T10:20:45.529810+0000","last_peered":"2023-12-18T10:20:45.529810+0000","last_clean":"2023-12-18T10:20:45.529810+0000","last_became_active":"2023-12-18T10:20:44.169239+0000","last_became_peered":"2023-12-18T10:20:44.169239+0000","last_unstale":"2023-12-18T10:20:45.529810+0000","last_undegraded":"2023-12-18T10:20:45.529810+0000","last_fullsized":"2023-12-18T10:20:45.529810+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:41:04.766861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625670+0000","last_change":"2023-12-18T10:20:44.559775+0000","last_active":"2023-12-18T10:20:45.625670+0000","last_peered":"2023-12-18T10:20:45.625670+0000","last_clean":"2023-12-18T10:20:45.625670+0000","last_became_active":"2023-12-18T10:20:44.559484+0000","last_became_peered":"2023-12-18T10:20:44.559484+0000","last_unstale":"2023-12-18T10:20:45.625670+0000","last_undegraded":"2023-12-18T10:20:45.625670+0000","last_fullsized":"2023-12-18T10:20:45.625670+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:01.293488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007191+0000","last_change":"2023-12-18T10:20:44.155223+0000","last_active":"2023-12-18T10:20:46.007191+0000","last_peered":"2023-12-18T10:20:46.007191+0000","last_clean":"2023-12-18T10:20:46.007191+0000","last_became_active":"2023-12-18T10:20:44.154919+0000","last_became_peered":"2023-12-18T10:20:44.154919+0000","last_unstale":"2023-12-18T10:20:46.007191+0000","last_undegraded":"2023-12-18T10:20:46.007191+0000","last_fullsized":"2023-12-18T10:20:46.007191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:18.073237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973513+0000","last_change":"2023-12-18T10:20:44.555178+0000","last_active":"2023-12-18T10:20:46.973513+0000","last_peered":"2023-12-18T10:20:46.973513+0000","last_clean":"2023-12-18T10:20:46.973513+0000","last_became_active":"2023-12-18T10:20:44.552676+0000","last_became_peered":"2023-12-18T10:20:44.552676+0000","last_unstale":"2023-12-18T10:20:46.973513+0000","last_undegraded":"2023-12-18T10:20:46.973513+0000","last_fullsized":"2023-12-18T10:20:46.973513+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974437+0000","last_change":"2023-12-18T10:20:44.163586+0000","last_active":"2023-12-18T10:20:46.974437+0000","last_peered":"2023-12-18T10:20:46.974437+0000","last_clean":"2023-12-18T10:20:46.974437+0000","last_became_active":"2023-12-18T10:20:44.163063+0000","last_became_peered":"2023-12-18T10:20:44.163063+0000","last_unstale":"2023-12-18T10:20:46.974437+0000","last_undegraded":"2023-12-18T10:20:46.974437+0000","last_fullsized":"2023-12-18T10:20:46.974437+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:44:52.499992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625675+0000","last_change":"2023-12-18T10:20:44.553548+0000","last_active":"2023-12-18T10:20:45.625675+0000","last_peered":"2023-12-18T10:20:45.625675+0000","last_clean":"2023-12-18T10:20:45.625675+0000","last_became_active":"2023-12-18T10:20:44.553132+0000","last_became_peered":"2023-12-18T10:20:44.553132+0000","last_unstale":"2023-12-18T10:20:45.625675+0000","last_undegraded":"2023-12-18T10:20:45.625675+0000","last_fullsized":"2023-12-18T10:20:45.625675+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:27.282296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529565+0000","last_change":"2023-12-18T10:20:44.162413+0000","last_active":"2023-12-18T10:20:45.529565+0000","last_peered":"2023-12-18T10:20:45.529565+0000","last_clean":"2023-12-18T10:20:45.529565+0000","last_became_active":"2023-12-18T10:20:44.162072+0000","last_became_peered":"2023-12-18T10:20:44.162072+0000","last_unstale":"2023-12-18T10:20:45.529565+0000","last_undegraded":"2023-12-18T10:20:45.529565+0000","last_fullsized":"2023-12-18T10:20:45.529565+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:29.295023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007200+0000","last_change":"2023-12-18T10:20:44.554437+0000","last_active":"2023-12-18T10:20:46.007200+0000","last_peered":"2023-12-18T10:20:46.007200+0000","last_clean":"2023-12-18T10:20:46.007200+0000","last_became_active":"2023-12-18T10:20:44.554152+0000","last_became_peered":"2023-12-18T10:20:44.554152+0000","last_unstale":"2023-12-18T10:20:46.007200+0000","last_undegraded":"2023-12-18T10:20:46.007200+0000","last_fullsized":"2023-12-18T10:20:46.007200+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:02:47.834572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625670+0000","last_change":"2023-12-18T10:20:44.157327+0000","last_active":"2023-12-18T10:20:45.625670+0000","last_peered":"2023-12-18T10:20:45.625670+0000","last_clean":"2023-12-18T10:20:45.625670+0000","last_became_active":"2023-12-18T10:20:44.157049+0000","last_became_peered":"2023-12-18T10:20:44.157049+0000","last_unstale":"2023-12-18T10:20:45.625670+0000","last_undegraded":"2023-12-18T10:20:45.625670+0000","last_fullsized":"2023-12-18T10:20:45.625670+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:44.265262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533813+0000","last_change":"2023-12-18T10:20:44.560201+0000","last_active":"2023-12-18T10:20:45.533813+0000","last_peered":"2023-12-18T10:20:45.533813+0000","last_clean":"2023-12-18T10:20:45.533813+0000","last_became_active":"2023-12-18T10:20:44.559244+0000","last_became_peered":"2023-12-18T10:20:44.559244+0000","last_unstale":"2023-12-18T10:20:45.533813+0000","last_undegraded":"2023-12-18T10:20:45.533813+0000","last_fullsized":"2023-12-18T10:20:45.533813+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:25:44.473810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007444+0000","last_change":"2023-12-18T10:20:44.167242+0000","last_active":"2023-12-18T10:20:46.007444+0000","last_peered":"2023-12-18T10:20:46.007444+0000","last_clean":"2023-12-18T10:20:46.007444+0000","last_became_active":"2023-12-18T10:20:44.166853+0000","last_became_peered":"2023-12-18T10:20:44.166853+0000","last_unstale":"2023-12-18T10:20:46.007444+0000","last_undegraded":"2023-12-18T10:20:46.007444+0000","last_fullsized":"2023-12-18T10:20:46.007444+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:24:20.559813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529762+0000","last_change":"2023-12-18T10:20:44.551734+0000","last_active":"2023-12-18T10:20:45.529762+0000","last_peered":"2023-12-18T10:20:45.529762+0000","last_clean":"2023-12-18T10:20:45.529762+0000","last_became_active":"2023-12-18T10:20:44.545973+0000","last_became_peered":"2023-12-18T10:20:44.545973+0000","last_unstale":"2023-12-18T10:20:45.529762+0000","last_undegraded":"2023-12-18T10:20:45.529762+0000","last_fullsized":"2023-12-18T10:20:45.529762+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:02:46.177659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"52'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625770+0000","last_change":"2023-12-18T10:20:44.168519+0000","last_active":"2023-12-18T10:20:45.625770+0000","last_peered":"2023-12-18T10:20:45.625770+0000","last_clean":"2023-12-18T10:20:45.625770+0000","last_became_active":"2023-12-18T10:20:44.168162+0000","last_became_peered":"2023-12-18T10:20:44.168162+0000","last_unstale":"2023-12-18T10:20:45.625770+0000","last_undegraded":"2023-12-18T10:20:45.625770+0000","last_fullsized":"2023-12-18T10:20:45.625770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007479+0000","last_change":"2023-12-18T10:20:44.553336+0000","last_active":"2023-12-18T10:20:46.007479+0000","last_peered":"2023-12-18T10:20:46.007479+0000","last_clean":"2023-12-18T10:20:46.007479+0000","last_became_active":"2023-12-18T10:20:44.553058+0000","last_became_peered":"2023-12-18T10:20:44.553058+0000","last_unstale":"2023-12-18T10:20:46.007479+0000","last_undegraded":"2023-12-18T10:20:46.007479+0000","last_fullsized":"2023-12-18T10:20:46.007479+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:42:05.275947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973472+0000","last_change":"2023-12-18T10:20:44.157054+0000","last_active":"2023-12-18T10:20:46.973472+0000","last_peered":"2023-12-18T10:20:46.973472+0000","last_clean":"2023-12-18T10:20:46.973472+0000","last_became_active":"2023-12-18T10:20:44.155959+0000","last_became_peered":"2023-12-18T10:20:44.155959+0000","last_unstale":"2023-12-18T10:20:46.973472+0000","last_undegraded":"2023-12-18T10:20:46.973472+0000","last_fullsized":"2023-12-18T10:20:46.973472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:16.706036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533754+0000","last_change":"2023-12-18T10:20:44.544356+0000","last_active":"2023-12-18T10:20:45.533754+0000","last_peered":"2023-12-18T10:20:45.533754+0000","last_clean":"2023-12-18T10:20:45.533754+0000","last_became_active":"2023-12-18T10:20:44.544088+0000","last_became_peered":"2023-12-18T10:20:44.544088+0000","last_unstale":"2023-12-18T10:20:45.533754+0000","last_undegraded":"2023-12-18T10:20:45.533754+0000","last_fullsized":"2023-12-18T10:20:45.533754+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:22:11.992675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529885+0000","last_change":"2023-12-18T10:20:44.164064+0000","last_active":"2023-12-18T10:20:45.529885+0000","last_peered":"2023-12-18T10:20:45.529885+0000","last_clean":"2023-12-18T10:20:45.529885+0000","last_became_active":"2023-12-18T10:20:44.163795+0000","last_became_peered":"2023-12-18T10:20:44.163795+0000","last_unstale":"2023-12-18T10:20:45.529885+0000","last_undegraded":"2023-12-18T10:20:45.529885+0000","last_fullsized":"2023-12-18T10:20:45.529885+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:24:57.538958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530059+0000","last_change":"2023-12-18T10:20:44.557971+0000","last_active":"2023-12-18T10:20:45.530059+0000","last_peered":"2023-12-18T10:20:45.530059+0000","last_clean":"2023-12-18T10:20:45.530059+0000","last_became_active":"2023-12-18T10:20:44.557422+0000","last_became_peered":"2023-12-18T10:20:44.557422+0000","last_unstale":"2023-12-18T10:20:45.530059+0000","last_undegraded":"2023-12-18T10:20:45.530059+0000","last_fullsized":"2023-12-18T10:20:45.530059+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:27:23.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974803+0000","last_change":"2023-12-18T10:20:44.164320+0000","last_active":"2023-12-18T10:20:46.974803+0000","last_peered":"2023-12-18T10:20:46.974803+0000","last_clean":"2023-12-18T10:20:46.974803+0000","last_became_active":"2023-12-18T10:20:44.163409+0000","last_became_peered":"2023-12-18T10:20:44.163409+0000","last_unstale":"2023-12-18T10:20:46.974803+0000","last_undegraded":"2023-12-18T10:20:46.974803+0000","last_fullsized":"2023-12-18T10:20:46.974803+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:34:08.030810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973450+0000","last_change":"2023-12-18T10:20:44.554995+0000","last_active":"2023-12-18T10:20:46.973450+0000","last_peered":"2023-12-18T10:20:46.973450+0000","last_clean":"2023-12-18T10:20:46.973450+0000","last_became_active":"2023-12-18T10:20:44.552286+0000","last_became_peered":"2023-12-18T10:20:44.552286+0000","last_unstale":"2023-12-18T10:20:46.973450+0000","last_undegraded":"2023-12-18T10:20:46.973450+0000","last_fullsized":"2023-12-18T10:20:46.973450+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:55:21.229790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625932+0000","last_change":"2023-12-18T10:20:44.164101+0000","last_active":"2023-12-18T10:20:45.625932+0000","last_peered":"2023-12-18T10:20:45.625932+0000","last_clean":"2023-12-18T10:20:45.625932+0000","last_became_active":"2023-12-18T10:20:44.163821+0000","last_became_peered":"2023-12-18T10:20:44.163821+0000","last_unstale":"2023-12-18T10:20:45.625932+0000","last_undegraded":"2023-12-18T10:20:45.625932+0000","last_fullsized":"2023-12-18T10:20:45.625932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:07:25.166970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530434+0000","last_change":"2023-12-18T10:20:44.551091+0000","last_active":"2023-12-18T10:20:45.530434+0000","last_peered":"2023-12-18T10:20:45.530434+0000","last_clean":"2023-12-18T10:20:45.530434+0000","last_became_active":"2023-12-18T10:20:44.539298+0000","last_became_peered":"2023-12-18T10:20:44.539298+0000","last_unstale":"2023-12-18T10:20:45.530434+0000","last_undegraded":"2023-12-18T10:20:45.530434+0000","last_fullsized":"2023-12-18T10:20:45.530434+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:53:45.035923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972927+0000","last_change":"2023-12-18T10:20:44.157364+0000","last_active":"2023-12-18T10:20:46.972927+0000","last_peered":"2023-12-18T10:20:46.972927+0000","last_clean":"2023-12-18T10:20:46.972927+0000","last_became_active":"2023-12-18T10:20:44.156619+0000","last_became_peered":"2023-12-18T10:20:44.156619+0000","last_unstale":"2023-12-18T10:20:46.972927+0000","last_undegraded":"2023-12-18T10:20:46.972927+0000","last_fullsized":"2023-12-18T10:20:46.972927+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:18.073237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972874+0000","last_change":"2023-12-18T10:20:44.555678+0000","last_active":"2023-12-18T10:20:46.972874+0000","last_peered":"2023-12-18T10:20:46.972874+0000","last_clean":"2023-12-18T10:20:46.972874+0000","last_became_active":"2023-12-18T10:20:44.555362+0000","last_became_peered":"2023-12-18T10:20:44.555362+0000","last_unstale":"2023-12-18T10:20:46.972874+0000","last_undegraded":"2023-12-18T10:20:46.972874+0000","last_fullsized":"2023-12-18T10:20:46.972874+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:43:28.833198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530498+0000","last_change":"2023-12-18T10:20:44.167688+0000","last_active":"2023-12-18T10:20:45.530498+0000","last_peered":"2023-12-18T10:20:45.530498+0000","last_clean":"2023-12-18T10:20:45.530498+0000","last_became_active":"2023-12-18T10:20:44.167355+0000","last_became_peered":"2023-12-18T10:20:44.167355+0000","last_unstale":"2023-12-18T10:20:45.530498+0000","last_undegraded":"2023-12-18T10:20:45.530498+0000","last_fullsized":"2023-12-18T10:20:45.530498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:50:09.229493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665076+0000","last_change":"2023-12-18T10:20:44.557736+0000","last_active":"2023-12-18T10:20:46.665076+0000","last_peered":"2023-12-18T10:20:46.665076+0000","last_clean":"2023-12-18T10:20:46.665076+0000","last_became_active":"2023-12-18T10:20:44.557460+0000","last_became_peered":"2023-12-18T10:20:44.557460+0000","last_unstale":"2023-12-18T10:20:46.665076+0000","last_undegraded":"2023-12-18T10:20:46.665076+0000","last_fullsized":"2023-12-18T10:20:46.665076+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:35:19.084208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973112+0000","last_change":"2023-12-18T10:20:44.151881+0000","last_active":"2023-12-18T10:20:46.973112+0000","last_peered":"2023-12-18T10:20:46.973112+0000","last_clean":"2023-12-18T10:20:46.973112+0000","last_became_active":"2023-12-18T10:20:44.151632+0000","last_became_peered":"2023-12-18T10:20:44.151632+0000","last_unstale":"2023-12-18T10:20:46.973112+0000","last_undegraded":"2023-12-18T10:20:46.973112+0000","last_fullsized":"2023-12-18T10:20:46.973112+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:49:34.977000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007240+0000","last_change":"2023-12-18T10:20:44.561781+0000","last_active":"2023-12-18T10:20:46.007240+0000","last_peered":"2023-12-18T10:20:46.007240+0000","last_clean":"2023-12-18T10:20:46.007240+0000","last_became_active":"2023-12-18T10:20:44.560974+0000","last_became_peered":"2023-12-18T10:20:44.560974+0000","last_unstale":"2023-12-18T10:20:46.007240+0000","last_undegraded":"2023-12-18T10:20:46.007240+0000","last_fullsized":"2023-12-18T10:20:46.007240+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:00:38.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974671+0000","last_change":"2023-12-18T10:20:44.170979+0000","last_active":"2023-12-18T10:20:46.974671+0000","last_peered":"2023-12-18T10:20:46.974671+0000","last_clean":"2023-12-18T10:20:46.974671+0000","last_became_active":"2023-12-18T10:20:44.170626+0000","last_became_peered":"2023-12-18T10:20:44.170626+0000","last_unstale":"2023-12-18T10:20:46.974671+0000","last_undegraded":"2023-12-18T10:20:46.974671+0000","last_fullsized":"2023-12-18T10:20:46.974671+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:53:23.769325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665228+0000","last_change":"2023-12-18T10:20:44.548267+0000","last_active":"2023-12-18T10:20:46.665228+0000","last_peered":"2023-12-18T10:20:46.665228+0000","last_clean":"2023-12-18T10:20:46.665228+0000","last_became_active":"2023-12-18T10:20:44.547627+0000","last_became_peered":"2023-12-18T10:20:44.547627+0000","last_unstale":"2023-12-18T10:20:46.665228+0000","last_undegraded":"2023-12-18T10:20:46.665228+0000","last_fullsized":"2023-12-18T10:20:46.665228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:36.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974791+0000","last_change":"2023-12-18T10:20:44.166174+0000","last_active":"2023-12-18T10:20:46.974791+0000","last_peered":"2023-12-18T10:20:46.974791+0000","last_clean":"2023-12-18T10:20:46.974791+0000","last_became_active":"2023-12-18T10:20:44.165054+0000","last_became_peered":"2023-12-18T10:20:44.165054+0000","last_unstale":"2023-12-18T10:20:46.974791+0000","last_undegraded":"2023-12-18T10:20:46.974791+0000","last_fullsized":"2023-12-18T10:20:46.974791+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:44:06.990219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533963+0000","last_change":"2023-12-18T10:20:44.553504+0000","last_active":"2023-12-18T10:20:45.533963+0000","last_peered":"2023-12-18T10:20:45.533963+0000","last_clean":"2023-12-18T10:20:45.533963+0000","last_became_active":"2023-12-18T10:20:44.553232+0000","last_became_peered":"2023-12-18T10:20:44.553232+0000","last_unstale":"2023-12-18T10:20:45.533963+0000","last_undegraded":"2023-12-18T10:20:45.533963+0000","last_fullsized":"2023-12-18T10:20:45.533963+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:56.149679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665294+0000","last_change":"2023-12-18T10:20:44.152396+0000","last_active":"2023-12-18T10:20:46.665294+0000","last_peered":"2023-12-18T10:20:46.665294+0000","last_clean":"2023-12-18T10:20:46.665294+0000","last_became_active":"2023-12-18T10:20:44.152118+0000","last_became_peered":"2023-12-18T10:20:44.152118+0000","last_unstale":"2023-12-18T10:20:46.665294+0000","last_undegraded":"2023-12-18T10:20:46.665294+0000","last_fullsized":"2023-12-18T10:20:46.665294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:34.913986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974549+0000","last_change":"2023-12-18T10:20:44.558747+0000","last_active":"2023-12-18T10:20:46.974549+0000","last_peered":"2023-12-18T10:20:46.974549+0000","last_clean":"2023-12-18T10:20:46.974549+0000","last_became_active":"2023-12-18T10:20:44.558132+0000","last_became_peered":"2023-12-18T10:20:44.558132+0000","last_unstale":"2023-12-18T10:20:46.974549+0000","last_undegraded":"2023-12-18T10:20:46.974549+0000","last_fullsized":"2023-12-18T10:20:46.974549+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:30.305994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973210+0000","last_change":"2023-12-18T10:20:44.157131+0000","last_active":"2023-12-18T10:20:46.973210+0000","last_peered":"2023-12-18T10:20:46.973210+0000","last_clean":"2023-12-18T10:20:46.973210+0000","last_became_active":"2023-12-18T10:20:44.155719+0000","last_became_peered":"2023-12-18T10:20:44.155719+0000","last_unstale":"2023-12-18T10:20:46.973210+0000","last_undegraded":"2023-12-18T10:20:46.973210+0000","last_fullsized":"2023-12-18T10:20:46.973210+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:06.923115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530230+0000","last_change":"2023-12-18T10:20:44.553001+0000","last_active":"2023-12-18T10:20:45.530230+0000","last_peered":"2023-12-18T10:20:45.530230+0000","last_clean":"2023-12-18T10:20:45.530230+0000","last_became_active":"2023-12-18T10:20:44.551969+0000","last_became_peered":"2023-12-18T10:20:44.551969+0000","last_unstale":"2023-12-18T10:20:45.530230+0000","last_undegraded":"2023-12-18T10:20:45.530230+0000","last_fullsized":"2023-12-18T10:20:45.530230+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:42:05.275947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529743+0000","last_change":"2023-12-18T10:20:44.168499+0000","last_active":"2023-12-18T10:20:45.529743+0000","last_peered":"2023-12-18T10:20:45.529743+0000","last_clean":"2023-12-18T10:20:45.529743+0000","last_became_active":"2023-12-18T10:20:44.168258+0000","last_became_peered":"2023-12-18T10:20:44.168258+0000","last_unstale":"2023-12-18T10:20:45.529743+0000","last_undegraded":"2023-12-18T10:20:45.529743+0000","last_fullsized":"2023-12-18T10:20:45.529743+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:18:35.611194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665415+0000","last_change":"2023-12-18T10:20:44.553780+0000","last_active":"2023-12-18T10:20:46.665415+0000","last_peered":"2023-12-18T10:20:46.665415+0000","last_clean":"2023-12-18T10:20:46.665415+0000","last_became_active":"2023-12-18T10:20:44.553492+0000","last_became_peered":"2023-12-18T10:20:44.553492+0000","last_unstale":"2023-12-18T10:20:46.665415+0000","last_undegraded":"2023-12-18T10:20:46.665415+0000","last_fullsized":"2023-12-18T10:20:46.665415+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:24:21.570784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.972778+0000","last_change":"2023-12-18T10:20:44.158923+0000","last_active":"2023-12-18T10:20:46.972778+0000","last_peered":"2023-12-18T10:20:46.972778+0000","last_clean":"2023-12-18T10:20:46.972778+0000","last_became_active":"2023-12-18T10:20:44.158643+0000","last_became_peered":"2023-12-18T10:20:44.158643+0000","last_unstale":"2023-12-18T10:20:46.972778+0000","last_undegraded":"2023-12-18T10:20:46.972778+0000","last_fullsized":"2023-12-18T10:20:46.972778+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:20:05.856413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.534016+0000","last_change":"2023-12-18T10:20:44.557128+0000","last_active":"2023-12-18T10:20:45.534016+0000","last_peered":"2023-12-18T10:20:45.534016+0000","last_clean":"2023-12-18T10:20:45.534016+0000","last_became_active":"2023-12-18T10:20:44.556447+0000","last_became_peered":"2023-12-18T10:20:44.556447+0000","last_unstale":"2023-12-18T10:20:45.534016+0000","last_undegraded":"2023-12-18T10:20:45.534016+0000","last_fullsized":"2023-12-18T10:20:45.534016+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:52.638493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974732+0000","last_change":"2023-12-18T10:20:44.168330+0000","last_active":"2023-12-18T10:20:46.974732+0000","last_peered":"2023-12-18T10:20:46.974732+0000","last_clean":"2023-12-18T10:20:46.974732+0000","last_became_active":"2023-12-18T10:20:44.167960+0000","last_became_peered":"2023-12-18T10:20:44.167960+0000","last_unstale":"2023-12-18T10:20:46.974732+0000","last_undegraded":"2023-12-18T10:20:46.974732+0000","last_fullsized":"2023-12-18T10:20:46.974732+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:17.767330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.665157+0000","last_change":"2023-12-18T10:20:44.549359+0000","last_active":"2023-12-18T10:20:46.665157+0000","last_peered":"2023-12-18T10:20:46.665157+0000","last_clean":"2023-12-18T10:20:46.665157+0000","last_became_active":"2023-12-18T10:20:44.549060+0000","last_became_peered":"2023-12-18T10:20:44.549060+0000","last_unstale":"2023-12-18T10:20:46.665157+0000","last_undegraded":"2023-12-18T10:20:46.665157+0000","last_fullsized":"2023-12-18T10:20:46.665157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:17.717007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.625785+0000","last_change":"2023-12-18T10:20:44.161537+0000","last_active":"2023-12-18T10:20:45.625785+0000","last_peered":"2023-12-18T10:20:45.625785+0000","last_clean":"2023-12-18T10:20:45.625785+0000","last_became_active":"2023-12-18T10:20:44.161261+0000","last_became_peered":"2023-12-18T10:20:44.161261+0000","last_unstale":"2023-12-18T10:20:45.625785+0000","last_undegraded":"2023-12-18T10:20:45.625785+0000","last_fullsized":"2023-12-18T10:20:45.625785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:08:34.913986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973211+0000","last_change":"2023-12-18T10:20:44.557727+0000","last_active":"2023-12-18T10:20:46.973211+0000","last_peered":"2023-12-18T10:20:46.973211+0000","last_clean":"2023-12-18T10:20:46.973211+0000","last_became_active":"2023-12-18T10:20:44.557468+0000","last_became_peered":"2023-12-18T10:20:44.557468+0000","last_unstale":"2023-12-18T10:20:46.973211+0000","last_undegraded":"2023-12-18T10:20:46.973211+0000","last_fullsized":"2023-12-18T10:20:46.973211+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:30:04.771313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530069+0000","last_change":"2023-12-18T10:20:44.163185+0000","last_active":"2023-12-18T10:20:45.530069+0000","last_peered":"2023-12-18T10:20:45.530069+0000","last_clean":"2023-12-18T10:20:45.530069+0000","last_became_active":"2023-12-18T10:20:44.162922+0000","last_became_peered":"2023-12-18T10:20:44.162922+0000","last_unstale":"2023-12-18T10:20:45.530069+0000","last_undegraded":"2023-12-18T10:20:45.530069+0000","last_fullsized":"2023-12-18T10:20:45.530069+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:15:49.482034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.529991+0000","last_change":"2023-12-18T10:20:44.568455+0000","last_active":"2023-12-18T10:20:45.529991+0000","last_peered":"2023-12-18T10:20:45.529991+0000","last_clean":"2023-12-18T10:20:45.529991+0000","last_became_active":"2023-12-18T10:20:44.568102+0000","last_became_peered":"2023-12-18T10:20:44.568102+0000","last_unstale":"2023-12-18T10:20:45.529991+0000","last_undegraded":"2023-12-18T10:20:45.529991+0000","last_fullsized":"2023-12-18T10:20:45.529991+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:28:24.655696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973294+0000","last_change":"2023-12-18T10:20:44.157348+0000","last_active":"2023-12-18T10:20:46.973294+0000","last_peered":"2023-12-18T10:20:46.973294+0000","last_clean":"2023-12-18T10:20:46.973294+0000","last_became_active":"2023-12-18T10:20:44.155951+0000","last_became_peered":"2023-12-18T10:20:44.155951+0000","last_unstale":"2023-12-18T10:20:46.973294+0000","last_undegraded":"2023-12-18T10:20:46.973294+0000","last_fullsized":"2023-12-18T10:20:46.973294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:34:26.271325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533827+0000","last_change":"2023-12-18T10:20:44.543651+0000","last_active":"2023-12-18T10:20:45.533827+0000","last_peered":"2023-12-18T10:20:45.533827+0000","last_clean":"2023-12-18T10:20:45.533827+0000","last_became_active":"2023-12-18T10:20:44.543355+0000","last_became_peered":"2023-12-18T10:20:44.543355+0000","last_unstale":"2023-12-18T10:20:45.533827+0000","last_undegraded":"2023-12-18T10:20:45.533827+0000","last_fullsized":"2023-12-18T10:20:45.533827+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:49:08.340522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973239+0000","last_change":"2023-12-18T10:20:44.158356+0000","last_active":"2023-12-18T10:20:46.973239+0000","last_peered":"2023-12-18T10:20:46.973239+0000","last_clean":"2023-12-18T10:20:46.973239+0000","last_became_active":"2023-12-18T10:20:44.158092+0000","last_became_peered":"2023-12-18T10:20:44.158092+0000","last_unstale":"2023-12-18T10:20:46.973239+0000","last_undegraded":"2023-12-18T10:20:46.973239+0000","last_fullsized":"2023-12-18T10:20:46.973239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:00.282517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530141+0000","last_change":"2023-12-18T10:20:44.540778+0000","last_active":"2023-12-18T10:20:45.530141+0000","last_peered":"2023-12-18T10:20:45.530141+0000","last_clean":"2023-12-18T10:20:45.530141+0000","last_became_active":"2023-12-18T10:20:44.540505+0000","last_became_peered":"2023-12-18T10:20:44.540505+0000","last_unstale":"2023-12-18T10:20:45.530141+0000","last_undegraded":"2023-12-18T10:20:45.530141+0000","last_fullsized":"2023-12-18T10:20:45.530141+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:31:51.447443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.007168+0000","last_change":"2023-12-18T10:20:44.161346+0000","last_active":"2023-12-18T10:20:46.007168+0000","last_peered":"2023-12-18T10:20:46.007168+0000","last_clean":"2023-12-18T10:20:46.007168+0000","last_became_active":"2023-12-18T10:20:44.160893+0000","last_became_peered":"2023-12-18T10:20:44.160893+0000","last_unstale":"2023-12-18T10:20:46.007168+0000","last_undegraded":"2023-12-18T10:20:46.007168+0000","last_fullsized":"2023-12-18T10:20:46.007168+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:02:06.923115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.973636+0000","last_change":"2023-12-18T10:20:44.550615+0000","last_active":"2023-12-18T10:20:46.973636+0000","last_peered":"2023-12-18T10:20:46.973636+0000","last_clean":"2023-12-18T10:20:46.973636+0000","last_became_active":"2023-12-18T10:20:44.550378+0000","last_became_peered":"2023-12-18T10:20:44.550378+0000","last_unstale":"2023-12-18T10:20:46.973636+0000","last_undegraded":"2023-12-18T10:20:46.973636+0000","last_fullsized":"2023-12-18T10:20:46.973636+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:27:23.893377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.533988+0000","last_change":"2023-12-18T10:20:44.169257+0000","last_active":"2023-12-18T10:20:45.533988+0000","last_peered":"2023-12-18T10:20:45.533988+0000","last_clean":"2023-12-18T10:20:45.533988+0000","last_became_active":"2023-12-18T10:20:44.168986+0000","last_became_peered":"2023-12-18T10:20:44.168986+0000","last_unstale":"2023-12-18T10:20:45.533988+0000","last_undegraded":"2023-12-18T10:20:45.533988+0000","last_fullsized":"2023-12-18T10:20:45.533988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:10:29.295023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:46.974499+0000","last_change":"2023-12-18T10:20:44.555391+0000","last_active":"2023-12-18T10:20:46.974499+0000","last_peered":"2023-12-18T10:20:46.974499+0000","last_clean":"2023-12-18T10:20:46.974499+0000","last_became_active":"2023-12-18T10:20:44.552659+0000","last_became_peered":"2023-12-18T10:20:44.552659+0000","last_unstale":"2023-12-18T10:20:46.974499+0000","last_undegraded":"2023-12-18T10:20:46.974499+0000","last_fullsized":"2023-12-18T10:20:46.974499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:44.134478+0000","last_clean_scrub_stamp":"2023-12-18T10:20:44.134478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:08:58.576387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-18T10:20:45.530308+0000","last_change":"2023-12-18T10:20:44.165658+0000","last_active":"2023-12-18T10:20:45.530308+0000","last_peered":"2023-12-18T10:20:45.530308+0000","last_clean":"2023-12-18T10:20:45.530308+0000","last_became_active":"2023-12-18T10:20:44.165389+0000","last_became_peered":"2023-12-18T10:20:44.165389+0000","last_unstale":"2023-12-18T10:20:45.530308+0000","last_undegraded":"2023-12-18T10:20:45.530308+0000","last_fullsized":"2023-12-18T10:20:45.530308+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:20:43.123507+0000","last_clean_scrub_stamp":"2023-12-18T10:20:43.123507+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:59.882047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":189,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-18T10:20:44.538185+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:20:44.538185+0000","last_peered":"2023-12-18T10:20:44.538185+0000","last_clean":"2023-12-18T10:20:44.538185+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:20:44.538185+0000","last_undegraded":"2023-12-18T10:20:44.538185+0000","last_fullsized":"2023-12-18T10:20:44.538185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1232896,"data_stored":871098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81000000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.47599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.78600000000000003,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.442}]},{"osd":1,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.88600000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.498,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84899999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.504},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69199999999999995,"15min":0.69999999999999996},"min":{"1min":0.49299999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61799999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.60499999999999998,"15min":0.61099999999999999},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84299999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.69099999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85699999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.67300000000000004,"15min":0.68799999999999994},"min":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76600000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67200000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.505,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.877,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":638976,"data_stored":281258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.84399999999999997,"15min":0.877},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88700000000000001,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.89000000000000001,"15min":0.92200000000000004},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93999999999999995,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.69499999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.55900000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.81899999999999995,"5min":1.845,"15min":1.845},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.86599999999999999,"15min":0.89600000000000002},"min":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.81200000000000006,"5min":4.524,"15min":4.524},"last":0.68899999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86499999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.497},"max":{"1min":0.873,"5min":1.925,"15min":1.925},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83999999999999997,"15min":0.85499999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91300000000000003,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.746},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.90300000000000002,"15min":0.92900000000000005},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85399999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.65700000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83999999999999997,"5min":1.054,"15min":1.054},"last":0.432},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91100000000000003,"5min":1.101,"15min":1.101},"last":0.41099999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":1.284,"15min":1.284},"last":0.501}]},{"osd":7,"last update":"Mon Dec 18 10:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.745,"15min":0.754},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88300000000000001,"5min":1.129,"15min":1.129},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84499999999999997,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":630784,"data_stored":280606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66500000000000004,"15min":0.67600000000000005},"min":{"1min":0.44900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.93999999999999995,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88400000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.75600000000000001,"15min":0.77600000000000002},"min":{"1min":0.44900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92000000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49099999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.48999999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.77800000000000002,"15min":0.79800000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.99399999999999999,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.51600000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91200000000000003,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.74099999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93500000000000005,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.83099999999999996,"15min":0.85299999999999998},"min":{"1min":0.51600000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0189999999999999,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.504}]},{"osd":4,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.98499999999999999,"15min":1.038},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94399999999999995,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0109999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.42499999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93200000000000005,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.82599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.042,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70099999999999996,"15min":0.70899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89900000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83699999999999997,"15min":0.85599999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98099999999999998,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.41099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":634880,"data_stored":281188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89500000000000002,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.131,"15min":1.131},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96299999999999997,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94699999999999995,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.51700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.92300000000000004,"5min":1.032,"15min":1.032},"last":0.53900000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.93700000000000006,"5min":0.999,"15min":0.999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.443},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.48499999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68999999999999995,"15min":0.69599999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90300000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91700000000000004,"5min":1.073,"15min":1.073},"last":0.69299999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93300000000000005,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.75900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":647168,"data_stored":282192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55900000000000005,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47699999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.54900000000000004,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.61899999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.497}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63100000000000001,"5min":1.254,"15min":1.254},"last":0.626},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.73999999999999999,"5min":1.772,"15min":1.772},"last":0.65800000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51000000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.98099999999999998,"5min":1.01,"15min":1.01},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.82399999999999995,"5min":1.181,"15min":1.181},"last":0.71999999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.81299999999999994,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71399999999999997,"15min":0.71799999999999997},"min":{"1min":0.53000000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.069},"last":0.76300000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.64000000000000001,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0629999999999999,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.85399999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96299999999999997,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94299999999999995,"5min":1.139,"15min":1.139},"last":0.78300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":643072,"data_stored":282170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.436,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.56799999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.501,"15min":0.51300000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69599999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.35399999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.623,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.65100000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48899999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56599999999999995,"15min":0.57599999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93100000000000005,"5min":1.698,"15min":1.698},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94399999999999995,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.96099999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0680000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.753}]},{"osd":6,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.56200000000000006,"5min":0.499,"15min":0.499},"max":{"1min":0.997,"5min":1.341,"15min":1.341},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.91900000000000004,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.86499999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:19:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.78300000000000003,"15min":0.80000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.032,"5min":1.282,"15min":1.282},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.58799999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98199999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.82199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":638976,"data_stored":280766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.61099999999999999,"15min":0.63900000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.7150000000000001,"5min":3.976,"15min":3.976},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.52000000000000002,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.34300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":3.2370000000000001,"5min":3.786,"15min":3.786},"last":0.375},{"interface":"front","average":{"1min":0.5,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.68000000000000005,"15min":0.70199999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":2.1589999999999998,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.9399999999999999,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.39600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81000000000000005,"15min":0.82199999999999995},"min":{"1min":0.52900000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7889999999999999,"5min":1.851,"15min":1.851},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.92700000000000005,"15min":0.96099999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6539999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.90800000000000003,"15min":0.93600000000000005},"min":{"1min":0.54400000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.6100000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.82499999999999996,"15min":0.83699999999999997},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.823,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.94099999999999995,"15min":0.97399999999999998},"min":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6850000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.71799999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.57699999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.745},{"interface":"front","average":{"1min":0.752,"5min":0.83099999999999996,"15min":0.84399999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8799999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.66100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1232896,"data_stored":871030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.49099999999999999,"15min":0.501},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.66700000000000004,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.54100000000000004,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.59499999999999997,"5min":1.456,"15min":1.456},"last":0.40300000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.54700000000000004,"15min":0.56499999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71599999999999997,"5min":1.595,"15min":1.595},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.58299999999999996,"15min":0.60899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.624,"5min":2.464,"15min":2.464},"last":0.45500000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84599999999999997,"5min":1.859,"15min":1.859},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.63,"15min":0.64600000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79500000000000004,"5min":1.903,"15min":1.903},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.94699999999999995,"5min":1.494,"15min":1.494},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.56200000000000006,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95599999999999996,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.93600000000000005,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94499999999999995,"5min":1.544,"15min":1.544},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80200000000000005,"15min":0.82099999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93200000000000005,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.89000000000000001,"5min":1.53,"15min":1.53},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:19:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.79200000000000004,"15min":0.81000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.81299999999999994,"5min":1.556,"15min":1.556},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.77700000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90000000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:20:53.457 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-18T10:20:53.458 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-18T10:20:53.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.631+0000 7fb4c2bce640 1 Processor -- start 2023-12-18T10:20:53.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.631+0000 7fb4c2bce640 1 -- start start 2023-12-18T10:20:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c2bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c2bce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4bc15e4f0 0x7fb4bc0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c2bce640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc155410 con 0x7fb4bc0ccd60 2023-12-18T10:20:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c2bce640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc070bf0 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c2bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc15ea60 con 0x7fb4bc0702d0 2023-12-18T10:20:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4bc15e4f0 0x7fb4bc0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c116b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb4bc0ccd60 0x7fb4bc15b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50820/0 (socket says 172.21.15.133:50820) 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4bc15e4f0 0x7fb4bc0cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60908/0 (socket says 172.21.15.133:60908) 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c116b640 1 -- 172.21.15.133:0/1854003016 learned_addr learned my addr 172.21.15.133:0/1854003016 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c096a640 1 --2- 172.21.15.133:0/1854003016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bbfff640 1 -- 172.21.15.133:0/1854003016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 msgr2=0x7fb4bc0706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bbfff640 1 --2- 172.21.15.133:0/1854003016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc0706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bbfff640 1 -- 172.21.15.133:0/1854003016 >> v1:172.21.15.133:6789/0 conn(0x7fb4bc0ccd60 legacy=0x7fb4bc15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bbfff640 1 -- 172.21.15.133:0/1854003016 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc15ed40 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4c096a640 1 --2- 172.21.15.133:0/1854003016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc0706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:53.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bb7fe640 1 -- 172.21.15.133:0/1854003016 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362002766 0 0) 0x7fb4bc155410 con 0x7fb4bc0ccd60 2023-12-18T10:20:53.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bbfff640 1 --2- 172.21.15.133:0/1854003016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0cc820 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80097c0 tx=0x7fb4a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb388c9b0e4fc9a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:53.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.635+0000 7fb4bb7fe640 1 -- 172.21.15.133:0/1854003016 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80ab650 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4bb7fe640 1 -- 172.21.15.133:0/1854003016 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a80ab7b0 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4bb7fe640 1 -- 172.21.15.133:0/1854003016 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80abb40 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- 172.21.15.133:0/1854003016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 msgr2=0x7fb4bc0cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/1854003016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0cc820 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80097c0 tx=0x7fb4a801c450 comp rx=0 tx=0).stop 2023-12-18T10:20:53.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- 172.21.15.133:0/1854003016 shutdown_connections 2023-12-18T10:20:53.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/1854003016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0cc820 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/1854003016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc0706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- 172.21.15.133:0/1854003016 >> 172.21.15.133:0/1854003016 conn(0x7fb4bc0ce450 msgr2=0x7fb4bc0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:53.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- 172.21.15.133:0/1854003016 shutdown_connections 2023-12-18T10:20:53.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- 172.21.15.133:0/1854003016 wait complete. 2023-12-18T10:20:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 Processor -- start 2023-12-18T10:20:53.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- start start 2023-12-18T10:20:53.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0ccd60 0x7fb4bc14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc153e00 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc154d50 con 0x7fb4bc0ccd60 2023-12-18T10:20:53.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c2bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc14a970 con 0x7fb4bc0702d0 2023-12-18T10:20:53.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c116b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c116b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60914/0 (socket says 172.21.15.133:60914) 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4c116b640 1 -- 172.21.15.133:0/2122631642 learned_addr learned my addr 172.21.15.133:0/2122631642 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c096a640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.639+0000 7fb4bbfff640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0ccd60 0x7fb4bc14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c116b640 1 -- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 msgr2=0x7fb4bc154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c116b640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c116b640 1 -- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0ccd60 msgr2=0x7fb4bc14a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c116b640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0ccd60 0x7fb4bc14a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c116b640 1 -- 172.21.15.133:0/2122631642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8009420 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c096a640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4bbfff640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0ccd60 0x7fb4bc14a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:53.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c116b640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0b3410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c780 tx=0x7fb4b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:53.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4b97fa640 1 -- 172.21.15.133:0/2122631642 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400ce90 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4b97fa640 1 -- 172.21.15.133:0/2122631642 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400a5e0 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc0b3950 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4b97fa640 1 -- 172.21.15.133:0/2122631642 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400a970 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc0b3ed0 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc04e000 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4b97fa640 1 -- 172.21.15.133:0/2122631642 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb4b400aad0 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4b97fa640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb4a0065a60 0x7fb4a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4b97fa640 1 -- 172.21.15.133:0/2122631642 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb4b4082b30 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.643+0000 7fb4c096a640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb4a0065a60 0x7fb4a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:53.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.647+0000 7fb4c096a640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb4a0065a60 0x7fb4a0067f20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000b990 tx=0x7fb4b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:53.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.647+0000 7fb4b97fa640 1 -- 172.21.15.133:0/2122631642 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb4b4050310 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.851+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb4bc06d6d0 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4b97fa640 1 -- 172.21.15.133:0/2122631642 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb4b40180e0 con 0x7fb4bc15e4f0 2023-12-18T10:20:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-18T10:20:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb4a0065a60 msgr2=0x7fb4a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb4a0065a60 0x7fb4a0067f20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000b990 tx=0x7fb4b0008040 comp rx=0 tx=0).stop 2023-12-18T10:20:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 msgr2=0x7fb4bc0b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0b3410 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400c780 tx=0x7fb4b400cc40 comp rx=0 tx=0).stop 2023-12-18T10:20:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 shutdown_connections 2023-12-18T10:20:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb4a0065a60 0x7fb4a0067f20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4bc15e4f0 0x7fb4bc0b3410 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb4bc0ccd60 0x7fb4bc14a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 --2- 172.21.15.133:0/2122631642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb4bc0702d0 0x7fb4bc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 >> 172.21.15.133:0/2122631642 conn(0x7fb4bc0ce450 msgr2=0x7fb4bc0af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 shutdown_connections 2023-12-18T10:20:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:53.859+0000 7fb4c2bce640 1 -- 172.21.15.133:0/2122631642 wait complete. 2023-12-18T10:20:53.883 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:54.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.015+0000 7feaa4509640 1 Processor -- start 2023-12-18T10:20:54.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.015+0000 7feaa4509640 1 -- start start 2023-12-18T10:20:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa4509640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea9c0cac10 0x7fea9c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa4509640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea9c06fdb0 0x7fea9c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa4509640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c15f100 con 0x7fea9c15a680 2023-12-18T10:20:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa4509640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c070780 con 0x7fea9c0cac10 2023-12-18T10:20:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa4509640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ca7d0 con 0x7fea9c06fdb0 2023-12-18T10:20:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa22a5640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fea9c15a680 0x7fea9c15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50826/0 (socket says 172.21.15.133:50826) 2023-12-18T10:20:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa22a5640 1 -- 172.21.15.133:0/4029282945 learned_addr learned my addr 172.21.15.133:0/4029282945 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa1aa4640 1 --2- 172.21.15.133:0/4029282945 >> v2:172.21.15.142:3300/0 conn(0x7fea9c0cac10 0x7fea9c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa2aa6640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea9c06fdb0 0x7fea9c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378977216 0 0) 0x7fea9c15f100 con 0x7fea9c15a680 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea88003530 con 0x7fea9c15a680 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4036833921 0 0) 0x7fea88003530 con 0x7fea9c15a680 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea9c06fdb0 msgr2=0x7fea9c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea9c06fdb0 0x7fea9c070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 >> v2:172.21.15.142:3300/0 conn(0x7fea9c0cac10 msgr2=0x7fea9c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 --2- 172.21.15.133:0/4029282945 >> v2:172.21.15.142:3300/0 conn(0x7fea9c0cac10 0x7fea9c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c15e860 con 0x7fea9c15a680 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fea98001680 con 0x7fea9c15a680 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 >> v1:172.21.15.133:6789/0 conn(0x7fea9c15a680 legacy=0x7fea9c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea88003980 0x7fea88003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea9c06fdb0 0x7fea880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea88004d10 0x7fea88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c070780 con 0x7fea88004d10 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0ca7d0 con 0x7fea88003980 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8800b9c0 con 0x7fea9c06fdb0 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa2aa6640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea88004d10 0x7fea88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa22a5640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea88003980 0x7fea88003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa1aa4640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea9c06fdb0 0x7fea880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa2aa6640 1 -- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea9c06fdb0 msgr2=0x7fea880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa2aa6640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea9c06fdb0 0x7fea880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa2aa6640 1 -- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea88003980 msgr2=0x7fea88003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa2aa6640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea88003980 0x7fea88003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.019+0000 7feaa2aa6640 1 -- 172.21.15.133:0/4029282945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88003530 con 0x7fea88004d10 2023-12-18T10:20:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa2aa6640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea88004d10 0x7fea88005190 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fea94009fc0 tx=0x7fea9401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f387130903cce789 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940a5c70 con 0x7fea88004d10 2023-12-18T10:20:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400f040 con 0x7fea88004d10 2023-12-18T10:20:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa12a3640 1 -- 172.21.15.133:0/4029282945 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940ad440 con 0x7fea88004d10 2023-12-18T10:20:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa4509640 1 -- 172.21.15.133:0/4029282945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea88004d10 msgr2=0x7fea88005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa4509640 1 --2- 172.21.15.133:0/4029282945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea88004d10 0x7fea88005190 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fea94009fc0 tx=0x7fea9401cc60 comp rx=0 tx=0).stop 2023-12-18T10:20:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa2aa6640 1 -- 172.21.15.133:0/4029282945 reap_dead start 2023-12-18T10:20:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa4509640 1 -- 172.21.15.133:0/4029282945 shutdown_connections 2023-12-18T10:20:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa4509640 1 -- 172.21.15.133:0/4029282945 >> 172.21.15.133:0/4029282945 conn(0x7fea9c06a3e0 msgr2=0x7fea9c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa4509640 1 -- 172.21.15.133:0/4029282945 shutdown_connections 2023-12-18T10:20:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa4509640 1 -- 172.21.15.133:0/4029282945 wait complete. 2023-12-18T10:20:54.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.023+0000 7feaa4509640 1 Processor -- start 2023-12-18T10:20:54.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 -- start start 2023-12-18T10:20:54.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea88004d10 0x7fea9c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea9c0ac220 0x7fea9c1f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea9c1f2400 0x7fea9c0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1f2ef0 con 0x7fea9c1f2400 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0c82b0 con 0x7fea9c0ac220 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1f2930 con 0x7fea88004d10 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea9c1f2400 0x7fea9c0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea9c1f2400 0x7fea9c0c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60940/0 (socket says 172.21.15.133:60940) 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 -- 172.21.15.133:0/1775614146 learned_addr learned my addr 172.21.15.133:0/1775614146 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa22a5640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea88004d10 0x7fea9c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa1aa4640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea9c0ac220 0x7fea9c1f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 -- 172.21.15.133:0/1775614146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea88004d10 msgr2=0x7fea9c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea88004d10 0x7fea9c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 -- 172.21.15.133:0/1775614146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea9c0ac220 msgr2=0x7fea9c1f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea9c0ac220 0x7fea9c1f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 -- 172.21.15.133:0/1775614146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c1f2c10 con 0x7fea9c1f2400 2023-12-18T10:20:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa2aa6640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea9c1f2400 0x7fea9c0c9180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fea940b0040 tx=0x7fea94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7fea92ffd640 1 -- 172.21.15.133:0/1775614146 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940ba070 con 0x7fea9c1f2400 2023-12-18T10:20:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7fea92ffd640 1 -- 172.21.15.133:0/1775614146 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea940039a0 con 0x7fea9c1f2400 2023-12-18T10:20:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7fea92ffd640 1 -- 172.21.15.133:0/1775614146 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94003b30 con 0x7fea9c1f2400 2023-12-18T10:20:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c0aba20 con 0x7fea9c1f2400 2023-12-18T10:20:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c0ad340 con 0x7fea9c1f2400 2023-12-18T10:20:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.027+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c0735b0 con 0x7fea9c1f2400 2023-12-18T10:20:54.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.031+0000 7fea92ffd640 1 -- 172.21.15.133:0/1775614146 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea940b4040 con 0x7fea9c1f2400 2023-12-18T10:20:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.031+0000 7fea92ffd640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea80065a90 0x7fea80067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.031+0000 7fea92ffd640 1 -- 172.21.15.133:0/1775614146 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fea9411ccb0 con 0x7fea9c1f2400 2023-12-18T10:20:54.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.031+0000 7feaa22a5640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea80065a90 0x7fea80067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.031+0000 7feaa22a5640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea80065a90 0x7fea80067f50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fea98000c10 tx=0x7fea98007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.035+0000 7fea92ffd640 1 -- 172.21.15.133:0/1775614146 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fea940ea660 con 0x7fea9c1f2400 2023-12-18T10:20:54.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.215+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea9c04e000 con 0x7fea9c1f2400 2023-12-18T10:20:54.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.215+0000 7fea92ffd640 1 -- 172.21.15.133:0/1775614146 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fea940edc80 con 0x7fea9c1f2400 2023-12-18T10:20:54.222 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:54.222 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6162,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:20:47.529769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:20:54.222 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 32 2023-12-18T10:20:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea80065a90 msgr2=0x7fea80067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea80065a90 0x7fea80067f50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fea98000c10 tx=0x7fea98007900 comp rx=0 tx=0).stop 2023-12-18T10:20:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea9c1f2400 msgr2=0x7fea9c0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea9c1f2400 0x7fea9c0c9180 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fea940b0040 tx=0x7fea94009750 comp rx=0 tx=0).stop 2023-12-18T10:20:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 shutdown_connections 2023-12-18T10:20:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea80065a90 0x7fea80067f50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea9c1f2400 0x7fea9c0c9180 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea9c0ac220 0x7fea9c1f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 --2- 172.21.15.133:0/1775614146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea88004d10 0x7fea9c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 >> 172.21.15.133:0/1775614146 conn(0x7fea9c06a3e0 msgr2=0x7fea9c0ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 shutdown_connections 2023-12-18T10:20:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.219+0000 7feaa4509640 1 -- 172.21.15.133:0/1775614146 wait complete. 2023-12-18T10:20:54.645 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:20:44.522180+0000', 'modified': '2023-12-18T10:20:47.529769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6165}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6165': {'gid': 6165, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1554379121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 1554379121}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1554379121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:20:54.646 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-18T10:20:54.646 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-18T10:20:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61ca48c640 1 Processor -- start 2023-12-18T10:20:54.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61ca48c640 1 -- start start 2023-12-18T10:20:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61ca48c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c415a680 0x7f61c415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61ca48c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c415f100 con 0x7f61c40cac10 2023-12-18T10:20:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61ca48c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c40ca7d0 con 0x7f61c406fdb0 2023-12-18T10:20:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61ca48c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c415e860 con 0x7f61c415a680 2023-12-18T10:20:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c37fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f61c40cac10 0x7f61c415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50840/0 (socket says 172.21.15.133:50840) 2023-12-18T10:20:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c37fe640 1 -- 172.21.15.133:0/2490106471 learned_addr learned my addr 172.21.15.133:0/2490106471 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c3fff640 1 --2- 172.21.15.133:0/2490106471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c415a680 0x7f61c415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c2ffd640 1 -- 172.21.15.133:0/2490106471 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865015866 0 0) 0x7f61c415f100 con 0x7f61c40cac10 2023-12-18T10:20:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c2ffd640 1 -- 172.21.15.133:0/2490106471 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61ac003530 con 0x7f61c40cac10 2023-12-18T10:20:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c2ffd640 1 -- 172.21.15.133:0/2490106471 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610857274 0 0) 0x7f61c40ca7d0 con 0x7f61c406fdb0 2023-12-18T10:20:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c2ffd640 1 -- 172.21.15.133:0/2490106471 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c415f100 con 0x7f61c406fdb0 2023-12-18T10:20:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c3fff640 1 -- 172.21.15.133:0/2490106471 >> v1:172.21.15.142:6789/0 conn(0x7f61c406fdb0 legacy=0x7f61c40c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c3fff640 1 -- 172.21.15.133:0/2490106471 >> v1:172.21.15.133:6789/0 conn(0x7f61c40cac10 legacy=0x7f61c415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c2ffd640 1 -- 172.21.15.133:0/2490106471 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 461701235 0 0) 0x7f61ac003530 con 0x7f61c40cac10 2023-12-18T10:20:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.783+0000 7f61c3fff640 1 -- 172.21.15.133:0/2490106471 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c415eb40 con 0x7f61c415a680 2023-12-18T10:20:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61c3fff640 1 --2- 172.21.15.133:0/2490106471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c415a680 0x7f61c415e160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61b40097f0 tx=0x7f61b401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5645387adbeaa3a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61c2ffd640 1 -- 172.21.15.133:0/2490106471 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8001680 con 0x7f61c415a680 2023-12-18T10:20:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61c2ffd640 1 -- 172.21.15.133:0/2490106471 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b40a7050 con 0x7f61c415a680 2023-12-18T10:20:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61c2ffd640 1 -- 172.21.15.133:0/2490106471 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b40ab620 con 0x7f61c415a680 2023-12-18T10:20:54.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61ca48c640 1 -- 172.21.15.133:0/2490106471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c415a680 msgr2=0x7f61c415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61ca48c640 1 --2- 172.21.15.133:0/2490106471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c415a680 0x7f61c415e160 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61b40097f0 tx=0x7f61b401c350 comp rx=0 tx=0).stop 2023-12-18T10:20:54.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61ca48c640 1 -- 172.21.15.133:0/2490106471 shutdown_connections 2023-12-18T10:20:54.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61ca48c640 1 --2- 172.21.15.133:0/2490106471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c415a680 0x7f61c415e160 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61ca48c640 1 -- 172.21.15.133:0/2490106471 >> 172.21.15.133:0/2490106471 conn(0x7f61c406a3e0 msgr2=0x7f61c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61ca48c640 1 -- 172.21.15.133:0/2490106471 shutdown_connections 2023-12-18T10:20:54.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.787+0000 7f61ca48c640 1 -- 172.21.15.133:0/2490106471 wait complete. 2023-12-18T10:20:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 Processor -- start 2023-12-18T10:20:54.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 -- start start 2023-12-18T10:20:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c406fdb0 0x7f61c40c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c40cac10 0x7f61c4154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c415a680 0x7f61c41546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c4156dd0 con 0x7f61c40cac10 2023-12-18T10:20:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c41564c0 con 0x7f61c415a680 2023-12-18T10:20:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40c3900 con 0x7f61c406fdb0 2023-12-18T10:20:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c40cac10 0x7f61c4154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c40cac10 0x7f61c4154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60956/0 (socket says 172.21.15.133:60956) 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 -- 172.21.15.133:0/3905272378 learned_addr learned my addr 172.21.15.133:0/3905272378 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c3fff640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c406fdb0 0x7f61c40c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c8a29640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c415a680 0x7f61c41546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 -- 172.21.15.133:0/3905272378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c406fdb0 msgr2=0x7f61c40c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c406fdb0 0x7f61c40c12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 -- 172.21.15.133:0/3905272378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c415a680 msgr2=0x7f61c41546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c415a680 0x7f61c41546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 -- 172.21.15.133:0/3905272378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009420 con 0x7f61c40cac10 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c37fe640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c40cac10 0x7f61c4154180 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c750 tx=0x7f61b800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c0ff9640 1 -- 172.21.15.133:0/3905272378 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8005ae0 con 0x7f61c40cac10 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c0ff9640 1 -- 172.21.15.133:0/3905272378 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8005c40 con 0x7f61c40cac10 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61c0ff9640 1 -- 172.21.15.133:0/3905272378 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8007070 con 0x7f61c40cac10 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 -- 172.21.15.133:0/3905272378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c4070750 con 0x7f61c40cac10 2023-12-18T10:20:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.791+0000 7f61ca48c640 1 -- 172.21.15.133:0/3905272378 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c4156a60 con 0x7f61c40cac10 2023-12-18T10:20:54.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.795+0000 7f61c0ff9640 1 -- 172.21.15.133:0/3905272378 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f61b80071d0 con 0x7f61c40cac10 2023-12-18T10:20:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.795+0000 7f61c0ff9640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f61b0065a60 0x7f61b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.795+0000 7f61c0ff9640 1 -- 172.21.15.133:0/3905272378 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f61b8082f10 con 0x7f61c40cac10 2023-12-18T10:20:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.795+0000 7f61c3fff640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f61b0065a60 0x7f61b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.795+0000 7f61cd7f5000 1 Processor -- start 2023-12-18T10:20:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.795+0000 7f61cd7f5000 1 -- start start 2023-12-18T10:20:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.795+0000 7f61c3fff640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f61b0065a60 0x7f61b0067f20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f61b40ad000 tx=0x7f61b40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92ab46070 0x55c92ab46450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92aafbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92aafc1c0 0x55c92aafc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92a91fc90 con 0x55c92aafc1c0 2023-12-18T10:20:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92a951220 con 0x55c92ab46990 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c92a94e7f0 con 0x55c92ab46070 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92aafc1c0 0x55c92aafc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92aafc1c0 0x55c92aafc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60964/0 (socket says 172.21.15.133:60964) 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 -- 172.21.15.133:0/2159647643 learned_addr learned my addr 172.21.15.133:0/2159647643 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c3fff640 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92ab46070 0x55c92ab46450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c37fe640 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92aafbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 -- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92ab46070 msgr2=0x55c92ab46450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92ab46070 0x55c92ab46450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 -- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 msgr2=0x55c92aafbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92aafbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 -- 172.21.15.133:0/2159647643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c92a646890 con 0x55c92aafc1c0 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c37fe640 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92aafbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61c8a29640 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92aafc1c0 0x55c92aafc5a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f61bc001d00 tx=0x7f61bc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55803cc15629f2bc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61a9ffb640 1 -- 172.21.15.133:0/2159647643 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc003b90 con 0x55c92aafc1c0 2023-12-18T10:20:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61a9ffb640 1 -- 172.21.15.133:0/2159647643 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc003cf0 con 0x55c92aafc1c0 2023-12-18T10:20:54.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61a9ffb640 1 -- 172.21.15.133:0/2159647643 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00fb70 con 0x55c92aafc1c0 2023-12-18T10:20:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- 172.21.15.133:0/2159647643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92aafc1c0 msgr2=0x55c92aafc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92aafc1c0 0x55c92aafc5a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f61bc001d00 tx=0x7f61bc001640 comp rx=0 tx=0).stop 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- 172.21.15.133:0/2159647643 shutdown_connections 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92aafc1c0 0x55c92aafc5a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92aafbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/2159647643 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92ab46070 0x55c92ab46450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- 172.21.15.133:0/2159647643 >> 172.21.15.133:0/2159647643 conn(0x55c92ab02950 msgr2=0x55c92aafa560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- 172.21.15.133:0/2159647643 shutdown_connections 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- 172.21.15.133:0/2159647643 wait complete. 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 -- start start 2023-12-18T10:20:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.799+0000 7f61cd7f5000 1 Processor -- start 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab01720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92ab08080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92a94a0e0 con 0x55c92ab46070 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92a8e9310 con 0x55c92ab46990 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c92a907770 con 0x55c92aafc1c0 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 10 client.0 _ll_register_callbacks cb 0x55c92aae7b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92ab08080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92ab08080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60976/0 (socket says 172.21.15.133:60976) 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 -- 172.21.15.133:0/3351590343 learned_addr learned my addr 172.21.15.133:0/3351590343 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c3fff640 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab01720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c8a29640 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 -- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 msgr2=0x55c92ab01720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab01720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 -- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 msgr2=0x55c92ab085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 -- 172.21.15.133:0/3351590343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c415f100 con 0x55c92ab46070 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c3fff640 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab01720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c37fe640 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92ab08080 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f61b8081200 tx=0x7f61b805c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1f78994fd1d69c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 1 -- 172.21.15.133:0/3351590343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b805a2c0 con 0x55c92ab46070 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 1 -- 172.21.15.133:0/3351590343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f61b807dbf0 con 0x55c92ab46070 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3351590343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c92a919c10 con 0x55c92ab46070 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 1 -- 172.21.15.133:0/3351590343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61b807ddb0 con 0x55c92ab46070 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 10 client.6324 fetch_fsmap learned FSMap version 32 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3351590343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55c92a90f260 con 0x55c92ab46070 2023-12-18T10:20:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 1 -- 172.21.15.133:0/3351590343 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b806f070 con 0x55c92ab46070 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 1 -- 172.21.15.133:0/3351590343 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f61b8019020 con 0x55c92ab46070 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 10 client.6324 fetch_fsmap finished waiting for FSMap version 32 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 10 client.6324 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 20 client.6324 populate_metadata read hostname 'smithi133' 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55c92ab4d8d0 0x55c92ab4dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 4 client.6324 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3351590343 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c92a948a30 con 0x55c92ab4d8d0 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c3fff640 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55c92ab4d8d0 0x55c92ab4dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61c3fff640 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55c92ab4d8d0 0x55c92ab4dcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a36ad7af69439a66 server_cookie=3e8d6f1274b9564f in_seq=0 out_seq=0 2023-12-18T10:20:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 10 client.6324 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:20:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 1 -- 172.21.15.133:0/3351590343 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c92a948a30 con 0x55c92ab4d8d0 2023-12-18T10:20:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 10 client.6324 handle_command_reply: tid=0 2023-12-18T10:20:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 client.6324 shutdown 2023-12-18T10:20:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3351590343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 msgr2=0x55c92ab08080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92ab08080 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f61b8081200 tx=0x7f61b805c390 comp rx=0 tx=0).stop 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3351590343 shutdown_connections 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55c92ab4d8d0 0x55c92ab4dcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92ab08080 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3351590343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab01720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3351590343 >> 172.21.15.133:0/3351590343 conn(0x55c92ab02950 msgr2=0x55c92aafac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.803+0000 7f61a2ffd640 0 client.6324 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.807+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3351590343 shutdown_connections 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.807+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3351590343 wait complete. 2023-12-18T10:20:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.807+0000 7f61cd7f5000 20 client.6324 trim_cache size 0 max 16384 2023-12-18T10:20:54.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61cd7f5000 1 Processor -- start 2023-12-18T10:20:54.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61cd7f5000 1 -- start start 2023-12-18T10:20:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab9e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46070 0x55c92ab9e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46990 0x55c92ab9ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92a607940 con 0x55c92ab46990 2023-12-18T10:20:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92a8ef770 con 0x55c92ab46070 2023-12-18T10:20:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c92a8ef570 con 0x55c92aafc1c0 2023-12-18T10:20:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61c8a29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46990 0x55c92ab9ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61c8a29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46990 0x55c92ab9ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60986/0 (socket says 172.21.15.133:60986) 2023-12-18T10:20:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.819+0000 7f61c8a29640 1 -- 172.21.15.133:0/3171975690 learned_addr learned my addr 172.21.15.133:0/3171975690 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c37fe640 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46070 0x55c92ab9e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c3fff640 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab9e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c8a29640 1 -- 172.21.15.133:0/3171975690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 msgr2=0x55c92ab9e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c8a29640 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab9e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c8a29640 1 -- 172.21.15.133:0/3171975690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46070 msgr2=0x55c92ab9e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c8a29640 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46070 0x55c92ab9e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c8a29640 1 -- 172.21.15.133:0/3171975690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c92a8f53b0 con 0x55c92ab46990 2023-12-18T10:20:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c8a29640 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46990 0x55c92ab9ed70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f61bc007cb0 tx=0x7f61bc00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613b952a988f89c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61aa7fc640 1 -- 172.21.15.133:0/3171975690 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc007d70 con 0x55c92ab46990 2023-12-18T10:20:54.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61aa7fc640 1 -- 172.21.15.133:0/3171975690 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc003db0 con 0x55c92ab46990 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61aa7fc640 1 -- 172.21.15.133:0/3171975690 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00fb70 con 0x55c92ab46990 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3171975690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46990 msgr2=0x55c92ab9ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46990 0x55c92ab9ed70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f61bc007cb0 tx=0x7f61bc00a000 comp rx=0 tx=0).stop 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3171975690 shutdown_connections 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46990 0x55c92ab9ed70 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46070 0x55c92ab9e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/3171975690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92ab9e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3171975690 >> 172.21.15.133:0/3171975690 conn(0x55c92ab02950 msgr2=0x55c92ab07f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3171975690 shutdown_connections 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- 172.21.15.133:0/3171975690 wait complete. 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- start start 2023-12-18T10:20:54.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 Processor -- start 2023-12-18T10:20:54.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92aba3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92aba3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92a94cc40 con 0x55c92ab46070 2023-12-18T10:20:54.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92ab01770 con 0x55c92ab46990 2023-12-18T10:20:54.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c92aa1ab30 con 0x55c92aafc1c0 2023-12-18T10:20:54.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61cd7f5000 10 client.0 _ll_register_callbacks cb 0x55c92a8f8640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92aba3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92aba3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60992/0 (socket says 172.21.15.133:60992) 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.823+0000 7f61c37fe640 1 -- 172.21.15.133:0/4231502432 learned_addr learned my addr 172.21.15.133:0/4231502432 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c8a29640 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c3fff640 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92aba3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c37fe640 1 -- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 msgr2=0x55c92aba3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c37fe640 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92aba3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c37fe640 1 -- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 msgr2=0x55c92ab86f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c37fe640 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab86f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c37fe640 1 -- 172.21.15.133:0/4231502432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c92a646890 con 0x55c92ab46070 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c8a29640 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c37fe640 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92aba3e80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f61b800a430 tx=0x7f61b8081130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96ecb48cc0fe980 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:20:54.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 1 -- 172.21.15.133:0/4231502432 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b805c1d0 con 0x55c92ab46070 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 1 -- 172.21.15.133:0/4231502432 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f61b805a2d0 con 0x55c92ab46070 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 -- 172.21.15.133:0/4231502432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c92a90fe00 con 0x55c92ab46070 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 1 -- 172.21.15.133:0/4231502432 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61b8054460 con 0x55c92ab46070 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 10 client.6330 fetch_fsmap learned FSMap version 32 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 -- 172.21.15.133:0/4231502432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55c92a646cc0 con 0x55c92ab46070 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 1 -- 172.21.15.133:0/4231502432 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c92a90fe00 con 0x55c92ab46070 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 1 -- 172.21.15.133:0/4231502432 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f61b8019070 con 0x55c92ab46070 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 10 client.6330 fetch_fsmap finished waiting for FSMap version 32 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 10 client.6330 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 20 client.6330 populate_metadata read hostname 'smithi133' 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55c92ab874b0 0x55c92ab87890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 4 client.6330 mds_command: new command op to 6165 tid=0[{"prefix": "status"}] 2023-12-18T10:20:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 -- 172.21.15.133:0/4231502432 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c92a943160 con 0x55c92ab874b0 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c3fff640 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55c92ab874b0 0x55c92ab87890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 10 client.6330 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61c3fff640 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55c92ab874b0 0x55c92ab87890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d211159777081f6 server_cookie=32b897821ee408e7 in_seq=0 out_seq=0 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 1 -- 172.21.15.133:0/4231502432 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55c92a943160 con 0x55c92ab874b0 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 10 client.6330 handle_command_reply: tid=0 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 client.6330 shutdown 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 -- 172.21.15.133:0/4231502432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 msgr2=0x55c92aba3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92aba3e80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f61b800a430 tx=0x7f61b8081130 comp rx=0 tx=0).stop 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 -- 172.21.15.133:0/4231502432 shutdown_connections 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55c92ab874b0 0x55c92ab87890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c92ab46990 0x55c92ab86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c92ab46070 0x55c92aba3e80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61a2ffd640 0 client.6330 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 --2- 172.21.15.133:0/4231502432 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c92aafc1c0 0x55c92aba3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 -- 172.21.15.133:0/4231502432 >> 172.21.15.133:0/4231502432 conn(0x55c92ab02950 msgr2=0x55c92ab43030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 -- 172.21.15.133:0/4231502432 shutdown_connections 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 1 -- 172.21.15.133:0/4231502432 wait complete. 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61cd7f5000 20 client.6330 trim_cache size 0 max 16384 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6165, 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:20:54.837 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:20:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 10.306695265, 2023-12-18T10:20:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 32, 2023-12-18T10:20:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 53, 2023-12-18T10:20:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 53, 2023-12-18T10:20:54.838 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 14.754128795 2023-12-18T10:20:54.838 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 -- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f61b0065a60 msgr2=0x7f61b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f61b0065a60 0x7f61b0067f20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f61b40ad000 tx=0x7f61b40a6000 comp rx=0 tx=0).stop 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 -- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c40cac10 msgr2=0x7f61c4154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c40cac10 0x7f61c4154180 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c750 tx=0x7f61b800cc10 comp rx=0 tx=0).stop 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 -- 172.21.15.133:0/3905272378 shutdown_connections 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f61b0065a60 0x7f61b0067f20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61c415a680 0x7f61c41546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61c40cac10 0x7f61c4154180 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 --2- 172.21.15.133:0/3905272378 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f61c406fdb0 0x7f61c40c12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 -- 172.21.15.133:0/3905272378 >> 172.21.15.133:0/3905272378 conn(0x7f61c406a3e0 msgr2=0x7f61c415cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 -- 172.21.15.133:0/3905272378 shutdown_connections 2023-12-18T10:20:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.827+0000 7f61ca48c640 1 -- 172.21.15.133:0/3905272378 wait complete. 2023-12-18T10:20:54.852 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:20:54.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.983+0000 7f2e98c66640 1 Processor -- start 2023-12-18T10:20:54.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.983+0000 7f2e98c66640 1 -- start start 2023-12-18T10:20:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e98c66640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e94158c20 0x7f2e94070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e98c66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e9415c800 0x7f2e940caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e98c66640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e940cb440 con 0x7f2e940cafb0 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e98c66640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e94070b80 con 0x7f2e94158c20 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e98c66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94070e60 con 0x7f2e9415c800 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e9259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e94158c20 0x7f2e94070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e9259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e94158c20 0x7f2e94070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32774/0 (socket says 172.21.15.133:32774) 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e9259c640 1 -- 172.21.15.133:0/1804402336 learned_addr learned my addr 172.21.15.133:0/1804402336 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e89d9b640 1 --2- 172.21.15.133:0/1804402336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e9415c800 0x7f2e940caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e9259c640 1 -- 172.21.15.133:0/1804402336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e9415c800 msgr2=0x7f2e940caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e9259c640 1 --2- 172.21.15.133:0/1804402336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e9415c800 0x7f2e940caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e9259c640 1 -- 172.21.15.133:0/1804402336 >> v1:172.21.15.142:6789/0 conn(0x7f2e940cafb0 legacy=0x7f2e9406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.987+0000 7f2e9259c640 1 -- 172.21.15.133:0/1804402336 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e94071140 con 0x7f2e94158c20 2023-12-18T10:20:54.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e9259c640 1 --2- 172.21.15.133:0/1804402336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e94070510 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009870 tx=0x7f2e8401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8557147c9aa9f5ce server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:54.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e91d9b640 1 -- 172.21.15.133:0/1804402336 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840ab600 con 0x7f2e94158c20 2023-12-18T10:20:54.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e91d9b640 1 -- 172.21.15.133:0/1804402336 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840ab760 con 0x7f2e94158c20 2023-12-18T10:20:54.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e91d9b640 1 -- 172.21.15.133:0/1804402336 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840abaf0 con 0x7f2e94158c20 2023-12-18T10:20:54.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 -- 172.21.15.133:0/1804402336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 msgr2=0x7f2e94070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:54.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 --2- 172.21.15.133:0/1804402336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e94070510 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009870 tx=0x7f2e8401c480 comp rx=0 tx=0).stop 2023-12-18T10:20:54.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 -- 172.21.15.133:0/1804402336 shutdown_connections 2023-12-18T10:20:54.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 --2- 172.21.15.133:0/1804402336 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e9415c800 0x7f2e940caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 --2- 172.21.15.133:0/1804402336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e94070510 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:54.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 -- 172.21.15.133:0/1804402336 >> 172.21.15.133:0/1804402336 conn(0x7f2e9406a3e0 msgr2=0x7f2e940afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:54.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 -- 172.21.15.133:0/1804402336 shutdown_connections 2023-12-18T10:20:54.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 -- 172.21.15.133:0/1804402336 wait complete. 2023-12-18T10:20:54.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 Processor -- start 2023-12-18T10:20:54.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.991+0000 7f2e98c66640 1 -- start start 2023-12-18T10:20:54.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cafb0 0x7f2e9414e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e940b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:54.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e9415c800 0x7f2e9415b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9414e830 con 0x7f2e94158c20 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940c5f70 con 0x7f2e9415c800 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940c6250 con 0x7f2e940cafb0 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e940b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e940b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32782/0 (socket says 172.21.15.133:32782) 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 -- 172.21.15.133:0/324467731 learned_addr learned my addr 172.21.15.133:0/324467731 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e9259c640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cafb0 0x7f2e9414e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e92d9d640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e9415c800 0x7f2e9415b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 -- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cafb0 msgr2=0x7f2e9414e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cafb0 0x7f2e9414e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 -- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e9415c800 msgr2=0x7f2e9415b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e9415c800 0x7f2e9415b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 -- 172.21.15.133:0/324467731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e840094d0 con 0x7f2e94158c20 2023-12-18T10:20:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e92d9d640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e9415c800 0x7f2e9415b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e89d9b640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e940b28b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c007e60 tx=0x7f2e7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e8b7fe640 1 -- 172.21.15.133:0/324467731 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c014620 con 0x7f2e94158c20 2023-12-18T10:20:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e8b7fe640 1 -- 172.21.15.133:0/324467731 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c00ee90 con 0x7f2e94158c20 2023-12-18T10:20:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e8b7fe640 1 -- 172.21.15.133:0/324467731 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0149e0 con 0x7f2e94158c20 2023-12-18T10:20:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e940c8800 con 0x7f2e94158c20 2023-12-18T10:20:55.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e940c6810 con 0x7f2e94158c20 2023-12-18T10:20:55.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e940735b0 con 0x7f2e94158c20 2023-12-18T10:20:55.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.995+0000 7f2e8b7fe640 1 -- 172.21.15.133:0/324467731 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2e7c014b40 con 0x7f2e94158c20 2023-12-18T10:20:55.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.999+0000 7f2e8b7fe640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e74065a90 0x7f2e74067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:55.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.999+0000 7f2e8b7fe640 1 -- 172.21.15.133:0/324467731 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e7c083b70 con 0x7f2e94158c20 2023-12-18T10:20:55.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.999+0000 7f2e9259c640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e74065a90 0x7f2e74067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:55.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:54.999+0000 7f2e9259c640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e74065a90 0x7f2e74067f50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2e840af000 tx=0x7f2e840b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.003+0000 7f2e8b7fe640 1 -- 172.21.15.133:0/324467731 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2e7c0513f0 con 0x7f2e94158c20 2023-12-18T10:20:55.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.187+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e940cb8e0 con 0x7f2e94158c20 2023-12-18T10:20:55.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.187+0000 7f2e8b7fe640 1 -- 172.21.15.133:0/324467731 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2e7c054a10 con 0x7f2e94158c20 2023-12-18T10:20:55.194 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e74065a90 msgr2=0x7f2e74067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e74065a90 0x7f2e74067f50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2e840af000 tx=0x7f2e840b6040 comp rx=0 tx=0).stop 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 msgr2=0x7f2e940b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e940b28b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c007e60 tx=0x7f2e7c00e4b0 comp rx=0 tx=0).stop 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 shutdown_connections 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e74065a90 0x7f2e74067f50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e9415c800 0x7f2e9415b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e94158c20 0x7f2e940b28b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 --2- 172.21.15.133:0/324467731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e940cafb0 0x7f2e9414e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 >> 172.21.15.133:0/324467731 conn(0x7f2e9406a3e0 msgr2=0x7f2e94152b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 shutdown_connections 2023-12-18T10:20:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:55.191+0000 7f2e98c66640 1 -- 172.21.15.133:0/324467731 wait complete. 2023-12-18T10:20:55.214 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:20:55.214 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:20:55.214 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:20:55.214 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-18T10:20:55.214 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-18T10:20:55.214 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:20:55.214 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:20:55.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:20:55.215 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:20:55.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:55.215 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:20:55.226 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:20:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:20:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:20:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:20:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:20:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:20:55.226 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:20:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41981sec preferred_lft 41981sec 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:20:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-18T10:20:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:20:55.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:55.229 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:20:55.288 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:20:55.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:55.290 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:20:55.344 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:20:55.344 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:20:55.344 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:20:55.345 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:20:55.345 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:20:55.345 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:20:55.345 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:20:55.345 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:20:55.345 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:20:55.345 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:20:55.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:55.345 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:20:55.346 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:20:55.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:20:55.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:20:55.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:20:55.346 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:20:55.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:55.436 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:20:55.445 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-18T10:20:55.445 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-18T10:20:55.446 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:20:55.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:55.446 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-18T10:20:55.510 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-18T10:20:55.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:20:55.510 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-18T10:20:55.562 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:20:55.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:20:55.562 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:20:55.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:20:55.675 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:20:55.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:20:55.736 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:20:55.738 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:20:55.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:55.738 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:20:55.790 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:20:55.790 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-18T10:20:55.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:20:55.858 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:20:55.858 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:20:55.924 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:20:55.926 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:20:55.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:55.927 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:20:55.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:2023-12-18T10:20:55.927+0000 7f720bc94580 -1 init, newargv = 0x55892795de50 newargc=15 2023-12-18T10:20:55.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[51805]: starting ceph client 2023-12-18T10:20:55.938 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[51805]: starting fuse 2023-12-18T10:20:55.942 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:20:55.942 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:20:55.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:20:55.942 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:20:55.942 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:20:55.942 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:20:55.942 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:20:55.942 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:20:55.942 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:20:55.942 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:20:55.943 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:20:55.944 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:20:55.944 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.0")) 2023-12-18T10:20:55.944 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:20:56.069 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.0.51805.asok 2023-12-18T10:20:56.254 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51805.asok 2023-12-18T10:20:56.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:56.254 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51805.asok status 2023-12-18T10:20:56.425 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:20:56.425 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:20:56.425 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "0", 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "51805", 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6342, 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:20:56.426 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 6342 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3652302707 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3652302707 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.6342 192.168.0.1:0/3652302707", 2023-12-18T10:20:56.427 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/3652302707", 2023-12-18T10:20:56.428 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:20:56.428 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 32, 2023-12-18T10:20:56.428 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 53, 2023-12-18T10:20:56.428 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:20:56.428 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:20:56.428 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:20:56.428 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:20:56.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:56.441 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:20:56.442 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-18T10:20:56.451 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:20:56.451 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-18T10:20:56.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:20:56.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:20:56.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-18T10:20:56.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c6798640 1 Processor -- start 2023-12-18T10:20:56.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c6798640 1 -- start start 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c6798640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 0x7f06c00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c6798640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06c00ce3b0 0x7f06c00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c6798640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00c9390 con 0x7f06c01582d0 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c6798640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c00ced80 con 0x7f06c00ce3b0 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c6798640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c015aee0 con 0x7f06c0070820 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c4d35640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06c00ce3b0 0x7f06c00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c4d35640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06c00ce3b0 0x7f06c00ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32790/0 (socket says 172.21.15.133:32790) 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c4d35640 1 -- 172.21.15.133:0/1050216679 learned_addr learned my addr 172.21.15.133:0/1050216679 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06bffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f06c01582d0 0x7f06c00ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50844/0 (socket says 172.21.15.133:50844) 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06bf7fe640 1 --2- 172.21.15.133:0/1050216679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 0x7f06c00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:56.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c4d35640 1 -- 172.21.15.133:0/1050216679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 msgr2=0x7f06c00c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:56.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c4d35640 1 --2- 172.21.15.133:0/1050216679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 0x7f06c00c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c4d35640 1 -- 172.21.15.133:0/1050216679 >> v1:172.21.15.133:6789/0 conn(0x7f06c01582d0 legacy=0x7f06c00ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:56.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.695+0000 7f06c4d35640 1 -- 172.21.15.133:0/1050216679 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c015b1c0 con 0x7f06c00ce3b0 2023-12-18T10:20:56.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c4d35640 1 --2- 172.21.15.133:0/1050216679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c00ce3b0 0x7f06c00ce840 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009e50 tx=0x7f06b801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e305504d57c7fd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:56.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06beffd640 1 -- 172.21.15.133:0/1050216679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80a58a0 con 0x7f06c00ce3b0 2023-12-18T10:20:56.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06beffd640 1 -- 172.21.15.133:0/1050216679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b80a5a00 con 0x7f06c00ce3b0 2023-12-18T10:20:56.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06beffd640 1 -- 172.21.15.133:0/1050216679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80a5d90 con 0x7f06c00ce3b0 2023-12-18T10:20:56.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 -- 172.21.15.133:0/1050216679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c00ce3b0 msgr2=0x7f06c00ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:56.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 --2- 172.21.15.133:0/1050216679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c00ce3b0 0x7f06c00ce840 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009e50 tx=0x7f06b801c9e0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 -- 172.21.15.133:0/1050216679 shutdown_connections 2023-12-18T10:20:56.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 --2- 172.21.15.133:0/1050216679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c00ce3b0 0x7f06c00ce840 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 --2- 172.21.15.133:0/1050216679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 0x7f06c00c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 -- 172.21.15.133:0/1050216679 >> 172.21.15.133:0/1050216679 conn(0x7f06c006a2a0 msgr2=0x7f06c00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:56.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 -- 172.21.15.133:0/1050216679 shutdown_connections 2023-12-18T10:20:56.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 -- 172.21.15.133:0/1050216679 wait complete. 2023-12-18T10:20:56.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 Processor -- start 2023-12-18T10:20:56.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.699+0000 7f06c6798640 1 -- start start 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 0x7f06c014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c00ce3b0 0x7f06c01f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01582d0 0x7f06c0152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c01f70d0 con 0x7f06c01582d0 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c01f6b10 con 0x7f06c00ce3b0 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c01f6df0 con 0x7f06c0070820 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01582d0 0x7f06c0152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01582d0 0x7f06c0152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32792/0 (socket says 172.21.15.133:32792) 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 -- 172.21.15.133:0/1238584507 learned_addr learned my addr 172.21.15.133:0/1238584507 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06bf7fe640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c00ce3b0 0x7f06c01f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06bffff640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 0x7f06c014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:56.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 -- 172.21.15.133:0/1238584507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 msgr2=0x7f06c014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 0x7f06c014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 -- 172.21.15.133:0/1238584507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c00ce3b0 msgr2=0x7f06c01f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c00ce3b0 0x7f06c01f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 -- 172.21.15.133:0/1238584507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b8009b30 con 0x7f06c01582d0 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c4d35640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01582d0 0x7f06c0152610 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f06b80af040 tx=0x7f06b8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06bcff9640 1 -- 172.21.15.133:0/1238584507 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b8670 con 0x7f06c01582d0 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06bcff9640 1 -- 172.21.15.133:0/1238584507 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b80b87f0 con 0x7f06c01582d0 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06bcff9640 1 -- 172.21.15.133:0/1238584507 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80b8ba0 con 0x7f06c01582d0 2023-12-18T10:20:56.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c00c5620 con 0x7f06c01582d0 2023-12-18T10:20:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c014fbb0 con 0x7f06c01582d0 2023-12-18T10:20:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.703+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c004e000 con 0x7f06c01582d0 2023-12-18T10:20:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.707+0000 7f06bcff9640 1 -- 172.21.15.133:0/1238584507 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f06b80b8d00 con 0x7f06c01582d0 2023-12-18T10:20:56.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.707+0000 7f06bcff9640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f06ac065a90 0x7f06ac067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:56.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.707+0000 7f06bcff9640 1 -- 172.21.15.133:0/1238584507 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f06b811e9c0 con 0x7f06c01582d0 2023-12-18T10:20:56.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.707+0000 7f06bffff640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f06ac065a90 0x7f06ac067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:56.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.707+0000 7f06bffff640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f06ac065a90 0x7f06ac067f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000f70 tx=0x7f06b0007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:56.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.711+0000 7f06bcff9640 1 -- 172.21.15.133:0/1238584507 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f06b80ec2d0 con 0x7f06c01582d0 2023-12-18T10:20:56.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.891+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f06c00c5ad0 con 0x7f06c01582d0 2023-12-18T10:20:56.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.955+0000 7f06bcff9640 1 -- 172.21.15.133:0/1238584507 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v33) v1 ==== 105+0+0 (secure 0 0 0) 0x7f06b80ef8f0 con 0x7f06c01582d0 2023-12-18T10:20:56.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f06ac065a90 msgr2=0x7f06ac067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:56.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f06ac065a90 0x7f06ac067f50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000f70 tx=0x7f06b0007cb0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01582d0 msgr2=0x7f06c0152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:56.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01582d0 0x7f06c0152610 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f06b80af040 tx=0x7f06b8019780 comp rx=0 tx=0).stop 2023-12-18T10:20:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 shutdown_connections 2023-12-18T10:20:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f06ac065a90 0x7f06ac067f50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01582d0 0x7f06c0152610 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c00ce3b0 0x7f06c01f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 --2- 172.21.15.133:0/1238584507 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f06c0070820 0x7f06c014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 >> 172.21.15.133:0/1238584507 conn(0x7f06c006a2a0 msgr2=0x7f06c00aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 shutdown_connections 2023-12-18T10:20:56.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:56.959+0000 7f06c6798640 1 -- 172.21.15.133:0/1238584507 wait complete. 2023-12-18T10:20:56.990 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.123+0000 7f4169ed7640 1 Processor -- start 2023-12-18T10:20:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.123+0000 7f4169ed7640 1 -- start start 2023-12-18T10:20:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f4169ed7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41640b0420 0x7f41640c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f4169ed7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f416406bea0 0x7f416406c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f4169ed7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41640c36c0 con 0x7f4164143f50 2023-12-18T10:20:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f4169ed7640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41640c39a0 con 0x7f416406bea0 2023-12-18T10:20:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f4169ed7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41640c3c80 con 0x7f41640b0420 2023-12-18T10:20:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f41696d6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f416406bea0 0x7f416406c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f41696d6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f416406bea0 0x7f416406c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32800/0 (socket says 172.21.15.133:32800) 2023-12-18T10:20:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f41696d6640 1 -- 172.21.15.133:0/1477627815 learned_addr learned my addr 172.21.15.133:0/1477627815 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f415bfff640 1 --2- 172.21.15.133:0/1477627815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41640b0420 0x7f41640c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f41696d6640 1 -- 172.21.15.133:0/1477627815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41640b0420 msgr2=0x7f41640c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f41696d6640 1 --2- 172.21.15.133:0/1477627815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41640b0420 0x7f41640c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f41696d6640 1 -- 172.21.15.133:0/1477627815 >> v1:172.21.15.142:6789/0 conn(0x7f4164143f50 legacy=0x7f41640afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f41696d6640 1 -- 172.21.15.133:0/1477627815 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41640c3f60 con 0x7f416406bea0 2023-12-18T10:20:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f415bfff640 1 --2- 172.21.15.133:0/1477627815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41640b0420 0x7f41640c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.127+0000 7f41696d6640 1 --2- 172.21.15.133:0/1477627815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f416406c350 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f415c009e50 tx=0x7f415c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1579b4137c545fd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f415b7fe640 1 -- 172.21.15.133:0/1477627815 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c0a5900 con 0x7f416406bea0 2023-12-18T10:20:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f415b7fe640 1 -- 172.21.15.133:0/1477627815 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c0a5a60 con 0x7f416406bea0 2023-12-18T10:20:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f415b7fe640 1 -- 172.21.15.133:0/1477627815 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c0a5df0 con 0x7f416406bea0 2023-12-18T10:20:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- 172.21.15.133:0/1477627815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 msgr2=0x7f416406c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1477627815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f416406c350 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f415c009e50 tx=0x7f415c01ca10 comp rx=0 tx=0).stop 2023-12-18T10:20:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- 172.21.15.133:0/1477627815 shutdown_connections 2023-12-18T10:20:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1477627815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f416406c350 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1477627815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41640b0420 0x7f41640c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- 172.21.15.133:0/1477627815 >> 172.21.15.133:0/1477627815 conn(0x7f41640ce130 msgr2=0x7f41640ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- 172.21.15.133:0/1477627815 shutdown_connections 2023-12-18T10:20:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- 172.21.15.133:0/1477627815 wait complete. 2023-12-18T10:20:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 Processor -- start 2023-12-18T10:20:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- start start 2023-12-18T10:20:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f41640cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41640b0420 0x7f41641f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4164143f50 0x7f4164164920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41641f4a50 con 0x7f416406bea0 2023-12-18T10:20:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416413c3e0 con 0x7f41640b0420 2023-12-18T10:20:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.131+0000 7f4169ed7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41641639c0 con 0x7f4164143f50 2023-12-18T10:20:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f41640cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f41640cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32802/0 (socket says 172.21.15.133:32802) 2023-12-18T10:20:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 -- 172.21.15.133:0/1274010755 learned_addr learned my addr 172.21.15.133:0/1274010755 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f415bfff640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41640b0420 0x7f41641f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f41696d6640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4164143f50 0x7f4164164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 -- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4164143f50 msgr2=0x7f4164164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4164143f50 0x7f4164164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 -- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41640b0420 msgr2=0x7f41641f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41640b0420 0x7f41641f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 -- 172.21.15.133:0/1274010755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c009b30 con 0x7f416406bea0 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f41696d6640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4164143f50 0x7f4164164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4168ed5640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f41640cc580 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f416000c3c0 tx=0x7f416000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f41597fa640 1 -- 172.21.15.133:0/1274010755 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600052d0 con 0x7f416406bea0 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f41597fa640 1 -- 172.21.15.133:0/1274010755 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160005430 con 0x7f416406bea0 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4164163ca0 con 0x7f416406bea0 2023-12-18T10:20:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f41597fa640 1 -- 172.21.15.133:0/1274010755 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160003840 con 0x7f416406bea0 2023-12-18T10:20:57.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4164164260 con 0x7f416406bea0 2023-12-18T10:20:57.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416404e850 con 0x7f416406bea0 2023-12-18T10:20:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f41597fa640 1 -- 172.21.15.133:0/1274010755 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f41600039a0 con 0x7f416406bea0 2023-12-18T10:20:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f41597fa640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4150065a60 0x7f4150067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.135+0000 7f41597fa640 1 -- 172.21.15.133:0/1274010755 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4160082750 con 0x7f416406bea0 2023-12-18T10:20:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.139+0000 7f415bfff640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4150065a60 0x7f4150067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.139+0000 7f415bfff640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4150065a60 0x7f4150067f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f416415c050 tx=0x7f4154008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.139+0000 7f41597fa640 1 -- 172.21.15.133:0/1274010755 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4160050070 con 0x7f416406bea0 2023-12-18T10:20:57.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.323+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41640b0940 con 0x7f416406bea0 2023-12-18T10:20:57.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.323+0000 7f41597fa640 1 -- 172.21.15.133:0/1274010755 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f4160053690 con 0x7f416406bea0 2023-12-18T10:20:57.390 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:57.390 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:20:56.962072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6165,"mds_1":6162},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6162":{"gid":6162,"name":"a","rank":1,"incarnation":34,"state":"up:creating","state_seq":1,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:20:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 34 2023-12-18T10:20:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4150065a60 msgr2=0x7f4150067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4150065a60 0x7f4150067f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f416415c050 tx=0x7f4154008040 comp rx=0 tx=0).stop 2023-12-18T10:20:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 msgr2=0x7f41640cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:57.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f41640cc580 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f416000c3c0 tx=0x7f416000c880 comp rx=0 tx=0).stop 2023-12-18T10:20:57.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 shutdown_connections 2023-12-18T10:20:57.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4150065a60 0x7f4150067f20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4164143f50 0x7f4164164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41640b0420 0x7f41641f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 --2- 172.21.15.133:0/1274010755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f416406bea0 0x7f41640cc580 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:57.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 >> 172.21.15.133:0/1274010755 conn(0x7f41640ce130 msgr2=0x7f416415de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:57.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 shutdown_connections 2023-12-18T10:20:57.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:57.327+0000 7f4169ed7640 1 -- 172.21.15.133:0/1274010755 wait complete. 2023-12-18T10:20:57.795 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:20:44.522180+0000', 'modified': '2023-12-18T10:20:56.962072+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6165, 'mds_1': 6162}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6162': {'gid': 6162, 'name': 'a', 'rank': 1, 'incarnation': 34, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.133:6836/4035374378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 4035374378}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 4035374378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6165': {'gid': 6165, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1554379121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 1554379121}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1554379121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:20:57.796 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6162:up:creating 2023-12-18T10:20:58.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:20:58.409 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:20:58.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:20:58.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9093e2d640 1 Processor -- start 2023-12-18T10:20:58.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9093e2d640 1 -- start start 2023-12-18T10:20:58.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9093e2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 0x7f908c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9093e2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f908c0cf7e0 0x7f908c1668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9093e2d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908c0d11c0 con 0x7f908c0ce3f0 2023-12-18T10:20:58.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9093e2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908c0d0310 con 0x7f908c0cf7e0 2023-12-18T10:20:58.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9093e2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0d05b0 con 0x7f908c15ca40 2023-12-18T10:20:58.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90913c8640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f908c0ce3f0 0x7f908c0cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50856/0 (socket says 172.21.15.133:50856) 2023-12-18T10:20:58.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90913c8640 1 -- 172.21.15.133:0/3677352960 learned_addr learned my addr 172.21.15.133:0/3677352960 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:58.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90923ca640 1 --2- 172.21.15.133:0/3677352960 >> v2:172.21.15.142:3300/0 conn(0x7f908c0cf7e0 0x7f908c1668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973349549 0 0) 0x7f908c0d11c0 con 0x7f908c0ce3f0 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9091bc9640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 0x7f908c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9078003530 con 0x7f908c0ce3f0 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2432125018 0 0) 0x7f9078003530 con 0x7f908c0ce3f0 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 msgr2=0x7f908c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 0x7f908c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 >> v2:172.21.15.142:3300/0 conn(0x7f908c0cf7e0 msgr2=0x7f908c1668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 --2- 172.21.15.133:0/3677352960 >> v2:172.21.15.142:3300/0 conn(0x7f908c0cf7e0 0x7f908c1668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0d0890 con 0x7f908c0ce3f0 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f907c001800 con 0x7f908c0ce3f0 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 >> v1:172.21.15.133:6789/0 conn(0x7f908c0ce3f0 legacy=0x7f908c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:58.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9078003980 0x7f9078003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90780047d0 0x7f9078004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 0x7f9078005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0d0310 con 0x7f90780047d0 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0d05b0 con 0x7f9078003980 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907800b990 con 0x7f908c15ca40 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90913c8640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90780047d0 0x7f9078004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f9091bc9640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9078003980 0x7f9078003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90923ca640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 0x7f9078005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90913c8640 1 -- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 msgr2=0x7f9078005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90913c8640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 0x7f9078005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90913c8640 1 -- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9078003980 msgr2=0x7f9078003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:58.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.939+0000 7f90913c8640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9078003980 0x7f9078003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:58.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f90913c8640 1 -- 172.21.15.133:0/3677352960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9078003530 con 0x7f90780047d0 2023-12-18T10:20:58.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f90923ca640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c15ca40 0x7f9078005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f90913c8640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90780047d0 0x7f9078004c50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c240 tx=0x7f907c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb332cf12cf4cd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0a8d00 con 0x7f90780047d0 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c0a8e60 con 0x7f90780047d0 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f9090bc7640 1 -- 172.21.15.133:0/3677352960 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0072d0 con 0x7f90780047d0 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f9093e2d640 1 -- 172.21.15.133:0/3677352960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90780047d0 msgr2=0x7f9078004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f9093e2d640 1 --2- 172.21.15.133:0/3677352960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90780047d0 0x7f9078004c50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f907c00c240 tx=0x7f907c01f3d0 comp rx=0 tx=0).stop 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f90923ca640 1 -- 172.21.15.133:0/3677352960 reap_dead start 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f9093e2d640 1 -- 172.21.15.133:0/3677352960 shutdown_connections 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.943+0000 7f9093e2d640 1 -- 172.21.15.133:0/3677352960 >> 172.21.15.133:0/3677352960 conn(0x7f908c089fb0 msgr2=0x7f908c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:58.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 -- 172.21.15.133:0/3677352960 shutdown_connections 2023-12-18T10:20:58.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 -- 172.21.15.133:0/3677352960 wait complete. 2023-12-18T10:20:58.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 Processor -- start 2023-12-18T10:20:58.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 -- start start 2023-12-18T10:20:58.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90780047d0 0x7f908c1f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c0b7e70 0x7f908c0cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c0cc400 0x7f908c158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0b7a50 con 0x7f908c0b7e70 2023-12-18T10:20:58.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0b56c0 con 0x7f90780047d0 2023-12-18T10:20:58.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9093e2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0b6dd0 con 0x7f908c0cc400 2023-12-18T10:20:58.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c0b7e70 0x7f908c0cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c0b7e70 0x7f908c0cba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32822/0 (socket says 172.21.15.133:32822) 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 -- 172.21.15.133:0/211302245 learned_addr learned my addr 172.21.15.133:0/211302245 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f9091bc9640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90780047d0 0x7f908c1f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90923ca640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c0cc400 0x7f908c158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 -- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c0cc400 msgr2=0x7f908c158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c0cc400 0x7f908c158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 -- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90780047d0 msgr2=0x7f908c1f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90780047d0 0x7f908c1f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 -- 172.21.15.133:0/211302245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0b70b0 con 0x7f908c0b7e70 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90923ca640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c0cc400 0x7f908c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.947+0000 7f90913c8640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c0b7e70 0x7f908c0cba50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f907c0a8fd0 tx=0x7f9078005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f90827fc640 1 -- 172.21.15.133:0/211302245 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c005af0 con 0x7f908c0b7e70 2023-12-18T10:20:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f90827fc640 1 -- 172.21.15.133:0/211302245 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c005c50 con 0x7f908c0b7e70 2023-12-18T10:20:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f90827fc640 1 -- 172.21.15.133:0/211302245 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0070d0 con 0x7f908c0b7e70 2023-12-18T10:20:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908c0b7390 con 0x7f908c0b7e70 2023-12-18T10:20:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c1f2f80 con 0x7f908c0b7e70 2023-12-18T10:20:58.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c0b7b90 con 0x7f908c0b7e70 2023-12-18T10:20:58.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f90827fc640 1 -- 172.21.15.133:0/211302245 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f907c007230 con 0x7f908c0b7e70 2023-12-18T10:20:58.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f90827fc640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9070065a90 0x7f9070067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:58.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f90827fc640 1 -- 172.21.15.133:0/211302245 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f907c120520 con 0x7f908c0b7e70 2023-12-18T10:20:58.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f9091bc9640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9070065a90 0x7f9070067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:58.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.951+0000 7f9091bc9640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9070065a90 0x7f9070067f50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f90880099c0 tx=0x7f9088008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:58.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:58.955+0000 7f90827fc640 1 -- 172.21.15.133:0/211302245 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f908c0b7b90 con 0x7f908c0b7e70 2023-12-18T10:20:59.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.139+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f908c0b7b90 con 0x7f908c0b7e70 2023-12-18T10:20:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.139+0000 7f90827fc640 1 -- 172.21.15.133:0/211302245 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4749 (secure 0 0 0) 0x7f908c0b7b90 con 0x7f908c0b7e70 2023-12-18T10:20:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:20:59.145 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:20:58.983581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6165,"mds_1":6162,"mds_2":5875},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5875":{"gid":5875,"name":"d","rank":2,"incarnation":36,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6162":{"gid":6162,"name":"a","rank":1,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:20:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 37 2023-12-18T10:20:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9070065a90 msgr2=0x7f9070067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9070065a90 0x7f9070067f50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f90880099c0 tx=0x7f9088008040 comp rx=0 tx=0).stop 2023-12-18T10:20:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c0b7e70 msgr2=0x7f908c0cba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c0b7e70 0x7f908c0cba50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f907c0a8fd0 tx=0x7f9078005800 comp rx=0 tx=0).stop 2023-12-18T10:20:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 shutdown_connections 2023-12-18T10:20:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9070065a90 0x7f9070067f50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f908c0cc400 0x7f908c158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c0b7e70 0x7f908c0cba50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 --2- 172.21.15.133:0/211302245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90780047d0 0x7f908c1f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 >> 172.21.15.133:0/211302245 conn(0x7f908c089fb0 msgr2=0x7f908c160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 shutdown_connections 2023-12-18T10:20:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.143+0000 7f9093e2d640 1 -- 172.21.15.133:0/211302245 wait complete. 2023-12-18T10:20:59.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:20:44.522180+0000', 'modified': '2023-12-18T10:20:58.983581+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6165, 'mds_1': 6162, 'mds_2': 5875}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5875': {'gid': 5875, 'name': 'd', 'rank': 2, 'incarnation': 36, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.142:6834/2140881005', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 2140881005}, {'type': 'v1', 'addr': '172.21.15.142:6834', 'nonce': 2140881005}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6162': {'gid': 6162, 'name': 'a', 'rank': 1, 'incarnation': 34, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.133:6836/4035374378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 4035374378}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 4035374378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6165': {'gid': 6165, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1554379121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 1554379121}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1554379121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:20:59.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-18T10:20:59.569 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-18T10:20:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.703+0000 7f480b42d640 1 Processor -- start 2023-12-18T10:20:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f480b42d640 1 -- start start 2023-12-18T10:20:59.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f480b42d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48040704c0 0x7f480415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f480b42d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480415f100 con 0x7f48040cac10 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f480b42d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48040ca7d0 con 0x7f480415a680 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f480b42d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480415e860 con 0x7f48040704c0 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f48099ca640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48040704c0 0x7f480415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f48089c8640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f48040cac10 0x7f480406fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50858/0 (socket says 172.21.15.133:50858) 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f48099ca640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48040704c0 0x7f480415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32826/0 (socket says 172.21.15.133:32826) 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f48089c8640 1 -- 172.21.15.133:0/1415736560 learned_addr learned my addr 172.21.15.133:0/1415736560 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f48099ca640 1 -- 172.21.15.133:0/1415736560 >> v1:172.21.15.142:6789/0 conn(0x7f480415a680 legacy=0x7f480415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f48099ca640 1 -- 172.21.15.133:0/1415736560 >> v1:172.21.15.133:6789/0 conn(0x7f48040cac10 legacy=0x7f480406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.707+0000 7f48099ca640 1 -- 172.21.15.133:0/1415736560 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480415eb40 con 0x7f48040704c0 2023-12-18T10:20:59.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f48099ca640 1 --2- 172.21.15.133:0/1415736560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480415e160 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009d90 tx=0x7f47fc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5ddc98c70582ee server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f47fbfff640 1 -- 172.21.15.133:0/1415736560 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0a5940 con 0x7f48040704c0 2023-12-18T10:20:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f47fbfff640 1 -- 172.21.15.133:0/1415736560 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc0a5aa0 con 0x7f48040704c0 2023-12-18T10:20:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f47fbfff640 1 -- 172.21.15.133:0/1415736560 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0a5e30 con 0x7f48040704c0 2023-12-18T10:20:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 -- 172.21.15.133:0/1415736560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 msgr2=0x7f480415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 --2- 172.21.15.133:0/1415736560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480415e160 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009d90 tx=0x7f47fc01c880 comp rx=0 tx=0).stop 2023-12-18T10:20:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 -- 172.21.15.133:0/1415736560 shutdown_connections 2023-12-18T10:20:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 --2- 172.21.15.133:0/1415736560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480415e160 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 -- 172.21.15.133:0/1415736560 >> 172.21.15.133:0/1415736560 conn(0x7f480406a3e0 msgr2=0x7f48040afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 -- 172.21.15.133:0/1415736560 shutdown_connections 2023-12-18T10:20:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 -- 172.21.15.133:0/1415736560 wait complete. 2023-12-18T10:20:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 Processor -- start 2023-12-18T10:20:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.711+0000 7f480b42d640 1 -- start start 2023-12-18T10:20:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f480b42d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f480b42d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48040cac10 0x7f48041556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f480b42d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f480415a680 0x7f4804155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f480b42d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040c71b0 con 0x7f48040704c0 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f480b42d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040c3890 con 0x7f480415a680 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f480b42d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48040c3b70 con 0x7f48040cac10 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480414e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32842/0 (socket says 172.21.15.133:32842) 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 -- 172.21.15.133:0/2208592578 learned_addr learned my addr 172.21.15.133:0/2208592578 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48099ca640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f480415a680 0x7f4804155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48089c8640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48040cac10 0x7f48041556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 -- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48040cac10 msgr2=0x7f48041556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48040cac10 0x7f48041556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 -- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f480415a680 msgr2=0x7f4804155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f480415a680 0x7f4804155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 -- 172.21.15.133:0/2208592578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc009a70 con 0x7f48040704c0 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48089c8640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48040cac10 0x7f48041556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f48091c9640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480414e7f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f480000c550 tx=0x7f480000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f47f9ffb640 1 -- 172.21.15.133:0/2208592578 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800012830 con 0x7f48040704c0 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f47f9ffb640 1 -- 172.21.15.133:0/2208592578 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4800012990 con 0x7f48040704c0 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f47f9ffb640 1 -- 172.21.15.133:0/2208592578 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800012d40 con 0x7f48040704c0 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f480b42d640 1 -- 172.21.15.133:0/2208592578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48040c3e50 con 0x7f48040704c0 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f480b42d640 1 -- 172.21.15.133:0/2208592578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480414ed30 con 0x7f48040704c0 2023-12-18T10:20:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.715+0000 7f47f9ffb640 1 -- 172.21.15.133:0/2208592578 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f480001b400 con 0x7f48040704c0 2023-12-18T10:20:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f47f9ffb640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47e8065ab0 0x7f47e8067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f47f9ffb640 1 -- 172.21.15.133:0/2208592578 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4800083510 con 0x7f48040704c0 2023-12-18T10:20:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48089c8640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47e8065ab0 0x7f47e8067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f480e79d000 1 Processor -- start 2023-12-18T10:20:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48089c8640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47e8065ab0 0x7f47e8067f70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005890 tx=0x7f47f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f480e79d000 1 -- start start 2023-12-18T10:20:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f480e79d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f72525e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f480e79d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525ebe0 0x55f725214090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f480e79d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f7252149b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f480e79d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f725033c90 con 0x55f72525e2c0 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f480e79d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f725065220 con 0x55f72525ebe0 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f480e79d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7250627f0 con 0x55f7252145d0 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f72525e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f72525e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32852/0 (socket says 172.21.15.133:32852) 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 -- 172.21.15.133:0/797250292 learned_addr learned my addr 172.21.15.133:0/797250292 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48089c8640 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525ebe0 0x55f725214090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48099ca640 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f7252149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 -- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 msgr2=0x55f7252149b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f7252149b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 -- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525ebe0 msgr2=0x55f725214090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525ebe0 0x55f725214090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 -- 172.21.15.133:0/797250292 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f724d5a890 con 0x55f72525e2c0 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48089c8640 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525ebe0 0x55f725214090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f48091c9640 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f72525e6a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4800081820 tx=0x7f4800007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b770933da2bb6f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f47e6ffd640 1 -- 172.21.15.133:0/797250292 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480005ca10 con 0x55f72525e2c0 2023-12-18T10:20:59.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f47e6ffd640 1 -- 172.21.15.133:0/797250292 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4800052dd0 con 0x55f72525e2c0 2023-12-18T10:20:59.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.719+0000 7f47e6ffd640 1 -- 172.21.15.133:0/797250292 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800053f20 con 0x55f72525e2c0 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- 172.21.15.133:0/797250292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 msgr2=0x55f72525e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f72525e6a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4800081820 tx=0x7f4800007f90 comp rx=0 tx=0).stop 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- 172.21.15.133:0/797250292 shutdown_connections 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f7252149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525ebe0 0x55f725214090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 --2- 172.21.15.133:0/797250292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f72525e6a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- 172.21.15.133:0/797250292 >> 172.21.15.133:0/797250292 conn(0x55f725216950 msgr2=0x55f72520e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- 172.21.15.133:0/797250292 shutdown_connections 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- 172.21.15.133:0/797250292 wait complete. 2023-12-18T10:20:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- start start 2023-12-18T10:20:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 Processor -- start 2023-12-18T10:20:59.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f725265410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f725265950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525ebe0 0x55f72524b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72505e0e0 con 0x55f72525ebe0 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f724ffd310 con 0x55f72525e2c0 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f72501b770 con 0x55f7252145d0 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 10 client.0 _ll_register_callbacks cb 0x55f7251fbb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525ebe0 0x55f72524b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525ebe0 0x55f72524b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32868/0 (socket says 172.21.15.133:32868) 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 -- 172.21.15.133:0/2674763209 learned_addr learned my addr 172.21.15.133:0/2674763209 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48091c9640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f725265410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48089c8640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f725265950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 -- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 msgr2=0x55f725265410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f725265410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 -- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 msgr2=0x55f725265950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f725265950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 -- 172.21.15.133:0/2674763209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480414ed30 con 0x55f72525ebe0 2023-12-18T10:20:59.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48091c9640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f725265410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48089c8640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f725265950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f48099ca640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525ebe0 0x55f72524b740 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0b0040 tx=0x7f47fc01b0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6beb93c8bebc98f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f47dffff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f47dffff640 1 -- 172.21.15.133:0/2674763209 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0b8a20 con 0x55f72525ebe0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f47dffff640 1 -- 172.21.15.133:0/2674763209 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f47fc0c4c40 con 0x55f72525ebe0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.723+0000 7f480e79d000 1 -- 172.21.15.133:0/2674763209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f72502dc10 con 0x55f72525ebe0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f47dffff640 1 -- 172.21.15.133:0/2674763209 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47fc0c4e00 con 0x55f72525ebe0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 10 client.6378 fetch_fsmap learned FSMap version 37 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 -- 172.21.15.133:0/2674763209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55f725023260 con 0x55f72525ebe0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f47dffff640 1 -- 172.21.15.133:0/2674763209 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f72502dc10 con 0x55f72525ebe0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f47dffff640 1 -- 172.21.15.133:0/2674763209 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 37) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f47fc0b8b80 con 0x55f72525ebe0 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 10 client.6378 fetch_fsmap finished waiting for FSMap version 37 2023-12-18T10:20:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 10 client.6378 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:20:59.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 20 client.6378 populate_metadata read hostname 'smithi133' 2023-12-18T10:20:59.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x55f72524c4e0 0x55f72524c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 4 client.6378 mds_command: new command op to 5875 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:20:59.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 -- 172.21.15.133:0/2674763209 --> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f72505ca30 con 0x55f72524c4e0 2023-12-18T10:20:59.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f48091c9640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x55f72524c4e0 0x55f72524c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f48091c9640 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x55f72524c4e0 0x55f72524c8c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33da9fb45cec402a server_cookie=9e2a89457c8c292 in_seq=0 out_seq=0 2023-12-18T10:20:59.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f47dffff640 10 client.6378 ms_handle_connect on v2:172.21.15.142:6832/2140881005 2023-12-18T10:20:59.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f47dffff640 1 -- 172.21.15.133:0/2674763209 <== mds.2 v2:172.21.15.142:6832/2140881005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55f72505ca30 con 0x55f72524c4e0 2023-12-18T10:20:59.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f47dffff640 10 client.6378 handle_command_reply: tid=0 2023-12-18T10:20:59.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 client.6378 shutdown 2023-12-18T10:20:59.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 -- 172.21.15.133:0/2674763209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525ebe0 msgr2=0x55f72524b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525ebe0 0x55f72524b740 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0b0040 tx=0x7f47fc01b0c0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 -- 172.21.15.133:0/2674763209 shutdown_connections 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x55f72524c4e0 0x55f72524c8c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525ebe0 0x55f72524b740 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f725265950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 --2- 172.21.15.133:0/2674763209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7252145d0 0x55f725265410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f47dffff640 0 client.6378 ms_handle_reset on v2:172.21.15.142:6832/2140881005 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 -- 172.21.15.133:0/2674763209 >> 172.21.15.133:0/2674763209 conn(0x55f725216950 msgr2=0x55f72520dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 -- 172.21.15.133:0/2674763209 shutdown_connections 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 1 -- 172.21.15.133:0/2674763209 wait complete. 2023-12-18T10:20:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.727+0000 7f480e79d000 20 client.6378 trim_cache size 0 max 16384 2023-12-18T10:20:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f480e79d000 1 Processor -- start 2023-12-18T10:20:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f480e79d000 1 -- start start 2023-12-18T10:20:59.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f480e79d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7252145d0 0x55f7252b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f480e79d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f7252b6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f480e79d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 0x55f7252b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f480e79d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f724d1b940 con 0x55f72525e2c0 2023-12-18T10:20:59.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f480e79d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7250664b0 con 0x55f7252145d0 2023-12-18T10:20:59.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f480e79d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f72512eb30 con 0x55f72525ebe0 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f7252b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f7252b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32882/0 (socket says 172.21.15.133:32882) 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 -- 172.21.15.133:0/3861678253 learned_addr learned my addr 172.21.15.133:0/3861678253 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48099ca640 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 0x55f7252b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48091c9640 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7252145d0 0x55f7252b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 -- 172.21.15.133:0/3861678253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 msgr2=0x55f7252b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 0x55f7252b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 -- 172.21.15.133:0/3861678253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7252145d0 msgr2=0x55f7252b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7252145d0 0x55f7252b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 -- 172.21.15.133:0/3861678253 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7250093b0 con 0x55f72525e2c0 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f48089c8640 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f7252b6450 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005ad0 tx=0x7f47f4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27da634cc5f185ca server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f47e77fe640 1 -- 172.21.15.133:0/3861678253 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400d9a0 con 0x55f72525e2c0 2023-12-18T10:20:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f47e77fe640 1 -- 172.21.15.133:0/3861678253 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f400db00 con 0x55f72525e2c0 2023-12-18T10:20:59.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.743+0000 7f47e77fe640 1 -- 172.21.15.133:0/3861678253 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400deb0 con 0x55f72525e2c0 2023-12-18T10:20:59.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- 172.21.15.133:0/3861678253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 msgr2=0x55f7252b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f7252b6450 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005ad0 tx=0x7f47f4011000 comp rx=0 tx=0).stop 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- 172.21.15.133:0/3861678253 shutdown_connections 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 0x55f7252b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f72525e2c0 0x55f7252b6450 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 --2- 172.21.15.133:0/3861678253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7252145d0 0x55f7252b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- 172.21.15.133:0/3861678253 >> 172.21.15.133:0/3861678253 conn(0x55f725216950 msgr2=0x55f72525d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- 172.21.15.133:0/3861678253 shutdown_connections 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- 172.21.15.133:0/3861678253 wait complete. 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- start start 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 Processor -- start 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7252145d0 0x55f725260ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f7252611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 0x55f725261720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7250620e0 con 0x55f7252145d0 2023-12-18T10:20:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f725006860 con 0x55f72525e2c0 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7250566f0 con 0x55f72525ebe0 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 10 client.0 _ll_register_callbacks cb 0x55f72500c640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7252145d0 0x55f725260ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7252145d0 0x55f725260ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32892/0 (socket says 172.21.15.133:32892) 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 -- 172.21.15.133:0/3326874693 learned_addr learned my addr 172.21.15.133:0/3326874693 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48089c8640 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f7252611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48099ca640 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 0x55f725261720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 -- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 msgr2=0x55f725261720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 0x55f725261720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 -- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 msgr2=0x55f7252611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f7252611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 -- 172.21.15.133:0/3326874693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480415f100 con 0x55f7252145d0 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48089c8640 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f7252611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f48091c9640 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7252145d0 0x55f725260ca0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f480000cf10 tx=0x7f4800001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc17040a65bbfcc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f47dffff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f47dffff640 1 -- 172.21.15.133:0/3326874693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800051140 con 0x55f7252145d0 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f47dffff640 1 -- 172.21.15.133:0/3326874693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4800080070 con 0x55f7252145d0 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- 172.21.15.133:0/3326874693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f725023e00 con 0x55f7252145d0 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f47dffff640 1 -- 172.21.15.133:0/3326874693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48000512a0 con 0x55f7252145d0 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 10 client.6384 fetch_fsmap learned FSMap version 37 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- 172.21.15.133:0/3326874693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55f724d5acc0 con 0x55f7252145d0 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f47dffff640 1 -- 172.21.15.133:0/3326874693 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f725023e00 con 0x55f7252145d0 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f47dffff640 1 -- 172.21.15.133:0/3326874693 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 37) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f4800053f20 con 0x55f7252145d0 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 10 client.6384 fetch_fsmap finished waiting for FSMap version 37 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 10 client.6384 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 20 client.6384 populate_metadata read hostname 'smithi133' 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x55f725261c60 0x55f725262040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 4 client.6384 mds_command: new command op to 5875 tid=0[{"prefix": "status"}] 2023-12-18T10:20:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.747+0000 7f480e79d000 1 -- 172.21.15.133:0/3326874693 --> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f725057160 con 0x55f725261c60 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f48089c8640 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x55f725261c60 0x55f725262040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f47dffff640 10 client.6384 ms_handle_connect on v2:172.21.15.142:6832/2140881005 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f48089c8640 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x55f725261c60 0x55f725262040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad59b93185b69bd0 server_cookie=a40459b1232a3598 in_seq=0 out_seq=0 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f47dffff640 1 -- 172.21.15.133:0/3326874693 <== mds.2 v2:172.21.15.142:6832/2140881005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f725057160 con 0x55f725261c60 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f47dffff640 10 client.6384 handle_command_reply: tid=0 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 client.6384 shutdown 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 -- 172.21.15.133:0/3326874693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7252145d0 msgr2=0x55f725260ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7252145d0 0x55f725260ca0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f480000cf10 tx=0x7f4800001090 comp rx=0 tx=0).stop 2023-12-18T10:20:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 -- 172.21.15.133:0/3326874693 shutdown_connections 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x55f725261c60 0x55f725262040 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f72525ebe0 0x55f725261720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f72525e2c0 0x55f7252611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f47dffff640 0 client.6384 ms_handle_reset on v2:172.21.15.142:6832/2140881005 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 --2- 172.21.15.133:0/3326874693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7252145d0 0x55f725260ca0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 -- 172.21.15.133:0/3326874693 >> 172.21.15.133:0/3326874693 conn(0x55f725216950 msgr2=0x55f7252149b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 -- 172.21.15.133:0/3326874693 shutdown_connections 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 1 -- 172.21.15.133:0/3326874693 wait complete. 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480e79d000 20 client.6384 trim_cache size 0 max 16384 2023-12-18T10:20:59.759 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 2, 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5875, 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 1.7712314659999999, 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 37, 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 53, 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 53, 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 19.669668788999999 2023-12-18T10:20:59.760 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:20:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 -- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47e8065ab0 msgr2=0x7f47e8067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47e8065ab0 0x7f47e8067f70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005890 tx=0x7f47f4009040 comp rx=0 tx=0).stop 2023-12-18T10:20:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 -- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 msgr2=0x7f480414e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480414e7f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f480000c550 tx=0x7f480000ca10 comp rx=0 tx=0).stop 2023-12-18T10:20:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 -- 172.21.15.133:0/2208592578 shutdown_connections 2023-12-18T10:20:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47e8065ab0 0x7f47e8067f70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f480415a680 0x7f4804155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48040cac10 0x7f48041556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 --2- 172.21.15.133:0/2208592578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48040704c0 0x7f480414e7f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 -- 172.21.15.133:0/2208592578 >> 172.21.15.133:0/2208592578 conn(0x7f480406a3e0 msgr2=0x7f4804072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 -- 172.21.15.133:0/2208592578 shutdown_connections 2023-12-18T10:20:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.751+0000 7f480b42d640 1 -- 172.21.15.133:0/2208592578 wait complete. 2023-12-18T10:20:59.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-18T10:20:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.907+0000 7fa821fb3640 1 Processor -- start 2023-12-18T10:20:59.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.907+0000 7fa821fb3640 1 -- start start 2023-12-18T10:20:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa821fb3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c15a680 0x7fa81c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa821fb3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c15f100 con 0x7fa81c06fdb0 2023-12-18T10:20:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa821fb3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0ca7d0 con 0x7fa81c0cac10 2023-12-18T10:20:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa821fb3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c15e860 con 0x7fa81c15a680 2023-12-18T10:20:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa81c06fdb0 0x7fa81c0c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51676/0 (socket says 172.21.15.133:51676) 2023-12-18T10:20:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81bfff640 1 -- 172.21.15.133:0/3430948278 learned_addr learned my addr 172.21.15.133:0/3430948278 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:20:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/3430948278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c15a680 0x7fa81c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81a7fc640 1 -- 172.21.15.133:0/3430948278 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15101501 0 0) 0x7fa81c15f100 con 0x7fa81c06fdb0 2023-12-18T10:20:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81a7fc640 1 -- 172.21.15.133:0/3430948278 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa804003530 con 0x7fa81c06fdb0 2023-12-18T10:20:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81a7fc640 1 -- 172.21.15.133:0/3430948278 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619361705 0 0) 0x7fa81c0ca7d0 con 0x7fa81c0cac10 2023-12-18T10:20:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81a7fc640 1 -- 172.21.15.133:0/3430948278 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa81c15f100 con 0x7fa81c0cac10 2023-12-18T10:20:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81b7fe640 1 -- 172.21.15.133:0/3430948278 >> v1:172.21.15.142:6789/0 conn(0x7fa81c0cac10 legacy=0x7fa81c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81b7fe640 1 -- 172.21.15.133:0/3430948278 >> v1:172.21.15.133:6789/0 conn(0x7fa81c06fdb0 legacy=0x7fa81c0c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.911+0000 7fa81b7fe640 1 -- 172.21.15.133:0/3430948278 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c15eb40 con 0x7fa81c15a680 2023-12-18T10:20:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/3430948278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c15a680 0x7fa81c15e160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0097f0 tx=0x7fa80c01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4bc33136c8c32a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa81a7fc640 1 -- 172.21.15.133:0/3430948278 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0a7070 con 0x7fa81c15a680 2023-12-18T10:20:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa81a7fc640 1 -- 172.21.15.133:0/3430948278 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c0ab430 con 0x7fa81c15a680 2023-12-18T10:20:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa81a7fc640 1 -- 172.21.15.133:0/3430948278 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0ab7c0 con 0x7fa81c15a680 2023-12-18T10:20:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa821fb3640 1 -- 172.21.15.133:0/3430948278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c15a680 msgr2=0x7fa81c15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa821fb3640 1 --2- 172.21.15.133:0/3430948278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c15a680 0x7fa81c15e160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0097f0 tx=0x7fa80c01c430 comp rx=0 tx=0).stop 2023-12-18T10:20:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa821fb3640 1 -- 172.21.15.133:0/3430948278 shutdown_connections 2023-12-18T10:20:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa821fb3640 1 --2- 172.21.15.133:0/3430948278 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c15a680 0x7fa81c15e160 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa821fb3640 1 -- 172.21.15.133:0/3430948278 >> 172.21.15.133:0/3430948278 conn(0x7fa81c06a3e0 msgr2=0x7fa81c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa821fb3640 1 -- 172.21.15.133:0/3430948278 shutdown_connections 2023-12-18T10:20:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa821fb3640 1 -- 172.21.15.133:0/3430948278 wait complete. 2023-12-18T10:20:59.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.915+0000 7fa821fb3640 1 Processor -- start 2023-12-18T10:20:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 -- start start 2023-12-18T10:20:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c06fdb0 0x7fa81c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa81c0cac10 0x7fa81c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa81c15a680 0x7fa81c15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0ccc30 con 0x7fa81c0cac10 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0cc300 con 0x7fa81c15a680 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0cc5e0 con 0x7fa81c06fdb0 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa81c0cac10 0x7fa81c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa81c0cac10 0x7fa81c0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41432/0 (socket says 172.21.15.133:41432) 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 -- 172.21.15.133:0/1548391308 learned_addr learned my addr 172.21.15.133:0/1548391308 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c06fdb0 0x7fa81c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81bfff640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa81c15a680 0x7fa81c15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 -- 172.21.15.133:0/1548391308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c06fdb0 msgr2=0x7fa81c0b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c06fdb0 0x7fa81c0b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 -- 172.21.15.133:0/1548391308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa81c15a680 msgr2=0x7fa81c15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa81c15a680 0x7fa81c15ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 -- 172.21.15.133:0/1548391308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c009420 con 0x7fa81c0cac10 2023-12-18T10:20:59.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa81affd640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa81c0cac10 0x7fa81c0cd0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa81000c430 tx=0x7fa81000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa803fff640 1 -- 172.21.15.133:0/1548391308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100052d0 con 0x7fa81c0cac10 2023-12-18T10:20:59.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa803fff640 1 -- 172.21.15.133:0/1548391308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa810005450 con 0x7fa81c0cac10 2023-12-18T10:20:59.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa803fff640 1 -- 172.21.15.133:0/1548391308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810003840 con 0x7fa81c0cac10 2023-12-18T10:20:59.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 -- 172.21.15.133:0/1548391308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c070750 con 0x7fa81c0cac10 2023-12-18T10:20:59.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.919+0000 7fa821fb3640 1 -- 172.21.15.133:0/1548391308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0b36b0 con 0x7fa81c0cac10 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa803fff640 1 -- 172.21.15.133:0/1548391308 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa8100039a0 con 0x7fa81c0cac10 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa803fff640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa808065a60 0x7fa808067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa803fff640 1 -- 172.21.15.133:0/1548391308 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa8100828f0 con 0x7fa81c0cac10 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa808065a60 0x7fa808067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa825327000 1 Processor -- start 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa825327000 1 -- start start 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa808065a60 0x7fa808067f20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0af000 tx=0x7fa80c0b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa825327000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d8d5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa825327000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5990 0x55b75d88ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa825327000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d88b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa825327000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b75d6aec90 con 0x55b75d88b1c0 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa825327000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b75d6e0220 con 0x55b75d8d5070 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa825327000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b75d6dd7f0 con 0x55b75d8d5990 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d88b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d88b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41446/0 (socket says 172.21.15.133:41446) 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 -- 172.21.15.133:0/628559884 learned_addr learned my addr 172.21.15.133:0/628559884 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81affd640 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5990 0x55b75d88ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d8d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 -- 172.21.15.133:0/628559884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5990 msgr2=0x55b75d88ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5990 0x55b75d88ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 -- 172.21.15.133:0/628559884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 msgr2=0x55b75d8d5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d8d5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 -- 172.21.15.133:0/628559884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b75d3d5890 con 0x55b75d88b1c0 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.923+0000 7fa81bfff640 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d88b5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa814002120 tx=0x7fa814007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a47d25fd96c598c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa8017fa640 1 -- 172.21.15.133:0/628559884 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814012560 con 0x55b75d88b1c0 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa8017fa640 1 -- 172.21.15.133:0/628559884 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8140126c0 con 0x55b75d88b1c0 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa8017fa640 1 -- 172.21.15.133:0/628559884 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814012a30 con 0x55b75d88b1c0 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- 172.21.15.133:0/628559884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 msgr2=0x55b75d88b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d88b5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa814002120 tx=0x7fa814007410 comp rx=0 tx=0).stop 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- 172.21.15.133:0/628559884 shutdown_connections 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d88b5a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5990 0x55b75d88ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 --2- 172.21.15.133:0/628559884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d8d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- 172.21.15.133:0/628559884 >> 172.21.15.133:0/628559884 conn(0x55b75d891950 msgr2=0x55b75d889560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- 172.21.15.133:0/628559884 shutdown_connections 2023-12-18T10:20:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- 172.21.15.133:0/628559884 wait complete. 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- start start 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 Processor -- start 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d890740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5070 0x55b75d897080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5990 0x55b75d8975c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b75d6d90e0 con 0x55b75d88b1c0 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b75d678310 con 0x55b75d8d5990 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b75d696770 con 0x55b75d8d5070 2023-12-18T10:20:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa825327000 10 client.0 _ll_register_callbacks cb 0x55b75d876b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d890740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d890740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41452/0 (socket says 172.21.15.133:41452) 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 -- 172.21.15.133:0/290040820 learned_addr learned my addr 172.21.15.133:0/290040820 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81affd640 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5070 0x55b75d897080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81bfff640 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5990 0x55b75d8975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 -- 172.21.15.133:0/290040820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5070 msgr2=0x55b75d897080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5070 0x55b75d897080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 -- 172.21.15.133:0/290040820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5990 msgr2=0x55b75d8975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5990 0x55b75d8975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 -- 172.21.15.133:0/290040820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa804003530 con 0x55b75d88b1c0 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d890740 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa80c01a060 tx=0x7fa80c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c2317c7776bf65 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.927+0000 7fa7fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/290040820 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0bfb80 con 0x55b75d88b1c0 2023-12-18T10:20:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/290040820 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa80c0b9040 con 0x55b75d88b1c0 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 -- 172.21.15.133:0/290040820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b75d6a8c10 con 0x55b75d88b1c0 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/290040820 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa80c0bfce0 con 0x55b75d88b1c0 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 10 client.6396 fetch_fsmap learned FSMap version 37 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 -- 172.21.15.133:0/290040820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55b75d69e260 con 0x55b75d88b1c0 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/290040820 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b75d6a8c10 con 0x55b75d88b1c0 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/290040820 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 37) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fa80c0ca070 con 0x55b75d88b1c0 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 10 client.6396 fetch_fsmap finished waiting for FSMap version 37 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 10 client.6396 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 20 client.6396 populate_metadata read hostname 'smithi133' 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b75d8dc8d0 0x55b75d8dccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 4 client.6396 mds_command: new command op to 6162 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 -- 172.21.15.133:0/290040820 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b75d6d7a30 con 0x55b75d8dc8d0 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa81affd640 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b75d8dc8d0 0x55b75d8dccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 10 client.6396 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:20:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa81affd640 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b75d8dc8d0 0x55b75d8dccb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29ceeede7a0d9600 server_cookie=8a3487c854acf11e in_seq=0 out_seq=0 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/290040820 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b75d6d7a30 con 0x55b75d8dc8d0 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 10 client.6396 handle_command_reply: tid=0 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 client.6396 shutdown 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 -- 172.21.15.133:0/290040820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 msgr2=0x55b75d890740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d890740 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa80c01a060 tx=0x7fa80c0046d0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 -- 172.21.15.133:0/290040820 shutdown_connections 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b75d8dc8d0 0x55b75d8dccb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5990 0x55b75d8975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d8d5070 0x55b75d897080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa7fa7fc640 0 client.6396 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 --2- 172.21.15.133:0/290040820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d88b1c0 0x55b75d890740 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 -- 172.21.15.133:0/290040820 >> 172.21.15.133:0/290040820 conn(0x55b75d891950 msgr2=0x55b75d889c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 -- 172.21.15.133:0/290040820 shutdown_connections 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 1 -- 172.21.15.133:0/290040820 wait complete. 2023-12-18T10:20:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.931+0000 7fa825327000 20 client.6396 trim_cache size 0 max 16384 2023-12-18T10:20:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa825327000 1 Processor -- start 2023-12-18T10:20:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa825327000 1 -- start start 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa825327000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d891950 0x55b75d92ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa825327000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d92d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa825327000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d8d5070 0x55b75d92d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa825327000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b75d396940 con 0x55b75d8d5070 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa825327000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b75d88dd70 con 0x55b75d891950 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa825327000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b75d6da670 con 0x55b75d88b1c0 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d8d5070 0x55b75d92d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d891950 0x55b75d92ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81affd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d92d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d8d5070 0x55b75d92d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41468/0 (socket says 172.21.15.133:41468) 2023-12-18T10:20:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 -- 172.21.15.133:0/1316955308 learned_addr learned my addr 172.21.15.133:0/1316955308 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 -- 172.21.15.133:0/1316955308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 msgr2=0x55b75d92d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 --2- 172.21.15.133:0/1316955308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d92d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 -- 172.21.15.133:0/1316955308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d891950 msgr2=0x55b75d92ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 --2- 172.21.15.133:0/1316955308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d891950 0x55b75d92ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 -- 172.21.15.133:0/1316955308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b75d6843b0 con 0x55b75d8d5070 2023-12-18T10:20:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81affd640 1 --2- 172.21.15.133:0/1316955308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d92d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.947+0000 7fa81bfff640 1 --2- 172.21.15.133:0/1316955308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d8d5070 0x55b75d92d950 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa814001440 tx=0x7fa81400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6b3628bdb7c467 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa801ffb640 1 -- 172.21.15.133:0/1316955308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814004d70 con 0x55b75d8d5070 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa801ffb640 1 -- 172.21.15.133:0/1316955308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400b040 con 0x55b75d8d5070 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa801ffb640 1 -- 172.21.15.133:0/1316955308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140127a0 con 0x55b75d8d5070 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- 172.21.15.133:0/1316955308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d8d5070 msgr2=0x55b75d92d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 --2- 172.21.15.133:0/1316955308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d8d5070 0x55b75d92d950 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa814001440 tx=0x7fa81400c000 comp rx=0 tx=0).stop 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- 172.21.15.133:0/1316955308 shutdown_connections 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 --2- 172.21.15.133:0/1316955308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d8d5070 0x55b75d92d950 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 --2- 172.21.15.133:0/1316955308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d92d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 --2- 172.21.15.133:0/1316955308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d891950 0x55b75d92ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- 172.21.15.133:0/1316955308 >> 172.21.15.133:0/1316955308 conn(0x55b75d890d50 msgr2=0x55b75d896f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- 172.21.15.133:0/1316955308 shutdown_connections 2023-12-18T10:20:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- 172.21.15.133:0/1316955308 wait complete. 2023-12-18T10:20:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- start start 2023-12-18T10:20:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 Processor -- start 2023-12-18T10:20:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d932520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d891950 0x55b75d932a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d915d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b75d6e14b0 con 0x55b75d891950 2023-12-18T10:20:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b75d6dd0e0 con 0x55b75d8d5070 2023-12-18T10:20:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b75d6ce1f0 con 0x55b75d88b1c0 2023-12-18T10:20:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa825327000 10 client.0 _ll_register_callbacks cb 0x55b75d687640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d891950 0x55b75d932a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d891950 0x55b75d932a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41470/0 (socket says 172.21.15.133:41470) 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 -- 172.21.15.133:0/85411032 learned_addr learned my addr 172.21.15.133:0/85411032 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d932520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81bfff640 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d915d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 -- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 msgr2=0x55b75d932520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d932520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 -- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 msgr2=0x55b75d915d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d915d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 -- 172.21.15.133:0/85411032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0b36b0 con 0x55b75d891950 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81bfff640 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d915d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa81affd640 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d891950 0x55b75d932a60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa810080c40 tx=0x7fa810005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9083c1493488a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:20:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.951+0000 7fa7fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/85411032 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81006b150 con 0x55b75d891950 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/85411032 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa81006b2b0 con 0x55b75d891950 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 -- 172.21.15.133:0/85411032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b75d69ee00 con 0x55b75d891950 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/85411032 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa81005b8e0 con 0x55b75d891950 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 10 client.6402 fetch_fsmap learned FSMap version 37 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 -- 172.21.15.133:0/85411032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55b75d3d5890 con 0x55b75d891950 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/85411032 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa810075030 con 0x55b75d891950 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/85411032 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 37) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fa81004fc30 con 0x55b75d891950 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 10 client.6402 fetch_fsmap finished waiting for FSMap version 37 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 10 client.6402 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 20 client.6402 populate_metadata read hostname 'smithi133' 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b75d8d5990 0x55b75d9162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 4 client.6402 mds_command: new command op to 6162 tid=0[{"prefix": "status"}] 2023-12-18T10:20:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 -- 172.21.15.133:0/85411032 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b75d6d2160 con 0x55b75d8d5990 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b75d8d5990 0x55b75d9162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa81b7fe640 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b75d8d5990 0x55b75d9162a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc0ef8c445a3e884 server_cookie=7caa0d100dd90064 in_seq=0 out_seq=0 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 10 client.6402 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 1 -- 172.21.15.133:0/85411032 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b75d6d2160 con 0x55b75d8d5990 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 10 client.6402 handle_command_reply: tid=0 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 client.6402 shutdown 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 -- 172.21.15.133:0/85411032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d891950 msgr2=0x55b75d932a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d891950 0x55b75d932a60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa810080c40 tx=0x7fa810005040 comp rx=0 tx=0).stop 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 -- 172.21.15.133:0/85411032 shutdown_connections 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b75d8d5990 0x55b75d9162a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b75d8d5070 0x55b75d915d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b75d891950 0x55b75d932a60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 --2- 172.21.15.133:0/85411032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b75d88b1c0 0x55b75d932520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa7fa7fc640 0 client.6402 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 -- 172.21.15.133:0/85411032 >> 172.21.15.133:0/85411032 conn(0x55b75d890d50 msgr2=0x55b75d8d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 -- 172.21.15.133:0/85411032 shutdown_connections 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 1 -- 172.21.15.133:0/85411032 wait complete. 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa825327000 20 client.6402 trim_cache size 0 max 16384 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 1, 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6162, 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:20:59.964 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:20:59.965 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 2.9910286890000002, 2023-12-18T10:20:59.965 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 37, 2023-12-18T10:20:59.965 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 53, 2023-12-18T10:20:59.965 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 53, 2023-12-18T10:20:59.965 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 19.882123978999999 2023-12-18T10:20:59.965 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:20:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 -- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa808065a60 msgr2=0x7fa808067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa808065a60 0x7fa808067f20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0af000 tx=0x7fa80c0b6040 comp rx=0 tx=0).stop 2023-12-18T10:20:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 -- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa81c0cac10 msgr2=0x7fa81c0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:20:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa81c0cac10 0x7fa81c0cd0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa81000c430 tx=0x7fa81000c8f0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 -- 172.21.15.133:0/1548391308 shutdown_connections 2023-12-18T10:20:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa808065a60 0x7fa808067f20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa81c15a680 0x7fa81c15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa81c0cac10 0x7fa81c0cd0c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 --2- 172.21.15.133:0/1548391308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa81c06fdb0 0x7fa81c0b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:20:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 -- 172.21.15.133:0/1548391308 >> 172.21.15.133:0/1548391308 conn(0x7fa81c06a3e0 msgr2=0x7fa81c0adde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:20:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 -- 172.21.15.133:0/1548391308 shutdown_connections 2023-12-18T10:20:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:20:59.955+0000 7fa821fb3640 1 -- 172.21.15.133:0/1548391308 wait complete. 2023-12-18T10:20:59.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-18T10:21:00.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5b181f640 1 Processor -- start 2023-12-18T10:21:00.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5b181f640 1 -- start start 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5b181f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5b181f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb5ac15d2d0 0x7fb5ac15d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5b181f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac06c140 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5b181f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac15cf10 con 0x7fb5ac15d2d0 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5b181f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac15e000 con 0x7fb5ac15cb30 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5aa7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5ac0cefe0 0x7fb5ac0cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51678/0 (socket says 172.21.15.133:51678) 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/1028267423 learned_addr learned my addr 172.21.15.133:0/1028267423 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/1028267423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5ab7fe640 1 --2- 172.21.15.133:0/1028267423 >> v2:172.21.15.142:3300/0 conn(0x7fb5ac15d2d0 0x7fb5ac15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5a9ffb640 1 -- 172.21.15.133:0/1028267423 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546207072 0 0) 0x7fb5ac06c140 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5a9ffb640 1 -- 172.21.15.133:0/1028267423 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb594003530 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5aaffd640 1 -- 172.21.15.133:0/1028267423 >> v2:172.21.15.142:3300/0 conn(0x7fb5ac15d2d0 msgr2=0x7fb5ac15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/1028267423 >> v2:172.21.15.142:3300/0 conn(0x7fb5ac15d2d0 0x7fb5ac15d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5aaffd640 1 -- 172.21.15.133:0/1028267423 >> v1:172.21.15.133:6789/0 conn(0x7fb5ac0cefe0 legacy=0x7fb5ac0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.119+0000 7fb5aaffd640 1 -- 172.21.15.133:0/1028267423 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac06ae40 con 0x7fb5ac15cb30 2023-12-18T10:21:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/1028267423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac06bc00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0097a0 tx=0x7fb59c01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7c48c347292d27d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5a9ffb640 1 -- 172.21.15.133:0/1028267423 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0a7070 con 0x7fb5ac15cb30 2023-12-18T10:21:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5a9ffb640 1 -- 172.21.15.133:0/1028267423 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0ab430 con 0x7fb5ac15cb30 2023-12-18T10:21:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5a9ffb640 1 -- 172.21.15.133:0/1028267423 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0ab7c0 con 0x7fb5ac15cb30 2023-12-18T10:21:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5b181f640 1 -- 172.21.15.133:0/1028267423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 msgr2=0x7fb5ac06bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5b181f640 1 --2- 172.21.15.133:0/1028267423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac06bc00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0097a0 tx=0x7fb59c01c430 comp rx=0 tx=0).stop 2023-12-18T10:21:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5b181f640 1 -- 172.21.15.133:0/1028267423 shutdown_connections 2023-12-18T10:21:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5b181f640 1 --2- 172.21.15.133:0/1028267423 >> v2:172.21.15.142:3300/0 conn(0x7fb5ac15d2d0 0x7fb5ac15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5b181f640 1 --2- 172.21.15.133:0/1028267423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac06bc00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5b181f640 1 -- 172.21.15.133:0/1028267423 >> 172.21.15.133:0/1028267423 conn(0x7fb5ac089fb0 msgr2=0x7fb5ac09b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5b181f640 1 -- 172.21.15.133:0/1028267423 shutdown_connections 2023-12-18T10:21:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.123+0000 7fb5b181f640 1 -- 172.21.15.133:0/1028267423 wait complete. 2023-12-18T10:21:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 Processor -- start 2023-12-18T10:21:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 -- start start 2023-12-18T10:21:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac0cefe0 0x7fb5ac0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0b4fa0 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1589a0 con 0x7fb5ac15d2d0 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac158c80 con 0x7fb5ac15cb30 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac0cefe0 0x7fb5ac0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac0cefe0 0x7fb5ac0af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41480/0 (socket says 172.21.15.133:41480) 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 -- 172.21.15.133:0/401159465 learned_addr learned my addr 172.21.15.133:0/401159465 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5ab7fe640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 -- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 msgr2=0x7fb5ac153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 -- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac15d2d0 msgr2=0x7fb5ac1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 -- 172.21.15.133:0/401159465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0093b0 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5ab7fe640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac0cefe0 0x7fb5ac0af3d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb59c01a060 tx=0x7fb59c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb593fff640 1 -- 172.21.15.133:0/401159465 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0b45f0 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb593fff640 1 -- 172.21.15.133:0/401159465 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c0b4770 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb593fff640 1 -- 172.21.15.133:0/401159465 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0b4b20 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 -- 172.21.15.133:0/401159465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac158f60 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.127+0000 7fb5b181f640 1 -- 172.21.15.133:0/401159465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac159760 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb593fff640 1 -- 172.21.15.133:0/401159465 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb59c0b4c80 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb593fff640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb598065a60 0x7fb598067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb593fff640 1 -- 172.21.15.133:0/401159465 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb59c11d730 con 0x7fb5ac0cefe0 2023-12-18T10:21:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb598065a60 0x7fb598067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5b4b8d000 1 Processor -- start 2023-12-18T10:21:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5b4b8d000 1 -- start start 2023-12-18T10:21:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb598065a60 0x7fb598067f20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0ceee0 tx=0x7fb5a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232070 0x55e7b9232450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b91e7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 0x55e7b91e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b900bc90 con 0x55e7b9232990 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b903d220 con 0x55e7b9232070 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.131+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7b903a7f0 con 0x55e7b91e81c0 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b91e7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b91e7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41492/0 (socket says 172.21.15.133:41492) 2023-12-18T10:21:00.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/1300917623 learned_addr learned my addr 172.21.15.133:0/1300917623 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232070 0x55e7b9232450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/1300917623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 msgr2=0x55e7b91e85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 0x55e7b91e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/1300917623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232070 msgr2=0x55e7b9232450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232070 0x55e7b9232450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/1300917623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7b8d32890 con 0x55e7b9232990 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232070 0x55e7b9232450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b91e7c80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00015b0 tx=0x7fb5a0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5320c159ca6c5b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5917fa640 1 -- 172.21.15.133:0/1300917623 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000d9a0 con 0x55e7b9232990 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5917fa640 1 -- 172.21.15.133:0/1300917623 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a000db00 con 0x55e7b9232990 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5917fa640 1 -- 172.21.15.133:0/1300917623 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a000deb0 con 0x55e7b9232990 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1300917623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 msgr2=0x55e7b91e7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b91e7c80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00015b0 tx=0x7fb5a0010000 comp rx=0 tx=0).stop 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1300917623 shutdown_connections 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 0x55e7b91e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b91e7c80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1300917623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232070 0x55e7b9232450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1300917623 >> 172.21.15.133:0/1300917623 conn(0x55e7b91ee950 msgr2=0x55e7b91e6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1300917623 shutdown_connections 2023-12-18T10:21:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1300917623 wait complete. 2023-12-18T10:21:00.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- start start 2023-12-18T10:21:00.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 Processor -- start 2023-12-18T10:21:00.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b91e81c0 0x55e7b91ed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 0x55e7b91f4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 0x55e7b91f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b90360e0 con 0x55e7b91e81c0 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8fd5310 con 0x55e7b9232990 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8ff3770 con 0x55e7b9232070 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5b4b8d000 10 client.0 _ll_register_callbacks cb 0x55e7b91d3b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.135+0000 7fb5aaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b91e81c0 0x55e7b91ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b91e81c0 0x55e7b91ed750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41504/0 (socket says 172.21.15.133:41504) 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aaffd640 1 -- 172.21.15.133:0/1672553647 learned_addr learned my addr 172.21.15.133:0/1672553647 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 0x55e7b91f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5ab7fe640 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 0x55e7b91f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aaffd640 1 -- 172.21.15.133:0/1672553647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 msgr2=0x55e7b91f4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 0x55e7b91f4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aaffd640 1 -- 172.21.15.133:0/1672553647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 msgr2=0x55e7b91f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 0x55e7b91f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aaffd640 1 -- 172.21.15.133:0/1672553647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb594003530 con 0x55e7b91e81c0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b91e81c0 0x55e7b91ed750 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0097a0 tx=0x7fb59c0eebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c55be8ef14d973c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 1 -- 172.21.15.133:0/1672553647 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0efde0 con 0x55e7b91e81c0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 1 -- 172.21.15.133:0/1672553647 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb59c0f6bb0 con 0x55e7b91e81c0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1672553647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7b9005c10 con 0x55e7b91e81c0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 1 -- 172.21.15.133:0/1672553647 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb59c106110 con 0x55e7b91e81c0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 10 client.6414 fetch_fsmap learned FSMap version 37 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1672553647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55e7b8ffb260 con 0x55e7b91e81c0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 1 -- 172.21.15.133:0/1672553647 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c11a020 con 0x55e7b91e81c0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 1 -- 172.21.15.133:0/1672553647 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 37) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fb59c0f6720 con 0x55e7b91e81c0 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 10 client.6414 fetch_fsmap finished waiting for FSMap version 37 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 10 client.6414 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:21:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 20 client.6414 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55e7b92398d0 0x55e7b9239cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 4 client.6414 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1672553647 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7b9034a30 con 0x55e7b92398d0 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55e7b92398d0 0x55e7b9239cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55e7b92398d0 0x55e7b9239cb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a59af8dcac277c4c server_cookie=25501206425ef14e in_seq=0 out_seq=0 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 10 client.6414 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 1 -- 172.21.15.133:0/1672553647 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55e7b9034a30 con 0x55e7b92398d0 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 10 client.6414 handle_command_reply: tid=0 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 client.6414 shutdown 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1672553647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b91e81c0 msgr2=0x55e7b91ed750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b91e81c0 0x55e7b91ed750 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0097a0 tx=0x7fb59c0eebd0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1672553647 shutdown_connections 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55e7b92398d0 0x55e7b9239cb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 0x55e7b91f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 0x55e7b91f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb58a7fc640 0 client.6414 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/1672553647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b91e81c0 0x55e7b91ed750 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1672553647 >> 172.21.15.133:0/1672553647 conn(0x55e7b91ee950 msgr2=0x55e7b91e6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1672553647 shutdown_connections 2023-12-18T10:21:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/1672553647 wait complete. 2023-12-18T10:21:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.139+0000 7fb5b4b8d000 20 client.6414 trim_cache size 0 max 16384 2023-12-18T10:21:00.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.155+0000 7fb5b4b8d000 1 Processor -- start 2023-12-18T10:21:00.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.155+0000 7fb5b4b8d000 1 -- start start 2023-12-18T10:21:00.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.155+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 0x55e7b928a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.155+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232070 0x55e7b928a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 0x55e7b928ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8cf3940 con 0x55e7b9232070 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8fde860 con 0x55e7b9232990 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8fdce10 con 0x55e7b91e81c0 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232070 0x55e7b928a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232070 0x55e7b928a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41510/0 (socket says 172.21.15.133:41510) 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/2186684515 learned_addr learned my addr 172.21.15.133:0/2186684515 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 0x55e7b928a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5ab7fe640 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 0x55e7b928ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/2186684515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 msgr2=0x55e7b928a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 0x55e7b928a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/2186684515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 msgr2=0x55e7b928ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 0x55e7b928ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 -- 172.21.15.133:0/2186684515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7b8fe13b0 con 0x55e7b9232070 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5aa7fc640 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232070 0x55e7b928a830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0001550 tx=0x7fb5a0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec1c6a1ccaa1b18 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb591ffb640 1 -- 172.21.15.133:0/2186684515 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a002f270 con 0x55e7b9232070 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb591ffb640 1 -- 172.21.15.133:0/2186684515 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0018070 con 0x55e7b9232070 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb591ffb640 1 -- 172.21.15.133:0/2186684515 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a002fa70 con 0x55e7b9232070 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2186684515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232070 msgr2=0x55e7b928a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232070 0x55e7b928a830 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0001550 tx=0x7fb5a0007000 comp rx=0 tx=0).stop 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2186684515 shutdown_connections 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b9232990 0x55e7b928ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232070 0x55e7b928a830 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2186684515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b91e81c0 0x55e7b928a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2186684515 >> 172.21.15.133:0/2186684515 conn(0x55e7b91ee950 msgr2=0x55e7b91f3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2186684515 shutdown_connections 2023-12-18T10:21:00.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2186684515 wait complete. 2023-12-18T10:21:00.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 -- start start 2023-12-18T10:21:00.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.159+0000 7fb5b4b8d000 1 Processor -- start 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b91e81c0 0x55e7b9273360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 0x55e7b92738a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b9273de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8fdb570 con 0x55e7b9232990 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b9079ce0 con 0x55e7b91e81c0 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7b90338f0 con 0x55e7b9232070 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 10 client.0 _ll_register_callbacks cb 0x55e7b8fe4640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b9273de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5aaffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b91e81c0 0x55e7b9273360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b9273de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41514/0 (socket says 172.21.15.133:41514) 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5aa7fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 0x55e7b92738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 -- 172.21.15.133:0/2638503653 learned_addr learned my addr 172.21.15.133:0/2638503653 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 -- 172.21.15.133:0/2638503653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 msgr2=0x55e7b92738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 0x55e7b92738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 -- 172.21.15.133:0/2638503653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b91e81c0 msgr2=0x55e7b9273360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b91e81c0 0x55e7b9273360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 -- 172.21.15.133:0/2638503653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7b8d32890 con 0x55e7b9232990 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5ab7fe640 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b9273de0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4007e10 tx=0x7fb5a4014690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e38f80ca368247a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 1 -- 172.21.15.133:0/2638503653 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4017440 con 0x55e7b9232990 2023-12-18T10:21:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 1 -- 172.21.15.133:0/2638503653 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb5a40175a0 con 0x55e7b9232990 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2638503653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7b8ffbe00 con 0x55e7b9232990 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 1 -- 172.21.15.133:0/2638503653 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5a4017760 con 0x55e7b9232990 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 10 client.6420 fetch_fsmap learned FSMap version 37 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2638503653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55e7b8d32cc0 con 0x55e7b9232990 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 1 -- 172.21.15.133:0/2638503653 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7b8ffbe00 con 0x55e7b9232990 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 1 -- 172.21.15.133:0/2638503653 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 37) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fb5a40178c0 con 0x55e7b9232990 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 10 client.6420 fetch_fsmap finished waiting for FSMap version 37 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 10 client.6420 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 20 client.6420 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55e7b9274320 0x55e7b9297590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 4 client.6420 mds_command: new command op to 6165 tid=0[{"prefix": "status"}] 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2638503653 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e7b902f160 con 0x55e7b9274320 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55e7b9274320 0x55e7b9297590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 10 client.6420 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5aaffd640 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55e7b9274320 0x55e7b9297590 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7acb8ac526daf3cb server_cookie=c2e94505b5c5eeb in_seq=0 out_seq=0 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 1 -- 172.21.15.133:0/2638503653 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55e7b902f160 con 0x55e7b9274320 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 10 client.6420 handle_command_reply: tid=0 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 client.6420 shutdown 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2638503653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 msgr2=0x55e7b9273de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b9273de0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4007e10 tx=0x7fb5a4014690 comp rx=0 tx=0).stop 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2638503653 shutdown_connections 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55e7b9274320 0x55e7b9297590 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e7b9232990 0x55e7b9273de0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e7b9232070 0x55e7b92738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 --2- 172.21.15.133:0/2638503653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b91e81c0 0x55e7b9273360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb58a7fc640 0 client.6420 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2638503653 >> 172.21.15.133:0/2638503653 conn(0x55e7b91ee950 msgr2=0x55e7b922f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2638503653 shutdown_connections 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.163+0000 7fb5b4b8d000 1 -- 172.21.15.133:0/2638503653 wait complete. 2023-12-18T10:21:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b4b8d000 20 client.6420 trim_cache size 0 max 16384 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6165, 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 15.643961206, 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 37, 2023-12-18T10:21:00.173 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 53, 2023-12-18T10:21:00.174 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 53, 2023-12-18T10:21:00.174 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 20.091394284 2023-12-18T10:21:00.174 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:00.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 -- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb598065a60 msgr2=0x7fb598067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb598065a60 0x7fb598067f20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0ceee0 tx=0x7fb5a0009040 comp rx=0 tx=0).stop 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 -- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac0cefe0 msgr2=0x7fb5ac0af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac0cefe0 0x7fb5ac0af3d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb59c01a060 tx=0x7fb59c0191d0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 -- 172.21.15.133:0/401159465 shutdown_connections 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb598065a60 0x7fb598067f20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb5ac15cb30 0x7fb5ac153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 --2- 172.21.15.133:0/401159465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ac0cefe0 0x7fb5ac0af3d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 -- 172.21.15.133:0/401159465 >> 172.21.15.133:0/401159465 conn(0x7fb5ac089fb0 msgr2=0x7fb5ac0d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 -- 172.21.15.133:0/401159465 shutdown_connections 2023-12-18T10:21:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.167+0000 7fb5b181f640 1 -- 172.21.15.133:0/401159465 wait complete. 2023-12-18T10:21:00.189 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:00.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdbb1ce640 1 Processor -- start 2023-12-18T10:21:00.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdbb1ce640 1 -- start start 2023-12-18T10:21:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdbb1ce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdb415a680 0x7efdb415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdbb1ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 0x7efdb415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdbb1ce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efdb415afa0 0x7efdb406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdbb1ce640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb415f100 con 0x7efdb415a680 2023-12-18T10:21:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdbb1ce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb40ca7d0 con 0x7efdb415afa0 2023-12-18T10:21:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdbb1ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb415e860 con 0x7efdb40cac10 2023-12-18T10:21:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb8f6a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdb415a680 0x7efdb415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb8f6a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdb415a680 0x7efdb415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41526/0 (socket says 172.21.15.133:41526) 2023-12-18T10:21:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb8f6a640 1 -- 172.21.15.133:0/1212659610 learned_addr learned my addr 172.21.15.133:0/1212659610 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb3fff640 1 --2- 172.21.15.133:0/1212659610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 0x7efdb415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb976b640 1 --2- 172.21.15.133:0/1212659610 >> v2:172.21.15.142:3300/0 conn(0x7efdb415afa0 0x7efdb406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb8f6a640 1 -- 172.21.15.133:0/1212659610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 msgr2=0x7efdb415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb8f6a640 1 --2- 172.21.15.133:0/1212659610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 0x7efdb415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb8f6a640 1 -- 172.21.15.133:0/1212659610 >> v2:172.21.15.142:3300/0 conn(0x7efdb415afa0 msgr2=0x7efdb406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb8f6a640 1 --2- 172.21.15.133:0/1212659610 >> v2:172.21.15.142:3300/0 conn(0x7efdb415afa0 0x7efdb406fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.323+0000 7efdb8f6a640 1 -- 172.21.15.133:0/1212659610 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb415eb40 con 0x7efdb415a680 2023-12-18T10:21:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdb8f6a640 1 --2- 172.21.15.133:0/1212659610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415a680 0x7efdb415e160 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efdb40add90 tx=0x7efda801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2c62cc4566b862 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdb37fe640 1 -- 172.21.15.133:0/1212659610 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80ab600 con 0x7efdb415a680 2023-12-18T10:21:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdb37fe640 1 -- 172.21.15.133:0/1212659610 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda80a7050 con 0x7efdb415a680 2023-12-18T10:21:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdb37fe640 1 -- 172.21.15.133:0/1212659610 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80ab980 con 0x7efdb415a680 2023-12-18T10:21:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 -- 172.21.15.133:0/1212659610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415a680 msgr2=0x7efdb415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/1212659610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415a680 0x7efdb415e160 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efdb40add90 tx=0x7efda801c470 comp rx=0 tx=0).stop 2023-12-18T10:21:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 -- 172.21.15.133:0/1212659610 shutdown_connections 2023-12-18T10:21:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/1212659610 >> v2:172.21.15.142:3300/0 conn(0x7efdb415afa0 0x7efdb406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/1212659610 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 0x7efdb415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/1212659610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415a680 0x7efdb415e160 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 -- 172.21.15.133:0/1212659610 >> 172.21.15.133:0/1212659610 conn(0x7efdb406a3e0 msgr2=0x7efdb40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 -- 172.21.15.133:0/1212659610 shutdown_connections 2023-12-18T10:21:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.327+0000 7efdbb1ce640 1 -- 172.21.15.133:0/1212659610 wait complete. 2023-12-18T10:21:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 Processor -- start 2023-12-18T10:21:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 -- start start 2023-12-18T10:21:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 0x7efdb40c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb415a680 0x7efdb40c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415afa0 0x7efdb41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40b11d0 con 0x7efdb415afa0 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40c1c90 con 0x7efdb415a680 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40b3250 con 0x7efdb40cac10 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415afa0 0x7efdb41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415afa0 0x7efdb41587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41532/0 (socket says 172.21.15.133:41532) 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 -- 172.21.15.133:0/32845324 learned_addr learned my addr 172.21.15.133:0/32845324 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb8f6a640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 0x7efdb40c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb3fff640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb415a680 0x7efdb40c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 -- 172.21.15.133:0/32845324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 msgr2=0x7efdb40c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 0x7efdb40c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 -- 172.21.15.133:0/32845324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb415a680 msgr2=0x7efdb40c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb415a680 0x7efdb40c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 -- 172.21.15.133:0/32845324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80094d0 con 0x7efdb415afa0 2023-12-18T10:21:00.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb976b640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415afa0 0x7efdb41587d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efdac007e60 tx=0x7efdac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb17fa640 1 -- 172.21.15.133:0/32845324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac014420 con 0x7efdb415afa0 2023-12-18T10:21:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb17fa640 1 -- 172.21.15.133:0/32845324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac0145a0 con 0x7efdb415afa0 2023-12-18T10:21:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb40c44c0 con 0x7efdb415afa0 2023-12-18T10:21:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdb17fa640 1 -- 172.21.15.133:0/32845324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac014950 con 0x7efdb415afa0 2023-12-18T10:21:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.331+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb40c4a80 con 0x7efdb415afa0 2023-12-18T10:21:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.335+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb40735b0 con 0x7efdb415afa0 2023-12-18T10:21:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.335+0000 7efdb17fa640 1 -- 172.21.15.133:0/32845324 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efdac014ab0 con 0x7efdb415afa0 2023-12-18T10:21:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.335+0000 7efdb17fa640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efd98065a60 0x7efd98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.335+0000 7efdb17fa640 1 -- 172.21.15.133:0/32845324 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efdac083930 con 0x7efdb415afa0 2023-12-18T10:21:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.335+0000 7efdb8f6a640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efd98065a60 0x7efd98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:00.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.335+0000 7efdb8f6a640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efd98065a60 0x7efd98067f20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efdb406ce40 tx=0x7efda8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:00.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.339+0000 7efdb17fa640 1 -- 172.21.15.133:0/32845324 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efdac0512f0 con 0x7efdb415afa0 2023-12-18T10:21:00.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.519+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdb404e000 con 0x7efdb415afa0 2023-12-18T10:21:00.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.519+0000 7efdb17fa640 1 -- 172.21.15.133:0/32845324 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4749 (secure 0 0 0) 0x7efdac054910 con 0x7efdb415afa0 2023-12-18T10:21:00.526 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:00.526 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:20:58.983581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6165,"mds_1":6162,"mds_2":5875},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5875":{"gid":5875,"name":"d","rank":2,"incarnation":36,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6162":{"gid":6162,"name":"a","rank":1,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:21:00.526 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 37 2023-12-18T10:21:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efd98065a60 msgr2=0x7efd98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efd98065a60 0x7efd98067f20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efdb406ce40 tx=0x7efda8009040 comp rx=0 tx=0).stop 2023-12-18T10:21:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415afa0 msgr2=0x7efdb41587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:00.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415afa0 0x7efdb41587d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efdac007e60 tx=0x7efdac00e4b0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 shutdown_connections 2023-12-18T10:21:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efd98065a60 0x7efd98067f20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdb415afa0 0x7efdb41587d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efdb415a680 0x7efdb40c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 --2- 172.21.15.133:0/32845324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efdb40cac10 0x7efdb40c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 >> 172.21.15.133:0/32845324 conn(0x7efdb406a3e0 msgr2=0x7efdb415d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 shutdown_connections 2023-12-18T10:21:00.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:00.523+0000 7efdbb1ce640 1 -- 172.21.15.133:0/32845324 wait complete. 2023-12-18T10:21:00.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:00.548 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:21:00.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:00.578 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:21:00.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:00.641 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-12-18T10:21:00.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:00.693 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-12-18T10:21:00.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:00.744 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-12-18T10:21:00.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:21:00.992 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:21:00.992 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:21:00.992 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:21:02.993 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:21:03.158 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:21:03.159 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:21:03.159 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:21:05.161 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:21:05.327 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:21:05.327 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:21:05.328 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:21:07.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:21:07.492 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:21:07.493 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:21:07.493 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:21:09.494 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:21:09.660 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:21:09.660 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:21:09.660 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:21:11.661 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:21:11.826 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-12-18T10:21:11.826 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:21:11.826 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:21:11.827 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:21:11.983 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:21:11.984 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:21:11.984 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:21:13.985 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:21:14.150 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:21:14.151 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:21:14.151 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:21:16.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:21:16.320 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-12-18T10:21:16.321 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:21:16.321 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:21:16.321 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:21:16.487 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:21:16.487 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:21:16.488 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:21:16.488 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2023-12-18T10:21:16.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.627+0000 7f1263c66640 1 Processor -- start 2023-12-18T10:21:16.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.627+0000 7f1263c66640 1 -- start start 2023-12-18T10:21:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.627+0000 7f1263c66640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f125c0c92b0 0x7f125c160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1263c66640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f125c0ceac0 0x7f125c142020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1263c66640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c142cd0 con 0x7f125c0c9690 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1263c66640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c142fb0 con 0x7f125c0ceac0 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1263c66640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c1604c0 con 0x7f125c0c92b0 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1261201640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f125c0c9690 0x7f125c0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40778/0 (socket says 172.21.15.133:40778) 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1261201640 1 -- 172.21.15.133:0/3274040954 learned_addr learned my addr 172.21.15.133:0/3274040954 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1262203640 1 --2- 172.21.15.133:0/3274040954 >> v2:172.21.15.133:3300/0 conn(0x7f125c0ceac0 0x7f125c142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1261a02640 1 --2- 172.21.15.133:0/3274040954 >> v2:172.21.15.142:3300/0 conn(0x7f125c0c92b0 0x7f125c160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1260a00640 1 -- 172.21.15.133:0/3274040954 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654215971 0 0) 0x7f125c142cd0 con 0x7f125c0c9690 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1260a00640 1 -- 172.21.15.133:0/3274040954 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1248003530 con 0x7f125c0c9690 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1262203640 1 -- 172.21.15.133:0/3274040954 >> v2:172.21.15.142:3300/0 conn(0x7f125c0c92b0 msgr2=0x7f125c160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1262203640 1 --2- 172.21.15.133:0/3274040954 >> v2:172.21.15.142:3300/0 conn(0x7f125c0c92b0 0x7f125c160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1262203640 1 -- 172.21.15.133:0/3274040954 >> v1:172.21.15.133:6789/0 conn(0x7f125c0c9690 legacy=0x7f125c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1262203640 1 -- 172.21.15.133:0/3274040954 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c1607a0 con 0x7f125c0ceac0 2023-12-18T10:21:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.631+0000 7f1262203640 1 --2- 172.21.15.133:0/3274040954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c142020 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f125c0b07c0 tx=0x7f125401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85c62499103d6a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1260a00640 1 -- 172.21.15.133:0/3274040954 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540a5960 con 0x7f125c0ceac0 2023-12-18T10:21:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1260a00640 1 -- 172.21.15.133:0/3274040954 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12540a5ac0 con 0x7f125c0ceac0 2023-12-18T10:21:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1260a00640 1 -- 172.21.15.133:0/3274040954 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540a5e50 con 0x7f125c0ceac0 2023-12-18T10:21:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- 172.21.15.133:0/3274040954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 msgr2=0x7f125c142020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 --2- 172.21.15.133:0/3274040954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c142020 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f125c0b07c0 tx=0x7f125401c880 comp rx=0 tx=0).stop 2023-12-18T10:21:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- 172.21.15.133:0/3274040954 shutdown_connections 2023-12-18T10:21:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 --2- 172.21.15.133:0/3274040954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c142020 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 --2- 172.21.15.133:0/3274040954 >> v2:172.21.15.142:3300/0 conn(0x7f125c0c92b0 0x7f125c160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- 172.21.15.133:0/3274040954 >> 172.21.15.133:0/3274040954 conn(0x7f125c06a2a0 msgr2=0x7f125c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- 172.21.15.133:0/3274040954 shutdown_connections 2023-12-18T10:21:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- 172.21.15.133:0/3274040954 wait complete. 2023-12-18T10:21:16.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 Processor -- start 2023-12-18T10:21:16.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- start start 2023-12-18T10:21:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f125c0c92b0 0x7f125c0ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f125c0c9690 0x7f125c0ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0af3c0 con 0x7f125c0ceac0 2023-12-18T10:21:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0abab0 con 0x7f125c0c92b0 2023-12-18T10:21:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.635+0000 7f1263c66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0abd90 con 0x7f125c0c9690 2023-12-18T10:21:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c0cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57506/0 (socket says 172.21.15.133:57506) 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 -- 172.21.15.133:0/2943879560 learned_addr learned my addr 172.21.15.133:0/2943879560 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1261201640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f125c0c9690 0x7f125c0ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1261a02640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f125c0c92b0 0x7f125c0ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 -- 172.21.15.133:0/2943879560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f125c0c9690 msgr2=0x7f125c0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f125c0c9690 0x7f125c0ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 -- 172.21.15.133:0/2943879560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f125c0c92b0 msgr2=0x7f125c0ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f125c0c92b0 0x7f125c0ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 -- 172.21.15.133:0/2943879560 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254009a70 con 0x7f125c0ceac0 2023-12-18T10:21:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1262203640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c0cd4a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1254019490 tx=0x7f1254019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f12527fc640 1 -- 172.21.15.133:0/2943879560 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540aec90 con 0x7f125c0ceac0 2023-12-18T10:21:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f12527fc640 1 -- 172.21.15.133:0/2943879560 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12540aedf0 con 0x7f125c0ceac0 2023-12-18T10:21:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f12527fc640 1 -- 172.21.15.133:0/2943879560 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540b7650 con 0x7f125c0ceac0 2023-12-18T10:21:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1263c66640 1 -- 172.21.15.133:0/2943879560 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c159c90 con 0x7f125c0ceac0 2023-12-18T10:21:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f1263c66640 1 -- 172.21.15.133:0/2943879560 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c1599a0 con 0x7f125c0ceac0 2023-12-18T10:21:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.639+0000 7f12527fc640 1 -- 172.21.15.133:0/2943879560 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f12540b4050 con 0x7f125c0ceac0 2023-12-18T10:21:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f12527fc640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1240065a60 0x7f1240067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f12527fc640 1 -- 172.21.15.133:0/2943879560 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f125411e3e0 con 0x7f125c0ceac0 2023-12-18T10:21:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1261a02640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1240065a60 0x7f1240067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 Processor -- start 2023-12-18T10:21:16.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- start start 2023-12-18T10:21:16.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1261a02640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1240065a60 0x7f1240067f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1258009b60 tx=0x7f1258009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d82f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82f5a0 0x55903d7e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d7e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d6ad430 con 0x55903d7e4fc0 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d63b460 con 0x55903d82ec80 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55903d638a30 con 0x55903d82f5a0 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d7e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d7e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57508/0 (socket says 172.21.15.133:57508) 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 -- 172.21.15.133:0/4118792725 learned_addr learned my addr 172.21.15.133:0/4118792725 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1261a02640 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d82f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1261201640 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82f5a0 0x55903d7e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 -- 172.21.15.133:0/4118792725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82f5a0 msgr2=0x55903d7e4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82f5a0 0x55903d7e4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 -- 172.21.15.133:0/4118792725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 msgr2=0x55903d82f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d82f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 -- 172.21.15.133:0/4118792725 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55903d330e20 con 0x55903d7e4fc0 2023-12-18T10:21:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1262203640 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d7e53a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1254098480 tx=0x7f12540ef830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2427c802cedc0f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f123f7fe640 1 -- 172.21.15.133:0/4118792725 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540f36b0 con 0x55903d7e4fc0 2023-12-18T10:21:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f123f7fe640 1 -- 172.21.15.133:0/4118792725 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12540f7860 con 0x55903d7e4fc0 2023-12-18T10:21:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f123f7fe640 1 -- 172.21.15.133:0/4118792725 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125411e0b0 con 0x55903d7e4fc0 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- 172.21.15.133:0/4118792725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 msgr2=0x55903d7e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d7e53a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1254098480 tx=0x7f12540ef830 comp rx=0 tx=0).stop 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- 172.21.15.133:0/4118792725 shutdown_connections 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d7e53a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82f5a0 0x55903d7e4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4118792725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d82f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- 172.21.15.133:0/4118792725 >> 172.21.15.133:0/4118792725 conn(0x55903d5e3910 msgr2=0x55903d7e3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- 172.21.15.133:0/4118792725 shutdown_connections 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.643+0000 7f1266fd5000 1 -- 172.21.15.133:0/4118792725 wait complete. 2023-12-18T10:21:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 -- start start 2023-12-18T10:21:16.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 Processor -- start 2023-12-18T10:21:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d835f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d836460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d7efe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d634320 con 0x55903d82f5a0 2023-12-18T10:21:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d5d34f0 con 0x55903d82ec80 2023-12-18T10:21:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55903d5f16e0 con 0x55903d7e4fc0 2023-12-18T10:21:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 10 client.0 _ll_register_callbacks cb 0x55903d7d0980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1262203640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d7efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1261a02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d835f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1261a02640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d835f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:51170/0 (socket says 172.21.15.133:51170) 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1261a02640 1 -- 172.21.15.133:0/4211043686 learned_addr learned my addr 172.21.15.133:0/4211043686 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1262203640 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d7efe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57518/0 (socket says 172.21.15.133:57518) 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1261201640 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d836460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1262203640 1 -- 172.21.15.133:0/4211043686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 msgr2=0x55903d835f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1262203640 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d835f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1262203640 1 -- 172.21.15.133:0/4211043686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 msgr2=0x55903d836460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1262203640 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d836460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1262203640 1 -- 172.21.15.133:0/4211043686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c1599a0 con 0x55903d82f5a0 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1261201640 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d836460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1262203640 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d7efe50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f125411c730 tx=0x7f1254009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b785b9607aaa660 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f123cff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f123cff9640 1 -- 172.21.15.133:0/4211043686 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540f3730 con 0x55903d82f5a0 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f123cff9640 1 -- 172.21.15.133:0/4211043686 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12540efb90 con 0x55903d82f5a0 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 -- 172.21.15.133:0/4211043686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55903d5f1120 con 0x55903d82f5a0 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f123cff9640 1 -- 172.21.15.133:0/4211043686 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12540efd50 con 0x55903d82f5a0 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 10 client.6441 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 -- 172.21.15.133:0/4211043686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55903d5f9250 con 0x55903d82f5a0 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f123cff9640 1 -- 172.21.15.133:0/4211043686 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55903d5f1120 con 0x55903d82f5a0 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f123cff9640 1 -- 172.21.15.133:0/4211043686 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f1254104070 con 0x55903d82f5a0 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 10 client.6441 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 10 client.6441 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 20 client.6441 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55903d7f0b90 0x55903d7f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 4 client.6441 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:16.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1266fd5000 1 -- 172.21.15.133:0/4211043686 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55903d632c70 con 0x55903d7f0b90 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.647+0000 7f1261a02640 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55903d7f0b90 0x55903d7f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1261a02640 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55903d7f0b90 0x55903d7f0f70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76f12d86cc050046 server_cookie=4e3d8eee9df0b34b in_seq=0 out_seq=0 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f123cff9640 10 client.6441 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f123cff9640 1 -- 172.21.15.133:0/4211043686 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55903d632c70 con 0x55903d7f0b90 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f123cff9640 10 client.6441 handle_command_reply: tid=0 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 client.6441 shutdown 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 -- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 msgr2=0x55903d7efe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d7efe50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f125411c730 tx=0x7f1254009750 comp rx=0 tx=0).stop 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 -- 172.21.15.133:0/4211043686 shutdown_connections 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55903d7f0b90 0x55903d7f0f70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d7efe50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d836460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f123cff9640 0 client.6441 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 --2- 172.21.15.133:0/4211043686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d835f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 -- 172.21.15.133:0/4211043686 >> 172.21.15.133:0/4211043686 conn(0x55903d5e3910 msgr2=0x55903d7e3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 -- 172.21.15.133:0/4211043686 shutdown_connections 2023-12-18T10:21:16.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 1 -- 172.21.15.133:0/4211043686 wait complete. 2023-12-18T10:21:16.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.651+0000 7f1266fd5000 20 client.6441 trim_cache size 0 max 16384 2023-12-18T10:21:16.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1266fd5000 1 Processor -- start 2023-12-18T10:21:16.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1266fd5000 1 -- start start 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d8349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82ec80 0x55903d834f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82f5a0 0x55903d827120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1266fd5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d2f1aa0 con 0x55903d7e4fc0 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1266fd5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d62fc90 con 0x55903d82f5a0 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1266fd5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55903d5f2480 con 0x55903d82ec80 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d8349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d8349e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57524/0 (socket says 172.21.15.133:57524) 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 -- 172.21.15.133:0/2346228443 learned_addr learned my addr 172.21.15.133:0/2346228443 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261201640 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82ec80 0x55903d834f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1262203640 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82f5a0 0x55903d827120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 -- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82ec80 msgr2=0x55903d834f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82ec80 0x55903d834f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 -- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82f5a0 msgr2=0x55903d827120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82f5a0 0x55903d827120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 -- 172.21.15.133:0/2346228443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55903d5df5a0 con 0x55903d7e4fc0 2023-12-18T10:21:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1262203640 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82f5a0 0x55903d827120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.663+0000 7f1261a02640 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d8349e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1258012010 tx=0x7f1258018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276cafc803626ab server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f123ffff640 1 -- 172.21.15.133:0/2346228443 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125801c040 con 0x55903d7e4fc0 2023-12-18T10:21:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f123ffff640 1 -- 172.21.15.133:0/2346228443 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125802a250 con 0x55903d7e4fc0 2023-12-18T10:21:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f123ffff640 1 -- 172.21.15.133:0/2346228443 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125802a820 con 0x55903d7e4fc0 2023-12-18T10:21:16.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- 172.21.15.133:0/2346228443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 msgr2=0x55903d8349e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d8349e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1258012010 tx=0x7f1258018000 comp rx=0 tx=0).stop 2023-12-18T10:21:16.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- 172.21.15.133:0/2346228443 shutdown_connections 2023-12-18T10:21:16.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82f5a0 0x55903d827120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d82ec80 0x55903d834f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2346228443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d7e4fc0 0x55903d8349e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- 172.21.15.133:0/2346228443 >> 172.21.15.133:0/2346228443 conn(0x55903d5e3910 msgr2=0x55903d8332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- 172.21.15.133:0/2346228443 shutdown_connections 2023-12-18T10:21:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- 172.21.15.133:0/2346228443 wait complete. 2023-12-18T10:21:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- start start 2023-12-18T10:21:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 Processor -- start 2023-12-18T10:21:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d88c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d88ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d891350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d7e4ae0 con 0x55903d82f5a0 2023-12-18T10:21:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d63c6f0 con 0x55903d82ec80 2023-12-18T10:21:16.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55903d6ebe50 con 0x55903d7e4fc0 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1266fd5000 10 client.0 _ll_register_callbacks cb 0x55903d5eb710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d891350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d891350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57532/0 (socket says 172.21.15.133:57532) 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 -- 172.21.15.133:0/2546044756 learned_addr learned my addr 172.21.15.133:0/2546044756 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1261a02640 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d88c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1261201640 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d88ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 -- 172.21.15.133:0/2546044756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 msgr2=0x55903d88c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d88c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 -- 172.21.15.133:0/2546044756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 msgr2=0x55903d88ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d88ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 -- 172.21.15.133:0/2546044756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55903d5d3110 con 0x55903d82f5a0 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f1262203640 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d891350 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f125401d120 tx=0x7f12540ebc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85abee519ea8ecb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f123cff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:16.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.667+0000 7f123cff9640 1 -- 172.21.15.133:0/2546044756 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540f75d0 con 0x55903d82f5a0 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f123cff9640 1 -- 172.21.15.133:0/2546044756 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12540f36b0 con 0x55903d82f5a0 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 1 -- 172.21.15.133:0/2546044756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55903d5fd6a0 con 0x55903d82f5a0 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f123cff9640 1 -- 172.21.15.133:0/2546044756 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f125410d420 con 0x55903d82f5a0 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 10 client.6447 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 1 -- 172.21.15.133:0/2546044756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55903d561e50 con 0x55903d82f5a0 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f123cff9640 1 -- 172.21.15.133:0/2546044756 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125411a080 con 0x55903d82f5a0 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f123cff9640 1 -- 172.21.15.133:0/2546044756 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f1254104040 con 0x55903d82f5a0 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 10 client.6447 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 10 client.6447 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 20 client.6447 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55903d891890 0x55903d893c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 4 client.6447 mds_command: new command op to 6165 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:21:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1266fd5000 1 -- 172.21.15.133:0/2546044756 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55903d62d3a0 con 0x55903d891890 2023-12-18T10:21:16.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1261a02640 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55903d891890 0x55903d893c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f1261a02640 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55903d891890 0x55903d893c80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2fd851af8680f98 server_cookie=c741b0b4b66cce8d in_seq=0 out_seq=0 2023-12-18T10:21:16.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.671+0000 7f123cff9640 10 client.6447 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:16.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f123cff9640 1 -- 172.21.15.133:0/2546044756 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55903d62d3a0 con 0x55903d891890 2023-12-18T10:21:16.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f123cff9640 10 client.6447 handle_command_reply: tid=0 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 client.6447 shutdown 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 -- 172.21.15.133:0/2546044756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 msgr2=0x55903d891350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d891350 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f125401d120 tx=0x7f12540ebc70 comp rx=0 tx=0).stop 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 -- 172.21.15.133:0/2546044756 shutdown_connections 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55903d891890 0x55903d893c80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55903d82f5a0 0x55903d891350 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d82ec80 0x55903d88ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 --2- 172.21.15.133:0/2546044756 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55903d7e4fc0 0x55903d88c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f123cff9640 0 client.6447 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 -- 172.21.15.133:0/2546044756 >> 172.21.15.133:0/2546044756 conn(0x55903d5e3910 msgr2=0x55903d8352f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 -- 172.21.15.133:0/2546044756 shutdown_connections 2023-12-18T10:21:16.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 1 -- 172.21.15.133:0/2546044756 wait complete. 2023-12-18T10:21:16.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.687+0000 7f1266fd5000 20 client.6447 trim_cache size 0 max 16384 2023-12-18T10:21:16.695 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:16.695 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:21:16.695 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:21:16.695 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 -- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1240065a60 msgr2=0x7f1240067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1240065a60 0x7f1240067f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1258009b60 tx=0x7f1258009190 comp rx=0 tx=0).stop 2023-12-18T10:21:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 -- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 msgr2=0x7f125c0cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c0cd4a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1254019490 tx=0x7f1254019620 comp rx=0 tx=0).stop 2023-12-18T10:21:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 -- 172.21.15.133:0/2943879560 shutdown_connections 2023-12-18T10:21:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1240065a60 0x7f1240067f20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f125c0ceac0 0x7f125c0cd4a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f125c0c9690 0x7f125c0ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 --2- 172.21.15.133:0/2943879560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f125c0c92b0 0x7f125c0ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 -- 172.21.15.133:0/2943879560 >> 172.21.15.133:0/2943879560 conn(0x7f125c06a2a0 msgr2=0x7f125c0cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 -- 172.21.15.133:0/2943879560 shutdown_connections 2023-12-18T10:21:16.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.691+0000 7f1263c66640 1 -- 172.21.15.133:0/2943879560 wait complete. 2023-12-18T10:21:16.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 flush journal 2023-12-18T10:21:16.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.847+0000 7fb001b39640 1 Processor -- start 2023-12-18T10:21:16.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.847+0000 7fb001b39640 1 -- start start 2023-12-18T10:21:16.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7fb001b39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faffc0ca410 0x7faffc159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7fb001b39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faffc0cbff0 0x7faffc0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7fb001b39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc0cc930 con 0x7faffc159fb0 2023-12-18T10:21:16.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7fb001b39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc15aab0 con 0x7faffc0cbff0 2023-12-18T10:21:16.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7fb001b39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc070df0 con 0x7faffc0ca410 2023-12-18T10:21:16.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faffc0cbff0 0x7faffc0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faffc0cbff0 0x7faffc0cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57538/0 (socket says 172.21.15.133:57538) 2023-12-18T10:21:16.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffbfff640 1 -- 172.21.15.133:0/3756745060 learned_addr learned my addr 172.21.15.133:0/3756745060 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffb7fe640 1 --2- 172.21.15.133:0/3756745060 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ca410 0x7faffc159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffbfff640 1 -- 172.21.15.133:0/3756745060 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ca410 msgr2=0x7faffc159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffbfff640 1 --2- 172.21.15.133:0/3756745060 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ca410 0x7faffc159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffbfff640 1 -- 172.21.15.133:0/3756745060 >> v1:172.21.15.142:6789/0 conn(0x7faffc159fb0 legacy=0x7faffc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffbfff640 1 -- 172.21.15.133:0/3756745060 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc15a4f0 con 0x7faffc0cbff0 2023-12-18T10:21:16.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.851+0000 7faffb7fe640 1 --2- 172.21.15.133:0/3756745060 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ca410 0x7faffc159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:16.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7faffbfff640 1 --2- 172.21.15.133:0/3756745060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0cc3f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7faffc0cbfa0 tx=0x7faff401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc29c8b666015c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7faffa7fc640 1 -- 172.21.15.133:0/3756745060 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40a5860 con 0x7faffc0cbff0 2023-12-18T10:21:16.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7faffa7fc640 1 -- 172.21.15.133:0/3756745060 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff40a59c0 con 0x7faffc0cbff0 2023-12-18T10:21:16.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7faffa7fc640 1 -- 172.21.15.133:0/3756745060 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40a5d50 con 0x7faffc0cbff0 2023-12-18T10:21:16.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- 172.21.15.133:0/3756745060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 msgr2=0x7faffc0cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 --2- 172.21.15.133:0/3756745060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0cc3f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7faffc0cbfa0 tx=0x7faff401c9a0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- 172.21.15.133:0/3756745060 shutdown_connections 2023-12-18T10:21:16.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 --2- 172.21.15.133:0/3756745060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0cc3f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 --2- 172.21.15.133:0/3756745060 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ca410 0x7faffc159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- 172.21.15.133:0/3756745060 >> 172.21.15.133:0/3756745060 conn(0x7faffc06a2a0 msgr2=0x7faffc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- 172.21.15.133:0/3756745060 shutdown_connections 2023-12-18T10:21:16.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- 172.21.15.133:0/3756745060 wait complete. 2023-12-18T10:21:16.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 Processor -- start 2023-12-18T10:21:16.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- start start 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0ca410 0x7faffc0a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc159fb0 0x7faffc152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc1542c0 con 0x7faffc0cbff0 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc153770 con 0x7faffc159fb0 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.855+0000 7fb001b39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc153a50 con 0x7faffc0ca410 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57548/0 (socket says 172.21.15.133:57548) 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 -- 172.21.15.133:0/3325686051 learned_addr learned my addr 172.21.15.133:0/3325686051 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffb7fe640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0ca410 0x7faffc0a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffbfff640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc159fb0 0x7faffc152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 -- 172.21.15.133:0/3325686051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0ca410 msgr2=0x7faffc0a7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0ca410 0x7faffc0a7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 -- 172.21.15.133:0/3325686051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc159fb0 msgr2=0x7faffc152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc159fb0 0x7faffc152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 -- 172.21.15.133:0/3325686051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec009420 con 0x7faffc0cbff0 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7faffaffd640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0c4930 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7faff000c4d0 tx=0x7faff000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7fafe3fff640 1 -- 172.21.15.133:0/3325686051 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00052d0 con 0x7faffc0cbff0 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7fafe3fff640 1 -- 172.21.15.133:0/3325686051 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff0005430 con 0x7faffc0cbff0 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7fafe3fff640 1 -- 172.21.15.133:0/3325686051 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0012830 con 0x7faffc0cbff0 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7fb001b39640 1 -- 172.21.15.133:0/3325686051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff4009b30 con 0x7faffc0cbff0 2023-12-18T10:21:16.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7fb001b39640 1 -- 172.21.15.133:0/3325686051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc154510 con 0x7faffc0cbff0 2023-12-18T10:21:16.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.859+0000 7fafe3fff640 1 -- 172.21.15.133:0/3325686051 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faff0012990 con 0x7faffc0cbff0 2023-12-18T10:21:16.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fafe3fff640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe8065a60 0x7fafe8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fafe3fff640 1 -- 172.21.15.133:0/3325686051 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faff0082c90 con 0x7faffc0cbff0 2023-12-18T10:21:16.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffb7fe640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe8065a60 0x7fafe8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 Processor -- start 2023-12-18T10:21:16.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- start start 2023-12-18T10:21:16.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffb7fe640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe8065a60 0x7fafe8067f20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fafec009c50 tx=0x7fafec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a052060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a007a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0083a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563869ed0430 con 0x56386a0525a0 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563869e5e460 con 0x56386a007fc0 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563869e5ba30 con 0x56386a051c80 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a007a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffb7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a052060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a007a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57562/0 (socket says 172.21.15.133:57562) 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 -- 172.21.15.133:0/3632659560 learned_addr learned my addr 172.21.15.133:0/3632659560 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffbfff640 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0083a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 -- 172.21.15.133:0/3632659560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 msgr2=0x56386a052060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a052060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 -- 172.21.15.133:0/3632659560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 msgr2=0x56386a0083a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0083a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 -- 172.21.15.133:0/3632659560 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563869b53e20 con 0x56386a0525a0 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffb7fe640 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a052060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:16.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7faffaffd640 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a007a80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faff005bc70 tx=0x7faff000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713795122b5b0994 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fafe17fa640 1 -- 172.21.15.133:0/3632659560 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff006b070 con 0x56386a0525a0 2023-12-18T10:21:16.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fafe17fa640 1 -- 172.21.15.133:0/3632659560 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff005a070 con 0x56386a0525a0 2023-12-18T10:21:16.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fafe17fa640 1 -- 172.21.15.133:0/3632659560 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0052610 con 0x56386a0525a0 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- 172.21.15.133:0/3632659560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 msgr2=0x56386a007a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a007a80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faff005bc70 tx=0x7faff000f000 comp rx=0 tx=0).stop 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- 172.21.15.133:0/3632659560 shutdown_connections 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0083a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a007a80 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 --2- 172.21.15.133:0/3632659560 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a052060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- 172.21.15.133:0/3632659560 >> 172.21.15.133:0/3632659560 conn(0x563869e06910 msgr2=0x56386a006360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- 172.21.15.133:0/3632659560 shutdown_connections 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.863+0000 7fb004ea4000 1 -- 172.21.15.133:0/3632659560 wait complete. 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 -- start start 2023-12-18T10:21:16.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 Processor -- start 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a007fc0 0x56386a052980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a051c80 0x56386a052ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 0x56386a053400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563869e57320 con 0x56386a007fc0 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563869df64f0 con 0x56386a051c80 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563869e146e0 con 0x56386a0525a0 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 10 client.0 _ll_register_callbacks cb 0x563869ff3980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a007fc0 0x56386a052980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a007fc0 0x56386a052980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57570/0 (socket says 172.21.15.133:57570) 2023-12-18T10:21:16.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffb7fe640 1 -- 172.21.15.133:0/4229319551 learned_addr learned my addr 172.21.15.133:0/4229319551 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffaffd640 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a051c80 0x56386a052ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffbfff640 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 0x56386a053400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffaffd640 1 -- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 msgr2=0x56386a053400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffaffd640 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 0x56386a053400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffaffd640 1 -- 172.21.15.133:0/4229319551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a007fc0 msgr2=0x56386a052980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffaffd640 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a007fc0 0x56386a052980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffaffd640 1 -- 172.21.15.133:0/4229319551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec009c80 con 0x56386a051c80 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffaffd640 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a051c80 0x56386a052ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faff0000fc0 tx=0x7faff0000ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dda525b8140dc4ad server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fafda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fafda7fc640 1 -- 172.21.15.133:0/4229319551 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff006b050 con 0x56386a051c80 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 -- 172.21.15.133:0/4229319551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563869e14120 con 0x56386a051c80 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fafda7fc640 1 -- 172.21.15.133:0/4229319551 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faff0050980 con 0x56386a051c80 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fafda7fc640 1 -- 172.21.15.133:0/4229319551 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7faff00011d0 con 0x56386a051c80 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 10 client.6133 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 -- 172.21.15.133:0/4229319551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x7faffc154510 con 0x56386a051c80 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fafda7fc640 1 -- 172.21.15.133:0/4229319551 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563869e14120 con 0x56386a051c80 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fafda7fc640 1 -- 172.21.15.133:0/4229319551 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7faff0019020 con 0x56386a051c80 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 10 client.6133 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 10 client.6133 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.a 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 20 client.6133 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x56386a061840 0x56386a063c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 4 client.6133 mds_command: new command op to 6162 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7fb004ea4000 1 -- 172.21.15.133:0/4229319551 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563869e55c70 con 0x56386a061840 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.867+0000 7faffb7fe640 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x56386a061840 0x56386a063c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fafda7fc640 10 client.6133 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:16.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7faffb7fe640 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x56386a061840 0x56386a063c30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ff2ba45397b85429 server_cookie=7b0b4bf2d92313b3 in_seq=0 out_seq=0 2023-12-18T10:21:16.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fafda7fc640 1 -- 172.21.15.133:0/4229319551 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563869e55c70 con 0x56386a061840 2023-12-18T10:21:16.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fafda7fc640 10 client.6133 handle_command_reply: tid=0 2023-12-18T10:21:16.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 client.6133 shutdown 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 -- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a051c80 msgr2=0x56386a052ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a051c80 0x56386a052ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faff0000fc0 tx=0x7faff0000ee0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 -- 172.21.15.133:0/4229319551 shutdown_connections 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x56386a061840 0x56386a063c30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 0x56386a053400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a051c80 0x56386a052ec0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 --2- 172.21.15.133:0/4229319551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a007fc0 0x56386a052980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fafda7fc640 0 client.6133 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 -- 172.21.15.133:0/4229319551 >> 172.21.15.133:0/4229319551 conn(0x563869e06910 msgr2=0x56386a006a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 -- 172.21.15.133:0/4229319551 shutdown_connections 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 1 -- 172.21.15.133:0/4229319551 wait complete. 2023-12-18T10:21:16.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.871+0000 7fb004ea4000 20 client.6133 trim_cache size 0 max 16384 2023-12-18T10:21:16.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fb004ea4000 1 Processor -- start 2023-12-18T10:21:16.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fb004ea4000 1 -- start start 2023-12-18T10:21:16.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a051c80 0x56386a065180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 0x56386a04b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fb004ea4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563869b14aa0 con 0x56386a051c80 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fb004ea4000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563869e54b30 con 0x56386a007fc0 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fb004ea4000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563869f26140 con 0x56386a0525a0 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a051c80 0x56386a065180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a051c80 0x56386a065180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57572/0 (socket says 172.21.15.133:57572) 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 -- 172.21.15.133:0/2001120614 learned_addr learned my addr 172.21.15.133:0/2001120614 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffbfff640 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 0x56386a04b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffb7fe640 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 -- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 msgr2=0x56386a04b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 0x56386a04b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 -- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 msgr2=0x56386a064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 -- 172.21.15.133:0/2001120614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563869e1c250 con 0x56386a051c80 2023-12-18T10:21:16.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffb7fe640 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:16.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7faffaffd640 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a051c80 0x56386a065180 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faff005bc70 tx=0x7faff007d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9821d9de4c483d69 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fafe1ffb640 1 -- 172.21.15.133:0/2001120614 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff006b040 con 0x56386a051c80 2023-12-18T10:21:16.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fafe1ffb640 1 -- 172.21.15.133:0/2001120614 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff000e040 con 0x56386a051c80 2023-12-18T10:21:16.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.883+0000 7fafe1ffb640 1 -- 172.21.15.133:0/2001120614 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00011d0 con 0x56386a051c80 2023-12-18T10:21:16.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- 172.21.15.133:0/2001120614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a051c80 msgr2=0x56386a065180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a051c80 0x56386a065180 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faff005bc70 tx=0x7faff007d000 comp rx=0 tx=0).stop 2023-12-18T10:21:16.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- 172.21.15.133:0/2001120614 shutdown_connections 2023-12-18T10:21:16.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a0525a0 0x56386a04b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a051c80 0x56386a065180 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2001120614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- 172.21.15.133:0/2001120614 >> 172.21.15.133:0/2001120614 conn(0x563869e06910 msgr2=0x56386a00d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- 172.21.15.133:0/2001120614 shutdown_connections 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- 172.21.15.133:0/2001120614 wait complete. 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- start start 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 Processor -- start 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a0b8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a04dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56386a007ae0 con 0x56386a0525a0 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563869dfc820 con 0x56386a007fc0 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563869e59e80 con 0x56386a051c80 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 10 client.0 _ll_register_callbacks cb 0x563869e0e710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a04dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffb7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a04dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57588/0 (socket says 172.21.15.133:57588) 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffaffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a0b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 -- 172.21.15.133:0/2106540114 learned_addr learned my addr 172.21.15.133:0/2106540114 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 -- 172.21.15.133:0/2106540114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 msgr2=0x56386a0b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a0b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 -- 172.21.15.133:0/2106540114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 msgr2=0x56386a0b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 -- 172.21.15.133:0/2106540114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc154510 con 0x56386a0525a0 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffb7fe640 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7faffbfff640 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a04dc50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faff40af040 tx=0x7faff401b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf5fc9ff564585d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fafda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fafda7fc640 1 -- 172.21.15.133:0/2106540114 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40c0480 con 0x56386a0525a0 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fafda7fc640 1 -- 172.21.15.133:0/2106540114 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faff40bb040 con 0x56386a0525a0 2023-12-18T10:21:16.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fb004ea4000 1 -- 172.21.15.133:0/2106540114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563869e206a0 con 0x56386a0525a0 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.887+0000 7fafda7fc640 1 -- 172.21.15.133:0/2106540114 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7faff40c05e0 con 0x56386a0525a0 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fb004ea4000 10 client.6465 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fb004ea4000 1 -- 172.21.15.133:0/2106540114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x563869e025a0 con 0x56386a0525a0 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fafda7fc640 1 -- 172.21.15.133:0/2106540114 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563869e206a0 con 0x56386a0525a0 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fafda7fc640 1 -- 172.21.15.133:0/2106540114 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7faff40c0740 con 0x56386a0525a0 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fb004ea4000 10 client.6465 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fb004ea4000 10 client.6465 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.a 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fb004ea4000 20 client.6465 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x56386a04e190 0x56386a04e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fb004ea4000 4 client.6465 mds_command: new command op to 6162 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fb004ea4000 1 -- 172.21.15.133:0/2106540114 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563869e503a0 con 0x56386a04e190 2023-12-18T10:21:16.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7faffb7fe640 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x56386a04e190 0x56386a04e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:16.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7faffb7fe640 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x56386a04e190 0x56386a04e5a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b85da0b4344f9bfb server_cookie=1d13de5f9289c73b in_seq=0 out_seq=0 2023-12-18T10:21:16.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.891+0000 7fafda7fc640 10 client.6465 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:16.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fafda7fc640 1 -- 172.21.15.133:0/2106540114 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563869e503a0 con 0x56386a04e190 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fafda7fc640 10 client.6465 handle_command_reply: tid=0 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 client.6465 shutdown 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 -- 172.21.15.133:0/2106540114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 msgr2=0x56386a04dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a04dc50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7faff40af040 tx=0x7faff401b1e0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 -- 172.21.15.133:0/2106540114 shutdown_connections 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x56386a04e190 0x56386a04e5a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56386a0525a0 0x56386a04dc50 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56386a051c80 0x56386a0b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fafda7fc640 0 client.6465 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 --2- 172.21.15.133:0/2106540114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56386a007fc0 0x56386a0b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 -- 172.21.15.133:0/2106540114 >> 172.21.15.133:0/2106540114 conn(0x563869e06910 msgr2=0x56386a063c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 -- 172.21.15.133:0/2106540114 shutdown_connections 2023-12-18T10:21:16.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 1 -- 172.21.15.133:0/2106540114 wait complete. 2023-12-18T10:21:16.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb004ea4000 20 client.6465 trim_cache size 0 max 16384 2023-12-18T10:21:16.909 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:16.909 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:21:16.909 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:21:16.909 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 -- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe8065a60 msgr2=0x7fafe8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe8065a60 0x7fafe8067f20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fafec009c50 tx=0x7fafec009190 comp rx=0 tx=0).stop 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 -- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 msgr2=0x7faffc0c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0c4930 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7faff000c4d0 tx=0x7faff000c990 comp rx=0 tx=0).stop 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 -- 172.21.15.133:0/3325686051 shutdown_connections 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe8065a60 0x7fafe8067f20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc159fb0 0x7faffc152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc0cbff0 0x7faffc0c4930 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 --2- 172.21.15.133:0/3325686051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0ca410 0x7faffc0a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:16.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 -- 172.21.15.133:0/3325686051 >> 172.21.15.133:0/3325686051 conn(0x7faffc06a2a0 msgr2=0x7faffc156580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:16.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 -- 172.21.15.133:0/3325686051 shutdown_connections 2023-12-18T10:21:16.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:16.903+0000 7fb001b39640 1 -- 172.21.15.133:0/3325686051 wait complete. 2023-12-18T10:21:16.927 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:2 flush journal 2023-12-18T10:21:17.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc51d96640 1 Processor -- start 2023-12-18T10:21:17.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc51d96640 1 -- start start 2023-12-18T10:21:17.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc51d96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0ca410 0x7fcc4c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc51d96640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c070df0 con 0x7fcc4c159fb0 2023-12-18T10:21:17.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc51d96640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c15a4f0 con 0x7fcc4c0cbff0 2023-12-18T10:21:17.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc51d96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c15aab0 con 0x7fcc4c0ca410 2023-12-18T10:21:17.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4affd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcc4c159fb0 0x7fcc4c071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40788/0 (socket says 172.21.15.133:40788) 2023-12-18T10:21:17.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4affd640 1 -- 172.21.15.133:0/3092408759 learned_addr learned my addr 172.21.15.133:0/3092408759 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:17.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/3092408759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0ca410 0x7fcc4c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4a7fc640 1 -- 172.21.15.133:0/3092408759 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786792789 0 0) 0x7fcc4c070df0 con 0x7fcc4c159fb0 2023-12-18T10:21:17.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4a7fc640 1 -- 172.21.15.133:0/3092408759 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc34003530 con 0x7fcc4c159fb0 2023-12-18T10:21:17.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4a7fc640 1 -- 172.21.15.133:0/3092408759 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683560305 0 0) 0x7fcc4c15a4f0 con 0x7fcc4c0cbff0 2023-12-18T10:21:17.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4a7fc640 1 -- 172.21.15.133:0/3092408759 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc4c070df0 con 0x7fcc4c0cbff0 2023-12-18T10:21:17.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/3092408759 >> v1:172.21.15.142:6789/0 conn(0x7fcc4c0cbff0 legacy=0x7fcc4c0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/3092408759 >> v1:172.21.15.133:6789/0 conn(0x7fcc4c159fb0 legacy=0x7fcc4c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.063+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/3092408759 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c15a7d0 con 0x7fcc4c0ca410 2023-12-18T10:21:17.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/3092408759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0ca410 0x7fcc4c159a70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0097f0 tx=0x7fcc3c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6da4d5690b16dd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc4a7fc640 1 -- 172.21.15.133:0/3092408759 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0aa5f0 con 0x7fcc4c0ca410 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc4a7fc640 1 -- 172.21.15.133:0/3092408759 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0aa750 con 0x7fcc4c0ca410 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc4a7fc640 1 -- 172.21.15.133:0/3092408759 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0aaae0 con 0x7fcc4c0ca410 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc51d96640 1 -- 172.21.15.133:0/3092408759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0ca410 msgr2=0x7fcc4c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc51d96640 1 --2- 172.21.15.133:0/3092408759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0ca410 0x7fcc4c159a70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0097f0 tx=0x7fcc3c01c490 comp rx=0 tx=0).stop 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc51d96640 1 -- 172.21.15.133:0/3092408759 shutdown_connections 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc51d96640 1 --2- 172.21.15.133:0/3092408759 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0ca410 0x7fcc4c159a70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc51d96640 1 -- 172.21.15.133:0/3092408759 >> 172.21.15.133:0/3092408759 conn(0x7fcc4c06a2a0 msgr2=0x7fcc4c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc51d96640 1 -- 172.21.15.133:0/3092408759 shutdown_connections 2023-12-18T10:21:17.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.067+0000 7fcc51d96640 1 -- 172.21.15.133:0/3092408759 wait complete. 2023-12-18T10:21:17.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 Processor -- start 2023-12-18T10:21:17.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 -- start start 2023-12-18T10:21:17.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc4c0ca410 0x7fcc4c0c1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0cbff0 0x7fcc4c0c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c159fb0 0x7fcc4c0c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c2760 con 0x7fcc4c0ca410 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c2a40 con 0x7fcc4c159fb0 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c2d20 con 0x7fcc4c0cbff0 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc4c0ca410 0x7fcc4c0c1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc4c0ca410 0x7fcc4c0c1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57600/0 (socket says 172.21.15.133:57600) 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/471344091 learned_addr learned my addr 172.21.15.133:0/471344091 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4affd640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0cbff0 0x7fcc4c0c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4bfff640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c159fb0 0x7fcc4c0c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/471344091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0cbff0 msgr2=0x7fcc4c0c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0cbff0 0x7fcc4c0c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/471344091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c159fb0 msgr2=0x7fcc4c0c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c159fb0 0x7fcc4c0c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/471344091 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c009420 con 0x7fcc4c0ca410 2023-12-18T10:21:17.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc4c0ca410 0x7fcc4c0c1f30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0097f0 tx=0x7fcc3c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:17.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc33fff640 1 -- 172.21.15.133:0/471344091 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0be610 con 0x7fcc4c0ca410 2023-12-18T10:21:17.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc33fff640 1 -- 172.21.15.133:0/471344091 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0be770 con 0x7fcc4c0ca410 2023-12-18T10:21:17.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 -- 172.21.15.133:0/471344091 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c0c3000 con 0x7fcc4c0ca410 2023-12-18T10:21:17.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc33fff640 1 -- 172.21.15.133:0/471344091 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0beb20 con 0x7fcc4c0ca410 2023-12-18T10:21:17.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.071+0000 7fcc51d96640 1 -- 172.21.15.133:0/471344091 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c0c2470 con 0x7fcc4c0ca410 2023-12-18T10:21:17.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.075+0000 7fcc33fff640 1 -- 172.21.15.133:0/471344091 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcc3c0bec80 con 0x7fcc4c0ca410 2023-12-18T10:21:17.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.075+0000 7fcc33fff640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc38065a60 0x7fcc38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.075+0000 7fcc33fff640 1 -- 172.21.15.133:0/471344091 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcc3c0a7070 con 0x7fcc4c0ca410 2023-12-18T10:21:17.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.075+0000 7fcc4affd640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc38065a60 0x7fcc38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.075+0000 7fcc550ea000 1 Processor -- start 2023-12-18T10:21:17.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.075+0000 7fcc550ea000 1 -- start start 2023-12-18T10:21:17.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.075+0000 7fcc4affd640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc38065a60 0x7fcc38067f20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c1fcb50 tx=0x7fcc40007d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:17.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075ded1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 0x56075ded23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075dd9a430 con 0x56075df1bc80 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075dd28460 con 0x56075ded1fc0 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56075dd25a30 con 0x56075df1c5a0 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57604/0 (socket says 172.21.15.133:57604) 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/720984236 learned_addr learned my addr 172.21.15.133:0/720984236 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4affd640 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075ded1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4bfff640 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 0x56075ded23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 msgr2=0x56075ded1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075ded1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 msgr2=0x56075ded23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 0x56075ded23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/720984236 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56075da1de20 con 0x56075df1bc80 2023-12-18T10:21:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4affd640 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075ded1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1c060 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0f6a70 tx=0x7fcc3c0eb4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad59cc9e0facbead server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc317fa640 1 -- 172.21.15.133:0/720984236 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0f2df0 con 0x56075df1bc80 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc317fa640 1 -- 172.21.15.133:0/720984236 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0f6fa0 con 0x56075df1bc80 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc317fa640 1 -- 172.21.15.133:0/720984236 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0eb780 con 0x56075df1bc80 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- 172.21.15.133:0/720984236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 msgr2=0x56075df1c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1c060 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0f6a70 tx=0x7fcc3c0eb4b0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- 172.21.15.133:0/720984236 shutdown_connections 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 0x56075ded23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075ded1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 --2- 172.21.15.133:0/720984236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1c060 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- 172.21.15.133:0/720984236 >> 172.21.15.133:0/720984236 conn(0x56075dcd0910 msgr2=0x56075ded0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:17.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- 172.21.15.133:0/720984236 shutdown_connections 2023-12-18T10:21:17.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- 172.21.15.133:0/720984236 wait complete. 2023-12-18T10:21:17.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 -- start start 2023-12-18T10:21:17.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.079+0000 7fcc550ea000 1 Processor -- start 2023-12-18T10:21:17.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 0x56075df1c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075df1d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075dd21320 con 0x56075df1bc80 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075dcc04f0 con 0x56075ded1fc0 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56075dcde6e0 con 0x56075df1c5a0 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 10 client.0 _ll_register_callbacks cb 0x56075debd980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57620/0 (socket says 172.21.15.133:57620) 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 -- 172.21.15.133:0/300372788 learned_addr learned my addr 172.21.15.133:0/300372788 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4bfff640 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075df1d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 0x56075df1c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 -- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 msgr2=0x56075df1d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075df1d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 -- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 msgr2=0x56075df1c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 0x56075df1c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 -- 172.21.15.133:0/300372788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c0c2470 con 0x56075df1bc80 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4bfff640 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075df1d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4affd640 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1cec0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcc40006cc0 tx=0x7fcc40001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2b58ec870a731d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/300372788 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc400135c0 con 0x56075df1bc80 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- 172.21.15.133:0/300372788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56075dcde120 con 0x56075df1bc80 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/300372788 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcc4001c040 con 0x56075df1bc80 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/300372788 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc40013720 con 0x56075df1bc80 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 10 client.6477 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- 172.21.15.133:0/300372788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x56075dce6250 con 0x56075df1bc80 2023-12-18T10:21:17.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/300372788 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56075dcde120 con 0x56075df1bc80 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/300372788 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fcc40012070 con 0x56075df1bc80 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 10 client.6477 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 10 client.6477 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 20 client.6477 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x56075df1de10 0x56075df2d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 4 client.6477 mds_command: new command op to 5875 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- 172.21.15.133:0/300372788 --> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56075dd1fc70 con 0x56075df1de10 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x56075df1de10 0x56075df2d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x56075df1de10 0x56075df2d850 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=102abfd48c858329 server_cookie=5fb9c76fbcc35f2a in_seq=0 out_seq=0 2023-12-18T10:21:17.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 10 client.6477 ms_handle_connect on v2:172.21.15.142:6832/2140881005 2023-12-18T10:21:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/300372788 <== mds.2 v2:172.21.15.142:6832/2140881005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56075dd1fc70 con 0x56075df1de10 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 10 client.6477 handle_command_reply: tid=0 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 client.6477 shutdown 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- 172.21.15.133:0/300372788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 msgr2=0x56075df1cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1cec0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcc40006cc0 tx=0x7fcc40001160 comp rx=0 tx=0).stop 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- 172.21.15.133:0/300372788 shutdown_connections 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x56075df1de10 0x56075df2d850 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1c5a0 0x56075df1d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1bc80 0x56075df1cec0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc2a7fc640 0 client.6477 ms_handle_reset on v2:172.21.15.142:6832/2140881005 2023-12-18T10:21:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 --2- 172.21.15.133:0/300372788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075ded1fc0 0x56075df1c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- 172.21.15.133:0/300372788 >> 172.21.15.133:0/300372788 conn(0x56075dcd0910 msgr2=0x56075ded0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- 172.21.15.133:0/300372788 shutdown_connections 2023-12-18T10:21:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 1 -- 172.21.15.133:0/300372788 wait complete. 2023-12-18T10:21:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.083+0000 7fcc550ea000 20 client.6477 trim_cache size 0 max 16384 2023-12-18T10:21:17.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 Processor -- start 2023-12-18T10:21:17.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- start start 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075ded1fc0 0x56075df2e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1bc80 0x56075df2eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1c5a0 0x56075df15010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075d9deaa0 con 0x56075ded1fc0 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075dd201b0 con 0x56075df1c5a0 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56075dd1e720 con 0x56075df1bc80 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075ded1fc0 0x56075df2e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075ded1fc0 0x56075df2e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57626/0 (socket says 172.21.15.133:57626) 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/2424248777 learned_addr learned my addr 172.21.15.133:0/2424248777 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4affd640 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1bc80 0x56075df2eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4bfff640 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1c5a0 0x56075df15010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1bc80 msgr2=0x56075df2eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1bc80 0x56075df2eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1c5a0 msgr2=0x56075df15010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1c5a0 0x56075df15010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/2424248777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56075dccc5a0 con 0x56075ded1fc0 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4bfff640 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1c5a0 0x56075df15010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075ded1fc0 0x56075df2e860 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c000c10 tx=0x7fcc3c0f2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574977fed3a58cd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc31ffb640 1 -- 172.21.15.133:0/2424248777 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c11b040 con 0x56075ded1fc0 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc31ffb640 1 -- 172.21.15.133:0/2424248777 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c115e90 con 0x56075ded1fc0 2023-12-18T10:21:17.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc31ffb640 1 -- 172.21.15.133:0/2424248777 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0eb3b0 con 0x56075ded1fc0 2023-12-18T10:21:17.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- 172.21.15.133:0/2424248777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075ded1fc0 msgr2=0x56075df2e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075ded1fc0 0x56075df2e860 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c000c10 tx=0x7fcc3c0f2000 comp rx=0 tx=0).stop 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- 172.21.15.133:0/2424248777 shutdown_connections 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1c5a0 0x56075df15010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075df1bc80 0x56075df2eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 --2- 172.21.15.133:0/2424248777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075ded1fc0 0x56075df2e860 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- 172.21.15.133:0/2424248777 >> 172.21.15.133:0/2424248777 conn(0x56075dcd0910 msgr2=0x56075ded7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- 172.21.15.133:0/2424248777 shutdown_connections 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- 172.21.15.133:0/2424248777 wait complete. 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 -- start start 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.099+0000 7fcc550ea000 1 Processor -- start 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075ded1fc0 0x56075df17c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1bc80 0x56075df18190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1c5a0 0x56075df186d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075ddf0140 con 0x56075df1c5a0 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56075dcdf480 con 0x56075df1bc80 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56075dd23e80 con 0x56075ded1fc0 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 10 client.0 _ll_register_callbacks cb 0x56075dcd8710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075ded1fc0 0x56075df17c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075ded1fc0 0x56075df17c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:51278/0 (socket says 172.21.15.133:51278) 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/1568975866 learned_addr learned my addr 172.21.15.133:0/1568975866 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4affd640 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1bc80 0x56075df18190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4bfff640 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1c5a0 0x56075df186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1bc80 msgr2=0x56075df18190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1bc80 0x56075df18190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/1568975866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1c5a0 msgr2=0x56075df186d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1c5a0 0x56075df186d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 -- 172.21.15.133:0/1568975866 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56075da1de20 con 0x56075ded1fc0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4b7fe640 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075ded1fc0 0x56075df17c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c11bd50 tx=0x7fcc3c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=503342ec6a11b6ba server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.142:3301/0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/1568975866 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c11b040 con 0x56075ded1fc0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/1568975866 <== mon.2 v2:172.21.15.142:3301/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcc3c0f2df0 con 0x56075ded1fc0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 -- 172.21.15.133:0/1568975866 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56075ded5940 con 0x56075ded1fc0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/1568975866 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc3c0eb3b0 con 0x56075ded1fc0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 10 client.5723 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 -- 172.21.15.133:0/1568975866 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x56075dcc0110 con 0x56075ded1fc0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/1568975866 <== mon.2 v2:172.21.15.142:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56075ded5940 con 0x56075ded1fc0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/1568975866 <== mon.2 v2:172.21.15.142:3301/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fcc3c0c7020 con 0x56075ded1fc0 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 10 client.5723 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 10 client.5723 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 20 client.5723 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x56075df75440 0x56075df18c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:17.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 4 client.5723 mds_command: new command op to 5875 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:21:17.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc550ea000 1 -- 172.21.15.133:0/1568975866 --> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56075dcea6a0 con 0x56075df75440 2023-12-18T10:21:17.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4affd640 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x56075df75440 0x56075df18c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:17.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc2a7fc640 10 client.5723 ms_handle_connect on v2:172.21.15.142:6832/2140881005 2023-12-18T10:21:17.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.103+0000 7fcc4affd640 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x56075df75440 0x56075df18c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3454c0bbff20a352 server_cookie=914d5a129575e16f in_seq=0 out_seq=0 2023-12-18T10:21:17.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc2a7fc640 1 -- 172.21.15.133:0/1568975866 <== mds.2 v2:172.21.15.142:6832/2140881005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56075dcea6a0 con 0x56075df75440 2023-12-18T10:21:17.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc2a7fc640 10 client.5723 handle_command_reply: tid=0 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 client.5723 shutdown 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 -- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075ded1fc0 msgr2=0x56075df17c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075ded1fc0 0x56075df17c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c11bd50 tx=0x7fcc3c01c490 comp rx=0 tx=0).stop 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 -- 172.21.15.133:0/1568975866 shutdown_connections 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x56075df75440 0x56075df18c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56075df1c5a0 0x56075df186d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc2a7fc640 0 client.5723 ms_handle_reset on v2:172.21.15.142:6832/2140881005 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56075df1bc80 0x56075df18190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 --2- 172.21.15.133:0/1568975866 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56075ded1fc0 0x56075df17c50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 -- 172.21.15.133:0/1568975866 >> 172.21.15.133:0/1568975866 conn(0x56075dcd0910 msgr2=0x56075df2d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 -- 172.21.15.133:0/1568975866 shutdown_connections 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 1 -- 172.21.15.133:0/1568975866 wait complete. 2023-12-18T10:21:17.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc550ea000 20 client.5723 trim_cache size 0 max 16384 2023-12-18T10:21:17.125 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:17.125 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:21:17.125 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:21:17.125 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 -- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc38065a60 msgr2=0x7fcc38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc38065a60 0x7fcc38067f20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c1fcb50 tx=0x7fcc40007d80 comp rx=0 tx=0).stop 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 -- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc4c0ca410 msgr2=0x7fcc4c0c1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc4c0ca410 0x7fcc4c0c1f30 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0097f0 tx=0x7fcc3c01acd0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 -- 172.21.15.133:0/471344091 shutdown_connections 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc38065a60 0x7fcc38067f20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc4c159fb0 0x7fcc4c0c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc4c0cbff0 0x7fcc4c0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 --2- 172.21.15.133:0/471344091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc4c0ca410 0x7fcc4c0c1f30 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 -- 172.21.15.133:0/471344091 >> 172.21.15.133:0/471344091 conn(0x7fcc4c06a2a0 msgr2=0x7fcc4c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 -- 172.21.15.133:0/471344091 shutdown_connections 2023-12-18T10:21:17.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:17.119+0000 7fcc51d96640 1 -- 172.21.15.133:0/471344091 wait complete. 2023-12-18T10:21:17.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:17.143 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-12-18T10:21:17.177 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/ 2023-12-18T10:21:17.177 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4 2023-12-18T10:21:17.177 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5 2023-12-18T10:21:17.177 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6 2023-12-18T10:21:17.177 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7 2023-12-18T10:21:17.177 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-12-18T10:21:17.178 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:21:17.178 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:21:17.178 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:21:17.178 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:17.178 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-12-18T10:21:17.178 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:21:17.289 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627778 2023-12-18T10:21:17.478 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:21:17.479 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:21:17.479 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:21:17.479 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:17.479 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-12-18T10:21:17.479 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:21:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627779 2023-12-18T10:21:17.779 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:21:17.779 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:21:17.779 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:21:17.779 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:17.779 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-12-18T10:21:17.779 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:21:17.885 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627780 2023-12-18T10:21:18.074 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:21:18.074 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:21:18.075 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:21:18.075 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:18.075 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-12-18T10:21:18.075 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:21:18.181 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627781 2023-12-18T10:21:18.370 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:21:18.370 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:21:18.370 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:21:18.370 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:18.370 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-12-18T10:21:18.370 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:21:18.481 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627782 2023-12-18T10:21:18.669 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:21:18.669 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:21:18.669 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:21:18.670 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:18.670 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-12-18T10:21:18.670 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:21:18.782 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627783 2023-12-18T10:21:18.971 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2023-12-18T10:21:19.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 Processor -- start 2023-12-18T10:21:19.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- start start 2023-12-18T10:21:19.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a15895210 0x563a15926d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a158955f0 0x563a159ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158afa30 0x563a159ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a157ac4d0 con 0x563a158955f0 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a157ac1d0 con 0x563a158afa30 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a157a2e40 con 0x563a15895210 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a158955f0 0x563a159ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a158955f0 0x563a159ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57640/0 (socket says 172.21.15.133:57640) 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 -- 172.21.15.133:0/1451556117 learned_addr learned my addr 172.21.15.133:0/1451556117 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e488f8640 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158afa30 0x563a159ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e480f7640 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a15895210 0x563a15926d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 -- 172.21.15.133:0/1451556117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a15895210 msgr2=0x563a15926d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a15895210 0x563a15926d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 -- 172.21.15.133:0/1451556117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158afa30 msgr2=0x563a159ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158afa30 0x563a159ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 -- 172.21.15.133:0/1451556117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e38005d30 con 0x563a158955f0 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e478f6640 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a158955f0 0x563a159ce310 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001c70 tx=0x7f2e3c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79da018147cb792b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e468f4640 1 -- 172.21.15.133:0/1451556117 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00e480 con 0x563a158955f0 2023-12-18T10:21:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e468f4640 1 -- 172.21.15.133:0/1451556117 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00e5e0 con 0x563a158955f0 2023-12-18T10:21:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e468f4640 1 -- 172.21.15.133:0/1451556117 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00e990 con 0x563a158955f0 2023-12-18T10:21:19.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- 172.21.15.133:0/1451556117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a158955f0 msgr2=0x563a159ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a158955f0 0x563a159ce310 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001c70 tx=0x7f2e3c00b6d0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- 172.21.15.133:0/1451556117 shutdown_connections 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158afa30 0x563a159ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a158955f0 0x563a159ce310 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 --2- 172.21.15.133:0/1451556117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a15895210 0x563a15926d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- 172.21.15.133:0/1451556117 >> 172.21.15.133:0/1451556117 conn(0x563a15863b50 msgr2=0x563a15896060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- 172.21.15.133:0/1451556117 shutdown_connections 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- 172.21.15.133:0/1451556117 wait complete. 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 Processor -- start 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.063+0000 7f2e4a5db080 1 -- start start 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e4a5db080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a15895210 0x563a1590af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e4a5db080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158955f0 0x563a158ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e4a5db080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a158afa30 0x563a158aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e4a5db080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a1588bd70 con 0x563a15895210 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e4a5db080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a158ad780 con 0x563a158955f0 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e4a5db080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a158ada20 con 0x563a158afa30 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a15895210 0x563a1590af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a15895210 0x563a1590af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57642/0 (socket says 172.21.15.133:57642) 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 -- 172.21.15.133:0/4225407210 learned_addr learned my addr 172.21.15.133:0/4225407210 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e488f8640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a158afa30 0x563a158aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e478f6640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158955f0 0x563a158ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 -- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a158afa30 msgr2=0x563a158aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a158afa30 0x563a158aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 -- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158955f0 msgr2=0x563a158ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a158955f0 0x563a158ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 -- 172.21.15.133:0/4225407210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e30001e20 con 0x563a15895210 2023-12-18T10:21:19.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e480f7640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a15895210 0x563a1590af40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2e3801b790 tx=0x7f2e3801a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e458f2640 1 -- 172.21.15.133:0/4225407210 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380af640 con 0x563a15895210 2023-12-18T10:21:19.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e458f2640 1 -- 172.21.15.133:0/4225407210 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e380af7a0 con 0x563a15895210 2023-12-18T10:21:19.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e458f2640 1 -- 172.21.15.133:0/4225407210 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e380afb10 con 0x563a15895210 2023-12-18T10:21:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a157bb070 con 0x563a15895210 2023-12-18T10:21:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a157ae4b0 con 0x563a15895210 2023-12-18T10:21:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.067+0000 7f2e458f2640 1 -- 172.21.15.133:0/4225407210 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2e380b6070 con 0x563a15895210 2023-12-18T10:21:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e458f2640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e34064410 0x7f2e340668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e458f2640 1 -- 172.21.15.133:0/4225407210 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e381206c0 con 0x563a15895210 2023-12-18T10:21:19.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e478f6640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e34064410 0x7f2e340668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x563a1590b480 0x563a159d5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- osd_op(unknown.0.0:1 7.12 7:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x563a158ad200 con 0x563a1590b480 2023-12-18T10:21:19.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e478f6640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e34064410 0x7f2e340668d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001b60 tx=0x7f2e3c01b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e488f8640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x563a1590b480 0x563a159d5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e488f8640 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x563a1590b480 0x563a159d5270 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e488f8640 1 -- 172.21.15.133:0/4225407210 <== osd.6 v2:172.21.15.142:6824/38346 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v53'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2e40002ad0 con 0x563a1590b480 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x563a1590b480 msgr2=0x563a159d5270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x563a1590b480 0x563a159d5270 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e34064410 msgr2=0x7f2e340668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e34064410 0x7f2e340668d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001b60 tx=0x7f2e3c01b040 comp rx=0 tx=0).stop 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a15895210 msgr2=0x563a1590af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 --2- 172.21.15.133:0/4225407210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a15895210 0x563a1590af40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2e3801b790 tx=0x7f2e3801a900 comp rx=0 tx=0).stop 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e488f8640 1 -- 172.21.15.133:0/4225407210 reap_dead start 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 shutdown_connections 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.071+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 >> 172.21.15.133:0/4225407210 conn(0x563a15863b50 msgr2=0x563a158960d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.075+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 shutdown_connections 2023-12-18T10:21:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.075+0000 7f2e4a5db080 1 -- 172.21.15.133:0/4225407210 wait complete. 2023-12-18T10:21:19.082 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2023-12-18T10:21:19.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b8157080 1 Processor -- start 2023-12-18T10:21:19.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b8157080 1 -- start start 2023-12-18T10:21:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b8157080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347030220 0x557347006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b8157080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557347032190 0x5573470d5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b8157080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5573470d82b0 0x557347027d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b8157080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557346f4a4d0 con 0x5573470d82b0 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b8157080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557346f4a1d0 con 0x557347030220 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b8157080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x557346f40e40 con 0x557347032190 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b6472640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5573470d82b0 0x557347027d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b6472640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5573470d82b0 0x557347027d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57664/0 (socket says 172.21.15.133:57664) 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b6472640 1 -- 172.21.15.133:0/47582141 learned_addr learned my addr 172.21.15.133:0/47582141 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b5470640 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557347032190 0x5573470d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b5c71640 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347030220 0x557347006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b6472640 1 -- 172.21.15.133:0/47582141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557347032190 msgr2=0x5573470d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b6472640 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557347032190 0x5573470d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b6472640 1 -- 172.21.15.133:0/47582141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347030220 msgr2=0x557347006b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b6472640 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347030220 0x557347006b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.123+0000 7f67b6472640 1 -- 172.21.15.133:0/47582141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac005df0 con 0x5573470d82b0 2023-12-18T10:21:19.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b6472640 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5573470d82b0 0x557347027d30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009710 tx=0x7f67b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cda5a739369edf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67a7fff640 1 -- 172.21.15.133:0/47582141 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b000bae0 con 0x5573470d82b0 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67a7fff640 1 -- 172.21.15.133:0/47582141 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b000bc60 con 0x5573470d82b0 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67a7fff640 1 -- 172.21.15.133:0/47582141 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0009e20 con 0x5573470d82b0 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- 172.21.15.133:0/47582141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5573470d82b0 msgr2=0x557347027d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5573470d82b0 0x557347027d30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009710 tx=0x7f67b0009bd0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- 172.21.15.133:0/47582141 shutdown_connections 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5573470d82b0 0x557347027d30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557347032190 0x5573470d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 --2- 172.21.15.133:0/47582141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347030220 0x557347006b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- 172.21.15.133:0/47582141 >> 172.21.15.133:0/47582141 conn(0x55734702ee00 msgr2=0x557347007350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- 172.21.15.133:0/47582141 shutdown_connections 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- 172.21.15.133:0/47582141 wait complete. 2023-12-18T10:21:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 Processor -- start 2023-12-18T10:21:19.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- start start 2023-12-18T10:21:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557347030220 0x5573470d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347032190 0x55734704c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5573470d82b0 0x557347028980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573470bd620 con 0x557347030220 2023-12-18T10:21:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573470d1840 con 0x557347032190 2023-12-18T10:21:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573470d1ae0 con 0x5573470d82b0 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557347030220 0x5573470d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557347030220 0x5573470d0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57680/0 (socket says 172.21.15.133:57680) 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 -- 172.21.15.133:0/960789703 learned_addr learned my addr 172.21.15.133:0/960789703 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5470640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347032190 0x55734704c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b6472640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5573470d82b0 0x557347028980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 -- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5573470d82b0 msgr2=0x557347028980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5573470d82b0 0x557347028980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 -- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347032190 msgr2=0x55734704c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557347032190 0x55734704c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 -- 172.21.15.133:0/960789703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b00092e0 con 0x557347030220 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b5c71640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557347030220 0x5573470d0fa0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f67a800a610 tx=0x7f67a800aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67a6ffd640 1 -- 172.21.15.133:0/960789703 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8010070 con 0x557347030220 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67a6ffd640 1 -- 172.21.15.133:0/960789703 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a8008780 con 0x557347030220 2023-12-18T10:21:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557346f59070 con 0x557347030220 2023-12-18T10:21:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.127+0000 7f67a6ffd640 1 -- 172.21.15.133:0/960789703 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8005ce0 con 0x557347030220 2023-12-18T10:21:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557346f4c4b0 con 0x557347030220 2023-12-18T10:21:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67a6ffd640 1 -- 172.21.15.133:0/960789703 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f67a8006040 con 0x557347030220 2023-12-18T10:21:19.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67a6ffd640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6798064410 0x7f67980668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67a6ffd640 1 -- 172.21.15.133:0/960789703 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f67a80816c0 con 0x557347030220 2023-12-18T10:21:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67b5470640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6798064410 0x7f67980668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67b8157080 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55734704c9e0 0x5573470bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- osd_op(unknown.0.0:1 7.12 7:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x5573470c0340 con 0x55734704c9e0 2023-12-18T10:21:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67b6472640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55734704c9e0 0x5573470bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.131+0000 7f67b5470640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6798064410 0x7f67980668d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0ac000 tx=0x7f67ac0a5000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b6472640 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55734704c9e0 0x5573470bdf60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b6472640 1 -- 172.21.15.133:0/960789703 <== osd.6 v2:172.21.15.142:6824/38346 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v53'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f67b000bdd0 con 0x55734704c9e0 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55734704c9e0 msgr2=0x5573470bdf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55734704c9e0 0x5573470bdf60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6798064410 msgr2=0x7f67980668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6798064410 0x7f67980668d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0ac000 tx=0x7f67ac0a5000 comp rx=0 tx=0).stop 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557347030220 msgr2=0x5573470d0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 --2- 172.21.15.133:0/960789703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557347030220 0x5573470d0fa0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f67a800a610 tx=0x7f67a800aad0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b6472640 1 -- 172.21.15.133:0/960789703 reap_dead start 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 shutdown_connections 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 >> 172.21.15.133:0/960789703 conn(0x55734702ee00 msgr2=0x5573470d5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 shutdown_connections 2023-12-18T10:21:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.135+0000 7f67b8157080 1 -- 172.21.15.133:0/960789703 wait complete. 2023-12-18T10:21:19.144 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2023-12-18T10:21:19.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff2132f080 1 Processor -- start 2023-12-18T10:21:19.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff2132f080 1 -- start start 2023-12-18T10:21:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff2132f080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a0f930 0x557a28ab18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff2132f080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557a28a11190 0x557a28b4be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff2132f080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a28ab72b0 0x557a28b4c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff2132f080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a289294d0 con 0x557a28a0f930 2023-12-18T10:21:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff2132f080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a289291d0 con 0x557a28ab72b0 2023-12-18T10:21:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff2132f080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a2891fe40 con 0x557a28a11190 2023-12-18T10:21:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a0f930 0x557a28ab18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a0f930 0x557a28ab18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57688/0 (socket says 172.21.15.133:57688) 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 -- 172.21.15.133:0/1138170515 learned_addr learned my addr 172.21.15.133:0/1138170515 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 -- 172.21.15.133:0/1138170515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557a28a11190 msgr2=0x557a28b4be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 --2- 172.21.15.133:0/1138170515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557a28a11190 0x557a28b4be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 -- 172.21.15.133:0/1138170515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a28ab72b0 msgr2=0x557a28b4c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 --2- 172.21.15.133:0/1138170515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a28ab72b0 0x557a28b4c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 -- 172.21.15.133:0/1138170515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10005d30 con 0x557a28a0f930 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1ee49640 1 --2- 172.21.15.133:0/1138170515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a0f930 0x557a28ab18f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7eff100099b0 tx=0x7eff10005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b48e57f30ae8b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1d646640 1 -- 172.21.15.133:0/1138170515 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000f040 con 0x557a28a0f930 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1d646640 1 -- 172.21.15.133:0/1138170515 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10008e60 con 0x557a28a0f930 2023-12-18T10:21:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.231+0000 7eff1d646640 1 -- 172.21.15.133:0/1138170515 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10014680 con 0x557a28a0f930 2023-12-18T10:21:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- 172.21.15.133:0/1138170515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a0f930 msgr2=0x557a28ab18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 --2- 172.21.15.133:0/1138170515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a0f930 0x557a28ab18f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7eff100099b0 tx=0x7eff10005a10 comp rx=0 tx=0).stop 2023-12-18T10:21:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- 172.21.15.133:0/1138170515 shutdown_connections 2023-12-18T10:21:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 --2- 172.21.15.133:0/1138170515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a28ab72b0 0x557a28b4c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 --2- 172.21.15.133:0/1138170515 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557a28a11190 0x557a28b4be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 --2- 172.21.15.133:0/1138170515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a0f930 0x557a28ab18f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- 172.21.15.133:0/1138170515 >> 172.21.15.133:0/1138170515 conn(0x557a28a0de00 msgr2=0x557a28a0ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- 172.21.15.133:0/1138170515 shutdown_connections 2023-12-18T10:21:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- 172.21.15.133:0/1138170515 wait complete. 2023-12-18T10:21:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 Processor -- start 2023-12-18T10:21:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- start start 2023-12-18T10:21:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a28a0f930 0x557a28a09300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a11190 0x557a28ab3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557a28ab72b0 0x557a28ab3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28ab4270 con 0x557a28a11190 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a28a09930 con 0x557a28a0f930 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x557a28a09bd0 con 0x557a28ab72b0 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a11190 0x557a28ab3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1ee49640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a28a0f930 0x557a28a09300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a11190 0x557a28ab3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57704/0 (socket says 172.21.15.133:57704) 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1f64a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557a28ab72b0 0x557a28ab3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 -- 172.21.15.133:0/404266492 learned_addr learned my addr 172.21.15.133:0/404266492 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 -- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557a28ab72b0 msgr2=0x557a28ab3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x557a28ab72b0 0x557a28ab3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 -- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a28a0f930 msgr2=0x557a28a09300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a28a0f930 0x557a28a09300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 -- 172.21.15.133:0/404266492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009580 con 0x557a28a11190 2023-12-18T10:21:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff1e648640 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a11190 0x557a28ab3d30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7eff1400bd70 tx=0x7eff14009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff07fff640 1 -- 172.21.15.133:0/404266492 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400e480 con 0x557a28a11190 2023-12-18T10:21:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff07fff640 1 -- 172.21.15.133:0/404266492 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1400e5e0 con 0x557a28a11190 2023-12-18T10:21:19.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff07fff640 1 -- 172.21.15.133:0/404266492 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400e9d0 con 0x557a28a11190 2023-12-18T10:21:19.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1800a100 con 0x557a28a11190 2023-12-18T10:21:19.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.235+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a28938070 con 0x557a28a11190 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff07fff640 1 -- 172.21.15.133:0/404266492 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff1400a040 con 0x557a28a11190 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff07fff640 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7eff0c064410 0x7eff0c0668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff07fff640 1 -- 172.21.15.133:0/404266492 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7eff14081e90 con 0x557a28a11190 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff1ee49640 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7eff0c064410 0x7eff0c0668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff2132f080 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x557a28ab37d0 0x557a28b4f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 --> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] -- osd_op(unknown.0.0:1 7.5 7:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x557a28b4fc60 con 0x557a28ab37d0 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff1ee49640 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7eff0c064410 0x7eff0c0668d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff10017040 tx=0x7eff10009f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff1f64a640 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x557a28ab37d0 0x557a28b4f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.239+0000 7eff1f64a640 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x557a28ab37d0 0x557a28b4f720 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff1f64a640 1 -- 172.21.15.133:0/404266492 <== osd.7 v2:172.21.15.142:6816/38355 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v53'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7eff180b5440 con 0x557a28ab37d0 2023-12-18T10:21:19.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x557a28ab37d0 msgr2=0x557a28b4f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x557a28ab37d0 0x557a28b4f720 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7eff0c064410 msgr2=0x7eff0c0668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7eff0c064410 0x7eff0c0668d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff10017040 tx=0x7eff10009f90 comp rx=0 tx=0).stop 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a11190 msgr2=0x557a28ab3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 --2- 172.21.15.133:0/404266492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557a28a11190 0x557a28ab3d30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7eff1400bd70 tx=0x7eff14009650 comp rx=0 tx=0).stop 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff1f64a640 1 -- 172.21.15.133:0/404266492 reap_dead start 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 shutdown_connections 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 >> 172.21.15.133:0/404266492 conn(0x557a28a0de00 msgr2=0x557a28a07f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 shutdown_connections 2023-12-18T10:21:19.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.243+0000 7eff2132f080 1 -- 172.21.15.133:0/404266492 wait complete. 2023-12-18T10:21:19.252 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2023-12-18T10:21:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.291+0000 7f1ce902b080 1 Processor -- start 2023-12-18T10:21:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.291+0000 7f1ce902b080 1 -- start start 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e20a210 0x55b58e21e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a5f0 0x55b58e29a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e224a30 0x55b58e29a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e1214d0 con 0x55b58e20a5f0 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e1211d0 con 0x55b58e224a30 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b58e117e40 con 0x55b58e20a210 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a5f0 0x55b58e29a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a5f0 0x55b58e29a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57728/0 (socket says 172.21.15.133:57728) 2023-12-18T10:21:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 -- 172.21.15.133:0/3779266623 learned_addr learned my addr 172.21.15.133:0/3779266623 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce6377640 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e224a30 0x55b58e29a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5b76640 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e20a210 0x55b58e21e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 -- 172.21.15.133:0/3779266623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e20a210 msgr2=0x55b58e21e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e20a210 0x55b58e21e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 -- 172.21.15.133:0/3779266623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e224a30 msgr2=0x55b58e29a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e224a30 0x55b58e29a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 -- 172.21.15.133:0/3779266623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc005df0 con 0x55b58e20a5f0 2023-12-18T10:21:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce5375640 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a5f0 0x55b58e29a2f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0b2040 tx=0x7f1cdc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7926c675dcfca71 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1cd7fff640 1 -- 172.21.15.133:0/3779266623 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0b9440 con 0x55b58e20a5f0 2023-12-18T10:21:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1cd7fff640 1 -- 172.21.15.133:0/3779266623 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc0b95a0 con 0x55b58e20a5f0 2023-12-18T10:21:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1cd7fff640 1 -- 172.21.15.133:0/3779266623 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0b9950 con 0x55b58e20a5f0 2023-12-18T10:21:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- 172.21.15.133:0/3779266623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a5f0 msgr2=0x55b58e29a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a5f0 0x55b58e29a2f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0b2040 tx=0x7f1cdc003030 comp rx=0 tx=0).stop 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- 172.21.15.133:0/3779266623 shutdown_connections 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e224a30 0x55b58e29a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a5f0 0x55b58e29a2f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 --2- 172.21.15.133:0/3779266623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e20a210 0x55b58e21e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- 172.21.15.133:0/3779266623 >> 172.21.15.133:0/3779266623 conn(0x55b58e1d8b50 msgr2=0x55b58e20b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- 172.21.15.133:0/3779266623 shutdown_connections 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- 172.21.15.133:0/3779266623 wait complete. 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 Processor -- start 2023-12-18T10:21:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.295+0000 7f1ce902b080 1 -- start start 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce902b080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a210 0x55b58e288210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce902b080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e20a5f0 0x55b58e288750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce902b080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e224a30 0x55b58e28b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce902b080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e28be50 con 0x55b58e20a210 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce902b080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e28c0f0 con 0x55b58e20a5f0 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce902b080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b58e28c390 con 0x55b58e224a30 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a210 0x55b58e288210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a210 0x55b58e288210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57732/0 (socket says 172.21.15.133:57732) 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 -- 172.21.15.133:0/2192992332 learned_addr learned my addr 172.21.15.133:0/2192992332 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5375640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e20a5f0 0x55b58e288750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce6377640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e224a30 0x55b58e28b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 -- 172.21.15.133:0/2192992332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e224a30 msgr2=0x55b58e28b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b58e224a30 0x55b58e28b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 -- 172.21.15.133:0/2192992332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e20a5f0 msgr2=0x55b58e288750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b58e20a5f0 0x55b58e288750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 -- 172.21.15.133:0/2192992332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b58e14a210 con 0x55b58e20a210 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce5b76640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a210 0x55b58e288210 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009fd0 tx=0x7f1cd8008ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1cd6ffd640 1 -- 172.21.15.133:0/2192992332 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd800f050 con 0x55b58e20a210 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1cd6ffd640 1 -- 172.21.15.133:0/2192992332 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8010040 con 0x55b58e20a210 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b58e130070 con 0x55b58e20a210 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1cd6ffd640 1 -- 172.21.15.133:0/2192992332 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8005e80 con 0x55b58e20a210 2023-12-18T10:21:19.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b58e1234b0 con 0x55b58e20a210 2023-12-18T10:21:19.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.299+0000 7f1cd6ffd640 1 -- 172.21.15.133:0/2192992332 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1cd801f460 con 0x55b58e20a210 2023-12-18T10:21:19.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1cd6ffd640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cc8064440 0x7f1cc8066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1cd6ffd640 1 -- 172.21.15.133:0/2192992332 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1cd80827d0 con 0x55b58e20a210 2023-12-18T10:21:19.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce5375640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cc8064440 0x7f1cc8066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b58e346030 0x55b58e2234e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 7.9 7:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x55b58e223a20 con 0x55b58e346030 2023-12-18T10:21:19.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce6377640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b58e346030 0x55b58e2234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce5375640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cc8064440 0x7f1cc8066900 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0bd000 tx=0x7f1cdc0a9000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce6377640 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b58e346030 0x55b58e2234e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce6377640 1 -- 172.21.15.133:0/2192992332 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v53'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1ce0001640 con 0x55b58e346030 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b58e346030 msgr2=0x55b58e2234e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55b58e346030 0x55b58e2234e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cc8064440 msgr2=0x7f1cc8066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1cc8064440 0x7f1cc8066900 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0bd000 tx=0x7f1cdc0a9000 comp rx=0 tx=0).stop 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a210 msgr2=0x55b58e288210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 --2- 172.21.15.133:0/2192992332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b58e20a210 0x55b58e288210 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009fd0 tx=0x7f1cd8008ba0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce6377640 1 -- 172.21.15.133:0/2192992332 reap_dead start 2023-12-18T10:21:19.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 shutdown_connections 2023-12-18T10:21:19.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 >> 172.21.15.133:0/2192992332 conn(0x55b58e1d8b50 msgr2=0x55b58e299390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 shutdown_connections 2023-12-18T10:21:19.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.303+0000 7f1ce902b080 1 -- 172.21.15.133:0/2192992332 wait complete. 2023-12-18T10:21:19.313 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2023-12-18T10:21:19.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 Processor -- start 2023-12-18T10:21:19.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 -- start start 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e8819220 0x55c5e88a2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e881b190 0x55c5e8955ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 0x55c5e8956400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5e87331d0 con 0x55c5e881b190 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5e8729e40 con 0x55c5e88c12b0 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c5e88bc9c0 con 0x55c5e8819220 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e881b190 0x55c5e8955ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e881b190 0x55c5e8955ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57742/0 (socket says 172.21.15.133:57742) 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 -- 172.21.15.133:0/2643981930 learned_addr learned my addr 172.21.15.133:0/2643981930 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426b310640 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e8819220 0x55c5e88a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426bb11640 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 0x55c5e8956400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 -- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e8819220 msgr2=0x55c5e88a2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e8819220 0x55c5e88a2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 -- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 msgr2=0x55c5e8956400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 0x55c5e8956400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 -- 172.21.15.133:0/2643981930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260005df0 con 0x55c5e881b190 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426bb11640 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 0x55c5e8956400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426ab0f640 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e881b190 0x55c5e8955ec0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f426000a590 tx=0x7f4260003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194805cd29ca317d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f4269b0d640 1 -- 172.21.15.133:0/2643981930 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600aa700 con 0x55c5e881b190 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f4269b0d640 1 -- 172.21.15.133:0/2643981930 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600aa860 con 0x55c5e881b190 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f4269b0d640 1 -- 172.21.15.133:0/2643981930 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600aabd0 con 0x55c5e881b190 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 -- 172.21.15.133:0/2643981930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e881b190 msgr2=0x55c5e8955ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.399+0000 7f426d7f6080 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e881b190 0x55c5e8955ec0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f426000a590 tx=0x7f4260003030 comp rx=0 tx=0).stop 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- 172.21.15.133:0/2643981930 shutdown_connections 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 0x55c5e8956400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e881b190 0x55c5e8955ec0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 --2- 172.21.15.133:0/2643981930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e8819220 0x55c5e88a2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- 172.21.15.133:0/2643981930 >> 172.21.15.133:0/2643981930 conn(0x55c5e8817e00 msgr2=0x55c5e88be860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- 172.21.15.133:0/2643981930 shutdown_connections 2023-12-18T10:21:19.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- 172.21.15.133:0/2643981930 wait complete. 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 Processor -- start 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- start start 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e8819220 0x55c5e8812010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e881b190 0x55c5e8810390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 0x55c5e88108d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5e8812550 con 0x55c5e8819220 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5e88110f0 con 0x55c5e88c12b0 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c5e8811390 con 0x55c5e881b190 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e8819220 0x55c5e8812010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e8819220 0x55c5e8812010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57752/0 (socket says 172.21.15.133:57752) 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 -- 172.21.15.133:0/1110294753 learned_addr learned my addr 172.21.15.133:0/1110294753 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426ab0f640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e881b190 0x55c5e8810390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426bb11640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 0x55c5e88108d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 -- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e881b190 msgr2=0x55c5e8810390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e881b190 0x55c5e8810390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 -- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 msgr2=0x55c5e88108d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c5e88c12b0 0x55c5e88108d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 -- 172.21.15.133:0/1110294753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5e8735120 con 0x55c5e8819220 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426ab0f640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c5e881b190 0x55c5e8810390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426b310640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e8819220 0x55c5e8812010 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f425c008710 tx=0x7f425c008bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f4268b0b640 1 -- 172.21.15.133:0/1110294753 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c011040 con 0x55c5e8819220 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f4268b0b640 1 -- 172.21.15.133:0/1110294753 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c006d80 con 0x55c5e8819220 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c5e875c210 con 0x55c5e8819220 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f4268b0b640 1 -- 172.21.15.133:0/1110294753 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c015620 con 0x55c5e8819220 2023-12-18T10:21:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.403+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5e8742070 con 0x55c5e8819220 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f4268b0b640 1 -- 172.21.15.133:0/1110294753 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f425c015780 con 0x55c5e8819220 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f4268b0b640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4258064410 0x7f42580668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f4268b0b640 1 -- 172.21.15.133:0/1110294753 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f425c081d40 con 0x55c5e8819220 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f426ab0f640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4258064410 0x7f42580668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f426d7f6080 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55c5e87ef910 0x55c5e87efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 --> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] -- osd_op(unknown.0.0:1 7.5 7:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x55c5e87f0260 con 0x55c5e87ef910 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f426bb11640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55c5e87ef910 0x55c5e87efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f426ab0f640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4258064410 0x7f42580668d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4260019a50 tx=0x7f42600c1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.407+0000 7f426bb11640 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55c5e87ef910 0x55c5e87efd20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426bb11640 1 -- 172.21.15.133:0/1110294753 <== osd.7 v2:172.21.15.142:6816/38355 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v53'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4264002940 con 0x55c5e87ef910 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55c5e87ef910 msgr2=0x55c5e87efd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55c5e87ef910 0x55c5e87efd20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4258064410 msgr2=0x7f42580668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4258064410 0x7f42580668d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4260019a50 tx=0x7f42600c1040 comp rx=0 tx=0).stop 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e8819220 msgr2=0x55c5e8812010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 --2- 172.21.15.133:0/1110294753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c5e8819220 0x55c5e8812010 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f425c008710 tx=0x7f425c008bd0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426bb11640 1 -- 172.21.15.133:0/1110294753 reap_dead start 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 shutdown_connections 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 >> 172.21.15.133:0/1110294753 conn(0x55c5e8817e00 msgr2=0x55c5e8834a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 shutdown_connections 2023-12-18T10:21:19.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.411+0000 7f426d7f6080 1 -- 172.21.15.133:0/1110294753 wait complete. 2023-12-18T10:21:19.419 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2023-12-18T10:21:19.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 Processor -- start 2023-12-18T10:21:19.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- start start 2023-12-18T10:21:19.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 0x558ebd014300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebd0a96a0 0x558ebcf453b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebcf458f0 0x558ebd011430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ebceee9c0 con 0x558ebd0a96a0 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ebce8a4d0 con 0x558ebcf458f0 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ebce8a1d0 con 0x7f995c0022a0 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebd0a96a0 0x558ebcf453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebd0a96a0 0x558ebcf453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57762/0 (socket says 172.21.15.133:57762) 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 -- 172.21.15.133:0/3342288391 learned_addr learned my addr 172.21.15.133:0/3342288391 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f99715d0640 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 0x558ebd014300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9971dd1640 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebcf458f0 0x558ebd011430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 -- 172.21.15.133:0/3342288391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 msgr2=0x558ebd014300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 0x558ebd014300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 -- 172.21.15.133:0/3342288391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebcf458f0 msgr2=0x558ebd011430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebcf458f0 0x558ebd011430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 -- 172.21.15.133:0/3342288391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ebce8c4b0 con 0x558ebd0a96a0 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9970dcf640 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebd0a96a0 0x558ebcf453b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f99680097c0 tx=0x7f9968005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad8c39b8ec270d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f99637fe640 1 -- 172.21.15.133:0/3342288391 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800f040 con 0x558ebd0a96a0 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f99637fe640 1 -- 172.21.15.133:0/3342288391 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9968008b90 con 0x558ebd0a96a0 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f99637fe640 1 -- 172.21.15.133:0/3342288391 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9968015470 con 0x558ebd0a96a0 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- 172.21.15.133:0/3342288391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebd0a96a0 msgr2=0x558ebcf453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebd0a96a0 0x558ebcf453b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f99680097c0 tx=0x7f9968005a10 comp rx=0 tx=0).stop 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- 172.21.15.133:0/3342288391 shutdown_connections 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebcf458f0 0x558ebd011430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebd0a96a0 0x558ebcf453b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 --2- 172.21.15.133:0/3342288391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 0x558ebd014300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- 172.21.15.133:0/3342288391 >> 172.21.15.133:0/3342288391 conn(0x558ebcf6ee00 msgr2=0x558ebcf45d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- 172.21.15.133:0/3342288391 shutdown_connections 2023-12-18T10:21:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- 172.21.15.133:0/3342288391 wait complete. 2023-12-18T10:21:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 Processor -- start 2023-12-18T10:21:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.463+0000 7f9973ab6080 1 -- start start 2023-12-18T10:21:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9973ab6080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebcf458f0 0x558ebd00ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9973ab6080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebd0a96a0 0x558ebd022550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9973ab6080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 0x558ebd00e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9973ab6080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ebce80e40 con 0x558ebcf458f0 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9973ab6080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ebd010f80 con 0x558ebd0a96a0 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9973ab6080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ebcff64f0 con 0x7f995c0022a0 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebcf458f0 0x558ebd00ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebcf458f0 0x558ebd00ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57768/0 (socket says 172.21.15.133:57768) 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 -- 172.21.15.133:0/3281039131 learned_addr learned my addr 172.21.15.133:0/3281039131 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9971dd1640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 0x558ebd00e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9970dcf640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebd0a96a0 0x558ebd022550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 -- 172.21.15.133:0/3281039131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 msgr2=0x558ebd00e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 0x558ebd00e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 -- 172.21.15.133:0/3281039131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebd0a96a0 msgr2=0x558ebd022550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebd0a96a0 0x558ebd022550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 -- 172.21.15.133:0/3281039131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968009420 con 0x558ebcf458f0 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9970dcf640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ebd0a96a0 0x558ebd022550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9971dd1640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f995c0022a0 0x558ebd00e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:19.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99715d0640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebcf458f0 0x558ebd00ec50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f99640ae040 tx=0x7f995c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99627fc640 1 -- 172.21.15.133:0/3281039131 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640010e0 con 0x558ebcf458f0 2023-12-18T10:21:19.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99627fc640 1 -- 172.21.15.133:0/3281039131 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99640b7440 con 0x558ebcf458f0 2023-12-18T10:21:19.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ebce8bf10 con 0x558ebcf458f0 2023-12-18T10:21:19.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99627fc640 1 -- 172.21.15.133:0/3281039131 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640b77b0 con 0x558ebcf458f0 2023-12-18T10:21:19.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ebcff6a30 con 0x558ebcf458f0 2023-12-18T10:21:19.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.467+0000 7f99627fc640 1 -- 172.21.15.133:0/3281039131 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f996400a040 con 0x558ebcf458f0 2023-12-18T10:21:19.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f99627fc640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9954064410 0x7f99540668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f99627fc640 1 -- 172.21.15.133:0/3281039131 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f996411d2d0 con 0x558ebcf458f0 2023-12-18T10:21:19.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9970dcf640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9954064410 0x7f99540668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x558ebd022a90 0x558ebd0ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 --> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] -- osd_op(unknown.0.0:1 7.1d 7:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x558ebcff76b0 con 0x558ebd022a90 2023-12-18T10:21:19.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9971dd1640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x558ebd022a90 0x558ebd0ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9970dcf640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9954064410 0x7f99540668d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9968005a50 tx=0x7f9968015000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9971dd1640 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x558ebd022a90 0x558ebd0ab530 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9971dd1640 1 -- 172.21.15.133:0/3281039131 <== osd.1 v2:172.21.15.133:6800/38184 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v53'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f996c002730 con 0x558ebd022a90 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x558ebd022a90 msgr2=0x558ebd0ab530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x558ebd022a90 0x558ebd0ab530 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9954064410 msgr2=0x7f99540668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9954064410 0x7f99540668d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9968005a50 tx=0x7f9968015000 comp rx=0 tx=0).stop 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebcf458f0 msgr2=0x558ebd00ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 --2- 172.21.15.133:0/3281039131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558ebcf458f0 0x558ebd00ec50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f99640ae040 tx=0x7f995c0040f0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9971dd1640 1 -- 172.21.15.133:0/3281039131 reap_dead start 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 shutdown_connections 2023-12-18T10:21:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 >> 172.21.15.133:0/3281039131 conn(0x558ebcf6ee00 msgr2=0x558ebd013920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 shutdown_connections 2023-12-18T10:21:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.471+0000 7f9973ab6080 1 -- 172.21.15.133:0/3281039131 wait complete. 2023-12-18T10:21:19.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /d1/d2/d3 recursive,force 2023-12-18T10:21:19.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0caf9640 1 Processor -- start 2023-12-18T10:21:19.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0caf9640 1 -- start start 2023-12-18T10:21:19.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0caf9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 0x7f5b080ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0caf9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b080ad6e0 con 0x7f5b080ce6a0 2023-12-18T10:21:19.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0caf9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b080ad9c0 con 0x7f5b080c89f0 2023-12-18T10:21:19.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0caf9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08159b20 con 0x7f5b080ca200 2023-12-18T10:21:19.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0659c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5b080ce6a0 0x7f5b080cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40834/0 (socket says 172.21.15.133:40834) 2023-12-18T10:21:19.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0659c640 1 -- 172.21.15.133:0/160741449 learned_addr learned my addr 172.21.15.133:0/160741449 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:19.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 0x7f5b080ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292712670 0 0) 0x7f5b080ad6e0 con 0x7f5b080ce6a0 2023-12-18T10:21:19.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af4005740 con 0x7f5b080ce6a0 2023-12-18T10:21:19.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756414416 0 0) 0x7f5af4005740 con 0x7f5b080ce6a0 2023-12-18T10:21:19.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 msgr2=0x7f5b080ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 0x7f5b080ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 >> v1:172.21.15.142:6789/0 conn(0x7f5b080c89f0 legacy=0x7f5b080c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0806be20 con 0x7f5b080ce6a0 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f5af8001680 con 0x7f5b080ce6a0 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 0x7f5b080ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 >> v1:172.21.15.133:6789/0 conn(0x7f5b080ce6a0 legacy=0x7f5b080cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4005bc0 0x7f5af4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af4006570 0x7f5af4006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 0x7f5af4007260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08159b20 con 0x7f5af4006570 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af400dba0 con 0x7f5af4005bc0 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af400dd60 con 0x7f5b080ca200 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af4006570 0x7f5af4006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b0659c640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4005bc0 0x7f5af4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.619+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 0x7f5af4007260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5afdd9b640 1 -- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 msgr2=0x7f5af4007260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b080ca200 0x7f5af4007260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5afdd9b640 1 -- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4005bc0 msgr2=0x7f5af4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4005bc0 0x7f5af4005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5afdd9b640 1 -- 172.21.15.133:0/160741449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009420 con 0x7f5af4006570 2023-12-18T10:21:19.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af4006570 0x7f5af4006a40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009cb0 tx=0x7f5af001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2108da37943a1fba server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00a58b0 con 0x7f5af4006570 2023-12-18T10:21:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af00a5a10 con 0x7f5af4006570 2023-12-18T10:21:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b05d9b640 1 -- 172.21.15.133:0/160741449 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00a5d80 con 0x7f5af4006570 2023-12-18T10:21:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b0caf9640 1 -- 172.21.15.133:0/160741449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af4006570 msgr2=0x7f5af4006a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b0caf9640 1 --2- 172.21.15.133:0/160741449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af4006570 0x7f5af4006a40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009cb0 tx=0x7f5af001cbf0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b06d9d640 1 -- 172.21.15.133:0/160741449 reap_dead start 2023-12-18T10:21:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b0caf9640 1 -- 172.21.15.133:0/160741449 shutdown_connections 2023-12-18T10:21:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b0caf9640 1 -- 172.21.15.133:0/160741449 >> 172.21.15.133:0/160741449 conn(0x7f5b08069e70 msgr2=0x7f5b0806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b0caf9640 1 -- 172.21.15.133:0/160741449 shutdown_connections 2023-12-18T10:21:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.623+0000 7f5b0caf9640 1 -- 172.21.15.133:0/160741449 wait complete. 2023-12-18T10:21:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0caf9640 1 Processor -- start 2023-12-18T10:21:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0caf9640 1 -- start start 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0caf9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4006570 0x7f5b08159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0caf9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b081553f0 0x7f5b0815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0caf9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b080add20 0x7f5b080c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0caf9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0815cbe0 con 0x7f5b080add20 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0caf9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080c3230 con 0x7f5af4006570 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0caf9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080c3510 con 0x7f5b081553f0 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b080add20 0x7f5b080c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b080add20 0x7f5b080c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57790/0 (socket says 172.21.15.133:57790) 2023-12-18T10:21:19.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 -- 172.21.15.133:0/404997930 learned_addr learned my addr 172.21.15.133:0/404997930 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b0659c640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4006570 0x7f5b08159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b081553f0 0x7f5b0815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 -- 172.21.15.133:0/404997930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b081553f0 msgr2=0x7f5b0815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b081553f0 0x7f5b0815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 -- 172.21.15.133:0/404997930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4006570 msgr2=0x7f5b08159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4006570 0x7f5b08159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 -- 172.21.15.133:0/404997930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080c37f0 con 0x7f5b080add20 2023-12-18T10:21:19.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.627+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b080add20 0x7f5b080c42d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5b0806e190 tx=0x7f5b00010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5aff7fe640 1 -- 172.21.15.133:0/404997930 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00003d90 con 0x7f5b080add20 2023-12-18T10:21:19.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5aff7fe640 1 -- 172.21.15.133:0/404997930 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000d070 con 0x7f5b080add20 2023-12-18T10:21:19.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5b0caf9640 1 -- 172.21.15.133:0/404997930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b080c3ad0 con 0x7f5b080add20 2023-12-18T10:21:19.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5aff7fe640 1 -- 172.21.15.133:0/404997930 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000ea10 con 0x7f5b080add20 2023-12-18T10:21:19.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5b0caf9640 1 -- 172.21.15.133:0/404997930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0815af30 con 0x7f5b080add20 2023-12-18T10:21:19.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5aff7fe640 1 -- 172.21.15.133:0/404997930 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b0000eb70 con 0x7f5b080add20 2023-12-18T10:21:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5aff7fe640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5ae8065a90 0x7f5ae8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5aff7fe640 1 -- 172.21.15.133:0/404997930 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b00086330 con 0x7f5b080add20 2023-12-18T10:21:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5b0659c640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5ae8065a90 0x7f5ae8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5b0fe56000 1 Processor -- start 2023-12-18T10:21:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5b0659c640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5ae8065a90 0x7f5ae8067f50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5af8000c10 tx=0x7f5af8000fd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.631+0000 7f5b0fe56000 1 -- start start 2023-12-18T10:21:19.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x55882557cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x558825532a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825533340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588253fab00 con 0x558825532f60 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558825388140 con 0x55882557d300 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558825385710 con 0x55882557c9e0 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825533340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825533340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57804/0 (socket says 172.21.15.133:57804) 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 -- 172.21.15.133:0/1595907633 learned_addr learned my addr 172.21.15.133:0/1595907633 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0659c640 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x55882557cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x558825532a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 -- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 msgr2=0x55882557cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x55882557cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 -- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 msgr2=0x558825532a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x558825532a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 -- 172.21.15.133:0/1595907633 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55882507dc90 con 0x558825532f60 2023-12-18T10:21:19.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0659c640 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x55882557cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:19.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x558825532a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:19.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825533340 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5b00053d30 tx=0x7f5b00057880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11d1dc958ac1fbc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5ae7fff640 1 -- 172.21.15.133:0/1595907633 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b000559c0 con 0x558825532f60 2023-12-18T10:21:19.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5ae7fff640 1 -- 172.21.15.133:0/1595907633 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00086070 con 0x558825532f60 2023-12-18T10:21:19.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5ae7fff640 1 -- 172.21.15.133:0/1595907633 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00053f90 con 0x558825532f60 2023-12-18T10:21:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- 172.21.15.133:0/1595907633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 msgr2=0x558825533340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825533340 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5b00053d30 tx=0x7f5b00057880 comp rx=0 tx=0).stop 2023-12-18T10:21:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- 172.21.15.133:0/1595907633 shutdown_connections 2023-12-18T10:21:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825533340 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x558825532a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/1595907633 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x55882557cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- 172.21.15.133:0/1595907633 >> 172.21.15.133:0/1595907633 conn(0x55882552ef10 msgr2=0x558825531300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- 172.21.15.133:0/1595907633 shutdown_connections 2023-12-18T10:21:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- 172.21.15.133:0/1595907633 wait complete. 2023-12-18T10:21:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 -- start start 2023-12-18T10:21:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.635+0000 7f5b0fe56000 1 Processor -- start 2023-12-18T10:21:19.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825583f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825584490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882556a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558825381000 con 0x55882557d300 2023-12-18T10:21:19.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558825320980 con 0x55882557c9e0 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558825320620 con 0x558825532f60 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 10 client.0 _ll_register_callbacks cb 0x55882537a940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882556a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882556a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57818/0 (socket says 172.21.15.133:57818) 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 -- 172.21.15.133:0/3683508264 learned_addr learned my addr 172.21.15.133:0/3683508264 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0659c640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825583f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825584490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 -- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 msgr2=0x558825583f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825583f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 -- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 msgr2=0x558825584490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825584490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 -- 172.21.15.133:0/3683508264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0815af30 con 0x55882557d300 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825584490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0659c640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825583f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882556a790 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5b0005b7c0 tx=0x7f5b000015c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579e13d237d7d2d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 1 -- 172.21.15.133:0/3683508264 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00074070 con 0x55882557d300 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 1 -- 172.21.15.133:0/3683508264 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b00055c20 con 0x55882557d300 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 -- 172.21.15.133:0/3683508264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588253424f0 con 0x55882557d300 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 1 -- 172.21.15.133:0/3683508264 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b00055a80 con 0x55882557d300 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 10 client.6552 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 -- 172.21.15.133:0/3683508264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x558825346390 con 0x55882557d300 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 1 -- 172.21.15.133:0/3683508264 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588253424f0 con 0x55882557d300 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 1 -- 172.21.15.133:0/3683508264 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f5b00075260 con 0x55882557d300 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 10 client.6552 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 10 client.6552 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 20 client.6552 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55882556b500 0x55882556b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 4 client.6552 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 -- 172.21.15.133:0/3683508264 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558825385ef0 con 0x55882556b500 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0659c640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55882556b500 0x55882556b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0659c640 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55882556b500 0x55882556b910 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66ff3414dd6d3d51 server_cookie=849520c222e1119e in_seq=0 out_seq=0 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 10 client.6552 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 1 -- 172.21.15.133:0/3683508264 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558825385ef0 con 0x55882556b500 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5ae57fa640 10 client.6552 handle_command_reply: tid=0 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.639+0000 7f5b0fe56000 1 client.6552 shutdown 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 -- 172.21.15.133:0/3683508264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 msgr2=0x55882556a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882556a790 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5b0005b7c0 tx=0x7f5b000015c0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 -- 172.21.15.133:0/3683508264 shutdown_connections 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55882556b500 0x55882556b910 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882556a790 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825584490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/3683508264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825583f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5ae57fa640 0 client.6552 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:19.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 -- 172.21.15.133:0/3683508264 >> 172.21.15.133:0/3683508264 conn(0x55882552ef10 msgr2=0x558825531b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 -- 172.21.15.133:0/3683508264 shutdown_connections 2023-12-18T10:21:19.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 1 -- 172.21.15.133:0/3683508264 wait complete. 2023-12-18T10:21:19.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.643+0000 7f5b0fe56000 20 client.6552 trim_cache size 0 max 16384 2023-12-18T10:21:19.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b0fe56000 1 Processor -- start 2023-12-18T10:21:19.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b0fe56000 1 -- start start 2023-12-18T10:21:19.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825531300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825531840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882557d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55882503ed40 con 0x55882557d300 2023-12-18T10:21:19.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55882543de20 con 0x55882557c9e0 2023-12-18T10:21:19.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558825593310 con 0x558825532f60 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.655+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882557d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882557d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57820/0 (socket says 172.21.15.133:57820) 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 -- 172.21.15.133:0/143461874 learned_addr learned my addr 172.21.15.133:0/143461874 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0659c640 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825531300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825531840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 -- 172.21.15.133:0/143461874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 msgr2=0x558825531300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825531300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 -- 172.21.15.133:0/143461874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 msgr2=0x558825531840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825531840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 -- 172.21.15.133:0/143461874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55882532c4e0 con 0x55882557d300 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882557d6e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5b00057200 tx=0x7f5b00083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06284d0c673c779 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5afcd99640 1 -- 172.21.15.133:0/143461874 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00074040 con 0x55882557d300 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5afcd99640 1 -- 172.21.15.133:0/143461874 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00055a80 con 0x55882557d300 2023-12-18T10:21:19.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5afcd99640 1 -- 172.21.15.133:0/143461874 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00084aa0 con 0x55882557d300 2023-12-18T10:21:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- 172.21.15.133:0/143461874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 msgr2=0x55882557d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882557d6e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5b00057200 tx=0x7f5b00083000 comp rx=0 tx=0).stop 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- 172.21.15.133:0/143461874 shutdown_connections 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55882557d300 0x55882557d6e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557c9e0 0x558825531840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/143461874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558825532f60 0x558825531300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- 172.21.15.133:0/143461874 >> 172.21.15.133:0/143461874 conn(0x55882552ef10 msgr2=0x5588255698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- 172.21.15.133:0/143461874 shutdown_connections 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- 172.21.15.133:0/143461874 wait complete. 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- start start 2023-12-18T10:21:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 Processor -- start 2023-12-18T10:21:19.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825582ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x5588255833e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x5588255d5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55882537e400 con 0x558825532f60 2023-12-18T10:21:19.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588253c48a0 con 0x55882557d300 2023-12-18T10:21:19.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55882552e8b0 con 0x55882557c9e0 2023-12-18T10:21:19.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0fe56000 10 client.0 _ll_register_callbacks cb 0x55882538a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825582ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825582ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57834/0 (socket says 172.21.15.133:57834) 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b0659c640 1 -- 172.21.15.133:0/4231444821 learned_addr learned my addr 172.21.15.133:0/4231444821 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x5588255833e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.659+0000 7f5b06d9d640 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x5588255d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0659c640 1 -- 172.21.15.133:0/4231444821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 msgr2=0x5588255833e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0659c640 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x5588255833e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0659c640 1 -- 172.21.15.133:0/4231444821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 msgr2=0x5588255d5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0659c640 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x5588255d5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0659c640 1 -- 172.21.15.133:0/4231444821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558825346390 con 0x558825532f60 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0659c640 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825582ea0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007800 tx=0x7f5af8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12700894a8c856f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 1 -- 172.21.15.133:0/4231444821 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af801a040 con 0x558825532f60 2023-12-18T10:21:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 1 -- 172.21.15.133:0/4231444821 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5af8015d40 con 0x558825532f60 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 -- 172.21.15.133:0/4231444821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55882537a080 con 0x558825532f60 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 1 -- 172.21.15.133:0/4231444821 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5af8030400 con 0x558825532f60 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 10 client.6558 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 -- 172.21.15.133:0/4231444821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55882507e0c0 con 0x558825532f60 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 1 -- 172.21.15.133:0/4231444821 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55882537a080 con 0x558825532f60 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 1 -- 172.21.15.133:0/4231444821 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f5af802e030 con 0x558825532f60 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 10 client.6558 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 10 client.6558 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 20 client.6558 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x5588255d61b0 0x5588255d65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 4 client.6558 mds_command: new command op to 6165 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 -- 172.21.15.133:0/4231444821 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x558825379da0 con 0x5588255d61b0 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x5588255d61b0 0x5588255d65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 10 client.6558 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5afdd9b640 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x5588255d61b0 0x5588255d65c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a94c1d56e30f731 server_cookie=f5ca1234f3be3093 in_seq=0 out_seq=0 2023-12-18T10:21:19.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 1 -- 172.21.15.133:0/4231444821 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558825379da0 con 0x5588255d61b0 2023-12-18T10:21:19.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 10 client.6558 handle_command_reply: tid=0 2023-12-18T10:21:19.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 client.6558 shutdown 2023-12-18T10:21:19.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 -- 172.21.15.133:0/4231444821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 msgr2=0x558825582ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825582ea0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007800 tx=0x7f5af8015000 comp rx=0 tx=0).stop 2023-12-18T10:21:19.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 -- 172.21.15.133:0/4231444821 shutdown_connections 2023-12-18T10:21:19.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x5588255d61b0 0x5588255d65c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55882557d300 0x5588255d5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55882557c9e0 0x5588255833e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 --2- 172.21.15.133:0/4231444821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558825532f60 0x558825582ea0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 -- 172.21.15.133:0/4231444821 >> 172.21.15.133:0/4231444821 conn(0x55882552ef10 msgr2=0x55882557c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.672 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-18T10:21:19.664+0000 7ff025535640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-12-18T10:21:00.576701+0000 1=0+1) n(v0 rc2023-12-18T10:21:00.576701+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={6342=pAsLsXsFsx/-@6},l=6342 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e3e14d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.576701+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.576701+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.576701+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-18T10:21:00.576701+0000 2=0+2)","error_str":""},"return_code":-61} 2023-12-18T10:21:19.672 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-18T10:21:19.664+0000 7ff025535640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (iversion lock) caps={6342=pAsLsXsFs/-@3},l=6342 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55e3e14d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-12-18T10:21:19.672 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:21:19.663+0000 7fdb0ccb9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-12-18T10:21:00.569841+0000 1=0+1) n(v3 rc2023-12-18T10:21:00.795324+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={6342=pAsLsXsFsx/AsLsXsFsx@9},l=6342 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5578a01ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.569841+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.795324+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.569841+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-12-18T10:21:00.795324+0000 6=0+6)","error_str":""},"return_code":-61} 2023-12-18T10:21:19.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5ae57fa640 0 client.6558 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:19.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 -- 172.21.15.133:0/4231444821 shutdown_connections 2023-12-18T10:21:19.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 1 -- 172.21.15.133:0/4231444821 wait complete. 2023-12-18T10:21:19.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.663+0000 7f5b0fe56000 20 client.6558 trim_cache size 0 max 16384 2023-12-18T10:21:19.674 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-18T10:21:19.663+0000 7fbf38424640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-12-18T10:21:00.573292+0000 1=0+1) n(v2 rc2023-12-18T10:21:00.795324+0000 4=0+4) (inest lock) (iversion lock) caps={6342=pAsLsXsFs/-@7},l=6342 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55d39ac7e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.573292+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.795324+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.573292+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-12-18T10:21:00.795324+0000 4=0+4)","error_str":""},"return_code":-61} 2023-12-18T10:21:19.674 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:19.674 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2023-12-18T10:21:19.674 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_tag": "caa1e0fe-9e81-41d1-a5a9-e36c961d30f3", 2023-12-18T10:21:19.674 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": "asynchronous" 2023-12-18T10:21:19.674 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 -- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5ae8065a90 msgr2=0x7f5ae8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5ae8065a90 0x7f5ae8067f50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5af8000c10 tx=0x7f5af8000fd0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 -- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b080add20 msgr2=0x7f5b080c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b080add20 0x7f5b080c42d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5b0806e190 tx=0x7f5b00010eb0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 -- 172.21.15.133:0/404997930 shutdown_connections 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5ae8065a90 0x7f5ae8067f50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b080add20 0x7f5b080c42d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5b081553f0 0x7f5b0815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 --2- 172.21.15.133:0/404997930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5af4006570 0x7f5b08159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 -- 172.21.15.133:0/404997930 >> 172.21.15.133:0/404997930 conn(0x7f5b08069e70 msgr2=0x7f5b080c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 -- 172.21.15.133:0/404997930 shutdown_connections 2023-12-18T10:21:19.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.667+0000 7f5b0caf9640 1 -- 172.21.15.133:0/404997930 wait complete. 2023-12-18T10:21:19.676 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:21:19.667+0000 7fdb12cc5640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-12-18T10:21:00.571547+0000 1=0+1) n(v4 rc2023-12-18T10:21:00.795324+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={6342=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x5578a01ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.571547+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.795324+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.571547+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-12-18T10:21:00.795324+0000 5=0+5)","error_str":""},"return_code":-61} 2023-12-18T10:21:19.676 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-18T10:21:19.667+0000 7fbf3e430640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-12-18T10:21:00.574998+0000 1=0+1) n(v1 rc2023-12-18T10:21:00.795324+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={6342=pAsLsXsFs/-@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55d39ac7e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.574998+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.576701+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.574998+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-12-18T10:21:00.795324+0000 3=0+3)","error_str":""},"return_code":-61} 2023-12-18T10:21:19.689 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub abort 2023-12-18T10:21:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.823+0000 7f1a58e63640 1 Processor -- start 2023-12-18T10:21:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.823+0000 7f1a58e63640 1 -- start start 2023-12-18T10:21:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.823+0000 7f1a58e63640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1a54160a60 0x7f1a540ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.823+0000 7f1a58e63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a540ce8f0 0x7f1a54164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.823+0000 7f1a58e63640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a54164e60 0x7f1a540cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.823+0000 7f1a58e63640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540ced50 con 0x7f1a54164e60 2023-12-18T10:21:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.823+0000 7f1a58e63640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540cc980 con 0x7f1a54160a60 2023-12-18T10:21:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.823+0000 7f1a58e63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540cc090 con 0x7f1a540ce8f0 2023-12-18T10:21:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a54164e60 0x7f1a540cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a54164e60 0x7f1a540cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57850/0 (socket says 172.21.15.133:57850) 2023-12-18T10:21:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 -- 172.21.15.133:0/2612510487 learned_addr learned my addr 172.21.15.133:0/2612510487 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/2612510487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a540ce8f0 0x7f1a54164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a5259c640 1 --2- 172.21.15.133:0/2612510487 >> v2:172.21.15.142:3300/0 conn(0x7f1a54160a60 0x7f1a540ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 -- 172.21.15.133:0/2612510487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a540ce8f0 msgr2=0x7f1a54164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/2612510487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a540ce8f0 0x7f1a54164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 -- 172.21.15.133:0/2612510487 >> v2:172.21.15.142:3300/0 conn(0x7f1a54160a60 msgr2=0x7f1a540ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/2612510487 >> v2:172.21.15.142:3300/0 conn(0x7f1a54160a60 0x7f1a540ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 -- 172.21.15.133:0/2612510487 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540cc330 con 0x7f1a54164e60 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/2612510487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a540ce8f0 0x7f1a54164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a5259c640 1 --2- 172.21.15.133:0/2612510487 >> v2:172.21.15.142:3300/0 conn(0x7f1a54160a60 0x7f1a540ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/2612510487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54164e60 0x7f1a540cad30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b07c0 tx=0x7f1a4c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6cf7fd3069d958 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a51d9b640 1 -- 172.21.15.133:0/2612510487 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0a5840 con 0x7f1a54164e60 2023-12-18T10:21:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a51d9b640 1 -- 172.21.15.133:0/2612510487 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0a59a0 con 0x7f1a54164e60 2023-12-18T10:21:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.827+0000 7f1a51d9b640 1 -- 172.21.15.133:0/2612510487 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0a5d30 con 0x7f1a54164e60 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- 172.21.15.133:0/2612510487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54164e60 msgr2=0x7f1a540cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2612510487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54164e60 0x7f1a540cad30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b07c0 tx=0x7f1a4c01c9a0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- 172.21.15.133:0/2612510487 shutdown_connections 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2612510487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54164e60 0x7f1a540cad30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2612510487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a540ce8f0 0x7f1a54164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2612510487 >> v2:172.21.15.142:3300/0 conn(0x7f1a54160a60 0x7f1a540ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- 172.21.15.133:0/2612510487 >> 172.21.15.133:0/2612510487 conn(0x7f1a5406a2a0 msgr2=0x7f1a540aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- 172.21.15.133:0/2612510487 shutdown_connections 2023-12-18T10:21:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- 172.21.15.133:0/2612510487 wait complete. 2023-12-18T10:21:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 Processor -- start 2023-12-18T10:21:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- start start 2023-12-18T10:21:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a540ce8f0 0x7f1a5415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54160a60 0x7f1a5415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a54164e60 0x7f1a541587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54156860 con 0x7f1a54160a60 2023-12-18T10:21:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5415a780 con 0x7f1a540ce8f0 2023-12-18T10:21:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a58e63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a541569f0 con 0x7f1a54164e60 2023-12-18T10:21:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a49d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54160a60 0x7f1a5415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a49d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54160a60 0x7f1a5415a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57852/0 (socket says 172.21.15.133:57852) 2023-12-18T10:21:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a49d9b640 1 -- 172.21.15.133:0/2100885208 learned_addr learned my addr 172.21.15.133:0/2100885208 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a5259c640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a540ce8f0 0x7f1a5415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.831+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a54164e60 0x7f1a541587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a49d9b640 1 -- 172.21.15.133:0/2100885208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a54164e60 msgr2=0x7f1a541587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a54164e60 0x7f1a541587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a49d9b640 1 -- 172.21.15.133:0/2100885208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a540ce8f0 msgr2=0x7f1a5415bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a540ce8f0 0x7f1a5415bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a49d9b640 1 -- 172.21.15.133:0/2100885208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009b30 con 0x7f1a54160a60 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54160a60 0x7f1a5415a240 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c820 tx=0x7f1a4400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a4b7fe640 1 -- 172.21.15.133:0/2100885208 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44007a30 con 0x7f1a54160a60 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a4b7fe640 1 -- 172.21.15.133:0/2100885208 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44007b90 con 0x7f1a54160a60 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a4b7fe640 1 -- 172.21.15.133:0/2100885208 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400ce10 con 0x7f1a54160a60 2023-12-18T10:21:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a58e63640 1 -- 172.21.15.133:0/2100885208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5415a9b0 con 0x7f1a54160a60 2023-12-18T10:21:19.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a58e63640 1 -- 172.21.15.133:0/2100885208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5415af70 con 0x7f1a54160a60 2023-12-18T10:21:19.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a4b7fe640 1 -- 172.21.15.133:0/2100885208 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a440113f0 con 0x7f1a54160a60 2023-12-18T10:21:19.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a4b7fe640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a34065a60 0x7f1a34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a4b7fe640 1 -- 172.21.15.133:0/2100885208 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a44083290 con 0x7f1a54160a60 2023-12-18T10:21:19.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.835+0000 7f1a5259c640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a34065a60 0x7f1a34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 Processor -- start 2023-12-18T10:21:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5259c640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a34065a60 0x7f1a34067f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1a5415b5e0 tx=0x7f1a3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- start start 2023-12-18T10:21:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 0x55ecb1647000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb15fca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb15fd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecb14c53d0 con 0x55ecb1647540 2023-12-18T10:21:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecb1453400 con 0x55ecb1646c20 2023-12-18T10:21:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ecb14509d0 con 0x55ecb15fcf60 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb15fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb15fca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57854/0 (socket says 172.21.15.133:57854) 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 -- 172.21.15.133:0/769832640 learned_addr learned my addr 172.21.15.133:0/769832640 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5259c640 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 0x55ecb1647000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb15fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 -- 172.21.15.133:0/769832640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 msgr2=0x55ecb15fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb15fd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 -- 172.21.15.133:0/769832640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 msgr2=0x55ecb1647000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 0x55ecb1647000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 -- 172.21.15.133:0/769832640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecb1148dc0 con 0x55ecb1647540 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb15fca20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1a4405c310 tx=0x7f1a440549d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380c69d10dbd4634 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a33fff640 1 -- 172.21.15.133:0/769832640 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4405c840 con 0x55ecb1647540 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a33fff640 1 -- 172.21.15.133:0/769832640 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44052cb0 con 0x55ecb1647540 2023-12-18T10:21:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a33fff640 1 -- 172.21.15.133:0/769832640 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4405c3b0 con 0x55ecb1647540 2023-12-18T10:21:19.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/769832640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 msgr2=0x55ecb15fca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb15fca20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1a4405c310 tx=0x7f1a440549d0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/769832640 shutdown_connections 2023-12-18T10:21:19.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb15fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb15fca20 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/769832640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 0x55ecb1647000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/769832640 >> 172.21.15.133:0/769832640 conn(0x55ecb13fb8b0 msgr2=0x55ecb15fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/769832640 shutdown_connections 2023-12-18T10:21:19.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.839+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/769832640 wait complete. 2023-12-18T10:21:19.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 -- start start 2023-12-18T10:21:19.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 Processor -- start 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb15fcf60 0x55ecb164dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb1646c20 0x55ecb164e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb1647920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecb144c2c0 con 0x55ecb1647540 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecb13eb490 con 0x55ecb15fcf60 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ecb1409680 con 0x55ecb1646c20 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 10 client.0 _ll_register_callbacks cb 0x55ecb15e8920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a52d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb1647920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a49d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb1646c20 0x55ecb164e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb15fcf60 0x55ecb164dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a52d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb1647920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57864/0 (socket says 172.21.15.133:57864) 2023-12-18T10:21:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a52d9d640 1 -- 172.21.15.133:0/3590151322 learned_addr learned my addr 172.21.15.133:0/3590151322 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5259c640 1 -- 172.21.15.133:0/3590151322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb1646c20 msgr2=0x55ecb164e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5259c640 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb1646c20 0x55ecb164e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5259c640 1 -- 172.21.15.133:0/3590151322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 msgr2=0x55ecb1647920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5259c640 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb1647920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5259c640 1 -- 172.21.15.133:0/3590151322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5415af70 con 0x55ecb15fcf60 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb1646c20 0x55ecb164e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb1647920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5259c640 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb15fcf60 0x55ecb164dfc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00afd0 tx=0x7f1a3c004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b05c16201a0d2c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a317fa640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a317fa640 1 -- 172.21.15.133:0/3590151322 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c013870 con 0x55ecb15fcf60 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a317fa640 1 -- 172.21.15.133:0/3590151322 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a3c0139d0 con 0x55ecb15fcf60 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/3590151322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecb14090c0 con 0x55ecb15fcf60 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a317fa640 1 -- 172.21.15.133:0/3590151322 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a3c013bd0 con 0x55ecb15fcf60 2023-12-18T10:21:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 10 client.6226 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/3590151322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55ecb14111f0 con 0x55ecb15fcf60 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a317fa640 1 -- 172.21.15.133:0/3590151322 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ecb14090c0 con 0x55ecb15fcf60 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a317fa640 1 -- 172.21.15.133:0/3590151322 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f1a3c011040 con 0x55ecb15fcf60 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 10 client.6226 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 10 client.6226 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 20 client.6226 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55ecb16486c0 0x55ecb1648ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 4 client.6226 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/3590151322 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ecb144ac10 con 0x55ecb16486c0 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.843+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55ecb16486c0 0x55ecb1648ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55ecb16486c0 0x55ecb1648ad0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6f00203926c1e88 server_cookie=ce12820b89e8ddb1 in_seq=0 out_seq=0 2023-12-18T10:21:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a317fa640 10 client.6226 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:19.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a317fa640 1 -- 172.21.15.133:0/3590151322 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ecb144ac10 con 0x55ecb16486c0 2023-12-18T10:21:19.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a317fa640 10 client.6226 handle_command_reply: tid=0 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 client.6226 shutdown 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/3590151322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb15fcf60 msgr2=0x55ecb164dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb15fcf60 0x55ecb164dfc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00afd0 tx=0x7f1a3c004740 comp rx=0 tx=0).stop 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/3590151322 shutdown_connections 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55ecb16486c0 0x55ecb1648ad0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb1647920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb1646c20 0x55ecb164e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/3590151322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb15fcf60 0x55ecb164dfc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a317fa640 0 client.6226 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/3590151322 >> 172.21.15.133:0/3590151322 conn(0x55ecb13fb8b0 msgr2=0x55ecb15fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/3590151322 shutdown_connections 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/3590151322 wait complete. 2023-12-18T10:21:19.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.847+0000 7f1a5c1b8000 20 client.6226 trim_cache size 0 max 16384 2023-12-18T10:21:19.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.859+0000 7f1a5c1b8000 1 Processor -- start 2023-12-18T10:21:19.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.859+0000 7f1a5c1b8000 1 -- start start 2023-12-18T10:21:19.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb164bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 0x55ecb164c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb163ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecb1109a40 con 0x55ecb1647540 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecb1447c30 con 0x55ecb1646c20 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ecb1449ad0 con 0x55ecb15fcf60 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb163ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb163ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57880/0 (socket says 172.21.15.133:57880) 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 -- 172.21.15.133:0/117369971 learned_addr learned my addr 172.21.15.133:0/117369971 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5259c640 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb164bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 0x55ecb164c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 -- 172.21.15.133:0/117369971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 msgr2=0x55ecb164bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb164bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 -- 172.21.15.133:0/117369971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 msgr2=0x55ecb164c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 0x55ecb164c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 -- 172.21.15.133:0/117369971 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecb13f7540 con 0x55ecb1647540 2023-12-18T10:21:19.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb163ffb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c01ce80 tx=0x7f1a4c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457af6ab81c65df1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a48d99640 1 -- 172.21.15.133:0/117369971 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0bb070 con 0x55ecb1647540 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a48d99640 1 -- 172.21.15.133:0/117369971 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0a5df0 con 0x55ecb1647540 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a48d99640 1 -- 172.21.15.133:0/117369971 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0bf670 con 0x55ecb1647540 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/117369971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 msgr2=0x55ecb163ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb163ffb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c01ce80 tx=0x7f1a4c004ac0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/117369971 shutdown_connections 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1647540 0x55ecb163ffb0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1646c20 0x55ecb164c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/117369971 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb164bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/117369971 >> 172.21.15.133:0/117369971 conn(0x55ecb13fb8b0 msgr2=0x55ecb1602470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/117369971 shutdown_connections 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/117369971 wait complete. 2023-12-18T10:21:19.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 -- start start 2023-12-18T10:21:19.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.863+0000 7f1a5c1b8000 1 Processor -- start 2023-12-18T10:21:19.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb16a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1646c20 0x55ecb1643190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1647540 0x55ecb16436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecb151b0e0 con 0x55ecb1646c20 2023-12-18T10:21:19.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecb13f17c0 con 0x55ecb1647540 2023-12-18T10:21:19.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ecb1454690 con 0x55ecb15fcf60 2023-12-18T10:21:19.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 10 client.0 _ll_register_callbacks cb 0x55ecb14036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:19.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1646c20 0x55ecb1643190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1646c20 0x55ecb1643190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57888/0 (socket says 172.21.15.133:57888) 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 -- 172.21.15.133:0/4242246787 learned_addr learned my addr 172.21.15.133:0/4242246787 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5259c640 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb16a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a52d9d640 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1647540 0x55ecb16436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 -- 172.21.15.133:0/4242246787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 msgr2=0x55ecb16a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb16a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 -- 172.21.15.133:0/4242246787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1647540 msgr2=0x55ecb16436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1647540 0x55ecb16436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 -- 172.21.15.133:0/4242246787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a540cc330 con 0x55ecb1646c20 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a49d9b640 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1646c20 0x55ecb1643190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1a440816e0 tx=0x7f1a44083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129b31a24b42d536 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 1 -- 172.21.15.133:0/4242246787 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a440546e0 con 0x55ecb1646c20 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 1 -- 172.21.15.133:0/4242246787 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a44052cb0 con 0x55ecb1646c20 2023-12-18T10:21:19.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/4242246787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecb16008e0 con 0x55ecb1646c20 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 1 -- 172.21.15.133:0/4242246787 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a440812b0 con 0x55ecb1646c20 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 10 client.6576 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/4242246787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55ecb13eb0b0 con 0x55ecb1646c20 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 1 -- 172.21.15.133:0/4242246787 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ecb16008e0 con 0x55ecb1646c20 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 1 -- 172.21.15.133:0/4242246787 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f1a44072230 con 0x55ecb1646c20 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 10 client.6576 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 10 client.6576 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 20 client.6576 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55ecb1643c10 0x55ecb1644020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 4 client.6576 mds_command: new command op to 6165 tid=0[{"prefix": "scrub abort"}] 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/4242246787 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x55ecb1415640 con 0x55ecb1643c10 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5259c640 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55ecb1643c10 0x55ecb1644020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5259c640 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55ecb1643c10 0x55ecb1644020 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69fa29142556d0bb server_cookie=62946c43724f41ba in_seq=0 out_seq=0 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 10 client.6576 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 1 -- 172.21.15.133:0/4242246787 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55ecb1415640 con 0x55ecb1643c10 2023-12-18T10:21:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 10 client.6576 handle_command_reply: tid=0 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 client.6576 shutdown 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/4242246787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1646c20 msgr2=0x55ecb1643190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1646c20 0x55ecb1643190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1a440816e0 tx=0x7f1a44083040 comp rx=0 tx=0).stop 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/4242246787 shutdown_connections 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55ecb1643c10 0x55ecb1644020 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecb1647540 0x55ecb16436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ecb1646c20 0x55ecb1643190 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a317fa640 0 client.6576 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 --2- 172.21.15.133:0/4242246787 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ecb15fcf60 0x55ecb16a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/4242246787 >> 172.21.15.133:0/4242246787 conn(0x55ecb13fb8b0 msgr2=0x55ecb164aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/4242246787 shutdown_connections 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 1 -- 172.21.15.133:0/4242246787 wait complete. 2023-12-18T10:21:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.867+0000 7f1a5c1b8000 20 client.6576 trim_cache size 0 max 16384 2023-12-18T10:21:19.877 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:19.877 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:21:19.877 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:19.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 -- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a34065a60 msgr2=0x7f1a34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a34065a60 0x7f1a34067f20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1a5415b5e0 tx=0x7f1a3c008040 comp rx=0 tx=0).stop 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 -- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54160a60 msgr2=0x7f1a5415a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54160a60 0x7f1a5415a240 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c820 tx=0x7f1a4400cce0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 -- 172.21.15.133:0/2100885208 shutdown_connections 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1a34065a60 0x7f1a34067f20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1a54164e60 0x7f1a541587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54160a60 0x7f1a5415a240 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 --2- 172.21.15.133:0/2100885208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a540ce8f0 0x7f1a5415bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 -- 172.21.15.133:0/2100885208 >> 172.21.15.133:0/2100885208 conn(0x7f1a5406a2a0 msgr2=0x7f1a541590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 -- 172.21.15.133:0/2100885208 shutdown_connections 2023-12-18T10:21:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:19.871+0000 7f1a58e63640 1 -- 172.21.15.133:0/2100885208 wait complete. 2023-12-18T10:21:19.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2023-12-18T10:21:20.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.031+0000 7f3e5372c640 1 Processor -- start 2023-12-18T10:21:20.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.031+0000 7f3e5372c640 1 -- start start 2023-12-18T10:21:20.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.031+0000 7f3e5372c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.031+0000 7f3e5372c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0cc980 con 0x7f3e4c164e60 2023-12-18T10:21:20.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.031+0000 7f3e5372c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0cc090 con 0x7f3e4c160a60 2023-12-18T10:21:20.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.031+0000 7f3e5372c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0cc330 con 0x7f3e4c0ceac0 2023-12-18T10:21:20.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e51cc9640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3e4c164e60 0x7f3e4c0cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43474/0 (socket says 172.21.15.133:43474) 2023-12-18T10:21:20.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e51cc9640 1 -- 172.21.15.133:0/2038263635 learned_addr learned my addr 172.21.15.133:0/2038263635 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:20.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/2038263635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e43fff640 1 -- 172.21.15.133:0/2038263635 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217700287 0 0) 0x7f3e4c0cc980 con 0x7f3e4c164e60 2023-12-18T10:21:20.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e43fff640 1 -- 172.21.15.133:0/2038263635 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e38003530 con 0x7f3e4c164e60 2023-12-18T10:21:20.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e43fff640 1 -- 172.21.15.133:0/2038263635 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440696858 0 0) 0x7f3e4c0cc090 con 0x7f3e4c160a60 2023-12-18T10:21:20.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e50cc7640 1 -- 172.21.15.133:0/2038263635 >> v1:172.21.15.142:6789/0 conn(0x7f3e4c160a60 legacy=0x7f3e4c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e50cc7640 1 -- 172.21.15.133:0/2038263635 >> v1:172.21.15.133:6789/0 conn(0x7f3e4c164e60 legacy=0x7f3e4c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e50cc7640 1 -- 172.21.15.133:0/2038263635 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0cc610 con 0x7f3e4c0ceac0 2023-12-18T10:21:20.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/2038263635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c164920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c009820 tx=0x7f3e3c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb29ae044e1c1c82 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:20.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e43fff640 1 -- 172.21.15.133:0/2038263635 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c165480 con 0x7f3e4c0ceac0 2023-12-18T10:21:20.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e43fff640 1 -- 172.21.15.133:0/2038263635 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c0aa620 con 0x7f3e4c0ceac0 2023-12-18T10:21:20.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.035+0000 7f3e43fff640 1 -- 172.21.15.133:0/2038263635 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0aa9b0 con 0x7f3e4c0ceac0 2023-12-18T10:21:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- 172.21.15.133:0/2038263635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 msgr2=0x7f3e4c164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 --2- 172.21.15.133:0/2038263635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c164920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c009820 tx=0x7f3e3c01c4a0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- 172.21.15.133:0/2038263635 shutdown_connections 2023-12-18T10:21:20.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 --2- 172.21.15.133:0/2038263635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c164920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- 172.21.15.133:0/2038263635 >> 172.21.15.133:0/2038263635 conn(0x7f3e4c06a2a0 msgr2=0x7f3e4c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:20.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- 172.21.15.133:0/2038263635 shutdown_connections 2023-12-18T10:21:20.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- 172.21.15.133:0/2038263635 wait complete. 2023-12-18T10:21:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 Processor -- start 2023-12-18T10:21:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- start start 2023-12-18T10:21:20.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c0b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c160a60 0x7f3e4c0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e4c164e60 0x7f3e4c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c162f90 con 0x7f3e4c160a60 2023-12-18T10:21:20.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c160080 con 0x7f3e4c164e60 2023-12-18T10:21:20.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e5372c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b24e0 con 0x7f3e4c0ceac0 2023-12-18T10:21:20.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e50cc7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c160a60 0x7f3e4c0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e50cc7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c160a60 0x7f3e4c0b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33568/0 (socket says 172.21.15.133:33568) 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e50cc7640 1 -- 172.21.15.133:0/4018160000 learned_addr learned my addr 172.21.15.133:0/4018160000 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e514c8640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c0b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.039+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e4c164e60 0x7f3e4c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e50cc7640 1 -- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 msgr2=0x7f3e4c0b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c0b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e50cc7640 1 -- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e4c164e60 msgr2=0x7f3e4c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e4c164e60 0x7f3e4c0b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e50cc7640 1 -- 172.21.15.133:0/4018160000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c009420 con 0x7f3e4c160a60 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e4c164e60 0x7f3e4c0b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c160a60 0x7f3e4c0b2d00 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c009820 tx=0x7f3e3c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e41ffb640 1 -- 172.21.15.133:0/4018160000 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0aade0 con 0x7f3e4c160a60 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e41ffb640 1 -- 172.21.15.133:0/4018160000 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c0be410 con 0x7f3e4c160a60 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e41ffb640 1 -- 172.21.15.133:0/4018160000 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0be7c0 con 0x7f3e4c160a60 2023-12-18T10:21:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e5372c640 1 -- 172.21.15.133:0/4018160000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0b27c0 con 0x7f3e4c160a60 2023-12-18T10:21:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e5372c640 1 -- 172.21.15.133:0/4018160000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0b3f30 con 0x7f3e4c160a60 2023-12-18T10:21:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.043+0000 7f3e41ffb640 1 -- 172.21.15.133:0/4018160000 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3e3c0be920 con 0x7f3e4c160a60 2023-12-18T10:21:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e41ffb640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e30065a60 0x7f3e30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e41ffb640 1 -- 172.21.15.133:0/4018160000 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3e3c11d8c0 con 0x7f3e4c160a60 2023-12-18T10:21:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e514c8640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e30065a60 0x7f3e30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 Processor -- start 2023-12-18T10:21:20.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- start start 2023-12-18T10:21:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e514c8640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e30065a60 0x7f3e30067f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3e48000f70 tx=0x7f3e48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 0x556f2a460a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f2a329430 con 0x556f2a460fc0 2023-12-18T10:21:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f2a2b7460 con 0x556f2a4ab5a0 2023-12-18T10:21:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f2a2b4a30 con 0x556f2a4aac80 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4613a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33572/0 (socket says 172.21.15.133:33572) 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 -- 172.21.15.133:0/2731306550 learned_addr learned my addr 172.21.15.133:0/2731306550 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 0x556f2a460a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e514c8640 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 -- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 msgr2=0x556f2a4ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 -- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 msgr2=0x556f2a460a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 0x556f2a460a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 -- 172.21.15.133:0/2731306550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f29face20 con 0x556f2a460fc0 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e514c8640 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:20.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4613a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3e44002070 tx=0x7f3e4400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd36cee03dbfb27 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:20.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e2effd640 1 -- 172.21.15.133:0/2731306550 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44014480 con 0x556f2a460fc0 2023-12-18T10:21:20.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e2effd640 1 -- 172.21.15.133:0/2731306550 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e440145e0 con 0x556f2a460fc0 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e2effd640 1 -- 172.21.15.133:0/2731306550 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44014950 con 0x556f2a460fc0 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- 172.21.15.133:0/2731306550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 msgr2=0x556f2a4613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4613a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3e44002070 tx=0x7f3e4400e530 comp rx=0 tx=0).stop 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- 172.21.15.133:0/2731306550 shutdown_connections 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4613a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 0x556f2a460a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2731306550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- 172.21.15.133:0/2731306550 >> 172.21.15.133:0/2731306550 conn(0x556f2a25f910 msgr2=0x556f2a45f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- 172.21.15.133:0/2731306550 shutdown_connections 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.047+0000 7f3e56a80000 1 -- 172.21.15.133:0/2731306550 wait complete. 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 -- start start 2023-12-18T10:21:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 Processor -- start 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 0x556f2a4abec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f2a2b0320 con 0x556f2a460fc0 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f2a24f4f0 con 0x556f2a4ab5a0 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f2a26d6e0 con 0x556f2a4aac80 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 10 client.0 _ll_register_callbacks cb 0x556f2a44c980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4aa1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33586/0 (socket says 172.21.15.133:33586) 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 -- 172.21.15.133:0/2989457867 learned_addr learned my addr 172.21.15.133:0/2989457867 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 0x556f2a4abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 -- 172.21.15.133:0/2989457867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 msgr2=0x556f2a4ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 -- 172.21.15.133:0/2989457867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 msgr2=0x556f2a4abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 0x556f2a4abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 -- 172.21.15.133:0/2989457867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4400f040 con 0x556f2a460fc0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e514c8640 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4aa1c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3e48014780 tx=0x7f3e48001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ccd2e2912133d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e27fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e27fff640 1 -- 172.21.15.133:0/2989457867 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480135c0 con 0x556f2a460fc0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e27fff640 1 -- 172.21.15.133:0/2989457867 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3e4801c040 con 0x556f2a460fc0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 -- 172.21.15.133:0/2989457867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f2a26d120 con 0x556f2a460fc0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e27fff640 1 -- 172.21.15.133:0/2989457867 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e48013720 con 0x556f2a460fc0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 10 client.6588 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 -- 172.21.15.133:0/2989457867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x556f2a275250 con 0x556f2a460fc0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e27fff640 1 -- 172.21.15.133:0/2989457867 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f2a26d120 con 0x556f2a460fc0 2023-12-18T10:21:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e27fff640 1 -- 172.21.15.133:0/2989457867 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3e48012070 con 0x556f2a460fc0 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 10 client.6588 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 10 client.6588 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.a 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 20 client.6588 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x556f2a4ac8d0 0x556f2a4acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 4 client.6588 mds_command: new command op to 6162 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.051+0000 7f3e56a80000 1 -- 172.21.15.133:0/2989457867 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f2a2aec70 con 0x556f2a4ac8d0 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x556f2a4ac8d0 0x556f2a4acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x556f2a4ac8d0 0x556f2a4acce0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1360c01d1c46b4e9 server_cookie=7c34763d3fad6ded in_seq=0 out_seq=0 2023-12-18T10:21:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e27fff640 10 client.6588 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e27fff640 1 -- 172.21.15.133:0/2989457867 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x556f2a2aec70 con 0x556f2a4ac8d0 2023-12-18T10:21:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e27fff640 10 client.6588 handle_command_reply: tid=0 2023-12-18T10:21:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 client.6588 shutdown 2023-12-18T10:21:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 -- 172.21.15.133:0/2989457867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 msgr2=0x556f2a4aa1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4aa1c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3e48014780 tx=0x7f3e48001090 comp rx=0 tx=0).stop 2023-12-18T10:21:20.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 -- 172.21.15.133:0/2989457867 shutdown_connections 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x556f2a4ac8d0 0x556f2a4acce0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4ab5a0 0x556f2a4abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 --2- 172.21.15.133:0/2989457867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a460fc0 0x556f2a4aa1c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e27fff640 0 client.6588 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 -- 172.21.15.133:0/2989457867 >> 172.21.15.133:0/2989457867 conn(0x556f2a25f910 msgr2=0x556f2a45fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 -- 172.21.15.133:0/2989457867 shutdown_connections 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 1 -- 172.21.15.133:0/2989457867 wait complete. 2023-12-18T10:21:20.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.055+0000 7f3e56a80000 20 client.6588 trim_cache size 0 max 16384 2023-12-18T10:21:20.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.067+0000 7f3e56a80000 1 Processor -- start 2023-12-18T10:21:20.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.067+0000 7f3e56a80000 1 -- start start 2023-12-18T10:21:20.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a460fc0 0x556f2a4a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4a9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4bafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f29f6daa0 con 0x556f2a4ab5a0 2023-12-18T10:21:20.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f2a2ad720 con 0x556f2a460fc0 2023-12-18T10:21:20.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f2a367e50 con 0x556f2a4aac80 2023-12-18T10:21:20.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4bafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e514c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a460fc0 0x556f2a4a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4bafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33592/0 (socket says 172.21.15.133:33592) 2023-12-18T10:21:20.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 -- 172.21.15.133:0/3256005738 learned_addr learned my addr 172.21.15.133:0/3256005738 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:20.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 -- 172.21.15.133:0/3256005738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 msgr2=0x556f2a4a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 -- 172.21.15.133:0/3256005738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a460fc0 msgr2=0x556f2a4a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a460fc0 0x556f2a4a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 -- 172.21.15.133:0/3256005738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f2a25b5a0 con 0x556f2a4ab5a0 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e514c8640 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a460fc0 0x556f2a4a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4bafa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3e44001590 tx=0x7f3e4400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d93d6dbb3eda1d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/3256005738 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44001bc0 con 0x556f2a4ab5a0 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/3256005738 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e44014480 con 0x556f2a4ab5a0 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/3256005738 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44014830 con 0x556f2a4ab5a0 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- 172.21.15.133:0/3256005738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 msgr2=0x556f2a4bafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4bafa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3e44001590 tx=0x7f3e4400a000 comp rx=0 tx=0).stop 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- 172.21.15.133:0/3256005738 shutdown_connections 2023-12-18T10:21:20.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4bafa0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a4aac80 0x556f2a4a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 --2- 172.21.15.133:0/3256005738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a460fc0 0x556f2a4a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- 172.21.15.133:0/3256005738 >> 172.21.15.133:0/3256005738 conn(0x556f2a25f910 msgr2=0x556f2a4b7590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:20.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- 172.21.15.133:0/3256005738 shutdown_connections 2023-12-18T10:21:20.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- 172.21.15.133:0/3256005738 wait complete. 2023-12-18T10:21:20.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 -- start start 2023-12-18T10:21:20.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.071+0000 7f3e56a80000 1 Processor -- start 2023-12-18T10:21:20.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a460fc0 0x556f2a4ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4aac80 0x556f2a4ec3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4ec900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f2a2f34d0 con 0x556f2a4ab5a0 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f2a2abc90 con 0x556f2a4aac80 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f2a465be0 con 0x556f2a460fc0 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 10 client.0 _ll_register_callbacks cb 0x556f2a267710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4ec900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4ec900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33606/0 (socket says 172.21.15.133:33606) 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 -- 172.21.15.133:0/995468154 learned_addr learned my addr 172.21.15.133:0/995468154 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e514c8640 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a460fc0 0x556f2a4ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e50cc7640 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4aac80 0x556f2a4ec3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 -- 172.21.15.133:0/995468154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a460fc0 msgr2=0x556f2a4ebb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a460fc0 0x556f2a4ebb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 -- 172.21.15.133:0/995468154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4aac80 msgr2=0x556f2a4ec3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:20.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4aac80 0x556f2a4ec3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 -- 172.21.15.133:0/995468154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f2a275250 con 0x556f2a4ab5a0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e51cc9640 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4ec900 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3e44000f90 tx=0x7f3e44001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58960d0fe4105817 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e27fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e27fff640 1 -- 172.21.15.133:0/995468154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44014800 con 0x556f2a4ab5a0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e27fff640 1 -- 172.21.15.133:0/995468154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3e44014960 con 0x556f2a4ab5a0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 -- 172.21.15.133:0/995468154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f2a2796a0 con 0x556f2a4ab5a0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e27fff640 1 -- 172.21.15.133:0/995468154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e44014b80 con 0x556f2a4ab5a0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 10 client.6594 fetch_fsmap learned FSMap version 39 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 -- 172.21.15.133:0/995468154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x556f29face20 con 0x556f2a4ab5a0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e27fff640 1 -- 172.21.15.133:0/995468154 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556f2a2796a0 con 0x556f2a4ab5a0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e27fff640 1 -- 172.21.15.133:0/995468154 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 39) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3e44026020 con 0x556f2a4ab5a0 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 10 client.6594 fetch_fsmap finished waiting for FSMap version 39 2023-12-18T10:21:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 10 client.6594 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.a 2023-12-18T10:21:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 20 client.6594 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x556f2a4ece40 0x556f2a4ed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 4 client.6594 mds_command: new command op to 6162 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:21:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e56a80000 1 -- 172.21.15.133:0/995468154 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556f2a2a93a0 con 0x556f2a4ece40 2023-12-18T10:21:20.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e514c8640 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x556f2a4ece40 0x556f2a4ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e514c8640 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x556f2a4ece40 0x556f2a4ed220 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5261598920f657b3 server_cookie=f797e9714e625f6a in_seq=0 out_seq=0 2023-12-18T10:21:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.075+0000 7f3e27fff640 10 client.6594 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e27fff640 1 -- 172.21.15.133:0/995468154 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x556f2a2a93a0 con 0x556f2a4ece40 2023-12-18T10:21:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e27fff640 10 client.6594 handle_command_reply: tid=0 2023-12-18T10:21:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 client.6594 shutdown 2023-12-18T10:21:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 -- 172.21.15.133:0/995468154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 msgr2=0x556f2a4ec900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4ec900 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3e44000f90 tx=0x7f3e44001260 comp rx=0 tx=0).stop 2023-12-18T10:21:20.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 -- 172.21.15.133:0/995468154 shutdown_connections 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x556f2a4ece40 0x556f2a4ed220 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556f2a4ab5a0 0x556f2a4ec900 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556f2a4aac80 0x556f2a4ec3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 --2- 172.21.15.133:0/995468154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556f2a460fc0 0x556f2a4ebb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 -- 172.21.15.133:0/995468154 >> 172.21.15.133:0/995468154 conn(0x556f2a25f910 msgr2=0x556f2a4a8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e27fff640 0 client.6594 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 -- 172.21.15.133:0/995468154 shutdown_connections 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 1 -- 172.21.15.133:0/995468154 wait complete. 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e56a80000 20 client.6594 trim_cache size 0 max 16384 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:21:20.087 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:21:20.088 INFO:teuthology.orchestra.run.smithi133.stdout: "caa1e0fe-9e81-41d1-a5a9-e36c961d30f3": { 2023-12-18T10:21:20.088 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:21:20.088 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "caa1e0fe-9e81-41d1-a5a9-e36c961d30f3", 2023-12-18T10:21:20.088 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:21:20.088 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:20.088 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:20.088 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 -- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e30065a60 msgr2=0x7f3e30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e30065a60 0x7f3e30067f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3e48000f70 tx=0x7f3e48009040 comp rx=0 tx=0).stop 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 -- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c160a60 msgr2=0x7f3e4c0b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c160a60 0x7f3e4c0b2d00 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c009820 tx=0x7f3e3c01ace0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 -- 172.21.15.133:0/4018160000 shutdown_connections 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e30065a60 0x7f3e30067f20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e4c164e60 0x7f3e4c0b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c160a60 0x7f3e4c0b2d00 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 --2- 172.21.15.133:0/4018160000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e4c0ceac0 0x7f3e4c0b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 -- 172.21.15.133:0/4018160000 >> 172.21.15.133:0/4018160000 conn(0x7f3e4c06a2a0 msgr2=0x7f3e4c0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 -- 172.21.15.133:0/4018160000 shutdown_connections 2023-12-18T10:21:20.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:20.079+0000 7f3e5372c640 1 -- 172.21.15.133:0/4018160000 wait complete. 2023-12-18T10:21:20.957 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:21:20.951+0000 7f3bac1eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-18T10:21:25.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2023-12-18T10:21:25.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf6a6fc640 1 Processor -- start 2023-12-18T10:21:25.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf6a6fc640 1 -- start start 2023-12-18T10:21:25.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf6a6fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf640ca410 0x7faf64159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf6a6fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf64159fb0 0x7faf64071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf6a6fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf64070df0 con 0x7faf64071db0 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf6a6fc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6415aab0 con 0x7faf640ca410 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf6a6fc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6415a4f0 con 0x7faf64159fb0 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf63fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf640ca410 0x7faf64159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf63fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf640ca410 0x7faf64159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33620/0 (socket says 172.21.15.133:33620) 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf63fff640 1 -- 172.21.15.133:0/4282931080 learned_addr learned my addr 172.21.15.133:0/4282931080 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf637fe640 1 --2- 172.21.15.133:0/4282931080 >> v2:172.21.15.142:3300/0 conn(0x7faf64159fb0 0x7faf64071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf63fff640 1 -- 172.21.15.133:0/4282931080 >> v2:172.21.15.142:3300/0 conn(0x7faf64159fb0 msgr2=0x7faf64071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf63fff640 1 --2- 172.21.15.133:0/4282931080 >> v2:172.21.15.142:3300/0 conn(0x7faf64159fb0 0x7faf64071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf63fff640 1 -- 172.21.15.133:0/4282931080 >> v1:172.21.15.142:6789/0 conn(0x7faf64071db0 legacy=0x7faf640cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf63fff640 1 -- 172.21.15.133:0/4282931080 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6415a7d0 con 0x7faf640ca410 2023-12-18T10:21:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.247+0000 7faf637fe640 1 --2- 172.21.15.133:0/4282931080 >> v2:172.21.15.142:3300/0 conn(0x7faf64159fb0 0x7faf64071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf63fff640 1 --2- 172.21.15.133:0/4282931080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64159a70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7faf640cbeb0 tx=0x7faf5401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672c8f53a03adab6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf62ffd640 1 -- 172.21.15.133:0/4282931080 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540aa5f0 con 0x7faf640ca410 2023-12-18T10:21:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf62ffd640 1 -- 172.21.15.133:0/4282931080 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf540aa750 con 0x7faf640ca410 2023-12-18T10:21:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf62ffd640 1 -- 172.21.15.133:0/4282931080 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540aaae0 con 0x7faf640ca410 2023-12-18T10:21:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf6a6fc640 1 -- 172.21.15.133:0/4282931080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 msgr2=0x7faf64159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/4282931080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64159a70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7faf640cbeb0 tx=0x7faf5401c490 comp rx=0 tx=0).stop 2023-12-18T10:21:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf6a6fc640 1 -- 172.21.15.133:0/4282931080 shutdown_connections 2023-12-18T10:21:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/4282931080 >> v2:172.21.15.142:3300/0 conn(0x7faf64159fb0 0x7faf64071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/4282931080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64159a70 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf6a6fc640 1 -- 172.21.15.133:0/4282931080 >> 172.21.15.133:0/4282931080 conn(0x7faf6406a2a0 msgr2=0x7faf640aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf6a6fc640 1 -- 172.21.15.133:0/4282931080 shutdown_connections 2023-12-18T10:21:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.251+0000 7faf6a6fc640 1 -- 172.21.15.133:0/4282931080 wait complete. 2023-12-18T10:21:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf6a6fc640 1 Processor -- start 2023-12-18T10:21:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf6a6fc640 1 -- start start 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf6a6fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf64071db0 0x7faf640c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf6a6fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf6a6fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf64159fb0 0x7faf640c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf6a6fc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c3d60 con 0x7faf640ca410 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf6a6fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64156640 con 0x7faf64071db0 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf6a6fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c2a60 con 0x7faf64159fb0 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33624/0 (socket says 172.21.15.133:33624) 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 -- 172.21.15.133:0/2416158499 learned_addr learned my addr 172.21.15.133:0/2416158499 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf63fff640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf64071db0 0x7faf640c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf68c99640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf64159fb0 0x7faf640c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 -- 172.21.15.133:0/2416158499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf64159fb0 msgr2=0x7faf640c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf64159fb0 0x7faf640c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 -- 172.21.15.133:0/2416158499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf64071db0 msgr2=0x7faf640c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf64071db0 0x7faf640c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 -- 172.21.15.133:0/2416158499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540094d0 con 0x7faf640ca410 2023-12-18T10:21:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.255+0000 7faf637fe640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64155f40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c7f0 tx=0x7faf5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf60ff9640 1 -- 172.21.15.133:0/2416158499 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800cea0 con 0x7faf640ca410 2023-12-18T10:21:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf60ff9640 1 -- 172.21.15.133:0/2416158499 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58007a30 con 0x7faf640ca410 2023-12-18T10:21:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf6a6fc640 1 -- 172.21.15.133:0/2416158499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf640c2d40 con 0x7faf640ca410 2023-12-18T10:21:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf60ff9640 1 -- 172.21.15.133:0/2416158499 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58007dc0 con 0x7faf640ca410 2023-12-18T10:21:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf6a6fc640 1 -- 172.21.15.133:0/2416158499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf640c3300 con 0x7faf640ca410 2023-12-18T10:21:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf60ff9640 1 -- 172.21.15.133:0/2416158499 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faf580113f0 con 0x7faf640ca410 2023-12-18T10:21:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf60ff9640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faf50065a90 0x7faf50067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf60ff9640 1 -- 172.21.15.133:0/2416158499 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faf58083320 con 0x7faf640ca410 2023-12-18T10:21:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf63fff640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faf50065a90 0x7faf50067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf6da4f000 1 Processor -- start 2023-12-18T10:21:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.259+0000 7faf6da4f000 1 -- start start 2023-12-18T10:21:25.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf63fff640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faf50065a90 0x7faf50067f50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faf540ae000 tx=0x7faf540b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 0x55b2ce58b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58b5a0 0x55b2ce540a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce540fc0 0x55b2ce5413a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce409430 con 0x55b2ce540fc0 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce397460 con 0x55b2ce58b5a0 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce394a30 con 0x55b2ce58ac80 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce540fc0 0x55b2ce5413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce540fc0 0x55b2ce5413a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33628/0 (socket says 172.21.15.133:33628) 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 -- 172.21.15.133:0/3908976883 learned_addr learned my addr 172.21.15.133:0/3908976883 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf63fff640 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 0x55b2ce58b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf637fe640 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58b5a0 0x55b2ce540a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 -- 172.21.15.133:0/3908976883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 msgr2=0x55b2ce58b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 0x55b2ce58b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 -- 172.21.15.133:0/3908976883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58b5a0 msgr2=0x55b2ce540a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58b5a0 0x55b2ce540a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 -- 172.21.15.133:0/3908976883 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2ce08ce20 con 0x55b2ce540fc0 2023-12-18T10:21:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf68c99640 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce540fc0 0x55b2ce5413a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009ee0 tx=0x7faf5c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c379d21457ba4ec7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf49ffb640 1 -- 172.21.15.133:0/3908976883 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c011070 con 0x55b2ce540fc0 2023-12-18T10:21:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf49ffb640 1 -- 172.21.15.133:0/3908976883 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c00a5f0 con 0x55b2ce540fc0 2023-12-18T10:21:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf49ffb640 1 -- 172.21.15.133:0/3908976883 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00a9e0 con 0x55b2ce540fc0 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- 172.21.15.133:0/3908976883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce540fc0 msgr2=0x55b2ce5413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce540fc0 0x55b2ce5413a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009ee0 tx=0x7faf5c00c7d0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- 172.21.15.133:0/3908976883 shutdown_connections 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce540fc0 0x55b2ce5413a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58b5a0 0x55b2ce540a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3908976883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 0x55b2ce58b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- 172.21.15.133:0/3908976883 >> 172.21.15.133:0/3908976883 conn(0x55b2ce33f910 msgr2=0x55b2ce53f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- 172.21.15.133:0/3908976883 shutdown_connections 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- 172.21.15.133:0/3908976883 wait complete. 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 -- start start 2023-12-18T10:21:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.263+0000 7faf6da4f000 1 Processor -- start 2023-12-18T10:21:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 0x55b2ce5965a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 0x55b2ce596ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58b5a0 0x55b2ce592b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce390320 con 0x55b2ce58b5a0 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce32f4f0 con 0x55b2ce540fc0 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce34d6e0 con 0x55b2ce58ac80 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 10 client.0 _ll_register_callbacks cb 0x55b2ce52c980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58b5a0 0x55b2ce592b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58b5a0 0x55b2ce592b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33642/0 (socket says 172.21.15.133:33642) 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 -- 172.21.15.133:0/1761995646 learned_addr learned my addr 172.21.15.133:0/1761995646 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf637fe640 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 0x55b2ce596ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf63fff640 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 0x55b2ce5965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 -- 172.21.15.133:0/1761995646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 msgr2=0x55b2ce596ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 0x55b2ce596ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 -- 172.21.15.133:0/1761995646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 msgr2=0x55b2ce5965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 0x55b2ce5965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 -- 172.21.15.133:0/1761995646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c009b90 con 0x55b2ce58b5a0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf68c99640 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58b5a0 0x55b2ce592b40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c810 tx=0x7faf5c004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87788b4c58227e78 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf42ffd640 1 -- 172.21.15.133:0/1761995646 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c007000 con 0x55b2ce58b5a0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 -- 172.21.15.133:0/1761995646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2ce34d120 con 0x55b2ce58b5a0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf42ffd640 1 -- 172.21.15.133:0/1761995646 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faf5c004250 con 0x55b2ce58b5a0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf42ffd640 1 -- 172.21.15.133:0/1761995646 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf5c004450 con 0x55b2ce58b5a0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 10 client.6606 fetch_fsmap learned FSMap version 42 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 -- 172.21.15.133:0/1761995646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55b2ce355250 con 0x55b2ce58b5a0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf42ffd640 1 -- 172.21.15.133:0/1761995646 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2ce34d120 con 0x55b2ce58b5a0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf42ffd640 1 -- 172.21.15.133:0/1761995646 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7faf5c0045b0 con 0x55b2ce58b5a0 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 10 client.6606 fetch_fsmap finished waiting for FSMap version 42 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 10 client.6606 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.a 2023-12-18T10:21:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 20 client.6606 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b2ce5938b0 0x55b2ce593cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 4 client.6606 mds_command: new command op to 6162 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf6da4f000 1 -- 172.21.15.133:0/1761995646 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2ce38ec70 con 0x55b2ce5938b0 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf63fff640 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b2ce5938b0 0x55b2ce593cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf42ffd640 10 client.6606 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.267+0000 7faf63fff640 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b2ce5938b0 0x55b2ce593cc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47ce3f39cbfa035f server_cookie=aaff23497cd18c56 in_seq=0 out_seq=0 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf42ffd640 1 -- 172.21.15.133:0/1761995646 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b2ce38ec70 con 0x55b2ce5938b0 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf42ffd640 10 client.6606 handle_command_reply: tid=0 2023-12-18T10:21:25.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 client.6606 shutdown 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 -- 172.21.15.133:0/1761995646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58b5a0 msgr2=0x55b2ce592b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58b5a0 0x55b2ce592b40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00c810 tx=0x7faf5c004a10 comp rx=0 tx=0).stop 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 -- 172.21.15.133:0/1761995646 shutdown_connections 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b2ce5938b0 0x55b2ce593cc0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58b5a0 0x55b2ce592b40 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce58ac80 0x55b2ce596ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 --2- 172.21.15.133:0/1761995646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 0x55b2ce5965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf42ffd640 0 client.6606 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:25.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 -- 172.21.15.133:0/1761995646 >> 172.21.15.133:0/1761995646 conn(0x55b2ce33f910 msgr2=0x55b2ce53fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 -- 172.21.15.133:0/1761995646 shutdown_connections 2023-12-18T10:21:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 1 -- 172.21.15.133:0/1761995646 wait complete. 2023-12-18T10:21:25.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.271+0000 7faf6da4f000 20 client.6606 trim_cache size 0 max 16384 2023-12-18T10:21:25.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf6da4f000 1 Processor -- start 2023-12-18T10:21:25.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf6da4f000 1 -- start start 2023-12-18T10:21:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce33f910 0x55b2ce589430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce540fc0 0x55b2ce589970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58ac80 0x55b2ce59f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf6da4f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce04daa0 con 0x55b2ce33f910 2023-12-18T10:21:25.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf6da4f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce38db30 con 0x55b2ce58ac80 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf6da4f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce540ae0 con 0x55b2ce540fc0 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.283+0000 7faf63fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce33f910 0x55b2ce589430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf63fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce33f910 0x55b2ce589430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33650/0 (socket says 172.21.15.133:33650) 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf63fff640 1 -- 172.21.15.133:0/576478620 learned_addr learned my addr 172.21.15.133:0/576478620 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf637fe640 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce540fc0 0x55b2ce589970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf68c99640 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58ac80 0x55b2ce59f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf63fff640 1 -- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce540fc0 msgr2=0x55b2ce589970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf63fff640 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce540fc0 0x55b2ce589970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf63fff640 1 -- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58ac80 msgr2=0x55b2ce59f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf63fff640 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58ac80 0x55b2ce59f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf63fff640 1 -- 172.21.15.133:0/576478620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2ce33b5a0 con 0x55b2ce33f910 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf637fe640 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce540fc0 0x55b2ce589970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:25.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf63fff640 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce33f910 0x55b2ce589430 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7faf5401ab40 tx=0x7faf540a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd46397c45e60d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf4a7fc640 1 -- 172.21.15.133:0/576478620 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540c4040 con 0x55b2ce33f910 2023-12-18T10:21:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf4a7fc640 1 -- 172.21.15.133:0/576478620 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf540aada0 con 0x55b2ce33f910 2023-12-18T10:21:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf4a7fc640 1 -- 172.21.15.133:0/576478620 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf540cae80 con 0x55b2ce33f910 2023-12-18T10:21:25.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- 172.21.15.133:0/576478620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce33f910 msgr2=0x55b2ce589430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce33f910 0x55b2ce589430 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7faf5401ab40 tx=0x7faf540a7000 comp rx=0 tx=0).stop 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- 172.21.15.133:0/576478620 shutdown_connections 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce58ac80 0x55b2ce59f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce540fc0 0x55b2ce589970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 --2- 172.21.15.133:0/576478620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce33f910 0x55b2ce589430 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- 172.21.15.133:0/576478620 >> 172.21.15.133:0/576478620 conn(0x55b2ce546950 msgr2=0x55b2ce5928c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- 172.21.15.133:0/576478620 shutdown_connections 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- 172.21.15.133:0/576478620 wait complete. 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- start start 2023-12-18T10:21:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 Processor -- start 2023-12-18T10:21:25.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce33f910 0x55b2ce5e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 0x55b2ce5eada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58ac80 0x55b2ce5eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce545df0 con 0x55b2ce58ac80 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce59c850 con 0x55b2ce540fc0 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2ce38bc90 con 0x55b2ce33f910 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf6da4f000 10 client.0 _ll_register_callbacks cb 0x55b2ce347710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.287+0000 7faf68c99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58ac80 0x55b2ce5eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf68c99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58ac80 0x55b2ce5eb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33652/0 (socket says 172.21.15.133:33652) 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf68c99640 1 -- 172.21.15.133:0/3539144986 learned_addr learned my addr 172.21.15.133:0/3539144986 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf637fe640 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 0x55b2ce5eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf63fff640 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce33f910 0x55b2ce5e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf68c99640 1 -- 172.21.15.133:0/3539144986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce33f910 msgr2=0x55b2ce5e9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf68c99640 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce33f910 0x55b2ce5e9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf68c99640 1 -- 172.21.15.133:0/3539144986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 msgr2=0x55b2ce5eada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf68c99640 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 0x55b2ce5eada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf68c99640 1 -- 172.21.15.133:0/3539144986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6415a7d0 con 0x55b2ce58ac80 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf68c99640 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58ac80 0x55b2ce5eb2e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7faf5c004a50 tx=0x7faf5c009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105528c84c7cb5dd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 1 -- 172.21.15.133:0/3539144986 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c037070 con 0x55b2ce58ac80 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 1 -- 172.21.15.133:0/3539144986 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faf5c00ccf0 con 0x55b2ce58ac80 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 -- 172.21.15.133:0/3539144986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2ce544940 con 0x55b2ce58ac80 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 1 -- 172.21.15.133:0/3539144986 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf5c007000 con 0x55b2ce58ac80 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 10 client.6612 fetch_fsmap learned FSMap version 42 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 -- 172.21.15.133:0/3539144986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55b2ce32f110 con 0x55b2ce58ac80 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 1 -- 172.21.15.133:0/3539144986 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2ce544940 con 0x55b2ce58ac80 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 1 -- 172.21.15.133:0/3539144986 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7faf5c03a020 con 0x55b2ce58ac80 2023-12-18T10:21:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 10 client.6612 fetch_fsmap finished waiting for FSMap version 42 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 10 client.6612 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.a 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 20 client.6612 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b2ce58b5a0 0x55b2ce5eb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 4 client.6612 mds_command: new command op to 6162 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 -- 172.21.15.133:0/3539144986 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b2ce3596a0 con 0x55b2ce58b5a0 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf63fff640 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b2ce58b5a0 0x55b2ce5eb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf63fff640 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b2ce58b5a0 0x55b2ce5eb820 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=14f7e66cea92b9ab server_cookie=6abbc96b725bf14d in_seq=0 out_seq=0 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 10 client.6612 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 1 -- 172.21.15.133:0/3539144986 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55b2ce3596a0 con 0x55b2ce58b5a0 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 10 client.6612 handle_command_reply: tid=0 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 client.6612 shutdown 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 -- 172.21.15.133:0/3539144986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58ac80 msgr2=0x55b2ce5eb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58ac80 0x55b2ce5eb2e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7faf5c004a50 tx=0x7faf5c009830 comp rx=0 tx=0).stop 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 -- 172.21.15.133:0/3539144986 shutdown_connections 2023-12-18T10:21:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55b2ce58b5a0 0x55b2ce5eb820 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2ce58ac80 0x55b2ce5eb2e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2ce540fc0 0x55b2ce5eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 --2- 172.21.15.133:0/3539144986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b2ce33f910 0x55b2ce5e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf42ffd640 0 client.6612 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 -- 172.21.15.133:0/3539144986 >> 172.21.15.133:0/3539144986 conn(0x55b2ce546950 msgr2=0x55b2ce588420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 -- 172.21.15.133:0/3539144986 shutdown_connections 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 1 -- 172.21.15.133:0/3539144986 wait complete. 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6da4f000 20 client.6612 trim_cache size 0 max 16384 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:21:25.300 INFO:teuthology.orchestra.run.smithi133.stdout: "caa1e0fe-9e81-41d1-a5a9-e36c961d30f3": { 2023-12-18T10:21:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:21:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "caa1e0fe-9e81-41d1-a5a9-e36c961d30f3", 2023-12-18T10:21:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:21:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:25.301 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 -- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faf50065a90 msgr2=0x7faf50067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faf50065a90 0x7faf50067f50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7faf540ae000 tx=0x7faf540b5040 comp rx=0 tx=0).stop 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 -- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 msgr2=0x7faf64155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64155f40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c7f0 tx=0x7faf5800ccb0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 -- 172.21.15.133:0/2416158499 shutdown_connections 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faf50065a90 0x7faf50067f50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf64159fb0 0x7faf640c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf640ca410 0x7faf64155f40 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 --2- 172.21.15.133:0/2416158499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf64071db0 0x7faf640c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 -- 172.21.15.133:0/2416158499 >> 172.21.15.133:0/2416158499 conn(0x7faf6406a2a0 msgr2=0x7faf64158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.291+0000 7faf6a6fc640 1 -- 172.21.15.133:0/2416158499 shutdown_connections 2023-12-18T10:21:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:25.295+0000 7faf6a6fc640 1 -- 172.21.15.133:0/2416158499 wait complete. 2023-12-18T10:21:28.453 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:21:28.457 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:21:29.957 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:21:29.951+0000 7f3bac1eb640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-18T10:21:30.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2023-12-18T10:21:30.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1629c2d640 1 Processor -- start 2023-12-18T10:21:30.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1629c2d640 1 -- start start 2023-12-18T10:21:30.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1629c2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f16240ca410 0x7f1624159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1629c2d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1624159fb0 0x7f1624071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1629c2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1624071db0 0x7f16240cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1629c2d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162415aab0 con 0x7f1624159fb0 2023-12-18T10:21:30.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1629c2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1624070df0 con 0x7f16240ca410 2023-12-18T10:21:30.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1629c2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162415a4f0 con 0x7f1624071db0 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1622ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1624159fb0 0x7f1624071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1622ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1624159fb0 0x7f1624071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43492/0 (socket says 172.21.15.133:43492) 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1622ffd640 1 -- 172.21.15.133:0/3648098245 learned_addr learned my addr 172.21.15.133:0/3648098245 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f16237fe640 1 --2- 172.21.15.133:0/3648098245 >> v2:172.21.15.142:3300/0 conn(0x7f16240ca410 0x7f1624159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1623fff640 1 --2- 172.21.15.133:0/3648098245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1624071db0 0x7f16240cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1622ffd640 1 -- 172.21.15.133:0/3648098245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1624071db0 msgr2=0x7f16240cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1622ffd640 1 --2- 172.21.15.133:0/3648098245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1624071db0 0x7f16240cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1622ffd640 1 -- 172.21.15.133:0/3648098245 >> v2:172.21.15.142:3300/0 conn(0x7f16240ca410 msgr2=0x7f1624159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1622ffd640 1 --2- 172.21.15.133:0/3648098245 >> v2:172.21.15.142:3300/0 conn(0x7f16240ca410 0x7f1624159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f1622ffd640 1 -- 172.21.15.133:0/3648098245 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162415a7d0 con 0x7f1624159fb0 2023-12-18T10:21:30.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.463+0000 7f16237fe640 1 --2- 172.21.15.133:0/3648098245 >> v2:172.21.15.142:3300/0 conn(0x7f16240ca410 0x7f1624159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:30.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1622ffd640 1 --2- 172.21.15.133:0/3648098245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624071870 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f16240cbfa0 tx=0x7f161801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381fa47e6a5304ef server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f16227fc640 1 -- 172.21.15.133:0/3648098245 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180ac600 con 0x7f1624159fb0 2023-12-18T10:21:30.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f16227fc640 1 -- 172.21.15.133:0/3648098245 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180a8050 con 0x7f1624159fb0 2023-12-18T10:21:30.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f16227fc640 1 -- 172.21.15.133:0/3648098245 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180ac980 con 0x7f1624159fb0 2023-12-18T10:21:30.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 -- 172.21.15.133:0/3648098245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 msgr2=0x7f1624071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3648098245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624071870 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f16240cbfa0 tx=0x7f161801c4d0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 -- 172.21.15.133:0/3648098245 shutdown_connections 2023-12-18T10:21:30.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3648098245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1624071db0 0x7f16240cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3648098245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624071870 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3648098245 >> v2:172.21.15.142:3300/0 conn(0x7f16240ca410 0x7f1624159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 -- 172.21.15.133:0/3648098245 >> 172.21.15.133:0/3648098245 conn(0x7f162406a2a0 msgr2=0x7f16240aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 -- 172.21.15.133:0/3648098245 shutdown_connections 2023-12-18T10:21:30.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.467+0000 7f1629c2d640 1 -- 172.21.15.133:0/3648098245 wait complete. 2023-12-18T10:21:30.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 Processor -- start 2023-12-18T10:21:30.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 -- start start 2023-12-18T10:21:30.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1624071db0 0x7f16240af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ca410 0x7f1624154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240ae020 con 0x7f1624159fb0 2023-12-18T10:21:30.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240ae300 con 0x7f1624071db0 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16240ae5e0 con 0x7f16240ca410 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43498/0 (socket says 172.21.15.133:43498) 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 -- 172.21.15.133:0/3174583059 learned_addr learned my addr 172.21.15.133:0/3174583059 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f16237fe640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1624071db0 0x7f16240af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1622ffd640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ca410 0x7f1624154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 -- 172.21.15.133:0/3174583059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ca410 msgr2=0x7f1624154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ca410 0x7f1624154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 -- 172.21.15.133:0/3174583059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1624071db0 msgr2=0x7f16240af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1624071db0 0x7f16240af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 -- 172.21.15.133:0/3174583059 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16180094d0 con 0x7f1624159fb0 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1623fff640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624155370 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f161c007e60 tx=0x7f161c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f160bfff640 1 -- 172.21.15.133:0/3174583059 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c014420 con 0x7f1624159fb0 2023-12-18T10:21:30.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f160bfff640 1 -- 172.21.15.133:0/3174583059 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c0145a0 con 0x7f1624159fb0 2023-12-18T10:21:30.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f160bfff640 1 -- 172.21.15.133:0/3174583059 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c014950 con 0x7f1624159fb0 2023-12-18T10:21:30.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 -- 172.21.15.133:0/3174583059 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16240ae8c0 con 0x7f1624159fb0 2023-12-18T10:21:30.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.471+0000 7f1629c2d640 1 -- 172.21.15.133:0/3174583059 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1624154290 con 0x7f1624159fb0 2023-12-18T10:21:30.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.475+0000 7f160bfff640 1 -- 172.21.15.133:0/3174583059 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f161c014ab0 con 0x7f1624159fb0 2023-12-18T10:21:30.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.475+0000 7f160bfff640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1610065a60 0x7f1610067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.475+0000 7f160bfff640 1 -- 172.21.15.133:0/3174583059 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f161c083af0 con 0x7f1624159fb0 2023-12-18T10:21:30.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.475+0000 7f16237fe640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1610065a60 0x7f1610067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.475+0000 7f162cf9d000 1 Processor -- start 2023-12-18T10:21:30.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.475+0000 7f162cf9d000 1 -- start start 2023-12-18T10:21:30.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.475+0000 7f16237fe640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1610065a60 0x7f1610067f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1614006e90 tx=0x7f1614008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 0x55841644b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 0x558416400a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x5584164013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584162c9430 con 0x558416400fc0 2023-12-18T10:21:30.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558416257460 con 0x55841644b5a0 2023-12-18T10:21:30.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558416254a30 con 0x55841644ac80 2023-12-18T10:21:30.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x5584164013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f16237fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 0x55841644b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x5584164013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43508/0 (socket says 172.21.15.133:43508) 2023-12-18T10:21:30.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1622ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 0x558416400a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 -- 172.21.15.133:0/747137554 learned_addr learned my addr 172.21.15.133:0/747137554 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 -- 172.21.15.133:0/747137554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 msgr2=0x55841644b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 --2- 172.21.15.133:0/747137554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 0x55841644b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 -- 172.21.15.133:0/747137554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 msgr2=0x558416400a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 --2- 172.21.15.133:0/747137554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 0x558416400a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 -- 172.21.15.133:0/747137554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558415f4ce20 con 0x558416400fc0 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f1623fff640 1 --2- 172.21.15.133:0/747137554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x5584164013a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f161c05cb70 tx=0x7f161c055880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d288769e30288c1d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f16097fa640 1 -- 172.21.15.133:0/747137554 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c05d0a0 con 0x558416400fc0 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f16097fa640 1 -- 172.21.15.133:0/747137554 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c053460 con 0x558416400fc0 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f16097fa640 1 -- 172.21.15.133:0/747137554 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0545b0 con 0x558416400fc0 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- 172.21.15.133:0/747137554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 msgr2=0x5584164013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 --2- 172.21.15.133:0/747137554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x5584164013a0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f161c05cb70 tx=0x7f161c055880 comp rx=0 tx=0).stop 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- 172.21.15.133:0/747137554 shutdown_connections 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 --2- 172.21.15.133:0/747137554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x5584164013a0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 --2- 172.21.15.133:0/747137554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 0x558416400a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 --2- 172.21.15.133:0/747137554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 0x55841644b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- 172.21.15.133:0/747137554 >> 172.21.15.133:0/747137554 conn(0x5584161ff910 msgr2=0x5584163ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- 172.21.15.133:0/747137554 shutdown_connections 2023-12-18T10:21:30.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- 172.21.15.133:0/747137554 wait complete. 2023-12-18T10:21:30.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 -- start start 2023-12-18T10:21:30.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.479+0000 7f162cf9d000 1 Processor -- start 2023-12-18T10:21:30.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558416400fc0 0x55841644b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644ac80 0x55841644bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644b5a0 0x55841644c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558416250320 con 0x55841644b5a0 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584161ef4f0 con 0x55841644ac80 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55841620d6e0 con 0x558416400fc0 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 10 client.0 _ll_register_callbacks cb 0x5584163ec980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644b5a0 0x55841644c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644b5a0 0x55841644c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43516/0 (socket says 172.21.15.133:43516) 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 -- 172.21.15.133:0/3084113864 learned_addr learned my addr 172.21.15.133:0/3084113864 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16237fe640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558416400fc0 0x55841644b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1622ffd640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644ac80 0x55841644bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 -- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558416400fc0 msgr2=0x55841644b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558416400fc0 0x55841644b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 -- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644ac80 msgr2=0x55841644bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644ac80 0x55841644bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 -- 172.21.15.133:0/3084113864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1624154290 con 0x55841644b5a0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16237fe640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558416400fc0 0x55841644b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1622ffd640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644ac80 0x55841644bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f1623fff640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644b5a0 0x55841644c400 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f161c054dc0 tx=0x7f161c016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98e9d831dd7a4a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 1 -- 172.21.15.133:0/3084113864 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c076070 con 0x55841644b5a0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- 172.21.15.133:0/3084113864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55841620d120 con 0x55841644b5a0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 1 -- 172.21.15.133:0/3084113864 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f161c0517d0 con 0x55841644b5a0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 1 -- 172.21.15.133:0/3084113864 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f161c051990 con 0x55841644b5a0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 10 client.6624 fetch_fsmap learned FSMap version 42 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- 172.21.15.133:0/3084113864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x558416215250 con 0x55841644b5a0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 1 -- 172.21.15.133:0/3084113864 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55841620d120 con 0x55841644b5a0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 1 -- 172.21.15.133:0/3084113864 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f161c079020 con 0x55841644b5a0 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 10 client.6624 fetch_fsmap finished waiting for FSMap version 42 2023-12-18T10:21:30.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 10 client.6624 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.a 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 20 client.6624 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55841644d0e0 0x55841645c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 4 client.6624 mds_command: new command op to 6162 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- 172.21.15.133:0/3084113864 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55841624ec70 con 0x55841644d0e0 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16237fe640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55841644d0e0 0x55841645c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16237fe640 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55841644d0e0 0x55841645c850 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9e5714ba54f6fd8 server_cookie=72cba5e8e4c5ee59 in_seq=0 out_seq=0 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 10 client.6624 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 1 -- 172.21.15.133:0/3084113864 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55841624ec70 con 0x55841644d0e0 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 10 client.6624 handle_command_reply: tid=0 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 client.6624 shutdown 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- 172.21.15.133:0/3084113864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644b5a0 msgr2=0x55841644c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644b5a0 0x55841644c400 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f161c054dc0 tx=0x7f161c016070 comp rx=0 tx=0).stop 2023-12-18T10:21:30.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- 172.21.15.133:0/3084113864 shutdown_connections 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x55841644d0e0 0x55841645c850 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644b5a0 0x55841644c400 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644ac80 0x55841644bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 --2- 172.21.15.133:0/3084113864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558416400fc0 0x55841644b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- 172.21.15.133:0/3084113864 >> 172.21.15.133:0/3084113864 conn(0x5584161ff910 msgr2=0x5584163ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f16027fc640 0 client.6624 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- 172.21.15.133:0/3084113864 shutdown_connections 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 1 -- 172.21.15.133:0/3084113864 wait complete. 2023-12-18T10:21:30.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.483+0000 7f162cf9d000 20 client.6624 trim_cache size 0 max 16384 2023-12-18T10:21:30.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f162cf9d000 1 Processor -- start 2023-12-18T10:21:30.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f162cf9d000 1 -- start start 2023-12-18T10:21:30.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x55841645d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 0x55841645dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 0x558416444010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f162cf9d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558415f0daa0 con 0x558416400fc0 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f162cf9d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584161f5820 con 0x55841644b5a0 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f162cf9d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55841620e480 con 0x55841644ac80 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x55841645d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x55841645d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43520/0 (socket says 172.21.15.133:43520) 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 -- 172.21.15.133:0/1727014367 learned_addr learned my addr 172.21.15.133:0/1727014367 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f1623fff640 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 0x558416444010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f1622ffd640 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 0x55841645dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 -- 172.21.15.133:0/1727014367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 msgr2=0x55841645dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 0x55841645dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 -- 172.21.15.133:0/1727014367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 msgr2=0x558416444010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 0x558416444010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 -- 172.21.15.133:0/1727014367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584161fb5a0 con 0x558416400fc0 2023-12-18T10:21:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.499+0000 7f16237fe640 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x55841645d860 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1614011aa0 tx=0x7f1614017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30c1bdbd3c51afa server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1609ffb640 1 -- 172.21.15.133:0/1727014367 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614028070 con 0x558416400fc0 2023-12-18T10:21:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1609ffb640 1 -- 172.21.15.133:0/1727014367 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614011cf0 con 0x558416400fc0 2023-12-18T10:21:30.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1609ffb640 1 -- 172.21.15.133:0/1727014367 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614029450 con 0x558416400fc0 2023-12-18T10:21:30.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- 172.21.15.133:0/1727014367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 msgr2=0x55841645d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x55841645d860 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1614011aa0 tx=0x7f1614017000 comp rx=0 tx=0).stop 2023-12-18T10:21:30.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- 172.21.15.133:0/1727014367 shutdown_connections 2023-12-18T10:21:30.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55841644b5a0 0x558416444010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644ac80 0x55841645dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1727014367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558416400fc0 0x55841645d860 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- 172.21.15.133:0/1727014367 >> 172.21.15.133:0/1727014367 conn(0x5584161ff910 msgr2=0x558416406220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- 172.21.15.133:0/1727014367 shutdown_connections 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- 172.21.15.133:0/1727014367 wait complete. 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- start start 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 Processor -- start 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558416400fc0 0x5584164a6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644ac80 0x5584164a6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644b5a0 0x5584164a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558416252e80 con 0x55841644ac80 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558416400ae0 con 0x558416400fc0 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558416254320 con 0x55841644b5a0 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 10 client.0 _ll_register_callbacks cb 0x558416207710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644ac80 0x5584164a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644ac80 0x5584164a6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43526/0 (socket says 172.21.15.133:43526) 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 -- 172.21.15.133:0/1505978145 learned_addr learned my addr 172.21.15.133:0/1505978145 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f16237fe640 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558416400fc0 0x5584164a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1623fff640 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644b5a0 0x5584164a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 -- 172.21.15.133:0/1505978145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644b5a0 msgr2=0x5584164a6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644b5a0 0x5584164a6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 -- 172.21.15.133:0/1505978145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558416400fc0 msgr2=0x5584164a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558416400fc0 0x5584164a6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 -- 172.21.15.133:0/1505978145 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161400e040 con 0x55841644ac80 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f1622ffd640 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644ac80 0x5584164a6560 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f161801ab80 tx=0x7f161801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa1d928f6ec36bb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f16027fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f16027fc640 1 -- 172.21.15.133:0/1505978145 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180acd80 con 0x55841644ac80 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f16027fc640 1 -- 172.21.15.133:0/1505978145 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f16180c1bf0 con 0x55841644ac80 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.503+0000 7f162cf9d000 1 -- 172.21.15.133:0/1505978145 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558416404940 con 0x55841644ac80 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16027fc640 1 -- 172.21.15.133:0/1505978145 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16180c1db0 con 0x55841644ac80 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 10 client.6630 fetch_fsmap learned FSMap version 42 2023-12-18T10:21:30.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 -- 172.21.15.133:0/1505978145 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x5584161ef110 con 0x55841644ac80 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16027fc640 1 -- 172.21.15.133:0/1505978145 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558416404940 con 0x55841644ac80 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16027fc640 1 -- 172.21.15.133:0/1505978145 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f16180be030 con 0x55841644ac80 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 10 client.6630 fetch_fsmap finished waiting for FSMap version 42 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 10 client.6630 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.a 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 20 client.6630 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x5584164a44b0 0x5584164a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 4 client.6630 mds_command: new command op to 6162 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 -- 172.21.15.133:0/1505978145 --> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5584162196a0 con 0x5584164a44b0 2023-12-18T10:21:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16237fe640 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x5584164a44b0 0x5584164a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16237fe640 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x5584164a44b0 0x5584164a48c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9365fa58ca984b77 server_cookie=e42fd534eff17c85 in_seq=0 out_seq=0 2023-12-18T10:21:30.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16027fc640 10 client.6630 ms_handle_connect on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:30.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16027fc640 1 -- 172.21.15.133:0/1505978145 <== mds.1 v2:172.21.15.133:6834/4035374378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5584162196a0 con 0x5584164a44b0 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16027fc640 10 client.6630 handle_command_reply: tid=0 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 client.6630 shutdown 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 -- 172.21.15.133:0/1505978145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644ac80 msgr2=0x5584164a6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644ac80 0x5584164a6560 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f161801ab80 tx=0x7f161801ad10 comp rx=0 tx=0).stop 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 -- 172.21.15.133:0/1505978145 shutdown_connections 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.133:6834/4035374378,v1:172.21.15.133:6836/4035374378] conn(0x5584164a44b0 0x5584164a48c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55841644b5a0 0x5584164a6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55841644ac80 0x5584164a6560 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 --2- 172.21.15.133:0/1505978145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558416400fc0 0x5584164a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f16027fc640 0 client.6630 ms_handle_reset on v2:172.21.15.133:6834/4035374378 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 -- 172.21.15.133:0/1505978145 >> 172.21.15.133:0/1505978145 conn(0x5584161ff910 msgr2=0x55841645c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 -- 172.21.15.133:0/1505978145 shutdown_connections 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 1 -- 172.21.15.133:0/1505978145 wait complete. 2023-12-18T10:21:30.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f162cf9d000 20 client.6630 trim_cache size 0 max 16384 2023-12-18T10:21:30.516 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:30.516 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "no active scrubs running", 2023-12-18T10:21:30.516 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": {} 2023-12-18T10:21:30.516 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 -- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1610065a60 msgr2=0x7f1610067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1610065a60 0x7f1610067f20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1614006e90 tx=0x7f1614008040 comp rx=0 tx=0).stop 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 -- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 msgr2=0x7f1624155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624155370 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f161c007e60 tx=0x7f161c00e4b0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 -- 172.21.15.133:0/3174583059 shutdown_connections 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1610065a60 0x7f1610067f20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1624159fb0 0x7f1624155370 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f16240ca410 0x7f1624154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 --2- 172.21.15.133:0/3174583059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1624071db0 0x7f16240af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 -- 172.21.15.133:0/3174583059 >> 172.21.15.133:0/3174583059 conn(0x7f162406a2a0 msgr2=0x7f162415ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 -- 172.21.15.133:0/3174583059 shutdown_connections 2023-12-18T10:21:30.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.507+0000 7f1629c2d640 1 -- 172.21.15.133:0/3174583059 wait complete. 2023-12-18T10:21:30.530 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:21:30.531 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:2 scrub status 2023-12-18T10:21:30.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f8a73640 1 Processor -- start 2023-12-18T10:21:30.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f8a73640 1 -- start start 2023-12-18T10:21:30.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f8a73640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f415cae0 0x7f62f40d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f8a73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f40cf880 0x7f62f40ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f8a73640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f415cec0 con 0x7f62f40cde90 2023-12-18T10:21:30.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f8a73640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40d0530 con 0x7f62f415cae0 2023-12-18T10:21:30.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f8a73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40d0810 con 0x7f62f40cf880 2023-12-18T10:21:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f415cae0 0x7f62f40d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f415cae0 0x7f62f40d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43536/0 (socket says 172.21.15.133:43536) 2023-12-18T10:21:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f259c640 1 -- 172.21.15.133:0/1199435346 learned_addr learned my addr 172.21.15.133:0/1199435346 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f2d9d640 1 --2- 172.21.15.133:0/1199435346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f40cf880 0x7f62f40ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f259c640 1 -- 172.21.15.133:0/1199435346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f40cf880 msgr2=0x7f62f40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f259c640 1 --2- 172.21.15.133:0/1199435346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f40cf880 0x7f62f40ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f259c640 1 -- 172.21.15.133:0/1199435346 >> v1:172.21.15.142:6789/0 conn(0x7f62f40cde90 legacy=0x7f62f40cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.667+0000 7f62f259c640 1 -- 172.21.15.133:0/1199435346 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40d0af0 con 0x7f62f415cae0 2023-12-18T10:21:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f259c640 1 --2- 172.21.15.133:0/1199435346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f415cae0 0x7f62f40d12f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009ea0 tx=0x7f62e401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c40af2de458e495 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f159a640 1 -- 172.21.15.133:0/1199435346 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40a5880 con 0x7f62f415cae0 2023-12-18T10:21:30.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f159a640 1 -- 172.21.15.133:0/1199435346 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40a59e0 con 0x7f62f415cae0 2023-12-18T10:21:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f159a640 1 -- 172.21.15.133:0/1199435346 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40a5d70 con 0x7f62f415cae0 2023-12-18T10:21:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f8a73640 1 -- 172.21.15.133:0/1199435346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f415cae0 msgr2=0x7f62f40d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1199435346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f415cae0 0x7f62f40d12f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009ea0 tx=0x7f62e401ca20 comp rx=0 tx=0).stop 2023-12-18T10:21:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f8a73640 1 -- 172.21.15.133:0/1199435346 shutdown_connections 2023-12-18T10:21:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1199435346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f40cf880 0x7f62f40ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1199435346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f415cae0 0x7f62f40d12f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f8a73640 1 -- 172.21.15.133:0/1199435346 >> 172.21.15.133:0/1199435346 conn(0x7f62f4089fb0 msgr2=0x7f62f40d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f8a73640 1 -- 172.21.15.133:0/1199435346 shutdown_connections 2023-12-18T10:21:30.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.671+0000 7f62f8a73640 1 -- 172.21.15.133:0/1199435346 wait complete. 2023-12-18T10:21:30.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 Processor -- start 2023-12-18T10:21:30.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 -- start start 2023-12-18T10:21:30.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f40cde90 0x7f62f4156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f40cf880 0x7f62f40b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f415cae0 0x7f62f40b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40cb360 con 0x7f62f40cf880 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40b5f10 con 0x7f62f40cde90 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40ca490 con 0x7f62f415cae0 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f40cf880 0x7f62f40b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f40cf880 0x7f62f40b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43548/0 (socket says 172.21.15.133:43548) 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 -- 172.21.15.133:0/1173225967 learned_addr learned my addr 172.21.15.133:0/1173225967 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f2d9d640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f415cae0 0x7f62f40b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f259c640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f40cde90 0x7f62f4156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 -- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f415cae0 msgr2=0x7f62f40b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f415cae0 0x7f62f40b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 -- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f40cde90 msgr2=0x7f62f4156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f40cde90 0x7f62f4156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 -- 172.21.15.133:0/1173225967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4009b30 con 0x7f62f40cf880 2023-12-18T10:21:30.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f259c640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f40cde90 0x7f62f4156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:30.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f40cf880 0x7f62f40b2140 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f62e800c500 tx=0x7f62e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62e2ffd640 1 -- 172.21.15.133:0/1173225967 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8005220 con 0x7f62f40cf880 2023-12-18T10:21:30.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62e2ffd640 1 -- 172.21.15.133:0/1173225967 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e8005380 con 0x7f62f40cf880 2023-12-18T10:21:30.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62e2ffd640 1 -- 172.21.15.133:0/1173225967 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8007270 con 0x7f62f40cf880 2023-12-18T10:21:30.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 -- 172.21.15.133:0/1173225967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f40caca0 con 0x7f62f40cf880 2023-12-18T10:21:30.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.675+0000 7f62f8a73640 1 -- 172.21.15.133:0/1173225967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f4157380 con 0x7f62f40cf880 2023-12-18T10:21:30.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.679+0000 7f62e2ffd640 1 -- 172.21.15.133:0/1173225967 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f62e80073d0 con 0x7f62f40cf880 2023-12-18T10:21:30.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.679+0000 7f62e2ffd640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62d4065a60 0x7f62d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.679+0000 7f62e2ffd640 1 -- 172.21.15.133:0/1173225967 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62e8082bb0 con 0x7f62f40cf880 2023-12-18T10:21:30.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.679+0000 7f62f259c640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62d4065a60 0x7f62d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.679+0000 7f62fbde0000 1 Processor -- start 2023-12-18T10:21:30.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.679+0000 7f62fbde0000 1 -- start start 2023-12-18T10:21:30.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62d4065a60 0x7f62d4067f20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f62e40ae000 tx=0x7f62e40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587de4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 0x560587d99a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 0x560587d9a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560587c62430 con 0x560587de3c80 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560587bf0460 con 0x560587d99fc0 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560587beda30 con 0x560587de45a0 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587de4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587de4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43564/0 (socket says 172.21.15.133:43564) 2023-12-18T10:21:30.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 -- 172.21.15.133:0/699889862 learned_addr learned my addr 172.21.15.133:0/699889862 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 0x560587d99a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f2d9d640 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 0x560587d9a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 -- 172.21.15.133:0/699889862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 msgr2=0x560587d99a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 0x560587d99a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 -- 172.21.15.133:0/699889862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 msgr2=0x560587d9a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 0x560587d9a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 -- 172.21.15.133:0/699889862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605878e5e20 con 0x560587de3c80 2023-12-18T10:21:30.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62f259c640 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587de4060 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f62e40985a0 tx=0x7f62e4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88f1d40f55971e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62d3fff640 1 -- 172.21.15.133:0/699889862 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40b6820 con 0x560587de3c80 2023-12-18T10:21:30.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62d3fff640 1 -- 172.21.15.133:0/699889862 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e40bd040 con 0x560587de3c80 2023-12-18T10:21:30.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62d3fff640 1 -- 172.21.15.133:0/699889862 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40b6b80 con 0x560587de3c80 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- 172.21.15.133:0/699889862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 msgr2=0x560587de4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587de4060 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f62e40985a0 tx=0x7f62e4004ac0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- 172.21.15.133:0/699889862 shutdown_connections 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 0x560587d9a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 0x560587d99a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 --2- 172.21.15.133:0/699889862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587de4060 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- 172.21.15.133:0/699889862 >> 172.21.15.133:0/699889862 conn(0x560587b98910 msgr2=0x560587d98360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- 172.21.15.133:0/699889862 shutdown_connections 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- 172.21.15.133:0/699889862 wait complete. 2023-12-18T10:21:30.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 -- start start 2023-12-18T10:21:30.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.683+0000 7f62fbde0000 1 Processor -- start 2023-12-18T10:21:30.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587d99fc0 0x560587de33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de3c80 0x560587de4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587de4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560587be9320 con 0x560587d99fc0 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560587b884f0 con 0x560587de45a0 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560587ba66e0 con 0x560587de3c80 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 10 client.0 _ll_register_callbacks cb 0x560587d85980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587d99fc0 0x560587de33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587d99fc0 0x560587de33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43574/0 (socket says 172.21.15.133:43574) 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 -- 172.21.15.133:0/4086994339 learned_addr learned my addr 172.21.15.133:0/4086994339 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de3c80 0x560587de4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f2d9d640 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587de4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 -- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de3c80 msgr2=0x560587de4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de3c80 0x560587de4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 -- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 msgr2=0x560587de4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587de4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 -- 172.21.15.133:0/4086994339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f40d0af0 con 0x560587d99fc0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f259c640 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587d99fc0 0x560587de33d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f62e401c490 tx=0x7f62e401b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6041ebfc8ed21778 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62d17fa640 1 -- 172.21.15.133:0/4086994339 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e40b6d90 con 0x560587d99fc0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62d17fa640 1 -- 172.21.15.133:0/4086994339 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62e40ca420 con 0x560587d99fc0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 -- 172.21.15.133:0/4086994339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560587ba6120 con 0x560587d99fc0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62d17fa640 1 -- 172.21.15.133:0/4086994339 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62e4007160 con 0x560587d99fc0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 10 client.6642 fetch_fsmap learned FSMap version 42 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 -- 172.21.15.133:0/4086994339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x560587bae250 con 0x560587d99fc0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62d17fa640 1 -- 172.21.15.133:0/4086994339 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560587ba6120 con 0x560587d99fc0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62d17fa640 1 -- 172.21.15.133:0/4086994339 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f62e40c0070 con 0x560587d99fc0 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 10 client.6642 fetch_fsmap finished waiting for FSMap version 42 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 10 client.6642 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2023-12-18T10:21:30.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 20 client.6642 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:30.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x560587de5c30 0x560587df5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 4 client.6642 mds_command: new command op to 5875 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:30.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62fbde0000 1 -- 172.21.15.133:0/4086994339 --> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560587be7c70 con 0x560587de5c30 2023-12-18T10:21:30.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x560587de5c30 0x560587df5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62d17fa640 10 client.6642 ms_handle_connect on v2:172.21.15.142:6832/2140881005 2023-12-18T10:21:30.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.687+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x560587de5c30 0x560587df5f10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f85ec4aa4a110ab server_cookie=769ca900f3c61f33 in_seq=0 out_seq=0 2023-12-18T10:21:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62d17fa640 1 -- 172.21.15.133:0/4086994339 <== mds.2 v2:172.21.15.142:6832/2140881005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x560587be7c70 con 0x560587de5c30 2023-12-18T10:21:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62d17fa640 10 client.6642 handle_command_reply: tid=0 2023-12-18T10:21:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 client.6642 shutdown 2023-12-18T10:21:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 -- 172.21.15.133:0/4086994339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587d99fc0 msgr2=0x560587de33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587d99fc0 0x560587de33d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f62e401c490 tx=0x7f62e401b260 comp rx=0 tx=0).stop 2023-12-18T10:21:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 -- 172.21.15.133:0/4086994339 shutdown_connections 2023-12-18T10:21:30.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x560587de5c30 0x560587df5f10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587de4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de3c80 0x560587de4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 --2- 172.21.15.133:0/4086994339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587d99fc0 0x560587de33d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 -- 172.21.15.133:0/4086994339 >> 172.21.15.133:0/4086994339 conn(0x560587b98910 msgr2=0x560587d98a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62d17fa640 0 client.6642 ms_handle_reset on v2:172.21.15.142:6832/2140881005 2023-12-18T10:21:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 -- 172.21.15.133:0/4086994339 shutdown_connections 2023-12-18T10:21:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 1 -- 172.21.15.133:0/4086994339 wait complete. 2023-12-18T10:21:30.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.691+0000 7f62fbde0000 20 client.6642 trim_cache size 0 max 16384 2023-12-18T10:21:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.703+0000 7f62fbde0000 1 Processor -- start 2023-12-18T10:21:30.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.703+0000 7f62fbde0000 1 -- start start 2023-12-18T10:21:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587d99fc0 0x560587d9f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587d9f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587df6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605878a6aa0 con 0x560587de3c80 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560587bed320 con 0x560587de45a0 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560587be81b0 con 0x560587d99fc0 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587d9f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587d9f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43578/0 (socket says 172.21.15.133:43578) 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 -- 172.21.15.133:0/38039051 learned_addr learned my addr 172.21.15.133:0/38039051 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f259c640 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587d99fc0 0x560587d9f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f2d9d640 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587df6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 -- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587d99fc0 msgr2=0x560587d9f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587d99fc0 0x560587d9f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 -- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 msgr2=0x560587df6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587df6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 -- 172.21.15.133:0/38039051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f41f91b0 con 0x560587de3c80 2023-12-18T10:21:30.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f2d9d640 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587df6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587d9f7f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f62e8053fa0 tx=0x7f62e8080e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e84e1d111f94515 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62e0ff9640 1 -- 172.21.15.133:0/38039051 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e805c040 con 0x560587de3c80 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62e0ff9640 1 -- 172.21.15.133:0/38039051 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e80521a0 con 0x560587de3c80 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62e0ff9640 1 -- 172.21.15.133:0/38039051 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8080360 con 0x560587de3c80 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- 172.21.15.133:0/38039051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 msgr2=0x560587d9f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587d9f7f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f62e8053fa0 tx=0x7f62e8080e60 comp rx=0 tx=0).stop 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- 172.21.15.133:0/38039051 shutdown_connections 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587de45a0 0x560587df6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587d9f7f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 --2- 172.21.15.133:0/38039051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587d99fc0 0x560587d9f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- 172.21.15.133:0/38039051 >> 172.21.15.133:0/38039051 conn(0x560587b98910 msgr2=0x560587d9eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- 172.21.15.133:0/38039051 shutdown_connections 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- 172.21.15.133:0/38039051 wait complete. 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 -- start start 2023-12-18T10:21:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 Processor -- start 2023-12-18T10:21:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.707+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 0x560587e415f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587e41b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 0x560587e25440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560587d99ae0 con 0x560587de3c80 2023-12-18T10:21:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560587d9cd80 con 0x560587d99fc0 2023-12-18T10:21:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560587cb8140 con 0x560587de45a0 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 10 client.0 _ll_register_callbacks cb 0x560587ba0710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587e41b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587e41b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43580/0 (socket says 172.21.15.133:43580) 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 0x560587e415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 -- 172.21.15.133:0/1259285275 learned_addr learned my addr 172.21.15.133:0/1259285275 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f2d9d640 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 0x560587e25440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 -- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 msgr2=0x560587e25440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 0x560587e25440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 -- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 msgr2=0x560587e415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 0x560587e415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 -- 172.21.15.133:0/1259285275 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f4157380 con 0x560587de3c80 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f1d9b640 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587e41b30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f62e8053ff0 tx=0x7f62e40b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cacd805dc881ad server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 1 -- 172.21.15.133:0/1259285275 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e805c040 con 0x560587de3c80 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 1 -- 172.21.15.133:0/1259285275 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62e8081010 con 0x560587de3c80 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- 172.21.15.133:0/1259285275 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560587d9d940 con 0x560587de3c80 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 1 -- 172.21.15.133:0/1259285275 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62e8050770 con 0x560587de3c80 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 10 client.6648 fetch_fsmap learned FSMap version 42 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- 172.21.15.133:0/1259285275 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x560587b945a0 con 0x560587de3c80 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 1 -- 172.21.15.133:0/1259285275 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560587d9d940 con 0x560587de3c80 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 1 -- 172.21.15.133:0/1259285275 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f62e8019030 con 0x560587de3c80 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 10 client.6648 fetch_fsmap finished waiting for FSMap version 42 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 10 client.6648 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 20 client.6648 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x560587e25980 0x560587e25d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 4 client.6648 mds_command: new command op to 5875 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- 172.21.15.133:0/1259285275 --> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560587bb26a0 con 0x560587e25980 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f259c640 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x560587e25980 0x560587e25d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 10 client.6648 ms_handle_connect on v2:172.21.15.142:6832/2140881005 2023-12-18T10:21:30.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f259c640 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x560587e25980 0x560587e25d90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a04bff9b39e31ac server_cookie=7f3c20128bccc940 in_seq=0 out_seq=0 2023-12-18T10:21:30.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 1 -- 172.21.15.133:0/1259285275 <== mds.2 v2:172.21.15.142:6832/2140881005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560587bb26a0 con 0x560587e25980 2023-12-18T10:21:30.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 10 client.6648 handle_command_reply: tid=0 2023-12-18T10:21:30.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 client.6648 shutdown 2023-12-18T10:21:30.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- 172.21.15.133:0/1259285275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 msgr2=0x560587e41b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587e41b30 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f62e8053ff0 tx=0x7f62e40b6000 comp rx=0 tx=0).stop 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- 172.21.15.133:0/1259285275 shutdown_connections 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:6832/2140881005,v1:172.21.15.142:6834/2140881005] conn(0x560587e25980 0x560587e25d90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560587de45a0 0x560587e25440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560587de3c80 0x560587e41b30 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 --2- 172.21.15.133:0/1259285275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560587d99fc0 0x560587e415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62d17fa640 0 client.6648 ms_handle_reset on v2:172.21.15.142:6832/2140881005 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- 172.21.15.133:0/1259285275 >> 172.21.15.133:0/1259285275 conn(0x560587b98910 msgr2=0x560587d9f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- 172.21.15.133:0/1259285275 shutdown_connections 2023-12-18T10:21:30.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 1 -- 172.21.15.133:0/1259285275 wait complete. 2023-12-18T10:21:30.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62fbde0000 20 client.6648 trim_cache size 0 max 16384 2023-12-18T10:21:30.721 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "no active scrubs running", 2023-12-18T10:21:30.721 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": {} 2023-12-18T10:21:30.721 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f8a73640 1 -- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62d4065a60 msgr2=0x7f62d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62d4065a60 0x7f62d4067f20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f62e40ae000 tx=0x7f62e40a7070 comp rx=0 tx=0).stop 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f8a73640 1 -- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f40cf880 msgr2=0x7f62f40b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.711+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f40cf880 0x7f62f40b2140 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f62e800c500 tx=0x7f62e800c9c0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.715+0000 7f62f8a73640 1 -- 172.21.15.133:0/1173225967 shutdown_connections 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.715+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62d4065a60 0x7f62d4067f20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.715+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f415cae0 0x7f62f40b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.715+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f40cf880 0x7f62f40b2140 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.715+0000 7f62f8a73640 1 --2- 172.21.15.133:0/1173225967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f40cde90 0x7f62f4156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.715+0000 7f62f8a73640 1 -- 172.21.15.133:0/1173225967 >> 172.21.15.133:0/1173225967 conn(0x7f62f4089fb0 msgr2=0x7f62f40d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.715+0000 7f62f8a73640 1 -- 172.21.15.133:0/1173225967 shutdown_connections 2023-12-18T10:21:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.715+0000 7f62f8a73640 1 -- 172.21.15.133:0/1173225967 wait complete. 2023-12-18T10:21:30.736 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:21:30.736 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-12-18T10:21:30.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.871+0000 7f923fc8c640 1 Processor -- start 2023-12-18T10:21:30.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.871+0000 7f923fc8c640 1 -- start start 2023-12-18T10:21:30.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923fc8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f92380ca410 0x7f9238159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923fc8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f9238071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923fc8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9238071db0 0x7f92380cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923fc8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923815aab0 con 0x7f9238071db0 2023-12-18T10:21:30.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923fc8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9238070df0 con 0x7f92380ca410 2023-12-18T10:21:30.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923fc8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923815a4f0 con 0x7f9238159fb0 2023-12-18T10:21:30.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923e229640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9238071db0 0x7f92380cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923e229640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9238071db0 0x7f92380cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43584/0 (socket says 172.21.15.133:43584) 2023-12-18T10:21:30.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923e229640 1 -- 172.21.15.133:0/3692961063 learned_addr learned my addr 172.21.15.133:0/3692961063 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923da28640 1 --2- 172.21.15.133:0/3692961063 >> v2:172.21.15.142:3300/0 conn(0x7f92380ca410 0x7f9238159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923d227640 1 --2- 172.21.15.133:0/3692961063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f9238071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923e229640 1 -- 172.21.15.133:0/3692961063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 msgr2=0x7f9238071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923e229640 1 --2- 172.21.15.133:0/3692961063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f9238071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923e229640 1 -- 172.21.15.133:0/3692961063 >> v2:172.21.15.142:3300/0 conn(0x7f92380ca410 msgr2=0x7f9238159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923e229640 1 --2- 172.21.15.133:0/3692961063 >> v2:172.21.15.142:3300/0 conn(0x7f92380ca410 0x7f9238159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.875+0000 7f923e229640 1 -- 172.21.15.133:0/3692961063 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923815a7d0 con 0x7f9238071db0 2023-12-18T10:21:30.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923e229640 1 --2- 172.21.15.133:0/3692961063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238071db0 0x7f92380cbff0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f92380cbfa0 tx=0x7f923001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f50859121cab1f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923ca26640 1 -- 172.21.15.133:0/3692961063 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300a5730 con 0x7f9238071db0 2023-12-18T10:21:30.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923ca26640 1 -- 172.21.15.133:0/3692961063 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300a5890 con 0x7f9238071db0 2023-12-18T10:21:30.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923ca26640 1 -- 172.21.15.133:0/3692961063 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300a5c20 con 0x7f9238071db0 2023-12-18T10:21:30.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 -- 172.21.15.133:0/3692961063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238071db0 msgr2=0x7f92380cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3692961063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238071db0 0x7f92380cbff0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f92380cbfa0 tx=0x7f923001c9a0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 -- 172.21.15.133:0/3692961063 shutdown_connections 2023-12-18T10:21:30.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3692961063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238071db0 0x7f92380cbff0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3692961063 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f9238071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3692961063 >> v2:172.21.15.142:3300/0 conn(0x7f92380ca410 0x7f9238159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 -- 172.21.15.133:0/3692961063 >> 172.21.15.133:0/3692961063 conn(0x7f923806a2a0 msgr2=0x7f92380aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 -- 172.21.15.133:0/3692961063 shutdown_connections 2023-12-18T10:21:30.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 -- 172.21.15.133:0/3692961063 wait complete. 2023-12-18T10:21:30.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 Processor -- start 2023-12-18T10:21:30.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.879+0000 7f923fc8c640 1 -- start start 2023-12-18T10:21:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923fc8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9238071db0 0x7f9238151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923fc8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92380ca410 0x7f92380c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923fc8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f92381f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923fc8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92380c86c0 con 0x7f92380ca410 2023-12-18T10:21:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923fc8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9238151950 con 0x7f9238071db0 2023-12-18T10:21:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923fc8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92380c83e0 con 0x7f9238159fb0 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92380ca410 0x7f92380c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92380ca410 0x7f92380c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43596/0 (socket says 172.21.15.133:43596) 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 -- 172.21.15.133:0/3901945201 learned_addr learned my addr 172.21.15.133:0/3901945201 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923da28640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9238071db0 0x7f9238151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923e229640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f92381f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 -- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 msgr2=0x7f92381f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f92381f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 -- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9238071db0 msgr2=0x7f9238151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9238071db0 0x7f9238151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 -- 172.21.15.133:0/3901945201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230009b30 con 0x7f92380ca410 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923e229640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f92381f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923d227640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92380ca410 0x7f92380c0ae0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f922800e930 tx=0x7f922800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f922e7fc640 1 -- 172.21.15.133:0/3901945201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228009690 con 0x7f92380ca410 2023-12-18T10:21:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f922e7fc640 1 -- 172.21.15.133:0/3901945201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922800ca00 con 0x7f92380ca410 2023-12-18T10:21:30.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f922e7fc640 1 -- 172.21.15.133:0/3901945201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800cd70 con 0x7f92380ca410 2023-12-18T10:21:30.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923fc8c640 1 -- 172.21.15.133:0/3901945201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92380c3120 con 0x7f92380ca410 2023-12-18T10:21:30.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f923fc8c640 1 -- 172.21.15.133:0/3901945201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92380c36e0 con 0x7f92380ca410 2023-12-18T10:21:30.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.883+0000 7f922e7fc640 1 -- 172.21.15.133:0/3901945201 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9228013470 con 0x7f92380ca410 2023-12-18T10:21:30.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f922e7fc640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f921c065a60 0x7f921c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f922e7fc640 1 -- 172.21.15.133:0/3901945201 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9228083480 con 0x7f92380ca410 2023-12-18T10:21:30.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923da28640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f921c065a60 0x7f921c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f9242ff8000 1 Processor -- start 2023-12-18T10:21:30.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f9242ff8000 1 -- start start 2023-12-18T10:21:30.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923da28640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f921c065a60 0x7f921c067f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9234009b60 tx=0x7f9234009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 0x55984f0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0ce7f0 0x55984f083e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f0847b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f9242ff8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984ef48430 con 0x55984f0843d0 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f9242ff8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984eed6460 con 0x55984f0cded0 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f9242ff8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55984eed3a30 con 0x55984f0ce7f0 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f0847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f0847b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43600/0 (socket says 172.21.15.133:43600) 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923da28640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 0x55984f0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 -- 172.21.15.133:0/1123065714 learned_addr learned my addr 172.21.15.133:0/1123065714 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923d227640 1 --2- 172.21.15.133:0/1123065714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0ce7f0 0x55984f083e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 -- 172.21.15.133:0/1123065714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0ce7f0 msgr2=0x55984f083e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 --2- 172.21.15.133:0/1123065714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0ce7f0 0x55984f083e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 -- 172.21.15.133:0/1123065714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 msgr2=0x55984f0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 --2- 172.21.15.133:0/1123065714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 0x55984f0ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 -- 172.21.15.133:0/1123065714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55984ebcbe20 con 0x55984f0843d0 2023-12-18T10:21:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f923e229640 1 --2- 172.21.15.133:0/1123065714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f0847b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f923001c9e0 tx=0x7f9230004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ada29e9c683ed5f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f921b7fe640 1 -- 172.21.15.133:0/1123065714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300a5a00 con 0x55984f0843d0 2023-12-18T10:21:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f921b7fe640 1 -- 172.21.15.133:0/1123065714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300a5b60 con 0x55984f0843d0 2023-12-18T10:21:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.887+0000 7f921b7fe640 1 -- 172.21.15.133:0/1123065714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300b6420 con 0x55984f0843d0 2023-12-18T10:21:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- 172.21.15.133:0/1123065714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 msgr2=0x55984f0847b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 --2- 172.21.15.133:0/1123065714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f0847b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f923001c9e0 tx=0x7f9230004ac0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- 172.21.15.133:0/1123065714 shutdown_connections 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 --2- 172.21.15.133:0/1123065714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f0847b0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 --2- 172.21.15.133:0/1123065714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0ce7f0 0x55984f083e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 --2- 172.21.15.133:0/1123065714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 0x55984f0ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- 172.21.15.133:0/1123065714 >> 172.21.15.133:0/1123065714 conn(0x55984ee7e910 msgr2=0x55984f07e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- 172.21.15.133:0/1123065714 shutdown_connections 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- 172.21.15.133:0/1123065714 wait complete. 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- start start 2023-12-18T10:21:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 Processor -- start 2023-12-18T10:21:30.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 0x55984f0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0cded0 0x55984f0cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 0x55984f0cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984eecf320 con 0x55984f0cded0 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984ee6e4f0 con 0x55984f0ce7f0 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55984ee8c6e0 con 0x55984f0843d0 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 10 client.0 _ll_register_callbacks cb 0x55984f06b980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0cded0 0x55984f0cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0cded0 0x55984f0cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43612/0 (socket says 172.21.15.133:43612) 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 -- 172.21.15.133:0/347794423 learned_addr learned my addr 172.21.15.133:0/347794423 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923da28640 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 0x55984f0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923e229640 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 0x55984f0cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 -- 172.21.15.133:0/347794423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 msgr2=0x55984f0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 0x55984f0cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 -- 172.21.15.133:0/347794423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 msgr2=0x55984f0cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 0x55984f0cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 -- 172.21.15.133:0/347794423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923815a7d0 con 0x55984f0cded0 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f923d227640 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0cded0 0x55984f0cf110 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9228051030 tx=0x7f922805cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca6cdd1638d885a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9218ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9218ff9640 1 -- 172.21.15.133:0/347794423 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922805c5d0 con 0x55984f0cded0 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9218ff9640 1 -- 172.21.15.133:0/347794423 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f922805c730 con 0x55984f0cded0 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- 172.21.15.133:0/347794423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55984ee8c120 con 0x55984f0cded0 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9218ff9640 1 -- 172.21.15.133:0/347794423 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92280812c0 con 0x55984f0cded0 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 10 client.6660 fetch_fsmap learned FSMap version 42 2023-12-18T10:21:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.891+0000 7f9242ff8000 1 -- 172.21.15.133:0/347794423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55984ee94250 con 0x55984f0cded0 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9218ff9640 1 -- 172.21.15.133:0/347794423 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55984ee8c120 con 0x55984f0cded0 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9218ff9640 1 -- 172.21.15.133:0/347794423 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f9228011070 con 0x55984f0cded0 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 10 client.6660 fetch_fsmap finished waiting for FSMap version 42 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 10 client.6660 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 20 client.6660 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55984f0dda90 0x55984f0dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 4 client.6660 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 -- 172.21.15.133:0/347794423 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55984eecdc70 con 0x55984f0dda90 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f923da28640 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55984f0dda90 0x55984f0dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9218ff9640 10 client.6660 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f923da28640 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55984f0dda90 0x55984f0dfe80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa47124516e752cc server_cookie=48b9bf6d12a76db4 in_seq=0 out_seq=0 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9218ff9640 1 -- 172.21.15.133:0/347794423 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55984eecdc70 con 0x55984f0dda90 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9218ff9640 10 client.6660 handle_command_reply: tid=0 2023-12-18T10:21:30.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 client.6660 shutdown 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 -- 172.21.15.133:0/347794423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0cded0 msgr2=0x55984f0cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0cded0 0x55984f0cf110 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9228051030 tx=0x7f922805cb20 comp rx=0 tx=0).stop 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 -- 172.21.15.133:0/347794423 shutdown_connections 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55984f0dda90 0x55984f0dfe80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 0x55984f0cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0cded0 0x55984f0cf110 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 --2- 172.21.15.133:0/347794423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 0x55984f0cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9218ff9640 0 client.6660 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 -- 172.21.15.133:0/347794423 >> 172.21.15.133:0/347794423 conn(0x55984ee7e910 msgr2=0x55984f07dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 -- 172.21.15.133:0/347794423 shutdown_connections 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 1 -- 172.21.15.133:0/347794423 wait complete. 2023-12-18T10:21:30.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.895+0000 7f9242ff8000 20 client.6660 trim_cache size 0 max 16384 2023-12-18T10:21:30.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 Processor -- start 2023-12-18T10:21:30.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- start start 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f07ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0cded0 0x55984f07f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 0x55984f084ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984eb8caa0 con 0x55984f0843d0 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984eeedaf0 con 0x55984f0ce7f0 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55984f0cda40 con 0x55984f0cded0 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f07ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f07ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43624/0 (socket says 172.21.15.133:43624) 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 -- 172.21.15.133:0/3205113877 learned_addr learned my addr 172.21.15.133:0/3205113877 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923d227640 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0cded0 0x55984f07f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923e229640 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 0x55984f084ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 -- 172.21.15.133:0/3205113877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0cded0 msgr2=0x55984f07f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0cded0 0x55984f07f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 -- 172.21.15.133:0/3205113877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 msgr2=0x55984f084ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 0x55984f084ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 -- 172.21.15.133:0/3205113877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55984ee7a5a0 con 0x55984f0843d0 2023-12-18T10:21:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f923da28640 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f07ecf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9234011f20 tx=0x7f9234018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c171d6772bad4e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f921bfff640 1 -- 172.21.15.133:0/3205113877 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234029040 con 0x55984f0843d0 2023-12-18T10:21:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f921bfff640 1 -- 172.21.15.133:0/3205113877 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923402c3f0 con 0x55984f0843d0 2023-12-18T10:21:30.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f921bfff640 1 -- 172.21.15.133:0/3205113877 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923401c040 con 0x55984f0843d0 2023-12-18T10:21:30.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- 172.21.15.133:0/3205113877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 msgr2=0x55984f07ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f07ecf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9234011f20 tx=0x7f9234018000 comp rx=0 tx=0).stop 2023-12-18T10:21:30.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- 172.21.15.133:0/3205113877 shutdown_connections 2023-12-18T10:21:30.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0ce7f0 0x55984f084ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0cded0 0x55984f07f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3205113877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0843d0 0x55984f07ecf0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- 172.21.15.133:0/3205113877 >> 172.21.15.133:0/3205113877 conn(0x55984ee7e910 msgr2=0x55984f0847b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- 172.21.15.133:0/3205113877 shutdown_connections 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- 172.21.15.133:0/3205113877 wait complete. 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.911+0000 7f9242ff8000 1 -- start start 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 Processor -- start 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 0x55984f112990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 0x55984f0deec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0ce7f0 0x55984f0df400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984f0cd170 con 0x55984f0ce7f0 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984ee8d480 con 0x55984f0cded0 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55984f0cee00 con 0x55984f0843d0 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 10 client.0 _ll_register_callbacks cb 0x55984ee86710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0ce7f0 0x55984f0df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0ce7f0 0x55984f0df400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43636/0 (socket says 172.21.15.133:43636) 2023-12-18T10:21:30.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 -- 172.21.15.133:0/3607634690 learned_addr learned my addr 172.21.15.133:0/3607634690 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:30.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923da28640 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 0x55984f112990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923d227640 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 0x55984f0deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 -- 172.21.15.133:0/3607634690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 msgr2=0x55984f112990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 0x55984f112990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 -- 172.21.15.133:0/3607634690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 msgr2=0x55984f0deec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:30.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 0x55984f0deec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 -- 172.21.15.133:0/3607634690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9234011c50 con 0x55984f0ce7f0 2023-12-18T10:21:30.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923e229640 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0ce7f0 0x55984f0df400 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9230000f90 tx=0x7f923001b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1665f25ea47ec371 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:30.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9218ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:30.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9218ff9640 1 -- 172.21.15.133:0/3607634690 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92300a5c00 con 0x55984f0ce7f0 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9218ff9640 1 -- 172.21.15.133:0/3607634690 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f92300c9070 con 0x55984f0ce7f0 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 -- 172.21.15.133:0/3607634690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55984f08c6c0 con 0x55984f0ce7f0 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9218ff9640 1 -- 172.21.15.133:0/3607634690 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92300a5d60 con 0x55984f0ce7f0 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 10 client.6666 fetch_fsmap learned FSMap version 42 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 -- 172.21.15.133:0/3607634690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55984ee6e110 con 0x55984f0ce7f0 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9218ff9640 1 -- 172.21.15.133:0/3607634690 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55984f08c6c0 con 0x55984f0ce7f0 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9218ff9640 1 -- 172.21.15.133:0/3607634690 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f9230005d20 con 0x55984f0ce7f0 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 10 client.6666 fetch_fsmap finished waiting for FSMap version 42 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 10 client.6666 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 20 client.6666 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55984f0df940 0x55984f0dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 4 client.6666 mds_command: new command op to 6165 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9242ff8000 1 -- 172.21.15.133:0/3607634690 --> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55984ee986a0 con 0x55984f0df940 2023-12-18T10:21:30.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923da28640 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55984f0df940 0x55984f0dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f923da28640 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55984f0df940 0x55984f0dfd50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7b018c1b59537b0 server_cookie=215e846e03173753 in_seq=0 out_seq=0 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.915+0000 7f9218ff9640 10 client.6666 ms_handle_connect on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9218ff9640 1 -- 172.21.15.133:0/3607634690 <== mds.0 v2:172.21.15.133:6835/1554379121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55984ee986a0 con 0x55984f0df940 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9218ff9640 10 client.6666 handle_command_reply: tid=0 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 client.6666 shutdown 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 -- 172.21.15.133:0/3607634690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0ce7f0 msgr2=0x55984f0df400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0ce7f0 0x55984f0df400 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9230000f90 tx=0x7f923001b1e0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 -- 172.21.15.133:0/3607634690 shutdown_connections 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.133:6835/1554379121,v1:172.21.15.133:6837/1554379121] conn(0x55984f0df940 0x55984f0dfd50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55984f0ce7f0 0x55984f0df400 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55984f0cded0 0x55984f0deec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9218ff9640 0 client.6666 ms_handle_reset on v2:172.21.15.133:6835/1554379121 2023-12-18T10:21:30.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 --2- 172.21.15.133:0/3607634690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55984f0843d0 0x55984f112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 -- 172.21.15.133:0/3607634690 >> 172.21.15.133:0/3607634690 conn(0x55984ee7e910 msgr2=0x55984f07dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 -- 172.21.15.133:0/3607634690 shutdown_connections 2023-12-18T10:21:30.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 1 -- 172.21.15.133:0/3607634690 wait complete. 2023-12-18T10:21:30.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f9242ff8000 20 client.6666 trim_cache size 0 max 16384 2023-12-18T10:21:30.926 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:30.926 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "no active scrubs running", 2023-12-18T10:21:30.926 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": {} 2023-12-18T10:21:30.926 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:30.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 -- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f921c065a60 msgr2=0x7f921c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f921c065a60 0x7f921c067f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9234009b60 tx=0x7f9234009190 comp rx=0 tx=0).stop 2023-12-18T10:21:30.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 -- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92380ca410 msgr2=0x7f92380c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:30.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92380ca410 0x7f92380c0ae0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f922800e930 tx=0x7f922800edf0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 -- 172.21.15.133:0/3901945201 shutdown_connections 2023-12-18T10:21:30.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f921c065a60 0x7f921c067f20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9238159fb0 0x7f92381f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92380ca410 0x7f92380c0ae0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 --2- 172.21.15.133:0/3901945201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9238071db0 0x7f9238151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:30.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 -- 172.21.15.133:0/3901945201 >> 172.21.15.133:0/3901945201 conn(0x7f923806a2a0 msgr2=0x7f923815b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:30.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 -- 172.21.15.133:0/3901945201 shutdown_connections 2023-12-18T10:21:30.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:30.919+0000 7f923fc8c640 1 -- 172.21.15.133:0/3901945201 wait complete. 2023-12-18T10:21:30.941 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:21:30.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:31.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff73ebdb640 1 Processor -- start 2023-12-18T10:21:31.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff73ebdb640 1 -- start start 2023-12-18T10:21:31.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff73ebdb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7380cac10 0x7ff73815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff73ebdb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73815f100 con 0x7ff73806fdb0 2023-12-18T10:21:31.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff73ebdb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7380ca7d0 con 0x7ff73815a680 2023-12-18T10:21:31.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff73ebdb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815e860 con 0x7ff7380cac10 2023-12-18T10:21:31.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff73d178640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff73806fdb0 0x7ff7380c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60604/0 (socket says 172.21.15.133:60604) 2023-12-18T10:21:31.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff73d178640 1 -- 172.21.15.133:0/249699276 learned_addr learned my addr 172.21.15.133:0/249699276 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:31.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72ffff640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7380cac10 0x7ff73815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150261602 0 0) 0x7ff73815f100 con 0x7ff73806fdb0 2023-12-18T10:21:31.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff720003530 con 0x7ff73806fdb0 2023-12-18T10:21:31.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559503475 0 0) 0x7ff7380ca7d0 con 0x7ff73815a680 2023-12-18T10:21:31.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff73815f100 con 0x7ff73815a680 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1659599301 0 0) 0x7ff720003530 con 0x7ff73806fdb0 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7380cac10 msgr2=0x7ff73815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7380cac10 0x7ff73815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 >> v1:172.21.15.142:6789/0 conn(0x7ff73815a680 legacy=0x7ff73815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73815eb40 con 0x7ff73806fdb0 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7ff730001a00 con 0x7ff73806fdb0 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.075+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 >> v1:172.21.15.133:6789/0 conn(0x7ff73806fdb0 legacy=0x7ff7380c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff72f7fe640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7380cac10 0x7ff720003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff72f7fe640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7200040a0 0x7ff7200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff72f7fe640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff720004d10 0x7ff720005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815e860 con 0x7ff720004d10 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72000bb20 con 0x7ff7200040a0 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72000bcb0 con 0x7ff7380cac10 2023-12-18T10:21:31.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff73d178640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff720004d10 0x7ff720005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff73c977640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7380cac10 0x7ff720003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff72ffff640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7200040a0 0x7ff7200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff73d178640 1 -- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7380cac10 msgr2=0x7ff720003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff73d178640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7380cac10 0x7ff720003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff73d178640 1 -- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7200040a0 msgr2=0x7ff7200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff73d178640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7200040a0 0x7ff7200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff73d178640 1 -- 172.21.15.133:0/249699276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720003530 con 0x7ff720004d10 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff73d178640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff720004d10 0x7ff720005190 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff73000a7a0 tx=0x7ff73001d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca8d6a6eea84ffb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.079+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300ad630 con 0x7ff720004d10 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7300a8070 con 0x7ff720004d10 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff72f7fe640 1 -- 172.21.15.133:0/249699276 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300ada30 con 0x7ff720004d10 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- 172.21.15.133:0/249699276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff720004d10 msgr2=0x7ff720005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 --2- 172.21.15.133:0/249699276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff720004d10 0x7ff720005190 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff73000a7a0 tx=0x7ff73001d2a0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73d178640 1 -- 172.21.15.133:0/249699276 reap_dead start 2023-12-18T10:21:31.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- 172.21.15.133:0/249699276 shutdown_connections 2023-12-18T10:21:31.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- 172.21.15.133:0/249699276 >> 172.21.15.133:0/249699276 conn(0x7ff73806a3e0 msgr2=0x7ff7380afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:31.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- 172.21.15.133:0/249699276 shutdown_connections 2023-12-18T10:21:31.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- 172.21.15.133:0/249699276 wait complete. 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 Processor -- start 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- start start 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7381f56b0 0x7ff7380c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7381f5a90 0x7ff7380c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7380c7d70 0x7ff73814c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381503e0 con 0x7ff7381f56b0 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380c4e10 con 0x7ff7380c7d70 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73ebdb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380c4850 con 0x7ff7381f5a90 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73c977640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7381f56b0 0x7ff7380c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73c977640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7381f56b0 0x7ff7380c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43648/0 (socket says 172.21.15.133:43648) 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.083+0000 7ff73c977640 1 -- 172.21.15.133:0/152422688 learned_addr learned my addr 172.21.15.133:0/152422688 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff72ffff640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7381f5a90 0x7ff7380c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73d178640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7380c7d70 0x7ff73814c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73c977640 1 -- 172.21.15.133:0/152422688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7381f5a90 msgr2=0x7ff7380c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73c977640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7381f5a90 0x7ff7380c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73c977640 1 -- 172.21.15.133:0/152422688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7380c7d70 msgr2=0x7ff73814c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73c977640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7380c7d70 0x7ff73814c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73c977640 1 -- 172.21.15.133:0/152422688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380c4b30 con 0x7ff7381f56b0 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73c977640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7381f56b0 0x7ff7380c1e90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff734012830 tx=0x7ff734012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff72d7fa640 1 -- 172.21.15.133:0/152422688 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734010bd0 con 0x7ff7381f56b0 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff72d7fa640 1 -- 172.21.15.133:0/152422688 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff734010d50 con 0x7ff7381f56b0 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff72d7fa640 1 -- 172.21.15.133:0/152422688 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340166c0 con 0x7ff7381f56b0 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7380cc060 con 0x7ff7381f56b0 2023-12-18T10:21:31.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7380c81f0 con 0x7ff7381f56b0 2023-12-18T10:21:31.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7380735b0 con 0x7ff7381f56b0 2023-12-18T10:21:31.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff72d7fa640 1 -- 172.21.15.133:0/152422688 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff734016820 con 0x7ff7381f56b0 2023-12-18T10:21:31.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.087+0000 7ff72d7fa640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff724065a60 0x7ff724067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.091+0000 7ff72d7fa640 1 -- 172.21.15.133:0/152422688 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff734086a60 con 0x7ff7381f56b0 2023-12-18T10:21:31.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.091+0000 7ff72ffff640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff724065a60 0x7ff724067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.091+0000 7ff72ffff640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff724065a60 0x7ff724067f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff7381f53b0 tx=0x7ff728009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.095+0000 7ff72d7fa640 1 -- 172.21.15.133:0/152422688 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff7340542d0 con 0x7ff7381f56b0 2023-12-18T10:21:31.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff73804e000 con 0x7ff7381f56b0 2023-12-18T10:21:31.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff72d7fa640 1 -- 172.21.15.133:0/152422688 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4758 (secure 0 0 0) 0x7ff7340578f0 con 0x7ff7381f56b0 2023-12-18T10:21:31.283 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:31.283 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:21:22.973560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6165,"mds_1":6162,"mds_2":5875},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5875":{"gid":5875,"name":"d","rank":2,"incarnation":36,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6162":{"gid":6162,"name":"a","rank":1,"incarnation":34,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:21:31.283 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 42 2023-12-18T10:21:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff724065a60 msgr2=0x7ff724067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff724065a60 0x7ff724067f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff7381f53b0 tx=0x7ff728009190 comp rx=0 tx=0).stop 2023-12-18T10:21:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7381f56b0 msgr2=0x7ff7380c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7381f56b0 0x7ff7380c1e90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff734012830 tx=0x7ff734012c30 comp rx=0 tx=0).stop 2023-12-18T10:21:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 shutdown_connections 2023-12-18T10:21:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff724065a60 0x7ff724067f20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7380c7d70 0x7ff73814c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7381f5a90 0x7ff7380c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 --2- 172.21.15.133:0/152422688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7381f56b0 0x7ff7380c1e90 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 >> 172.21.15.133:0/152422688 conn(0x7ff73806a3e0 msgr2=0x7ff7380af000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 shutdown_connections 2023-12-18T10:21:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.279+0000 7ff73ebdb640 1 -- 172.21.15.133:0/152422688 wait complete. 2023-12-18T10:21:31.304 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2023-12-18T10:21:31.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:21:31.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcfff81f640 1 Processor -- start 2023-12-18T10:21:31.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcfff81f640 1 -- start start 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcfff81f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcff80ae040 0x7fcff806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcfff81f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 0x7fcff80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcfff81f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcff80ce290 0x7fcff80c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcfff81f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff80ce720 con 0x7fcff80ce290 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcfff81f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff80cccf0 con 0x7fcff80ae040 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcfff81f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80ae420 con 0x7fcff806d170 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffddbc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcff80ce290 0x7fcff80c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffddbc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcff80ce290 0x7fcff80c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43650/0 (socket says 172.21.15.133:43650) 2023-12-18T10:21:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffddbc640 1 -- 172.21.15.133:0/2563630160 learned_addr learned my addr 172.21.15.133:0/2563630160 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:31.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffcdba640 1 --2- 172.21.15.133:0/2563630160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 0x7fcff80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffd5bb640 1 --2- 172.21.15.133:0/2563630160 >> v2:172.21.15.142:3300/0 conn(0x7fcff80ae040 0x7fcff806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffddbc640 1 -- 172.21.15.133:0/2563630160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 msgr2=0x7fcff80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:31.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffddbc640 1 --2- 172.21.15.133:0/2563630160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 0x7fcff80cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffddbc640 1 -- 172.21.15.133:0/2563630160 >> v2:172.21.15.142:3300/0 conn(0x7fcff80ae040 msgr2=0x7fcff806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:31.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffddbc640 1 --2- 172.21.15.133:0/2563630160 >> v2:172.21.15.142:3300/0 conn(0x7fcff80ae040 0x7fcff806cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.439+0000 7fcffddbc640 1 -- 172.21.15.133:0/2563630160 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80ccf90 con 0x7fcff80ce290 2023-12-18T10:21:31.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcffddbc640 1 --2- 172.21.15.133:0/2563630160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80c9920 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fcff80b4d00 tx=0x7fcff001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124db2da0cfb9571 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:31.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfeffff640 1 -- 172.21.15.133:0/2563630160 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00a5730 con 0x7fcff80ce290 2023-12-18T10:21:31.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfeffff640 1 -- 172.21.15.133:0/2563630160 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff00a5890 con 0x7fcff80ce290 2023-12-18T10:21:31.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfeffff640 1 -- 172.21.15.133:0/2563630160 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00a5c20 con 0x7fcff80ce290 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 -- 172.21.15.133:0/2563630160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 msgr2=0x7fcff80c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 --2- 172.21.15.133:0/2563630160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80c9920 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fcff80b4d00 tx=0x7fcff001c9a0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 -- 172.21.15.133:0/2563630160 shutdown_connections 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 --2- 172.21.15.133:0/2563630160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80c9920 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 --2- 172.21.15.133:0/2563630160 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 0x7fcff80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 --2- 172.21.15.133:0/2563630160 >> v2:172.21.15.142:3300/0 conn(0x7fcff80ae040 0x7fcff806cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 -- 172.21.15.133:0/2563630160 >> 172.21.15.133:0/2563630160 conn(0x7fcff80cb610 msgr2=0x7fcff80cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 -- 172.21.15.133:0/2563630160 shutdown_connections 2023-12-18T10:21:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.443+0000 7fcfff81f640 1 -- 172.21.15.133:0/2563630160 wait complete. 2023-12-18T10:21:31.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 Processor -- start 2023-12-18T10:21:31.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 -- start start 2023-12-18T10:21:31.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 0x7fcff815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff80ae040 0x7fcff8154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80b4740 con 0x7fcff80ce290 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80b44a0 con 0x7fcff80ae040 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8153aa0 con 0x7fcff806d170 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43656/0 (socket says 172.21.15.133:43656) 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 -- 172.21.15.133:0/1554877044 learned_addr learned my addr 172.21.15.133:0/1554877044 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffd5bb640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 0x7fcff815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffcdba640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff80ae040 0x7fcff8154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 -- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 msgr2=0x7fcff815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 0x7fcff815be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 -- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff80ae040 msgr2=0x7fcff8154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff80ae040 0x7fcff8154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 -- 172.21.15.133:0/1554877044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff0009b30 con 0x7fcff80ce290 2023-12-18T10:21:31.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffcdba640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff80ae040 0x7fcff8154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:31.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcffddbc640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80b3f60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fcff00af040 tx=0x7fcff0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:31.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfedffb640 1 -- 172.21.15.133:0/1554877044 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00be070 con 0x7fcff80ce290 2023-12-18T10:21:31.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfedffb640 1 -- 172.21.15.133:0/1554877044 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff00b8440 con 0x7fcff80ce290 2023-12-18T10:21:31.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff8153d80 con 0x7fcff80ce290 2023-12-18T10:21:31.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfedffb640 1 -- 172.21.15.133:0/1554877044 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00b8810 con 0x7fcff80ce290 2023-12-18T10:21:31.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff8154340 con 0x7fcff80ce290 2023-12-18T10:21:31.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.447+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff8154530 con 0x7fcff80ce290 2023-12-18T10:21:31.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.451+0000 7fcfedffb640 1 -- 172.21.15.133:0/1554877044 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcff00b8970 con 0x7fcff80ce290 2023-12-18T10:21:31.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.451+0000 7fcfedffb640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfdc065a90 0x7fcfdc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.451+0000 7fcfedffb640 1 -- 172.21.15.133:0/1554877044 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcff011db00 con 0x7fcff80ce290 2023-12-18T10:21:31.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.451+0000 7fcffd5bb640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfdc065a90 0x7fcfdc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:31.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.451+0000 7fcffd5bb640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfdc065a90 0x7fcfdc067f50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcff40079e0 tx=0x7fcff4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:31.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.455+0000 7fcfedffb640 1 -- 172.21.15.133:0/1554877044 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcff00eb380 con 0x7fcff80ce290 2023-12-18T10:21:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.659+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcff804e000 con 0x7fcff80ce290 2023-12-18T10:21:31.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.659+0000 7fcfedffb640 1 -- 172.21.15.133:0/1554877044 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1869 (secure 0 0 0) 0x7fcff00ee9a0 con 0x7fcff80ce290 2023-12-18T10:21:31.664 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:31.664 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":231,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700657,"bytes_used":235782144,"bytes_avail":772858331136,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":42,"id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5875},{"filesystem_id":3,"rank":1,"name":"a","status":"up:active","gid":6162},{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":6165}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-12-18T10:21:31.138247+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfdc065a90 msgr2=0x7fcfdc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfdc065a90 0x7fcfdc067f50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcff40079e0 tx=0x7fcff4008040 comp rx=0 tx=0).stop 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 msgr2=0x7fcff80b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80b3f60 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fcff00af040 tx=0x7fcff0019740 comp rx=0 tx=0).stop 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 shutdown_connections 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfdc065a90 0x7fcfdc067f50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff80ce290 0x7fcff80b3f60 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff80ae040 0x7fcff8154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 --2- 172.21.15.133:0/1554877044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcff806d170 0x7fcff815be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:31.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 >> 172.21.15.133:0/1554877044 conn(0x7fcff80cb610 msgr2=0x7fcff80cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:31.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 shutdown_connections 2023-12-18T10:21:31.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.663+0000 7fcfff81f640 1 -- 172.21.15.133:0/1554877044 wait complete. 2023-12-18T10:21:31.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'idle+waiting paths [/d1/d2/d3]'} 2023-12-18T10:21:31.685 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:21:31.685 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:21:31.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:21:31.809 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:21:31.809 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:21:31.809 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:21:31.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:21:31.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e68d7640 1 Processor -- start 2023-12-18T10:21:31.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e68d7640 1 -- start start 2023-12-18T10:21:31.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e68d7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29e015c730 0x7f29e00b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e68d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29e00cf670 0x7f29e00b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:31.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e68d7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e015cb10 con 0x7f29e00cea00 2023-12-18T10:21:31.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e68d7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00b84c0 con 0x7f29e015c730 2023-12-18T10:21:32.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e68d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00cd960 con 0x7f29e00cf670 2023-12-18T10:21:32.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e50d4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f29e00cea00 0x7f29e00cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60608/0 (socket says 172.21.15.133:60608) 2023-12-18T10:21:32.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e50d4640 1 -- 172.21.15.133:0/3484507276 learned_addr learned my addr 172.21.15.133:0/3484507276 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:32.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e58d5640 1 --2- 172.21.15.133:0/3484507276 >> v2:172.21.15.142:3300/0 conn(0x7f29e015c730 0x7f29e00b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e60d6640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29e00cf670 0x7f29e00b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621883327 0 0) 0x7f29e015cb10 con 0x7f29e00cea00 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29cc003530 con 0x7f29e00cea00 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3108864759 0 0) 0x7f29cc003530 con 0x7f29e00cea00 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29e00cf670 msgr2=0x7f29e00b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29e00cf670 0x7f29e00b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 >> v2:172.21.15.142:3300/0 conn(0x7f29e015c730 msgr2=0x7f29e00b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 --2- 172.21.15.133:0/3484507276 >> v2:172.21.15.142:3300/0 conn(0x7f29e015c730 0x7f29e00b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00cdc40 con 0x7f29e00cea00 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f29d0001680 con 0x7f29e00cea00 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e58d5640 1 --2- 172.21.15.133:0/3484507276 >> v2:172.21.15.142:3300/0 conn(0x7f29e015c730 0x7f29e00b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 >> v1:172.21.15.133:6789/0 conn(0x7f29e00cea00 legacy=0x7f29e00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29cc003980 0x7f29cc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29e00cf670 0x7f29cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29cc004d10 0x7f29cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00b84c0 con 0x7f29cc004d10 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00cd960 con 0x7f29cc003980 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc00b990 con 0x7f29e00cf670 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e60d6640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29cc004d10 0x7f29cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e58d5640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29cc003980 0x7f29cc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e50d4640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29e00cf670 0x7f29cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e60d6640 1 -- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29e00cf670 msgr2=0x7f29cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e60d6640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29e00cf670 0x7f29cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e60d6640 1 -- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29cc003980 msgr2=0x7f29cc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e60d6640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29cc003980 0x7f29cc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.995+0000 7f29e60d6640 1 -- 172.21.15.133:0/3484507276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc003530 con 0x7f29cc004d10 2023-12-18T10:21:32.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e60d6640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29cc004d10 0x7f29cc005190 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009fc0 tx=0x7f29d801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a06c2095b533fd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80a5c70 con 0x7f29cc004d10 2023-12-18T10:21:32.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d800f040 con 0x7f29cc004d10 2023-12-18T10:21:32.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e48d3640 1 -- 172.21.15.133:0/3484507276 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80ad440 con 0x7f29cc004d10 2023-12-18T10:21:32.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e68d7640 1 -- 172.21.15.133:0/3484507276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29cc004d10 msgr2=0x7f29cc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e68d7640 1 --2- 172.21.15.133:0/3484507276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29cc004d10 0x7f29cc005190 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009fc0 tx=0x7f29d801cc60 comp rx=0 tx=0).stop 2023-12-18T10:21:32.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e60d6640 1 -- 172.21.15.133:0/3484507276 reap_dead start 2023-12-18T10:21:32.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e68d7640 1 -- 172.21.15.133:0/3484507276 shutdown_connections 2023-12-18T10:21:32.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e68d7640 1 -- 172.21.15.133:0/3484507276 >> 172.21.15.133:0/3484507276 conn(0x7f29e006b120 msgr2=0x7f29e006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:32.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e68d7640 1 -- 172.21.15.133:0/3484507276 shutdown_connections 2023-12-18T10:21:32.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:31.999+0000 7f29e68d7640 1 -- 172.21.15.133:0/3484507276 wait complete. 2023-12-18T10:21:32.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 Processor -- start 2023-12-18T10:21:32.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 -- start start 2023-12-18T10:21:32.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29cc004d10 0x7f29e0149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29e00ca610 0x7f29e00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e00caa90 0x7f29e00cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00cb8b0 con 0x7f29e00caa90 2023-12-18T10:21:32.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00cb010 con 0x7f29e00ca610 2023-12-18T10:21:32.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00cb2f0 con 0x7f29cc004d10 2023-12-18T10:21:32.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e00caa90 0x7f29e00cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e00caa90 0x7f29e00cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43676/0 (socket says 172.21.15.133:43676) 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 -- 172.21.15.133:0/3567526600 learned_addr learned my addr 172.21.15.133:0/3567526600 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e50d4640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29e00ca610 0x7f29e00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e58d5640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29cc004d10 0x7f29e0149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 -- 172.21.15.133:0/3567526600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29cc004d10 msgr2=0x7f29e0149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29cc004d10 0x7f29e0149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 -- 172.21.15.133:0/3567526600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29e00ca610 msgr2=0x7f29e00cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29e00ca610 0x7f29e00cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 -- 172.21.15.133:0/3567526600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00cb5d0 con 0x7f29e00caa90 2023-12-18T10:21:32.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e60d6640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e00caa90 0x7f29e00cc250 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f29d80b0040 tx=0x7f29d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29d67fc640 1 -- 172.21.15.133:0/3567526600 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80bc070 con 0x7f29e00caa90 2023-12-18T10:21:32.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29d67fc640 1 -- 172.21.15.133:0/3567526600 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d80039a0 con 0x7f29e00caa90 2023-12-18T10:21:32.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29d67fc640 1 -- 172.21.15.133:0/3567526600 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8003b30 con 0x7f29e00caa90 2023-12-18T10:21:32.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e015cda0 con 0x7f29e00caa90 2023-12-18T10:21:32.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.003+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e014fc00 con 0x7f29e00caa90 2023-12-18T10:21:32.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.007+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e0066c50 con 0x7f29e00caa90 2023-12-18T10:21:32.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.007+0000 7f29d67fc640 1 -- 172.21.15.133:0/3567526600 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f29d80b4040 con 0x7f29e00caa90 2023-12-18T10:21:32.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.007+0000 7f29d67fc640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29c4065a90 0x7f29c4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.007+0000 7f29d67fc640 1 -- 172.21.15.133:0/3567526600 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29d811d400 con 0x7f29e00caa90 2023-12-18T10:21:32.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.007+0000 7f29e58d5640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29c4065a90 0x7f29c4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.007+0000 7f29e58d5640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29c4065a90 0x7f29c4067f50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0093f0 tx=0x7f29dc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.011+0000 7f29d67fc640 1 -- 172.21.15.133:0/3567526600 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f29d80ead20 con 0x7f29e00caa90 2023-12-18T10:21:32.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.167+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29e0066c50 con 0x7f29e00caa90 2023-12-18T10:21:32.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.167+0000 7f29d67fc640 1 -- 172.21.15.133:0/3567526600 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16354 (secure 0 0 0) 0x7f29d80ee340 con 0x7f29e00caa90 2023-12-18T10:21:32.172 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:32.172 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:20:45.524788+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:20:42.874010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-18T10:20:43.517857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.167+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29c4065a90 msgr2=0x7f29c4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.167+0000 7f29e68d7640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29c4065a90 0x7f29c4067f50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0093f0 tx=0x7f29dc009190 comp rx=0 tx=0).stop 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.167+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e00caa90 msgr2=0x7f29e00cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.167+0000 7f29e68d7640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e00caa90 0x7f29e00cc250 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f29d80b0040 tx=0x7f29d8009750 comp rx=0 tx=0).stop 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.171+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 shutdown_connections 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.171+0000 7f29e68d7640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29c4065a90 0x7f29c4067f50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.171+0000 7f29e68d7640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e00caa90 0x7f29e00cc250 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.171+0000 7f29e68d7640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29e00ca610 0x7f29e00cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.171+0000 7f29e68d7640 1 --2- 172.21.15.133:0/3567526600 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29cc004d10 0x7f29e0149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.171+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 >> 172.21.15.133:0/3567526600 conn(0x7f29e006b120 msgr2=0x7f29e0158290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.171+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 shutdown_connections 2023-12-18T10:21:32.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.171+0000 7f29e68d7640 1 -- 172.21.15.133:0/3567526600 wait complete. 2023-12-18T10:21:32.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:20:42.874010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:20:43.517857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:21:32.193 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:21:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72ca3c0640 1 Processor -- start 2023-12-18T10:21:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72ca3c0640 1 -- start start 2023-12-18T10:21:32.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72ca3c0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72c41582d0 0x7f72c40c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72ca3c0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f72c4070820 0x7f72c40ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72ca3c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c40ce3b0 0x7f72c40ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72ca3c0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c40ced80 con 0x7f72c41582d0 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72ca3c0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c40c9390 con 0x7f72c4070820 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72ca3c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c415aee0 con 0x7f72c40ce3b0 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72c3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72c41582d0 0x7f72c40c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72c3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72c41582d0 0x7f72c40c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43678/0 (socket says 172.21.15.133:43678) 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72c3fff640 1 -- 172.21.15.133:0/1976896578 learned_addr learned my addr 172.21.15.133:0/1976896578 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72c37fe640 1 --2- 172.21.15.133:0/1976896578 >> v2:172.21.15.142:3300/0 conn(0x7f72c4070820 0x7f72c40ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72c895d640 1 --2- 172.21.15.133:0/1976896578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c40ce3b0 0x7f72c40ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72c3fff640 1 -- 172.21.15.133:0/1976896578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c40ce3b0 msgr2=0x7f72c40ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72c3fff640 1 --2- 172.21.15.133:0/1976896578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c40ce3b0 0x7f72c40ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.331+0000 7f72c3fff640 1 -- 172.21.15.133:0/1976896578 >> v2:172.21.15.142:3300/0 conn(0x7f72c4070820 msgr2=0x7f72c40ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72c3fff640 1 --2- 172.21.15.133:0/1976896578 >> v2:172.21.15.142:3300/0 conn(0x7f72c4070820 0x7f72c40ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72c3fff640 1 -- 172.21.15.133:0/1976896578 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c415b1c0 con 0x7f72c41582d0 2023-12-18T10:21:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72c37fe640 1 --2- 172.21.15.133:0/1976896578 >> v2:172.21.15.142:3300/0 conn(0x7f72c4070820 0x7f72c40ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:32.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72c3fff640 1 --2- 172.21.15.133:0/1976896578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c8e50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f72c406dfa0 tx=0x7f72b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8605eb0044f94304 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72c2ffd640 1 -- 172.21.15.133:0/1976896578 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b40aa5f0 con 0x7f72c41582d0 2023-12-18T10:21:32.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72c2ffd640 1 -- 172.21.15.133:0/1976896578 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b40aa750 con 0x7f72c41582d0 2023-12-18T10:21:32.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72c2ffd640 1 -- 172.21.15.133:0/1976896578 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b40aaae0 con 0x7f72c41582d0 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 -- 172.21.15.133:0/1976896578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 msgr2=0x7f72c40c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/1976896578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c8e50 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f72c406dfa0 tx=0x7f72b401c4d0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 -- 172.21.15.133:0/1976896578 shutdown_connections 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/1976896578 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c40ce3b0 0x7f72c40ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/1976896578 >> v2:172.21.15.142:3300/0 conn(0x7f72c4070820 0x7f72c40ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/1976896578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c8e50 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 -- 172.21.15.133:0/1976896578 >> 172.21.15.133:0/1976896578 conn(0x7f72c406a2a0 msgr2=0x7f72c40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 -- 172.21.15.133:0/1976896578 shutdown_connections 2023-12-18T10:21:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.335+0000 7f72ca3c0640 1 -- 172.21.15.133:0/1976896578 wait complete. 2023-12-18T10:21:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 Processor -- start 2023-12-18T10:21:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 -- start start 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4070820 0x7f72c4151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c40ce3b0 0x7f72c40c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4155c50 con 0x7f72c41582d0 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4155f30 con 0x7f72c40ce3b0 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4156210 con 0x7f72c4070820 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43688/0 (socket says 172.21.15.133:43688) 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 -- 172.21.15.133:0/674368895 learned_addr learned my addr 172.21.15.133:0/674368895 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c3fff640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4070820 0x7f72c4151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c37fe640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c40ce3b0 0x7f72c40c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 -- 172.21.15.133:0/674368895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4070820 msgr2=0x7f72c4151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4070820 0x7f72c4151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 -- 172.21.15.133:0/674368895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c40ce3b0 msgr2=0x7f72c40c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c40ce3b0 0x7f72c40c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 -- 172.21.15.133:0/674368895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b40094d0 con 0x7f72c41582d0 2023-12-18T10:21:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c895d640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c78f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f72bc007e40 tx=0x7f72bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c0ff9640 1 -- 172.21.15.133:0/674368895 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc014620 con 0x7f72c41582d0 2023-12-18T10:21:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72c0ff9640 1 -- 172.21.15.133:0/674368895 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc00ee90 con 0x7f72c41582d0 2023-12-18T10:21:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.339+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c41564f0 con 0x7f72c41582d0 2023-12-18T10:21:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.343+0000 7f72c0ff9640 1 -- 172.21.15.133:0/674368895 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0149e0 con 0x7f72c41582d0 2023-12-18T10:21:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.343+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c40c6420 con 0x7f72c41582d0 2023-12-18T10:21:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.343+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c404e000 con 0x7f72c41582d0 2023-12-18T10:21:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.343+0000 7f72c0ff9640 1 -- 172.21.15.133:0/674368895 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f72bc014b40 con 0x7f72c41582d0 2023-12-18T10:21:32.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.343+0000 7f72c0ff9640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f72b0065a60 0x7f72b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.343+0000 7f72c0ff9640 1 -- 172.21.15.133:0/674368895 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f72bc0839f0 con 0x7f72c41582d0 2023-12-18T10:21:32.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.343+0000 7f72c3fff640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f72b0065a60 0x7f72b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.343+0000 7f72c3fff640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f72b0065a60 0x7f72b0067f20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f72b40ae000 tx=0x7f72b40b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.347+0000 7f72c0ff9640 1 -- 172.21.15.133:0/674368895 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f72bc0513b0 con 0x7f72c41582d0 2023-12-18T10:21:32.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.499+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72c41569a0 con 0x7f72c41582d0 2023-12-18T10:21:32.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.499+0000 7f72c0ff9640 1 -- 172.21.15.133:0/674368895 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72bc0549d0 con 0x7f72c41582d0 2023-12-18T10:21:32.505 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:21:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f72b0065a60 msgr2=0x7f72b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f72b0065a60 0x7f72b0067f20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f72b40ae000 tx=0x7f72b40b5040 comp rx=0 tx=0).stop 2023-12-18T10:21:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 msgr2=0x7f72c40c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c78f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f72bc007e40 tx=0x7f72bc00e4b0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 shutdown_connections 2023-12-18T10:21:32.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f72b0065a60 0x7f72b0067f20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72c41582d0 0x7f72c40c78f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72c40ce3b0 0x7f72c40c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 --2- 172.21.15.133:0/674368895 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f72c4070820 0x7f72c4151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 >> 172.21.15.133:0/674368895 conn(0x7f72c406a2a0 msgr2=0x7f72c40af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:32.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 shutdown_connections 2023-12-18T10:21:32.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.503+0000 7f72ca3c0640 1 -- 172.21.15.133:0/674368895 wait complete. 2023-12-18T10:21:32.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:21:32.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f3405e41640 1 Processor -- start 2023-12-18T10:21:32.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f3405e41640 1 -- start start 2023-12-18T10:21:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f3405e41640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3400071870 0x7f3400071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f3405e41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 0x7f34000cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f3405e41640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000cc930 con 0x7f34000ca410 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f3405e41640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340015aab0 con 0x7f3400071870 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f3405e41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3400070df0 con 0x7f34000cbff0 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f33ff7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f34000ca410 0x7f3400159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60612/0 (socket says 172.21.15.133:60612) 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f33ff7fe640 1 -- 172.21.15.133:0/2692772194 learned_addr learned my addr 172.21.15.133:0/2692772194 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f33fffff640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 0x7f34000cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f33feffd640 1 --2- 172.21.15.133:0/2692772194 >> v2:172.21.15.142:3300/0 conn(0x7f3400071870 0x7f3400071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438926817 0 0) 0x7f34000cc930 con 0x7f34000ca410 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.667+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e8003530 con 0x7f34000ca410 2023-12-18T10:21:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1629316000 0 0) 0x7f33e8003530 con 0x7f34000ca410 2023-12-18T10:21:32.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 msgr2=0x7f34000cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 0x7f34000cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 >> v2:172.21.15.142:3300/0 conn(0x7f3400071870 msgr2=0x7f3400071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 --2- 172.21.15.133:0/2692772194 >> v2:172.21.15.142:3300/0 conn(0x7f3400071870 0x7f3400071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340015a4f0 con 0x7f34000ca410 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f33f00016a0 con 0x7f34000ca410 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fffff640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 0x7f34000cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 >> v1:172.21.15.133:6789/0 conn(0x7f34000ca410 legacy=0x7f3400159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e8003980 0x7f33e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33e80047d0 0x7f33e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 0x7f33e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340015aab0 con 0x7f33e80047d0 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400070df0 con 0x7f33e8003980 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8009980 con 0x7f34000cbff0 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33feffd640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33e80047d0 0x7f33e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33ff7fe640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e8003980 0x7f33e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33fffff640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 0x7f33e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33feffd640 1 -- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 msgr2=0x7f33e8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33feffd640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000cbff0 0x7f33e8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33feffd640 1 -- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e8003980 msgr2=0x7f33e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:32.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33feffd640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e8003980 0x7f33e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33feffd640 1 -- 172.21.15.133:0/2692772194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009a70 con 0x7f33e80047d0 2023-12-18T10:21:32.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.671+0000 7f33feffd640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33e80047d0 0x7f33e8004c50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009ae0 tx=0x7f33f401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3380f57fe12430e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40a55a0 con 0x7f33e80047d0 2023-12-18T10:21:32.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f40a5700 con 0x7f33e80047d0 2023-12-18T10:21:32.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f33fe7fc640 1 -- 172.21.15.133:0/2692772194 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f40a5ab0 con 0x7f33e80047d0 2023-12-18T10:21:32.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- 172.21.15.133:0/2692772194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33e80047d0 msgr2=0x7f33e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 --2- 172.21.15.133:0/2692772194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33e80047d0 0x7f33e8004c50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009ae0 tx=0x7f33f401ca90 comp rx=0 tx=0).stop 2023-12-18T10:21:32.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f33fffff640 1 -- 172.21.15.133:0/2692772194 reap_dead start 2023-12-18T10:21:32.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- 172.21.15.133:0/2692772194 shutdown_connections 2023-12-18T10:21:32.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- 172.21.15.133:0/2692772194 >> 172.21.15.133:0/2692772194 conn(0x7f340006a2a0 msgr2=0x7f34000aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:32.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- 172.21.15.133:0/2692772194 shutdown_connections 2023-12-18T10:21:32.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- 172.21.15.133:0/2692772194 wait complete. 2023-12-18T10:21:32.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 Processor -- start 2023-12-18T10:21:32.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- start start 2023-12-18T10:21:32.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e80047d0 0x7f3400156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000c7720 0x7f3400155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34000c7ba0 0x7f3400155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000c8730 con 0x7f34000c7ba0 2023-12-18T10:21:32.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400155ed0 con 0x7f33e80047d0 2023-12-18T10:21:32.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.675+0000 7f3405e41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000c8170 con 0x7f34000c7720 2023-12-18T10:21:32.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34000c7ba0 0x7f3400155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33feffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000c7720 0x7f3400155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34000c7ba0 0x7f3400155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43706/0 (socket says 172.21.15.133:43706) 2023-12-18T10:21:32.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 -- 172.21.15.133:0/3681002888 learned_addr learned my addr 172.21.15.133:0/3681002888 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:32.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33ff7fe640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e80047d0 0x7f3400156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 -- 172.21.15.133:0/3681002888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000c7720 msgr2=0x7f3400155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000c7720 0x7f3400155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 -- 172.21.15.133:0/3681002888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e80047d0 msgr2=0x7f3400156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e80047d0 0x7f3400156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 -- 172.21.15.133:0/3681002888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000c8450 con 0x7f34000c7ba0 2023-12-18T10:21:32.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33feffd640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000c7720 0x7f3400155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:32.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33fffff640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34000c7ba0 0x7f3400155990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f340006e230 tx=0x7f33f800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33e7fff640 1 -- 172.21.15.133:0/3681002888 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f800e040 con 0x7f34000c7ba0 2023-12-18T10:21:32.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33e7fff640 1 -- 172.21.15.133:0/3681002888 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f800f040 con 0x7f34000c7ba0 2023-12-18T10:21:32.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34000c5690 con 0x7f34000c7ba0 2023-12-18T10:21:32.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33e7fff640 1 -- 172.21.15.133:0/3681002888 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8003be0 con 0x7f34000c7ba0 2023-12-18T10:21:32.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34000c1170 con 0x7f34000c7ba0 2023-12-18T10:21:32.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34000c54f0 con 0x7f34000c7ba0 2023-12-18T10:21:32.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.679+0000 7f33e7fff640 1 -- 172.21.15.133:0/3681002888 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f33f8015430 con 0x7f34000c7ba0 2023-12-18T10:21:32.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.683+0000 7f33e7fff640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33ec065a60 0x7f33ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:32.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.683+0000 7f33e7fff640 1 -- 172.21.15.133:0/3681002888 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f33f8083ab0 con 0x7f34000c7ba0 2023-12-18T10:21:32.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.683+0000 7f33ff7fe640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33ec065a60 0x7f33ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:32.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.683+0000 7f33ff7fe640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33ec065a60 0x7f33ec067f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f34000cb240 tx=0x7f33f0007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:32.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.683+0000 7f33e7fff640 1 -- 172.21.15.133:0/3681002888 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f34000c54f0 con 0x7f34000c7ba0 2023-12-18T10:21:32.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.839+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34000c54f0 con 0x7f34000c7ba0 2023-12-18T10:21:32.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.839+0000 7f33e7fff640 1 -- 172.21.15.133:0/3681002888 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34000c54f0 con 0x7f34000c7ba0 2023-12-18T10:21:32.844 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33ec065a60 msgr2=0x7f33ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33ec065a60 0x7f33ec067f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f34000cb240 tx=0x7f33f0007900 comp rx=0 tx=0).stop 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34000c7ba0 msgr2=0x7f3400155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34000c7ba0 0x7f3400155990 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f340006e230 tx=0x7f33f800f580 comp rx=0 tx=0).stop 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 shutdown_connections 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33ec065a60 0x7f33ec067f20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34000c7ba0 0x7f3400155990 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34000c7720 0x7f3400155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 --2- 172.21.15.133:0/3681002888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33e80047d0 0x7f3400156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 >> 172.21.15.133:0/3681002888 conn(0x7f340006a2a0 msgr2=0x7f3400157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:32.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 shutdown_connections 2023-12-18T10:21:32.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:32.843+0000 7f3405e41640 1 -- 172.21.15.133:0/3681002888 wait complete. 2023-12-18T10:21:32.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:21:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab7cb6640 1 Processor -- start 2023-12-18T10:21:33.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab7cb6640 1 -- start start 2023-12-18T10:21:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab7cb6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feab015cae0 0x7feab00d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab7cb6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feab00cf880 0x7feab00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab7cb6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab015cec0 con 0x7feab00cde90 2023-12-18T10:21:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab7cb6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab00d0530 con 0x7feab015cae0 2023-12-18T10:21:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab7cb6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab00d0810 con 0x7feab00cf880 2023-12-18T10:21:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab5a52640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feab015cae0 0x7feab00d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab5a52640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feab015cae0 0x7feab00d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43712/0 (socket says 172.21.15.133:43712) 2023-12-18T10:21:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab5a52640 1 -- 172.21.15.133:0/1907409352 learned_addr learned my addr 172.21.15.133:0/1907409352 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:33.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab6253640 1 --2- 172.21.15.133:0/1907409352 >> v2:172.21.15.142:3300/0 conn(0x7feab00cf880 0x7feab00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab5a52640 1 -- 172.21.15.133:0/1907409352 >> v2:172.21.15.142:3300/0 conn(0x7feab00cf880 msgr2=0x7feab00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:33.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab5a52640 1 --2- 172.21.15.133:0/1907409352 >> v2:172.21.15.142:3300/0 conn(0x7feab00cf880 0x7feab00ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab5a52640 1 -- 172.21.15.133:0/1907409352 >> v1:172.21.15.142:6789/0 conn(0x7feab00cde90 legacy=0x7feab00cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab5a52640 1 -- 172.21.15.133:0/1907409352 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00d0af0 con 0x7feab015cae0 2023-12-18T10:21:33.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.003+0000 7feab6253640 1 --2- 172.21.15.133:0/1907409352 >> v2:172.21.15.142:3300/0 conn(0x7feab00cf880 0x7feab00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab5a52640 1 --2- 172.21.15.133:0/1907409352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab015cae0 0x7feab00d12f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7feab008bf80 tx=0x7feaac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1866108947f77eed server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab4a50640 1 -- 172.21.15.133:0/1907409352 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac0ab660 con 0x7feab015cae0 2023-12-18T10:21:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab4a50640 1 -- 172.21.15.133:0/1907409352 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac0ab7c0 con 0x7feab015cae0 2023-12-18T10:21:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab4a50640 1 -- 172.21.15.133:0/1907409352 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac0abb50 con 0x7feab015cae0 2023-12-18T10:21:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab7cb6640 1 -- 172.21.15.133:0/1907409352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab015cae0 msgr2=0x7feab00d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1907409352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab015cae0 0x7feab00d12f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7feab008bf80 tx=0x7feaac01c4d0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab7cb6640 1 -- 172.21.15.133:0/1907409352 shutdown_connections 2023-12-18T10:21:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1907409352 >> v2:172.21.15.142:3300/0 conn(0x7feab00cf880 0x7feab00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1907409352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab015cae0 0x7feab00d12f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab7cb6640 1 -- 172.21.15.133:0/1907409352 >> 172.21.15.133:0/1907409352 conn(0x7feab0089fb0 msgr2=0x7feab00d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:33.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab7cb6640 1 -- 172.21.15.133:0/1907409352 shutdown_connections 2023-12-18T10:21:33.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.007+0000 7feab7cb6640 1 -- 172.21.15.133:0/1907409352 wait complete. 2023-12-18T10:21:33.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 Processor -- start 2023-12-18T10:21:33.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 -- start start 2023-12-18T10:21:33.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab00cde90 0x7feab00b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab00cf880 0x7feab0155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feab015cae0 0x7feab00c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab00b74e0 con 0x7feab00cf880 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab00b68d0 con 0x7feab00cde90 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab00b6bb0 con 0x7feab015cae0 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab00cf880 0x7feab0155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab00cf880 0x7feab0155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43724/0 (socket says 172.21.15.133:43724) 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 -- 172.21.15.133:0/1032669353 learned_addr learned my addr 172.21.15.133:0/1032669353 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5a52640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab00cde90 0x7feab00b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab6253640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feab015cae0 0x7feab00c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 -- 172.21.15.133:0/1032669353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feab015cae0 msgr2=0x7feab00c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feab015cae0 0x7feab00c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 -- 172.21.15.133:0/1032669353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab00cde90 msgr2=0x7feab00b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab00cde90 0x7feab00b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 -- 172.21.15.133:0/1032669353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac009480 con 0x7feab00cf880 2023-12-18T10:21:33.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab5251640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab00cf880 0x7feab0155d10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7feaa000c500 tx=0x7feaa000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:33.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feaa67fc640 1 -- 172.21.15.133:0/1032669353 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0005220 con 0x7feab00cf880 2023-12-18T10:21:33.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feaa67fc640 1 -- 172.21.15.133:0/1032669353 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa0005380 con 0x7feab00cf880 2023-12-18T10:21:33.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feaa67fc640 1 -- 172.21.15.133:0/1032669353 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0007270 con 0x7feab00cf880 2023-12-18T10:21:33.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab00b6e90 con 0x7feab00cf880 2023-12-18T10:21:33.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.011+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab00b7eb0 con 0x7feab00cf880 2023-12-18T10:21:33.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.015+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab00b7650 con 0x7feab00cf880 2023-12-18T10:21:33.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.015+0000 7feaa67fc640 1 -- 172.21.15.133:0/1032669353 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feaa00073d0 con 0x7feab00cf880 2023-12-18T10:21:33.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.015+0000 7feaa67fc640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea94065a60 0x7fea94067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.015+0000 7feaa67fc640 1 -- 172.21.15.133:0/1032669353 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feaa0082b90 con 0x7feab00cf880 2023-12-18T10:21:33.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.015+0000 7feab5a52640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea94065a60 0x7fea94067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.015+0000 7feab5a52640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea94065a60 0x7fea94067f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feaac0af000 tx=0x7feaac0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.019+0000 7feaa67fc640 1 -- 172.21.15.133:0/1032669353 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feaa0050430 con 0x7feab00cf880 2023-12-18T10:21:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feab004e000 con 0x7feab00cf880 2023-12-18T10:21:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feaa67fc640 1 -- 172.21.15.133:0/1032669353 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7feaa0053a50 con 0x7feab00cf880 2023-12-18T10:21:33.174 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:21:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea94065a60 msgr2=0x7fea94067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea94065a60 0x7fea94067f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feaac0af000 tx=0x7feaac0a7000 comp rx=0 tx=0).stop 2023-12-18T10:21:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab00cf880 msgr2=0x7feab0155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab00cf880 0x7feab0155d10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7feaa000c500 tx=0x7feaa000c9c0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 shutdown_connections 2023-12-18T10:21:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fea94065a60 0x7fea94067f20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feab015cae0 0x7feab00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feab00cf880 0x7feab0155d10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 --2- 172.21.15.133:0/1032669353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab00cde90 0x7feab00b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 >> 172.21.15.133:0/1032669353 conn(0x7feab0089fb0 msgr2=0x7feab00d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 shutdown_connections 2023-12-18T10:21:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.171+0000 7feab7cb6640 1 -- 172.21.15.133:0/1032669353 wait complete. 2023-12-18T10:21:33.195 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:21:33.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.331+0000 7fb09fe1f640 1 Processor -- start 2023-12-18T10:21:33.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.331+0000 7fb09fe1f640 1 -- start start 2023-12-18T10:21:33.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09fe1f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb098158c20 0x7fb098070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09fe1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb0980ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09fe1f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb098070b80 con 0x7fb09815c800 2023-12-18T10:21:33.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09fe1f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb098070e60 con 0x7fb098158c20 2023-12-18T10:21:33.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09fe1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb098071140 con 0x7fb0980cb180 2023-12-18T10:21:33.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09dbbb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb098158c20 0x7fb098070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09dbbb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb098158c20 0x7fb098070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43740/0 (socket says 172.21.15.133:43740) 2023-12-18T10:21:33.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09dbbb640 1 -- 172.21.15.133:0/3407838266 learned_addr learned my addr 172.21.15.133:0/3407838266 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:33.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09e3bc640 1 --2- 172.21.15.133:0/3407838266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb0980ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09dbbb640 1 -- 172.21.15.133:0/3407838266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 msgr2=0x7fb0980ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:33.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09dbbb640 1 --2- 172.21.15.133:0/3407838266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb0980ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09dbbb640 1 -- 172.21.15.133:0/3407838266 >> v1:172.21.15.142:6789/0 conn(0x7fb09815c800 legacy=0x7fb0980caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:33.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09dbbb640 1 -- 172.21.15.133:0/3407838266 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098071420 con 0x7fb098158c20 2023-12-18T10:21:33.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.335+0000 7fb09e3bc640 1 --2- 172.21.15.133:0/3407838266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb0980ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09dbbb640 1 --2- 172.21.15.133:0/3407838266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb098158c20 0x7fb098070510 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb094009870 tx=0x7fb09401cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bafad7e66924d4e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09cbb9640 1 -- 172.21.15.133:0/3407838266 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940ab600 con 0x7fb098158c20 2023-12-18T10:21:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09cbb9640 1 -- 172.21.15.133:0/3407838266 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0940a7050 con 0x7fb098158c20 2023-12-18T10:21:33.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09cbb9640 1 -- 172.21.15.133:0/3407838266 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940ab980 con 0x7fb098158c20 2023-12-18T10:21:33.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3407838266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb098158c20 msgr2=0x7fb098070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3407838266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb098158c20 0x7fb098070510 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb094009870 tx=0x7fb09401cea0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3407838266 shutdown_connections 2023-12-18T10:21:33.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3407838266 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb0980ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3407838266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb098158c20 0x7fb098070510 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3407838266 >> 172.21.15.133:0/3407838266 conn(0x7fb09806a3e0 msgr2=0x7fb0980afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:33.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3407838266 shutdown_connections 2023-12-18T10:21:33.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3407838266 wait complete. 2023-12-18T10:21:33.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 Processor -- start 2023-12-18T10:21:33.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.339+0000 7fb09fe1f640 1 -- start start 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb09814c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb098158c20 0x7fb0980c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09815c800 0x7fb098165f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098159680 con 0x7fb09815c800 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098166ed0 con 0x7fb098158c20 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09814e520 con 0x7fb0980cb180 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09815c800 0x7fb098165f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09815c800 0x7fb098165f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43748/0 (socket says 172.21.15.133:43748) 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 -- 172.21.15.133:0/3656471841 learned_addr learned my addr 172.21.15.133:0/3656471841 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09dbbb640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb09814c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09d3ba640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb098158c20 0x7fb0980c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 -- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 msgr2=0x7fb09814c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb09814c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 -- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb098158c20 msgr2=0x7fb0980c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb098158c20 0x7fb0980c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 -- 172.21.15.133:0/3656471841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0940094d0 con 0x7fb09815c800 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09dbbb640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb09814c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09e3bc640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09815c800 0x7fb098165f10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb09000cea0 tx=0x7fb09000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb08e7fc640 1 -- 172.21.15.133:0/3656471841 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090003ba0 con 0x7fb09815c800 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb08e7fc640 1 -- 172.21.15.133:0/3656471841 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb090003d20 con 0x7fb09815c800 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb08e7fc640 1 -- 172.21.15.133:0/3656471841 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09000d880 con 0x7fb09815c800 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0980c8800 con 0x7fb09815c800 2023-12-18T10:21:33.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09814e730 con 0x7fb09815c800 2023-12-18T10:21:33.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0980735b0 con 0x7fb09815c800 2023-12-18T10:21:33.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb08e7fc640 1 -- 172.21.15.133:0/3656471841 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb09000d9e0 con 0x7fb09815c800 2023-12-18T10:21:33.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb08e7fc640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb07c065a60 0x7fb07c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:33.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.343+0000 7fb08e7fc640 1 -- 172.21.15.133:0/3656471841 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb090083c70 con 0x7fb09815c800 2023-12-18T10:21:33.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.347+0000 7fb09dbbb640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb07c065a60 0x7fb07c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:33.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.347+0000 7fb09dbbb640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb07c065a60 0x7fb07c067f20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0940ad000 tx=0x7fb094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:33.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.347+0000 7fb08e7fc640 1 -- 172.21.15.133:0/3656471841 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb090051450 con 0x7fb09815c800 2023-12-18T10:21:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.511+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0980c8600 con 0x7fb09815c800 2023-12-18T10:21:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.511+0000 7fb08e7fc640 1 -- 172.21.15.133:0/3656471841 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb090054a70 con 0x7fb09815c800 2023-12-18T10:21:33.516 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:21:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb07c065a60 msgr2=0x7fb07c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb07c065a60 0x7fb07c067f20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0940ad000 tx=0x7fb094008040 comp rx=0 tx=0).stop 2023-12-18T10:21:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09815c800 msgr2=0x7fb098165f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09815c800 0x7fb098165f10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb09000cea0 tx=0x7fb09000cf90 comp rx=0 tx=0).stop 2023-12-18T10:21:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 shutdown_connections 2023-12-18T10:21:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb07c065a60 0x7fb07c067f20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09815c800 0x7fb098165f10 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb098158c20 0x7fb0980c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 --2- 172.21.15.133:0/3656471841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb0980cb180 0x7fb09814c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 >> 172.21.15.133:0/3656471841 conn(0x7fb09806a3e0 msgr2=0x7fb0980cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 shutdown_connections 2023-12-18T10:21:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:33.515+0000 7fb09fe1f640 1 -- 172.21.15.133:0/3656471841 wait complete. 2023-12-18T10:21:33.536 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:21:33.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:33.537 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-18T10:21:33.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[51805]: fuse finished with error 0 and tester_r 0 2023-12-18T10:21:33.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:21:33.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:33.558 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-18T10:21:33.723 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:21:33.723 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:21:33.733 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:21:33.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:21:33.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:33.734 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-18T10:21:33.782 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-18T10:21:33.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:21:33.783 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:21:33.783 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:21:33.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:21:33.792 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:21:33.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:33.792 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-18T10:21:33.842 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-18T10:21:33.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:21:33.843 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:21:33.843 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:21:33.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:21:33.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:21:33.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:33.853 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-18T10:21:33.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:21:33.903 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-18T10:21:33.903 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:34.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f883d360640 1 Processor -- start 2023-12-18T10:21:34.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f883d360640 1 -- start start 2023-12-18T10:21:34.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f883d360640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f883806ca30 0x7f883815e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f883d360640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 0x7f88380d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f883d360640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8838160620 con 0x7f88380cdfd0 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f883d360640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883806c0d0 con 0x7f883806ca30 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f883d360640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8838160870 con 0x7f883806bc50 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f88367fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f883806ca30 0x7f883815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f88367fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f883806ca30 0x7f883815e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43756/0 (socket says 172.21.15.133:43756) 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f88367fc640 1 -- 172.21.15.133:0/3834400396 learned_addr learned my addr 172.21.15.133:0/3834400396 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f88377fe640 1 --2- 172.21.15.133:0/3834400396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 0x7f88380d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f88367fc640 1 -- 172.21.15.133:0/3834400396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 msgr2=0x7f88380d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f88367fc640 1 --2- 172.21.15.133:0/3834400396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 0x7f88380d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f88367fc640 1 -- 172.21.15.133:0/3834400396 >> v1:172.21.15.133:6789/0 conn(0x7f88380cdfd0 legacy=0x7f88380ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.039+0000 7f88367fc640 1 -- 172.21.15.133:0/3834400396 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838160b50 con 0x7f883806ca30 2023-12-18T10:21:34.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f88367fc640 1 --2- 172.21.15.133:0/3834400396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f883815e140 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f882c009870 tx=0x7f882c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4da4543588d0b3f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f8835ffb640 1 -- 172.21.15.133:0/3834400396 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab650 con 0x7f883806ca30 2023-12-18T10:21:34.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f8835ffb640 1 -- 172.21.15.133:0/3834400396 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c0ab7b0 con 0x7f883806ca30 2023-12-18T10:21:34.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f8835ffb640 1 -- 172.21.15.133:0/3834400396 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0abb40 con 0x7f883806ca30 2023-12-18T10:21:34.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 -- 172.21.15.133:0/3834400396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 msgr2=0x7f883815e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 --2- 172.21.15.133:0/3834400396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f883815e140 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f882c009870 tx=0x7f882c01c540 comp rx=0 tx=0).stop 2023-12-18T10:21:34.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 -- 172.21.15.133:0/3834400396 shutdown_connections 2023-12-18T10:21:34.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 --2- 172.21.15.133:0/3834400396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 0x7f88380d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 --2- 172.21.15.133:0/3834400396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f883815e140 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 -- 172.21.15.133:0/3834400396 >> 172.21.15.133:0/3834400396 conn(0x7f8838069ca0 msgr2=0x7f883806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:34.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 -- 172.21.15.133:0/3834400396 shutdown_connections 2023-12-18T10:21:34.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 -- 172.21.15.133:0/3834400396 wait complete. 2023-12-18T10:21:34.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.043+0000 7f883d360640 1 Processor -- start 2023-12-18T10:21:34.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 -- start start 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 0x7f88381523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f88380b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88380cdfd0 0x7f883815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8838158f20 con 0x7f883806ca30 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88380b4e30 con 0x7f88380cdfd0 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88380b5110 con 0x7f883806bc50 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f88380b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f88380b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43758/0 (socket says 172.21.15.133:43758) 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 -- 172.21.15.133:0/285899552 learned_addr learned my addr 172.21.15.133:0/285899552 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f8836ffd640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 0x7f88381523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88377fe640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88380cdfd0 0x7f883815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 -- 172.21.15.133:0/285899552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 msgr2=0x7f88381523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 0x7f88381523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 -- 172.21.15.133:0/285899552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88380cdfd0 msgr2=0x7f883815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88380cdfd0 0x7f883815ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 -- 172.21.15.133:0/285899552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0094d0 con 0x7f883806ca30 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f88367fc640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f88380b4600 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f882c01a170 tx=0x7f882c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f881f7fe640 1 -- 172.21.15.133:0/285899552 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0b4800 con 0x7f883806ca30 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f881f7fe640 1 -- 172.21.15.133:0/285899552 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c0b4980 con 0x7f883806ca30 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f881f7fe640 1 -- 172.21.15.133:0/285899552 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0b4d30 con 0x7f883806ca30 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88380b53f0 con 0x7f883806ca30 2023-12-18T10:21:34.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88380b59b0 con 0x7f883806ca30 2023-12-18T10:21:34.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.047+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88380b5ba0 con 0x7f883806ca30 2023-12-18T10:21:34.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.051+0000 7f881f7fe640 1 -- 172.21.15.133:0/285899552 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f882c0b3380 con 0x7f883806ca30 2023-12-18T10:21:34.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.051+0000 7f881f7fe640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8824065a60 0x7f8824067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.051+0000 7f881f7fe640 1 -- 172.21.15.133:0/285899552 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f882c11d950 con 0x7f883806ca30 2023-12-18T10:21:34.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.051+0000 7f8836ffd640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8824065a60 0x7f8824067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.051+0000 7f8836ffd640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8824065a60 0x7f8824067f20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8828007fd0 tx=0x7f8828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.055+0000 7f881f7fe640 1 -- 172.21.15.133:0/285899552 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f882c0eb390 con 0x7f883806ca30 2023-12-18T10:21:34.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f883804e000 con 0x7f883806ca30 2023-12-18T10:21:34.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f881f7fe640 1 -- 172.21.15.133:0/285899552 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4758 (secure 0 0 0) 0x7f882c0c4090 con 0x7f883806ca30 2023-12-18T10:21:34.239 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:34.239 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:21:22.973560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6165,"mds_1":6162,"mds_2":5875},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5875":{"gid":5875,"name":"d","rank":2,"incarnation":36,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6162":{"gid":6162,"name":"a","rank":1,"incarnation":34,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:21:34.240 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 42 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8824065a60 msgr2=0x7f8824067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8824065a60 0x7f8824067f20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8828007fd0 tx=0x7f8828009040 comp rx=0 tx=0).stop 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 msgr2=0x7f88380b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f88380b4600 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f882c01a170 tx=0x7f882c01ad80 comp rx=0 tx=0).stop 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 shutdown_connections 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8824065a60 0x7f8824067f20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88380cdfd0 0x7f883815ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f883806ca30 0x7f88380b4600 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 --2- 172.21.15.133:0/285899552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f883806bc50 0x7f88381523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.235+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 >> 172.21.15.133:0/285899552 conn(0x7f8838069ca0 msgr2=0x7f88380afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.239+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 shutdown_connections 2023-12-18T10:21:34.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.239+0000 7f883d360640 1 -- 172.21.15.133:0/285899552 wait complete. 2023-12-18T10:21:34.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:21:34.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ffb925640 1 Processor -- start 2023-12-18T10:21:34.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ffb925640 1 -- start start 2023-12-18T10:21:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ffb925640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ff40ca000 0x7f5ff4164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ffb925640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40c9460 con 0x7f5ff41570c0 2023-12-18T10:21:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ffb925640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff41574a0 con 0x7f5ff406c4f0 2023-12-18T10:21:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ffb925640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff40c8b30 con 0x7f5ff40ca000 2023-12-18T10:21:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff96c1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5ff41570c0 0x7f5ff406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60624/0 (socket says 172.21.15.133:60624) 2023-12-18T10:21:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff96c1640 1 -- 172.21.15.133:0/2458131729 learned_addr learned my addr 172.21.15.133:0/2458131729 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff9ec2640 1 --2- 172.21.15.133:0/2458131729 >> v2:172.21.15.142:3300/0 conn(0x7f5ff40ca000 0x7f5ff4164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217410707 0 0) 0x7f5ff40c9460 con 0x7f5ff41570c0 2023-12-18T10:21:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe0003530 con 0x7f5ff41570c0 2023-12-18T10:21:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3361943777 0 0) 0x7f5fe0003530 con 0x7f5ff41570c0 2023-12-18T10:21:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 >> v2:172.21.15.142:3300/0 conn(0x7f5ff40ca000 msgr2=0x7f5ff4164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 --2- 172.21.15.133:0/2458131729 >> v2:172.21.15.142:3300/0 conn(0x7f5ff40ca000 0x7f5ff4164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 >> v1:172.21.15.142:6789/0 conn(0x7f5ff406c4f0 legacy=0x7f5ff40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40c8e10 con 0x7f5ff41570c0 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f5ff0001680 con 0x7f5ff41570c0 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 >> v1:172.21.15.133:6789/0 conn(0x7f5ff41570c0 legacy=0x7f5ff406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fe0003980 0x7f5fe0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe00047d0 0x7f5fe0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe0005190 0x7f5fe000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40c8b30 con 0x7f5fe00047d0 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe000c130 con 0x7f5fe0005190 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe000e500 con 0x7f5fe0003980 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff8ec0640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe00047d0 0x7f5fe0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff96c1640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fe0003980 0x7f5fe0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff9ec2640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe0005190 0x7f5fe000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff8ec0640 1 -- 172.21.15.133:0/2458131729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fe0003980 msgr2=0x7f5fe0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:34.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff8ec0640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fe0003980 0x7f5fe0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff8ec0640 1 -- 172.21.15.133:0/2458131729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe0005190 msgr2=0x7f5fe000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:34.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff8ec0640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe0005190 0x7f5fe000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff8ec0640 1 -- 172.21.15.133:0/2458131729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0003530 con 0x7f5fe00047d0 2023-12-18T10:21:34.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.395+0000 7f5ff9ec2640 1 -- 172.21.15.133:0/2458131729 reap_dead start 2023-12-18T10:21:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5ff8ec0640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe00047d0 0x7f5fe0004c50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4001780 tx=0x7f5fe401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0de51a4640e9042 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40052d0 con 0x7f5fe00047d0 2023-12-18T10:21:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe4005450 con 0x7f5fe00047d0 2023-12-18T10:21:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5febfff640 1 -- 172.21.15.133:0/2458131729 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4003840 con 0x7f5fe00047d0 2023-12-18T10:21:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5ffb925640 1 -- 172.21.15.133:0/2458131729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe00047d0 msgr2=0x7f5fe0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5ffb925640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe00047d0 0x7f5fe0004c50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4001780 tx=0x7f5fe401c3b0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5ffb925640 1 -- 172.21.15.133:0/2458131729 shutdown_connections 2023-12-18T10:21:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5ffb925640 1 --2- 172.21.15.133:0/2458131729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe00047d0 0x7f5fe0004c50 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5ffb925640 1 -- 172.21.15.133:0/2458131729 >> 172.21.15.133:0/2458131729 conn(0x7f5ff406a3e0 msgr2=0x7f5ff40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5ffb925640 1 -- 172.21.15.133:0/2458131729 shutdown_connections 2023-12-18T10:21:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.399+0000 7f5ffb925640 1 -- 172.21.15.133:0/2458131729 wait complete. 2023-12-18T10:21:34.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 Processor -- start 2023-12-18T10:21:34.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 -- start start 2023-12-18T10:21:34.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe00047d0 0x7f5ff414e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40ce900 0x7f5ff40c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff41e4f20 0x7f5ff41e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff41e5910 con 0x7f5ff40ce900 2023-12-18T10:21:34.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40cade0 con 0x7f5fe00047d0 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40c7950 con 0x7f5ff41e4f20 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40ce900 0x7f5ff40c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40ce900 0x7f5ff40c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43772/0 (socket says 172.21.15.133:43772) 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 -- 172.21.15.133:0/3768402738 learned_addr learned my addr 172.21.15.133:0/3768402738 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff96c1640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe00047d0 0x7f5ff414e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff9ec2640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff41e4f20 0x7f5ff41e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 -- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff41e4f20 msgr2=0x7f5ff41e53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff41e4f20 0x7f5ff41e53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 -- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe00047d0 msgr2=0x7f5ff414e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe00047d0 0x7f5ff414e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 -- 172.21.15.133:0/3768402738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40cb030 con 0x7f5ff40ce900 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff9ec2640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff41e4f20 0x7f5ff41e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:34.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ff8ec0640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40ce900 0x7f5ff40c7120 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5fe401c1e0 tx=0x7f5fe0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5fe9ffb640 1 -- 172.21.15.133:0/3768402738 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4007250 con 0x7f5ff40ce900 2023-12-18T10:21:34.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5fe9ffb640 1 -- 172.21.15.133:0/3768402738 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe40073b0 con 0x7f5ff40ce900 2023-12-18T10:21:34.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5fe9ffb640 1 -- 172.21.15.133:0/3768402738 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40067e0 con 0x7f5ff40ce900 2023-12-18T10:21:34.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.403+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff40cb310 con 0x7f5ff40ce900 2023-12-18T10:21:34.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.407+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff414e970 con 0x7f5ff40ce900 2023-12-18T10:21:34.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.407+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff40735b0 con 0x7f5ff40ce900 2023-12-18T10:21:34.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.407+0000 7f5fe9ffb640 1 -- 172.21.15.133:0/3768402738 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5fe4006940 con 0x7f5ff40ce900 2023-12-18T10:21:34.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.407+0000 7f5fe9ffb640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fd8065a90 0x7f5fd8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.407+0000 7f5fe9ffb640 1 -- 172.21.15.133:0/3768402738 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5fe411c950 con 0x7f5ff40ce900 2023-12-18T10:21:34.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.407+0000 7f5ff96c1640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fd8065a90 0x7f5fd8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.407+0000 7f5ff96c1640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fd8065a90 0x7f5fd8067f50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4072590 tx=0x7f5ff0000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.411+0000 7f5fe9ffb640 1 -- 172.21.15.133:0/3768402738 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5fe40ea270 con 0x7f5ff40ce900 2023-12-18T10:21:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.563+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ff404e000 con 0x7f5ff40ce900 2023-12-18T10:21:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.563+0000 7f5fe9ffb640 1 -- 172.21.15.133:0/3768402738 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16354 (secure 0 0 0) 0x7f5fe40ed890 con 0x7f5ff40ce900 2023-12-18T10:21:34.569 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:34.569 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:20:45.524788+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:20:42.874010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-18T10:20:43.517857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:21:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fd8065a90 msgr2=0x7f5fd8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fd8065a90 0x7f5fd8067f50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4072590 tx=0x7f5ff0000bd0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40ce900 msgr2=0x7f5ff40c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40ce900 0x7f5ff40c7120 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f5fe401c1e0 tx=0x7f5fe0005800 comp rx=0 tx=0).stop 2023-12-18T10:21:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 shutdown_connections 2023-12-18T10:21:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fd8065a90 0x7f5fd8067f50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff41e4f20 0x7f5ff41e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff40ce900 0x7f5ff40c7120 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 --2- 172.21.15.133:0/3768402738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fe00047d0 0x7f5ff414e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 >> 172.21.15.133:0/3768402738 conn(0x7f5ff406a3e0 msgr2=0x7f5ff41576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 shutdown_connections 2023-12-18T10:21:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.567+0000 7f5ffb925640 1 -- 172.21.15.133:0/3768402738 wait complete. 2023-12-18T10:21:34.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:20:42.874010+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:20:43.517857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:21:34.591 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:21:34.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f10825e9640 1 Processor -- start 2023-12-18T10:21:34.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f10825e9640 1 -- start start 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f10825e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f10825e9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f10825e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107c0c9390 con 0x7f107c0ce3b0 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f10825e9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c15aee0 con 0x7f107c070820 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f10825e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c15b1c0 con 0x7f107c1582d0 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f107b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f107b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43784/0 (socket says 172.21.15.133:43784) 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f107b7fe640 1 -- 172.21.15.133:0/1886244383 learned_addr learned my addr 172.21.15.133:0/1886244383 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.727+0000 7f107bfff640 1 --2- 172.21.15.133:0/1886244383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f107b7fe640 1 -- 172.21.15.133:0/1886244383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 msgr2=0x7f107c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:34.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f107b7fe640 1 --2- 172.21.15.133:0/1886244383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f107b7fe640 1 -- 172.21.15.133:0/1886244383 >> v1:172.21.15.142:6789/0 conn(0x7f107c0ce3b0 legacy=0x7f107c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f107b7fe640 1 -- 172.21.15.133:0/1886244383 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c15b4a0 con 0x7f107c070820 2023-12-18T10:21:34.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f107b7fe640 1 --2- 172.21.15.133:0/1886244383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c070820 0x7f107c0ca5f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1070009870 tx=0x7f107001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c490e6f0f829ffe server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f107affd640 1 -- 172.21.15.133:0/1886244383 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700a95f0 con 0x7f107c070820 2023-12-18T10:21:34.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f107affd640 1 -- 172.21.15.133:0/1886244383 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10700a9750 con 0x7f107c070820 2023-12-18T10:21:34.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f107affd640 1 -- 172.21.15.133:0/1886244383 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700a9ae0 con 0x7f107c070820 2023-12-18T10:21:34.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f10825e9640 1 -- 172.21.15.133:0/1886244383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c070820 msgr2=0x7f107c0ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f10825e9640 1 --2- 172.21.15.133:0/1886244383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c070820 0x7f107c0ca5f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1070009870 tx=0x7f107001c510 comp rx=0 tx=0).stop 2023-12-18T10:21:34.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f10825e9640 1 -- 172.21.15.133:0/1886244383 shutdown_connections 2023-12-18T10:21:34.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f10825e9640 1 --2- 172.21.15.133:0/1886244383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c070820 0x7f107c0ca5f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f10825e9640 1 --2- 172.21.15.133:0/1886244383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 0x7f107c0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.731+0000 7f10825e9640 1 -- 172.21.15.133:0/1886244383 >> 172.21.15.133:0/1886244383 conn(0x7f107c06a2a0 msgr2=0x7f107c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:34.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 -- 172.21.15.133:0/1886244383 shutdown_connections 2023-12-18T10:21:34.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 -- 172.21.15.133:0/1886244383 wait complete. 2023-12-18T10:21:34.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 Processor -- start 2023-12-18T10:21:34.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 -- start start 2023-12-18T10:21:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f107c070820 0x7f107c151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c0ce3b0 0x7f107c153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 0x7f107c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c152b80 con 0x7f107c0ce3b0 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c152e60 con 0x7f107c070820 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f10825e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c153140 con 0x7f107c1582d0 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c0ce3b0 0x7f107c153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c0ce3b0 0x7f107c153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43798/0 (socket says 172.21.15.133:43798) 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 -- 172.21.15.133:0/1000833479 learned_addr learned my addr 172.21.15.133:0/1000833479 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107bfff640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f107c070820 0x7f107c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f1080b86640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 0x7f107c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 -- 172.21.15.133:0/1000833479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 msgr2=0x7f107c152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 0x7f107c152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 -- 172.21.15.133:0/1000833479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f107c070820 msgr2=0x7f107c151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f107c070820 0x7f107c151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 -- 172.21.15.133:0/1000833479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700094d0 con 0x7f107c0ce3b0 2023-12-18T10:21:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f107b7fe640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c0ce3b0 0x7f107c153c20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f10700ab040 tx=0x7f107001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.735+0000 7f1078ff9640 1 -- 172.21.15.133:0/1000833479 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700b1800 con 0x7f107c0ce3b0 2023-12-18T10:21:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f1078ff9640 1 -- 172.21.15.133:0/1000833479 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10700b1980 con 0x7f107c0ce3b0 2023-12-18T10:21:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f1078ff9640 1 -- 172.21.15.133:0/1000833479 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700b1d30 con 0x7f107c0ce3b0 2023-12-18T10:21:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c153420 con 0x7f107c0ce3b0 2023-12-18T10:21:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c151e70 con 0x7f107c0ce3b0 2023-12-18T10:21:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c153940 con 0x7f107c0ce3b0 2023-12-18T10:21:34.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f1078ff9640 1 -- 172.21.15.133:0/1000833479 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f10700bc450 con 0x7f107c0ce3b0 2023-12-18T10:21:34.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f1078ff9640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1068065a60 0x7f1068067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:34.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f1078ff9640 1 -- 172.21.15.133:0/1000833479 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f107011dbb0 con 0x7f107c0ce3b0 2023-12-18T10:21:34.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f107bfff640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1068065a60 0x7f1068067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:34.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.739+0000 7f107bfff640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1068065a60 0x7f1068067f20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f106c009ac0 tx=0x7f106c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:34.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.743+0000 7f1078ff9640 1 -- 172.21.15.133:0/1000833479 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f107c153940 con 0x7f107c0ce3b0 2023-12-18T10:21:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.891+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f107c153940 con 0x7f107c0ce3b0 2023-12-18T10:21:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.891+0000 7f1078ff9640 1 -- 172.21.15.133:0/1000833479 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f107c153940 con 0x7f107c0ce3b0 2023-12-18T10:21:34.898 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1068065a60 msgr2=0x7f1068067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1068065a60 0x7f1068067f20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f106c009ac0 tx=0x7f106c009190 comp rx=0 tx=0).stop 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c0ce3b0 msgr2=0x7f107c153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c0ce3b0 0x7f107c153c20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f10700ab040 tx=0x7f107001ad50 comp rx=0 tx=0).stop 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 shutdown_connections 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1068065a60 0x7f1068067f20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f107c1582d0 0x7f107c152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f107c0ce3b0 0x7f107c153c20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 --2- 172.21.15.133:0/1000833479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f107c070820 0x7f107c151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 >> 172.21.15.133:0/1000833479 conn(0x7f107c06a2a0 msgr2=0x7f107c1649d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 shutdown_connections 2023-12-18T10:21:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:34.895+0000 7f10825e9640 1 -- 172.21.15.133:0/1000833479 wait complete. 2023-12-18T10:21:34.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:21:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.055+0000 7fe2d8796640 1 Processor -- start 2023-12-18T10:21:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d8796640 1 -- start start 2023-12-18T10:21:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d8796640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2d015cae0 0x7fe2d00d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d8796640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cf880 0x7fe2d00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d8796640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d015cec0 con 0x7fe2d00cde90 2023-12-18T10:21:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d8796640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d00d0530 con 0x7fe2d015cae0 2023-12-18T10:21:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d8796640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00d0810 con 0x7fe2d00cf880 2023-12-18T10:21:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d6532640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2d015cae0 0x7fe2d00d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d6d33640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cf880 0x7fe2d00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d5d31640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe2d00cde90 0x7fe2d00cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:35592/0 (socket says 172.21.15.133:35592) 2023-12-18T10:21:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d5d31640 1 -- 172.21.15.133:0/758469917 learned_addr learned my addr 172.21.15.133:0/758469917 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d6532640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe2d015cae0 0x7fe2d00d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:40554/0 (socket says 172.21.15.133:40554) 2023-12-18T10:21:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d5530640 1 -- 172.21.15.133:0/758469917 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319541041 0 0) 0x7fe2d015cec0 con 0x7fe2d00cde90 2023-12-18T10:21:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d5530640 1 -- 172.21.15.133:0/758469917 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2bc003530 con 0x7fe2d00cde90 2023-12-18T10:21:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d6532640 1 -- 172.21.15.133:0/758469917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cf880 msgr2=0x7fe2d00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d6532640 1 --2- 172.21.15.133:0/758469917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cf880 0x7fe2d00ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d6532640 1 -- 172.21.15.133:0/758469917 >> v1:172.21.15.142:6789/0 conn(0x7fe2d00cde90 legacy=0x7fe2d00cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d6532640 1 -- 172.21.15.133:0/758469917 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00d0af0 con 0x7fe2d015cae0 2023-12-18T10:21:35.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.059+0000 7fe2d6d33640 1 --2- 172.21.15.133:0/758469917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cf880 0x7fe2d00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d6532640 1 --2- 172.21.15.133:0/758469917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 0x7fe2d00d12f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0097a0 tx=0x7fe2cc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d237f7f36828fe7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d5530640 1 -- 172.21.15.133:0/758469917 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0ac620 con 0x7fe2d015cae0 2023-12-18T10:21:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d5530640 1 -- 172.21.15.133:0/758469917 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0ac780 con 0x7fe2d015cae0 2023-12-18T10:21:35.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d5530640 1 -- 172.21.15.133:0/758469917 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0acb10 con 0x7fe2d015cae0 2023-12-18T10:21:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d8796640 1 -- 172.21.15.133:0/758469917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 msgr2=0x7fe2d00d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d8796640 1 --2- 172.21.15.133:0/758469917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 0x7fe2d00d12f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0097a0 tx=0x7fe2cc01c430 comp rx=0 tx=0).stop 2023-12-18T10:21:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d8796640 1 -- 172.21.15.133:0/758469917 shutdown_connections 2023-12-18T10:21:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d8796640 1 --2- 172.21.15.133:0/758469917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cf880 0x7fe2d00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d8796640 1 --2- 172.21.15.133:0/758469917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 0x7fe2d00d12f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d8796640 1 -- 172.21.15.133:0/758469917 >> 172.21.15.133:0/758469917 conn(0x7fe2d0089fb0 msgr2=0x7fe2d00d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:35.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d8796640 1 -- 172.21.15.133:0/758469917 shutdown_connections 2023-12-18T10:21:35.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.063+0000 7fe2d8796640 1 -- 172.21.15.133:0/758469917 wait complete. 2023-12-18T10:21:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 Processor -- start 2023-12-18T10:21:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 -- start start 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cde90 0x7fe2d01576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d00cf880 0x7fe2d0155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 0x7fe2d00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00cc870 con 0x7fe2d00cf880 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0157c30 con 0x7fe2d015cae0 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00c9d30 con 0x7fe2d00cde90 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d00cf880 0x7fe2d0155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d00cf880 0x7fe2d0155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43806/0 (socket says 172.21.15.133:43806) 2023-12-18T10:21:35.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 -- 172.21.15.133:0/3881705650 learned_addr learned my addr 172.21.15.133:0/3881705650 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d6d33640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 0x7fe2d00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d6532640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cde90 0x7fe2d01576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 -- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cde90 msgr2=0x7fe2d01576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cde90 0x7fe2d01576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 -- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 msgr2=0x7fe2d00cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 0x7fe2d00cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 -- 172.21.15.133:0/3881705650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8009a70 con 0x7fe2d00cf880 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d6532640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cde90 0x7fe2d01576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d5d31640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d00cf880 0x7fe2d0155ae0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c4d0 tx=0x7fe2c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2c6ffd640 1 -- 172.21.15.133:0/3881705650 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0005cf0 con 0x7fe2d00cf880 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2c6ffd640 1 -- 172.21.15.133:0/3881705650 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0005e50 con 0x7fe2d00cf880 2023-12-18T10:21:35.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2c6ffd640 1 -- 172.21.15.133:0/3881705650 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0007270 con 0x7fe2d00cf880 2023-12-18T10:21:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc0093b0 con 0x7fe2d00cf880 2023-12-18T10:21:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d01571d0 con 0x7fe2d00cf880 2023-12-18T10:21:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.067+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d00ced40 con 0x7fe2d00cf880 2023-12-18T10:21:35.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.071+0000 7fe2c6ffd640 1 -- 172.21.15.133:0/3881705650 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe2c00073d0 con 0x7fe2d00cf880 2023-12-18T10:21:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.071+0000 7fe2c6ffd640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2b4065a60 0x7fe2b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.071+0000 7fe2c6ffd640 1 -- 172.21.15.133:0/3881705650 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe2c0082ce0 con 0x7fe2d00cf880 2023-12-18T10:21:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.071+0000 7fe2d6532640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2b4065a60 0x7fe2b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.071+0000 7fe2d6532640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2b4065a60 0x7fe2b4067f20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0ae000 tx=0x7fe2cc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.075+0000 7fe2c6ffd640 1 -- 172.21.15.133:0/3881705650 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe2c00505f0 con 0x7fe2d00cf880 2023-12-18T10:21:35.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.227+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2d01573c0 con 0x7fe2d00cf880 2023-12-18T10:21:35.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.227+0000 7fe2c6ffd640 1 -- 172.21.15.133:0/3881705650 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2c0053c10 con 0x7fe2d00cf880 2023-12-18T10:21:35.233 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:21:35.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2b4065a60 msgr2=0x7fe2b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2b4065a60 0x7fe2b4067f20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0ae000 tx=0x7fe2cc0a7000 comp rx=0 tx=0).stop 2023-12-18T10:21:35.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d00cf880 msgr2=0x7fe2d0155ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d00cf880 0x7fe2d0155ae0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c4d0 tx=0x7fe2c000c990 comp rx=0 tx=0).stop 2023-12-18T10:21:35.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 shutdown_connections 2023-12-18T10:21:35.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2b4065a60 0x7fe2b4067f20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2d015cae0 0x7fe2d00cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2d00cf880 0x7fe2d0155ae0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 --2- 172.21.15.133:0/3881705650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2d00cde90 0x7fe2d01576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 >> 172.21.15.133:0/3881705650 conn(0x7fe2d0089fb0 msgr2=0x7fe2d0158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:35.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 shutdown_connections 2023-12-18T10:21:35.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.231+0000 7fe2d8796640 1 -- 172.21.15.133:0/3881705650 wait complete. 2023-12-18T10:21:35.254 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:21:35.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7db02d640 1 Processor -- start 2023-12-18T10:21:35.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7db02d640 1 -- start start 2023-12-18T10:21:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7db02d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7db02d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d4070df0 con 0x7fb7d40cbff0 2023-12-18T10:21:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7db02d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d415a4f0 con 0x7fb7d4159fb0 2023-12-18T10:21:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7db02d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d415aab0 con 0x7fb7d40ca410 2023-12-18T10:21:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7d95ca640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb7d40cbff0 0x7fb7d40ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60632/0 (socket says 172.21.15.133:60632) 2023-12-18T10:21:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7d95ca640 1 -- 172.21.15.133:0/213668204 learned_addr learned my addr 172.21.15.133:0/213668204 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.391+0000 7fb7d8dc9640 1 --2- 172.21.15.133:0/213668204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d37fe640 1 -- 172.21.15.133:0/213668204 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425626462 0 0) 0x7fb7d4070df0 con 0x7fb7d40cbff0 2023-12-18T10:21:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d37fe640 1 -- 172.21.15.133:0/213668204 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c4003530 con 0x7fb7d40cbff0 2023-12-18T10:21:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d37fe640 1 -- 172.21.15.133:0/213668204 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730397895 0 0) 0x7fb7d415a4f0 con 0x7fb7d4159fb0 2023-12-18T10:21:35.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d37fe640 1 -- 172.21.15.133:0/213668204 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d4070df0 con 0x7fb7d4159fb0 2023-12-18T10:21:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d8dc9640 1 -- 172.21.15.133:0/213668204 >> v1:172.21.15.142:6789/0 conn(0x7fb7d4159fb0 legacy=0x7fb7d4071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d37fe640 1 -- 172.21.15.133:0/213668204 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2544248643 0 0) 0x7fb7c4003530 con 0x7fb7d40cbff0 2023-12-18T10:21:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d8dc9640 1 -- 172.21.15.133:0/213668204 >> v1:172.21.15.133:6789/0 conn(0x7fb7d40cbff0 legacy=0x7fb7d40ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d8dc9640 1 -- 172.21.15.133:0/213668204 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d415a7d0 con 0x7fb7d40ca410 2023-12-18T10:21:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d8dc9640 1 --2- 172.21.15.133:0/213668204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d4159a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80097f0 tx=0x7fb7c801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41b23cecb2b3ebd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d37fe640 1 -- 172.21.15.133:0/213668204 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc001a00 con 0x7fb7d40ca410 2023-12-18T10:21:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d37fe640 1 -- 172.21.15.133:0/213668204 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c80a7050 con 0x7fb7d40ca410 2023-12-18T10:21:35.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.395+0000 7fb7d37fe640 1 -- 172.21.15.133:0/213668204 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c80ab600 con 0x7fb7d40ca410 2023-12-18T10:21:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- 172.21.15.133:0/213668204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 msgr2=0x7fb7d4159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 --2- 172.21.15.133:0/213668204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d4159a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80097f0 tx=0x7fb7c801c3b0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- 172.21.15.133:0/213668204 shutdown_connections 2023-12-18T10:21:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 --2- 172.21.15.133:0/213668204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d4159a70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- 172.21.15.133:0/213668204 >> 172.21.15.133:0/213668204 conn(0x7fb7d406a2a0 msgr2=0x7fb7d40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- 172.21.15.133:0/213668204 shutdown_connections 2023-12-18T10:21:35.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- 172.21.15.133:0/213668204 wait complete. 2023-12-18T10:21:35.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 Processor -- start 2023-12-18T10:21:35.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- start start 2023-12-18T10:21:35.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d40c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7d40cbff0 0x7fb7d41507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7d4159fb0 0x7fb7d41520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4151c40 con 0x7fb7d4159fb0 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4151070 con 0x7fb7d40cbff0 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7db02d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4151310 con 0x7fb7d40ca410 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7d95ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7d4159fb0 0x7fb7d41520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7d95ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7d4159fb0 0x7fb7d41520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43820/0 (socket says 172.21.15.133:43820) 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.399+0000 7fb7d95ca640 1 -- 172.21.15.133:0/1272646394 learned_addr learned my addr 172.21.15.133:0/1272646394 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d3fff640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7d40cbff0 0x7fb7d41507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d8dc9640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d40c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d95ca640 1 -- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 msgr2=0x7fb7d40c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d95ca640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d40c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d95ca640 1 -- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7d40cbff0 msgr2=0x7fb7d41507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d95ca640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7d40cbff0 0x7fb7d41507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d95ca640 1 -- 172.21.15.133:0/1272646394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8009420 con 0x7fb7d4159fb0 2023-12-18T10:21:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d8dc9640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d40c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d3fff640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7d40cbff0 0x7fb7d41507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d95ca640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7d4159fb0 0x7fb7d41520d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc001f90 tx=0x7fb7cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d17fa640 1 -- 172.21.15.133:0/1272646394 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc012400 con 0x7fb7d4159fb0 2023-12-18T10:21:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d17fa640 1 -- 172.21.15.133:0/1272646394 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc012560 con 0x7fb7d4159fb0 2023-12-18T10:21:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d41515f0 con 0x7fb7d4159fb0 2023-12-18T10:21:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d17fa640 1 -- 172.21.15.133:0/1272646394 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc012930 con 0x7fb7d4159fb0 2023-12-18T10:21:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d40c3200 con 0x7fb7d4159fb0 2023-12-18T10:21:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d4151db0 con 0x7fb7d4159fb0 2023-12-18T10:21:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d17fa640 1 -- 172.21.15.133:0/1272646394 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb7cc012a90 con 0x7fb7d4159fb0 2023-12-18T10:21:35.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d17fa640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb7b8065a60 0x7fb7b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.403+0000 7fb7d17fa640 1 -- 172.21.15.133:0/1272646394 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb7cc083bc0 con 0x7fb7d4159fb0 2023-12-18T10:21:35.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.407+0000 7fb7d8dc9640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb7b8065a60 0x7fb7b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.407+0000 7fb7d8dc9640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb7b8065a60 0x7fb7b8067f20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80ad000 tx=0x7fb7c80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.407+0000 7fb7d17fa640 1 -- 172.21.15.133:0/1272646394 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb7cc051430 con 0x7fb7d4159fb0 2023-12-18T10:21:35.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.555+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7d404e000 con 0x7fb7d4159fb0 2023-12-18T10:21:35.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7d17fa640 1 -- 172.21.15.133:0/1272646394 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7cc054a50 con 0x7fb7d4159fb0 2023-12-18T10:21:35.562 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb7b8065a60 msgr2=0x7fb7b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb7b8065a60 0x7fb7b8067f20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80ad000 tx=0x7fb7c80a6000 comp rx=0 tx=0).stop 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7d4159fb0 msgr2=0x7fb7d41520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7d4159fb0 0x7fb7d41520d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc001f90 tx=0x7fb7cc00a430 comp rx=0 tx=0).stop 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 shutdown_connections 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb7b8065a60 0x7fb7b8067f20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7d4159fb0 0x7fb7d41520d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7d40cbff0 0x7fb7d41507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 --2- 172.21.15.133:0/1272646394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7d40ca410 0x7fb7d40c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 >> 172.21.15.133:0/1272646394 conn(0x7fb7d406a2a0 msgr2=0x7fb7d4153350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 shutdown_connections 2023-12-18T10:21:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.559+0000 7fb7db02d640 1 -- 172.21.15.133:0/1272646394 wait complete. 2023-12-18T10:21:35.583 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:35.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.715+0000 7f0e91c2d640 1 Processor -- start 2023-12-18T10:21:35.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.715+0000 7f0e91c2d640 1 -- start start 2023-12-18T10:21:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e91c2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e91c2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e8c0cd730 0x7f0e8c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e91c2d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8c0d1320 con 0x7f0e8c157080 2023-12-18T10:21:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e91c2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8c157460 con 0x7f0e8c0cd730 2023-12-18T10:21:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e91c2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0cc970 con 0x7f0e8c0ce920 2023-12-18T10:21:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0e8c157080 0x7f0e8c0ce210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60646/0 (socket says 172.21.15.133:60646) 2023-12-18T10:21:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8b7fe640 1 -- 172.21.15.133:0/496695664 learned_addr learned my addr 172.21.15.133:0/496695664 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8affd640 1 --2- 172.21.15.133:0/496695664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8bfff640 1 --2- 172.21.15.133:0/496695664 >> v2:172.21.15.142:3300/0 conn(0x7f0e8c0cd730 0x7f0e8c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8a7fc640 1 -- 172.21.15.133:0/496695664 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778255814 0 0) 0x7f0e8c0d1320 con 0x7f0e8c157080 2023-12-18T10:21:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8a7fc640 1 -- 172.21.15.133:0/496695664 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e74003530 con 0x7f0e8c157080 2023-12-18T10:21:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8affd640 1 -- 172.21.15.133:0/496695664 >> v2:172.21.15.142:3300/0 conn(0x7f0e8c0cd730 msgr2=0x7f0e8c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8affd640 1 --2- 172.21.15.133:0/496695664 >> v2:172.21.15.142:3300/0 conn(0x7f0e8c0cd730 0x7f0e8c0d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8affd640 1 -- 172.21.15.133:0/496695664 >> v1:172.21.15.133:6789/0 conn(0x7f0e8c157080 legacy=0x7f0e8c0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8affd640 1 -- 172.21.15.133:0/496695664 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c0ccc50 con 0x7f0e8c0ce920 2023-12-18T10:21:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.719+0000 7f0e8bfff640 1 --2- 172.21.15.133:0/496695664 >> v2:172.21.15.142:3300/0 conn(0x7f0e8c0cd730 0x7f0e8c0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:35.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e8affd640 1 --2- 172.21.15.133:0/496695664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c0d05b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e800097c0 tx=0x7f0e8001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=895c0ea2501b7944 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e8a7fc640 1 -- 172.21.15.133:0/496695664 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800ab650 con 0x7f0e8c0ce920 2023-12-18T10:21:35.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e8a7fc640 1 -- 172.21.15.133:0/496695664 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e800ab7b0 con 0x7f0e8c0ce920 2023-12-18T10:21:35.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e8a7fc640 1 -- 172.21.15.133:0/496695664 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800abb40 con 0x7f0e8c0ce920 2023-12-18T10:21:35.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 -- 172.21.15.133:0/496695664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 msgr2=0x7f0e8c0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/496695664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c0d05b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e800097c0 tx=0x7f0e8001c450 comp rx=0 tx=0).stop 2023-12-18T10:21:35.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 -- 172.21.15.133:0/496695664 shutdown_connections 2023-12-18T10:21:35.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/496695664 >> v2:172.21.15.142:3300/0 conn(0x7f0e8c0cd730 0x7f0e8c0d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/496695664 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c0d05b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 -- 172.21.15.133:0/496695664 >> 172.21.15.133:0/496695664 conn(0x7f0e8c069ca0 msgr2=0x7f0e8c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:35.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 -- 172.21.15.133:0/496695664 shutdown_connections 2023-12-18T10:21:35.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 -- 172.21.15.133:0/496695664 wait complete. 2023-12-18T10:21:35.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 Processor -- start 2023-12-18T10:21:35.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.723+0000 7f0e91c2d640 1 -- start start 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e8c0cd730 0x7f0e8c1f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c13d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8c157080 0x7f0e8c0b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c1401f0 con 0x7f0e8c157080 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0b54e0 con 0x7f0e8c0cd730 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0b4c10 con 0x7f0e8c0ce920 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8c157080 0x7f0e8c0b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8c157080 0x7f0e8c0b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43828/0 (socket says 172.21.15.133:43828) 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 -- 172.21.15.133:0/3117221456 learned_addr learned my addr 172.21.15.133:0/3117221456 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8b7fe640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e8c0cd730 0x7f0e8c1f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8affd640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c13d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 -- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 msgr2=0x7f0e8c13d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c13d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 -- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e8c0cd730 msgr2=0x7f0e8c1f7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e8c0cd730 0x7f0e8c1f7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 -- 172.21.15.133:0/3117221456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84009a70 con 0x7f0e8c157080 2023-12-18T10:21:35.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8affd640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c13d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:35.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8b7fe640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e8c0cd730 0x7f0e8c1f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:35.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e8bfff640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8c157080 0x7f0e8c0b5970 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009f00 tx=0x7f0e8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e73fff640 1 -- 172.21.15.133:0/3117221456 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84009d70 con 0x7f0e8c157080 2023-12-18T10:21:35.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e73fff640 1 -- 172.21.15.133:0/3117221456 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8400f040 con 0x7f0e8c157080 2023-12-18T10:21:35.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e80009420 con 0x7f0e8c157080 2023-12-18T10:21:35.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e73fff640 1 -- 172.21.15.133:0/3117221456 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84003bc0 con 0x7f0e8c157080 2023-12-18T10:21:35.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8c0b4e90 con 0x7f0e8c157080 2023-12-18T10:21:35.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8c0b5690 con 0x7f0e8c157080 2023-12-18T10:21:35.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.727+0000 7f0e73fff640 1 -- 172.21.15.133:0/3117221456 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e84014480 con 0x7f0e8c157080 2023-12-18T10:21:35.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.731+0000 7f0e73fff640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e78065a60 0x7f0e78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:35.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.731+0000 7f0e73fff640 1 -- 172.21.15.133:0/3117221456 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e84083fe0 con 0x7f0e8c157080 2023-12-18T10:21:35.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.731+0000 7f0e8b7fe640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e78065a60 0x7f0e78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:35.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.731+0000 7f0e8b7fe640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e78065a60 0x7f0e78067f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0011f0 tx=0x7f0e7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:35.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.735+0000 7f0e73fff640 1 -- 172.21.15.133:0/3117221456 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0e84051820 con 0x7f0e8c157080 2023-12-18T10:21:35.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e8c04e000 con 0x7f0e8c157080 2023-12-18T10:21:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e73fff640 1 -- 172.21.15.133:0/3117221456 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4758 (secure 0 0 0) 0x7f0e84054e40 con 0x7f0e8c157080 2023-12-18T10:21:35.919 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:35.919 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:21:22.973560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6165,"mds_1":6162,"mds_2":5875},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5875":{"gid":5875,"name":"d","rank":2,"incarnation":36,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6162":{"gid":6162,"name":"a","rank":1,"incarnation":34,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:21:35.919 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 42 2023-12-18T10:21:35.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e78065a60 msgr2=0x7f0e78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e78065a60 0x7f0e78067f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0011f0 tx=0x7f0e7c009040 comp rx=0 tx=0).stop 2023-12-18T10:21:35.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8c157080 msgr2=0x7f0e8c0b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:35.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8c157080 0x7f0e8c0b5970 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009f00 tx=0x7f0e8400c490 comp rx=0 tx=0).stop 2023-12-18T10:21:35.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 shutdown_connections 2023-12-18T10:21:35.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e78065a60 0x7f0e78067f20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8c157080 0x7f0e8c0b5970 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e8c0ce920 0x7f0e8c13d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 --2- 172.21.15.133:0/3117221456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e8c0cd730 0x7f0e8c1f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:35.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 >> 172.21.15.133:0/3117221456 conn(0x7f0e8c069ca0 msgr2=0x7f0e8c15eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:35.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 shutdown_connections 2023-12-18T10:21:35.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:35.915+0000 7f0e91c2d640 1 -- 172.21.15.133:0/3117221456 wait complete. 2023-12-18T10:21:35.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:21:36.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f255b7a6640 1 Processor -- start 2023-12-18T10:21:36.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f255b7a6640 1 -- start start 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f255b7a6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f255415a680 0x7f255415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f255b7a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f255406fdb0 0x7f2554070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f255b7a6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255415f100 con 0x7f25540cac10 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f255b7a6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2554070780 con 0x7f255406fdb0 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f255b7a6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540ca7d0 con 0x7f255415a680 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f2559d43640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f255406fdb0 0x7f2554070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f2559d43640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f255406fdb0 0x7f2554070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43836/0 (socket says 172.21.15.133:43836) 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.075+0000 7f2559d43640 1 -- 172.21.15.133:0/2647830068 learned_addr learned my addr 172.21.15.133:0/2647830068 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f2559542640 1 --2- 172.21.15.133:0/2647830068 >> v2:172.21.15.142:3300/0 conn(0x7f255415a680 0x7f255415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f2559d43640 1 -- 172.21.15.133:0/2647830068 >> v2:172.21.15.142:3300/0 conn(0x7f255415a680 msgr2=0x7f255415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f2559d43640 1 --2- 172.21.15.133:0/2647830068 >> v2:172.21.15.142:3300/0 conn(0x7f255415a680 0x7f255415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f2559d43640 1 -- 172.21.15.133:0/2647830068 >> v1:172.21.15.142:6789/0 conn(0x7f25540cac10 legacy=0x7f255415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:36.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f2559d43640 1 -- 172.21.15.133:0/2647830068 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255415e860 con 0x7f255406fdb0 2023-12-18T10:21:36.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f2559542640 1 --2- 172.21.15.133:0/2647830068 >> v2:172.21.15.142:3300/0 conn(0x7f255415a680 0x7f255415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:36.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f2559d43640 1 --2- 172.21.15.133:0/2647830068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554070240 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f254c009e50 tx=0x7f254c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8705067599c45481 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f254bfff640 1 -- 172.21.15.133:0/2647830068 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0a57c0 con 0x7f255406fdb0 2023-12-18T10:21:36.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f254bfff640 1 -- 172.21.15.133:0/2647830068 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c0a5920 con 0x7f255406fdb0 2023-12-18T10:21:36.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f254bfff640 1 -- 172.21.15.133:0/2647830068 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c0a5cb0 con 0x7f255406fdb0 2023-12-18T10:21:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f255b7a6640 1 -- 172.21.15.133:0/2647830068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 msgr2=0x7f2554070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.079+0000 7f255b7a6640 1 --2- 172.21.15.133:0/2647830068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554070240 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f254c009e50 tx=0x7f254c01c900 comp rx=0 tx=0).stop 2023-12-18T10:21:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 -- 172.21.15.133:0/2647830068 shutdown_connections 2023-12-18T10:21:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 --2- 172.21.15.133:0/2647830068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554070240 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 --2- 172.21.15.133:0/2647830068 >> v2:172.21.15.142:3300/0 conn(0x7f255415a680 0x7f255415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 -- 172.21.15.133:0/2647830068 >> 172.21.15.133:0/2647830068 conn(0x7f255406a3e0 msgr2=0x7f25540afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 -- 172.21.15.133:0/2647830068 shutdown_connections 2023-12-18T10:21:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 -- 172.21.15.133:0/2647830068 wait complete. 2023-12-18T10:21:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 Processor -- start 2023-12-18T10:21:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 -- start start 2023-12-18T10:21:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25540cac10 0x7f25541538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f255415a680 0x7f255414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554151ba0 con 0x7f255406fdb0 2023-12-18T10:21:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554150940 con 0x7f255415a680 2023-12-18T10:21:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f255b7a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2554150c20 con 0x7f25540cac10 2023-12-18T10:21:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43840/0 (socket says 172.21.15.133:43840) 2023-12-18T10:21:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 -- 172.21.15.133:0/820383363 learned_addr learned my addr 172.21.15.133:0/820383363 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559d43640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f255415a680 0x7f255414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2558d41640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25540cac10 0x7f25541538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 -- 172.21.15.133:0/820383363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25540cac10 msgr2=0x7f25541538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25540cac10 0x7f25541538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 -- 172.21.15.133:0/820383363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f255415a680 msgr2=0x7f255414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f255415a680 0x7f255414fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 -- 172.21.15.133:0/820383363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c009b30 con 0x7f255406fdb0 2023-12-18T10:21:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2559542640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554150360 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f255000e810 tx=0x7f255000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2549ffb640 1 -- 172.21.15.133:0/820383363 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255000c8d0 con 0x7f255406fdb0 2023-12-18T10:21:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.083+0000 7f2549ffb640 1 -- 172.21.15.133:0/820383363 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255000ca30 con 0x7f255406fdb0 2023-12-18T10:21:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.087+0000 7f2549ffb640 1 -- 172.21.15.133:0/820383363 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255000cde0 con 0x7f255406fdb0 2023-12-18T10:21:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.087+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2554150f00 con 0x7f255406fdb0 2023-12-18T10:21:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.087+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25541514c0 con 0x7f255406fdb0 2023-12-18T10:21:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.087+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25540735b0 con 0x7f255406fdb0 2023-12-18T10:21:36.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.087+0000 7f2549ffb640 1 -- 172.21.15.133:0/820383363 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2550013410 con 0x7f255406fdb0 2023-12-18T10:21:36.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.087+0000 7f2549ffb640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2538065a60 0x7f2538067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.091+0000 7f2549ffb640 1 -- 172.21.15.133:0/820383363 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2550083060 con 0x7f255406fdb0 2023-12-18T10:21:36.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.091+0000 7f2558d41640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2538065a60 0x7f2538067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.091+0000 7f2558d41640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2538065a60 0x7f2538067f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f255415d3e0 tx=0x7f2544009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.091+0000 7f2549ffb640 1 -- 172.21.15.133:0/820383363 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f25500b40a0 con 0x7f255406fdb0 2023-12-18T10:21:36.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.247+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f255404e000 con 0x7f255406fdb0 2023-12-18T10:21:36.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f2549ffb640 1 -- 172.21.15.133:0/820383363 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16354 (secure 0 0 0) 0x7f25500508f0 con 0x7f255406fdb0 2023-12-18T10:21:36.254 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:36.254 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:20:45.524788+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:20:42.874010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-18T10:20:43.517857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:21:36.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2538065a60 msgr2=0x7f2538067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2538065a60 0x7f2538067f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f255415d3e0 tx=0x7f2544009060 comp rx=0 tx=0).stop 2023-12-18T10:21:36.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 msgr2=0x7f2554150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554150360 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f255000e810 tx=0x7f255000ecd0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 shutdown_connections 2023-12-18T10:21:36.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2538065a60 0x7f2538067f20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f255415a680 0x7f255414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25540cac10 0x7f25541538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 --2- 172.21.15.133:0/820383363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f255406fdb0 0x7f2554150360 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 >> 172.21.15.133:0/820383363 conn(0x7f255406a3e0 msgr2=0x7f25540af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:36.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 shutdown_connections 2023-12-18T10:21:36.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.251+0000 7f255b7a6640 1 -- 172.21.15.133:0/820383363 wait complete. 2023-12-18T10:21:36.275 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-18T10:21:36.275 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:36.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260759e640 1 Processor -- start 2023-12-18T10:21:36.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260759e640 1 -- start start 2023-12-18T10:21:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260759e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2608069ca0 0x7f260806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f2608160230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260759e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260815d020 con 0x7f26080ae010 2023-12-18T10:21:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260759e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260815dbc0 con 0x7f2608069ca0 2023-12-18T10:21:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260806a5c0 con 0x7f26080b2d20 2023-12-18T10:21:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f25fffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f26080ae010 0x7f260815d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60654/0 (socket says 172.21.15.133:60654) 2023-12-18T10:21:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f25fffff640 1 -- 172.21.15.133:0/3059681251 learned_addr learned my addr 172.21.15.133:0/3059681251 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260659c640 1 --2- 172.21.15.133:0/3059681251 >> v2:172.21.15.142:3300/0 conn(0x7f2608069ca0 0x7f260806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f2606d9d640 1 --2- 172.21.15.133:0/3059681251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f2608160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f2605d9b640 1 -- 172.21.15.133:0/3059681251 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385919395 0 0) 0x7f260815d020 con 0x7f26080ae010 2023-12-18T10:21:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f2605d9b640 1 -- 172.21.15.133:0/3059681251 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f4003530 con 0x7f26080ae010 2023-12-18T10:21:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260659c640 1 -- 172.21.15.133:0/3059681251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 msgr2=0x7f2608160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260659c640 1 --2- 172.21.15.133:0/3059681251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f2608160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260659c640 1 -- 172.21.15.133:0/3059681251 >> v1:172.21.15.133:6789/0 conn(0x7f26080ae010 legacy=0x7f260815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.411+0000 7f260659c640 1 -- 172.21.15.133:0/3059681251 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080ae510 con 0x7f2608069ca0 2023-12-18T10:21:36.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260659c640 1 --2- 172.21.15.133:0/3059681251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 0x7f260806a080 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f25f80097c0 tx=0x7f25f801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61745eabb816cc48 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f2605d9b640 1 -- 172.21.15.133:0/3059681251 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f80a8970 con 0x7f2608069ca0 2023-12-18T10:21:36.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f2605d9b640 1 -- 172.21.15.133:0/3059681251 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f80a8ad0 con 0x7f2608069ca0 2023-12-18T10:21:36.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f2605d9b640 1 -- 172.21.15.133:0/3059681251 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f80a8e40 con 0x7f2608069ca0 2023-12-18T10:21:36.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260759e640 1 -- 172.21.15.133:0/3059681251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 msgr2=0x7f260806a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260759e640 1 --2- 172.21.15.133:0/3059681251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 0x7f260806a080 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f25f80097c0 tx=0x7f25f801ec70 comp rx=0 tx=0).stop 2023-12-18T10:21:36.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260759e640 1 -- 172.21.15.133:0/3059681251 shutdown_connections 2023-12-18T10:21:36.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260759e640 1 --2- 172.21.15.133:0/3059681251 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f2608160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260759e640 1 --2- 172.21.15.133:0/3059681251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 0x7f260806a080 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260759e640 1 -- 172.21.15.133:0/3059681251 >> 172.21.15.133:0/3059681251 conn(0x7f26080b0ea0 msgr2=0x7f26080b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:36.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260759e640 1 -- 172.21.15.133:0/3059681251 shutdown_connections 2023-12-18T10:21:36.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.415+0000 7f260759e640 1 -- 172.21.15.133:0/3059681251 wait complete. 2023-12-18T10:21:36.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 Processor -- start 2023-12-18T10:21:36.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 -- start start 2023-12-18T10:21:36.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 0x7f2608153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26080ae010 0x7f2608151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f26080cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2608152290 con 0x7f26080ae010 2023-12-18T10:21:36.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080cbca0 con 0x7f2608069ca0 2023-12-18T10:21:36.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26080cc820 con 0x7f26080b2d20 2023-12-18T10:21:36.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26080ae010 0x7f2608151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26080ae010 0x7f2608151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43856/0 (socket says 172.21.15.133:43856) 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 -- 172.21.15.133:0/1975479032 learned_addr learned my addr 172.21.15.133:0/1975479032 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260659c640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 0x7f2608153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f2606d9d640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f26080cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 -- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 msgr2=0x7f26080cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f26080cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 -- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 msgr2=0x7f2608153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 0x7f2608153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 -- 172.21.15.133:0/1975479032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8009420 con 0x7f26080ae010 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f2606d9d640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f26080cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25fffff640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26080ae010 0x7f2608151d50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c480 tx=0x7f25f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25feffd640 1 -- 172.21.15.133:0/1975479032 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0005cf0 con 0x7f26080ae010 2023-12-18T10:21:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25feffd640 1 -- 172.21.15.133:0/1975479032 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f0005e50 con 0x7f26080ae010 2023-12-18T10:21:36.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f25feffd640 1 -- 172.21.15.133:0/1975479032 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0007290 con 0x7f26080ae010 2023-12-18T10:21:36.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26080cbef0 con 0x7f26080ae010 2023-12-18T10:21:36.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26080cc4b0 con 0x7f26080ae010 2023-12-18T10:21:36.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.419+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260804e850 con 0x7f26080ae010 2023-12-18T10:21:36.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.423+0000 7f25feffd640 1 -- 172.21.15.133:0/1975479032 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f25f00073f0 con 0x7f26080ae010 2023-12-18T10:21:36.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.423+0000 7f25feffd640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25e8065a60 0x7f25e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.423+0000 7f25feffd640 1 -- 172.21.15.133:0/1975479032 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f25f0082840 con 0x7f26080ae010 2023-12-18T10:21:36.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.423+0000 7f260659c640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25e8065a60 0x7f25e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.423+0000 7f260659c640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25e8065a60 0x7f25e8067f20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f25f80b2000 tx=0x7f25f80aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.427+0000 7f25feffd640 1 -- 172.21.15.133:0/1975479032 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f25f0050160 con 0x7f26080ae010 2023-12-18T10:21:36.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.607+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26080b1690 con 0x7f26080ae010 2023-12-18T10:21:36.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.607+0000 7f25feffd640 1 -- 172.21.15.133:0/1975479032 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4758 (secure 0 0 0) 0x7f25f0017090 con 0x7f26080ae010 2023-12-18T10:21:36.612 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:36.612 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:21:22.973560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6165,"mds_1":6162,"mds_2":5875},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5875":{"gid":5875,"name":"d","rank":2,"incarnation":36,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6162":{"gid":6162,"name":"a","rank":1,"incarnation":34,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:21:36.613 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 42 2023-12-18T10:21:36.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25e8065a60 msgr2=0x7f25e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25e8065a60 0x7f25e8067f20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f25f80b2000 tx=0x7f25f80aa070 comp rx=0 tx=0).stop 2023-12-18T10:21:36.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26080ae010 msgr2=0x7f2608151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26080ae010 0x7f2608151d50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c480 tx=0x7f25f000c940 comp rx=0 tx=0).stop 2023-12-18T10:21:36.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 shutdown_connections 2023-12-18T10:21:36.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25e8065a60 0x7f25e8067f20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f26080b2d20 0x7f26080cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26080ae010 0x7f2608151d50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 --2- 172.21.15.133:0/1975479032 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2608069ca0 0x7f2608153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 >> 172.21.15.133:0/1975479032 conn(0x7f26080b0ea0 msgr2=0x7f26080b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:36.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 shutdown_connections 2023-12-18T10:21:36.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.611+0000 7f260759e640 1 -- 172.21.15.133:0/1975479032 wait complete. 2023-12-18T10:21:36.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:36.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f45bc640 1 Processor -- start 2023-12-18T10:21:36.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f45bc640 1 -- start start 2023-12-18T10:21:36.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f45bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec15ca40 0x7f76ec0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f45bc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76ec0ce3f0 0x7f76ec0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f45bc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76ec0cf610 0x7f76ec1605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f45bc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec0cfa70 con 0x7f76ec0ce3f0 2023-12-18T10:21:36.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f45bc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec0d11c0 con 0x7f76ec0cf610 2023-12-18T10:21:36.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f45bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0d0310 con 0x7f76ec15ca40 2023-12-18T10:21:36.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f1b57640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76ec0ce3f0 0x7f76ec0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f1b57640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76ec0ce3f0 0x7f76ec0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43870/0 (socket says 172.21.15.133:43870) 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f1b57640 1 -- 172.21.15.133:0/3394565533 learned_addr learned my addr 172.21.15.133:0/3394565533 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f2b59640 1 --2- 172.21.15.133:0/3394565533 >> v2:172.21.15.142:3300/0 conn(0x7f76ec0cf610 0x7f76ec1605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f2358640 1 --2- 172.21.15.133:0/3394565533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec15ca40 0x7f76ec0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f1b57640 1 -- 172.21.15.133:0/3394565533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec15ca40 msgr2=0x7f76ec0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f1b57640 1 --2- 172.21.15.133:0/3394565533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec15ca40 0x7f76ec0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f1b57640 1 -- 172.21.15.133:0/3394565533 >> v2:172.21.15.142:3300/0 conn(0x7f76ec0cf610 msgr2=0x7f76ec1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f1b57640 1 --2- 172.21.15.133:0/3394565533 >> v2:172.21.15.142:3300/0 conn(0x7f76ec0cf610 0x7f76ec1605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.767+0000 7f76f1b57640 1 -- 172.21.15.133:0/3394565533 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0d05b0 con 0x7f76ec0ce3f0 2023-12-18T10:21:36.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f1b57640 1 --2- 172.21.15.133:0/3394565533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec0ce3f0 0x7f76ec0cf0d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0b52f0 tx=0x7f76dc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d00a42cf66ba89 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f1356640 1 -- 172.21.15.133:0/3394565533 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0ab600 con 0x7f76ec0ce3f0 2023-12-18T10:21:36.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f1356640 1 -- 172.21.15.133:0/3394565533 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc0a7050 con 0x7f76ec0ce3f0 2023-12-18T10:21:36.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f1356640 1 -- 172.21.15.133:0/3394565533 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0ab980 con 0x7f76ec0ce3f0 2023-12-18T10:21:36.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 -- 172.21.15.133:0/3394565533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec0ce3f0 msgr2=0x7f76ec0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 --2- 172.21.15.133:0/3394565533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec0ce3f0 0x7f76ec0cf0d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0b52f0 tx=0x7f76dc01c240 comp rx=0 tx=0).stop 2023-12-18T10:21:36.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 -- 172.21.15.133:0/3394565533 shutdown_connections 2023-12-18T10:21:36.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 --2- 172.21.15.133:0/3394565533 >> v2:172.21.15.142:3300/0 conn(0x7f76ec0cf610 0x7f76ec1605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 --2- 172.21.15.133:0/3394565533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec0ce3f0 0x7f76ec0cf0d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 --2- 172.21.15.133:0/3394565533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec15ca40 0x7f76ec0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 -- 172.21.15.133:0/3394565533 >> 172.21.15.133:0/3394565533 conn(0x7f76ec089fb0 msgr2=0x7f76ec0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:36.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 -- 172.21.15.133:0/3394565533 shutdown_connections 2023-12-18T10:21:36.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.771+0000 7f76f45bc640 1 -- 172.21.15.133:0/3394565533 wait complete. 2023-12-18T10:21:36.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 Processor -- start 2023-12-18T10:21:36.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 -- start start 2023-12-18T10:21:36.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec0ce3f0 0x7f76ec1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76ec0cf610 0x7f76ec15d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec15ca40 0x7f76ec0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0c9240 con 0x7f76ec15ca40 2023-12-18T10:21:36.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec154ee0 con 0x7f76ec0cf610 2023-12-18T10:21:36.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0c8fa0 con 0x7f76ec0ce3f0 2023-12-18T10:21:36.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec15ca40 0x7f76ec0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec15ca40 0x7f76ec0c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43878/0 (socket says 172.21.15.133:43878) 2023-12-18T10:21:36.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 -- 172.21.15.133:0/4263576329 learned_addr learned my addr 172.21.15.133:0/4263576329 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:36.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2358640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec0ce3f0 0x7f76ec1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f1b57640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76ec0cf610 0x7f76ec15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 -- 172.21.15.133:0/4263576329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec0ce3f0 msgr2=0x7f76ec1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec0ce3f0 0x7f76ec1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 -- 172.21.15.133:0/4263576329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76ec0cf610 msgr2=0x7f76ec15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76ec0cf610 0x7f76ec15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 -- 172.21.15.133:0/4263576329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc009480 con 0x7f76ec15ca40 2023-12-18T10:21:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f2b59640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec15ca40 0x7f76ec0c71a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f76e4007d40 tx=0x7f76e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76e2ffd640 1 -- 172.21.15.133:0/4263576329 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4014420 con 0x7f76ec15ca40 2023-12-18T10:21:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76e2ffd640 1 -- 172.21.15.133:0/4263576329 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e40145a0 con 0x7f76ec15ca40 2023-12-18T10:21:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec0c6ca0 con 0x7f76ec15ca40 2023-12-18T10:21:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76e2ffd640 1 -- 172.21.15.133:0/4263576329 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4014950 con 0x7f76ec15ca40 2023-12-18T10:21:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec0b8140 con 0x7f76ec15ca40 2023-12-18T10:21:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.775+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec0c6e90 con 0x7f76ec15ca40 2023-12-18T10:21:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.779+0000 7f76e2ffd640 1 -- 172.21.15.133:0/4263576329 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f76e4014ab0 con 0x7f76ec15ca40 2023-12-18T10:21:36.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.779+0000 7f76e2ffd640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76d0065a60 0x7f76d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:36.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.779+0000 7f76e2ffd640 1 -- 172.21.15.133:0/4263576329 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f76e4083a00 con 0x7f76ec15ca40 2023-12-18T10:21:36.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.779+0000 7f76f2358640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76d0065a60 0x7f76d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:36.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.779+0000 7f76f2358640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76d0065a60 0x7f76d0067f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006fd0 tx=0x7f76e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:36.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.783+0000 7f76e2ffd640 1 -- 172.21.15.133:0/4263576329 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f76e4051290 con 0x7f76ec15ca40 2023-12-18T10:21:36.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76ec04e000 con 0x7f76ec15ca40 2023-12-18T10:21:36.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76e2ffd640 1 -- 172.21.15.133:0/4263576329 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4758 (secure 0 0 0) 0x7f76e4083020 con 0x7f76ec15ca40 2023-12-18T10:21:36.967 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:36.967 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:20:44.522180+0000","modified":"2023-12-18T10:21:22.973560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6165,"mds_1":6162,"mds_2":5875},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5875":{"gid":5875,"name":"d","rank":2,"incarnation":36,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/2140881005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2140881005},{"type":"v1","addr":"172.21.15.142:6834","nonce":2140881005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6162":{"gid":6162,"name":"a","rank":1,"incarnation":34,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/4035374378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":4035374378},{"type":"v1","addr":"172.21.15.133:6836","nonce":4035374378}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6165":{"gid":6165,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1554379121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1554379121},{"type":"v1","addr":"172.21.15.133:6837","nonce":1554379121}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-18T10:21:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 42 2023-12-18T10:21:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76d0065a60 msgr2=0x7f76d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76d0065a60 0x7f76d0067f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006fd0 tx=0x7f76e8008040 comp rx=0 tx=0).stop 2023-12-18T10:21:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec15ca40 msgr2=0x7f76ec0c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec15ca40 0x7f76ec0c71a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f76e4007d40 tx=0x7f76e400e4b0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 shutdown_connections 2023-12-18T10:21:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76d0065a60 0x7f76d0067f20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ec15ca40 0x7f76ec0c71a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76ec0cf610 0x7f76ec15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 --2- 172.21.15.133:0/4263576329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76ec0ce3f0 0x7f76ec1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 >> 172.21.15.133:0/4263576329 conn(0x7f76ec089fb0 msgr2=0x7f76ec15ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 shutdown_connections 2023-12-18T10:21:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:36.963+0000 7f76f45bc640 1 -- 172.21.15.133:0/4263576329 wait complete. 2023-12-18T10:21:36.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:21:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93e032c640 1 Processor -- start 2023-12-18T10:21:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93e032c640 1 -- start start 2023-12-18T10:21:37.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93e032c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93d8158c20 0x7f93d8070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93e032c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d815c800 0x7f93d80caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93e032c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f93d80cafb0 0x7f93d806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93e032c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d80cb440 con 0x7f93d8158c20 2023-12-18T10:21:37.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93e032c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d8070b80 con 0x7f93d80cafb0 2023-12-18T10:21:37.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93e032c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8070e60 con 0x7f93d815c800 2023-12-18T10:21:37.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de0c8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93d8158c20 0x7f93d8070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de0c8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93d8158c20 0x7f93d8070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43886/0 (socket says 172.21.15.133:43886) 2023-12-18T10:21:37.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de0c8640 1 -- 172.21.15.133:0/4274517945 learned_addr learned my addr 172.21.15.133:0/4274517945 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:37.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93dd8c7640 1 --2- 172.21.15.133:0/4274517945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d815c800 0x7f93d80caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de8c9640 1 --2- 172.21.15.133:0/4274517945 >> v2:172.21.15.142:3300/0 conn(0x7f93d80cafb0 0x7f93d806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de0c8640 1 -- 172.21.15.133:0/4274517945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d815c800 msgr2=0x7f93d80caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:37.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de0c8640 1 --2- 172.21.15.133:0/4274517945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d815c800 0x7f93d80caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de0c8640 1 -- 172.21.15.133:0/4274517945 >> v2:172.21.15.142:3300/0 conn(0x7f93d80cafb0 msgr2=0x7f93d806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:37.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de0c8640 1 --2- 172.21.15.133:0/4274517945 >> v2:172.21.15.142:3300/0 conn(0x7f93d80cafb0 0x7f93d806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.123+0000 7f93de0c8640 1 -- 172.21.15.133:0/4274517945 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8071140 con 0x7f93d8158c20 2023-12-18T10:21:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93de0c8640 1 --2- 172.21.15.133:0/4274517945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d8158c20 0x7f93d8070510 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f93d80b44d0 tx=0x7f93d401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a53c79b1b5cb285 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93dd0c6640 1 -- 172.21.15.133:0/4274517945 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40ab600 con 0x7f93d8158c20 2023-12-18T10:21:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93dd0c6640 1 -- 172.21.15.133:0/4274517945 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d40a7050 con 0x7f93d8158c20 2023-12-18T10:21:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93dd0c6640 1 -- 172.21.15.133:0/4274517945 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40ab980 con 0x7f93d8158c20 2023-12-18T10:21:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 -- 172.21.15.133:0/4274517945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d8158c20 msgr2=0x7f93d8070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 --2- 172.21.15.133:0/4274517945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d8158c20 0x7f93d8070510 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f93d80b44d0 tx=0x7f93d401c180 comp rx=0 tx=0).stop 2023-12-18T10:21:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 -- 172.21.15.133:0/4274517945 shutdown_connections 2023-12-18T10:21:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 --2- 172.21.15.133:0/4274517945 >> v2:172.21.15.142:3300/0 conn(0x7f93d80cafb0 0x7f93d806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 --2- 172.21.15.133:0/4274517945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d815c800 0x7f93d80caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 --2- 172.21.15.133:0/4274517945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d8158c20 0x7f93d8070510 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 -- 172.21.15.133:0/4274517945 >> 172.21.15.133:0/4274517945 conn(0x7f93d806a3e0 msgr2=0x7f93d80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 -- 172.21.15.133:0/4274517945 shutdown_connections 2023-12-18T10:21:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.127+0000 7f93e032c640 1 -- 172.21.15.133:0/4274517945 wait complete. 2023-12-18T10:21:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 Processor -- start 2023-12-18T10:21:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 -- start start 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d80cafb0 0x7f93d80c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d8158c20 0x7f93d80c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d815c800 0x7f93d81484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80c47f0 con 0x7f93d815c800 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80c2190 con 0x7f93d80cafb0 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8148f20 con 0x7f93d8158c20 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d815c800 0x7f93d81484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d815c800 0x7f93d81484d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43888/0 (socket says 172.21.15.133:43888) 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 -- 172.21.15.133:0/32928973 learned_addr learned my addr 172.21.15.133:0/32928973 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de0c8640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d80cafb0 0x7f93d80c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93dd8c7640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d8158c20 0x7f93d80c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 -- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d8158c20 msgr2=0x7f93d80c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d8158c20 0x7f93d80c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 -- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d80cafb0 msgr2=0x7f93d80c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d80cafb0 0x7f93d80c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 -- 172.21.15.133:0/32928973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40094d0 con 0x7f93d815c800 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de0c8640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d80cafb0 0x7f93d80c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93de8c9640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d815c800 0x7f93d81484d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f93d000efc0 tx=0x7f93d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93ceffd640 1 -- 172.21.15.133:0/32928973 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0014480 con 0x7f93d815c800 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93ceffd640 1 -- 172.21.15.133:0/32928973 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d000f040 con 0x7f93d815c800 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93ceffd640 1 -- 172.21.15.133:0/32928973 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0014820 con 0x7f93d815c800 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d80c8800 con 0x7f93d815c800 2023-12-18T10:21:37.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d80c3ec0 con 0x7f93d815c800 2023-12-18T10:21:37.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.131+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d80735b0 con 0x7f93d815c800 2023-12-18T10:21:37.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.135+0000 7f93ceffd640 1 -- 172.21.15.133:0/32928973 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f93d0014980 con 0x7f93d815c800 2023-12-18T10:21:37.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.135+0000 7f93ceffd640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93bc065a60 0x7f93bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.135+0000 7f93ceffd640 1 -- 172.21.15.133:0/32928973 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93d00842a0 con 0x7f93d815c800 2023-12-18T10:21:37.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.135+0000 7f93de0c8640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93bc065a60 0x7f93bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.135+0000 7f93de0c8640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93bc065a60 0x7f93bc067f20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f93d40ad000 tx=0x7f93d40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.139+0000 7f93ceffd640 1 -- 172.21.15.133:0/32928973 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f93d00519f0 con 0x7f93d815c800 2023-12-18T10:21:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.291+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93d80c4990 con 0x7f93d815c800 2023-12-18T10:21:37.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.291+0000 7f93ceffd640 1 -- 172.21.15.133:0/32928973 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16354 (secure 0 0 0) 0x7f93d0018090 con 0x7f93d815c800 2023-12-18T10:21:37.297 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:37.298 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:20:45.524788+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:20:42.874010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-12-18T10:20:43.517857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:21:37.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93bc065a60 msgr2=0x7f93bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93bc065a60 0x7f93bc067f20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f93d40ad000 tx=0x7f93d40a6000 comp rx=0 tx=0).stop 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d815c800 msgr2=0x7f93d81484d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d815c800 0x7f93d81484d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f93d000efc0 tx=0x7f93d000c490 comp rx=0 tx=0).stop 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 shutdown_connections 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f93bc065a60 0x7f93bc067f20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93d815c800 0x7f93d81484d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f93d8158c20 0x7f93d80c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 --2- 172.21.15.133:0/32928973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93d80cafb0 0x7f93d80c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 >> 172.21.15.133:0/32928973 conn(0x7f93d806a3e0 msgr2=0x7f93d80ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 shutdown_connections 2023-12-18T10:21:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.295+0000 7f93e032c640 1 -- 172.21.15.133:0/32928973 wait complete. 2023-12-18T10:21:37.319 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-18T10:21:37.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.451+0000 7f6d37325640 1 Processor -- start 2023-12-18T10:21:37.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d37325640 1 -- start start 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d37325640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d3015c9d0 0x7f6d300cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d37325640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d30160690 con 0x7f6d300cdd40 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d37325640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d300b0d80 con 0x7f6d3006fdb0 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d37325640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d301603f0 con 0x7f6d3015c9d0 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d350c1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d3015c9d0 0x7f6d300cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d350c1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d3015c9d0 0x7f6d300cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43904/0 (socket says 172.21.15.133:43904) 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d350c1640 1 -- 172.21.15.133:0/3585871164 learned_addr learned my addr 172.21.15.133:0/3585871164 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d348c0640 1 --1- 172.21.15.133:0/3585871164 >> v1:172.21.15.133:6789/0 conn(0x7f6d300cdd40 0x7f6d30160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60660/0 (socket says 172.21.15.133:60660) 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d350c1640 1 -- 172.21.15.133:0/3585871164 >> v1:172.21.15.142:6789/0 conn(0x7f6d3006fdb0 legacy=0x7f6d300cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d350c1640 1 -- 172.21.15.133:0/3585871164 >> v1:172.21.15.133:6789/0 conn(0x7f6d300cdd40 legacy=0x7f6d30160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d350c1640 1 -- 172.21.15.133:0/3585871164 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d300ccb00 con 0x7f6d3015c9d0 2023-12-18T10:21:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.455+0000 7f6d27fff640 1 -- 172.21.15.133:0/3585871164 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720379014 0 0) 0x7f6d30160690 con 0x7f6d300cdd40 2023-12-18T10:21:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d350c1640 1 --2- 172.21.15.133:0/3585871164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3015c9d0 0x7f6d300cc400 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009870 tx=0x7f6d2c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1608ab04ce069f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d27fff640 1 -- 172.21.15.133:0/3585871164 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0ab610 con 0x7f6d3015c9d0 2023-12-18T10:21:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d27fff640 1 -- 172.21.15.133:0/3585871164 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0ab770 con 0x7f6d3015c9d0 2023-12-18T10:21:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d27fff640 1 -- 172.21.15.133:0/3585871164 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0abb00 con 0x7f6d3015c9d0 2023-12-18T10:21:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 -- 172.21.15.133:0/3585871164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3015c9d0 msgr2=0x7f6d300cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 --2- 172.21.15.133:0/3585871164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3015c9d0 0x7f6d300cc400 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c009870 tx=0x7f6d2c01c500 comp rx=0 tx=0).stop 2023-12-18T10:21:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 -- 172.21.15.133:0/3585871164 shutdown_connections 2023-12-18T10:21:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 --2- 172.21.15.133:0/3585871164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3015c9d0 0x7f6d300cc400 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 -- 172.21.15.133:0/3585871164 >> 172.21.15.133:0/3585871164 conn(0x7f6d3006a3e0 msgr2=0x7f6d300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 -- 172.21.15.133:0/3585871164 shutdown_connections 2023-12-18T10:21:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 -- 172.21.15.133:0/3585871164 wait complete. 2023-12-18T10:21:37.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 Processor -- start 2023-12-18T10:21:37.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.459+0000 7f6d37325640 1 -- start start 2023-12-18T10:21:37.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3006fdb0 0x7f6d300c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d300cdd40 0x7f6d301f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d3015c9d0 0x7f6d300ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300c4fd0 con 0x7f6d3006fdb0 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300c6270 con 0x7f6d3015c9d0 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300c6550 con 0x7f6d300cdd40 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3006fdb0 0x7f6d300c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3006fdb0 0x7f6d300c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43914/0 (socket says 172.21.15.133:43914) 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 -- 172.21.15.133:0/384949884 learned_addr learned my addr 172.21.15.133:0/384949884 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d348c0640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d300cdd40 0x7f6d301f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d358c2640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d3015c9d0 0x7f6d300ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 -- 172.21.15.133:0/384949884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d300cdd40 msgr2=0x7f6d301f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d300cdd40 0x7f6d301f9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 -- 172.21.15.133:0/384949884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d3015c9d0 msgr2=0x7f6d300ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d3015c9d0 0x7f6d300ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 -- 172.21.15.133:0/384949884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0094d0 con 0x7f6d3006fdb0 2023-12-18T10:21:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d350c1640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3006fdb0 0x7f6d300c4a90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c019110 tx=0x7f6d2c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d25ffb640 1 -- 172.21.15.133:0/384949884 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0b4800 con 0x7f6d3006fdb0 2023-12-18T10:21:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d25ffb640 1 -- 172.21.15.133:0/384949884 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0b4980 con 0x7f6d3006fdb0 2023-12-18T10:21:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d301613b0 con 0x7f6d3006fdb0 2023-12-18T10:21:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d25ffb640 1 -- 172.21.15.133:0/384949884 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0b4d30 con 0x7f6d3006fdb0 2023-12-18T10:21:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d300c6b10 con 0x7f6d3006fdb0 2023-12-18T10:21:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.463+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d300735b0 con 0x7f6d3006fdb0 2023-12-18T10:21:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.467+0000 7f6d25ffb640 1 -- 172.21.15.133:0/384949884 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6d2c0b3380 con 0x7f6d3006fdb0 2023-12-18T10:21:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.467+0000 7f6d25ffb640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6d14065a60 0x7f6d14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.467+0000 7f6d25ffb640 1 -- 172.21.15.133:0/384949884 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6d2c11d1c0 con 0x7f6d3006fdb0 2023-12-18T10:21:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.467+0000 7f6d348c0640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6d14065a60 0x7f6d14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.467+0000 7f6d348c0640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6d14065a60 0x7f6d14067f20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6d300c53e0 tx=0x7f6d20007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.471+0000 7f6d25ffb640 1 -- 172.21.15.133:0/384949884 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6d2c0eac80 con 0x7f6d3006fdb0 2023-12-18T10:21:37.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.655+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6d3004e000 con 0x7f6d3006fdb0 2023-12-18T10:21:37.660 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:21:37.655+0000 7f3ba99e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-18T10:21:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.667+0000 7f6d25ffb640 1 -- 172.21.15.133:0/384949884 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6d2c0ee2a0 con 0x7f6d3006fdb0 2023-12-18T10:21:37.673 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-18T10:21:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6d14065a60 msgr2=0x7f6d14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6d14065a60 0x7f6d14067f20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6d300c53e0 tx=0x7f6d20007d60 comp rx=0 tx=0).stop 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3006fdb0 msgr2=0x7f6d300c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3006fdb0 0x7f6d300c4a90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c019110 tx=0x7f6d2c01ad40 comp rx=0 tx=0).stop 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 shutdown_connections 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6d14065a60 0x7f6d14067f20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6d3015c9d0 0x7f6d300ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6d300cdd40 0x7f6d301f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 --2- 172.21.15.133:0/384949884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d3006fdb0 0x7f6d300c4a90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 >> 172.21.15.133:0/384949884 conn(0x7f6d3006a3e0 msgr2=0x7f6d300af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 shutdown_connections 2023-12-18T10:21:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.671+0000 7f6d37325640 1 -- 172.21.15.133:0/384949884 wait complete. 2023-12-18T10:21:37.686 INFO:tasks.ceph.mds.d.smithi142.stderr: -813> 2023-12-18T10:21:19.664+0000 7ff025535640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-12-18T10:21:00.576701+0000 1=0+1) n(v0 rc2023-12-18T10:21:00.576701+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={6342=pAsLsXsFsx/-@6},l=6342 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e3e14d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.576701+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.576701+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.576701+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-18T10:21:00.576701+0000 2=0+2)","error_str":""},"return_code":-61} 2023-12-18T10:21:37.686 INFO:tasks.ceph.mds.d.smithi142.stderr: -791> 2023-12-18T10:21:19.664+0000 7ff025535640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (iversion lock) caps={6342=pAsLsXsFs/-@3},l=6342 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55e3e14d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-12-18T10:21:37.687 INFO:tasks.ceph.mds.a.smithi133.stderr: -1001> 2023-12-18T10:21:19.663+0000 7fbf38424640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-12-18T10:21:00.573292+0000 1=0+1) n(v2 rc2023-12-18T10:21:00.795324+0000 4=0+4) (inest lock) (iversion lock) caps={6342=pAsLsXsFs/-@7},l=6342 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55d39ac7e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.573292+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.795324+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.573292+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-12-18T10:21:00.795324+0000 4=0+4)","error_str":""},"return_code":-61} 2023-12-18T10:21:37.687 INFO:tasks.ceph.mds.a.smithi133.stderr: -881> 2023-12-18T10:21:19.667+0000 7fbf3e430640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-12-18T10:21:00.574998+0000 1=0+1) n(v1 rc2023-12-18T10:21:00.795324+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={6342=pAsLsXsFs/-@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55d39ac7e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.574998+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.576701+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.574998+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-12-18T10:21:00.795324+0000 3=0+3)","error_str":""},"return_code":-61} 2023-12-18T10:21:37.693 INFO:tasks.ceph.mds.c.smithi133.stderr: -2065> 2023-12-18T10:21:19.663+0000 7fdb0ccb9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-12-18T10:21:00.569841+0000 1=0+1) n(v3 rc2023-12-18T10:21:00.795324+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={6342=pAsLsXsFsx/AsLsXsFsx@9},l=6342 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5578a01ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.569841+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.795324+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.569841+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-12-18T10:21:00.795324+0000 6=0+6)","error_str":""},"return_code":-61} 2023-12-18T10:21:37.693 INFO:tasks.ceph.mds.c.smithi133.stderr: -1962> 2023-12-18T10:21:19.667+0000 7fdb12cc5640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-12-18T10:21:00.571547+0000 1=0+1) n(v4 rc2023-12-18T10:21:00.795324+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={6342=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x5578a01ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:21:00.571547+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:21:00.795324+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-12-18T10:21:00.571547+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-12-18T10:21:00.795324+0000 5=0+5)","error_str":""},"return_code":-61} 2023-12-18T10:21:37.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-18T10:21:37.730 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:21:37.732 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:21:37.739 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:21:37.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c0ec8c640 1 Processor -- start 2023-12-18T10:21:37.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c0ec8c640 1 -- start start 2023-12-18T10:21:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c0ec8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c08071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c0ec8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c08070df0 con 0x7f8c080cbff0 2023-12-18T10:21:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c0ec8c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0815a4f0 con 0x7f8c080ca410 2023-12-18T10:21:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c0ec8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0815aab0 con 0x7f8c08071870 2023-12-18T10:21:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c0d229640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8c080cbff0 0x7f8c080ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60692/0 (socket says 172.21.15.133:60692) 2023-12-18T10:21:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c0d229640 1 -- 172.21.15.133:0/4210006522 learned_addr learned my addr 172.21.15.133:0/4210006522 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:37.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.839+0000 7f8c07fff640 1 --2- 172.21.15.133:0/4210006522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c08071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c077fe640 1 -- 172.21.15.133:0/4210006522 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370153886 0 0) 0x7f8c08070df0 con 0x7f8c080cbff0 2023-12-18T10:21:37.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c077fe640 1 -- 172.21.15.133:0/4210006522 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf8003530 con 0x7f8c080cbff0 2023-12-18T10:21:37.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c077fe640 1 -- 172.21.15.133:0/4210006522 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808504460 0 0) 0x7f8c0815a4f0 con 0x7f8c080ca410 2023-12-18T10:21:37.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c077fe640 1 -- 172.21.15.133:0/4210006522 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c08070df0 con 0x7f8c080ca410 2023-12-18T10:21:37.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c07fff640 1 -- 172.21.15.133:0/4210006522 >> v1:172.21.15.142:6789/0 conn(0x7f8c080ca410 legacy=0x7f8c08159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c07fff640 1 -- 172.21.15.133:0/4210006522 >> v1:172.21.15.133:6789/0 conn(0x7f8c080cbff0 legacy=0x7f8c080ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c07fff640 1 -- 172.21.15.133:0/4210006522 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0815a7d0 con 0x7f8c08071870 2023-12-18T10:21:37.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c07fff640 1 --2- 172.21.15.133:0/4210006522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c08071cd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40097f0 tx=0x7f8bf401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca157bb8e888ce41 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c077fe640 1 -- 172.21.15.133:0/4210006522 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40ab600 con 0x7f8c08071870 2023-12-18T10:21:37.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c077fe640 1 -- 172.21.15.133:0/4210006522 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf40ab760 con 0x7f8c08071870 2023-12-18T10:21:37.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.843+0000 7f8c077fe640 1 -- 172.21.15.133:0/4210006522 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40abaf0 con 0x7f8c08071870 2023-12-18T10:21:37.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/4210006522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 msgr2=0x7f8c08071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 --2- 172.21.15.133:0/4210006522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c08071cd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40097f0 tx=0x7f8bf401c400 comp rx=0 tx=0).stop 2023-12-18T10:21:37.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/4210006522 shutdown_connections 2023-12-18T10:21:37.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 --2- 172.21.15.133:0/4210006522 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c08071cd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/4210006522 >> 172.21.15.133:0/4210006522 conn(0x7f8c0806a2a0 msgr2=0x7f8c080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:37.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/4210006522 shutdown_connections 2023-12-18T10:21:37.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/4210006522 wait complete. 2023-12-18T10:21:37.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 Processor -- start 2023-12-18T10:21:37.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- start start 2023-12-18T10:21:37.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c081519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c080ca410 0x7f8c080af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c080cbff0 0x7f8c08157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080aba40 con 0x7f8c080ca410 2023-12-18T10:21:37.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080c4700 con 0x7f8c080cbff0 2023-12-18T10:21:37.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ec8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080c49e0 con 0x7f8c08071870 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c080ca410 0x7f8c080af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c080ca410 0x7f8c080af400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43942/0 (socket says 172.21.15.133:43942) 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 -- 172.21.15.133:0/2549799044 learned_addr learned my addr 172.21.15.133:0/2549799044 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0d229640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c080cbff0 0x7f8c08157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c0ca28640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c081519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 -- 172.21.15.133:0/2549799044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 msgr2=0x7f8c081519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c081519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 -- 172.21.15.133:0/2549799044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c080cbff0 msgr2=0x7f8c08157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c080cbff0 0x7f8c08157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 -- 172.21.15.133:0/2549799044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4009420 con 0x7f8c080ca410 2023-12-18T10:21:37.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.847+0000 7f8c07fff640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c080ca410 0x7f8c080af400 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40ad040 tx=0x7f8bf401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c057fa640 1 -- 172.21.15.133:0/2549799044 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40bf610 con 0x7f8c080ca410 2023-12-18T10:21:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c057fa640 1 -- 172.21.15.133:0/2549799044 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf40bf7b0 con 0x7f8c080ca410 2023-12-18T10:21:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c057fa640 1 -- 172.21.15.133:0/2549799044 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40bfb60 con 0x7f8c080ca410 2023-12-18T10:21:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c080c4cc0 con 0x7f8c080ca410 2023-12-18T10:21:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c08151f00 con 0x7f8c080ca410 2023-12-18T10:21:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c080abb80 con 0x7f8c080ca410 2023-12-18T10:21:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c057fa640 1 -- 172.21.15.133:0/2549799044 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8bf40b5400 con 0x7f8c080ca410 2023-12-18T10:21:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c057fa640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8bec065a60 0x7f8bec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c057fa640 1 -- 172.21.15.133:0/2549799044 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f8bf411df90 con 0x7f8c080ca410 2023-12-18T10:21:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c0ca28640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8bec065a60 0x7f8bec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.851+0000 7f8c0ca28640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8bec065a60 0x7f8bec067f20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0011f0 tx=0x7f8bfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:37.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:37.855+0000 7f8c057fa640 1 -- 172.21.15.133:0/2549799044 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8c080abb80 con 0x7f8c080ca410 2023-12-18T10:21:38.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.043+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8c080abb80 con 0x7f8c080ca410 2023-12-18T10:21:38.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.671+0000 7f8c057fa640 1 -- 172.21.15.133:0/2549799044 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8c080abb80 con 0x7f8c080ca410 2023-12-18T10:21:38.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8bec065a60 msgr2=0x7f8bec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:38.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8bec065a60 0x7f8bec067f20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0011f0 tx=0x7f8bfc009040 comp rx=0 tx=0).stop 2023-12-18T10:21:38.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c080ca410 msgr2=0x7f8c080af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:38.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c080ca410 0x7f8c080af400 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40ad040 tx=0x7f8bf401ac40 comp rx=0 tx=0).stop 2023-12-18T10:21:38.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 shutdown_connections 2023-12-18T10:21:38.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8bec065a60 0x7f8bec067f20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c080cbff0 0x7f8c08157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c080ca410 0x7f8c080af400 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 --2- 172.21.15.133:0/2549799044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c08071870 0x7f8c081519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 >> 172.21.15.133:0/2549799044 conn(0x7f8c0806a2a0 msgr2=0x7f8c0815ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:38.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 shutdown_connections 2023-12-18T10:21:38.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.675+0000 7f8c0ec8c640 1 -- 172.21.15.133:0/2549799044 wait complete. 2023-12-18T10:21:38.700 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-18T10:21:38.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.879+0000 7f0844ec4640 1 Processor -- start 2023-12-18T10:21:38.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.879+0000 7f0844ec4640 1 -- start start 2023-12-18T10:21:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0844ec4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08400ce5d0 0x7f08400ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0844ec4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f084006d440 0x7f084006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0844ec4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08400b28a0 con 0x7f084015e2d0 2023-12-18T10:21:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0844ec4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08400ac1a0 con 0x7f084006d440 2023-12-18T10:21:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0844ec4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08400ceef0 con 0x7f08400ce5d0 2023-12-18T10:21:38.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0837fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f084006d440 0x7f084006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0837fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f084006d440 0x7f084006d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43956/0 (socket says 172.21.15.133:43956) 2023-12-18T10:21:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0837fff640 1 -- 172.21.15.133:0/3898725162 learned_addr learned my addr 172.21.15.133:0/3898725162 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f083e59c640 1 --2- 172.21.15.133:0/3898725162 >> v2:172.21.15.142:3300/0 conn(0x7f08400ce5d0 0x7f08400ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0837fff640 1 -- 172.21.15.133:0/3898725162 >> v2:172.21.15.142:3300/0 conn(0x7f08400ce5d0 msgr2=0x7f08400ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0837fff640 1 --2- 172.21.15.133:0/3898725162 >> v2:172.21.15.142:3300/0 conn(0x7f08400ce5d0 0x7f08400ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0837fff640 1 -- 172.21.15.133:0/3898725162 >> v1:172.21.15.142:6789/0 conn(0x7f084015e2d0 legacy=0x7f084015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0837fff640 1 -- 172.21.15.133:0/3898725162 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084015ab30 con 0x7f084006d440 2023-12-18T10:21:38.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f083e59c640 1 --2- 172.21.15.133:0/3898725162 >> v2:172.21.15.142:3300/0 conn(0x7f08400ce5d0 0x7f08400ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:38.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.883+0000 7f0837fff640 1 --2- 172.21.15.133:0/3898725162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084006d440 0x7f084006d8a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f084006ac50 tx=0x7f082801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf5001467dfe72d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:38.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f083dd9b640 1 -- 172.21.15.133:0/3898725162 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280aa430 con 0x7f084006d440 2023-12-18T10:21:38.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f083dd9b640 1 -- 172.21.15.133:0/3898725162 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08280aa590 con 0x7f084006d440 2023-12-18T10:21:38.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f083dd9b640 1 -- 172.21.15.133:0/3898725162 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280aa920 con 0x7f084006d440 2023-12-18T10:21:38.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- 172.21.15.133:0/3898725162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084006d440 msgr2=0x7f084006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:38.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 --2- 172.21.15.133:0/3898725162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084006d440 0x7f084006d8a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f084006ac50 tx=0x7f082801c4d0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- 172.21.15.133:0/3898725162 shutdown_connections 2023-12-18T10:21:38.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 --2- 172.21.15.133:0/3898725162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084006d440 0x7f084006d8a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 --2- 172.21.15.133:0/3898725162 >> v2:172.21.15.142:3300/0 conn(0x7f08400ce5d0 0x7f08400ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- 172.21.15.133:0/3898725162 >> 172.21.15.133:0/3898725162 conn(0x7f0840069e70 msgr2=0x7f084006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:38.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- 172.21.15.133:0/3898725162 shutdown_connections 2023-12-18T10:21:38.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- 172.21.15.133:0/3898725162 wait complete. 2023-12-18T10:21:38.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 Processor -- start 2023-12-18T10:21:38.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- start start 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006d440 0x7f0840157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400ce5d0 0x7f084015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084015e2d0 0x7f08400c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401476b0 con 0x7f084015e2d0 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08400c48a0 con 0x7f084006d440 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f0844ec4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084015bdf0 con 0x7f08400ce5d0 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f083ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084015e2d0 0x7f08400c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f083ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084015e2d0 0x7f08400c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43962/0 (socket says 172.21.15.133:43962) 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.887+0000 7f083ed9d640 1 -- 172.21.15.133:0/1967260701 learned_addr learned my addr 172.21.15.133:0/1967260701 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f083e59c640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006d440 0x7f0840157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0837fff640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400ce5d0 0x7f084015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:38.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f083ed9d640 1 -- 172.21.15.133:0/1967260701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400ce5d0 msgr2=0x7f084015b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:38.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f083ed9d640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400ce5d0 0x7f084015b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f083ed9d640 1 -- 172.21.15.133:0/1967260701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006d440 msgr2=0x7f0840157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:38.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f083ed9d640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006d440 0x7f0840157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:38.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f083ed9d640 1 -- 172.21.15.133:0/1967260701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280094d0 con 0x7f084015e2d0 2023-12-18T10:21:38.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f083ed9d640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084015e2d0 0x7f08400c4360 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f083800c770 tx=0x7f083800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:38.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0836ffd640 1 -- 172.21.15.133:0/1967260701 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838003b80 con 0x7f084015e2d0 2023-12-18T10:21:38.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0836ffd640 1 -- 172.21.15.133:0/1967260701 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838003ce0 con 0x7f084015e2d0 2023-12-18T10:21:38.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084015c0d0 con 0x7f084015e2d0 2023-12-18T10:21:38.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0836ffd640 1 -- 172.21.15.133:0/1967260701 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800aa90 con 0x7f084015e2d0 2023-12-18T10:21:38.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084015c690 con 0x7f084015e2d0 2023-12-18T10:21:38.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084004e070 con 0x7f084015e2d0 2023-12-18T10:21:38.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0836ffd640 1 -- 172.21.15.133:0/1967260701 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f083800abf0 con 0x7f084015e2d0 2023-12-18T10:21:38.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0836ffd640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0820065a90 0x7f0820067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:38.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f0836ffd640 1 -- 172.21.15.133:0/1967260701 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f0838082ff0 con 0x7f084015e2d0 2023-12-18T10:21:38.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.891+0000 7f083e59c640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0820065a90 0x7f0820067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.895+0000 7f083e59c640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0820065a90 0x7f0820067f50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f08300045f0 tx=0x7f0830008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:38.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:38.899+0000 7f0836ffd640 1 -- 172.21.15.133:0/1967260701 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f08380508b0 con 0x7f084015e2d0 2023-12-18T10:21:39.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.047+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f084006cdf0 con 0x7f084015e2d0 2023-12-18T10:21:39.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0836ffd640 1 -- 172.21.15.133:0/1967260701 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0838053ed0 con 0x7f084015e2d0 2023-12-18T10:21:39.682 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0820065a90 msgr2=0x7f0820067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0820065a90 0x7f0820067f50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f08300045f0 tx=0x7f0830008040 comp rx=0 tx=0).stop 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084015e2d0 msgr2=0x7f08400c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084015e2d0 0x7f08400c4360 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f083800c770 tx=0x7f083800cc30 comp rx=0 tx=0).stop 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 shutdown_connections 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0820065a90 0x7f0820067f50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f084015e2d0 0x7f08400c4360 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08400ce5d0 0x7f084015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 --2- 172.21.15.133:0/1967260701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f084006d440 0x7f0840157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 >> 172.21.15.133:0/1967260701 conn(0x7f0840069e70 msgr2=0x7f08400c5470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:39.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 shutdown_connections 2023-12-18T10:21:39.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.679+0000 7f0844ec4640 1 -- 172.21.15.133:0/1967260701 wait complete. 2023-12-18T10:21:39.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-18T10:21:39.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.847+0000 7f1c42398640 1 Processor -- start 2023-12-18T10:21:39.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.847+0000 7f1c42398640 1 -- start start 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c42398640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c0719b0 0x7f1c3c0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c42398640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1c3c0cb2b0 0x7f1c3c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c42398640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c0cb730 con 0x7f1c3c0b2da0 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c42398640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c06cbb0 con 0x7f1c3c0cb2b0 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c42398640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0cd2a0 con 0x7f1c3c0719b0 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c40935640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1c3c0b2da0 0x7f1c3c15b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60698/0 (socket says 172.21.15.133:60698) 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c40935640 1 -- 172.21.15.133:0/1894351267 learned_addr learned my addr 172.21.15.133:0/1894351267 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3b7fe640 1 --2- 172.21.15.133:0/1894351267 >> v2:172.21.15.142:3300/0 conn(0x7f1c3c0cb2b0 0x7f1c3c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3bfff640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c0719b0 0x7f1c3c0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569917639 0 0) 0x7f1c3c0cb730 con 0x7f1c3c0b2da0 2023-12-18T10:21:39.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c24005740 con 0x7f1c3c0b2da0 2023-12-18T10:21:39.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1306821687 0 0) 0x7f1c24005740 con 0x7f1c3c0b2da0 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c0719b0 msgr2=0x7f1c3c0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c0719b0 0x7f1c3c0cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 >> v2:172.21.15.142:3300/0 conn(0x7f1c3c0cb2b0 msgr2=0x7f1c3c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 --2- 172.21.15.133:0/1894351267 >> v2:172.21.15.142:3300/0 conn(0x7f1c3c0cb2b0 0x7f1c3c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0b2200 con 0x7f1c3c0b2da0 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f1c34001a00 con 0x7f1c3c0b2da0 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3b7fe640 1 --2- 172.21.15.133:0/1894351267 >> v2:172.21.15.142:3300/0 conn(0x7f1c3c0cb2b0 0x7f1c3c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 >> v1:172.21.15.133:6789/0 conn(0x7f1c3c0b2da0 legacy=0x7f1c3c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c24005b90 0x7f1c24005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c240069e0 0x7f1c24006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240073a0 0x7f1c2400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c06cbb0 con 0x7f1c240069e0 2023-12-18T10:21:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2400e0e0 con 0x7f1c24005b90 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2400e220 con 0x7f1c240073a0 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3bfff640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c0719b0 0x7f1c3c0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3b7fe640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c240069e0 0x7f1c24006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c40935640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240073a0 0x7f1c2400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3bfff640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c24005b90 0x7f1c24005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3b7fe640 1 -- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240073a0 msgr2=0x7f1c2400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3b7fe640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c240073a0 0x7f1c2400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3b7fe640 1 -- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c24005b90 msgr2=0x7f1c24005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3b7fe640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c24005b90 0x7f1c24005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3b7fe640 1 -- 172.21.15.133:0/1894351267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24005740 con 0x7f1c240069e0 2023-12-18T10:21:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.851+0000 7f1c3bfff640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c24005b90 0x7f1c24005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c3b7fe640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c240069e0 0x7f1c24006e60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009ce0 tx=0x7f1c3001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38682df59da2a69f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c300a5800 con 0x7f1c240069e0 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300a5960 con 0x7f1c240069e0 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c3affd640 1 -- 172.21.15.133:0/1894351267 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c300a5d10 con 0x7f1c240069e0 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c42398640 1 -- 172.21.15.133:0/1894351267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c240069e0 msgr2=0x7f1c24006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c42398640 1 --2- 172.21.15.133:0/1894351267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c240069e0 0x7f1c24006e60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009ce0 tx=0x7f1c3001cc50 comp rx=0 tx=0).stop 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c40935640 1 -- 172.21.15.133:0/1894351267 reap_dead start 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c42398640 1 -- 172.21.15.133:0/1894351267 shutdown_connections 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c42398640 1 -- 172.21.15.133:0/1894351267 >> 172.21.15.133:0/1894351267 conn(0x7f1c3c069e70 msgr2=0x7f1c3c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c42398640 1 -- 172.21.15.133:0/1894351267 shutdown_connections 2023-12-18T10:21:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.855+0000 7f1c42398640 1 -- 172.21.15.133:0/1894351267 wait complete. 2023-12-18T10:21:39.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 Processor -- start 2023-12-18T10:21:39.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 -- start start 2023-12-18T10:21:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240069e0 0x7f1c3c15c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c15cdc0 0x7f1c3c0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c3c15d310 0x7f1c3c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c83f0 con 0x7f1c3c15d310 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c77e0 con 0x7f1c240069e0 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c7ac0 con 0x7f1c3c15cdc0 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c3c15d310 0x7f1c3c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c3c15d310 0x7f1c3c0ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43976/0 (socket says 172.21.15.133:43976) 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 -- 172.21.15.133:0/4119888297 learned_addr learned my addr 172.21.15.133:0/4119888297 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c3b7fe640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c15cdc0 0x7f1c3c0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c3bfff640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240069e0 0x7f1c3c15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 -- 172.21.15.133:0/4119888297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c15cdc0 msgr2=0x7f1c3c0ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c15cdc0 0x7f1c3c0ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 -- 172.21.15.133:0/4119888297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240069e0 msgr2=0x7f1c3c15c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240069e0 0x7f1c3c15c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 -- 172.21.15.133:0/4119888297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0c7da0 con 0x7f1c3c15d310 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c40935640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c3c15d310 0x7f1c3c0ab6d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1c34002240 tx=0x7f1c34011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c38ff9640 1 -- 172.21.15.133:0/4119888297 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400f8a0 con 0x7f1c3c15d310 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c38ff9640 1 -- 172.21.15.133:0/4119888297 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3400fa20 con 0x7f1c3c15d310 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c0c8080 con 0x7f1c3c15d310 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c38ff9640 1 -- 172.21.15.133:0/4119888297 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400fdd0 con 0x7f1c3c15d310 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c15ca60 con 0x7f1c3c15d310 2023-12-18T10:21:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.859+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c0c8210 con 0x7f1c3c15d310 2023-12-18T10:21:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.863+0000 7f1c38ff9640 1 -- 172.21.15.133:0/4119888297 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1c3401f460 con 0x7f1c3c15d310 2023-12-18T10:21:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.863+0000 7f1c38ff9640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c28065a60 0x7f1c28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.863+0000 7f1c38ff9640 1 -- 172.21.15.133:0/4119888297 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f1c34086090 con 0x7f1c3c15d310 2023-12-18T10:21:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.863+0000 7f1c3bfff640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c28065a60 0x7f1c28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.863+0000 7f1c3bfff640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c28065a60 0x7f1c28067f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c06e000 tx=0x7f1c2c0040f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:39.867+0000 7f1c38ff9640 1 -- 172.21.15.133:0/4119888297 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1c340539d0 con 0x7f1c3c15d310 2023-12-18T10:21:40.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.019+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c3c04e070 con 0x7f1c3c15d310 2023-12-18T10:21:40.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.971+0000 7f1c38ff9640 1 -- 172.21.15.133:0/4119888297 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1c34056ff0 con 0x7f1c3c15d310 2023-12-18T10:21:40.975 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-18T10:21:40.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c28065a60 msgr2=0x7f1c28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:40.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c28065a60 0x7f1c28067f20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c06e000 tx=0x7f1c2c0040f0 comp rx=0 tx=0).stop 2023-12-18T10:21:40.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c3c15d310 msgr2=0x7f1c3c0ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:40.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c3c15d310 0x7f1c3c0ab6d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1c34002240 tx=0x7f1c34011c20 comp rx=0 tx=0).stop 2023-12-18T10:21:40.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 shutdown_connections 2023-12-18T10:21:40.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1c28065a60 0x7f1c28067f20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:40.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c3c15d310 0x7f1c3c0ab6d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:40.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1c3c15cdc0 0x7f1c3c0ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:40.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 --2- 172.21.15.133:0/4119888297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1c240069e0 0x7f1c3c15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:40.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 >> 172.21.15.133:0/4119888297 conn(0x7f1c3c069e70 msgr2=0x7f1c3c0ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:40.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 shutdown_connections 2023-12-18T10:21:40.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:40.975+0000 7f1c42398640 1 -- 172.21.15.133:0/4119888297 wait complete. 2023-12-18T10:21:41.009 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-18T10:21:41.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.147+0000 7f199c552640 1 Processor -- start 2023-12-18T10:21:41.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.147+0000 7f199c552640 1 -- start start 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199c552640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f19940c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199c552640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19940ce3b0 0x7f19940ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199c552640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19940c9390 con 0x7f1994070820 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199c552640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19940ced80 con 0x7f19940ce3b0 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199c552640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199415aee0 con 0x7f19941582d0 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199aaef640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19940ce3b0 0x7f19940ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f1999aed640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1994070820 0x7f19940ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60460/0 (socket says 172.21.15.133:60460) 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f1999aed640 1 -- 172.21.15.133:0/3343292760 learned_addr learned my addr 172.21.15.133:0/3343292760 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199a2ee640 1 --2- 172.21.15.133:0/3343292760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f19940c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199aaef640 1 -- 172.21.15.133:0/3343292760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 msgr2=0x7f19940c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:41.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199aaef640 1 --2- 172.21.15.133:0/3343292760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f19940c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199aaef640 1 -- 172.21.15.133:0/3343292760 >> v1:172.21.15.133:6789/0 conn(0x7f1994070820 legacy=0x7f19940ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199aaef640 1 -- 172.21.15.133:0/3343292760 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199415b1c0 con 0x7f19940ce3b0 2023-12-18T10:21:41.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f19992ec640 1 -- 172.21.15.133:0/3343292760 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806444494 0 0) 0x7f19940c9390 con 0x7f1994070820 2023-12-18T10:21:41.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199a2ee640 1 --2- 172.21.15.133:0/3343292760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f19940c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:41.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f199aaef640 1 --2- 172.21.15.133:0/3343292760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19940ce3b0 0x7f19940ce840 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f198c009d90 tx=0x7f198c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db11cf1170306f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:41.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f19992ec640 1 -- 172.21.15.133:0/3343292760 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0a59e0 con 0x7f19940ce3b0 2023-12-18T10:21:41.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f19992ec640 1 -- 172.21.15.133:0/3343292760 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c0a5b40 con 0x7f19940ce3b0 2023-12-18T10:21:41.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.151+0000 7f19992ec640 1 -- 172.21.15.133:0/3343292760 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0ad440 con 0x7f19940ce3b0 2023-12-18T10:21:41.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- 172.21.15.133:0/3343292760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19940ce3b0 msgr2=0x7f19940ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 --2- 172.21.15.133:0/3343292760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19940ce3b0 0x7f19940ce840 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f198c009d90 tx=0x7f198c01c920 comp rx=0 tx=0).stop 2023-12-18T10:21:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- 172.21.15.133:0/3343292760 shutdown_connections 2023-12-18T10:21:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 --2- 172.21.15.133:0/3343292760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19940ce3b0 0x7f19940ce840 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 --2- 172.21.15.133:0/3343292760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f19940c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- 172.21.15.133:0/3343292760 >> 172.21.15.133:0/3343292760 conn(0x7f199406a2a0 msgr2=0x7f19940aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- 172.21.15.133:0/3343292760 shutdown_connections 2023-12-18T10:21:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- 172.21.15.133:0/3343292760 wait complete. 2023-12-18T10:21:41.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 Processor -- start 2023-12-18T10:21:41.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- start start 2023-12-18T10:21:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1994070820 0x7f19940b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19940ce3b0 0x7f199415d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f1994150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199415c390 con 0x7f1994070820 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199414ac60 con 0x7f19940ce3b0 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199c552640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199415ced0 con 0x7f19941582d0 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199a2ee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1994070820 0x7f19940b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199a2ee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1994070820 0x7f19940b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39236/0 (socket says 172.21.15.133:39236) 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199a2ee640 1 -- 172.21.15.133:0/1718981974 learned_addr learned my addr 172.21.15.133:0/1718981974 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f1999aed640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19940ce3b0 0x7f199415d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199aaef640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f1994150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199a2ee640 1 -- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 msgr2=0x7f1994150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199a2ee640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f1994150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199a2ee640 1 -- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19940ce3b0 msgr2=0x7f199415d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.155+0000 7f199a2ee640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19940ce3b0 0x7f199415d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f199a2ee640 1 -- 172.21.15.133:0/1718981974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c009a70 con 0x7f1994070820 2023-12-18T10:21:41.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f1999aed640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19940ce3b0 0x7f199415d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:41.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f199a2ee640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1994070820 0x7f19940b37c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f199000d800 tx=0x7f199000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:41.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f198affd640 1 -- 172.21.15.133:0/1718981974 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000b6c0 con 0x7f1994070820 2023-12-18T10:21:41.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f198affd640 1 -- 172.21.15.133:0/1718981974 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000b820 con 0x7f1994070820 2023-12-18T10:21:41.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f198affd640 1 -- 172.21.15.133:0/1718981974 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000bbd0 con 0x7f1994070820 2023-12-18T10:21:41.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199415c5a0 con 0x7f1994070820 2023-12-18T10:21:41.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199415cb60 con 0x7f1994070820 2023-12-18T10:21:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199404e000 con 0x7f1994070820 2023-12-18T10:21:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f198affd640 1 -- 172.21.15.133:0/1718981974 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f199000bd30 con 0x7f1994070820 2023-12-18T10:21:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f198affd640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1978065a60 0x7f1978067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f198affd640 1 -- 172.21.15.133:0/1718981974 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f1990083600 con 0x7f1994070820 2023-12-18T10:21:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.159+0000 7f1999aed640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1978065a60 0x7f1978067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.163+0000 7f1999aed640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1978065a60 0x7f1978067f20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19940c5200 tx=0x7f1984007c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.163+0000 7f198affd640 1 -- 172.21.15.133:0/1718981974 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1990051030 con 0x7f1994070820 2023-12-18T10:21:41.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.315+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f19940ae0b0 con 0x7f1994070820 2023-12-18T10:21:41.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f198affd640 1 -- 172.21.15.133:0/1718981974 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1990054650 con 0x7f1994070820 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1978065a60 msgr2=0x7f1978067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1978065a60 0x7f1978067f20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19940c5200 tx=0x7f1984007c20 comp rx=0 tx=0).stop 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1994070820 msgr2=0x7f19940b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1994070820 0x7f19940b37c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f199000d800 tx=0x7f199000dcc0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 shutdown_connections 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1978065a60 0x7f1978067f20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19941582d0 0x7f1994150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19940ce3b0 0x7f199415d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 --2- 172.21.15.133:0/1718981974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1994070820 0x7f19940b37c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 >> 172.21.15.133:0/1718981974 conn(0x7f199406a2a0 msgr2=0x7f19940cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 shutdown_connections 2023-12-18T10:21:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.319+0000 7f199c552640 1 -- 172.21.15.133:0/1718981974 wait complete. 2023-12-18T10:21:41.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2023-12-18T10:21:41.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f9d8f640 1 Processor -- start 2023-12-18T10:21:41.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f9d8f640 1 -- start start 2023-12-18T10:21:41.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f9d8f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46f40cf0d0 0x7f46f40cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f9d8f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46f41648d0 0x7f46f4166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f9d8f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f40cfa70 con 0x7f46f415ca40 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f9d8f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f40d11c0 con 0x7f46f41648d0 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f9d8f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f40d0310 con 0x7f46f40cf0d0 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46f41648d0 0x7f46f4166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46f41648d0 0x7f46f4166cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39238/0 (socket says 172.21.15.133:39238) 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f3fff640 1 -- 172.21.15.133:0/1913515068 learned_addr learned my addr 172.21.15.133:0/1913515068 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f37fe640 1 --1- 172.21.15.133:0/1913515068 >> v1:172.21.15.133:6789/0 conn(0x7f46f415ca40 0x7f46f40cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60468/0 (socket says 172.21.15.133:60468) 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f2ffd640 1 --2- 172.21.15.133:0/1913515068 >> v2:172.21.15.142:3300/0 conn(0x7f46f40cf0d0 0x7f46f40cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f3fff640 1 -- 172.21.15.133:0/1913515068 >> v2:172.21.15.142:3300/0 conn(0x7f46f40cf0d0 msgr2=0x7f46f40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:41.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f3fff640 1 --2- 172.21.15.133:0/1913515068 >> v2:172.21.15.142:3300/0 conn(0x7f46f40cf0d0 0x7f46f40cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f3fff640 1 -- 172.21.15.133:0/1913515068 >> v1:172.21.15.133:6789/0 conn(0x7f46f415ca40 legacy=0x7f46f40cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.483+0000 7f46f3fff640 1 -- 172.21.15.133:0/1913515068 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f40d05b0 con 0x7f46f41648d0 2023-12-18T10:21:41.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f3fff640 1 --2- 172.21.15.133:0/1913515068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f4166cc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f46f40d26d0 tx=0x7f46ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58b06387e844e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:41.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f27fc640 1 -- 172.21.15.133:0/1913515068 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0aa430 con 0x7f46f41648d0 2023-12-18T10:21:41.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f27fc640 1 -- 172.21.15.133:0/1913515068 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec0aa590 con 0x7f46f41648d0 2023-12-18T10:21:41.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f27fc640 1 -- 172.21.15.133:0/1913515068 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0aa920 con 0x7f46f41648d0 2023-12-18T10:21:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f9d8f640 1 -- 172.21.15.133:0/1913515068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 msgr2=0x7f46f4166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/1913515068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f4166cc0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f46f40d26d0 tx=0x7f46ec01c4d0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f9d8f640 1 -- 172.21.15.133:0/1913515068 shutdown_connections 2023-12-18T10:21:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/1913515068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f4166cc0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/1913515068 >> v2:172.21.15.142:3300/0 conn(0x7f46f40cf0d0 0x7f46f40cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f9d8f640 1 -- 172.21.15.133:0/1913515068 >> 172.21.15.133:0/1913515068 conn(0x7f46f4089fb0 msgr2=0x7f46f40d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f9d8f640 1 -- 172.21.15.133:0/1913515068 shutdown_connections 2023-12-18T10:21:41.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.487+0000 7f46f9d8f640 1 -- 172.21.15.133:0/1913515068 wait complete. 2023-12-18T10:21:41.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 Processor -- start 2023-12-18T10:21:41.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 -- start start 2023-12-18T10:21:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46f40cf0d0 0x7f46f40afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46f415ca40 0x7f46f4156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f41516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f41568a0 con 0x7f46f41648d0 2023-12-18T10:21:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4155b80 con 0x7f46f40cf0d0 2023-12-18T10:21:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f4154fb0 con 0x7f46f415ca40 2023-12-18T10:21:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f41516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f41516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39252/0 (socket says 172.21.15.133:39252) 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 -- 172.21.15.133:0/4086052375 learned_addr learned my addr 172.21.15.133:0/4086052375 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f37fe640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46f40cf0d0 0x7f46f40afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f2ffd640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46f415ca40 0x7f46f4156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 -- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46f415ca40 msgr2=0x7f46f4156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46f415ca40 0x7f46f4156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 -- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46f40cf0d0 msgr2=0x7f46f40afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46f40cf0d0 0x7f46f40afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 -- 172.21.15.133:0/4086052375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0094d0 con 0x7f46f41648d0 2023-12-18T10:21:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f37fe640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46f40cf0d0 0x7f46f40afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:41.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f3fff640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f41516c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0ac040 tx=0x7f46ec01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46dbfff640 1 -- 172.21.15.133:0/4086052375 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0aa430 con 0x7f46f41648d0 2023-12-18T10:21:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46dbfff640 1 -- 172.21.15.133:0/4086052375 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec0b3800 con 0x7f46f41648d0 2023-12-18T10:21:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46dbfff640 1 -- 172.21.15.133:0/4086052375 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0b3bb0 con 0x7f46f41648d0 2023-12-18T10:21:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f4155250 con 0x7f46f41648d0 2023-12-18T10:21:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.491+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f4155810 con 0x7f46f41648d0 2023-12-18T10:21:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.495+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f4155d10 con 0x7f46f41648d0 2023-12-18T10:21:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.495+0000 7f46dbfff640 1 -- 172.21.15.133:0/4086052375 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f46ec0b3d10 con 0x7f46f41648d0 2023-12-18T10:21:41.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.495+0000 7f46dbfff640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46e0065a60 0x7f46e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:41.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.495+0000 7f46dbfff640 1 -- 172.21.15.133:0/4086052375 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f46ec11d4f0 con 0x7f46f41648d0 2023-12-18T10:21:41.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.495+0000 7f46f37fe640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46e0065a60 0x7f46e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:41.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.495+0000 7f46f37fe640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46e0065a60 0x7f46e0067f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f46e40013b0 tx=0x7f46e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.499+0000 7f46dbfff640 1 -- 172.21.15.133:0/4086052375 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f46ec0eb070 con 0x7f46f41648d0 2023-12-18T10:21:41.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.699+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) v1 -- 0x7f46f404e000 con 0x7f46f41648d0 2023-12-18T10:21:41.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.971+0000 7f46dbfff640 1 -- 172.21.15.133:0/4086052375 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v204) v1 ==== 143+0+0 (secure 0 0 0) 0x7f46ec0ee690 con 0x7f46f41648d0 2023-12-18T10:21:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46e0065a60 msgr2=0x7f46e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46e0065a60 0x7f46e0067f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f46e40013b0 tx=0x7f46e4009040 comp rx=0 tx=0).stop 2023-12-18T10:21:41.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 msgr2=0x7f46f41516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f41516c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0ac040 tx=0x7f46ec01ad10 comp rx=0 tx=0).stop 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 shutdown_connections 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46e0065a60 0x7f46e0067f20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46f41648d0 0x7f46f41516c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46f415ca40 0x7f46f4156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 --2- 172.21.15.133:0/4086052375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46f40cf0d0 0x7f46f40afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 >> 172.21.15.133:0/4086052375 conn(0x7f46f4089fb0 msgr2=0x7f46f40ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 shutdown_connections 2023-12-18T10:21:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:41.975+0000 7f46f9d8f640 1 -- 172.21.15.133:0/4086052375 wait complete. 2023-12-18T10:21:41.999 INFO:tasks.cephfs_test_runner:test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-12-18T10:21:42.000 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-12-18T10:21:42.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189ca41640 1 Processor -- start 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189ca41640 1 -- start start 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189ca41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1898069ca0 0x7f189806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189ca41640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18980ccde0 con 0x7f18980cdc20 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189ca41640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189806a5c0 con 0x7f189815caf0 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189ca41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980cc600 con 0x7f1898069ca0 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f1896d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f18980cdc20 0x7f18980717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60472/0 (socket says 172.21.15.133:60472) 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f1896d9d640 1 -- 172.21.15.133:0/867701163 learned_addr learned my addr 172.21.15.133:0/867701163 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189659c640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1898069ca0 0x7f189806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:42.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959938576 0 0) 0x7f18980ccde0 con 0x7f18980cdc20 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1880003530 con 0x7f18980cdc20 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287228931 0 0) 0x7f189806a5c0 con 0x7f189815caf0 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18980ccde0 con 0x7f189815caf0 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1457878300 0 0) 0x7f1880003530 con 0x7f18980cdc20 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1898069ca0 msgr2=0x7f189806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1898069ca0 0x7f189806a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 >> v1:172.21.15.142:6789/0 conn(0x7f189815caf0 legacy=0x7f18980cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18980cc820 con 0x7f18980cdc20 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f1890001680 con 0x7f18980cdc20 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 >> v1:172.21.15.133:6789/0 conn(0x7f18980cdc20 legacy=0x7f18980717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880003b40 0x7f1880003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1898069ca0 0x7f18800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1880004d10 0x7f1880005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:42.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18980cc600 con 0x7f1880004d10 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188000ba40 con 0x7f1880003b40 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188000bbb0 con 0x7f1898069ca0 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f1896d9d640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1880004d10 0x7f1880005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f189659c640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880003b40 0x7f1880003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.135+0000 7f1895d9b640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1898069ca0 0x7f18800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f1896d9d640 1 -- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1898069ca0 msgr2=0x7f18800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f1896d9d640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1898069ca0 0x7f18800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f1896d9d640 1 -- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880003b40 msgr2=0x7f1880003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f1896d9d640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880003b40 0x7f1880003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f1896d9d640 1 -- 172.21.15.133:0/867701163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880003530 con 0x7f1880004d10 2023-12-18T10:21:42.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f1896d9d640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1880004d10 0x7f1880005190 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f189000c160 tx=0x7f189001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde1dae3f64f039 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:42.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890005ae0 con 0x7f1880004d10 2023-12-18T10:21:42.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18900ab070 con 0x7f1880004d10 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f189559a640 1 -- 172.21.15.133:0/867701163 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890005ea0 con 0x7f1880004d10 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f189ca41640 1 -- 172.21.15.133:0/867701163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1880004d10 msgr2=0x7f1880005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f189ca41640 1 --2- 172.21.15.133:0/867701163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1880004d10 0x7f1880005190 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f189000c160 tx=0x7f189001f310 comp rx=0 tx=0).stop 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f1896d9d640 1 -- 172.21.15.133:0/867701163 reap_dead start 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f189ca41640 1 -- 172.21.15.133:0/867701163 shutdown_connections 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.139+0000 7f189ca41640 1 -- 172.21.15.133:0/867701163 >> 172.21.15.133:0/867701163 conn(0x7f189806cf80 msgr2=0x7f189806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 -- 172.21.15.133:0/867701163 shutdown_connections 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 -- 172.21.15.133:0/867701163 wait complete. 2023-12-18T10:21:42.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 Processor -- start 2023-12-18T10:21:42.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 -- start start 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880004d10 0x7f1898152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18980c3050 0x7f18980c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18980b3c40 0x7f18980b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18980b4600 con 0x7f18980c3050 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1898153000 con 0x7f1880004d10 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189ca41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980c3b10 con 0x7f18980b3c40 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18980c3050 0x7f18980c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18980c3050 0x7f18980c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39272/0 (socket says 172.21.15.133:39272) 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 -- 172.21.15.133:0/79826577 learned_addr learned my addr 172.21.15.133:0/79826577 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189659c640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880004d10 0x7f1898152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1896d9d640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18980b3c40 0x7f18980b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 -- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18980b3c40 msgr2=0x7f18980b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:42.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18980b3c40 0x7f18980b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 -- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880004d10 msgr2=0x7f1898152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880004d10 0x7f1898152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 -- 172.21.15.133:0/79826577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18980c3df0 con 0x7f18980c3050 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f189659c640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880004d10 0x7f1898152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.143+0000 7f1895d9b640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18980c3050 0x7f18980c34d0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e7e0 tx=0x7f188c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f1886ffd640 1 -- 172.21.15.133:0/79826577 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c0050d0 con 0x7f18980c3050 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f1886ffd640 1 -- 172.21.15.133:0/79826577 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c005250 con 0x7f18980c3050 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f1886ffd640 1 -- 172.21.15.133:0/79826577 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00c6c0 con 0x7f18980c3050 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18980c40d0 con 0x7f18980c3050 2023-12-18T10:21:42.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18980c4710 con 0x7f18980c3050 2023-12-18T10:21:42.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189804e000 con 0x7f18980c3050 2023-12-18T10:21:42.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f1886ffd640 1 -- 172.21.15.133:0/79826577 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f188c00c820 con 0x7f18980c3050 2023-12-18T10:21:42.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f1886ffd640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1878065a90 0x7f1878067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:42.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f1886ffd640 1 -- 172.21.15.133:0/79826577 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f188c082e90 con 0x7f18980c3050 2023-12-18T10:21:42.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f189659c640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1878065a90 0x7f1878067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:42.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.147+0000 7f189659c640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1878065a90 0x7f1878067f50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f18880074d0 tx=0x7f188800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:42.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.151+0000 7f1886ffd640 1 -- 172.21.15.133:0/79826577 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f188c0509d0 con 0x7f18980c3050 2023-12-18T10:21:42.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.355+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) v1 -- 0x7f18980b10e0 con 0x7f18980c3050 2023-12-18T10:21:42.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.975+0000 7f1886ffd640 1 -- 172.21.15.133:0/79826577 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v205) v1 ==== 145+0+0 (secure 0 0 0) 0x7f188c053ff0 con 0x7f18980c3050 2023-12-18T10:21:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1878065a90 msgr2=0x7f1878067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1878065a90 0x7f1878067f50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f18880074d0 tx=0x7f188800b040 comp rx=0 tx=0).stop 2023-12-18T10:21:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18980c3050 msgr2=0x7f18980c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18980c3050 0x7f18980c34d0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e7e0 tx=0x7f188c00eca0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 shutdown_connections 2023-12-18T10:21:42.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1878065a90 0x7f1878067f50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18980b3c40 0x7f18980b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18980c3050 0x7f18980c34d0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 --2- 172.21.15.133:0/79826577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1880004d10 0x7f1898152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 >> 172.21.15.133:0/79826577 conn(0x7f189806cf80 msgr2=0x7f189815f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 shutdown_connections 2023-12-18T10:21:42.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:42.979+0000 7f189ca41640 1 -- 172.21.15.133:0/79826577 wait complete. 2023-12-18T10:21:43.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-18T10:21:43.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a1e325640 1 Processor -- start 2023-12-18T10:21:43.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a1e325640 1 -- start start 2023-12-18T10:21:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a1e325640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a18161240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a1e325640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a180cad80 con 0x7f8a180b2780 2023-12-18T10:21:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a1e325640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a180cb020 con 0x7f8a1806afc0 2023-12-18T10:21:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a1e325640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180cf1d0 con 0x7f8a1815c910 2023-12-18T10:21:43.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a1c8c2640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8a180b2780 0x7f8a180cb500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60478/0 (socket says 172.21.15.133:60478) 2023-12-18T10:21:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a1c8c2640 1 -- 172.21.15.133:0/3517216102 learned_addr learned my addr 172.21.15.133:0/3517216102 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.139+0000 7f8a17fff640 1 --2- 172.21.15.133:0/3517216102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a18161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a16ffd640 1 -- 172.21.15.133:0/3517216102 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88621473 0 0) 0x7f8a180cb020 con 0x7f8a1806afc0 2023-12-18T10:21:43.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a16ffd640 1 -- 172.21.15.133:0/3517216102 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a00003530 con 0x7f8a1806afc0 2023-12-18T10:21:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a16ffd640 1 -- 172.21.15.133:0/3517216102 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005362755 0 0) 0x7f8a180cad80 con 0x7f8a180b2780 2023-12-18T10:21:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a17fff640 1 -- 172.21.15.133:0/3517216102 >> v1:172.21.15.142:6789/0 conn(0x7f8a1806afc0 legacy=0x7f8a180b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a17fff640 1 -- 172.21.15.133:0/3517216102 >> v1:172.21.15.133:6789/0 conn(0x7f8a180b2780 legacy=0x7f8a180cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a17fff640 1 -- 172.21.15.133:0/3517216102 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a180ce930 con 0x7f8a1815c910 2023-12-18T10:21:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a17fff640 1 --2- 172.21.15.133:0/3517216102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a18161240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a080097d0 tx=0x7f8a0801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea70a58c694a82ba server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a16ffd640 1 -- 172.21.15.133:0/3517216102 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080ab670 con 0x7f8a1815c910 2023-12-18T10:21:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a16ffd640 1 -- 172.21.15.133:0/3517216102 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a080ab7d0 con 0x7f8a1815c910 2023-12-18T10:21:43.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.143+0000 7f8a16ffd640 1 -- 172.21.15.133:0/3517216102 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080abb60 con 0x7f8a1815c910 2023-12-18T10:21:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- 172.21.15.133:0/3517216102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 msgr2=0x7f8a18161240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 --2- 172.21.15.133:0/3517216102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a18161240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a080097d0 tx=0x7f8a0801c470 comp rx=0 tx=0).stop 2023-12-18T10:21:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- 172.21.15.133:0/3517216102 shutdown_connections 2023-12-18T10:21:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 --2- 172.21.15.133:0/3517216102 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a18161240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- 172.21.15.133:0/3517216102 >> 172.21.15.133:0/3517216102 conn(0x7f8a180cd070 msgr2=0x7f8a180cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- 172.21.15.133:0/3517216102 shutdown_connections 2023-12-18T10:21:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- 172.21.15.133:0/3517216102 wait complete. 2023-12-18T10:21:43.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 Processor -- start 2023-12-18T10:21:43.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- start start 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1806afc0 0x7f8a180ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a180b2780 0x7f8a181546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a180b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180b36a0 con 0x7f8a180b2780 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180c60c0 con 0x7f8a1806afc0 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a1e325640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180b38d0 con 0x7f8a1815c910 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a177fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a180b2780 0x7f8a181546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a177fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a180b2780 0x7f8a181546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39274/0 (socket says 172.21.15.133:39274) 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.147+0000 7f8a177fe640 1 -- 172.21.15.133:0/1534275900 learned_addr learned my addr 172.21.15.133:0/1534275900 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a1c8c2640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a180b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a17fff640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1806afc0 0x7f8a180ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a177fe640 1 -- 172.21.15.133:0/1534275900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 msgr2=0x7f8a180b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a177fe640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a180b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a177fe640 1 -- 172.21.15.133:0/1534275900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1806afc0 msgr2=0x7f8a180ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a177fe640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1806afc0 0x7f8a180ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a177fe640 1 -- 172.21.15.133:0/1534275900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080093b0 con 0x7f8a180b2780 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a177fe640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a180b2780 0x7f8a181546e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00c500 tx=0x7f8a0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a14ff9640 1 -- 172.21.15.133:0/1534275900 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0052d0 con 0x7f8a180b2780 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a14ff9640 1 -- 172.21.15.133:0/1534275900 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c005430 con 0x7f8a180b2780 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a14ff9640 1 -- 172.21.15.133:0/1534275900 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c003820 con 0x7f8a180b2780 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a180c5820 con 0x7f8a180b2780 2023-12-18T10:21:43.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a180c5de0 con 0x7f8a180b2780 2023-12-18T10:21:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a180c7a60 con 0x7f8a180b2780 2023-12-18T10:21:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a14ff9640 1 -- 172.21.15.133:0/1534275900 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8a0c003980 con 0x7f8a180b2780 2023-12-18T10:21:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a14ff9640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a04065a60 0x7f8a04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.151+0000 7f8a14ff9640 1 -- 172.21.15.133:0/1534275900 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f8a0c0826b0 con 0x7f8a180b2780 2023-12-18T10:21:43.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.155+0000 7f8a17fff640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a04065a60 0x7f8a04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.155+0000 7f8a17fff640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a04065a60 0x7f8a04067f20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a080af000 tx=0x7f8a080b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:43.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.159+0000 7f8a14ff9640 1 -- 172.21.15.133:0/1534275900 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8a180c7a60 con 0x7f8a180b2780 2023-12-18T10:21:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.307+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8a180c7a60 con 0x7f8a180b2780 2023-12-18T10:21:43.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.311+0000 7f8a14ff9640 1 -- 172.21.15.133:0/1534275900 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8a180c7a60 con 0x7f8a180b2780 2023-12-18T10:21:43.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a04065a60 msgr2=0x7f8a04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a04065a60 0x7f8a04067f20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a080af000 tx=0x7f8a080b6040 comp rx=0 tx=0).stop 2023-12-18T10:21:43.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a180b2780 msgr2=0x7f8a181546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a180b2780 0x7f8a181546e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00c500 tx=0x7f8a0c00c9c0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 shutdown_connections 2023-12-18T10:21:43.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a04065a60 0x7f8a04067f20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a1815c910 0x7f8a180b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a180b2780 0x7f8a181546e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 --2- 172.21.15.133:0/1534275900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1806afc0 0x7f8a180ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 >> 172.21.15.133:0/1534275900 conn(0x7f8a180cd070 msgr2=0x7f8a180b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 shutdown_connections 2023-12-18T10:21:43.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.315+0000 7f8a1e325640 1 -- 172.21.15.133:0/1534275900 wait complete. 2023-12-18T10:21:43.337 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:21:43.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:21:43.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:21:43.500 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:21:43.500 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:21:43.501 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:21:43.511 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:21:43.511 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:21:43.511 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:21:43.520 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:21:43.520 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:21:43.520 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:21:43.565 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:21:43.565 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:21:43.565 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:21:43.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:21:43.576 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-18T10:21:43.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:43.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795ab2d640 1 Processor -- start 2023-12-18T10:21:43.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795ab2d640 1 -- start start 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795ab2d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7954160bd0 0x7f7954165000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795ab2d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79540c33d0 0x7f79540c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795ab2d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79540c4550 con 0x7f79540afd10 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795ab2d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540c86f0 con 0x7f7954160bd0 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795ab2d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79540cc820 con 0x7f79540c33d0 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f7959b2b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7954160bd0 0x7f7954165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f7959b2b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7954160bd0 0x7f7954165000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39286/0 (socket says 172.21.15.133:39286) 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f7959b2b640 1 -- 172.21.15.133:0/4021399191 learned_addr learned my addr 172.21.15.133:0/4021399191 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795932a640 1 --2- 172.21.15.133:0/4021399191 >> v2:172.21.15.142:3300/0 conn(0x7f79540c33d0 0x7f79540c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f7959b2b640 1 -- 172.21.15.133:0/4021399191 >> v2:172.21.15.142:3300/0 conn(0x7f79540c33d0 msgr2=0x7f79540c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:43.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f7959b2b640 1 --2- 172.21.15.133:0/4021399191 >> v2:172.21.15.142:3300/0 conn(0x7f79540c33d0 0x7f79540c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f7959b2b640 1 -- 172.21.15.133:0/4021399191 >> v1:172.21.15.142:6789/0 conn(0x7f79540afd10 legacy=0x7f795406fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f7959b2b640 1 -- 172.21.15.133:0/4021399191 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954165540 con 0x7f7954160bd0 2023-12-18T10:21:43.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.743+0000 7f795932a640 1 --2- 172.21.15.133:0/4021399191 >> v2:172.21.15.142:3300/0 conn(0x7f79540c33d0 0x7f79540c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:43.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f7959b2b640 1 --2- 172.21.15.133:0/4021399191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7954160bd0 0x7f7954165000 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f79540667d0 tx=0x7f795001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3eda3dd1d983af server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:43.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f7958b29640 1 -- 172.21.15.133:0/4021399191 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500a89f0 con 0x7f7954160bd0 2023-12-18T10:21:43.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f7958b29640 1 -- 172.21.15.133:0/4021399191 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79500a8b50 con 0x7f7954160bd0 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f7958b29640 1 -- 172.21.15.133:0/4021399191 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500b0440 con 0x7f7954160bd0 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 -- 172.21.15.133:0/4021399191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7954160bd0 msgr2=0x7f7954165000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 --2- 172.21.15.133:0/4021399191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7954160bd0 0x7f7954165000 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f79540667d0 tx=0x7f795001ecf0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 -- 172.21.15.133:0/4021399191 shutdown_connections 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 --2- 172.21.15.133:0/4021399191 >> v2:172.21.15.142:3300/0 conn(0x7f79540c33d0 0x7f79540c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 --2- 172.21.15.133:0/4021399191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7954160bd0 0x7f7954165000 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 -- 172.21.15.133:0/4021399191 >> 172.21.15.133:0/4021399191 conn(0x7f79540ce130 msgr2=0x7f79540ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 -- 172.21.15.133:0/4021399191 shutdown_connections 2023-12-18T10:21:43.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 -- 172.21.15.133:0/4021399191 wait complete. 2023-12-18T10:21:43.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.747+0000 7f795ab2d640 1 Processor -- start 2023-12-18T10:21:43.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 -- start start 2023-12-18T10:21:43.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79540afd10 0x7f79541f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79540c33d0 0x7f79540b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954160bd0 0x7f79540caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7954162e00 con 0x7f79540c33d0 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79541fa330 con 0x7f7954160bd0 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540b42c0 con 0x7f79540afd10 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79540c33d0 0x7f79540b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79540c33d0 0x7f79540b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39292/0 (socket says 172.21.15.133:39292) 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 -- 172.21.15.133:0/790230349 learned_addr learned my addr 172.21.15.133:0/790230349 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 -- 172.21.15.133:0/790230349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79540afd10 msgr2=0x7f79541f9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79540afd10 0x7f79541f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 -- 172.21.15.133:0/790230349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954160bd0 msgr2=0x7f79540caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795a32c640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954160bd0 0x7f79540caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954160bd0 0x7f79540caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 -- 172.21.15.133:0/790230349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500094d0 con 0x7f79540c33d0 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795a32c640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954160bd0 0x7f79540caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795932a640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79540c33d0 0x7f79540b3d80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f794400e810 tx=0x7f794400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f794a7fc640 1 -- 172.21.15.133:0/790230349 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400c8d0 con 0x7f79540c33d0 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f794a7fc640 1 -- 172.21.15.133:0/790230349 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794400ca30 con 0x7f79540c33d0 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79540c8480 con 0x7f79540c33d0 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f794a7fc640 1 -- 172.21.15.133:0/790230349 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400cde0 con 0x7f79540c33d0 2023-12-18T10:21:43.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79540c7be0 con 0x7f79540c33d0 2023-12-18T10:21:43.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.751+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795404e850 con 0x7f79540c33d0 2023-12-18T10:21:43.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.755+0000 7f794a7fc640 1 -- 172.21.15.133:0/790230349 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7944013410 con 0x7f79540c33d0 2023-12-18T10:21:43.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.755+0000 7f794a7fc640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7938065a60 0x7f7938067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:43.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.755+0000 7f794a7fc640 1 -- 172.21.15.133:0/790230349 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7944082e60 con 0x7f79540c33d0 2023-12-18T10:21:43.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.755+0000 7f7959b2b640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7938065a60 0x7f7938067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:43.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.755+0000 7f7959b2b640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7938065a60 0x7f7938067f20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79500b2000 tx=0x7f7950004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:43.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.759+0000 7f794a7fc640 1 -- 172.21.15.133:0/790230349 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7944050930 con 0x7f79540c33d0 2023-12-18T10:21:43.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79540c9300 con 0x7f79540c33d0 2023-12-18T10:21:43.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f794a7fc640 1 -- 172.21.15.133:0/790230349 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f7944021df0 con 0x7f79540c33d0 2023-12-18T10:21:43.942 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:43.942 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5501,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/1545117572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1545117572},{"type":"v1","addr":"172.21.15.142:6835","nonce":1545117572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2816860004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2816860004},{"type":"v1","addr":"172.21.15.142:6834","nonce":2816860004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6789,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3241706587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3241706587},{"type":"v1","addr":"172.21.15.133:6835","nonce":3241706587}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2414877092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2414877092},{"type":"v1","addr":"172.21.15.133:6837","nonce":2414877092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[]} 2023-12-18T10:21:43.943 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 44 2023-12-18T10:21:43.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7938065a60 msgr2=0x7f7938067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7938065a60 0x7f7938067f20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79500b2000 tx=0x7f7950004740 comp rx=0 tx=0).stop 2023-12-18T10:21:43.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79540c33d0 msgr2=0x7f79540b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:43.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79540c33d0 0x7f79540b3d80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f794400e810 tx=0x7f794400ecd0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 shutdown_connections 2023-12-18T10:21:43.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7938065a60 0x7f7938067f20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7954160bd0 0x7f79540caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79540c33d0 0x7f79540b3d80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 --2- 172.21.15.133:0/790230349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79540afd10 0x7f79541f9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:43.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 >> 172.21.15.133:0/790230349 conn(0x7f79540ce130 msgr2=0x7f795415f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:43.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 shutdown_connections 2023-12-18T10:21:43.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:43.939+0000 7f795ab2d640 1 -- 172.21.15.133:0/790230349 wait complete. 2023-12-18T10:21:43.963 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-18T10:21:43.963 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-18T10:21:43.963 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-18T10:21:43.963 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:21:43.963 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-18T10:21:43.963 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-18T10:21:43.964 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-18T10:21:43.964 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:21:43.964 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-18T10:21:43.964 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-18T10:21:43.964 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-18T10:21:43.964 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:21:43.964 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-18T10:21:43.964 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-18T10:21:43.965 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-18T10:21:43.965 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:21:43.977 INFO:tasks.ceph.mds.a:Stopped 2023-12-18T10:21:43.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-18T10:21:43.980 INFO:tasks.ceph.mds.c:Stopped 2023-12-18T10:21:43.980 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-18T10:21:43.982 INFO:tasks.ceph.mds.b:Stopped 2023-12-18T10:21:43.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-18T10:21:43.983 INFO:tasks.ceph.mds.d:Stopped 2023-12-18T10:21:43.983 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-18T10:21:44.020 INFO:tasks.ceph.mds.a:Started 2023-12-18T10:21:44.020 DEBUG:teuthology.parallel:result is None 2023-12-18T10:21:44.022 INFO:tasks.ceph.mds.c:Started 2023-12-18T10:21:44.022 DEBUG:teuthology.parallel:result is None 2023-12-18T10:21:44.029 INFO:tasks.ceph.mds.b:Started 2023-12-18T10:21:44.029 DEBUG:teuthology.parallel:result is None 2023-12-18T10:21:44.031 INFO:tasks.ceph.mds.d:Started 2023-12-18T10:21:44.031 DEBUG:teuthology.parallel:result is None 2023-12-18T10:21:44.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-18T10:21:44.111 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:21:44.111 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:21:44.122 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:21:44.122 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.179+0000 7f33cc125640 1 Processor -- start 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.179+0000 7f33cc125640 1 -- start start 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.179+0000 7f33cc125640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33c41570c0 0x7f33c406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.179+0000 7f33cc125640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33c40ca000 0x7f33c4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.179+0000 7f33cc125640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c40c9460 con 0x7f33c406c320 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.179+0000 7f33cc125640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c406c7a0 con 0x7f33c41570c0 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.179+0000 7f33cc125640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c41574a0 con 0x7f33c40ca000 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.179+0000 7f33c9ec1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33c41570c0 0x7f33c406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c9ec1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33c41570c0 0x7f33c406bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39344/0 (socket says 172.21.15.133:39344) 2023-12-18T10:21:44.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c9ec1640 1 -- 172.21.15.133:0/818721766 learned_addr learned my addr 172.21.15.133:0/818721766 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:44.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33ca6c2640 1 --2- 172.21.15.133:0/818721766 >> v2:172.21.15.142:3300/0 conn(0x7f33c40ca000 0x7f33c4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:44.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c9ec1640 1 -- 172.21.15.133:0/818721766 >> v2:172.21.15.142:3300/0 conn(0x7f33c40ca000 msgr2=0x7f33c4070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:44.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c9ec1640 1 --2- 172.21.15.133:0/818721766 >> v2:172.21.15.142:3300/0 conn(0x7f33c40ca000 0x7f33c4070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:44.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c9ec1640 1 -- 172.21.15.133:0/818721766 >> v1:172.21.15.142:6789/0 conn(0x7f33c406c320 legacy=0x7f33c40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:44.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c9ec1640 1 -- 172.21.15.133:0/818721766 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40c8b30 con 0x7f33c41570c0 2023-12-18T10:21:44.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c9ec1640 1 --2- 172.21.15.133:0/818721766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c41570c0 0x7f33c406bde0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f33c406cf60 tx=0x7f33c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fa2e4894047c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:44.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c8ebf640 1 -- 172.21.15.133:0/818721766 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c00ab640 con 0x7f33c41570c0 2023-12-18T10:21:44.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c8ebf640 1 -- 172.21.15.133:0/818721766 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c00a7070 con 0x7f33c41570c0 2023-12-18T10:21:44.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.183+0000 7f33c8ebf640 1 -- 172.21.15.133:0/818721766 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c00ab9c0 con 0x7f33c41570c0 2023-12-18T10:21:44.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- 172.21.15.133:0/818721766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c41570c0 msgr2=0x7f33c406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:44.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 --2- 172.21.15.133:0/818721766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c41570c0 0x7f33c406bde0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f33c406cf60 tx=0x7f33c001c440 comp rx=0 tx=0).stop 2023-12-18T10:21:44.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- 172.21.15.133:0/818721766 shutdown_connections 2023-12-18T10:21:44.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 --2- 172.21.15.133:0/818721766 >> v2:172.21.15.142:3300/0 conn(0x7f33c40ca000 0x7f33c4070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:44.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 --2- 172.21.15.133:0/818721766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c41570c0 0x7f33c406bde0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:44.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- 172.21.15.133:0/818721766 >> 172.21.15.133:0/818721766 conn(0x7f33c406a3e0 msgr2=0x7f33c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:44.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- 172.21.15.133:0/818721766 shutdown_connections 2023-12-18T10:21:44.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- 172.21.15.133:0/818721766 wait complete. 2023-12-18T10:21:44.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 Processor -- start 2023-12-18T10:21:44.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- start start 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33c406c320 0x7f33c414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c40ca000 0x7f33c40ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33c41570c0 0x7f33c41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c414a8a0 con 0x7f33c40ca000 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40ad7c0 con 0x7f33c41570c0 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33cc125640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40acbb0 con 0x7f33c406c320 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c40ca000 0x7f33c40ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c40ca000 0x7f33c40ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39352/0 (socket says 172.21.15.133:39352) 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 -- 172.21.15.133:0/2213865118 learned_addr learned my addr 172.21.15.133:0/2213865118 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c9ec1640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33c406c320 0x7f33c414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:44.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33ca6c2640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33c41570c0 0x7f33c41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:44.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 -- 172.21.15.133:0/2213865118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33c406c320 msgr2=0x7f33c414a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33c406c320 0x7f33c414a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 -- 172.21.15.133:0/2213865118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33c41570c0 msgr2=0x7f33c41508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33c41570c0 0x7f33c41508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 -- 172.21.15.133:0/2213865118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c00094d0 con 0x7f33c40ca000 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.187+0000 7f33c96c0640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c40ca000 0x7f33c40ac2b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c3c0 tx=0x7f33b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33ba7fc640 1 -- 172.21.15.133:0/2213865118 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40052d0 con 0x7f33c40ca000 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33ba7fc640 1 -- 172.21.15.133:0/2213865118 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b4005430 con 0x7f33c40ca000 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33ba7fc640 1 -- 172.21.15.133:0/2213865118 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4003840 con 0x7f33c40ca000 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c40ace90 con 0x7f33c40ca000 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c40ad450 con 0x7f33c40ca000 2023-12-18T10:21:44.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c40735b0 con 0x7f33c40ca000 2023-12-18T10:21:44.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33ba7fc640 1 -- 172.21.15.133:0/2213865118 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f33b40039a0 con 0x7f33c40ca000 2023-12-18T10:21:44.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33ba7fc640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33a8065a60 0x7f33a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:44.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33ba7fc640 1 -- 172.21.15.133:0/2213865118 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f33b40824f0 con 0x7f33c40ca000 2023-12-18T10:21:44.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33c9ec1640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33a8065a60 0x7f33a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:44.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.191+0000 7f33c9ec1640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33a8065a60 0x7f33a8067f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f33c00af000 tx=0x7f33c00b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:44.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.195+0000 7f33ba7fc640 1 -- 172.21.15.133:0/2213865118 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f33b4050070 con 0x7f33c40ca000 2023-12-18T10:21:44.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:44.359+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f33c404e000 con 0x7f33c40ca000 2023-12-18T10:21:45.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.147+0000 7f33ba7fc640 1 -- 172.21.15.133:0/2213865118 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33b4053690 con 0x7f33c40ca000 2023-12-18T10:21:45.154 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-18T10:21:45.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33a8065a60 msgr2=0x7f33a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33a8065a60 0x7f33a8067f20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f33c00af000 tx=0x7f33c00b6040 comp rx=0 tx=0).stop 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c40ca000 msgr2=0x7f33c40ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c40ca000 0x7f33c40ac2b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c3c0 tx=0x7f33b400c880 comp rx=0 tx=0).stop 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 shutdown_connections 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33a8065a60 0x7f33a8067f20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33c41570c0 0x7f33c41508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c40ca000 0x7f33c40ac2b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 --2- 172.21.15.133:0/2213865118 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33c406c320 0x7f33c414a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 >> 172.21.15.133:0/2213865118 conn(0x7f33c406a3e0 msgr2=0x7f33c4159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:45.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 shutdown_connections 2023-12-18T10:21:45.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.151+0000 7f33cc125640 1 -- 172.21.15.133:0/2213865118 wait complete. 2023-12-18T10:21:45.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-18T10:21:45.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8b59e640 1 Processor -- start 2023-12-18T10:21:45.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8b59e640 1 -- start start 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8b59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e8c143f50 0x7f6e8c0c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6e8c0afd10 0x7f6e8c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0c36c0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8b59e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c06ca20 con 0x7f6e8c143f50 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8b59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b06d0 con 0x7f6e8c0afd10 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8a59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e8c143f50 0x7f6e8c0c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8a59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e8c143f50 0x7f6e8c0c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39368/0 (socket says 172.21.15.133:39368) 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8a59c640 1 -- 172.21.15.133:0/2904092211 learned_addr learned my addr 172.21.15.133:0/2904092211 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e89d9b640 1 --2- 172.21.15.133:0/2904092211 >> v2:172.21.15.142:3300/0 conn(0x7f6e8c0afd10 0x7f6e8c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8a59c640 1 -- 172.21.15.133:0/2904092211 >> v2:172.21.15.142:3300/0 conn(0x7f6e8c0afd10 msgr2=0x7f6e8c0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:45.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8a59c640 1 --2- 172.21.15.133:0/2904092211 >> v2:172.21.15.142:3300/0 conn(0x7f6e8c0afd10 0x7f6e8c0b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8a59c640 1 -- 172.21.15.133:0/2904092211 >> v1:172.21.15.142:6789/0 conn(0x7f6e8c06bea0 legacy=0x7f6e8c06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.315+0000 7f6e8a59c640 1 -- 172.21.15.133:0/2904092211 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0c39a0 con 0x7f6e8c143f50 2023-12-18T10:21:45.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8a59c640 1 --2- 172.21.15.133:0/2904092211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c143f50 0x7f6e8c0c4480 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0ce090 tx=0x7f6e7c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9c61a6212cdc04 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:45.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8959a640 1 -- 172.21.15.133:0/2904092211 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0aa680 con 0x7f6e8c143f50 2023-12-18T10:21:45.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8959a640 1 -- 172.21.15.133:0/2904092211 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0aa7e0 con 0x7f6e8c143f50 2023-12-18T10:21:45.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8959a640 1 -- 172.21.15.133:0/2904092211 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0aab70 con 0x7f6e8c143f50 2023-12-18T10:21:45.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8b59e640 1 -- 172.21.15.133:0/2904092211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c143f50 msgr2=0x7f6e8c0c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/2904092211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c143f50 0x7f6e8c0c4480 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0ce090 tx=0x7f6e7c01c500 comp rx=0 tx=0).stop 2023-12-18T10:21:45.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8b59e640 1 -- 172.21.15.133:0/2904092211 shutdown_connections 2023-12-18T10:21:45.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/2904092211 >> v2:172.21.15.142:3300/0 conn(0x7f6e8c0afd10 0x7f6e8c0b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/2904092211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c143f50 0x7f6e8c0c4480 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8b59e640 1 -- 172.21.15.133:0/2904092211 >> 172.21.15.133:0/2904092211 conn(0x7f6e8c0ce130 msgr2=0x7f6e8c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:45.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8b59e640 1 -- 172.21.15.133:0/2904092211 shutdown_connections 2023-12-18T10:21:45.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.319+0000 7f6e8b59e640 1 -- 172.21.15.133:0/2904092211 wait complete. 2023-12-18T10:21:45.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 Processor -- start 2023-12-18T10:21:45.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 -- start start 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c06bea0 0x7f6e8c13c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c0afd10 0x7f6e8c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8c143f50 0x7f6e8c0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b26b0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b1aa0 con 0x7f6e8c0afd10 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b1d80 con 0x7f6e8c143f50 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c06bea0 0x7f6e8c13c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c06bea0 0x7f6e8c13c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39380/0 (socket says 172.21.15.133:39380) 2023-12-18T10:21:45.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 -- 172.21.15.133:0/522073645 learned_addr learned my addr 172.21.15.133:0/522073645 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e89d9b640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c0afd10 0x7f6e8c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8ad9d640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8c143f50 0x7f6e8c0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 -- 172.21.15.133:0/522073645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8c143f50 msgr2=0x7f6e8c0b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8c143f50 0x7f6e8c0b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 -- 172.21.15.133:0/522073645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c0afd10 msgr2=0x7f6e8c0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c0afd10 0x7f6e8c0b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 -- 172.21.15.133:0/522073645 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c0094d0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8a59c640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c06bea0 0x7f6e8c13c970 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c019110 tx=0x7f6e7c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e7affd640 1 -- 172.21.15.133:0/522073645 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0aa680 con 0x7f6e8c06bea0 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e7affd640 1 -- 172.21.15.133:0/522073645 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0b3800 con 0x7f6e8c06bea0 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e7affd640 1 -- 172.21.15.133:0/522073645 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0b3bb0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c0b2060 con 0x7f6e8c06bea0 2023-12-18T10:21:45.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c13ceb0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.323+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c13d0a0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.327+0000 7f6e7affd640 1 -- 172.21.15.133:0/522073645 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e7c0b3d10 con 0x7f6e8c06bea0 2023-12-18T10:21:45.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.327+0000 7f6e7affd640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a90 0x7f6e6c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.327+0000 7f6e7affd640 1 -- 172.21.15.133:0/522073645 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6e7c11d7b0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.327+0000 7f6e89d9b640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a90 0x7f6e6c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.327+0000 7f6e89d9b640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a90 0x7f6e6c067f50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c15da70 tx=0x7f6e80009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:45.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.331+0000 7f6e7affd640 1 -- 172.21.15.133:0/522073645 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6e8c13d0a0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.531+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6e8c13d0a0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.531+0000 7f6e7affd640 1 -- 172.21.15.133:0/522073645 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6e8c13d0a0 con 0x7f6e8c06bea0 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlq/3QHRAAeGrWPAL1IMuRSsb9HM8t0Q==", 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBleUoUKhAA7KQ881Hp59b6BfYF5Mc8Rw==", 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlsRoJJRAAYgbCztPYO/qzR7wJgYhPqQ==", 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:21:45.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlr0paMRAAUlbr607Vw8Yc0/S1EvLUUA==", 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.538 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAgHIBlbTjYDhAA2KUnOrWIaGtzxXx9T64djw==", 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjHIBlr8a1FhAAGRT54akJvp65F8xxu9Mw1g==", 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:21:45.539 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAmHIBlv+HSHBAAxDHSTox1AtpTMfCNbatjzA==", 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApHIBlj5xPIxAAkZglsOO2rg+8kXVIb+JK+w==", 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.540 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAvHIBlhQRmKxAAahzzO4gYz5LHWhvFvZlOAA==", 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-18T10:21:45.541 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyHIBlatiUMhAAk0X1zO+dYOu5hMZvGBJNkQ==", 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1HIBl86v0OBAA70FwnvAugWtLupto+cbBjg==", 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA5HIBlZAYVBBAAa0V4jDTdYV8TBoNR7SenjQ==", 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlugNkNRAADsDapfYnOr+gcvgQ4394aA==", 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-18T10:21:45.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlM7J1AxAAgoKo5xm3Wz4xWjPX4Mpn0A==", 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlrzVcOxAAwwd6eFzNGehg/4chJq1qJA==", 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.544 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlRgxmCRAAN/aEmPSonvc17SvLB1GdXQ==", 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:21:45.545 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAbHIBlJHzPORAAQupFGwV6/izxeyNlnyeMSA==", 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-18T10:21:45.546 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlDP4UFhAA8KB7vRFpeBSRad2GRiKh/A==", 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBl+lIiEhAAx9zNJbwPBf7oGsFzDJKxEw==", 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:21:45.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:45.548 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-18T10:21:45.548 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:45.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a90 msgr2=0x7f6e6c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a90 0x7f6e6c067f50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c15da70 tx=0x7f6e80009190 comp rx=0 tx=0).stop 2023-12-18T10:21:45.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c06bea0 msgr2=0x7f6e8c13c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c06bea0 0x7f6e8c13c970 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c019110 tx=0x7f6e7c01ad40 comp rx=0 tx=0).stop 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 shutdown_connections 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a90 0x7f6e6c067f50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8c143f50 0x7f6e8c0b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c0afd10 0x7f6e8c0b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 --2- 172.21.15.133:0/522073645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c06bea0 0x7f6e8c13c970 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 >> 172.21.15.133:0/522073645 conn(0x7f6e8c0ce130 msgr2=0x7f6e8c06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 shutdown_connections 2023-12-18T10:21:45.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.535+0000 7f6e8b59e640 1 -- 172.21.15.133:0/522073645 wait complete. 2023-12-18T10:21:45.557 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:21:45.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.687+0000 7f2618ed7640 1 Processor -- start 2023-12-18T10:21:45.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2618ed7640 1 -- start start 2023-12-18T10:21:45.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2618ed7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 0x7f261406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2618ed7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f26140cc6c0 0x7f26140ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2618ed7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26140cbc70 con 0x7f26140afd10 2023-12-18T10:21:45.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2618ed7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26140c3bb0 con 0x7f26140cc6c0 2023-12-18T10:21:45.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2618ed7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140c3e90 con 0x7f261406fb60 2023-12-18T10:21:45.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f26137fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f26140afd10 0x7f26140b00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60486/0 (socket says 172.21.15.133:60486) 2023-12-18T10:21:45.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f26137fe640 1 -- 172.21.15.133:0/3861512262 learned_addr learned my addr 172.21.15.133:0/3861512262 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:45.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2612ffd640 1 --2- 172.21.15.133:0/3861512262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 0x7f261406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2613fff640 1 --2- 172.21.15.133:0/3861512262 >> v2:172.21.15.142:3300/0 conn(0x7f26140cc6c0 0x7f26140ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f26127fc640 1 -- 172.21.15.133:0/3861512262 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843765325 0 0) 0x7f26140cbc70 con 0x7f26140afd10 2023-12-18T10:21:45.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f26127fc640 1 -- 172.21.15.133:0/3861512262 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25fc003530 con 0x7f26140afd10 2023-12-18T10:21:45.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2613fff640 1 -- 172.21.15.133:0/3861512262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 msgr2=0x7f261406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:45.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2613fff640 1 --2- 172.21.15.133:0/3861512262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 0x7f261406ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2613fff640 1 -- 172.21.15.133:0/3861512262 >> v1:172.21.15.133:6789/0 conn(0x7f26140afd10 legacy=0x7f26140b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.691+0000 7f2613fff640 1 -- 172.21.15.133:0/3861512262 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26140cbec0 con 0x7f26140cc6c0 2023-12-18T10:21:45.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2613fff640 1 --2- 172.21.15.133:0/3861512262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cc6c0 0x7f26140ccb50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f260c009d90 tx=0x7f260c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6bbc1ece6851e23 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:45.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f26127fc640 1 -- 172.21.15.133:0/3861512262 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0a59c0 con 0x7f26140cc6c0 2023-12-18T10:21:45.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f26127fc640 1 -- 172.21.15.133:0/3861512262 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0a5b20 con 0x7f26140cc6c0 2023-12-18T10:21:45.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f26127fc640 1 -- 172.21.15.133:0/3861512262 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0a5e90 con 0x7f26140cc6c0 2023-12-18T10:21:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2618ed7640 1 -- 172.21.15.133:0/3861512262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cc6c0 msgr2=0x7f26140ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2618ed7640 1 --2- 172.21.15.133:0/3861512262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cc6c0 0x7f26140ccb50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f260c009d90 tx=0x7f260c01c920 comp rx=0 tx=0).stop 2023-12-18T10:21:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2618ed7640 1 -- 172.21.15.133:0/3861512262 shutdown_connections 2023-12-18T10:21:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2618ed7640 1 --2- 172.21.15.133:0/3861512262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140cc6c0 0x7f26140ccb50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2618ed7640 1 --2- 172.21.15.133:0/3861512262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 0x7f261406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2618ed7640 1 -- 172.21.15.133:0/3861512262 >> 172.21.15.133:0/3861512262 conn(0x7f26140ce130 msgr2=0x7f26140ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:45.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2618ed7640 1 -- 172.21.15.133:0/3861512262 shutdown_connections 2023-12-18T10:21:45.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.695+0000 7f2618ed7640 1 -- 172.21.15.133:0/3861512262 wait complete. 2023-12-18T10:21:45.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 Processor -- start 2023-12-18T10:21:45.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 -- start start 2023-12-18T10:21:45.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 0x7f26141400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140afd10 0x7f26140c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cc6c0 0x7f2614158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26140c60c0 con 0x7f26140cc6c0 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26140c62f0 con 0x7f26140afd10 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26140c65d0 con 0x7f261406fb60 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cc6c0 0x7f2614158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cc6c0 0x7f2614158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39388/0 (socket says 172.21.15.133:39388) 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 -- 172.21.15.133:0/1715616973 learned_addr learned my addr 172.21.15.133:0/1715616973 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f26137fe640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 0x7f26141400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2612ffd640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140afd10 0x7f26140c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 -- 172.21.15.133:0/1715616973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 msgr2=0x7f26141400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 0x7f26141400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 -- 172.21.15.133:0/1715616973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140afd10 msgr2=0x7f26140c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140afd10 0x7f26140c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 -- 172.21.15.133:0/1715616973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009a70 con 0x7f26140cc6c0 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2613fff640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cc6c0 0x7f2614158dd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f260c01a550 tx=0x7f260c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f25fbfff640 1 -- 172.21.15.133:0/1715616973 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0bd070 con 0x7f26140cc6c0 2023-12-18T10:21:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f25fbfff640 1 -- 172.21.15.133:0/1715616973 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c004040 con 0x7f26140cc6c0 2023-12-18T10:21:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26140c68b0 con 0x7f26140cc6c0 2023-12-18T10:21:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f25fbfff640 1 -- 172.21.15.133:0/1715616973 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0043f0 con 0x7f26140cc6c0 2023-12-18T10:21:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26140c6e70 con 0x7f26140cc6c0 2023-12-18T10:21:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.699+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2614159da0 con 0x7f26140cc6c0 2023-12-18T10:21:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.703+0000 7f25fbfff640 1 -- 172.21.15.133:0/1715616973 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f260c0b4030 con 0x7f26140cc6c0 2023-12-18T10:21:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.703+0000 7f25fbfff640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2600065a60 0x7f2600067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.703+0000 7f25fbfff640 1 -- 172.21.15.133:0/1715616973 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f260c11d900 con 0x7f26140cc6c0 2023-12-18T10:21:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.703+0000 7f26137fe640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2600065a60 0x7f2600067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.703+0000 7f26137fe640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2600065a60 0x7f2600067f20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2604007fd0 tx=0x7f2604009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:45.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.707+0000 7f25fbfff640 1 -- 172.21.15.133:0/1715616973 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f260c0eb4e0 con 0x7f26140cc6c0 2023-12-18T10:21:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.855+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f261404e850 con 0x7f26140cc6c0 2023-12-18T10:21:45.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f25fbfff640 1 -- 172.21.15.133:0/1715616973 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+12642 (secure 0 0 0) 0x7f260c0eeb00 con 0x7f26140cc6c0 2023-12-18T10:21:45.862 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:45.862 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":61,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:21:45.148495+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:21:45.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2600065a60 msgr2=0x7f2600067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2600065a60 0x7f2600067f20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2604007fd0 tx=0x7f2604009040 comp rx=0 tx=0).stop 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cc6c0 msgr2=0x7f2614158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cc6c0 0x7f2614158dd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f260c01a550 tx=0x7f260c0196c0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 shutdown_connections 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2600065a60 0x7f2600067f20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26140cc6c0 0x7f2614158dd0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f26140afd10 0x7f26140c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 --2- 172.21.15.133:0/1715616973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f261406fb60 0x7f26141400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 >> 172.21.15.133:0/1715616973 conn(0x7f26140ce130 msgr2=0x7f2614071720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 shutdown_connections 2023-12-18T10:21:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:45.859+0000 7f2618ed7640 1 -- 172.21.15.133:0/1715616973 wait complete. 2023-12-18T10:21:45.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:21:45.883 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:21:46.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae7863640 1 Processor -- start 2023-12-18T10:21:46.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae7863640 1 -- start start 2023-12-18T10:21:46.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae7863640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ae015c690 0x7f2ae00d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae7863640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2ae00cd520 0x7f2ae00d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae7863640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae00d17c0 con 0x7f2ae015ca70 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae7863640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae00b1c20 con 0x7f2ae015c690 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae7863640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae00d15c0 con 0x7f2ae00cd520 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae55ff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ae015c690 0x7f2ae00d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae55ff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ae015c690 0x7f2ae00d2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39398/0 (socket says 172.21.15.133:39398) 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae55ff640 1 -- 172.21.15.133:0/1893247378 learned_addr learned my addr 172.21.15.133:0/1893247378 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae4dfe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2ae015ca70 0x7f2ae00cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60496/0 (socket says 172.21.15.133:60496) 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae5e00640 1 --2- 172.21.15.133:0/1893247378 >> v2:172.21.15.142:3300/0 conn(0x7f2ae00cd520 0x7f2ae00d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae55ff640 1 -- 172.21.15.133:0/1893247378 >> v2:172.21.15.142:3300/0 conn(0x7f2ae00cd520 msgr2=0x7f2ae00d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae55ff640 1 --2- 172.21.15.133:0/1893247378 >> v2:172.21.15.142:3300/0 conn(0x7f2ae00cd520 0x7f2ae00d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ad7fff640 1 -- 172.21.15.133:0/1893247378 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899818640 0 0) 0x7f2ae00d17c0 con 0x7f2ae015ca70 2023-12-18T10:21:46.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae55ff640 1 -- 172.21.15.133:0/1893247378 >> v1:172.21.15.133:6789/0 conn(0x7f2ae015ca70 legacy=0x7f2ae00cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.023+0000 7f2ae55ff640 1 -- 172.21.15.133:0/1893247378 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00d1cb0 con 0x7f2ae015c690 2023-12-18T10:21:46.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae55ff640 1 --2- 172.21.15.133:0/1893247378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015c690 0x7f2ae00d2a70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00ce630 tx=0x7f2adc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174c0471223f7536 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ad7fff640 1 -- 172.21.15.133:0/1893247378 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0a89f0 con 0x7f2ae015c690 2023-12-18T10:21:46.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ad7fff640 1 -- 172.21.15.133:0/1893247378 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc0a8b50 con 0x7f2ae015c690 2023-12-18T10:21:46.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ad7fff640 1 -- 172.21.15.133:0/1893247378 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0b0440 con 0x7f2ae015c690 2023-12-18T10:21:46.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae7863640 1 -- 172.21.15.133:0/1893247378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015c690 msgr2=0x7f2ae00d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae7863640 1 --2- 172.21.15.133:0/1893247378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015c690 0x7f2ae00d2a70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2ae00ce630 tx=0x7f2adc01ecf0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae7863640 1 -- 172.21.15.133:0/1893247378 shutdown_connections 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae7863640 1 --2- 172.21.15.133:0/1893247378 >> v2:172.21.15.142:3300/0 conn(0x7f2ae00cd520 0x7f2ae00d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae7863640 1 --2- 172.21.15.133:0/1893247378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015c690 0x7f2ae00d2a70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae7863640 1 -- 172.21.15.133:0/1893247378 >> 172.21.15.133:0/1893247378 conn(0x7f2ae00717d0 msgr2=0x7f2ae0071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae7863640 1 -- 172.21.15.133:0/1893247378 shutdown_connections 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.027+0000 7f2ae7863640 1 -- 172.21.15.133:0/1893247378 wait complete. 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 Processor -- start 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 -- start start 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae00cd520 0x7f2ae00a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae015c690 0x7f2ae01f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015ca70 0x7f2ae01f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01f6470 con 0x7f2ae015ca70 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00a94e0 con 0x7f2ae015c690 2023-12-18T10:21:46.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00c9e90 con 0x7f2ae00cd520 2023-12-18T10:21:46.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015ca70 0x7f2ae01f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015ca70 0x7f2ae01f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39406/0 (socket says 172.21.15.133:39406) 2023-12-18T10:21:46.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 -- 172.21.15.133:0/3253351675 learned_addr learned my addr 172.21.15.133:0/3253351675 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae55ff640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae00cd520 0x7f2ae00a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 -- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae00cd520 msgr2=0x7f2ae00a8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae4dfe640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae015c690 0x7f2ae01f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae00cd520 0x7f2ae00a8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 -- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae015c690 msgr2=0x7f2ae01f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae015c690 0x7f2ae01f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 -- 172.21.15.133:0/3253351675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0094d0 con 0x7f2ae015ca70 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae55ff640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae00cd520 0x7f2ae00a8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae4dfe640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae015c690 0x7f2ae01f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae5e00640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015ca70 0x7f2ae01f57f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8007e70 tx=0x7f2ad800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ad5ffb640 1 -- 172.21.15.133:0/3253351675 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8014620 con 0x7f2ae015ca70 2023-12-18T10:21:46.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ad5ffb640 1 -- 172.21.15.133:0/3253351675 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad80147a0 con 0x7f2ae015ca70 2023-12-18T10:21:46.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ad5ffb640 1 -- 172.21.15.133:0/3253351675 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8014b50 con 0x7f2ae015ca70 2023-12-18T10:21:46.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae00ca170 con 0x7f2ae015ca70 2023-12-18T10:21:46.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.031+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae00ca730 con 0x7f2ae015ca70 2023-12-18T10:21:46.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.035+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae004e000 con 0x7f2ae015ca70 2023-12-18T10:21:46.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.035+0000 7f2ad5ffb640 1 -- 172.21.15.133:0/3253351675 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ad8014cb0 con 0x7f2ae015ca70 2023-12-18T10:21:46.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.035+0000 7f2ad5ffb640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2ac4065a60 0x7f2ac4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.035+0000 7f2ad5ffb640 1 -- 172.21.15.133:0/3253351675 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2ad80839a0 con 0x7f2ae015ca70 2023-12-18T10:21:46.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.035+0000 7f2ae55ff640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2ac4065a60 0x7f2ac4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.035+0000 7f2ae55ff640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2ac4065a60 0x7f2ac4067f20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0b2000 tx=0x7f2adc0aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.039+0000 7f2ad5ffb640 1 -- 172.21.15.133:0/3253351675 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2ad80514d0 con 0x7f2ae015ca70 2023-12-18T10:21:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ae00d2240 con 0x7f2ae015ca70 2023-12-18T10:21:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ad5ffb640 1 -- 172.21.15.133:0/3253351675 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ad8054af0 con 0x7f2ae015ca70 2023-12-18T10:21:46.194 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:21:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2ac4065a60 msgr2=0x7f2ac4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2ac4065a60 0x7f2ac4067f20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0b2000 tx=0x7f2adc0aa070 comp rx=0 tx=0).stop 2023-12-18T10:21:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015ca70 msgr2=0x7f2ae01f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015ca70 0x7f2ae01f57f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8007e70 tx=0x7f2ad800e4b0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 shutdown_connections 2023-12-18T10:21:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2ac4065a60 0x7f2ac4067f20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ae015ca70 0x7f2ae01f57f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ae015c690 0x7f2ae01f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 --2- 172.21.15.133:0/3253351675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ae00cd520 0x7f2ae00a8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 >> 172.21.15.133:0/3253351675 conn(0x7f2ae00717d0 msgr2=0x7f2ae00b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:46.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 shutdown_connections 2023-12-18T10:21:46.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.191+0000 7f2ae7863640 1 -- 172.21.15.133:0/3253351675 wait complete. 2023-12-18T10:21:46.215 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-18T10:21:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.347+0000 7f04169a2640 1 Processor -- start 2023-12-18T10:21:46.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.347+0000 7f04169a2640 1 -- start start 2023-12-18T10:21:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04169a2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04101605c0 0x7f0410160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04169a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04101613f0 con 0x7f041015fec0 2023-12-18T10:21:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04169a2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04100aca40 con 0x7f04100ac560 2023-12-18T10:21:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04169a2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0410160f90 con 0x7f04101605c0 2023-12-18T10:21:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04159a0640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f041015fec0 0x7f04100adae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60506/0 (socket says 172.21.15.133:60506) 2023-12-18T10:21:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04159a0640 1 -- 172.21.15.133:0/2380697258 learned_addr learned my addr 172.21.15.133:0/2380697258 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:46.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04161a1640 1 --2- 172.21.15.133:0/2380697258 >> v2:172.21.15.133:3300/0 conn(0x7f04101605c0 0x7f0410160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04161a1640 1 -- 172.21.15.133:0/2380697258 >> v1:172.21.15.142:6789/0 conn(0x7f04100ac560 legacy=0x7f0410071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04161a1640 1 -- 172.21.15.133:0/2380697258 >> v1:172.21.15.133:6789/0 conn(0x7f041015fec0 legacy=0x7f04100adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f04161a1640 1 -- 172.21.15.133:0/2380697258 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100acd20 con 0x7f04101605c0 2023-12-18T10:21:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.351+0000 7f041499e640 1 -- 172.21.15.133:0/2380697258 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379573860 0 0) 0x7f04101613f0 con 0x7f041015fec0 2023-12-18T10:21:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04161a1640 1 --2- 172.21.15.133:0/2380697258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04101605c0 0x7f0410160a50 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0408009d90 tx=0x7f040801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1114b4808896439 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f041499e640 1 -- 172.21.15.133:0/2380697258 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080a59a0 con 0x7f04101605c0 2023-12-18T10:21:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f041499e640 1 -- 172.21.15.133:0/2380697258 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04080a5b00 con 0x7f04101605c0 2023-12-18T10:21:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f041499e640 1 -- 172.21.15.133:0/2380697258 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080a5e90 con 0x7f04101605c0 2023-12-18T10:21:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- 172.21.15.133:0/2380697258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04101605c0 msgr2=0x7f0410160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 --2- 172.21.15.133:0/2380697258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04101605c0 0x7f0410160a50 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0408009d90 tx=0x7f040801c8e0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- 172.21.15.133:0/2380697258 shutdown_connections 2023-12-18T10:21:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 --2- 172.21.15.133:0/2380697258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04101605c0 0x7f0410160a50 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- 172.21.15.133:0/2380697258 >> 172.21.15.133:0/2380697258 conn(0x7f0410070400 msgr2=0x7f0410070810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:46.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- 172.21.15.133:0/2380697258 shutdown_connections 2023-12-18T10:21:46.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- 172.21.15.133:0/2380697258 wait complete. 2023-12-18T10:21:46.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 Processor -- start 2023-12-18T10:21:46.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- start start 2023-12-18T10:21:46.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04100ac560 0x7f0410156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f041015fec0 0x7f0410157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04101605c0 0x7f04101f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04101f5ec0 con 0x7f041015fec0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04101548c0 con 0x7f04101605c0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.355+0000 7f04169a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04101530a0 con 0x7f04100ac560 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f041015fec0 0x7f0410157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f041015fec0 0x7f0410157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39420/0 (socket says 172.21.15.133:39420) 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04161a1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04101605c0 0x7f04101f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 -- 172.21.15.133:0/314155839 learned_addr learned my addr 172.21.15.133:0/314155839 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04159a0640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04100ac560 0x7f0410156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 -- 172.21.15.133:0/314155839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04100ac560 msgr2=0x7f0410156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04100ac560 0x7f0410156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 -- 172.21.15.133:0/314155839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04101605c0 msgr2=0x7f04101f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04101605c0 0x7f04101f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 -- 172.21.15.133:0/314155839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408009a70 con 0x7f041015fec0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f041519f640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f041015fec0 0x7f0410157d70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f040000c410 tx=0x7f040000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04067fc640 1 -- 172.21.15.133:0/314155839 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400011790 con 0x7f041015fec0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04067fc640 1 -- 172.21.15.133:0/314155839 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04000118f0 con 0x7f041015fec0 2023-12-18T10:21:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04067fc640 1 -- 172.21.15.133:0/314155839 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400011ce0 con 0x7f041015fec0 2023-12-18T10:21:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0410153380 con 0x7f041015fec0 2023-12-18T10:21:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0410153940 con 0x7f041015fec0 2023-12-18T10:21:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0410154a50 con 0x7f041015fec0 2023-12-18T10:21:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04067fc640 1 -- 172.21.15.133:0/314155839 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f040001c460 con 0x7f041015fec0 2023-12-18T10:21:46.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04067fc640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f03f4065a60 0x7f03f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.359+0000 7f04067fc640 1 -- 172.21.15.133:0/314155839 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0400082ae0 con 0x7f041015fec0 2023-12-18T10:21:46.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.363+0000 7f04159a0640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f03f4065a60 0x7f03f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.363+0000 7f04159a0640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f03f4065a60 0x7f03f4067f20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f040c007fd0 tx=0x7f040c007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.367+0000 7f04067fc640 1 -- 172.21.15.133:0/314155839 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f04000507f0 con 0x7f041015fec0 2023-12-18T10:21:46.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.515+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f041004e850 con 0x7f041015fec0 2023-12-18T10:21:46.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.515+0000 7f04067fc640 1 -- 172.21.15.133:0/314155839 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0400053e10 con 0x7f041015fec0 2023-12-18T10:21:46.521 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:46.521 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:21:46.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:21:46.521 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-18T10:21:46.521 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-18T10:21:46.521 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:21:46.522 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:21:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f03f4065a60 msgr2=0x7f03f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f03f4065a60 0x7f03f4067f20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f040c007fd0 tx=0x7f040c007d60 comp rx=0 tx=0).stop 2023-12-18T10:21:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f041015fec0 msgr2=0x7f0410157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f041015fec0 0x7f0410157d70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f040000c410 tx=0x7f040000c8d0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 shutdown_connections 2023-12-18T10:21:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f03f4065a60 0x7f03f4067f20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04101605c0 0x7f04101f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f041015fec0 0x7f0410157d70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 --2- 172.21.15.133:0/314155839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04100ac560 0x7f0410156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 >> 172.21.15.133:0/314155839 conn(0x7f0410070400 msgr2=0x7f041015c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 shutdown_connections 2023-12-18T10:21:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.519+0000 7f04169a2640 1 -- 172.21.15.133:0/314155839 wait complete. 2023-12-18T10:21:46.542 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-18T10:21:46.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-18T10:21:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b15a41640 1 Processor -- start 2023-12-18T10:21:46.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b15a41640 1 -- start start 2023-12-18T10:21:46.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b15a41640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b100b2780 0x7f9b1006e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b15a41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1015c590 0x7f9b1015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b15a41640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b100cadd0 con 0x7f9b100b23a0 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b15a41640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1006ee00 con 0x7f9b100b2780 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b15a41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1006eb20 con 0x7f9b1015c590 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b07fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b100b2780 0x7f9b1006e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b0effd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9b100b23a0 0x7f9b1006ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60520/0 (socket says 172.21.15.133:60520) 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b0effd640 1 -- 172.21.15.133:0/3122932950 learned_addr learned my addr 172.21.15.133:0/3122932950 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b07fff640 1 --2- 172.21.15.133:0/3122932950 >> v2:172.21.15.133:3300/0 conn(0x7f9b100b2780 0x7f9b1006e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39436/0 (socket says 172.21.15.133:39436) 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b0f7fe640 1 --2- 172.21.15.133:0/3122932950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1015c590 0x7f9b1015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b07fff640 1 -- 172.21.15.133:0/3122932950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1015c590 msgr2=0x7f9b1015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b07fff640 1 --2- 172.21.15.133:0/3122932950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1015c590 0x7f9b1015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.679+0000 7f9b07fff640 1 -- 172.21.15.133:0/3122932950 >> v1:172.21.15.133:6789/0 conn(0x7f9b100b23a0 legacy=0x7f9b1006ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b07fff640 1 -- 172.21.15.133:0/3122932950 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100cb070 con 0x7f9b100b2780 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b0f7fe640 1 --2- 172.21.15.133:0/3122932950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1015c590 0x7f9b1015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:46.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b0e7fc640 1 -- 172.21.15.133:0/3122932950 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87189725 0 0) 0x7f9b100cadd0 con 0x7f9b100b23a0 2023-12-18T10:21:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b07fff640 1 --2- 172.21.15.133:0/3122932950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b100b2780 0x7f9b1006e500 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097c0 tx=0x7f9af801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36916cc830df16c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b0e7fc640 1 -- 172.21.15.133:0/3122932950 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80a8970 con 0x7f9b100b2780 2023-12-18T10:21:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b0e7fc640 1 -- 172.21.15.133:0/3122932950 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af80a8ad0 con 0x7f9b100b2780 2023-12-18T10:21:46.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b0e7fc640 1 -- 172.21.15.133:0/3122932950 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80a8e60 con 0x7f9b100b2780 2023-12-18T10:21:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b15a41640 1 -- 172.21.15.133:0/3122932950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b100b2780 msgr2=0x7f9b1006e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3122932950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b100b2780 0x7f9b1006e500 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f9af80097c0 tx=0x7f9af801ec70 comp rx=0 tx=0).stop 2023-12-18T10:21:46.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b15a41640 1 -- 172.21.15.133:0/3122932950 shutdown_connections 2023-12-18T10:21:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3122932950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1015c590 0x7f9b1015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3122932950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b100b2780 0x7f9b1006e500 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b15a41640 1 -- 172.21.15.133:0/3122932950 >> 172.21.15.133:0/3122932950 conn(0x7f9b100cd0e0 msgr2=0x7f9b100cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b15a41640 1 -- 172.21.15.133:0/3122932950 shutdown_connections 2023-12-18T10:21:46.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.683+0000 7f9b15a41640 1 -- 172.21.15.133:0/3122932950 wait complete. 2023-12-18T10:21:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b15a41640 1 Processor -- start 2023-12-18T10:21:46.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b15a41640 1 -- start start 2023-12-18T10:21:46.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b15a41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b100b23a0 0x7f9b100c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b15a41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b100b2780 0x7f9b1014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b15a41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1015c590 0x7f9b1014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b15a41640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101f3b30 con 0x7f9b1015c590 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b15a41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101f2f00 con 0x7f9b100b2780 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b15a41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101f3200 con 0x7f9b100b23a0 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1015c590 0x7f9b1014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1015c590 0x7f9b1014dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39440/0 (socket says 172.21.15.133:39440) 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 -- 172.21.15.133:0/3412347946 learned_addr learned my addr 172.21.15.133:0/3412347946 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0effd640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b100b23a0 0x7f9b100c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b07fff640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b100b2780 0x7f9b1014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 -- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b100b23a0 msgr2=0x7f9b100c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b100b23a0 0x7f9b100c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 -- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b100b2780 msgr2=0x7f9b1014d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b100b2780 0x7f9b1014d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 -- 172.21.15.133:0/3412347946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009420 con 0x7f9b1015c590 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b07fff640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b100b2780 0x7f9b1014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.687+0000 7f9b0f7fe640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1015c590 0x7f9b1014dbe0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800cd50 tx=0x7f9b0800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b0cff9640 1 -- 172.21.15.133:0/3412347946 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800f680 con 0x7f9b1015c590 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b0cff9640 1 -- 172.21.15.133:0/3412347946 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0800f800 con 0x7f9b1015c590 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b101f34e0 con 0x7f9b1015c590 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b0cff9640 1 -- 172.21.15.133:0/3412347946 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800fbb0 con 0x7f9b1015c590 2023-12-18T10:21:46.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b100ca0a0 con 0x7f9b1015c590 2023-12-18T10:21:46.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b100ca2f0 con 0x7f9b1015c590 2023-12-18T10:21:46.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b0cff9640 1 -- 172.21.15.133:0/3412347946 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b0800b040 con 0x7f9b1015c590 2023-12-18T10:21:46.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b0cff9640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0065a60 0x7f9af0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:46.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b0cff9640 1 -- 172.21.15.133:0/3412347946 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9b080838e0 con 0x7f9b1015c590 2023-12-18T10:21:46.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b0effd640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0065a60 0x7f9af0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:46.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.691+0000 7f9b0effd640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0065a60 0x7f9af0067f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9b00007fd0 tx=0x7f9b00007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:46.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.695+0000 7f9b0cff9640 1 -- 172.21.15.133:0/3412347946 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b100ca2f0 con 0x7f9b1015c590 2023-12-18T10:21:46.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:46.847+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9b100ca2f0 con 0x7f9b1015c590 2023-12-18T10:21:47.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b0cff9640 1 -- 172.21.15.133:0/3412347946 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9b100ca2f0 con 0x7f9b1015c590 2023-12-18T10:21:47.007 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-18T10:21:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0065a60 msgr2=0x7f9af0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:47.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0065a60 0x7f9af0067f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9b00007fd0 tx=0x7f9b00007d60 comp rx=0 tx=0).stop 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1015c590 msgr2=0x7f9b1014dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1015c590 0x7f9b1014dbe0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800cd50 tx=0x7f9b0800a650 comp rx=0 tx=0).stop 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 shutdown_connections 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9af0065a60 0x7f9af0067f20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1015c590 0x7f9b1014dbe0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b100b2780 0x7f9b1014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 --2- 172.21.15.133:0/3412347946 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b100b23a0 0x7f9b100c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 >> 172.21.15.133:0/3412347946 conn(0x7f9b100cd0e0 msgr2=0x7f9b10072850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.003+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 shutdown_connections 2023-12-18T10:21:47.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.007+0000 7f9b15a41640 1 -- 172.21.15.133:0/3412347946 wait complete. 2023-12-18T10:21:47.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-18T10:21:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe510339640 1 Processor -- start 2023-12-18T10:21:47.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe510339640 1 -- start start 2023-12-18T10:21:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe510339640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080702d0 0x7fe5080706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe510339640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe50815e4f0 0x7fe5080cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe510339640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe508155410 con 0x7fe5080ccd60 2023-12-18T10:21:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe510339640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe508070bf0 con 0x7fe50815e4f0 2023-12-18T10:21:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe510339640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50815ea60 con 0x7fe5080702d0 2023-12-18T10:21:47.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe50e8d6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe5080ccd60 0x7fe50815b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60522/0 (socket says 172.21.15.133:60522) 2023-12-18T10:21:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe50e8d6640 1 -- 172.21.15.133:0/3224338242 learned_addr learned my addr 172.21.15.133:0/3224338242 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe50e0d5640 1 --2- 172.21.15.133:0/3224338242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080702d0 0x7fe5080706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.175+0000 7fe50d8d4640 1 --2- 172.21.15.133:0/3224338242 >> v2:172.21.15.142:3300/0 conn(0x7fe50815e4f0 0x7fe5080cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50d0d3640 1 -- 172.21.15.133:0/3224338242 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215982235 0 0) 0x7fe508155410 con 0x7fe5080ccd60 2023-12-18T10:21:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50d0d3640 1 -- 172.21.15.133:0/3224338242 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f4003530 con 0x7fe5080ccd60 2023-12-18T10:21:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50e0d5640 1 -- 172.21.15.133:0/3224338242 >> v2:172.21.15.142:3300/0 conn(0x7fe50815e4f0 msgr2=0x7fe5080cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50e0d5640 1 --2- 172.21.15.133:0/3224338242 >> v2:172.21.15.142:3300/0 conn(0x7fe50815e4f0 0x7fe5080cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50d0d3640 1 -- 172.21.15.133:0/3224338242 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255388227 0 0) 0x7fe4f4003530 con 0x7fe5080ccd60 2023-12-18T10:21:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50e0d5640 1 -- 172.21.15.133:0/3224338242 >> v1:172.21.15.133:6789/0 conn(0x7fe5080ccd60 legacy=0x7fe50815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:47.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50e0d5640 1 -- 172.21.15.133:0/3224338242 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50815ed40 con 0x7fe5080702d0 2023-12-18T10:21:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50e0d5640 1 --2- 172.21.15.133:0/3224338242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080702d0 0x7fe5080706b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5040097c0 tx=0x7fe50401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4c31daa18c479e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50d0d3640 1 -- 172.21.15.133:0/3224338242 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500001a00 con 0x7fe5080702d0 2023-12-18T10:21:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50d0d3640 1 -- 172.21.15.133:0/3224338242 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5040a7050 con 0x7fe5080702d0 2023-12-18T10:21:47.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.179+0000 7fe50d0d3640 1 -- 172.21.15.133:0/3224338242 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5040ab600 con 0x7fe5080702d0 2023-12-18T10:21:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- 172.21.15.133:0/3224338242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080702d0 msgr2=0x7fe5080706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 --2- 172.21.15.133:0/3224338242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080702d0 0x7fe5080706b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5040097c0 tx=0x7fe50401c370 comp rx=0 tx=0).stop 2023-12-18T10:21:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- 172.21.15.133:0/3224338242 shutdown_connections 2023-12-18T10:21:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 --2- 172.21.15.133:0/3224338242 >> v2:172.21.15.142:3300/0 conn(0x7fe50815e4f0 0x7fe5080cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 --2- 172.21.15.133:0/3224338242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080702d0 0x7fe5080706b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- 172.21.15.133:0/3224338242 >> 172.21.15.133:0/3224338242 conn(0x7fe5080ce450 msgr2=0x7fe5080ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- 172.21.15.133:0/3224338242 shutdown_connections 2023-12-18T10:21:47.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- 172.21.15.133:0/3224338242 wait complete. 2023-12-18T10:21:47.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 Processor -- start 2023-12-18T10:21:47.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- start start 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5080702d0 0x7fe5080c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080ccd60 0x7fe5080c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50815e4f0 0x7fe50814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080c8a10 con 0x7fe50815e4f0 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50814ee00 con 0x7fe5080702d0 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe510339640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080ca5a0 con 0x7fe5080ccd60 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e8d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50815e4f0 0x7fe50814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e8d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50815e4f0 0x7fe50814e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39448/0 (socket says 172.21.15.133:39448) 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50d8d4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080ccd60 0x7fe5080c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e8d6640 1 -- 172.21.15.133:0/832938108 learned_addr learned my addr 172.21.15.133:0/832938108 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:47.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e0d5640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5080702d0 0x7fe5080c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:47.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e8d6640 1 -- 172.21.15.133:0/832938108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080ccd60 msgr2=0x7fe5080c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:47.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e8d6640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080ccd60 0x7fe5080c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e8d6640 1 -- 172.21.15.133:0/832938108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5080702d0 msgr2=0x7fe5080c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:47.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e8d6640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5080702d0 0x7fe5080c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:47.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.183+0000 7fe50e8d6640 1 -- 172.21.15.133:0/832938108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe504009420 con 0x7fe50815e4f0 2023-12-18T10:21:47.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe50e8d6640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50815e4f0 0x7fe50814e8c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe50000cc00 tx=0x7fe50000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:47.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe4feffd640 1 -- 172.21.15.133:0/832938108 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000ce10 con 0x7fe50815e4f0 2023-12-18T10:21:47.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5080ca880 con 0x7fe50815e4f0 2023-12-18T10:21:47.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5080c8f40 con 0x7fe50815e4f0 2023-12-18T10:21:47.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe4feffd640 1 -- 172.21.15.133:0/832938108 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50001b400 con 0x7fe50815e4f0 2023-12-18T10:21:47.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe4feffd640 1 -- 172.21.15.133:0/832938108 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50001b770 con 0x7fe50815e4f0 2023-12-18T10:21:47.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0005260 con 0x7fe50815e4f0 2023-12-18T10:21:47.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe4feffd640 1 -- 172.21.15.133:0/832938108 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe50001b8d0 con 0x7fe50815e4f0 2023-12-18T10:21:47.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe4feffd640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe4ec065a60 0x7fe4ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:47.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe4feffd640 1 -- 172.21.15.133:0/832938108 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fe5000836a0 con 0x7fe50815e4f0 2023-12-18T10:21:47.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.187+0000 7fe50e0d5640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe4ec065a60 0x7fe4ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:47.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.191+0000 7fe50e0d5640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe4ec065a60 0x7fe4ec067f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe5040ad000 tx=0x7fe5040a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:47.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.195+0000 7fe4feffd640 1 -- 172.21.15.133:0/832938108 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe5000511a0 con 0x7fe50815e4f0 2023-12-18T10:21:47.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:47.347+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe4f0005510 con 0x7fe50815e4f0 2023-12-18T10:21:48.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.019+0000 7fe4feffd640 1 -- 172.21.15.133:0/832938108 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe5000547c0 con 0x7fe50815e4f0 2023-12-18T10:21:48.022 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe4ec065a60 msgr2=0x7fe4ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe4ec065a60 0x7fe4ec067f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe5040ad000 tx=0x7fe5040a6000 comp rx=0 tx=0).stop 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50815e4f0 msgr2=0x7fe50814e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50815e4f0 0x7fe50814e8c0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe50000cc00 tx=0x7fe50000a430 comp rx=0 tx=0).stop 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 shutdown_connections 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe4ec065a60 0x7fe4ec067f20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe50815e4f0 0x7fe50814e8c0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5080ccd60 0x7fe5080c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 --2- 172.21.15.133:0/832938108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5080702d0 0x7fe5080c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 >> 172.21.15.133:0/832938108 conn(0x7fe5080ce450 msgr2=0x7fe5080af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:48.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 shutdown_connections 2023-12-18T10:21:48.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.023+0000 7fe510339640 1 -- 172.21.15.133:0/832938108 wait complete. 2023-12-18T10:21:48.060 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-18T10:21:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5dca66640 1 Processor -- start 2023-12-18T10:21:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5dca66640 1 -- start start 2023-12-18T10:21:48.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5dca66640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5d80ca410 0x7fa5d8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5dca66640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5d8159fb0 0x7fa5d8071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5dca66640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d8070df0 con 0x7fa5d8071db0 2023-12-18T10:21:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5dca66640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d815aab0 con 0x7fa5d80ca410 2023-12-18T10:21:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5dca66640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d815a4f0 con 0x7fa5d8159fb0 2023-12-18T10:21:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5d659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5d80ca410 0x7fa5d8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5d659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5d80ca410 0x7fa5d8159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39454/0 (socket says 172.21.15.133:39454) 2023-12-18T10:21:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5d659c640 1 -- 172.21.15.133:0/3041243394 learned_addr learned my addr 172.21.15.133:0/3041243394 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:48.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5cdd9b640 1 --2- 172.21.15.133:0/3041243394 >> v2:172.21.15.142:3300/0 conn(0x7fa5d8159fb0 0x7fa5d8071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5d659c640 1 -- 172.21.15.133:0/3041243394 >> v2:172.21.15.142:3300/0 conn(0x7fa5d8159fb0 msgr2=0x7fa5d8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:48.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5d659c640 1 --2- 172.21.15.133:0/3041243394 >> v2:172.21.15.142:3300/0 conn(0x7fa5d8159fb0 0x7fa5d8071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5d659c640 1 -- 172.21.15.133:0/3041243394 >> v1:172.21.15.133:6789/0 conn(0x7fa5d8071db0 legacy=0x7fa5d80cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5d659c640 1 -- 172.21.15.133:0/3041243394 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d815a7d0 con 0x7fa5d80ca410 2023-12-18T10:21:48.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.199+0000 7fa5d5d9b640 1 -- 172.21.15.133:0/3041243394 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471499509 0 0) 0x7fa5d8070df0 con 0x7fa5d8071db0 2023-12-18T10:21:48.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5d659c640 1 --2- 172.21.15.133:0/3041243394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d80ca410 0x7fa5d8159a70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80cbeb0 tx=0x7fa5c801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcadce13faf1633 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5d5d9b640 1 -- 172.21.15.133:0/3041243394 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80a7b80 con 0x7fa5d80ca410 2023-12-18T10:21:48.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5d5d9b640 1 -- 172.21.15.133:0/3041243394 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c80a7ce0 con 0x7fa5d80ca410 2023-12-18T10:21:48.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5d5d9b640 1 -- 172.21.15.133:0/3041243394 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80af660 con 0x7fa5d80ca410 2023-12-18T10:21:48.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5dca66640 1 -- 172.21.15.133:0/3041243394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d80ca410 msgr2=0x7fa5d8159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5dca66640 1 --2- 172.21.15.133:0/3041243394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d80ca410 0x7fa5d8159a70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80cbeb0 tx=0x7fa5c801eba0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5dca66640 1 -- 172.21.15.133:0/3041243394 shutdown_connections 2023-12-18T10:21:48.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5dca66640 1 --2- 172.21.15.133:0/3041243394 >> v2:172.21.15.142:3300/0 conn(0x7fa5d8159fb0 0x7fa5d8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5dca66640 1 --2- 172.21.15.133:0/3041243394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d80ca410 0x7fa5d8159a70 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5dca66640 1 -- 172.21.15.133:0/3041243394 >> 172.21.15.133:0/3041243394 conn(0x7fa5d806a2a0 msgr2=0x7fa5d80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:48.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5dca66640 1 -- 172.21.15.133:0/3041243394 shutdown_connections 2023-12-18T10:21:48.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.203+0000 7fa5dca66640 1 -- 172.21.15.133:0/3041243394 wait complete. 2023-12-18T10:21:48.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 Processor -- start 2023-12-18T10:21:48.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 -- start start 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d8071db0 0x7fa5d814c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d80ca410 0x7fa5d814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d8159fb0 0x7fa5d80c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d814f0c0 con 0x7fa5d8071db0 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d814e4b0 con 0x7fa5d80ca410 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d814e790 con 0x7fa5d8159fb0 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d8071db0 0x7fa5d814c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d8071db0 0x7fa5d814c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39462/0 (socket says 172.21.15.133:39462) 2023-12-18T10:21:48.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 -- 172.21.15.133:0/660671482 learned_addr learned my addr 172.21.15.133:0/660671482 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d6d9d640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d8159fb0 0x7fa5d80c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5cdd9b640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d80ca410 0x7fa5d814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 -- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d8159fb0 msgr2=0x7fa5d80c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d8159fb0 0x7fa5d80c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 -- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d80ca410 msgr2=0x7fa5d814da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d80ca410 0x7fa5d814da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 -- 172.21.15.133:0/660671482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c800b770 con 0x7fa5d8071db0 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5cdd9b640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d80ca410 0x7fa5d814da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:48.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5d659c640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d8071db0 0x7fa5d814c980 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa5c801b7b0 tx=0x7fa5c801b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5cf7fe640 1 -- 172.21.15.133:0/660671482 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c80afe00 con 0x7fa5d8071db0 2023-12-18T10:21:48.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5cf7fe640 1 -- 172.21.15.133:0/660671482 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c8004020 con 0x7fa5d8071db0 2023-12-18T10:21:48.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5cf7fe640 1 -- 172.21.15.133:0/660671482 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8004390 con 0x7fa5d8071db0 2023-12-18T10:21:48.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d814ea70 con 0x7fa5d8071db0 2023-12-18T10:21:48.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.207+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d814a2d0 con 0x7fa5d8071db0 2023-12-18T10:21:48.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.211+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d804e000 con 0x7fa5d8071db0 2023-12-18T10:21:48.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.211+0000 7fa5cf7fe640 1 -- 172.21.15.133:0/660671482 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa5c80b6070 con 0x7fa5d8071db0 2023-12-18T10:21:48.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.211+0000 7fa5cf7fe640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5b8065a60 0x7fa5b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.211+0000 7fa5cf7fe640 1 -- 172.21.15.133:0/660671482 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fa5c811dee0 con 0x7fa5d8071db0 2023-12-18T10:21:48.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.211+0000 7fa5cdd9b640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5b8065a60 0x7fa5b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.211+0000 7fa5cdd9b640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5b8065a60 0x7fa5b8067f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0003fd0 tx=0x7fa5c00039e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.215+0000 7fa5cf7fe640 1 -- 172.21.15.133:0/660671482 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa5c80eba50 con 0x7fa5d8071db0 2023-12-18T10:21:48.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.395+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa5d80cd600 con 0x7fa5d8071db0 2023-12-18T10:21:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.407+0000 7fa5cf7fe640 1 -- 172.21.15.133:0/660671482 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v46) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa5c80b40c0 con 0x7fa5d8071db0 2023-12-18T10:21:48.410 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 9 and data pool 10 2023-12-18T10:21:48.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.407+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5b8065a60 msgr2=0x7fa5b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.407+0000 7fa5dca66640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5b8065a60 0x7fa5b8067f20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0003fd0 tx=0x7fa5c00039e0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.407+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d8071db0 msgr2=0x7fa5d814c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.407+0000 7fa5dca66640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d8071db0 0x7fa5d814c980 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa5c801b7b0 tx=0x7fa5c801b940 comp rx=0 tx=0).stop 2023-12-18T10:21:48.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.411+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 shutdown_connections 2023-12-18T10:21:48.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.411+0000 7fa5dca66640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa5b8065a60 0x7fa5b8067f20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.411+0000 7fa5dca66640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d8159fb0 0x7fa5d80c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.411+0000 7fa5dca66640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d80ca410 0x7fa5d814da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.411+0000 7fa5dca66640 1 --2- 172.21.15.133:0/660671482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5d8071db0 0x7fa5d814c980 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.411+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 >> 172.21.15.133:0/660671482 conn(0x7fa5d806a2a0 msgr2=0x7fa5d8157690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:48.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.411+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 shutdown_connections 2023-12-18T10:21:48.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.411+0000 7fa5dca66640 1 -- 172.21.15.133:0/660671482 wait complete. 2023-12-18T10:21:48.453 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:21:48.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.587+0000 7f3f112f2640 1 Processor -- start 2023-12-18T10:21:48.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.587+0000 7f3f112f2640 1 -- start start 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.587+0000 7f3f112f2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f0c069ca0 0x7f3f0c06a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.587+0000 7f3f112f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f112f2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0ccde0 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f112f2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c06a5c0 con 0x7f3f0c069ca0 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f112f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0cc820 con 0x7f3f0c15caf0 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3f0c0cdc20 0x7f3f0c0717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60536/0 (socket says 172.21.15.133:60536) 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0b7fe640 1 -- 172.21.15.133:0/1279555628 learned_addr learned my addr 172.21.15.133:0/1279555628 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0affd640 1 --2- 172.21.15.133:0/1279555628 >> v2:172.21.15.142:3300/0 conn(0x7f3f0c069ca0 0x7f3f0c06a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f027fc640 1 --2- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0a7fc640 1 -- 172.21.15.133:0/1279555628 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148917907 0 0) 0x7f3f0c0ccde0 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0a7fc640 1 -- 172.21.15.133:0/1279555628 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef8003530 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0a7fc640 1 -- 172.21.15.133:0/1279555628 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4206712339 0 0) 0x7f3ef8003530 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0affd640 1 -- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 msgr2=0x7f3f0c0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:48.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0affd640 1 --2- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0affd640 1 -- 172.21.15.133:0/1279555628 >> v1:172.21.15.133:6789/0 conn(0x7f3f0c0cdc20 legacy=0x7f3f0c0717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0affd640 1 -- 172.21.15.133:0/1279555628 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0ccb00 con 0x7f3f0c069ca0 2023-12-18T10:21:48.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f027fc640 1 --2- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:48.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.591+0000 7f3f0affd640 1 --2- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 0x7f3f0c06a080 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc3a07a05ab0c848 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f0a7fc640 1 -- 172.21.15.133:0/1279555628 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04001680 con 0x7f3f0c069ca0 2023-12-18T10:21:48.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f0a7fc640 1 -- 172.21.15.133:0/1279555628 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0a7050 con 0x7f3f0c069ca0 2023-12-18T10:21:48.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f0a7fc640 1 -- 172.21.15.133:0/1279555628 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0ab600 con 0x7f3f0c069ca0 2023-12-18T10:21:48.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 msgr2=0x7f3f0c06a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 --2- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 0x7f3f0c06a080 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01c370 comp rx=0 tx=0).stop 2023-12-18T10:21:48.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- 172.21.15.133:0/1279555628 shutdown_connections 2023-12-18T10:21:48.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 --2- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 --2- 172.21.15.133:0/1279555628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 0x7f3f0c06a080 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- 172.21.15.133:0/1279555628 >> 172.21.15.133:0/1279555628 conn(0x7f3f0c06cf80 msgr2=0x7f3f0c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:48.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- 172.21.15.133:0/1279555628 shutdown_connections 2023-12-18T10:21:48.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- 172.21.15.133:0/1279555628 wait complete. 2023-12-18T10:21:48.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 Processor -- start 2023-12-18T10:21:48.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- start start 2023-12-18T10:21:48.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 0x7f3f0c151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0cdc20 0x7f3f0c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c157c10 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c157650 con 0x7f3f0c069ca0 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.595+0000 7f3f112f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c157930 con 0x7f3f0c15caf0 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0cdc20 0x7f3f0c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0cdc20 0x7f3f0c15bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39468/0 (socket says 172.21.15.133:39468) 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 -- 172.21.15.133:0/107798172 learned_addr learned my addr 172.21.15.133:0/107798172 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f0affd640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 0x7f3f0c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f0b7fe640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 -- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 msgr2=0x7f3f0c14b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c14b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 -- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 msgr2=0x7f3f0c151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 0x7f3f0c151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 -- 172.21.15.133:0/107798172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4009a70 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f0b7fe640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:48.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f027fc640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0cdc20 0x7f3f0c15bb30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400efc0 tx=0x7f3ef4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f03fff640 1 -- 172.21.15.133:0/107798172 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4009d70 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f03fff640 1 -- 172.21.15.133:0/107798172 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef400f040 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc009420 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f03fff640 1 -- 172.21.15.133:0/107798172 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40148c0 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c159a30 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c04e000 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.599+0000 7f3f03fff640 1 -- 172.21.15.133:0/107798172 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ef4014a20 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.603+0000 7f3f03fff640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.603+0000 7f3f03fff640 1 -- 172.21.15.133:0/107798172 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3ef4083f60 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.603+0000 7f3f0affd640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.603+0000 7f3f0affd640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0ad000 tx=0x7f3efc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.607+0000 7f3f03fff640 1 -- 172.21.15.133:0/107798172 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3ef40517d0 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.755+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f0c1675e0 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.755+0000 7f3f03fff640 1 -- 172.21.15.133:0/107798172 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16309 (secure 0 0 0) 0x7f3ef400ce60 con 0x7f3f0c0cdc20 2023-12-18T10:21:48.760 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:48.760 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":64,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:21:48.400701+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:21:46.894515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-18T10:21:47.396141+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:21:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 msgr2=0x7f3eec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0ad000 tx=0x7f3efc008040 comp rx=0 tx=0).stop 2023-12-18T10:21:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0cdc20 msgr2=0x7f3f0c15bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0cdc20 0x7f3f0c15bb30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400efc0 tx=0x7f3ef4009f90 comp rx=0 tx=0).stop 2023-12-18T10:21:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 shutdown_connections 2023-12-18T10:21:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c15caf0 0x7f3f0c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c0cdc20 0x7f3f0c15bb30 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 --2- 172.21.15.133:0/107798172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c069ca0 0x7f3f0c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 >> 172.21.15.133:0/107798172 conn(0x7f3f0c06cf80 msgr2=0x7f3f0c15e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 shutdown_connections 2023-12-18T10:21:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.759+0000 7f3f112f2640 1 -- 172.21.15.133:0/107798172 wait complete. 2023-12-18T10:21:48.782 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:21:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.915+0000 7f908f4d1640 1 Processor -- start 2023-12-18T10:21:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.915+0000 7f908f4d1640 1 -- start start 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.915+0000 7f908f4d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9088160cc0 0x7f90880cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.915+0000 7f908f4d1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90880c1280 0x7f90880cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908f4d1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908806fdb0 con 0x7f90880c17d0 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908f4d1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90881654a0 con 0x7f90880c1280 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908f4d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90881610a0 con 0x7f9088160cc0 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908ca6c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90880c1280 0x7f90880cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908d26d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9088160cc0 0x7f90880cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908ca6c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90880c1280 0x7f90880cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:37130/0 (socket says 172.21.15.133:37130) 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908ca6c640 1 -- 172.21.15.133:0/3775468101 learned_addr learned my addr 172.21.15.133:0/3775468101 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:48.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908d26d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9088160cc0 0x7f90880cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:57396/0 (socket says 172.21.15.133:57396) 2023-12-18T10:21:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908d26d640 1 -- 172.21.15.133:0/3775468101 >> v2:172.21.15.142:3300/0 conn(0x7f90880c1280 msgr2=0x7f90880cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908d26d640 1 --2- 172.21.15.133:0/3775468101 >> v2:172.21.15.142:3300/0 conn(0x7f90880c1280 0x7f90880cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908d26d640 1 -- 172.21.15.133:0/3775468101 >> v1:172.21.15.142:6789/0 conn(0x7f90880c17d0 legacy=0x7f908806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908d26d640 1 -- 172.21.15.133:0/3775468101 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880cb6b0 con 0x7f9088160cc0 2023-12-18T10:21:48.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.919+0000 7f908d26d640 1 --2- 172.21.15.133:0/3775468101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9088160cc0 0x7f90880cac30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f90840097f0 tx=0x7f908401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1038a7bdaf1b86 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f907ffff640 1 -- 172.21.15.133:0/3775468101 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840ab600 con 0x7f9088160cc0 2023-12-18T10:21:48.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f907ffff640 1 -- 172.21.15.133:0/3775468101 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90840a7050 con 0x7f9088160cc0 2023-12-18T10:21:48.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f907ffff640 1 -- 172.21.15.133:0/3775468101 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840ab980 con 0x7f9088160cc0 2023-12-18T10:21:48.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- 172.21.15.133:0/3775468101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9088160cc0 msgr2=0x7f90880cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3775468101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9088160cc0 0x7f90880cac30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f90840097f0 tx=0x7f908401c3c0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- 172.21.15.133:0/3775468101 shutdown_connections 2023-12-18T10:21:48.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3775468101 >> v2:172.21.15.142:3300/0 conn(0x7f90880c1280 0x7f90880cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3775468101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9088160cc0 0x7f90880cac30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- 172.21.15.133:0/3775468101 >> 172.21.15.133:0/3775468101 conn(0x7f908806a3e0 msgr2=0x7f90880afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:48.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- 172.21.15.133:0/3775468101 shutdown_connections 2023-12-18T10:21:48.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- 172.21.15.133:0/3775468101 wait complete. 2023-12-18T10:21:48.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 Processor -- start 2023-12-18T10:21:48.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- start start 2023-12-18T10:21:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90880c1280 0x7f908815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c17d0 0x7f90880ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9088160cc0 0x7f90880ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9088164020 con 0x7f90880c17d0 2023-12-18T10:21:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90881633a0 con 0x7f9088160cc0 2023-12-18T10:21:48.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.923+0000 7f908f4d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9088163680 con 0x7f90880c1280 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90880c1280 0x7f908815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908ca6c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c17d0 0x7f90880ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90880c1280 0x7f908815a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:57400/0 (socket says 172.21.15.133:57400) 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908ca6c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c17d0 0x7f90880ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39474/0 (socket says 172.21.15.133:39474) 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 -- 172.21.15.133:0/3969264191 learned_addr learned my addr 172.21.15.133:0/3969264191 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908da6e640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9088160cc0 0x7f90880ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 -- 172.21.15.133:0/3969264191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9088160cc0 msgr2=0x7f90880ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9088160cc0 0x7f90880ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 -- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c17d0 msgr2=0x7f90880ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c17d0 0x7f90880ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 -- 172.21.15.133:0/3969264191 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084009420 con 0x7f90880c1280 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908ca6c640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c17d0 0x7f90880ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:48.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908d26d640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90880c1280 0x7f908815a1e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f90840ae040 tx=0x7f9084019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f907dffb640 1 -- 172.21.15.133:0/3969264191 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840b4430 con 0x7f90880c1280 2023-12-18T10:21:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f907dffb640 1 -- 172.21.15.133:0/3969264191 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90840b4590 con 0x7f90880c1280 2023-12-18T10:21:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f907dffb640 1 -- 172.21.15.133:0/3969264191 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90840b4940 con 0x7f90880c1280 2023-12-18T10:21:48.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9088163960 con 0x7f90880c1280 2023-12-18T10:21:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908815a720 con 0x7f90880c1280 2023-12-18T10:21:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.927+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90880735b0 con 0x7f90880c1280 2023-12-18T10:21:48.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.931+0000 7f907dffb640 1 -- 172.21.15.133:0/3969264191 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90840b2040 con 0x7f90880c1280 2023-12-18T10:21:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.931+0000 7f907dffb640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f906c065a60 0x7f906c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.931+0000 7f907dffb640 1 -- 172.21.15.133:0/3969264191 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f908411d930 con 0x7f90880c1280 2023-12-18T10:21:48.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.931+0000 7f908ca6c640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f906c065a60 0x7f906c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:48.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.931+0000 7f908ca6c640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f906c065a60 0x7f906c067f20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f908815e1c0 tx=0x7f9078009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:48.935+0000 7f907dffb640 1 -- 172.21.15.133:0/3969264191 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f90840eb310 con 0x7f90880c1280 2023-12-18T10:21:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.091+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9088164160 con 0x7f90880c1280 2023-12-18T10:21:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.091+0000 7f907dffb640 1 -- 172.21.15.133:0/3969264191 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16309 (secure 0 0 0) 0x7f9088164160 con 0x7f90880c1280 2023-12-18T10:21:49.096 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:49.096 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":64,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:21:48.400701+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:21:46.894515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-18T10:21:47.396141+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:21:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f906c065a60 msgr2=0x7f906c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f906c065a60 0x7f906c067f20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f908815e1c0 tx=0x7f9078009240 comp rx=0 tx=0).stop 2023-12-18T10:21:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90880c1280 msgr2=0x7f908815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90880c1280 0x7f908815a1e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f90840ae040 tx=0x7f9084019160 comp rx=0 tx=0).stop 2023-12-18T10:21:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 shutdown_connections 2023-12-18T10:21:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f906c065a60 0x7f906c067f20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9088160cc0 0x7f90880ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c17d0 0x7f90880ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 --2- 172.21.15.133:0/3969264191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90880c1280 0x7f908815a1e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 >> 172.21.15.133:0/3969264191 conn(0x7f908806a3e0 msgr2=0x7f90880cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 shutdown_connections 2023-12-18T10:21:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.095+0000 7f908f4d1640 1 -- 172.21.15.133:0/3969264191 wait complete. 2023-12-18T10:21:49.117 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-18T10:21:49.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f78751ce640 1 Processor -- start 2023-12-18T10:21:49.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f78751ce640 1 -- start start 2023-12-18T10:21:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f78751ce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f78701582d0 0x7f78700c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f78751ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7870070820 0x7f78700ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f78751ce640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78700c9390 con 0x7f78700ce3b0 2023-12-18T10:21:49.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f78751ce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787015aee0 con 0x7f78701582d0 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f78751ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787015b1c0 con 0x7f7870070820 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786f59e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f78700ce3b0 0x7f78700cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60538/0 (socket says 172.21.15.133:60538) 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786f59e640 1 -- 172.21.15.133:0/1571206558 learned_addr learned my addr 172.21.15.133:0/1571206558 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786659c640 1 --2- 172.21.15.133:0/1571206558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7870070820 0x7f78700ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786ed9d640 1 --2- 172.21.15.133:0/1571206558 >> v2:172.21.15.142:3300/0 conn(0x7f78701582d0 0x7f78700c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786e59c640 1 -- 172.21.15.133:0/1571206558 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524463930 0 0) 0x7f78700c9390 con 0x7f78700ce3b0 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786e59c640 1 -- 172.21.15.133:0/1571206558 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f785c003530 con 0x7f78700ce3b0 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786659c640 1 -- 172.21.15.133:0/1571206558 >> v2:172.21.15.142:3300/0 conn(0x7f78701582d0 msgr2=0x7f78700c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786659c640 1 --2- 172.21.15.133:0/1571206558 >> v2:172.21.15.142:3300/0 conn(0x7f78701582d0 0x7f78700c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786659c640 1 -- 172.21.15.133:0/1571206558 >> v1:172.21.15.133:6789/0 conn(0x7f78700ce3b0 legacy=0x7f78700cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786659c640 1 -- 172.21.15.133:0/1571206558 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787015b4a0 con 0x7f7870070820 2023-12-18T10:21:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.255+0000 7f786ed9d640 1 --2- 172.21.15.133:0/1571206558 >> v2:172.21.15.142:3300/0 conn(0x7f78701582d0 0x7f78700c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f786659c640 1 --2- 172.21.15.133:0/1571206558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7870070820 0x7f78700ca5f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f78580097c0 tx=0x7f785801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1031dbb8b1d93f18 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f786e59c640 1 -- 172.21.15.133:0/1571206558 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580ab670 con 0x7f7870070820 2023-12-18T10:21:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f786e59c640 1 -- 172.21.15.133:0/1571206558 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78580ab7d0 con 0x7f7870070820 2023-12-18T10:21:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f786e59c640 1 -- 172.21.15.133:0/1571206558 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580abb60 con 0x7f7870070820 2023-12-18T10:21:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f78751ce640 1 -- 172.21.15.133:0/1571206558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7870070820 msgr2=0x7f78700ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f78751ce640 1 --2- 172.21.15.133:0/1571206558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7870070820 0x7f78700ca5f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f78580097c0 tx=0x7f785801c450 comp rx=0 tx=0).stop 2023-12-18T10:21:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f78751ce640 1 -- 172.21.15.133:0/1571206558 shutdown_connections 2023-12-18T10:21:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f78751ce640 1 --2- 172.21.15.133:0/1571206558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7870070820 0x7f78700ca5f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f78751ce640 1 --2- 172.21.15.133:0/1571206558 >> v2:172.21.15.142:3300/0 conn(0x7f78701582d0 0x7f78700c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f78751ce640 1 -- 172.21.15.133:0/1571206558 >> 172.21.15.133:0/1571206558 conn(0x7f787006a2a0 msgr2=0x7f78700aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f78751ce640 1 -- 172.21.15.133:0/1571206558 shutdown_connections 2023-12-18T10:21:49.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.259+0000 7f78751ce640 1 -- 172.21.15.133:0/1571206558 wait complete. 2023-12-18T10:21:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 Processor -- start 2023-12-18T10:21:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 -- start start 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7870070820 0x7f7870154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78700ce3b0 0x7f78701531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78701582d0 0x7f78700aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78700c54f0 con 0x7f7870070820 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7870153730 con 0x7f78701582d0 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700c67e0 con 0x7f78700ce3b0 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7870070820 0x7f7870154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7870070820 0x7f7870154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39478/0 (socket says 172.21.15.133:39478) 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 -- 172.21.15.133:0/4254870606 learned_addr learned my addr 172.21.15.133:0/4254870606 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786f59e640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78701582d0 0x7f78700aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786659c640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78700ce3b0 0x7f78701531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 -- 172.21.15.133:0/4254870606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78700ce3b0 msgr2=0x7f78701531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78700ce3b0 0x7f78701531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 -- 172.21.15.133:0/4254870606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78701582d0 msgr2=0x7f78700aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78701582d0 0x7f78700aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 -- 172.21.15.133:0/4254870606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860009a70 con 0x7f7870070820 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f786ed9d640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7870070820 0x7f7870154cd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f786000efc0 tx=0x7f786000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f7867fff640 1 -- 172.21.15.133:0/4254870606 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860014680 con 0x7f7870070820 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f7867fff640 1 -- 172.21.15.133:0/4254870606 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786000f040 con 0x7f7870070820 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7858009420 con 0x7f7870070820 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f7867fff640 1 -- 172.21.15.133:0/4254870606 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860014a00 con 0x7f7870070820 2023-12-18T10:21:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.263+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78700c5a20 con 0x7f7870070820 2023-12-18T10:21:49.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.267+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78700caae0 con 0x7f7870070820 2023-12-18T10:21:49.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.267+0000 7f7867fff640 1 -- 172.21.15.133:0/4254870606 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7860014b60 con 0x7f7870070820 2023-12-18T10:21:49.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.267+0000 7f7867fff640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:49.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.267+0000 7f7867fff640 1 -- 172.21.15.133:0/4254870606 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7860084330 con 0x7f7870070820 2023-12-18T10:21:49.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.267+0000 7f786659c640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:49.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.267+0000 7f786659c640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f78580af000 tx=0x7f78580a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.271+0000 7f7867fff640 1 -- 172.21.15.133:0/4254870606 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7860051b10 con 0x7f7870070820 2023-12-18T10:21:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:49.455+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f787004e000 con 0x7f7870070820 2023-12-18T10:21:49.998 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-12-18T10:21:49.996+0000 7f2b3d1a4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:21:50.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.411+0000 7f7867fff640 1 -- 172.21.15.133:0/4254870606 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7860055130 con 0x7f7870070820 2023-12-18T10:21:50.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 msgr2=0x7f7850067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:50.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f78580af000 tx=0x7f78580a7000 comp rx=0 tx=0).stop 2023-12-18T10:21:50.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7870070820 msgr2=0x7f7870154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:50.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7870070820 0x7f7870154cd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f786000efc0 tx=0x7f786000c490 comp rx=0 tx=0).stop 2023-12-18T10:21:50.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 shutdown_connections 2023-12-18T10:21:50.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78701582d0 0x7f78700aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78700ce3b0 0x7f78701531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 --2- 172.21.15.133:0/4254870606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7870070820 0x7f7870154cd0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 >> 172.21.15.133:0/4254870606 conn(0x7f787006a2a0 msgr2=0x7f7870154110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:50.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 shutdown_connections 2023-12-18T10:21:50.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.415+0000 7f78751ce640 1 -- 172.21.15.133:0/4254870606 wait complete. 2023-12-18T10:21:50.438 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-18T10:21:50.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-18T10:21:50.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.575+0000 7faaf4066640 1 Processor -- start 2023-12-18T10:21:50.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.575+0000 7faaf4066640 1 -- start start 2023-12-18T10:21:50.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.575+0000 7faaf4066640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faaec1582d0 0x7faaec0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:50.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.575+0000 7faaf4066640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faaec070820 0x7faaec0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:50.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf4066640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec0c9390 con 0x7faaec0ce3b0 2023-12-18T10:21:50.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf4066640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec15aee0 con 0x7faaec1582d0 2023-12-18T10:21:50.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf4066640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec15b1c0 con 0x7faaec070820 2023-12-18T10:21:50.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf1e02640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faaec1582d0 0x7faaec0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:50.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf1601640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faaec070820 0x7faaec0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:50.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf2603640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faaec0ce3b0 0x7faaec0cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:57278/0 (socket says 172.21.15.133:57278) 2023-12-18T10:21:50.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf2603640 1 -- 172.21.15.133:0/1447093955 learned_addr learned my addr 172.21.15.133:0/1447093955 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:50.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf1e02640 1 -- 172.21.15.133:0/1447093955 >> v2:172.21.15.142:3300/0 conn(0x7faaec070820 msgr2=0x7faaec0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:50.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf1e02640 1 --2- 172.21.15.133:0/1447093955 >> v2:172.21.15.142:3300/0 conn(0x7faaec070820 0x7faaec0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf1e02640 1 -- 172.21.15.133:0/1447093955 >> v1:172.21.15.142:6789/0 conn(0x7faaec0ce3b0 legacy=0x7faaec0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:50.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf1e02640 1 -- 172.21.15.133:0/1447093955 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec15b4a0 con 0x7faaec1582d0 2023-12-18T10:21:50.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf1e02640 1 --2- 172.21.15.133:0/1447093955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec1582d0 0x7faaec0c8e50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faaec06dfa0 tx=0x7faae801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2542e293ff496e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:50.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.579+0000 7faaf0e00640 1 -- 172.21.15.133:0/1447093955 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80ab650 con 0x7faaec1582d0 2023-12-18T10:21:50.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf0e00640 1 -- 172.21.15.133:0/1447093955 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae80ab7b0 con 0x7faaec1582d0 2023-12-18T10:21:50.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf0e00640 1 -- 172.21.15.133:0/1447093955 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80abb40 con 0x7faaec1582d0 2023-12-18T10:21:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- 172.21.15.133:0/1447093955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec1582d0 msgr2=0x7faaec0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 --2- 172.21.15.133:0/1447093955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec1582d0 0x7faaec0c8e50 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faaec06dfa0 tx=0x7faae801c430 comp rx=0 tx=0).stop 2023-12-18T10:21:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- 172.21.15.133:0/1447093955 shutdown_connections 2023-12-18T10:21:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 --2- 172.21.15.133:0/1447093955 >> v2:172.21.15.142:3300/0 conn(0x7faaec070820 0x7faaec0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 --2- 172.21.15.133:0/1447093955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec1582d0 0x7faaec0c8e50 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- 172.21.15.133:0/1447093955 >> 172.21.15.133:0/1447093955 conn(0x7faaec06a2a0 msgr2=0x7faaec0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- 172.21.15.133:0/1447093955 shutdown_connections 2023-12-18T10:21:50.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- 172.21.15.133:0/1447093955 wait complete. 2023-12-18T10:21:50.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 Processor -- start 2023-12-18T10:21:50.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- start start 2023-12-18T10:21:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec070820 0x7faaec0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec0ce3b0 0x7faaec15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaec1582d0 0x7faaec0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec14c420 con 0x7faaec070820 2023-12-18T10:21:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0cdd80 con 0x7faaec0ce3b0 2023-12-18T10:21:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf4066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec163740 con 0x7faaec1582d0 2023-12-18T10:21:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.583+0000 7faaf1e02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec070820 0x7faaec0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1e02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec070820 0x7faaec0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59558/0 (socket says 172.21.15.133:59558) 2023-12-18T10:21:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1e02640 1 -- 172.21.15.133:0/1040663057 learned_addr learned my addr 172.21.15.133:0/1040663057 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1601640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec0ce3b0 0x7faaec15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf2603640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaec1582d0 0x7faaec0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1e02640 1 -- 172.21.15.133:0/1040663057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaec1582d0 msgr2=0x7faaec0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1e02640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaec1582d0 0x7faaec0c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1e02640 1 -- 172.21.15.133:0/1040663057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec0ce3b0 msgr2=0x7faaec15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1e02640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec0ce3b0 0x7faaec15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1e02640 1 -- 172.21.15.133:0/1040663057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8009420 con 0x7faaec070820 2023-12-18T10:21:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf1e02640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec070820 0x7faaec0cd6a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7faae8019040 tx=0x7faae801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faae27fc640 1 -- 172.21.15.133:0/1040663057 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80bf610 con 0x7faaec070820 2023-12-18T10:21:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faae27fc640 1 -- 172.21.15.133:0/1040663057 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae80bf770 con 0x7faaec070820 2023-12-18T10:21:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec163a20 con 0x7faaec070820 2023-12-18T10:21:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faae27fc640 1 -- 172.21.15.133:0/1040663057 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae80bfb20 con 0x7faaec070820 2023-12-18T10:21:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec163fe0 con 0x7faaec070820 2023-12-18T10:21:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec04e000 con 0x7faaec070820 2023-12-18T10:21:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.587+0000 7faae27fc640 1 -- 172.21.15.133:0/1040663057 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faae80bfc80 con 0x7faaec070820 2023-12-18T10:21:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.591+0000 7faae27fc640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faad0065a60 0x7faad0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.591+0000 7faae27fc640 1 -- 172.21.15.133:0/1040663057 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faae811e000 con 0x7faaec070820 2023-12-18T10:21:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.591+0000 7faaf1601640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faad0065a60 0x7faad0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.591+0000 7faaf1601640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faad0065a60 0x7faad0067f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faaec0cc060 tx=0x7faadc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:50.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.595+0000 7faae27fc640 1 -- 172.21.15.133:0/1040663057 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faae80eb930 con 0x7faaec070820 2023-12-18T10:21:50.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:50.775+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faaec0b0c00 con 0x7faaec070820 2023-12-18T10:21:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.415+0000 7faae27fc640 1 -- 172.21.15.133:0/1040663057 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) v1 ==== 122+0+0 (secure 0 0 0) 0x7faae80eef50 con 0x7faaec070820 2023-12-18T10:21:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faad0065a60 msgr2=0x7faad0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faad0065a60 0x7faad0067f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faaec0cc060 tx=0x7faadc009190 comp rx=0 tx=0).stop 2023-12-18T10:21:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec070820 msgr2=0x7faaec0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec070820 0x7faaec0cd6a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7faae8019040 tx=0x7faae801ac70 comp rx=0 tx=0).stop 2023-12-18T10:21:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 shutdown_connections 2023-12-18T10:21:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faad0065a60 0x7faad0067f20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaec1582d0 0x7faaec0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaec0ce3b0 0x7faaec15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 --2- 172.21.15.133:0/1040663057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec070820 0x7faaec0cd6a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 >> 172.21.15.133:0/1040663057 conn(0x7faaec06a2a0 msgr2=0x7faaec0c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 shutdown_connections 2023-12-18T10:21:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.419+0000 7faaf4066640 1 -- 172.21.15.133:0/1040663057 wait complete. 2023-12-18T10:21:51.445 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-18T10:21:51.445 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f754c96c640 1 Processor -- start 2023-12-18T10:21:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f754c96c640 1 -- start start 2023-12-18T10:21:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f754c96c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f754806c5b0 0x7f75480c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f754c96c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75480c36c0 con 0x7f75480b0420 2023-12-18T10:21:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f754c96c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75480c39a0 con 0x7f7548143f50 2023-12-18T10:21:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f754c96c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f754806ca20 con 0x7f754806c5b0 2023-12-18T10:21:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f7546ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f75480b0420 0x7f754806bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54072/0 (socket says 172.21.15.133:54072) 2023-12-18T10:21:51.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f7546ffd640 1 -- 172.21.15.133:0/3490509365 learned_addr learned my addr 172.21.15.133:0/3490509365 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:51.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f7547fff640 1 --2- 172.21.15.133:0/3490509365 >> v2:172.21.15.142:3300/0 conn(0x7f754806c5b0 0x7f75480c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f75467fc640 1 -- 172.21.15.133:0/3490509365 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912935074 0 0) 0x7f75480c36c0 con 0x7f75480b0420 2023-12-18T10:21:51.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f75467fc640 1 -- 172.21.15.133:0/3490509365 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7530003530 con 0x7f75480b0420 2023-12-18T10:21:51.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f75467fc640 1 -- 172.21.15.133:0/3490509365 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384784374 0 0) 0x7f75480c39a0 con 0x7f7548143f50 2023-12-18T10:21:51.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f75467fc640 1 -- 172.21.15.133:0/3490509365 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75480c36c0 con 0x7f7548143f50 2023-12-18T10:21:51.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f7547fff640 1 -- 172.21.15.133:0/3490509365 >> v1:172.21.15.142:6789/0 conn(0x7f7548143f50 legacy=0x7f75480afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f7547fff640 1 -- 172.21.15.133:0/3490509365 >> v1:172.21.15.133:6789/0 conn(0x7f75480b0420 legacy=0x7f754806bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.583+0000 7f7547fff640 1 -- 172.21.15.133:0/3490509365 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480c3c80 con 0x7f754806c5b0 2023-12-18T10:21:51.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f7547fff640 1 --2- 172.21.15.133:0/3490509365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754806c5b0 0x7f75480c4480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7540009d90 tx=0x7f754001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40bf3a6c922db1e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f75467fc640 1 -- 172.21.15.133:0/3490509365 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400a5a30 con 0x7f754806c5b0 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f75467fc640 1 -- 172.21.15.133:0/3490509365 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75400a5b90 con 0x7f754806c5b0 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f75467fc640 1 -- 172.21.15.133:0/3490509365 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400ad440 con 0x7f754806c5b0 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f754c96c640 1 -- 172.21.15.133:0/3490509365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754806c5b0 msgr2=0x7f75480c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f754c96c640 1 --2- 172.21.15.133:0/3490509365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754806c5b0 0x7f75480c4480 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7540009d90 tx=0x7f754001c950 comp rx=0 tx=0).stop 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f754c96c640 1 -- 172.21.15.133:0/3490509365 shutdown_connections 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f754c96c640 1 --2- 172.21.15.133:0/3490509365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f754806c5b0 0x7f75480c4480 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f754c96c640 1 -- 172.21.15.133:0/3490509365 >> 172.21.15.133:0/3490509365 conn(0x7f75480ce130 msgr2=0x7f75480ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f754c96c640 1 -- 172.21.15.133:0/3490509365 shutdown_connections 2023-12-18T10:21:51.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.587+0000 7f754c96c640 1 -- 172.21.15.133:0/3490509365 wait complete. 2023-12-18T10:21:51.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 Processor -- start 2023-12-18T10:21:51.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 -- start start 2023-12-18T10:21:51.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f754806c5b0 0x7f7548137720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75480b0420 0x7f7548159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7548143f50 0x7f7548156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7548153760 con 0x7f754806c5b0 2023-12-18T10:21:51.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7548153a40 con 0x7f75480b0420 2023-12-18T10:21:51.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7548153d20 con 0x7f7548143f50 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f754806c5b0 0x7f7548137720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f754806c5b0 0x7f7548137720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59570/0 (socket says 172.21.15.133:59570) 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 -- 172.21.15.133:0/3192922839 learned_addr learned my addr 172.21.15.133:0/3192922839 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f7546ffd640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75480b0420 0x7f7548159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f7547fff640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7548143f50 0x7f7548156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 -- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7548143f50 msgr2=0x7f7548156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7548143f50 0x7f7548156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 -- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75480b0420 msgr2=0x7f7548159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75480b0420 0x7f7548159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 -- 172.21.15.133:0/3192922839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7540009a70 con 0x7f754806c5b0 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f7546ffd640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75480b0420 0x7f7548159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:51.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f7547fff640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7548143f50 0x7f7548156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:51.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f75477fe640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f754806c5b0 0x7f7548137720 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f753800c430 tx=0x7f753800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:51.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f752ffff640 1 -- 172.21.15.133:0/3192922839 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75380052d0 con 0x7f754806c5b0 2023-12-18T10:21:51.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f752ffff640 1 -- 172.21.15.133:0/3192922839 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538005450 con 0x7f754806c5b0 2023-12-18T10:21:51.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f752ffff640 1 -- 172.21.15.133:0/3192922839 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538003840 con 0x7f754806c5b0 2023-12-18T10:21:51.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7548154000 con 0x7f754806c5b0 2023-12-18T10:21:51.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7548137c60 con 0x7f754806c5b0 2023-12-18T10:21:51.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.591+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754804e850 con 0x7f754806c5b0 2023-12-18T10:21:51.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.595+0000 7f752ffff640 1 -- 172.21.15.133:0/3192922839 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f75380039a0 con 0x7f754806c5b0 2023-12-18T10:21:51.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.595+0000 7f752ffff640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7534065a60 0x7f7534067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.595+0000 7f752ffff640 1 -- 172.21.15.133:0/3192922839 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7538082910 con 0x7f754806c5b0 2023-12-18T10:21:51.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.595+0000 7f7546ffd640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7534065a60 0x7f7534067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.595+0000 7f7546ffd640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7534065a60 0x7f7534067f20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7548166380 tx=0x7f753c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.599+0000 7f752ffff640 1 -- 172.21.15.133:0/3192922839 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7538050180 con 0x7f754806c5b0 2023-12-18T10:21:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.779+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75480c3990 con 0x7f754806c5b0 2023-12-18T10:21:51.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.779+0000 7f752ffff640 1 -- 172.21.15.133:0/3192922839 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f7538017090 con 0x7f754806c5b0 2023-12-18T10:21:51.785 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:51.786 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":50,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:21:51.415675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:21:51.786 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 50 2023-12-18T10:21:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7534065a60 msgr2=0x7f7534067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7534065a60 0x7f7534067f20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7548166380 tx=0x7f753c009040 comp rx=0 tx=0).stop 2023-12-18T10:21:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f754806c5b0 msgr2=0x7f7548137720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f754806c5b0 0x7f7548137720 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f753800c430 tx=0x7f753800c8f0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 shutdown_connections 2023-12-18T10:21:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7534065a60 0x7f7534067f20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7548143f50 0x7f7548156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75480b0420 0x7f7548159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 --2- 172.21.15.133:0/3192922839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f754806c5b0 0x7f7548137720 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 >> 172.21.15.133:0/3192922839 conn(0x7f75480ce130 msgr2=0x7f75480ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 shutdown_connections 2023-12-18T10:21:51.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.783+0000 7f754c96c640 1 -- 172.21.15.133:0/3192922839 wait complete. 2023-12-18T10:21:51.807 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:21:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.939+0000 7fd1a99ce640 1 Processor -- start 2023-12-18T10:21:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.939+0000 7fd1a99ce640 1 -- start start 2023-12-18T10:21:51.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd1a99ce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1a40cac10 0x7fd1a415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd1a99ce640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a415f100 con 0x7fd1a406fdb0 2023-12-18T10:21:51.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd1a99ce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a40ca7d0 con 0x7fd1a415a680 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd1a99ce640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a415e860 con 0x7fd1a40cac10 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd19a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1a40cac10 0x7fd1a415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd19a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1a40cac10 0x7fd1a415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59578/0 (socket says 172.21.15.133:59578) 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd19a7fc640 1 -- 172.21.15.133:0/918733097 learned_addr learned my addr 172.21.15.133:0/918733097 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd1a37fe640 1 --1- 172.21.15.133:0/918733097 >> v1:172.21.15.133:6789/0 conn(0x7fd1a406fdb0 0x7fd1a40c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54078/0 (socket says 172.21.15.133:54078) 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd19a7fc640 1 -- 172.21.15.133:0/918733097 >> v1:172.21.15.142:6789/0 conn(0x7fd1a415a680 legacy=0x7fd1a415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd19a7fc640 1 -- 172.21.15.133:0/918733097 >> v1:172.21.15.133:6789/0 conn(0x7fd1a406fdb0 legacy=0x7fd1a40c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd19a7fc640 1 -- 172.21.15.133:0/918733097 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a415eb40 con 0x7fd1a40cac10 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.943+0000 7fd19a7fc640 1 --2- 172.21.15.133:0/918733097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a40cac10 0x7fd1a415e160 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009870 tx=0x7fd18c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862a170251f301bd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a27fc640 1 -- 172.21.15.133:0/918733097 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0aa610 con 0x7fd1a40cac10 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a27fc640 1 -- 172.21.15.133:0/918733097 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c0a6040 con 0x7fd1a40cac10 2023-12-18T10:21:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a27fc640 1 -- 172.21.15.133:0/918733097 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0aa990 con 0x7fd1a40cac10 2023-12-18T10:21:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- 172.21.15.133:0/918733097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a40cac10 msgr2=0x7fd1a415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 --2- 172.21.15.133:0/918733097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a40cac10 0x7fd1a415e160 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009870 tx=0x7fd18c01c4b0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- 172.21.15.133:0/918733097 shutdown_connections 2023-12-18T10:21:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 --2- 172.21.15.133:0/918733097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a40cac10 0x7fd1a415e160 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- 172.21.15.133:0/918733097 >> 172.21.15.133:0/918733097 conn(0x7fd1a406a3e0 msgr2=0x7fd1a40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- 172.21.15.133:0/918733097 shutdown_connections 2023-12-18T10:21:51.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- 172.21.15.133:0/918733097 wait complete. 2023-12-18T10:21:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 Processor -- start 2023-12-18T10:21:51.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- start start 2023-12-18T10:21:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a406fdb0 0x7fd1a4157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a40cac10 0x7fd1a4150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a415a680 0x7fd1a40c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40c1fc0 con 0x7fd1a406fdb0 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40c22a0 con 0x7fd1a415a680 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.947+0000 7fd1a99ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40c2580 con 0x7fd1a40cac10 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a406fdb0 0x7fd1a4157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a406fdb0 0x7fd1a4157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59582/0 (socket says 172.21.15.133:59582) 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 -- 172.21.15.133:0/2606771338 learned_addr learned my addr 172.21.15.133:0/2606771338 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a37fe640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a415a680 0x7fd1a40c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd19a7fc640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a40cac10 0x7fd1a4150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 -- 172.21.15.133:0/2606771338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a40cac10 msgr2=0x7fd1a4150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a40cac10 0x7fd1a4150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 -- 172.21.15.133:0/2606771338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a415a680 msgr2=0x7fd1a40c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a415a680 0x7fd1a40c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 -- 172.21.15.133:0/2606771338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0094d0 con 0x7fd1a406fdb0 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a2ffd640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a406fdb0 0x7fd1a4157180 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd19400c500 tx=0x7fd19400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:51.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a0ff9640 1 -- 172.21.15.133:0/2606771338 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194005220 con 0x7fd1a406fdb0 2023-12-18T10:21:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a0ff9640 1 -- 172.21.15.133:0/2606771338 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd194005380 con 0x7fd1a406fdb0 2023-12-18T10:21:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a4070750 con 0x7fd1a406fdb0 2023-12-18T10:21:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a0ff9640 1 -- 172.21.15.133:0/2606771338 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194007270 con 0x7fd1a406fdb0 2023-12-18T10:21:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a40c7cb0 con 0x7fd1a406fdb0 2023-12-18T10:21:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a40735b0 con 0x7fd1a406fdb0 2023-12-18T10:21:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a0ff9640 1 -- 172.21.15.133:0/2606771338 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd1940073d0 con 0x7fd1a406fdb0 2023-12-18T10:21:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a0ff9640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd184065a60 0x7fd184067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd1a0ff9640 1 -- 172.21.15.133:0/2606771338 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd194082660 con 0x7fd1a406fdb0 2023-12-18T10:21:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.951+0000 7fd19a7fc640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd184065a60 0x7fd184067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:51.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.955+0000 7fd19a7fc640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd184065a60 0x7fd184067f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0ae000 tx=0x7fd18c0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:51.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:51.955+0000 7fd1a0ff9640 1 -- 172.21.15.133:0/2606771338 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd19404ff00 con 0x7fd1a406fdb0 2023-12-18T10:21:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.111+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1a40c2100 con 0x7fd1a406fdb0 2023-12-18T10:21:52.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.111+0000 7fd1a0ff9640 1 -- 172.21.15.133:0/2606771338 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16296 (secure 0 0 0) 0x7fd1a40c2100 con 0x7fd1a406fdb0 2023-12-18T10:21:52.116 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":65,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:21:49.403956+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:21:46.894515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-18T10:21:47.396141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd184065a60 msgr2=0x7fd184067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd184065a60 0x7fd184067f20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0ae000 tx=0x7fd18c0b5040 comp rx=0 tx=0).stop 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a406fdb0 msgr2=0x7fd1a4157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a406fdb0 0x7fd1a4157180 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd19400c500 tx=0x7fd19400c9c0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 shutdown_connections 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd184065a60 0x7fd184067f20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd1a415a680 0x7fd1a40c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd1a40cac10 0x7fd1a4150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 --2- 172.21.15.133:0/2606771338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1a406fdb0 0x7fd1a4157180 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 >> 172.21.15.133:0/2606771338 conn(0x7fd1a406a3e0 msgr2=0x7fd1a4072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 shutdown_connections 2023-12-18T10:21:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.115+0000 7fd1a99ce640 1 -- 172.21.15.133:0/2606771338 wait complete. 2023-12-18T10:21:52.137 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-18T10:21:52.138 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:21:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe704220640 1 Processor -- start 2023-12-18T10:21:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe704220640 1 -- start start 2023-12-18T10:21:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe704220640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc15ca40 0x7fe6fc0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe704220640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6fc0ce3f0 0x7fe6fc0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe704220640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6fc0cf610 0x7fe6fc1605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe704220640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0cfa70 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe704220640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0d11c0 con 0x7fe6fc0cf610 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe704220640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0d0310 con 0x7fe6fc15ca40 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7017bb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6fc0ce3f0 0x7fe6fc0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7017bb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6fc0ce3f0 0x7fe6fc0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59592/0 (socket says 172.21.15.133:59592) 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7017bb640 1 -- 172.21.15.133:0/2168779295 learned_addr learned my addr 172.21.15.133:0/2168779295 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7027bd640 1 --2- 172.21.15.133:0/2168779295 >> v2:172.21.15.142:3300/0 conn(0x7fe6fc0cf610 0x7fe6fc1605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7017bb640 1 -- 172.21.15.133:0/2168779295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc15ca40 msgr2=0x7fe6fc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe701fbc640 1 --2- 172.21.15.133:0/2168779295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc15ca40 0x7fe6fc0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7017bb640 1 --2- 172.21.15.133:0/2168779295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc15ca40 0x7fe6fc0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7017bb640 1 -- 172.21.15.133:0/2168779295 >> v2:172.21.15.142:3300/0 conn(0x7fe6fc0cf610 msgr2=0x7fe6fc1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7017bb640 1 --2- 172.21.15.133:0/2168779295 >> v2:172.21.15.142:3300/0 conn(0x7fe6fc0cf610 0x7fe6fc1605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7017bb640 1 -- 172.21.15.133:0/2168779295 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0d05b0 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe7027bd640 1 --2- 172.21.15.133:0/2168779295 >> v2:172.21.15.142:3300/0 conn(0x7fe6fc0cf610 0x7fe6fc1605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:52.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.271+0000 7fe701fbc640 1 --2- 172.21.15.133:0/2168779295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc15ca40 0x7fe6fc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe7017bb640 1 --2- 172.21.15.133:0/2168779295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0cf0d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0b52f0 tx=0x7fe6ec01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ce1fe109e914d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe700fba640 1 -- 172.21.15.133:0/2168779295 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ab600 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe700fba640 1 -- 172.21.15.133:0/2168779295 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0a7050 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe700fba640 1 -- 172.21.15.133:0/2168779295 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ab980 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 -- 172.21.15.133:0/2168779295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 msgr2=0x7fe6fc0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 --2- 172.21.15.133:0/2168779295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0cf0d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0b52f0 tx=0x7fe6ec01c240 comp rx=0 tx=0).stop 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 -- 172.21.15.133:0/2168779295 shutdown_connections 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 --2- 172.21.15.133:0/2168779295 >> v2:172.21.15.142:3300/0 conn(0x7fe6fc0cf610 0x7fe6fc1605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 --2- 172.21.15.133:0/2168779295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0cf0d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 --2- 172.21.15.133:0/2168779295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc15ca40 0x7fe6fc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 -- 172.21.15.133:0/2168779295 >> 172.21.15.133:0/2168779295 conn(0x7fe6fc089fb0 msgr2=0x7fe6fc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 -- 172.21.15.133:0/2168779295 shutdown_connections 2023-12-18T10:21:52.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.275+0000 7fe704220640 1 -- 172.21.15.133:0/2168779295 wait complete. 2023-12-18T10:21:52.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 Processor -- start 2023-12-18T10:21:52.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 -- start start 2023-12-18T10:21:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc0cf610 0x7fe6fc15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6fc15ca40 0x7fe6fc14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0b0bf0 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc155e80 con 0x7fe6fc15ca40 2023-12-18T10:21:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc156160 con 0x7fe6fc0cf610 2023-12-18T10:21:52.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59596/0 (socket says 172.21.15.133:59596) 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 -- 172.21.15.133:0/3081123829 learned_addr learned my addr 172.21.15.133:0/3081123829 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe7027bd640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6fc15ca40 0x7fe6fc14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe7017bb640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc0cf610 0x7fe6fc15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 -- 172.21.15.133:0/3081123829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc0cf610 msgr2=0x7fe6fc15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc0cf610 0x7fe6fc15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 -- 172.21.15.133:0/3081123829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6fc15ca40 msgr2=0x7fe6fc14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6fc15ca40 0x7fe6fc14b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 -- 172.21.15.133:0/3081123829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec009480 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe701fbc640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0c7a10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800c7f0 tx=0x7fe6f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe6f27fc640 1 -- 172.21.15.133:0/3081123829 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8005ba0 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe6f27fc640 1 -- 172.21.15.133:0/3081123829 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8005d00 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc0b05a0 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe6f27fc640 1 -- 172.21.15.133:0/3081123829 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8007a50 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.279+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc0c7f50 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.283+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc04e000 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.283+0000 7fe6f27fc640 1 -- 172.21.15.133:0/3081123829 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe6f8007bb0 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.283+0000 7fe6f27fc640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6e0065a60 0x7fe6e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.283+0000 7fe6f27fc640 1 -- 172.21.15.133:0/3081123829 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe6f80832f0 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.283+0000 7fe7017bb640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6e0065a60 0x7fe6e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.283+0000 7fe7017bb640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6e0065a60 0x7fe6e0067f20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0ad000 tx=0x7fe6ec0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.287+0000 7fe6f27fc640 1 -- 172.21.15.133:0/3081123829 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe6f8050ad0 con 0x7fe6fc0ce3f0 2023-12-18T10:21:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.435+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6fc15ce20 con 0x7fe6e0065a60 2023-12-18T10:21:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.443+0000 7fe6f27fc640 1 -- 172.21.15.133:0/3081123829 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278525 (secure 0 0 0) 0x7fe6ec0a4e90 con 0x7fe6e0065a60 2023-12-18T10:21:52.451 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:52.452 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:21:52.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6e0065a60 msgr2=0x7fe6e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6e0065a60 0x7fe6e0067f20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0ad000 tx=0x7fe6ec0a6000 comp rx=0 tx=0).stop 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 msgr2=0x7fe6fc0c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0c7a10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800c7f0 tx=0x7fe6f800cbf0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 shutdown_connections 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe6e0065a60 0x7fe6e0067f20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6fc15ca40 0x7fe6fc14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe6fc0cf610 0x7fe6fc15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 --2- 172.21.15.133:0/3081123829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6fc0ce3f0 0x7fe6fc0c7a10 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 >> 172.21.15.133:0/3081123829 conn(0x7fe6fc089fb0 msgr2=0x7fe6fc0cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 shutdown_connections 2023-12-18T10:21:52.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.447+0000 7fe704220640 1 -- 172.21.15.133:0/3081123829 wait complete. 2023-12-18T10:21:52.470 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-12-18T10:21:51.141966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234896,"kb_used_data":6992,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754739824,"statfs":{"total":773094113280,"available":772853579776,"internally_reserved":0,"allocated":7159808,"data_stored":3841798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.136214"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.011014+0000","last_change":"2023-12-18T10:21:47.011014+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.011014+0000","last_undegraded":"2023-12-18T10:21:47.011014+0000","last_fullsized":"2023-12-18T10:21:47.011014+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.018579+0000","last_change":"2023-12-18T10:21:47.018579+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.018579+0000","last_undegraded":"2023-12-18T10:21:47.018579+0000","last_fullsized":"2023-12-18T10:21:47.018579+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:23.245351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.019432+0000","last_change":"2023-12-18T10:21:47.019432+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.019432+0000","last_undegraded":"2023-12-18T10:21:47.019432+0000","last_fullsized":"2023-12-18T10:21:47.019432+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:56.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.018581+0000","last_change":"2023-12-18T10:21:47.018581+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.018581+0000","last_undegraded":"2023-12-18T10:21:47.018581+0000","last_fullsized":"2023-12-18T10:21:47.018581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:26.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014686+0000","last_change":"2023-12-18T10:21:47.014686+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014686+0000","last_undegraded":"2023-12-18T10:21:47.014686+0000","last_fullsized":"2023-12-18T10:21:47.014686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:49.083987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.015979+0000","last_change":"2023-12-18T10:21:47.015979+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.015979+0000","last_undegraded":"2023-12-18T10:21:47.015979+0000","last_fullsized":"2023-12-18T10:21:47.015979+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:50:14.424178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.015848+0000","last_change":"2023-12-18T10:21:47.015848+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.015848+0000","last_undegraded":"2023-12-18T10:21:47.015848+0000","last_fullsized":"2023-12-18T10:21:47.015848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:28.451928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.015719+0000","last_change":"2023-12-18T10:21:47.015719+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.015719+0000","last_undegraded":"2023-12-18T10:21:47.015719+0000","last_fullsized":"2023-12-18T10:21:47.015719+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:35.509047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013143+0000","last_change":"2023-12-18T10:21:47.013143+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013143+0000","last_undegraded":"2023-12-18T10:21:47.013143+0000","last_fullsized":"2023-12-18T10:21:47.013143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.016425+0000","last_change":"2023-12-18T10:21:47.016425+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.016425+0000","last_undegraded":"2023-12-18T10:21:47.016425+0000","last_fullsized":"2023-12-18T10:21:47.016425+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:10.130187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014466+0000","last_change":"2023-12-18T10:21:47.014466+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014466+0000","last_undegraded":"2023-12-18T10:21:47.014466+0000","last_fullsized":"2023-12-18T10:21:47.014466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:31:16.925985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.011460+0000","last_change":"2023-12-18T10:21:47.011460+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.011460+0000","last_undegraded":"2023-12-18T10:21:47.011460+0000","last_fullsized":"2023-12-18T10:21:47.011460+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013592+0000","last_change":"2023-12-18T10:21:47.013592+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013592+0000","last_undegraded":"2023-12-18T10:21:47.013592+0000","last_fullsized":"2023-12-18T10:21:47.013592+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:32:04.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010929+0000","last_change":"2023-12-18T10:21:47.010929+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010929+0000","last_undegraded":"2023-12-18T10:21:47.010929+0000","last_fullsized":"2023-12-18T10:21:47.010929+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013596+0000","last_change":"2023-12-18T10:21:47.013596+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013596+0000","last_undegraded":"2023-12-18T10:21:47.013596+0000","last_fullsized":"2023-12-18T10:21:47.013596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:13:21.619300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.016495+0000","last_change":"2023-12-18T10:21:47.016495+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.016495+0000","last_undegraded":"2023-12-18T10:21:47.016495+0000","last_fullsized":"2023-12-18T10:21:47.016495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:11:24.315740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010930+0000","last_change":"2023-12-18T10:21:47.010930+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010930+0000","last_undegraded":"2023-12-18T10:21:47.010930+0000","last_fullsized":"2023-12-18T10:21:47.010930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.012853+0000","last_change":"2023-12-18T10:21:47.012853+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.012853+0000","last_undegraded":"2023-12-18T10:21:47.012853+0000","last_fullsized":"2023-12-18T10:21:47.012853+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:49.230808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013979+0000","last_change":"2023-12-18T10:21:47.013979+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013979+0000","last_undegraded":"2023-12-18T10:21:47.013979+0000","last_fullsized":"2023-12-18T10:21:47.013979+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:16:40.749682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014661+0000","last_change":"2023-12-18T10:21:47.014661+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014661+0000","last_undegraded":"2023-12-18T10:21:47.014661+0000","last_fullsized":"2023-12-18T10:21:47.014661+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:45.292256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.018511+0000","last_change":"2023-12-18T10:21:47.018511+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.018511+0000","last_undegraded":"2023-12-18T10:21:47.018511+0000","last_fullsized":"2023-12-18T10:21:47.018511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:32.620503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010143+0000","last_change":"2023-12-18T10:21:47.010143+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010143+0000","last_undegraded":"2023-12-18T10:21:47.010143+0000","last_fullsized":"2023-12-18T10:21:47.010143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.019132+0000","last_change":"2023-12-18T10:21:47.019132+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.019132+0000","last_undegraded":"2023-12-18T10:21:47.019132+0000","last_fullsized":"2023-12-18T10:21:47.019132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:10.710378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010192+0000","last_change":"2023-12-18T10:21:47.010192+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010192+0000","last_undegraded":"2023-12-18T10:21:47.010192+0000","last_fullsized":"2023-12-18T10:21:47.010192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010196+0000","last_change":"2023-12-18T10:21:47.010196+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010196+0000","last_undegraded":"2023-12-18T10:21:47.010196+0000","last_fullsized":"2023-12-18T10:21:47.010196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.018585+0000","last_change":"2023-12-18T10:21:47.018585+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.018585+0000","last_undegraded":"2023-12-18T10:21:47.018585+0000","last_fullsized":"2023-12-18T10:21:47.018585+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:41.290961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.011021+0000","last_change":"2023-12-18T10:21:47.011021+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.011021+0000","last_undegraded":"2023-12-18T10:21:47.011021+0000","last_fullsized":"2023-12-18T10:21:47.011021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013019+0000","last_change":"2023-12-18T10:21:47.013019+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013019+0000","last_undegraded":"2023-12-18T10:21:47.013019+0000","last_fullsized":"2023-12-18T10:21:47.013019+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:53:18.623750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014640+0000","last_change":"2023-12-18T10:21:47.014640+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014640+0000","last_undegraded":"2023-12-18T10:21:47.014640+0000","last_fullsized":"2023-12-18T10:21:47.014640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:30.962732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014588+0000","last_change":"2023-12-18T10:21:47.014588+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014588+0000","last_undegraded":"2023-12-18T10:21:47.014588+0000","last_fullsized":"2023-12-18T10:21:47.014588+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:26.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010993+0000","last_change":"2023-12-18T10:21:47.010993+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010993+0000","last_undegraded":"2023-12-18T10:21:47.010993+0000","last_fullsized":"2023-12-18T10:21:47.010993+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014648+0000","last_change":"2023-12-18T10:21:47.014648+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014648+0000","last_undegraded":"2023-12-18T10:21:47.014648+0000","last_fullsized":"2023-12-18T10:21:47.014648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:35.516738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-18T10:21:45.282591+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:21:45.282591+0000","last_peered":"2023-12-18T10:21:45.282591+0000","last_clean":"2023-12-18T10:21:45.282591+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:21:45.282591+0000","last_undegraded":"2023-12-18T10:21:45.282591+0000","last_fullsized":"2023-12-18T10:21:45.282591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":924535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.88400000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.442,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.626},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66100000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60899999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79400000000000004,"15min":0.85999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77800000000000002,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84599999999999997,"15min":0.90700000000000003},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91300000000000003,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.66300000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.76800000000000002,"5min":1.845,"15min":1.845},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.82499999999999996,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":4.524,"15min":4.524},"last":0.50900000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83599999999999997,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96199999999999997,"5min":1.925,"15min":1.925},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.81899999999999995,"15min":0.84799999999999998},"min":{"1min":0.65400000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0489999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.85499999999999998,"15min":0.91300000000000003},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85299999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0049999999999999,"5min":1.101,"15min":1.101},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63800000000000001,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78100000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.752},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":1.284,"15min":1.284},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0880000000000001,"5min":1.129,"15min":1.129},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.71699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.67500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.45300000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0249999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.76900000000000002},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92500000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56599999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.751,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.505},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.81299999999999994},"min":{"1min":0.501,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.879,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.72699999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.52800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91100000000000003,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.84199999999999997},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.90000000000000002,"15min":1.01},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.745}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73799999999999999,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89400000000000002,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.76600000000000001,"15min":0.81299999999999994},"min":{"1min":0.47099999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96199999999999997,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.042,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84199999999999997},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0669999999999999,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.628}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.67400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88700000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.131,"15min":1.131},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":1.032,"15min":1.032},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.999,"15min":0.999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.57399999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84099999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.625},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.874,"15min":0.874},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77400000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79900000000000004,"5min":1.073,"15min":1.073},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.878,"5min":1.042,"15min":1.042},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":328030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.42899999999999999},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.49099999999999999,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69299999999999995,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.373},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63800000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.58899999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74099999999999999,"5min":1.254,"15min":1.254},"last":0.505},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.66900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83899999999999997,"5min":1.772,"15min":1.772},"last":0.44800000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85899999999999999,"5min":1.01,"15min":1.01},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0669999999999999,"5min":1.181,"15min":1.181},"last":0.45600000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0129999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.53200000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.871,"5min":1.069,"15min":1.069},"last":0.622}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.036,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92000000000000004,"5min":1.127,"15min":1.127},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97699999999999998,"5min":1.139,"15min":1.139},"last":0.64500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.432,"15min":0.442},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.376},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63500000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78500000000000003,"15min":0.80900000000000005},"min":{"1min":0.56799999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0469999999999999,"5min":1.698,"15min":1.698},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0820000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.752}]},{"osd":5,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95999999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.085,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0680000000000001,"5min":1.341,"15min":1.341},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0900000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.048,"5min":1.282,"15min":1.282},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.093,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.56599999999999995,"15min":0.624},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64400000000000002,"5min":3.976,"15min":3.976},"last":0.252},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.503,"15min":0.52300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60499999999999998,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.31900000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.61599999999999999,"15min":0.66200000000000003},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71399999999999997,"5min":3.786,"15min":3.786},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78600000000000003,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.42799999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.63300000000000001,"15min":0.68200000000000005},"min":{"1min":0.39600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83099999999999996,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.54900000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1399999999999999,"5min":1.851,"15min":1.851},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.878,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99199999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.872,"15min":0.92400000000000004},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.0960000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.58699999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.872}]},{"osd":6,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0169999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.89400000000000002,"15min":0.95799999999999996},"min":{"1min":0.56000000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0880000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.88700000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0529999999999999,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81499999999999995,"15min":0.83899999999999997},"min":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0649999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.90000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":918398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.96899999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92900000000000005,"5min":1.456,"15min":1.456},"last":0.60799999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55800000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0589999999999999,"5min":1.595,"15min":1.595},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.55600000000000005,"15min":0.59999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":2.464,"15min":2.464},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73699999999999999,"5min":1.859,"15min":1.859},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90000000000000002,"5min":1.903,"15min":1.903},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.58699999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3240000000000001,"5min":1.494,"15min":1.494},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.54700000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.53700000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.034,"5min":1.544,"15min":1.544},"last":0.73499999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.278,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.53,"15min":1.53},"last":0.84999999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.55900000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.349,"5min":1.556,"15min":1.556},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.032,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.63200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:21:52.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:21:52.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f893762d640 1 Processor -- start 2023-12-18T10:21:52.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f893762d640 1 -- start start 2023-12-18T10:21:52.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f893762d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89300ca000 0x7f8930164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f893762d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300c9460 con 0x7f893006c4f0 2023-12-18T10:21:52.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f893762d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89301574a0 con 0x7f89301570c0 2023-12-18T10:21:52.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f893762d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89300c8b30 con 0x7f89300ca000 2023-12-18T10:21:52.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8934bc8640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f893006c4f0 0x7f89300c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54094/0 (socket says 172.21.15.133:54094) 2023-12-18T10:21:52.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8934bc8640 1 -- 172.21.15.133:0/2718690938 learned_addr learned my addr 172.21.15.133:0/2718690938 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:52.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8935bca640 1 --2- 172.21.15.133:0/2718690938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89300ca000 0x7f8930164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8927fff640 1 -- 172.21.15.133:0/2718690938 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154419580 0 0) 0x7f89300c9460 con 0x7f893006c4f0 2023-12-18T10:21:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8927fff640 1 -- 172.21.15.133:0/2718690938 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f891c003530 con 0x7f893006c4f0 2023-12-18T10:21:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8927fff640 1 -- 172.21.15.133:0/2718690938 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510270758 0 0) 0x7f89301574a0 con 0x7f89301570c0 2023-12-18T10:21:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8927fff640 1 -- 172.21.15.133:0/2718690938 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89300c9460 con 0x7f89301570c0 2023-12-18T10:21:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8927fff640 1 -- 172.21.15.133:0/2718690938 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3904911309 0 0) 0x7f891c003530 con 0x7f893006c4f0 2023-12-18T10:21:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8935bca640 1 -- 172.21.15.133:0/2718690938 >> v1:172.21.15.142:6789/0 conn(0x7f89301570c0 legacy=0x7f893006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8935bca640 1 -- 172.21.15.133:0/2718690938 >> v1:172.21.15.133:6789/0 conn(0x7f893006c4f0 legacy=0x7f89300c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.647+0000 7f8935bca640 1 -- 172.21.15.133:0/2718690938 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300c8e10 con 0x7f89300ca000 2023-12-18T10:21:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f8935bca640 1 --2- 172.21.15.133:0/2718690938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89300ca000 0x7f8930164230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8928009dc0 tx=0x7f892801c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3122a9faf103568 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f8927fff640 1 -- 172.21.15.133:0/2718690938 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920001680 con 0x7f89300ca000 2023-12-18T10:21:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f8927fff640 1 -- 172.21.15.133:0/2718690938 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89280a55d0 con 0x7f89300ca000 2023-12-18T10:21:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f8927fff640 1 -- 172.21.15.133:0/2718690938 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89280a5960 con 0x7f89300ca000 2023-12-18T10:21:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f893762d640 1 -- 172.21.15.133:0/2718690938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89300ca000 msgr2=0x7f8930164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f893762d640 1 --2- 172.21.15.133:0/2718690938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89300ca000 0x7f8930164230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8928009dc0 tx=0x7f892801c7d0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f893762d640 1 -- 172.21.15.133:0/2718690938 shutdown_connections 2023-12-18T10:21:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f893762d640 1 --2- 172.21.15.133:0/2718690938 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89300ca000 0x7f8930164230 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f893762d640 1 -- 172.21.15.133:0/2718690938 >> 172.21.15.133:0/2718690938 conn(0x7f893006a3e0 msgr2=0x7f89300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f893762d640 1 -- 172.21.15.133:0/2718690938 shutdown_connections 2023-12-18T10:21:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.651+0000 7f893762d640 1 -- 172.21.15.133:0/2718690938 wait complete. 2023-12-18T10:21:52.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 Processor -- start 2023-12-18T10:21:52.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 -- start start 2023-12-18T10:21:52.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f893006c4f0 0x7f893014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89300ca000 0x7f89300c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89301570c0 0x7f89300c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89300c30b0 con 0x7f893006c4f0 2023-12-18T10:21:52.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893015b410 con 0x7f89300ca000 2023-12-18T10:21:52.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893015ae00 con 0x7f89301570c0 2023-12-18T10:21:52.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f893006c4f0 0x7f893014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f893006c4f0 0x7f893014ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59612/0 (socket says 172.21.15.133:59612) 2023-12-18T10:21:52.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 -- 172.21.15.133:0/3912988531 learned_addr learned my addr 172.21.15.133:0/3912988531 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f8934bc8640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89300ca000 0x7f89300c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f8935bca640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89301570c0 0x7f89300c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 -- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89301570c0 msgr2=0x7f89300c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89301570c0 0x7f89300c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 -- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89300ca000 msgr2=0x7f89300c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89300ca000 0x7f89300c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 -- 172.21.15.133:0/3912988531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928009a70 con 0x7f893006c4f0 2023-12-18T10:21:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f8934bc8640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89300ca000 0x7f89300c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f8935bca640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89301570c0 0x7f89300c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f89353c9640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f893006c4f0 0x7f893014ecd0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c430 tx=0x7f892c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f8925ffb640 1 -- 172.21.15.133:0/3912988531 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0052d0 con 0x7f893006c4f0 2023-12-18T10:21:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f8925ffb640 1 -- 172.21.15.133:0/3912988531 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c005450 con 0x7f893006c4f0 2023-12-18T10:21:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f8925ffb640 1 -- 172.21.15.133:0/3912988531 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c003840 con 0x7f893006c4f0 2023-12-18T10:21:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89300c6380 con 0x7f893006c4f0 2023-12-18T10:21:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.655+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893015b0a0 con 0x7f893006c4f0 2023-12-18T10:21:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.659+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89300735b0 con 0x7f893006c4f0 2023-12-18T10:21:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.659+0000 7f8925ffb640 1 -- 172.21.15.133:0/3912988531 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f892c0039a0 con 0x7f893006c4f0 2023-12-18T10:21:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.659+0000 7f8925ffb640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8914065a60 0x7f8914067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.659+0000 7f8925ffb640 1 -- 172.21.15.133:0/3912988531 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f892c082a10 con 0x7f893006c4f0 2023-12-18T10:21:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.659+0000 7f8934bc8640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8914065a60 0x7f8914067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.659+0000 7f8934bc8640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8914065a60 0x7f8914067f20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f89200011f0 tx=0x7f8920009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.663+0000 7f8925ffb640 1 -- 172.21.15.133:0/3912988531 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f892c050170 con 0x7f893006c4f0 2023-12-18T10:21:52.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.807+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89300ca4b0 con 0x7f8914065a60 2023-12-18T10:21:52.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.815+0000 7f8925ffb640 1 -- 172.21.15.133:0/3912988531 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278525 (secure 0 0 0) 0x7f8920001cb0 con 0x7f8914065a60 2023-12-18T10:21:52.823 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:21:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8914065a60 msgr2=0x7f8914067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8914065a60 0x7f8914067f20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f89200011f0 tx=0x7f8920009040 comp rx=0 tx=0).stop 2023-12-18T10:21:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f893006c4f0 msgr2=0x7f893014ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f893006c4f0 0x7f893014ecd0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c430 tx=0x7f892c00c8f0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 shutdown_connections 2023-12-18T10:21:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8914065a60 0x7f8914067f20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89301570c0 0x7f89300c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f89300ca000 0x7f89300c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 --2- 172.21.15.133:0/3912988531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f893006c4f0 0x7f893014ecd0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 >> 172.21.15.133:0/3912988531 conn(0x7f893006a3e0 msgr2=0x7f89300cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 shutdown_connections 2023-12-18T10:21:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:52.819+0000 7f893762d640 1 -- 172.21.15.133:0/3912988531 wait complete. 2023-12-18T10:21:52.843 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-12-18T10:21:51.141966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234896,"kb_used_data":6992,"kb_used_omap":0,"kb_used_meta":227840,"kb_avail":754739824,"statfs":{"total":773094113280,"available":772853579776,"internally_reserved":0,"allocated":7159808,"data_stored":3841798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":233308160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.136214"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.011014+0000","last_change":"2023-12-18T10:21:47.011014+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.011014+0000","last_undegraded":"2023-12-18T10:21:47.011014+0000","last_fullsized":"2023-12-18T10:21:47.011014+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.018579+0000","last_change":"2023-12-18T10:21:47.018579+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.018579+0000","last_undegraded":"2023-12-18T10:21:47.018579+0000","last_fullsized":"2023-12-18T10:21:47.018579+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:23.245351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.019432+0000","last_change":"2023-12-18T10:21:47.019432+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.019432+0000","last_undegraded":"2023-12-18T10:21:47.019432+0000","last_fullsized":"2023-12-18T10:21:47.019432+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:56.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.018581+0000","last_change":"2023-12-18T10:21:47.018581+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.018581+0000","last_undegraded":"2023-12-18T10:21:47.018581+0000","last_fullsized":"2023-12-18T10:21:47.018581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:26.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014686+0000","last_change":"2023-12-18T10:21:47.014686+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014686+0000","last_undegraded":"2023-12-18T10:21:47.014686+0000","last_fullsized":"2023-12-18T10:21:47.014686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:49.083987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.015979+0000","last_change":"2023-12-18T10:21:47.015979+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.015979+0000","last_undegraded":"2023-12-18T10:21:47.015979+0000","last_fullsized":"2023-12-18T10:21:47.015979+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:50:14.424178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.015848+0000","last_change":"2023-12-18T10:21:47.015848+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.015848+0000","last_undegraded":"2023-12-18T10:21:47.015848+0000","last_fullsized":"2023-12-18T10:21:47.015848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:28.451928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.015719+0000","last_change":"2023-12-18T10:21:47.015719+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.015719+0000","last_undegraded":"2023-12-18T10:21:47.015719+0000","last_fullsized":"2023-12-18T10:21:47.015719+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:35.509047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013143+0000","last_change":"2023-12-18T10:21:47.013143+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013143+0000","last_undegraded":"2023-12-18T10:21:47.013143+0000","last_fullsized":"2023-12-18T10:21:47.013143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.016425+0000","last_change":"2023-12-18T10:21:47.016425+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.016425+0000","last_undegraded":"2023-12-18T10:21:47.016425+0000","last_fullsized":"2023-12-18T10:21:47.016425+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:10.130187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014466+0000","last_change":"2023-12-18T10:21:47.014466+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014466+0000","last_undegraded":"2023-12-18T10:21:47.014466+0000","last_fullsized":"2023-12-18T10:21:47.014466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:31:16.925985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.011460+0000","last_change":"2023-12-18T10:21:47.011460+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.011460+0000","last_undegraded":"2023-12-18T10:21:47.011460+0000","last_fullsized":"2023-12-18T10:21:47.011460+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013592+0000","last_change":"2023-12-18T10:21:47.013592+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013592+0000","last_undegraded":"2023-12-18T10:21:47.013592+0000","last_fullsized":"2023-12-18T10:21:47.013592+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:32:04.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010929+0000","last_change":"2023-12-18T10:21:47.010929+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010929+0000","last_undegraded":"2023-12-18T10:21:47.010929+0000","last_fullsized":"2023-12-18T10:21:47.010929+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013596+0000","last_change":"2023-12-18T10:21:47.013596+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013596+0000","last_undegraded":"2023-12-18T10:21:47.013596+0000","last_fullsized":"2023-12-18T10:21:47.013596+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:13:21.619300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.016495+0000","last_change":"2023-12-18T10:21:47.016495+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.016495+0000","last_undegraded":"2023-12-18T10:21:47.016495+0000","last_fullsized":"2023-12-18T10:21:47.016495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:11:24.315740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010930+0000","last_change":"2023-12-18T10:21:47.010930+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010930+0000","last_undegraded":"2023-12-18T10:21:47.010930+0000","last_fullsized":"2023-12-18T10:21:47.010930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.012853+0000","last_change":"2023-12-18T10:21:47.012853+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.012853+0000","last_undegraded":"2023-12-18T10:21:47.012853+0000","last_fullsized":"2023-12-18T10:21:47.012853+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:49.230808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013979+0000","last_change":"2023-12-18T10:21:47.013979+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013979+0000","last_undegraded":"2023-12-18T10:21:47.013979+0000","last_fullsized":"2023-12-18T10:21:47.013979+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:16:40.749682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014661+0000","last_change":"2023-12-18T10:21:47.014661+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014661+0000","last_undegraded":"2023-12-18T10:21:47.014661+0000","last_fullsized":"2023-12-18T10:21:47.014661+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:45.292256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.018511+0000","last_change":"2023-12-18T10:21:47.018511+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.018511+0000","last_undegraded":"2023-12-18T10:21:47.018511+0000","last_fullsized":"2023-12-18T10:21:47.018511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:32.620503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010143+0000","last_change":"2023-12-18T10:21:47.010143+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010143+0000","last_undegraded":"2023-12-18T10:21:47.010143+0000","last_fullsized":"2023-12-18T10:21:47.010143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.019132+0000","last_change":"2023-12-18T10:21:47.019132+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.019132+0000","last_undegraded":"2023-12-18T10:21:47.019132+0000","last_fullsized":"2023-12-18T10:21:47.019132+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:10.710378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010192+0000","last_change":"2023-12-18T10:21:47.010192+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010192+0000","last_undegraded":"2023-12-18T10:21:47.010192+0000","last_fullsized":"2023-12-18T10:21:47.010192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010196+0000","last_change":"2023-12-18T10:21:47.010196+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010196+0000","last_undegraded":"2023-12-18T10:21:47.010196+0000","last_fullsized":"2023-12-18T10:21:47.010196+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.018585+0000","last_change":"2023-12-18T10:21:47.018585+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.018585+0000","last_undegraded":"2023-12-18T10:21:47.018585+0000","last_fullsized":"2023-12-18T10:21:47.018585+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:41.290961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.011021+0000","last_change":"2023-12-18T10:21:47.011021+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.011021+0000","last_undegraded":"2023-12-18T10:21:47.011021+0000","last_fullsized":"2023-12-18T10:21:47.011021+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.013019+0000","last_change":"2023-12-18T10:21:47.013019+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.013019+0000","last_undegraded":"2023-12-18T10:21:47.013019+0000","last_fullsized":"2023-12-18T10:21:47.013019+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:53:18.623750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014640+0000","last_change":"2023-12-18T10:21:47.014640+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014640+0000","last_undegraded":"2023-12-18T10:21:47.014640+0000","last_fullsized":"2023-12-18T10:21:47.014640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:30.962732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014588+0000","last_change":"2023-12-18T10:21:47.014588+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014588+0000","last_undegraded":"2023-12-18T10:21:47.014588+0000","last_fullsized":"2023-12-18T10:21:47.014588+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:26.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.010993+0000","last_change":"2023-12-18T10:21:47.010993+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.010993+0000","last_undegraded":"2023-12-18T10:21:47.010993+0000","last_fullsized":"2023-12-18T10:21:47.010993+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:21:48.005728+0000","last_change":"2023-12-18T10:21:48.005728+0000","last_active":"2023-12-18T10:21:48.005728+0000","last_peered":"2023-12-18T10:21:48.005728+0000","last_clean":"2023-12-18T10:21:48.005728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:48.005728+0000","last_undegraded":"2023-12-18T10:21:48.005728+0000","last_fullsized":"2023-12-18T10:21:48.005728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-12-18T10:21:47.014648+0000","last_change":"2023-12-18T10:21:47.014648+0000","last_active":"2023-12-18T10:21:46.998160+0000","last_peered":"2023-12-18T10:21:46.998160+0000","last_clean":"2023-12-18T10:21:46.998160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:21:47.014648+0000","last_undegraded":"2023-12-18T10:21:47.014648+0000","last_fullsized":"2023-12-18T10:21:47.014648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:35.516738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":195,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-18T10:21:45.282591+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:21:45.282591+0000","last_peered":"2023-12-18T10:21:45.282591+0000","last_clean":"2023-12-18T10:21:45.282591+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:21:45.282591+0000","last_undegraded":"2023-12-18T10:21:45.282591+0000","last_fullsized":"2023-12-18T10:21:45.282591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":924535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.88400000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.442,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.626},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66100000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60899999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79400000000000004,"15min":0.85999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77800000000000002,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84599999999999997,"15min":0.90700000000000003},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91300000000000003,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.66300000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.76800000000000002,"5min":1.845,"15min":1.845},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.82499999999999996,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":4.524,"15min":4.524},"last":0.50900000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83599999999999997,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96199999999999997,"5min":1.925,"15min":1.925},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.81899999999999995,"15min":0.84799999999999998},"min":{"1min":0.65400000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0489999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.85499999999999998,"15min":0.91300000000000003},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85299999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.64600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0049999999999999,"5min":1.101,"15min":1.101},"last":0.70399999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63800000000000001,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78100000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.752},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":1.284,"15min":1.284},"last":0.78100000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0880000000000001,"5min":1.129,"15min":1.129},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.71699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.67500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.45300000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0249999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.76900000000000002},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92500000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56599999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.751,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.505},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.81299999999999994},"min":{"1min":0.501,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.879,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.72699999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.52800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91100000000000003,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.84199999999999997},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.90000000000000002,"15min":1.01},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.745}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73799999999999999,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89400000000000002,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.76600000000000001,"15min":0.81299999999999994},"min":{"1min":0.47099999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96199999999999997,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.042,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84199999999999997},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0669999999999999,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.628}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.67400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88700000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.131,"15min":1.131},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":1.032,"15min":1.032},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.999,"15min":0.999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.57399999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84099999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.625},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.874,"15min":0.874},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77400000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79900000000000004,"5min":1.073,"15min":1.073},"last":0.55400000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.878,"5min":1.042,"15min":1.042},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":737280,"data_stored":328030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.42899999999999999},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.49099999999999999,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69299999999999995,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.373},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63800000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.58899999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74099999999999999,"5min":1.254,"15min":1.254},"last":0.505},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.66900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83899999999999997,"5min":1.772,"15min":1.772},"last":0.44800000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85899999999999999,"5min":1.01,"15min":1.01},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0669999999999999,"5min":1.181,"15min":1.181},"last":0.45600000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0129999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.53200000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.871,"5min":1.069,"15min":1.069},"last":0.622}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.036,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92000000000000004,"5min":1.127,"15min":1.127},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97699999999999998,"5min":1.139,"15min":1.139},"last":0.64500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.432,"15min":0.442},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.376},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51600000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63500000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78500000000000003,"15min":0.80900000000000005},"min":{"1min":0.56799999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0469999999999999,"5min":1.698,"15min":1.698},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0820000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.752}]},{"osd":5,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95999999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.085,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0680000000000001,"5min":1.341,"15min":1.341},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0900000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.048,"5min":1.282,"15min":1.282},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.093,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.83299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":749568,"data_stored":334167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.56599999999999995,"15min":0.624},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64400000000000002,"5min":3.976,"15min":3.976},"last":0.252},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.503,"15min":0.52300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60499999999999998,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.31900000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.61599999999999999,"15min":0.66200000000000003},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71399999999999997,"5min":3.786,"15min":3.786},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78600000000000003,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.42799999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.63300000000000001,"15min":0.68200000000000005},"min":{"1min":0.39600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83099999999999996,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.54900000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1399999999999999,"5min":1.851,"15min":1.851},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.878,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99199999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.872,"15min":0.92400000000000004},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.0960000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.58699999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.872}]},{"osd":6,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0169999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.89400000000000002,"15min":0.95799999999999996},"min":{"1min":0.56000000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0880000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.88700000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0529999999999999,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81499999999999995,"15min":0.83899999999999997},"min":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0649999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.90000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":918398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.96899999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92900000000000005,"5min":1.456,"15min":1.456},"last":0.60799999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55800000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0589999999999999,"5min":1.595,"15min":1.595},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.55600000000000005,"15min":0.59999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":2.464,"15min":2.464},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73699999999999999,"5min":1.859,"15min":1.859},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90000000000000002,"5min":1.903,"15min":1.903},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.58699999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3240000000000001,"5min":1.494,"15min":1.494},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.54700000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.53700000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.034,"5min":1.544,"15min":1.544},"last":0.73499999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.278,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.53,"15min":1.53},"last":0.84999999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.55900000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.349,"5min":1.556,"15min":1.556},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.032,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.63200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:21:52.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:21:53.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.019+0000 7f1852ee5640 1 Processor -- start 2023-12-18T10:21:53.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.019+0000 7f1852ee5640 1 -- start start 2023-12-18T10:21:53.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1852ee5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f184c1570c0 0x7f184c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1852ee5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f184c06c320 0x7f184c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1852ee5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184c0c9460 con 0x7f184c0c9e30 2023-12-18T10:21:53.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1852ee5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c06c7a0 con 0x7f184c1570c0 2023-12-18T10:21:53.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1852ee5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c1574a0 con 0x7f184c06c320 2023-12-18T10:21:53.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1850c81640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f184c1570c0 0x7f184c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1850c81640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f184c1570c0 0x7f184c06bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59628/0 (socket says 172.21.15.133:59628) 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1850c81640 1 -- 172.21.15.133:0/1544787501 learned_addr learned my addr 172.21.15.133:0/1544787501 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1851482640 1 --1- 172.21.15.133:0/1544787501 >> v1:172.21.15.133:6789/0 conn(0x7f184c0c9e30 0x7f184c15d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54110/0 (socket says 172.21.15.133:54110) 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f184bfff640 1 --2- 172.21.15.133:0/1544787501 >> v2:172.21.15.142:3300/0 conn(0x7f184c06c320 0x7f184c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1850c81640 1 -- 172.21.15.133:0/1544787501 >> v2:172.21.15.142:3300/0 conn(0x7f184c06c320 msgr2=0x7f184c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1850c81640 1 --2- 172.21.15.133:0/1544787501 >> v2:172.21.15.142:3300/0 conn(0x7f184c06c320 0x7f184c0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f184b7fe640 1 -- 172.21.15.133:0/1544787501 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468197651 0 0) 0x7f184c0c9460 con 0x7f184c0c9e30 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1850c81640 1 -- 172.21.15.133:0/1544787501 >> v1:172.21.15.133:6789/0 conn(0x7f184c0c9e30 legacy=0x7f184c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f1850c81640 1 -- 172.21.15.133:0/1544787501 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0c8b30 con 0x7f184c1570c0 2023-12-18T10:21:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.023+0000 7f184bfff640 1 --2- 172.21.15.133:0/1544787501 >> v2:172.21.15.142:3300/0 conn(0x7f184c06c320 0x7f184c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:53.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1850c81640 1 --2- 172.21.15.133:0/1544787501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c06bde0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f184c0ce330 tx=0x7f184001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a400b781c62b962 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f184b7fe640 1 -- 172.21.15.133:0/1544787501 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18400a7ca0 con 0x7f184c1570c0 2023-12-18T10:21:53.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f184b7fe640 1 -- 172.21.15.133:0/1544787501 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18400a7e00 con 0x7f184c1570c0 2023-12-18T10:21:53.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f184b7fe640 1 -- 172.21.15.133:0/1544787501 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18400af660 con 0x7f184c1570c0 2023-12-18T10:21:53.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 -- 172.21.15.133:0/1544787501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 msgr2=0x7f184c06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1544787501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c06bde0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f184c0ce330 tx=0x7f184001ebd0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 -- 172.21.15.133:0/1544787501 shutdown_connections 2023-12-18T10:21:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1544787501 >> v2:172.21.15.142:3300/0 conn(0x7f184c06c320 0x7f184c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1544787501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c06bde0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 -- 172.21.15.133:0/1544787501 >> 172.21.15.133:0/1544787501 conn(0x7f184c06a3e0 msgr2=0x7f184c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 -- 172.21.15.133:0/1544787501 shutdown_connections 2023-12-18T10:21:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 -- 172.21.15.133:0/1544787501 wait complete. 2023-12-18T10:21:53.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 Processor -- start 2023-12-18T10:21:53.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.027+0000 7f1852ee5640 1 -- start start 2023-12-18T10:21:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f184c06c320 0x7f184c0cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f184c0c9e30 0x7f184c0bf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c0bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c148da0 con 0x7f184c1570c0 2023-12-18T10:21:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0ce000 con 0x7f184c06c320 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c14aaa0 con 0x7f184c0c9e30 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c0bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c0bf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59640/0 (socket says 172.21.15.133:59640) 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 -- 172.21.15.133:0/1894796301 learned_addr learned my addr 172.21.15.133:0/1894796301 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1850c81640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f184c06c320 0x7f184c0cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f184bfff640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f184c0c9e30 0x7f184c0bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 -- 172.21.15.133:0/1894796301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f184c0c9e30 msgr2=0x7f184c0bf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f184c0c9e30 0x7f184c0bf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 -- 172.21.15.133:0/1894796301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f184c06c320 msgr2=0x7f184c0cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f184c06c320 0x7f184c0cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 -- 172.21.15.133:0/1894796301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184000b770 con 0x7f184c1570c0 2023-12-18T10:21:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1851482640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c0bf950 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f184400c810 tx=0x7f184400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f18497fa640 1 -- 172.21.15.133:0/1894796301 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400a640 con 0x7f184c1570c0 2023-12-18T10:21:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f18497fa640 1 -- 172.21.15.133:0/1894796301 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184400a7c0 con 0x7f184c1570c0 2023-12-18T10:21:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c14ad80 con 0x7f184c1570c0 2023-12-18T10:21:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f18497fa640 1 -- 172.21.15.133:0/1894796301 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400ab70 con 0x7f184c1570c0 2023-12-18T10:21:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c1492d0 con 0x7f184c1570c0 2023-12-18T10:21:53.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c0735b0 con 0x7f184c1570c0 2023-12-18T10:21:53.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.031+0000 7f18497fa640 1 -- 172.21.15.133:0/1894796301 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f184400acd0 con 0x7f184c1570c0 2023-12-18T10:21:53.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.035+0000 7f18497fa640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1830065a60 0x7f1830067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.035+0000 7f1850c81640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1830065a60 0x7f1830067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.035+0000 7f18497fa640 1 -- 172.21.15.133:0/1894796301 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f18440540a0 con 0x7f184c1570c0 2023-12-18T10:21:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.035+0000 7f1850c81640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1830065a60 0x7f1830067f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f18400b1000 tx=0x7f18400a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.039+0000 7f18497fa640 1 -- 172.21.15.133:0/1894796301 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f18440503e0 con 0x7f184c1570c0 2023-12-18T10:21:53.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.187+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f184c0ca8a0 con 0x7f1830065a60 2023-12-18T10:21:53.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.195+0000 7f18497fa640 1 -- 172.21.15.133:0/1894796301 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289451 (secure 0 0 0) 0x7f18400bd070 con 0x7f1830065a60 2023-12-18T10:21:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:21:53.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1830065a60 msgr2=0x7f1830067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1830065a60 0x7f1830067f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f18400b1000 tx=0x7f18400a9070 comp rx=0 tx=0).stop 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 msgr2=0x7f184c0bf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c0bf950 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f184400c810 tx=0x7f184400ccd0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 shutdown_connections 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1830065a60 0x7f1830067f20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f184c1570c0 0x7f184c0bf950 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f184c0c9e30 0x7f184c0bf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 --2- 172.21.15.133:0/1894796301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f184c06c320 0x7f184c0cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 >> 172.21.15.133:0/1894796301 conn(0x7f184c06a3e0 msgr2=0x7f184c0ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:53.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 shutdown_connections 2023-12-18T10:21:53.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.199+0000 7f1852ee5640 1 -- 172.21.15.133:0/1894796301 wait complete. 2023-12-18T10:21:53.222 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-12-18T10:21:53.142476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239368,"kb_used_data":7368,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754735352,"statfs":{"total":773094113280,"available":772849000448,"internally_reserved":0,"allocated":7544832,"data_stored":4021212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001230"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834579+0000","last_change":"2023-12-18T10:21:48.434897+0000","last_active":"2023-12-18T10:21:50.834579+0000","last_peered":"2023-12-18T10:21:50.834579+0000","last_clean":"2023-12-18T10:21:50.834579+0000","last_became_active":"2023-12-18T10:21:48.434578+0000","last_became_peered":"2023-12-18T10:21:48.434578+0000","last_unstale":"2023-12-18T10:21:50.834579+0000","last_undegraded":"2023-12-18T10:21:50.834579+0000","last_fullsized":"2023-12-18T10:21:50.834579+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:10:43.067633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833981+0000","last_change":"2023-12-18T10:21:48.417639+0000","last_active":"2023-12-18T10:21:50.833981+0000","last_peered":"2023-12-18T10:21:50.833981+0000","last_clean":"2023-12-18T10:21:50.833981+0000","last_became_active":"2023-12-18T10:21:48.416863+0000","last_became_peered":"2023-12-18T10:21:48.416863+0000","last_unstale":"2023-12-18T10:21:50.833981+0000","last_undegraded":"2023-12-18T10:21:50.833981+0000","last_fullsized":"2023-12-18T10:21:50.833981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:11:25.323308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334380+0000","last_change":"2023-12-18T10:21:48.448550+0000","last_active":"2023-12-18T10:21:50.334380+0000","last_peered":"2023-12-18T10:21:50.334380+0000","last_clean":"2023-12-18T10:21:50.334380+0000","last_became_active":"2023-12-18T10:21:48.448146+0000","last_became_peered":"2023-12-18T10:21:48.448146+0000","last_unstale":"2023-12-18T10:21:50.334380+0000","last_undegraded":"2023-12-18T10:21:50.334380+0000","last_fullsized":"2023-12-18T10:21:50.334380+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:27:02.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418050+0000","last_change":"2023-12-18T10:21:48.440593+0000","last_active":"2023-12-18T10:21:49.418050+0000","last_peered":"2023-12-18T10:21:49.418050+0000","last_clean":"2023-12-18T10:21:49.418050+0000","last_became_active":"2023-12-18T10:21:48.433754+0000","last_became_peered":"2023-12-18T10:21:48.433754+0000","last_unstale":"2023-12-18T10:21:49.418050+0000","last_undegraded":"2023-12-18T10:21:49.418050+0000","last_fullsized":"2023-12-18T10:21:49.418050+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:46.299824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834941+0000","last_change":"2023-12-18T10:21:48.431578+0000","last_active":"2023-12-18T10:21:50.834941+0000","last_peered":"2023-12-18T10:21:50.834941+0000","last_clean":"2023-12-18T10:21:50.834941+0000","last_became_active":"2023-12-18T10:21:48.431304+0000","last_became_peered":"2023-12-18T10:21:48.431304+0000","last_unstale":"2023-12-18T10:21:50.834941+0000","last_undegraded":"2023-12-18T10:21:50.834941+0000","last_fullsized":"2023-12-18T10:21:50.834941+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:50.238376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834276+0000","last_change":"2023-12-18T10:21:48.419957+0000","last_active":"2023-12-18T10:21:50.834276+0000","last_peered":"2023-12-18T10:21:50.834276+0000","last_clean":"2023-12-18T10:21:50.834276+0000","last_became_active":"2023-12-18T10:21:48.419672+0000","last_became_peered":"2023-12-18T10:21:48.419672+0000","last_unstale":"2023-12-18T10:21:50.834276+0000","last_undegraded":"2023-12-18T10:21:50.834276+0000","last_fullsized":"2023-12-18T10:21:50.834276+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:50.091555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417128+0000","last_change":"2023-12-18T10:21:48.441330+0000","last_active":"2023-12-18T10:21:49.417128+0000","last_peered":"2023-12-18T10:21:49.417128+0000","last_clean":"2023-12-18T10:21:49.417128+0000","last_became_active":"2023-12-18T10:21:48.441030+0000","last_became_peered":"2023-12-18T10:21:48.441030+0000","last_unstale":"2023-12-18T10:21:49.417128+0000","last_undegraded":"2023-12-18T10:21:49.417128+0000","last_fullsized":"2023-12-18T10:21:49.417128+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:49:55.833641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834217+0000","last_change":"2023-12-18T10:21:48.446465+0000","last_active":"2023-12-18T10:21:50.834217+0000","last_peered":"2023-12-18T10:21:50.834217+0000","last_clean":"2023-12-18T10:21:50.834217+0000","last_became_active":"2023-12-18T10:21:48.446183+0000","last_became_peered":"2023-12-18T10:21:48.446183+0000","last_unstale":"2023-12-18T10:21:50.834217+0000","last_undegraded":"2023-12-18T10:21:50.834217+0000","last_fullsized":"2023-12-18T10:21:50.834217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334712+0000","last_change":"2023-12-18T10:21:48.450885+0000","last_active":"2023-12-18T10:21:50.334712+0000","last_peered":"2023-12-18T10:21:50.334712+0000","last_clean":"2023-12-18T10:21:50.334712+0000","last_became_active":"2023-12-18T10:21:48.450262+0000","last_became_peered":"2023-12-18T10:21:48.450262+0000","last_unstale":"2023-12-18T10:21:50.334712+0000","last_undegraded":"2023-12-18T10:21:50.334712+0000","last_fullsized":"2023-12-18T10:21:50.334712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:57.360980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334585+0000","last_change":"2023-12-18T10:21:48.451228+0000","last_active":"2023-12-18T10:21:50.334585+0000","last_peered":"2023-12-18T10:21:50.334585+0000","last_clean":"2023-12-18T10:21:50.334585+0000","last_became_active":"2023-12-18T10:21:48.450909+0000","last_became_peered":"2023-12-18T10:21:48.450909+0000","last_unstale":"2023-12-18T10:21:50.334585+0000","last_undegraded":"2023-12-18T10:21:50.334585+0000","last_fullsized":"2023-12-18T10:21:50.334585+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418015+0000","last_change":"2023-12-18T10:21:48.429822+0000","last_active":"2023-12-18T10:21:49.418015+0000","last_peered":"2023-12-18T10:21:49.418015+0000","last_clean":"2023-12-18T10:21:49.418015+0000","last_became_active":"2023-12-18T10:21:48.429488+0000","last_became_peered":"2023-12-18T10:21:48.429488+0000","last_unstale":"2023-12-18T10:21:49.418015+0000","last_undegraded":"2023-12-18T10:21:49.418015+0000","last_fullsized":"2023-12-18T10:21:49.418015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:50:15.431746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834357+0000","last_change":"2023-12-18T10:21:48.445659+0000","last_active":"2023-12-18T10:21:50.834357+0000","last_peered":"2023-12-18T10:21:50.834357+0000","last_clean":"2023-12-18T10:21:50.834357+0000","last_became_active":"2023-12-18T10:21:48.445384+0000","last_became_peered":"2023-12-18T10:21:48.445384+0000","last_unstale":"2023-12-18T10:21:50.834357+0000","last_undegraded":"2023-12-18T10:21:50.834357+0000","last_fullsized":"2023-12-18T10:21:50.834357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834366+0000","last_change":"2023-12-18T10:21:48.436781+0000","last_active":"2023-12-18T10:21:50.834366+0000","last_peered":"2023-12-18T10:21:50.834366+0000","last_clean":"2023-12-18T10:21:50.834366+0000","last_became_active":"2023-12-18T10:21:48.436525+0000","last_became_peered":"2023-12-18T10:21:48.436525+0000","last_unstale":"2023-12-18T10:21:50.834366+0000","last_undegraded":"2023-12-18T10:21:50.834366+0000","last_fullsized":"2023-12-18T10:21:50.834366+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:11.717946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334403+0000","last_change":"2023-12-18T10:21:48.446331+0000","last_active":"2023-12-18T10:21:50.334403+0000","last_peered":"2023-12-18T10:21:50.334403+0000","last_clean":"2023-12-18T10:21:50.334403+0000","last_became_active":"2023-12-18T10:21:48.445998+0000","last_became_peered":"2023-12-18T10:21:48.445998+0000","last_unstale":"2023-12-18T10:21:50.334403+0000","last_undegraded":"2023-12-18T10:21:50.334403+0000","last_fullsized":"2023-12-18T10:21:50.334403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:23:30.222618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334241+0000","last_change":"2023-12-18T10:21:48.445026+0000","last_active":"2023-12-18T10:21:50.334241+0000","last_peered":"2023-12-18T10:21:50.334241+0000","last_clean":"2023-12-18T10:21:50.334241+0000","last_became_active":"2023-12-18T10:21:48.444765+0000","last_became_peered":"2023-12-18T10:21:48.444765+0000","last_unstale":"2023-12-18T10:21:50.334241+0000","last_undegraded":"2023-12-18T10:21:50.334241+0000","last_fullsized":"2023-12-18T10:21:50.334241+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417038+0000","last_change":"2023-12-18T10:21:48.442006+0000","last_active":"2023-12-18T10:21:49.417038+0000","last_peered":"2023-12-18T10:21:49.417038+0000","last_clean":"2023-12-18T10:21:49.417038+0000","last_became_active":"2023-12-18T10:21:48.441738+0000","last_became_peered":"2023-12-18T10:21:48.441738+0000","last_unstale":"2023-12-18T10:21:49.417038+0000","last_undegraded":"2023-12-18T10:21:49.417038+0000","last_fullsized":"2023-12-18T10:21:49.417038+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:20.902657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834607+0000","last_change":"2023-12-18T10:21:48.431569+0000","last_active":"2023-12-18T10:21:50.834607+0000","last_peered":"2023-12-18T10:21:50.834607+0000","last_clean":"2023-12-18T10:21:50.834607+0000","last_became_active":"2023-12-18T10:21:48.431326+0000","last_became_peered":"2023-12-18T10:21:48.431326+0000","last_unstale":"2023-12-18T10:21:50.834607+0000","last_undegraded":"2023-12-18T10:21:50.834607+0000","last_fullsized":"2023-12-18T10:21:50.834607+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:27.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418156+0000","last_change":"2023-12-18T10:21:48.433208+0000","last_active":"2023-12-18T10:21:49.418156+0000","last_peered":"2023-12-18T10:21:49.418156+0000","last_clean":"2023-12-18T10:21:49.418156+0000","last_became_active":"2023-12-18T10:21:48.432941+0000","last_became_peered":"2023-12-18T10:21:48.432941+0000","last_unstale":"2023-12-18T10:21:49.418156+0000","last_undegraded":"2023-12-18T10:21:49.418156+0000","last_fullsized":"2023-12-18T10:21:49.418156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:36.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834992+0000","last_change":"2023-12-18T10:21:48.434145+0000","last_active":"2023-12-18T10:21:50.834992+0000","last_peered":"2023-12-18T10:21:50.834992+0000","last_clean":"2023-12-18T10:21:50.834992+0000","last_became_active":"2023-12-18T10:21:48.433505+0000","last_became_peered":"2023-12-18T10:21:48.433505+0000","last_unstale":"2023-12-18T10:21:50.834992+0000","last_undegraded":"2023-12-18T10:21:50.834992+0000","last_fullsized":"2023-12-18T10:21:50.834992+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:16:41.757250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833619+0000","last_change":"2023-12-18T10:21:48.424288+0000","last_active":"2023-12-18T10:21:50.833619+0000","last_peered":"2023-12-18T10:21:50.833619+0000","last_clean":"2023-12-18T10:21:50.833619+0000","last_became_active":"2023-12-18T10:21:48.424033+0000","last_became_peered":"2023-12-18T10:21:48.424033+0000","last_unstale":"2023-12-18T10:21:50.833619+0000","last_undegraded":"2023-12-18T10:21:50.833619+0000","last_fullsized":"2023-12-18T10:21:50.833619+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:05:30.756965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834479+0000","last_change":"2023-12-18T10:21:48.439646+0000","last_active":"2023-12-18T10:21:50.834479+0000","last_peered":"2023-12-18T10:21:50.834479+0000","last_clean":"2023-12-18T10:21:50.834479+0000","last_became_active":"2023-12-18T10:21:48.431449+0000","last_became_peered":"2023-12-18T10:21:48.431449+0000","last_unstale":"2023-12-18T10:21:50.834479+0000","last_undegraded":"2023-12-18T10:21:50.834479+0000","last_fullsized":"2023-12-18T10:21:50.834479+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:11.137755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833553+0000","last_change":"2023-12-18T10:21:48.425153+0000","last_active":"2023-12-18T10:21:50.833553+0000","last_peered":"2023-12-18T10:21:50.833553+0000","last_clean":"2023-12-18T10:21:50.833553+0000","last_became_active":"2023-12-18T10:21:48.424891+0000","last_became_peered":"2023-12-18T10:21:48.424891+0000","last_unstale":"2023-12-18T10:21:50.833553+0000","last_undegraded":"2023-12-18T10:21:50.833553+0000","last_fullsized":"2023-12-18T10:21:50.833553+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:05.464349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833390+0000","last_change":"2023-12-18T10:21:48.426896+0000","last_active":"2023-12-18T10:21:50.833390+0000","last_peered":"2023-12-18T10:21:50.833390+0000","last_clean":"2023-12-18T10:21:50.833390+0000","last_became_active":"2023-12-18T10:21:48.426318+0000","last_became_peered":"2023-12-18T10:21:48.426318+0000","last_unstale":"2023-12-18T10:21:50.833390+0000","last_undegraded":"2023-12-18T10:21:50.833390+0000","last_fullsized":"2023-12-18T10:21:50.833390+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:42:36.055759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334171+0000","last_change":"2023-12-18T10:21:48.433113+0000","last_active":"2023-12-18T10:21:50.334171+0000","last_peered":"2023-12-18T10:21:50.334171+0000","last_clean":"2023-12-18T10:21:50.334171+0000","last_became_active":"2023-12-18T10:21:48.432816+0000","last_became_peered":"2023-12-18T10:21:48.432816+0000","last_unstale":"2023-12-18T10:21:50.334171+0000","last_undegraded":"2023-12-18T10:21:50.334171+0000","last_fullsized":"2023-12-18T10:21:50.334171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:11.717946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834517+0000","last_change":"2023-12-18T10:21:48.435237+0000","last_active":"2023-12-18T10:21:50.834517+0000","last_peered":"2023-12-18T10:21:50.834517+0000","last_clean":"2023-12-18T10:21:50.834517+0000","last_became_active":"2023-12-18T10:21:48.434894+0000","last_became_peered":"2023-12-18T10:21:48.434894+0000","last_unstale":"2023-12-18T10:21:50.834517+0000","last_undegraded":"2023-12-18T10:21:50.834517+0000","last_fullsized":"2023-12-18T10:21:50.834517+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:42.298529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834365+0000","last_change":"2023-12-18T10:21:48.435992+0000","last_active":"2023-12-18T10:21:50.834365+0000","last_peered":"2023-12-18T10:21:50.834365+0000","last_clean":"2023-12-18T10:21:50.834365+0000","last_became_active":"2023-12-18T10:21:48.435702+0000","last_became_peered":"2023-12-18T10:21:48.435702+0000","last_unstale":"2023-12-18T10:21:50.834365+0000","last_undegraded":"2023-12-18T10:21:50.834365+0000","last_fullsized":"2023-12-18T10:21:50.834365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:57.360980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418081+0000","last_change":"2023-12-18T10:21:48.441611+0000","last_active":"2023-12-18T10:21:49.418081+0000","last_peered":"2023-12-18T10:21:49.418081+0000","last_clean":"2023-12-18T10:21:49.418081+0000","last_became_active":"2023-12-18T10:21:48.437132+0000","last_became_peered":"2023-12-18T10:21:48.437132+0000","last_unstale":"2023-12-18T10:21:49.418081+0000","last_undegraded":"2023-12-18T10:21:49.418081+0000","last_fullsized":"2023-12-18T10:21:49.418081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:31.970301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834578+0000","last_change":"2023-12-18T10:21:48.425031+0000","last_active":"2023-12-18T10:21:50.834578+0000","last_peered":"2023-12-18T10:21:50.834578+0000","last_clean":"2023-12-18T10:21:50.834578+0000","last_became_active":"2023-12-18T10:21:48.424777+0000","last_became_peered":"2023-12-18T10:21:48.424777+0000","last_unstale":"2023-12-18T10:21:50.834578+0000","last_undegraded":"2023-12-18T10:21:50.834578+0000","last_fullsized":"2023-12-18T10:21:50.834578+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:11.137755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334339+0000","last_change":"2023-12-18T10:21:48.444498+0000","last_active":"2023-12-18T10:21:50.334339+0000","last_peered":"2023-12-18T10:21:50.334339+0000","last_clean":"2023-12-18T10:21:50.334339+0000","last_became_active":"2023-12-18T10:21:48.444233+0000","last_became_peered":"2023-12-18T10:21:48.444233+0000","last_unstale":"2023-12-18T10:21:50.334339+0000","last_undegraded":"2023-12-18T10:21:50.334339+0000","last_fullsized":"2023-12-18T10:21:50.334339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:42.298529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834457+0000","last_change":"2023-12-18T10:21:48.445156+0000","last_active":"2023-12-18T10:21:50.834457+0000","last_peered":"2023-12-18T10:21:50.834457+0000","last_clean":"2023-12-18T10:21:50.834457+0000","last_became_active":"2023-12-18T10:21:48.444896+0000","last_became_peered":"2023-12-18T10:21:48.444896+0000","last_unstale":"2023-12-18T10:21:50.834457+0000","last_undegraded":"2023-12-18T10:21:50.834457+0000","last_fullsized":"2023-12-18T10:21:50.834457+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:36:39.295713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417775+0000","last_change":"2023-12-18T10:21:48.436580+0000","last_active":"2023-12-18T10:21:49.417775+0000","last_peered":"2023-12-18T10:21:49.417775+0000","last_clean":"2023-12-18T10:21:49.417775+0000","last_became_active":"2023-12-18T10:21:48.435579+0000","last_became_peered":"2023-12-18T10:21:48.435579+0000","last_unstale":"2023-12-18T10:21:49.417775+0000","last_undegraded":"2023-12-18T10:21:49.417775+0000","last_fullsized":"2023-12-18T10:21:49.417775+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:23:30.222618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833627+0000","last_change":"2023-12-18T10:21:48.429224+0000","last_active":"2023-12-18T10:21:50.833627+0000","last_peered":"2023-12-18T10:21:50.833627+0000","last_clean":"2023-12-18T10:21:50.833627+0000","last_became_active":"2023-12-18T10:21:48.428929+0000","last_became_peered":"2023-12-18T10:21:48.428929+0000","last_unstale":"2023-12-18T10:21:50.833627+0000","last_undegraded":"2023-12-18T10:21:50.833627+0000","last_fullsized":"2023-12-18T10:21:50.833627+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:36.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835152+0000","last_change":"2023-12-18T10:21:48.436670+0000","last_active":"2023-12-18T10:21:50.835152+0000","last_peered":"2023-12-18T10:21:50.835152+0000","last_clean":"2023-12-18T10:21:50.835152+0000","last_became_active":"2023-12-18T10:21:48.436401+0000","last_became_peered":"2023-12-18T10:21:48.436401+0000","last_unstale":"2023-12-18T10:21:50.835152+0000","last_undegraded":"2023-12-18T10:21:50.835152+0000","last_fullsized":"2023-12-18T10:21:50.835152+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:14:20.867347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.447607+0000","last_change":"2023-12-18T10:21:48.039433+0000","last_active":"2023-12-18T10:21:48.447607+0000","last_peered":"2023-12-18T10:21:48.447607+0000","last_clean":"2023-12-18T10:21:48.447607+0000","last_became_active":"2023-12-18T10:21:48.039120+0000","last_became_peered":"2023-12-18T10:21:48.039120+0000","last_unstale":"2023-12-18T10:21:48.447607+0000","last_undegraded":"2023-12-18T10:21:48.447607+0000","last_fullsized":"2023-12-18T10:21:48.447607+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418144+0000","last_change":"2023-12-18T10:21:48.441480+0000","last_active":"2023-12-18T10:21:49.418144+0000","last_peered":"2023-12-18T10:21:49.418144+0000","last_clean":"2023-12-18T10:21:49.418144+0000","last_became_active":"2023-12-18T10:21:48.439460+0000","last_became_peered":"2023-12-18T10:21:48.439460+0000","last_unstale":"2023-12-18T10:21:49.418144+0000","last_undegraded":"2023-12-18T10:21:49.418144+0000","last_fullsized":"2023-12-18T10:21:49.418144+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:50.091555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.444899+0000","last_change":"2023-12-18T10:21:48.040368+0000","last_active":"2023-12-18T10:21:48.444899+0000","last_peered":"2023-12-18T10:21:48.444899+0000","last_clean":"2023-12-18T10:21:48.444899+0000","last_became_active":"2023-12-18T10:21:48.039832+0000","last_became_peered":"2023-12-18T10:21:48.039832+0000","last_unstale":"2023-12-18T10:21:48.444899+0000","last_undegraded":"2023-12-18T10:21:48.444899+0000","last_fullsized":"2023-12-18T10:21:48.444899+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:23.245351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834086+0000","last_change":"2023-12-18T10:21:48.430156+0000","last_active":"2023-12-18T10:21:50.834086+0000","last_peered":"2023-12-18T10:21:50.834086+0000","last_clean":"2023-12-18T10:21:50.834086+0000","last_became_active":"2023-12-18T10:21:48.429711+0000","last_became_peered":"2023-12-18T10:21:48.429711+0000","last_unstale":"2023-12-18T10:21:50.834086+0000","last_undegraded":"2023-12-18T10:21:50.834086+0000","last_fullsized":"2023-12-18T10:21:50.834086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:21:40.051326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.440120+0000","last_change":"2023-12-18T10:21:48.045644+0000","last_active":"2023-12-18T10:21:48.440120+0000","last_peered":"2023-12-18T10:21:48.440120+0000","last_clean":"2023-12-18T10:21:48.440120+0000","last_became_active":"2023-12-18T10:21:48.045326+0000","last_became_peered":"2023-12-18T10:21:48.045326+0000","last_unstale":"2023-12-18T10:21:48.440120+0000","last_undegraded":"2023-12-18T10:21:48.440120+0000","last_fullsized":"2023-12-18T10:21:48.440120+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:56.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334680+0000","last_change":"2023-12-18T10:21:48.449749+0000","last_active":"2023-12-18T10:21:50.334680+0000","last_peered":"2023-12-18T10:21:50.334680+0000","last_clean":"2023-12-18T10:21:50.334680+0000","last_became_active":"2023-12-18T10:21:48.449454+0000","last_became_peered":"2023-12-18T10:21:48.449454+0000","last_unstale":"2023-12-18T10:21:50.334680+0000","last_undegraded":"2023-12-18T10:21:50.334680+0000","last_fullsized":"2023-12-18T10:21:50.334680+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:24.252919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431077+0000","last_change":"2023-12-18T10:21:48.033347+0000","last_active":"2023-12-18T10:21:48.431077+0000","last_peered":"2023-12-18T10:21:48.431077+0000","last_clean":"2023-12-18T10:21:48.431077+0000","last_became_active":"2023-12-18T10:21:48.033043+0000","last_became_peered":"2023-12-18T10:21:48.033043+0000","last_unstale":"2023-12-18T10:21:48.431077+0000","last_undegraded":"2023-12-18T10:21:48.431077+0000","last_fullsized":"2023-12-18T10:21:48.431077+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:26.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417022+0000","last_change":"2023-12-18T10:21:48.417853+0000","last_active":"2023-12-18T10:21:49.417022+0000","last_peered":"2023-12-18T10:21:49.417022+0000","last_clean":"2023-12-18T10:21:49.417022+0000","last_became_active":"2023-12-18T10:21:48.416985+0000","last_became_peered":"2023-12-18T10:21:48.416985+0000","last_unstale":"2023-12-18T10:21:49.417022+0000","last_undegraded":"2023-12-18T10:21:49.417022+0000","last_fullsized":"2023-12-18T10:21:49.417022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:50:57.134438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431776+0000","last_change":"2023-12-18T10:21:48.039260+0000","last_active":"2023-12-18T10:21:48.431776+0000","last_peered":"2023-12-18T10:21:48.431776+0000","last_clean":"2023-12-18T10:21:48.431776+0000","last_became_active":"2023-12-18T10:21:48.038959+0000","last_became_peered":"2023-12-18T10:21:48.038959+0000","last_unstale":"2023-12-18T10:21:48.431776+0000","last_undegraded":"2023-12-18T10:21:48.431776+0000","last_fullsized":"2023-12-18T10:21:48.431776+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:49.083987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834041+0000","last_change":"2023-12-18T10:21:48.431276+0000","last_active":"2023-12-18T10:21:50.834041+0000","last_peered":"2023-12-18T10:21:50.834041+0000","last_clean":"2023-12-18T10:21:50.834041+0000","last_became_active":"2023-12-18T10:21:48.430965+0000","last_became_peered":"2023-12-18T10:21:48.430965+0000","last_unstale":"2023-12-18T10:21:50.834041+0000","last_undegraded":"2023-12-18T10:21:50.834041+0000","last_fullsized":"2023-12-18T10:21:50.834041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:26:54.871700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.432746+0000","last_change":"2023-12-18T10:21:48.042888+0000","last_active":"2023-12-18T10:21:48.432746+0000","last_peered":"2023-12-18T10:21:48.432746+0000","last_clean":"2023-12-18T10:21:48.432746+0000","last_became_active":"2023-12-18T10:21:48.042599+0000","last_became_peered":"2023-12-18T10:21:48.042599+0000","last_unstale":"2023-12-18T10:21:48.432746+0000","last_undegraded":"2023-12-18T10:21:48.432746+0000","last_fullsized":"2023-12-18T10:21:48.432746+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:50:14.424178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834978+0000","last_change":"2023-12-18T10:21:48.435436+0000","last_active":"2023-12-18T10:21:50.834978+0000","last_peered":"2023-12-18T10:21:50.834978+0000","last_clean":"2023-12-18T10:21:50.834978+0000","last_became_active":"2023-12-18T10:21:48.434960+0000","last_became_peered":"2023-12-18T10:21:48.434960+0000","last_unstale":"2023-12-18T10:21:50.834978+0000","last_undegraded":"2023-12-18T10:21:50.834978+0000","last_fullsized":"2023-12-18T10:21:50.834978+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:36.311083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408142+0000","last_change":"2023-12-18T10:21:48.037703+0000","last_active":"2023-12-18T10:21:48.408142+0000","last_peered":"2023-12-18T10:21:48.408142+0000","last_clean":"2023-12-18T10:21:48.408142+0000","last_became_active":"2023-12-18T10:21:48.037416+0000","last_became_peered":"2023-12-18T10:21:48.037416+0000","last_unstale":"2023-12-18T10:21:48.408142+0000","last_undegraded":"2023-12-18T10:21:48.408142+0000","last_fullsized":"2023-12-18T10:21:48.408142+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:28.451928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833504+0000","last_change":"2023-12-18T10:21:48.428917+0000","last_active":"2023-12-18T10:21:50.833504+0000","last_peered":"2023-12-18T10:21:50.833504+0000","last_clean":"2023-12-18T10:21:50.833504+0000","last_became_active":"2023-12-18T10:21:48.428463+0000","last_became_peered":"2023-12-18T10:21:48.428463+0000","last_unstale":"2023-12-18T10:21:50.833504+0000","last_undegraded":"2023-12-18T10:21:50.833504+0000","last_fullsized":"2023-12-18T10:21:50.833504+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:11:42.943877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.419391+0000","last_change":"2023-12-18T10:21:48.041034+0000","last_active":"2023-12-18T10:21:48.419391+0000","last_peered":"2023-12-18T10:21:48.419391+0000","last_clean":"2023-12-18T10:21:48.419391+0000","last_became_active":"2023-12-18T10:21:48.040700+0000","last_became_peered":"2023-12-18T10:21:48.040700+0000","last_unstale":"2023-12-18T10:21:48.419391+0000","last_undegraded":"2023-12-18T10:21:48.419391+0000","last_fullsized":"2023-12-18T10:21:48.419391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:35.509047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834552+0000","last_change":"2023-12-18T10:21:48.417692+0000","last_active":"2023-12-18T10:21:50.834552+0000","last_peered":"2023-12-18T10:21:50.834552+0000","last_clean":"2023-12-18T10:21:50.834552+0000","last_became_active":"2023-12-18T10:21:48.417075+0000","last_became_peered":"2023-12-18T10:21:48.417075+0000","last_unstale":"2023-12-18T10:21:50.834552+0000","last_undegraded":"2023-12-18T10:21:50.834552+0000","last_fullsized":"2023-12-18T10:21:50.834552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:36:39.295713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.437218+0000","last_change":"2023-12-18T10:21:48.047318+0000","last_active":"2023-12-18T10:21:48.437218+0000","last_peered":"2023-12-18T10:21:48.437218+0000","last_clean":"2023-12-18T10:21:48.437218+0000","last_became_active":"2023-12-18T10:21:48.047010+0000","last_became_peered":"2023-12-18T10:21:48.047010+0000","last_unstale":"2023-12-18T10:21:48.437218+0000","last_undegraded":"2023-12-18T10:21:48.437218+0000","last_fullsized":"2023-12-18T10:21:48.437218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833453+0000","last_change":"2023-12-18T10:21:48.435274+0000","last_active":"2023-12-18T10:21:50.833453+0000","last_peered":"2023-12-18T10:21:50.833453+0000","last_clean":"2023-12-18T10:21:50.833453+0000","last_became_active":"2023-12-18T10:21:48.435009+0000","last_became_peered":"2023-12-18T10:21:48.435009+0000","last_unstale":"2023-12-18T10:21:50.833453+0000","last_undegraded":"2023-12-18T10:21:50.833453+0000","last_fullsized":"2023-12-18T10:21:50.833453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:44:00.526234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.421567+0000","last_change":"2023-12-18T10:21:48.046447+0000","last_active":"2023-12-18T10:21:48.421567+0000","last_peered":"2023-12-18T10:21:48.421567+0000","last_clean":"2023-12-18T10:21:48.421567+0000","last_became_active":"2023-12-18T10:21:48.046182+0000","last_became_peered":"2023-12-18T10:21:48.046182+0000","last_unstale":"2023-12-18T10:21:48.421567+0000","last_undegraded":"2023-12-18T10:21:48.421567+0000","last_fullsized":"2023-12-18T10:21:48.421567+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:10.130187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835003+0000","last_change":"2023-12-18T10:21:48.443458+0000","last_active":"2023-12-18T10:21:50.835003+0000","last_peered":"2023-12-18T10:21:50.835003+0000","last_clean":"2023-12-18T10:21:50.835003+0000","last_became_active":"2023-12-18T10:21:48.443214+0000","last_became_peered":"2023-12-18T10:21:48.443214+0000","last_unstale":"2023-12-18T10:21:50.835003+0000","last_undegraded":"2023-12-18T10:21:50.835003+0000","last_fullsized":"2023-12-18T10:21:50.835003+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:18:22.665558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.449882+0000","last_change":"2023-12-18T10:21:48.045279+0000","last_active":"2023-12-18T10:21:48.449882+0000","last_peered":"2023-12-18T10:21:48.449882+0000","last_clean":"2023-12-18T10:21:48.449882+0000","last_became_active":"2023-12-18T10:21:48.044922+0000","last_became_peered":"2023-12-18T10:21:48.044922+0000","last_unstale":"2023-12-18T10:21:48.449882+0000","last_undegraded":"2023-12-18T10:21:48.449882+0000","last_fullsized":"2023-12-18T10:21:48.449882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:31:16.925985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418363+0000","last_change":"2023-12-18T10:21:48.430115+0000","last_active":"2023-12-18T10:21:49.418363+0000","last_peered":"2023-12-18T10:21:49.418363+0000","last_clean":"2023-12-18T10:21:49.418363+0000","last_became_active":"2023-12-18T10:21:48.429743+0000","last_became_peered":"2023-12-18T10:21:48.429743+0000","last_unstale":"2023-12-18T10:21:49.418363+0000","last_undegraded":"2023-12-18T10:21:49.418363+0000","last_fullsized":"2023-12-18T10:21:49.418363+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:29.459496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451861+0000","last_change":"2023-12-18T10:21:48.043037+0000","last_active":"2023-12-18T10:21:48.451861+0000","last_peered":"2023-12-18T10:21:48.451861+0000","last_clean":"2023-12-18T10:21:48.451861+0000","last_became_active":"2023-12-18T10:21:48.042733+0000","last_became_peered":"2023-12-18T10:21:48.042733+0000","last_unstale":"2023-12-18T10:21:48.451861+0000","last_undegraded":"2023-12-18T10:21:48.451861+0000","last_fullsized":"2023-12-18T10:21:48.451861+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417742+0000","last_change":"2023-12-18T10:21:48.423021+0000","last_active":"2023-12-18T10:21:49.417742+0000","last_peered":"2023-12-18T10:21:49.417742+0000","last_clean":"2023-12-18T10:21:49.417742+0000","last_became_active":"2023-12-18T10:21:48.422453+0000","last_became_peered":"2023-12-18T10:21:48.422453+0000","last_unstale":"2023-12-18T10:21:49.417742+0000","last_undegraded":"2023-12-18T10:21:49.417742+0000","last_fullsized":"2023-12-18T10:21:49.417742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.448256+0000","last_change":"2023-12-18T10:21:48.038440+0000","last_active":"2023-12-18T10:21:48.448256+0000","last_peered":"2023-12-18T10:21:48.448256+0000","last_clean":"2023-12-18T10:21:48.448256+0000","last_became_active":"2023-12-18T10:21:48.038157+0000","last_became_peered":"2023-12-18T10:21:48.038157+0000","last_unstale":"2023-12-18T10:21:48.448256+0000","last_undegraded":"2023-12-18T10:21:48.448256+0000","last_fullsized":"2023-12-18T10:21:48.448256+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:32:04.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834217+0000","last_change":"2023-12-18T10:21:48.435170+0000","last_active":"2023-12-18T10:21:50.834217+0000","last_peered":"2023-12-18T10:21:50.834217+0000","last_clean":"2023-12-18T10:21:50.834217+0000","last_became_active":"2023-12-18T10:21:48.434884+0000","last_became_peered":"2023-12-18T10:21:48.434884+0000","last_unstale":"2023-12-18T10:21:50.834217+0000","last_undegraded":"2023-12-18T10:21:50.834217+0000","last_fullsized":"2023-12-18T10:21:50.834217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:03:02.116576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.425836+0000","last_change":"2023-12-18T10:21:48.045035+0000","last_active":"2023-12-18T10:21:48.425836+0000","last_peered":"2023-12-18T10:21:48.425836+0000","last_clean":"2023-12-18T10:21:48.425836+0000","last_became_active":"2023-12-18T10:21:48.044611+0000","last_became_peered":"2023-12-18T10:21:48.044611+0000","last_unstale":"2023-12-18T10:21:48.425836+0000","last_undegraded":"2023-12-18T10:21:48.425836+0000","last_fullsized":"2023-12-18T10:21:48.425836+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834817+0000","last_change":"2023-12-18T10:21:48.437943+0000","last_active":"2023-12-18T10:21:50.834817+0000","last_peered":"2023-12-18T10:21:50.834817+0000","last_clean":"2023-12-18T10:21:50.834817+0000","last_became_active":"2023-12-18T10:21:48.437643+0000","last_became_peered":"2023-12-18T10:21:48.437643+0000","last_unstale":"2023-12-18T10:21:50.834817+0000","last_undegraded":"2023-12-18T10:21:50.834817+0000","last_fullsized":"2023-12-18T10:21:50.834817+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:31:17.933553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.427243+0000","last_change":"2023-12-18T10:21:48.043022+0000","last_active":"2023-12-18T10:21:48.427243+0000","last_peered":"2023-12-18T10:21:48.427243+0000","last_clean":"2023-12-18T10:21:48.427243+0000","last_became_active":"2023-12-18T10:21:48.042699+0000","last_became_peered":"2023-12-18T10:21:48.042699+0000","last_unstale":"2023-12-18T10:21:48.427243+0000","last_undegraded":"2023-12-18T10:21:48.427243+0000","last_fullsized":"2023-12-18T10:21:48.427243+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:13:21.619300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834264+0000","last_change":"2023-12-18T10:21:48.421196+0000","last_active":"2023-12-18T10:21:50.834264+0000","last_peered":"2023-12-18T10:21:50.834264+0000","last_clean":"2023-12-18T10:21:50.834264+0000","last_became_active":"2023-12-18T10:21:48.420884+0000","last_became_peered":"2023-12-18T10:21:48.420884+0000","last_unstale":"2023-12-18T10:21:50.834264+0000","last_undegraded":"2023-12-18T10:21:50.834264+0000","last_fullsized":"2023-12-18T10:21:50.834264+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:28:00.192661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451492+0000","last_change":"2023-12-18T10:21:48.046905+0000","last_active":"2023-12-18T10:21:48.451492+0000","last_peered":"2023-12-18T10:21:48.451492+0000","last_clean":"2023-12-18T10:21:48.451492+0000","last_became_active":"2023-12-18T10:21:48.045846+0000","last_became_peered":"2023-12-18T10:21:48.045846+0000","last_unstale":"2023-12-18T10:21:48.451492+0000","last_undegraded":"2023-12-18T10:21:48.451492+0000","last_fullsized":"2023-12-18T10:21:48.451492+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:11:24.315740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334522+0000","last_change":"2023-12-18T10:21:48.448786+0000","last_active":"2023-12-18T10:21:50.334522+0000","last_peered":"2023-12-18T10:21:50.334522+0000","last_clean":"2023-12-18T10:21:50.334522+0000","last_became_active":"2023-12-18T10:21:48.448323+0000","last_became_peered":"2023-12-18T10:21:48.448323+0000","last_unstale":"2023-12-18T10:21:50.334522+0000","last_undegraded":"2023-12-18T10:21:50.334522+0000","last_fullsized":"2023-12-18T10:21:50.334522+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:27.126391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.441396+0000","last_change":"2023-12-18T10:21:48.046002+0000","last_active":"2023-12-18T10:21:48.441396+0000","last_peered":"2023-12-18T10:21:48.441396+0000","last_clean":"2023-12-18T10:21:48.441396+0000","last_became_active":"2023-12-18T10:21:48.045617+0000","last_became_peered":"2023-12-18T10:21:48.045617+0000","last_unstale":"2023-12-18T10:21:48.441396+0000","last_undegraded":"2023-12-18T10:21:48.441396+0000","last_fullsized":"2023-12-18T10:21:48.441396+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835084+0000","last_change":"2023-12-18T10:21:48.434324+0000","last_active":"2023-12-18T10:21:50.835084+0000","last_peered":"2023-12-18T10:21:50.835084+0000","last_clean":"2023-12-18T10:21:50.835084+0000","last_became_active":"2023-12-18T10:21:48.433856+0000","last_became_peered":"2023-12-18T10:21:48.433856+0000","last_unstale":"2023-12-18T10:21:50.835084+0000","last_undegraded":"2023-12-18T10:21:50.835084+0000","last_fullsized":"2023-12-18T10:21:50.835084+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:32:05.625357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451251+0000","last_change":"2023-12-18T10:21:48.045742+0000","last_active":"2023-12-18T10:21:48.451251+0000","last_peered":"2023-12-18T10:21:48.451251+0000","last_clean":"2023-12-18T10:21:48.451251+0000","last_became_active":"2023-12-18T10:21:48.045437+0000","last_became_peered":"2023-12-18T10:21:48.045437+0000","last_unstale":"2023-12-18T10:21:48.451251+0000","last_undegraded":"2023-12-18T10:21:48.451251+0000","last_fullsized":"2023-12-18T10:21:48.451251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:49.230808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418256+0000","last_change":"2023-12-18T10:21:48.438290+0000","last_active":"2023-12-18T10:21:49.418256+0000","last_peered":"2023-12-18T10:21:49.418256+0000","last_clean":"2023-12-18T10:21:49.418256+0000","last_became_active":"2023-12-18T10:21:48.438025+0000","last_became_peered":"2023-12-18T10:21:48.438025+0000","last_unstale":"2023-12-18T10:21:49.418256+0000","last_undegraded":"2023-12-18T10:21:49.418256+0000","last_fullsized":"2023-12-18T10:21:49.418256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:21:40.051326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.448380+0000","last_change":"2023-12-18T10:21:48.046674+0000","last_active":"2023-12-18T10:21:48.448380+0000","last_peered":"2023-12-18T10:21:48.448380+0000","last_clean":"2023-12-18T10:21:48.448380+0000","last_became_active":"2023-12-18T10:21:48.046323+0000","last_became_peered":"2023-12-18T10:21:48.046323+0000","last_unstale":"2023-12-18T10:21:48.448380+0000","last_undegraded":"2023-12-18T10:21:48.448380+0000","last_fullsized":"2023-12-18T10:21:48.448380+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:16:40.749682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835002+0000","last_change":"2023-12-18T10:21:48.430886+0000","last_active":"2023-12-18T10:21:50.835002+0000","last_peered":"2023-12-18T10:21:50.835002+0000","last_clean":"2023-12-18T10:21:50.835002+0000","last_became_active":"2023-12-18T10:21:48.430425+0000","last_became_peered":"2023-12-18T10:21:48.430425+0000","last_unstale":"2023-12-18T10:21:50.835002+0000","last_undegraded":"2023-12-18T10:21:50.835002+0000","last_fullsized":"2023-12-18T10:21:50.835002+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:55.070518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408535+0000","last_change":"2023-12-18T10:21:48.043422+0000","last_active":"2023-12-18T10:21:48.408535+0000","last_peered":"2023-12-18T10:21:48.408535+0000","last_clean":"2023-12-18T10:21:48.408535+0000","last_became_active":"2023-12-18T10:21:48.043178+0000","last_became_peered":"2023-12-18T10:21:48.043178+0000","last_unstale":"2023-12-18T10:21:48.408535+0000","last_undegraded":"2023-12-18T10:21:48.408535+0000","last_fullsized":"2023-12-18T10:21:48.408535+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:45.292256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833716+0000","last_change":"2023-12-18T10:21:48.428607+0000","last_active":"2023-12-18T10:21:50.833716+0000","last_peered":"2023-12-18T10:21:50.833716+0000","last_clean":"2023-12-18T10:21:50.833716+0000","last_became_active":"2023-12-18T10:21:48.426002+0000","last_became_peered":"2023-12-18T10:21:48.426002+0000","last_unstale":"2023-12-18T10:21:50.833716+0000","last_undegraded":"2023-12-18T10:21:50.833716+0000","last_fullsized":"2023-12-18T10:21:50.833716+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:46.299824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431415+0000","last_change":"2023-12-18T10:21:48.034968+0000","last_active":"2023-12-18T10:21:48.431415+0000","last_peered":"2023-12-18T10:21:48.431415+0000","last_clean":"2023-12-18T10:21:48.431415+0000","last_became_active":"2023-12-18T10:21:48.034724+0000","last_became_peered":"2023-12-18T10:21:48.034724+0000","last_unstale":"2023-12-18T10:21:48.431415+0000","last_undegraded":"2023-12-18T10:21:48.431415+0000","last_fullsized":"2023-12-18T10:21:48.431415+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:32.620503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834367+0000","last_change":"2023-12-18T10:21:48.434770+0000","last_active":"2023-12-18T10:21:50.834367+0000","last_peered":"2023-12-18T10:21:50.834367+0000","last_clean":"2023-12-18T10:21:50.834367+0000","last_became_active":"2023-12-18T10:21:48.434492+0000","last_became_peered":"2023-12-18T10:21:48.434492+0000","last_unstale":"2023-12-18T10:21:50.834367+0000","last_undegraded":"2023-12-18T10:21:50.834367+0000","last_fullsized":"2023-12-18T10:21:50.834367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:24.252919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.425841+0000","last_change":"2023-12-18T10:21:48.046893+0000","last_active":"2023-12-18T10:21:48.425841+0000","last_peered":"2023-12-18T10:21:48.425841+0000","last_clean":"2023-12-18T10:21:48.425841+0000","last_became_active":"2023-12-18T10:21:48.046595+0000","last_became_peered":"2023-12-18T10:21:48.046595+0000","last_unstale":"2023-12-18T10:21:48.425841+0000","last_undegraded":"2023-12-18T10:21:48.425841+0000","last_fullsized":"2023-12-18T10:21:48.425841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834926+0000","last_change":"2023-12-18T10:21:48.435226+0000","last_active":"2023-12-18T10:21:50.834926+0000","last_peered":"2023-12-18T10:21:50.834926+0000","last_clean":"2023-12-18T10:21:50.834926+0000","last_became_active":"2023-12-18T10:21:48.432531+0000","last_became_peered":"2023-12-18T10:21:48.432531+0000","last_unstale":"2023-12-18T10:21:50.834926+0000","last_undegraded":"2023-12-18T10:21:50.834926+0000","last_fullsized":"2023-12-18T10:21:50.834926+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:47.242626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.412604+0000","last_change":"2023-12-18T10:21:48.038232+0000","last_active":"2023-12-18T10:21:48.412604+0000","last_peered":"2023-12-18T10:21:48.412604+0000","last_clean":"2023-12-18T10:21:48.412604+0000","last_became_active":"2023-12-18T10:21:48.037888+0000","last_became_peered":"2023-12-18T10:21:48.037888+0000","last_unstale":"2023-12-18T10:21:48.412604+0000","last_undegraded":"2023-12-18T10:21:48.412604+0000","last_fullsized":"2023-12-18T10:21:48.412604+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:10.710378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834214+0000","last_change":"2023-12-18T10:21:48.428405+0000","last_active":"2023-12-18T10:21:50.834214+0000","last_peered":"2023-12-18T10:21:50.834214+0000","last_clean":"2023-12-18T10:21:50.834214+0000","last_became_active":"2023-12-18T10:21:48.428116+0000","last_became_peered":"2023-12-18T10:21:48.428116+0000","last_unstale":"2023-12-18T10:21:50.834214+0000","last_undegraded":"2023-12-18T10:21:50.834214+0000","last_fullsized":"2023-12-18T10:21:50.834214+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:15:06.452111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.449466+0000","last_change":"2023-12-18T10:21:48.048899+0000","last_active":"2023-12-18T10:21:48.449466+0000","last_peered":"2023-12-18T10:21:48.449466+0000","last_clean":"2023-12-18T10:21:48.449466+0000","last_became_active":"2023-12-18T10:21:48.048619+0000","last_became_peered":"2023-12-18T10:21:48.048619+0000","last_unstale":"2023-12-18T10:21:48.449466+0000","last_undegraded":"2023-12-18T10:21:48.449466+0000","last_fullsized":"2023-12-18T10:21:48.449466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417350+0000","last_change":"2023-12-18T10:21:48.423355+0000","last_active":"2023-12-18T10:21:49.417350+0000","last_peered":"2023-12-18T10:21:49.417350+0000","last_clean":"2023-12-18T10:21:49.417350+0000","last_became_active":"2023-12-18T10:21:48.423114+0000","last_became_peered":"2023-12-18T10:21:48.423114+0000","last_unstale":"2023-12-18T10:21:49.417350+0000","last_undegraded":"2023-12-18T10:21:49.417350+0000","last_fullsized":"2023-12-18T10:21:49.417350+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:10:33.318309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.427923+0000","last_change":"2023-12-18T10:21:48.045907+0000","last_active":"2023-12-18T10:21:48.427923+0000","last_peered":"2023-12-18T10:21:48.427923+0000","last_clean":"2023-12-18T10:21:48.427923+0000","last_became_active":"2023-12-18T10:21:48.044701+0000","last_became_peered":"2023-12-18T10:21:48.044701+0000","last_unstale":"2023-12-18T10:21:48.427923+0000","last_undegraded":"2023-12-18T10:21:48.427923+0000","last_fullsized":"2023-12-18T10:21:48.427923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834501+0000","last_change":"2023-12-18T10:21:48.434656+0000","last_active":"2023-12-18T10:21:50.834501+0000","last_peered":"2023-12-18T10:21:50.834501+0000","last_clean":"2023-12-18T10:21:50.834501+0000","last_became_active":"2023-12-18T10:21:48.434335+0000","last_became_peered":"2023-12-18T10:21:48.434335+0000","last_unstale":"2023-12-18T10:21:50.834501+0000","last_undegraded":"2023-12-18T10:21:50.834501+0000","last_fullsized":"2023-12-18T10:21:50.834501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:27.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.412901+0000","last_change":"2023-12-18T10:21:48.044683+0000","last_active":"2023-12-18T10:21:48.412901+0000","last_peered":"2023-12-18T10:21:48.412901+0000","last_clean":"2023-12-18T10:21:48.412901+0000","last_became_active":"2023-12-18T10:21:48.044361+0000","last_became_peered":"2023-12-18T10:21:48.044361+0000","last_unstale":"2023-12-18T10:21:48.412901+0000","last_undegraded":"2023-12-18T10:21:48.412901+0000","last_fullsized":"2023-12-18T10:21:48.412901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:41.290961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835132+0000","last_change":"2023-12-18T10:21:48.430694+0000","last_active":"2023-12-18T10:21:50.835132+0000","last_peered":"2023-12-18T10:21:50.835132+0000","last_clean":"2023-12-18T10:21:50.835132+0000","last_became_active":"2023-12-18T10:21:48.430091+0000","last_became_peered":"2023-12-18T10:21:48.430091+0000","last_unstale":"2023-12-18T10:21:50.835132+0000","last_undegraded":"2023-12-18T10:21:50.835132+0000","last_fullsized":"2023-12-18T10:21:50.835132+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:02.335252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.409410+0000","last_change":"2023-12-18T10:21:48.043141+0000","last_active":"2023-12-18T10:21:48.409410+0000","last_peered":"2023-12-18T10:21:48.409410+0000","last_clean":"2023-12-18T10:21:48.409410+0000","last_became_active":"2023-12-18T10:21:48.042748+0000","last_became_peered":"2023-12-18T10:21:48.042748+0000","last_unstale":"2023-12-18T10:21:48.409410+0000","last_undegraded":"2023-12-18T10:21:48.409410+0000","last_fullsized":"2023-12-18T10:21:48.409410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834355+0000","last_change":"2023-12-18T10:21:48.435771+0000","last_active":"2023-12-18T10:21:50.834355+0000","last_peered":"2023-12-18T10:21:50.834355+0000","last_clean":"2023-12-18T10:21:50.834355+0000","last_became_active":"2023-12-18T10:21:48.430821+0000","last_became_peered":"2023-12-18T10:21:48.430821+0000","last_unstale":"2023-12-18T10:21:50.834355+0000","last_undegraded":"2023-12-18T10:21:50.834355+0000","last_fullsized":"2023-12-18T10:21:50.834355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:49:03.414174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431877+0000","last_change":"2023-12-18T10:21:48.041087+0000","last_active":"2023-12-18T10:21:48.431877+0000","last_peered":"2023-12-18T10:21:48.431877+0000","last_clean":"2023-12-18T10:21:48.431877+0000","last_became_active":"2023-12-18T10:21:48.040651+0000","last_became_peered":"2023-12-18T10:21:48.040651+0000","last_unstale":"2023-12-18T10:21:48.431877+0000","last_undegraded":"2023-12-18T10:21:48.431877+0000","last_fullsized":"2023-12-18T10:21:48.431877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:53:18.623750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417828+0000","last_change":"2023-12-18T10:21:48.442730+0000","last_active":"2023-12-18T10:21:49.417828+0000","last_peered":"2023-12-18T10:21:49.417828+0000","last_clean":"2023-12-18T10:21:49.417828+0000","last_became_active":"2023-12-18T10:21:48.442437+0000","last_became_peered":"2023-12-18T10:21:48.442437+0000","last_unstale":"2023-12-18T10:21:49.417828+0000","last_undegraded":"2023-12-18T10:21:49.417828+0000","last_fullsized":"2023-12-18T10:21:49.417828+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408017+0000","last_change":"2023-12-18T10:21:48.034202+0000","last_active":"2023-12-18T10:21:48.408017+0000","last_peered":"2023-12-18T10:21:48.408017+0000","last_clean":"2023-12-18T10:21:48.408017+0000","last_became_active":"2023-12-18T10:21:48.033929+0000","last_became_peered":"2023-12-18T10:21:48.033929+0000","last_unstale":"2023-12-18T10:21:48.408017+0000","last_undegraded":"2023-12-18T10:21:48.408017+0000","last_fullsized":"2023-12-18T10:21:48.408017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:30.962732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833902+0000","last_change":"2023-12-18T10:21:48.431174+0000","last_active":"2023-12-18T10:21:50.833902+0000","last_peered":"2023-12-18T10:21:50.833902+0000","last_clean":"2023-12-18T10:21:50.833902+0000","last_became_active":"2023-12-18T10:21:48.430895+0000","last_became_peered":"2023-12-18T10:21:48.430895+0000","last_unstale":"2023-12-18T10:21:50.833902+0000","last_undegraded":"2023-12-18T10:21:50.833902+0000","last_fullsized":"2023-12-18T10:21:50.833902+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:03:02.116576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408175+0000","last_change":"2023-12-18T10:21:48.035689+0000","last_active":"2023-12-18T10:21:48.408175+0000","last_peered":"2023-12-18T10:21:48.408175+0000","last_clean":"2023-12-18T10:21:48.408175+0000","last_became_active":"2023-12-18T10:21:48.035442+0000","last_became_peered":"2023-12-18T10:21:48.035442+0000","last_unstale":"2023-12-18T10:21:48.408175+0000","last_undegraded":"2023-12-18T10:21:48.408175+0000","last_fullsized":"2023-12-18T10:21:48.408175+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:26.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417176+0000","last_change":"2023-12-18T10:21:48.440493+0000","last_active":"2023-12-18T10:21:49.417176+0000","last_peered":"2023-12-18T10:21:49.417176+0000","last_clean":"2023-12-18T10:21:49.417176+0000","last_became_active":"2023-12-18T10:21:48.440216+0000","last_became_peered":"2023-12-18T10:21:48.440216+0000","last_unstale":"2023-12-18T10:21:49.417176+0000","last_undegraded":"2023-12-18T10:21:49.417176+0000","last_fullsized":"2023-12-18T10:21:49.417176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:11:34.360183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408006+0000","last_change":"2023-12-18T10:21:48.031460+0000","last_active":"2023-12-18T10:21:48.408006+0000","last_peered":"2023-12-18T10:21:48.408006+0000","last_clean":"2023-12-18T10:21:48.408006+0000","last_became_active":"2023-12-18T10:21:48.031176+0000","last_became_peered":"2023-12-18T10:21:48.031176+0000","last_unstale":"2023-12-18T10:21:48.408006+0000","last_undegraded":"2023-12-18T10:21:48.408006+0000","last_fullsized":"2023-12-18T10:21:48.408006+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835038+0000","last_change":"2023-12-18T10:21:48.428634+0000","last_active":"2023-12-18T10:21:50.835038+0000","last_peered":"2023-12-18T10:21:50.835038+0000","last_clean":"2023-12-18T10:21:50.835038+0000","last_became_active":"2023-12-18T10:21:48.427691+0000","last_became_peered":"2023-12-18T10:21:48.427691+0000","last_unstale":"2023-12-18T10:21:50.835038+0000","last_undegraded":"2023-12-18T10:21:50.835038+0000","last_fullsized":"2023-12-18T10:21:50.835038+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:17.022691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.407740+0000","last_change":"2023-12-18T10:21:48.041269+0000","last_active":"2023-12-18T10:21:48.407740+0000","last_peered":"2023-12-18T10:21:48.407740+0000","last_clean":"2023-12-18T10:21:48.407740+0000","last_became_active":"2023-12-18T10:21:48.040986+0000","last_became_peered":"2023-12-18T10:21:48.040986+0000","last_unstale":"2023-12-18T10:21:48.407740+0000","last_undegraded":"2023-12-18T10:21:48.407740+0000","last_fullsized":"2023-12-18T10:21:48.407740+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:35.516738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.418725+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:21:48.418725+0000","last_peered":"2023-12-18T10:21:48.418725+0000","last_clean":"2023-12-18T10:21:48.418725+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:21:48.418725+0000","last_undegraded":"2023-12-18T10:21:48.418725+0000","last_fullsized":"2023-12-18T10:21:48.418725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1396736,"data_stored":945613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.88400000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.442,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.83399999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.379},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41299999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.751}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":354503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79400000000000004,"15min":0.85999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77800000000000002,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84599999999999997,"15min":0.90700000000000003},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91300000000000003,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.47999999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.76800000000000002,"5min":1.845,"15min":1.845},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.82499999999999996,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":4.524,"15min":4.524},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83599999999999997,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96199999999999997,"5min":1.925,"15min":1.925},"last":0.60699999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.81899999999999995,"15min":0.84799999999999998},"min":{"1min":0.65400000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0489999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.85499999999999998,"15min":0.91300000000000003},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85299999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.622}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0049999999999999,"5min":1.101,"15min":1.101},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63800000000000001,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78100000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.441},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":1.284,"15min":1.284},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0880000000000001,"5min":1.129,"15min":1.129},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":354491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.67500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.45300000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0249999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.501}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.76900000000000002},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92500000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.751,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.623},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.81299999999999994},"min":{"1min":0.501,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.879,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.52800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91100000000000003,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.84199999999999997},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.90000000000000002,"15min":1.01},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.755}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73799999999999999,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89400000000000002,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.76600000000000001,"15min":0.81299999999999994},"min":{"1min":0.47099999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96199999999999997,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.042,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84199999999999997},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0669999999999999,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":798720,"data_stored":356033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.67400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88700000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.131,"15min":1.131},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":1.032,"15min":1.032},"last":0.71599999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.999,"15min":0.999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.57399999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84099999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.874,"15min":0.874},"last":0.51000000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77400000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79900000000000004,"5min":1.073,"15min":1.073},"last":0.746}]},{"osd":7,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.878,"5min":1.042,"15min":1.042},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.42899999999999999},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.49099999999999999,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69299999999999995,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63800000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.58899999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74099999999999999,"5min":1.254,"15min":1.254},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.66900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83899999999999997,"5min":1.772,"15min":1.772},"last":0.497}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85899999999999999,"5min":1.01,"15min":1.01},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0669999999999999,"5min":1.181,"15min":1.181},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0129999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.53200000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.871,"5min":1.069,"15min":1.069},"last":0.70699999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.036,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92000000000000004,"5min":1.127,"15min":1.127},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97699999999999998,"5min":1.139,"15min":1.139},"last":0.71599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.432,"15min":0.442},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.497}]},{"osd":3,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63500000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78500000000000003,"15min":0.80900000000000005},"min":{"1min":0.56799999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0469999999999999,"5min":1.698,"15min":1.698},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0820000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95999999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.085,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0680000000000001,"5min":1.341,"15min":1.341},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0900000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.048,"5min":1.282,"15min":1.282},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.093,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":815104,"data_stored":356797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.56599999999999995,"15min":0.624},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64400000000000002,"5min":3.976,"15min":3.976},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.503,"15min":0.52300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60499999999999998,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.61599999999999999,"15min":0.66200000000000003},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71399999999999997,"5min":3.786,"15min":3.786},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78600000000000003,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.63300000000000001,"15min":0.68200000000000005},"min":{"1min":0.39600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83099999999999996,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1399999999999999,"5min":1.851,"15min":1.851},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.878,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99199999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.52900000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.872,"15min":0.92400000000000004},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.0960000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.58699999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0169999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.89400000000000002,"15min":0.95799999999999996},"min":{"1min":0.56000000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0880000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0529999999999999,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81499999999999995,"15min":0.83899999999999997},"min":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0649999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":944837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.96899999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92900000000000005,"5min":1.456,"15min":1.456},"last":0.53800000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55800000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0589999999999999,"5min":1.595,"15min":1.595},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.55600000000000005,"15min":0.59999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":2.464,"15min":2.464},"last":0.5}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73699999999999999,"5min":1.859,"15min":1.859},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90000000000000002,"5min":1.903,"15min":1.903},"last":0.60099999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.58699999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3240000000000001,"5min":1.494,"15min":1.494},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.54700000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.53700000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.034,"5min":1.544,"15min":1.544},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.278,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.53,"15min":1.53},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.55900000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.349,"5min":1.556,"15min":1.556},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.032,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.80800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:21:53.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:21:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.395+0000 7fcef1cf9640 1 Processor -- start 2023-12-18T10:21:53.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.395+0000 7fcef1cf9640 1 -- start start 2023-12-18T10:21:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fcef1cf9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fceec1570c0 0x7fceec06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fcef1cf9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fcef1cf9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0c9460 con 0x7fceec06c320 2023-12-18T10:21:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fcef1cf9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec06c7a0 con 0x7fceec1570c0 2023-12-18T10:21:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fcef1cf9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec1574a0 con 0x7fceec0ca000 2023-12-18T10:21:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceeb7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fceec1570c0 0x7fceec06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceebfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceeb7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fceec1570c0 0x7fceec06bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:39620/0 (socket says 172.21.15.133:39620) 2023-12-18T10:21:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceeb7fe640 1 -- 172.21.15.133:0/1783419685 learned_addr learned my addr 172.21.15.133:0/1783419685 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceeb7fe640 1 -- 172.21.15.133:0/1783419685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 msgr2=0x7fceec070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:53.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceeb7fe640 1 --2- 172.21.15.133:0/1783419685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceeb7fe640 1 -- 172.21.15.133:0/1783419685 >> v1:172.21.15.142:6789/0 conn(0x7fceec06c320 legacy=0x7fceec0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceeb7fe640 1 -- 172.21.15.133:0/1783419685 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0c8b30 con 0x7fceec1570c0 2023-12-18T10:21:53.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceebfff640 1 --2- 172.21.15.133:0/1783419685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:53.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.399+0000 7fceea7fc640 1 -- 172.21.15.133:0/1783419685 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206281678 0 0) 0x7fceec0c9460 con 0x7fceec06c320 2023-12-18T10:21:53.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fceeb7fe640 1 --2- 172.21.15.133:0/1783419685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec1570c0 0x7fceec06bde0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009870 tx=0x7fcedc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=817b6a9095370fa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fceea7fc640 1 -- 172.21.15.133:0/1783419685 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0ab680 con 0x7fceec1570c0 2023-12-18T10:21:53.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fceea7fc640 1 -- 172.21.15.133:0/1783419685 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc0ab7e0 con 0x7fceec1570c0 2023-12-18T10:21:53.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fceea7fc640 1 -- 172.21.15.133:0/1783419685 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0abb70 con 0x7fceec1570c0 2023-12-18T10:21:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 -- 172.21.15.133:0/1783419685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec1570c0 msgr2=0x7fceec06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/1783419685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec1570c0 0x7fceec06bde0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009870 tx=0x7fcedc01c480 comp rx=0 tx=0).stop 2023-12-18T10:21:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 -- 172.21.15.133:0/1783419685 shutdown_connections 2023-12-18T10:21:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/1783419685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/1783419685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec1570c0 0x7fceec06bde0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 -- 172.21.15.133:0/1783419685 >> 172.21.15.133:0/1783419685 conn(0x7fceec06a3e0 msgr2=0x7fceec0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 -- 172.21.15.133:0/1783419685 shutdown_connections 2023-12-18T10:21:53.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 -- 172.21.15.133:0/1783419685 wait complete. 2023-12-18T10:21:53.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 Processor -- start 2023-12-18T10:21:53.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.403+0000 7fcef1cf9640 1 -- start start 2023-12-18T10:21:53.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec06c320 0x7fceec0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec14a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceec1570c0 0x7fceec15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec15c1c0 con 0x7fceec1570c0 2023-12-18T10:21:53.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec15b5b0 con 0x7fceec06c320 2023-12-18T10:21:53.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec15b890 con 0x7fceec0ca000 2023-12-18T10:21:53.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceec1570c0 0x7fceec15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceec1570c0 0x7fceec15ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59654/0 (socket says 172.21.15.133:59654) 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 -- 172.21.15.133:0/294927771 learned_addr learned my addr 172.21.15.133:0/294927771 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceeaffd640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec14a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceeb7fe640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec06c320 0x7fceec0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 -- 172.21.15.133:0/294927771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 msgr2=0x7fceec14a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec14a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 -- 172.21.15.133:0/294927771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec06c320 msgr2=0x7fceec0cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec06c320 0x7fceec0cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 -- 172.21.15.133:0/294927771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee4009a70 con 0x7fceec1570c0 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fceebfff640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceec1570c0 0x7fceec15ad80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcee400efc0 tx=0x7fcee4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fced3fff640 1 -- 172.21.15.133:0/294927771 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4009d70 con 0x7fceec1570c0 2023-12-18T10:21:53.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fced3fff640 1 -- 172.21.15.133:0/294927771 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee400f040 con 0x7fceec1570c0 2023-12-18T10:21:53.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fced3fff640 1 -- 172.21.15.133:0/294927771 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40039a0 con 0x7fceec1570c0 2023-12-18T10:21:53.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc0094d0 con 0x7fceec1570c0 2023-12-18T10:21:53.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec15be50 con 0x7fceec1570c0 2023-12-18T10:21:53.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec0735b0 con 0x7fceec1570c0 2023-12-18T10:21:53.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.407+0000 7fced3fff640 1 -- 172.21.15.133:0/294927771 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcee40144a0 con 0x7fceec1570c0 2023-12-18T10:21:53.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.411+0000 7fced3fff640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fced8065a90 0x7fced8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.411+0000 7fced3fff640 1 -- 172.21.15.133:0/294927771 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcee4083da0 con 0x7fceec1570c0 2023-12-18T10:21:53.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.411+0000 7fceeb7fe640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fced8065a90 0x7fced8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.411+0000 7fceeb7fe640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fced8065a90 0x7fced8067f50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0af000 tx=0x7fcedc0b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.415+0000 7fced3fff640 1 -- 172.21.15.133:0/294927771 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcee40516c0 con 0x7fceec1570c0 2023-12-18T10:21:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fceec04e000 con 0x7fceec1570c0 2023-12-18T10:21:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fced3fff640 1 -- 172.21.15.133:0/294927771 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1528 (secure 0 0 0) 0x7fcee4054ce0 con 0x7fceec1570c0 2023-12-18T10:21:53.619 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:53.620 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":253,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":65,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":240533504,"bytes_avail":772853579776,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":50,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6867}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-12-18T10:21:41.140357+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fced8065a90 msgr2=0x7fced8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fced8065a90 0x7fced8067f50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0af000 tx=0x7fcedc0b6040 comp rx=0 tx=0).stop 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceec1570c0 msgr2=0x7fceec15ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceec1570c0 0x7fceec15ad80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcee400efc0 tx=0x7fcee4009f90 comp rx=0 tx=0).stop 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 shutdown_connections 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fced8065a90 0x7fced8067f50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceec1570c0 0x7fceec15ad80 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fceec0ca000 0x7fceec14a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.615+0000 7fcef1cf9640 1 --2- 172.21.15.133:0/294927771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fceec06c320 0x7fceec0cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.619+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 >> 172.21.15.133:0/294927771 conn(0x7fceec06a3e0 msgr2=0x7fceec0c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:53.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.619+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 shutdown_connections 2023-12-18T10:21:53.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.619+0000 7fcef1cf9640 1 -- 172.21.15.133:0/294927771 wait complete. 2023-12-18T10:21:53.641 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-18T10:21:53.641 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:21:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2ef59e640 1 Processor -- start 2023-12-18T10:21:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2ef59e640 1 -- start start 2023-12-18T10:21:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2ef59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff2f015c730 0x7ff2f00b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2ef59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2f00cea00 0x7ff2f00cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2ef59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f00b65c0 con 0x7ff2f00cd3a0 2023-12-18T10:21:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2ef59e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f015cb10 con 0x7ff2f00cea00 2023-12-18T10:21:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2ef59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f00b84c0 con 0x7ff2f015c730 2023-12-18T10:21:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2edd9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2f00cea00 0x7ff2f00cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2edd9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2f00cea00 0x7ff2f00cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59664/0 (socket says 172.21.15.133:59664) 2023-12-18T10:21:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2edd9b640 1 -- 172.21.15.133:0/2556669858 learned_addr learned my addr 172.21.15.133:0/2556669858 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2ee59c640 1 --2- 172.21.15.133:0/2556669858 >> v2:172.21.15.142:3300/0 conn(0x7ff2f015c730 0x7ff2f00b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2edd9b640 1 -- 172.21.15.133:0/2556669858 >> v2:172.21.15.142:3300/0 conn(0x7ff2f015c730 msgr2=0x7ff2f00b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2edd9b640 1 --2- 172.21.15.133:0/2556669858 >> v2:172.21.15.142:3300/0 conn(0x7ff2f015c730 0x7ff2f00b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2edd9b640 1 -- 172.21.15.133:0/2556669858 >> v1:172.21.15.142:6789/0 conn(0x7ff2f00cd3a0 legacy=0x7ff2f00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.775+0000 7ff2edd9b640 1 -- 172.21.15.133:0/2556669858 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00cd960 con 0x7ff2f00cea00 2023-12-18T10:21:53.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2edd9b640 1 --2- 172.21.15.133:0/2556669858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f00cea00 0x7ff2f00cef60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00d33f0 tx=0x7ff2e401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb71c70207c398a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ed59a640 1 -- 172.21.15.133:0/2556669858 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40ac600 con 0x7ff2f00cea00 2023-12-18T10:21:53.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ed59a640 1 -- 172.21.15.133:0/2556669858 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e40a8050 con 0x7ff2f00cea00 2023-12-18T10:21:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ed59a640 1 -- 172.21.15.133:0/2556669858 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40ac980 con 0x7ff2f00cea00 2023-12-18T10:21:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ef59e640 1 -- 172.21.15.133:0/2556669858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f00cea00 msgr2=0x7ff2f00cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/2556669858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f00cea00 0x7ff2f00cef60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00d33f0 tx=0x7ff2e401c490 comp rx=0 tx=0).stop 2023-12-18T10:21:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ef59e640 1 -- 172.21.15.133:0/2556669858 shutdown_connections 2023-12-18T10:21:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/2556669858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f00cea00 0x7ff2f00cef60 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/2556669858 >> v2:172.21.15.142:3300/0 conn(0x7ff2f015c730 0x7ff2f00b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ef59e640 1 -- 172.21.15.133:0/2556669858 >> 172.21.15.133:0/2556669858 conn(0x7ff2f006b120 msgr2=0x7ff2f006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ef59e640 1 -- 172.21.15.133:0/2556669858 shutdown_connections 2023-12-18T10:21:53.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.779+0000 7ff2ef59e640 1 -- 172.21.15.133:0/2556669858 wait complete. 2023-12-18T10:21:53.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 Processor -- start 2023-12-18T10:21:53.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 -- start start 2023-12-18T10:21:53.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2f00cd3a0 0x7ff2f01538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2f00cea00 0x7ff2f015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f015c730 0x7ff2f015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f015d3d0 con 0x7ff2f015c730 2023-12-18T10:21:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f014cd90 con 0x7ff2f00cd3a0 2023-12-18T10:21:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f015cd50 con 0x7ff2f00cea00 2023-12-18T10:21:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f015c730 0x7ff2f015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ee59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2f00cd3a0 0x7ff2f01538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f015c730 0x7ff2f015dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59676/0 (socket says 172.21.15.133:59676) 2023-12-18T10:21:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 -- 172.21.15.133:0/3818222845 learned_addr learned my addr 172.21.15.133:0/3818222845 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2edd9b640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2f00cea00 0x7ff2f015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 -- 172.21.15.133:0/3818222845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2f00cea00 msgr2=0x7ff2f015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2f00cea00 0x7ff2f015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 -- 172.21.15.133:0/3818222845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2f00cd3a0 msgr2=0x7ff2f01538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2f00cd3a0 0x7ff2f01538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 -- 172.21.15.133:0/3818222845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40094d0 con 0x7ff2f015c730 2023-12-18T10:21:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ee59c640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2f00cd3a0 0x7ff2f01538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:21:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2eed9d640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f015c730 0x7ff2f015dd30 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c7b0 tx=0x7ff2e800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2deffd640 1 -- 172.21.15.133:0/3818222845 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8004b70 con 0x7ff2f015c730 2023-12-18T10:21:53.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2deffd640 1 -- 172.21.15.133:0/3818222845 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e8004cd0 con 0x7ff2f015c730 2023-12-18T10:21:53.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2deffd640 1 -- 172.21.15.133:0/3818222845 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e800aa90 con 0x7ff2f015c730 2023-12-18T10:21:53.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f015f2b0 con 0x7ff2f015c730 2023-12-18T10:21:53.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.783+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f0153df0 con 0x7ff2f015c730 2023-12-18T10:21:53.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.787+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f015d510 con 0x7ff2f015c730 2023-12-18T10:21:53.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.787+0000 7ff2deffd640 1 -- 172.21.15.133:0/3818222845 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff2e800abf0 con 0x7ff2f015c730 2023-12-18T10:21:53.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.787+0000 7ff2deffd640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff2d0065a60 0x7ff2d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:53.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.787+0000 7ff2deffd640 1 -- 172.21.15.133:0/3818222845 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff2e8083350 con 0x7ff2f015c730 2023-12-18T10:21:53.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.787+0000 7ff2ee59c640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff2d0065a60 0x7ff2d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:53.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.787+0000 7ff2ee59c640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff2d0065a60 0x7ff2d0067f20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0007db0 tx=0x7ff2e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:53.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.791+0000 7ff2deffd640 1 -- 172.21.15.133:0/3818222845 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff2e8050be0 con 0x7ff2f015c730 2023-12-18T10:21:53.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.939+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2f00ce4e0 con 0x7ff2d0065a60 2023-12-18T10:21:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.947+0000 7ff2deffd640 1 -- 172.21.15.133:0/3818222845 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289451 (secure 0 0 0) 0x7ff2e0007a00 con 0x7ff2d0065a60 2023-12-18T10:21:53.955 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:53.957 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:21:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff2d0065a60 msgr2=0x7ff2d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff2d0065a60 0x7ff2d0067f20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0007db0 tx=0x7ff2e0008040 comp rx=0 tx=0).stop 2023-12-18T10:21:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f015c730 msgr2=0x7ff2f015dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f015c730 0x7ff2f015dd30 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c7b0 tx=0x7ff2e800cc70 comp rx=0 tx=0).stop 2023-12-18T10:21:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 shutdown_connections 2023-12-18T10:21:53.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff2d0065a60 0x7ff2d0067f20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2f015c730 0x7ff2f015dd30 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2f00cea00 0x7ff2f015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 --2- 172.21.15.133:0/3818222845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2f00cd3a0 0x7ff2f01538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:53.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 >> 172.21.15.133:0/3818222845 conn(0x7ff2f006b120 msgr2=0x7ff2f01509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:53.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 shutdown_connections 2023-12-18T10:21:53.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:53.951+0000 7ff2ef59e640 1 -- 172.21.15.133:0/3818222845 wait complete. 2023-12-18T10:21:53.974 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-12-18T10:21:53.142476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239368,"kb_used_data":7368,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754735352,"statfs":{"total":773094113280,"available":772849000448,"internally_reserved":0,"allocated":7544832,"data_stored":4021212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001230"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834579+0000","last_change":"2023-12-18T10:21:48.434897+0000","last_active":"2023-12-18T10:21:50.834579+0000","last_peered":"2023-12-18T10:21:50.834579+0000","last_clean":"2023-12-18T10:21:50.834579+0000","last_became_active":"2023-12-18T10:21:48.434578+0000","last_became_peered":"2023-12-18T10:21:48.434578+0000","last_unstale":"2023-12-18T10:21:50.834579+0000","last_undegraded":"2023-12-18T10:21:50.834579+0000","last_fullsized":"2023-12-18T10:21:50.834579+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:10:43.067633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833981+0000","last_change":"2023-12-18T10:21:48.417639+0000","last_active":"2023-12-18T10:21:50.833981+0000","last_peered":"2023-12-18T10:21:50.833981+0000","last_clean":"2023-12-18T10:21:50.833981+0000","last_became_active":"2023-12-18T10:21:48.416863+0000","last_became_peered":"2023-12-18T10:21:48.416863+0000","last_unstale":"2023-12-18T10:21:50.833981+0000","last_undegraded":"2023-12-18T10:21:50.833981+0000","last_fullsized":"2023-12-18T10:21:50.833981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:11:25.323308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334380+0000","last_change":"2023-12-18T10:21:48.448550+0000","last_active":"2023-12-18T10:21:50.334380+0000","last_peered":"2023-12-18T10:21:50.334380+0000","last_clean":"2023-12-18T10:21:50.334380+0000","last_became_active":"2023-12-18T10:21:48.448146+0000","last_became_peered":"2023-12-18T10:21:48.448146+0000","last_unstale":"2023-12-18T10:21:50.334380+0000","last_undegraded":"2023-12-18T10:21:50.334380+0000","last_fullsized":"2023-12-18T10:21:50.334380+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:27:02.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418050+0000","last_change":"2023-12-18T10:21:48.440593+0000","last_active":"2023-12-18T10:21:49.418050+0000","last_peered":"2023-12-18T10:21:49.418050+0000","last_clean":"2023-12-18T10:21:49.418050+0000","last_became_active":"2023-12-18T10:21:48.433754+0000","last_became_peered":"2023-12-18T10:21:48.433754+0000","last_unstale":"2023-12-18T10:21:49.418050+0000","last_undegraded":"2023-12-18T10:21:49.418050+0000","last_fullsized":"2023-12-18T10:21:49.418050+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:46.299824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834941+0000","last_change":"2023-12-18T10:21:48.431578+0000","last_active":"2023-12-18T10:21:50.834941+0000","last_peered":"2023-12-18T10:21:50.834941+0000","last_clean":"2023-12-18T10:21:50.834941+0000","last_became_active":"2023-12-18T10:21:48.431304+0000","last_became_peered":"2023-12-18T10:21:48.431304+0000","last_unstale":"2023-12-18T10:21:50.834941+0000","last_undegraded":"2023-12-18T10:21:50.834941+0000","last_fullsized":"2023-12-18T10:21:50.834941+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:50.238376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834276+0000","last_change":"2023-12-18T10:21:48.419957+0000","last_active":"2023-12-18T10:21:50.834276+0000","last_peered":"2023-12-18T10:21:50.834276+0000","last_clean":"2023-12-18T10:21:50.834276+0000","last_became_active":"2023-12-18T10:21:48.419672+0000","last_became_peered":"2023-12-18T10:21:48.419672+0000","last_unstale":"2023-12-18T10:21:50.834276+0000","last_undegraded":"2023-12-18T10:21:50.834276+0000","last_fullsized":"2023-12-18T10:21:50.834276+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:50.091555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417128+0000","last_change":"2023-12-18T10:21:48.441330+0000","last_active":"2023-12-18T10:21:49.417128+0000","last_peered":"2023-12-18T10:21:49.417128+0000","last_clean":"2023-12-18T10:21:49.417128+0000","last_became_active":"2023-12-18T10:21:48.441030+0000","last_became_peered":"2023-12-18T10:21:48.441030+0000","last_unstale":"2023-12-18T10:21:49.417128+0000","last_undegraded":"2023-12-18T10:21:49.417128+0000","last_fullsized":"2023-12-18T10:21:49.417128+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:49:55.833641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834217+0000","last_change":"2023-12-18T10:21:48.446465+0000","last_active":"2023-12-18T10:21:50.834217+0000","last_peered":"2023-12-18T10:21:50.834217+0000","last_clean":"2023-12-18T10:21:50.834217+0000","last_became_active":"2023-12-18T10:21:48.446183+0000","last_became_peered":"2023-12-18T10:21:48.446183+0000","last_unstale":"2023-12-18T10:21:50.834217+0000","last_undegraded":"2023-12-18T10:21:50.834217+0000","last_fullsized":"2023-12-18T10:21:50.834217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334712+0000","last_change":"2023-12-18T10:21:48.450885+0000","last_active":"2023-12-18T10:21:50.334712+0000","last_peered":"2023-12-18T10:21:50.334712+0000","last_clean":"2023-12-18T10:21:50.334712+0000","last_became_active":"2023-12-18T10:21:48.450262+0000","last_became_peered":"2023-12-18T10:21:48.450262+0000","last_unstale":"2023-12-18T10:21:50.334712+0000","last_undegraded":"2023-12-18T10:21:50.334712+0000","last_fullsized":"2023-12-18T10:21:50.334712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:57.360980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334585+0000","last_change":"2023-12-18T10:21:48.451228+0000","last_active":"2023-12-18T10:21:50.334585+0000","last_peered":"2023-12-18T10:21:50.334585+0000","last_clean":"2023-12-18T10:21:50.334585+0000","last_became_active":"2023-12-18T10:21:48.450909+0000","last_became_peered":"2023-12-18T10:21:48.450909+0000","last_unstale":"2023-12-18T10:21:50.334585+0000","last_undegraded":"2023-12-18T10:21:50.334585+0000","last_fullsized":"2023-12-18T10:21:50.334585+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418015+0000","last_change":"2023-12-18T10:21:48.429822+0000","last_active":"2023-12-18T10:21:49.418015+0000","last_peered":"2023-12-18T10:21:49.418015+0000","last_clean":"2023-12-18T10:21:49.418015+0000","last_became_active":"2023-12-18T10:21:48.429488+0000","last_became_peered":"2023-12-18T10:21:48.429488+0000","last_unstale":"2023-12-18T10:21:49.418015+0000","last_undegraded":"2023-12-18T10:21:49.418015+0000","last_fullsized":"2023-12-18T10:21:49.418015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:50:15.431746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834357+0000","last_change":"2023-12-18T10:21:48.445659+0000","last_active":"2023-12-18T10:21:50.834357+0000","last_peered":"2023-12-18T10:21:50.834357+0000","last_clean":"2023-12-18T10:21:50.834357+0000","last_became_active":"2023-12-18T10:21:48.445384+0000","last_became_peered":"2023-12-18T10:21:48.445384+0000","last_unstale":"2023-12-18T10:21:50.834357+0000","last_undegraded":"2023-12-18T10:21:50.834357+0000","last_fullsized":"2023-12-18T10:21:50.834357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834366+0000","last_change":"2023-12-18T10:21:48.436781+0000","last_active":"2023-12-18T10:21:50.834366+0000","last_peered":"2023-12-18T10:21:50.834366+0000","last_clean":"2023-12-18T10:21:50.834366+0000","last_became_active":"2023-12-18T10:21:48.436525+0000","last_became_peered":"2023-12-18T10:21:48.436525+0000","last_unstale":"2023-12-18T10:21:50.834366+0000","last_undegraded":"2023-12-18T10:21:50.834366+0000","last_fullsized":"2023-12-18T10:21:50.834366+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:11.717946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334403+0000","last_change":"2023-12-18T10:21:48.446331+0000","last_active":"2023-12-18T10:21:50.334403+0000","last_peered":"2023-12-18T10:21:50.334403+0000","last_clean":"2023-12-18T10:21:50.334403+0000","last_became_active":"2023-12-18T10:21:48.445998+0000","last_became_peered":"2023-12-18T10:21:48.445998+0000","last_unstale":"2023-12-18T10:21:50.334403+0000","last_undegraded":"2023-12-18T10:21:50.334403+0000","last_fullsized":"2023-12-18T10:21:50.334403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:23:30.222618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334241+0000","last_change":"2023-12-18T10:21:48.445026+0000","last_active":"2023-12-18T10:21:50.334241+0000","last_peered":"2023-12-18T10:21:50.334241+0000","last_clean":"2023-12-18T10:21:50.334241+0000","last_became_active":"2023-12-18T10:21:48.444765+0000","last_became_peered":"2023-12-18T10:21:48.444765+0000","last_unstale":"2023-12-18T10:21:50.334241+0000","last_undegraded":"2023-12-18T10:21:50.334241+0000","last_fullsized":"2023-12-18T10:21:50.334241+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417038+0000","last_change":"2023-12-18T10:21:48.442006+0000","last_active":"2023-12-18T10:21:49.417038+0000","last_peered":"2023-12-18T10:21:49.417038+0000","last_clean":"2023-12-18T10:21:49.417038+0000","last_became_active":"2023-12-18T10:21:48.441738+0000","last_became_peered":"2023-12-18T10:21:48.441738+0000","last_unstale":"2023-12-18T10:21:49.417038+0000","last_undegraded":"2023-12-18T10:21:49.417038+0000","last_fullsized":"2023-12-18T10:21:49.417038+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:20.902657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834607+0000","last_change":"2023-12-18T10:21:48.431569+0000","last_active":"2023-12-18T10:21:50.834607+0000","last_peered":"2023-12-18T10:21:50.834607+0000","last_clean":"2023-12-18T10:21:50.834607+0000","last_became_active":"2023-12-18T10:21:48.431326+0000","last_became_peered":"2023-12-18T10:21:48.431326+0000","last_unstale":"2023-12-18T10:21:50.834607+0000","last_undegraded":"2023-12-18T10:21:50.834607+0000","last_fullsized":"2023-12-18T10:21:50.834607+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:27.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418156+0000","last_change":"2023-12-18T10:21:48.433208+0000","last_active":"2023-12-18T10:21:49.418156+0000","last_peered":"2023-12-18T10:21:49.418156+0000","last_clean":"2023-12-18T10:21:49.418156+0000","last_became_active":"2023-12-18T10:21:48.432941+0000","last_became_peered":"2023-12-18T10:21:48.432941+0000","last_unstale":"2023-12-18T10:21:49.418156+0000","last_undegraded":"2023-12-18T10:21:49.418156+0000","last_fullsized":"2023-12-18T10:21:49.418156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:36.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834992+0000","last_change":"2023-12-18T10:21:48.434145+0000","last_active":"2023-12-18T10:21:50.834992+0000","last_peered":"2023-12-18T10:21:50.834992+0000","last_clean":"2023-12-18T10:21:50.834992+0000","last_became_active":"2023-12-18T10:21:48.433505+0000","last_became_peered":"2023-12-18T10:21:48.433505+0000","last_unstale":"2023-12-18T10:21:50.834992+0000","last_undegraded":"2023-12-18T10:21:50.834992+0000","last_fullsized":"2023-12-18T10:21:50.834992+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:16:41.757250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833619+0000","last_change":"2023-12-18T10:21:48.424288+0000","last_active":"2023-12-18T10:21:50.833619+0000","last_peered":"2023-12-18T10:21:50.833619+0000","last_clean":"2023-12-18T10:21:50.833619+0000","last_became_active":"2023-12-18T10:21:48.424033+0000","last_became_peered":"2023-12-18T10:21:48.424033+0000","last_unstale":"2023-12-18T10:21:50.833619+0000","last_undegraded":"2023-12-18T10:21:50.833619+0000","last_fullsized":"2023-12-18T10:21:50.833619+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:05:30.756965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834479+0000","last_change":"2023-12-18T10:21:48.439646+0000","last_active":"2023-12-18T10:21:50.834479+0000","last_peered":"2023-12-18T10:21:50.834479+0000","last_clean":"2023-12-18T10:21:50.834479+0000","last_became_active":"2023-12-18T10:21:48.431449+0000","last_became_peered":"2023-12-18T10:21:48.431449+0000","last_unstale":"2023-12-18T10:21:50.834479+0000","last_undegraded":"2023-12-18T10:21:50.834479+0000","last_fullsized":"2023-12-18T10:21:50.834479+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:11.137755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833553+0000","last_change":"2023-12-18T10:21:48.425153+0000","last_active":"2023-12-18T10:21:50.833553+0000","last_peered":"2023-12-18T10:21:50.833553+0000","last_clean":"2023-12-18T10:21:50.833553+0000","last_became_active":"2023-12-18T10:21:48.424891+0000","last_became_peered":"2023-12-18T10:21:48.424891+0000","last_unstale":"2023-12-18T10:21:50.833553+0000","last_undegraded":"2023-12-18T10:21:50.833553+0000","last_fullsized":"2023-12-18T10:21:50.833553+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:05.464349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833390+0000","last_change":"2023-12-18T10:21:48.426896+0000","last_active":"2023-12-18T10:21:50.833390+0000","last_peered":"2023-12-18T10:21:50.833390+0000","last_clean":"2023-12-18T10:21:50.833390+0000","last_became_active":"2023-12-18T10:21:48.426318+0000","last_became_peered":"2023-12-18T10:21:48.426318+0000","last_unstale":"2023-12-18T10:21:50.833390+0000","last_undegraded":"2023-12-18T10:21:50.833390+0000","last_fullsized":"2023-12-18T10:21:50.833390+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:42:36.055759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334171+0000","last_change":"2023-12-18T10:21:48.433113+0000","last_active":"2023-12-18T10:21:50.334171+0000","last_peered":"2023-12-18T10:21:50.334171+0000","last_clean":"2023-12-18T10:21:50.334171+0000","last_became_active":"2023-12-18T10:21:48.432816+0000","last_became_peered":"2023-12-18T10:21:48.432816+0000","last_unstale":"2023-12-18T10:21:50.334171+0000","last_undegraded":"2023-12-18T10:21:50.334171+0000","last_fullsized":"2023-12-18T10:21:50.334171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:11.717946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834517+0000","last_change":"2023-12-18T10:21:48.435237+0000","last_active":"2023-12-18T10:21:50.834517+0000","last_peered":"2023-12-18T10:21:50.834517+0000","last_clean":"2023-12-18T10:21:50.834517+0000","last_became_active":"2023-12-18T10:21:48.434894+0000","last_became_peered":"2023-12-18T10:21:48.434894+0000","last_unstale":"2023-12-18T10:21:50.834517+0000","last_undegraded":"2023-12-18T10:21:50.834517+0000","last_fullsized":"2023-12-18T10:21:50.834517+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:42.298529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834365+0000","last_change":"2023-12-18T10:21:48.435992+0000","last_active":"2023-12-18T10:21:50.834365+0000","last_peered":"2023-12-18T10:21:50.834365+0000","last_clean":"2023-12-18T10:21:50.834365+0000","last_became_active":"2023-12-18T10:21:48.435702+0000","last_became_peered":"2023-12-18T10:21:48.435702+0000","last_unstale":"2023-12-18T10:21:50.834365+0000","last_undegraded":"2023-12-18T10:21:50.834365+0000","last_fullsized":"2023-12-18T10:21:50.834365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:57.360980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418081+0000","last_change":"2023-12-18T10:21:48.441611+0000","last_active":"2023-12-18T10:21:49.418081+0000","last_peered":"2023-12-18T10:21:49.418081+0000","last_clean":"2023-12-18T10:21:49.418081+0000","last_became_active":"2023-12-18T10:21:48.437132+0000","last_became_peered":"2023-12-18T10:21:48.437132+0000","last_unstale":"2023-12-18T10:21:49.418081+0000","last_undegraded":"2023-12-18T10:21:49.418081+0000","last_fullsized":"2023-12-18T10:21:49.418081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:31.970301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834578+0000","last_change":"2023-12-18T10:21:48.425031+0000","last_active":"2023-12-18T10:21:50.834578+0000","last_peered":"2023-12-18T10:21:50.834578+0000","last_clean":"2023-12-18T10:21:50.834578+0000","last_became_active":"2023-12-18T10:21:48.424777+0000","last_became_peered":"2023-12-18T10:21:48.424777+0000","last_unstale":"2023-12-18T10:21:50.834578+0000","last_undegraded":"2023-12-18T10:21:50.834578+0000","last_fullsized":"2023-12-18T10:21:50.834578+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:11.137755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334339+0000","last_change":"2023-12-18T10:21:48.444498+0000","last_active":"2023-12-18T10:21:50.334339+0000","last_peered":"2023-12-18T10:21:50.334339+0000","last_clean":"2023-12-18T10:21:50.334339+0000","last_became_active":"2023-12-18T10:21:48.444233+0000","last_became_peered":"2023-12-18T10:21:48.444233+0000","last_unstale":"2023-12-18T10:21:50.334339+0000","last_undegraded":"2023-12-18T10:21:50.334339+0000","last_fullsized":"2023-12-18T10:21:50.334339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:42.298529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834457+0000","last_change":"2023-12-18T10:21:48.445156+0000","last_active":"2023-12-18T10:21:50.834457+0000","last_peered":"2023-12-18T10:21:50.834457+0000","last_clean":"2023-12-18T10:21:50.834457+0000","last_became_active":"2023-12-18T10:21:48.444896+0000","last_became_peered":"2023-12-18T10:21:48.444896+0000","last_unstale":"2023-12-18T10:21:50.834457+0000","last_undegraded":"2023-12-18T10:21:50.834457+0000","last_fullsized":"2023-12-18T10:21:50.834457+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:36:39.295713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417775+0000","last_change":"2023-12-18T10:21:48.436580+0000","last_active":"2023-12-18T10:21:49.417775+0000","last_peered":"2023-12-18T10:21:49.417775+0000","last_clean":"2023-12-18T10:21:49.417775+0000","last_became_active":"2023-12-18T10:21:48.435579+0000","last_became_peered":"2023-12-18T10:21:48.435579+0000","last_unstale":"2023-12-18T10:21:49.417775+0000","last_undegraded":"2023-12-18T10:21:49.417775+0000","last_fullsized":"2023-12-18T10:21:49.417775+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:23:30.222618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833627+0000","last_change":"2023-12-18T10:21:48.429224+0000","last_active":"2023-12-18T10:21:50.833627+0000","last_peered":"2023-12-18T10:21:50.833627+0000","last_clean":"2023-12-18T10:21:50.833627+0000","last_became_active":"2023-12-18T10:21:48.428929+0000","last_became_peered":"2023-12-18T10:21:48.428929+0000","last_unstale":"2023-12-18T10:21:50.833627+0000","last_undegraded":"2023-12-18T10:21:50.833627+0000","last_fullsized":"2023-12-18T10:21:50.833627+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:36.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835152+0000","last_change":"2023-12-18T10:21:48.436670+0000","last_active":"2023-12-18T10:21:50.835152+0000","last_peered":"2023-12-18T10:21:50.835152+0000","last_clean":"2023-12-18T10:21:50.835152+0000","last_became_active":"2023-12-18T10:21:48.436401+0000","last_became_peered":"2023-12-18T10:21:48.436401+0000","last_unstale":"2023-12-18T10:21:50.835152+0000","last_undegraded":"2023-12-18T10:21:50.835152+0000","last_fullsized":"2023-12-18T10:21:50.835152+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:14:20.867347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.447607+0000","last_change":"2023-12-18T10:21:48.039433+0000","last_active":"2023-12-18T10:21:48.447607+0000","last_peered":"2023-12-18T10:21:48.447607+0000","last_clean":"2023-12-18T10:21:48.447607+0000","last_became_active":"2023-12-18T10:21:48.039120+0000","last_became_peered":"2023-12-18T10:21:48.039120+0000","last_unstale":"2023-12-18T10:21:48.447607+0000","last_undegraded":"2023-12-18T10:21:48.447607+0000","last_fullsized":"2023-12-18T10:21:48.447607+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418144+0000","last_change":"2023-12-18T10:21:48.441480+0000","last_active":"2023-12-18T10:21:49.418144+0000","last_peered":"2023-12-18T10:21:49.418144+0000","last_clean":"2023-12-18T10:21:49.418144+0000","last_became_active":"2023-12-18T10:21:48.439460+0000","last_became_peered":"2023-12-18T10:21:48.439460+0000","last_unstale":"2023-12-18T10:21:49.418144+0000","last_undegraded":"2023-12-18T10:21:49.418144+0000","last_fullsized":"2023-12-18T10:21:49.418144+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:50.091555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.444899+0000","last_change":"2023-12-18T10:21:48.040368+0000","last_active":"2023-12-18T10:21:48.444899+0000","last_peered":"2023-12-18T10:21:48.444899+0000","last_clean":"2023-12-18T10:21:48.444899+0000","last_became_active":"2023-12-18T10:21:48.039832+0000","last_became_peered":"2023-12-18T10:21:48.039832+0000","last_unstale":"2023-12-18T10:21:48.444899+0000","last_undegraded":"2023-12-18T10:21:48.444899+0000","last_fullsized":"2023-12-18T10:21:48.444899+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:23.245351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834086+0000","last_change":"2023-12-18T10:21:48.430156+0000","last_active":"2023-12-18T10:21:50.834086+0000","last_peered":"2023-12-18T10:21:50.834086+0000","last_clean":"2023-12-18T10:21:50.834086+0000","last_became_active":"2023-12-18T10:21:48.429711+0000","last_became_peered":"2023-12-18T10:21:48.429711+0000","last_unstale":"2023-12-18T10:21:50.834086+0000","last_undegraded":"2023-12-18T10:21:50.834086+0000","last_fullsized":"2023-12-18T10:21:50.834086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:21:40.051326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.440120+0000","last_change":"2023-12-18T10:21:48.045644+0000","last_active":"2023-12-18T10:21:48.440120+0000","last_peered":"2023-12-18T10:21:48.440120+0000","last_clean":"2023-12-18T10:21:48.440120+0000","last_became_active":"2023-12-18T10:21:48.045326+0000","last_became_peered":"2023-12-18T10:21:48.045326+0000","last_unstale":"2023-12-18T10:21:48.440120+0000","last_undegraded":"2023-12-18T10:21:48.440120+0000","last_fullsized":"2023-12-18T10:21:48.440120+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:56.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334680+0000","last_change":"2023-12-18T10:21:48.449749+0000","last_active":"2023-12-18T10:21:50.334680+0000","last_peered":"2023-12-18T10:21:50.334680+0000","last_clean":"2023-12-18T10:21:50.334680+0000","last_became_active":"2023-12-18T10:21:48.449454+0000","last_became_peered":"2023-12-18T10:21:48.449454+0000","last_unstale":"2023-12-18T10:21:50.334680+0000","last_undegraded":"2023-12-18T10:21:50.334680+0000","last_fullsized":"2023-12-18T10:21:50.334680+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:24.252919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431077+0000","last_change":"2023-12-18T10:21:48.033347+0000","last_active":"2023-12-18T10:21:48.431077+0000","last_peered":"2023-12-18T10:21:48.431077+0000","last_clean":"2023-12-18T10:21:48.431077+0000","last_became_active":"2023-12-18T10:21:48.033043+0000","last_became_peered":"2023-12-18T10:21:48.033043+0000","last_unstale":"2023-12-18T10:21:48.431077+0000","last_undegraded":"2023-12-18T10:21:48.431077+0000","last_fullsized":"2023-12-18T10:21:48.431077+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:26.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417022+0000","last_change":"2023-12-18T10:21:48.417853+0000","last_active":"2023-12-18T10:21:49.417022+0000","last_peered":"2023-12-18T10:21:49.417022+0000","last_clean":"2023-12-18T10:21:49.417022+0000","last_became_active":"2023-12-18T10:21:48.416985+0000","last_became_peered":"2023-12-18T10:21:48.416985+0000","last_unstale":"2023-12-18T10:21:49.417022+0000","last_undegraded":"2023-12-18T10:21:49.417022+0000","last_fullsized":"2023-12-18T10:21:49.417022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:50:57.134438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431776+0000","last_change":"2023-12-18T10:21:48.039260+0000","last_active":"2023-12-18T10:21:48.431776+0000","last_peered":"2023-12-18T10:21:48.431776+0000","last_clean":"2023-12-18T10:21:48.431776+0000","last_became_active":"2023-12-18T10:21:48.038959+0000","last_became_peered":"2023-12-18T10:21:48.038959+0000","last_unstale":"2023-12-18T10:21:48.431776+0000","last_undegraded":"2023-12-18T10:21:48.431776+0000","last_fullsized":"2023-12-18T10:21:48.431776+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:49.083987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834041+0000","last_change":"2023-12-18T10:21:48.431276+0000","last_active":"2023-12-18T10:21:50.834041+0000","last_peered":"2023-12-18T10:21:50.834041+0000","last_clean":"2023-12-18T10:21:50.834041+0000","last_became_active":"2023-12-18T10:21:48.430965+0000","last_became_peered":"2023-12-18T10:21:48.430965+0000","last_unstale":"2023-12-18T10:21:50.834041+0000","last_undegraded":"2023-12-18T10:21:50.834041+0000","last_fullsized":"2023-12-18T10:21:50.834041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:26:54.871700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.432746+0000","last_change":"2023-12-18T10:21:48.042888+0000","last_active":"2023-12-18T10:21:48.432746+0000","last_peered":"2023-12-18T10:21:48.432746+0000","last_clean":"2023-12-18T10:21:48.432746+0000","last_became_active":"2023-12-18T10:21:48.042599+0000","last_became_peered":"2023-12-18T10:21:48.042599+0000","last_unstale":"2023-12-18T10:21:48.432746+0000","last_undegraded":"2023-12-18T10:21:48.432746+0000","last_fullsized":"2023-12-18T10:21:48.432746+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:50:14.424178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834978+0000","last_change":"2023-12-18T10:21:48.435436+0000","last_active":"2023-12-18T10:21:50.834978+0000","last_peered":"2023-12-18T10:21:50.834978+0000","last_clean":"2023-12-18T10:21:50.834978+0000","last_became_active":"2023-12-18T10:21:48.434960+0000","last_became_peered":"2023-12-18T10:21:48.434960+0000","last_unstale":"2023-12-18T10:21:50.834978+0000","last_undegraded":"2023-12-18T10:21:50.834978+0000","last_fullsized":"2023-12-18T10:21:50.834978+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:36.311083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408142+0000","last_change":"2023-12-18T10:21:48.037703+0000","last_active":"2023-12-18T10:21:48.408142+0000","last_peered":"2023-12-18T10:21:48.408142+0000","last_clean":"2023-12-18T10:21:48.408142+0000","last_became_active":"2023-12-18T10:21:48.037416+0000","last_became_peered":"2023-12-18T10:21:48.037416+0000","last_unstale":"2023-12-18T10:21:48.408142+0000","last_undegraded":"2023-12-18T10:21:48.408142+0000","last_fullsized":"2023-12-18T10:21:48.408142+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:28.451928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833504+0000","last_change":"2023-12-18T10:21:48.428917+0000","last_active":"2023-12-18T10:21:50.833504+0000","last_peered":"2023-12-18T10:21:50.833504+0000","last_clean":"2023-12-18T10:21:50.833504+0000","last_became_active":"2023-12-18T10:21:48.428463+0000","last_became_peered":"2023-12-18T10:21:48.428463+0000","last_unstale":"2023-12-18T10:21:50.833504+0000","last_undegraded":"2023-12-18T10:21:50.833504+0000","last_fullsized":"2023-12-18T10:21:50.833504+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:11:42.943877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.419391+0000","last_change":"2023-12-18T10:21:48.041034+0000","last_active":"2023-12-18T10:21:48.419391+0000","last_peered":"2023-12-18T10:21:48.419391+0000","last_clean":"2023-12-18T10:21:48.419391+0000","last_became_active":"2023-12-18T10:21:48.040700+0000","last_became_peered":"2023-12-18T10:21:48.040700+0000","last_unstale":"2023-12-18T10:21:48.419391+0000","last_undegraded":"2023-12-18T10:21:48.419391+0000","last_fullsized":"2023-12-18T10:21:48.419391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:35.509047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834552+0000","last_change":"2023-12-18T10:21:48.417692+0000","last_active":"2023-12-18T10:21:50.834552+0000","last_peered":"2023-12-18T10:21:50.834552+0000","last_clean":"2023-12-18T10:21:50.834552+0000","last_became_active":"2023-12-18T10:21:48.417075+0000","last_became_peered":"2023-12-18T10:21:48.417075+0000","last_unstale":"2023-12-18T10:21:50.834552+0000","last_undegraded":"2023-12-18T10:21:50.834552+0000","last_fullsized":"2023-12-18T10:21:50.834552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:36:39.295713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.437218+0000","last_change":"2023-12-18T10:21:48.047318+0000","last_active":"2023-12-18T10:21:48.437218+0000","last_peered":"2023-12-18T10:21:48.437218+0000","last_clean":"2023-12-18T10:21:48.437218+0000","last_became_active":"2023-12-18T10:21:48.047010+0000","last_became_peered":"2023-12-18T10:21:48.047010+0000","last_unstale":"2023-12-18T10:21:48.437218+0000","last_undegraded":"2023-12-18T10:21:48.437218+0000","last_fullsized":"2023-12-18T10:21:48.437218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833453+0000","last_change":"2023-12-18T10:21:48.435274+0000","last_active":"2023-12-18T10:21:50.833453+0000","last_peered":"2023-12-18T10:21:50.833453+0000","last_clean":"2023-12-18T10:21:50.833453+0000","last_became_active":"2023-12-18T10:21:48.435009+0000","last_became_peered":"2023-12-18T10:21:48.435009+0000","last_unstale":"2023-12-18T10:21:50.833453+0000","last_undegraded":"2023-12-18T10:21:50.833453+0000","last_fullsized":"2023-12-18T10:21:50.833453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:44:00.526234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.421567+0000","last_change":"2023-12-18T10:21:48.046447+0000","last_active":"2023-12-18T10:21:48.421567+0000","last_peered":"2023-12-18T10:21:48.421567+0000","last_clean":"2023-12-18T10:21:48.421567+0000","last_became_active":"2023-12-18T10:21:48.046182+0000","last_became_peered":"2023-12-18T10:21:48.046182+0000","last_unstale":"2023-12-18T10:21:48.421567+0000","last_undegraded":"2023-12-18T10:21:48.421567+0000","last_fullsized":"2023-12-18T10:21:48.421567+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:10.130187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835003+0000","last_change":"2023-12-18T10:21:48.443458+0000","last_active":"2023-12-18T10:21:50.835003+0000","last_peered":"2023-12-18T10:21:50.835003+0000","last_clean":"2023-12-18T10:21:50.835003+0000","last_became_active":"2023-12-18T10:21:48.443214+0000","last_became_peered":"2023-12-18T10:21:48.443214+0000","last_unstale":"2023-12-18T10:21:50.835003+0000","last_undegraded":"2023-12-18T10:21:50.835003+0000","last_fullsized":"2023-12-18T10:21:50.835003+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:18:22.665558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.449882+0000","last_change":"2023-12-18T10:21:48.045279+0000","last_active":"2023-12-18T10:21:48.449882+0000","last_peered":"2023-12-18T10:21:48.449882+0000","last_clean":"2023-12-18T10:21:48.449882+0000","last_became_active":"2023-12-18T10:21:48.044922+0000","last_became_peered":"2023-12-18T10:21:48.044922+0000","last_unstale":"2023-12-18T10:21:48.449882+0000","last_undegraded":"2023-12-18T10:21:48.449882+0000","last_fullsized":"2023-12-18T10:21:48.449882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:31:16.925985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418363+0000","last_change":"2023-12-18T10:21:48.430115+0000","last_active":"2023-12-18T10:21:49.418363+0000","last_peered":"2023-12-18T10:21:49.418363+0000","last_clean":"2023-12-18T10:21:49.418363+0000","last_became_active":"2023-12-18T10:21:48.429743+0000","last_became_peered":"2023-12-18T10:21:48.429743+0000","last_unstale":"2023-12-18T10:21:49.418363+0000","last_undegraded":"2023-12-18T10:21:49.418363+0000","last_fullsized":"2023-12-18T10:21:49.418363+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:29.459496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451861+0000","last_change":"2023-12-18T10:21:48.043037+0000","last_active":"2023-12-18T10:21:48.451861+0000","last_peered":"2023-12-18T10:21:48.451861+0000","last_clean":"2023-12-18T10:21:48.451861+0000","last_became_active":"2023-12-18T10:21:48.042733+0000","last_became_peered":"2023-12-18T10:21:48.042733+0000","last_unstale":"2023-12-18T10:21:48.451861+0000","last_undegraded":"2023-12-18T10:21:48.451861+0000","last_fullsized":"2023-12-18T10:21:48.451861+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417742+0000","last_change":"2023-12-18T10:21:48.423021+0000","last_active":"2023-12-18T10:21:49.417742+0000","last_peered":"2023-12-18T10:21:49.417742+0000","last_clean":"2023-12-18T10:21:49.417742+0000","last_became_active":"2023-12-18T10:21:48.422453+0000","last_became_peered":"2023-12-18T10:21:48.422453+0000","last_unstale":"2023-12-18T10:21:49.417742+0000","last_undegraded":"2023-12-18T10:21:49.417742+0000","last_fullsized":"2023-12-18T10:21:49.417742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.448256+0000","last_change":"2023-12-18T10:21:48.038440+0000","last_active":"2023-12-18T10:21:48.448256+0000","last_peered":"2023-12-18T10:21:48.448256+0000","last_clean":"2023-12-18T10:21:48.448256+0000","last_became_active":"2023-12-18T10:21:48.038157+0000","last_became_peered":"2023-12-18T10:21:48.038157+0000","last_unstale":"2023-12-18T10:21:48.448256+0000","last_undegraded":"2023-12-18T10:21:48.448256+0000","last_fullsized":"2023-12-18T10:21:48.448256+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:32:04.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834217+0000","last_change":"2023-12-18T10:21:48.435170+0000","last_active":"2023-12-18T10:21:50.834217+0000","last_peered":"2023-12-18T10:21:50.834217+0000","last_clean":"2023-12-18T10:21:50.834217+0000","last_became_active":"2023-12-18T10:21:48.434884+0000","last_became_peered":"2023-12-18T10:21:48.434884+0000","last_unstale":"2023-12-18T10:21:50.834217+0000","last_undegraded":"2023-12-18T10:21:50.834217+0000","last_fullsized":"2023-12-18T10:21:50.834217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:03:02.116576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.425836+0000","last_change":"2023-12-18T10:21:48.045035+0000","last_active":"2023-12-18T10:21:48.425836+0000","last_peered":"2023-12-18T10:21:48.425836+0000","last_clean":"2023-12-18T10:21:48.425836+0000","last_became_active":"2023-12-18T10:21:48.044611+0000","last_became_peered":"2023-12-18T10:21:48.044611+0000","last_unstale":"2023-12-18T10:21:48.425836+0000","last_undegraded":"2023-12-18T10:21:48.425836+0000","last_fullsized":"2023-12-18T10:21:48.425836+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834817+0000","last_change":"2023-12-18T10:21:48.437943+0000","last_active":"2023-12-18T10:21:50.834817+0000","last_peered":"2023-12-18T10:21:50.834817+0000","last_clean":"2023-12-18T10:21:50.834817+0000","last_became_active":"2023-12-18T10:21:48.437643+0000","last_became_peered":"2023-12-18T10:21:48.437643+0000","last_unstale":"2023-12-18T10:21:50.834817+0000","last_undegraded":"2023-12-18T10:21:50.834817+0000","last_fullsized":"2023-12-18T10:21:50.834817+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:31:17.933553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.427243+0000","last_change":"2023-12-18T10:21:48.043022+0000","last_active":"2023-12-18T10:21:48.427243+0000","last_peered":"2023-12-18T10:21:48.427243+0000","last_clean":"2023-12-18T10:21:48.427243+0000","last_became_active":"2023-12-18T10:21:48.042699+0000","last_became_peered":"2023-12-18T10:21:48.042699+0000","last_unstale":"2023-12-18T10:21:48.427243+0000","last_undegraded":"2023-12-18T10:21:48.427243+0000","last_fullsized":"2023-12-18T10:21:48.427243+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:13:21.619300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834264+0000","last_change":"2023-12-18T10:21:48.421196+0000","last_active":"2023-12-18T10:21:50.834264+0000","last_peered":"2023-12-18T10:21:50.834264+0000","last_clean":"2023-12-18T10:21:50.834264+0000","last_became_active":"2023-12-18T10:21:48.420884+0000","last_became_peered":"2023-12-18T10:21:48.420884+0000","last_unstale":"2023-12-18T10:21:50.834264+0000","last_undegraded":"2023-12-18T10:21:50.834264+0000","last_fullsized":"2023-12-18T10:21:50.834264+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:28:00.192661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451492+0000","last_change":"2023-12-18T10:21:48.046905+0000","last_active":"2023-12-18T10:21:48.451492+0000","last_peered":"2023-12-18T10:21:48.451492+0000","last_clean":"2023-12-18T10:21:48.451492+0000","last_became_active":"2023-12-18T10:21:48.045846+0000","last_became_peered":"2023-12-18T10:21:48.045846+0000","last_unstale":"2023-12-18T10:21:48.451492+0000","last_undegraded":"2023-12-18T10:21:48.451492+0000","last_fullsized":"2023-12-18T10:21:48.451492+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:11:24.315740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334522+0000","last_change":"2023-12-18T10:21:48.448786+0000","last_active":"2023-12-18T10:21:50.334522+0000","last_peered":"2023-12-18T10:21:50.334522+0000","last_clean":"2023-12-18T10:21:50.334522+0000","last_became_active":"2023-12-18T10:21:48.448323+0000","last_became_peered":"2023-12-18T10:21:48.448323+0000","last_unstale":"2023-12-18T10:21:50.334522+0000","last_undegraded":"2023-12-18T10:21:50.334522+0000","last_fullsized":"2023-12-18T10:21:50.334522+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:27.126391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.441396+0000","last_change":"2023-12-18T10:21:48.046002+0000","last_active":"2023-12-18T10:21:48.441396+0000","last_peered":"2023-12-18T10:21:48.441396+0000","last_clean":"2023-12-18T10:21:48.441396+0000","last_became_active":"2023-12-18T10:21:48.045617+0000","last_became_peered":"2023-12-18T10:21:48.045617+0000","last_unstale":"2023-12-18T10:21:48.441396+0000","last_undegraded":"2023-12-18T10:21:48.441396+0000","last_fullsized":"2023-12-18T10:21:48.441396+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835084+0000","last_change":"2023-12-18T10:21:48.434324+0000","last_active":"2023-12-18T10:21:50.835084+0000","last_peered":"2023-12-18T10:21:50.835084+0000","last_clean":"2023-12-18T10:21:50.835084+0000","last_became_active":"2023-12-18T10:21:48.433856+0000","last_became_peered":"2023-12-18T10:21:48.433856+0000","last_unstale":"2023-12-18T10:21:50.835084+0000","last_undegraded":"2023-12-18T10:21:50.835084+0000","last_fullsized":"2023-12-18T10:21:50.835084+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:32:05.625357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451251+0000","last_change":"2023-12-18T10:21:48.045742+0000","last_active":"2023-12-18T10:21:48.451251+0000","last_peered":"2023-12-18T10:21:48.451251+0000","last_clean":"2023-12-18T10:21:48.451251+0000","last_became_active":"2023-12-18T10:21:48.045437+0000","last_became_peered":"2023-12-18T10:21:48.045437+0000","last_unstale":"2023-12-18T10:21:48.451251+0000","last_undegraded":"2023-12-18T10:21:48.451251+0000","last_fullsized":"2023-12-18T10:21:48.451251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:49.230808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418256+0000","last_change":"2023-12-18T10:21:48.438290+0000","last_active":"2023-12-18T10:21:49.418256+0000","last_peered":"2023-12-18T10:21:49.418256+0000","last_clean":"2023-12-18T10:21:49.418256+0000","last_became_active":"2023-12-18T10:21:48.438025+0000","last_became_peered":"2023-12-18T10:21:48.438025+0000","last_unstale":"2023-12-18T10:21:49.418256+0000","last_undegraded":"2023-12-18T10:21:49.418256+0000","last_fullsized":"2023-12-18T10:21:49.418256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:21:40.051326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.448380+0000","last_change":"2023-12-18T10:21:48.046674+0000","last_active":"2023-12-18T10:21:48.448380+0000","last_peered":"2023-12-18T10:21:48.448380+0000","last_clean":"2023-12-18T10:21:48.448380+0000","last_became_active":"2023-12-18T10:21:48.046323+0000","last_became_peered":"2023-12-18T10:21:48.046323+0000","last_unstale":"2023-12-18T10:21:48.448380+0000","last_undegraded":"2023-12-18T10:21:48.448380+0000","last_fullsized":"2023-12-18T10:21:48.448380+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:16:40.749682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835002+0000","last_change":"2023-12-18T10:21:48.430886+0000","last_active":"2023-12-18T10:21:50.835002+0000","last_peered":"2023-12-18T10:21:50.835002+0000","last_clean":"2023-12-18T10:21:50.835002+0000","last_became_active":"2023-12-18T10:21:48.430425+0000","last_became_peered":"2023-12-18T10:21:48.430425+0000","last_unstale":"2023-12-18T10:21:50.835002+0000","last_undegraded":"2023-12-18T10:21:50.835002+0000","last_fullsized":"2023-12-18T10:21:50.835002+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:55.070518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408535+0000","last_change":"2023-12-18T10:21:48.043422+0000","last_active":"2023-12-18T10:21:48.408535+0000","last_peered":"2023-12-18T10:21:48.408535+0000","last_clean":"2023-12-18T10:21:48.408535+0000","last_became_active":"2023-12-18T10:21:48.043178+0000","last_became_peered":"2023-12-18T10:21:48.043178+0000","last_unstale":"2023-12-18T10:21:48.408535+0000","last_undegraded":"2023-12-18T10:21:48.408535+0000","last_fullsized":"2023-12-18T10:21:48.408535+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:45.292256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833716+0000","last_change":"2023-12-18T10:21:48.428607+0000","last_active":"2023-12-18T10:21:50.833716+0000","last_peered":"2023-12-18T10:21:50.833716+0000","last_clean":"2023-12-18T10:21:50.833716+0000","last_became_active":"2023-12-18T10:21:48.426002+0000","last_became_peered":"2023-12-18T10:21:48.426002+0000","last_unstale":"2023-12-18T10:21:50.833716+0000","last_undegraded":"2023-12-18T10:21:50.833716+0000","last_fullsized":"2023-12-18T10:21:50.833716+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:46.299824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431415+0000","last_change":"2023-12-18T10:21:48.034968+0000","last_active":"2023-12-18T10:21:48.431415+0000","last_peered":"2023-12-18T10:21:48.431415+0000","last_clean":"2023-12-18T10:21:48.431415+0000","last_became_active":"2023-12-18T10:21:48.034724+0000","last_became_peered":"2023-12-18T10:21:48.034724+0000","last_unstale":"2023-12-18T10:21:48.431415+0000","last_undegraded":"2023-12-18T10:21:48.431415+0000","last_fullsized":"2023-12-18T10:21:48.431415+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:32.620503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834367+0000","last_change":"2023-12-18T10:21:48.434770+0000","last_active":"2023-12-18T10:21:50.834367+0000","last_peered":"2023-12-18T10:21:50.834367+0000","last_clean":"2023-12-18T10:21:50.834367+0000","last_became_active":"2023-12-18T10:21:48.434492+0000","last_became_peered":"2023-12-18T10:21:48.434492+0000","last_unstale":"2023-12-18T10:21:50.834367+0000","last_undegraded":"2023-12-18T10:21:50.834367+0000","last_fullsized":"2023-12-18T10:21:50.834367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:24.252919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.425841+0000","last_change":"2023-12-18T10:21:48.046893+0000","last_active":"2023-12-18T10:21:48.425841+0000","last_peered":"2023-12-18T10:21:48.425841+0000","last_clean":"2023-12-18T10:21:48.425841+0000","last_became_active":"2023-12-18T10:21:48.046595+0000","last_became_peered":"2023-12-18T10:21:48.046595+0000","last_unstale":"2023-12-18T10:21:48.425841+0000","last_undegraded":"2023-12-18T10:21:48.425841+0000","last_fullsized":"2023-12-18T10:21:48.425841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834926+0000","last_change":"2023-12-18T10:21:48.435226+0000","last_active":"2023-12-18T10:21:50.834926+0000","last_peered":"2023-12-18T10:21:50.834926+0000","last_clean":"2023-12-18T10:21:50.834926+0000","last_became_active":"2023-12-18T10:21:48.432531+0000","last_became_peered":"2023-12-18T10:21:48.432531+0000","last_unstale":"2023-12-18T10:21:50.834926+0000","last_undegraded":"2023-12-18T10:21:50.834926+0000","last_fullsized":"2023-12-18T10:21:50.834926+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:47.242626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.412604+0000","last_change":"2023-12-18T10:21:48.038232+0000","last_active":"2023-12-18T10:21:48.412604+0000","last_peered":"2023-12-18T10:21:48.412604+0000","last_clean":"2023-12-18T10:21:48.412604+0000","last_became_active":"2023-12-18T10:21:48.037888+0000","last_became_peered":"2023-12-18T10:21:48.037888+0000","last_unstale":"2023-12-18T10:21:48.412604+0000","last_undegraded":"2023-12-18T10:21:48.412604+0000","last_fullsized":"2023-12-18T10:21:48.412604+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:10.710378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834214+0000","last_change":"2023-12-18T10:21:48.428405+0000","last_active":"2023-12-18T10:21:50.834214+0000","last_peered":"2023-12-18T10:21:50.834214+0000","last_clean":"2023-12-18T10:21:50.834214+0000","last_became_active":"2023-12-18T10:21:48.428116+0000","last_became_peered":"2023-12-18T10:21:48.428116+0000","last_unstale":"2023-12-18T10:21:50.834214+0000","last_undegraded":"2023-12-18T10:21:50.834214+0000","last_fullsized":"2023-12-18T10:21:50.834214+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:15:06.452111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.449466+0000","last_change":"2023-12-18T10:21:48.048899+0000","last_active":"2023-12-18T10:21:48.449466+0000","last_peered":"2023-12-18T10:21:48.449466+0000","last_clean":"2023-12-18T10:21:48.449466+0000","last_became_active":"2023-12-18T10:21:48.048619+0000","last_became_peered":"2023-12-18T10:21:48.048619+0000","last_unstale":"2023-12-18T10:21:48.449466+0000","last_undegraded":"2023-12-18T10:21:48.449466+0000","last_fullsized":"2023-12-18T10:21:48.449466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417350+0000","last_change":"2023-12-18T10:21:48.423355+0000","last_active":"2023-12-18T10:21:49.417350+0000","last_peered":"2023-12-18T10:21:49.417350+0000","last_clean":"2023-12-18T10:21:49.417350+0000","last_became_active":"2023-12-18T10:21:48.423114+0000","last_became_peered":"2023-12-18T10:21:48.423114+0000","last_unstale":"2023-12-18T10:21:49.417350+0000","last_undegraded":"2023-12-18T10:21:49.417350+0000","last_fullsized":"2023-12-18T10:21:49.417350+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:10:33.318309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.427923+0000","last_change":"2023-12-18T10:21:48.045907+0000","last_active":"2023-12-18T10:21:48.427923+0000","last_peered":"2023-12-18T10:21:48.427923+0000","last_clean":"2023-12-18T10:21:48.427923+0000","last_became_active":"2023-12-18T10:21:48.044701+0000","last_became_peered":"2023-12-18T10:21:48.044701+0000","last_unstale":"2023-12-18T10:21:48.427923+0000","last_undegraded":"2023-12-18T10:21:48.427923+0000","last_fullsized":"2023-12-18T10:21:48.427923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834501+0000","last_change":"2023-12-18T10:21:48.434656+0000","last_active":"2023-12-18T10:21:50.834501+0000","last_peered":"2023-12-18T10:21:50.834501+0000","last_clean":"2023-12-18T10:21:50.834501+0000","last_became_active":"2023-12-18T10:21:48.434335+0000","last_became_peered":"2023-12-18T10:21:48.434335+0000","last_unstale":"2023-12-18T10:21:50.834501+0000","last_undegraded":"2023-12-18T10:21:50.834501+0000","last_fullsized":"2023-12-18T10:21:50.834501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:27.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.412901+0000","last_change":"2023-12-18T10:21:48.044683+0000","last_active":"2023-12-18T10:21:48.412901+0000","last_peered":"2023-12-18T10:21:48.412901+0000","last_clean":"2023-12-18T10:21:48.412901+0000","last_became_active":"2023-12-18T10:21:48.044361+0000","last_became_peered":"2023-12-18T10:21:48.044361+0000","last_unstale":"2023-12-18T10:21:48.412901+0000","last_undegraded":"2023-12-18T10:21:48.412901+0000","last_fullsized":"2023-12-18T10:21:48.412901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:41.290961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835132+0000","last_change":"2023-12-18T10:21:48.430694+0000","last_active":"2023-12-18T10:21:50.835132+0000","last_peered":"2023-12-18T10:21:50.835132+0000","last_clean":"2023-12-18T10:21:50.835132+0000","last_became_active":"2023-12-18T10:21:48.430091+0000","last_became_peered":"2023-12-18T10:21:48.430091+0000","last_unstale":"2023-12-18T10:21:50.835132+0000","last_undegraded":"2023-12-18T10:21:50.835132+0000","last_fullsized":"2023-12-18T10:21:50.835132+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:02.335252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.409410+0000","last_change":"2023-12-18T10:21:48.043141+0000","last_active":"2023-12-18T10:21:48.409410+0000","last_peered":"2023-12-18T10:21:48.409410+0000","last_clean":"2023-12-18T10:21:48.409410+0000","last_became_active":"2023-12-18T10:21:48.042748+0000","last_became_peered":"2023-12-18T10:21:48.042748+0000","last_unstale":"2023-12-18T10:21:48.409410+0000","last_undegraded":"2023-12-18T10:21:48.409410+0000","last_fullsized":"2023-12-18T10:21:48.409410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834355+0000","last_change":"2023-12-18T10:21:48.435771+0000","last_active":"2023-12-18T10:21:50.834355+0000","last_peered":"2023-12-18T10:21:50.834355+0000","last_clean":"2023-12-18T10:21:50.834355+0000","last_became_active":"2023-12-18T10:21:48.430821+0000","last_became_peered":"2023-12-18T10:21:48.430821+0000","last_unstale":"2023-12-18T10:21:50.834355+0000","last_undegraded":"2023-12-18T10:21:50.834355+0000","last_fullsized":"2023-12-18T10:21:50.834355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:49:03.414174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431877+0000","last_change":"2023-12-18T10:21:48.041087+0000","last_active":"2023-12-18T10:21:48.431877+0000","last_peered":"2023-12-18T10:21:48.431877+0000","last_clean":"2023-12-18T10:21:48.431877+0000","last_became_active":"2023-12-18T10:21:48.040651+0000","last_became_peered":"2023-12-18T10:21:48.040651+0000","last_unstale":"2023-12-18T10:21:48.431877+0000","last_undegraded":"2023-12-18T10:21:48.431877+0000","last_fullsized":"2023-12-18T10:21:48.431877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:53:18.623750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417828+0000","last_change":"2023-12-18T10:21:48.442730+0000","last_active":"2023-12-18T10:21:49.417828+0000","last_peered":"2023-12-18T10:21:49.417828+0000","last_clean":"2023-12-18T10:21:49.417828+0000","last_became_active":"2023-12-18T10:21:48.442437+0000","last_became_peered":"2023-12-18T10:21:48.442437+0000","last_unstale":"2023-12-18T10:21:49.417828+0000","last_undegraded":"2023-12-18T10:21:49.417828+0000","last_fullsized":"2023-12-18T10:21:49.417828+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408017+0000","last_change":"2023-12-18T10:21:48.034202+0000","last_active":"2023-12-18T10:21:48.408017+0000","last_peered":"2023-12-18T10:21:48.408017+0000","last_clean":"2023-12-18T10:21:48.408017+0000","last_became_active":"2023-12-18T10:21:48.033929+0000","last_became_peered":"2023-12-18T10:21:48.033929+0000","last_unstale":"2023-12-18T10:21:48.408017+0000","last_undegraded":"2023-12-18T10:21:48.408017+0000","last_fullsized":"2023-12-18T10:21:48.408017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:30.962732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833902+0000","last_change":"2023-12-18T10:21:48.431174+0000","last_active":"2023-12-18T10:21:50.833902+0000","last_peered":"2023-12-18T10:21:50.833902+0000","last_clean":"2023-12-18T10:21:50.833902+0000","last_became_active":"2023-12-18T10:21:48.430895+0000","last_became_peered":"2023-12-18T10:21:48.430895+0000","last_unstale":"2023-12-18T10:21:50.833902+0000","last_undegraded":"2023-12-18T10:21:50.833902+0000","last_fullsized":"2023-12-18T10:21:50.833902+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:03:02.116576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408175+0000","last_change":"2023-12-18T10:21:48.035689+0000","last_active":"2023-12-18T10:21:48.408175+0000","last_peered":"2023-12-18T10:21:48.408175+0000","last_clean":"2023-12-18T10:21:48.408175+0000","last_became_active":"2023-12-18T10:21:48.035442+0000","last_became_peered":"2023-12-18T10:21:48.035442+0000","last_unstale":"2023-12-18T10:21:48.408175+0000","last_undegraded":"2023-12-18T10:21:48.408175+0000","last_fullsized":"2023-12-18T10:21:48.408175+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:26.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417176+0000","last_change":"2023-12-18T10:21:48.440493+0000","last_active":"2023-12-18T10:21:49.417176+0000","last_peered":"2023-12-18T10:21:49.417176+0000","last_clean":"2023-12-18T10:21:49.417176+0000","last_became_active":"2023-12-18T10:21:48.440216+0000","last_became_peered":"2023-12-18T10:21:48.440216+0000","last_unstale":"2023-12-18T10:21:49.417176+0000","last_undegraded":"2023-12-18T10:21:49.417176+0000","last_fullsized":"2023-12-18T10:21:49.417176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:11:34.360183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408006+0000","last_change":"2023-12-18T10:21:48.031460+0000","last_active":"2023-12-18T10:21:48.408006+0000","last_peered":"2023-12-18T10:21:48.408006+0000","last_clean":"2023-12-18T10:21:48.408006+0000","last_became_active":"2023-12-18T10:21:48.031176+0000","last_became_peered":"2023-12-18T10:21:48.031176+0000","last_unstale":"2023-12-18T10:21:48.408006+0000","last_undegraded":"2023-12-18T10:21:48.408006+0000","last_fullsized":"2023-12-18T10:21:48.408006+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835038+0000","last_change":"2023-12-18T10:21:48.428634+0000","last_active":"2023-12-18T10:21:50.835038+0000","last_peered":"2023-12-18T10:21:50.835038+0000","last_clean":"2023-12-18T10:21:50.835038+0000","last_became_active":"2023-12-18T10:21:48.427691+0000","last_became_peered":"2023-12-18T10:21:48.427691+0000","last_unstale":"2023-12-18T10:21:50.835038+0000","last_undegraded":"2023-12-18T10:21:50.835038+0000","last_fullsized":"2023-12-18T10:21:50.835038+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:17.022691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.407740+0000","last_change":"2023-12-18T10:21:48.041269+0000","last_active":"2023-12-18T10:21:48.407740+0000","last_peered":"2023-12-18T10:21:48.407740+0000","last_clean":"2023-12-18T10:21:48.407740+0000","last_became_active":"2023-12-18T10:21:48.040986+0000","last_became_peered":"2023-12-18T10:21:48.040986+0000","last_unstale":"2023-12-18T10:21:48.407740+0000","last_undegraded":"2023-12-18T10:21:48.407740+0000","last_fullsized":"2023-12-18T10:21:48.407740+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:35.516738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.418725+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:21:48.418725+0000","last_peered":"2023-12-18T10:21:48.418725+0000","last_clean":"2023-12-18T10:21:48.418725+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:21:48.418725+0000","last_undegraded":"2023-12-18T10:21:48.418725+0000","last_fullsized":"2023-12-18T10:21:48.418725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1396736,"data_stored":945613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.88400000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.442,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.83399999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.379},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41299999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.751}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":354503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79400000000000004,"15min":0.85999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77800000000000002,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84599999999999997,"15min":0.90700000000000003},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91300000000000003,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.47999999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.76800000000000002,"5min":1.845,"15min":1.845},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.82499999999999996,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":4.524,"15min":4.524},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83599999999999997,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96199999999999997,"5min":1.925,"15min":1.925},"last":0.60699999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.81899999999999995,"15min":0.84799999999999998},"min":{"1min":0.65400000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0489999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.85499999999999998,"15min":0.91300000000000003},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85299999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.622}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0049999999999999,"5min":1.101,"15min":1.101},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63800000000000001,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78100000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.441},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":1.284,"15min":1.284},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0880000000000001,"5min":1.129,"15min":1.129},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":354491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.67500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.45300000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0249999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.501}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.76900000000000002},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92500000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.751,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.623},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.81299999999999994},"min":{"1min":0.501,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.879,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.52800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91100000000000003,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.84199999999999997},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.90000000000000002,"15min":1.01},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.755}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73799999999999999,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89400000000000002,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.76600000000000001,"15min":0.81299999999999994},"min":{"1min":0.47099999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96199999999999997,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.042,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84199999999999997},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0669999999999999,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":798720,"data_stored":356033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.67400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88700000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.131,"15min":1.131},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":1.032,"15min":1.032},"last":0.71599999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.999,"15min":0.999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.57399999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84099999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.874,"15min":0.874},"last":0.51000000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77400000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79900000000000004,"5min":1.073,"15min":1.073},"last":0.746}]},{"osd":7,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.878,"5min":1.042,"15min":1.042},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.42899999999999999},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.49099999999999999,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69299999999999995,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63800000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.58899999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74099999999999999,"5min":1.254,"15min":1.254},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.66900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83899999999999997,"5min":1.772,"15min":1.772},"last":0.497}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85899999999999999,"5min":1.01,"15min":1.01},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0669999999999999,"5min":1.181,"15min":1.181},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0129999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.53200000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.871,"5min":1.069,"15min":1.069},"last":0.70699999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.036,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92000000000000004,"5min":1.127,"15min":1.127},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97699999999999998,"5min":1.139,"15min":1.139},"last":0.71599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.432,"15min":0.442},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.497}]},{"osd":3,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63500000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78500000000000003,"15min":0.80900000000000005},"min":{"1min":0.56799999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0469999999999999,"5min":1.698,"15min":1.698},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0820000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95999999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.085,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0680000000000001,"5min":1.341,"15min":1.341},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0900000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.048,"5min":1.282,"15min":1.282},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.093,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":815104,"data_stored":356797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.56599999999999995,"15min":0.624},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64400000000000002,"5min":3.976,"15min":3.976},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.503,"15min":0.52300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60499999999999998,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.61599999999999999,"15min":0.66200000000000003},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71399999999999997,"5min":3.786,"15min":3.786},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78600000000000003,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.63300000000000001,"15min":0.68200000000000005},"min":{"1min":0.39600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83099999999999996,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1399999999999999,"5min":1.851,"15min":1.851},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.878,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99199999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.52900000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.872,"15min":0.92400000000000004},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.0960000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.58699999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0169999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.89400000000000002,"15min":0.95799999999999996},"min":{"1min":0.56000000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0880000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0529999999999999,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81499999999999995,"15min":0.83899999999999997},"min":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0649999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":944837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.96899999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92900000000000005,"5min":1.456,"15min":1.456},"last":0.53800000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55800000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0589999999999999,"5min":1.595,"15min":1.595},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.55600000000000005,"15min":0.59999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":2.464,"15min":2.464},"last":0.5}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73699999999999999,"5min":1.859,"15min":1.859},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90000000000000002,"5min":1.903,"15min":1.903},"last":0.60099999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.58699999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3240000000000001,"5min":1.494,"15min":1.494},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.54700000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.53700000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.034,"5min":1.544,"15min":1.544},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.278,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.53,"15min":1.53},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.55900000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.349,"5min":1.556,"15min":1.556},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.032,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.80800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:21:56.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:21:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.123+0000 7f4fcc612640 1 Processor -- start 2023-12-18T10:21:57.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.123+0000 7f4fcc612640 1 -- start start 2023-12-18T10:21:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcc612640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4fc4158c20 0x7f4fc4070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcc612640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc4070b80 con 0x7f4fc415c800 2023-12-18T10:21:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcc612640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc4070e60 con 0x7f4fc40cb180 2023-12-18T10:21:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcc612640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc4071140 con 0x7f4fc4158c20 2023-12-18T10:21:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc9bad640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4fc415c800 0x7f4fc40caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54122/0 (socket says 172.21.15.133:54122) 2023-12-18T10:21:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc9bad640 1 -- 172.21.15.133:0/566072355 learned_addr learned my addr 172.21.15.133:0/566072355 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fca3ae640 1 --2- 172.21.15.133:0/566072355 >> v2:172.21.15.142:3300/0 conn(0x7f4fc4158c20 0x7f4fc4070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438175384 0 0) 0x7f4fc4070b80 con 0x7f4fc415c800 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb0003530 con 0x7f4fc415c800 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979842458 0 0) 0x7f4fc4070e60 con 0x7f4fc40cb180 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc4070b80 con 0x7f4fc40cb180 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658337581 0 0) 0x7f4fb0003530 con 0x7f4fc415c800 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 >> v2:172.21.15.142:3300/0 conn(0x7f4fc4158c20 msgr2=0x7f4fc4070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 --2- 172.21.15.133:0/566072355 >> v2:172.21.15.142:3300/0 conn(0x7f4fc4158c20 0x7f4fc4070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 >> v1:172.21.15.142:6789/0 conn(0x7f4fc40cb180 legacy=0x7f4fc40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4071420 con 0x7f4fc415c800 2023-12-18T10:21:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f4fb4001680 con 0x7f4fc415c800 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 >> v1:172.21.15.133:6789/0 conn(0x7f4fc415c800 legacy=0x7f4fc40caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fb0003b10 0x7f4fb0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb00047d0 0x7f4fb0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb0005190 0x7f4fb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4071140 con 0x7f4fb0005190 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb000e2d0 con 0x7f4fb0003b10 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb000c090 con 0x7f4fb00047d0 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcabaf640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb0005190 0x7f4fb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fca3ae640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fb0003b10 0x7f4fb0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fc9bad640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb00047d0 0x7f4fb0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcabaf640 1 -- 172.21.15.133:0/566072355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb00047d0 msgr2=0x7f4fb0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcabaf640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb00047d0 0x7f4fb0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcabaf640 1 -- 172.21.15.133:0/566072355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fb0003b10 msgr2=0x7f4fb0003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcabaf640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fb0003b10 0x7f4fb0003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.127+0000 7f4fcabaf640 1 -- 172.21.15.133:0/566072355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0003530 con 0x7f4fb0005190 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcabaf640 1 -- 172.21.15.133:0/566072355 reap_dead start 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcabaf640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb0005190 0x7f4fb000b990 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc001fd0 tx=0x7f4fbc01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4db06873baab4e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0a8c70 con 0x7f4fb0005190 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc0a8dd0 con 0x7f4fb0005190 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fc93ac640 1 -- 172.21.15.133:0/566072355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc003bc0 con 0x7f4fb0005190 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcc612640 1 -- 172.21.15.133:0/566072355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb0005190 msgr2=0x7f4fb000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcc612640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb0005190 0x7f4fb000b990 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc001fd0 tx=0x7f4fbc01f050 comp rx=0 tx=0).stop 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcc612640 1 -- 172.21.15.133:0/566072355 shutdown_connections 2023-12-18T10:21:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcc612640 1 --2- 172.21.15.133:0/566072355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fb0005190 0x7f4fb000b990 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcc612640 1 -- 172.21.15.133:0/566072355 >> 172.21.15.133:0/566072355 conn(0x7f4fc406a3e0 msgr2=0x7f4fc40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:57.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcc612640 1 -- 172.21.15.133:0/566072355 shutdown_connections 2023-12-18T10:21:57.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.131+0000 7f4fcc612640 1 -- 172.21.15.133:0/566072355 wait complete. 2023-12-18T10:21:57.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 Processor -- start 2023-12-18T10:21:57.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 -- start start 2023-12-18T10:21:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb0005190 0x7f4fc4159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc4142560 0x7f4fc41501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fc4150720 0x7f4fc4150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc41596c0 con 0x7f4fc4150720 2023-12-18T10:21:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4151b70 con 0x7f4fc4142560 2023-12-18T10:21:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4140770 con 0x7f4fb0005190 2023-12-18T10:21:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fc4150720 0x7f4fc4150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fc4150720 0x7f4fc4150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59690/0 (socket says 172.21.15.133:59690) 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 -- 172.21.15.133:0/1185727333 learned_addr learned my addr 172.21.15.133:0/1185727333 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fca3ae640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb0005190 0x7f4fc4159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fc9bad640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc4142560 0x7f4fc41501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 -- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb0005190 msgr2=0x7f4fc4159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb0005190 0x7f4fc4159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 -- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc4142560 msgr2=0x7f4fc41501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc4142560 0x7f4fc41501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 -- 172.21.15.133:0/1185727333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4142fa0 con 0x7f4fc4150720 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fc9bad640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc4142560 0x7f4fc41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcabaf640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fc4150720 0x7f4fc4150ba0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc01f8f0 tx=0x7f4fb0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fbaffd640 1 -- 172.21.15.133:0/1185727333 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0b5070 con 0x7f4fc4150720 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fbaffd640 1 -- 172.21.15.133:0/1185727333 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc0a8a70 con 0x7f4fc4150720 2023-12-18T10:21:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc4140160 con 0x7f4fc4150720 2023-12-18T10:21:57.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fbaffd640 1 -- 172.21.15.133:0/1185727333 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc003b80 con 0x7f4fc4150720 2023-12-18T10:21:57.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc415bf90 con 0x7f4fc4150720 2023-12-18T10:21:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.135+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc40735b0 con 0x7f4fc4150720 2023-12-18T10:21:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.139+0000 7f4fbaffd640 1 -- 172.21.15.133:0/1185727333 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4fbc003ce0 con 0x7f4fc4150720 2023-12-18T10:21:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.139+0000 7f4fbaffd640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fa8065a90 0x7f4fa8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.139+0000 7f4fbaffd640 1 -- 172.21.15.133:0/1185727333 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4fbc11fa20 con 0x7f4fc4150720 2023-12-18T10:21:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.139+0000 7f4fca3ae640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fa8065a90 0x7f4fa8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.139+0000 7f4fca3ae640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fa8065a90 0x7f4fa8067f50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009b60 tx=0x7f4fc0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.143+0000 7f4fbaffd640 1 -- 172.21.15.133:0/1185727333 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4fbc0ed200 con 0x7f4fc4150720 2023-12-18T10:21:57.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.291+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fc4159000 con 0x7f4fa8065a90 2023-12-18T10:21:57.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.299+0000 7f4fbaffd640 1 -- 172.21.15.133:0/1185727333 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289451 (secure 0 0 0) 0x7f4fc0019070 con 0x7f4fa8065a90 2023-12-18T10:21:57.307 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:57.308 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fa8065a90 msgr2=0x7f4fa8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fa8065a90 0x7f4fa8067f50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009b60 tx=0x7f4fc0009190 comp rx=0 tx=0).stop 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fc4150720 msgr2=0x7f4fc4150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fc4150720 0x7f4fc4150ba0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc01f8f0 tx=0x7f4fb0005800 comp rx=0 tx=0).stop 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 shutdown_connections 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fa8065a90 0x7f4fa8067f50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fc4150720 0x7f4fc4150ba0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fc4142560 0x7f4fc41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 --2- 172.21.15.133:0/1185727333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4fb0005190 0x7f4fc4159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 >> 172.21.15.133:0/1185727333 conn(0x7f4fc406a3e0 msgr2=0x7f4fc40ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 shutdown_connections 2023-12-18T10:21:57.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.303+0000 7f4fcc612640 1 -- 172.21.15.133:0/1185727333 wait complete. 2023-12-18T10:21:57.327 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2023-12-18T10:21:57.143341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239368,"kb_used_data":7368,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754735352,"statfs":{"total":773094113280,"available":772849000448,"internally_reserved":0,"allocated":7544832,"data_stored":4021212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":50,"apply_latency_ms":50,"commit_latency_ns":50000000,"apply_latency_ns":50000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.737289"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834579+0000","last_change":"2023-12-18T10:21:48.434897+0000","last_active":"2023-12-18T10:21:50.834579+0000","last_peered":"2023-12-18T10:21:50.834579+0000","last_clean":"2023-12-18T10:21:50.834579+0000","last_became_active":"2023-12-18T10:21:48.434578+0000","last_became_peered":"2023-12-18T10:21:48.434578+0000","last_unstale":"2023-12-18T10:21:50.834579+0000","last_undegraded":"2023-12-18T10:21:50.834579+0000","last_fullsized":"2023-12-18T10:21:50.834579+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:10:43.067633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833981+0000","last_change":"2023-12-18T10:21:48.417639+0000","last_active":"2023-12-18T10:21:50.833981+0000","last_peered":"2023-12-18T10:21:50.833981+0000","last_clean":"2023-12-18T10:21:50.833981+0000","last_became_active":"2023-12-18T10:21:48.416863+0000","last_became_peered":"2023-12-18T10:21:48.416863+0000","last_unstale":"2023-12-18T10:21:50.833981+0000","last_undegraded":"2023-12-18T10:21:50.833981+0000","last_fullsized":"2023-12-18T10:21:50.833981+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:11:25.323308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334380+0000","last_change":"2023-12-18T10:21:48.448550+0000","last_active":"2023-12-18T10:21:50.334380+0000","last_peered":"2023-12-18T10:21:50.334380+0000","last_clean":"2023-12-18T10:21:50.334380+0000","last_became_active":"2023-12-18T10:21:48.448146+0000","last_became_peered":"2023-12-18T10:21:48.448146+0000","last_unstale":"2023-12-18T10:21:50.334380+0000","last_undegraded":"2023-12-18T10:21:50.334380+0000","last_fullsized":"2023-12-18T10:21:50.334380+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:27:02.953358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418050+0000","last_change":"2023-12-18T10:21:48.440593+0000","last_active":"2023-12-18T10:21:49.418050+0000","last_peered":"2023-12-18T10:21:49.418050+0000","last_clean":"2023-12-18T10:21:49.418050+0000","last_became_active":"2023-12-18T10:21:48.433754+0000","last_became_peered":"2023-12-18T10:21:48.433754+0000","last_unstale":"2023-12-18T10:21:49.418050+0000","last_undegraded":"2023-12-18T10:21:49.418050+0000","last_fullsized":"2023-12-18T10:21:49.418050+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:46.299824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834941+0000","last_change":"2023-12-18T10:21:48.431578+0000","last_active":"2023-12-18T10:21:50.834941+0000","last_peered":"2023-12-18T10:21:50.834941+0000","last_clean":"2023-12-18T10:21:50.834941+0000","last_became_active":"2023-12-18T10:21:48.431304+0000","last_became_peered":"2023-12-18T10:21:48.431304+0000","last_unstale":"2023-12-18T10:21:50.834941+0000","last_undegraded":"2023-12-18T10:21:50.834941+0000","last_fullsized":"2023-12-18T10:21:50.834941+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:50.238376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834276+0000","last_change":"2023-12-18T10:21:48.419957+0000","last_active":"2023-12-18T10:21:50.834276+0000","last_peered":"2023-12-18T10:21:50.834276+0000","last_clean":"2023-12-18T10:21:50.834276+0000","last_became_active":"2023-12-18T10:21:48.419672+0000","last_became_peered":"2023-12-18T10:21:48.419672+0000","last_unstale":"2023-12-18T10:21:50.834276+0000","last_undegraded":"2023-12-18T10:21:50.834276+0000","last_fullsized":"2023-12-18T10:21:50.834276+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:50.091555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417128+0000","last_change":"2023-12-18T10:21:48.441330+0000","last_active":"2023-12-18T10:21:49.417128+0000","last_peered":"2023-12-18T10:21:49.417128+0000","last_clean":"2023-12-18T10:21:49.417128+0000","last_became_active":"2023-12-18T10:21:48.441030+0000","last_became_peered":"2023-12-18T10:21:48.441030+0000","last_unstale":"2023-12-18T10:21:49.417128+0000","last_undegraded":"2023-12-18T10:21:49.417128+0000","last_fullsized":"2023-12-18T10:21:49.417128+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:49:55.833641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834217+0000","last_change":"2023-12-18T10:21:48.446465+0000","last_active":"2023-12-18T10:21:50.834217+0000","last_peered":"2023-12-18T10:21:50.834217+0000","last_clean":"2023-12-18T10:21:50.834217+0000","last_became_active":"2023-12-18T10:21:48.446183+0000","last_became_peered":"2023-12-18T10:21:48.446183+0000","last_unstale":"2023-12-18T10:21:50.834217+0000","last_undegraded":"2023-12-18T10:21:50.834217+0000","last_fullsized":"2023-12-18T10:21:50.834217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334712+0000","last_change":"2023-12-18T10:21:48.450885+0000","last_active":"2023-12-18T10:21:50.334712+0000","last_peered":"2023-12-18T10:21:50.334712+0000","last_clean":"2023-12-18T10:21:50.334712+0000","last_became_active":"2023-12-18T10:21:48.450262+0000","last_became_peered":"2023-12-18T10:21:48.450262+0000","last_unstale":"2023-12-18T10:21:50.334712+0000","last_undegraded":"2023-12-18T10:21:50.334712+0000","last_fullsized":"2023-12-18T10:21:50.334712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:57.360980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334585+0000","last_change":"2023-12-18T10:21:48.451228+0000","last_active":"2023-12-18T10:21:50.334585+0000","last_peered":"2023-12-18T10:21:50.334585+0000","last_clean":"2023-12-18T10:21:50.334585+0000","last_became_active":"2023-12-18T10:21:48.450909+0000","last_became_peered":"2023-12-18T10:21:48.450909+0000","last_unstale":"2023-12-18T10:21:50.334585+0000","last_undegraded":"2023-12-18T10:21:50.334585+0000","last_fullsized":"2023-12-18T10:21:50.334585+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418015+0000","last_change":"2023-12-18T10:21:48.429822+0000","last_active":"2023-12-18T10:21:49.418015+0000","last_peered":"2023-12-18T10:21:49.418015+0000","last_clean":"2023-12-18T10:21:49.418015+0000","last_became_active":"2023-12-18T10:21:48.429488+0000","last_became_peered":"2023-12-18T10:21:48.429488+0000","last_unstale":"2023-12-18T10:21:49.418015+0000","last_undegraded":"2023-12-18T10:21:49.418015+0000","last_fullsized":"2023-12-18T10:21:49.418015+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:50:15.431746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834357+0000","last_change":"2023-12-18T10:21:48.445659+0000","last_active":"2023-12-18T10:21:50.834357+0000","last_peered":"2023-12-18T10:21:50.834357+0000","last_clean":"2023-12-18T10:21:50.834357+0000","last_became_active":"2023-12-18T10:21:48.445384+0000","last_became_peered":"2023-12-18T10:21:48.445384+0000","last_unstale":"2023-12-18T10:21:50.834357+0000","last_undegraded":"2023-12-18T10:21:50.834357+0000","last_fullsized":"2023-12-18T10:21:50.834357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834366+0000","last_change":"2023-12-18T10:21:48.436781+0000","last_active":"2023-12-18T10:21:50.834366+0000","last_peered":"2023-12-18T10:21:50.834366+0000","last_clean":"2023-12-18T10:21:50.834366+0000","last_became_active":"2023-12-18T10:21:48.436525+0000","last_became_peered":"2023-12-18T10:21:48.436525+0000","last_unstale":"2023-12-18T10:21:50.834366+0000","last_undegraded":"2023-12-18T10:21:50.834366+0000","last_fullsized":"2023-12-18T10:21:50.834366+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:11.717946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334403+0000","last_change":"2023-12-18T10:21:48.446331+0000","last_active":"2023-12-18T10:21:50.334403+0000","last_peered":"2023-12-18T10:21:50.334403+0000","last_clean":"2023-12-18T10:21:50.334403+0000","last_became_active":"2023-12-18T10:21:48.445998+0000","last_became_peered":"2023-12-18T10:21:48.445998+0000","last_unstale":"2023-12-18T10:21:50.334403+0000","last_undegraded":"2023-12-18T10:21:50.334403+0000","last_fullsized":"2023-12-18T10:21:50.334403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:23:30.222618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334241+0000","last_change":"2023-12-18T10:21:48.445026+0000","last_active":"2023-12-18T10:21:50.334241+0000","last_peered":"2023-12-18T10:21:50.334241+0000","last_clean":"2023-12-18T10:21:50.334241+0000","last_became_active":"2023-12-18T10:21:48.444765+0000","last_became_peered":"2023-12-18T10:21:48.444765+0000","last_unstale":"2023-12-18T10:21:50.334241+0000","last_undegraded":"2023-12-18T10:21:50.334241+0000","last_fullsized":"2023-12-18T10:21:50.334241+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417038+0000","last_change":"2023-12-18T10:21:48.442006+0000","last_active":"2023-12-18T10:21:49.417038+0000","last_peered":"2023-12-18T10:21:49.417038+0000","last_clean":"2023-12-18T10:21:49.417038+0000","last_became_active":"2023-12-18T10:21:48.441738+0000","last_became_peered":"2023-12-18T10:21:48.441738+0000","last_unstale":"2023-12-18T10:21:49.417038+0000","last_undegraded":"2023-12-18T10:21:49.417038+0000","last_fullsized":"2023-12-18T10:21:49.417038+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:01:20.902657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834607+0000","last_change":"2023-12-18T10:21:48.431569+0000","last_active":"2023-12-18T10:21:50.834607+0000","last_peered":"2023-12-18T10:21:50.834607+0000","last_clean":"2023-12-18T10:21:50.834607+0000","last_became_active":"2023-12-18T10:21:48.431326+0000","last_became_peered":"2023-12-18T10:21:48.431326+0000","last_unstale":"2023-12-18T10:21:50.834607+0000","last_undegraded":"2023-12-18T10:21:50.834607+0000","last_fullsized":"2023-12-18T10:21:50.834607+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:27.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418156+0000","last_change":"2023-12-18T10:21:48.433208+0000","last_active":"2023-12-18T10:21:49.418156+0000","last_peered":"2023-12-18T10:21:49.418156+0000","last_clean":"2023-12-18T10:21:49.418156+0000","last_became_active":"2023-12-18T10:21:48.432941+0000","last_became_peered":"2023-12-18T10:21:48.432941+0000","last_unstale":"2023-12-18T10:21:49.418156+0000","last_undegraded":"2023-12-18T10:21:49.418156+0000","last_fullsized":"2023-12-18T10:21:49.418156+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:36.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834992+0000","last_change":"2023-12-18T10:21:48.434145+0000","last_active":"2023-12-18T10:21:50.834992+0000","last_peered":"2023-12-18T10:21:50.834992+0000","last_clean":"2023-12-18T10:21:50.834992+0000","last_became_active":"2023-12-18T10:21:48.433505+0000","last_became_peered":"2023-12-18T10:21:48.433505+0000","last_unstale":"2023-12-18T10:21:50.834992+0000","last_undegraded":"2023-12-18T10:21:50.834992+0000","last_fullsized":"2023-12-18T10:21:50.834992+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:16:41.757250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833619+0000","last_change":"2023-12-18T10:21:48.424288+0000","last_active":"2023-12-18T10:21:50.833619+0000","last_peered":"2023-12-18T10:21:50.833619+0000","last_clean":"2023-12-18T10:21:50.833619+0000","last_became_active":"2023-12-18T10:21:48.424033+0000","last_became_peered":"2023-12-18T10:21:48.424033+0000","last_unstale":"2023-12-18T10:21:50.833619+0000","last_undegraded":"2023-12-18T10:21:50.833619+0000","last_fullsized":"2023-12-18T10:21:50.833619+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:05:30.756965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834479+0000","last_change":"2023-12-18T10:21:48.439646+0000","last_active":"2023-12-18T10:21:50.834479+0000","last_peered":"2023-12-18T10:21:50.834479+0000","last_clean":"2023-12-18T10:21:50.834479+0000","last_became_active":"2023-12-18T10:21:48.431449+0000","last_became_peered":"2023-12-18T10:21:48.431449+0000","last_unstale":"2023-12-18T10:21:50.834479+0000","last_undegraded":"2023-12-18T10:21:50.834479+0000","last_fullsized":"2023-12-18T10:21:50.834479+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:11.137755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833553+0000","last_change":"2023-12-18T10:21:48.425153+0000","last_active":"2023-12-18T10:21:50.833553+0000","last_peered":"2023-12-18T10:21:50.833553+0000","last_clean":"2023-12-18T10:21:50.833553+0000","last_became_active":"2023-12-18T10:21:48.424891+0000","last_became_peered":"2023-12-18T10:21:48.424891+0000","last_unstale":"2023-12-18T10:21:50.833553+0000","last_undegraded":"2023-12-18T10:21:50.833553+0000","last_fullsized":"2023-12-18T10:21:50.833553+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:05.464349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833390+0000","last_change":"2023-12-18T10:21:48.426896+0000","last_active":"2023-12-18T10:21:50.833390+0000","last_peered":"2023-12-18T10:21:50.833390+0000","last_clean":"2023-12-18T10:21:50.833390+0000","last_became_active":"2023-12-18T10:21:48.426318+0000","last_became_peered":"2023-12-18T10:21:48.426318+0000","last_unstale":"2023-12-18T10:21:50.833390+0000","last_undegraded":"2023-12-18T10:21:50.833390+0000","last_fullsized":"2023-12-18T10:21:50.833390+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:42:36.055759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334171+0000","last_change":"2023-12-18T10:21:48.433113+0000","last_active":"2023-12-18T10:21:50.334171+0000","last_peered":"2023-12-18T10:21:50.334171+0000","last_clean":"2023-12-18T10:21:50.334171+0000","last_became_active":"2023-12-18T10:21:48.432816+0000","last_became_peered":"2023-12-18T10:21:48.432816+0000","last_unstale":"2023-12-18T10:21:50.334171+0000","last_undegraded":"2023-12-18T10:21:50.334171+0000","last_fullsized":"2023-12-18T10:21:50.334171+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:11.717946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834517+0000","last_change":"2023-12-18T10:21:48.435237+0000","last_active":"2023-12-18T10:21:50.834517+0000","last_peered":"2023-12-18T10:21:50.834517+0000","last_clean":"2023-12-18T10:21:50.834517+0000","last_became_active":"2023-12-18T10:21:48.434894+0000","last_became_peered":"2023-12-18T10:21:48.434894+0000","last_unstale":"2023-12-18T10:21:50.834517+0000","last_undegraded":"2023-12-18T10:21:50.834517+0000","last_fullsized":"2023-12-18T10:21:50.834517+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:42.298529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834365+0000","last_change":"2023-12-18T10:21:48.435992+0000","last_active":"2023-12-18T10:21:50.834365+0000","last_peered":"2023-12-18T10:21:50.834365+0000","last_clean":"2023-12-18T10:21:50.834365+0000","last_became_active":"2023-12-18T10:21:48.435702+0000","last_became_peered":"2023-12-18T10:21:48.435702+0000","last_unstale":"2023-12-18T10:21:50.834365+0000","last_undegraded":"2023-12-18T10:21:50.834365+0000","last_fullsized":"2023-12-18T10:21:50.834365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:57.360980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418081+0000","last_change":"2023-12-18T10:21:48.441611+0000","last_active":"2023-12-18T10:21:49.418081+0000","last_peered":"2023-12-18T10:21:49.418081+0000","last_clean":"2023-12-18T10:21:49.418081+0000","last_became_active":"2023-12-18T10:21:48.437132+0000","last_became_peered":"2023-12-18T10:21:48.437132+0000","last_unstale":"2023-12-18T10:21:49.418081+0000","last_undegraded":"2023-12-18T10:21:49.418081+0000","last_fullsized":"2023-12-18T10:21:49.418081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:31.970301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834578+0000","last_change":"2023-12-18T10:21:48.425031+0000","last_active":"2023-12-18T10:21:50.834578+0000","last_peered":"2023-12-18T10:21:50.834578+0000","last_clean":"2023-12-18T10:21:50.834578+0000","last_became_active":"2023-12-18T10:21:48.424777+0000","last_became_peered":"2023-12-18T10:21:48.424777+0000","last_unstale":"2023-12-18T10:21:50.834578+0000","last_undegraded":"2023-12-18T10:21:50.834578+0000","last_fullsized":"2023-12-18T10:21:50.834578+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:11.137755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334339+0000","last_change":"2023-12-18T10:21:48.444498+0000","last_active":"2023-12-18T10:21:50.334339+0000","last_peered":"2023-12-18T10:21:50.334339+0000","last_clean":"2023-12-18T10:21:50.334339+0000","last_became_active":"2023-12-18T10:21:48.444233+0000","last_became_peered":"2023-12-18T10:21:48.444233+0000","last_unstale":"2023-12-18T10:21:50.334339+0000","last_undegraded":"2023-12-18T10:21:50.334339+0000","last_fullsized":"2023-12-18T10:21:50.334339+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:42.298529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834457+0000","last_change":"2023-12-18T10:21:48.445156+0000","last_active":"2023-12-18T10:21:50.834457+0000","last_peered":"2023-12-18T10:21:50.834457+0000","last_clean":"2023-12-18T10:21:50.834457+0000","last_became_active":"2023-12-18T10:21:48.444896+0000","last_became_peered":"2023-12-18T10:21:48.444896+0000","last_unstale":"2023-12-18T10:21:50.834457+0000","last_undegraded":"2023-12-18T10:21:50.834457+0000","last_fullsized":"2023-12-18T10:21:50.834457+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:36:39.295713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417775+0000","last_change":"2023-12-18T10:21:48.436580+0000","last_active":"2023-12-18T10:21:49.417775+0000","last_peered":"2023-12-18T10:21:49.417775+0000","last_clean":"2023-12-18T10:21:49.417775+0000","last_became_active":"2023-12-18T10:21:48.435579+0000","last_became_peered":"2023-12-18T10:21:48.435579+0000","last_unstale":"2023-12-18T10:21:49.417775+0000","last_undegraded":"2023-12-18T10:21:49.417775+0000","last_fullsized":"2023-12-18T10:21:49.417775+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:23:30.222618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833627+0000","last_change":"2023-12-18T10:21:48.429224+0000","last_active":"2023-12-18T10:21:50.833627+0000","last_peered":"2023-12-18T10:21:50.833627+0000","last_clean":"2023-12-18T10:21:50.833627+0000","last_became_active":"2023-12-18T10:21:48.428929+0000","last_became_peered":"2023-12-18T10:21:48.428929+0000","last_unstale":"2023-12-18T10:21:50.833627+0000","last_undegraded":"2023-12-18T10:21:50.833627+0000","last_fullsized":"2023-12-18T10:21:50.833627+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:36.524306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835152+0000","last_change":"2023-12-18T10:21:48.436670+0000","last_active":"2023-12-18T10:21:50.835152+0000","last_peered":"2023-12-18T10:21:50.835152+0000","last_clean":"2023-12-18T10:21:50.835152+0000","last_became_active":"2023-12-18T10:21:48.436401+0000","last_became_peered":"2023-12-18T10:21:48.436401+0000","last_unstale":"2023-12-18T10:21:50.835152+0000","last_undegraded":"2023-12-18T10:21:50.835152+0000","last_fullsized":"2023-12-18T10:21:50.835152+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:14:20.867347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"64'4","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.447607+0000","last_change":"2023-12-18T10:21:48.039433+0000","last_active":"2023-12-18T10:21:48.447607+0000","last_peered":"2023-12-18T10:21:48.447607+0000","last_clean":"2023-12-18T10:21:48.447607+0000","last_became_active":"2023-12-18T10:21:48.039120+0000","last_became_peered":"2023-12-18T10:21:48.039120+0000","last_unstale":"2023-12-18T10:21:48.447607+0000","last_undegraded":"2023-12-18T10:21:48.447607+0000","last_fullsized":"2023-12-18T10:21:48.447607+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418144+0000","last_change":"2023-12-18T10:21:48.441480+0000","last_active":"2023-12-18T10:21:49.418144+0000","last_peered":"2023-12-18T10:21:49.418144+0000","last_clean":"2023-12-18T10:21:49.418144+0000","last_became_active":"2023-12-18T10:21:48.439460+0000","last_became_peered":"2023-12-18T10:21:48.439460+0000","last_unstale":"2023-12-18T10:21:49.418144+0000","last_undegraded":"2023-12-18T10:21:49.418144+0000","last_fullsized":"2023-12-18T10:21:49.418144+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:50.091555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.444899+0000","last_change":"2023-12-18T10:21:48.040368+0000","last_active":"2023-12-18T10:21:48.444899+0000","last_peered":"2023-12-18T10:21:48.444899+0000","last_clean":"2023-12-18T10:21:48.444899+0000","last_became_active":"2023-12-18T10:21:48.039832+0000","last_became_peered":"2023-12-18T10:21:48.039832+0000","last_unstale":"2023-12-18T10:21:48.444899+0000","last_undegraded":"2023-12-18T10:21:48.444899+0000","last_fullsized":"2023-12-18T10:21:48.444899+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:23.245351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834086+0000","last_change":"2023-12-18T10:21:48.430156+0000","last_active":"2023-12-18T10:21:50.834086+0000","last_peered":"2023-12-18T10:21:50.834086+0000","last_clean":"2023-12-18T10:21:50.834086+0000","last_became_active":"2023-12-18T10:21:48.429711+0000","last_became_peered":"2023-12-18T10:21:48.429711+0000","last_unstale":"2023-12-18T10:21:50.834086+0000","last_undegraded":"2023-12-18T10:21:50.834086+0000","last_fullsized":"2023-12-18T10:21:50.834086+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:21:40.051326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.440120+0000","last_change":"2023-12-18T10:21:48.045644+0000","last_active":"2023-12-18T10:21:48.440120+0000","last_peered":"2023-12-18T10:21:48.440120+0000","last_clean":"2023-12-18T10:21:48.440120+0000","last_became_active":"2023-12-18T10:21:48.045326+0000","last_became_peered":"2023-12-18T10:21:48.045326+0000","last_unstale":"2023-12-18T10:21:48.440120+0000","last_undegraded":"2023-12-18T10:21:48.440120+0000","last_fullsized":"2023-12-18T10:21:48.440120+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:56.353412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334680+0000","last_change":"2023-12-18T10:21:48.449749+0000","last_active":"2023-12-18T10:21:50.334680+0000","last_peered":"2023-12-18T10:21:50.334680+0000","last_clean":"2023-12-18T10:21:50.334680+0000","last_became_active":"2023-12-18T10:21:48.449454+0000","last_became_peered":"2023-12-18T10:21:48.449454+0000","last_unstale":"2023-12-18T10:21:50.334680+0000","last_undegraded":"2023-12-18T10:21:50.334680+0000","last_fullsized":"2023-12-18T10:21:50.334680+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:24.252919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431077+0000","last_change":"2023-12-18T10:21:48.033347+0000","last_active":"2023-12-18T10:21:48.431077+0000","last_peered":"2023-12-18T10:21:48.431077+0000","last_clean":"2023-12-18T10:21:48.431077+0000","last_became_active":"2023-12-18T10:21:48.033043+0000","last_became_peered":"2023-12-18T10:21:48.033043+0000","last_unstale":"2023-12-18T10:21:48.431077+0000","last_undegraded":"2023-12-18T10:21:48.431077+0000","last_fullsized":"2023-12-18T10:21:48.431077+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:26.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417022+0000","last_change":"2023-12-18T10:21:48.417853+0000","last_active":"2023-12-18T10:21:49.417022+0000","last_peered":"2023-12-18T10:21:49.417022+0000","last_clean":"2023-12-18T10:21:49.417022+0000","last_became_active":"2023-12-18T10:21:48.416985+0000","last_became_peered":"2023-12-18T10:21:48.416985+0000","last_unstale":"2023-12-18T10:21:49.417022+0000","last_undegraded":"2023-12-18T10:21:49.417022+0000","last_fullsized":"2023-12-18T10:21:49.417022+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:50:57.134438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431776+0000","last_change":"2023-12-18T10:21:48.039260+0000","last_active":"2023-12-18T10:21:48.431776+0000","last_peered":"2023-12-18T10:21:48.431776+0000","last_clean":"2023-12-18T10:21:48.431776+0000","last_became_active":"2023-12-18T10:21:48.038959+0000","last_became_peered":"2023-12-18T10:21:48.038959+0000","last_unstale":"2023-12-18T10:21:48.431776+0000","last_undegraded":"2023-12-18T10:21:48.431776+0000","last_fullsized":"2023-12-18T10:21:48.431776+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:46:49.083987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834041+0000","last_change":"2023-12-18T10:21:48.431276+0000","last_active":"2023-12-18T10:21:50.834041+0000","last_peered":"2023-12-18T10:21:50.834041+0000","last_clean":"2023-12-18T10:21:50.834041+0000","last_became_active":"2023-12-18T10:21:48.430965+0000","last_became_peered":"2023-12-18T10:21:48.430965+0000","last_unstale":"2023-12-18T10:21:50.834041+0000","last_undegraded":"2023-12-18T10:21:50.834041+0000","last_fullsized":"2023-12-18T10:21:50.834041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:26:54.871700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.432746+0000","last_change":"2023-12-18T10:21:48.042888+0000","last_active":"2023-12-18T10:21:48.432746+0000","last_peered":"2023-12-18T10:21:48.432746+0000","last_clean":"2023-12-18T10:21:48.432746+0000","last_became_active":"2023-12-18T10:21:48.042599+0000","last_became_peered":"2023-12-18T10:21:48.042599+0000","last_unstale":"2023-12-18T10:21:48.432746+0000","last_undegraded":"2023-12-18T10:21:48.432746+0000","last_fullsized":"2023-12-18T10:21:48.432746+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:50:14.424178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834978+0000","last_change":"2023-12-18T10:21:48.435436+0000","last_active":"2023-12-18T10:21:50.834978+0000","last_peered":"2023-12-18T10:21:50.834978+0000","last_clean":"2023-12-18T10:21:50.834978+0000","last_became_active":"2023-12-18T10:21:48.434960+0000","last_became_peered":"2023-12-18T10:21:48.434960+0000","last_unstale":"2023-12-18T10:21:50.834978+0000","last_undegraded":"2023-12-18T10:21:50.834978+0000","last_fullsized":"2023-12-18T10:21:50.834978+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:36.311083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408142+0000","last_change":"2023-12-18T10:21:48.037703+0000","last_active":"2023-12-18T10:21:48.408142+0000","last_peered":"2023-12-18T10:21:48.408142+0000","last_clean":"2023-12-18T10:21:48.408142+0000","last_became_active":"2023-12-18T10:21:48.037416+0000","last_became_peered":"2023-12-18T10:21:48.037416+0000","last_unstale":"2023-12-18T10:21:48.408142+0000","last_undegraded":"2023-12-18T10:21:48.408142+0000","last_fullsized":"2023-12-18T10:21:48.408142+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:28.451928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833504+0000","last_change":"2023-12-18T10:21:48.428917+0000","last_active":"2023-12-18T10:21:50.833504+0000","last_peered":"2023-12-18T10:21:50.833504+0000","last_clean":"2023-12-18T10:21:50.833504+0000","last_became_active":"2023-12-18T10:21:48.428463+0000","last_became_peered":"2023-12-18T10:21:48.428463+0000","last_unstale":"2023-12-18T10:21:50.833504+0000","last_undegraded":"2023-12-18T10:21:50.833504+0000","last_fullsized":"2023-12-18T10:21:50.833504+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:11:42.943877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.419391+0000","last_change":"2023-12-18T10:21:48.041034+0000","last_active":"2023-12-18T10:21:48.419391+0000","last_peered":"2023-12-18T10:21:48.419391+0000","last_clean":"2023-12-18T10:21:48.419391+0000","last_became_active":"2023-12-18T10:21:48.040700+0000","last_became_peered":"2023-12-18T10:21:48.040700+0000","last_unstale":"2023-12-18T10:21:48.419391+0000","last_undegraded":"2023-12-18T10:21:48.419391+0000","last_fullsized":"2023-12-18T10:21:48.419391+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:35.509047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834552+0000","last_change":"2023-12-18T10:21:48.417692+0000","last_active":"2023-12-18T10:21:50.834552+0000","last_peered":"2023-12-18T10:21:50.834552+0000","last_clean":"2023-12-18T10:21:50.834552+0000","last_became_active":"2023-12-18T10:21:48.417075+0000","last_became_peered":"2023-12-18T10:21:48.417075+0000","last_unstale":"2023-12-18T10:21:50.834552+0000","last_undegraded":"2023-12-18T10:21:50.834552+0000","last_fullsized":"2023-12-18T10:21:50.834552+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:36:39.295713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.437218+0000","last_change":"2023-12-18T10:21:48.047318+0000","last_active":"2023-12-18T10:21:48.437218+0000","last_peered":"2023-12-18T10:21:48.437218+0000","last_clean":"2023-12-18T10:21:48.437218+0000","last_became_active":"2023-12-18T10:21:48.047010+0000","last_became_peered":"2023-12-18T10:21:48.047010+0000","last_unstale":"2023-12-18T10:21:48.437218+0000","last_undegraded":"2023-12-18T10:21:48.437218+0000","last_fullsized":"2023-12-18T10:21:48.437218+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833453+0000","last_change":"2023-12-18T10:21:48.435274+0000","last_active":"2023-12-18T10:21:50.833453+0000","last_peered":"2023-12-18T10:21:50.833453+0000","last_clean":"2023-12-18T10:21:50.833453+0000","last_became_active":"2023-12-18T10:21:48.435009+0000","last_became_peered":"2023-12-18T10:21:48.435009+0000","last_unstale":"2023-12-18T10:21:50.833453+0000","last_undegraded":"2023-12-18T10:21:50.833453+0000","last_fullsized":"2023-12-18T10:21:50.833453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:44:00.526234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.421567+0000","last_change":"2023-12-18T10:21:48.046447+0000","last_active":"2023-12-18T10:21:48.421567+0000","last_peered":"2023-12-18T10:21:48.421567+0000","last_clean":"2023-12-18T10:21:48.421567+0000","last_became_active":"2023-12-18T10:21:48.046182+0000","last_became_peered":"2023-12-18T10:21:48.046182+0000","last_unstale":"2023-12-18T10:21:48.421567+0000","last_undegraded":"2023-12-18T10:21:48.421567+0000","last_fullsized":"2023-12-18T10:21:48.421567+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:28:10.130187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835003+0000","last_change":"2023-12-18T10:21:48.443458+0000","last_active":"2023-12-18T10:21:50.835003+0000","last_peered":"2023-12-18T10:21:50.835003+0000","last_clean":"2023-12-18T10:21:50.835003+0000","last_became_active":"2023-12-18T10:21:48.443214+0000","last_became_peered":"2023-12-18T10:21:48.443214+0000","last_unstale":"2023-12-18T10:21:50.835003+0000","last_undegraded":"2023-12-18T10:21:50.835003+0000","last_fullsized":"2023-12-18T10:21:50.835003+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:18:22.665558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"64'3","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.449882+0000","last_change":"2023-12-18T10:21:48.045279+0000","last_active":"2023-12-18T10:21:48.449882+0000","last_peered":"2023-12-18T10:21:48.449882+0000","last_clean":"2023-12-18T10:21:48.449882+0000","last_became_active":"2023-12-18T10:21:48.044922+0000","last_became_peered":"2023-12-18T10:21:48.044922+0000","last_unstale":"2023-12-18T10:21:48.449882+0000","last_undegraded":"2023-12-18T10:21:48.449882+0000","last_fullsized":"2023-12-18T10:21:48.449882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:31:16.925985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418363+0000","last_change":"2023-12-18T10:21:48.430115+0000","last_active":"2023-12-18T10:21:49.418363+0000","last_peered":"2023-12-18T10:21:49.418363+0000","last_clean":"2023-12-18T10:21:49.418363+0000","last_became_active":"2023-12-18T10:21:48.429743+0000","last_became_peered":"2023-12-18T10:21:48.429743+0000","last_unstale":"2023-12-18T10:21:49.418363+0000","last_undegraded":"2023-12-18T10:21:49.418363+0000","last_fullsized":"2023-12-18T10:21:49.418363+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:00:29.459496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"64'6","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451861+0000","last_change":"2023-12-18T10:21:48.043037+0000","last_active":"2023-12-18T10:21:48.451861+0000","last_peered":"2023-12-18T10:21:48.451861+0000","last_clean":"2023-12-18T10:21:48.451861+0000","last_became_active":"2023-12-18T10:21:48.042733+0000","last_became_peered":"2023-12-18T10:21:48.042733+0000","last_unstale":"2023-12-18T10:21:48.451861+0000","last_undegraded":"2023-12-18T10:21:48.451861+0000","last_fullsized":"2023-12-18T10:21:48.451861+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417742+0000","last_change":"2023-12-18T10:21:48.423021+0000","last_active":"2023-12-18T10:21:49.417742+0000","last_peered":"2023-12-18T10:21:49.417742+0000","last_clean":"2023-12-18T10:21:49.417742+0000","last_became_active":"2023-12-18T10:21:48.422453+0000","last_became_peered":"2023-12-18T10:21:48.422453+0000","last_unstale":"2023-12-18T10:21:49.417742+0000","last_undegraded":"2023-12-18T10:21:49.417742+0000","last_fullsized":"2023-12-18T10:21:49.417742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:33.628072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.448256+0000","last_change":"2023-12-18T10:21:48.038440+0000","last_active":"2023-12-18T10:21:48.448256+0000","last_peered":"2023-12-18T10:21:48.448256+0000","last_clean":"2023-12-18T10:21:48.448256+0000","last_became_active":"2023-12-18T10:21:48.038157+0000","last_became_peered":"2023-12-18T10:21:48.038157+0000","last_unstale":"2023-12-18T10:21:48.448256+0000","last_undegraded":"2023-12-18T10:21:48.448256+0000","last_fullsized":"2023-12-18T10:21:48.448256+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:32:04.617789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834217+0000","last_change":"2023-12-18T10:21:48.435170+0000","last_active":"2023-12-18T10:21:50.834217+0000","last_peered":"2023-12-18T10:21:50.834217+0000","last_clean":"2023-12-18T10:21:50.834217+0000","last_became_active":"2023-12-18T10:21:48.434884+0000","last_became_peered":"2023-12-18T10:21:48.434884+0000","last_unstale":"2023-12-18T10:21:50.834217+0000","last_undegraded":"2023-12-18T10:21:50.834217+0000","last_fullsized":"2023-12-18T10:21:50.834217+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:03:02.116576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.425836+0000","last_change":"2023-12-18T10:21:48.045035+0000","last_active":"2023-12-18T10:21:48.425836+0000","last_peered":"2023-12-18T10:21:48.425836+0000","last_clean":"2023-12-18T10:21:48.425836+0000","last_became_active":"2023-12-18T10:21:48.044611+0000","last_became_peered":"2023-12-18T10:21:48.044611+0000","last_unstale":"2023-12-18T10:21:48.425836+0000","last_undegraded":"2023-12-18T10:21:48.425836+0000","last_fullsized":"2023-12-18T10:21:48.425836+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:28:35.303515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834817+0000","last_change":"2023-12-18T10:21:48.437943+0000","last_active":"2023-12-18T10:21:50.834817+0000","last_peered":"2023-12-18T10:21:50.834817+0000","last_clean":"2023-12-18T10:21:50.834817+0000","last_became_active":"2023-12-18T10:21:48.437643+0000","last_became_peered":"2023-12-18T10:21:48.437643+0000","last_unstale":"2023-12-18T10:21:50.834817+0000","last_undegraded":"2023-12-18T10:21:50.834817+0000","last_fullsized":"2023-12-18T10:21:50.834817+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:31:17.933553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.427243+0000","last_change":"2023-12-18T10:21:48.043022+0000","last_active":"2023-12-18T10:21:48.427243+0000","last_peered":"2023-12-18T10:21:48.427243+0000","last_clean":"2023-12-18T10:21:48.427243+0000","last_became_active":"2023-12-18T10:21:48.042699+0000","last_became_peered":"2023-12-18T10:21:48.042699+0000","last_unstale":"2023-12-18T10:21:48.427243+0000","last_undegraded":"2023-12-18T10:21:48.427243+0000","last_fullsized":"2023-12-18T10:21:48.427243+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:13:21.619300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834264+0000","last_change":"2023-12-18T10:21:48.421196+0000","last_active":"2023-12-18T10:21:50.834264+0000","last_peered":"2023-12-18T10:21:50.834264+0000","last_clean":"2023-12-18T10:21:50.834264+0000","last_became_active":"2023-12-18T10:21:48.420884+0000","last_became_peered":"2023-12-18T10:21:48.420884+0000","last_unstale":"2023-12-18T10:21:50.834264+0000","last_undegraded":"2023-12-18T10:21:50.834264+0000","last_fullsized":"2023-12-18T10:21:50.834264+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:28:00.192661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"64'8","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451492+0000","last_change":"2023-12-18T10:21:48.046905+0000","last_active":"2023-12-18T10:21:48.451492+0000","last_peered":"2023-12-18T10:21:48.451492+0000","last_clean":"2023-12-18T10:21:48.451492+0000","last_became_active":"2023-12-18T10:21:48.045846+0000","last_became_peered":"2023-12-18T10:21:48.045846+0000","last_unstale":"2023-12-18T10:21:48.451492+0000","last_undegraded":"2023-12-18T10:21:48.451492+0000","last_fullsized":"2023-12-18T10:21:48.451492+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:11:24.315740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.334522+0000","last_change":"2023-12-18T10:21:48.448786+0000","last_active":"2023-12-18T10:21:50.334522+0000","last_peered":"2023-12-18T10:21:50.334522+0000","last_clean":"2023-12-18T10:21:50.334522+0000","last_became_active":"2023-12-18T10:21:48.448323+0000","last_became_peered":"2023-12-18T10:21:48.448323+0000","last_unstale":"2023-12-18T10:21:50.334522+0000","last_undegraded":"2023-12-18T10:21:50.334522+0000","last_fullsized":"2023-12-18T10:21:50.334522+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:27.126391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.441396+0000","last_change":"2023-12-18T10:21:48.046002+0000","last_active":"2023-12-18T10:21:48.441396+0000","last_peered":"2023-12-18T10:21:48.441396+0000","last_clean":"2023-12-18T10:21:48.441396+0000","last_became_active":"2023-12-18T10:21:48.045617+0000","last_became_peered":"2023-12-18T10:21:48.045617+0000","last_unstale":"2023-12-18T10:21:48.441396+0000","last_undegraded":"2023-12-18T10:21:48.441396+0000","last_fullsized":"2023-12-18T10:21:48.441396+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835084+0000","last_change":"2023-12-18T10:21:48.434324+0000","last_active":"2023-12-18T10:21:50.835084+0000","last_peered":"2023-12-18T10:21:50.835084+0000","last_clean":"2023-12-18T10:21:50.835084+0000","last_became_active":"2023-12-18T10:21:48.433856+0000","last_became_peered":"2023-12-18T10:21:48.433856+0000","last_unstale":"2023-12-18T10:21:50.835084+0000","last_undegraded":"2023-12-18T10:21:50.835084+0000","last_fullsized":"2023-12-18T10:21:50.835084+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:32:05.625357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.451251+0000","last_change":"2023-12-18T10:21:48.045742+0000","last_active":"2023-12-18T10:21:48.451251+0000","last_peered":"2023-12-18T10:21:48.451251+0000","last_clean":"2023-12-18T10:21:48.451251+0000","last_became_active":"2023-12-18T10:21:48.045437+0000","last_became_peered":"2023-12-18T10:21:48.045437+0000","last_unstale":"2023-12-18T10:21:48.451251+0000","last_undegraded":"2023-12-18T10:21:48.451251+0000","last_fullsized":"2023-12-18T10:21:48.451251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:49.230808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.418256+0000","last_change":"2023-12-18T10:21:48.438290+0000","last_active":"2023-12-18T10:21:49.418256+0000","last_peered":"2023-12-18T10:21:49.418256+0000","last_clean":"2023-12-18T10:21:49.418256+0000","last_became_active":"2023-12-18T10:21:48.438025+0000","last_became_peered":"2023-12-18T10:21:48.438025+0000","last_unstale":"2023-12-18T10:21:49.418256+0000","last_undegraded":"2023-12-18T10:21:49.418256+0000","last_fullsized":"2023-12-18T10:21:49.418256+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:21:40.051326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"64'1","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.448380+0000","last_change":"2023-12-18T10:21:48.046674+0000","last_active":"2023-12-18T10:21:48.448380+0000","last_peered":"2023-12-18T10:21:48.448380+0000","last_clean":"2023-12-18T10:21:48.448380+0000","last_became_active":"2023-12-18T10:21:48.046323+0000","last_became_peered":"2023-12-18T10:21:48.046323+0000","last_unstale":"2023-12-18T10:21:48.448380+0000","last_undegraded":"2023-12-18T10:21:48.448380+0000","last_fullsized":"2023-12-18T10:21:48.448380+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:16:40.749682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835002+0000","last_change":"2023-12-18T10:21:48.430886+0000","last_active":"2023-12-18T10:21:50.835002+0000","last_peered":"2023-12-18T10:21:50.835002+0000","last_clean":"2023-12-18T10:21:50.835002+0000","last_became_active":"2023-12-18T10:21:48.430425+0000","last_became_peered":"2023-12-18T10:21:48.430425+0000","last_unstale":"2023-12-18T10:21:50.835002+0000","last_undegraded":"2023-12-18T10:21:50.835002+0000","last_fullsized":"2023-12-18T10:21:50.835002+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:55.070518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408535+0000","last_change":"2023-12-18T10:21:48.043422+0000","last_active":"2023-12-18T10:21:48.408535+0000","last_peered":"2023-12-18T10:21:48.408535+0000","last_clean":"2023-12-18T10:21:48.408535+0000","last_became_active":"2023-12-18T10:21:48.043178+0000","last_became_peered":"2023-12-18T10:21:48.043178+0000","last_unstale":"2023-12-18T10:21:48.408535+0000","last_undegraded":"2023-12-18T10:21:48.408535+0000","last_fullsized":"2023-12-18T10:21:48.408535+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:45.292256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833716+0000","last_change":"2023-12-18T10:21:48.428607+0000","last_active":"2023-12-18T10:21:50.833716+0000","last_peered":"2023-12-18T10:21:50.833716+0000","last_clean":"2023-12-18T10:21:50.833716+0000","last_became_active":"2023-12-18T10:21:48.426002+0000","last_became_peered":"2023-12-18T10:21:48.426002+0000","last_unstale":"2023-12-18T10:21:50.833716+0000","last_undegraded":"2023-12-18T10:21:50.833716+0000","last_fullsized":"2023-12-18T10:21:50.833716+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:26:46.299824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431415+0000","last_change":"2023-12-18T10:21:48.034968+0000","last_active":"2023-12-18T10:21:48.431415+0000","last_peered":"2023-12-18T10:21:48.431415+0000","last_clean":"2023-12-18T10:21:48.431415+0000","last_became_active":"2023-12-18T10:21:48.034724+0000","last_became_peered":"2023-12-18T10:21:48.034724+0000","last_unstale":"2023-12-18T10:21:48.431415+0000","last_undegraded":"2023-12-18T10:21:48.431415+0000","last_fullsized":"2023-12-18T10:21:48.431415+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:07:32.620503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834367+0000","last_change":"2023-12-18T10:21:48.434770+0000","last_active":"2023-12-18T10:21:50.834367+0000","last_peered":"2023-12-18T10:21:50.834367+0000","last_clean":"2023-12-18T10:21:50.834367+0000","last_became_active":"2023-12-18T10:21:48.434492+0000","last_became_peered":"2023-12-18T10:21:48.434492+0000","last_unstale":"2023-12-18T10:21:50.834367+0000","last_undegraded":"2023-12-18T10:21:50.834367+0000","last_fullsized":"2023-12-18T10:21:50.834367+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:52:24.252919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.425841+0000","last_change":"2023-12-18T10:21:48.046893+0000","last_active":"2023-12-18T10:21:48.425841+0000","last_peered":"2023-12-18T10:21:48.425841+0000","last_clean":"2023-12-18T10:21:48.425841+0000","last_became_active":"2023-12-18T10:21:48.046595+0000","last_became_peered":"2023-12-18T10:21:48.046595+0000","last_unstale":"2023-12-18T10:21:48.425841+0000","last_undegraded":"2023-12-18T10:21:48.425841+0000","last_fullsized":"2023-12-18T10:21:48.425841+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834926+0000","last_change":"2023-12-18T10:21:48.435226+0000","last_active":"2023-12-18T10:21:50.834926+0000","last_peered":"2023-12-18T10:21:50.834926+0000","last_clean":"2023-12-18T10:21:50.834926+0000","last_became_active":"2023-12-18T10:21:48.432531+0000","last_became_peered":"2023-12-18T10:21:48.432531+0000","last_unstale":"2023-12-18T10:21:50.834926+0000","last_undegraded":"2023-12-18T10:21:50.834926+0000","last_fullsized":"2023-12-18T10:21:50.834926+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:47.242626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.412604+0000","last_change":"2023-12-18T10:21:48.038232+0000","last_active":"2023-12-18T10:21:48.412604+0000","last_peered":"2023-12-18T10:21:48.412604+0000","last_clean":"2023-12-18T10:21:48.412604+0000","last_became_active":"2023-12-18T10:21:48.037888+0000","last_became_peered":"2023-12-18T10:21:48.037888+0000","last_unstale":"2023-12-18T10:21:48.412604+0000","last_undegraded":"2023-12-18T10:21:48.412604+0000","last_fullsized":"2023-12-18T10:21:48.412604+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:16:10.710378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834214+0000","last_change":"2023-12-18T10:21:48.428405+0000","last_active":"2023-12-18T10:21:50.834214+0000","last_peered":"2023-12-18T10:21:50.834214+0000","last_clean":"2023-12-18T10:21:50.834214+0000","last_became_active":"2023-12-18T10:21:48.428116+0000","last_became_peered":"2023-12-18T10:21:48.428116+0000","last_unstale":"2023-12-18T10:21:50.834214+0000","last_undegraded":"2023-12-18T10:21:50.834214+0000","last_fullsized":"2023-12-18T10:21:50.834214+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:15:06.452111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"64'2","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.449466+0000","last_change":"2023-12-18T10:21:48.048899+0000","last_active":"2023-12-18T10:21:48.449466+0000","last_peered":"2023-12-18T10:21:48.449466+0000","last_clean":"2023-12-18T10:21:48.449466+0000","last_became_active":"2023-12-18T10:21:48.048619+0000","last_became_peered":"2023-12-18T10:21:48.048619+0000","last_unstale":"2023-12-18T10:21:48.449466+0000","last_undegraded":"2023-12-18T10:21:48.449466+0000","last_fullsized":"2023-12-18T10:21:48.449466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:54.062950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417350+0000","last_change":"2023-12-18T10:21:48.423355+0000","last_active":"2023-12-18T10:21:49.417350+0000","last_peered":"2023-12-18T10:21:49.417350+0000","last_clean":"2023-12-18T10:21:49.417350+0000","last_became_active":"2023-12-18T10:21:48.423114+0000","last_became_peered":"2023-12-18T10:21:48.423114+0000","last_unstale":"2023-12-18T10:21:49.417350+0000","last_undegraded":"2023-12-18T10:21:49.417350+0000","last_fullsized":"2023-12-18T10:21:49.417350+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:10:33.318309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.427923+0000","last_change":"2023-12-18T10:21:48.045907+0000","last_active":"2023-12-18T10:21:48.427923+0000","last_peered":"2023-12-18T10:21:48.427923+0000","last_clean":"2023-12-18T10:21:48.427923+0000","last_became_active":"2023-12-18T10:21:48.044701+0000","last_became_peered":"2023-12-18T10:21:48.044701+0000","last_unstale":"2023-12-18T10:21:48.427923+0000","last_undegraded":"2023-12-18T10:21:48.427923+0000","last_fullsized":"2023-12-18T10:21:48.427923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:16.015123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834501+0000","last_change":"2023-12-18T10:21:48.434656+0000","last_active":"2023-12-18T10:21:50.834501+0000","last_peered":"2023-12-18T10:21:50.834501+0000","last_clean":"2023-12-18T10:21:50.834501+0000","last_became_active":"2023-12-18T10:21:48.434335+0000","last_became_peered":"2023-12-18T10:21:48.434335+0000","last_unstale":"2023-12-18T10:21:50.834501+0000","last_undegraded":"2023-12-18T10:21:50.834501+0000","last_fullsized":"2023-12-18T10:21:50.834501+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:57:27.635958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.412901+0000","last_change":"2023-12-18T10:21:48.044683+0000","last_active":"2023-12-18T10:21:48.412901+0000","last_peered":"2023-12-18T10:21:48.412901+0000","last_clean":"2023-12-18T10:21:48.412901+0000","last_became_active":"2023-12-18T10:21:48.044361+0000","last_became_peered":"2023-12-18T10:21:48.044361+0000","last_unstale":"2023-12-18T10:21:48.412901+0000","last_undegraded":"2023-12-18T10:21:48.412901+0000","last_fullsized":"2023-12-18T10:21:48.412901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:29:41.290961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835132+0000","last_change":"2023-12-18T10:21:48.430694+0000","last_active":"2023-12-18T10:21:50.835132+0000","last_peered":"2023-12-18T10:21:50.835132+0000","last_clean":"2023-12-18T10:21:50.835132+0000","last_became_active":"2023-12-18T10:21:48.430091+0000","last_became_peered":"2023-12-18T10:21:48.430091+0000","last_unstale":"2023-12-18T10:21:50.835132+0000","last_undegraded":"2023-12-18T10:21:50.835132+0000","last_fullsized":"2023-12-18T10:21:50.835132+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:02.335252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.409410+0000","last_change":"2023-12-18T10:21:48.043141+0000","last_active":"2023-12-18T10:21:48.409410+0000","last_peered":"2023-12-18T10:21:48.409410+0000","last_clean":"2023-12-18T10:21:48.409410+0000","last_became_active":"2023-12-18T10:21:48.042748+0000","last_became_peered":"2023-12-18T10:21:48.042748+0000","last_unstale":"2023-12-18T10:21:48.409410+0000","last_undegraded":"2023-12-18T10:21:48.409410+0000","last_fullsized":"2023-12-18T10:21:48.409410+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:46.235058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.834355+0000","last_change":"2023-12-18T10:21:48.435771+0000","last_active":"2023-12-18T10:21:50.834355+0000","last_peered":"2023-12-18T10:21:50.834355+0000","last_clean":"2023-12-18T10:21:50.834355+0000","last_became_active":"2023-12-18T10:21:48.430821+0000","last_became_peered":"2023-12-18T10:21:48.430821+0000","last_unstale":"2023-12-18T10:21:50.834355+0000","last_undegraded":"2023-12-18T10:21:50.834355+0000","last_fullsized":"2023-12-18T10:21:50.834355+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:49:03.414174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.431877+0000","last_change":"2023-12-18T10:21:48.041087+0000","last_active":"2023-12-18T10:21:48.431877+0000","last_peered":"2023-12-18T10:21:48.431877+0000","last_clean":"2023-12-18T10:21:48.431877+0000","last_became_active":"2023-12-18T10:21:48.040651+0000","last_became_peered":"2023-12-18T10:21:48.040651+0000","last_unstale":"2023-12-18T10:21:48.431877+0000","last_undegraded":"2023-12-18T10:21:48.431877+0000","last_fullsized":"2023-12-18T10:21:48.431877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:53:18.623750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417828+0000","last_change":"2023-12-18T10:21:48.442730+0000","last_active":"2023-12-18T10:21:49.417828+0000","last_peered":"2023-12-18T10:21:49.417828+0000","last_clean":"2023-12-18T10:21:49.417828+0000","last_became_active":"2023-12-18T10:21:48.442437+0000","last_became_peered":"2023-12-18T10:21:48.442437+0000","last_unstale":"2023-12-18T10:21:49.417828+0000","last_undegraded":"2023-12-18T10:21:49.417828+0000","last_fullsized":"2023-12-18T10:21:49.417828+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:17:45.307174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408017+0000","last_change":"2023-12-18T10:21:48.034202+0000","last_active":"2023-12-18T10:21:48.408017+0000","last_peered":"2023-12-18T10:21:48.408017+0000","last_clean":"2023-12-18T10:21:48.408017+0000","last_became_active":"2023-12-18T10:21:48.033929+0000","last_became_peered":"2023-12-18T10:21:48.033929+0000","last_unstale":"2023-12-18T10:21:48.408017+0000","last_undegraded":"2023-12-18T10:21:48.408017+0000","last_fullsized":"2023-12-18T10:21:48.408017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:30.962732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.833902+0000","last_change":"2023-12-18T10:21:48.431174+0000","last_active":"2023-12-18T10:21:50.833902+0000","last_peered":"2023-12-18T10:21:50.833902+0000","last_clean":"2023-12-18T10:21:50.833902+0000","last_became_active":"2023-12-18T10:21:48.430895+0000","last_became_peered":"2023-12-18T10:21:48.430895+0000","last_unstale":"2023-12-18T10:21:50.833902+0000","last_undegraded":"2023-12-18T10:21:50.833902+0000","last_fullsized":"2023-12-18T10:21:50.833902+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:03:02.116576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408175+0000","last_change":"2023-12-18T10:21:48.035689+0000","last_active":"2023-12-18T10:21:48.408175+0000","last_peered":"2023-12-18T10:21:48.408175+0000","last_clean":"2023-12-18T10:21:48.408175+0000","last_became_active":"2023-12-18T10:21:48.035442+0000","last_became_peered":"2023-12-18T10:21:48.035442+0000","last_unstale":"2023-12-18T10:21:48.408175+0000","last_undegraded":"2023-12-18T10:21:48.408175+0000","last_fullsized":"2023-12-18T10:21:48.408175+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:43:26.118823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:49.417176+0000","last_change":"2023-12-18T10:21:48.440493+0000","last_active":"2023-12-18T10:21:49.417176+0000","last_peered":"2023-12-18T10:21:49.417176+0000","last_clean":"2023-12-18T10:21:49.417176+0000","last_became_active":"2023-12-18T10:21:48.440216+0000","last_became_peered":"2023-12-18T10:21:48.440216+0000","last_unstale":"2023-12-18T10:21:49.417176+0000","last_undegraded":"2023-12-18T10:21:49.417176+0000","last_fullsized":"2023-12-18T10:21:49.417176+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:11:34.360183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.408006+0000","last_change":"2023-12-18T10:21:48.031460+0000","last_active":"2023-12-18T10:21:48.408006+0000","last_peered":"2023-12-18T10:21:48.408006+0000","last_clean":"2023-12-18T10:21:48.408006+0000","last_became_active":"2023-12-18T10:21:48.031176+0000","last_became_peered":"2023-12-18T10:21:48.031176+0000","last_unstale":"2023-12-18T10:21:48.408006+0000","last_undegraded":"2023-12-18T10:21:48.408006+0000","last_fullsized":"2023-12-18T10:21:48.408006+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:16:01.327684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-18T10:21:50.835038+0000","last_change":"2023-12-18T10:21:48.428634+0000","last_active":"2023-12-18T10:21:50.835038+0000","last_peered":"2023-12-18T10:21:50.835038+0000","last_clean":"2023-12-18T10:21:50.835038+0000","last_became_active":"2023-12-18T10:21:48.427691+0000","last_became_peered":"2023-12-18T10:21:48.427691+0000","last_unstale":"2023-12-18T10:21:50.835038+0000","last_undegraded":"2023-12-18T10:21:50.835038+0000","last_fullsized":"2023-12-18T10:21:50.835038+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:48.005728+0000","last_clean_scrub_stamp":"2023-12-18T10:21:48.005728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:27:17.022691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.407740+0000","last_change":"2023-12-18T10:21:48.041269+0000","last_active":"2023-12-18T10:21:48.407740+0000","last_peered":"2023-12-18T10:21:48.407740+0000","last_clean":"2023-12-18T10:21:48.407740+0000","last_became_active":"2023-12-18T10:21:48.040986+0000","last_became_peered":"2023-12-18T10:21:48.040986+0000","last_unstale":"2023-12-18T10:21:48.407740+0000","last_undegraded":"2023-12-18T10:21:48.407740+0000","last_fullsized":"2023-12-18T10:21:48.407740+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:21:46.998160+0000","last_clean_scrub_stamp":"2023-12-18T10:21:46.998160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:05:35.516738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-18T10:21:48.418725+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:21:48.418725+0000","last_peered":"2023-12-18T10:21:48.418725+0000","last_clean":"2023-12-18T10:21:48.418725+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:21:48.418725+0000","last_undegraded":"2023-12-18T10:21:48.418725+0000","last_fullsized":"2023-12-18T10:21:48.418725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1396736,"data_stored":945613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.42499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.88400000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60099999999999998,"15min":0.58699999999999997},"min":{"1min":0.442,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71499999999999997}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.48499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.83099999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.83399999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.48499999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88400000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.379},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.86499999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.69099999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68999999999999995},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90000000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.68300000000000005},"min":{"1min":0.44900000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.41299999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.751}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":354503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79400000000000004,"15min":0.85999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77800000000000002,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84599999999999997,"15min":0.90700000000000003},"min":{"1min":0.54200000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91300000000000003,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.47999999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.72499999999999998,"15min":0.76200000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.76800000000000002,"5min":1.845,"15min":1.845},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.82499999999999996,"15min":0.88200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":4.524,"15min":4.524},"last":0.67400000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.83599999999999997,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96199999999999997,"5min":1.925,"15min":1.925},"last":0.60699999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.81899999999999995,"15min":0.84799999999999998},"min":{"1min":0.65400000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0489999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.85499999999999998,"15min":0.91300000000000003},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.85299999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.622}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65400000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0049999999999999,"5min":1.101,"15min":1.101},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63800000000000001,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78100000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.441},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.70199999999999996,"15min":0.71599999999999997},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.83099999999999996,"5min":1.284,"15min":1.284},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0880000000000001,"5min":1.129,"15min":1.129},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.49099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.80200000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":354491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.67500000000000004},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.73099999999999998,"15min":0.76500000000000001},"min":{"1min":0.45300000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0249999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.501}]},{"osd":1,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73599999999999999,"15min":0.76900000000000002},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92500000000000004,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.67000000000000004},"min":{"1min":0.48999999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54700000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.751,"15min":0.78900000000000003},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.91400000000000003,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.623},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77100000000000002,"15min":0.81299999999999994},"min":{"1min":0.501,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.879,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.52800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.91100000000000003,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80000000000000004,"15min":0.84199999999999997},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.67500000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.90000000000000002,"15min":1.01},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.70099999999999996},"min":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97899999999999998,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.755}]},{"osd":6,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73799999999999999,"15min":0.78000000000000003},"min":{"1min":0.36799999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89400000000000002,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.76600000000000001,"15min":0.81299999999999994},"min":{"1min":0.47099999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96199999999999997,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:21:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.042,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.79600000000000004,"15min":0.84199999999999997},"min":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0669999999999999,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.80000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":798720,"data_stored":356033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.67400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88700000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71199999999999997,"15min":0.71099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.004,"5min":1.131,"15min":1.131},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.98199999999999998,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":1.032,"15min":1.032},"last":0.71599999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71899999999999997,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.999,"15min":0.999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.57399999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.443,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84099999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81200000000000006,"5min":0.874,"15min":0.874},"last":0.51000000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66900000000000004,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77400000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.79900000000000004,"5min":1.073,"15min":1.073},"last":0.746}]},{"osd":7,"last update":"Mon Dec 18 10:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70999999999999996,"15min":0.72199999999999998},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.878,"5min":1.042,"15min":1.042},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89000000000000001,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.497}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.42899999999999999},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69599999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.49099999999999999,"15min":0.51700000000000002},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.69299999999999995,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.63800000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56200000000000006,"15min":0.58899999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74099999999999999,"5min":1.254,"15min":1.254},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64000000000000001,"15min":0.66900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.83899999999999997,"5min":1.772,"15min":1.772},"last":0.497}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68300000000000005,"15min":0.68700000000000006},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.85899999999999999,"5min":1.01,"15min":1.01},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0669999999999999,"5min":1.181,"15min":1.181},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73299999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0129999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70299999999999996,"15min":0.71499999999999997},"min":{"1min":0.53200000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.871,"5min":1.069,"15min":1.069},"last":0.70699999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.036,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.79500000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76100000000000001,"15min":0.78200000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92000000000000004,"5min":1.127,"15min":1.127},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.97699999999999998,"5min":1.139,"15min":1.139},"last":0.71599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":786432,"data_stored":354469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.432,"15min":0.442},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.32900000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67200000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65700000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.497}]},{"osd":3,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.48999999999999999},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65700000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.46000000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63500000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78500000000000003,"15min":0.80900000000000005},"min":{"1min":0.56799999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0469999999999999,"5min":1.698,"15min":1.698},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0820000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74399999999999999,"15min":0.75600000000000001},"min":{"1min":0.51200000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95999999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.56299999999999994,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.085,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.59999999999999998,"5min":0.499,"15min":0.499},"max":{"1min":1.0680000000000001,"5min":1.341,"15min":1.341},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78000000000000003,"15min":0.78900000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0900000000000001,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:20:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.79800000000000004},"min":{"1min":0.52200000000000002,"5min":0.501,"15min":0.501},"max":{"1min":1.048,"5min":1.282,"15min":1.282},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78300000000000003,"15min":0.78600000000000003},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.093,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.623}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":815104,"data_stored":356797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.56599999999999995,"15min":0.624},"min":{"1min":0.26200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64400000000000002,"5min":3.976,"15min":3.976},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.503,"15min":0.52300000000000002},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60499999999999998,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.61599999999999999,"15min":0.66200000000000003},"min":{"1min":0.34000000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71399999999999997,"5min":3.786,"15min":3.786},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78600000000000003,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.64700000000000002,"15min":0.69099999999999995},"min":{"1min":0.42199999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.63300000000000001,"15min":0.68200000000000005},"min":{"1min":0.39600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83099999999999996,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1399999999999999,"5min":1.851,"15min":1.851},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.878,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.99199999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.52900000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.872,"15min":0.92400000000000004},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":1.0960000000000001,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78100000000000003,"15min":0.79700000000000004},"min":{"1min":0.58699999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.96399999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.83099999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0169999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.89400000000000002,"15min":0.95799999999999996},"min":{"1min":0.56000000000000005,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0880000000000001,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.60299999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:20:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80800000000000005},"min":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0529999999999999,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81499999999999995,"15min":0.83899999999999997},"min":{"1min":0.57599999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0649999999999999,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":944837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.48199999999999998,"15min":0.498},"min":{"1min":0.28399999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.96899999999999997,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53200000000000003,"15min":0.55200000000000005},"min":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.92900000000000005,"5min":1.456,"15min":1.456},"last":0.53800000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52800000000000002,"15min":0.55800000000000005},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0589999999999999,"5min":1.595,"15min":1.595},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.55600000000000005,"15min":0.59999999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.748,"5min":2.464,"15min":2.464},"last":0.5}]},{"osd":3,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.33900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73699999999999999,"5min":1.859,"15min":1.859},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90000000000000002,"5min":1.903,"15min":1.903},"last":0.60099999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.58699999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3240000000000001,"5min":1.494,"15min":1.494},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.74299999999999999,"15min":0.749},"min":{"1min":0.54700000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0269999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80400000000000005,"15min":0.82399999999999995},"min":{"1min":0.53700000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.034,"5min":1.544,"15min":1.544},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.56399999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.278,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0389999999999999,"5min":1.53,"15min":1.53},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:20:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.80600000000000005},"min":{"1min":0.55900000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.349,"5min":1.556,"15min":1.556},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.78800000000000003},"min":{"1min":0.55200000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.032,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.80800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:21:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-18T10:21:57.332 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-18T10:21:57.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.511+0000 7f1ee0041640 1 Processor -- start 2023-12-18T10:21:57.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.511+0000 7f1ee0041640 1 -- start start 2023-12-18T10:21:57.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.511+0000 7f1ee0041640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ed80afed0 0x7f1ed80b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.511+0000 7f1ee0041640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80b0850 con 0x7f1ed80ca9d0 2023-12-18T10:21:57.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.511+0000 7f1ee0041640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80c8a10 con 0x7f1ed8159c60 2023-12-18T10:21:57.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.511+0000 7f1ee0041640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed815a860 con 0x7f1ed80afed0 2023-12-18T10:21:57.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1edd5dc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ed80afed0 0x7f1ed80b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1eddddd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1ed80ca9d0 0x7f1ed80c94b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54136/0 (socket says 172.21.15.133:54136) 2023-12-18T10:21:57.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1eddddd640 1 -- 172.21.15.133:0/3450207235 learned_addr learned my addr 172.21.15.133:0/3450207235 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:57.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1edd5dc640 1 -- 172.21.15.133:0/3450207235 >> v1:172.21.15.142:6789/0 conn(0x7f1ed8159c60 legacy=0x7f1ed8071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1edd5dc640 1 -- 172.21.15.133:0/3450207235 >> v1:172.21.15.133:6789/0 conn(0x7f1ed80ca9d0 legacy=0x7f1ed80c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1edd5dc640 1 -- 172.21.15.133:0/3450207235 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed815ab40 con 0x7f1ed80afed0 2023-12-18T10:21:57.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1edd5dc640 1 --2- 172.21.15.133:0/3450207235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80b0310 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800ba60 tx=0x7f1ec801ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b635c521af6e29ec server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1edcddb640 1 -- 172.21.15.133:0/3450207235 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80a7a60 con 0x7f1ed80afed0 2023-12-18T10:21:57.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1edcddb640 1 -- 172.21.15.133:0/3450207235 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80a7bc0 con 0x7f1ed80afed0 2023-12-18T10:21:57.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.515+0000 7f1edcddb640 1 -- 172.21.15.133:0/3450207235 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80af440 con 0x7f1ed80afed0 2023-12-18T10:21:57.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- 172.21.15.133:0/3450207235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 msgr2=0x7f1ed80b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 --2- 172.21.15.133:0/3450207235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80b0310 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800ba60 tx=0x7f1ec801ea90 comp rx=0 tx=0).stop 2023-12-18T10:21:57.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- 172.21.15.133:0/3450207235 shutdown_connections 2023-12-18T10:21:57.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 --2- 172.21.15.133:0/3450207235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80b0310 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- 172.21.15.133:0/3450207235 >> 172.21.15.133:0/3450207235 conn(0x7f1ed80ce450 msgr2=0x7f1ed80ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:57.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- 172.21.15.133:0/3450207235 shutdown_connections 2023-12-18T10:21:57.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- 172.21.15.133:0/3450207235 wait complete. 2023-12-18T10:21:57.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 Processor -- start 2023-12-18T10:21:57.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- start start 2023-12-18T10:21:57.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ed80ca9d0 0x7f1ed80c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed8159c60 0x7f1ed80b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80b3150 con 0x7f1ed80afed0 2023-12-18T10:21:57.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815b090 con 0x7f1ed8159c60 2023-12-18T10:21:57.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ee0041640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80c4120 con 0x7f1ed80ca9d0 2023-12-18T10:21:57.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1eddddd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1eddddd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59718/0 (socket says 172.21.15.133:59718) 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1eddddd640 1 -- 172.21.15.133:0/2475130526 learned_addr learned my addr 172.21.15.133:0/2475130526 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1edd5dc640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ed80ca9d0 0x7f1ed80c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1ede5de640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed8159c60 0x7f1ed80b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1eddddd640 1 -- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ed80ca9d0 msgr2=0x7f1ed80c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1eddddd640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ed80ca9d0 0x7f1ed80c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1eddddd640 1 -- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed8159c60 msgr2=0x7f1ed80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.519+0000 7f1eddddd640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed8159c60 0x7f1ed80b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1eddddd640 1 -- 172.21.15.133:0/2475130526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec800b6c0 con 0x7f1ed80afed0 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1edd5dc640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ed80ca9d0 0x7f1ed80c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ede5de640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed8159c60 0x7f1ed80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1eddddd640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80c60c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400c500 tx=0x7f1ed400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ece7fc640 1 -- 172.21.15.133:0/2475130526 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4005cf0 con 0x7f1ed80afed0 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ece7fc640 1 -- 172.21.15.133:0/2475130526 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed4005e50 con 0x7f1ed80afed0 2023-12-18T10:21:57.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ece7fc640 1 -- 172.21.15.133:0/2475130526 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40072f0 con 0x7f1ed80afed0 2023-12-18T10:21:57.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed80b28b0 con 0x7f1ed80afed0 2023-12-18T10:21:57.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed80b2e70 con 0x7f1ed80afed0 2023-12-18T10:21:57.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed815ae60 con 0x7f1ed80afed0 2023-12-18T10:21:57.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ece7fc640 1 -- 172.21.15.133:0/2475130526 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ed4007450 con 0x7f1ed80afed0 2023-12-18T10:21:57.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ece7fc640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ebc065a60 0x7f1ebc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1ece7fc640 1 -- 172.21.15.133:0/2475130526 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1ed4082740 con 0x7f1ed80afed0 2023-12-18T10:21:57.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.523+0000 7f1edd5dc640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ebc065a60 0x7f1ebc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.527+0000 7f1edd5dc640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ebc065a60 0x7f1ebc067f20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80b1000 tx=0x7f1ec80a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.527+0000 7f1ece7fc640 1 -- 172.21.15.133:0/2475130526 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1ed815ae60 con 0x7f1ed80afed0 2023-12-18T10:21:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.731+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1ed815ae60 con 0x7f1ed80afed0 2023-12-18T10:21:57.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ece7fc640 1 -- 172.21.15.133:0/2475130526 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1ed815ae60 con 0x7f1ed80afed0 2023-12-18T10:21:57.739 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ebc065a60 msgr2=0x7f1ebc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ebc065a60 0x7f1ebc067f20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80b1000 tx=0x7f1ec80a9070 comp rx=0 tx=0).stop 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 msgr2=0x7f1ed80c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80c60c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1ed400c500 tx=0x7f1ed400c9c0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 shutdown_connections 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ebc065a60 0x7f1ebc067f20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ed8159c60 0x7f1ed80b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ed80ca9d0 0x7f1ed80c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 --2- 172.21.15.133:0/2475130526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ed80afed0 0x7f1ed80c60c0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 >> 172.21.15.133:0/2475130526 conn(0x7f1ed80ce450 msgr2=0x7f1ed8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 shutdown_connections 2023-12-18T10:21:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.735+0000 7f1ee0041640 1 -- 172.21.15.133:0/2475130526 wait complete. 2023-12-18T10:21:57.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:21:57.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0f620640 1 Processor -- start 2023-12-18T10:21:57.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0f620640 1 -- start start 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0f620640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f080d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0f620640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f080cd730 0x7f6f080d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0f620640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f080d1320 con 0x7f6f08157080 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0f620640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f08157460 con 0x7f6f080cd730 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0f620640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080cc970 con 0x7f6f080ce920 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0dbbd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f080cd730 0x7f6f080d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0dbbd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f080cd730 0x7f6f080d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59720/0 (socket says 172.21.15.133:59720) 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0dbbd640 1 -- 172.21.15.133:0/1459911394 learned_addr learned my addr 172.21.15.133:0/1459911394 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0cbbb640 1 --2- 172.21.15.133:0/1459911394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f080d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0dbbd640 1 -- 172.21.15.133:0/1459911394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 msgr2=0x7f6f080d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0dbbd640 1 --2- 172.21.15.133:0/1459911394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f080d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0dbbd640 1 -- 172.21.15.133:0/1459911394 >> v1:172.21.15.142:6789/0 conn(0x7f6f08157080 legacy=0x7f6f080ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0dbbd640 1 -- 172.21.15.133:0/1459911394 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080ccc50 con 0x7f6f080cd730 2023-12-18T10:21:57.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.895+0000 7f6f0cbbb640 1 --2- 172.21.15.133:0/1459911394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f080d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:57.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0dbbd640 1 --2- 172.21.15.133:0/1459911394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f080cd730 0x7f6f080d0af0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6f00009e50 tx=0x7f6f0001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6247e297b1bcb359 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6efffff640 1 -- 172.21.15.133:0/1459911394 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000a58a0 con 0x7f6f080cd730 2023-12-18T10:21:57.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6efffff640 1 -- 172.21.15.133:0/1459911394 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f000a5a00 con 0x7f6f080cd730 2023-12-18T10:21:57.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6efffff640 1 -- 172.21.15.133:0/1459911394 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000a5d90 con 0x7f6f080cd730 2023-12-18T10:21:57.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0f620640 1 -- 172.21.15.133:0/1459911394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f080cd730 msgr2=0x7f6f080d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0f620640 1 --2- 172.21.15.133:0/1459911394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f080cd730 0x7f6f080d0af0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6f00009e50 tx=0x7f6f0001c9e0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0f620640 1 -- 172.21.15.133:0/1459911394 shutdown_connections 2023-12-18T10:21:57.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0f620640 1 --2- 172.21.15.133:0/1459911394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f080cd730 0x7f6f080d0af0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0f620640 1 --2- 172.21.15.133:0/1459911394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f080d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0f620640 1 -- 172.21.15.133:0/1459911394 >> 172.21.15.133:0/1459911394 conn(0x7f6f08069ca0 msgr2=0x7f6f0806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:57.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0f620640 1 -- 172.21.15.133:0/1459911394 shutdown_connections 2023-12-18T10:21:57.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.899+0000 7f6f0f620640 1 -- 172.21.15.133:0/1459911394 wait complete. 2023-12-18T10:21:57.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 Processor -- start 2023-12-18T10:21:57.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 -- start start 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f080cd730 0x7f6f080c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f08145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f08157080 0x7f6f08145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0814a620 con 0x7f6f08157080 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08149a10 con 0x7f6f080cd730 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08149cf0 con 0x7f6f080ce920 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f08157080 0x7f6f08145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f08157080 0x7f6f08145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59726/0 (socket says 172.21.15.133:59726) 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 -- 172.21.15.133:0/4236457245 learned_addr learned my addr 172.21.15.133:0/4236457245 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:57.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0d3bc640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f080cd730 0x7f6f080c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0cbbb640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f08145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 -- 172.21.15.133:0/4236457245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 msgr2=0x7f6f08145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f08145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 -- 172.21.15.133:0/4236457245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f080cd730 msgr2=0x7f6f080c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f080cd730 0x7f6f080c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:57.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 -- 172.21.15.133:0/4236457245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00009b30 con 0x7f6f08157080 2023-12-18T10:21:57.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0dbbd640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f08157080 0x7f6f08145c60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6f000af040 tx=0x7f6f00019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6efdffb640 1 -- 172.21.15.133:0/4236457245 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000b8670 con 0x7f6f08157080 2023-12-18T10:21:57.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6efdffb640 1 -- 172.21.15.133:0/4236457245 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f000b87d0 con 0x7f6f08157080 2023-12-18T10:21:57.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6efdffb640 1 -- 172.21.15.133:0/4236457245 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000b8b80 con 0x7f6f08157080 2023-12-18T10:21:57.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f08149fd0 con 0x7f6f08157080 2023-12-18T10:21:57.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f080c3df0 con 0x7f6f08157080 2023-12-18T10:21:57.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.903+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f080c4150 con 0x7f6f08157080 2023-12-18T10:21:57.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.907+0000 7f6efdffb640 1 -- 172.21.15.133:0/4236457245 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f000b8ce0 con 0x7f6f08157080 2023-12-18T10:21:57.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.907+0000 7f6efdffb640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6eec065a60 0x7f6eec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:57.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.907+0000 7f6efdffb640 1 -- 172.21.15.133:0/4236457245 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6f0011e900 con 0x7f6f08157080 2023-12-18T10:21:57.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.907+0000 7f6f0d3bc640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6eec065a60 0x7f6eec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:57.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.907+0000 7f6f0d3bc640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6eec065a60 0x7f6eec067f20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6f08156250 tx=0x7f6f04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:57.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:57.911+0000 7f6efdffb640 1 -- 172.21.15.133:0/4236457245 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6f000ec340 con 0x7f6f08157080 2023-12-18T10:21:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.091+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f0804e000 con 0x7f6f08157080 2023-12-18T10:21:58.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6efdffb640 1 -- 172.21.15.133:0/4236457245 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f6f000bc090 con 0x7f6f08157080 2023-12-18T10:21:58.098 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:21:58.098 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":50,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:21:51.415675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:21:58.099 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 50 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6eec065a60 msgr2=0x7f6eec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6eec065a60 0x7f6eec067f20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6f08156250 tx=0x7f6f04009040 comp rx=0 tx=0).stop 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f08157080 msgr2=0x7f6f08145c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f08157080 0x7f6f08145c60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6f000af040 tx=0x7f6f00019780 comp rx=0 tx=0).stop 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 shutdown_connections 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6eec065a60 0x7f6eec067f20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f08157080 0x7f6f08145c60 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f080ce920 0x7f6f08145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 --2- 172.21.15.133:0/4236457245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f080cd730 0x7f6f080c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 >> 172.21.15.133:0/4236457245 conn(0x7f6f08069ca0 msgr2=0x7f6f08155220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:58.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 shutdown_connections 2023-12-18T10:21:58.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.095+0000 7f6f0f620640 1 -- 172.21.15.133:0/4236457245 wait complete. 2023-12-18T10:21:58.507 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:21:58.511 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:21:58.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:21:48.401032+0000', 'modified': '2023-12-18T10:21:51.415675+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6867}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6867': {'gid': 6867, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/900380605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 900380605}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 900380605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:21:58.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-18T10:21:58.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-18T10:21:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4bad2c640 1 Processor -- start 2023-12-18T10:21:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4bad2c640 1 -- start start 2023-12-18T10:21:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4bad2c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4b406c4f0 0x7ff4b40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4bad2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c9e30 0x7ff4b4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4bad2c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b40c9460 con 0x7ff4b41570c0 2023-12-18T10:21:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4bad2c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b41574a0 con 0x7ff4b406c4f0 2023-12-18T10:21:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4bad2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40c8b30 con 0x7ff4b40c9e30 2023-12-18T10:21:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4b8ac8640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff4b41570c0 0x7ff4b406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54142/0 (socket says 172.21.15.133:54142) 2023-12-18T10:21:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2972659331 learned_addr learned my addr 172.21.15.133:0/2972659331 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c9e30 0x7ff4b4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4abfff640 1 --2- 172.21.15.133:0/2972659331 >> v2:172.21.15.142:3300/0 conn(0x7ff4b406c4f0 0x7ff4b40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697405828 0 0) 0x7ff4b40c9460 con 0x7ff4b41570c0 2023-12-18T10:21:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.687+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49c003530 con 0x7ff4b41570c0 2023-12-18T10:21:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1913490520 0 0) 0x7ff49c003530 con 0x7ff4b41570c0 2023-12-18T10:21:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c9e30 msgr2=0x7ff4b4070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c9e30 0x7ff4b4070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 >> v2:172.21.15.142:3300/0 conn(0x7ff4b406c4f0 msgr2=0x7ff4b40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 --2- 172.21.15.133:0/2972659331 >> v2:172.21.15.142:3300/0 conn(0x7ff4b406c4f0 0x7ff4b40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40c8e10 con 0x7ff4b41570c0 2023-12-18T10:21:58.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7ff4b0001680 con 0x7ff4b41570c0 2023-12-18T10:21:58.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 >> v1:172.21.15.133:6789/0 conn(0x7ff4b41570c0 legacy=0x7ff4b406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c003980 0x7ff49c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c9e30 0x7ff49c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c0042e0 0x7ff49c004d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41574a0 con 0x7ff49c003980 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40c8b30 con 0x7ff49c0042e0 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c005610 con 0x7ff4b40c9e30 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c003980 0x7ff49c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4abfff640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c9e30 0x7ff49c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c0042e0 0x7ff49c004d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c9e30 msgr2=0x7ff49c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c9e30 0x7ff49c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c0042e0 msgr2=0x7ff49c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c0042e0 0x7ff49c004d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2972659331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c003530 con 0x7ff49c003980 2023-12-18T10:21:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c0042e0 0x7ff49c004d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c003980 0x7ff49c003da0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c240 tx=0x7ff4b001ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e86506d6dfc9f4c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00058e0 con 0x7ff49c003980 2023-12-18T10:21:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b0005a40 con 0x7ff49c003980 2023-12-18T10:21:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.691+0000 7ff4ab7fe640 1 -- 172.21.15.133:0/2972659331 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0005e10 con 0x7ff49c003980 2023-12-18T10:21:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- 172.21.15.133:0/2972659331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c003980 msgr2=0x7ff49c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 --2- 172.21.15.133:0/2972659331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c003980 0x7ff49c003da0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c240 tx=0x7ff4b001ccd0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4b92c9640 1 -- 172.21.15.133:0/2972659331 reap_dead start 2023-12-18T10:21:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- 172.21.15.133:0/2972659331 shutdown_connections 2023-12-18T10:21:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- 172.21.15.133:0/2972659331 >> 172.21.15.133:0/2972659331 conn(0x7ff4b406a3e0 msgr2=0x7ff4b40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- 172.21.15.133:0/2972659331 shutdown_connections 2023-12-18T10:21:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- 172.21.15.133:0/2972659331 wait complete. 2023-12-18T10:21:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 Processor -- start 2023-12-18T10:21:58.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- start start 2023-12-18T10:21:58.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c003980 0x7ff4b414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c47b0 0x7ff4b414b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c23c0 0x7ff4b40c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40c2d80 con 0x7ff4b40c47b0 2023-12-18T10:21:58.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40c6680 con 0x7ff49c003980 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4bad2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b414e2d0 con 0x7ff4b40c23c0 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c47b0 0x7ff4b414b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c47b0 0x7ff4b414b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59742/0 (socket says 172.21.15.133:59742) 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4abfff640 1 -- 172.21.15.133:0/1141353958 learned_addr learned my addr 172.21.15.133:0/1141353958 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c003980 0x7ff4b414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.695+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c23c0 0x7ff4b40c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4abfff640 1 -- 172.21.15.133:0/1141353958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c23c0 msgr2=0x7ff4b40c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4abfff640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c23c0 0x7ff4b40c2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4abfff640 1 -- 172.21.15.133:0/1141353958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c003980 msgr2=0x7ff4b414edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4abfff640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c003980 0x7ff4b414edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4abfff640 1 -- 172.21.15.133:0/1141353958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b414e5b0 con 0x7ff4b40c47b0 2023-12-18T10:21:58.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4abfff640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c47b0 0x7ff4b414b730 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40119d0 tx=0x7ff4a4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4a97fa640 1 -- 172.21.15.133:0/1141353958 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400fad0 con 0x7ff4b40c47b0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4a97fa640 1 -- 172.21.15.133:0/1141353958 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400fc30 con 0x7ff4b40c47b0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4a97fa640 1 -- 172.21.15.133:0/1141353958 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4014440 con 0x7ff4b40c47b0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4bad2c640 1 -- 172.21.15.133:0/1141353958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b414e890 con 0x7ff4b40c47b0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4bad2c640 1 -- 172.21.15.133:0/1141353958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b40c6300 con 0x7ff4b40c47b0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4a97fa640 1 -- 172.21.15.133:0/1141353958 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff4a40145a0 con 0x7ff4b40c47b0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4a97fa640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff4a0065a90 0x7ff4a0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.699+0000 7ff4a97fa640 1 -- 172.21.15.133:0/1141353958 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff4a4083920 con 0x7ff4b40c47b0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff4a0065a90 0x7ff4a0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 Processor -- start 2023-12-18T10:21:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- start start 2023-12-18T10:21:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff4a0065a90 0x7ff4a0067f50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00ab000 tx=0x7ff4b0001a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648bba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba990 0x561648b6fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b701c0 0x561648b705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561648993c90 con 0x561648bba070 2023-12-18T10:21:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616489c5220 con 0x561648bba990 2023-12-18T10:21:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616489c27f0 con 0x561648b701c0 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648bba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648bba450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59756/0 (socket says 172.21.15.133:59756) 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2474656382 learned_addr learned my addr 172.21.15.133:0/2474656382 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b701c0 0x561648b705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b701c0 msgr2=0x561648b705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4abfff640 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba990 0x561648b6fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b701c0 0x561648b705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba990 msgr2=0x561648b6fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba990 0x561648b6fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2474656382 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616486ba890 con 0x561648bba070 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4abfff640 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba990 0x561648b6fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648bba450 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00ac040 tx=0x7ff4b40c93d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1973b351910b48 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff49affd640 1 -- 172.21.15.133:0/2474656382 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00b5070 con 0x561648bba070 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff49affd640 1 -- 172.21.15.133:0/2474656382 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b00047f0 con 0x561648bba070 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff49affd640 1 -- 172.21.15.133:0/2474656382 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0004b60 con 0x561648bba070 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- 172.21.15.133:0/2474656382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 msgr2=0x561648bba450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648bba450 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00ac040 tx=0x7ff4b40c93d0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- 172.21.15.133:0/2474656382 shutdown_connections 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b701c0 0x561648b705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba990 0x561648b6fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2474656382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648bba450 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- 172.21.15.133:0/2474656382 >> 172.21.15.133:0/2474656382 conn(0x561648b76950 msgr2=0x561648b6e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- 172.21.15.133:0/2474656382 shutdown_connections 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.703+0000 7ff4be07d000 1 -- 172.21.15.133:0/2474656382 wait complete. 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 -- start start 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 Processor -- start 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648bc17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 0x561648bc1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648bba990 0x561648ba8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616489be0e0 con 0x561648b701c0 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164895d310 con 0x561648bba070 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56164897b770 con 0x561648bba990 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 10 client.0 _ll_register_callbacks cb 0x561648b5bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648bc17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648bc17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59762/0 (socket says 172.21.15.133:59762) 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/1189422407 learned_addr learned my addr 172.21.15.133:0/1189422407 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4abfff640 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 0x561648bc1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648bba990 0x561648ba8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648bba990 msgr2=0x561648ba8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648bba990 0x561648ba8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 msgr2=0x561648bc1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 0x561648bc1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/1189422407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c003530 con 0x561648b701c0 2023-12-18T10:21:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648bba990 0x561648ba8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648bc17f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff4b001c740 tx=0x7ff4b0019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9539b5622a81f8f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4937fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4937fe640 1 -- 172.21.15.133:0/1189422407 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00a6810 con 0x561648b701c0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 -- 172.21.15.133:0/1189422407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56164898dc10 con 0x561648b701c0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4937fe640 1 -- 172.21.15.133:0/1189422407 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff4b00a6970 con 0x561648b701c0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4937fe640 1 -- 172.21.15.133:0/1189422407 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4b00a6b30 con 0x561648b701c0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 10 client.7029 fetch_fsmap learned FSMap version 50 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 -- 172.21.15.133:0/1189422407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x561648983260 con 0x561648b701c0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4937fe640 1 -- 172.21.15.133:0/1189422407 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56164898dc10 con 0x561648b701c0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4937fe640 1 -- 172.21.15.133:0/1189422407 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 50) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff4b00cd030 con 0x561648b701c0 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 10 client.7029 fetch_fsmap finished waiting for FSMap version 50 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 10 client.7029 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:21:58.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 20 client.7029 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x561648ba8dd0 0x561648ba91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 4 client.7029 mds_command: new command op to 6867 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4be07d000 1 -- 172.21.15.133:0/1189422407 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616489bca30 con 0x561648ba8dd0 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.707+0000 7ff4abfff640 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x561648ba8dd0 0x561648ba91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4937fe640 10 client.7029 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4abfff640 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x561648ba8dd0 0x561648ba91b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e45a4cde37738e8a server_cookie=9a3bb59f2335885b in_seq=0 out_seq=0 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4937fe640 1 -- 172.21.15.133:0/1189422407 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5616489bca30 con 0x561648ba8dd0 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4937fe640 10 client.7029 handle_command_reply: tid=0 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 client.7029 shutdown 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 -- 172.21.15.133:0/1189422407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 msgr2=0x561648bc17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648bc17f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff4b001c740 tx=0x7ff4b0019a70 comp rx=0 tx=0).stop 2023-12-18T10:21:58.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 -- 172.21.15.133:0/1189422407 shutdown_connections 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x561648ba8dd0 0x561648ba91b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648bba990 0x561648ba8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 0x561648bc1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4937fe640 0 client.7029 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 --2- 172.21.15.133:0/1189422407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648bc17f0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 -- 172.21.15.133:0/1189422407 >> 172.21.15.133:0/1189422407 conn(0x561648b76950 msgr2=0x561648b6ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 -- 172.21.15.133:0/1189422407 shutdown_connections 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 1 -- 172.21.15.133:0/1189422407 wait complete. 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.711+0000 7ff4be07d000 20 client.7029 trim_cache size 0 max 16384 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 Processor -- start 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- start start 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 0x561648c12710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648b701c0 0x561648c12c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648c13190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164867b940 con 0x561648bba070 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616489c64b0 con 0x561648b701c0 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616489bb8f0 con 0x561648b76950 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648c13190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648c13190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59766/0 (socket says 172.21.15.133:59766) 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 -- 172.21.15.133:0/2816685996 learned_addr learned my addr 172.21.15.133:0/2816685996 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 0x561648c12710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4abfff640 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648b701c0 0x561648c12c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 -- 172.21.15.133:0/2816685996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 msgr2=0x561648c12710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 0x561648c12710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 -- 172.21.15.133:0/2816685996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648b701c0 msgr2=0x561648c12c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648b701c0 0x561648c12c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 -- 172.21.15.133:0/2816685996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616489693b0 con 0x561648bba070 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648c13190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40addd0 tx=0x7ff4ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1d629c29f80903 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff49b7fe640 1 -- 172.21.15.133:0/2816685996 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0039a0 con 0x561648bba070 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff49b7fe640 1 -- 172.21.15.133:0/2816685996 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac011040 con 0x561648bba070 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff49b7fe640 1 -- 172.21.15.133:0/2816685996 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac003d60 con 0x561648bba070 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- 172.21.15.133:0/2816685996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 msgr2=0x561648c13190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648c13190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40addd0 tx=0x7ff4ac00b040 comp rx=0 tx=0).stop 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- 172.21.15.133:0/2816685996 shutdown_connections 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648bba070 0x561648c13190 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648b701c0 0x561648c12c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2816685996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 0x561648c12710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- 172.21.15.133:0/2816685996 >> 172.21.15.133:0/2816685996 conn(0x561648bb97f0 msgr2=0x561648ba5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- 172.21.15.133:0/2816685996 shutdown_connections 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- 172.21.15.133:0/2816685996 wait complete. 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 -- start start 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.727+0000 7ff4be07d000 1 Processor -- start 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648c16620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 0x561648bcce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 0x561648bcd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561648b72d70 con 0x561648b701c0 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164898ba80 con 0x561648bba070 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616489b9a50 con 0x561648b76950 2023-12-18T10:21:58.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 10 client.0 _ll_register_callbacks cb 0x56164896c640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648c16620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648c16620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59778/0 (socket says 172.21.15.133:59778) 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2615977668 learned_addr learned my addr 172.21.15.133:0/2615977668 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4abfff640 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 0x561648bcce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b92c9640 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 0x561648bcd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 msgr2=0x561648bcce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 0x561648bcce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 msgr2=0x561648bcd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 0x561648bcd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 -- 172.21.15.133:0/2615977668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616486bacc0 con 0x561648b701c0 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4b8ac8640 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648c16620 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00ac040 tx=0x7ff4b00a8070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541ee4969fe873e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:21:58.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 1 -- 172.21.15.133:0/2615977668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00a6c20 con 0x561648b701c0 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 1 -- 172.21.15.133:0/2615977668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff4b0007120 con 0x561648b701c0 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- 172.21.15.133:0/2615977668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561648b743e0 con 0x561648b701c0 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 1 -- 172.21.15.133:0/2615977668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4b00072e0 con 0x561648b701c0 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 10 client.7035 fetch_fsmap learned FSMap version 50 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- 172.21.15.133:0/2615977668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x5616488eba50 con 0x561648b701c0 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 1 -- 172.21.15.133:0/2615977668 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561648b743e0 con 0x561648b701c0 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 1 -- 172.21.15.133:0/2615977668 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 50) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff4b00cd040 con 0x561648b701c0 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 10 client.7035 fetch_fsmap finished waiting for FSMap version 50 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 10 client.7035 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 20 client.7035 populate_metadata read hostname 'smithi133' 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x561648bba990 0x561648bcd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:58.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 4 client.7035 mds_command: new command op to 6867 tid=0[{"prefix": "status"}] 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- 172.21.15.133:0/2615977668 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561648983e00 con 0x561648bba990 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4abfff640 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x561648bba990 0x561648bcd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 10 client.7035 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4abfff640 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x561648bba990 0x561648bcd8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad5ac81310a24d80 server_cookie=46b595075bc0f826 in_seq=0 out_seq=0 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 1 -- 172.21.15.133:0/2615977668 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x561648983e00 con 0x561648bba990 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 10 client.7035 handle_command_reply: tid=0 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 client.7035 shutdown 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- 172.21.15.133:0/2615977668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 msgr2=0x561648c16620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648c16620 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00ac040 tx=0x7ff4b00a8070 comp rx=0 tx=0).stop 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- 172.21.15.133:0/2615977668 shutdown_connections 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x561648bba990 0x561648bcd8d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561648bba070 0x561648bcd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561648b76950 0x561648bcce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 --2- 172.21.15.133:0/2615977668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561648b701c0 0x561648c16620 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4937fe640 0 client.7035 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- 172.21.15.133:0/2615977668 >> 172.21.15.133:0/2615977668 conn(0x561648bb97f0 msgr2=0x561648ba5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.731+0000 7ff4be07d000 1 -- 172.21.15.133:0/2615977668 shutdown_connections 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4be07d000 1 -- 172.21.15.133:0/2615977668 wait complete. 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4be07d000 20 client.7035 trim_cache size 0 max 16384 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:21:58.859 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6867, 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 10.33351931, 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 50, 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 65, 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 65, 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 14.612252692 2023-12-18T10:21:58.860 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:21:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 -- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff4a0065a90 msgr2=0x7ff4a0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff4a0065a90 0x7ff4a0067f50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00ab000 tx=0x7ff4b0001a10 comp rx=0 tx=0).stop 2023-12-18T10:21:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 -- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c47b0 msgr2=0x7ff4b414b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c47b0 0x7ff4b414b730 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40119d0 tx=0x7ff4a4011e90 comp rx=0 tx=0).stop 2023-12-18T10:21:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 -- 172.21.15.133:0/1141353958 shutdown_connections 2023-12-18T10:21:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff4a0065a90 0x7ff4a0067f50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff4b40c23c0 0x7ff4b40c2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c47b0 0x7ff4b414b730 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 --2- 172.21.15.133:0/1141353958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff49c003980 0x7ff4b414edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 -- 172.21.15.133:0/1141353958 >> 172.21.15.133:0/1141353958 conn(0x7ff4b406a3e0 msgr2=0x7ff4b414c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 -- 172.21.15.133:0/1141353958 shutdown_connections 2023-12-18T10:21:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.735+0000 7ff4bad2c640 1 -- 172.21.15.133:0/1141353958 wait complete. 2023-12-18T10:21:58.863 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:21:59.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.995+0000 7f124d82d640 1 Processor -- start 2023-12-18T10:21:59.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.995+0000 7f124d82d640 1 -- start start 2023-12-18T10:21:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f124d82d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f124815a680 0x7f124815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f124d82d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124806fdb0 0x7f1248070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f124d82d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124815f100 con 0x7f12480cac10 2023-12-18T10:21:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f124d82d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1248070780 con 0x7f124815a680 2023-12-18T10:21:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f124d82d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12480ca7d0 con 0x7f124806fdb0 2023-12-18T10:21:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f123e7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f12480cac10 0x7f124815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54146/0 (socket says 172.21.15.133:54146) 2023-12-18T10:21:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f123e7fc640 1 -- 172.21.15.133:0/2691590917 learned_addr learned my addr 172.21.15.133:0/2691590917 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:21:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f12477fe640 1 --2- 172.21.15.133:0/2691590917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124806fdb0 0x7f1248070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f1246ffd640 1 --2- 172.21.15.133:0/2691590917 >> v2:172.21.15.142:3300/0 conn(0x7f124815a680 0x7f124815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f12467fc640 1 -- 172.21.15.133:0/2691590917 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275105286 0 0) 0x7f124815f100 con 0x7f12480cac10 2023-12-18T10:21:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f12467fc640 1 -- 172.21.15.133:0/2691590917 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1234003530 con 0x7f12480cac10 2023-12-18T10:21:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f12467fc640 1 -- 172.21.15.133:0/2691590917 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485386087 0 0) 0x7f1234003530 con 0x7f12480cac10 2023-12-18T10:21:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f12477fe640 1 -- 172.21.15.133:0/2691590917 >> v2:172.21.15.142:3300/0 conn(0x7f124815a680 msgr2=0x7f124815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:21:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f12477fe640 1 --2- 172.21.15.133:0/2691590917 >> v2:172.21.15.142:3300/0 conn(0x7f124815a680 0x7f124815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f12477fe640 1 -- 172.21.15.133:0/2691590917 >> v1:172.21.15.133:6789/0 conn(0x7f12480cac10 legacy=0x7f124815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:58.999+0000 7f12477fe640 1 -- 172.21.15.133:0/2691590917 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124815e860 con 0x7f124806fdb0 2023-12-18T10:21:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f12477fe640 1 --2- 172.21.15.133:0/2691590917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124806fdb0 0x7f1248070240 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12400097f0 tx=0x7f124001c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c65571588db66903 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f12467fc640 1 -- 172.21.15.133:0/2691590917 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230001a00 con 0x7f124806fdb0 2023-12-18T10:21:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f12467fc640 1 -- 172.21.15.133:0/2691590917 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12400a7050 con 0x7f124806fdb0 2023-12-18T10:21:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f12467fc640 1 -- 172.21.15.133:0/2691590917 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12400ab600 con 0x7f124806fdb0 2023-12-18T10:21:59.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 -- 172.21.15.133:0/2691590917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124806fdb0 msgr2=0x7f1248070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:59.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 --2- 172.21.15.133:0/2691590917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124806fdb0 0x7f1248070240 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12400097f0 tx=0x7f124001c310 comp rx=0 tx=0).stop 2023-12-18T10:21:59.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 -- 172.21.15.133:0/2691590917 shutdown_connections 2023-12-18T10:21:59.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 --2- 172.21.15.133:0/2691590917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124806fdb0 0x7f1248070240 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 --2- 172.21.15.133:0/2691590917 >> v2:172.21.15.142:3300/0 conn(0x7f124815a680 0x7f124815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 -- 172.21.15.133:0/2691590917 >> 172.21.15.133:0/2691590917 conn(0x7f124806a3e0 msgr2=0x7f12480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 -- 172.21.15.133:0/2691590917 shutdown_connections 2023-12-18T10:21:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 -- 172.21.15.133:0/2691590917 wait complete. 2023-12-18T10:21:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 Processor -- start 2023-12-18T10:21:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.003+0000 7f124d82d640 1 -- start start 2023-12-18T10:21:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124806fdb0 0x7f1248155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12480cac10 0x7f12480c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124815a680 0x7f12481587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248156320 con 0x7f124806fdb0 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12480c1c10 con 0x7f12480cac10 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12480cd950 con 0x7f124815a680 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124806fdb0 0x7f1248155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f123e7fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12480cac10 0x7f12480c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f12477fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124815a680 0x7f12481587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124806fdb0 0x7f1248155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59794/0 (socket says 172.21.15.133:59794) 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 -- 172.21.15.133:0/1552480579 learned_addr learned my addr 172.21.15.133:0/1552480579 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 -- 172.21.15.133:0/1552480579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124815a680 msgr2=0x7f12481587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124815a680 0x7f12481587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 -- 172.21.15.133:0/1552480579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12480cac10 msgr2=0x7f12480c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12480cac10 0x7f12480c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 -- 172.21.15.133:0/1552480579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240009420 con 0x7f124806fdb0 2023-12-18T10:21:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1246ffd640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124806fdb0 0x7f1248155de0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f123800e930 tx=0x7f123800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1244ff9640 1 -- 172.21.15.133:0/1552480579 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238009690 con 0x7f124806fdb0 2023-12-18T10:21:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1244ff9640 1 -- 172.21.15.133:0/1552480579 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123800ca00 con 0x7f124806fdb0 2023-12-18T10:21:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1248155300 con 0x7f124806fdb0 2023-12-18T10:21:59.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1244ff9640 1 -- 172.21.15.133:0/1552480579 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123800cd70 con 0x7f124806fdb0 2023-12-18T10:21:59.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12481558c0 con 0x7f124806fdb0 2023-12-18T10:21:59.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12480735b0 con 0x7f124806fdb0 2023-12-18T10:21:59.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.007+0000 7f1244ff9640 1 -- 172.21.15.133:0/1552480579 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1238013470 con 0x7f124806fdb0 2023-12-18T10:21:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.011+0000 7f1244ff9640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1228065a60 0x7f1228067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:21:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.011+0000 7f1244ff9640 1 -- 172.21.15.133:0/1552480579 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1238083520 con 0x7f124806fdb0 2023-12-18T10:21:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.011+0000 7f123e7fc640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1228065a60 0x7f1228067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:21:59.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.011+0000 7f123e7fc640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1228065a60 0x7f1228067f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f12480c7980 tx=0x7f1230009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:21:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.015+0000 7f1244ff9640 1 -- 172.21.15.133:0/1552480579 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1238050f00 con 0x7f124806fdb0 2023-12-18T10:21:59.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f124804e000 con 0x7f124806fdb0 2023-12-18T10:21:59.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f1244ff9640 1 -- 172.21.15.133:0/1552480579 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1238054520 con 0x7f124806fdb0 2023-12-18T10:21:59.202 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-18T10:21:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1228065a60 msgr2=0x7f1228067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1228065a60 0x7f1228067f20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f12480c7980 tx=0x7f1230009040 comp rx=0 tx=0).stop 2023-12-18T10:21:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124806fdb0 msgr2=0x7f1248155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:21:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124806fdb0 0x7f1248155de0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f123800e930 tx=0x7f123800edf0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 shutdown_connections 2023-12-18T10:21:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1228065a60 0x7f1228067f20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f124815a680 0x7f12481587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f12480cac10 0x7f12480c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 --2- 172.21.15.133:0/1552480579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124806fdb0 0x7f1248155de0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:21:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 >> 172.21.15.133:0/1552480579 conn(0x7f124806a3e0 msgr2=0x7f124815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:21:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 shutdown_connections 2023-12-18T10:21:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:21:59.199+0000 7f124d82d640 1 -- 172.21.15.133:0/1552480579 wait complete. 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:21:59.223 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:21:59.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:59.224 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:21:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41917sec preferred_lft 41917sec 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-18T10:21:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-18T10:21:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:21:59.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:59.238 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:21:59.300 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:21:59.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:59.302 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:21:59.355 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:21:59.355 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:21:59.355 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:21:59.355 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:21:59.355 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:21:59.355 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:21:59.355 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:21:59.356 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:21:59.356 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:21:59.356 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:21:59.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:59.356 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:21:59.356 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:21:59.356 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:21:59.356 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:21:59.356 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:21:59.356 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:21:59.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:59.447 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:21:59.457 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-18T10:21:59.457 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-18T10:21:59.457 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:21:59.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:59.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-18T10:21:59.521 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-18T10:21:59.521 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:21:59.521 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-18T10:21:59.573 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:21:59.573 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:21:59.574 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:21:59.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:21:59.685 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:21:59.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:21:59.751 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:21:59.753 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:21:59.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:59.753 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:21:59.809 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:21:59.809 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-18T10:21:59.860 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:21:59.881 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:21:59.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:21:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:21:59.946 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:21:59.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:21:59.946 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:21:59.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:2023-12-18T10:21:59.951+0000 7fd469821580 -1 init, newargv = 0x557e01135fe0 newargc=15 2023-12-18T10:21:59.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[54286]: starting ceph client 2023-12-18T10:21:59.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[54286]: starting fuse 2023-12-18T10:21:59.965 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:21:59.965 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:21:59.965 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:21:59.965 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:21:59.965 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:21:59.965 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:21:59.966 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:21:59.967 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:21:59.967 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:21:59.967 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:21:59.967 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:21:59.967 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:21:59.967 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:21:59.967 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.0")) 2023-12-18T10:21:59.967 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:22:00.092 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.0.54286.asok 2023-12-18T10:22:00.276 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54286.asok 2023-12-18T10:22:00.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:00.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54286.asok status 2023-12-18T10:22:00.445 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:00.445 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:22:00.445 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:22:00.445 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:22:00.445 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "0", 2023-12-18T10:22:00.445 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:22:00.445 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "54286", 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7050, 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 7050 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:22:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1164830580 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1164830580 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.7050 192.168.0.1:0/1164830580", 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/1164830580", 2023-12-18T10:22:00.447 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:22:00.448 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 50, 2023-12-18T10:22:00.448 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 65, 2023-12-18T10:22:00.448 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:22:00.448 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:22:00.448 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:22:00.448 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:00.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:00.460 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:22:00.460 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-18T10:22:00.470 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:22:00.470 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-18T10:22:00.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:00.470 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:22:00.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-18T10:22:00.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.715+0000 7f53799a2640 1 Processor -- start 2023-12-18T10:22:00.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.715+0000 7f53799a2640 1 -- start start 2023-12-18T10:22:00.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f53799a2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53740cb810 0x7f537415d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:00.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f53799a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537415d8c0 con 0x7f537406bdf0 2023-12-18T10:22:00.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f53799a2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537415dba0 con 0x7f537406c1d0 2023-12-18T10:22:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f53799a2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537415de80 con 0x7f53740cb810 2023-12-18T10:22:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f536bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53740cb810 0x7f537415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f536bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53740cb810 0x7f537415d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36590/0 (socket says 172.21.15.133:36590) 2023-12-18T10:22:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f536bfff640 1 -- 172.21.15.133:0/61399505 learned_addr learned my addr 172.21.15.133:0/61399505 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f536bfff640 1 -- 172.21.15.133:0/61399505 >> v1:172.21.15.142:6789/0 conn(0x7f537406c1d0 legacy=0x7f537414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f536bfff640 1 -- 172.21.15.133:0/61399505 >> v1:172.21.15.133:6789/0 conn(0x7f537406bdf0 legacy=0x7f53740c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f536bfff640 1 -- 172.21.15.133:0/61399505 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740c8880 con 0x7f53740cb810 2023-12-18T10:22:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.719+0000 7f536b7fe640 1 -- 172.21.15.133:0/61399505 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159813025 0 0) 0x7f537415d8c0 con 0x7f537406bdf0 2023-12-18T10:22:00.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f536bfff640 1 --2- 172.21.15.133:0/61399505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f537415d070 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5364009870 tx=0x7f536401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3f965bd4564f10 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:00.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f536b7fe640 1 -- 172.21.15.133:0/61399505 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640ab600 con 0x7f53740cb810 2023-12-18T10:22:00.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f536b7fe640 1 -- 172.21.15.133:0/61399505 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53640ab760 con 0x7f53740cb810 2023-12-18T10:22:00.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f536b7fe640 1 -- 172.21.15.133:0/61399505 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640abaf0 con 0x7f53740cb810 2023-12-18T10:22:00.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 -- 172.21.15.133:0/61399505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 msgr2=0x7f537415d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:00.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 --2- 172.21.15.133:0/61399505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f537415d070 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5364009870 tx=0x7f536401c440 comp rx=0 tx=0).stop 2023-12-18T10:22:00.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 -- 172.21.15.133:0/61399505 shutdown_connections 2023-12-18T10:22:00.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 --2- 172.21.15.133:0/61399505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f537415d070 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:00.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 -- 172.21.15.133:0/61399505 >> 172.21.15.133:0/61399505 conn(0x7f537406a2a0 msgr2=0x7f53740cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:00.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 -- 172.21.15.133:0/61399505 shutdown_connections 2023-12-18T10:22:00.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 -- 172.21.15.133:0/61399505 wait complete. 2023-12-18T10:22:00.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 Processor -- start 2023-12-18T10:22:00.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.723+0000 7f53799a2640 1 -- start start 2023-12-18T10:22:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f537406bdf0 0x7f5374153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f537406c1d0 0x7f53740c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f53740c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53740c7c60 con 0x7f53740cb810 2023-12-18T10:22:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53741f49d0 con 0x7f537406bdf0 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53741539d0 con 0x7f537406c1d0 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f53740c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f53740c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36602/0 (socket says 172.21.15.133:36602) 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 -- 172.21.15.133:0/2104778679 learned_addr learned my addr 172.21.15.133:0/2104778679 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53789a0640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f537406bdf0 0x7f5374153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f536bfff640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f537406c1d0 0x7f53740c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 -- 172.21.15.133:0/2104778679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f537406c1d0 msgr2=0x7f53740c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f537406c1d0 0x7f53740c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 -- 172.21.15.133:0/2104778679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f537406bdf0 msgr2=0x7f5374153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f537406bdf0 0x7f5374153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 -- 172.21.15.133:0/2104778679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640094d0 con 0x7f53740cb810 2023-12-18T10:22:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53791a1640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f53740c67f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f536c00c7b0 tx=0x7f536c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:00.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53697fa640 1 -- 172.21.15.133:0/2104778679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c004b70 con 0x7f53740cb810 2023-12-18T10:22:00.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53697fa640 1 -- 172.21.15.133:0/2104778679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c004cd0 con 0x7f53740cb810 2023-12-18T10:22:00.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53697fa640 1 -- 172.21.15.133:0/2104778679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c00aa90 con 0x7f53740cb810 2023-12-18T10:22:00.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53740c76a0 con 0x7f53740cb810 2023-12-18T10:22:00.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53741f4660 con 0x7f53740cb810 2023-12-18T10:22:00.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53741f44c0 con 0x7f53740cb810 2023-12-18T10:22:00.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.727+0000 7f53697fa640 1 -- 172.21.15.133:0/2104778679 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f536c00abf0 con 0x7f53740cb810 2023-12-18T10:22:00.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.731+0000 7f53697fa640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5360065a90 0x7f5360067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:00.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.731+0000 7f53697fa640 1 -- 172.21.15.133:0/2104778679 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f536c083490 con 0x7f53740cb810 2023-12-18T10:22:00.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.731+0000 7f53789a0640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5360065a90 0x7f5360067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:00.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.731+0000 7f53789a0640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5360065a90 0x7f5360067f50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5370000f70 tx=0x7f5370009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:00.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.735+0000 7f53697fa640 1 -- 172.21.15.133:0/2104778679 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f53741f44c0 con 0x7f53740cb810 2023-12-18T10:22:00.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.915+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f53741f44c0 con 0x7f53740cb810 2023-12-18T10:22:00.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.971+0000 7f53697fa640 1 -- 172.21.15.133:0/2104778679 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v51) v1 ==== 105+0+0 (secure 0 0 0) 0x7f53741f44c0 con 0x7f53740cb810 2023-12-18T10:22:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5360065a90 msgr2=0x7f5360067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5360065a90 0x7f5360067f50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5370000f70 tx=0x7f5370009040 comp rx=0 tx=0).stop 2023-12-18T10:22:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 msgr2=0x7f53740c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f53740c67f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f536c00c7b0 tx=0x7f536c00cc70 comp rx=0 tx=0).stop 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 shutdown_connections 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5360065a90 0x7f5360067f50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53740cb810 0x7f53740c67f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f537406c1d0 0x7f53740c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 --2- 172.21.15.133:0/2104778679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f537406bdf0 0x7f5374153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 >> 172.21.15.133:0/2104778679 conn(0x7f537406a2a0 msgr2=0x7f53740afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 shutdown_connections 2023-12-18T10:22:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:00.975+0000 7f53799a2640 1 -- 172.21.15.133:0/2104778679 wait complete. 2023-12-18T10:22:01.005 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:22:01.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f25384c4640 1 Processor -- start 2023-12-18T10:22:01.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f25384c4640 1 -- start start 2023-12-18T10:22:01.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f25384c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f25300cac10 0x7f253015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:01.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f25384c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253015f100 con 0x7f253006fdb0 2023-12-18T10:22:01.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f25384c4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25300ca7d0 con 0x7f253015a680 2023-12-18T10:22:01.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f25384c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253015e860 con 0x7f25300cac10 2023-12-18T10:22:01.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f2536a61640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f253006fdb0 0x7f25300c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51942/0 (socket says 172.21.15.133:51942) 2023-12-18T10:22:01.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f2536a61640 1 -- 172.21.15.133:0/3380289637 learned_addr learned my addr 172.21.15.133:0/3380289637 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:01.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f2535a5f640 1 --2- 172.21.15.133:0/3380289637 >> v2:172.21.15.142:3300/0 conn(0x7f25300cac10 0x7f253015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:01.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233301619 0 0) 0x7f253015f100 con 0x7f253006fdb0 2023-12-18T10:22:01.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251c003530 con 0x7f253006fdb0 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743074309 0 0) 0x7f25300ca7d0 con 0x7f253015a680 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f253015f100 con 0x7f253015a680 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3881097570 0 0) 0x7f251c003530 con 0x7f253006fdb0 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 >> v2:172.21.15.142:3300/0 conn(0x7f25300cac10 msgr2=0x7f253015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 --2- 172.21.15.133:0/3380289637 >> v2:172.21.15.142:3300/0 conn(0x7f25300cac10 0x7f253015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 >> v1:172.21.15.142:6789/0 conn(0x7f253015a680 legacy=0x7f253015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253015eb40 con 0x7f253006fdb0 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f2528001a00 con 0x7f253006fdb0 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f2535a5f640 1 --2- 172.21.15.133:0/3380289637 >> v2:172.21.15.142:3300/0 conn(0x7f25300cac10 0x7f253015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 >> v1:172.21.15.133:6789/0 conn(0x7f253006fdb0 legacy=0x7f25300c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f251c003b60 0x7f251c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f251c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:01.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f251c0051e0 0x7f251c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253015e860 con 0x7f251c0047d0 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c00c110 con 0x7f251c003b60 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.139+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c00c2d0 con 0x7f251c0051e0 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2535a5f640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f251c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2536a61640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f251c0051e0 0x7f251c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2536260640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f251c003b60 0x7f251c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2535a5f640 1 -- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f251c0051e0 msgr2=0x7f251c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2535a5f640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f251c0051e0 0x7f251c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2535a5f640 1 -- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f251c003b60 msgr2=0x7f251c003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2535a5f640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f251c003b60 0x7f251c003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2535a5f640 1 -- 172.21.15.133:0/3380289637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c003530 con 0x7f251c0047d0 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2536a61640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f251c0051e0 0x7f251c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:01.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2536a61640 1 -- 172.21.15.133:0/3380289637 reap_dead start 2023-12-18T10:22:01.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f2535a5f640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f251c004c50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f2520009cb0 tx=0x7f252001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd8528552c59f23 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200a5770 con 0x7f251c0047d0 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25200a58d0 con 0x7f251c0047d0 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.143+0000 7f253525e640 1 -- 172.21.15.133:0/3380289637 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200a5cc0 con 0x7f251c0047d0 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- 172.21.15.133:0/3380289637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 msgr2=0x7f251c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f251c004c50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f2520009cb0 tx=0x7f252001cbc0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- 172.21.15.133:0/3380289637 shutdown_connections 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 --2- 172.21.15.133:0/3380289637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f251c004c50 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- 172.21.15.133:0/3380289637 >> 172.21.15.133:0/3380289637 conn(0x7f253006a3e0 msgr2=0x7f25300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- 172.21.15.133:0/3380289637 shutdown_connections 2023-12-18T10:22:01.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- 172.21.15.133:0/3380289637 wait complete. 2023-12-18T10:22:01.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 Processor -- start 2023-12-18T10:22:01.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- start start 2023-12-18T10:22:01.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f25300c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:01.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25301ebdc0 0x7f25300c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:01.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25300c6de0 0x7f25301f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:01.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300c7290 con 0x7f251c0047d0 2023-12-18T10:22:01.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300c48a0 con 0x7f25300c6de0 2023-12-18T10:22:01.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f25384c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2530148040 con 0x7f25301ebdc0 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536260640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f25300c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536260640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f25300c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36630/0 (socket says 172.21.15.133:36630) 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536260640 1 -- 172.21.15.133:0/2551708271 learned_addr learned my addr 172.21.15.133:0/2551708271 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2535a5f640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25301ebdc0 0x7f25300c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536a61640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25300c6de0 0x7f25301f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536260640 1 -- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25301ebdc0 msgr2=0x7f25300c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536260640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25301ebdc0 0x7f25300c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536260640 1 -- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25300c6de0 msgr2=0x7f25301f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536260640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25300c6de0 0x7f25301f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2536260640 1 -- 172.21.15.133:0/2551708271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25300c3c90 con 0x7f251c0047d0 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.147+0000 7f2535a5f640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25301ebdc0 0x7f25300c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2536260640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f25300c5e40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f252c00e780 tx=0x7f252c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2526ffd640 1 -- 172.21.15.133:0/2551708271 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0050d0 con 0x7f251c0047d0 2023-12-18T10:22:01.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2526ffd640 1 -- 172.21.15.133:0/2551708271 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c005230 con 0x7f251c0047d0 2023-12-18T10:22:01.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25300c3f70 con 0x7f251c0047d0 2023-12-18T10:22:01.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2526ffd640 1 -- 172.21.15.133:0/2551708271 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00c6c0 con 0x7f251c0047d0 2023-12-18T10:22:01.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25300c4530 con 0x7f251c0047d0 2023-12-18T10:22:01.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25300735b0 con 0x7f251c0047d0 2023-12-18T10:22:01.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2526ffd640 1 -- 172.21.15.133:0/2551708271 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f252c00c820 con 0x7f251c0047d0 2023-12-18T10:22:01.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2526ffd640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2514065a60 0x7f2514067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:01.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2526ffd640 1 -- 172.21.15.133:0/2551708271 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f252c083120 con 0x7f251c0047d0 2023-12-18T10:22:01.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2535a5f640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2514065a60 0x7f2514067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:01.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.151+0000 7f2535a5f640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2514065a60 0x7f2514067f20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f25200af000 tx=0x7f25200046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:01.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.155+0000 7f2526ffd640 1 -- 172.21.15.133:0/2551708271 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f252c050990 con 0x7f251c0047d0 2023-12-18T10:22:01.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25300adb70 con 0x7f251c0047d0 2023-12-18T10:22:01.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f2526ffd640 1 -- 172.21.15.133:0/2551708271 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4732 (secure 0 0 0) 0x7f252c053fb0 con 0x7f251c0047d0 2023-12-18T10:22:01.343 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:01.343 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":52,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:22:00.976982+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6867,"mds_1":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":52,"state":"up:creating","state_seq":1,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:22:01.343 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 52 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2514065a60 msgr2=0x7f2514067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2514065a60 0x7f2514067f20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f25200af000 tx=0x7f25200046d0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 msgr2=0x7f25300c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f25300c5e40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f252c00e780 tx=0x7f252c00ec40 comp rx=0 tx=0).stop 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 shutdown_connections 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2514065a60 0x7f2514067f20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25300c6de0 0x7f25301f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25301ebdc0 0x7f25300c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 --2- 172.21.15.133:0/2551708271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f251c0047d0 0x7f25300c5e40 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 >> 172.21.15.133:0/2551708271 conn(0x7f253006a3e0 msgr2=0x7f253015d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 shutdown_connections 2023-12-18T10:22:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:01.339+0000 7f25384c4640 1 -- 172.21.15.133:0/2551708271 wait complete. 2023-12-18T10:22:01.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:21:48.401032+0000', 'modified': '2023-12-18T10:22:00.976982+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6867, 'mds_1': 6861}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6861': {'gid': 6861, 'name': 'c', 'rank': 1, 'incarnation': 52, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.133:6836/995027883', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 995027883}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 995027883}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6867': {'gid': 6867, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/900380605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 900380605}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 900380605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:22:01.766 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6861:up:creating 2023-12-18T10:22:02.767 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:22:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.911+0000 7f9919e66640 1 Processor -- start 2023-12-18T10:22:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.911+0000 7f9919e66640 1 -- start start 2023-12-18T10:22:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.911+0000 7f9919e66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f9914070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.911+0000 7f9919e66640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9914159080 con 0x7f9914158c20 2023-12-18T10:22:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.911+0000 7f9919e66640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9914070b80 con 0x7f99140caa70 2023-12-18T10:22:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.911+0000 7f9919e66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99140b0cb0 con 0x7f991415c800 2023-12-18T10:22:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f990bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9914158c20 0x7f99140b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51956/0 (socket says 172.21.15.133:51956) 2023-12-18T10:22:02.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f990bfff640 1 -- 172.21.15.133:0/1162162174 learned_addr learned my addr 172.21.15.133:0/1162162174 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:02.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f99137fe640 1 --2- 172.21.15.133:0/1162162174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f9914070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:02.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f9912ffd640 1 -- 172.21.15.133:0/1162162174 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463382193 0 0) 0x7f9914159080 con 0x7f9914158c20 2023-12-18T10:22:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f9912ffd640 1 -- 172.21.15.133:0/1162162174 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9900003530 con 0x7f9914158c20 2023-12-18T10:22:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f9912ffd640 1 -- 172.21.15.133:0/1162162174 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376262594 0 0) 0x7f9914070b80 con 0x7f99140caa70 2023-12-18T10:22:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f9912ffd640 1 -- 172.21.15.133:0/1162162174 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9914159080 con 0x7f99140caa70 2023-12-18T10:22:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f99137fe640 1 -- 172.21.15.133:0/1162162174 >> v1:172.21.15.142:6789/0 conn(0x7f99140caa70 legacy=0x7f99140caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f9912ffd640 1 -- 172.21.15.133:0/1162162174 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1882796493 0 0) 0x7f9900003530 con 0x7f9914158c20 2023-12-18T10:22:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f99137fe640 1 -- 172.21.15.133:0/1162162174 >> v1:172.21.15.133:6789/0 conn(0x7f9914158c20 legacy=0x7f99140b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f99137fe640 1 -- 172.21.15.133:0/1162162174 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914070e60 con 0x7f991415c800 2023-12-18T10:22:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.915+0000 7f99137fe640 1 --2- 172.21.15.133:0/1162162174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f9914070510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99040097f0 tx=0x7f990401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acba0f152382d96f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9912ffd640 1 -- 172.21.15.133:0/1162162174 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040ab600 con 0x7f991415c800 2023-12-18T10:22:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9912ffd640 1 -- 172.21.15.133:0/1162162174 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99040ab760 con 0x7f991415c800 2023-12-18T10:22:02.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9912ffd640 1 -- 172.21.15.133:0/1162162174 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040abaf0 con 0x7f991415c800 2023-12-18T10:22:02.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- 172.21.15.133:0/1162162174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 msgr2=0x7f9914070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:02.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 --2- 172.21.15.133:0/1162162174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f9914070510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99040097f0 tx=0x7f990401c400 comp rx=0 tx=0).stop 2023-12-18T10:22:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- 172.21.15.133:0/1162162174 shutdown_connections 2023-12-18T10:22:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 --2- 172.21.15.133:0/1162162174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f9914070510 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- 172.21.15.133:0/1162162174 >> 172.21.15.133:0/1162162174 conn(0x7f991406a3e0 msgr2=0x7f99140afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- 172.21.15.133:0/1162162174 shutdown_connections 2023-12-18T10:22:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- 172.21.15.133:0/1162162174 wait complete. 2023-12-18T10:22:02.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 Processor -- start 2023-12-18T10:22:02.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- start start 2023-12-18T10:22:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99140caa70 0x7f991415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914158c20 0x7f991414aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f991414c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141f92b0 con 0x7f99140caa70 2023-12-18T10:22:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141f8730 con 0x7f9914158c20 2023-12-18T10:22:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.919+0000 7f9919e66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99141f8a10 con 0x7f991415c800 2023-12-18T10:22:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99140caa70 0x7f991415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99140caa70 0x7f991415a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36642/0 (socket says 172.21.15.133:36642) 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 -- 172.21.15.133:0/2898406631 learned_addr learned my addr 172.21.15.133:0/2898406631 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9913fff640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f991414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f990bfff640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914158c20 0x7f991414aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 -- 172.21.15.133:0/2898406631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 msgr2=0x7f991414c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f991414c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 -- 172.21.15.133:0/2898406631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914158c20 msgr2=0x7f991414aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914158c20 0x7f991414aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 -- 172.21.15.133:0/2898406631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904009420 con 0x7f99140caa70 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f99137fe640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99140caa70 0x7f991415a690 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9904000c10 tx=0x7f99040191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9910ff9640 1 -- 172.21.15.133:0/2898406631 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040abad0 con 0x7f99140caa70 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9910ff9640 1 -- 172.21.15.133:0/2898406631 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99040abc30 con 0x7f99140caa70 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99140c8800 con 0x7f99140caa70 2023-12-18T10:22:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9910ff9640 1 -- 172.21.15.133:0/2898406631 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040be420 con 0x7f99140caa70 2023-12-18T10:22:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99141f8fd0 con 0x7f99140caa70 2023-12-18T10:22:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99140735b0 con 0x7f99140caa70 2023-12-18T10:22:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9910ff9640 1 -- 172.21.15.133:0/2898406631 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f99040bc070 con 0x7f99140caa70 2023-12-18T10:22:02.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9910ff9640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98f4065a60 0x7f98f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:02.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.923+0000 7f9910ff9640 1 -- 172.21.15.133:0/2898406631 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f990411d690 con 0x7f99140caa70 2023-12-18T10:22:02.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.927+0000 7f990bfff640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98f4065a60 0x7f98f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:02.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.927+0000 7f990bfff640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98f4065a60 0x7f98f4067f20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f99140ad6d0 tx=0x7f98fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:02.927+0000 7f9910ff9640 1 -- 172.21.15.133:0/2898406631 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f99040eb060 con 0x7f99140caa70 2023-12-18T10:22:03.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.115+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f991404e000 con 0x7f99140caa70 2023-12-18T10:22:03.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9910ff9640 1 -- 172.21.15.133:0/2898406631 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4744 (secure 0 0 0) 0x7f99040c3090 con 0x7f99140caa70 2023-12-18T10:22:03.122 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:03.122 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:22:02.990650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6867,"mds_1":6861,"mds_2":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":2,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":52,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:22:03.122 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 55 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98f4065a60 msgr2=0x7f98f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98f4065a60 0x7f98f4067f20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f99140ad6d0 tx=0x7f98fc009040 comp rx=0 tx=0).stop 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99140caa70 msgr2=0x7f991415a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99140caa70 0x7f991415a690 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9904000c10 tx=0x7f99040191a0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 shutdown_connections 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f98f4065a60 0x7f98f4067f20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f991415c800 0x7f991414c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914158c20 0x7f991414aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 --2- 172.21.15.133:0/2898406631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99140caa70 0x7f991415a690 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 >> 172.21.15.133:0/2898406631 conn(0x7f991406a3e0 msgr2=0x7f991414ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 shutdown_connections 2023-12-18T10:22:03.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.119+0000 7f9919e66640 1 -- 172.21.15.133:0/2898406631 wait complete. 2023-12-18T10:22:03.545 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:21:48.401032+0000', 'modified': '2023-12-18T10:22:02.990650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6867, 'mds_1': 6861, 'mds_2': 6505}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6505': {'gid': 6505, 'name': 'd', 'rank': 2, 'incarnation': 54, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.142:6834/3664781290', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 3664781290}, {'type': 'v1', 'addr': '172.21.15.142:6834', 'nonce': 3664781290}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6861': {'gid': 6861, 'name': 'c', 'rank': 1, 'incarnation': 52, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.133:6836/995027883', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 995027883}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 995027883}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6867': {'gid': 6867, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/900380605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 900380605}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 900380605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:22:03.545 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-18T10:22:03.545 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-18T10:22:03.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbfbdb640 1 Processor -- start 2023-12-18T10:22:03.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbfbdb640 1 -- start start 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbfbdb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9fb815a680 0x7f9fb815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbfbdb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9fb80cac10 0x7f9fb815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbfbdb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb815f100 con 0x7f9fb815afa0 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbfbdb640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb80ca7d0 con 0x7f9fb80cac10 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbfbdb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb815e860 con 0x7f9fb815a680 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd176640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9fb80cac10 0x7f9fb815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd176640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9fb80cac10 0x7f9fb815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36658/0 (socket says 172.21.15.133:36658) 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd176640 1 -- 172.21.15.133:0/2490802242 learned_addr learned my addr 172.21.15.133:0/2490802242 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd977640 1 --2- 172.21.15.133:0/2490802242 >> v2:172.21.15.142:3300/0 conn(0x7f9fb815a680 0x7f9fb815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd176640 1 -- 172.21.15.133:0/2490802242 >> v2:172.21.15.142:3300/0 conn(0x7f9fb815a680 msgr2=0x7f9fb815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd176640 1 --2- 172.21.15.133:0/2490802242 >> v2:172.21.15.142:3300/0 conn(0x7f9fb815a680 0x7f9fb815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd176640 1 -- 172.21.15.133:0/2490802242 >> v1:172.21.15.142:6789/0 conn(0x7f9fb815afa0 legacy=0x7f9fb806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd176640 1 -- 172.21.15.133:0/2490802242 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb815eb40 con 0x7f9fb80cac10 2023-12-18T10:22:03.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.683+0000 7f9fbd977640 1 --2- 172.21.15.133:0/2490802242 >> v2:172.21.15.142:3300/0 conn(0x7f9fb815a680 0x7f9fb815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:03.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbd176640 1 --2- 172.21.15.133:0/2490802242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb80cac10 0x7f9fb815aa60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009870 tx=0x7f9fa801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6add981e4918037 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbc975640 1 -- 172.21.15.133:0/2490802242 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80a7070 con 0x7f9fb80cac10 2023-12-18T10:22:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbc975640 1 -- 172.21.15.133:0/2490802242 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80ab430 con 0x7f9fb80cac10 2023-12-18T10:22:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbc975640 1 -- 172.21.15.133:0/2490802242 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80ab7c0 con 0x7f9fb80cac10 2023-12-18T10:22:03.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/2490802242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb80cac10 msgr2=0x7f9fb815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/2490802242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb80cac10 0x7f9fb815aa60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009870 tx=0x7f9fa801c430 comp rx=0 tx=0).stop 2023-12-18T10:22:03.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/2490802242 shutdown_connections 2023-12-18T10:22:03.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/2490802242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb80cac10 0x7f9fb815aa60 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/2490802242 >> v2:172.21.15.142:3300/0 conn(0x7f9fb815a680 0x7f9fb815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/2490802242 >> 172.21.15.133:0/2490802242 conn(0x7f9fb806a3e0 msgr2=0x7f9fb80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/2490802242 shutdown_connections 2023-12-18T10:22:03.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.687+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/2490802242 wait complete. 2023-12-18T10:22:03.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 Processor -- start 2023-12-18T10:22:03.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 -- start start 2023-12-18T10:22:03.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb80cac10 0x7f9fb8150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb815a680 0x7f9fb8154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb815afa0 0x7f9fb80aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8151bc0 con 0x7f9fb815a680 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8150b90 con 0x7f9fb815afa0 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8155260 con 0x7f9fb80cac10 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb815a680 0x7f9fb8154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb815a680 0x7f9fb8154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36668/0 (socket says 172.21.15.133:36668) 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 -- 172.21.15.133:0/3223020702 learned_addr learned my addr 172.21.15.133:0/3223020702 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb80cac10 0x7f9fb8150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbe178640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb815afa0 0x7f9fb80aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 -- 172.21.15.133:0/3223020702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb80cac10 msgr2=0x7f9fb8150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb80cac10 0x7f9fb8150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 -- 172.21.15.133:0/3223020702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb815afa0 msgr2=0x7f9fb80aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb815afa0 0x7f9fb80aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 -- 172.21.15.133:0/3223020702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80094d0 con 0x7f9fb815a680 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbd176640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb815a680 0x7f9fb8154d20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80ad040 tx=0x7f9fa80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fae7fc640 1 -- 172.21.15.133:0/3223020702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80b4830 con 0x7f9fb815a680 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fae7fc640 1 -- 172.21.15.133:0/3223020702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80b49b0 con 0x7f9fb815a680 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/3223020702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb8150cf0 con 0x7f9fb815a680 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fae7fc640 1 -- 172.21.15.133:0/3223020702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80b4d60 con 0x7f9fb815a680 2023-12-18T10:22:03.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.691+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/3223020702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb8151220 con 0x7f9fb815a680 2023-12-18T10:22:03.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.695+0000 7f9fae7fc640 1 -- 172.21.15.133:0/3223020702 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9fa80c0460 con 0x7f9fb815a680 2023-12-18T10:22:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.695+0000 7f9fae7fc640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f9c065a60 0x7f9f9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.695+0000 7f9fae7fc640 1 -- 172.21.15.133:0/3223020702 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9fa811d720 con 0x7f9fb815a680 2023-12-18T10:22:03.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.695+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f9c065a60 0x7f9f9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.695+0000 7f9fc2f4c000 1 Processor -- start 2023-12-18T10:22:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.695+0000 7f9fc2f4c000 1 -- start start 2023-12-18T10:22:03.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.695+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f9c065a60 0x7f9f9c067f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9fb815cd50 tx=0x7f9fb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d777a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d777a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5d7599c90 con 0x55f5d77c4be0 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5d75cb220 con 0x55f5d77c42c0 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5d75c87f0 con 0x55f5d777a5d0 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d777a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d777a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36684/0 (socket says 172.21.15.133:36684) 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 -- 172.21.15.133:0/4020166695 learned_addr learned my addr 172.21.15.133:0/4020166695 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd977640 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbe178640 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d777a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 -- 172.21.15.133:0/4020166695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 msgr2=0x55f5d777a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d777a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 -- 172.21.15.133:0/4020166695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 msgr2=0x55f5d77c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 -- 172.21.15.133:0/4020166695 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5d72c0890 con 0x55f5d77c4be0 2023-12-18T10:22:03.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fbd176640 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d777a090 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9fa801a060 tx=0x7f9fa80ee9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b116540b9d7e535 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9f9b7fe640 1 -- 172.21.15.133:0/4020166695 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80f2ba0 con 0x55f5d77c4be0 2023-12-18T10:22:03.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9f9b7fe640 1 -- 172.21.15.133:0/4020166695 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80f6d50 con 0x55f5d77c4be0 2023-12-18T10:22:03.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9f9b7fe640 1 -- 172.21.15.133:0/4020166695 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80eb480 con 0x55f5d77c4be0 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/4020166695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 msgr2=0x55f5d777a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d777a090 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9fa801a060 tx=0x7f9fa80ee9e0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/4020166695 shutdown_connections 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d777a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d777a090 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/4020166695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/4020166695 >> 172.21.15.133:0/4020166695 conn(0x55f5d777c950 msgr2=0x55f5d7774560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/4020166695 shutdown_connections 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/4020166695 wait complete. 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 -- start start 2023-12-18T10:22:03.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.699+0000 7f9fc2f4c000 1 Processor -- start 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d7784620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c42c0 0x55f5d7784b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c4be0 0x55f5d77850a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5d75c40e0 con 0x55f5d77c42c0 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5d7563310 con 0x55f5d77c4be0 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5d7581770 con 0x55f5d777a5d0 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 10 client.0 _ll_register_callbacks cb 0x55f5d7761b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c42c0 0x55f5d7784b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c42c0 0x55f5d7784b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36688/0 (socket says 172.21.15.133:36688) 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 -- 172.21.15.133:0/3406770021 learned_addr learned my addr 172.21.15.133:0/3406770021 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d7784620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbe178640 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c4be0 0x55f5d77850a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 -- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 msgr2=0x55f5d7784620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d7784620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 -- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c4be0 msgr2=0x55f5d77850a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c4be0 0x55f5d77850a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 -- 172.21.15.133:0/3406770021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb8151220 con 0x55f5d77c42c0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd176640 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c42c0 0x55f5d7784b60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80eea20 tx=0x7f9fa8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54723666dadf632 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9f98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9f98ff9640 1 -- 172.21.15.133:0/3406770021 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80ee460 con 0x55f5d77c42c0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9f98ff9640 1 -- 172.21.15.133:0/3406770021 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9fa80f2ba0 con 0x55f5d77c42c0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3406770021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5d7593c10 con 0x55f5d77c42c0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9f98ff9640 1 -- 172.21.15.133:0/3406770021 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fa80f68c0 con 0x55f5d77c42c0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 10 client.7083 fetch_fsmap learned FSMap version 55 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3406770021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55f5d7589260 con 0x55f5d77c42c0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9f98ff9640 1 -- 172.21.15.133:0/3406770021 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa80fa020 con 0x55f5d77c42c0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9f98ff9640 1 -- 172.21.15.133:0/3406770021 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 55) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f9fa8106020 con 0x55f5d77c42c0 2023-12-18T10:22:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 10 client.7083 fetch_fsmap finished waiting for FSMap version 55 2023-12-18T10:22:03.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 10 client.7083 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:22:03.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 20 client.7083 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:03.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x55f5d77d3350 0x55f5d77d5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 4 client.7083 mds_command: new command op to 6505 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:03.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3406770021 --> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5d75c2a30 con 0x55f5d77d3350 2023-12-18T10:22:03.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x55f5d77d3350 0x55f5d77d5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9f98ff9640 10 client.7083 ms_handle_connect on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:03.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.703+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x55f5d77d3350 0x55f5d77d5740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8fd6f1131180c794 server_cookie=ec8627b8051e67f0 in_seq=0 out_seq=0 2023-12-18T10:22:03.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9f98ff9640 1 -- 172.21.15.133:0/3406770021 <== mds.2 v2:172.21.15.142:6833/3664781290 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55f5d75c2a30 con 0x55f5d77d3350 2023-12-18T10:22:03.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9f98ff9640 10 client.7083 handle_command_reply: tid=0 2023-12-18T10:22:03.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 client.7083 shutdown 2023-12-18T10:22:03.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3406770021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c42c0 msgr2=0x55f5d7784b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c42c0 0x55f5d7784b60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80eea20 tx=0x7f9fa8000bd0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3406770021 shutdown_connections 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x55f5d77d3350 0x55f5d77d5740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c4be0 0x55f5d77850a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c42c0 0x55f5d7784b60 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9f98ff9640 0 client.7083 ms_handle_reset on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3406770021 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d7784620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3406770021 >> 172.21.15.133:0/3406770021 conn(0x55f5d777c950 msgr2=0x55f5d7773cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3406770021 shutdown_connections 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3406770021 wait complete. 2023-12-18T10:22:03.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.707+0000 7f9fc2f4c000 20 client.7083 trim_cache size 0 max 16384 2023-12-18T10:22:03.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.719+0000 7f9fc2f4c000 1 Processor -- start 2023-12-18T10:22:03.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.719+0000 7f9fc2f4c000 1 -- start start 2023-12-18T10:22:03.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d777a5d0 0x55f5d77d76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77d5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d77c4be0 0x55f5d77d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5d77825d0 con 0x55f5d777a5d0 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5d7281940 con 0x55f5d77c42c0 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5d756c860 con 0x55f5d77c4be0 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d777a5d0 0x55f5d77d76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d777a5d0 0x55f5d77d76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36700/0 (socket says 172.21.15.133:36700) 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 -- 172.21.15.133:0/3830274613 learned_addr learned my addr 172.21.15.133:0/3830274613 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbe178640 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d77c4be0 0x55f5d77d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 -- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d77c4be0 msgr2=0x55f5d77d5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d77c4be0 0x55f5d77d5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 -- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 msgr2=0x55f5d77d5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd176640 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77d5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77d5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 -- 172.21.15.133:0/3830274613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5d756f3b0 con 0x55f5d777a5d0 2023-12-18T10:22:03.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbe178640 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d77c4be0 0x55f5d77d5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:03.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd176640 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77d5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:03.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fbd977640 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d777a5d0 0x55f5d77d76a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400fa30 tx=0x7f9fb400a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53f3b3a1f988375 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9f9bfff640 1 -- 172.21.15.133:0/3830274613 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4028070 con 0x55f5d777a5d0 2023-12-18T10:22:03.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9f9bfff640 1 -- 172.21.15.133:0/3830274613 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb400fd80 con 0x55f5d777a5d0 2023-12-18T10:22:03.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9f9bfff640 1 -- 172.21.15.133:0/3830274613 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4029450 con 0x55f5d777a5d0 2023-12-18T10:22:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3830274613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d777a5d0 msgr2=0x55f5d77d76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d777a5d0 0x55f5d77d76a0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400fa30 tx=0x7f9fb400a040 comp rx=0 tx=0).stop 2023-12-18T10:22:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3830274613 shutdown_connections 2023-12-18T10:22:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d77c4be0 0x55f5d77d5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d77d5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/3830274613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d777a5d0 0x55f5d77d76a0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3830274613 >> 172.21.15.133:0/3830274613 conn(0x55f5d777c950 msgr2=0x55f5d7773cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3830274613 shutdown_connections 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/3830274613 wait complete. 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 -- start start 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.723+0000 7f9fc2f4c000 1 Processor -- start 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d77d6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d781bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d781c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5d75c6c40 con 0x55f5d77c4be0 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5d75c2f70 con 0x55f5d77c42c0 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5d75c5670 con 0x55f5d777a5d0 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 10 client.0 _ll_register_callbacks cb 0x55f5d7572640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d781c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d781c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36704/0 (socket says 172.21.15.133:36704) 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 -- 172.21.15.133:0/2657588267 learned_addr learned my addr 172.21.15.133:0/2657588267 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbd977640 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d77d6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbd176640 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d781bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 -- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 msgr2=0x55f5d77d6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d77d6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 -- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 msgr2=0x55f5d781bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d781bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 -- 172.21.15.133:0/2657588267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb400e040 con 0x55f5d77c4be0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbe178640 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d781c4e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000bba0 tx=0x7f9fb000a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b546ac47909b793 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 1 -- 172.21.15.133:0/2657588267 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000bea0 con 0x55f5d77c4be0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 1 -- 172.21.15.133:0/2657588267 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9fb0018640 con 0x55f5d77c4be0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/2657588267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5d7589e00 con 0x55f5d77c4be0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 1 -- 172.21.15.133:0/2657588267 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fb0011070 con 0x55f5d77c4be0 2023-12-18T10:22:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 10 client.7089 fetch_fsmap learned FSMap version 55 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/2657588267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55f5d72c0cc0 con 0x55f5d77c4be0 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 1 -- 172.21.15.133:0/2657588267 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f5d7589e00 con 0x55f5d77c4be0 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 1 -- 172.21.15.133:0/2657588267 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 55) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f9fb001f060 con 0x55f5d77c4be0 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 10 client.7089 fetch_fsmap finished waiting for FSMap version 55 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 10 client.7089 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 20 client.7089 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x55f5d77c03f0 0x55f5d77c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 4 client.7089 mds_command: new command op to 6505 tid=0[{"prefix": "status"}] 2023-12-18T10:22:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/2657588267 --> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f5d75bd160 con 0x55f5d77c03f0 2023-12-18T10:22:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbd977640 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x55f5d77c03f0 0x55f5d77c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 10 client.7089 ms_handle_connect on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fbd977640 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x55f5d77c03f0 0x55f5d77c07d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17bc2ce4275fcb8 server_cookie=31d1484a7e7dbb6f in_seq=0 out_seq=0 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 1 -- 172.21.15.133:0/2657588267 <== mds.2 v2:172.21.15.142:6833/3664781290 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f5d75bd160 con 0x55f5d77c03f0 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 10 client.7089 handle_command_reply: tid=0 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 client.7089 shutdown 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/2657588267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 msgr2=0x55f5d781c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d781c4e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000bba0 tx=0x7f9fb000a7b0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/2657588267 shutdown_connections 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x55f5d77c03f0 0x55f5d77c07d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f5d77c4be0 0x55f5d781c4e0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9f98ff9640 0 client.7089 ms_handle_reset on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f5d77c42c0 0x55f5d781bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 --2- 172.21.15.133:0/2657588267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f5d777a5d0 0x55f5d77d6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/2657588267 >> 172.21.15.133:0/2657588267 conn(0x55f5d777c950 msgr2=0x55f5d7774560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/2657588267 shutdown_connections 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.727+0000 7f9fc2f4c000 1 -- 172.21.15.133:0/2657588267 wait complete. 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fc2f4c000 20 client.7089 trim_cache size 0 max 16384 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 2, 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6505, 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:22:03.737 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:22:03.738 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 1.7427736540000001, 2023-12-18T10:22:03.738 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 55, 2023-12-18T10:22:03.738 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 65, 2023-12-18T10:22:03.738 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 65, 2023-12-18T10:22:03.738 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 19.607989562 2023-12-18T10:22:03.738 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:03.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f9c065a60 msgr2=0x7f9f9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f9c065a60 0x7f9f9c067f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9fb815cd50 tx=0x7f9fb4008040 comp rx=0 tx=0).stop 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb815a680 msgr2=0x7f9fb8154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb815a680 0x7f9fb8154d20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80ad040 tx=0x7f9fa80191d0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/3223020702 shutdown_connections 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9f9c065a60 0x7f9f9c067f20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fb815afa0 0x7f9fb80aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fb815a680 0x7f9fb8154d20 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 --2- 172.21.15.133:0/3223020702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9fb80cac10 0x7f9fb8150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/3223020702 >> 172.21.15.133:0/3223020702 conn(0x7f9fb806a3e0 msgr2=0x7f9fb815c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/3223020702 shutdown_connections 2023-12-18T10:22:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.731+0000 7f9fbfbdb640 1 -- 172.21.15.133:0/3223020702 wait complete. 2023-12-18T10:22:03.752 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-18T10:22:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32d10d7640 1 Processor -- start 2023-12-18T10:22:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32d10d7640 1 -- start start 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32d10d7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f32cc06fb60 0x7f32cc06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32d10d7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32cc0cbc70 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32d10d7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32cc0c3bb0 con 0x7f32cc0afd10 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32d10d7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32cc0c3e90 con 0x7f32cc06fb60 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32d08d6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f32cc0cc6c0 0x7f32cc0c2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51962/0 (socket says 172.21.15.133:51962) 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32d08d6640 1 -- 172.21.15.133:0/1540183066 learned_addr learned my addr 172.21.15.133:0/1540183066 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/1540183066 >> v2:172.21.15.142:3300/0 conn(0x7f32cc06fb60 0x7f32cc06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32caffd640 1 -- 172.21.15.133:0/1540183066 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606915791 0 0) 0x7f32cc0cbc70 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32caffd640 1 -- 172.21.15.133:0/1540183066 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b4003530 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32cb7fe640 1 -- 172.21.15.133:0/1540183066 >> v1:172.21.15.142:6789/0 conn(0x7f32cc0afd10 legacy=0x7f32cc0b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32cb7fe640 1 -- 172.21.15.133:0/1540183066 >> v1:172.21.15.133:6789/0 conn(0x7f32cc0cc6c0 legacy=0x7f32cc0c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.887+0000 7f32cb7fe640 1 -- 172.21.15.133:0/1540183066 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0cbec0 con 0x7f32cc06fb60 2023-12-18T10:22:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/1540183066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 0x7f32cc06ffe0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097c0 tx=0x7f32c001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb64599c04df8880 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32caffd640 1 -- 172.21.15.133:0/1540183066 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c00a7070 con 0x7f32cc06fb60 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32caffd640 1 -- 172.21.15.133:0/1540183066 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c00ab430 con 0x7f32cc06fb60 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32caffd640 1 -- 172.21.15.133:0/1540183066 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c00ab7c0 con 0x7f32cc06fb60 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32d10d7640 1 -- 172.21.15.133:0/1540183066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 msgr2=0x7f32cc06ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32d10d7640 1 --2- 172.21.15.133:0/1540183066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 0x7f32cc06ffe0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f32c00097c0 tx=0x7f32c001c450 comp rx=0 tx=0).stop 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32d10d7640 1 -- 172.21.15.133:0/1540183066 shutdown_connections 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32d10d7640 1 --2- 172.21.15.133:0/1540183066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 0x7f32cc06ffe0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32d10d7640 1 -- 172.21.15.133:0/1540183066 >> 172.21.15.133:0/1540183066 conn(0x7f32cc0ce130 msgr2=0x7f32cc0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32d10d7640 1 -- 172.21.15.133:0/1540183066 shutdown_connections 2023-12-18T10:22:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.891+0000 7f32d10d7640 1 -- 172.21.15.133:0/1540183066 wait complete. 2023-12-18T10:22:03.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 Processor -- start 2023-12-18T10:22:03.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 -- start start 2023-12-18T10:22:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 0x7f32cc140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32cc0afd10 0x7f32cc13fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32cc0cc6c0 0x7f32cc164420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc15bf80 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc1407e0 con 0x7f32cc06fb60 2023-12-18T10:22:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc140f90 con 0x7f32cc0afd10 2023-12-18T10:22:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32cc0cc6c0 0x7f32cc164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32cc0cc6c0 0x7f32cc164420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36714/0 (socket says 172.21.15.133:36714) 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 -- 172.21.15.133:0/672277238 learned_addr learned my addr 172.21.15.133:0/672277238 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32cc0afd10 0x7f32cc13fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32cbfff640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 0x7f32cc140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 -- 172.21.15.133:0/672277238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32cc0afd10 msgr2=0x7f32cc13fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32cc0afd10 0x7f32cc13fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 -- 172.21.15.133:0/672277238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 msgr2=0x7f32cc140a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 0x7f32cc140a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 -- 172.21.15.133:0/672277238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0009420 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d08d6640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32cc0cc6c0 0x7f32cc164420 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f32c400caa0 tx=0x7f32c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32c8ff9640 1 -- 172.21.15.133:0/672277238 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c400ac00 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32c8ff9640 1 -- 172.21.15.133:0/672277238 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c400ad60 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32d10d7640 1 -- 172.21.15.133:0/672277238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32cc15b300 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.895+0000 7f32c8ff9640 1 -- 172.21.15.133:0/672277238 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4012620 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.899+0000 7f32d10d7640 1 -- 172.21.15.133:0/672277238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc15b8c0 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.899+0000 7f32c8ff9640 1 -- 172.21.15.133:0/672277238 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f32c4007070 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.899+0000 7f32c8ff9640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f32b8065a60 0x7f32b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.899+0000 7f32c8ff9640 1 -- 172.21.15.133:0/672277238 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f32c4083290 con 0x7f32cc0cc6c0 2023-12-18T10:22:03.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.899+0000 7f32cbfff640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f32b8065a60 0x7f32b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 Processor -- start 2023-12-18T10:22:03.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- start start 2023-12-18T10:22:03.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32cbfff640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f32b8065a60 0x7f32b8067f20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f32bc007fd0 tx=0x7f32bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242070 0x559544242450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595441f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5595441f81c0 0x5595441f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954401bc90 con 0x5595441f81c0 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954404d220 con 0x559544242070 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55954404a7f0 con 0x559544242990 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5595441f81c0 0x5595441f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5595441f81c0 0x5595441f85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36720/0 (socket says 172.21.15.133:36720) 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 -- 172.21.15.133:0/1812796347 learned_addr learned my addr 172.21.15.133:0/1812796347 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595441f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32cbfff640 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242070 0x559544242450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 -- 172.21.15.133:0/1812796347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 msgr2=0x5595441f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595441f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 -- 172.21.15.133:0/1812796347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242070 msgr2=0x559544242450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242070 0x559544242450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 -- 172.21.15.133:0/1812796347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559543d42890 con 0x5595441f81c0 2023-12-18T10:22:03.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d08d6640 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5595441f81c0 0x5595441f85a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f32c405c1e0 tx=0x7f32c4054270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89bdc1b1eb27d01 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32b1ffb640 1 -- 172.21.15.133:0/1812796347 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c405c710 con 0x5595441f81c0 2023-12-18T10:22:03.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32b1ffb640 1 -- 172.21.15.133:0/1812796347 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c4052b80 con 0x5595441f81c0 2023-12-18T10:22:03.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32b1ffb640 1 -- 172.21.15.133:0/1812796347 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4058170 con 0x5595441f81c0 2023-12-18T10:22:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- 172.21.15.133:0/1812796347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5595441f81c0 msgr2=0x5595441f85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5595441f81c0 0x5595441f85a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f32c405c1e0 tx=0x7f32c4054270 comp rx=0 tx=0).stop 2023-12-18T10:22:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- 172.21.15.133:0/1812796347 shutdown_connections 2023-12-18T10:22:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5595441f81c0 0x5595441f85a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595441f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 --2- 172.21.15.133:0/1812796347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242070 0x559544242450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- 172.21.15.133:0/1812796347 >> 172.21.15.133:0/1812796347 conn(0x5595441fe950 msgr2=0x5595441f6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- 172.21.15.133:0/1812796347 shutdown_connections 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- 172.21.15.133:0/1812796347 wait complete. 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.903+0000 7f32d56ad000 1 -- start start 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 Processor -- start 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 0x5595441fd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595442045c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595440460e0 con 0x559544242070 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559543fe5310 con 0x5595441f81c0 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559544003770 con 0x559544242990 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 10 client.0 _ll_register_callbacks cb 0x5595441e3b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:03.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36726/0 (socket says 172.21.15.133:36726) 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 -- 172.21.15.133:0/113154000 learned_addr learned my addr 172.21.15.133:0/113154000 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cbfff640 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 0x5595441fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d08d6640 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595442045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 -- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 msgr2=0x5595442045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595442045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 -- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 msgr2=0x5595441fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 0x5595441fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 -- 172.21.15.133:0/113154000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc15b8c0 con 0x559544242070 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d08d6640 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595442045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204080 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f32c0008010 tx=0x7f32c00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e346c728eca381 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32aaffd640 1 -- 172.21.15.133:0/113154000 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c00c3070 con 0x559544242070 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32aaffd640 1 -- 172.21.15.133:0/113154000 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f32c00ba070 con 0x559544242070 2023-12-18T10:22:03.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 -- 172.21.15.133:0/113154000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559544015c10 con 0x559544242070 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32aaffd640 1 -- 172.21.15.133:0/113154000 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c00abda0 con 0x559544242070 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 10 client.7101 fetch_fsmap learned FSMap version 55 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 -- 172.21.15.133:0/113154000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55954400b260 con 0x559544242070 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32aaffd640 1 -- 172.21.15.133:0/113154000 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559544015c10 con 0x559544242070 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32aaffd640 1 -- 172.21.15.133:0/113154000 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 55) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f32c00b5400 con 0x559544242070 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 10 client.7101 fetch_fsmap finished waiting for FSMap version 55 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 10 client.7101 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 20 client.7101 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5595442498d0 0x559544249cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 4 client.7101 mds_command: new command op to 6861 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32d56ad000 1 -- 172.21.15.133:0/113154000 --> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559544044a30 con 0x5595442498d0 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cbfff640 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5595442498d0 0x559544249cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32cbfff640 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5595442498d0 0x559544249cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9cfdf67056873a99 server_cookie=9dbbd459b5f7dd5b in_seq=0 out_seq=0 2023-12-18T10:22:03.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.907+0000 7f32aaffd640 10 client.7101 ms_handle_connect on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:03.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32aaffd640 1 -- 172.21.15.133:0/113154000 <== mds.1 v2:172.21.15.133:6834/995027883 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559544044a30 con 0x5595442498d0 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32aaffd640 10 client.7101 handle_command_reply: tid=0 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 client.7101 shutdown 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 -- 172.21.15.133:0/113154000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 msgr2=0x559544204080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204080 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f32c0008010 tx=0x7f32c00046d0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 -- 172.21.15.133:0/113154000 shutdown_connections 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5595442498d0 0x559544249cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x5595442045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204080 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 --2- 172.21.15.133:0/113154000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 0x5595441fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32aaffd640 0 client.7101 ms_handle_reset on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 -- 172.21.15.133:0/113154000 >> 172.21.15.133:0/113154000 conn(0x5595441fe950 msgr2=0x5595441f6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 -- 172.21.15.133:0/113154000 shutdown_connections 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 1 -- 172.21.15.133:0/113154000 wait complete. 2023-12-18T10:22:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.911+0000 7f32d56ad000 20 client.7101 trim_cache size 0 max 16384 2023-12-18T10:22:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.923+0000 7f32d56ad000 1 Processor -- start 2023-12-18T10:22:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- start start 2023-12-18T10:22:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 0x559544203fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x559544240040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559543d03940 con 0x559544242070 2023-12-18T10:22:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595441fb8c0 con 0x5595441f81c0 2023-12-18T10:22:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595440438f0 con 0x559544242990 2023-12-18T10:22:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36728/0 (socket says 172.21.15.133:36728) 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 -- 172.21.15.133:0/201916851 learned_addr learned my addr 172.21.15.133:0/201916851 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cbfff640 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 0x559544203fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d08d6640 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x559544240040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 -- 172.21.15.133:0/201916851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 msgr2=0x559544240040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x559544240040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 -- 172.21.15.133:0/201916851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 msgr2=0x559544203fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 0x559544203fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 -- 172.21.15.133:0/201916851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559543ff13b0 con 0x559544242070 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204510 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f32c001c9c0 tx=0x7f32c0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c293708831377763 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32b27fc640 1 -- 172.21.15.133:0/201916851 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c00c3040 con 0x559544242070 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32b27fc640 1 -- 172.21.15.133:0/201916851 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c0006e20 con 0x559544242070 2023-12-18T10:22:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32b27fc640 1 -- 172.21.15.133:0/201916851 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c00a4ec0 con 0x559544242070 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- 172.21.15.133:0/201916851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 msgr2=0x559544204510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204510 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f32c001c9c0 tx=0x7f32c0009190 comp rx=0 tx=0).stop 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- 172.21.15.133:0/201916851 shutdown_connections 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559544242990 0x559544240040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544204510 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 --2- 172.21.15.133:0/201916851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5595441f81c0 0x559544203fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- 172.21.15.133:0/201916851 >> 172.21.15.133:0/201916851 conn(0x5595441fe950 msgr2=0x5595442038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- 172.21.15.133:0/201916851 shutdown_connections 2023-12-18T10:22:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- 172.21.15.133:0/201916851 wait complete. 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 -- start start 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.927+0000 7f32d56ad000 1 Processor -- start 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5595441f81c0 0x559544258320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544258860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242990 0x55954429ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559544047670 con 0x559544242070 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954404e4b0 con 0x559544242990 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559543fee860 con 0x5595441f81c0 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 10 client.0 _ll_register_callbacks cb 0x559543ff4640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544258860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544258860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36732/0 (socket says 172.21.15.133:36732) 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 -- 172.21.15.133:0/2360792056 learned_addr learned my addr 172.21.15.133:0/2360792056 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cbfff640 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5595441f81c0 0x559544258320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d08d6640 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242990 0x55954429ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 -- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5595441f81c0 msgr2=0x559544258320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5595441f81c0 0x559544258320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 -- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242990 msgr2=0x55954429ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242990 0x55954429ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 -- 172.21.15.133:0/2360792056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55954400b260 con 0x559544242070 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d08d6640 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242990 0x55954429ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cb7fe640 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544258860 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f32c0097f00 tx=0x7f32c001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af0ac3f51b86145 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 1 -- 172.21.15.133:0/2360792056 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0004230 con 0x559544242070 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 1 -- 172.21.15.133:0/2360792056 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f32c0004390 con 0x559544242070 2023-12-18T10:22:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- 172.21.15.133:0/2360792056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55954400be00 con 0x559544242070 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 1 -- 172.21.15.133:0/2360792056 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c00a4ec0 con 0x559544242070 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 10 client.7107 fetch_fsmap learned FSMap version 55 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- 172.21.15.133:0/2360792056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x559543d42cc0 con 0x559544242070 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 1 -- 172.21.15.133:0/2360792056 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55954400be00 con 0x559544242070 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 1 -- 172.21.15.133:0/2360792056 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 55) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f32c00c6020 con 0x559544242070 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 10 client.7107 fetch_fsmap finished waiting for FSMap version 55 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 10 client.7107 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 20 client.7107 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x55954429b040 0x55954429b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 4 client.7107 mds_command: new command op to 6861 tid=0[{"prefix": "status"}] 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- 172.21.15.133:0/2360792056 --> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55954403f160 con 0x55954429b040 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cbfff640 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x55954429b040 0x55954429b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32cbfff640 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x55954429b040 0x55954429b420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=977b20b7cb5a530 server_cookie=2e1f3ad5d0233678 in_seq=0 out_seq=0 2023-12-18T10:22:03.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 10 client.7107 ms_handle_connect on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 1 -- 172.21.15.133:0/2360792056 <== mds.1 v2:172.21.15.133:6834/995027883 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55954403f160 con 0x55954429b040 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 10 client.7107 handle_command_reply: tid=0 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 client.7107 shutdown 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- 172.21.15.133:0/2360792056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 msgr2=0x559544258860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544258860 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f32c0097f00 tx=0x7f32c001ac90 comp rx=0 tx=0).stop 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- 172.21.15.133:0/2360792056 shutdown_connections 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x55954429b040 0x55954429b420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559544242990 0x55954429ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559544242070 0x559544258860 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 --2- 172.21.15.133:0/2360792056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5595441f81c0 0x559544258320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32aaffd640 0 client.7107 ms_handle_reset on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- 172.21.15.133:0/2360792056 >> 172.21.15.133:0/2360792056 conn(0x5595441fe950 msgr2=0x559544203fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- 172.21.15.133:0/2360792056 shutdown_connections 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 1 -- 172.21.15.133:0/2360792056 wait complete. 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.931+0000 7f32d56ad000 20 client.7107 trim_cache size 0 max 16384 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 1, 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6861, 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 2.9579245429999999, 2023-12-18T10:22:03.941 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 55, 2023-12-18T10:22:03.942 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 65, 2023-12-18T10:22:03.942 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 65, 2023-12-18T10:22:03.942 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 19.820696154 2023-12-18T10:22:03.942 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 -- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f32b8065a60 msgr2=0x7f32b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f32b8065a60 0x7f32b8067f20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f32bc007fd0 tx=0x7f32bc009040 comp rx=0 tx=0).stop 2023-12-18T10:22:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 -- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32cc0cc6c0 msgr2=0x7f32cc164420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32cc0cc6c0 0x7f32cc164420 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f32c400caa0 tx=0x7f32c400cf60 comp rx=0 tx=0).stop 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 -- 172.21.15.133:0/672277238 shutdown_connections 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f32b8065a60 0x7f32b8067f20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32cc0cc6c0 0x7f32cc164420 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f32cc0afd10 0x7f32cc13fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 --2- 172.21.15.133:0/672277238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc06fb60 0x7f32cc140a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 -- 172.21.15.133:0/672277238 >> 172.21.15.133:0/672277238 conn(0x7f32cc0ce130 msgr2=0x7f32cc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 -- 172.21.15.133:0/672277238 shutdown_connections 2023-12-18T10:22:03.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:03.935+0000 7f32d10d7640 1 -- 172.21.15.133:0/672277238 wait complete. 2023-12-18T10:22:03.956 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-18T10:22:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.095+0000 7f39511ce640 1 Processor -- start 2023-12-18T10:22:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.095+0000 7f39511ce640 1 -- start start 2023-12-18T10:22:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.095+0000 7f39511ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c0cac10 0x7f394c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.095+0000 7f39511ce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f394c06fdb0 0x7f394c070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.095+0000 7f39511ce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c15f100 con 0x7f394c15a680 2023-12-18T10:22:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.095+0000 7f39511ce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0707a0 con 0x7f394c06fdb0 2023-12-18T10:22:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.095+0000 7f39511ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0ca7d0 con 0x7f394c0cac10 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c0cac10 0x7f394c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f394c06fdb0 0x7f394c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c0cac10 0x7f394c15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:41780/0 (socket says 172.21.15.133:41780) 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394b59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f394c06fdb0 0x7f394c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:32928/0 (socket says 172.21.15.133:32928) 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394a59c640 1 -- 172.21.15.133:0/4155563527 learned_addr learned my addr 172.21.15.133:0/4155563527 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394b59e640 1 -- 172.21.15.133:0/4155563527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c0cac10 msgr2=0x7f394c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394b59e640 1 --2- 172.21.15.133:0/4155563527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c0cac10 0x7f394c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394b59e640 1 -- 172.21.15.133:0/4155563527 >> v1:172.21.15.142:6789/0 conn(0x7f394c15a680 legacy=0x7f394c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394b59e640 1 -- 172.21.15.133:0/4155563527 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c15e860 con 0x7f394c06fdb0 2023-12-18T10:22:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f394b59e640 1 --2- 172.21.15.133:0/4155563527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c06fdb0 0x7f394c070260 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3944009d90 tx=0x7f394401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc50d3b54bb5e152 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f3949d9b640 1 -- 172.21.15.133:0/4155563527 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440a5980 con 0x7f394c06fdb0 2023-12-18T10:22:04.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f3949d9b640 1 -- 172.21.15.133:0/4155563527 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39440a5ae0 con 0x7f394c06fdb0 2023-12-18T10:22:04.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.099+0000 7f3949d9b640 1 -- 172.21.15.133:0/4155563527 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440a5e70 con 0x7f394c06fdb0 2023-12-18T10:22:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- 172.21.15.133:0/4155563527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c06fdb0 msgr2=0x7f394c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 --2- 172.21.15.133:0/4155563527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c06fdb0 0x7f394c070260 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3944009d90 tx=0x7f394401c8c0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- 172.21.15.133:0/4155563527 shutdown_connections 2023-12-18T10:22:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 --2- 172.21.15.133:0/4155563527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c0cac10 0x7f394c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 --2- 172.21.15.133:0/4155563527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c06fdb0 0x7f394c070260 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- 172.21.15.133:0/4155563527 >> 172.21.15.133:0/4155563527 conn(0x7f394c06a3e0 msgr2=0x7f394c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- 172.21.15.133:0/4155563527 shutdown_connections 2023-12-18T10:22:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- 172.21.15.133:0/4155563527 wait complete. 2023-12-18T10:22:04.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 Processor -- start 2023-12-18T10:22:04.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- start start 2023-12-18T10:22:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c06fdb0 0x7f394c0c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0cac10 0x7f394c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f394c15a680 0x7f394c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c5e00 con 0x7f394c15a680 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c141870 con 0x7f394c0cac10 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f39511ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c54d0 con 0x7f394c06fdb0 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f394b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f394c15a680 0x7f394c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f394b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f394c15a680 0x7f394c15cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36744/0 (socket says 172.21.15.133:36744) 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f394b59e640 1 -- 172.21.15.133:0/3074179558 learned_addr learned my addr 172.21.15.133:0/3074179558 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f394a59c640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0cac10 0x7f394c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.103+0000 7f394ad9d640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c06fdb0 0x7f394c0c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f394b59e640 1 -- 172.21.15.133:0/3074179558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c06fdb0 msgr2=0x7f394c0c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f394b59e640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c06fdb0 0x7f394c0c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f394b59e640 1 -- 172.21.15.133:0/3074179558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0cac10 msgr2=0x7f394c15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f394b59e640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0cac10 0x7f394c15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f394b59e640 1 -- 172.21.15.133:0/3074179558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944009a70 con 0x7f394c15a680 2023-12-18T10:22:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f394b59e640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f394c15a680 0x7f394c15cb70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f39440b0040 tx=0x7f3944019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f39337fe640 1 -- 172.21.15.133:0/3074179558 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440b9860 con 0x7f394c15a680 2023-12-18T10:22:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f39337fe640 1 -- 172.21.15.133:0/3074179558 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39440b99c0 con 0x7f394c15a680 2023-12-18T10:22:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f39337fe640 1 -- 172.21.15.133:0/3074179558 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440b9d70 con 0x7f394c15a680 2023-12-18T10:22:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f39511ce640 1 -- 172.21.15.133:0/3074179558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c0c57b0 con 0x7f394c15a680 2023-12-18T10:22:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f39511ce640 1 -- 172.21.15.133:0/3074179558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0c6290 con 0x7f394c15a680 2023-12-18T10:22:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f39337fe640 1 -- 172.21.15.133:0/3074179558 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39440ad440 con 0x7f394c15a680 2023-12-18T10:22:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f39337fe640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3938065a60 0x7f3938067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f39337fe640 1 -- 172.21.15.133:0/3074179558 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f394411e4b0 con 0x7f394c15a680 2023-12-18T10:22:04.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.107+0000 7f394ad9d640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3938065a60 0x7f3938067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 Processor -- start 2023-12-18T10:22:04.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3938065a60 0x7f3938067f20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f393c007fd0 tx=0x7f393c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- start start 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e57be0 0x55e595e0d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 0x55e595e0d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e595c2cc90 con 0x55e595e572c0 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e595c5e220 con 0x55e595e57be0 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e595c5b7f0 con 0x55e595e0d5d0 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36756/0 (socket says 172.21.15.133:36756) 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 -- 172.21.15.133:0/1944706893 learned_addr learned my addr 172.21.15.133:0/1944706893 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394a59c640 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e57be0 0x55e595e0d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394b59e640 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 0x55e595e0d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 -- 172.21.15.133:0/1944706893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 msgr2=0x55e595e0d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 0x55e595e0d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 -- 172.21.15.133:0/1944706893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e57be0 msgr2=0x55e595e0d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e57be0 0x55e595e0d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 -- 172.21.15.133:0/1944706893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e595953890 con 0x55e595e572c0 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f394ad9d640 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e576a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f393c00f950 tx=0x7f393c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7ecdd5d5fe6ce7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3930ff9640 1 -- 172.21.15.133:0/1944706893 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00fed0 con 0x55e595e572c0 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3930ff9640 1 -- 172.21.15.133:0/1944706893 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c014be0 con 0x55e595e572c0 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3930ff9640 1 -- 172.21.15.133:0/1944706893 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c020410 con 0x55e595e572c0 2023-12-18T10:22:04.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- 172.21.15.133:0/1944706893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 msgr2=0x55e595e576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e576a0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f393c00f950 tx=0x7f393c012000 comp rx=0 tx=0).stop 2023-12-18T10:22:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- 172.21.15.133:0/1944706893 shutdown_connections 2023-12-18T10:22:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 0x55e595e0d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e57be0 0x55e595e0d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 --2- 172.21.15.133:0/1944706893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e576a0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- 172.21.15.133:0/1944706893 >> 172.21.15.133:0/1944706893 conn(0x55e595e0f950 msgr2=0x55e595e07560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- 172.21.15.133:0/1944706893 shutdown_connections 2023-12-18T10:22:04.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.111+0000 7f3954549000 1 -- 172.21.15.133:0/1944706893 wait complete. 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 -- start start 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 Processor -- start 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 0x55e595e44b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e572c0 0x55e595e450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e57be0 0x55e595e45610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e595c570e0 con 0x55e595e57be0 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e595bf6310 con 0x55e595e0d5d0 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e595c14770 con 0x55e595e572c0 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 10 client.0 _ll_register_callbacks cb 0x55e595df4b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e57be0 0x55e595e45610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e57be0 0x55e595e45610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36758/0 (socket says 172.21.15.133:36758) 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 -- 172.21.15.133:0/2037868273 learned_addr learned my addr 172.21.15.133:0/2037868273 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394ad9d640 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 0x55e595e44b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394a59c640 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e572c0 0x55e595e450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 -- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e572c0 msgr2=0x55e595e450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e572c0 0x55e595e450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 -- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 msgr2=0x55e595e44b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 0x55e595e44b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 -- 172.21.15.133:0/2037868273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c15f100 con 0x55e595e57be0 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394b59e640 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e57be0 0x55e595e45610 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f39440984a0 tx=0x7f39440efb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b203ad2156b784c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3929ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3929ffb640 1 -- 172.21.15.133:0/2037868273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440efe60 con 0x55e595e57be0 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3929ffb640 1 -- 172.21.15.133:0/2037868273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f39440ede60 con 0x55e595e57be0 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 -- 172.21.15.133:0/2037868273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e595c26c10 con 0x55e595e57be0 2023-12-18T10:22:04.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3929ffb640 1 -- 172.21.15.133:0/2037868273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f394411e2c0 con 0x55e595e57be0 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 10 client.7116 fetch_fsmap learned FSMap version 55 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 -- 172.21.15.133:0/2037868273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e595c1c260 con 0x55e595e57be0 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3929ffb640 1 -- 172.21.15.133:0/2037868273 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e595c26c10 con 0x55e595e57be0 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3929ffb640 1 -- 172.21.15.133:0/2037868273 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 55) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f3944005d20 con 0x55e595e57be0 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 10 client.7116 fetch_fsmap finished waiting for FSMap version 55 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 10 client.7116 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 20 client.7116 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e595e45eb0 0x55e595e68830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 4 client.7116 mds_command: new command op to 6867 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f3954549000 1 -- 172.21.15.133:0/2037868273 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e595c55a30 con 0x55e595e45eb0 2023-12-18T10:22:04.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.115+0000 7f394ad9d640 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e595e45eb0 0x55e595e68830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f394ad9d640 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e595e45eb0 0x55e595e68830 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b58119a70774a6a4 server_cookie=28779aff66e4392a in_seq=0 out_seq=0 2023-12-18T10:22:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3929ffb640 10 client.7116 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:04.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3929ffb640 1 -- 172.21.15.133:0/2037868273 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55e595c55a30 con 0x55e595e45eb0 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3929ffb640 10 client.7116 handle_command_reply: tid=0 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 client.7116 shutdown 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 -- 172.21.15.133:0/2037868273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e57be0 msgr2=0x55e595e45610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e57be0 0x55e595e45610 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f39440984a0 tx=0x7f39440efb40 comp rx=0 tx=0).stop 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 -- 172.21.15.133:0/2037868273 shutdown_connections 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e595e45eb0 0x55e595e68830 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e57be0 0x55e595e45610 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e572c0 0x55e595e450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 --2- 172.21.15.133:0/2037868273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 0x55e595e44b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3929ffb640 0 client.7116 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 -- 172.21.15.133:0/2037868273 >> 172.21.15.133:0/2037868273 conn(0x55e595e0f950 msgr2=0x55e595e06cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 -- 172.21.15.133:0/2037868273 shutdown_connections 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 1 -- 172.21.15.133:0/2037868273 wait complete. 2023-12-18T10:22:04.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.119+0000 7f3954549000 20 client.7116 trim_cache size 0 max 16384 2023-12-18T10:22:04.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f3954549000 1 Processor -- start 2023-12-18T10:22:04.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f3954549000 1 -- start start 2023-12-18T10:22:04.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f3954549000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0f950 0x55e595e43d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f3954549000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 0x55e595e07ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f3954549000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e08220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f3954549000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e595914940 con 0x55e595e572c0 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f3954549000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e595c4c1f0 con 0x55e595e0d5d0 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f3954549000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e595c59c40 con 0x55e595e0f950 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e08220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394ad9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0f950 0x55e595e43d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e08220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36766/0 (socket says 172.21.15.133:36766) 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 -- 172.21.15.133:0/1073720972 learned_addr learned my addr 172.21.15.133:0/1073720972 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394a59c640 1 --2- 172.21.15.133:0/1073720972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 0x55e595e07ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 -- 172.21.15.133:0/1073720972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0f950 msgr2=0x55e595e43d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 --2- 172.21.15.133:0/1073720972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0f950 0x55e595e43d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 -- 172.21.15.133:0/1073720972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 msgr2=0x55e595e07ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 --2- 172.21.15.133:0/1073720972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 0x55e595e07ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 -- 172.21.15.133:0/1073720972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e595e57130 con 0x55e595e572c0 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.135+0000 7f394b59e640 1 --2- 172.21.15.133:0/1073720972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e08220 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f39440f7af0 tx=0x7f39440b2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32d47a6f6c3f041 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f39317fa640 1 -- 172.21.15.133:0/1073720972 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440a5970 con 0x55e595e572c0 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f39317fa640 1 -- 172.21.15.133:0/1073720972 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394411e2c0 con 0x55e595e572c0 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f39317fa640 1 -- 172.21.15.133:0/1073720972 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440f76c0 con 0x55e595e572c0 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- 172.21.15.133:0/1073720972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 msgr2=0x55e595e08220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 --2- 172.21.15.133:0/1073720972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e08220 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f39440f7af0 tx=0x7f39440b2000 comp rx=0 tx=0).stop 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- 172.21.15.133:0/1073720972 shutdown_connections 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 --2- 172.21.15.133:0/1073720972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e572c0 0x55e595e08220 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 --2- 172.21.15.133:0/1073720972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e0d5d0 0x55e595e07ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 --2- 172.21.15.133:0/1073720972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0f950 0x55e595e43d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- 172.21.15.133:0/1073720972 >> 172.21.15.133:0/1073720972 conn(0x55e595e14b70 msgr2=0x55e595e0e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- 172.21.15.133:0/1073720972 shutdown_connections 2023-12-18T10:22:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- 172.21.15.133:0/1073720972 wait complete. 2023-12-18T10:22:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- start start 2023-12-18T10:22:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 Processor -- start 2023-12-18T10:22:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 0x55e595eb4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e0f950 0x55e595e0a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e572c0 0x55e595e0a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e595c5f4b0 con 0x55e595e0f950 2023-12-18T10:22:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e595bff860 con 0x55e595e572c0 2023-12-18T10:22:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e595c10170 con 0x55e595e0d5d0 2023-12-18T10:22:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 10 client.0 _ll_register_callbacks cb 0x55e595c05640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e0f950 0x55e595e0a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e0f950 0x55e595e0a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36780/0 (socket says 172.21.15.133:36780) 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 -- 172.21.15.133:0/992120947 learned_addr learned my addr 172.21.15.133:0/992120947 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394ad9d640 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 0x55e595eb4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394b59e640 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e572c0 0x55e595e0a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 -- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 msgr2=0x55e595eb4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 0x55e595eb4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 -- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e572c0 msgr2=0x55e595e0a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e572c0 0x55e595e0a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 -- 172.21.15.133:0/992120947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e595c1c260 con 0x55e595e0f950 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f394a59c640 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e0f950 0x55e595e0a130 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f394c13e7c0 tx=0x7f39400039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753b0a4a9956d987 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3929ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3929ffb640 1 -- 172.21.15.133:0/992120947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394001b070 con 0x55e595e0f950 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3929ffb640 1 -- 172.21.15.133:0/992120947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3940021c10 con 0x55e595e0f950 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.139+0000 7f3954549000 1 -- 172.21.15.133:0/992120947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e595e158a0 con 0x55e595e0f950 2023-12-18T10:22:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3929ffb640 1 -- 172.21.15.133:0/992120947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3940021dd0 con 0x55e595e0f950 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 10 client.7122 fetch_fsmap learned FSMap version 55 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 -- 172.21.15.133:0/992120947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e595c023b0 con 0x55e595e0f950 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3929ffb640 1 -- 172.21.15.133:0/992120947 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e595e158a0 con 0x55e595e0f950 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3929ffb640 1 -- 172.21.15.133:0/992120947 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 55) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f3940011040 con 0x55e595e0f950 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 10 client.7122 fetch_fsmap finished waiting for FSMap version 55 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 10 client.7122 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 20 client.7122 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e595e57be0 0x55e595e0abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 4 client.7122 mds_command: new command op to 6867 tid=0[{"prefix": "status"}] 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 -- 172.21.15.133:0/992120947 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e595c1ce00 con 0x55e595e57be0 2023-12-18T10:22:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f394ad9d640 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e595e57be0 0x55e595e0abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3929ffb640 10 client.7122 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f394ad9d640 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e595e57be0 0x55e595e0abb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f1cb01a6c693b32 server_cookie=4575ff4f75c2c954 in_seq=0 out_seq=0 2023-12-18T10:22:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3929ffb640 1 -- 172.21.15.133:0/992120947 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55e595c1ce00 con 0x55e595e57be0 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3929ffb640 10 client.7122 handle_command_reply: tid=0 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 client.7122 shutdown 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 -- 172.21.15.133:0/992120947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e0f950 msgr2=0x55e595e0a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e0f950 0x55e595e0a130 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f394c13e7c0 tx=0x7f39400039f0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 -- 172.21.15.133:0/992120947 shutdown_connections 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e595e57be0 0x55e595e0abb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e595e572c0 0x55e595e0a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e595e0f950 0x55e595e0a130 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3929ffb640 0 client.7122 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 --2- 172.21.15.133:0/992120947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e595e0d5d0 0x55e595eb4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 -- 172.21.15.133:0/992120947 >> 172.21.15.133:0/992120947 conn(0x55e595e14b70 msgr2=0x55e595e0e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 -- 172.21.15.133:0/992120947 shutdown_connections 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 1 -- 172.21.15.133:0/992120947 wait complete. 2023-12-18T10:22:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f3954549000 20 client.7122 trim_cache size 0 max 16384 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6867, 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 15.743605298, 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 55, 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 65, 2023-12-18T10:22:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 65, 2023-12-18T10:22:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 20.022337215 2023-12-18T10:22:04.152 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 -- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3938065a60 msgr2=0x7f3938067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3938065a60 0x7f3938067f20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f393c007fd0 tx=0x7f393c009040 comp rx=0 tx=0).stop 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 -- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f394c15a680 msgr2=0x7f394c15cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f394c15a680 0x7f394c15cb70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f39440b0040 tx=0x7f3944019660 comp rx=0 tx=0).stop 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 -- 172.21.15.133:0/3074179558 shutdown_connections 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3938065a60 0x7f3938067f20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f394c15a680 0x7f394c15cb70 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f394c0cac10 0x7f394c15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 --2- 172.21.15.133:0/3074179558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f394c06fdb0 0x7f394c0c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 -- 172.21.15.133:0/3074179558 >> 172.21.15.133:0/3074179558 conn(0x7f394c06a3e0 msgr2=0x7f394c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 -- 172.21.15.133:0/3074179558 shutdown_connections 2023-12-18T10:22:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.143+0000 7f39511ce640 1 -- 172.21.15.133:0/3074179558 wait complete. 2023-12-18T10:22:04.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:22:04.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73acc41640 1 Processor -- start 2023-12-18T10:22:04.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73acc41640 1 -- start start 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73acc41640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73a8158c20 0x7f73a8070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73acc41640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a8070b80 con 0x7f73a815c800 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73acc41640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a8070e60 con 0x7f73a80cb180 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73acc41640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a8071140 con 0x7f73a8158c20 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73a659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73a8158c20 0x7f73a8070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73a659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73a8158c20 0x7f73a8070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36786/0 (socket says 172.21.15.133:36786) 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73a659c640 1 -- 172.21.15.133:0/3386086137 learned_addr learned my addr 172.21.15.133:0/3386086137 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73a659c640 1 -- 172.21.15.133:0/3386086137 >> v1:172.21.15.142:6789/0 conn(0x7f73a80cb180 legacy=0x7f73a80ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73a659c640 1 -- 172.21.15.133:0/3386086137 >> v1:172.21.15.133:6789/0 conn(0x7f73a815c800 legacy=0x7f73a80caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.299+0000 7f73a659c640 1 -- 172.21.15.133:0/3386086137 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a8071420 con 0x7f73a8158c20 2023-12-18T10:22:04.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73a659c640 1 --2- 172.21.15.133:0/3386086137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a8158c20 0x7f73a8070510 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7398009870 tx=0x7f739801f0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6546e4160d36e07d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73a5d9b640 1 -- 172.21.15.133:0/3386086137 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980aa620 con 0x7f73a8158c20 2023-12-18T10:22:04.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73a5d9b640 1 -- 172.21.15.133:0/3386086137 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73980aa780 con 0x7f73a8158c20 2023-12-18T10:22:04.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73a5d9b640 1 -- 172.21.15.133:0/3386086137 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980aab10 con 0x7f73a8158c20 2023-12-18T10:22:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73acc41640 1 -- 172.21.15.133:0/3386086137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a8158c20 msgr2=0x7f73a8070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73acc41640 1 --2- 172.21.15.133:0/3386086137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a8158c20 0x7f73a8070510 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7398009870 tx=0x7f739801f0b0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73acc41640 1 -- 172.21.15.133:0/3386086137 shutdown_connections 2023-12-18T10:22:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73acc41640 1 --2- 172.21.15.133:0/3386086137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a8158c20 0x7f73a8070510 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73acc41640 1 -- 172.21.15.133:0/3386086137 >> 172.21.15.133:0/3386086137 conn(0x7f73a806a3e0 msgr2=0x7f73a80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73acc41640 1 -- 172.21.15.133:0/3386086137 shutdown_connections 2023-12-18T10:22:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.303+0000 7f73acc41640 1 -- 172.21.15.133:0/3386086137 wait complete. 2023-12-18T10:22:04.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73acc41640 1 Processor -- start 2023-12-18T10:22:04.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73acc41640 1 -- start start 2023-12-18T10:22:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73acc41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a80cb180 0x7f73a80ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73acc41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8158c20 0x7f73a814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73acc41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a815c800 0x7f73a814f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73acc41640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a814d960 con 0x7f73a80cb180 2023-12-18T10:22:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73acc41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a81f6390 con 0x7f73a8158c20 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73acc41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a81f6f10 con 0x7f73a815c800 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a80cb180 0x7f73a80ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a80cb180 0x7f73a80ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36802/0 (socket says 172.21.15.133:36802) 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 -- 172.21.15.133:0/416484242 learned_addr learned my addr 172.21.15.133:0/416484242 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f739ffff640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8158c20 0x7f73a814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a6d9d640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a815c800 0x7f73a814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 -- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a815c800 msgr2=0x7f73a814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a815c800 0x7f73a814f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 -- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8158c20 msgr2=0x7f73a814d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8158c20 0x7f73a814d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 -- 172.21.15.133:0/416484242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73980094d0 con 0x7f73a80cb180 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a6d9d640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a815c800 0x7f73a814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.307+0000 7f73a659c640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a80cb180 0x7f73a80ae880 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f739801c280 tx=0x7f739801b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f739effd640 1 -- 172.21.15.133:0/416484242 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980b2810 con 0x7f73a80cb180 2023-12-18T10:22:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f739effd640 1 -- 172.21.15.133:0/416484242 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73980b2970 con 0x7f73a80cb180 2023-12-18T10:22:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f739effd640 1 -- 172.21.15.133:0/416484242 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980b2d20 con 0x7f73a80cb180 2023-12-18T10:22:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a80c8800 con 0x7f73a80cb180 2023-12-18T10:22:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a81f65e0 con 0x7f73a80cb180 2023-12-18T10:22:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a80735b0 con 0x7f73a80cb180 2023-12-18T10:22:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f739effd640 1 -- 172.21.15.133:0/416484242 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f73980be460 con 0x7f73a80cb180 2023-12-18T10:22:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f739effd640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7388065a60 0x7f7388067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f739effd640 1 -- 172.21.15.133:0/416484242 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f739811d8f0 con 0x7f73a80cb180 2023-12-18T10:22:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f739ffff640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7388065a60 0x7f7388067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.311+0000 7f739ffff640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7388065a60 0x7f7388067f20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73a80cade0 tx=0x7f7390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:04.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.315+0000 7f739effd640 1 -- 172.21.15.133:0/416484242 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f73980eb2b0 con 0x7f73a80cb180 2023-12-18T10:22:04.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.499+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73a80cd2a0 con 0x7f73a80cb180 2023-12-18T10:22:04.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.499+0000 7f739effd640 1 -- 172.21.15.133:0/416484242 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4744 (secure 0 0 0) 0x7f73980ee8d0 con 0x7f73a80cb180 2023-12-18T10:22:04.505 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:04.505 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:22:02.990650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6867,"mds_1":6861,"mds_2":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":2,"incarnation":54,"state":"up:active","state_seq":6,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":52,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:22:04.505 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 55 2023-12-18T10:22:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7388065a60 msgr2=0x7f7388067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7388065a60 0x7f7388067f20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73a80cade0 tx=0x7f7390009040 comp rx=0 tx=0).stop 2023-12-18T10:22:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a80cb180 msgr2=0x7f73a80ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a80cb180 0x7f73a80ae880 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f739801c280 tx=0x7f739801b3f0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 shutdown_connections 2023-12-18T10:22:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7388065a60 0x7f7388067f20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a815c800 0x7f73a814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a8158c20 0x7f73a814d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 --2- 172.21.15.133:0/416484242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a80cb180 0x7f73a80ae880 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 >> 172.21.15.133:0/416484242 conn(0x7f73a806a3e0 msgr2=0x7f73a8151020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 shutdown_connections 2023-12-18T10:22:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:04.503+0000 7f73acc41640 1 -- 172.21.15.133:0/416484242 wait complete. 2023-12-18T10:22:04.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:04.526 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:22:04.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:04.560 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:22:04.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:04.618 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-12-18T10:22:04.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:04.672 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-12-18T10:22:04.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:04.724 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-12-18T10:22:04.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:22:04.941 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:22:04.942 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:22:04.942 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:22:06.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:22:07.108 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:22:07.108 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:22:07.108 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:22:09.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:22:09.277 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:22:09.278 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:22:09.278 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:22:11.279 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:22:11.438 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:22:11.438 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:22:11.439 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:22:13.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:22:13.603 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:22:13.603 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:22:13.604 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:22:15.605 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:22:15.770 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-12-18T10:22:15.770 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:22:15.771 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:22:15.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:22:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:22:15.936 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:22:15.936 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:22:17.937 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:22:18.102 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:22:18.102 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:22:18.102 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:22:20.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:22:20.270 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-12-18T10:22:20.270 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:22:20.271 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:22:20.271 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:22:20.437 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:22:20.438 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:22:20.438 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:22:20.438 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2023-12-18T10:22:20.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f1256d640 1 Processor -- start 2023-12-18T10:22:20.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f1256d640 1 -- start start 2023-12-18T10:22:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f1256d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f0c1582d0 0x7f3f0c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f1256d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0c9390 con 0x7f3f0c070820 2023-12-18T10:22:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f1256d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c15aee0 con 0x7f3f0c0ce3b0 2023-12-18T10:22:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f1256d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c15b1c0 con 0x7f3f0c1582d0 2023-12-18T10:22:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f0bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f0c1582d0 0x7f3f0c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f03fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3f0c070820 0x7f3f0c0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53070/0 (socket says 172.21.15.133:53070) 2023-12-18T10:22:20.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f03fff640 1 -- 172.21.15.133:0/2213432987 learned_addr learned my addr 172.21.15.133:0/2213432987 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:20.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f0b7fe640 1 -- 172.21.15.133:0/2213432987 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485223284 0 0) 0x7f3f0c0c9390 con 0x7f3f0c070820 2023-12-18T10:22:20.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f0bfff640 1 -- 172.21.15.133:0/2213432987 >> v1:172.21.15.142:6789/0 conn(0x7f3f0c0ce3b0 legacy=0x7f3f0c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f0bfff640 1 -- 172.21.15.133:0/2213432987 >> v1:172.21.15.133:6789/0 conn(0x7f3f0c070820 legacy=0x7f3f0c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.575+0000 7f3f0bfff640 1 -- 172.21.15.133:0/2213432987 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c15b4a0 con 0x7f3f0c1582d0 2023-12-18T10:22:20.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/2213432987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c1582d0 0x7f3f0c0c8e50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed67805496d4937 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f0b7fe640 1 -- 172.21.15.133:0/2213432987 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0a7070 con 0x7f3f0c1582d0 2023-12-18T10:22:20.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f0b7fe640 1 -- 172.21.15.133:0/2213432987 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0ab430 con 0x7f3f0c1582d0 2023-12-18T10:22:20.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f0b7fe640 1 -- 172.21.15.133:0/2213432987 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0ab7c0 con 0x7f3f0c1582d0 2023-12-18T10:22:20.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f1256d640 1 -- 172.21.15.133:0/2213432987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c1582d0 msgr2=0x7f3f0c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f1256d640 1 --2- 172.21.15.133:0/2213432987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c1582d0 0x7f3f0c0c8e50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01c410 comp rx=0 tx=0).stop 2023-12-18T10:22:20.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f1256d640 1 -- 172.21.15.133:0/2213432987 shutdown_connections 2023-12-18T10:22:20.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f1256d640 1 --2- 172.21.15.133:0/2213432987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c1582d0 0x7f3f0c0c8e50 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f1256d640 1 -- 172.21.15.133:0/2213432987 >> 172.21.15.133:0/2213432987 conn(0x7f3f0c06a2a0 msgr2=0x7f3f0c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f1256d640 1 -- 172.21.15.133:0/2213432987 shutdown_connections 2023-12-18T10:22:20.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.579+0000 7f3f1256d640 1 -- 172.21.15.133:0/2213432987 wait complete. 2023-12-18T10:22:20.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 Processor -- start 2023-12-18T10:22:20.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 -- start start 2023-12-18T10:22:20.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c070820 0x7f3f0c15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c0ce3b0 0x7f3f0c154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c1582d0 0x7f3f0c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0ae210 con 0x7f3f0c070820 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c154c00 con 0x7f3f0c1582d0 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c154ee0 con 0x7f3f0c0ce3b0 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c070820 0x7f3f0c15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c070820 0x7f3f0c15ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52030/0 (socket says 172.21.15.133:52030) 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 -- 172.21.15.133:0/21501769 learned_addr learned my addr 172.21.15.133:0/21501769 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c1582d0 0x7f3f0c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f03fff640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c0ce3b0 0x7f3f0c154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 -- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c0ce3b0 msgr2=0x7f3f0c154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c0ce3b0 0x7f3f0c154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 -- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c1582d0 msgr2=0x7f3f0c1545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c1582d0 0x7f3f0c1545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 -- 172.21.15.133:0/21501769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc009420 con 0x7f3f0c070820 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f03fff640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c0ce3b0 0x7f3f0c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:20.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c1582d0 0x7f3f0c1545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c070820 0x7f3f0c15ebd0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0ad040 tx=0x7f3efc0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f097fa640 1 -- 172.21.15.133:0/21501769 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc004230 con 0x7f3f0c070820 2023-12-18T10:22:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f097fa640 1 -- 172.21.15.133:0/21501769 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc004390 con 0x7f3f0c070820 2023-12-18T10:22:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 -- 172.21.15.133:0/21501769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c1551c0 con 0x7f3f0c070820 2023-12-18T10:22:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f097fa640 1 -- 172.21.15.133:0/21501769 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc003820 con 0x7f3f0c070820 2023-12-18T10:22:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.583+0000 7f3f1256d640 1 -- 172.21.15.133:0/21501769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c1462b0 con 0x7f3f0c070820 2023-12-18T10:22:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.587+0000 7f3f097fa640 1 -- 172.21.15.133:0/21501769 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3efc003980 con 0x7f3f0c070820 2023-12-18T10:22:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.587+0000 7f3f097fa640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.587+0000 7f3f097fa640 1 -- 172.21.15.133:0/21501769 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3efc11cf10 con 0x7f3f0c070820 2023-12-18T10:22:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.587+0000 7f3f03fff640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.587+0000 7f3f158c4000 1 Processor -- start 2023-12-18T10:22:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.587+0000 7f3f158c4000 1 -- start start 2023-12-18T10:22:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.587+0000 7f3f03fff640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0cb590 tx=0x7f3ef4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b76c80 0x55cd01b77060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 0x55cd01b2ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 0x55cd01b2d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd019f5430 con 0x55cd01b76c80 2023-12-18T10:22:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd01983460 con 0x55cd01b2cfc0 2023-12-18T10:22:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd01980a30 con 0x55cd01b775a0 2023-12-18T10:22:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b76c80 0x55cd01b77060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b76c80 0x55cd01b77060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52038/0 (socket says 172.21.15.133:52038) 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 -- 172.21.15.133:0/4071794525 learned_addr learned my addr 172.21.15.133:0/4071794525 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f03fff640 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 0x55cd01b2ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 0x55cd01b2d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 -- 172.21.15.133:0/4071794525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 msgr2=0x55cd01b2ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 0x55cd01b2ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 -- 172.21.15.133:0/4071794525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 msgr2=0x55cd01b2d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 0x55cd01b2d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 -- 172.21.15.133:0/4071794525 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd01678e20 con 0x55cd01b76c80 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b76c80 0x55cd01b77060 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0f5e60 tx=0x7f3efc0ee2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e28121058d56382 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f01ffb640 1 -- 172.21.15.133:0/4071794525 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0ee3b0 con 0x55cd01b76c80 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f01ffb640 1 -- 172.21.15.133:0/4071794525 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0f21e0 con 0x55cd01b76c80 2023-12-18T10:22:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f01ffb640 1 -- 172.21.15.133:0/4071794525 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0f6390 con 0x55cd01b76c80 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- 172.21.15.133:0/4071794525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b76c80 msgr2=0x55cd01b77060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b76c80 0x55cd01b77060 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0f5e60 tx=0x7f3efc0ee2b0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- 172.21.15.133:0/4071794525 shutdown_connections 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 0x55cd01b2d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 0x55cd01b2ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4071794525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b76c80 0x55cd01b77060 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- 172.21.15.133:0/4071794525 >> 172.21.15.133:0/4071794525 conn(0x55cd0192b910 msgr2=0x55cd01b2b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- 172.21.15.133:0/4071794525 shutdown_connections 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- 172.21.15.133:0/4071794525 wait complete. 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 -- start start 2023-12-18T10:22:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.591+0000 7f3f158c4000 1 Processor -- start 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 0x55cd01b7e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b76c80 0x55cd01b7e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b77980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd0197c320 con 0x55cd01b775a0 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd0191b4f0 con 0x55cd01b2cfc0 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd019396e0 con 0x55cd01b76c80 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 10 client.0 _ll_register_callbacks cb 0x55cd01b18980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b77980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b77980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52048/0 (socket says 172.21.15.133:52048) 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 -- 172.21.15.133:0/4144116671 learned_addr learned my addr 172.21.15.133:0/4144116671 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f03fff640 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b76c80 0x55cd01b7e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 0x55cd01b7e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 -- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b76c80 msgr2=0x55cd01b7e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b76c80 0x55cd01b7e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 -- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 msgr2=0x55cd01b7e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 0x55cd01b7e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 -- 172.21.15.133:0/4144116671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c1462b0 con 0x55cd01b775a0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b77980 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400f4e0 tx=0x7f3f0400f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f749ad4630d2d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 1 -- 172.21.15.133:0/4144116671 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04003b90 con 0x55cd01b775a0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 1 -- 172.21.15.133:0/4144116671 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f04003cf0 con 0x55cd01b775a0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- 172.21.15.133:0/4144116671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd01939120 con 0x55cd01b775a0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 1 -- 172.21.15.133:0/4144116671 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f040018a0 con 0x55cd01b775a0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 10 client.7146 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- 172.21.15.133:0/4144116671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x55cd01941250 con 0x55cd01b775a0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 1 -- 172.21.15.133:0/4144116671 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd01939120 con 0x55cd01b775a0 2023-12-18T10:22:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 1 -- 172.21.15.133:0/4144116671 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3f04012070 con 0x55cd01b775a0 2023-12-18T10:22:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 10 client.7146 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 10 client.7146 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 20 client.7146 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55cd01b786f0 0x55cd01b78b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 4 client.7146 mds_command: new command op to 6867 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- 172.21.15.133:0/4144116671 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd0197ac70 con 0x55cd01b786f0 2023-12-18T10:22:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55cd01b786f0 0x55cd01b78b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55cd01b786f0 0x55cd01b78b00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4742f6f35dbb0aef server_cookie=f04eda0ad06270d0 in_seq=0 out_seq=0 2023-12-18T10:22:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 10 client.7146 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 1 -- 172.21.15.133:0/4144116671 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55cd0197ac70 con 0x55cd01b786f0 2023-12-18T10:22:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 10 client.7146 handle_command_reply: tid=0 2023-12-18T10:22:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 client.7146 shutdown 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- 172.21.15.133:0/4144116671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 msgr2=0x55cd01b77980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b77980 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400f4e0 tx=0x7f3f0400f9a0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- 172.21.15.133:0/4144116671 shutdown_connections 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55cd01b786f0 0x55cd01b78b00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b77980 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b76c80 0x55cd01b7e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 --2- 172.21.15.133:0/4144116671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b2cfc0 0x55cd01b7e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3eeaffd640 0 client.7146 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- 172.21.15.133:0/4144116671 >> 172.21.15.133:0/4144116671 conn(0x55cd0192b910 msgr2=0x55cd01b2ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- 172.21.15.133:0/4144116671 shutdown_connections 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 1 -- 172.21.15.133:0/4144116671 wait complete. 2023-12-18T10:22:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.595+0000 7f3f158c4000 20 client.7146 trim_cache size 0 max 16384 2023-12-18T10:22:20.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 Processor -- start 2023-12-18T10:22:20.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- start start 2023-12-18T10:22:20.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b2cfc0 0x55cd01b7c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01b7c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b70010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd01639aa0 con 0x55cd01b775a0 2023-12-18T10:22:20.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd0193a480 con 0x55cd01b76c80 2023-12-18T10:22:20.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd01b84aa0 con 0x55cd01b2cfc0 2023-12-18T10:22:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01b7c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01b7c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:52184/0 (socket says 172.21.15.133:52184) 2023-12-18T10:22:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 -- 172.21.15.133:0/724774975 learned_addr learned my addr 172.21.15.133:0/724774975 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b70010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b2cfc0 0x55cd01b7c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 -- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b2cfc0 msgr2=0x55cd01b7c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b2cfc0 0x55cd01b7c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 -- 172.21.15.133:0/724774975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 msgr2=0x55cd01b70010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b70010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 -- 172.21.15.133:0/724774975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd019275a0 con 0x55cd01b76c80 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b2cfc0 0x55cd01b7c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b70010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f03fff640 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01b7c740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4000c10 tx=0x7f3ef4010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98e99fa6403cc206 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f027fc640 1 -- 172.21.15.133:0/724774975 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40076b0 con 0x55cd01b76c80 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f027fc640 1 -- 172.21.15.133:0/724774975 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4005c90 con 0x55cd01b76c80 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f027fc640 1 -- 172.21.15.133:0/724774975 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4022440 con 0x55cd01b76c80 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 msgr2=0x55cd01b7c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01b7c740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4000c10 tx=0x7f3ef4010000 comp rx=0 tx=0).stop 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- 172.21.15.133:0/724774975 shutdown_connections 2023-12-18T10:22:20.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b775a0 0x55cd01b70010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01b7c740 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 --2- 172.21.15.133:0/724774975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b2cfc0 0x55cd01b7c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- 172.21.15.133:0/724774975 >> 172.21.15.133:0/724774975 conn(0x55cd0192b910 msgr2=0x55cd01b7aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- 172.21.15.133:0/724774975 shutdown_connections 2023-12-18T10:22:20.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.611+0000 7f3f158c4000 1 -- 172.21.15.133:0/724774975 wait complete. 2023-12-18T10:22:20.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 -- start start 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 Processor -- start 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b2cfc0 0x55cd01bb7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01bb88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 0x55cd01bb8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd01a33e50 con 0x55cd01b2cfc0 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd01a4b140 con 0x55cd01b76c80 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd01979b30 con 0x55cd01b775a0 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 10 client.0 _ll_register_callbacks cb 0x55cd01933710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b2cfc0 0x55cd01bb7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b2cfc0 0x55cd01bb7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52066/0 (socket says 172.21.15.133:52066) 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 -- 172.21.15.133:0/3657860993 learned_addr learned my addr 172.21.15.133:0/3657860993 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f03fff640 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01bb88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f10b0a640 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 0x55cd01bb8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 -- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 msgr2=0x55cd01bb8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 0x55cd01bb8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 -- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 msgr2=0x55cd01bb88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01bb88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 -- 172.21.15.133:0/3657860993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef4007360 con 0x55cd01b2cfc0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f0bfff640 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b2cfc0 0x55cd01bb7e50 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3efc004000 tx=0x7f3efc0c3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f6085bd366df6b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3eeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3eeaffd640 1 -- 172.21.15.133:0/3657860993 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc004500 con 0x55cd01b2cfc0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3eeaffd640 1 -- 172.21.15.133:0/3657860993 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3efc0ee3b0 con 0x55cd01b2cfc0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 -- 172.21.15.133:0/3657860993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd01b30940 con 0x55cd01b2cfc0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3eeaffd640 1 -- 172.21.15.133:0/3657860993 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3efc0f6390 con 0x55cd01b2cfc0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 10 client.7152 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 -- 172.21.15.133:0/3657860993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x55cd0191b110 con 0x55cd01b2cfc0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3eeaffd640 1 -- 172.21.15.133:0/3657860993 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd01b30940 con 0x55cd01b2cfc0 2023-12-18T10:22:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3eeaffd640 1 -- 172.21.15.133:0/3657860993 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3efc10e050 con 0x55cd01b2cfc0 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 10 client.7152 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 10 client.7152 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 20 client.7152 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55cd01bb9360 0x55cd01bb9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 4 client.7152 mds_command: new command op to 6867 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f158c4000 1 -- 172.21.15.133:0/3657860993 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cd019456a0 con 0x55cd01bb9360 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f03fff640 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55cd01bb9360 0x55cd01bb9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3f03fff640 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55cd01bb9360 0x55cd01bb9770 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dff2cc06fa9a053a server_cookie=34b966c61d2fc09d in_seq=0 out_seq=0 2023-12-18T10:22:20.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.615+0000 7f3eeaffd640 10 client.7152 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:20.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3eeaffd640 1 -- 172.21.15.133:0/3657860993 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cd019456a0 con 0x55cd01bb9360 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3eeaffd640 10 client.7152 handle_command_reply: tid=0 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 client.7152 shutdown 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 -- 172.21.15.133:0/3657860993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b2cfc0 msgr2=0x55cd01bb7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b2cfc0 0x55cd01bb7e50 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3efc004000 tx=0x7f3efc0c3000 comp rx=0 tx=0).stop 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 -- 172.21.15.133:0/3657860993 shutdown_connections 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55cd01bb9360 0x55cd01bb9770 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cd01b775a0 0x55cd01bb8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cd01b76c80 0x55cd01bb88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3eeaffd640 0 client.7152 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 --2- 172.21.15.133:0/3657860993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cd01b2cfc0 0x55cd01bb7e50 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 -- 172.21.15.133:0/3657860993 >> 172.21.15.133:0/3657860993 conn(0x55cd0192b910 msgr2=0x55cd01b7aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 -- 172.21.15.133:0/3657860993 shutdown_connections 2023-12-18T10:22:20.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 1 -- 172.21.15.133:0/3657860993 wait complete. 2023-12-18T10:22:20.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f158c4000 20 client.7152 trim_cache size 0 max 16384 2023-12-18T10:22:20.637 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:20.637 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:22:20.637 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:22:20.637 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 -- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 msgr2=0x7f3eec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0cb590 tx=0x7f3ef4009040 comp rx=0 tx=0).stop 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 -- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c070820 msgr2=0x7f3f0c15ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c070820 0x7f3f0c15ebd0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0ad040 tx=0x7f3efc0191b0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 -- 172.21.15.133:0/21501769 shutdown_connections 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3eec065a60 0x7f3eec067f20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f0c1582d0 0x7f3f0c1545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f0c0ce3b0 0x7f3f0c154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 --2- 172.21.15.133:0/21501769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f0c070820 0x7f3f0c15ebd0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 -- 172.21.15.133:0/21501769 >> 172.21.15.133:0/21501769 conn(0x7f3f0c06a2a0 msgr2=0x7f3f0c0ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 -- 172.21.15.133:0/21501769 shutdown_connections 2023-12-18T10:22:20.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.631+0000 7f3f1256d640 1 -- 172.21.15.133:0/21501769 wait complete. 2023-12-18T10:22:20.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 flush journal 2023-12-18T10:22:20.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea19495640 1 Processor -- start 2023-12-18T10:22:20.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea19495640 1 -- start start 2023-12-18T10:22:20.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea19495640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea14153020 0x7fea140c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea19495640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea140ceaa0 0x7fea14070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea19495640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea140c9730 con 0x7fea141598d0 2023-12-18T10:22:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea19495640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140c8e00 con 0x7fea140ceaa0 2023-12-18T10:22:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea19495640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140c90e0 con 0x7fea14153020 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea12ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea14153020 0x7fea140c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea137fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea140ceaa0 0x7fea14070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea0a7fc640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fea141598d0 0x7fea140ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:45900/0 (socket says 172.21.15.133:45900) 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea0a7fc640 1 -- 172.21.15.133:0/2474882454 learned_addr learned my addr 172.21.15.133:0/2474882454 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea127fc640 1 -- 172.21.15.133:0/2474882454 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637214126 0 0) 0x7fea140c9730 con 0x7fea141598d0 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea127fc640 1 -- 172.21.15.133:0/2474882454 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea00003530 con 0x7fea141598d0 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea137fe640 1 -- 172.21.15.133:0/2474882454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea14153020 msgr2=0x7fea140c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea137fe640 1 --2- 172.21.15.133:0/2474882454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea14153020 0x7fea140c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea137fe640 1 -- 172.21.15.133:0/2474882454 >> v1:172.21.15.142:6789/0 conn(0x7fea141598d0 legacy=0x7fea140ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea137fe640 1 -- 172.21.15.133:0/2474882454 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140c93c0 con 0x7fea140ceaa0 2023-12-18T10:22:20.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.791+0000 7fea12ffd640 1 --2- 172.21.15.133:0/2474882454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea14153020 0x7fea140c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:20.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea137fe640 1 --2- 172.21.15.133:0/2474882454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea140ceaa0 0x7fea14070590 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0097c0 tx=0x7fea0c01c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bce838dc703c1433 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea127fc640 1 -- 172.21.15.133:0/2474882454 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0ab600 con 0x7fea140ceaa0 2023-12-18T10:22:20.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea127fc640 1 -- 172.21.15.133:0/2474882454 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c0a7050 con 0x7fea140ceaa0 2023-12-18T10:22:20.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea127fc640 1 -- 172.21.15.133:0/2474882454 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0ab980 con 0x7fea140ceaa0 2023-12-18T10:22:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea19495640 1 -- 172.21.15.133:0/2474882454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea140ceaa0 msgr2=0x7fea14070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea19495640 1 --2- 172.21.15.133:0/2474882454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea140ceaa0 0x7fea14070590 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0097c0 tx=0x7fea0c01c300 comp rx=0 tx=0).stop 2023-12-18T10:22:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea19495640 1 -- 172.21.15.133:0/2474882454 shutdown_connections 2023-12-18T10:22:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea19495640 1 --2- 172.21.15.133:0/2474882454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea140ceaa0 0x7fea14070590 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea19495640 1 --2- 172.21.15.133:0/2474882454 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea14153020 0x7fea140c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea19495640 1 -- 172.21.15.133:0/2474882454 >> 172.21.15.133:0/2474882454 conn(0x7fea1406a2a0 msgr2=0x7fea140aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea19495640 1 -- 172.21.15.133:0/2474882454 shutdown_connections 2023-12-18T10:22:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.795+0000 7fea19495640 1 -- 172.21.15.133:0/2474882454 wait complete. 2023-12-18T10:22:20.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 Processor -- start 2023-12-18T10:22:20.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 -- start start 2023-12-18T10:22:20.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea140ceaa0 0x7fea140afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea14153020 0x7fea140b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea141598d0 0x7fea140b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140affd0 con 0x7fea14153020 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea14137e60 con 0x7fea141598d0 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea141493c0 con 0x7fea140ceaa0 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea14153020 0x7fea140b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea14153020 0x7fea140b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52080/0 (socket says 172.21.15.133:52080) 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 -- 172.21.15.133:0/3207162201 learned_addr learned my addr 172.21.15.133:0/3207162201 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea137fe640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea141598d0 0x7fea140b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea12ffd640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea140ceaa0 0x7fea140afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 -- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea140ceaa0 msgr2=0x7fea140afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea140ceaa0 0x7fea140afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 -- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea141598d0 msgr2=0x7fea140b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea141598d0 0x7fea140b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 -- 172.21.15.133:0/3207162201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04009420 con 0x7fea14153020 2023-12-18T10:22:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea137fe640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea141598d0 0x7fea140b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea14153020 0x7fea140b1060 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00cbc0 tx=0x7fe9fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0bfff640 1 -- 172.21.15.133:0/3207162201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc00ad40 con 0x7fea14153020 2023-12-18T10:22:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0bfff640 1 -- 172.21.15.133:0/3207162201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc012400 con 0x7fea14153020 2023-12-18T10:22:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea0bfff640 1 -- 172.21.15.133:0/3207162201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc00aea0 con 0x7fea14153020 2023-12-18T10:22:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 -- 172.21.15.133:0/3207162201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0c009420 con 0x7fea14153020 2023-12-18T10:22:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.799+0000 7fea19495640 1 -- 172.21.15.133:0/3207162201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea14149980 con 0x7fea14153020 2023-12-18T10:22:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.803+0000 7fea0bfff640 1 -- 172.21.15.133:0/3207162201 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe9fc007070 con 0x7fea14153020 2023-12-18T10:22:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.803+0000 7fea0bfff640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9f4065a60 0x7fe9f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.803+0000 7fea0bfff640 1 -- 172.21.15.133:0/3207162201 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe9fc0832b0 con 0x7fea14153020 2023-12-18T10:22:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.803+0000 7fea1c804000 1 Processor -- start 2023-12-18T10:22:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.803+0000 7fea12ffd640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9f4065a60 0x7fe9f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.803+0000 7fea1c804000 1 -- start start 2023-12-18T10:22:20.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.803+0000 7fea12ffd640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9f4065a60 0x7fe9f4067f20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fea04009cf0 tx=0x7fea04009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6e65060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6e1aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e1afc0 0x5619e6e1b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e6ce3430 con 0x5619e6e64c80 2023-12-18T10:22:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e6c71460 con 0x5619e6e655a0 2023-12-18T10:22:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5619e6c6ea30 con 0x5619e6e1afc0 2023-12-18T10:22:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6e65060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6e65060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52082/0 (socket says 172.21.15.133:52082) 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 -- 172.21.15.133:0/1986489978 learned_addr learned my addr 172.21.15.133:0/1986489978 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6e1aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea137fe640 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e1afc0 0x5619e6e1b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 -- 172.21.15.133:0/1986489978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e1afc0 msgr2=0x5619e6e1b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e1afc0 0x5619e6e1b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 -- 172.21.15.133:0/1986489978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 msgr2=0x5619e6e1aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6e1aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 -- 172.21.15.133:0/1986489978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619e6966e20 con 0x5619e6e64c80 2023-12-18T10:22:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6e65060 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fea04014440 tx=0x7fea04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2be5e2ed53caf3f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea08ff9640 1 -- 172.21.15.133:0/1986489978 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04014cc0 con 0x5619e6e64c80 2023-12-18T10:22:20.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea08ff9640 1 -- 172.21.15.133:0/1986489978 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea04014e20 con 0x5619e6e64c80 2023-12-18T10:22:20.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea08ff9640 1 -- 172.21.15.133:0/1986489978 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040215f0 con 0x5619e6e64c80 2023-12-18T10:22:20.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- 172.21.15.133:0/1986489978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 msgr2=0x5619e6e65060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6e65060 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fea04014440 tx=0x7fea04014000 comp rx=0 tx=0).stop 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- 172.21.15.133:0/1986489978 shutdown_connections 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e1afc0 0x5619e6e1b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6e1aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 --2- 172.21.15.133:0/1986489978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6e65060 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- 172.21.15.133:0/1986489978 >> 172.21.15.133:0/1986489978 conn(0x5619e6c19910 msgr2=0x5619e6e19360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- 172.21.15.133:0/1986489978 shutdown_connections 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- 172.21.15.133:0/1986489978 wait complete. 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 -- start start 2023-12-18T10:22:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.807+0000 7fea1c804000 1 Processor -- start 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6e6c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6e6c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6e25e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e6c6a320 con 0x5619e6e1afc0 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e6c094f0 con 0x5619e6e655a0 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5619e6c276e0 con 0x5619e6e64c80 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 10 client.0 _ll_register_callbacks cb 0x5619e6e06980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6e6c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6e6c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52090/0 (socket says 172.21.15.133:52090) 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 -- 172.21.15.133:0/1418383618 learned_addr learned my addr 172.21.15.133:0/1418383618 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea137fe640 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6e25e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6e6c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 -- 172.21.15.133:0/1418383618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 msgr2=0x5619e6e6c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6e6c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 -- 172.21.15.133:0/1418383618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 msgr2=0x5619e6e25e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6e25e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 -- 172.21.15.133:0/1418383618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea04009d20 con 0x5619e6e1afc0 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6e6c2a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x5619e6d19180 tx=0x7fea04004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944ece58b2619466 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1418383618 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04003820 con 0x5619e6e1afc0 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1418383618 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fea0401c040 con 0x5619e6e1afc0 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- 172.21.15.133:0/1418383618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619e6c27120 con 0x5619e6e1afc0 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1418383618 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea040059a0 con 0x5619e6e1afc0 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 10 client.7161 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- 172.21.15.133:0/1418383618 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5619e6c2f250 con 0x5619e6e1afc0 2023-12-18T10:22:20.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1418383618 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619e6c27120 con 0x5619e6e1afc0 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1418383618 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fea04005b00 con 0x5619e6e1afc0 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 10 client.7161 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 10 client.7161 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 20 client.7161 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5619e6e26bc0 0x5619e6e26fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 4 client.7161 mds_command: new command op to 6861 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- 172.21.15.133:0/1418383618 --> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5619e6c68c70 con 0x5619e6e26bc0 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5619e6e26bc0 0x5619e6e26fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5619e6e26bc0 0x5619e6e26fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a3a49e768ad3d29 server_cookie=76c9c3f295997db0 in_seq=0 out_seq=0 2023-12-18T10:22:20.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 10 client.7161 ms_handle_connect on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:20.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1418383618 <== mds.1 v2:172.21.15.133:6834/995027883 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5619e6c68c70 con 0x5619e6e26bc0 2023-12-18T10:22:20.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 10 client.7161 handle_command_reply: tid=0 2023-12-18T10:22:20.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 client.7161 shutdown 2023-12-18T10:22:20.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- 172.21.15.133:0/1418383618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 msgr2=0x5619e6e6c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6e6c2a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x5619e6d19180 tx=0x7fea04004740 comp rx=0 tx=0).stop 2023-12-18T10:22:20.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- 172.21.15.133:0/1418383618 shutdown_connections 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5619e6e26bc0 0x5619e6e26fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6e25e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6e6c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 --2- 172.21.15.133:0/1418383618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6e6c2a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fe9f1ffb640 0 client.7161 ms_handle_reset on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- 172.21.15.133:0/1418383618 >> 172.21.15.133:0/1418383618 conn(0x5619e6c19910 msgr2=0x5619e6e19a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- 172.21.15.133:0/1418383618 shutdown_connections 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 1 -- 172.21.15.133:0/1418383618 wait complete. 2023-12-18T10:22:20.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.811+0000 7fea1c804000 20 client.7161 trim_cache size 0 max 16384 2023-12-18T10:22:20.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 Processor -- start 2023-12-18T10:22:20.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- start start 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e1afc0 0x5619e6ebce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6ebd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e655a0 0x5619e6ebd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e6927aa0 con 0x5619e6e64c80 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e6c6ce80 con 0x5619e6e1afc0 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5619e6e1aae0 con 0x5619e6e655a0 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6ebd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6ebd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52096/0 (socket says 172.21.15.133:52096) 2023-12-18T10:22:20.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 -- 172.21.15.133:0/2403020701 learned_addr learned my addr 172.21.15.133:0/2403020701 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea137fe640 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e655a0 0x5619e6ebd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea12ffd640 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e1afc0 0x5619e6ebce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 -- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e655a0 msgr2=0x5619e6ebd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e655a0 0x5619e6ebd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 -- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e1afc0 msgr2=0x5619e6ebce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e1afc0 0x5619e6ebce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 -- 172.21.15.133:0/2403020701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619e6c155a0 con 0x5619e6e64c80 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea12ffd640 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e1afc0 0x5619e6ebce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6ebd350 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0012f0 tx=0x7fe9fc01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc58bc2079ee64fe server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea097fa640 1 -- 172.21.15.133:0/2403020701 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc052a90 con 0x5619e6e64c80 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea097fa640 1 -- 172.21.15.133:0/2403020701 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc081710 con 0x5619e6e64c80 2023-12-18T10:22:20.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea097fa640 1 -- 172.21.15.133:0/2403020701 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc050fa0 con 0x5619e6e64c80 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- 172.21.15.133:0/2403020701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 msgr2=0x5619e6ebd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6ebd350 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0012f0 tx=0x7fe9fc01e040 comp rx=0 tx=0).stop 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- 172.21.15.133:0/2403020701 shutdown_connections 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e655a0 0x5619e6ebd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e64c80 0x5619e6ebd350 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 --2- 172.21.15.133:0/2403020701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e1afc0 0x5619e6ebce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- 172.21.15.133:0/2403020701 >> 172.21.15.133:0/2403020701 conn(0x5619e6c19910 msgr2=0x5619e6e61a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- 172.21.15.133:0/2403020701 shutdown_connections 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- 172.21.15.133:0/2403020701 wait complete. 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 -- start start 2023-12-18T10:22:20.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.827+0000 7fea1c804000 1 Processor -- start 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6ea5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6ea6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6ea6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e6d39140 con 0x5619e6e1afc0 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619e6c67720 con 0x5619e6e655a0 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5619e6c28480 con 0x5619e6e64c80 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 10 client.0 _ll_register_callbacks cb 0x5619e6c21710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6ea5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6ea5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52110/0 (socket says 172.21.15.133:52110) 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 -- 172.21.15.133:0/1522095738 learned_addr learned my addr 172.21.15.133:0/1522095738 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6ea6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea137fe640 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6ea6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 -- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 msgr2=0x5619e6ea6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6ea6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 -- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 msgr2=0x5619e6ea6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6ea6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 -- 172.21.15.133:0/1522095738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea14149980 con 0x5619e6e1afc0 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6ea6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea12ffd640 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6ea5e00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fea040047c0 tx=0x7fea04018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df02b976dbb703e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fe9f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1522095738 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04003ed0 con 0x5619e6e1afc0 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1522095738 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fea04009940 con 0x5619e6e1afc0 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 -- 172.21.15.133:0/1522095738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619e6e1e940 con 0x5619e6e1afc0 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1522095738 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea040042f0 con 0x5619e6e1afc0 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 10 client.7167 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:20.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 -- 172.21.15.133:0/1522095738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5619e6c09110 con 0x5619e6e1afc0 2023-12-18T10:22:20.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1522095738 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5619e6e1e940 con 0x5619e6e1afc0 2023-12-18T10:22:20.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1522095738 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fea04005f70 con 0x5619e6e1afc0 2023-12-18T10:22:20.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 10 client.7167 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:20.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 10 client.7167 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2023-12-18T10:22:20.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 20 client.7167 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:20.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5619e6e20660 0x5619e6ea7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:20.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 4 client.7167 mds_command: new command op to 6861 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:22:20.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea1c804000 1 -- 172.21.15.133:0/1522095738 --> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5619e6c336a0 con 0x5619e6e20660 2023-12-18T10:22:20.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5619e6e20660 0x5619e6ea7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:20.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fea0a7fc640 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5619e6e20660 0x5619e6ea7100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=599a5c6b63eb1c15 server_cookie=bc4eda53c886e6a1 in_seq=0 out_seq=0 2023-12-18T10:22:20.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.831+0000 7fe9f1ffb640 10 client.7167 ms_handle_connect on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.839+0000 7fe9f1ffb640 1 -- 172.21.15.133:0/1522095738 <== mds.1 v2:172.21.15.133:6834/995027883 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5619e6c336a0 con 0x5619e6e20660 2023-12-18T10:22:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.839+0000 7fe9f1ffb640 10 client.7167 handle_command_reply: tid=0 2023-12-18T10:22:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.839+0000 7fea1c804000 1 client.7167 shutdown 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 -- 172.21.15.133:0/1522095738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 msgr2=0x5619e6ea5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6ea5e00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fea040047c0 tx=0x7fea04018000 comp rx=0 tx=0).stop 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 -- 172.21.15.133:0/1522095738 shutdown_connections 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x5619e6e20660 0x5619e6ea7100 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619e6e655a0 0x5619e6ea6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5619e6e64c80 0x5619e6ea6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fe9f1ffb640 0 client.7167 ms_handle_reset on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 --2- 172.21.15.133:0/1522095738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5619e6e1afc0 0x5619e6ea5e00 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 -- 172.21.15.133:0/1522095738 >> 172.21.15.133:0/1522095738 conn(0x5619e6c19910 msgr2=0x5619e6e62100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 -- 172.21.15.133:0/1522095738 shutdown_connections 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 1 -- 172.21.15.133:0/1522095738 wait complete. 2023-12-18T10:22:20.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea1c804000 20 client.7167 trim_cache size 0 max 16384 2023-12-18T10:22:20.847 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:20.847 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:22:20.847 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:22:20.847 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 -- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9f4065a60 msgr2=0x7fe9f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9f4065a60 0x7fe9f4067f20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fea04009cf0 tx=0x7fea04009190 comp rx=0 tx=0).stop 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 -- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea14153020 msgr2=0x7fea140b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea14153020 0x7fea140b1060 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00cbc0 tx=0x7fe9fc00a430 comp rx=0 tx=0).stop 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 -- 172.21.15.133:0/3207162201 shutdown_connections 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9f4065a60 0x7fe9f4067f20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea141598d0 0x7fea140b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea14153020 0x7fea140b1060 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 --2- 172.21.15.133:0/3207162201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea140ceaa0 0x7fea140afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 -- 172.21.15.133:0/3207162201 >> 172.21.15.133:0/3207162201 conn(0x7fea1406a2a0 msgr2=0x7fea140712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 -- 172.21.15.133:0/3207162201 shutdown_connections 2023-12-18T10:22:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.843+0000 7fea19495640 1 -- 172.21.15.133:0/3207162201 wait complete. 2023-12-18T10:22:20.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 flush journal 2023-12-18T10:22:21.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.999+0000 7fcb3f339640 1 Processor -- start 2023-12-18T10:22:21.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:20.999+0000 7fcb3f339640 1 -- start start 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3f339640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcb381582d0 0x7fcb380c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3f339640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb380ce3b0 0x7fcb380ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3f339640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb380c9390 con 0x7fcb38070820 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3f339640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb380ced60 con 0x7fcb380ce3b0 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3f339640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3815aee0 con 0x7fcb381582d0 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3d8d6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb380ce3b0 0x7fcb380ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3c8d4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcb38070820 0x7fcb380ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53086/0 (socket says 172.21.15.133:53086) 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3c8d4640 1 -- 172.21.15.133:0/2913418097 learned_addr learned my addr 172.21.15.133:0/2913418097 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/2913418097 >> v2:172.21.15.142:3300/0 conn(0x7fcb381582d0 0x7fcb380c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/2913418097 >> v2:172.21.15.142:3300/0 conn(0x7fcb381582d0 msgr2=0x7fcb380c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/2913418097 >> v2:172.21.15.142:3300/0 conn(0x7fcb381582d0 0x7fcb380c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/2913418097 >> v1:172.21.15.133:6789/0 conn(0x7fcb38070820 legacy=0x7fcb380ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb2ffff640 1 -- 172.21.15.133:0/2913418097 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279378138 0 0) 0x7fcb380c9390 con 0x7fcb38070820 2023-12-18T10:22:21.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.003+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/2913418097 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3815b1c0 con 0x7fcb380ce3b0 2023-12-18T10:22:21.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/2913418097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb380ce3b0 0x7fcb380ce820 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fcb380cf000 tx=0x7fcb3001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb4ccccf110cb6a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:21.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb2ffff640 1 -- 172.21.15.133:0/2913418097 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300a59a0 con 0x7fcb380ce3b0 2023-12-18T10:22:21.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb2ffff640 1 -- 172.21.15.133:0/2913418097 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb300a5b00 con 0x7fcb380ce3b0 2023-12-18T10:22:21.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb2ffff640 1 -- 172.21.15.133:0/2913418097 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300a5e90 con 0x7fcb380ce3b0 2023-12-18T10:22:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 -- 172.21.15.133:0/2913418097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb380ce3b0 msgr2=0x7fcb380ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 --2- 172.21.15.133:0/2913418097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb380ce3b0 0x7fcb380ce820 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fcb380cf000 tx=0x7fcb3001c8e0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 -- 172.21.15.133:0/2913418097 shutdown_connections 2023-12-18T10:22:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 --2- 172.21.15.133:0/2913418097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb380ce3b0 0x7fcb380ce820 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 --2- 172.21.15.133:0/2913418097 >> v2:172.21.15.142:3300/0 conn(0x7fcb381582d0 0x7fcb380c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 -- 172.21.15.133:0/2913418097 >> 172.21.15.133:0/2913418097 conn(0x7fcb3806a2a0 msgr2=0x7fcb380aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 -- 172.21.15.133:0/2913418097 shutdown_connections 2023-12-18T10:22:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 -- 172.21.15.133:0/2913418097 wait complete. 2023-12-18T10:22:21.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 Processor -- start 2023-12-18T10:22:21.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.007+0000 7fcb3f339640 1 -- start start 2023-12-18T10:22:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3f339640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb38070820 0x7fcb380c0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3f339640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb380ce3b0 0x7fcb380c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3f339640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb381582d0 0x7fcb380c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3f339640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380c12f0 con 0x7fcb38070820 2023-12-18T10:22:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3f339640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380c7b70 con 0x7fcb380ce3b0 2023-12-18T10:22:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3f339640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38157ca0 con 0x7fcb381582d0 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb38070820 0x7fcb380c0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb38070820 0x7fcb380c0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52136/0 (socket says 172.21.15.133:52136) 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/1204452762 learned_addr learned my addr 172.21.15.133:0/1204452762 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb380ce3b0 0x7fcb380c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb381582d0 0x7fcb380c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/1204452762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb381582d0 msgr2=0x7fcb380c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb381582d0 0x7fcb380c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/1204452762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb380ce3b0 msgr2=0x7fcb380c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb380ce3b0 0x7fcb380c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/1204452762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb30009a70 con 0x7fcb38070820 2023-12-18T10:22:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb38070820 0x7fcb380c0db0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400d5f0 tx=0x7fcb3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:21.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb2dffb640 1 -- 172.21.15.133:0/1204452762 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340125f0 con 0x7fcb38070820 2023-12-18T10:22:21.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb2dffb640 1 -- 172.21.15.133:0/1204452762 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb34012750 con 0x7fcb38070820 2023-12-18T10:22:21.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb2dffb640 1 -- 172.21.15.133:0/1204452762 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34012ae0 con 0x7fcb38070820 2023-12-18T10:22:21.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3f339640 1 -- 172.21.15.133:0/1204452762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb380c2330 con 0x7fcb38070820 2023-12-18T10:22:21.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.011+0000 7fcb3f339640 1 -- 172.21.15.133:0/1204452762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb380c28f0 con 0x7fcb38070820 2023-12-18T10:22:21.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb2dffb640 1 -- 172.21.15.133:0/1204452762 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcb34012c40 con 0x7fcb38070820 2023-12-18T10:22:21.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb2dffb640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb1c065a60 0x7fcb1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb2dffb640 1 -- 172.21.15.133:0/1204452762 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcb34083640 con 0x7fcb38070820 2023-12-18T10:22:21.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb1c065a60 0x7fcb1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb426a7000 1 Processor -- start 2023-12-18T10:22:21.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb426a7000 1 -- start start 2023-12-18T10:22:21.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb1c065a60 0x7fcb1c067f20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcb381f5e40 tx=0x7fcb28007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:21.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 0x563c30054a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300553a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb426a7000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2ff1d430 con 0x563c30054fc0 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb426a7000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2feab460 con 0x563c3009ec80 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb426a7000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c2fea8a30 con 0x563c3009f5a0 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d8d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:52274/0 (socket says 172.21.15.133:52274) 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/2988665097 learned_addr learned my addr 172.21.15.133:0/2988665097 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 0x563c30054a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/2988665097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 msgr2=0x563c30054a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 0x563c30054a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/2988665097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 msgr2=0x563c3009f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/2988665097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2fba0e20 con 0x563c30054fc0 2023-12-18T10:22:21.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:21.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.015+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300553a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcb300ac000 tx=0x7fcb30004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcd051046ddb826 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:21.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb1affd640 1 -- 172.21.15.133:0/2988665097 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300ad640 con 0x563c30054fc0 2023-12-18T10:22:21.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb1affd640 1 -- 172.21.15.133:0/2988665097 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb300ad7a0 con 0x563c30054fc0 2023-12-18T10:22:21.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb1affd640 1 -- 172.21.15.133:0/2988665097 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300adb50 con 0x563c30054fc0 2023-12-18T10:22:21.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- 172.21.15.133:0/2988665097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 msgr2=0x563c300553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300553a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcb300ac000 tx=0x7fcb30004ac0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- 172.21.15.133:0/2988665097 shutdown_connections 2023-12-18T10:22:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300553a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 0x563c30054a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 --2- 172.21.15.133:0/2988665097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- 172.21.15.133:0/2988665097 >> 172.21.15.133:0/2988665097 conn(0x563c2fe53910 msgr2=0x563c30053360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- 172.21.15.133:0/2988665097 shutdown_connections 2023-12-18T10:22:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- 172.21.15.133:0/2988665097 wait complete. 2023-12-18T10:22:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- start start 2023-12-18T10:22:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 Processor -- start 2023-12-18T10:22:21.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c30054fc0 0x563c3009e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 0x563c3009f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c3009f5a0 0x563c3009fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2fea4320 con 0x563c3009f5a0 2023-12-18T10:22:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2fe434f0 con 0x563c30054fc0 2023-12-18T10:22:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c2fe616e0 con 0x563c3009ec80 2023-12-18T10:22:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb426a7000 10 client.0 _ll_register_callbacks cb 0x563c30040980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c30054fc0 0x563c3009e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d8d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c3009f5a0 0x563c3009fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c30054fc0 0x563c3009e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:52288/0 (socket says 172.21.15.133:52288) 2023-12-18T10:22:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/3767946806 learned_addr learned my addr 172.21.15.133:0/3767946806 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c3009f5a0 0x563c3009fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52152/0 (socket says 172.21.15.133:52152) 2023-12-18T10:22:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 0x563c3009f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 msgr2=0x563c3009f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 0x563c3009f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c30054fc0 msgr2=0x563c3009e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c30054fc0 0x563c3009e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d8d6640 1 -- 172.21.15.133:0/3767946806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb380c28f0 con 0x563c3009f5a0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c3009f5a0 0x563c3009fec0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcb300194f0 tx=0x7fcb3001b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24897025e41e441d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.019+0000 7fcb13fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 1 -- 172.21.15.133:0/3767946806 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300aeb80 con 0x563c3009f5a0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 1 -- 172.21.15.133:0/3767946806 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcb300aece0 con 0x563c3009f5a0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 -- 172.21.15.133:0/3767946806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c2fe61120 con 0x563c3009f5a0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 1 -- 172.21.15.133:0/3767946806 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb300aeea0 con 0x563c3009f5a0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 10 client.7182 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 -- 172.21.15.133:0/3767946806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x7fcb3815b1c0 con 0x563c3009f5a0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 1 -- 172.21.15.133:0/3767946806 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c2fe61120 con 0x563c3009f5a0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 1 -- 172.21.15.133:0/3767946806 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fcb300c2410 con 0x563c3009f5a0 2023-12-18T10:22:21.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 10 client.7182 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:21.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 10 client.7182 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.d 2023-12-18T10:22:21.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 20 client.7182 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:21.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x563c300a08d0 0x563c300a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 4 client.7182 mds_command: new command op to 6505 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:21.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 -- 172.21.15.133:0/3767946806 --> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c2fea2c70 con 0x563c300a08d0 2023-12-18T10:22:21.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x563c300a08d0 0x563c300a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x563c300a08d0 0x563c300a0cb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c27c67d7e12fde7 server_cookie=60fd7d4e4066ce47 in_seq=0 out_seq=0 2023-12-18T10:22:21.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 10 client.7182 ms_handle_connect on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:21.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 1 -- 172.21.15.133:0/3767946806 <== mds.2 v2:172.21.15.142:6833/3664781290 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563c2fea2c70 con 0x563c300a08d0 2023-12-18T10:22:21.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 10 client.7182 handle_command_reply: tid=0 2023-12-18T10:22:21.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 client.7182 shutdown 2023-12-18T10:22:21.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 -- 172.21.15.133:0/3767946806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c3009f5a0 msgr2=0x563c3009fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c3009f5a0 0x563c3009fec0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcb300194f0 tx=0x7fcb3001b120 comp rx=0 tx=0).stop 2023-12-18T10:22:21.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 -- 172.21.15.133:0/3767946806 shutdown_connections 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x563c300a08d0 0x563c300a0cb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c3009f5a0 0x563c3009fec0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 0x563c3009f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3767946806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c30054fc0 0x563c3009e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb13fff640 0 client.7182 ms_handle_reset on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 -- 172.21.15.133:0/3767946806 >> 172.21.15.133:0/3767946806 conn(0x563c2fe53910 msgr2=0x563c30053a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 -- 172.21.15.133:0/3767946806 shutdown_connections 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 1 -- 172.21.15.133:0/3767946806 wait complete. 2023-12-18T10:22:21.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.023+0000 7fcb426a7000 20 client.7182 trim_cache size 0 max 16384 2023-12-18T10:22:21.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 Processor -- start 2023-12-18T10:22:21.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- start start 2023-12-18T10:22:21.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c3009d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 0x563c300aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2fb61aa0 con 0x563c30054fc0 2023-12-18T10:22:21.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2fea6e80 con 0x563c3009ec80 2023-12-18T10:22:21.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c30059c10 con 0x563c3009f5a0 2023-12-18T10:22:21.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c3009d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c3009d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52156/0 (socket says 172.21.15.133:52156) 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/58618850 learned_addr learned my addr 172.21.15.133:0/58618850 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 0x563c300aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 msgr2=0x563c300aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 0x563c300aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 msgr2=0x563c3009d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/58618850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2fe69250 con 0x563c30054fc0 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c3009d040 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400dfb0 tx=0x7fcb34083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db61c2ecf1051107 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb1b7fe640 1 -- 172.21.15.133:0/58618850 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3406c100 con 0x563c30054fc0 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb1b7fe640 1 -- 172.21.15.133:0/58618850 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb34052d70 con 0x563c30054fc0 2023-12-18T10:22:21.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb1b7fe640 1 -- 172.21.15.133:0/58618850 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34051340 con 0x563c30054fc0 2023-12-18T10:22:21.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- 172.21.15.133:0/58618850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 msgr2=0x563c3009d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c3009d040 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400dfb0 tx=0x7fcb34083040 comp rx=0 tx=0).stop 2023-12-18T10:22:21.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- 172.21.15.133:0/58618850 shutdown_connections 2023-12-18T10:22:21.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009f5a0 0x563c300aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009ec80 0x563c3009d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 --2- 172.21.15.133:0/58618850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c3009d040 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- 172.21.15.133:0/58618850 >> 172.21.15.133:0/58618850 conn(0x563c2fe53910 msgr2=0x563c300ab590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- 172.21.15.133:0/58618850 shutdown_connections 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- 172.21.15.133:0/58618850 wait complete. 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 -- start start 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.039+0000 7fcb426a7000 1 Processor -- start 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 0x563c300b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009f5a0 0x563c300b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2ff73140 con 0x563c30054fc0 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c2fe62480 con 0x563c3009f5a0 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c30054ae0 con 0x563c3009ec80 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 10 client.0 _ll_register_callbacks cb 0x563c2fe5b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52166/0 (socket says 172.21.15.133:52166) 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/3188796545 learned_addr learned my addr 172.21.15.133:0/3188796545 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:21.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d8d6640 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009f5a0 0x563c300b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 0x563c300b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 msgr2=0x563c300b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 0x563c300b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009f5a0 msgr2=0x563c300b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:21.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009f5a0 0x563c300b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 -- 172.21.15.133:0/3188796545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb34023070 con 0x563c30054fc0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3d0d5640 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300f80b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcb34054bc0 tx=0x7fcb34054db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e178340baf79ae7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb13fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb13fff640 1 -- 172.21.15.133:0/3188796545 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34051340 con 0x563c30054fc0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb13fff640 1 -- 172.21.15.133:0/3188796545 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcb340514a0 con 0x563c30054fc0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 -- 172.21.15.133:0/3188796545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c2fe6d6a0 con 0x563c30054fc0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb13fff640 1 -- 172.21.15.133:0/3188796545 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb3405c6d0 con 0x563c30054fc0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 10 client.7188 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 -- 172.21.15.133:0/3188796545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x563c2fe4f5a0 con 0x563c30054fc0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb13fff640 1 -- 172.21.15.133:0/3188796545 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c2fe6d6a0 con 0x563c30054fc0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb13fff640 1 -- 172.21.15.133:0/3188796545 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fcb34055b90 con 0x563c30054fc0 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 10 client.7188 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 10 client.7188 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.d 2023-12-18T10:22:21.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 20 client.7188 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:21.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x563c300b2660 0x563c300b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:21.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 4 client.7188 mds_command: new command op to 6505 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:22:21.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb426a7000 1 -- 172.21.15.133:0/3188796545 --> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563c2fe9d3a0 con 0x563c300b2660 2023-12-18T10:22:21.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x563c300b2660 0x563c300b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:21.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb13fff640 10 client.7188 ms_handle_connect on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:21.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.043+0000 7fcb3c8d4640 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x563c300b2660 0x563c300b2a70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7682acd72039bcf4 server_cookie=54e61a98ca2158e9 in_seq=0 out_seq=0 2023-12-18T10:22:21.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb13fff640 1 -- 172.21.15.133:0/3188796545 <== mds.2 v2:172.21.15.142:6833/3664781290 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563c2fe9d3a0 con 0x563c300b2660 2023-12-18T10:22:21.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb13fff640 10 client.7188 handle_command_reply: tid=0 2023-12-18T10:22:21.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 client.7188 shutdown 2023-12-18T10:22:21.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 -- 172.21.15.133:0/3188796545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 msgr2=0x563c300f80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300f80b0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcb34054bc0 tx=0x7fcb34054db0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 -- 172.21.15.133:0/3188796545 shutdown_connections 2023-12-18T10:22:21.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x563c300b2660 0x563c300b2a70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c3009f5a0 0x563c300b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c3009ec80 0x563c300b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 --2- 172.21.15.133:0/3188796545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c30054fc0 0x563c300f80b0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb13fff640 0 client.7188 ms_handle_reset on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 -- 172.21.15.133:0/3188796545 >> 172.21.15.133:0/3188796545 conn(0x563c2fe53910 msgr2=0x563c3009c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 -- 172.21.15.133:0/3188796545 shutdown_connections 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 1 -- 172.21.15.133:0/3188796545 wait complete. 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb426a7000 20 client.7188 trim_cache size 0 max 16384 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:21.060 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:22:21.061 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:22:21.061 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 -- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb1c065a60 msgr2=0x7fcb1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb1c065a60 0x7fcb1c067f20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcb381f5e40 tx=0x7fcb28007d60 comp rx=0 tx=0).stop 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 -- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb38070820 msgr2=0x7fcb380c0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb38070820 0x7fcb380c0db0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400d5f0 tx=0x7fcb3400dab0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 -- 172.21.15.133:0/1204452762 shutdown_connections 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcb1c065a60 0x7fcb1c067f20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcb381582d0 0x7fcb380c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb380ce3b0 0x7fcb380c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 --2- 172.21.15.133:0/1204452762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb38070820 0x7fcb380c0db0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 -- 172.21.15.133:0/1204452762 >> 172.21.15.133:0/1204452762 conn(0x7fcb3806a2a0 msgr2=0x7fcb38154230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 -- 172.21.15.133:0/1204452762 shutdown_connections 2023-12-18T10:22:21.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:21.055+0000 7fcb3f339640 1 -- 172.21.15.133:0/1204452762 wait complete. 2023-12-18T10:22:21.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:21.079 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-12-18T10:22:21.117 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/ 2023-12-18T10:22:21.117 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4 2023-12-18T10:22:21.117 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5 2023-12-18T10:22:21.117 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6 2023-12-18T10:22:21.117 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7 2023-12-18T10:22:21.117 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-12-18T10:22:21.118 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:22:21.118 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:22:21.118 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:22:21.118 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:22:21.118 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-12-18T10:22:21.118 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:22:21.229 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627778 2023-12-18T10:22:21.418 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:22:21.418 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:22:21.418 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:22:21.418 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:22:21.419 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-12-18T10:22:21.419 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:22:21.528 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627779 2023-12-18T10:22:21.717 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:22:21.718 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:22:21.718 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:22:21.718 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:22:21.718 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-12-18T10:22:21.718 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:22:21.824 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627780 2023-12-18T10:22:22.012 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:22:22.013 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:22:22.013 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:22:22.013 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:22:22.013 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-12-18T10:22:22.013 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:22:22.120 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627781 2023-12-18T10:22:22.309 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:22:22.309 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:22:22.309 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:22:22.309 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:22:22.309 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-12-18T10:22:22.309 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:22:22.416 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627782 2023-12-18T10:22:22.606 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:22:22.606 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:22:22.606 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:22:22.606 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:22:22.606 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-12-18T10:22:22.606 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:22:22.717 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627783 2023-12-18T10:22:22.906 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2023-12-18T10:22:22.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f52703ad080 1 Processor -- start 2023-12-18T10:22:22.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f52703ad080 1 -- start start 2023-12-18T10:22:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f52703ad080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986d3210 0x5565987770f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f52703ad080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d35f0 0x5565986d4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f52703ad080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986eda30 0x556598779550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f52703ad080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55659864e9c0 con 0x5565986d35f0 2023-12-18T10:22:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f52703ad080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565985ea4d0 con 0x5565986d3210 2023-12-18T10:22:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f52703ad080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565985ea1d0 con 0x5565986eda30 2023-12-18T10:22:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f526d6c6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d35f0 0x5565986d4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f526d6c6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d35f0 0x5565986d4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52172/0 (socket says 172.21.15.133:52172) 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f526d6c6640 1 -- 172.21.15.133:0/618355653 learned_addr learned my addr 172.21.15.133:0/618355653 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.991+0000 7f526dec7640 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986d3210 0x5565987770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526e6c8640 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986eda30 0x556598779550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526d6c6640 1 -- 172.21.15.133:0/618355653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986eda30 msgr2=0x556598779550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526d6c6640 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986eda30 0x556598779550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526d6c6640 1 -- 172.21.15.133:0/618355653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986d3210 msgr2=0x5565987770f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526d6c6640 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986d3210 0x5565987770f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526d6c6640 1 -- 172.21.15.133:0/618355653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260005d30 con 0x5565986d35f0 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526d6c6640 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d35f0 0x5565986d4370 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f526400b280 tx=0x7f526400b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435ea5716805f15d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f525ffff640 1 -- 172.21.15.133:0/618355653 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264008070 con 0x5565986d35f0 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f525ffff640 1 -- 172.21.15.133:0/618355653 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526400d4c0 con 0x5565986d35f0 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f525ffff640 1 -- 172.21.15.133:0/618355653 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400d670 con 0x5565986d35f0 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- 172.21.15.133:0/618355653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d35f0 msgr2=0x5565986d4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d35f0 0x5565986d4370 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f526400b280 tx=0x7f526400b740 comp rx=0 tx=0).stop 2023-12-18T10:22:22.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- 172.21.15.133:0/618355653 shutdown_connections 2023-12-18T10:22:23.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986eda30 0x556598779550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d35f0 0x5565986d4370 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 --2- 172.21.15.133:0/618355653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986d3210 0x5565987770f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- 172.21.15.133:0/618355653 >> 172.21.15.133:0/618355653 conn(0x5565986a1b50 msgr2=0x5565986e6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- 172.21.15.133:0/618355653 shutdown_connections 2023-12-18T10:22:23.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- 172.21.15.133:0/618355653 wait complete. 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 Processor -- start 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- start start 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d3210 0x556598802210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986d35f0 0x5565986d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986eda30 0x5565987fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565985e0e40 con 0x5565986d3210 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55659880b970 con 0x5565986eda30 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f52703ad080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556598800b70 con 0x5565986d35f0 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d3210 0x556598802210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d3210 0x556598802210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52178/0 (socket says 172.21.15.133:52178) 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 -- 172.21.15.133:0/4090901645 learned_addr learned my addr 172.21.15.133:0/4090901645 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526d6c6640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986d35f0 0x5565986d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526e6c8640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986eda30 0x5565987fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 -- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986d35f0 msgr2=0x5565986d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986d35f0 0x5565986d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 -- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986eda30 msgr2=0x5565987fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986eda30 0x5565987fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 -- 172.21.15.133:0/4090901645 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5264001b80 con 0x5565986d3210 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526d6c6640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5565986d35f0 0x5565986d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526e6c8640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5565986eda30 0x5565987fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.995+0000 7f526dec7640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d3210 0x556598802210 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f526000a530 tx=0x7f526001a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f525effd640 1 -- 172.21.15.133:0/4090901645 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600a7e30 con 0x5565986d3210 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f525effd640 1 -- 172.21.15.133:0/4090901645 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52600c3460 con 0x5565986d3210 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f525effd640 1 -- 172.21.15.133:0/4090901645 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600c37d0 con 0x5565986d3210 2023-12-18T10:22:23.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5565985ec4b0 con 0x5565986d3210 2023-12-18T10:22:23.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565985ebf10 con 0x5565986d3210 2023-12-18T10:22:23.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f525effd640 1 -- 172.21.15.133:0/4090901645 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f52600b6070 con 0x5565986d3210 2023-12-18T10:22:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f525effd640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5250064410 0x7f52500668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f525effd640 1 -- 172.21.15.133:0/4090901645 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f52601204f0 con 0x5565986d3210 2023-12-18T10:22:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f526d6c6640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5250064410 0x7f52500668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f52703ad080 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x5565986d6800 0x556598776150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 --> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] -- osd_op(unknown.0.0:1 9.12 9:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v8 -- 0x55659880a390 con 0x5565986d6800 2023-12-18T10:22:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f526d6c6640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5250064410 0x7f52500668d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f526400b280 tx=0x7f5264002000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:22.999+0000 7f526e6c8640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x5565986d6800 0x556598776150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f526e6c8640 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x5565986d6800 0x556598776150 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f526e6c8640 1 -- 172.21.15.133:0/4090901645 <== osd.5 v2:172.21.15.142:6808/38345 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v65'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f52680049f0 con 0x5565986d6800 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x5565986d6800 msgr2=0x556598776150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x5565986d6800 0x556598776150 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5250064410 msgr2=0x7f52500668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5250064410 0x7f52500668d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f526400b280 tx=0x7f5264002000 comp rx=0 tx=0).stop 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d3210 msgr2=0x556598802210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 --2- 172.21.15.133:0/4090901645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5565986d3210 0x556598802210 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f526000a530 tx=0x7f526001a780 comp rx=0 tx=0).stop 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f526e6c8640 1 -- 172.21.15.133:0/4090901645 reap_dead start 2023-12-18T10:22:23.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 shutdown_connections 2023-12-18T10:22:23.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 >> 172.21.15.133:0/4090901645 conn(0x5565986a1b50 msgr2=0x556598776ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 shutdown_connections 2023-12-18T10:22:23.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.003+0000 7f52703ad080 1 -- 172.21.15.133:0/4090901645 wait complete. 2023-12-18T10:22:23.012 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2023-12-18T10:22:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 Processor -- start 2023-12-18T10:22:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 -- start start 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e8ae220 0x55d93e8c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 0x55d93e951b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e9562b0 0x55d93e8c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93e7c81d0 con 0x55d93e8ae220 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93e7bee40 con 0x55d93e9562b0 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d93e885280 con 0x55d93e8b0190 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e8ae220 0x55d93e8c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e8ae220 0x55d93e8c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52198/0 (socket says 172.21.15.133:52198) 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 -- 172.21.15.133:0/2217290094 learned_addr learned my addr 172.21.15.133:0/2217290094 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f660ffff640 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 0x55d93e951b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6615415640 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e9562b0 0x55d93e8c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 -- 172.21.15.133:0/2217290094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 msgr2=0x55d93e951b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 0x55d93e951b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 -- 172.21.15.133:0/2217290094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e9562b0 msgr2=0x55d93e8c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e9562b0 0x55d93e8c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 -- 172.21.15.133:0/2217290094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661000a1c0 con 0x55d93e8ae220 2023-12-18T10:22:23.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f6614c14640 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e8ae220 0x55d93e8c8000 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f660800a7e0 tx=0x7f660800aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87a15dd6c7e08a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f660effd640 1 -- 172.21.15.133:0/2217290094 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800f070 con 0x55d93e8ae220 2023-12-18T10:22:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f660effd640 1 -- 172.21.15.133:0/2217290094 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608008c00 con 0x55d93e8ae220 2023-12-18T10:22:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f660effd640 1 -- 172.21.15.133:0/2217290094 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608013430 con 0x55d93e8ae220 2023-12-18T10:22:23.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.095+0000 7f66170fa080 1 -- 172.21.15.133:0/2217290094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e8ae220 msgr2=0x55d93e8c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e8ae220 0x55d93e8c8000 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f660800a7e0 tx=0x7f660800aca0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- 172.21.15.133:0/2217290094 shutdown_connections 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e9562b0 0x55d93e8c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 0x55d93e951b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 --2- 172.21.15.133:0/2217290094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e8ae220 0x55d93e8c8000 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- 172.21.15.133:0/2217290094 >> 172.21.15.133:0/2217290094 conn(0x55d93e8ace00 msgr2=0x55d93e8833b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- 172.21.15.133:0/2217290094 shutdown_connections 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- 172.21.15.133:0/2217290094 wait complete. 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 Processor -- start 2023-12-18T10:22:23.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- start start 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e8ae220 0x55d93e9510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 0x55d93e9e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e9562b0 0x55d93e9540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93e9515f0 con 0x55d93e9562b0 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d93e9e8610 con 0x55d93e8ae220 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d93e9e88b0 con 0x55d93e8b0190 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e9562b0 0x55d93e9540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e9562b0 0x55d93e9540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52200/0 (socket says 172.21.15.133:52200) 2023-12-18T10:22:23.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 -- 172.21.15.133:0/2884271506 learned_addr learned my addr 172.21.15.133:0/2884271506 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6614c14640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e8ae220 0x55d93e9510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f660ffff640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 0x55d93e9e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 -- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 msgr2=0x55d93e9e7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d93e8b0190 0x55d93e9e7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 -- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e8ae220 msgr2=0x55d93e9510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d93e8ae220 0x55d93e9510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 -- 172.21.15.133:0/2884271506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660800a430 con 0x55d93e9562b0 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f6615415640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e9562b0 0x55d93e9540a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f661001b990 tx=0x7f6610017e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f660dffb640 1 -- 172.21.15.133:0/2884271506 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100ab410 con 0x55d93e9562b0 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f660dffb640 1 -- 172.21.15.133:0/2884271506 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610005b50 con 0x55d93e9562b0 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f660dffb640 1 -- 172.21.15.133:0/2884271506 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100b6680 con 0x55d93e9562b0 2023-12-18T10:22:23.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d93e7f1210 con 0x55d93e9562b0 2023-12-18T10:22:23.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.099+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d93e7d7070 con 0x55d93e9562b0 2023-12-18T10:22:23.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f660dffb640 1 -- 172.21.15.133:0/2884271506 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f66100b67e0 con 0x55d93e9562b0 2023-12-18T10:22:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f660dffb640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65f8064440 0x7f65f8066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f660dffb640 1 -- 172.21.15.133:0/2884271506 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f661011ce90 con 0x55d93e9562b0 2023-12-18T10:22:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f6614c14640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65f8064440 0x7f65f8066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f66170fa080 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55d93e9545e0 0x55d93e9e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 --> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] -- osd_op(unknown.0.0:1 9.12 9:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v8 -- 0x55d93e8c2730 con 0x55d93e9545e0 2023-12-18T10:22:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f660ffff640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55d93e9545e0 0x55d93e9e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f6614c14640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65f8064440 0x7f65f8066900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6608016040 tx=0x7f660800c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.103+0000 7f660ffff640 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55d93e9545e0 0x55d93e9e9d00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f660ffff640 1 -- 172.21.15.133:0/2884271506 <== osd.5 v2:172.21.15.142:6808/38345 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v65'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6600009990 con 0x55d93e9545e0 2023-12-18T10:22:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55d93e9545e0 msgr2=0x55d93e9e9d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55d93e9545e0 0x55d93e9e9d00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65f8064440 msgr2=0x7f65f8066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65f8064440 0x7f65f8066900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6608016040 tx=0x7f660800c000 comp rx=0 tx=0).stop 2023-12-18T10:22:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e9562b0 msgr2=0x55d93e9540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 --2- 172.21.15.133:0/2884271506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d93e9562b0 0x55d93e9540a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f661001b990 tx=0x7f6610017e90 comp rx=0 tx=0).stop 2023-12-18T10:22:23.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f6615415640 1 -- 172.21.15.133:0/2884271506 reap_dead start 2023-12-18T10:22:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 shutdown_connections 2023-12-18T10:22:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 >> 172.21.15.133:0/2884271506 conn(0x55d93e8ace00 msgr2=0x55d93e8833b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 shutdown_connections 2023-12-18T10:22:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.107+0000 7f66170fa080 1 -- 172.21.15.133:0/2884271506 wait complete. 2023-12-18T10:22:23.115 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2023-12-18T10:22:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc637d38080 1 Processor -- start 2023-12-18T10:22:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc637d38080 1 -- start start 2023-12-18T10:22:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc637d38080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 0x55ac64ae4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc637d38080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64b11190 0x55ac64b07bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc637d38080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64bb72b0 0x55ac64b0ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc637d38080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac64a294d0 con 0x55ac64bb72b0 2023-12-18T10:22:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc637d38080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac64a291d0 con 0x55ac64b0f220 2023-12-18T10:22:23.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc637d38080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac64a1fe40 con 0x55ac64b11190 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc636055640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64bb72b0 0x55ac64b0ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc636055640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64bb72b0 0x55ac64b0ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52218/0 (socket says 172.21.15.133:52218) 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc636055640 1 -- 172.21.15.133:0/1953597222 learned_addr learned my addr 172.21.15.133:0/1953597222 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc635854640 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 0x55ac64ae4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.199+0000 7fc635053640 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64b11190 0x55ac64b07bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc636055640 1 -- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64b11190 msgr2=0x55ac64b07bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc636055640 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64b11190 0x55ac64b07bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc636055640 1 -- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 msgr2=0x55ac64ae4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc636055640 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 0x55ac64ae4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc636055640 1 -- 172.21.15.133:0/1953597222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c005d30 con 0x55ac64bb72b0 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64b11190 0x55ac64b07bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc636055640 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64bb72b0 0x55ac64b0ccb0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc6300096e0 tx=0x7fc630009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4fd1957d54e30a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc627fff640 1 -- 172.21.15.133:0/1953597222 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000b930 con 0x55ac64bb72b0 2023-12-18T10:22:23.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc627fff640 1 -- 172.21.15.133:0/1953597222 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000bab0 con 0x55ac64bb72b0 2023-12-18T10:22:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc627fff640 1 -- 172.21.15.133:0/1953597222 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000be60 con 0x55ac64bb72b0 2023-12-18T10:22:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- 172.21.15.133:0/1953597222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64bb72b0 msgr2=0x55ac64b0ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64bb72b0 0x55ac64b0ccb0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc6300096e0 tx=0x7fc630009ba0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- 172.21.15.133:0/1953597222 shutdown_connections 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64bb72b0 0x55ac64b0ccb0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64b11190 0x55ac64b07bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 --2- 172.21.15.133:0/1953597222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 0x55ac64ae4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- 172.21.15.133:0/1953597222 >> 172.21.15.133:0/1953597222 conn(0x55ac64b0de00 msgr2=0x55ac64ae62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- 172.21.15.133:0/1953597222 shutdown_connections 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- 172.21.15.133:0/1953597222 wait complete. 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 Processor -- start 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- start start 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 0x55ac64b06e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64b11190 0x55ac64b9aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64bb72b0 0x55ac64b9aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac64b9b820 con 0x55ac64b11190 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac64b9bac0 con 0x55ac64b0f220 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc637d38080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac64b9bd60 con 0x55ac64bb72b0 2023-12-18T10:22:23.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64b11190 0x55ac64b9aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64b11190 0x55ac64b9aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52234/0 (socket says 172.21.15.133:52234) 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 -- 172.21.15.133:0/1793148691 learned_addr learned my addr 172.21.15.133:0/1793148691 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635854640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 0x55ac64b06e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc636055640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64bb72b0 0x55ac64b9aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 -- 172.21.15.133:0/1793148691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64bb72b0 msgr2=0x55ac64b9aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ac64bb72b0 0x55ac64b9aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 -- 172.21.15.133:0/1793148691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 msgr2=0x55ac64b06e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac64b0f220 0x55ac64b06e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 -- 172.21.15.133:0/1793148691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300092e0 con 0x55ac64b11190 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.203+0000 7fc635053640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64b11190 0x55ac64b9aab0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc62c017c60 tx=0x7fc62c017df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc626ffd640 1 -- 172.21.15.133:0/1793148691 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0b5680 con 0x55ac64b11190 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc626ffd640 1 -- 172.21.15.133:0/1793148691 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c0b57e0 con 0x55ac64b11190 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc626ffd640 1 -- 172.21.15.133:0/1793148691 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0b5b90 con 0x55ac64b11190 2023-12-18T10:22:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ac64a38070 con 0x55ac64b11190 2023-12-18T10:22:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac64a2b4b0 con 0x55ac64b11190 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc626ffd640 1 -- 172.21.15.133:0/1793148691 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc62c0b1040 con 0x55ac64b11190 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc626ffd640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc618064410 0x7fc6180668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc626ffd640 1 -- 172.21.15.133:0/1793148691 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc62c11d270 con 0x55ac64b11190 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc635854640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc618064410 0x7fc6180668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc637d38080 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55ac64b07340 0x55ac64b23100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 9.5 9:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v8 -- 0x55ac64b23640 con 0x55ac64b07340 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc636055640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55ac64b07340 0x55ac64b23100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.207+0000 7fc635854640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc618064410 0x7fc6180668d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc628000f70 tx=0x7fc628010040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc636055640 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55ac64b07340 0x55ac64b23100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc636055640 1 -- 172.21.15.133:0/1793148691 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v65'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fc630021040 con 0x55ac64b07340 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55ac64b07340 msgr2=0x55ac64b23100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55ac64b07340 0x55ac64b23100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc618064410 msgr2=0x7fc6180668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc618064410 0x7fc6180668d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc628000f70 tx=0x7fc628010040 comp rx=0 tx=0).stop 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64b11190 msgr2=0x55ac64b9aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 --2- 172.21.15.133:0/1793148691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ac64b11190 0x55ac64b9aab0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc62c017c60 tx=0x7fc62c017df0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc636055640 1 -- 172.21.15.133:0/1793148691 reap_dead start 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 shutdown_connections 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 >> 172.21.15.133:0/1793148691 conn(0x55ac64b0de00 msgr2=0x55ac64b0ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 shutdown_connections 2023-12-18T10:22:23.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.211+0000 7fc637d38080 1 -- 172.21.15.133:0/1793148691 wait complete. 2023-12-18T10:22:23.219 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2023-12-18T10:22:23.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 Processor -- start 2023-12-18T10:22:23.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- start start 2023-12-18T10:22:23.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b14bd220 0x55d1b14d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bf190 0x55d1b1562ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b15652b0 0x55d1b15fbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b13d71d0 con 0x55d1b15652b0 2023-12-18T10:22:23.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b13cde40 con 0x55d1b14bd220 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1b155ced0 con 0x55d1b14bf190 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b15652b0 0x55d1b15fbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b15652b0 0x55d1b15fbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52262/0 (socket says 172.21.15.133:52262) 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 -- 172.21.15.133:0/2201361421 learned_addr learned my addr 172.21.15.133:0/2201361421 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa33fff640 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bf190 0x55d1b1562ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa38f8a640 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b14bd220 0x55d1b14d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 -- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bf190 msgr2=0x55d1b1562ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bf190 0x55d1b1562ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 -- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b14bd220 msgr2=0x55d1b14d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b14bd220 0x55d1b14d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 -- 172.21.15.133:0/2201361421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c005df0 con 0x55d1b15652b0 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa33fff640 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bf190 0x55d1b1562ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3978b640 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b15652b0 0x55d1b15fbf50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7faa3400b620 tx=0x7faa3400bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64ba8c3c93d8ac7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa32ffd640 1 -- 172.21.15.133:0/2201361421 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34009810 con 0x55d1b15652b0 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa32ffd640 1 -- 172.21.15.133:0/2201361421 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3400b050 con 0x55d1b15652b0 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa32ffd640 1 -- 172.21.15.133:0/2201361421 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34009b70 con 0x55d1b15652b0 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- 172.21.15.133:0/2201361421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b15652b0 msgr2=0x55d1b15fbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b15652b0 0x55d1b15fbf50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7faa3400b620 tx=0x7faa3400bae0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- 172.21.15.133:0/2201361421 shutdown_connections 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b15652b0 0x55d1b15fbf50 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bf190 0x55d1b1562ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 --2- 172.21.15.133:0/2201361421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b14bd220 0x55d1b14d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- 172.21.15.133:0/2201361421 >> 172.21.15.133:0/2201361421 conn(0x55d1b14bbe00 msgr2=0x55d1b14943c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- 172.21.15.133:0/2201361421 shutdown_connections 2023-12-18T10:22:23.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.303+0000 7faa3b470080 1 -- 172.21.15.133:0/2201361421 wait complete. 2023-12-18T10:22:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 Processor -- start 2023-12-18T10:22:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 -- start start 2023-12-18T10:22:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bd220 0x55d1b1561ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b14bf190 0x55d1b155bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b15652b0 0x55d1b15f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b15f7bf0 con 0x55d1b14bf190 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1b155d060 con 0x55d1b15652b0 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1b15fadf0 con 0x55d1b14bd220 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b14bf190 0x55d1b155bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b14bf190 0x55d1b155bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52272/0 (socket says 172.21.15.133:52272) 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 -- 172.21.15.133:0/3254737422 learned_addr learned my addr 172.21.15.133:0/3254737422 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa38f8a640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bd220 0x55d1b1561ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3978b640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b15652b0 0x55d1b15f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 -- 172.21.15.133:0/3254737422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bd220 msgr2=0x55d1b1561ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d1b14bd220 0x55d1b1561ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 -- 172.21.15.133:0/3254737422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b15652b0 msgr2=0x55d1b15f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d1b15652b0 0x55d1b15f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 -- 172.21.15.133:0/3254737422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3400b250 con 0x55d1b14bf190 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa33fff640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b14bf190 0x55d1b155bb40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7faa24005fd0 tx=0x7faa24006b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa31ffb640 1 -- 172.21.15.133:0/3254737422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400d8b0 con 0x55d1b14bf190 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa31ffb640 1 -- 172.21.15.133:0/3254737422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2400f040 con 0x55d1b14bf190 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa31ffb640 1 -- 172.21.15.133:0/3254737422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400dc30 con 0x55d1b14bf190 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d1b1400210 con 0x55d1b14bf190 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.307+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1b13e6070 con 0x55d1b14bf190 2023-12-18T10:22:23.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa31ffb640 1 -- 172.21.15.133:0/3254737422 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa2400dd90 con 0x55d1b14bf190 2023-12-18T10:22:23.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa31ffb640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa1c064410 0x7faa1c0668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa31ffb640 1 -- 172.21.15.133:0/3254737422 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa24082080 con 0x55d1b14bf190 2023-12-18T10:22:23.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa38f8a640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa1c064410 0x7faa1c0668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa3b470080 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d1b15fa950 0x55d1b155dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 9.9 9:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v8 -- 0x55d1b155c080 con 0x55d1b15fa950 2023-12-18T10:22:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa3978b640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d1b15fa950 0x55d1b155dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa38f8a640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa1c064410 0x7faa1c0668d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0ac000 tx=0x7faa2c0a5000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.311+0000 7faa3978b640 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d1b15fa950 0x55d1b155dee0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3978b640 1 -- 172.21.15.133:0/3254737422 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v65'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7faa34016020 con 0x55d1b15fa950 2023-12-18T10:22:23.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d1b15fa950 msgr2=0x55d1b155dee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d1b15fa950 0x55d1b155dee0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa1c064410 msgr2=0x7faa1c0668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa1c064410 0x7faa1c0668d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0ac000 tx=0x7faa2c0a5000 comp rx=0 tx=0).stop 2023-12-18T10:22:23.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b14bf190 msgr2=0x55d1b155bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 --2- 172.21.15.133:0/3254737422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d1b14bf190 0x55d1b155bb40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7faa24005fd0 tx=0x7faa24006b20 comp rx=0 tx=0).stop 2023-12-18T10:22:23.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3978b640 1 -- 172.21.15.133:0/3254737422 reap_dead start 2023-12-18T10:22:23.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 shutdown_connections 2023-12-18T10:22:23.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 >> 172.21.15.133:0/3254737422 conn(0x55d1b14bbe00 msgr2=0x55d1b1490890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 shutdown_connections 2023-12-18T10:22:23.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.315+0000 7faa3b470080 1 -- 172.21.15.133:0/3254737422 wait complete. 2023-12-18T10:22:23.322 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2023-12-18T10:22:23.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.363+0000 7fbdba003080 1 Processor -- start 2023-12-18T10:22:23.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.363+0000 7fbdba003080 1 -- start start 2023-12-18T10:22:23.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d548757a0 0x560d549211e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906ab0 0x560d549b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d54906e90 0x560d549b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d547904d0 con 0x560d548757a0 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d547901d0 con 0x560d54906e90 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d54786e40 con 0x560d54906ab0 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d548757a0 0x560d549211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d548757a0 0x560d549211e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52274/0 (socket says 172.21.15.133:52274) 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 -- 172.21.15.133:0/70237834 learned_addr learned my addr 172.21.15.133:0/70237834 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb831e640 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d54906e90 0x560d549b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdaffff640 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906ab0 0x560d549b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 -- 172.21.15.133:0/70237834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906ab0 msgr2=0x560d549b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906ab0 0x560d549b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 -- 172.21.15.133:0/70237834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d54906e90 msgr2=0x560d549b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d54906e90 0x560d549b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 -- 172.21.15.133:0/70237834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb000a100 con 0x560d548757a0 2023-12-18T10:22:23.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb7b1d640 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d548757a0 0x560d549211e0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fbda800b350 tx=0x7fbda800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff58df34c9ec7c61 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb6b1b640 1 -- 172.21.15.133:0/70237834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8014070 con 0x560d548757a0 2023-12-18T10:22:23.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb6b1b640 1 -- 172.21.15.133:0/70237834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda800d5d0 con 0x560d548757a0 2023-12-18T10:22:23.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdb6b1b640 1 -- 172.21.15.133:0/70237834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda800d940 con 0x560d548757a0 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- 172.21.15.133:0/70237834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d548757a0 msgr2=0x560d549211e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d548757a0 0x560d549211e0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fbda800b350 tx=0x7fbda800b810 comp rx=0 tx=0).stop 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- 172.21.15.133:0/70237834 shutdown_connections 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d54906e90 0x560d549b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906ab0 0x560d549b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 --2- 172.21.15.133:0/70237834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d548757a0 0x560d549211e0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- 172.21.15.133:0/70237834 >> 172.21.15.133:0/70237834 conn(0x560d54873e40 msgr2=0x560d54874220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- 172.21.15.133:0/70237834 shutdown_connections 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- 172.21.15.133:0/70237834 wait complete. 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 Processor -- start 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 -- start start 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.367+0000 7fbdba003080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d548757a0 0x560d549249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdba003080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d54906ab0 0x560d54890700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdba003080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906e90 0x560d54874400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdba003080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d54924ef0 con 0x560d54906ab0 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdba003080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d5488f7e0 con 0x560d548757a0 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdba003080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d5488fa80 con 0x560d54906e90 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d54906ab0 0x560d54890700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdb7b1d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d548757a0 0x560d549249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdb831e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906e90 0x560d54874400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d54906ab0 0x560d54890700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52278/0 (socket says 172.21.15.133:52278) 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 -- 172.21.15.133:0/3556703927 learned_addr learned my addr 172.21.15.133:0/3556703927 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 -- 172.21.15.133:0/3556703927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906e90 msgr2=0x560d54874400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x560d54906e90 0x560d54874400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 -- 172.21.15.133:0/3556703927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d548757a0 msgr2=0x560d549249b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560d548757a0 0x560d549249b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 -- 172.21.15.133:0/3556703927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8001c20 con 0x560d54906ab0 2023-12-18T10:22:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdaffff640 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d54906ab0 0x560d54890700 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fbda00087f0 tx=0x7fbda0008cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdb5b19640 1 -- 172.21.15.133:0/3556703927 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda000f040 con 0x560d54906ab0 2023-12-18T10:22:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdb5b19640 1 -- 172.21.15.133:0/3556703927 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0010ba0 con 0x560d54906ab0 2023-12-18T10:22:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d5479f070 con 0x560d54906ab0 2023-12-18T10:22:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdb5b19640 1 -- 172.21.15.133:0/3556703927 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0015450 con 0x560d54906ab0 2023-12-18T10:22:23.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d547924b0 con 0x560d54906ab0 2023-12-18T10:22:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.371+0000 7fbdb5b19640 1 -- 172.21.15.133:0/3556703927 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbda00155b0 con 0x560d54906ab0 2023-12-18T10:22:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdb5b19640 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98064410 0x7fbd980668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdb5b19640 1 -- 172.21.15.133:0/3556703927 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbda0082b70 con 0x560d54906ab0 2023-12-18T10:22:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdb7b1d640 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98064410 0x7fbd980668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x560d54874940 0x560d549b8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 9.5 9:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v8 -- 0x560d5492a8d0 con 0x560d54874940 2023-12-18T10:22:23.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdb831e640 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x560d54874940 0x560d549b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdb7b1d640 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98064410 0x7fbd980668d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbda8000c10 tx=0x7fbda8011040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdb831e640 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x560d54874940 0x560d549b8800 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdb831e640 1 -- 172.21.15.133:0/3556703927 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v65'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fbdb00aa690 con 0x560d54874940 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x560d54874940 msgr2=0x560d549b8800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x560d54874940 0x560d549b8800 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98064410 msgr2=0x7fbd980668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd98064410 0x7fbd980668d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbda8000c10 tx=0x7fbda8011040 comp rx=0 tx=0).stop 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d54906ab0 msgr2=0x560d54890700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 --2- 172.21.15.133:0/3556703927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d54906ab0 0x560d54890700 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fbda00087f0 tx=0x7fbda0008cb0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdb831e640 1 -- 172.21.15.133:0/3556703927 reap_dead start 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 shutdown_connections 2023-12-18T10:22:23.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 >> 172.21.15.133:0/3556703927 conn(0x560d54873e40 msgr2=0x560d549203c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 shutdown_connections 2023-12-18T10:22:23.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.375+0000 7fbdba003080 1 -- 172.21.15.133:0/3556703927 wait complete. 2023-12-18T10:22:23.385 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2023-12-18T10:22:23.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 Processor -- start 2023-12-18T10:22:23.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- start start 2023-12-18T10:22:23.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1d220 0x55d8bedbf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1f190 0x55d8becf3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 0x55d8bedc0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8bec374d0 con 0x55d8bed1d220 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8bec371d0 con 0x55d8bed1f190 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8bec2de40 con 0x55d8bedc52b0 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1d220 0x55d8bedbf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1d220 0x55d8bedbf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52294/0 (socket says 172.21.15.133:52294) 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 -- 172.21.15.133:0/805903439 learned_addr learned my addr 172.21.15.133:0/805903439 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbccfc97640 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1f190 0x55d8becf3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0c99640 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 0x55d8bedc0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 -- 172.21.15.133:0/805903439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 msgr2=0x55d8bedc0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 0x55d8bedc0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 -- 172.21.15.133:0/805903439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1f190 msgr2=0x55d8becf3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1f190 0x55d8becf3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 -- 172.21.15.133:0/805903439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc0005df0 con 0x55d8bed1d220 2023-12-18T10:22:23.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd0498640 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1d220 0x55d8bedbf940 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0018e10 tx=0x7fbcc0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d730e5e23b24c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbccec95640 1 -- 172.21.15.133:0/805903439 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00aa740 con 0x55d8bed1d220 2023-12-18T10:22:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbccec95640 1 -- 172.21.15.133:0/805903439 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc00aa8c0 con 0x55d8bed1d220 2023-12-18T10:22:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbccec95640 1 -- 172.21.15.133:0/805903439 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00aac70 con 0x55d8bed1d220 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- 172.21.15.133:0/805903439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1d220 msgr2=0x55d8bedbf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1d220 0x55d8bedbf940 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0018e10 tx=0x7fbcc0003030 comp rx=0 tx=0).stop 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- 172.21.15.133:0/805903439 shutdown_connections 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 0x55d8bedc0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1f190 0x55d8becf3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 --2- 172.21.15.133:0/805903439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1d220 0x55d8bedbf940 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- 172.21.15.133:0/805903439 >> 172.21.15.133:0/805903439 conn(0x55d8bed1be00 msgr2=0x55d8bed39760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- 172.21.15.133:0/805903439 shutdown_connections 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.471+0000 7fbcd297e080 1 -- 172.21.15.133:0/805903439 wait complete. 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 Processor -- start 2023-12-18T10:22:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 -- start start 2023-12-18T10:22:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1d220 0x55d8bedcfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1f190 0x55d8bedc2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 0x55d8bee66a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8bedbee10 con 0x55d8bed1f190 2023-12-18T10:22:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8bedbf0b0 con 0x55d8bed1d220 2023-12-18T10:22:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8bedbf350 con 0x55d8bedc52b0 2023-12-18T10:22:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1f190 0x55d8bedc2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1f190 0x55d8bedc2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52296/0 (socket says 172.21.15.133:52296) 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 -- 172.21.15.133:0/2469710090 learned_addr learned my addr 172.21.15.133:0/2469710090 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd0c99640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 0x55d8bee66a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd0498640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1d220 0x55d8bedcfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 -- 172.21.15.133:0/2469710090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 msgr2=0x55d8bee66a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d8bedc52b0 0x55d8bee66a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 -- 172.21.15.133:0/2469710090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1d220 msgr2=0x55d8bedcfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8bed1d220 0x55d8bedcfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 -- 172.21.15.133:0/2469710090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8bec60210 con 0x55d8bed1f190 2023-12-18T10:22:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccfc97640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1f190 0x55d8bedc2a40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4008720 tx=0x7fbcc4008be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccdc93640 1 -- 172.21.15.133:0/2469710090 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400f040 con 0x55d8bed1f190 2023-12-18T10:22:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccdc93640 1 -- 172.21.15.133:0/2469710090 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc4010ba0 con 0x55d8bed1f190 2023-12-18T10:22:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d8bec46070 con 0x55d8bed1f190 2023-12-18T10:22:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbccdc93640 1 -- 172.21.15.133:0/2469710090 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4008e30 con 0x55d8bed1f190 2023-12-18T10:22:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.475+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8bec394b0 con 0x55d8bed1f190 2023-12-18T10:22:23.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbccdc93640 1 -- 172.21.15.133:0/2469710090 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbcc4015450 con 0x55d8bed1f190 2023-12-18T10:22:23.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbccdc93640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcbc064490 0x7fbcbc066950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbccdc93640 1 -- 172.21.15.133:0/2469710090 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbcc4082990 con 0x55d8bed1f190 2023-12-18T10:22:23.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbcd0498640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcbc064490 0x7fbcbc066950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbcd297e080 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d8bedc2f80 0x55d8bedbdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 9.1d 9:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65) v8 -- 0x55d8bee653d0 con 0x55d8bedc2f80 2023-12-18T10:22:23.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbcd0c99640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d8bedc2f80 0x55d8bedbdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbcd0498640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcbc064490 0x7fbcbc066950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0019890 tx=0x7fbcc00ac040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.479+0000 7fbcd0c99640 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d8bedc2f80 0x55d8bedbdc00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd0c99640 1 -- 172.21.15.133:0/2469710090 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v65'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fbcc80038e0 con 0x55d8bedc2f80 2023-12-18T10:22:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d8bedc2f80 msgr2=0x55d8bedbdc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55d8bedc2f80 0x55d8bedbdc00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcbc064490 msgr2=0x7fbcbc066950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcbc064490 0x7fbcbc066950 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0019890 tx=0x7fbcc00ac040 comp rx=0 tx=0).stop 2023-12-18T10:22:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1f190 msgr2=0x55d8bedc2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 --2- 172.21.15.133:0/2469710090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d8bed1f190 0x55d8bedc2a40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4008720 tx=0x7fbcc4008be0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd0c99640 1 -- 172.21.15.133:0/2469710090 reap_dead start 2023-12-18T10:22:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 shutdown_connections 2023-12-18T10:22:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 >> 172.21.15.133:0/2469710090 conn(0x55d8bed1be00 msgr2=0x55d8bed14f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 shutdown_connections 2023-12-18T10:22:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.483+0000 7fbcd297e080 1 -- 172.21.15.133:0/2469710090 wait complete. 2023-12-18T10:22:23.490 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /d1/d2/d3 recursive,force 2023-12-18T10:22:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.626+0000 7fca30f60640 1 Processor -- start 2023-12-18T10:22:23.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.626+0000 7fca30f60640 1 -- start start 2023-12-18T10:22:23.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.626+0000 7fca30f60640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca2c06d440 0x7fca2c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.626+0000 7fca30f60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ab190 0x7fca2c0ab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca30f60640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c0b28a0 con 0x7fca2c0ce5d0 2023-12-18T10:22:23.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca30f60640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c15ab30 con 0x7fca2c06d440 2023-12-18T10:22:23.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca30f60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0b1c90 con 0x7fca2c0ab190 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca21d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca2c06d440 0x7fca2c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca2a59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fca2c0ce5d0 0x7fca2c0ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53112/0 (socket says 172.21.15.133:53112) 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca2a59c640 1 -- 172.21.15.133:0/1684233049 learned_addr learned my addr 172.21.15.133:0/1684233049 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca21d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca2c06d440 0x7fca2c06d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52312/0 (socket says 172.21.15.133:52312) 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca2ad9d640 1 --2- 172.21.15.133:0/1684233049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ab190 0x7fca2c0ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca21d9b640 1 -- 172.21.15.133:0/1684233049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ab190 msgr2=0x7fca2c0ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca21d9b640 1 --2- 172.21.15.133:0/1684233049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ab190 0x7fca2c0ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca21d9b640 1 -- 172.21.15.133:0/1684233049 >> v1:172.21.15.133:6789/0 conn(0x7fca2c0ce5d0 legacy=0x7fca2c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca29d9b640 1 -- 172.21.15.133:0/1684233049 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958444591 0 0) 0x7fca2c0b28a0 con 0x7fca2c0ce5d0 2023-12-18T10:22:23.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca21d9b640 1 -- 172.21.15.133:0/1684233049 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0b1f70 con 0x7fca2c06d440 2023-12-18T10:22:23.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca21d9b640 1 --2- 172.21.15.133:0/1684233049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c06d440 0x7fca2c06d8a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fca140097c0 tx=0x7fca1401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcd9487b070a2aa server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca29d9b640 1 -- 172.21.15.133:0/1684233049 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140ab650 con 0x7fca2c06d440 2023-12-18T10:22:23.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca29d9b640 1 -- 172.21.15.133:0/1684233049 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca140ab7b0 con 0x7fca2c06d440 2023-12-18T10:22:23.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.630+0000 7fca29d9b640 1 -- 172.21.15.133:0/1684233049 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140abb40 con 0x7fca2c06d440 2023-12-18T10:22:23.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- 172.21.15.133:0/1684233049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c06d440 msgr2=0x7fca2c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 --2- 172.21.15.133:0/1684233049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c06d440 0x7fca2c06d8a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fca140097c0 tx=0x7fca1401c450 comp rx=0 tx=0).stop 2023-12-18T10:22:23.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- 172.21.15.133:0/1684233049 shutdown_connections 2023-12-18T10:22:23.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 --2- 172.21.15.133:0/1684233049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ab190 0x7fca2c0ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 --2- 172.21.15.133:0/1684233049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c06d440 0x7fca2c06d8a0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- 172.21.15.133:0/1684233049 >> 172.21.15.133:0/1684233049 conn(0x7fca2c069e70 msgr2=0x7fca2c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- 172.21.15.133:0/1684233049 shutdown_connections 2023-12-18T10:22:23.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- 172.21.15.133:0/1684233049 wait complete. 2023-12-18T10:22:23.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 Processor -- start 2023-12-18T10:22:23.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- start start 2023-12-18T10:22:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c06d440 0x7fca2c0c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c0ab190 0x7fca2c1f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ce5d0 0x7fca2c1f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c4a30 con 0x7fca2c0ab190 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c3db0 con 0x7fca2c06d440 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca30f60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c4090 con 0x7fca2c0ce5d0 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.634+0000 7fca21d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c0ab190 0x7fca2c1f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca21d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c0ab190 0x7fca2c1f8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52316/0 (socket says 172.21.15.133:52316) 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca21d9b640 1 -- 172.21.15.133:0/2609758096 learned_addr learned my addr 172.21.15.133:0/2609758096 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca2a59c640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c06d440 0x7fca2c0c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca2ad9d640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ce5d0 0x7fca2c1f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca21d9b640 1 -- 172.21.15.133:0/2609758096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ce5d0 msgr2=0x7fca2c1f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca21d9b640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ce5d0 0x7fca2c1f93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca21d9b640 1 -- 172.21.15.133:0/2609758096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c06d440 msgr2=0x7fca2c0c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca21d9b640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c06d440 0x7fca2c0c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca21d9b640 1 -- 172.21.15.133:0/2609758096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca14009420 con 0x7fca2c0ab190 2023-12-18T10:22:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca21d9b640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c0ab190 0x7fca2c1f8e60 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fca140ad040 tx=0x7fca1401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca237fe640 1 -- 172.21.15.133:0/2609758096 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140bf610 con 0x7fca2c0ab190 2023-12-18T10:22:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca237fe640 1 -- 172.21.15.133:0/2609758096 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca140bf770 con 0x7fca2c0ab190 2023-12-18T10:22:23.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca237fe640 1 -- 172.21.15.133:0/2609758096 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140bfb20 con 0x7fca2c0ab190 2023-12-18T10:22:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca30f60640 1 -- 172.21.15.133:0/2609758096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c0b2eb0 con 0x7fca2c0ab190 2023-12-18T10:22:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca30f60640 1 -- 172.21.15.133:0/2609758096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c0c4650 con 0x7fca2c0ab190 2023-12-18T10:22:23.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca237fe640 1 -- 172.21.15.133:0/2609758096 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fca140bfc80 con 0x7fca2c0ab190 2023-12-18T10:22:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.638+0000 7fca237fe640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fca0c065a60 0x7fca0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca237fe640 1 -- 172.21.15.133:0/2609758096 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca1411de40 con 0x7fca2c0ab190 2023-12-18T10:22:23.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fca0c065a60 0x7fca0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 Processor -- start 2023-12-18T10:22:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fca0c065a60 0x7fca0c067f20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fca1c007fd0 tx=0x7fca1c007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 -- start start 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b4cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b4d300 0x55ddb3b02a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3b03340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb39cab00 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb3958140 con 0x55ddb3b4d300 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ddb3955710 con 0x55ddb3b02f60 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b4cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b4cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52330/0 (socket says 172.21.15.133:52330) 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 -- 172.21.15.133:0/3708593828 learned_addr learned my addr 172.21.15.133:0/3708593828 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca21d9b640 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b4d300 0x55ddb3b02a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2ad9d640 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3b03340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 -- 172.21.15.133:0/3708593828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 msgr2=0x55ddb3b03340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3b03340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 -- 172.21.15.133:0/3708593828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b4d300 msgr2=0x55ddb3b02a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b4d300 0x55ddb3b02a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 -- 172.21.15.133:0/3708593828 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddb364dc90 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca2a59c640 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b4cdc0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fca1c001dc0 tx=0x7fca1c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2466937b031f3b31 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca0bfff640 1 -- 172.21.15.133:0/3708593828 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c015a80 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca0bfff640 1 -- 172.21.15.133:0/3708593828 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c015be0 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca0bfff640 1 -- 172.21.15.133:0/3708593828 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c021450 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 -- 172.21.15.133:0/3708593828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 msgr2=0x55ddb3b4cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b4cdc0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fca1c001dc0 tx=0x7fca1c012000 comp rx=0 tx=0).stop 2023-12-18T10:22:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 -- 172.21.15.133:0/3708593828 shutdown_connections 2023-12-18T10:22:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3b03340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b4d300 0x55ddb3b02a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 --2- 172.21.15.133:0/3708593828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b4cdc0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.642+0000 7fca342bc000 1 -- 172.21.15.133:0/3708593828 >> 172.21.15.133:0/3708593828 conn(0x55ddb3afef10 msgr2=0x55ddb3b01300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- 172.21.15.133:0/3708593828 shutdown_connections 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- 172.21.15.133:0/3708593828 wait complete. 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- start start 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 Processor -- start 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b02f60 0x55ddb3b53f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b54490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b4d300 0x55ddb3b3a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb3951000 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb38f0980 con 0x55ddb3b02f60 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ddb38f0620 con 0x55ddb3b4d300 2023-12-18T10:22:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 10 client.0 _ll_register_callbacks cb 0x55ddb394a940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b54490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b02f60 0x55ddb3b53f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b54490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52332/0 (socket says 172.21.15.133:52332) 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 -- 172.21.15.133:0/4214161373 learned_addr learned my addr 172.21.15.133:0/4214161373 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca2ad9d640 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b4d300 0x55ddb3b3a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 -- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b4d300 msgr2=0x55ddb3b3a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b4d300 0x55ddb3b3a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 -- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b02f60 msgr2=0x55ddb3b53f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b02f60 0x55ddb3b53f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 -- 172.21.15.133:0/4214161373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c00f040 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca21d9b640 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b54490 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fca140eb990 tx=0x7fca140efb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570e88bb1a2c96f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca097fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca097fa640 1 -- 172.21.15.133:0/4214161373 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140f32c0 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca097fa640 1 -- 172.21.15.133:0/4214161373 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca140f7470 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- 172.21.15.133:0/4214161373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddb39124f0 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca097fa640 1 -- 172.21.15.133:0/4214161373 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca140f50b0 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 10 client.7254 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- 172.21.15.133:0/4214161373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x55ddb3916390 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca097fa640 1 -- 172.21.15.133:0/4214161373 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ddb39124f0 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca097fa640 1 -- 172.21.15.133:0/4214161373 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fca140c8020 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 10 client.7254 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 10 client.7254 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 20 client.7254 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55ddb3b3b4d0 0x55ddb3b3b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 4 client.7254 mds_command: new command op to 6867 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.646+0000 7fca342bc000 1 -- 172.21.15.133:0/4214161373 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddb3955ef0 con 0x55ddb3b3b4d0 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca2a59c640 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55ddb3b3b4d0 0x55ddb3b3b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca2a59c640 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55ddb3b3b4d0 0x55ddb3b3b8e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=569b3426f48e67b5 server_cookie=24d8807d7056cae in_seq=0 out_seq=0 2023-12-18T10:22:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca097fa640 10 client.7254 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca097fa640 1 -- 172.21.15.133:0/4214161373 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ddb3955ef0 con 0x55ddb3b3b4d0 2023-12-18T10:22:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca097fa640 10 client.7254 handle_command_reply: tid=0 2023-12-18T10:22:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 client.7254 shutdown 2023-12-18T10:22:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 -- 172.21.15.133:0/4214161373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 msgr2=0x55ddb3b54490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b54490 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fca140eb990 tx=0x7fca140efb90 comp rx=0 tx=0).stop 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 -- 172.21.15.133:0/4214161373 shutdown_connections 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55ddb3b3b4d0 0x55ddb3b3b8e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b4d300 0x55ddb3b3a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b4c9e0 0x55ddb3b54490 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca097fa640 0 client.7254 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 --2- 172.21.15.133:0/4214161373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b02f60 0x55ddb3b53f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 -- 172.21.15.133:0/4214161373 >> 172.21.15.133:0/4214161373 conn(0x55ddb3afef10 msgr2=0x55ddb3b01b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 -- 172.21.15.133:0/4214161373 shutdown_connections 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 1 -- 172.21.15.133:0/4214161373 wait complete. 2023-12-18T10:22:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.650+0000 7fca342bc000 20 client.7254 trim_cache size 0 max 16384 2023-12-18T10:22:23.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 Processor -- start 2023-12-18T10:22:23.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- start start 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b082f0 0x55ddb3ba6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3afef10 0x55ddb3ba6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3ba6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb3afeba0 con 0x55ddb3afef10 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb360ed40 con 0x55ddb3b082f0 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ddb3953b60 con 0x55ddb3b02f60 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3afef10 0x55ddb3ba6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3afef10 0x55ddb3ba6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52334/0 (socket says 172.21.15.133:52334) 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 -- 172.21.15.133:0/3684802893 learned_addr learned my addr 172.21.15.133:0/3684802893 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca2a59c640 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b082f0 0x55ddb3ba6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca2ad9d640 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3ba6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 -- 172.21.15.133:0/3684802893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 msgr2=0x55ddb3ba6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3ba6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 -- 172.21.15.133:0/3684802893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b082f0 msgr2=0x55ddb3ba6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b082f0 0x55ddb3ba6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 -- 172.21.15.133:0/3684802893 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddb38fc4e0 con 0x55ddb3afef10 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca21d9b640 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3afef10 0x55ddb3ba6770 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fca140ebeb0 tx=0x7fca140c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7499d05e6a4e30e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca20d99640 1 -- 172.21.15.133:0/3684802893 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140f32c0 con 0x55ddb3afef10 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca20d99640 1 -- 172.21.15.133:0/3684802893 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca140eefd0 con 0x55ddb3afef10 2023-12-18T10:22:23.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca20d99640 1 -- 172.21.15.133:0/3684802893 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca140f52f0 con 0x55ddb3afef10 2023-12-18T10:22:23.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- 172.21.15.133:0/3684802893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3afef10 msgr2=0x55ddb3ba6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3afef10 0x55ddb3ba6770 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fca140ebeb0 tx=0x7fca140c1000 comp rx=0 tx=0).stop 2023-12-18T10:22:23.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- 172.21.15.133:0/3684802893 shutdown_connections 2023-12-18T10:22:23.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3ba6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3afef10 0x55ddb3ba6770 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 --2- 172.21.15.133:0/3684802893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3b082f0 0x55ddb3ba6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- 172.21.15.133:0/3684802893 >> 172.21.15.133:0/3684802893 conn(0x55ddb3b5a340 msgr2=0x55ddb3b398f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- 172.21.15.133:0/3684802893 shutdown_connections 2023-12-18T10:22:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- 172.21.15.133:0/3684802893 wait complete. 2023-12-18T10:22:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 -- start start 2023-12-18T10:22:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.666+0000 7fca342bc000 1 Processor -- start 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3afef10 0x55ddb3ba5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3b509c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b082f0 0x55ddb3b50f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb3b060b0 con 0x55ddb3b082f0 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb39948a0 con 0x55ddb3afef10 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ddb394e810 con 0x55ddb3b02f60 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 10 client.0 _ll_register_callbacks cb 0x55ddb395a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b082f0 0x55ddb3b50f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3afef10 0x55ddb3ba5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b082f0 0x55ddb3b50f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52348/0 (socket says 172.21.15.133:52348) 2023-12-18T10:22:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 -- 172.21.15.133:0/4034685840 learned_addr learned my addr 172.21.15.133:0/4034685840 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca21d9b640 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3b509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 -- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 msgr2=0x55ddb3b509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3b509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 -- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3afef10 msgr2=0x55ddb3ba5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3afef10 0x55ddb3ba5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 -- 172.21.15.133:0/4034685840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddb3916390 con 0x55ddb3b082f0 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2a59c640 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3afef10 0x55ddb3ba5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2ad9d640 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b082f0 0x55ddb3b50f00 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fca24009e00 tx=0x7fca24018820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4ae17eb50a8ff4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca097fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca097fa640 1 -- 172.21.15.133:0/4034685840 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24016870 con 0x55ddb3b082f0 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca097fa640 1 -- 172.21.15.133:0/4034685840 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca24022c30 con 0x55ddb3b082f0 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 -- 172.21.15.133:0/4034685840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddb3b06c70 con 0x55ddb3b082f0 2023-12-18T10:22:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca097fa640 1 -- 172.21.15.133:0/4034685840 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca24022df0 con 0x55ddb3b082f0 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 10 client.7260 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 -- 172.21.15.133:0/4034685840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x55ddb364e0c0 con 0x55ddb3b082f0 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca097fa640 1 -- 172.21.15.133:0/4034685840 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ddb3b06c70 con 0x55ddb3b082f0 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca097fa640 1 -- 172.21.15.133:0/4034685840 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fca240169d0 con 0x55ddb3b082f0 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 10 client.7260 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 10 client.7260 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 20 client.7260 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55ddb3b4c9e0 0x55ddb3b51f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 4 client.7260 mds_command: new command op to 6867 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca342bc000 1 -- 172.21.15.133:0/4034685840 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x55ddb391acf0 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2a59c640 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55ddb3b4c9e0 0x55ddb3b51f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca2a59c640 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55ddb3b4c9e0 0x55ddb3b51f20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc4b7121a8b63a3a server_cookie=ca9322bbd9519ea0 in_seq=0 out_seq=0 2023-12-18T10:22:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.670+0000 7fca097fa640 10 client.7260 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:23.680 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-12-18T10:22:23.679+0000 7f2b3999d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-12-18T10:22:04.549519+0000 1=0+1) n(v3 rc2023-12-18T10:22:04.775215+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={7050=pAsLsXsFsx/AsLsXsFsx@9},l=7050 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55aa761cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.549519+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.775215+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.549519+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-12-18T10:22:04.775215+0000 6=0+6)","error_str":""},"return_code":-61} 2023-12-18T10:22:23.680 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-18T10:22:23.679+0000 7f8a45416640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-12-18T10:22:04.558575+0000 1=0+1) n(v0 rc2023-12-18T10:22:04.558575+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7050=pAsLsXsFsx/-@6},l=7050 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5648b8991600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.558575+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.558575+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.558575+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-18T10:22:04.558575+0000 2=0+2)","error_str":""},"return_code":-61} 2023-12-18T10:22:23.681 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-18T10:22:23.679+0000 7f8a45416640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (iversion lock) caps={7050=pAsLsXsFs/-@3},l=7050 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5648b8991b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-12-18T10:22:23.681 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-12-18T10:22:23.679+0000 7f2b3f9a9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-12-18T10:22:04.551742+0000 1=0+1) n(v4 rc2023-12-18T10:22:04.775215+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={7050=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55aa761ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.551742+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.775215+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.551742+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-12-18T10:22:04.775215+0000 5=0+5)","error_str":""},"return_code":-61} 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca097fa640 1 -- 172.21.15.133:0/4034685840 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ddb391acf0 con 0x55ddb3b4c9e0 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca097fa640 10 client.7260 handle_command_reply: tid=0 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 client.7260 shutdown 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 -- 172.21.15.133:0/4034685840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b082f0 msgr2=0x55ddb3b50f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b082f0 0x55ddb3b50f00 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fca24009e00 tx=0x7fca24018820 comp rx=0 tx=0).stop 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 -- 172.21.15.133:0/4034685840 shutdown_connections 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55ddb3b4c9e0 0x55ddb3b51f20 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ddb3b082f0 0x55ddb3b50f00 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ddb3b02f60 0x55ddb3b509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca097fa640 0 client.7260 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 --2- 172.21.15.133:0/4034685840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddb3afef10 0x55ddb3ba5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 -- 172.21.15.133:0/4034685840 >> 172.21.15.133:0/4034685840 conn(0x55ddb3b5a340 msgr2=0x55ddb3b01b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 -- 172.21.15.133:0/4034685840 shutdown_connections 2023-12-18T10:22:23.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 1 -- 172.21.15.133:0/4034685840 wait complete. 2023-12-18T10:22:23.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca342bc000 20 client.7260 trim_cache size 0 max 16384 2023-12-18T10:22:23.683 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:23.683 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2023-12-18T10:22:23.683 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_tag": "b8b6e95b-8c75-4b45-8f05-1b323d94b1b7", 2023-12-18T10:22:23.683 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": "asynchronous" 2023-12-18T10:22:23.683 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:23.683 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fe0fcb2e640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-12-18T10:22:04.554184+0000 1=0+1) n(v2 rc2023-12-18T10:22:04.775215+0000 4=0+4) (inest lock) (iversion lock) caps={7050=pAsLsXsFs/-@8},l=7050 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x56339897d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.554184+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.775215+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.554184+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-12-18T10:22:04.775215+0000 4=0+4)","error_str":""},"return_code":-61} 2023-12-18T10:22:23.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 -- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fca0c065a60 msgr2=0x7fca0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fca0c065a60 0x7fca0c067f20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fca1c007fd0 tx=0x7fca1c007ee0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 -- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c0ab190 msgr2=0x7fca2c1f8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c0ab190 0x7fca2c1f8e60 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fca140ad040 tx=0x7fca1401ac90 comp rx=0 tx=0).stop 2023-12-18T10:22:23.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 -- 172.21.15.133:0/2609758096 shutdown_connections 2023-12-18T10:22:23.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fca0c065a60 0x7fca0c067f20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fca2c0ce5d0 0x7fca2c1f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca2c0ab190 0x7fca2c1f8e60 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 --2- 172.21.15.133:0/2609758096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c06d440 0x7fca2c0c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 -- 172.21.15.133:0/2609758096 >> 172.21.15.133:0/2609758096 conn(0x7fca2c069e70 msgr2=0x7fca2c159060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 -- 172.21.15.133:0/2609758096 shutdown_connections 2023-12-18T10:22:23.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fca30f60640 1 -- 172.21.15.133:0/2609758096 wait complete. 2023-12-18T10:22:23.685 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:22:23.674+0000 7fe102b3a640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-12-18T10:22:04.556225+0000 1=0+1) n(v1 rc2023-12-18T10:22:04.775215+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={7050=pAsLsXsFs/-@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x56339897d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.556225+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.558575+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.556225+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-12-18T10:22:04.775215+0000 3=0+3)","error_str":""},"return_code":-61} 2023-12-18T10:22:23.698 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-12-18T10:22:23.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.830+0000 7fcc65a8c640 1 Processor -- start 2023-12-18T10:22:23.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.830+0000 7fcc65a8c640 1 -- start start 2023-12-18T10:22:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc65a8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc60070820 0x7fcc600c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc65a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc600ce3b0 0x7fcc600ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc65a8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600c9390 con 0x7fcc601582d0 2023-12-18T10:22:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc65a8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc600ced80 con 0x7fcc60070820 2023-12-18T10:22:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc65a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6015aee0 con 0x7fcc600ce3b0 2023-12-18T10:22:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5f7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcc601582d0 0x7fcc600ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53116/0 (socket says 172.21.15.133:53116) 2023-12-18T10:22:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5f7fe640 1 -- 172.21.15.133:0/4046911570 learned_addr learned my addr 172.21.15.133:0/4046911570 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5effd640 1 --2- 172.21.15.133:0/4046911570 >> v2:172.21.15.133:3300/0 conn(0x7fcc60070820 0x7fcc600c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/4046911570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc600ce3b0 0x7fcc600ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5e7fc640 1 -- 172.21.15.133:0/4046911570 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055902627 0 0) 0x7fcc600c9390 con 0x7fcc601582d0 2023-12-18T10:22:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5effd640 1 -- 172.21.15.133:0/4046911570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc600ce3b0 msgr2=0x7fcc600ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5effd640 1 --2- 172.21.15.133:0/4046911570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc600ce3b0 0x7fcc600ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5effd640 1 -- 172.21.15.133:0/4046911570 >> v1:172.21.15.133:6789/0 conn(0x7fcc601582d0 legacy=0x7fcc600ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.834+0000 7fcc5effd640 1 -- 172.21.15.133:0/4046911570 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6015b1c0 con 0x7fcc60070820 2023-12-18T10:22:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc5effd640 1 --2- 172.21.15.133:0/4046911570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc60070820 0x7fcc600c8e50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fcc540097c0 tx=0x7fcc5401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953c891a1daa5423 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc5e7fc640 1 -- 172.21.15.133:0/4046911570 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540ab650 con 0x7fcc60070820 2023-12-18T10:22:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc5e7fc640 1 -- 172.21.15.133:0/4046911570 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc540ab7b0 con 0x7fcc60070820 2023-12-18T10:22:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc5e7fc640 1 -- 172.21.15.133:0/4046911570 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540abb40 con 0x7fcc60070820 2023-12-18T10:22:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 -- 172.21.15.133:0/4046911570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc60070820 msgr2=0x7fcc600c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/4046911570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc60070820 0x7fcc600c8e50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fcc540097c0 tx=0x7fcc5401c450 comp rx=0 tx=0).stop 2023-12-18T10:22:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 -- 172.21.15.133:0/4046911570 shutdown_connections 2023-12-18T10:22:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/4046911570 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc600ce3b0 0x7fcc600ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/4046911570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc60070820 0x7fcc600c8e50 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 -- 172.21.15.133:0/4046911570 >> 172.21.15.133:0/4046911570 conn(0x7fcc6006a2a0 msgr2=0x7fcc600aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 -- 172.21.15.133:0/4046911570 shutdown_connections 2023-12-18T10:22:23.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 -- 172.21.15.133:0/4046911570 wait complete. 2023-12-18T10:22:23.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 Processor -- start 2023-12-18T10:22:23.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.838+0000 7fcc65a8c640 1 -- start start 2023-12-18T10:22:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc65a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc60070820 0x7fcc6015e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc65a8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc600ce3b0 0x7fcc600c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc65a8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc601582d0 0x7fcc601f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc65a8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6015f040 con 0x7fcc601582d0 2023-12-18T10:22:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc65a8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc60152410 con 0x7fcc600ce3b0 2023-12-18T10:22:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc65a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600c49b0 con 0x7fcc60070820 2023-12-18T10:22:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc601582d0 0x7fcc601f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc601582d0 0x7fcc601f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52362/0 (socket says 172.21.15.133:52362) 2023-12-18T10:22:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 -- 172.21.15.133:0/501323880 learned_addr learned my addr 172.21.15.133:0/501323880 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5effd640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc600ce3b0 0x7fcc600c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc60070820 0x7fcc6015e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 -- 172.21.15.133:0/501323880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc60070820 msgr2=0x7fcc6015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc60070820 0x7fcc6015e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 -- 172.21.15.133:0/501323880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc600ce3b0 msgr2=0x7fcc600c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc600ce3b0 0x7fcc600c2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 -- 172.21.15.133:0/501323880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54009420 con 0x7fcc601582d0 2023-12-18T10:22:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc601582d0 0x7fcc601f8090 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fcc58007e40 tx=0x7fcc5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc47fff640 1 -- 172.21.15.133:0/501323880 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58014620 con 0x7fcc601582d0 2023-12-18T10:22:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc47fff640 1 -- 172.21.15.133:0/501323880 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5800ee90 con 0x7fcc601582d0 2023-12-18T10:22:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc47fff640 1 -- 172.21.15.133:0/501323880 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc580149e0 con 0x7fcc601582d0 2023-12-18T10:22:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc65a8c640 1 -- 172.21.15.133:0/501323880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc600c43f0 con 0x7fcc601582d0 2023-12-18T10:22:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.842+0000 7fcc65a8c640 1 -- 172.21.15.133:0/501323880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc60158bf0 con 0x7fcc601582d0 2023-12-18T10:22:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc47fff640 1 -- 172.21.15.133:0/501323880 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcc58014b40 con 0x7fcc601582d0 2023-12-18T10:22:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc47fff640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc4c065a60 0x7fcc4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc47fff640 1 -- 172.21.15.133:0/501323880 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcc58083b50 con 0x7fcc601582d0 2023-12-18T10:22:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc4c065a60 0x7fcc4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc68deb000 1 Processor -- start 2023-12-18T10:22:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc4c065a60 0x7fcc4c067f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcc50000f70 tx=0x7fcc50007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc68deb000 1 -- start start 2023-12-18T10:22:23.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 0x5648a5458a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a5458fc0 0x5648a54593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc68deb000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a5321430 con 0x5648a5458fc0 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc68deb000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a52af460 con 0x5648a54a2c80 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc68deb000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648a52aca30 con 0x5648a54a35a0 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a5458fc0 0x5648a54593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a5458fc0 0x5648a54593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52368/0 (socket says 172.21.15.133:52368) 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 -- 172.21.15.133:0/4249694181 learned_addr learned my addr 172.21.15.133:0/4249694181 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5effd640 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 0x5648a5458a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 -- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 msgr2=0x5648a5458a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 0x5648a5458a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 -- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 msgr2=0x5648a54a3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54a3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 -- 172.21.15.133:0/4249694181 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a4fa4e20 con 0x5648a5458fc0 2023-12-18T10:22:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a5458fc0 0x5648a54593a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fcc58054e30 tx=0x7fcc580552b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13dbb2a52a2a360 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc457fa640 1 -- 172.21.15.133:0/4249694181 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58058070 con 0x5648a5458fc0 2023-12-18T10:22:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc457fa640 1 -- 172.21.15.133:0/4249694181 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc58053270 con 0x5648a5458fc0 2023-12-18T10:22:23.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.846+0000 7fcc457fa640 1 -- 172.21.15.133:0/4249694181 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58051840 con 0x5648a5458fc0 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- 172.21.15.133:0/4249694181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a5458fc0 msgr2=0x5648a54593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a5458fc0 0x5648a54593a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fcc58054e30 tx=0x7fcc580552b0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- 172.21.15.133:0/4249694181 shutdown_connections 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a5458fc0 0x5648a54593a0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 0x5648a5458a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 --2- 172.21.15.133:0/4249694181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- 172.21.15.133:0/4249694181 >> 172.21.15.133:0/4249694181 conn(0x5648a5257910 msgr2=0x5648a5457360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- 172.21.15.133:0/4249694181 shutdown_connections 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- 172.21.15.133:0/4249694181 wait complete. 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- start start 2023-12-18T10:22:23.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 Processor -- start 2023-12-18T10:22:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a54a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a35a0 0x5648a54a3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a52a8320 con 0x5648a54a2c80 2023-12-18T10:22:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a52474f0 con 0x5648a54a35a0 2023-12-18T10:22:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648a52656e0 con 0x5648a5458fc0 2023-12-18T10:22:23.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 10 client.0 _ll_register_callbacks cb 0x5648a5444980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52370/0 (socket says 172.21.15.133:52370) 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 -- 172.21.15.133:0/1712621269 learned_addr learned my addr 172.21.15.133:0/1712621269 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a54a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a35a0 0x5648a54a3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 -- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 msgr2=0x5648a54a23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a54a23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 -- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a35a0 msgr2=0x5648a54a3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a35a0 0x5648a54a3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 -- 172.21.15.133:0/1712621269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc60158bf0 con 0x5648a54a2c80 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a54a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc5effd640 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a3980 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fcc540ad040 tx=0x7fcc5401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b99896d6bc2a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1712621269 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540ab920 con 0x5648a54a2c80 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1712621269 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcc540aba80 con 0x5648a54a2c80 2023-12-18T10:22:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.850+0000 7fcc68deb000 1 -- 172.21.15.133:0/1712621269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648a5265120 con 0x5648a54a2c80 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1712621269 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc540abc40 con 0x5648a54a2c80 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 10 client.7275 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 -- 172.21.15.133:0/1712621269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5648a526d250 con 0x5648a54a2c80 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1712621269 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5648a5265120 con 0x5648a54a2c80 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1712621269 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fcc540be070 con 0x5648a54a2c80 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 10 client.7275 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 10 client.7275 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 20 client.7275 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x5648a54a48d0 0x5648a54a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 4 client.7275 mds_command: new command op to 6867 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 -- 172.21.15.133:0/1712621269 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648a52a6c70 con 0x5648a54a48d0 2023-12-18T10:22:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x5648a54a48d0 0x5648a54a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x5648a54a48d0 0x5648a54a4ce0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba16de677e705b6 server_cookie=231a2b9289dd3727 in_seq=0 out_seq=0 2023-12-18T10:22:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc3e7fc640 10 client.7275 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1712621269 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5648a52a6c70 con 0x5648a54a48d0 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc3e7fc640 10 client.7275 handle_command_reply: tid=0 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 client.7275 shutdown 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 -- 172.21.15.133:0/1712621269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 msgr2=0x5648a54a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a3980 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fcc540ad040 tx=0x7fcc5401ac90 comp rx=0 tx=0).stop 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 -- 172.21.15.133:0/1712621269 shutdown_connections 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x5648a54a48d0 0x5648a54a4ce0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a35a0 0x5648a54a3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a3980 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc3e7fc640 0 client.7275 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1712621269 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a54a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 -- 172.21.15.133:0/1712621269 >> 172.21.15.133:0/1712621269 conn(0x5648a5257910 msgr2=0x5648a5457a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 -- 172.21.15.133:0/1712621269 shutdown_connections 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 1 -- 172.21.15.133:0/1712621269 wait complete. 2023-12-18T10:22:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.854+0000 7fcc68deb000 20 client.7275 trim_cache size 0 max 16384 2023-12-18T10:22:23.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 Processor -- start 2023-12-18T10:22:23.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 -- start start 2023-12-18T10:22:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a5458fc0 0x5648a54a1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 0x5648a54b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a4f65aa0 con 0x5648a54a2c80 2023-12-18T10:22:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a52eb4d0 con 0x5648a5458fc0 2023-12-18T10:22:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648a524d820 con 0x5648a54a35a0 2023-12-18T10:22:23.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52382/0 (socket says 172.21.15.133:52382) 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 -- 172.21.15.133:0/3208331354 learned_addr learned my addr 172.21.15.133:0/3208331354 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a5458fc0 0x5648a54a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 0x5648a54b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 -- 172.21.15.133:0/3208331354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 msgr2=0x5648a54b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 0x5648a54b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 -- 172.21.15.133:0/3208331354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a5458fc0 msgr2=0x5648a54a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a5458fc0 0x5648a54a1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 -- 172.21.15.133:0/3208331354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a52535a0 con 0x5648a54a2c80 2023-12-18T10:22:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc5effd640 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a1580 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fcc5401ab00 tx=0x7fcc540b7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff8cedf8fcadc63 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc45ffb640 1 -- 172.21.15.133:0/3208331354 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540b6e60 con 0x5648a54a2c80 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc45ffb640 1 -- 172.21.15.133:0/3208331354 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc540bb040 con 0x5648a54a2c80 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc45ffb640 1 -- 172.21.15.133:0/3208331354 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540042f0 con 0x5648a54a2c80 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 -- 172.21.15.133:0/3208331354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 msgr2=0x5648a54a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.870+0000 7fcc68deb000 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a1580 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fcc5401ab00 tx=0x7fcc540b7070 comp rx=0 tx=0).stop 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- 172.21.15.133:0/3208331354 shutdown_connections 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a54a35a0 0x5648a54b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a2c80 0x5648a54a1580 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 --2- 172.21.15.133:0/3208331354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a5458fc0 0x5648a54a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- 172.21.15.133:0/3208331354 >> 172.21.15.133:0/3208331354 conn(0x5648a5257910 msgr2=0x5648a54afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- 172.21.15.133:0/3208331354 shutdown_connections 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- 172.21.15.133:0/3208331354 wait complete. 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- start start 2023-12-18T10:22:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 Processor -- start 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a55085b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a35a0 0x5648a54b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a5458ae0 con 0x5648a54a35a0 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a545daa0 con 0x5648a54a2c80 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5648a5377140 con 0x5648a5458fc0 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 10 client.0 _ll_register_callbacks cb 0x5648a525f710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a35a0 0x5648a54b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a35a0 0x5648a54b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52388/0 (socket says 172.21.15.133:52388) 2023-12-18T10:22:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 -- 172.21.15.133:0/1914576137 learned_addr learned my addr 172.21.15.133:0/1914576137 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a55085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5effd640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 -- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 msgr2=0x5648a55085b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a55085b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 -- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 msgr2=0x5648a54b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 -- 172.21.15.133:0/1914576137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648a526d250 con 0x5648a54a35a0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a55085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5effd640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5ffff640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a35a0 0x5648a54b6190 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800e9b0 tx=0x7fcc58016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866fdc589a195086 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1914576137 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58058040 con 0x5648a54a35a0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1914576137 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcc58051840 con 0x5648a54a35a0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- 172.21.15.133:0/1914576137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648a545c940 con 0x5648a54a35a0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1914576137 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc58054c70 con 0x5648a54a35a0 2023-12-18T10:22:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 10 client.7281 fetch_fsmap learned FSMap version 57 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- 172.21.15.133:0/1914576137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x5648a5247110 con 0x5648a54a35a0 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1914576137 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5648a545c940 con 0x5648a54a35a0 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1914576137 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 57) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fcc5805e020 con 0x5648a54a35a0 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 10 client.7281 fetch_fsmap finished waiting for FSMap version 57 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 10 client.7281 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 20 client.7281 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x5648a54b66d0 0x5648a54b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 4 client.7281 mds_command: new command op to 6867 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc68deb000 1 -- 172.21.15.133:0/1914576137 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5648a52716a0 con 0x5648a54b66d0 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.874+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x5648a54b66d0 0x5648a54b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc3e7fc640 10 client.7281 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc5f7fe640 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x5648a54b66d0 0x5648a54b6ae0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a981fb968366b3c server_cookie=a76c8981efbffe81 in_seq=0 out_seq=0 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc3e7fc640 1 -- 172.21.15.133:0/1914576137 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5648a52716a0 con 0x5648a54b66d0 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc3e7fc640 10 client.7281 handle_command_reply: tid=0 2023-12-18T10:22:23.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 client.7281 shutdown 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 -- 172.21.15.133:0/1914576137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a35a0 msgr2=0x5648a54b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a35a0 0x5648a54b6190 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800e9b0 tx=0x7fcc58016070 comp rx=0 tx=0).stop 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 -- 172.21.15.133:0/1914576137 shutdown_connections 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x5648a54b66d0 0x5648a54b6ae0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5648a54a35a0 0x5648a54b6190 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648a54a2c80 0x5648a54b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 --2- 172.21.15.133:0/1914576137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5648a5458fc0 0x5648a55085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc3e7fc640 0 client.7281 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 -- 172.21.15.133:0/1914576137 >> 172.21.15.133:0/1914576137 conn(0x5648a5257910 msgr2=0x5648a54a0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 -- 172.21.15.133:0/1914576137 shutdown_connections 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 1 -- 172.21.15.133:0/1914576137 wait complete. 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc68deb000 20 client.7281 trim_cache size 0 max 16384 2023-12-18T10:22:23.886 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout: "b8b6e95b-8c75-4b45-8f05-1b323d94b1b7": { 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b8b6e95b-8c75-4b45-8f05-1b323d94b1b7", 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:22:23.887 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 -- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc4c065a60 msgr2=0x7fcc4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc4c065a60 0x7fcc4c067f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcc50000f70 tx=0x7fcc50007df0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 -- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc601582d0 msgr2=0x7fcc601f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc601582d0 0x7fcc601f8090 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fcc58007e40 tx=0x7fcc5800e4b0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 -- 172.21.15.133:0/501323880 shutdown_connections 2023-12-18T10:22:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcc4c065a60 0x7fcc4c067f20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc601582d0 0x7fcc601f8090 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc600ce3b0 0x7fcc600c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 --2- 172.21.15.133:0/501323880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcc60070820 0x7fcc6015e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 -- 172.21.15.133:0/501323880 >> 172.21.15.133:0/501323880 conn(0x7fcc6006a2a0 msgr2=0x7fcc60155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 -- 172.21.15.133:0/501323880 shutdown_connections 2023-12-18T10:22:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:23.878+0000 7fcc65a8c640 1 -- 172.21.15.133:0/501323880 wait complete. 2023-12-18T10:22:23.901 INFO:tasks.cephfs.filesystem:scrub status for tag:b8b6e95b-8c75-4b45-8f05-1b323d94b1b7 - {'path': '/d1/d2/d3', 'tag': 'b8b6e95b-8c75-4b45-8f05-1b323d94b1b7', 'options': 'recursive,force'} 2023-12-18T10:22:25.239 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:22:25.238+0000 7f3bac1eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-18T10:22:28.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:22:28.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:22:34.973 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:22:34.970+0000 7f3bac1eb640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-18T10:22:53.902 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-12-18T10:22:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cded7640 1 Processor -- start 2023-12-18T10:22:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cded7640 1 -- start start 2023-12-18T10:22:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cded7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c815b4b0 0x7fa0c815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cded7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0c813faf0 0x7fa0c806bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cded7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c8140320 con 0x7fa0c806c240 2023-12-18T10:22:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cded7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c806c6d0 con 0x7fa0c813faf0 2023-12-18T10:22:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cded7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8140600 con 0x7fa0c815b4b0 2023-12-18T10:22:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0c7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0c813faf0 0x7fa0c806bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cced5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c815b4b0 0x7fa0c815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0c7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0c813faf0 0x7fa0c806bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:47476/0 (socket says 172.21.15.133:47476) 2023-12-18T10:22:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0c7fff640 1 -- 172.21.15.133:0/1643345726 learned_addr learned my addr 172.21.15.133:0/1643345726 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cced5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c815b4b0 0x7fa0c815aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:41458/0 (socket says 172.21.15.133:41458) 2023-12-18T10:22:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0c7fff640 1 -- 172.21.15.133:0/1643345726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c815b4b0 msgr2=0x7fa0c815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/1643345726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c815b4b0 0x7fa0c815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0c7fff640 1 -- 172.21.15.133:0/1643345726 >> v1:172.21.15.142:6789/0 conn(0x7fa0c806c240 legacy=0x7fa0c815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0c7fff640 1 -- 172.21.15.133:0/1643345726 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c81408e0 con 0x7fa0c813faf0 2023-12-18T10:22:54.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.050+0000 7fa0cced5640 1 --2- 172.21.15.133:0/1643345726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c815b4b0 0x7fa0c815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/1643345726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c813faf0 0x7fa0c806bd00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009870 tx=0x7fa0b401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf054c178da4304 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0c77fe640 1 -- 172.21.15.133:0/1643345726 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40ab610 con 0x7fa0c813faf0 2023-12-18T10:22:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0c77fe640 1 -- 172.21.15.133:0/1643345726 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40ab770 con 0x7fa0c813faf0 2023-12-18T10:22:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0c77fe640 1 -- 172.21.15.133:0/1643345726 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40abb00 con 0x7fa0c813faf0 2023-12-18T10:22:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0cded7640 1 -- 172.21.15.133:0/1643345726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c813faf0 msgr2=0x7fa0c806bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0cded7640 1 --2- 172.21.15.133:0/1643345726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c813faf0 0x7fa0c806bd00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009870 tx=0x7fa0b401c3f0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0cded7640 1 -- 172.21.15.133:0/1643345726 shutdown_connections 2023-12-18T10:22:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0cded7640 1 --2- 172.21.15.133:0/1643345726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c813faf0 0x7fa0c806bd00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0cded7640 1 --2- 172.21.15.133:0/1643345726 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c815b4b0 0x7fa0c815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0cded7640 1 -- 172.21.15.133:0/1643345726 >> 172.21.15.133:0/1643345726 conn(0x7fa0c806d8d0 msgr2=0x7fa0c8069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0cded7640 1 -- 172.21.15.133:0/1643345726 shutdown_connections 2023-12-18T10:22:54.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.054+0000 7fa0cded7640 1 -- 172.21.15.133:0/1643345726 wait complete. 2023-12-18T10:22:54.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 Processor -- start 2023-12-18T10:22:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 -- start start 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c806c240 0x7fa0c80b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c813faf0 0x7fa0c8070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c815b4b0 0x7fa0c81501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8071cf0 con 0x7fa0c806c240 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8071130 con 0x7fa0c815b4b0 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c8071730 con 0x7fa0c813faf0 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c806c240 0x7fa0c80b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c806c240 0x7fa0c80b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58910/0 (socket says 172.21.15.133:58910) 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 -- 172.21.15.133:0/512022077 learned_addr learned my addr 172.21.15.133:0/512022077 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c813faf0 0x7fa0c8070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cd6d6640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c815b4b0 0x7fa0c81501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 -- 172.21.15.133:0/512022077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c813faf0 msgr2=0x7fa0c8070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c813faf0 0x7fa0c8070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 -- 172.21.15.133:0/512022077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c815b4b0 msgr2=0x7fa0c81501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c815b4b0 0x7fa0c81501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 -- 172.21.15.133:0/512022077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc009420 con 0x7fa0c806c240 2023-12-18T10:22:54.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cced5640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c806c240 0x7fa0c80b0440 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00ebe0 tx=0x7fa0bc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0c57fa640 1 -- 172.21.15.133:0/512022077 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00eee0 con 0x7fa0c806c240 2023-12-18T10:22:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0c57fa640 1 -- 172.21.15.133:0/512022077 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc00cc30 con 0x7fa0c806c240 2023-12-18T10:22:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0c57fa640 1 -- 172.21.15.133:0/512022077 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc013470 con 0x7fa0c806c240 2023-12-18T10:22:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 -- 172.21.15.133:0/512022077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b40094d0 con 0x7fa0c806c240 2023-12-18T10:22:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.058+0000 7fa0cded7640 1 -- 172.21.15.133:0/512022077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c81400f0 con 0x7fa0c806c240 2023-12-18T10:22:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c57fa640 1 -- 172.21.15.133:0/512022077 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa0bc0135d0 con 0x7fa0c806c240 2023-12-18T10:22:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c57fa640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa0ac065a90 0x7fa0ac067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c57fa640 1 -- 172.21.15.133:0/512022077 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fa0bc083620 con 0x7fa0c806c240 2023-12-18T10:22:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa0ac065a90 0x7fa0ac067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0d24a6000 1 Processor -- start 2023-12-18T10:22:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0d24a6000 1 -- start start 2023-12-18T10:22:54.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa0ac065a90 0x7fa0ac067f50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40af000 tx=0x7fa0b40b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081d5a0 0x559eb07d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb07d2fc0 0x559eb07d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb069b430 con 0x559eb081d5a0 2023-12-18T10:22:54.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb0629460 con 0x559eb081cc80 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559eb0626a30 con 0x559eb07d2fc0 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081d5a0 0x559eb07d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081d5a0 0x559eb07d2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58912/0 (socket says 172.21.15.133:58912) 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 -- 172.21.15.133:0/2484812460 learned_addr learned my addr 172.21.15.133:0/2484812460 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0cced5640 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0cd6d6640 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb07d2fc0 0x559eb07d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 -- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb07d2fc0 msgr2=0x559eb07d33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb07d2fc0 0x559eb07d33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 -- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 msgr2=0x559eb081d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0c7fff640 1 -- 172.21.15.133:0/2484812460 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559eb031ee20 con 0x559eb081d5a0 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.062+0000 7fa0cced5640 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081d5a0 0x559eb07d2a80 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa0b401c430 tx=0x7fa0b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e868fb3a66eb4ef1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0b27fc640 1 -- 172.21.15.133:0/2484812460 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40c0960 con 0x559eb081d5a0 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0b27fc640 1 -- 172.21.15.133:0/2484812460 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40c0ac0 con 0x559eb081d5a0 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0b27fc640 1 -- 172.21.15.133:0/2484812460 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40c0e30 con 0x559eb081d5a0 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2484812460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081d5a0 msgr2=0x559eb07d2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081d5a0 0x559eb07d2a80 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa0b401c430 tx=0x7fa0b4004740 comp rx=0 tx=0).stop 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2484812460 shutdown_connections 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb07d2fc0 0x559eb07d33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081d5a0 0x559eb07d2a80 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2484812460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2484812460 >> 172.21.15.133:0/2484812460 conn(0x559eb05d1910 msgr2=0x559eb07d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2484812460 shutdown_connections 2023-12-18T10:22:54.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2484812460 wait complete. 2023-12-18T10:22:54.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- start start 2023-12-18T10:22:54.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 Processor -- start 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb081c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb081dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb0622320 con 0x559eb07d2fc0 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb05c14f0 con 0x559eb081cc80 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559eb05df6e0 con 0x559eb081d5a0 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0d24a6000 10 client.0 _ll_register_callbacks cb 0x559eb07be980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cced5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb081c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cced5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb081c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58916/0 (socket says 172.21.15.133:58916) 2023-12-18T10:22:54.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cced5640 1 -- 172.21.15.133:0/2358910458 learned_addr learned my addr 172.21.15.133:0/2358910458 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cd6d6640 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb081dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cced5640 1 -- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 msgr2=0x559eb081dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cced5640 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb081dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cced5640 1 -- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 msgr2=0x559eb081d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cced5640 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.066+0000 7fa0cced5640 1 -- 172.21.15.133:0/2358910458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c81400f0 con 0x559eb07d2fc0 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0cced5640 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb081c440 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00ebb0 tx=0x7fa0bc054ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4aa90adc15a46ee server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 1 -- 172.21.15.133:0/2358910458 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc05c780 con 0x559eb07d2fc0 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 1 -- 172.21.15.133:0/2358910458 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fa0bc0830b0 con 0x559eb07d2fc0 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2358910458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559eb05df120 con 0x559eb07d2fc0 2023-12-18T10:22:54.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 1 -- 172.21.15.133:0/2358910458 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0bc083270 con 0x559eb07d2fc0 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 10 client.7290 fetch_fsmap learned FSMap version 60 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2358910458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x7fa0c81408e0 con 0x559eb07d2fc0 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 1 -- 172.21.15.133:0/2358910458 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559eb05df120 con 0x559eb07d2fc0 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 1 -- 172.21.15.133:0/2358910458 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fa0bc011070 con 0x559eb07d2fc0 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 10 client.7290 fetch_fsmap finished waiting for FSMap version 60 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 10 client.7290 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 20 client.7290 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x559eb081e8d0 0x559eb081ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 4 client.7290 mds_command: new command op to 6867 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2358910458 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559eb0620c70 con 0x559eb081e8d0 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x559eb081e8d0 0x559eb081ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 10 client.7290 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x559eb081e8d0 0x559eb081ece0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2704f0454e616e44 server_cookie=a4b240f8d2c8a775 in_seq=0 out_seq=0 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 1 -- 172.21.15.133:0/2358910458 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559eb0620c70 con 0x559eb081e8d0 2023-12-18T10:22:54.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 10 client.7290 handle_command_reply: tid=0 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 client.7290 shutdown 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2358910458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 msgr2=0x559eb081c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb081c440 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00ebb0 tx=0x7fa0bc054ae0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2358910458 shutdown_connections 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x559eb081e8d0 0x559eb081ece0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb081dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb081d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2358910458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb081c440 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0a77fe640 0 client.7290 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2358910458 >> 172.21.15.133:0/2358910458 conn(0x559eb05d1910 msgr2=0x559eb07d1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2358910458 shutdown_connections 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2358910458 wait complete. 2023-12-18T10:22:54.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.070+0000 7fa0d24a6000 20 client.7290 trim_cache size 0 max 16384 2023-12-18T10:22:54.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 Processor -- start 2023-12-18T10:22:54.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 -- start start 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb0829ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb082a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb081b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb02dfaa0 con 0x559eb07d2fc0 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb0626320 con 0x559eb081cc80 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559eb06654d0 con 0x559eb081d5a0 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb0829ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb0829ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58932/0 (socket says 172.21.15.133:58932) 2023-12-18T10:22:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 -- 172.21.15.133:0/2031090801 learned_addr learned my addr 172.21.15.133:0/2031090801 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 -- 172.21.15.133:0/2031090801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 msgr2=0x559eb081b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb081b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 -- 172.21.15.133:0/2031090801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 msgr2=0x559eb082a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb082a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb082a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 -- 172.21.15.133:0/2031090801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559eb05e7250 con 0x559eb07d2fc0 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb082a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0cced5640 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb0829ca0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009160 tx=0x7fa0bc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3c2cf88a6a83b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0b2ffd640 1 -- 172.21.15.133:0/2031090801 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00e070 con 0x559eb07d2fc0 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0b2ffd640 1 -- 172.21.15.133:0/2031090801 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc054440 con 0x559eb07d2fc0 2023-12-18T10:22:54.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0b2ffd640 1 -- 172.21.15.133:0/2031090801 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc05c7c0 con 0x559eb07d2fc0 2023-12-18T10:22:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2031090801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 msgr2=0x559eb0829ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb0829ca0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc009160 tx=0x7fa0bc01e000 comp rx=0 tx=0).stop 2023-12-18T10:22:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2031090801 shutdown_connections 2023-12-18T10:22:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb081b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb081cc80 0x559eb082a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/2031090801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb07d2fc0 0x559eb0829ca0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.086+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2031090801 >> 172.21.15.133:0/2031090801 conn(0x559eb05d1910 msgr2=0x559eb0829590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2031090801 shutdown_connections 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- 172.21.15.133:0/2031090801 wait complete. 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- start start 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 Processor -- start 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb07d2fc0 0x559eb08764c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081cc80 0x559eb08316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb0831be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb07d7570 con 0x559eb081cc80 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559eb05c7820 con 0x559eb07d2fc0 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559eb061dc90 con 0x559eb081d5a0 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 10 client.0 _ll_register_callbacks cb 0x559eb05d9710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081cc80 0x559eb08316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081cc80 0x559eb08316a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58948/0 (socket says 172.21.15.133:58948) 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 -- 172.21.15.133:0/824071604 learned_addr learned my addr 172.21.15.133:0/824071604 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0cd6d6640 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb0831be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0cced5640 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb07d2fc0 0x559eb08764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 -- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 msgr2=0x559eb0831be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb0831be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 -- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb07d2fc0 msgr2=0x559eb08764c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb07d2fc0 0x559eb08764c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 -- 172.21.15.133:0/824071604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c81408e0 con 0x559eb081cc80 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0c7fff640 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081cc80 0x559eb08316a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa0b401aaa0 tx=0x7fa0b40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a67e2b76b0ff72 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0a77fe640 1 -- 172.21.15.133:0/824071604 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40d9270 con 0x559eb081cc80 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0a77fe640 1 -- 172.21.15.133:0/824071604 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fa0b40d93d0 con 0x559eb081cc80 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- 172.21.15.133:0/824071604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559eb07d6940 con 0x559eb081cc80 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0a77fe640 1 -- 172.21.15.133:0/824071604 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0b40c0a60 con 0x559eb081cc80 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 10 client.7296 fetch_fsmap learned FSMap version 60 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- 172.21.15.133:0/824071604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x559eb05cd5a0 con 0x559eb081cc80 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0a77fe640 1 -- 172.21.15.133:0/824071604 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559eb07d6940 con 0x559eb081cc80 2023-12-18T10:22:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0a77fe640 1 -- 172.21.15.133:0/824071604 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fa0b40c0bc0 con 0x559eb081cc80 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 10 client.7296 fetch_fsmap finished waiting for FSMap version 60 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 10 client.7296 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 20 client.7296 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x559eb0832120 0x559eb0832530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 4 client.7296 mds_command: new command op to 6867 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.090+0000 7fa0d24a6000 1 -- 172.21.15.133:0/824071604 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559eb05eb6a0 con 0x559eb0832120 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cced5640 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x559eb0832120 0x559eb0832530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cced5640 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x559eb0832120 0x559eb0832530 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b65b834f8bc6de server_cookie=bfb44200a7e4691f in_seq=0 out_seq=0 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0a77fe640 10 client.7296 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0a77fe640 1 -- 172.21.15.133:0/824071604 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559eb05eb6a0 con 0x559eb0832120 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0a77fe640 10 client.7296 handle_command_reply: tid=0 2023-12-18T10:22:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 client.7296 shutdown 2023-12-18T10:22:54.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 -- 172.21.15.133:0/824071604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081cc80 msgr2=0x559eb08316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081cc80 0x559eb08316a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa0b401aaa0 tx=0x7fa0b40046d0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 -- 172.21.15.133:0/824071604 shutdown_connections 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x559eb0832120 0x559eb0832530 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559eb081d5a0 0x559eb0831be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559eb081cc80 0x559eb08316a0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 --2- 172.21.15.133:0/824071604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559eb07d2fc0 0x559eb08764c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0a77fe640 0 client.7296 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 -- 172.21.15.133:0/824071604 >> 172.21.15.133:0/824071604 conn(0x559eb05d1910 msgr2=0x559eb0829590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 -- 172.21.15.133:0/824071604 shutdown_connections 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 1 -- 172.21.15.133:0/824071604 wait complete. 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0d24a6000 20 client.7296 trim_cache size 0 max 16384 2023-12-18T10:22:54.102 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:22:54.103 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "no active scrubs running", 2023-12-18T10:22:54.103 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": {} 2023-12-18T10:22:54.103 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:22:54.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 -- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa0ac065a90 msgr2=0x7fa0ac067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa0ac065a90 0x7fa0ac067f50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40af000 tx=0x7fa0b40b6040 comp rx=0 tx=0).stop 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 -- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c806c240 msgr2=0x7fa0c80b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c806c240 0x7fa0c80b0440 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00ebe0 tx=0x7fa0bc00c520 comp rx=0 tx=0).stop 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 -- 172.21.15.133:0/512022077 shutdown_connections 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa0ac065a90 0x7fa0ac067f50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0c815b4b0 0x7fa0c81501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0c813faf0 0x7fa0c8070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 --2- 172.21.15.133:0/512022077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c806c240 0x7fa0c80b0440 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 -- 172.21.15.133:0/512022077 >> 172.21.15.133:0/512022077 conn(0x7fa0c806d8d0 msgr2=0x7fa0c8069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 -- 172.21.15.133:0/512022077 shutdown_connections 2023-12-18T10:22:54.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.094+0000 7fa0cded7640 1 -- 172.21.15.133:0/512022077 wait complete. 2023-12-18T10:22:54.117 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:22:54.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 damage ls 2023-12-18T10:22:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82ba36d640 1 Processor -- start 2023-12-18T10:22:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82ba36d640 1 -- start start 2023-12-18T10:22:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82ba36d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82b41610f0 0x7f82b40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82ba36d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b40ced90 con 0x7f82b415cbd0 2023-12-18T10:22:54.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82ba36d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b4161580 con 0x7f82b40b2780 2023-12-18T10:22:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82ba36d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b40cf220 con 0x7f82b41610f0 2023-12-18T10:22:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b3fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f82b415cbd0 0x7f82b40b2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59716/0 (socket says 172.21.15.133:59716) 2023-12-18T10:22:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b3fff640 1 -- 172.21.15.133:0/842268899 learned_addr learned my addr 172.21.15.133:0/842268899 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b890a640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82b41610f0 0x7f82b40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229260633 0 0) 0x7f82b40ced90 con 0x7f82b415cbd0 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f829c003530 con 0x7f82b415cbd0 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 750742535 0 0) 0x7f829c003530 con 0x7f82b415cbd0 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82b41610f0 msgr2=0x7f82b40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82b41610f0 0x7f82b40cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 >> v1:172.21.15.142:6789/0 conn(0x7f82b40b2780 legacy=0x7f82b406b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b415cfb0 con 0x7f82b415cbd0 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f82a4001800 con 0x7f82b415cbd0 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 >> v1:172.21.15.133:6789/0 conn(0x7f82b415cbd0 legacy=0x7f82b40b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.254+0000 7f82b2ffd640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82b41610f0 0x7f829c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b2ffd640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f829c003f30 0x7f829c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b2ffd640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829c004d10 0x7f829c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b40cf220 con 0x7f829c003f30 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c00ba70 con 0x7f829c004d10 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c00bc30 con 0x7f82b41610f0 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b37fe640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f829c003f30 0x7f829c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b3fff640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82b41610f0 0x7f829c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b890a640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829c004d10 0x7f829c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b37fe640 1 -- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82b41610f0 msgr2=0x7f829c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b37fe640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82b41610f0 0x7f829c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b37fe640 1 -- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829c004d10 msgr2=0x7f829c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b37fe640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f829c004d10 0x7f829c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b37fe640 1 -- 172.21.15.133:0/842268899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c003530 con 0x7f829c003f30 2023-12-18T10:22:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b37fe640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f829c003f30 0x7f829c0047d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f82a8001780 tx=0x7f82a801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdac9cea283b179 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a80052d0 con 0x7f829c003f30 2023-12-18T10:22:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a80a7050 con 0x7f829c003f30 2023-12-18T10:22:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.258+0000 7f82b2ffd640 1 -- 172.21.15.133:0/842268899 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8003600 con 0x7f829c003f30 2023-12-18T10:22:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- 172.21.15.133:0/842268899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f829c003f30 msgr2=0x7f829c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 --2- 172.21.15.133:0/842268899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f829c003f30 0x7f829c0047d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f82a8001780 tx=0x7f82a801c400 comp rx=0 tx=0).stop 2023-12-18T10:22:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82b890a640 1 -- 172.21.15.133:0/842268899 reap_dead start 2023-12-18T10:22:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- 172.21.15.133:0/842268899 shutdown_connections 2023-12-18T10:22:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- 172.21.15.133:0/842268899 >> 172.21.15.133:0/842268899 conn(0x7f82b40cd070 msgr2=0x7f82b40cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- 172.21.15.133:0/842268899 shutdown_connections 2023-12-18T10:22:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- 172.21.15.133:0/842268899 wait complete. 2023-12-18T10:22:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 Processor -- start 2023-12-18T10:22:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- start start 2023-12-18T10:22:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c003f30 0x7f82b40b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82b406ddd0 0x7f82b406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b40c76c0 0x7f82b40c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b406e770 con 0x7f82b40c76c0 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b40b51c0 con 0x7f82b406ddd0 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82ba36d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b41f30e0 con 0x7f829c003f30 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82b890a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b40c76c0 0x7f82b40c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82b890a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b40c76c0 0x7f82b40c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58966/0 (socket says 172.21.15.133:58966) 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82b890a640 1 -- 172.21.15.133:0/2250875489 learned_addr learned my addr 172.21.15.133:0/2250875489 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82b37fe640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82b406ddd0 0x7f82b406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.262+0000 7f82b3fff640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c003f30 0x7f82b40b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b890a640 1 -- 172.21.15.133:0/2250875489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c003f30 msgr2=0x7f82b40b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b890a640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c003f30 0x7f82b40b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b890a640 1 -- 172.21.15.133:0/2250875489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82b406ddd0 msgr2=0x7f82b406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b890a640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82b406ddd0 0x7f82b406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b890a640 1 -- 172.21.15.133:0/2250875489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b41f33c0 con 0x7f82b40c76c0 2023-12-18T10:22:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b890a640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b40c76c0 0x7f82b40c7b40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f82b40d16f0 tx=0x7f82ac00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b0ff9640 1 -- 172.21.15.133:0/2250875489 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00e040 con 0x7f82b40c76c0 2023-12-18T10:22:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b0ff9640 1 -- 172.21.15.133:0/2250875489 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac00f040 con 0x7f82b40c76c0 2023-12-18T10:22:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b0ff9640 1 -- 172.21.15.133:0/2250875489 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac015430 con 0x7f82b40c76c0 2023-12-18T10:22:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82ba36d640 1 -- 172.21.15.133:0/2250875489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b40b3280 con 0x7f82b40c76c0 2023-12-18T10:22:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82ba36d640 1 -- 172.21.15.133:0/2250875489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b40b3840 con 0x7f82b40c76c0 2023-12-18T10:22:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b0ff9640 1 -- 172.21.15.133:0/2250875489 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f82ac015590 con 0x7f82b40c76c0 2023-12-18T10:22:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b0ff9640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82a0065a60 0x7f82a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b0ff9640 1 -- 172.21.15.133:0/2250875489 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f82ac0838f0 con 0x7f82b40c76c0 2023-12-18T10:22:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.266+0000 7f82b3fff640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82a0065a60 0x7f82a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 Processor -- start 2023-12-18T10:22:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- start start 2023-12-18T10:22:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82a0065a60 0x7f82a0067f20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f82a4001db0 tx=0x7f82a4000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716cdb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c90ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716c913f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e716b58de0 con 0x55e716cdac90 2023-12-18T10:22:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e716ae7430 con 0x55e716c91010 2023-12-18T10:22:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e716ae4a00 con 0x55e716cdb5b0 2023-12-18T10:22:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716cdb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716cdb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58976/0 (socket says 172.21.15.133:58976) 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 -- 172.21.15.133:0/3619346970 learned_addr learned my addr 172.21.15.133:0/3619346970 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b890a640 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716c913f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b37fe640 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c90ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 -- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 msgr2=0x55e716c90ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c90ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 -- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 msgr2=0x55e716c913f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716c913f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 -- 172.21.15.133:0/3619346970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e716a81190 con 0x55e716cdac90 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b890a640 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716c913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:54.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82b3fff640 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716cdb070 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f82a40159f0 tx=0x7f82a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357dd07f58103d86 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f8299ffb640 1 -- 172.21.15.133:0/3619346970 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40179b0 con 0x55e716cdac90 2023-12-18T10:22:54.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f8299ffb640 1 -- 172.21.15.133:0/3619346970 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a4017b10 con 0x55e716cdac90 2023-12-18T10:22:54.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f8299ffb640 1 -- 172.21.15.133:0/3619346970 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4017c80 con 0x55e716cdac90 2023-12-18T10:22:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3619346970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 msgr2=0x55e716cdb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716cdb070 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f82a40159f0 tx=0x7f82a4018000 comp rx=0 tx=0).stop 2023-12-18T10:22:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3619346970 shutdown_connections 2023-12-18T10:22:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716c913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c90ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3619346970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716cdb070 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3619346970 >> 172.21.15.133:0/3619346970 conn(0x55e716c8cfc0 msgr2=0x55e716c8f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3619346970 shutdown_connections 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3619346970 wait complete. 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.270+0000 7f82bd6cc000 1 -- start start 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 Processor -- start 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716ce2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716ce2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c9ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e716ae02f0 con 0x55e716cdac90 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e716a7f620 con 0x55e716c91010 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e716a9d840 con 0x55e716cdb5b0 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 10 client.0 _ll_register_callbacks cb 0x55e716ad41b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716ce2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716ce2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58982/0 (socket says 172.21.15.133:58982) 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 -- 172.21.15.133:0/2342493890 learned_addr learned my addr 172.21.15.133:0/2342493890 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b3fff640 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716ce2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b890a640 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c9ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 -- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 msgr2=0x55e716c9ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c9ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 -- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 msgr2=0x55e716ce2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716ce2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 -- 172.21.15.133:0/2342493890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b415cfb0 con 0x55e716cdac90 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b890a640 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c9ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b37fe640 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716ce2740 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005040 tx=0x7f82a80191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4810baefe48029e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f8292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f8292ffd640 1 -- 172.21.15.133:0/2342493890 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8007040 con 0x55e716cdac90 2023-12-18T10:22:54.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f8292ffd640 1 -- 172.21.15.133:0/2342493890 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f82a80c1c80 con 0x55e716cdac90 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2342493890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e716aa43d0 con 0x55e716cdac90 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f8292ffd640 1 -- 172.21.15.133:0/2342493890 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82a80c1e40 con 0x55e716cdac90 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 10 client.7308 fetch_fsmap learned FSMap version 60 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2342493890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x55e7167dce20 con 0x55e716cdac90 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f8292ffd640 1 -- 172.21.15.133:0/2342493890 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e716aa43d0 con 0x55e716cdac90 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f8292ffd640 1 -- 172.21.15.133:0/2342493890 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f82a80be020 con 0x55e716cdac90 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 10 client.7308 fetch_fsmap finished waiting for FSMap version 60 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 10 client.7308 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 20 client.7308 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e716c9d830 0x55e716c9dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 4 client.7308 mds_command: new command op to 6867 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2342493890 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e716adec40 con 0x55e716c9d830 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b3fff640 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e716c9d830 0x55e716c9dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f82b3fff640 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e716c9d830 0x55e716c9dc40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=116c2358df591640 server_cookie=fe949a4fa1ef6266 in_seq=0 out_seq=0 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.274+0000 7f8292ffd640 10 client.7308 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f8292ffd640 1 -- 172.21.15.133:0/2342493890 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55e716adec40 con 0x55e716c9d830 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f8292ffd640 10 client.7308 handle_command_reply: tid=0 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 client.7308 shutdown 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2342493890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 msgr2=0x55e716ce2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716ce2740 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f82a8005040 tx=0x7f82a80191a0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2342493890 shutdown_connections 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e716c9d830 0x55e716c9dc40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716cdb5b0 0x55e716c9ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716cdac90 0x55e716ce2740 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f8292ffd640 0 client.7308 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:54.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2342493890 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716ce2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2342493890 >> 172.21.15.133:0/2342493890 conn(0x55e716c8cfc0 msgr2=0x55e716c8fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2342493890 shutdown_connections 2023-12-18T10:22:54.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2342493890 wait complete. 2023-12-18T10:22:54.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.278+0000 7f82bd6cc000 20 client.7308 trim_cache size 0 max 16384 2023-12-18T10:22:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.286+0000 7f82bd6cc000 1 Processor -- start 2023-12-18T10:22:54.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- start start 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c965f0 0x55e716c903c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c8cfc0 0x55e716c90900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c91010 0x55e716cdb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e71679daa0 con 0x55e716c8cfc0 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e716c964b0 con 0x55e716c965f0 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e716ae42f0 con 0x55e716c91010 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c8cfc0 0x55e716c90900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c8cfc0 0x55e716c90900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58988/0 (socket says 172.21.15.133:58988) 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 -- 172.21.15.133:0/2537656055 learned_addr learned my addr 172.21.15.133:0/2537656055 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 -- 172.21.15.133:0/2537656055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c91010 msgr2=0x55e716cdb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 --2- 172.21.15.133:0/2537656055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c91010 0x55e716cdb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 -- 172.21.15.133:0/2537656055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c965f0 msgr2=0x55e716c903c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 --2- 172.21.15.133:0/2537656055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c965f0 0x55e716c903c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 -- 172.21.15.133:0/2537656055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e716c943a0 con 0x55e716c8cfc0 2023-12-18T10:22:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82b37fe640 1 --2- 172.21.15.133:0/2537656055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c8cfc0 0x55e716c90900 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f82a801c230 tx=0x7f82a80b9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b7a5e980fd2c65 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f829a7fc640 1 -- 172.21.15.133:0/2537656055 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8007510 con 0x55e716c8cfc0 2023-12-18T10:22:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f829a7fc640 1 -- 172.21.15.133:0/2537656055 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8007670 con 0x55e716c8cfc0 2023-12-18T10:22:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f829a7fc640 1 -- 172.21.15.133:0/2537656055 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8003840 con 0x55e716c8cfc0 2023-12-18T10:22:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2537656055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c8cfc0 msgr2=0x55e716c90900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2537656055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c8cfc0 0x55e716c90900 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f82a801c230 tx=0x7f82a80b9000 comp rx=0 tx=0).stop 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2537656055 shutdown_connections 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2537656055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c91010 0x55e716cdb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2537656055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c8cfc0 0x55e716c90900 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/2537656055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c965f0 0x55e716c903c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2537656055 >> 172.21.15.133:0/2537656055 conn(0x55e716ce8c80 msgr2=0x55e716cd9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2537656055 shutdown_connections 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- 172.21.15.133:0/2537656055 wait complete. 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 -- start start 2023-12-18T10:22:54.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.290+0000 7f82bd6cc000 1 Processor -- start 2023-12-18T10:22:54.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c8cfc0 0x55e716d388d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716d38e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c965f0 0x55e716cde5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e716adf180 con 0x55e716c965f0 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e716addb00 con 0x55e716c91010 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e716adee30 con 0x55e716c8cfc0 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 10 client.0 _ll_register_callbacks cb 0x55e716c5ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c965f0 0x55e716cde5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c965f0 0x55e716cde5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58992/0 (socket says 172.21.15.133:58992) 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c8cfc0 0x55e716d388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b37fe640 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716d38e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 -- 172.21.15.133:0/3703060952 learned_addr learned my addr 172.21.15.133:0/3703060952 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 -- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c8cfc0 msgr2=0x55e716d388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c8cfc0 0x55e716d388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 -- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 msgr2=0x55e716d38e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716d38e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 -- 172.21.15.133:0/3703060952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7167dce20 con 0x55e716c965f0 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b890a640 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c965f0 0x55e716cde5d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f82ac081bb0 tx=0x7f82ac054f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abf67102d13a68c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 1 -- 172.21.15.133:0/3703060952 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0532a0 con 0x55e716c965f0 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 1 -- 172.21.15.133:0/3703060952 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f82ac06c030 con 0x55e716c965f0 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3703060952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e716a8fca0 con 0x55e716c965f0 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 1 -- 172.21.15.133:0/3703060952 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82ac06c1f0 con 0x55e716c965f0 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 10 client.7314 fetch_fsmap learned FSMap version 60 2023-12-18T10:22:54.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3703060952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x55e716aa5220 con 0x55e716c965f0 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 1 -- 172.21.15.133:0/3703060952 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e716a8fca0 con 0x55e716c965f0 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 1 -- 172.21.15.133:0/3703060952 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f82ac026020 con 0x55e716c965f0 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 10 client.7314 fetch_fsmap finished waiting for FSMap version 60 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 10 client.7314 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 20 client.7314 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e716cdac90 0x55e716cdeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 4 client.7314 mds_command: new command op to 6867 tid=0[{"prefix": "damage ls"}] 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3703060952 --> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e716ad9370 con 0x55e716cdac90 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b3fff640 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e716cdac90 0x55e716cdeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82b3fff640 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e716cdac90 0x55e716cdeb10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e32e3e88557a466 server_cookie=47238874bf1a5ebe in_seq=0 out_seq=0 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 10 client.7314 ms_handle_connect on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 1 -- 172.21.15.133:0/3703060952 <== mds.0 v2:172.21.15.142:6832/900380605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+271 (crc 0 0 0) 0x55e716ad9370 con 0x55e716cdac90 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 10 client.7314 handle_command_reply: tid=0 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 client.7314 shutdown 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3703060952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c965f0 msgr2=0x55e716cde5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c965f0 0x55e716cde5d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f82ac081bb0 tx=0x7f82ac054f80 comp rx=0 tx=0).stop 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3703060952 shutdown_connections 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:6832/900380605,v1:172.21.15.142:6835/900380605] conn(0x55e716cdac90 0x55e716cdeb10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e716c965f0 0x55e716cde5d0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e716c91010 0x55e716d38e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 --2- 172.21.15.133:0/3703060952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e716c8cfc0 0x55e716d388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f8292ffd640 0 client.7314 ms_handle_reset on v2:172.21.15.142:6832/900380605 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3703060952 >> 172.21.15.133:0/3703060952 conn(0x55e716ce8c80 msgr2=0x55e716cd9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3703060952 shutdown_connections 2023-12-18T10:22:54.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.294+0000 7f82bd6cc000 1 -- 172.21.15.133:0/3703060952 wait complete. 2023-12-18T10:22:54.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82bd6cc000 20 client.7314 trim_cache size 0 max 16384 2023-12-18T10:22:54.306 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:22:54.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:22:54.306 INFO:teuthology.orchestra.run.smithi133.stdout: "damage_type": "backtrace", 2023-12-18T10:22:54.306 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 756591913, 2023-12-18T10:22:54.306 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 1099511627779, 2023-12-18T10:22:54.306 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3/d4" 2023-12-18T10:22:54.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:22:54.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:22:54.307 INFO:teuthology.orchestra.run.smithi133.stdout: "damage_type": "backtrace", 2023-12-18T10:22:54.307 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 2072252149, 2023-12-18T10:22:54.307 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 1099511627778, 2023-12-18T10:22:54.307 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3" 2023-12-18T10:22:54.307 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:22:54.307 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:22:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 -- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82a0065a60 msgr2=0x7f82a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82a0065a60 0x7f82a0067f20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f82a4001db0 tx=0x7f82a4000f80 comp rx=0 tx=0).stop 2023-12-18T10:22:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 -- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b40c76c0 msgr2=0x7f82b40c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b40c76c0 0x7f82b40c7b40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f82b40d16f0 tx=0x7f82ac00f580 comp rx=0 tx=0).stop 2023-12-18T10:22:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 -- 172.21.15.133:0/2250875489 shutdown_connections 2023-12-18T10:22:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82a0065a60 0x7f82a0067f20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82b40c76c0 0x7f82b40c7b40 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82b406ddd0 0x7f82b406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 --2- 172.21.15.133:0/2250875489 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f829c003f30 0x7f82b40b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 -- 172.21.15.133:0/2250875489 >> 172.21.15.133:0/2250875489 conn(0x7f82b40cd070 msgr2=0x7f82b40b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 -- 172.21.15.133:0/2250875489 shutdown_connections 2023-12-18T10:22:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.298+0000 7f82ba36d640 1 -- 172.21.15.133:0/2250875489 wait complete. 2023-12-18T10:22:54.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 damage ls 2023-12-18T10:22:54.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.454+0000 7fee09c41640 1 Processor -- start 2023-12-18T10:22:54.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee09c41640 1 -- start start 2023-12-18T10:22:54.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee09c41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 0x7fee04159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee09c41640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee04159fb0 0x7fee04071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee09c41640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee04070df0 con 0x7fee04071db0 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee09c41640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0415aab0 con 0x7fee04159fb0 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee09c41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0415a4f0 con 0x7fee040ca410 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee02ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee04159fb0 0x7fee04071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee02ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee04159fb0 0x7fee04071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59008/0 (socket says 172.21.15.133:59008) 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee02ffd640 1 -- 172.21.15.133:0/1936770613 learned_addr learned my addr 172.21.15.133:0/1936770613 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee03fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fee04071db0 0x7fee040cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59724/0 (socket says 172.21.15.133:59724) 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee037fe640 1 --2- 172.21.15.133:0/1936770613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 0x7fee04159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee02ffd640 1 -- 172.21.15.133:0/1936770613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 msgr2=0x7fee04159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee02ffd640 1 --2- 172.21.15.133:0/1936770613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 0x7fee04159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee02ffd640 1 -- 172.21.15.133:0/1936770613 >> v1:172.21.15.133:6789/0 conn(0x7fee04071db0 legacy=0x7fee040cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee02ffd640 1 -- 172.21.15.133:0/1936770613 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0415a7d0 con 0x7fee04159fb0 2023-12-18T10:22:54.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.458+0000 7fee027fc640 1 -- 172.21.15.133:0/1936770613 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557237909 0 0) 0x7fee04070df0 con 0x7fee04071db0 2023-12-18T10:22:54.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee02ffd640 1 --2- 172.21.15.133:0/1936770613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04159fb0 0x7fee04071870 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009870 tx=0x7fedf801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42be020285f52748 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee027fc640 1 -- 172.21.15.133:0/1936770613 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf80aa670 con 0x7fee04159fb0 2023-12-18T10:22:54.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee027fc640 1 -- 172.21.15.133:0/1936770613 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf80aa7d0 con 0x7fee04159fb0 2023-12-18T10:22:54.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee027fc640 1 -- 172.21.15.133:0/1936770613 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf80aab60 con 0x7fee04159fb0 2023-12-18T10:22:54.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 -- 172.21.15.133:0/1936770613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04159fb0 msgr2=0x7fee04071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 --2- 172.21.15.133:0/1936770613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04159fb0 0x7fee04071870 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009870 tx=0x7fedf801c510 comp rx=0 tx=0).stop 2023-12-18T10:22:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 -- 172.21.15.133:0/1936770613 shutdown_connections 2023-12-18T10:22:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 --2- 172.21.15.133:0/1936770613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04159fb0 0x7fee04071870 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 --2- 172.21.15.133:0/1936770613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 0x7fee04159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 -- 172.21.15.133:0/1936770613 >> 172.21.15.133:0/1936770613 conn(0x7fee0406a2a0 msgr2=0x7fee040aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 -- 172.21.15.133:0/1936770613 shutdown_connections 2023-12-18T10:22:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 -- 172.21.15.133:0/1936770613 wait complete. 2023-12-18T10:22:54.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 Processor -- start 2023-12-18T10:22:54.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.462+0000 7fee09c41640 1 -- start start 2023-12-18T10:22:54.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee09c41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04071db0 0x7fee04158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee09c41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 0x7fee040c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee09c41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee04159fb0 0x7fee040c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee09c41640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040c8500 con 0x7fee04071db0 2023-12-18T10:22:54.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee09c41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040c8220 con 0x7fee04159fb0 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee09c41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee04158140 con 0x7fee040ca410 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04071db0 0x7fee04158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04071db0 0x7fee04158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59016/0 (socket says 172.21.15.133:59016) 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 -- 172.21.15.133:0/1641750725 learned_addr learned my addr 172.21.15.133:0/1641750725 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee02ffd640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 0x7fee040c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee03fff640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee04159fb0 0x7fee040c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 -- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 msgr2=0x7fee040c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 0x7fee040c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 -- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee04159fb0 msgr2=0x7fee040c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee04159fb0 0x7fee040c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 -- 172.21.15.133:0/1641750725 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80094d0 con 0x7fee04071db0 2023-12-18T10:22:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee03fff640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee04159fb0 0x7fee040c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee037fe640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04071db0 0x7fee04158c20 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fedf400e930 tx=0x7fedf400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fedebfff640 1 -- 172.21.15.133:0/1641750725 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4009690 con 0x7fee04071db0 2023-12-18T10:22:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fedebfff640 1 -- 172.21.15.133:0/1641750725 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf400ca00 con 0x7fee04071db0 2023-12-18T10:22:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fedebfff640 1 -- 172.21.15.133:0/1641750725 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400cd70 con 0x7fee04071db0 2023-12-18T10:22:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee09c41640 1 -- 172.21.15.133:0/1641750725 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee04158420 con 0x7fee04071db0 2023-12-18T10:22:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fee09c41640 1 -- 172.21.15.133:0/1641750725 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee040c7e40 con 0x7fee04071db0 2023-12-18T10:22:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.466+0000 7fedebfff640 1 -- 172.21.15.133:0/1641750725 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fedf4013470 con 0x7fee04071db0 2023-12-18T10:22:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fedebfff640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fedf0065a60 0x7fedf0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fedebfff640 1 -- 172.21.15.133:0/1641750725 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fedf4083640 con 0x7fee04071db0 2023-12-18T10:22:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee02ffd640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fedf0065a60 0x7fedf0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee0cfa8000 1 Processor -- start 2023-12-18T10:22:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee0cfa8000 1 -- start start 2023-12-18T10:22:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee02ffd640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fedf0065a60 0x7fedf0067f20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fedf80ae000 tx=0x7fedf80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5ec90 0x562bd4e5f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5f5b0 0x562bd4e14ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4e153f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd4cdcde0 con 0x562bd4e15010 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c6b430 con 0x562bd4e5ec90 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c68a00 con 0x562bd4e5f5b0 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4e153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4e153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59022/0 (socket says 172.21.15.133:59022) 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 -- 172.21.15.133:0/3634194879 learned_addr learned my addr 172.21.15.133:0/3634194879 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee037fe640 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5ec90 0x562bd4e5f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee02ffd640 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5f5b0 0x562bd4e14ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 -- 172.21.15.133:0/3634194879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5f5b0 msgr2=0x562bd4e14ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5f5b0 0x562bd4e14ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 -- 172.21.15.133:0/3634194879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5ec90 msgr2=0x562bd4e5f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5ec90 0x562bd4e5f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 -- 172.21.15.133:0/3634194879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bd4c05190 con 0x562bd4e15010 2023-12-18T10:22:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fee03fff640 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4e153f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0074a0 tx=0x7fedfc007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6767e99d9096d257 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fede9ffb640 1 -- 172.21.15.133:0/3634194879 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc001d90 con 0x562bd4e15010 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fede9ffb640 1 -- 172.21.15.133:0/3634194879 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc001ef0 con 0x562bd4e15010 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.470+0000 7fede9ffb640 1 -- 172.21.15.133:0/3634194879 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc014480 con 0x562bd4e15010 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- 172.21.15.133:0/3634194879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 msgr2=0x562bd4e153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4e153f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0074a0 tx=0x7fedfc007960 comp rx=0 tx=0).stop 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- 172.21.15.133:0/3634194879 shutdown_connections 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4e153f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5f5b0 0x562bd4e14ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/3634194879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5ec90 0x562bd4e5f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- 172.21.15.133:0/3634194879 >> 172.21.15.133:0/3634194879 conn(0x562bd4e10fc0 msgr2=0x562bd4e133b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- 172.21.15.133:0/3634194879 shutdown_connections 2023-12-18T10:22:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- 172.21.15.133:0/3634194879 wait complete. 2023-12-18T10:22:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- start start 2023-12-18T10:22:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 Processor -- start 2023-12-18T10:22:54.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e15010 0x562bd4e1a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4e20a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e5f5b0 0x562bd4e20fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c642f0 con 0x562bd4e5f5b0 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c03620 con 0x562bd4e15010 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c21840 con 0x562bd4e5ec90 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 10 client.0 _ll_register_callbacks cb 0x562bd4c581b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e5f5b0 0x562bd4e20fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e5f5b0 0x562bd4e20fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59032/0 (socket says 172.21.15.133:59032) 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 -- 172.21.15.133:0/284015371 learned_addr learned my addr 172.21.15.133:0/284015371 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee037fe640 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e15010 0x562bd4e1a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee02ffd640 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4e20a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 -- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 msgr2=0x562bd4e20a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4e20a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 -- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e15010 msgr2=0x562bd4e1a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e15010 0x562bd4e1a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 -- 172.21.15.133:0/284015371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc00f040 con 0x562bd4e5f5b0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee02ffd640 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4e20a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee03fff640 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e5f5b0 0x562bd4e20fd0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fedfc017040 tx=0x7fedfc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50ee0e95367fb71 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fede27fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fede27fc640 1 -- 172.21.15.133:0/284015371 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc014690 con 0x562bd4e5f5b0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fede27fc640 1 -- 172.21.15.133:0/284015371 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fedfc0147f0 con 0x562bd4e5f5b0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- 172.21.15.133:0/284015371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bd4c283d0 con 0x562bd4e5f5b0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fede27fc640 1 -- 172.21.15.133:0/284015371 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedfc0149b0 con 0x562bd4e5f5b0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 10 client.7329 fetch_fsmap learned FSMap version 60 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.474+0000 7fee0cfa8000 1 -- 172.21.15.133:0/284015371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x562bd4960e20 con 0x562bd4e5f5b0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fede27fc640 1 -- 172.21.15.133:0/284015371 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562bd4c283d0 con 0x562bd4e5f5b0 2023-12-18T10:22:54.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fede27fc640 1 -- 172.21.15.133:0/284015371 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fedfc014b10 con 0x562bd4e5f5b0 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 10 client.7329 fetch_fsmap finished waiting for FSMap version 60 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 10 client.7329 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 20 client.7329 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x562bd4e664f0 0x562bd4e66900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 4 client.7329 mds_command: new command op to 6861 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 -- 172.21.15.133:0/284015371 --> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bd4c62c40 con 0x562bd4e664f0 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee037fe640 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x562bd4e664f0 0x562bd4e66900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fede27fc640 10 client.7329 ms_handle_connect on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee037fe640 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x562bd4e664f0 0x562bd4e66900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2459fee78f74ce01 server_cookie=3cbb8f5f0895d00e in_seq=0 out_seq=0 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fede27fc640 1 -- 172.21.15.133:0/284015371 <== mds.1 v2:172.21.15.133:6834/995027883 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x562bd4c62c40 con 0x562bd4e664f0 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fede27fc640 10 client.7329 handle_command_reply: tid=0 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 client.7329 shutdown 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 -- 172.21.15.133:0/284015371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e5f5b0 msgr2=0x562bd4e20fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e5f5b0 0x562bd4e20fd0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fedfc017040 tx=0x7fedfc011000 comp rx=0 tx=0).stop 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 -- 172.21.15.133:0/284015371 shutdown_connections 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x562bd4e664f0 0x562bd4e66900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e5f5b0 0x562bd4e20fd0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fede27fc640 0 client.7329 ms_handle_reset on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4e20a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/284015371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e15010 0x562bd4e1a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 -- 172.21.15.133:0/284015371 >> 172.21.15.133:0/284015371 conn(0x562bd4e10fc0 msgr2=0x562bd4e13c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 -- 172.21.15.133:0/284015371 shutdown_connections 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 1 -- 172.21.15.133:0/284015371 wait complete. 2023-12-18T10:22:54.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.478+0000 7fee0cfa8000 20 client.7329 trim_cache size 0 max 16384 2023-12-18T10:22:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 Processor -- start 2023-12-18T10:22:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- start start 2023-12-18T10:22:54.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4eb6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4eb7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 0x562bd4eb7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd4921aa0 con 0x562bd4e15010 2023-12-18T10:22:54.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c5fc60 con 0x562bd4e5f5b0 2023-12-18T10:22:54.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c616f0 con 0x562bd4e5ec90 2023-12-18T10:22:54.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4eb6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4eb6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59042/0 (socket says 172.21.15.133:59042) 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 -- 172.21.15.133:0/814250567 learned_addr learned my addr 172.21.15.133:0/814250567 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee03fff640 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 0x562bd4eb7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee02ffd640 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4eb7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 -- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 msgr2=0x562bd4eb7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4eb7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 -- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 msgr2=0x562bd4eb7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 0x562bd4eb7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 -- 172.21.15.133:0/814250567 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bd4c29220 con 0x562bd4e15010 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee02ffd640 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4eb7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee037fe640 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4eb6af0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fedf40548c0 tx=0x7fedf4083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e91a4a93d6729b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fedea7fc640 1 -- 172.21.15.133:0/814250567 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4052dc0 con 0x562bd4e15010 2023-12-18T10:22:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fedea7fc640 1 -- 172.21.15.133:0/814250567 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf4052f60 con 0x562bd4e15010 2023-12-18T10:22:54.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fedea7fc640 1 -- 172.21.15.133:0/814250567 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf405c660 con 0x562bd4e15010 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- 172.21.15.133:0/814250567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 msgr2=0x562bd4eb6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4eb6af0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fedf40548c0 tx=0x7fedf4083040 comp rx=0 tx=0).stop 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- 172.21.15.133:0/814250567 shutdown_connections 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 0x562bd4eb7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4eb7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/814250567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4eb6af0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- 172.21.15.133:0/814250567 >> 172.21.15.133:0/814250567 conn(0x562bd4e10fc0 msgr2=0x562bd4e20950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- 172.21.15.133:0/814250567 shutdown_connections 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- 172.21.15.133:0/814250567 wait complete. 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.490+0000 7fee0cfa8000 1 -- start start 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 Processor -- start 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4ebc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4ebc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 0x562bd4e71840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd4e189c0 con 0x562bd4e15010 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c013b0 con 0x562bd4e5f5b0 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bd4c682f0 con 0x562bd4e5ec90 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 10 client.0 _ll_register_callbacks cb 0x562bd4de0e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4ebc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4ebc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59044/0 (socket says 172.21.15.133:59044) 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 -- 172.21.15.133:0/483346159 learned_addr learned my addr 172.21.15.133:0/483346159 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee03fff640 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 0x562bd4e71840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee02ffd640 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4ebc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 -- 172.21.15.133:0/483346159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 msgr2=0x562bd4ebc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4ebc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 -- 172.21.15.133:0/483346159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 msgr2=0x562bd4e71840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 0x562bd4e71840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 -- 172.21.15.133:0/483346159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee040c7e40 con 0x562bd4e15010 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee037fe640 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4ebc1b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fedf400e900 tx=0x7fedfc009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dba9137106efd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 1 -- 172.21.15.133:0/483346159 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf405c860 con 0x562bd4e15010 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 1 -- 172.21.15.133:0/483346159 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fedf401dcd0 con 0x562bd4e15010 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- 172.21.15.133:0/483346159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bd4c13ca0 con 0x562bd4e15010 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 1 -- 172.21.15.133:0/483346159 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedf401de90 con 0x562bd4e15010 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 10 client.7335 fetch_fsmap learned FSMap version 60 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- 172.21.15.133:0/483346159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x562bd4c0f570 con 0x562bd4e15010 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 1 -- 172.21.15.133:0/483346159 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf407a020 con 0x562bd4e15010 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 1 -- 172.21.15.133:0/483346159 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fedf406e070 con 0x562bd4e15010 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 10 client.7335 fetch_fsmap finished waiting for FSMap version 60 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 10 client.7335 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2023-12-18T10:22:54.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 20 client.7335 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x562bd4e71d80 0x562bd4e72190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 4 client.7335 mds_command: new command op to 6861 tid=0[{"prefix": "damage ls"}] 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- 172.21.15.133:0/483346159 --> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562bd4c5d370 con 0x562bd4e71d80 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee02ffd640 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x562bd4e71d80 0x562bd4e72190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 10 client.7335 ms_handle_connect on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee02ffd640 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x562bd4e71d80 0x562bd4e72190 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cae18bea8fced1e1 server_cookie=6ad4da0f4d1e6b29 in_seq=0 out_seq=0 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 1 -- 172.21.15.133:0/483346159 <== mds.1 v2:172.21.15.133:6834/995027883 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x562bd4c5d370 con 0x562bd4e71d80 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 10 client.7335 handle_command_reply: tid=0 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 client.7335 shutdown 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- 172.21.15.133:0/483346159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 msgr2=0x562bd4ebc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4ebc1b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fedf400e900 tx=0x7fedfc009030 comp rx=0 tx=0).stop 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- 172.21.15.133:0/483346159 shutdown_connections 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.133:6834/995027883,v1:172.21.15.133:6836/995027883] conn(0x562bd4e71d80 0x562bd4e72190 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562bd4e5f5b0 0x562bd4e71840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562bd4e5ec90 0x562bd4ebc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 --2- 172.21.15.133:0/483346159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562bd4e15010 0x562bd4ebc1b0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fede27fc640 0 client.7335 ms_handle_reset on v2:172.21.15.133:6834/995027883 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- 172.21.15.133:0/483346159 >> 172.21.15.133:0/483346159 conn(0x562bd4e10fc0 msgr2=0x562bd4e5da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.494+0000 7fee0cfa8000 1 -- 172.21.15.133:0/483346159 shutdown_connections 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee0cfa8000 1 -- 172.21.15.133:0/483346159 wait complete. 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee0cfa8000 20 client.7335 trim_cache size 0 max 16384 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:22:54.505 INFO:teuthology.orchestra.run.smithi133.stdout: "damage_type": "backtrace", 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 3259321344, 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 1099511627780, 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3/d4/d5" 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: "damage_type": "backtrace", 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 3460482945, 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 1099511627781, 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3/d4/d5/d6" 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:22:54.506 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:22:54.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 -- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fedf0065a60 msgr2=0x7fedf0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fedf0065a60 0x7fedf0067f20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fedf80ae000 tx=0x7fedf80a7000 comp rx=0 tx=0).stop 2023-12-18T10:22:54.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 -- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04071db0 msgr2=0x7fee04158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04071db0 0x7fee04158c20 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fedf400e930 tx=0x7fedf400edf0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 -- 172.21.15.133:0/1641750725 shutdown_connections 2023-12-18T10:22:54.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fedf0065a60 0x7fedf0067f20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee04159fb0 0x7fee040c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee040ca410 0x7fee040c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 --2- 172.21.15.133:0/1641750725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee04071db0 0x7fee04158c20 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 -- 172.21.15.133:0/1641750725 >> 172.21.15.133:0/1641750725 conn(0x7fee0406a2a0 msgr2=0x7fee040c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 -- 172.21.15.133:0/1641750725 shutdown_connections 2023-12-18T10:22:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.498+0000 7fee09c41640 1 -- 172.21.15.133:0/1641750725 wait complete. 2023-12-18T10:22:54.520 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 damage ls 2023-12-18T10:22:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9432d5a640 1 Processor -- start 2023-12-18T10:22:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9432d5a640 1 -- start start 2023-12-18T10:22:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9432d5a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f942c06c410 0x7f942c071a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9432d5a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942c165760 con 0x7f942c160da0 2023-12-18T10:22:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9432d5a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942c06cb60 con 0x7f942c1609c0 2023-12-18T10:22:54.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9432d5a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942c0cac20 con 0x7f942c06c410 2023-12-18T10:22:54.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9431557640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f942c06c410 0x7f942c071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9432559640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f942c160da0 0x7f942c0cd450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59734/0 (socket says 172.21.15.133:59734) 2023-12-18T10:22:54.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.654+0000 7f9432559640 1 -- 172.21.15.133:0/301380040 learned_addr learned my addr 172.21.15.133:0/301380040 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:54.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9430d56640 1 -- 172.21.15.133:0/301380040 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207206098 0 0) 0x7f942c165760 con 0x7f942c160da0 2023-12-18T10:22:54.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9430d56640 1 -- 172.21.15.133:0/301380040 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9418003530 con 0x7f942c160da0 2023-12-18T10:22:54.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9431557640 1 -- 172.21.15.133:0/301380040 >> v1:172.21.15.142:6789/0 conn(0x7f942c1609c0 legacy=0x7f942c06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9431557640 1 -- 172.21.15.133:0/301380040 >> v1:172.21.15.133:6789/0 conn(0x7f942c160da0 legacy=0x7f942c0cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9431557640 1 -- 172.21.15.133:0/301380040 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0b12c0 con 0x7f942c06c410 2023-12-18T10:22:54.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9431557640 1 --2- 172.21.15.133:0/301380040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c071a90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f941c0097f0 tx=0x7f941c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5c723fb53244e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9430d56640 1 -- 172.21.15.133:0/301380040 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0ab600 con 0x7f942c06c410 2023-12-18T10:22:54.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9430d56640 1 -- 172.21.15.133:0/301380040 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c0a7050 con 0x7f942c06c410 2023-12-18T10:22:54.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.658+0000 7f9430d56640 1 -- 172.21.15.133:0/301380040 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0ab980 con 0x7f942c06c410 2023-12-18T10:22:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- 172.21.15.133:0/301380040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 msgr2=0x7f942c071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 --2- 172.21.15.133:0/301380040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c071a90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f941c0097f0 tx=0x7f941c01c360 comp rx=0 tx=0).stop 2023-12-18T10:22:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- 172.21.15.133:0/301380040 shutdown_connections 2023-12-18T10:22:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 --2- 172.21.15.133:0/301380040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c071a90 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- 172.21.15.133:0/301380040 >> 172.21.15.133:0/301380040 conn(0x7f942c06d8d0 msgr2=0x7f942c069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- 172.21.15.133:0/301380040 shutdown_connections 2023-12-18T10:22:54.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- 172.21.15.133:0/301380040 wait complete. 2023-12-18T10:22:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 Processor -- start 2023-12-18T10:22:54.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- start start 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c1609c0 0x7f942c14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f942c160da0 0x7f942c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0af7f0 con 0x7f942c06c410 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c14dbf0 con 0x7f942c1609c0 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432d5a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c14d630 con 0x7f942c160da0 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c148b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59070/0 (socket says 172.21.15.133:59070) 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 -- 172.21.15.133:0/3589086803 learned_addr learned my addr 172.21.15.133:0/3589086803 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431557640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c1609c0 0x7f942c14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9432559640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f942c160da0 0x7f942c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 -- 172.21.15.133:0/3589086803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f942c160da0 msgr2=0x7f942c153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f942c160da0 0x7f942c153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 -- 172.21.15.133:0/3589086803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c1609c0 msgr2=0x7f942c14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c1609c0 0x7f942c14cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 -- 172.21.15.133:0/3589086803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c009420 con 0x7f942c06c410 2023-12-18T10:22:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.662+0000 7f9431d58640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c148b90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f942800c530 tx=0x7f942800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f94227fc640 1 -- 172.21.15.133:0/3589086803 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428005220 con 0x7f942c06c410 2023-12-18T10:22:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f94227fc640 1 -- 172.21.15.133:0/3589086803 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9428005380 con 0x7f942c06c410 2023-12-18T10:22:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f9432d5a640 1 -- 172.21.15.133:0/3589086803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c14d910 con 0x7f942c06c410 2023-12-18T10:22:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f94227fc640 1 -- 172.21.15.133:0/3589086803 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428007270 con 0x7f942c06c410 2023-12-18T10:22:54.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f9432d5a640 1 -- 172.21.15.133:0/3589086803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c149460 con 0x7f942c06c410 2023-12-18T10:22:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f94227fc640 1 -- 172.21.15.133:0/3589086803 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f94280073d0 con 0x7f942c06c410 2023-12-18T10:22:54.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f94227fc640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9410065a60 0x7f9410067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f94227fc640 1 -- 172.21.15.133:0/3589086803 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f9428082bc0 con 0x7f942c06c410 2023-12-18T10:22:54.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f9431557640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9410065a60 0x7f9410067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.666+0000 7f9437316000 1 Processor -- start 2023-12-18T10:22:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- start start 2023-12-18T10:22:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9410065a60 0x7f9410067f20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f941c0ad000 tx=0x7f941c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc852070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc8525b0 0x5620cc807ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc8083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620cc6cfde0 con 0x5620cc8525b0 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620cc65e430 con 0x5620cc851c90 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620cc65ba00 con 0x5620cc808010 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc8525b0 0x5620cc807ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc8525b0 0x5620cc807ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59078/0 (socket says 172.21.15.133:59078) 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 -- 172.21.15.133:0/1267498637 learned_addr learned my addr 172.21.15.133:0/1267498637 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431d58640 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc852070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9432559640 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc8083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 -- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 msgr2=0x5620cc8083f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc8083f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 -- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 msgr2=0x5620cc852070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc852070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 -- 172.21.15.133:0/1267498637 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620cc5f8190 con 0x5620cc8525b0 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9432559640 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc8083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9431557640 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc8525b0 0x5620cc807ad0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f941c0b8040 tx=0x7f941c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b02ccf61dce26b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f940f7fe640 1 -- 172.21.15.133:0/1267498637 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0b6480 con 0x5620cc8525b0 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f940f7fe640 1 -- 172.21.15.133:0/1267498637 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c0bd040 con 0x5620cc8525b0 2023-12-18T10:22:54.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f940f7fe640 1 -- 172.21.15.133:0/1267498637 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0b67e0 con 0x5620cc8525b0 2023-12-18T10:22:54.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- 172.21.15.133:0/1267498637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc8525b0 msgr2=0x5620cc807ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc8525b0 0x5620cc807ad0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f941c0b8040 tx=0x7f941c004740 comp rx=0 tx=0).stop 2023-12-18T10:22:54.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- 172.21.15.133:0/1267498637 shutdown_connections 2023-12-18T10:22:54.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc8083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc8525b0 0x5620cc807ad0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 --2- 172.21.15.133:0/1267498637 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc852070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- 172.21.15.133:0/1267498637 >> 172.21.15.133:0/1267498637 conn(0x5620cc803fc0 msgr2=0x5620cc8063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- 172.21.15.133:0/1267498637 shutdown_connections 2023-12-18T10:22:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- 172.21.15.133:0/1267498637 wait complete. 2023-12-18T10:22:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.670+0000 7f9437316000 1 -- start start 2023-12-18T10:22:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 Processor -- start 2023-12-18T10:22:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc858ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc851c90 0x5620cc859530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc8525b0 0x5620cc812a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620cc6572f0 con 0x5620cc851c90 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620cc5f6620 con 0x5620cc8525b0 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620cc614840 con 0x5620cc808010 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 10 client.0 _ll_register_callbacks cb 0x5620cc64b1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc851c90 0x5620cc859530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc851c90 0x5620cc859530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59086/0 (socket says 172.21.15.133:59086) 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 -- 172.21.15.133:0/984661053 learned_addr learned my addr 172.21.15.133:0/984661053 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431d58640 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc858ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9432559640 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc8525b0 0x5620cc812a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 -- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 msgr2=0x5620cc858ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc858ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 -- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc8525b0 msgr2=0x5620cc812a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc8525b0 0x5620cc812a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 -- 172.21.15.133:0/984661053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c0b12c0 con 0x5620cc851c90 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431557640 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc851c90 0x5620cc859530 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f941c0b8040 tx=0x7f941c01aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46a1924518ba7f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f940cff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f940cff9640 1 -- 172.21.15.133:0/984661053 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0b6cb0 con 0x5620cc851c90 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f940cff9640 1 -- 172.21.15.133:0/984661053 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f941c0b6e10 con 0x5620cc851c90 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 -- 172.21.15.133:0/984661053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620cc61b3d0 con 0x5620cc851c90 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f940cff9640 1 -- 172.21.15.133:0/984661053 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f941c0cc420 con 0x5620cc851c90 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 10 client.7350 fetch_fsmap learned FSMap version 60 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 -- 172.21.15.133:0/984661053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5620cc353e20 con 0x5620cc851c90 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f940cff9640 1 -- 172.21.15.133:0/984661053 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5620cc61b3d0 con 0x5620cc851c90 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f940cff9640 1 -- 172.21.15.133:0/984661053 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f941c0c0070 con 0x5620cc851c90 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 10 client.7350 fetch_fsmap finished waiting for FSMap version 60 2023-12-18T10:22:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 10 client.7350 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.d 2023-12-18T10:22:54.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 20 client.7350 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:54.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x5620cc8137e0 0x5620cc813bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 4 client.7350 mds_command: new command op to 6505 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:22:54.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9437316000 1 -- 172.21.15.133:0/984661053 --> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620cc655c40 con 0x5620cc8137e0 2023-12-18T10:22:54.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.674+0000 7f9431d58640 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x5620cc8137e0 0x5620cc813bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9431d58640 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x5620cc8137e0 0x5620cc813bc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbbbf75213e7d52c server_cookie=35e018f53f8d9207 in_seq=0 out_seq=0 2023-12-18T10:22:54.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f940cff9640 10 client.7350 ms_handle_connect on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f940cff9640 1 -- 172.21.15.133:0/984661053 <== mds.2 v2:172.21.15.142:6833/3664781290 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5620cc655c40 con 0x5620cc8137e0 2023-12-18T10:22:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f940cff9640 10 client.7350 handle_command_reply: tid=0 2023-12-18T10:22:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 client.7350 shutdown 2023-12-18T10:22:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 -- 172.21.15.133:0/984661053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc851c90 msgr2=0x5620cc859530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc851c90 0x5620cc859530 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f941c0b8040 tx=0x7f941c01aba0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 -- 172.21.15.133:0/984661053 shutdown_connections 2023-12-18T10:22:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x5620cc8137e0 0x5620cc813bc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc8525b0 0x5620cc812a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc851c90 0x5620cc859530 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f940cff9640 0 client.7350 ms_handle_reset on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 --2- 172.21.15.133:0/984661053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc808010 0x5620cc858ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 -- 172.21.15.133:0/984661053 >> 172.21.15.133:0/984661053 conn(0x5620cc803fc0 msgr2=0x5620cc806c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 -- 172.21.15.133:0/984661053 shutdown_connections 2023-12-18T10:22:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 1 -- 172.21.15.133:0/984661053 wait complete. 2023-12-18T10:22:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.678+0000 7f9437316000 20 client.7350 trim_cache size 0 max 16384 2023-12-18T10:22:54.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 Processor -- start 2023-12-18T10:22:54.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- start start 2023-12-18T10:22:54.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc850fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc8549a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 0x5620cc854ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620cc314aa0 con 0x5620cc808010 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620cc65f6c0 con 0x5620cc851c90 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620cc652c60 con 0x5620cc8525b0 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc850fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc850fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59098/0 (socket says 172.21.15.133:59098) 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 -- 172.21.15.133:0/4113995494 learned_addr learned my addr 172.21.15.133:0/4113995494 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 -- 172.21.15.133:0/4113995494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 msgr2=0x5620cc854ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 --2- 172.21.15.133:0/4113995494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 0x5620cc854ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 -- 172.21.15.133:0/4113995494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 msgr2=0x5620cc8549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 --2- 172.21.15.133:0/4113995494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc8549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 -- 172.21.15.133:0/4113995494 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620cc61c220 con 0x5620cc808010 2023-12-18T10:22:54.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9431d58640 1 --2- 172.21.15.133:0/4113995494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc850fe0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f942800cef0 tx=0x7f9428001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45534faf2bdce34b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f940ffff640 1 -- 172.21.15.133:0/4113995494 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942806f070 con 0x5620cc808010 2023-12-18T10:22:54.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f940ffff640 1 -- 172.21.15.133:0/4113995494 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9428080040 con 0x5620cc808010 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f940ffff640 1 -- 172.21.15.133:0/4113995494 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428057e90 con 0x5620cc808010 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- 172.21.15.133:0/4113995494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 msgr2=0x5620cc850fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 --2- 172.21.15.133:0/4113995494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc850fe0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f942800cef0 tx=0x7f9428001130 comp rx=0 tx=0).stop 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- 172.21.15.133:0/4113995494 shutdown_connections 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 --2- 172.21.15.133:0/4113995494 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 0x5620cc854ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 --2- 172.21.15.133:0/4113995494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc8549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 --2- 172.21.15.133:0/4113995494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc850fe0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- 172.21.15.133:0/4113995494 >> 172.21.15.133:0/4113995494 conn(0x5620cc803fc0 msgr2=0x5620cc8063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- 172.21.15.133:0/4113995494 shutdown_connections 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- 172.21.15.133:0/4113995494 wait complete. 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 -- start start 2023-12-18T10:22:54.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.690+0000 7f9437316000 1 Processor -- start 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc84cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc84d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 0x5620cc84d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620cc7ff440 con 0x5620cc808010 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620cc654b00 con 0x5620cc851c90 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620cc617710 con 0x5620cc8525b0 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 10 client.0 _ll_register_callbacks cb 0x5620cc7d3e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc84cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc84cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59104/0 (socket says 172.21.15.133:59104) 2023-12-18T10:22:54.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 -- 172.21.15.133:0/3094795258 learned_addr learned my addr 172.21.15.133:0/3094795258 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9432559640 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 0x5620cc84d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431557640 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc84d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 -- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 msgr2=0x5620cc84d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 0x5620cc84d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 -- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 msgr2=0x5620cc84d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc84d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 -- 172.21.15.133:0/3094795258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c149460 con 0x5620cc808010 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431d58640 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc84cdd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f9428050560 tx=0x7f941c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e446ec15c752fb01 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 1 -- 172.21.15.133:0/3094795258 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942806f040 con 0x5620cc808010 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 1 -- 172.21.15.133:0/3094795258 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f942807e040 con 0x5620cc808010 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- 172.21.15.133:0/3094795258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620cc606ca0 con 0x5620cc808010 2023-12-18T10:22:54.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 1 -- 172.21.15.133:0/3094795258 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9428057e90 con 0x5620cc808010 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 10 client.7356 fetch_fsmap learned FSMap version 60 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- 172.21.15.133:0/3094795258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5620cc602570 con 0x5620cc808010 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 1 -- 172.21.15.133:0/3094795258 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5620cc606ca0 con 0x5620cc808010 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 1 -- 172.21.15.133:0/3094795258 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f9428019030 con 0x5620cc808010 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 10 client.7356 fetch_fsmap finished waiting for FSMap version 60 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 10 client.7356 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.d 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 20 client.7356 populate_metadata read hostname 'smithi133' 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x5620cc8ab610 0x5620cc84f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 4 client.7356 mds_command: new command op to 6505 tid=0[{"prefix": "damage ls"}] 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- 172.21.15.133:0/3094795258 --> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5620cc650370 con 0x5620cc8ab610 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431557640 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x5620cc8ab610 0x5620cc84f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9431557640 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x5620cc8ab610 0x5620cc84f150 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8f0589812d2c28a server_cookie=2ca5a8cead452849 in_seq=0 out_seq=0 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 10 client.7356 ms_handle_connect on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 1 -- 172.21.15.133:0/3094795258 <== mds.2 v2:172.21.15.142:6833/3664781290 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+295 (crc 0 0 0) 0x5620cc650370 con 0x5620cc8ab610 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 10 client.7356 handle_command_reply: tid=0 2023-12-18T10:22:54.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 client.7356 shutdown 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- 172.21.15.133:0/3094795258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 msgr2=0x5620cc84cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc84cdd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f9428050560 tx=0x7f941c009190 comp rx=0 tx=0).stop 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- 172.21.15.133:0/3094795258 shutdown_connections 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:6833/3664781290,v1:172.21.15.142:6834/3664781290] conn(0x5620cc8ab610 0x5620cc84f150 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5620cc8525b0 0x5620cc84d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5620cc851c90 0x5620cc84d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 --2- 172.21.15.133:0/3094795258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5620cc808010 0x5620cc84cdd0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f940cff9640 0 client.7356 ms_handle_reset on v2:172.21.15.142:6833/3664781290 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.694+0000 7f9437316000 1 -- 172.21.15.133:0/3094795258 >> 172.21.15.133:0/3094795258 conn(0x5620cc803fc0 msgr2=0x5620cc8063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9437316000 1 -- 172.21.15.133:0/3094795258 shutdown_connections 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9437316000 1 -- 172.21.15.133:0/3094795258 wait complete. 2023-12-18T10:22:54.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9437316000 20 client.7356 trim_cache size 0 max 16384 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: "damage_type": "backtrace", 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 825734184, 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 1099511627782, 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7" 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: "damage_type": "backtrace", 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 2768321254, 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: "ino": 1099511627783, 2023-12-18T10:22:54.705 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7/d8" 2023-12-18T10:22:54.706 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:22:54.706 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:22:54.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 -- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9410065a60 msgr2=0x7f9410067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9410065a60 0x7f9410067f20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f941c0ad000 tx=0x7f941c008040 comp rx=0 tx=0).stop 2023-12-18T10:22:54.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 -- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 msgr2=0x7f942c148b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:54.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c148b90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f942800c530 tx=0x7f942800c9f0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 -- 172.21.15.133:0/3589086803 shutdown_connections 2023-12-18T10:22:54.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9410065a60 0x7f9410067f20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f942c160da0 0x7f942c153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f942c1609c0 0x7f942c14cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 --2- 172.21.15.133:0/3589086803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f942c06c410 0x7f942c148b90 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:54.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 -- 172.21.15.133:0/3589086803 >> 172.21.15.133:0/3589086803 conn(0x7f942c06d8d0 msgr2=0x7f942c1551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:54.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 -- 172.21.15.133:0/3589086803 shutdown_connections 2023-12-18T10:22:54.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:54.698+0000 7f9432d5a640 1 -- 172.21.15.133:0/3589086803 wait complete. 2023-12-18T10:22:54.720 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:22:54.720 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:22:54.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:22:54.892 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:22:54.892 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:22:54.892 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:22:54.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:22:55.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90ec241640 1 Processor -- start 2023-12-18T10:22:55.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90ec241640 1 -- start start 2023-12-18T10:22:55.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90ec241640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90e406c4f0 0x7f90e40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90ec241640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e40c9460 con 0x7f90e40c9e30 2023-12-18T10:22:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90ec241640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e41574a0 con 0x7f90e41570c0 2023-12-18T10:22:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90ec241640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e40c8b30 con 0x7f90e406c4f0 2023-12-18T10:22:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90ea7de640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f90e40c9e30 0x7f90e4070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59744/0 (socket says 172.21.15.133:59744) 2023-12-18T10:22:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90ea7de640 1 -- 172.21.15.133:0/3688353134 learned_addr learned my addr 172.21.15.133:0/3688353134 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:55.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90e97dc640 1 --2- 172.21.15.133:0/3688353134 >> v2:172.21.15.142:3300/0 conn(0x7f90e406c4f0 0x7f90e40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165992678 0 0) 0x7f90e40c9460 con 0x7f90e40c9e30 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.082+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d0003530 con 0x7f90e40c9e30 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4165324168 0 0) 0x7f90d0003530 con 0x7f90e40c9e30 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 >> v2:172.21.15.142:3300/0 conn(0x7f90e406c4f0 msgr2=0x7f90e40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 --2- 172.21.15.133:0/3688353134 >> v2:172.21.15.142:3300/0 conn(0x7f90e406c4f0 0x7f90e40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 >> v1:172.21.15.142:6789/0 conn(0x7f90e41570c0 legacy=0x7f90e406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e40c8e10 con 0x7f90e40c9e30 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f90dc001a00 con 0x7f90e40c9e30 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 >> v1:172.21.15.133:6789/0 conn(0x7f90e40c9e30 legacy=0x7f90e4070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d0003980 0x7f90d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d00047d0 0x7f90d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90d000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40c8b30 con 0x7f90d0005190 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0010540 con 0x7f90d0003980 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0010700 con 0x7f90d00047d0 2023-12-18T10:22:55.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90ea7de640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90d000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e9fdd640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d0003980 0x7f90d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90e97dc640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d00047d0 0x7f90d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90ea7de640 1 -- 172.21.15.133:0/3688353134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d00047d0 msgr2=0x7f90d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90ea7de640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d00047d0 0x7f90d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90ea7de640 1 -- 172.21.15.133:0/3688353134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d0003980 msgr2=0x7f90d0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90ea7de640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d0003980 0x7f90d0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90ea7de640 1 -- 172.21.15.133:0/3688353134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0003530 con 0x7f90d0005190 2023-12-18T10:22:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90ea7de640 1 -- 172.21.15.133:0/3688353134 reap_dead start 2023-12-18T10:22:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.086+0000 7f90ea7de640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90d000ffa0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00a830 tx=0x7f90dc01faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6279ddcdd3bbf328 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0aa6d0 con 0x7f90d0005190 2023-12-18T10:22:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc0aa870 con 0x7f90d0005190 2023-12-18T10:22:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90e8fdb640 1 -- 172.21.15.133:0/3688353134 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0aac20 con 0x7f90d0005190 2023-12-18T10:22:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- 172.21.15.133:0/3688353134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 msgr2=0x7f90d000ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90d000ffa0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f90dc00a830 tx=0x7f90dc01faa0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- 172.21.15.133:0/3688353134 shutdown_connections 2023-12-18T10:22:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 --2- 172.21.15.133:0/3688353134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90d000ffa0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- 172.21.15.133:0/3688353134 >> 172.21.15.133:0/3688353134 conn(0x7f90e406a3e0 msgr2=0x7f90e40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- 172.21.15.133:0/3688353134 shutdown_connections 2023-12-18T10:22:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- 172.21.15.133:0/3688353134 wait complete. 2023-12-18T10:22:55.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 Processor -- start 2023-12-18T10:22:55.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- start start 2023-12-18T10:22:55.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90e40c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90e413faf0 0x7f90e40cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90e40c45b0 0x7f90e40c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e413ff70 con 0x7f90d0005190 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40cdc80 con 0x7f90e40c45b0 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90ec241640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e40c4120 con 0x7f90e413faf0 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90e9fdd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90e40c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90e9fdd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90e40c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59120/0 (socket says 172.21.15.133:59120) 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.090+0000 7f90e9fdd640 1 -- 172.21.15.133:0/2496899156 learned_addr learned my addr 172.21.15.133:0/2496899156 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90e97dc640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90e413faf0 0x7f90e40cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90ea7de640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90e40c45b0 0x7f90e40c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90e9fdd640 1 -- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90e413faf0 msgr2=0x7f90e40cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90e9fdd640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90e413faf0 0x7f90e40cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90e9fdd640 1 -- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90e40c45b0 msgr2=0x7f90e40c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90e9fdd640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90e40c45b0 0x7f90e40c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90e9fdd640 1 -- 172.21.15.133:0/2496899156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e40c3550 con 0x7f90d0005190 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90ea7de640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90e40c45b0 0x7f90e40c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90e9fdd640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90e40c0c70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f90e000f7f0 tx=0x7f90e000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90da7fc640 1 -- 172.21.15.133:0/2496899156 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00050d0 con 0x7f90d0005190 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90da7fc640 1 -- 172.21.15.133:0/2496899156 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0005230 con 0x7f90d0005190 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e40cd9e0 con 0x7f90d0005190 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90da7fc640 1 -- 172.21.15.133:0/2496899156 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000d6d0 con 0x7f90d0005190 2023-12-18T10:22:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e40c3ad0 con 0x7f90d0005190 2023-12-18T10:22:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e40735b0 con 0x7f90d0005190 2023-12-18T10:22:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90da7fc640 1 -- 172.21.15.133:0/2496899156 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90e000d830 con 0x7f90d0005190 2023-12-18T10:22:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90da7fc640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f90c8065a90 0x7f90c8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90da7fc640 1 -- 172.21.15.133:0/2496899156 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f90e0083210 con 0x7f90d0005190 2023-12-18T10:22:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.094+0000 7f90e97dc640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f90c8065a90 0x7f90c8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.098+0000 7f90e97dc640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f90c8065a90 0x7f90c8067f50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f90e4152990 tx=0x7f90d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.102+0000 7f90da7fc640 1 -- 172.21.15.133:0/2496899156 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f90e0050960 con 0x7f90d0005190 2023-12-18T10:22:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.250+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90e404e000 con 0x7f90d0005190 2023-12-18T10:22:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90da7fc640 1 -- 172.21.15.133:0/2496899156 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16536 (secure 0 0 0) 0x7f90e0053f80 con 0x7f90d0005190 2023-12-18T10:22:55.258 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:55.258 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:22:47.996890+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:21:46.894515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-18T10:21:47.396141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.11","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:22:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f90c8065a90 msgr2=0x7f90c8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f90c8065a90 0x7f90c8067f50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f90e4152990 tx=0x7f90d4008040 comp rx=0 tx=0).stop 2023-12-18T10:22:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 msgr2=0x7f90e40c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90e40c0c70 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f90e000f7f0 tx=0x7f90e000fcb0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 shutdown_connections 2023-12-18T10:22:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f90c8065a90 0x7f90c8067f50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90e40c45b0 0x7f90e40c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90e413faf0 0x7f90e40cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 --2- 172.21.15.133:0/2496899156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90d0005190 0x7f90e40c0c70 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 >> 172.21.15.133:0/2496899156 conn(0x7f90e406a3e0 msgr2=0x7f90e41508d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 shutdown_connections 2023-12-18T10:22:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.254+0000 7f90ec241640 1 -- 172.21.15.133:0/2496899156 wait complete. 2023-12-18T10:22:55.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:21:46.894515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:21:47.396141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:22:55.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:22:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.414+0000 7f6bf1a73640 1 Processor -- start 2023-12-18T10:22:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.414+0000 7f6bf1a73640 1 -- start start 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bf1a73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec1582d0 0x7f6bec0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bf1a73640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6bec0ce3b0 0x7f6bec0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bf1a73640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bec0c9390 con 0x7f6bec070820 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bf1a73640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bec0ced80 con 0x7f6bec0ce3b0 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bf1a73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec15aee0 con 0x7f6bec1582d0 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bebfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6bec0ce3b0 0x7f6bec0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bebfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6bec0ce3b0 0x7f6bec0ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59130/0 (socket says 172.21.15.133:59130) 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bebfff640 1 -- 172.21.15.133:0/1756702654 learned_addr learned my addr 172.21.15.133:0/1756702654 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:55.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6beb7fe640 1 --2- 172.21.15.133:0/1756702654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec1582d0 0x7f6bec0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bebfff640 1 -- 172.21.15.133:0/1756702654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec1582d0 msgr2=0x7f6bec0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bebfff640 1 --2- 172.21.15.133:0/1756702654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec1582d0 0x7f6bec0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bebfff640 1 -- 172.21.15.133:0/1756702654 >> v1:172.21.15.142:6789/0 conn(0x7f6bec070820 legacy=0x7f6bec0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.418+0000 7f6bebfff640 1 -- 172.21.15.133:0/1756702654 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec15b1c0 con 0x7f6bec0ce3b0 2023-12-18T10:22:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bebfff640 1 --2- 172.21.15.133:0/1756702654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec0ce3b0 0x7f6bec0ce840 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009e50 tx=0x7f6be401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7f30adf2b0e105 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bea7fc640 1 -- 172.21.15.133:0/1756702654 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40a58a0 con 0x7f6bec0ce3b0 2023-12-18T10:22:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bea7fc640 1 -- 172.21.15.133:0/1756702654 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40a5a00 con 0x7f6bec0ce3b0 2023-12-18T10:22:55.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bea7fc640 1 -- 172.21.15.133:0/1756702654 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40a5d90 con 0x7f6bec0ce3b0 2023-12-18T10:22:55.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 -- 172.21.15.133:0/1756702654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec0ce3b0 msgr2=0x7f6bec0ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/1756702654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec0ce3b0 0x7f6bec0ce840 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009e50 tx=0x7f6be401c9e0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 -- 172.21.15.133:0/1756702654 shutdown_connections 2023-12-18T10:22:55.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/1756702654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec0ce3b0 0x7f6bec0ce840 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/1756702654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec1582d0 0x7f6bec0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 -- 172.21.15.133:0/1756702654 >> 172.21.15.133:0/1756702654 conn(0x7f6bec06a2a0 msgr2=0x7f6bec0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:55.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 -- 172.21.15.133:0/1756702654 shutdown_connections 2023-12-18T10:22:55.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 -- 172.21.15.133:0/1756702654 wait complete. 2023-12-18T10:22:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 Processor -- start 2023-12-18T10:22:55.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.422+0000 7f6bf1a73640 1 -- start start 2023-12-18T10:22:55.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec070820 0x7f6bec152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec0ce3b0 0x7f6bec0cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec1582d0 0x7f6bec0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0cc120 con 0x7f6bec1582d0 2023-12-18T10:22:55.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0cc3c0 con 0x7f6bec0ce3b0 2023-12-18T10:22:55.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bec0cc6a0 con 0x7f6bec070820 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec1582d0 0x7f6bec0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec1582d0 0x7f6bec0cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59134/0 (socket says 172.21.15.133:59134) 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 -- 172.21.15.133:0/3456855997 learned_addr learned my addr 172.21.15.133:0/3456855997 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6beaffd640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec0ce3b0 0x7f6bec0cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 -- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec070820 msgr2=0x7f6bec152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6beb7fe640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec070820 0x7f6bec152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec070820 0x7f6bec152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 -- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec0ce3b0 msgr2=0x7f6bec0cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec0ce3b0 0x7f6bec0cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 -- 172.21.15.133:0/3456855997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4009b30 con 0x7f6bec1582d0 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6beaffd640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec0ce3b0 0x7f6bec0cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bebfff640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec1582d0 0x7f6bec0cda50 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6be40af040 tx=0x7f6be4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bd3fff640 1 -- 172.21.15.133:0/3456855997 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40b8670 con 0x7f6bec1582d0 2023-12-18T10:22:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bd3fff640 1 -- 172.21.15.133:0/3456855997 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40b87f0 con 0x7f6bec1582d0 2023-12-18T10:22:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bec0cc980 con 0x7f6bec1582d0 2023-12-18T10:22:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bd3fff640 1 -- 172.21.15.133:0/3456855997 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40b8ba0 con 0x7f6bec1582d0 2023-12-18T10:22:55.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bec153280 con 0x7f6bec1582d0 2023-12-18T10:22:55.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bec04e000 con 0x7f6bec1582d0 2023-12-18T10:22:55.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.426+0000 7f6bd3fff640 1 -- 172.21.15.133:0/3456855997 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6be40b8d00 con 0x7f6bec1582d0 2023-12-18T10:22:55.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.430+0000 7f6bd3fff640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bd8065a60 0x7f6bd8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.430+0000 7f6bd3fff640 1 -- 172.21.15.133:0/3456855997 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f6be411eb70 con 0x7f6bec1582d0 2023-12-18T10:22:55.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.430+0000 7f6beb7fe640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bd8065a60 0x7f6bd8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.430+0000 7f6beb7fe640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bd8065a60 0x7f6bd8067f20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0096f0 tx=0x7f6bdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.434+0000 7f6bd3fff640 1 -- 172.21.15.133:0/3456855997 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6be40ec2d0 con 0x7f6bec1582d0 2023-12-18T10:22:55.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bec0cce30 con 0x7f6bec1582d0 2023-12-18T10:22:55.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bd3fff640 1 -- 172.21.15.133:0/3456855997 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6be40bc020 con 0x7f6bec1582d0 2023-12-18T10:22:55.585 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:22:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bd8065a60 msgr2=0x7f6bd8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bd8065a60 0x7f6bd8067f20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0096f0 tx=0x7f6bdc008040 comp rx=0 tx=0).stop 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec1582d0 msgr2=0x7f6bec0cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec1582d0 0x7f6bec0cda50 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6be40af040 tx=0x7f6be4019780 comp rx=0 tx=0).stop 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 shutdown_connections 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bd8065a60 0x7f6bd8067f20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bec1582d0 0x7f6bec0cda50 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bec0ce3b0 0x7f6bec0cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 --2- 172.21.15.133:0/3456855997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bec070820 0x7f6bec152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 >> 172.21.15.133:0/3456855997 conn(0x7f6bec06a2a0 msgr2=0x7f6bec158980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 shutdown_connections 2023-12-18T10:22:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.582+0000 7f6bf1a73640 1 -- 172.21.15.133:0/3456855997 wait complete. 2023-12-18T10:22:55.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:22:55.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.742+0000 7f55036fc640 1 Processor -- start 2023-12-18T10:22:55.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.742+0000 7f55036fc640 1 -- start start 2023-12-18T10:22:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f55036fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54fc1582d0 0x7f54fc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f55036fc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc0c9390 con 0x7f54fc070820 2023-12-18T10:22:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f55036fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc15aee0 con 0x7f54fc0ce3b0 2023-12-18T10:22:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f55036fc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc15b1c0 con 0x7f54fc1582d0 2023-12-18T10:22:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5500c97640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f54fc070820 0x7f54fc0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59756/0 (socket says 172.21.15.133:59756) 2023-12-18T10:22:55.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5500c97640 1 -- 172.21.15.133:0/1260655791 learned_addr learned my addr 172.21.15.133:0/1260655791 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:55.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5501498640 1 --2- 172.21.15.133:0/1260655791 >> v2:172.21.15.142:3300/0 conn(0x7f54fc1582d0 0x7f54fc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965870282 0 0) 0x7f54fc0c9390 con 0x7f54fc070820 2023-12-18T10:22:55.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e8003530 con 0x7f54fc070820 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876991183 0 0) 0x7f54e8003530 con 0x7f54fc070820 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 >> v2:172.21.15.142:3300/0 conn(0x7f54fc1582d0 msgr2=0x7f54fc0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 --2- 172.21.15.133:0/1260655791 >> v2:172.21.15.142:3300/0 conn(0x7f54fc1582d0 0x7f54fc0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 >> v1:172.21.15.142:6789/0 conn(0x7f54fc0ce3b0 legacy=0x7f54fc0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc15b4a0 con 0x7f54fc070820 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f54ec001680 con 0x7f54fc070820 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 >> v1:172.21.15.133:6789/0 conn(0x7f54fc070820 legacy=0x7f54fc0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e8003980 0x7f54e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e8005190 0x7f54e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc15b1c0 con 0x7f54e80047d0 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e800c030 con 0x7f54e8005190 2023-12-18T10:22:55.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e800c1f0 con 0x7f54e8003980 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5500c97640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5501498640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e8003980 0x7f54e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5501c99640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e8005190 0x7f54e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5500c97640 1 -- 172.21.15.133:0/1260655791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e8003980 msgr2=0x7f54e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5500c97640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54e8003980 0x7f54e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5500c97640 1 -- 172.21.15.133:0/1260655791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e8005190 msgr2=0x7f54e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5500c97640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54e8005190 0x7f54e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5501c99640 1 -- 172.21.15.133:0/1260655791 reap_dead start 2023-12-18T10:22:55.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.746+0000 7f5500c97640 1 -- 172.21.15.133:0/1260655791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e8003530 con 0x7f54e80047d0 2023-12-18T10:22:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f5500c97640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54e8004c50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00c240 tx=0x7f54ec01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fde0f2fd81b020 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec005ae0 con 0x7f54e80047d0 2023-12-18T10:22:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec0ab070 con 0x7f54e80047d0 2023-12-18T10:22:55.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f54f3fff640 1 -- 172.21.15.133:0/1260655791 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec007070 con 0x7f54e80047d0 2023-12-18T10:22:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f55036fc640 1 -- 172.21.15.133:0/1260655791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 msgr2=0x7f54e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f55036fc640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54e8004c50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00c240 tx=0x7f54ec01f3b0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f55036fc640 1 -- 172.21.15.133:0/1260655791 shutdown_connections 2023-12-18T10:22:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f55036fc640 1 --2- 172.21.15.133:0/1260655791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54e8004c50 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f55036fc640 1 -- 172.21.15.133:0/1260655791 >> 172.21.15.133:0/1260655791 conn(0x7f54fc06a2a0 msgr2=0x7f54fc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f55036fc640 1 -- 172.21.15.133:0/1260655791 shutdown_connections 2023-12-18T10:22:55.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f55036fc640 1 -- 172.21.15.133:0/1260655791 wait complete. 2023-12-18T10:22:55.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.750+0000 7f55036fc640 1 Processor -- start 2023-12-18T10:22:55.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 -- start start 2023-12-18T10:22:55.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54fc1f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54fc1f1f00 0x7f54fc0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54fc0c9f90 0x7f54fc0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1f2ef0 con 0x7f54e80047d0 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0ca950 con 0x7f54fc1f1f00 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc1f2380 con 0x7f54fc0c9f90 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54fc1f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54fc1f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59156/0 (socket says 172.21.15.133:59156) 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 -- 172.21.15.133:0/4013160545 learned_addr learned my addr 172.21.15.133:0/4013160545 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5500c97640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54fc1f1f00 0x7f54fc0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501c99640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54fc0c9f90 0x7f54fc0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 -- 172.21.15.133:0/4013160545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54fc0c9f90 msgr2=0x7f54fc0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54fc0c9f90 0x7f54fc0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 -- 172.21.15.133:0/4013160545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54fc1f1f00 msgr2=0x7f54fc0c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54fc1f1f00 0x7f54fc0c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 -- 172.21.15.133:0/4013160545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc1f2650 con 0x7f54e80047d0 2023-12-18T10:22:55.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f5501498640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54fc1f5f50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f54f8011900 tx=0x7f54f8011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f54f1ffb640 1 -- 172.21.15.133:0/4013160545 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80095b0 con 0x7f54e80047d0 2023-12-18T10:22:55.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f54f1ffb640 1 -- 172.21.15.133:0/4013160545 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f8004240 con 0x7f54e80047d0 2023-12-18T10:22:55.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f54f1ffb640 1 -- 172.21.15.133:0/4013160545 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f800f8e0 con 0x7f54e80047d0 2023-12-18T10:22:55.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc1f2930 con 0x7f54e80047d0 2023-12-18T10:22:55.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc1efd30 con 0x7f54e80047d0 2023-12-18T10:22:55.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.754+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc1efb90 con 0x7f54e80047d0 2023-12-18T10:22:55.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.758+0000 7f54f1ffb640 1 -- 172.21.15.133:0/4013160545 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f54f800fa40 con 0x7f54e80047d0 2023-12-18T10:22:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.758+0000 7f54f1ffb640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f54e0065a60 0x7f54e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.758+0000 7f54f1ffb640 1 -- 172.21.15.133:0/4013160545 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f54f8083a30 con 0x7f54e80047d0 2023-12-18T10:22:55.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.758+0000 7f5500c97640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f54e0065a60 0x7f54e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:55.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.758+0000 7f5500c97640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f54e0065a60 0x7f54e0067f20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0af000 tx=0x7f54ec0aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.762+0000 7f54f1ffb640 1 -- 172.21.15.133:0/4013160545 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f54fc1efb90 con 0x7f54e80047d0 2023-12-18T10:22:55.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.910+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54fc1efb90 con 0x7f54e80047d0 2023-12-18T10:22:55.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f54f1ffb640 1 -- 172.21.15.133:0/4013160545 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54f8023020 con 0x7f54e80047d0 2023-12-18T10:22:55.917 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:22:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f54e0065a60 msgr2=0x7f54e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f54e0065a60 0x7f54e0067f20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0af000 tx=0x7f54ec0aa000 comp rx=0 tx=0).stop 2023-12-18T10:22:55.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 msgr2=0x7f54fc1f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54fc1f5f50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f54f8011900 tx=0x7f54f8011dc0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 shutdown_connections 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f54e0065a60 0x7f54e0067f20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54fc0c9f90 0x7f54fc0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54fc1f1f00 0x7f54fc0c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 --2- 172.21.15.133:0/4013160545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80047d0 0x7f54fc1f5f50 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 >> 172.21.15.133:0/4013160545 conn(0x7f54fc06a2a0 msgr2=0x7f54fc0ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 shutdown_connections 2023-12-18T10:22:55.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:55.914+0000 7f55036fc640 1 -- 172.21.15.133:0/4013160545 wait complete. 2023-12-18T10:22:55.938 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:22:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e838f640 1 Processor -- start 2023-12-18T10:22:56.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e838f640 1 -- start start 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e838f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd6e00ca410 0x7fd6e0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e838f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e0070df0 con 0x7fd6e0159fb0 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e838f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e015a4f0 con 0x7fd6e00cbff0 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e838f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e015aab0 con 0x7fd6e00ca410 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e612b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd6e00ca410 0x7fd6e0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e612b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd6e00ca410 0x7fd6e0159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59170/0 (socket says 172.21.15.133:59170) 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e612b640 1 -- 172.21.15.133:0/1211563355 learned_addr learned my addr 172.21.15.133:0/1211563355 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.078+0000 7fd6e592a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd6e0159fb0 0x7fd6e0071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59772/0 (socket says 172.21.15.133:59772) 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e612b640 1 -- 172.21.15.133:0/1211563355 >> v1:172.21.15.142:6789/0 conn(0x7fd6e00cbff0 legacy=0x7fd6e00ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e612b640 1 -- 172.21.15.133:0/1211563355 >> v1:172.21.15.133:6789/0 conn(0x7fd6e0159fb0 legacy=0x7fd6e0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e612b640 1 -- 172.21.15.133:0/1211563355 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e015a7d0 con 0x7fd6e00ca410 2023-12-18T10:22:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e612b640 1 --2- 172.21.15.133:0/1211563355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00ca410 0x7fd6e0159a70 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009870 tx=0x7fd6dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd91d06529cda19b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e5129640 1 -- 172.21.15.133:0/1211563355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0aa670 con 0x7fd6e00ca410 2023-12-18T10:22:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e5129640 1 -- 172.21.15.133:0/1211563355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0aa7d0 con 0x7fd6e00ca410 2023-12-18T10:22:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e5129640 1 -- 172.21.15.133:0/1211563355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0aab60 con 0x7fd6e00ca410 2023-12-18T10:22:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e838f640 1 -- 172.21.15.133:0/1211563355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00ca410 msgr2=0x7fd6e0159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.082+0000 7fd6e838f640 1 --2- 172.21.15.133:0/1211563355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00ca410 0x7fd6e0159a70 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009870 tx=0x7fd6dc01c510 comp rx=0 tx=0).stop 2023-12-18T10:22:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 -- 172.21.15.133:0/1211563355 shutdown_connections 2023-12-18T10:22:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 --2- 172.21.15.133:0/1211563355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00ca410 0x7fd6e0159a70 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 -- 172.21.15.133:0/1211563355 >> 172.21.15.133:0/1211563355 conn(0x7fd6e006a2a0 msgr2=0x7fd6e00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 -- 172.21.15.133:0/1211563355 shutdown_connections 2023-12-18T10:22:56.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 -- 172.21.15.133:0/1211563355 wait complete. 2023-12-18T10:22:56.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 Processor -- start 2023-12-18T10:22:56.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 -- start start 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6e00ca410 0x7fd6e00aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e00cbff0 0x7fd6e00c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e0159fb0 0x7fd6e0145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e0145d40 con 0x7fd6e0159fb0 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00afd00 con 0x7fd6e00cbff0 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e838f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00afa20 con 0x7fd6e00ca410 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e0159fb0 0x7fd6e0145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e0159fb0 0x7fd6e0145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59174/0 (socket says 172.21.15.133:59174) 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 -- 172.21.15.133:0/3580274373 learned_addr learned my addr 172.21.15.133:0/3580274373 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e612b640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6e00ca410 0x7fd6e00aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e592a640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e00cbff0 0x7fd6e00c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 -- 172.21.15.133:0/3580274373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6e00ca410 msgr2=0x7fd6e00aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6e00ca410 0x7fd6e00aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 -- 172.21.15.133:0/3580274373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e00cbff0 msgr2=0x7fd6e00c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e00cbff0 0x7fd6e00c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 -- 172.21.15.133:0/3580274373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0094d0 con 0x7fd6e0159fb0 2023-12-18T10:22:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.086+0000 7fd6e692c640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e0159fb0 0x7fd6e0145800 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c770 tx=0x7fd6d800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6d6ffd640 1 -- 172.21.15.133:0/3580274373 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8003b80 con 0x7fd6e0159fb0 2023-12-18T10:22:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6d6ffd640 1 -- 172.21.15.133:0/3580274373 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d8003ce0 con 0x7fd6e0159fb0 2023-12-18T10:22:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6d6ffd640 1 -- 172.21.15.133:0/3580274373 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800aa90 con 0x7fd6e0159fb0 2023-12-18T10:22:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e00cc960 con 0x7fd6e0159fb0 2023-12-18T10:22:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e00ade50 con 0x7fd6e0159fb0 2023-12-18T10:22:56.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e004e000 con 0x7fd6e0159fb0 2023-12-18T10:22:56.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6d6ffd640 1 -- 172.21.15.133:0/3580274373 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd6d800abf0 con 0x7fd6e0159fb0 2023-12-18T10:22:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6d6ffd640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6c4065a60 0x7fd6c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6d6ffd640 1 -- 172.21.15.133:0/3580274373 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fd6d8082ff0 con 0x7fd6e0159fb0 2023-12-18T10:22:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.090+0000 7fd6e612b640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6c4065a60 0x7fd6c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.094+0000 7fd6e612b640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6c4065a60 0x7fd6c4067f20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0ae000 tx=0x7fd6dc0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:56.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.094+0000 7fd6d6ffd640 1 -- 172.21.15.133:0/3580274373 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd6d80508e0 con 0x7fd6e0159fb0 2023-12-18T10:22:56.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.246+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6e00ca970 con 0x7fd6e0159fb0 2023-12-18T10:22:56.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.246+0000 7fd6d6ffd640 1 -- 172.21.15.133:0/3580274373 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6d8053f00 con 0x7fd6e0159fb0 2023-12-18T10:22:56.253 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:22:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6c4065a60 msgr2=0x7fd6c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6c4065a60 0x7fd6c4067f20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0ae000 tx=0x7fd6dc0b5040 comp rx=0 tx=0).stop 2023-12-18T10:22:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e0159fb0 msgr2=0x7fd6e0145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e0159fb0 0x7fd6e0145800 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c770 tx=0x7fd6d800cc30 comp rx=0 tx=0).stop 2023-12-18T10:22:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 shutdown_connections 2023-12-18T10:22:56.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd6c4065a60 0x7fd6c4067f20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e0159fb0 0x7fd6e0145800 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e00cbff0 0x7fd6e00c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 --2- 172.21.15.133:0/3580274373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6e00ca410 0x7fd6e00aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 >> 172.21.15.133:0/3580274373 conn(0x7fd6e006a2a0 msgr2=0x7fd6e0071870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:56.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 shutdown_connections 2023-12-18T10:22:56.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.250+0000 7fd6e838f640 1 -- 172.21.15.133:0/3580274373 wait complete. 2023-12-18T10:22:56.272 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:22:56.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.406+0000 7f25ba4f9640 1 Processor -- start 2023-12-18T10:22:56.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.406+0000 7f25ba4f9640 1 -- start start 2023-12-18T10:22:56.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25ba4f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25ba4f9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f25b40ca000 0x7f25b4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25ba4f9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40c9460 con 0x7f25b406c320 2023-12-18T10:22:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25ba4f9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b406c7a0 con 0x7f25b40ca000 2023-12-18T10:22:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25ba4f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41574a0 con 0x7f25b41570c0 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b8a96640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f25b40ca000 0x7f25b4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b37fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f25b406c320 0x7f25b40c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:58308/0 (socket says 172.21.15.133:58308) 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b37fe640 1 -- 172.21.15.133:0/3668173330 learned_addr learned my addr 172.21.15.133:0/3668173330 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b2ffd640 1 -- 172.21.15.133:0/3668173330 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912875386 0 0) 0x7f25b40c9460 con 0x7f25b406c320 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b8a96640 1 -- 172.21.15.133:0/3668173330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 msgr2=0x7f25b406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b8a96640 1 --2- 172.21.15.133:0/3668173330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b8a96640 1 -- 172.21.15.133:0/3668173330 >> v1:172.21.15.142:6789/0 conn(0x7f25b406c320 legacy=0x7f25b40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b8a96640 1 -- 172.21.15.133:0/3668173330 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40c8b30 con 0x7f25b40ca000 2023-12-18T10:22:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.410+0000 7f25b3fff640 1 --2- 172.21.15.133:0/3668173330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:56.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25b8a96640 1 --2- 172.21.15.133:0/3668173330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b40ca000 0x7f25b4070df0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00bfa0 tx=0x7f25ac01ea90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bb6f085fff76cff server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:56.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25b2ffd640 1 -- 172.21.15.133:0/3668173330 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac00b2d0 con 0x7f25b40ca000 2023-12-18T10:22:56.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25b2ffd640 1 -- 172.21.15.133:0/3668173330 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0a7960 con 0x7f25b40ca000 2023-12-18T10:22:56.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25b2ffd640 1 -- 172.21.15.133:0/3668173330 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0a7cf0 con 0x7f25b40ca000 2023-12-18T10:22:56.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3668173330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b40ca000 msgr2=0x7f25b4070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3668173330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b40ca000 0x7f25b4070df0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00bfa0 tx=0x7f25ac01ea90 comp rx=0 tx=0).stop 2023-12-18T10:22:56.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3668173330 shutdown_connections 2023-12-18T10:22:56.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3668173330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b40ca000 0x7f25b4070df0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3668173330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3668173330 >> 172.21.15.133:0/3668173330 conn(0x7f25b406a3e0 msgr2=0x7f25b40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:56.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3668173330 shutdown_connections 2023-12-18T10:22:56.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3668173330 wait complete. 2023-12-18T10:22:56.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 Processor -- start 2023-12-18T10:22:56.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 -- start start 2023-12-18T10:22:56.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b406c320 0x7f25b414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b40ca000 0x7f25b40c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.414+0000 7f25ba4f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b40c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25ba4f9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41590d0 con 0x7f25b40ca000 2023-12-18T10:22:56.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25ba4f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41593b0 con 0x7f25b406c320 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25ba4f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4159690 con 0x7f25b41570c0 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b40ca000 0x7f25b40c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b3fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b406c320 0x7f25b414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b40ca000 0x7f25b40c3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59176/0 (socket says 172.21.15.133:59176) 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 -- 172.21.15.133:0/3896854058 learned_addr learned my addr 172.21.15.133:0/3896854058 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b8a96640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b40c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 -- 172.21.15.133:0/3896854058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 msgr2=0x7f25b40c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b40c35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 -- 172.21.15.133:0/3896854058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b406c320 msgr2=0x7f25b414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b406c320 0x7f25b414f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 -- 172.21.15.133:0/3896854058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009420 con 0x7f25b40ca000 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b3fff640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b406c320 0x7f25b414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:56.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b37fe640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b40ca000 0x7f25b40c3070 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f25a80011f0 tx=0x7f25a800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b0ff9640 1 -- 172.21.15.133:0/3896854058 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80074e0 con 0x7f25b40ca000 2023-12-18T10:22:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b0ff9640 1 -- 172.21.15.133:0/3896854058 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a8007640 con 0x7f25b40ca000 2023-12-18T10:22:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b0ff9640 1 -- 172.21.15.133:0/3896854058 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8004a10 con 0x7f25b40ca000 2023-12-18T10:22:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac00bc80 con 0x7f25b40ca000 2023-12-18T10:22:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b4159c50 con 0x7f25b40ca000 2023-12-18T10:22:56.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b40735b0 con 0x7f25b40ca000 2023-12-18T10:22:56.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.418+0000 7f25b0ff9640 1 -- 172.21.15.133:0/3896854058 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f25a8004b70 con 0x7f25b40ca000 2023-12-18T10:22:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.422+0000 7f25b0ff9640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25a0065a60 0x7f25a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.422+0000 7f25b0ff9640 1 -- 172.21.15.133:0/3896854058 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f25a8082530 con 0x7f25b40ca000 2023-12-18T10:22:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.422+0000 7f25b3fff640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25a0065a60 0x7f25a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:56.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.422+0000 7f25b3fff640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25a0065a60 0x7f25a0067f20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f25a4011310 tx=0x7f25a4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:56.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.426+0000 7f25b0ff9640 1 -- 172.21.15.133:0/3896854058 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f25a804fe60 con 0x7f25b40ca000 2023-12-18T10:22:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25b404e000 con 0x7f25b40ca000 2023-12-18T10:22:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25b0ff9640 1 -- 172.21.15.133:0/3896854058 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25a8018080 con 0x7f25b40ca000 2023-12-18T10:22:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:22:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25a0065a60 msgr2=0x7f25a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25a0065a60 0x7f25a0067f20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f25a4011310 tx=0x7f25a4009190 comp rx=0 tx=0).stop 2023-12-18T10:22:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b40ca000 msgr2=0x7f25b40c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b40ca000 0x7f25b40c3070 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f25a80011f0 tx=0x7f25a800c9b0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 shutdown_connections 2023-12-18T10:22:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25a0065a60 0x7f25a0067f20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25b41570c0 0x7f25b40c35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25b40ca000 0x7f25b40c3070 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 --2- 172.21.15.133:0/3896854058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25b406c320 0x7f25b414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 >> 172.21.15.133:0/3896854058 conn(0x7f25b406a3e0 msgr2=0x7f25b41561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 shutdown_connections 2023-12-18T10:22:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:56.586+0000 7f25ba4f9640 1 -- 172.21.15.133:0/3896854058 wait complete. 2023-12-18T10:22:56.610 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:22:56.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:56.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-18T10:22:56.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[54286]: fuse finished with error 0 and tester_r 0 2023-12-18T10:22:56.632 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:22:56.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:56.633 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-18T10:22:56.800 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:22:56.800 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:22:56.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:22:56.810 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:22:56.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:56.810 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-18T10:22:56.865 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-18T10:22:56.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:22:56.869 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:22:56.869 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:22:56.879 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:22:56.879 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:22:56.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:56.879 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-18T10:22:56.927 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-18T10:22:56.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:22:56.929 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:22:56.929 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:22:56.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:22:56.939 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:22:56.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:22:56.939 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-18T10:22:56.994 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-18T10:22:56.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:22:56.995 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:22:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0ec95640 1 Processor -- start 2023-12-18T10:22:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0ec95640 1 -- start start 2023-12-18T10:22:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0ec95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0ec95640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d080ce6d0 con 0x7f3d080ae040 2023-12-18T10:22:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0ec95640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d080cccf0 con 0x7f3d080cdd50 2023-12-18T10:22:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0ec95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080ae420 con 0x7f3d080ca030 2023-12-18T10:22:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0ca31640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3d080ae040 0x7f3d0806cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59776/0 (socket says 172.21.15.133:59776) 2023-12-18T10:22:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0ca31640 1 -- 172.21.15.133:0/187011274 learned_addr learned my addr 172.21.15.133:0/187011274 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0d232640 1 --2- 172.21.15.133:0/187011274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3cff7fe640 1 -- 172.21.15.133:0/187011274 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821140491 0 0) 0x7f3d04001120 con 0x7f3d080ae040 2023-12-18T10:22:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3cff7fe640 1 -- 172.21.15.133:0/187011274 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf0003530 con 0x7f3d080ae040 2023-12-18T10:22:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3cff7fe640 1 -- 172.21.15.133:0/187011274 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550376604 0 0) 0x7f3d080cccf0 con 0x7f3d080cdd50 2023-12-18T10:22:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3cff7fe640 1 -- 172.21.15.133:0/187011274 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d04001120 con 0x7f3d080cdd50 2023-12-18T10:22:57.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0d232640 1 -- 172.21.15.133:0/187011274 >> v1:172.21.15.142:6789/0 conn(0x7f3d080cdd50 legacy=0x7f3d080c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0d232640 1 -- 172.21.15.133:0/187011274 >> v1:172.21.15.133:6789/0 conn(0x7f3d080ae040 legacy=0x7f3d0806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.130+0000 7f3d0d232640 1 -- 172.21.15.133:0/187011274 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d080ccf90 con 0x7f3d080ca030 2023-12-18T10:22:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3d0d232640 1 --2- 172.21.15.133:0/187011274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080ce190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009dc0 tx=0x7f3d0001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95c4376e3317f69c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3cff7fe640 1 -- 172.21.15.133:0/187011274 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000a5a00 con 0x7f3d080ca030 2023-12-18T10:22:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3cff7fe640 1 -- 172.21.15.133:0/187011274 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d000a5b60 con 0x7f3d080ca030 2023-12-18T10:22:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3cff7fe640 1 -- 172.21.15.133:0/187011274 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000ad440 con 0x7f3d080ca030 2023-12-18T10:22:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3d0ec95640 1 -- 172.21.15.133:0/187011274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 msgr2=0x7f3d080ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3d0ec95640 1 --2- 172.21.15.133:0/187011274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080ce190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009dc0 tx=0x7f3d0001c940 comp rx=0 tx=0).stop 2023-12-18T10:22:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3d0ec95640 1 -- 172.21.15.133:0/187011274 shutdown_connections 2023-12-18T10:22:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3d0ec95640 1 --2- 172.21.15.133:0/187011274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080ce190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3d0ec95640 1 -- 172.21.15.133:0/187011274 >> 172.21.15.133:0/187011274 conn(0x7f3d080cb610 msgr2=0x7f3d080cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3d0ec95640 1 -- 172.21.15.133:0/187011274 shutdown_connections 2023-12-18T10:22:57.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.134+0000 7f3d0ec95640 1 -- 172.21.15.133:0/187011274 wait complete. 2023-12-18T10:22:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 Processor -- start 2023-12-18T10:22:57.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 -- start start 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d080ae040 0x7f3d080b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d080cdd50 0x7f3d080b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0814e8d0 con 0x7f3d080ae040 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d081552d0 con 0x7f3d080cdd50 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080b3450 con 0x7f3d080ca030 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d080ae040 0x7f3d080b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d080ae040 0x7f3d080b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59184/0 (socket says 172.21.15.133:59184) 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 -- 172.21.15.133:0/2982469152 learned_addr learned my addr 172.21.15.133:0/2982469152 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:57.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0d232640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d080cdd50 0x7f3d080b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3cfffff640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 -- 172.21.15.133:0/2982469152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 msgr2=0x7f3d080c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 -- 172.21.15.133:0/2982469152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d080cdd50 msgr2=0x7f3d080b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d080cdd50 0x7f3d080b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 -- 172.21.15.133:0/2982469152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00009a70 con 0x7f3d080ae040 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ca31640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d080ae040 0x7f3d080b2f10 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400c730 tx=0x7f3d0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3cfd7fa640 1 -- 172.21.15.133:0/2982469152 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04005ac0 con 0x7f3d080ae040 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3cfd7fa640 1 -- 172.21.15.133:0/2982469152 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d04005c20 con 0x7f3d080ae040 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3cfd7fa640 1 -- 172.21.15.133:0/2982469152 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04007070 con 0x7f3d080ae040 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d080c8660 con 0x7f3d080ae040 2023-12-18T10:22:57.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.138+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d080c8c20 con 0x7f3d080ae040 2023-12-18T10:22:57.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.142+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d080adeb0 con 0x7f3d080ae040 2023-12-18T10:22:57.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.142+0000 7f3cfd7fa640 1 -- 172.21.15.133:0/2982469152 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3d040071d0 con 0x7f3d080ae040 2023-12-18T10:22:57.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.142+0000 7f3cfd7fa640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf4065a60 0x7f3cf4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.142+0000 7f3cfd7fa640 1 -- 172.21.15.133:0/2982469152 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f3d040827c0 con 0x7f3d080ae040 2023-12-18T10:22:57.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.142+0000 7f3cfffff640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf4065a60 0x7f3cf4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.142+0000 7f3cfffff640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf4065a60 0x7f3cf4067f20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3d08158560 tx=0x7f3cf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.146+0000 7f3cfd7fa640 1 -- 172.21.15.133:0/2982469152 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3d04050050 con 0x7f3d080ae040 2023-12-18T10:22:57.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.326+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d080ce6a0 con 0x7f3d080ae040 2023-12-18T10:22:57.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.326+0000 7f3cfd7fa640 1 -- 172.21.15.133:0/2982469152 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4753 (secure 0 0 0) 0x7f3d04053670 con 0x7f3d080ae040 2023-12-18T10:22:57.331 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:57.331 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":60,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:22:26.977024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6867,"mds_1":6861,"mds_2":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":2,"incarnation":54,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":52,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:22:57.331 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 60 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.326+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf4065a60 msgr2=0x7f3cf4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.326+0000 7f3d0ec95640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf4065a60 0x7f3cf4067f20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3d08158560 tx=0x7f3cf8009040 comp rx=0 tx=0).stop 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.326+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d080ae040 msgr2=0x7f3d080b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.326+0000 7f3d0ec95640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d080ae040 0x7f3d080b2f10 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400c730 tx=0x7f3d0400cbf0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.330+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 shutdown_connections 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.330+0000 7f3d0ec95640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3cf4065a60 0x7f3cf4067f20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.330+0000 7f3d0ec95640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d080cdd50 0x7f3d080b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.330+0000 7f3d0ec95640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d080ca030 0x7f3d080c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.330+0000 7f3d0ec95640 1 --2- 172.21.15.133:0/2982469152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d080ae040 0x7f3d080b2f10 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.330+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 >> 172.21.15.133:0/2982469152 conn(0x7f3d080cb610 msgr2=0x7f3d080cb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:57.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.330+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 shutdown_connections 2023-12-18T10:22:57.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.330+0000 7f3d0ec95640 1 -- 172.21.15.133:0/2982469152 wait complete. 2023-12-18T10:22:57.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:22:57.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd15655640 1 Processor -- start 2023-12-18T10:22:57.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd15655640 1 -- start start 2023-12-18T10:22:57.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd15655640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd1015c800 0x7fbd10070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd15655640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd100caa70 0x7fbd100caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd15655640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd10159080 con 0x7fbd10158c20 2023-12-18T10:22:57.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd15655640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100b0cb0 con 0x7fbd100caa70 2023-12-18T10:22:57.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd15655640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100cb440 con 0x7fbd1015c800 2023-12-18T10:22:57.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd067fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbd10158c20 0x7fbd100b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59784/0 (socket says 172.21.15.133:59784) 2023-12-18T10:22:57.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd067fc640 1 -- 172.21.15.133:0/3299314340 learned_addr learned my addr 172.21.15.133:0/3299314340 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:57.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0f7fe640 1 --2- 172.21.15.133:0/3299314340 >> v2:172.21.15.142:3300/0 conn(0x7fbd100caa70 0x7fbd100caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0effd640 1 --2- 172.21.15.133:0/3299314340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd1015c800 0x7fbd10070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0e7fc640 1 -- 172.21.15.133:0/3299314340 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352198537 0 0) 0x7fbd10159080 con 0x7fbd10158c20 2023-12-18T10:22:57.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0e7fc640 1 -- 172.21.15.133:0/3299314340 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcfc003530 con 0x7fbd10158c20 2023-12-18T10:22:57.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0e7fc640 1 -- 172.21.15.133:0/3299314340 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 835674178 0 0) 0x7fbcfc003530 con 0x7fbd10158c20 2023-12-18T10:22:57.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0f7fe640 1 -- 172.21.15.133:0/3299314340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd1015c800 msgr2=0x7fbd10070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:57.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0f7fe640 1 --2- 172.21.15.133:0/3299314340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd1015c800 0x7fbd10070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0f7fe640 1 -- 172.21.15.133:0/3299314340 >> v1:172.21.15.133:6789/0 conn(0x7fbd10158c20 legacy=0x7fbd100b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.486+0000 7fbd0f7fe640 1 -- 172.21.15.133:0/3299314340 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10070b80 con 0x7fbd100caa70 2023-12-18T10:22:57.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd0f7fe640 1 --2- 172.21.15.133:0/3299314340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd100caa70 0x7fbd100caf00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009d90 tx=0x7fbd0801c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=424a430ca9c811b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd0e7fc640 1 -- 172.21.15.133:0/3299314340 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00001680 con 0x7fbd100caa70 2023-12-18T10:22:57.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd0e7fc640 1 -- 172.21.15.133:0/3299314340 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd080a55b0 con 0x7fbd100caa70 2023-12-18T10:22:57.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd0e7fc640 1 -- 172.21.15.133:0/3299314340 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080a5920 con 0x7fbd100caa70 2023-12-18T10:22:57.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd15655640 1 -- 172.21.15.133:0/3299314340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd100caa70 msgr2=0x7fbd100caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd15655640 1 --2- 172.21.15.133:0/3299314340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd100caa70 0x7fbd100caf00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009d90 tx=0x7fbd0801c7b0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd15655640 1 -- 172.21.15.133:0/3299314340 shutdown_connections 2023-12-18T10:22:57.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd15655640 1 --2- 172.21.15.133:0/3299314340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd100caa70 0x7fbd100caf00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd15655640 1 --2- 172.21.15.133:0/3299314340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd1015c800 0x7fbd10070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd15655640 1 -- 172.21.15.133:0/3299314340 >> 172.21.15.133:0/3299314340 conn(0x7fbd1006a3e0 msgr2=0x7fbd100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:57.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd15655640 1 -- 172.21.15.133:0/3299314340 shutdown_connections 2023-12-18T10:22:57.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.490+0000 7fbd15655640 1 -- 172.21.15.133:0/3299314340 wait complete. 2023-12-18T10:22:57.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 Processor -- start 2023-12-18T10:22:57.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 -- start start 2023-12-18T10:22:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd100caa70 0x7fbd101501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd10158c20 0x7fbd101538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd1015c800 0x7fbd101554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10153e10 con 0x7fbd10158c20 2023-12-18T10:22:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1014f160 con 0x7fbd1015c800 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1014f3e0 con 0x7fbd100caa70 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd10158c20 0x7fbd101538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd10158c20 0x7fbd101538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59192/0 (socket says 172.21.15.133:59192) 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 -- 172.21.15.133:0/783319298 learned_addr learned my addr 172.21.15.133:0/783319298 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd0f7fe640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd1015c800 0x7fbd101554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd0effd640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd100caa70 0x7fbd101501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 -- 172.21.15.133:0/783319298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd100caa70 msgr2=0x7fbd101501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd100caa70 0x7fbd101501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 -- 172.21.15.133:0/783319298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd1015c800 msgr2=0x7fbd101554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd1015c800 0x7fbd101554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 -- 172.21.15.133:0/783319298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd08009a70 con 0x7fbd10158c20 2023-12-18T10:22:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd067fc640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd10158c20 0x7fbd101538d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c780 tx=0x7fbd0000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd07fff640 1 -- 172.21.15.133:0/783319298 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00005ae0 con 0x7fbd10158c20 2023-12-18T10:22:57.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd07fff640 1 -- 172.21.15.133:0/783319298 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00005c40 con 0x7fbd10158c20 2023-12-18T10:22:57.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd07fff640 1 -- 172.21.15.133:0/783319298 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00007070 con 0x7fbd10158c20 2023-12-18T10:22:57.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1014f6c0 con 0x7fbd10158c20 2023-12-18T10:22:57.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.494+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1014fc80 con 0x7fbd10158c20 2023-12-18T10:22:57.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.498+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd100735b0 con 0x7fbd10158c20 2023-12-18T10:22:57.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.498+0000 7fbd07fff640 1 -- 172.21.15.133:0/783319298 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd000071f0 con 0x7fbd10158c20 2023-12-18T10:22:57.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.498+0000 7fbd07fff640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcf0065a60 0x7fbcf0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.498+0000 7fbd07fff640 1 -- 172.21.15.133:0/783319298 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fbd00082ff0 con 0x7fbd10158c20 2023-12-18T10:22:57.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.498+0000 7fbd0effd640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcf0065a60 0x7fbcf0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.498+0000 7fbd0effd640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcf0065a60 0x7fbcf0067f20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbd10155e20 tx=0x7fbcf8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.502+0000 7fbd07fff640 1 -- 172.21.15.133:0/783319298 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbd000508e0 con 0x7fbd10158c20 2023-12-18T10:22:57.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd1014fea0 con 0x7fbd10158c20 2023-12-18T10:22:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd07fff640 1 -- 172.21.15.133:0/783319298 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16536 (secure 0 0 0) 0x7fbd00053f00 con 0x7fbd10158c20 2023-12-18T10:22:57.659 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:57.660 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:22:47.996890+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:21:46.894515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-18T10:21:47.396141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.11","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:22:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcf0065a60 msgr2=0x7fbcf0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcf0065a60 0x7fbcf0067f20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbd10155e20 tx=0x7fbcf8009190 comp rx=0 tx=0).stop 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd10158c20 msgr2=0x7fbd101538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd10158c20 0x7fbd101538d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c780 tx=0x7fbd0000cc40 comp rx=0 tx=0).stop 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 shutdown_connections 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbcf0065a60 0x7fbcf0067f20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd1015c800 0x7fbd101554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd10158c20 0x7fbd101538d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 --2- 172.21.15.133:0/783319298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd100caa70 0x7fbd101501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 >> 172.21.15.133:0/783319298 conn(0x7fbd1006a3e0 msgr2=0x7fbd10071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 shutdown_connections 2023-12-18T10:22:57.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.654+0000 7fbd15655640 1 -- 172.21.15.133:0/783319298 wait complete. 2023-12-18T10:22:57.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:21:46.894515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:21:47.396141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:22:57.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:22:57.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.814+0000 7f0f937a6640 1 Processor -- start 2023-12-18T10:22:57.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.814+0000 7f0f937a6640 1 -- start start 2023-12-18T10:22:57.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f937a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f8c071870 0x7f0f8c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f937a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 0x7f0f8c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f937a6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f8c0cc930 con 0x7f0f8c0ca410 2023-12-18T10:22:57.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f937a6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8c15aab0 con 0x7f0f8c071870 2023-12-18T10:22:57.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f937a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c070df0 con 0x7f0f8c0cbff0 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f90d41640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f8c071870 0x7f0f8c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f90d41640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f8c071870 0x7f0f8c071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59198/0 (socket says 172.21.15.133:59198) 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f90d41640 1 -- 172.21.15.133:0/1347556152 learned_addr learned my addr 172.21.15.133:0/1347556152 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f91542640 1 --1- 172.21.15.133:0/1347556152 >> v1:172.21.15.133:6789/0 conn(0x7f0f8c0ca410 0x7f0f8c159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59792/0 (socket says 172.21.15.133:59792) 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f91d43640 1 --2- 172.21.15.133:0/1347556152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 0x7f0f8c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f90d41640 1 -- 172.21.15.133:0/1347556152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 msgr2=0x7f0f8c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f90d41640 1 --2- 172.21.15.133:0/1347556152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 0x7f0f8c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f90d41640 1 -- 172.21.15.133:0/1347556152 >> v1:172.21.15.133:6789/0 conn(0x7f0f8c0ca410 legacy=0x7f0f8c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f90d41640 1 -- 172.21.15.133:0/1347556152 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c15a4f0 con 0x7f0f8c071870 2023-12-18T10:22:57.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.818+0000 7f0f83fff640 1 -- 172.21.15.133:0/1347556152 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413544720 0 0) 0x7f0f8c0cc930 con 0x7f0f8c0ca410 2023-12-18T10:22:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f90d41640 1 --2- 172.21.15.133:0/1347556152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c071870 0x7f0f8c071d00 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009870 tx=0x7f0f7c01e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a3d9797ba8ce0d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f83fff640 1 -- 172.21.15.133:0/1347556152 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0a86f0 con 0x7f0f8c071870 2023-12-18T10:22:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f83fff640 1 -- 172.21.15.133:0/1347556152 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c0a8850 con 0x7f0f8c071870 2023-12-18T10:22:57.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f83fff640 1 -- 172.21.15.133:0/1347556152 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0a8be0 con 0x7f0f8c071870 2023-12-18T10:22:57.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 -- 172.21.15.133:0/1347556152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c071870 msgr2=0x7f0f8c071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1347556152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c071870 0x7f0f8c071d00 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009870 tx=0x7f0f7c01e720 comp rx=0 tx=0).stop 2023-12-18T10:22:57.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 -- 172.21.15.133:0/1347556152 shutdown_connections 2023-12-18T10:22:57.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1347556152 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 0x7f0f8c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1347556152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c071870 0x7f0f8c071d00 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 -- 172.21.15.133:0/1347556152 >> 172.21.15.133:0/1347556152 conn(0x7f0f8c06a2a0 msgr2=0x7f0f8c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:57.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 -- 172.21.15.133:0/1347556152 shutdown_connections 2023-12-18T10:22:57.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 -- 172.21.15.133:0/1347556152 wait complete. 2023-12-18T10:22:57.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 Processor -- start 2023-12-18T10:22:57.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.822+0000 7f0f937a6640 1 -- start start 2023-12-18T10:22:57.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f8c071870 0x7f0f8c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c0ca410 0x7f0f8c158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 0x7f0f8c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0af200 con 0x7f0f8c0ca410 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0ae580 con 0x7f0f8c071870 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0ae860 con 0x7f0f8c0cbff0 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c0ca410 0x7f0f8c158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c0ca410 0x7f0f8c158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59212/0 (socket says 172.21.15.133:59212) 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 -- 172.21.15.133:0/1400704472 learned_addr learned my addr 172.21.15.133:0/1400704472 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f91542640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f8c071870 0x7f0f8c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f91d43640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 0x7f0f8c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 -- 172.21.15.133:0/1400704472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 msgr2=0x7f0f8c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 0x7f0f8c158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 -- 172.21.15.133:0/1400704472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f8c071870 msgr2=0x7f0f8c14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f8c071870 0x7f0f8c14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 -- 172.21.15.133:0/1400704472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0094d0 con 0x7f0f8c0ca410 2023-12-18T10:22:57.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f90d41640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c0ca410 0x7f0f8c158810 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b2040 tx=0x7f0f7c01b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f81ffb640 1 -- 172.21.15.133:0/1400704472 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0bd070 con 0x7f0f8c0ca410 2023-12-18T10:22:57.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f81ffb640 1 -- 172.21.15.133:0/1400704472 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c0a8690 con 0x7f0f8c0ca410 2023-12-18T10:22:57.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f81ffb640 1 -- 172.21.15.133:0/1400704472 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0b0870 con 0x7f0f8c0ca410 2023-12-18T10:22:57.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c0aeb40 con 0x7f0f8c0ca410 2023-12-18T10:22:57.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c14e890 con 0x7f0f8c0ca410 2023-12-18T10:22:57.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8c0af340 con 0x7f0f8c0ca410 2023-12-18T10:22:57.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.826+0000 7f0f81ffb640 1 -- 172.21.15.133:0/1400704472 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0f7c0b09d0 con 0x7f0f8c0ca410 2023-12-18T10:22:57.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.830+0000 7f0f81ffb640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f70065a90 0x7f0f70067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:57.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.830+0000 7f0f81ffb640 1 -- 172.21.15.133:0/1400704472 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f0f7c0ac070 con 0x7f0f8c0ca410 2023-12-18T10:22:57.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.830+0000 7f0f91542640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f70065a90 0x7f0f70067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:57.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.830+0000 7f0f91542640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f70065a90 0x7f0f70067f50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0f88007fd0 tx=0x7f0f88007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:57.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.834+0000 7f0f81ffb640 1 -- 172.21.15.133:0/1400704472 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0f8c0af340 con 0x7f0f8c0ca410 2023-12-18T10:22:57.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.982+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f8c0af340 con 0x7f0f8c0ca410 2023-12-18T10:22:57.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.982+0000 7f0f81ffb640 1 -- 172.21.15.133:0/1400704472 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f8c0af340 con 0x7f0f8c0ca410 2023-12-18T10:22:57.988 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:22:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f70065a90 msgr2=0x7f0f70067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f70065a90 0x7f0f70067f50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0f88007fd0 tx=0x7f0f88007d60 comp rx=0 tx=0).stop 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c0ca410 msgr2=0x7f0f8c158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c0ca410 0x7f0f8c158810 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0b2040 tx=0x7f0f7c01b4c0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 shutdown_connections 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f70065a90 0x7f0f70067f50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f8c0cbff0 0x7f0f8c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f8c0ca410 0x7f0f8c158810 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 --2- 172.21.15.133:0/1400704472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f8c071870 0x7f0f8c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 >> 172.21.15.133:0/1400704472 conn(0x7f0f8c06a2a0 msgr2=0x7f0f8c156a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 shutdown_connections 2023-12-18T10:22:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:57.986+0000 7f0f937a6640 1 -- 172.21.15.133:0/1400704472 wait complete. 2023-12-18T10:22:58.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:22:58.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.146+0000 7fc020fa6640 1 Processor -- start 2023-12-18T10:22:58.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc020fa6640 1 -- start start 2023-12-18T10:22:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc020fa6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c0ca410 0x7fc01c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc020fa6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc01c159fb0 0x7fc01c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc020fa6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c070df0 con 0x7fc01c071db0 2023-12-18T10:22:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc020fa6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c15aab0 con 0x7fc01c159fb0 2023-12-18T10:22:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc020fa6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15a4f0 con 0x7fc01c0ca410 2023-12-18T10:22:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc013fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc01c159fb0 0x7fc01c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc013fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc01c159fb0 0x7fc01c071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59228/0 (socket says 172.21.15.133:59228) 2023-12-18T10:22:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc013fff640 1 -- 172.21.15.133:0/414764067 learned_addr learned my addr 172.21.15.133:0/414764067 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc01a59c640 1 --2- 172.21.15.133:0/414764067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c0ca410 0x7fc01c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc013fff640 1 -- 172.21.15.133:0/414764067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c0ca410 msgr2=0x7fc01c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc013fff640 1 --2- 172.21.15.133:0/414764067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c0ca410 0x7fc01c159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc013fff640 1 -- 172.21.15.133:0/414764067 >> v1:172.21.15.142:6789/0 conn(0x7fc01c071db0 legacy=0x7fc01c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.150+0000 7fc013fff640 1 -- 172.21.15.133:0/414764067 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c15a7d0 con 0x7fc01c159fb0 2023-12-18T10:22:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc013fff640 1 --2- 172.21.15.133:0/414764067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c159fb0 0x7fc01c071870 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc004009870 tx=0x7fc00401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed845db1e438f139 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc019d9b640 1 -- 172.21.15.133:0/414764067 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040aa670 con 0x7fc01c159fb0 2023-12-18T10:22:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc019d9b640 1 -- 172.21.15.133:0/414764067 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0040aa7d0 con 0x7fc01c159fb0 2023-12-18T10:22:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc019d9b640 1 -- 172.21.15.133:0/414764067 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040aab60 con 0x7fc01c159fb0 2023-12-18T10:22:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 -- 172.21.15.133:0/414764067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c159fb0 msgr2=0x7fc01c071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 --2- 172.21.15.133:0/414764067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c159fb0 0x7fc01c071870 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc004009870 tx=0x7fc00401c510 comp rx=0 tx=0).stop 2023-12-18T10:22:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 -- 172.21.15.133:0/414764067 shutdown_connections 2023-12-18T10:22:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 --2- 172.21.15.133:0/414764067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c159fb0 0x7fc01c071870 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 --2- 172.21.15.133:0/414764067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c0ca410 0x7fc01c159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 -- 172.21.15.133:0/414764067 >> 172.21.15.133:0/414764067 conn(0x7fc01c06a2a0 msgr2=0x7fc01c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 -- 172.21.15.133:0/414764067 shutdown_connections 2023-12-18T10:22:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 -- 172.21.15.133:0/414764067 wait complete. 2023-12-18T10:22:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 Processor -- start 2023-12-18T10:22:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.154+0000 7fc020fa6640 1 -- start start 2023-12-18T10:22:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc01c071db0 0x7fc01c0c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c0ca410 0x7fc01c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c159fb0 0x7fc01c1512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0ad290 con 0x7fc01c0ca410 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0c17c0 con 0x7fc01c071db0 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0ac2b0 con 0x7fc01c159fb0 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c0ca410 0x7fc01c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c0ca410 0x7fc01c0acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59234/0 (socket says 172.21.15.133:59234) 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 -- 172.21.15.133:0/4228925101 learned_addr learned my addr 172.21.15.133:0/4228925101 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc01a59c640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc01c071db0 0x7fc01c0c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc01ad9d640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c159fb0 0x7fc01c1512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 -- 172.21.15.133:0/4228925101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c159fb0 msgr2=0x7fc01c1512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c159fb0 0x7fc01c1512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 -- 172.21.15.133:0/4228925101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc01c071db0 msgr2=0x7fc01c0c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc01c071db0 0x7fc01c0c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 -- 172.21.15.133:0/4228925101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0040094d0 con 0x7fc01c0ca410 2023-12-18T10:22:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc013fff640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c0ca410 0x7fc01c0acd50 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc0040ac040 tx=0x7fc0040192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc012ffd640 1 -- 172.21.15.133:0/4228925101 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040b4810 con 0x7fc01c0ca410 2023-12-18T10:22:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc012ffd640 1 -- 172.21.15.133:0/4228925101 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0040b49b0 con 0x7fc01c0ca410 2023-12-18T10:22:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc012ffd640 1 -- 172.21.15.133:0/4228925101 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040b4d60 con 0x7fc01c0ca410 2023-12-18T10:22:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c0c2310 con 0x7fc01c0ca410 2023-12-18T10:22:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c0ac550 con 0x7fc01c0ca410 2023-12-18T10:22:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c04e000 con 0x7fc01c0ca410 2023-12-18T10:22:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.158+0000 7fc012ffd640 1 -- 172.21.15.133:0/4228925101 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc0040be410 con 0x7fc01c0ca410 2023-12-18T10:22:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.162+0000 7fc012ffd640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbffc065a60 0x7fbffc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.162+0000 7fc012ffd640 1 -- 172.21.15.133:0/4228925101 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fc00411df20 con 0x7fc01c0ca410 2023-12-18T10:22:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.162+0000 7fc01a59c640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbffc065a60 0x7fbffc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.162+0000 7fc01a59c640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbffc065a60 0x7fbffc067f20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc00c007a60 tx=0x7fc00c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.166+0000 7fc012ffd640 1 -- 172.21.15.133:0/4228925101 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc0040eb720 con 0x7fc01c0ca410 2023-12-18T10:22:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.310+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc01c0c8a30 con 0x7fc01c0ca410 2023-12-18T10:22:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc012ffd640 1 -- 172.21.15.133:0/4228925101 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0040eed40 con 0x7fc01c0ca410 2023-12-18T10:22:58.317 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:22:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbffc065a60 msgr2=0x7fbffc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbffc065a60 0x7fbffc067f20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc00c007a60 tx=0x7fc00c008040 comp rx=0 tx=0).stop 2023-12-18T10:22:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c0ca410 msgr2=0x7fc01c0acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c0ca410 0x7fc01c0acd50 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc0040ac040 tx=0x7fc0040192b0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 shutdown_connections 2023-12-18T10:22:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbffc065a60 0x7fbffc067f20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc01c159fb0 0x7fc01c1512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc01c0ca410 0x7fc01c0acd50 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 --2- 172.21.15.133:0/4228925101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc01c071db0 0x7fc01c0c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 >> 172.21.15.133:0/4228925101 conn(0x7fc01c06a2a0 msgr2=0x7fc01c0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 shutdown_connections 2023-12-18T10:22:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.314+0000 7fc020fa6640 1 -- 172.21.15.133:0/4228925101 wait complete. 2023-12-18T10:22:58.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:22:58.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5ff622d640 1 Processor -- start 2023-12-18T10:22:58.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5ff622d640 1 -- start start 2023-12-18T10:22:58.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5ff622d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff00ca410 0x7f5ff0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5ff622d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5ff0159fb0 0x7f5ff0071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5ff622d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff0070df0 con 0x7f5ff0071db0 2023-12-18T10:22:58.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5ff622d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff015aab0 con 0x7f5ff0159fb0 2023-12-18T10:22:58.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5ff622d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff015a4f0 con 0x7f5ff00ca410 2023-12-18T10:22:58.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5feffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5ff0071db0 0x7f5ff00cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59796/0 (socket says 172.21.15.133:59796) 2023-12-18T10:22:58.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5feffff640 1 -- 172.21.15.133:0/1688159248 learned_addr learned my addr 172.21.15.133:0/1688159248 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5fef7fe640 1 --2- 172.21.15.133:0/1688159248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff00ca410 0x7f5ff0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5feeffd640 1 --2- 172.21.15.133:0/1688159248 >> v2:172.21.15.142:3300/0 conn(0x7f5ff0159fb0 0x7f5ff0071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5fee7fc640 1 -- 172.21.15.133:0/1688159248 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231565816 0 0) 0x7f5ff0070df0 con 0x7f5ff0071db0 2023-12-18T10:22:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5fee7fc640 1 -- 172.21.15.133:0/1688159248 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd8003530 con 0x7f5ff0071db0 2023-12-18T10:22:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5fef7fe640 1 -- 172.21.15.133:0/1688159248 >> v2:172.21.15.142:3300/0 conn(0x7f5ff0159fb0 msgr2=0x7f5ff0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5fef7fe640 1 --2- 172.21.15.133:0/1688159248 >> v2:172.21.15.142:3300/0 conn(0x7f5ff0159fb0 0x7f5ff0071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5fef7fe640 1 -- 172.21.15.133:0/1688159248 >> v1:172.21.15.133:6789/0 conn(0x7f5ff0071db0 legacy=0x7f5ff00cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.474+0000 7f5fef7fe640 1 -- 172.21.15.133:0/1688159248 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff015a7d0 con 0x7f5ff00ca410 2023-12-18T10:22:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5fef7fe640 1 --2- 172.21.15.133:0/1688159248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff00ca410 0x7f5ff0159a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097c0 tx=0x7f5fe001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a64a14b9fa1e74a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5fee7fc640 1 -- 172.21.15.133:0/1688159248 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab650 con 0x7f5ff00ca410 2023-12-18T10:22:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5fee7fc640 1 -- 172.21.15.133:0/1688159248 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00ab7b0 con 0x7f5ff00ca410 2023-12-18T10:22:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5fee7fc640 1 -- 172.21.15.133:0/1688159248 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00abb40 con 0x7f5ff00ca410 2023-12-18T10:22:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5ff622d640 1 -- 172.21.15.133:0/1688159248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff00ca410 msgr2=0x7f5ff0159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5ff622d640 1 --2- 172.21.15.133:0/1688159248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff00ca410 0x7f5ff0159a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097c0 tx=0x7f5fe001c450 comp rx=0 tx=0).stop 2023-12-18T10:22:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5ff622d640 1 -- 172.21.15.133:0/1688159248 shutdown_connections 2023-12-18T10:22:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5ff622d640 1 --2- 172.21.15.133:0/1688159248 >> v2:172.21.15.142:3300/0 conn(0x7f5ff0159fb0 0x7f5ff0071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5ff622d640 1 --2- 172.21.15.133:0/1688159248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff00ca410 0x7f5ff0159a70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5ff622d640 1 -- 172.21.15.133:0/1688159248 >> 172.21.15.133:0/1688159248 conn(0x7f5ff006a2a0 msgr2=0x7f5ff00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5ff622d640 1 -- 172.21.15.133:0/1688159248 shutdown_connections 2023-12-18T10:22:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.478+0000 7f5ff622d640 1 -- 172.21.15.133:0/1688159248 wait complete. 2023-12-18T10:22:58.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5ff622d640 1 Processor -- start 2023-12-18T10:22:58.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5ff622d640 1 -- start start 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5ff622d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff0071db0 0x7f5ff01f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5ff622d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ff00ca410 0x7f5ff00adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5ff622d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff0159fb0 0x7f5ff01516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5ff622d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0151bf0 con 0x7f5ff0071db0 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5ff622d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00ae1d0 con 0x7f5ff00ca410 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5ff622d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00ae4b0 con 0x7f5ff0159fb0 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff0071db0 0x7f5ff01f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff0071db0 0x7f5ff01f8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59246/0 (socket says 172.21.15.133:59246) 2023-12-18T10:22:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 -- 172.21.15.133:0/3028002926 learned_addr learned my addr 172.21.15.133:0/3028002926 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5feeffd640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ff00ca410 0x7f5ff00adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5feffff640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff0159fb0 0x7f5ff01516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 -- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff0159fb0 msgr2=0x7f5ff01516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff0159fb0 0x7f5ff01516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 -- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ff00ca410 msgr2=0x7f5ff00adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ff00ca410 0x7f5ff00adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 -- 172.21.15.133:0/3028002926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009420 con 0x7f5ff0071db0 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5feeffd640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ff00ca410 0x7f5ff00adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:22:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.482+0000 7f5fef7fe640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff0071db0 0x7f5ff01f8800 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ad040 tx=0x7f5fe001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5fd7fff640 1 -- 172.21.15.133:0/3028002926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00bf610 con 0x7f5ff0071db0 2023-12-18T10:22:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5fd7fff640 1 -- 172.21.15.133:0/3028002926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00bf790 con 0x7f5ff0071db0 2023-12-18T10:22:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5fd7fff640 1 -- 172.21.15.133:0/3028002926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00bfb40 con 0x7f5ff0071db0 2023-12-18T10:22:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff00ae790 con 0x7f5ff0071db0 2023-12-18T10:22:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff00aed50 con 0x7f5ff0071db0 2023-12-18T10:22:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff00aef40 con 0x7f5ff0071db0 2023-12-18T10:22:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5fd7fff640 1 -- 172.21.15.133:0/3028002926 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5fe00bfca0 con 0x7f5ff0071db0 2023-12-18T10:22:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5fd7fff640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fdc065a60 0x7f5fdc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5fd7fff640 1 -- 172.21.15.133:0/3028002926 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f5fe011dd10 con 0x7f5ff0071db0 2023-12-18T10:22:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5feeffd640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fdc065a60 0x7f5fdc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.486+0000 7f5feeffd640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fdc065a60 0x7f5fdc067f20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00c88c0 tx=0x7f5fe4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.490+0000 7f5fd7fff640 1 -- 172.21.15.133:0/3028002926 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5fe00eb590 con 0x7f5ff0071db0 2023-12-18T10:22:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ff004e000 con 0x7f5ff0071db0 2023-12-18T10:22:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5fd7fff640 1 -- 172.21.15.133:0/3028002926 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fe00eebb0 con 0x7f5ff0071db0 2023-12-18T10:22:58.646 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:22:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fdc065a60 msgr2=0x7f5fdc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fdc065a60 0x7f5fdc067f20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00c88c0 tx=0x7f5fe4008040 comp rx=0 tx=0).stop 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff0071db0 msgr2=0x7f5ff01f8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff0071db0 0x7f5ff01f8800 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ad040 tx=0x7f5fe001ac90 comp rx=0 tx=0).stop 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 shutdown_connections 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fdc065a60 0x7f5fdc067f20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5ff0159fb0 0x7f5ff01516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ff00ca410 0x7f5ff00adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 --2- 172.21.15.133:0/3028002926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ff0071db0 0x7f5ff01f8800 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 >> 172.21.15.133:0/3028002926 conn(0x7f5ff006a2a0 msgr2=0x7f5ff00acdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 shutdown_connections 2023-12-18T10:22:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.642+0000 7f5ff622d640 1 -- 172.21.15.133:0/3028002926 wait complete. 2023-12-18T10:22:58.652 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:22:58.655 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:22:58.667 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:22:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.874+0000 7fdf2d7a5640 1 Processor -- start 2023-12-18T10:22:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.874+0000 7fdf2d7a5640 1 -- start start 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf2d7a5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdf28158c20 0x7fdf28070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf2d7a5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf2815c800 0x7fdf280caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf2d7a5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf28070b80 con 0x7fdf280cafb0 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf2d7a5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf28070e60 con 0x7fdf2815c800 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf2d7a5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf28071140 con 0x7fdf28158c20 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf1e7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf2815c800 0x7fdf280caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf277fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf280cafb0 0x7fdf2806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59800/0 (socket says 172.21.15.133:59800) 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf277fe640 1 -- 172.21.15.133:0/76579328 learned_addr learned my addr 172.21.15.133:0/76579328 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf26ffd640 1 --2- 172.21.15.133:0/76579328 >> v2:172.21.15.142:3300/0 conn(0x7fdf28158c20 0x7fdf28070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf1e7fc640 1 -- 172.21.15.133:0/76579328 >> v2:172.21.15.142:3300/0 conn(0x7fdf28158c20 msgr2=0x7fdf28070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf1e7fc640 1 --2- 172.21.15.133:0/76579328 >> v2:172.21.15.142:3300/0 conn(0x7fdf28158c20 0x7fdf28070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf1e7fc640 1 -- 172.21.15.133:0/76579328 >> v1:172.21.15.133:6789/0 conn(0x7fdf280cafb0 legacy=0x7fdf2806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.878+0000 7fdf1e7fc640 1 -- 172.21.15.133:0/76579328 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28071420 con 0x7fdf2815c800 2023-12-18T10:22:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf1e7fc640 1 --2- 172.21.15.133:0/76579328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf2815c800 0x7fdf280caa70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fdf280cc0c0 tx=0x7fdf1001ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408f85e19b006081 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf267fc640 1 -- 172.21.15.133:0/76579328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100ab600 con 0x7fdf2815c800 2023-12-18T10:22:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf267fc640 1 -- 172.21.15.133:0/76579328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf100a7050 con 0x7fdf2815c800 2023-12-18T10:22:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf267fc640 1 -- 172.21.15.133:0/76579328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100ab980 con 0x7fdf2815c800 2023-12-18T10:22:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/76579328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf2815c800 msgr2=0x7fdf280caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/76579328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf2815c800 0x7fdf280caa70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fdf280cc0c0 tx=0x7fdf1001ce00 comp rx=0 tx=0).stop 2023-12-18T10:22:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/76579328 shutdown_connections 2023-12-18T10:22:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/76579328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf2815c800 0x7fdf280caa70 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/76579328 >> v2:172.21.15.142:3300/0 conn(0x7fdf28158c20 0x7fdf28070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/76579328 >> 172.21.15.133:0/76579328 conn(0x7fdf2806a3e0 msgr2=0x7fdf280afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/76579328 shutdown_connections 2023-12-18T10:22:58.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/76579328 wait complete. 2023-12-18T10:22:58.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 Processor -- start 2023-12-18T10:22:58.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- start start 2023-12-18T10:22:58.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf280cafb0 0x7fdf2814ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf28158c20 0x7fdf281675d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2815c800 0x7fdf28159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28167cd0 con 0x7fdf280cafb0 2023-12-18T10:22:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28161e70 con 0x7fdf2815c800 2023-12-18T10:22:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.882+0000 7fdf2d7a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28156e50 con 0x7fdf28158c20 2023-12-18T10:22:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf280cafb0 0x7fdf2814ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf280cafb0 0x7fdf2814ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59268/0 (socket says 172.21.15.133:59268) 2023-12-18T10:22:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 -- 172.21.15.133:0/62046221 learned_addr learned my addr 172.21.15.133:0/62046221 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:58.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf277fe640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2815c800 0x7fdf28159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf1e7fc640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf28158c20 0x7fdf281675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 -- 172.21.15.133:0/62046221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf28158c20 msgr2=0x7fdf281675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf28158c20 0x7fdf281675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 -- 172.21.15.133:0/62046221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2815c800 msgr2=0x7fdf28159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2815c800 0x7fdf28159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 -- 172.21.15.133:0/62046221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10009420 con 0x7fdf280cafb0 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf26ffd640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf280cafb0 0x7fdf2814ad90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fdf18007ef0 tx=0x7fdf1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf1ffff640 1 -- 172.21.15.133:0/62046221 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18014620 con 0x7fdf280cafb0 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf1ffff640 1 -- 172.21.15.133:0/62046221 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18014780 con 0x7fdf280cafb0 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf1ffff640 1 -- 172.21.15.133:0/62046221 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf18014b30 con 0x7fdf280cafb0 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf280c8800 con 0x7fdf280cafb0 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf281623f0 con 0x7fdf280cafb0 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf280735b0 con 0x7fdf280cafb0 2023-12-18T10:22:58.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.886+0000 7fdf1ffff640 1 -- 172.21.15.133:0/62046221 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdf18014c90 con 0x7fdf280cafb0 2023-12-18T10:22:58.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.890+0000 7fdf1ffff640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdf08065a60 0x7fdf08067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:58.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.890+0000 7fdf1ffff640 1 -- 172.21.15.133:0/62046221 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fdf18083d70 con 0x7fdf280cafb0 2023-12-18T10:22:58.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.890+0000 7fdf1e7fc640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdf08065a60 0x7fdf08067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:58.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.890+0000 7fdf1e7fc640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdf08065a60 0x7fdf08067f20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdf100ad000 tx=0x7fdf10004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:58.894+0000 7fdf1ffff640 1 -- 172.21.15.133:0/62046221 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdf18051550 con 0x7fdf280cafb0 2023-12-18T10:22:59.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf2804e000 con 0x7fdf280cafb0 2023-12-18T10:22:59.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf1ffff640 1 -- 172.21.15.133:0/62046221 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4753 (secure 0 0 0) 0x7fdf18054b70 con 0x7fdf280cafb0 2023-12-18T10:22:59.082 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:59.082 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":60,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:22:26.977024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6867,"mds_1":6861,"mds_2":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":2,"incarnation":54,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":52,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:22:59.082 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 60 2023-12-18T10:22:59.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdf08065a60 msgr2=0x7fdf08067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdf08065a60 0x7fdf08067f20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdf100ad000 tx=0x7fdf10004740 comp rx=0 tx=0).stop 2023-12-18T10:22:59.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf280cafb0 msgr2=0x7fdf2814ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf280cafb0 0x7fdf2814ad90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fdf18007ef0 tx=0x7fdf1800e4b0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 shutdown_connections 2023-12-18T10:22:59.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdf08065a60 0x7fdf08067f20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf2815c800 0x7fdf28159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdf28158c20 0x7fdf281675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 --2- 172.21.15.133:0/62046221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf280cafb0 0x7fdf2814ad90 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 >> 172.21.15.133:0/62046221 conn(0x7fdf2806a3e0 msgr2=0x7fdf28157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:59.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 shutdown_connections 2023-12-18T10:22:59.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.078+0000 7fdf2d7a5640 1 -- 172.21.15.133:0/62046221 wait complete. 2023-12-18T10:22:59.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:22:59.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa56da2640 1 Processor -- start 2023-12-18T10:22:59.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa56da2640 1 -- start start 2023-12-18T10:22:59.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa56da2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa500cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa56da2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa500cd3a0 0x7faa500cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa56da2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5015cb10 con 0x7faa5015c730 2023-12-18T10:22:59.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa56da2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa500b65c0 con 0x7faa500cd3a0 2023-12-18T10:22:59.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa56da2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500cd960 con 0x7faa500cea00 2023-12-18T10:22:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa5559f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa500cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa565a1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faa500cd3a0 0x7faa500cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa5559f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa500cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:41844/0 (socket says 172.21.15.133:41844) 2023-12-18T10:22:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa5559f640 1 -- 172.21.15.133:0/746280997 learned_addr learned my addr 172.21.15.133:0/746280997 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa54d9e640 1 -- 172.21.15.133:0/746280997 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156696339 0 0) 0x7faa5015cb10 con 0x7faa5015c730 2023-12-18T10:22:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa54d9e640 1 -- 172.21.15.133:0/746280997 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa3c003530 con 0x7faa5015c730 2023-12-18T10:22:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa5559f640 1 -- 172.21.15.133:0/746280997 >> v2:172.21.15.142:3300/0 conn(0x7faa500cd3a0 msgr2=0x7faa500cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa5559f640 1 --2- 172.21.15.133:0/746280997 >> v2:172.21.15.142:3300/0 conn(0x7faa500cd3a0 0x7faa500cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa5559f640 1 -- 172.21.15.133:0/746280997 >> v1:172.21.15.142:6789/0 conn(0x7faa5015c730 legacy=0x7faa500b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa5559f640 1 -- 172.21.15.133:0/746280997 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500cdc40 con 0x7faa500cea00 2023-12-18T10:22:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.242+0000 7faa565a1640 1 --2- 172.21.15.133:0/746280997 >> v2:172.21.15.142:3300/0 conn(0x7faa500cd3a0 0x7faa500cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:22:59.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa5559f640 1 --2- 172.21.15.133:0/746280997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa500cef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa40009870 tx=0x7faa4001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9737ab96b2e8454e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa54d9e640 1 -- 172.21.15.133:0/746280997 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400a8a30 con 0x7faa500cea00 2023-12-18T10:22:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa54d9e640 1 -- 172.21.15.133:0/746280997 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa400a8b90 con 0x7faa500cea00 2023-12-18T10:22:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa54d9e640 1 -- 172.21.15.133:0/746280997 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400b0440 con 0x7faa500cea00 2023-12-18T10:22:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa56da2640 1 -- 172.21.15.133:0/746280997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 msgr2=0x7faa500cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa56da2640 1 --2- 172.21.15.133:0/746280997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa500cef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa40009870 tx=0x7faa4001ed30 comp rx=0 tx=0).stop 2023-12-18T10:22:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa56da2640 1 -- 172.21.15.133:0/746280997 shutdown_connections 2023-12-18T10:22:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa56da2640 1 --2- 172.21.15.133:0/746280997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa500cef60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa56da2640 1 --2- 172.21.15.133:0/746280997 >> v2:172.21.15.142:3300/0 conn(0x7faa500cd3a0 0x7faa500cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.246+0000 7faa56da2640 1 -- 172.21.15.133:0/746280997 >> 172.21.15.133:0/746280997 conn(0x7faa5006b120 msgr2=0x7faa5006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 -- 172.21.15.133:0/746280997 shutdown_connections 2023-12-18T10:22:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 -- 172.21.15.133:0/746280997 wait complete. 2023-12-18T10:22:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 Processor -- start 2023-12-18T10:22:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 -- start start 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500cd3a0 0x7faa500cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa50157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5015c730 0x7faa50155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501592a0 con 0x7faa500cd3a0 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa50158690 con 0x7faa5015c730 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa50158970 con 0x7faa500cea00 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500cd3a0 0x7faa500cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500cd3a0 0x7faa500cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59282/0 (socket says 172.21.15.133:59282) 2023-12-18T10:22:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 -- 172.21.15.133:0/243483382 learned_addr learned my addr 172.21.15.133:0/243483382 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa565a1640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5015c730 0x7faa50155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa5559f640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa50157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 -- 172.21.15.133:0/243483382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 msgr2=0x7faa50157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa50157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 -- 172.21.15.133:0/243483382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5015c730 msgr2=0x7faa50155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5015c730 0x7faa50155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 -- 172.21.15.133:0/243483382 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009a70 con 0x7faa500cd3a0 2023-12-18T10:22:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa55da0640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500cd3a0 0x7faa500cad80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c430 tx=0x7faa4c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa467fc640 1 -- 172.21.15.133:0/243483382 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0052d0 con 0x7faa500cd3a0 2023-12-18T10:22:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa467fc640 1 -- 172.21.15.133:0/243483382 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c005450 con 0x7faa500cd3a0 2023-12-18T10:22:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa467fc640 1 -- 172.21.15.133:0/243483382 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c003840 con 0x7faa500cd3a0 2023-12-18T10:22:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.250+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa400094d0 con 0x7faa500cd3a0 2023-12-18T10:22:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.254+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa50158f30 con 0x7faa500cd3a0 2023-12-18T10:22:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.254+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50066c50 con 0x7faa500cd3a0 2023-12-18T10:22:59.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.254+0000 7faa467fc640 1 -- 172.21.15.133:0/243483382 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa4c0039a0 con 0x7faa500cd3a0 2023-12-18T10:22:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.254+0000 7faa467fc640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa34065a60 0x7faa34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.254+0000 7faa467fc640 1 -- 172.21.15.133:0/243483382 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7faa4c082870 con 0x7faa500cd3a0 2023-12-18T10:22:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.254+0000 7faa5559f640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa34065a60 0x7faa34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.258+0000 7faa5559f640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa34065a60 0x7faa34067f20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faa400b2000 tx=0x7faa40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.258+0000 7faa467fc640 1 -- 172.21.15.133:0/243483382 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faa4c050070 con 0x7faa500cd3a0 2023-12-18T10:22:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.410+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa5004e850 con 0x7faa500cd3a0 2023-12-18T10:22:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa467fc640 1 -- 172.21.15.133:0/243483382 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16536 (secure 0 0 0) 0x7faa4c053690 con 0x7faa500cd3a0 2023-12-18T10:22:59.417 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:59.417 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:22:47.996890+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:21:46.894515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-18T10:21:47.396141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.11","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:22:59.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa34065a60 msgr2=0x7faa34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa34065a60 0x7faa34067f20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faa400b2000 tx=0x7faa40009040 comp rx=0 tx=0).stop 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500cd3a0 msgr2=0x7faa500cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500cd3a0 0x7faa500cad80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c430 tx=0x7faa4c00c830 comp rx=0 tx=0).stop 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 shutdown_connections 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa34065a60 0x7faa34067f20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa5015c730 0x7faa50155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa500cea00 0x7faa50157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 --2- 172.21.15.133:0/243483382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa500cd3a0 0x7faa500cad80 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 >> 172.21.15.133:0/243483382 conn(0x7faa5006b120 msgr2=0x7faa500d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 shutdown_connections 2023-12-18T10:22:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.414+0000 7faa56da2640 1 -- 172.21.15.133:0/243483382 wait complete. 2023-12-18T10:22:59.439 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-18T10:22:59.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:22:59.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.570+0000 7f9b37efc640 1 Processor -- start 2023-12-18T10:22:59.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.570+0000 7f9b37efc640 1 -- start start 2023-12-18T10:22:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b37efc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b30070510 0x7f9b30158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b37efc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b30070b80 con 0x7f9b3015c800 2023-12-18T10:22:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b37efc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b30070e60 con 0x7f9b300caa70 2023-12-18T10:22:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b37efc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30070970 con 0x7f9b30070510 2023-12-18T10:22:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35c98640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9b3015c800 0x7f9b300b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59806/0 (socket says 172.21.15.133:59806) 2023-12-18T10:22:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35c98640 1 -- 172.21.15.133:0/3147900402 learned_addr learned my addr 172.21.15.133:0/3147900402 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35497640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b30070510 0x7f9b30158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180537216 0 0) 0x7f9b30070b80 con 0x7f9b3015c800 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b1c003530 con 0x7f9b3015c800 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113254128 0 0) 0x7f9b30070e60 con 0x7f9b300caa70 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b30070b80 con 0x7f9b300caa70 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3017737076 0 0) 0x7f9b1c003530 con 0x7f9b3015c800 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b30070510 msgr2=0x7f9b30158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b30070510 0x7f9b30158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 >> v1:172.21.15.142:6789/0 conn(0x7f9b300caa70 legacy=0x7f9b300caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30071140 con 0x7f9b3015c800 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f9b2c001680 con 0x7f9b3015c800 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 >> v1:172.21.15.133:6789/0 conn(0x7f9b3015c800 legacy=0x7f9b300b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b1c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0047d0 0x7f9b1c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b30070510 0x7f9b1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30070970 con 0x7f9b1c003b40 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c00ba40 con 0x7f9b1c0047d0 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c00bbd0 con 0x7f9b30070510 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35c98640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b1c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35497640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0047d0 0x7f9b1c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b36499640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b30070510 0x7f9b1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35c98640 1 -- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b30070510 msgr2=0x7f9b1c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35c98640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b30070510 0x7f9b1c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35c98640 1 -- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0047d0 msgr2=0x7f9b1c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35c98640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0047d0 0x7f9b1c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.574+0000 7f9b35c98640 1 -- 172.21.15.133:0/3147900402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c003530 con 0x7f9b1c003b40 2023-12-18T10:22:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b35c98640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b1c003f40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c160 tx=0x7f9b2c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761e4e19a6bb6146 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0058e0 con 0x7f9b1c003b40 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c005a40 con 0x7f9b1c003b40 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b34c96640 1 -- 172.21.15.133:0/3147900402 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c005df0 con 0x7f9b1c003b40 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b37efc640 1 -- 172.21.15.133:0/3147900402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 msgr2=0x7f9b1c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b37efc640 1 --2- 172.21.15.133:0/3147900402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b1c003f40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c160 tx=0x7f9b2c01cb60 comp rx=0 tx=0).stop 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b36499640 1 -- 172.21.15.133:0/3147900402 reap_dead start 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b37efc640 1 -- 172.21.15.133:0/3147900402 shutdown_connections 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b37efc640 1 -- 172.21.15.133:0/3147900402 >> 172.21.15.133:0/3147900402 conn(0x7f9b3006a3e0 msgr2=0x7f9b300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b37efc640 1 -- 172.21.15.133:0/3147900402 shutdown_connections 2023-12-18T10:22:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b37efc640 1 -- 172.21.15.133:0/3147900402 wait complete. 2023-12-18T10:22:59.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.578+0000 7f9b37efc640 1 Processor -- start 2023-12-18T10:22:59.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 -- start start 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b301f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b300b1010 0x7f9b3015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b300c8990 0x7f9b300c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300c9360 con 0x7f9b1c003b40 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30153c20 con 0x7f9b300b1010 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30153e70 con 0x7f9b300c8990 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b301f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b301f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59306/0 (socket says 172.21.15.133:59306) 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 -- 172.21.15.133:0/958297486 learned_addr learned my addr 172.21.15.133:0/958297486 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35497640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b300b1010 0x7f9b3015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b36499640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b300c8990 0x7f9b300c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 -- 172.21.15.133:0/958297486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b300c8990 msgr2=0x7f9b300c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b300c8990 0x7f9b300c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 -- 172.21.15.133:0/958297486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b300b1010 msgr2=0x7f9b3015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b300b1010 0x7f9b3015b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 -- 172.21.15.133:0/958297486 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300c8800 con 0x7f9b1c003b40 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b35c98640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b301f4b60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ab040 tx=0x7f9b1c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b267fc640 1 -- 172.21.15.133:0/958297486 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c001be0 con 0x7f9b1c003b40 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b267fc640 1 -- 172.21.15.133:0/958297486 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c005dd0 con 0x7f9b1c003b40 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b30154150 con 0x7f9b1c003b40 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b267fc640 1 -- 172.21.15.133:0/958297486 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c001680 con 0x7f9b1c003b40 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b30154710 con 0x7f9b1c003b40 2023-12-18T10:22:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.582+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b300735b0 con 0x7f9b1c003b40 2023-12-18T10:22:59.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.586+0000 7f9b267fc640 1 -- 172.21.15.133:0/958297486 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b2c007090 con 0x7f9b1c003b40 2023-12-18T10:22:59.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.586+0000 7f9b267fc640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b14065a90 0x7f9b14067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.586+0000 7f9b267fc640 1 -- 172.21.15.133:0/958297486 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f9b2c11cce0 con 0x7f9b1c003b40 2023-12-18T10:22:59.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.586+0000 7f9b35497640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b14065a90 0x7f9b14067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.586+0000 7f9b35497640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b14065a90 0x7f9b14067f50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9b300cb570 tx=0x7f9b20009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.590+0000 7f9b267fc640 1 -- 172.21.15.133:0/958297486 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b2c0ea700 con 0x7f9b1c003b40 2023-12-18T10:22:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b3015c5f0 con 0x7f9b1c003b40 2023-12-18T10:22:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b267fc640 1 -- 172.21.15.133:0/958297486 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4753 (secure 0 0 0) 0x7f9b3015c5f0 con 0x7f9b1c003b40 2023-12-18T10:22:59.774 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:22:59.774 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":60,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:22:26.977024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6867,"mds_1":6861,"mds_2":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":2,"incarnation":54,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":52,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:22:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 60 2023-12-18T10:22:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b14065a90 msgr2=0x7f9b14067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b14065a90 0x7f9b14067f50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9b300cb570 tx=0x7f9b20009190 comp rx=0 tx=0).stop 2023-12-18T10:22:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 msgr2=0x7f9b301f4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b301f4b60 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ab040 tx=0x7f9b1c005800 comp rx=0 tx=0).stop 2023-12-18T10:22:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 shutdown_connections 2023-12-18T10:22:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b14065a90 0x7f9b14067f50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b300c8990 0x7f9b300c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b300b1010 0x7f9b3015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 --2- 172.21.15.133:0/958297486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b1c003b40 0x7f9b301f4b60 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 >> 172.21.15.133:0/958297486 conn(0x7f9b3006a3e0 msgr2=0x7f9b3015e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 shutdown_connections 2023-12-18T10:22:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.770+0000 7f9b37efc640 1 -- 172.21.15.133:0/958297486 wait complete. 2023-12-18T10:22:59.795 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:22:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.926+0000 7f590dbc0640 1 Processor -- start 2023-12-18T10:22:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.926+0000 7f590dbc0640 1 -- start start 2023-12-18T10:22:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f590dbc0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59080cb180 0x7f5908070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f590dbc0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f590dbc0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5908070b80 con 0x7f5908158c20 2023-12-18T10:22:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f590dbc0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5908070e60 con 0x7f59080cb180 2023-12-18T10:22:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f590dbc0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5908071140 con 0x7f590815c800 2023-12-18T10:22:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f5906ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59080cb180 0x7f5908070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f59077fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5908158c20 0x7f59080caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57800/0 (socket says 172.21.15.133:57800) 2023-12-18T10:22:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f59077fe640 1 -- 172.21.15.133:0/280779106 learned_addr learned my addr 172.21.15.133:0/280779106 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:22:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f5907fff640 1 --2- 172.21.15.133:0/280779106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f5906ffd640 1 -- 172.21.15.133:0/280779106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 msgr2=0x7f59080ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:22:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f5906ffd640 1 --2- 172.21.15.133:0/280779106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f5906ffd640 1 -- 172.21.15.133:0/280779106 >> v1:172.21.15.133:6789/0 conn(0x7f5908158c20 legacy=0x7f59080caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f5906ffd640 1 -- 172.21.15.133:0/280779106 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5908071420 con 0x7f59080cb180 2023-12-18T10:22:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f59067fc640 1 -- 172.21.15.133:0/280779106 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426649184 0 0) 0x7f5908070b80 con 0x7f5908158c20 2023-12-18T10:22:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.930+0000 7f5907fff640 1 --2- 172.21.15.133:0/280779106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:22:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f5906ffd640 1 --2- 172.21.15.133:0/280779106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59080cb180 0x7f5908070510 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0097c0 tx=0x7f58fc01df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce37ba0b2052cc32 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f59067fc640 1 -- 172.21.15.133:0/280779106 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc0ac680 con 0x7f59080cb180 2023-12-18T10:22:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f59067fc640 1 -- 172.21.15.133:0/280779106 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc0ac7e0 con 0x7f59080cb180 2023-12-18T10:22:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f59067fc640 1 -- 172.21.15.133:0/280779106 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc0acb70 con 0x7f59080cb180 2023-12-18T10:22:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 -- 172.21.15.133:0/280779106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59080cb180 msgr2=0x7f5908070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 --2- 172.21.15.133:0/280779106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59080cb180 0x7f5908070510 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0097c0 tx=0x7f58fc01df30 comp rx=0 tx=0).stop 2023-12-18T10:22:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 -- 172.21.15.133:0/280779106 shutdown_connections 2023-12-18T10:22:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 --2- 172.21.15.133:0/280779106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 --2- 172.21.15.133:0/280779106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59080cb180 0x7f5908070510 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 -- 172.21.15.133:0/280779106 >> 172.21.15.133:0/280779106 conn(0x7f590806a3e0 msgr2=0x7f59080afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:22:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 -- 172.21.15.133:0/280779106 shutdown_connections 2023-12-18T10:22:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 -- 172.21.15.133:0/280779106 wait complete. 2023-12-18T10:22:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 Processor -- start 2023-12-18T10:22:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.934+0000 7f590dbc0640 1 -- start start 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59080cb180 0x7f59080ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908158c20 0x7f59081503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080aeb10 con 0x7f5908158c20 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59080afd30 con 0x7f59080cb180 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59080b0fd0 con 0x7f590815c800 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908158c20 0x7f59081503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908158c20 0x7f59081503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45156/0 (socket says 172.21.15.133:45156) 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 -- 172.21.15.133:0/689624559 learned_addr learned my addr 172.21.15.133:0/689624559 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f59077fe640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59080cb180 0x7f59080ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5907fff640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 -- 172.21.15.133:0/689624559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 msgr2=0x7f59080af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 -- 172.21.15.133:0/689624559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59080cb180 msgr2=0x7f59080ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:22:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59080cb180 0x7f59080ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:22:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 -- 172.21.15.133:0/689624559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc009420 con 0x7f5908158c20 2023-12-18T10:22:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f5906ffd640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908158c20 0x7f59081503c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f58fc01b100 tx=0x7f58fc01bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f58effff640 1 -- 172.21.15.133:0/689624559 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc004220 con 0x7f5908158c20 2023-12-18T10:22:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f58effff640 1 -- 172.21.15.133:0/689624559 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc004380 con 0x7f5908158c20 2023-12-18T10:22:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59080c8800 con 0x7f5908158c20 2023-12-18T10:22:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f58effff640 1 -- 172.21.15.133:0/689624559 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc003820 con 0x7f5908158c20 2023-12-18T10:22:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59080b1590 con 0x7f5908158c20 2023-12-18T10:22:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.938+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59080735b0 con 0x7f5908158c20 2023-12-18T10:22:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.942+0000 7f58effff640 1 -- 172.21.15.133:0/689624559 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f58fc003980 con 0x7f5908158c20 2023-12-18T10:22:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.942+0000 7f58effff640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58f4065a60 0x7f58f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:22:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.942+0000 7f58effff640 1 -- 172.21.15.133:0/689624559 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f58fc11e670 con 0x7f5908158c20 2023-12-18T10:22:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.942+0000 7f59077fe640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58f4065a60 0x7f58f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:22:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.942+0000 7f59077fe640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58f4065a60 0x7f58f4067f20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f58f8007fd0 tx=0x7f58f8007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:22:59.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:22:59.946+0000 7f58effff640 1 -- 172.21.15.133:0/689624559 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f58fc0ec040 con 0x7f5908158c20 2023-12-18T10:23:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.130+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f590804e000 con 0x7f5908158c20 2023-12-18T10:23:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f58effff640 1 -- 172.21.15.133:0/689624559 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4753 (secure 0 0 0) 0x7f58fc0044f0 con 0x7f5908158c20 2023-12-18T10:23:00.137 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:00.137 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":60,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:21:48.401032+0000","modified":"2023-12-18T10:22:26.977024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6867,"mds_1":6861,"mds_2":6505},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6505":{"gid":6505,"name":"d","rank":2,"incarnation":54,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6834/3664781290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3664781290},{"type":"v1","addr":"172.21.15.142:6834","nonce":3664781290}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":52,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/995027883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":995027883},{"type":"v1","addr":"172.21.15.133:6836","nonce":995027883}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6867":{"gid":6867,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/900380605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":900380605},{"type":"v1","addr":"172.21.15.142:6835","nonce":900380605}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-18T10:23:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 60 2023-12-18T10:23:00.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58f4065a60 msgr2=0x7f58f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58f4065a60 0x7f58f4067f20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f58f8007fd0 tx=0x7f58f8007d60 comp rx=0 tx=0).stop 2023-12-18T10:23:00.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908158c20 msgr2=0x7f59081503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908158c20 0x7f59081503c0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f58fc01b100 tx=0x7f58fc01bd10 comp rx=0 tx=0).stop 2023-12-18T10:23:00.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 shutdown_connections 2023-12-18T10:23:00.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f58f4065a60 0x7f58f4067f20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f590815c800 0x7f59080af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5908158c20 0x7f59081503c0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 --2- 172.21.15.133:0/689624559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f59080cb180 0x7f59080ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 >> 172.21.15.133:0/689624559 conn(0x7f590806a3e0 msgr2=0x7f5908163470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 shutdown_connections 2023-12-18T10:23:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.134+0000 7f590dbc0640 1 -- 172.21.15.133:0/689624559 wait complete. 2023-12-18T10:23:00.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:00.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a215a640 1 Processor -- start 2023-12-18T10:23:00.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a215a640 1 -- start start 2023-12-18T10:23:00.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a215a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f469c15c730 0x7f469c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a215a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c0cf670 0x7f469c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a215a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c15cb10 con 0x7f469c0cea00 2023-12-18T10:23:00.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a215a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0b84c0 con 0x7f469c15c730 2023-12-18T10:23:00.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a215a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0cd960 con 0x7f469c0cf670 2023-12-18T10:23:00.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1158640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f469c15c730 0x7f469c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1158640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f469c15c730 0x7f469c0b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45158/0 (socket says 172.21.15.133:45158) 2023-12-18T10:23:00.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1158640 1 -- 172.21.15.133:0/3893572557 learned_addr learned my addr 172.21.15.133:0/3893572557 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1959640 1 --2- 172.21.15.133:0/3893572557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c0cf670 0x7f469c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1158640 1 -- 172.21.15.133:0/3893572557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c0cf670 msgr2=0x7f469c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1158640 1 --2- 172.21.15.133:0/3893572557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c0cf670 0x7f469c0b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1158640 1 -- 172.21.15.133:0/3893572557 >> v1:172.21.15.142:6789/0 conn(0x7f469c0cea00 legacy=0x7f469c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:00.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1158640 1 -- 172.21.15.133:0/3893572557 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0cdc40 con 0x7f469c15c730 2023-12-18T10:23:00.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.294+0000 7f46a1959640 1 --2- 172.21.15.133:0/3893572557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c0cf670 0x7f469c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:00.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a1158640 1 --2- 172.21.15.133:0/3893572557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c15c730 0x7f469c0b7f80 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f4698009870 tx=0x7f469801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe36a6537323865 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:00.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f4693fff640 1 -- 172.21.15.133:0/3893572557 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980a89b0 con 0x7f469c15c730 2023-12-18T10:23:00.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f4693fff640 1 -- 172.21.15.133:0/3893572557 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980a8b10 con 0x7f469c15c730 2023-12-18T10:23:00.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f4693fff640 1 -- 172.21.15.133:0/3893572557 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980a8ea0 con 0x7f469c15c730 2023-12-18T10:23:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 -- 172.21.15.133:0/3893572557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c15c730 msgr2=0x7f469c0b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 --2- 172.21.15.133:0/3893572557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c15c730 0x7f469c0b7f80 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f4698009870 tx=0x7f469801ecf0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 -- 172.21.15.133:0/3893572557 shutdown_connections 2023-12-18T10:23:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 --2- 172.21.15.133:0/3893572557 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c0cf670 0x7f469c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 --2- 172.21.15.133:0/3893572557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c15c730 0x7f469c0b7f80 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 -- 172.21.15.133:0/3893572557 >> 172.21.15.133:0/3893572557 conn(0x7f469c06b120 msgr2=0x7f469c06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 -- 172.21.15.133:0/3893572557 shutdown_connections 2023-12-18T10:23:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 -- 172.21.15.133:0/3893572557 wait complete. 2023-12-18T10:23:00.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 Processor -- start 2023-12-18T10:23:00.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.298+0000 7f46a215a640 1 -- start start 2023-12-18T10:23:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c0cea00 0x7f469c1f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f469c0cf670 0x7f469c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c15c730 0x7f469c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1f1da0 con 0x7f469c0cea00 2023-12-18T10:23:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c15ad50 con 0x7f469c0cf670 2023-12-18T10:23:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c15b030 con 0x7f469c15c730 2023-12-18T10:23:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c0cea00 0x7f469c1f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c0cea00 0x7f469c1f1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45164/0 (socket says 172.21.15.133:45164) 2023-12-18T10:23:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 -- 172.21.15.133:0/284513930 learned_addr learned my addr 172.21.15.133:0/284513930 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a0957640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f469c0cf670 0x7f469c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1959640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c15c730 0x7f469c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 -- 172.21.15.133:0/284513930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c15c730 msgr2=0x7f469c157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c15c730 0x7f469c157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 -- 172.21.15.133:0/284513930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f469c0cf670 msgr2=0x7f469c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f469c0cf670 0x7f469c15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 -- 172.21.15.133:0/284513930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980094d0 con 0x7f469c0cea00 2023-12-18T10:23:00.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a1158640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c0cea00 0x7f469c1f1860 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f46980b3040 tx=0x7f469801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:00.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f4691ffb640 1 -- 172.21.15.133:0/284513930 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980a89b0 con 0x7f469c0cea00 2023-12-18T10:23:00.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f4691ffb640 1 -- 172.21.15.133:0/284513930 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980bb480 con 0x7f469c0cea00 2023-12-18T10:23:00.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f4691ffb640 1 -- 172.21.15.133:0/284513930 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980bb850 con 0x7f469c0cea00 2023-12-18T10:23:00.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c15b310 con 0x7f469c0cea00 2023-12-18T10:23:00.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c15b8d0 con 0x7f469c0cea00 2023-12-18T10:23:00.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.302+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c066c50 con 0x7f469c0cea00 2023-12-18T10:23:00.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.306+0000 7f4691ffb640 1 -- 172.21.15.133:0/284513930 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f46980bb9b0 con 0x7f469c0cea00 2023-12-18T10:23:00.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.306+0000 7f4691ffb640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4680065a60 0x7f4680067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.306+0000 7f4691ffb640 1 -- 172.21.15.133:0/284513930 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f4698121920 con 0x7f469c0cea00 2023-12-18T10:23:00.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.306+0000 7f46a0957640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4680065a60 0x7f4680067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.306+0000 7f46a0957640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4680065a60 0x7f4680067f20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f469c157830 tx=0x7f468c007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.310+0000 7f4691ffb640 1 -- 172.21.15.133:0/284513930 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f46980ef1b0 con 0x7f469c0cea00 2023-12-18T10:23:00.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.466+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f469c066c50 con 0x7f469c0cea00 2023-12-18T10:23:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.466+0000 7f4691ffb640 1 -- 172.21.15.133:0/284513930 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16536 (secure 0 0 0) 0x7f46980b5020 con 0x7f469c0cea00 2023-12-18T10:23:00.472 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:00.473 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:22:47.996890+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:21:46.894515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-12-18T10:21:47.396141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.11","mappings":[{"from":7,"to":2}]},{"pgid":"10.1","mappings":[{"from":4,"to":3}]},{"pgid":"10.2e","mappings":[{"from":4,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.34","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4680065a60 msgr2=0x7f4680067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4680065a60 0x7f4680067f20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f469c157830 tx=0x7f468c007e40 comp rx=0 tx=0).stop 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c0cea00 msgr2=0x7f469c1f1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c0cea00 0x7f469c1f1860 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f46980b3040 tx=0x7f469801ba90 comp rx=0 tx=0).stop 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 shutdown_connections 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4680065a60 0x7f4680067f20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f469c15c730 0x7f469c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f469c0cf670 0x7f469c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 --2- 172.21.15.133:0/284513930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f469c0cea00 0x7f469c1f1860 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 >> 172.21.15.133:0/284513930 conn(0x7f469c06b120 msgr2=0x7f469c0b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 shutdown_connections 2023-12-18T10:23:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.470+0000 7f46a215a640 1 -- 172.21.15.133:0/284513930 wait complete. 2023-12-18T10:23:00.494 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-18T10:23:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb9725640 1 Processor -- start 2023-12-18T10:23:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb9725640 1 -- start start 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb9725640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fadb4158c20 0x7fadb4070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb9725640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fadb40cb180 0x7fadb40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb9725640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb4070b80 con 0x7fadb415c800 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb9725640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb4070e60 con 0x7fadb4158c20 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb9725640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb4071140 con 0x7fadb40cb180 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fadb4158c20 0x7fadb4070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fadb4158c20 0x7fadb4070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45168/0 (socket says 172.21.15.133:45168) 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb2ffd640 1 -- 172.21.15.133:0/2336398668 learned_addr learned my addr 172.21.15.133:0/2336398668 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb37fe640 1 --2- 172.21.15.133:0/2336398668 >> v2:172.21.15.142:3300/0 conn(0x7fadb40cb180 0x7fadb40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb2ffd640 1 -- 172.21.15.133:0/2336398668 >> v2:172.21.15.142:3300/0 conn(0x7fadb40cb180 msgr2=0x7fadb40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb2ffd640 1 --2- 172.21.15.133:0/2336398668 >> v2:172.21.15.142:3300/0 conn(0x7fadb40cb180 0x7fadb40ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb2ffd640 1 -- 172.21.15.133:0/2336398668 >> v1:172.21.15.142:6789/0 conn(0x7fadb415c800 legacy=0x7fadb40caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb2ffd640 1 -- 172.21.15.133:0/2336398668 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4071420 con 0x7fadb4158c20 2023-12-18T10:23:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.630+0000 7fadb37fe640 1 --2- 172.21.15.133:0/2336398668 >> v2:172.21.15.142:3300/0 conn(0x7fadb40cb180 0x7fadb40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb2ffd640 1 --2- 172.21.15.133:0/2336398668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4070510 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fadb40c53c0 tx=0x7fada401ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20af34c31aa7bb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb27fc640 1 -- 172.21.15.133:0/2336398668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada40ab620 con 0x7fadb4158c20 2023-12-18T10:23:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb27fc640 1 -- 172.21.15.133:0/2336398668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada40ab780 con 0x7fadb4158c20 2023-12-18T10:23:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb27fc640 1 -- 172.21.15.133:0/2336398668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada40abb10 con 0x7fadb4158c20 2023-12-18T10:23:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb9725640 1 -- 172.21.15.133:0/2336398668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 msgr2=0x7fadb4070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb9725640 1 --2- 172.21.15.133:0/2336398668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4070510 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fadb40c53c0 tx=0x7fada401ce60 comp rx=0 tx=0).stop 2023-12-18T10:23:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb9725640 1 -- 172.21.15.133:0/2336398668 shutdown_connections 2023-12-18T10:23:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb9725640 1 --2- 172.21.15.133:0/2336398668 >> v2:172.21.15.142:3300/0 conn(0x7fadb40cb180 0x7fadb40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb9725640 1 --2- 172.21.15.133:0/2336398668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4070510 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb9725640 1 -- 172.21.15.133:0/2336398668 >> 172.21.15.133:0/2336398668 conn(0x7fadb406a3e0 msgr2=0x7fadb40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb9725640 1 -- 172.21.15.133:0/2336398668 shutdown_connections 2023-12-18T10:23:00.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.634+0000 7fadb9725640 1 -- 172.21.15.133:0/2336398668 wait complete. 2023-12-18T10:23:00.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 Processor -- start 2023-12-18T10:23:00.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 -- start start 2023-12-18T10:23:00.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadb40cb180 0x7fadb40c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadb415c800 0x7fadb40c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb41540b0 con 0x7fadb4158c20 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40c5ac0 con 0x7fadb415c800 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40c5da0 con 0x7fadb40cb180 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45172/0 (socket says 172.21.15.133:45172) 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 -- 172.21.15.133:0/2240621100 learned_addr learned my addr 172.21.15.133:0/2240621100 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb2ffd640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadb40cb180 0x7fadb40c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb37fe640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadb415c800 0x7fadb40c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 -- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadb40cb180 msgr2=0x7fadb40c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadb40cb180 0x7fadb40c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 -- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadb415c800 msgr2=0x7fadb40c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadb415c800 0x7fadb40c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 -- 172.21.15.133:0/2240621100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada40094d0 con 0x7fadb4158c20 2023-12-18T10:23:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb2ffd640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadb40cb180 0x7fadb40c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb37fe640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadb415c800 0x7fadb40c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadaa7fc640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4153b70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00ba50 tx=0x7fad9c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadabfff640 1 -- 172.21.15.133:0/2240621100 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00cbe0 con 0x7fadb4158c20 2023-12-18T10:23:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadabfff640 1 -- 172.21.15.133:0/2240621100 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c00cd80 con 0x7fadb4158c20 2023-12-18T10:23:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb40c8800 con 0x7fadb4158c20 2023-12-18T10:23:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadabfff640 1 -- 172.21.15.133:0/2240621100 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c014680 con 0x7fadb4158c20 2023-12-18T10:23:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb40c6360 con 0x7fadb4158c20 2023-12-18T10:23:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.638+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb40735b0 con 0x7fadb4158c20 2023-12-18T10:23:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.642+0000 7fadabfff640 1 -- 172.21.15.133:0/2240621100 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fad9c0147e0 con 0x7fadb4158c20 2023-12-18T10:23:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.642+0000 7fadabfff640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fad94065a60 0x7fad94067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.642+0000 7fadabfff640 1 -- 172.21.15.133:0/2240621100 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fad9c0832a0 con 0x7fadb4158c20 2023-12-18T10:23:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.642+0000 7fadb2ffd640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fad94065a60 0x7fad94067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.642+0000 7fadb2ffd640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fad94065a60 0x7fad94067f20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fada40af000 tx=0x7fada4004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:00.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.646+0000 7fadabfff640 1 -- 172.21.15.133:0/2240621100 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fad9c050aa0 con 0x7fadb4158c20 2023-12-18T10:23:00.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.826+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fadb40c6580 con 0x7fadb4158c20 2023-12-18T10:23:00.831 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:23:00.826+0000 7f3ba99e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-18T10:23:00.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadabfff640 1 -- 172.21.15.133:0/2240621100 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7fad9c0540c0 con 0x7fadb4158c20 2023-12-18T10:23:00.841 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-18T10:23:00.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fad94065a60 msgr2=0x7fad94067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fad94065a60 0x7fad94067f20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fada40af000 tx=0x7fada4004740 comp rx=0 tx=0).stop 2023-12-18T10:23:00.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 msgr2=0x7fadb4153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:00.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4153b70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00ba50 tx=0x7fad9c00bf10 comp rx=0 tx=0).stop 2023-12-18T10:23:00.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 shutdown_connections 2023-12-18T10:23:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fad94065a60 0x7fad94067f20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadb415c800 0x7fadb40c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadb4158c20 0x7fadb4153b70 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 --2- 172.21.15.133:0/2240621100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadb40cb180 0x7fadb40c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 >> 172.21.15.133:0/2240621100 conn(0x7fadb406a3e0 msgr2=0x7fadb4154230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 shutdown_connections 2023-12-18T10:23:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:00.838+0000 7fadb9725640 1 -- 172.21.15.133:0/2240621100 wait complete. 2023-12-18T10:23:00.855 INFO:tasks.ceph.mds.c.smithi133.stderr: -1429> 2023-12-18T10:22:23.674+0000 7fe0fcb2e640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-12-18T10:22:04.554184+0000 1=0+1) n(v2 rc2023-12-18T10:22:04.775215+0000 4=0+4) (inest lock) (iversion lock) caps={7050=pAsLsXsFs/-@8},l=7050 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x56339897d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.554184+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.775215+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.554184+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-12-18T10:22:04.775215+0000 4=0+4)","error_str":""},"return_code":-61} 2023-12-18T10:23:00.855 INFO:tasks.ceph.mds.c.smithi133.stderr: -1309> 2023-12-18T10:22:23.674+0000 7fe102b3a640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-12-18T10:22:04.556225+0000 1=0+1) n(v1 rc2023-12-18T10:22:04.775215+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={7050=pAsLsXsFs/-@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x56339897d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.556225+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.558575+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.556225+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-12-18T10:22:04.775215+0000 3=0+3)","error_str":""},"return_code":-61} 2023-12-18T10:23:00.864 INFO:tasks.ceph.mds.d.smithi142.stderr: -1317> 2023-12-18T10:22:23.679+0000 7f8a45416640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-12-18T10:22:04.558575+0000 1=0+1) n(v0 rc2023-12-18T10:22:04.558575+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={7050=pAsLsXsFsx/-@6},l=7050 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5648b8991600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.558575+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.558575+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.558575+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-18T10:22:04.558575+0000 2=0+2)","error_str":""},"return_code":-61} 2023-12-18T10:23:00.864 INFO:tasks.ceph.mds.d.smithi142.stderr: -1297> 2023-12-18T10:22:23.679+0000 7f8a45416640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (iversion lock) caps={7050=pAsLsXsFs/-@3},l=7050 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5648b8991b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-12-18T10:23:00.866 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-18T10:23:00.875 INFO:tasks.ceph.mds.b.smithi142.stderr: -3346> 2023-12-18T10:22:23.679+0000 7f2b3999d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-12-18T10:22:04.549519+0000 1=0+1) n(v3 rc2023-12-18T10:22:04.775215+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={7050=pAsLsXsFsx/AsLsXsFsx@9},l=7050 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55aa761cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.549519+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.775215+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.549519+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-12-18T10:22:04.775215+0000 6=0+6)","error_str":""},"return_code":-61} 2023-12-18T10:23:00.876 INFO:tasks.ceph.mds.b.smithi142.stderr: -3243> 2023-12-18T10:22:23.679+0000 7f2b3f9a9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-12-18T10:22:04.551742+0000 1=0+1) n(v4 rc2023-12-18T10:22:04.775215+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={7050=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55aa761ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:22:04.551742+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:22:04.775215+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-12-18T10:22:04.551742+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-12-18T10:22:04.775215+0000 5=0+5)","error_str":""},"return_code":-61} 2023-12-18T10:23:00.898 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:23:00.914 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:23:00.925 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:23:01.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.002+0000 7f8e93d39640 1 Processor -- start 2023-12-18T10:23:01.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.002+0000 7f8e93d39640 1 -- start start 2023-12-18T10:23:01.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e93d39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e8c160a60 0x7f8e8c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:01.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e93d39640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c0ced50 con 0x7f8e8c165030 2023-12-18T10:23:01.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e93d39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c0cc980 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e93d39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c1654a0 con 0x7f8e8c160a60 2023-12-18T10:23:01.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e922d6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8e8c165030 0x7f8e8c0cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57824/0 (socket says 172.21.15.133:57824) 2023-12-18T10:23:01.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e922d6640 1 -- 172.21.15.133:0/808432724 learned_addr learned my addr 172.21.15.133:0/808432724 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:01.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e91ad5640 1 --2- 172.21.15.133:0/808432724 >> v2:172.21.15.142:3300/0 conn(0x7f8e8c160a60 0x7f8e8c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:01.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e90ad3640 1 -- 172.21.15.133:0/808432724 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819615460 0 0) 0x7f8e8c0ced50 con 0x7f8e8c165030 2023-12-18T10:23:01.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e90ad3640 1 -- 172.21.15.133:0/808432724 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e78003530 con 0x7f8e8c165030 2023-12-18T10:23:01.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e91ad5640 1 -- 172.21.15.133:0/808432724 >> v1:172.21.15.142:6789/0 conn(0x7f8e8c0ce8f0 legacy=0x7f8e8c164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:01.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e90ad3640 1 -- 172.21.15.133:0/808432724 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412876090 0 0) 0x7f8e8c0cc980 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e91ad5640 1 -- 172.21.15.133:0/808432724 >> v1:172.21.15.133:6789/0 conn(0x7f8e8c165030 legacy=0x7f8e8c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:01.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.006+0000 7f8e91ad5640 1 -- 172.21.15.133:0/808432724 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0cc090 con 0x7f8e8c160a60 2023-12-18T10:23:01.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.010+0000 7f8e91ad5640 1 --2- 172.21.15.133:0/808432724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 0x7f8e8c0ce3b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e880097c0 tx=0x7f8e8801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4860489cb0fe6393 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:01.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.010+0000 7f8e90ad3640 1 -- 172.21.15.133:0/808432724 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880ab650 con 0x7f8e8c160a60 2023-12-18T10:23:01.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.010+0000 7f8e90ad3640 1 -- 172.21.15.133:0/808432724 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880ab7b0 con 0x7f8e8c160a60 2023-12-18T10:23:01.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.010+0000 7f8e90ad3640 1 -- 172.21.15.133:0/808432724 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880abb40 con 0x7f8e8c160a60 2023-12-18T10:23:01.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- 172.21.15.133:0/808432724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 msgr2=0x7f8e8c0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:01.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 --2- 172.21.15.133:0/808432724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 0x7f8e8c0ce3b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e880097c0 tx=0x7f8e8801c450 comp rx=0 tx=0).stop 2023-12-18T10:23:01.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- 172.21.15.133:0/808432724 shutdown_connections 2023-12-18T10:23:01.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 --2- 172.21.15.133:0/808432724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 0x7f8e8c0ce3b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:01.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- 172.21.15.133:0/808432724 >> 172.21.15.133:0/808432724 conn(0x7f8e8c06a2a0 msgr2=0x7f8e8c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:01.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- 172.21.15.133:0/808432724 shutdown_connections 2023-12-18T10:23:01.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- 172.21.15.133:0/808432724 wait complete. 2023-12-18T10:23:01.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 Processor -- start 2023-12-18T10:23:01.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- start start 2023-12-18T10:23:01.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e8c0ce8f0 0x7f8e8c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:01.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 0x7f8e8c159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:01.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e8c165030 0x7f8e8c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:01.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c157b00 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0c5fc0 con 0x7f8e8c160a60 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e93d39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c156ee0 con 0x7f8e8c165030 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e91ad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e8c0ce8f0 0x7f8e8c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e91ad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e8c0ce8f0 0x7f8e8c1569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45190/0 (socket says 172.21.15.133:45190) 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e91ad5640 1 -- 172.21.15.133:0/1340485945 learned_addr learned my addr 172.21.15.133:0/1340485945 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e922d6640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e8c165030 0x7f8e8c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e912d4640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 0x7f8e8c159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e91ad5640 1 -- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e8c165030 msgr2=0x7f8e8c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e91ad5640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e8c165030 0x7f8e8c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e91ad5640 1 -- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 msgr2=0x7f8e8c159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e91ad5640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 0x7f8e8c159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:01.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e91ad5640 1 -- 172.21.15.133:0/1340485945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88009420 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.014+0000 7f8e922d6640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e8c165030 0x7f8e8c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:01.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e91ad5640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e8c0ce8f0 0x7f8e8c1569a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ad040 tx=0x7f8e8801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:01.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e827fc640 1 -- 172.21.15.133:0/1340485945 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880bf610 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e827fc640 1 -- 172.21.15.133:0/1340485945 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880bf770 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e827fc640 1 -- 172.21.15.133:0/1340485945 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880bfb00 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c1585f0 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c158030 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c04e000 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e827fc640 1 -- 172.21.15.133:0/1340485945 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e880b5400 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e827fc640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e70065a60 0x7f8e70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e827fc640 1 -- 172.21.15.133:0/1340485945 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6432+0+0 (secure 0 0 0) 0x7f8e8811df20 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e912d4640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e70065a60 0x7f8e70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.018+0000 7f8e912d4640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e70065a60 0x7f8e70067f20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c16cb00 tx=0x7f8e7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.022+0000 7f8e827fc640 1 -- 172.21.15.133:0/1340485945 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8e880eb640 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.210+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8e8c0c5d90 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e827fc640 1 -- 172.21.15.133:0/1340485945 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8e880eec60 con 0x7f8e8c0ce8f0 2023-12-18T10:23:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e70065a60 msgr2=0x7f8e70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e70065a60 0x7f8e70067f20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c16cb00 tx=0x7f8e7c009040 comp rx=0 tx=0).stop 2023-12-18T10:23:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e8c0ce8f0 msgr2=0x7f8e8c1569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e8c0ce8f0 0x7f8e8c1569a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ad040 tx=0x7f8e8801ac90 comp rx=0 tx=0).stop 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 shutdown_connections 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8e70065a60 0x7f8e70067f20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e8c165030 0x7f8e8c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8c160a60 0x7f8e8c159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 --2- 172.21.15.133:0/1340485945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e8c0ce8f0 0x7f8e8c1569a0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 >> 172.21.15.133:0/1340485945 conn(0x7f8e8c06a2a0 msgr2=0x7f8e8c0cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 shutdown_connections 2023-12-18T10:23:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:01.842+0000 7f8e93d39640 1 -- 172.21.15.133:0/1340485945 wait complete. 2023-12-18T10:23:01.870 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-18T10:23:02.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.054+0000 7f661f6d1640 1 Processor -- start 2023-12-18T10:23:02.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661f6d1640 1 -- start start 2023-12-18T10:23:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661f6d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66180d1480 0x7f66181674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661f6d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66180af360 con 0x7f661815cab0 2023-12-18T10:23:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661f6d1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66180ce6b0 con 0x7f66180d07c0 2023-12-18T10:23:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661f6d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661806ae90 con 0x7f66180d1480 2023-12-18T10:23:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661dc6e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66180d1480 0x7f66181674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661d46d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f661815cab0 0x7f66180cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57834/0 (socket says 172.21.15.133:57834) 2023-12-18T10:23:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661d46d640 1 -- 172.21.15.133:0/2815079088 learned_addr learned my addr 172.21.15.133:0/2815079088 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:02.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661dc6e640 1 -- 172.21.15.133:0/2815079088 >> v1:172.21.15.142:6789/0 conn(0x7f66180d07c0 legacy=0x7f66180d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:02.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661dc6e640 1 -- 172.21.15.133:0/2815079088 >> v1:172.21.15.133:6789/0 conn(0x7f661815cab0 legacy=0x7f66180cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:02.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.058+0000 7f661dc6e640 1 -- 172.21.15.133:0/2815079088 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661806b170 con 0x7f66180d1480 2023-12-18T10:23:02.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661dc6e640 1 --2- 172.21.15.133:0/2815079088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66180d1480 0x7f66181674c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f6610009d90 tx=0x7f661001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bf8e36cf27a60c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:02.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f660ffff640 1 -- 172.21.15.133:0/2815079088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100a5900 con 0x7f66180d1480 2023-12-18T10:23:02.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f660ffff640 1 -- 172.21.15.133:0/2815079088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100a5a60 con 0x7f66180d1480 2023-12-18T10:23:02.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f660ffff640 1 -- 172.21.15.133:0/2815079088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100a5df0 con 0x7f66180d1480 2023-12-18T10:23:02.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 -- 172.21.15.133:0/2815079088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66180d1480 msgr2=0x7f66181674c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:02.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 --2- 172.21.15.133:0/2815079088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66180d1480 0x7f66181674c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f6610009d90 tx=0x7f661001c950 comp rx=0 tx=0).stop 2023-12-18T10:23:02.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 -- 172.21.15.133:0/2815079088 shutdown_connections 2023-12-18T10:23:02.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 --2- 172.21.15.133:0/2815079088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66180d1480 0x7f66181674c0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:02.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 -- 172.21.15.133:0/2815079088 >> 172.21.15.133:0/2815079088 conn(0x7f6618089fb0 msgr2=0x7f66180d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:02.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 -- 172.21.15.133:0/2815079088 shutdown_connections 2023-12-18T10:23:02.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 -- 172.21.15.133:0/2815079088 wait complete. 2023-12-18T10:23:02.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 Processor -- start 2023-12-18T10:23:02.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.062+0000 7f661f6d1640 1 -- start start 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66180d07c0 0x7f6618150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66180d1480 0x7f66181f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f661815cab0 0x7f6618158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66181f92c0 con 0x7f661815cab0 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6618150a50 con 0x7f66180d07c0 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66180c9a20 con 0x7f66180d1480 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f661815cab0 0x7f6618158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f661815cab0 0x7f6618158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45206/0 (socket says 172.21.15.133:45206) 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 -- 172.21.15.133:0/4206191325 learned_addr learned my addr 172.21.15.133:0/4206191325 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:02.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661cc6c640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66180d1480 0x7f66181f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:02.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661d46d640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66180d07c0 0x7f6618150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:02.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 -- 172.21.15.133:0/4206191325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66180d1480 msgr2=0x7f66181f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:02.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66180d1480 0x7f66181f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:02.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 -- 172.21.15.133:0/4206191325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66180d07c0 msgr2=0x7f6618150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:02.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66180d07c0 0x7f6618150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:02.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 -- 172.21.15.133:0/4206191325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610009a70 con 0x7f661815cab0 2023-12-18T10:23:02.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661dc6e640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f661815cab0 0x7f6618158a50 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f661001a580 tx=0x7f66100196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:02.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f660dffb640 1 -- 172.21.15.133:0/4206191325 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100ad950 con 0x7f661815cab0 2023-12-18T10:23:02.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f660dffb640 1 -- 172.21.15.133:0/4206191325 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100adab0 con 0x7f661815cab0 2023-12-18T10:23:02.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66180c9d00 con 0x7f661815cab0 2023-12-18T10:23:02.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f660dffb640 1 -- 172.21.15.133:0/4206191325 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100ade40 con 0x7f661815cab0 2023-12-18T10:23:02.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66180c9fe0 con 0x7f661815cab0 2023-12-18T10:23:02.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.066+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66181f9430 con 0x7f661815cab0 2023-12-18T10:23:02.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.070+0000 7f660dffb640 1 -- 172.21.15.133:0/4206191325 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f66100b9450 con 0x7f661815cab0 2023-12-18T10:23:02.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.070+0000 7f660dffb640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65fc065a90 0x7f65fc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:02.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.070+0000 7f660dffb640 1 -- 172.21.15.133:0/4206191325 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6432+0+0 (secure 0 0 0) 0x7f661011e370 con 0x7f661815cab0 2023-12-18T10:23:02.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.070+0000 7f661d46d640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65fc065a90 0x7f65fc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:02.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.070+0000 7f661d46d640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65fc065a90 0x7f65fc067f50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6614005890 tx=0x7f6614009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:02.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.074+0000 7f660dffb640 1 -- 172.21.15.133:0/4206191325 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f66100ebc40 con 0x7f661815cab0 2023-12-18T10:23:02.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:02.222+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f661804e070 con 0x7f661815cab0 2023-12-18T10:23:03.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.026+0000 7f660dffb640 1 -- 172.21.15.133:0/4206191325 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7f66100ef260 con 0x7f661815cab0 2023-12-18T10:23:03.030 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65fc065a90 msgr2=0x7f65fc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65fc065a90 0x7f65fc067f50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6614005890 tx=0x7f6614009040 comp rx=0 tx=0).stop 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f661815cab0 msgr2=0x7f6618158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f661815cab0 0x7f6618158a50 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f661001a580 tx=0x7f66100196f0 comp rx=0 tx=0).stop 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 shutdown_connections 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65fc065a90 0x7f65fc067f50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f661815cab0 0x7f6618158a50 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66180d1480 0x7f66181f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 --2- 172.21.15.133:0/4206191325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66180d07c0 0x7f6618150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:03.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 >> 172.21.15.133:0/4206191325 conn(0x7f6618089fb0 msgr2=0x7f66180cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:03.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 shutdown_connections 2023-12-18T10:23:03.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.030+0000 7f661f6d1640 1 -- 172.21.15.133:0/4206191325 wait complete. 2023-12-18T10:23:03.058 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-18T10:23:03.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7627bce640 1 Processor -- start 2023-12-18T10:23:03.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7627bce640 1 -- start start 2023-12-18T10:23:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7627bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f762006d440 0x7f762006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7627bce640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76200b28a0 con 0x7f76200ce5d0 2023-12-18T10:23:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7627bce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762015ab30 con 0x7f76200ab190 2023-12-18T10:23:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7627bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200b1c90 con 0x7f762006d440 2023-12-18T10:23:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f762596a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f76200ce5d0 0x7f76200ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57836/0 (socket says 172.21.15.133:57836) 2023-12-18T10:23:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f762596a640 1 -- 172.21.15.133:0/1030023315 learned_addr learned my addr 172.21.15.133:0/1030023315 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7625169640 1 --2- 172.21.15.133:0/1030023315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f762006d440 0x7f762006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7624968640 1 -- 172.21.15.133:0/1030023315 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769048890 0 0) 0x7f76200b28a0 con 0x7f76200ce5d0 2023-12-18T10:23:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7624968640 1 -- 172.21.15.133:0/1030023315 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f760c003530 con 0x7f76200ce5d0 2023-12-18T10:23:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7624968640 1 -- 172.21.15.133:0/1030023315 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460101391 0 0) 0x7f762015ab30 con 0x7f76200ab190 2023-12-18T10:23:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7624968640 1 -- 172.21.15.133:0/1030023315 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76200b28a0 con 0x7f76200ab190 2023-12-18T10:23:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7625169640 1 -- 172.21.15.133:0/1030023315 >> v1:172.21.15.142:6789/0 conn(0x7f76200ab190 legacy=0x7f76200ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7625169640 1 -- 172.21.15.133:0/1030023315 >> v1:172.21.15.133:6789/0 conn(0x7f76200ce5d0 legacy=0x7f76200ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.198+0000 7f7625169640 1 -- 172.21.15.133:0/1030023315 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200b1f70 con 0x7f762006d440 2023-12-18T10:23:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7625169640 1 --2- 172.21.15.133:0/1030023315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f762006d440 0x7f762006d8a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f76100097f0 tx=0x7f761001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=371e487eeddaad8c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7624968640 1 -- 172.21.15.133:0/1030023315 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76100aa610 con 0x7f762006d440 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7624968640 1 -- 172.21.15.133:0/1030023315 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76100a6040 con 0x7f762006d440 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7624968640 1 -- 172.21.15.133:0/1030023315 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76100aa990 con 0x7f762006d440 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7627bce640 1 -- 172.21.15.133:0/1030023315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f762006d440 msgr2=0x7f762006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7627bce640 1 --2- 172.21.15.133:0/1030023315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f762006d440 0x7f762006d8a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f76100097f0 tx=0x7f761001c490 comp rx=0 tx=0).stop 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7627bce640 1 -- 172.21.15.133:0/1030023315 shutdown_connections 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7627bce640 1 --2- 172.21.15.133:0/1030023315 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f762006d440 0x7f762006d8a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7627bce640 1 -- 172.21.15.133:0/1030023315 >> 172.21.15.133:0/1030023315 conn(0x7f7620069e70 msgr2=0x7f762006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7627bce640 1 -- 172.21.15.133:0/1030023315 shutdown_connections 2023-12-18T10:23:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.202+0000 7f7627bce640 1 -- 172.21.15.133:0/1030023315 wait complete. 2023-12-18T10:23:03.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 Processor -- start 2023-12-18T10:23:03.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 -- start start 2023-12-18T10:23:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f762006d440 0x7f762015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200ab190 0x7f76200c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76200ce5d0 0x7f76200c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76201566d0 con 0x7f762006d440 2023-12-18T10:23:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76200cd8c0 con 0x7f76200ce5d0 2023-12-18T10:23:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200ccb00 con 0x7f76200ab190 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f762006d440 0x7f762015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f762006d440 0x7f762015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45208/0 (socket says 172.21.15.133:45208) 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 -- 172.21.15.133:0/2717295397 learned_addr learned my addr 172.21.15.133:0/2717295397 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7625169640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200ab190 0x7f76200c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762616b640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76200ce5d0 0x7f76200c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 -- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200ab190 msgr2=0x7f76200c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200ab190 0x7f76200c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 -- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76200ce5d0 msgr2=0x7f76200c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76200ce5d0 0x7f76200c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 -- 172.21.15.133:0/2717295397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7610009420 con 0x7f762006d440 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7625169640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200ab190 0x7f76200c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762616b640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76200ce5d0 0x7f76200c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f762596a640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f762006d440 0x7f762015a1f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f761c00c4d0 tx=0x7f761c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f76167fc640 1 -- 172.21.15.133:0/2717295397 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c005cf0 con 0x7f762006d440 2023-12-18T10:23:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f76167fc640 1 -- 172.21.15.133:0/2717295397 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c005e50 con 0x7f762006d440 2023-12-18T10:23:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f76167fc640 1 -- 172.21.15.133:0/2717295397 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c0072b0 con 0x7f762006d440 2023-12-18T10:23:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76200ccde0 con 0x7f762006d440 2023-12-18T10:23:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.206+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76200cd3a0 con 0x7f762006d440 2023-12-18T10:23:03.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.210+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762004e070 con 0x7f762006d440 2023-12-18T10:23:03.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.210+0000 7f76167fc640 1 -- 172.21.15.133:0/2717295397 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f761c007410 con 0x7f762006d440 2023-12-18T10:23:03.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.210+0000 7f76167fc640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7604065a60 0x7f7604067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:03.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.210+0000 7f76167fc640 1 -- 172.21.15.133:0/2717295397 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5965+0+0 (secure 0 0 0) 0x7f761c0828d0 con 0x7f762006d440 2023-12-18T10:23:03.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.210+0000 7f7625169640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7604065a60 0x7f7604067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:03.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.210+0000 7f7625169640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7604065a60 0x7f7604067f20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f76100ae000 tx=0x7f76100a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:03.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.214+0000 7f76167fc640 1 -- 172.21.15.133:0/2717295397 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f761c050180 con 0x7f762006d440 2023-12-18T10:23:03.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:03.366+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f762006c630 con 0x7f762006d440 2023-12-18T10:23:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.042+0000 7f76167fc640 1 -- 172.21.15.133:0/2717295397 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7f761c017020 con 0x7f762006d440 2023-12-18T10:23:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-18T10:23:04.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7604065a60 msgr2=0x7f7604067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7604065a60 0x7f7604067f20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f76100ae000 tx=0x7f76100a7000 comp rx=0 tx=0).stop 2023-12-18T10:23:04.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f762006d440 msgr2=0x7f762015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f762006d440 0x7f762015a1f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f761c00c4d0 tx=0x7f761c00c990 comp rx=0 tx=0).stop 2023-12-18T10:23:04.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 shutdown_connections 2023-12-18T10:23:04.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7604065a60 0x7f7604067f20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76200ce5d0 0x7f76200c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76200ab190 0x7f76200c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 --2- 172.21.15.133:0/2717295397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f762006d440 0x7f762015a1f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 >> 172.21.15.133:0/2717295397 conn(0x7f7620069e70 msgr2=0x7f762006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:04.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 shutdown_connections 2023-12-18T10:23:04.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.046+0000 7f7627bce640 1 -- 172.21.15.133:0/2717295397 wait complete. 2023-12-18T10:23:04.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-18T10:23:04.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.210+0000 7f7839b09640 1 Processor -- start 2023-12-18T10:23:04.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.210+0000 7f7839b09640 1 -- start start 2023-12-18T10:23:04.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f7839b09640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7834153020 0x7f78340c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f7839b09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f78340ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f7839b09640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78340c9730 con 0x7f78340ce8d0 2023-12-18T10:23:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f7839b09640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78340ced60 con 0x7f7834153020 2023-12-18T10:23:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f7839b09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c8e00 con 0x7f78341598d0 2023-12-18T10:23:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f78337fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7834153020 0x7f78340c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f782bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f78340ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f78337fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7834153020 0x7f78340c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:44110/0 (socket says 172.21.15.133:44110) 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f782bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f78340ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:42950/0 (socket says 172.21.15.133:42950) 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f78337fe640 1 -- 172.21.15.133:0/118719455 learned_addr learned my addr 172.21.15.133:0/118719455 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f78337fe640 1 -- 172.21.15.133:0/118719455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 msgr2=0x7f78340ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f78337fe640 1 --2- 172.21.15.133:0/118719455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f78340ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f78337fe640 1 -- 172.21.15.133:0/118719455 >> v1:172.21.15.142:6789/0 conn(0x7f78340ce8d0 legacy=0x7f7834070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f78337fe640 1 -- 172.21.15.133:0/118719455 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78340c90e0 con 0x7f7834153020 2023-12-18T10:23:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.214+0000 7f782bfff640 1 --2- 172.21.15.133:0/118719455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f78340ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:04.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f78337fe640 1 --2- 172.21.15.133:0/118719455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7834153020 0x7f78340c9bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7824009870 tx=0x7f782401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e508682881be9246 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7832ffd640 1 -- 172.21.15.133:0/118719455 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240ac410 con 0x7f7834153020 2023-12-18T10:23:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7832ffd640 1 -- 172.21.15.133:0/118719455 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78240ac570 con 0x7f7834153020 2023-12-18T10:23:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7832ffd640 1 -- 172.21.15.133:0/118719455 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240ac900 con 0x7f7834153020 2023-12-18T10:23:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 -- 172.21.15.133:0/118719455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7834153020 msgr2=0x7f78340c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 --2- 172.21.15.133:0/118719455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7834153020 0x7f78340c9bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7824009870 tx=0x7f782401c3f0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 -- 172.21.15.133:0/118719455 shutdown_connections 2023-12-18T10:23:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 --2- 172.21.15.133:0/118719455 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f78340ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 --2- 172.21.15.133:0/118719455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7834153020 0x7f78340c9bc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 -- 172.21.15.133:0/118719455 >> 172.21.15.133:0/118719455 conn(0x7f783406a2a0 msgr2=0x7f78340aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 -- 172.21.15.133:0/118719455 shutdown_connections 2023-12-18T10:23:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 -- 172.21.15.133:0/118719455 wait complete. 2023-12-18T10:23:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 Processor -- start 2023-12-18T10:23:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.218+0000 7f7839b09640 1 -- start start 2023-12-18T10:23:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340ce8d0 0x7f7834148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834153020 0x7f78340c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f7834157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c4480 con 0x7f7834153020 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7834167120 con 0x7f78340ce8d0 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340c3b50 con 0x7f78341598d0 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834153020 0x7f78340c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834153020 0x7f78340c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45214/0 (socket says 172.21.15.133:45214) 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 -- 172.21.15.133:0/585239133 learned_addr learned my addr 172.21.15.133:0/585239133 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f78337fe640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340ce8d0 0x7f7834148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7833fff640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f7834157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 -- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 msgr2=0x7f7834157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f7834157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 -- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340ce8d0 msgr2=0x7f7834148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340ce8d0 0x7f7834148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 -- 172.21.15.133:0/585239133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c009420 con 0x7f7834153020 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7833fff640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f7834157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f782bfff640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834153020 0x7f78340c4910 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f781c00e980 tx=0x7f781c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7830ff9640 1 -- 172.21.15.133:0/585239133 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00ca00 con 0x7f7834153020 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7830ff9640 1 -- 172.21.15.133:0/585239133 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c00cb60 con 0x7f7834153020 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7830ff9640 1 -- 172.21.15.133:0/585239133 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c013470 con 0x7f7834153020 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78240094d0 con 0x7f7834153020 2023-12-18T10:23:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78340c4110 con 0x7f7834153020 2023-12-18T10:23:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.222+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783414d700 con 0x7f7834153020 2023-12-18T10:23:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.226+0000 7f7830ff9640 1 -- 172.21.15.133:0/585239133 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f781c0135d0 con 0x7f7834153020 2023-12-18T10:23:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.226+0000 7f7830ff9640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7814065a60 0x7f7814067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.226+0000 7f7830ff9640 1 -- 172.21.15.133:0/585239133 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f781c083400 con 0x7f7834153020 2023-12-18T10:23:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.226+0000 7f78337fe640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7814065a60 0x7f7814067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.226+0000 7f78337fe640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7814065a60 0x7f7814067f20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f78240ae000 tx=0x7f7824008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.230+0000 7f7830ff9640 1 -- 172.21.15.133:0/585239133 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f781c050da0 con 0x7f7834153020 2023-12-18T10:23:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.378+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f783404e000 con 0x7f7834153020 2023-12-18T10:23:04.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.382+0000 7f7830ff9640 1 -- 172.21.15.133:0/585239133 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f781c0543c0 con 0x7f7834153020 2023-12-18T10:23:04.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7814065a60 msgr2=0x7f7814067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7814065a60 0x7f7814067f20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f78240ae000 tx=0x7f7824008040 comp rx=0 tx=0).stop 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834153020 msgr2=0x7f78340c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834153020 0x7f78340c4910 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f781c00e980 tx=0x7f781c00ee40 comp rx=0 tx=0).stop 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 shutdown_connections 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7814065a60 0x7f7814067f20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78341598d0 0x7f7834157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834153020 0x7f78340c4910 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 --2- 172.21.15.133:0/585239133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78340ce8d0 0x7f7834148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 >> 172.21.15.133:0/585239133 conn(0x7f783406a2a0 msgr2=0x7f783415a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 shutdown_connections 2023-12-18T10:23:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.386+0000 7f7839b09640 1 -- 172.21.15.133:0/585239133 wait complete. 2023-12-18T10:23:04.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2023-12-18T10:23:04.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f6302b60640 1 Processor -- start 2023-12-18T10:23:04.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f6302b60640 1 -- start start 2023-12-18T10:23:04.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f6302b60640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62fc15c9d0 0x7f62fc0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f6302b60640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f62fc0cdd40 0x7f62fc160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f6302b60640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62fc160690 con 0x7f62fc161060 2023-12-18T10:23:04.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f6302b60640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62fc1603f0 con 0x7f62fc15c9d0 2023-12-18T10:23:04.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f6302b60640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62fc0b0d80 con 0x7f62fc0cdd40 2023-12-18T10:23:04.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f63008fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62fc15c9d0 0x7f62fc0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f63010fd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f62fc161060 0x7f62fc06fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57846/0 (socket says 172.21.15.133:57846) 2023-12-18T10:23:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.554+0000 7f63010fd640 1 -- 172.21.15.133:0/3630546031 learned_addr learned my addr 172.21.15.133:0/3630546031 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f62fbfff640 1 --2- 172.21.15.133:0/3630546031 >> v2:172.21.15.142:3300/0 conn(0x7f62fc0cdd40 0x7f62fc160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f63008fc640 1 -- 172.21.15.133:0/3630546031 >> v2:172.21.15.142:3300/0 conn(0x7f62fc0cdd40 msgr2=0x7f62fc160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f63008fc640 1 --2- 172.21.15.133:0/3630546031 >> v2:172.21.15.142:3300/0 conn(0x7f62fc0cdd40 0x7f62fc160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f63008fc640 1 -- 172.21.15.133:0/3630546031 >> v1:172.21.15.133:6789/0 conn(0x7f62fc161060 legacy=0x7f62fc06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f62fb7fe640 1 -- 172.21.15.133:0/3630546031 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244129023 0 0) 0x7f62fc160690 con 0x7f62fc161060 2023-12-18T10:23:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f63008fc640 1 -- 172.21.15.133:0/3630546031 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc0ccb00 con 0x7f62fc15c9d0 2023-12-18T10:23:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f62fbfff640 1 --2- 172.21.15.133:0/3630546031 >> v2:172.21.15.142:3300/0 conn(0x7f62fc0cdd40 0x7f62fc160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f63008fc640 1 --2- 172.21.15.133:0/3630546031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc15c9d0 0x7f62fc0cc400 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0c8ad0 tx=0x7f62f001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d47a20c3ea2b3ce server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:04.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f62fb7fe640 1 -- 172.21.15.133:0/3630546031 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00ab5f0 con 0x7f62fc15c9d0 2023-12-18T10:23:04.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f62fb7fe640 1 -- 172.21.15.133:0/3630546031 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f00ab750 con 0x7f62fc15c9d0 2023-12-18T10:23:04.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.558+0000 7f62fb7fe640 1 -- 172.21.15.133:0/3630546031 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00abae0 con 0x7f62fc15c9d0 2023-12-18T10:23:04.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- 172.21.15.133:0/3630546031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc15c9d0 msgr2=0x7f62fc0cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 --2- 172.21.15.133:0/3630546031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc15c9d0 0x7f62fc0cc400 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0c8ad0 tx=0x7f62f001c3d0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- 172.21.15.133:0/3630546031 shutdown_connections 2023-12-18T10:23:04.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 --2- 172.21.15.133:0/3630546031 >> v2:172.21.15.142:3300/0 conn(0x7f62fc0cdd40 0x7f62fc160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 --2- 172.21.15.133:0/3630546031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc15c9d0 0x7f62fc0cc400 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- 172.21.15.133:0/3630546031 >> 172.21.15.133:0/3630546031 conn(0x7f62fc06a3e0 msgr2=0x7f62fc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:04.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- 172.21.15.133:0/3630546031 shutdown_connections 2023-12-18T10:23:04.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- 172.21.15.133:0/3630546031 wait complete. 2023-12-18T10:23:04.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 Processor -- start 2023-12-18T10:23:04.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- start start 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc0cdd40 0x7f62fc1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62fc15c9d0 0x7f62fc14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62fc161060 0x7f62fc0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc15ae80 con 0x7f62fc0cdd40 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc15a9f0 con 0x7f62fc15c9d0 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f6302b60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc0acd10 con 0x7f62fc161060 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63008fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc0cdd40 0x7f62fc1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63008fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc0cdd40 0x7f62fc1596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45224/0 (socket says 172.21.15.133:45224) 2023-12-18T10:23:04.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63008fc640 1 -- 172.21.15.133:0/4217705476 learned_addr learned my addr 172.21.15.133:0/4217705476 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f62fbfff640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62fc15c9d0 0x7f62fc14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63010fd640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62fc161060 0x7f62fc0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63008fc640 1 -- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62fc161060 msgr2=0x7f62fc0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63008fc640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62fc161060 0x7f62fc0ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63008fc640 1 -- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62fc15c9d0 msgr2=0x7f62fc14b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63008fc640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62fc15c9d0 0x7f62fc14b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63008fc640 1 -- 172.21.15.133:0/4217705476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0009420 con 0x7f62fc0cdd40 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f62fbfff640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62fc15c9d0 0x7f62fc14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.562+0000 7f63010fd640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62fc161060 0x7f62fc0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f63008fc640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc0cdd40 0x7f62fc1596e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f62f0018fe0 tx=0x7f62f001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f62f97fa640 1 -- 172.21.15.133:0/4217705476 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00b5810 con 0x7f62fc0cdd40 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f62f97fa640 1 -- 172.21.15.133:0/4217705476 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f00b5990 con 0x7f62fc0cdd40 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62fc159de0 con 0x7f62fc0cdd40 2023-12-18T10:23:04.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f62f97fa640 1 -- 172.21.15.133:0/4217705476 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00b5d40 con 0x7f62fc0cdd40 2023-12-18T10:23:04.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62fc15a3a0 con 0x7f62fc0cdd40 2023-12-18T10:23:04.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62fc0735b0 con 0x7f62fc0cdd40 2023-12-18T10:23:04.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f62f97fa640 1 -- 172.21.15.133:0/4217705476 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f62f00c83f0 con 0x7f62fc0cdd40 2023-12-18T10:23:04.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f62f97fa640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e0065a90 0x7f62e0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:04.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f62f97fa640 1 -- 172.21.15.133:0/4217705476 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f62f00a8050 con 0x7f62fc0cdd40 2023-12-18T10:23:04.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f62fbfff640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e0065a90 0x7f62e0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:04.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.566+0000 7f62fbfff640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e0065a90 0x7f62e0067f50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f62e8006fd0 tx=0x7f62e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:04.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.570+0000 7f62f97fa640 1 -- 172.21.15.133:0/4217705476 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f62f00eb850 con 0x7f62fc0cdd40 2023-12-18T10:23:04.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:04.770+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) v1 -- 0x7f62fc04e000 con 0x7f62fc0cdd40 2023-12-18T10:23:05.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.042+0000 7f62f97fa640 1 -- 172.21.15.133:0/4217705476 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v267) v1 ==== 142+0+0 (secure 0 0 0) 0x7f62f00ab5b0 con 0x7f62fc0cdd40 2023-12-18T10:23:05.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.042+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e0065a90 msgr2=0x7f62e0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:05.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.042+0000 7f6302b60640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e0065a90 0x7f62e0067f50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f62e8006fd0 tx=0x7f62e8008040 comp rx=0 tx=0).stop 2023-12-18T10:23:05.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.042+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc0cdd40 msgr2=0x7f62fc1596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:05.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.042+0000 7f6302b60640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc0cdd40 0x7f62fc1596e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f62f0018fe0 tx=0x7f62f001ac10 comp rx=0 tx=0).stop 2023-12-18T10:23:05.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.046+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 shutdown_connections 2023-12-18T10:23:05.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.046+0000 7f6302b60640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e0065a90 0x7f62e0067f50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.046+0000 7f6302b60640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62fc161060 0x7f62fc0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.046+0000 7f6302b60640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62fc15c9d0 0x7f62fc14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.046+0000 7f6302b60640 1 --2- 172.21.15.133:0/4217705476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62fc0cdd40 0x7f62fc1596e0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.046+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 >> 172.21.15.133:0/4217705476 conn(0x7f62fc06a3e0 msgr2=0x7f62fc15bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:05.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.046+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 shutdown_connections 2023-12-18T10:23:05.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.046+0000 7f6302b60640 1 -- 172.21.15.133:0/4217705476 wait complete. 2023-12-18T10:23:05.068 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-12-18T10:23:05.068 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-12-18T10:23:05.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2023-12-18T10:23:05.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde47998640 1 Processor -- start 2023-12-18T10:23:05.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde47998640 1 -- start start 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde47998640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 0x7fde400cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde47998640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde40160690 con 0x7fde400cdd40 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde47998640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde400b0d80 con 0x7fde4006fdb0 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde47998640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde401603f0 con 0x7fde4015c9d0 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde44f33640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fde400cdd40 0x7fde40160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57854/0 (socket says 172.21.15.133:57854) 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde44f33640 1 -- 172.21.15.133:0/1154412292 learned_addr learned my addr 172.21.15.133:0/1154412292 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.202+0000 7fde45734640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 0x7fde400cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195261579 0 0) 0x7fde40160690 con 0x7fde400cdd40 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde2c003530 con 0x7fde400cdd40 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362775950 0 0) 0x7fde2c003530 con 0x7fde400cdd40 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 msgr2=0x7fde400cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 0x7fde400cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 >> v1:172.21.15.142:6789/0 conn(0x7fde4006fdb0 legacy=0x7fde400cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde400ccb00 con 0x7fde400cdd40 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fde30001680 con 0x7fde400cdd40 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45734640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 0x7fde400cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 >> v1:172.21.15.133:6789/0 conn(0x7fde400cdd40 legacy=0x7fde40160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde2c0039b0 0x7fde2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde2c0047d0 0x7fde2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 0x7fde2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde401603f0 con 0x7fde2c0039b0 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c00ba40 con 0x7fde2c0047d0 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c00bbb0 con 0x7fde4015c9d0 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45734640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde2c0039b0 0x7fde2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde44f33640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde2c0047d0 0x7fde2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45f35640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 0x7fde2c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45734640 1 -- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 msgr2=0x7fde2c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:05.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45734640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde4015c9d0 0x7fde2c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45734640 1 -- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde2c0047d0 msgr2=0x7fde2c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:05.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45734640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde2c0047d0 0x7fde2c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45734640 1 -- 172.21.15.133:0/1154412292 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c009420 con 0x7fde2c0039b0 2023-12-18T10:23:05.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde44f33640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde2c0047d0 0x7fde2c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:05.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.206+0000 7fde45734640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde2c0039b0 0x7fde2c003dd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009c80 tx=0x7fde3c01cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1d531ac0019ad8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:05.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0a5740 con 0x7fde2c0039b0 2023-12-18T10:23:05.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c0a58a0 con 0x7fde2c0039b0 2023-12-18T10:23:05.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde37fff640 1 -- 172.21.15.133:0/1154412292 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0a5c50 con 0x7fde2c0039b0 2023-12-18T10:23:05.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- 172.21.15.133:0/1154412292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde2c0039b0 msgr2=0x7fde2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:05.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 --2- 172.21.15.133:0/1154412292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde2c0039b0 0x7fde2c003dd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009c80 tx=0x7fde3c01cb30 comp rx=0 tx=0).stop 2023-12-18T10:23:05.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde45f35640 1 -- 172.21.15.133:0/1154412292 reap_dead start 2023-12-18T10:23:05.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- 172.21.15.133:0/1154412292 shutdown_connections 2023-12-18T10:23:05.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- 172.21.15.133:0/1154412292 >> 172.21.15.133:0/1154412292 conn(0x7fde4006a3e0 msgr2=0x7fde400afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:05.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- 172.21.15.133:0/1154412292 shutdown_connections 2023-12-18T10:23:05.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- 172.21.15.133:0/1154412292 wait complete. 2023-12-18T10:23:05.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 Processor -- start 2023-12-18T10:23:05.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- start start 2023-12-18T10:23:05.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde2c0039b0 0x7fde400c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:05.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde4014e280 0x7fde4014d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4014d790 0x7fde40158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde400c8320 con 0x7fde4014e280 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4014d090 con 0x7fde4014d790 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde47998640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde400c7a80 con 0x7fde2c0039b0 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.210+0000 7fde44f33640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde4014e280 0x7fde4014d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde44f33640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde4014e280 0x7fde4014d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45242/0 (socket says 172.21.15.133:45242) 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde44f33640 1 -- 172.21.15.133:0/186748308 learned_addr learned my addr 172.21.15.133:0/186748308 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde45734640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde2c0039b0 0x7fde400c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde45f35640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4014d790 0x7fde40158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde44f33640 1 -- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde2c0039b0 msgr2=0x7fde400c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde44f33640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde2c0039b0 0x7fde400c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde44f33640 1 -- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4014d790 msgr2=0x7fde40158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde44f33640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4014d790 0x7fde40158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde44f33640 1 -- 172.21.15.133:0/186748308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde401613b0 con 0x7fde4014e280 2023-12-18T10:23:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde45f35640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4014d790 0x7fde40158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde44f33640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde4014e280 0x7fde4014d250 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fde30000f70 tx=0x7fde3000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde35ffb640 1 -- 172.21.15.133:0/186748308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3000c8d0 con 0x7fde4014e280 2023-12-18T10:23:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde35ffb640 1 -- 172.21.15.133:0/186748308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3000ca30 con 0x7fde4014e280 2023-12-18T10:23:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde35ffb640 1 -- 172.21.15.133:0/186748308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3000cda0 con 0x7fde4014e280 2023-12-18T10:23:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde400c7d60 con 0x7fde4014e280 2023-12-18T10:23:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde40158910 con 0x7fde4014e280 2023-12-18T10:23:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde400735b0 con 0x7fde4014e280 2023-12-18T10:23:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde35ffb640 1 -- 172.21.15.133:0/186748308 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde3001d460 con 0x7fde4014e280 2023-12-18T10:23:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde35ffb640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde24065a60 0x7fde24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.214+0000 7fde35ffb640 1 -- 172.21.15.133:0/186748308 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fde300830c0 con 0x7fde4014e280 2023-12-18T10:23:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.218+0000 7fde45734640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde24065a60 0x7fde24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:05.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.218+0000 7fde45734640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde24065a60 0x7fde24067f20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0af000 tx=0x7fde3c0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:05.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.222+0000 7fde35ffb640 1 -- 172.21.15.133:0/186748308 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fde30050b90 con 0x7fde4014e280 2023-12-18T10:23:05.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:05.426+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) v1 -- 0x7fde40158770 con 0x7fde4014e280 2023-12-18T10:23:06.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde35ffb640 1 -- 172.21.15.133:0/186748308 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v268) v1 ==== 144+0+0 (secure 0 0 0) 0x7fde40158770 con 0x7fde4014e280 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde24065a60 msgr2=0x7fde24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde24065a60 0x7fde24067f20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0af000 tx=0x7fde3c0046d0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde4014e280 msgr2=0x7fde4014d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde4014e280 0x7fde4014d250 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fde30000f70 tx=0x7fde3000ed50 comp rx=0 tx=0).stop 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 shutdown_connections 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde24065a60 0x7fde24067f20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde4014d790 0x7fde40158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde4014e280 0x7fde4014d250 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 --2- 172.21.15.133:0/186748308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde2c0039b0 0x7fde400c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 >> 172.21.15.133:0/186748308 conn(0x7fde4006a3e0 msgr2=0x7fde4015bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 shutdown_connections 2023-12-18T10:23:06.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.054+0000 7fde47998640 1 -- 172.21.15.133:0/186748308 wait complete. 2023-12-18T10:23:06.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-18T10:23:06.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f520cc66640 1 Processor -- start 2023-12-18T10:23:06.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f520cc66640 1 -- start start 2023-12-18T10:23:06.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f520cc66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52080ca410 0x7f5208159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f520cc66640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5208159fb0 0x7f5208071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f520cc66640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5208070df0 con 0x7f5208071db0 2023-12-18T10:23:06.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f520cc66640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520815aab0 con 0x7f5208159fb0 2023-12-18T10:23:06.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f520cc66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520815a4f0 con 0x7f52080ca410 2023-12-18T10:23:06.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f5206d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5208071db0 0x7f52080cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57860/0 (socket says 172.21.15.133:57860) 2023-12-18T10:23:06.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f5206d9d640 1 -- 172.21.15.133:0/2117851129 learned_addr learned my addr 172.21.15.133:0/2117851129 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f51fdd9b640 1 --2- 172.21.15.133:0/2117851129 >> v2:172.21.15.133:3300/0 conn(0x7f5208159fb0 0x7f5208071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f520659c640 1 --2- 172.21.15.133:0/2117851129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52080ca410 0x7f5208159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f5205d9b640 1 -- 172.21.15.133:0/2117851129 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809153461 0 0) 0x7f5208070df0 con 0x7f5208071db0 2023-12-18T10:23:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f5205d9b640 1 -- 172.21.15.133:0/2117851129 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f4003530 con 0x7f5208071db0 2023-12-18T10:23:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f51fdd9b640 1 -- 172.21.15.133:0/2117851129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52080ca410 msgr2=0x7f5208159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f51fdd9b640 1 --2- 172.21.15.133:0/2117851129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52080ca410 0x7f5208159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f51fdd9b640 1 -- 172.21.15.133:0/2117851129 >> v1:172.21.15.133:6789/0 conn(0x7f5208071db0 legacy=0x7f52080cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.218+0000 7f51fdd9b640 1 -- 172.21.15.133:0/2117851129 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520815a7d0 con 0x7f5208159fb0 2023-12-18T10:23:06.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f51fdd9b640 1 --2- 172.21.15.133:0/2117851129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208159fb0 0x7f5208071870 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f51f80097c0 tx=0x7f51f801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c618096b8fc81742 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:06.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f5205d9b640 1 -- 172.21.15.133:0/2117851129 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80ab650 con 0x7f5208159fb0 2023-12-18T10:23:06.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f5205d9b640 1 -- 172.21.15.133:0/2117851129 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80ab7b0 con 0x7f5208159fb0 2023-12-18T10:23:06.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f5205d9b640 1 -- 172.21.15.133:0/2117851129 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80abb40 con 0x7f5208159fb0 2023-12-18T10:23:06.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f520cc66640 1 -- 172.21.15.133:0/2117851129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208159fb0 msgr2=0x7f5208071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f520cc66640 1 --2- 172.21.15.133:0/2117851129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208159fb0 0x7f5208071870 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f51f80097c0 tx=0x7f51f801c450 comp rx=0 tx=0).stop 2023-12-18T10:23:06.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f520cc66640 1 -- 172.21.15.133:0/2117851129 shutdown_connections 2023-12-18T10:23:06.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f520cc66640 1 --2- 172.21.15.133:0/2117851129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208159fb0 0x7f5208071870 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f520cc66640 1 --2- 172.21.15.133:0/2117851129 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52080ca410 0x7f5208159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f520cc66640 1 -- 172.21.15.133:0/2117851129 >> 172.21.15.133:0/2117851129 conn(0x7f520806a2a0 msgr2=0x7f52080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:06.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f520cc66640 1 -- 172.21.15.133:0/2117851129 shutdown_connections 2023-12-18T10:23:06.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.222+0000 7f520cc66640 1 -- 172.21.15.133:0/2117851129 wait complete. 2023-12-18T10:23:06.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520cc66640 1 Processor -- start 2023-12-18T10:23:06.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520cc66640 1 -- start start 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520cc66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208071db0 0x7f52080c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520cc66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52080ca410 0x7f520815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520cc66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5208159fb0 0x7f5208157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520cc66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52080ae8c0 con 0x7f5208071db0 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520cc66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5208149060 con 0x7f52080ca410 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520cc66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52080aeab0 con 0x7f5208159fb0 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208071db0 0x7f52080c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208071db0 0x7f52080c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45250/0 (socket says 172.21.15.133:45250) 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 -- 172.21.15.133:0/2910012245 learned_addr learned my addr 172.21.15.133:0/2910012245 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:06.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f51fdd9b640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52080ca410 0x7f520815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f5206d9d640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5208159fb0 0x7f5208157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 -- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5208159fb0 msgr2=0x7f5208157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5208159fb0 0x7f5208157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 -- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52080ca410 msgr2=0x7f520815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52080ca410 0x7f520815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 -- 172.21.15.133:0/2910012245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8009420 con 0x7f5208071db0 2023-12-18T10:23:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f5206d9d640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5208159fb0 0x7f5208157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f520659c640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208071db0 0x7f52080c93b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f51f000e930 tx=0x7f51f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f51ff7fe640 1 -- 172.21.15.133:0/2910012245 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0009690 con 0x7f5208071db0 2023-12-18T10:23:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.226+0000 7f51ff7fe640 1 -- 172.21.15.133:0/2910012245 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f000ca00 con 0x7f5208071db0 2023-12-18T10:23:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f51ff7fe640 1 -- 172.21.15.133:0/2910012245 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f000cd70 con 0x7f5208071db0 2023-12-18T10:23:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52080aed90 con 0x7f5208071db0 2023-12-18T10:23:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5208149590 con 0x7f5208071db0 2023-12-18T10:23:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52080aefd0 con 0x7f5208071db0 2023-12-18T10:23:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f51ff7fe640 1 -- 172.21.15.133:0/2910012245 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51f0013470 con 0x7f5208071db0 2023-12-18T10:23:06.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f51ff7fe640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f51e8065a90 0x7f51e8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f51ff7fe640 1 -- 172.21.15.133:0/2910012245 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f51f00832d0 con 0x7f5208071db0 2023-12-18T10:23:06.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f51fdd9b640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f51e8065a90 0x7f51e8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.230+0000 7f51fdd9b640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f51e8065a90 0x7f51e8067f50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f51f80af000 tx=0x7f51f80b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:06.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.234+0000 7f51ff7fe640 1 -- 172.21.15.133:0/2910012245 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f51f0050e50 con 0x7f5208071db0 2023-12-18T10:23:06.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.382+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f520804e000 con 0x7f5208071db0 2023-12-18T10:23:06.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f51ff7fe640 1 -- 172.21.15.133:0/2910012245 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f51f0054470 con 0x7f5208071db0 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f51e8065a90 msgr2=0x7f51e8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f51e8065a90 0x7f51e8067f50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f51f80af000 tx=0x7f51f80b6040 comp rx=0 tx=0).stop 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208071db0 msgr2=0x7f52080c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208071db0 0x7f52080c93b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f51f000e930 tx=0x7f51f000edf0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 shutdown_connections 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f51e8065a90 0x7f51e8067f50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5208159fb0 0x7f5208157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52080ca410 0x7f520815ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 --2- 172.21.15.133:0/2910012245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5208071db0 0x7f52080c93b0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 >> 172.21.15.133:0/2910012245 conn(0x7f520806a2a0 msgr2=0x7f52081569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 shutdown_connections 2023-12-18T10:23:06.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.390+0000 7f520cc66640 1 -- 172.21.15.133:0/2910012245 wait complete. 2023-12-18T10:23:06.415 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:23:06.415 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:23:06.499 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:23:06.583 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:23:06.584 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:23:06.584 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:06.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:23:06.593 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:23:06.593 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:06.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:23:06.602 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:23:06.602 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:06.648 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:23:06.648 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:23:06.649 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:06.657 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:23:06.658 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-18T10:23:06.658 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:06.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.822+0000 7f04adde9640 1 Processor -- start 2023-12-18T10:23:06.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04adde9640 1 -- start start 2023-12-18T10:23:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04adde9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a80cac10 0x7f04a815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04adde9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a815f100 con 0x7f04a806fdb0 2023-12-18T10:23:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04adde9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a80ca7d0 con 0x7f04a815a680 2023-12-18T10:23:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04adde9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a815e860 con 0x7f04a80cac10 2023-12-18T10:23:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04a7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f04a806fdb0 0x7f04a80c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57866/0 (socket says 172.21.15.133:57866) 2023-12-18T10:23:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04a7fff640 1 -- 172.21.15.133:0/3505768947 learned_addr learned my addr 172.21.15.133:0/3505768947 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04a6ffd640 1 --2- 172.21.15.133:0/3505768947 >> v2:172.21.15.133:3300/0 conn(0x7f04a80cac10 0x7f04a815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04a6ffd640 1 -- 172.21.15.133:0/3505768947 >> v1:172.21.15.142:6789/0 conn(0x7f04a815a680 legacy=0x7f04a815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04a6ffd640 1 -- 172.21.15.133:0/3505768947 >> v1:172.21.15.133:6789/0 conn(0x7f04a806fdb0 legacy=0x7f04a80c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04a67fc640 1 -- 172.21.15.133:0/3505768947 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818732645 0 0) 0x7f04a80ca7d0 con 0x7f04a815a680 2023-12-18T10:23:06.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.826+0000 7f04a6ffd640 1 -- 172.21.15.133:0/3505768947 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a815eb40 con 0x7f04a80cac10 2023-12-18T10:23:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04a6ffd640 1 --2- 172.21.15.133:0/3505768947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a80cac10 0x7f04a815e160 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f049c0097c0 tx=0x7f049c01c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f466717111b3507 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:06.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04a67fc640 1 -- 172.21.15.133:0/3505768947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c0ab600 con 0x7f04a80cac10 2023-12-18T10:23:06.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04a67fc640 1 -- 172.21.15.133:0/3505768947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c0a7050 con 0x7f04a80cac10 2023-12-18T10:23:06.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04a67fc640 1 -- 172.21.15.133:0/3505768947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c0ab980 con 0x7f04a80cac10 2023-12-18T10:23:06.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04adde9640 1 -- 172.21.15.133:0/3505768947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a80cac10 msgr2=0x7f04a815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04adde9640 1 --2- 172.21.15.133:0/3505768947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a80cac10 0x7f04a815e160 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f049c0097c0 tx=0x7f049c01c280 comp rx=0 tx=0).stop 2023-12-18T10:23:06.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04adde9640 1 -- 172.21.15.133:0/3505768947 shutdown_connections 2023-12-18T10:23:06.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04adde9640 1 --2- 172.21.15.133:0/3505768947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a80cac10 0x7f04a815e160 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04adde9640 1 -- 172.21.15.133:0/3505768947 >> 172.21.15.133:0/3505768947 conn(0x7f04a806a3e0 msgr2=0x7f04a80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:06.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04adde9640 1 -- 172.21.15.133:0/3505768947 shutdown_connections 2023-12-18T10:23:06.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04adde9640 1 -- 172.21.15.133:0/3505768947 wait complete. 2023-12-18T10:23:06.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.830+0000 7f04adde9640 1 Processor -- start 2023-12-18T10:23:06.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 -- start start 2023-12-18T10:23:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a806fdb0 0x7f04a81f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80cac10 0x7f04a81576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04a815a680 0x7f04a80c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a81f6200 con 0x7f04a806fdb0 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80ad350 con 0x7f04a80cac10 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a81f1dd0 con 0x7f04a815a680 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a806fdb0 0x7f04a81f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a806fdb0 0x7f04a81f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45270/0 (socket says 172.21.15.133:45270) 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 -- 172.21.15.133:0/3113937439 learned_addr learned my addr 172.21.15.133:0/3113937439 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a7fff640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04a815a680 0x7f04a80c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a6ffd640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80cac10 0x7f04a81576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 -- 172.21.15.133:0/3113937439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04a815a680 msgr2=0x7f04a80c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04a815a680 0x7f04a80c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 -- 172.21.15.133:0/3113937439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80cac10 msgr2=0x7f04a81576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80cac10 0x7f04a81576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 -- 172.21.15.133:0/3113937439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c009420 con 0x7f04a806fdb0 2023-12-18T10:23:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04a77fe640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a806fdb0 0x7f04a81f5cc0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f049800c4d0 tx=0x7f049800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f048ffff640 1 -- 172.21.15.133:0/3113937439 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498005480 con 0x7f04a806fdb0 2023-12-18T10:23:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f048ffff640 1 -- 172.21.15.133:0/3113937439 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0498003600 con 0x7f04a806fdb0 2023-12-18T10:23:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f048ffff640 1 -- 172.21.15.133:0/3113937439 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980039b0 con 0x7f04a806fdb0 2023-12-18T10:23:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a81f20b0 con 0x7f04a806fdb0 2023-12-18T10:23:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a81f2670 con 0x7f04a806fdb0 2023-12-18T10:23:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a80735b0 con 0x7f04a806fdb0 2023-12-18T10:23:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.834+0000 7f048ffff640 1 -- 172.21.15.133:0/3113937439 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0498003b10 con 0x7f04a806fdb0 2023-12-18T10:23:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.838+0000 7f048ffff640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0494065a30 0x7f0494067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.838+0000 7f048ffff640 1 -- 172.21.15.133:0/3113937439 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f04980826c0 con 0x7f04a806fdb0 2023-12-18T10:23:06.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.838+0000 7f04a6ffd640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0494065a30 0x7f0494067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:06.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.838+0000 7f04a6ffd640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0494065a30 0x7f0494067ef0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f049c0ad000 tx=0x7f049c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:06.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:06.842+0000 7f048ffff640 1 -- 172.21.15.133:0/3113937439 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0498050250 con 0x7f04a806fdb0 2023-12-18T10:23:07.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04a804e000 con 0x7f04a806fdb0 2023-12-18T10:23:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f048ffff640 1 -- 172.21.15.133:0/3113937439 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f0498017020 con 0x7f04a806fdb0 2023-12-18T10:23:07.030 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:07.030 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6041,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3464304429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3464304429},{"type":"v1","addr":"172.21.15.133:6837","nonce":3464304429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3743273532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3743273532},{"type":"v1","addr":"172.21.15.142:6835","nonce":3743273532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/3940058998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":3940058998},{"type":"v1","addr":"172.21.15.142:6833","nonce":3940058998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7464,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1251815920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1251815920},{"type":"v1","addr":"172.21.15.133:6836","nonce":1251815920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-12-18T10:23:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 62 2023-12-18T10:23:07.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0494065a30 msgr2=0x7f0494067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:07.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0494065a30 0x7f0494067ef0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f049c0ad000 tx=0x7f049c0a6000 comp rx=0 tx=0).stop 2023-12-18T10:23:07.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a806fdb0 msgr2=0x7f04a81f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a806fdb0 0x7f04a81f5cc0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f049800c4d0 tx=0x7f049800c990 comp rx=0 tx=0).stop 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 shutdown_connections 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0494065a30 0x7f0494067ef0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04a815a680 0x7f04a80c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04a80cac10 0x7f04a81576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 --2- 172.21.15.133:0/3113937439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a806fdb0 0x7f04a81f5cc0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 >> 172.21.15.133:0/3113937439 conn(0x7f04a806a3e0 msgr2=0x7f04a80ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 shutdown_connections 2023-12-18T10:23:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.026+0000 7f04adde9640 1 -- 172.21.15.133:0/3113937439 wait complete. 2023-12-18T10:23:07.052 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-18T10:23:07.052 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-18T10:23:07.052 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-18T10:23:07.052 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:23:07.053 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-18T10:23:07.053 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-18T10:23:07.053 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-18T10:23:07.053 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:23:07.053 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-18T10:23:07.053 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-18T10:23:07.053 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-18T10:23:07.054 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:23:07.054 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-18T10:23:07.054 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-18T10:23:07.054 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-18T10:23:07.054 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:23:07.067 INFO:tasks.ceph.mds.b:Stopped 2023-12-18T10:23:07.067 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-18T10:23:07.069 INFO:tasks.ceph.mds.d:Stopped 2023-12-18T10:23:07.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-18T10:23:07.070 INFO:tasks.ceph.mds.a:Stopped 2023-12-18T10:23:07.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-18T10:23:07.071 INFO:tasks.ceph.mds.c:Stopped 2023-12-18T10:23:07.071 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-18T10:23:07.115 INFO:tasks.ceph.mds.b:Started 2023-12-18T10:23:07.116 DEBUG:teuthology.parallel:result is None 2023-12-18T10:23:07.118 INFO:tasks.ceph.mds.d:Started 2023-12-18T10:23:07.118 DEBUG:teuthology.parallel:result is None 2023-12-18T10:23:07.119 INFO:tasks.ceph.mds.a:Started 2023-12-18T10:23:07.119 DEBUG:teuthology.parallel:result is None 2023-12-18T10:23:07.121 INFO:tasks.ceph.mds.c:Started 2023-12-18T10:23:07.121 DEBUG:teuthology.parallel:result is None 2023-12-18T10:23:07.122 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-18T10:23:07.207 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:23:07.208 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:23:07.208 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:23:07.208 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:23:07.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-18T10:23:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cf996640 1 Processor -- start 2023-12-18T10:23:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cf996640 1 -- start start 2023-12-18T10:23:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cf996640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94c815ca40 0x7f94c80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cf996640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 0x7f94c81668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cf996640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80d11c0 con 0x7f94c80ce3f0 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cf996640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c80d0310 con 0x7f94c815ca40 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cf996640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80d05b0 con 0x7f94c80cf7e0 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cd732640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94c815ca40 0x7f94c80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cd732640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94c815ca40 0x7f94c80cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45318/0 (socket says 172.21.15.133:45318) 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cd732640 1 -- 172.21.15.133:0/367290832 learned_addr learned my addr 172.21.15.133:0/367290832 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cdf33640 1 --2- 172.21.15.133:0/367290832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 0x7f94c81668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cd732640 1 -- 172.21.15.133:0/367290832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 msgr2=0x7f94c81668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cd732640 1 --2- 172.21.15.133:0/367290832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 0x7f94c81668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cd732640 1 -- 172.21.15.133:0/367290832 >> v1:172.21.15.142:6789/0 conn(0x7f94c80ce3f0 legacy=0x7f94c80cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.270+0000 7f94cd732640 1 -- 172.21.15.133:0/367290832 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80d0890 con 0x7f94c815ca40 2023-12-18T10:23:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cd732640 1 --2- 172.21.15.133:0/367290832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c815ca40 0x7f94c80cdeb0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f94c4006fd0 tx=0x7f94c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c2f95dbbf9f4c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94bffff640 1 -- 172.21.15.133:0/367290832 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40aa680 con 0x7f94c815ca40 2023-12-18T10:23:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94bffff640 1 -- 172.21.15.133:0/367290832 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c40aa7e0 con 0x7f94c815ca40 2023-12-18T10:23:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94bffff640 1 -- 172.21.15.133:0/367290832 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40aab70 con 0x7f94c815ca40 2023-12-18T10:23:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cf996640 1 -- 172.21.15.133:0/367290832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c815ca40 msgr2=0x7f94c80cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cf996640 1 --2- 172.21.15.133:0/367290832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c815ca40 0x7f94c80cdeb0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f94c4006fd0 tx=0x7f94c401c520 comp rx=0 tx=0).stop 2023-12-18T10:23:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cf996640 1 -- 172.21.15.133:0/367290832 shutdown_connections 2023-12-18T10:23:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cf996640 1 --2- 172.21.15.133:0/367290832 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 0x7f94c81668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cf996640 1 --2- 172.21.15.133:0/367290832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c815ca40 0x7f94c80cdeb0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cf996640 1 -- 172.21.15.133:0/367290832 >> 172.21.15.133:0/367290832 conn(0x7f94c8089fb0 msgr2=0x7f94c80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cf996640 1 -- 172.21.15.133:0/367290832 shutdown_connections 2023-12-18T10:23:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.274+0000 7f94cf996640 1 -- 172.21.15.133:0/367290832 wait complete. 2023-12-18T10:23:07.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 Processor -- start 2023-12-18T10:23:07.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 -- start start 2023-12-18T10:23:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c80ce3f0 0x7f94c8153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 0x7f94c815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c815ca40 0x7f94c8156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8159bd0 con 0x7f94c80ce3f0 2023-12-18T10:23:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815c0e0 con 0x7f94c815ca40 2023-12-18T10:23:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8159de0 con 0x7f94c80cf7e0 2023-12-18T10:23:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c80ce3f0 0x7f94c8153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c80ce3f0 0x7f94c8153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45328/0 (socket says 172.21.15.133:45328) 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 -- 172.21.15.133:0/4169191718 learned_addr learned my addr 172.21.15.133:0/4169191718 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cdf33640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c815ca40 0x7f94c8156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94ccf31640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 0x7f94c815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 -- 172.21.15.133:0/4169191718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 msgr2=0x7f94c815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 0x7f94c815b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 -- 172.21.15.133:0/4169191718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c815ca40 msgr2=0x7f94c8156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c815ca40 0x7f94c8156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 -- 172.21.15.133:0/4169191718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4009480 con 0x7f94c80ce3f0 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cd732640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c80ce3f0 0x7f94c8153d70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f94c401a150 tx=0x7f94c40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94bdffb640 1 -- 172.21.15.133:0/4169191718 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40aad60 con 0x7f94c80ce3f0 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94bdffb640 1 -- 172.21.15.133:0/4169191718 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c40aa640 con 0x7f94c80ce3f0 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94bdffb640 1 -- 172.21.15.133:0/4169191718 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c4005be0 con 0x7f94c80ce3f0 2023-12-18T10:23:07.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c80d17d0 con 0x7f94c80ce3f0 2023-12-18T10:23:07.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.278+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c815a3a0 con 0x7f94c80ce3f0 2023-12-18T10:23:07.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.282+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c804e000 con 0x7f94c80ce3f0 2023-12-18T10:23:07.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.282+0000 7f94bdffb640 1 -- 172.21.15.133:0/4169191718 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f94c4003620 con 0x7f94c80ce3f0 2023-12-18T10:23:07.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.282+0000 7f94bdffb640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f94ac065a60 0x7f94ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:07.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.282+0000 7f94bdffb640 1 -- 172.21.15.133:0/4169191718 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f94c411d9c0 con 0x7f94c80ce3f0 2023-12-18T10:23:07.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.282+0000 7f94ccf31640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f94ac065a60 0x7f94ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:07.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.282+0000 7f94ccf31640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f94ac065a60 0x7f94ac067f20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f94c815b570 tx=0x7f94b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:07.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.286+0000 7f94bdffb640 1 -- 172.21.15.133:0/4169191718 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f94c40eb5b0 con 0x7f94c80ce3f0 2023-12-18T10:23:07.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:07.450+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f94c80cff10 con 0x7f94c80ce3f0 2023-12-18T10:23:08.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94bdffb640 1 -- 172.21.15.133:0/4169191718 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f94c40c2080 con 0x7f94c80ce3f0 2023-12-18T10:23:08.253 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-18T10:23:08.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f94ac065a60 msgr2=0x7f94ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f94ac065a60 0x7f94ac067f20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f94c815b570 tx=0x7f94b8009040 comp rx=0 tx=0).stop 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c80ce3f0 msgr2=0x7f94c8153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c80ce3f0 0x7f94c8153d70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f94c401a150 tx=0x7f94c40192c0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 shutdown_connections 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f94ac065a60 0x7f94ac067f20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94c815ca40 0x7f94c8156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94c80cf7e0 0x7f94c815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 --2- 172.21.15.133:0/4169191718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94c80ce3f0 0x7f94c8153d70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 >> 172.21.15.133:0/4169191718 conn(0x7f94c8089fb0 msgr2=0x7f94c80ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 shutdown_connections 2023-12-18T10:23:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.250+0000 7f94cf996640 1 -- 172.21.15.133:0/4169191718 wait complete. 2023-12-18T10:23:08.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-18T10:23:08.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f9196895640 1 Processor -- start 2023-12-18T10:23:08.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f9196895640 1 -- start start 2023-12-18T10:23:08.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f9196895640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f919015a680 0x7f919015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f9196895640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919015f100 con 0x7f919006fdb0 2023-12-18T10:23:08.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f9196895640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91900ca7d0 con 0x7f91900cac10 2023-12-18T10:23:08.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f9196895640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919015e860 con 0x7f919015a680 2023-12-18T10:23:08.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f918ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f919015a680 0x7f919015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f9194e32640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f919006fdb0 0x7f91900c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57892/0 (socket says 172.21.15.133:57892) 2023-12-18T10:23:08.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.410+0000 7f9194e32640 1 -- 172.21.15.133:0/3900128172 learned_addr learned my addr 172.21.15.133:0/3900128172 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:08.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.414+0000 7f918ffff640 1 -- 172.21.15.133:0/3900128172 >> v1:172.21.15.142:6789/0 conn(0x7f91900cac10 legacy=0x7f919015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.414+0000 7f918ffff640 1 -- 172.21.15.133:0/3900128172 >> v1:172.21.15.133:6789/0 conn(0x7f919006fdb0 legacy=0x7f91900c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.414+0000 7f918ffff640 1 -- 172.21.15.133:0/3900128172 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919015eb40 con 0x7f919015a680 2023-12-18T10:23:08.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.414+0000 7f918ffff640 1 --2- 172.21.15.133:0/3900128172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919015a680 0x7f919015e160 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f91800097f0 tx=0x7f918001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aee0b1378b94ee server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:08.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.414+0000 7f918effd640 1 -- 172.21.15.133:0/3900128172 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91800ab5f0 con 0x7f919015a680 2023-12-18T10:23:08.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.414+0000 7f918effd640 1 -- 172.21.15.133:0/3900128172 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91800ab750 con 0x7f919015a680 2023-12-18T10:23:08.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.414+0000 7f918effd640 1 -- 172.21.15.133:0/3900128172 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91800abae0 con 0x7f919015a680 2023-12-18T10:23:08.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- 172.21.15.133:0/3900128172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919015a680 msgr2=0x7f919015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 --2- 172.21.15.133:0/3900128172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919015a680 0x7f919015e160 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f91800097f0 tx=0x7f918001c3f0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- 172.21.15.133:0/3900128172 shutdown_connections 2023-12-18T10:23:08.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 --2- 172.21.15.133:0/3900128172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919015a680 0x7f919015e160 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- 172.21.15.133:0/3900128172 >> 172.21.15.133:0/3900128172 conn(0x7f919006a3e0 msgr2=0x7f91900afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:08.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- 172.21.15.133:0/3900128172 shutdown_connections 2023-12-18T10:23:08.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- 172.21.15.133:0/3900128172 wait complete. 2023-12-18T10:23:08.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 Processor -- start 2023-12-18T10:23:08.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- start start 2023-12-18T10:23:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919006fdb0 0x7f9190156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900cac10 0x7f91901508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015a680 0x7f91900c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900c4e00 con 0x7f919006fdb0 2023-12-18T10:23:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900ab9d0 con 0x7f91900cac10 2023-12-18T10:23:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f9196895640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900abcb0 con 0x7f919015a680 2023-12-18T10:23:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f918ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919006fdb0 0x7f9190156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f918ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919006fdb0 0x7f9190156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45332/0 (socket says 172.21.15.133:45332) 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.418+0000 7f918ffff640 1 -- 172.21.15.133:0/4211523371 learned_addr learned my addr 172.21.15.133:0/4211523371 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918ffff640 1 -- 172.21.15.133:0/4211523371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015a680 msgr2=0x7f91900c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918ffff640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015a680 0x7f91900c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918ffff640 1 -- 172.21.15.133:0/4211523371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900cac10 msgr2=0x7f91901508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918ffff640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900cac10 0x7f91901508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918ffff640 1 -- 172.21.15.133:0/4211523371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9180009420 con 0x7f919006fdb0 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918ffff640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919006fdb0 0x7f9190156800 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f91800ad040 tx=0x7f918001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918cff9640 1 -- 172.21.15.133:0/4211523371 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91800b5810 con 0x7f919006fdb0 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918cff9640 1 -- 172.21.15.133:0/4211523371 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91800b5970 con 0x7f919006fdb0 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9190070750 con 0x7f919006fdb0 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918cff9640 1 -- 172.21.15.133:0/4211523371 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91800b5d20 con 0x7f919006fdb0 2023-12-18T10:23:08.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91900ac270 con 0x7f919006fdb0 2023-12-18T10:23:08.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91900735b0 con 0x7f919006fdb0 2023-12-18T10:23:08.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918cff9640 1 -- 172.21.15.133:0/4211523371 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f91800bf410 con 0x7f919006fdb0 2023-12-18T10:23:08.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918cff9640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f917c065a60 0x7f917c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.422+0000 7f918cff9640 1 -- 172.21.15.133:0/4211523371 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f91800a8050 con 0x7f919006fdb0 2023-12-18T10:23:08.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.426+0000 7f918f7fe640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f917c065a60 0x7f917c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.426+0000 7f918f7fe640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f917c065a60 0x7f917c067f20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9184000f70 tx=0x7f91840079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:08.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.430+0000 7f918cff9640 1 -- 172.21.15.133:0/4211523371 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f91800eb7a0 con 0x7f919006fdb0 2023-12-18T10:23:08.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.626+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f91900ac460 con 0x7f919006fdb0 2023-12-18T10:23:08.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f918cff9640 1 -- 172.21.15.133:0/4211523371 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f91800ab5b0 con 0x7f919006fdb0 2023-12-18T10:23:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:08.633 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-18T10:23:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-18T10:23:08.633 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlq/3QHRAAeGrWPAL1IMuRSsb9HM8t0Q==", 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBleUoUKhAA7KQ881Hp59b6BfYF5Mc8Rw==", 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:23:08.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlsRoJJRAAYgbCztPYO/qzR7wJgYhPqQ==", 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlr0paMRAAUlbr607Vw8Yc0/S1EvLUUA==", 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.636 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAgHIBlbTjYDhAA2KUnOrWIaGtzxXx9T64djw==", 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjHIBlr8a1FhAAGRT54akJvp65F8xxu9Mw1g==", 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:23:08.637 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAmHIBlv+HSHBAAxDHSTox1AtpTMfCNbatjzA==", 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApHIBlj5xPIxAAkZglsOO2rg+8kXVIb+JK+w==", 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAvHIBlhQRmKxAAahzzO4gYz5LHWhvFvZlOAA==", 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:23:08.639 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyHIBlatiUMhAAk0X1zO+dYOu5hMZvGBJNkQ==", 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-18T10:23:08.640 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1HIBl86v0OBAA70FwnvAugWtLupto+cbBjg==", 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA5HIBlZAYVBBAAa0V4jDTdYV8TBoNR7SenjQ==", 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.641 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlugNkNRAADsDapfYnOr+gcvgQ4394aA==", 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlM7J1AxAAgoKo5xm3Wz4xWjPX4Mpn0A==", 2023-12-18T10:23:08.642 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlrzVcOxAAwwd6eFzNGehg/4chJq1qJA==", 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:23:08.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlRgxmCRAAN/aEmPSonvc17SvLB1GdXQ==", 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAbHIBlJHzPORAAQupFGwV6/izxeyNlnyeMSA==", 2023-12-18T10:23:08.644 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlDP4UFhAA8KB7vRFpeBSRad2GRiKh/A==", 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBl+lIiEhAAx9zNJbwPBf7oGsFzDJKxEw==", 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-18T10:23:08.646 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f917c065a60 msgr2=0x7f917c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f917c065a60 0x7f917c067f20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9184000f70 tx=0x7f91840079c0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919006fdb0 msgr2=0x7f9190156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919006fdb0 0x7f9190156800 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f91800ad040 tx=0x7f918001ac30 comp rx=0 tx=0).stop 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 shutdown_connections 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f917c065a60 0x7f917c067f20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015a680 0x7f91900c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900cac10 0x7f91901508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 --2- 172.21.15.133:0/4211523371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f919006fdb0 0x7f9190156800 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 >> 172.21.15.133:0/4211523371 conn(0x7f919006a3e0 msgr2=0x7f9190155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 shutdown_connections 2023-12-18T10:23:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.630+0000 7f9196895640 1 -- 172.21.15.133:0/4211523371 wait complete. 2023-12-18T10:23:08.654 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:08.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.786+0000 7f5fa468c640 1 Processor -- start 2023-12-18T10:23:08.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.786+0000 7f5fa468c640 1 -- start start 2023-12-18T10:23:08.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.786+0000 7f5fa468c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5f9c0704c0 0x7f5f9c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.786+0000 7f5fa468c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c15f100 con 0x7f5f9c15a680 2023-12-18T10:23:08.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa468c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c0ca7d0 con 0x7f5f9c0cac10 2023-12-18T10:23:08.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa468c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c15e860 con 0x7f5f9c0704c0 2023-12-18T10:23:08.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2428640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5f9c15a680 0x7f5f9c15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57900/0 (socket says 172.21.15.133:57900) 2023-12-18T10:23:08.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2428640 1 -- 172.21.15.133:0/2635967964 learned_addr learned my addr 172.21.15.133:0/2635967964 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:08.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2c29640 1 --2- 172.21.15.133:0/2635967964 >> v2:172.21.15.142:3300/0 conn(0x7f5f9c0704c0 0x7f5f9c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203132019 0 0) 0x7f5f9c15f100 con 0x7f5f9c15a680 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f88003530 con 0x7f5f9c15a680 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2074455248 0 0) 0x7f5f88003530 con 0x7f5f9c15a680 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 >> v2:172.21.15.142:3300/0 conn(0x7f5f9c0704c0 msgr2=0x7f5f9c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 --2- 172.21.15.133:0/2635967964 >> v2:172.21.15.142:3300/0 conn(0x7f5f9c0704c0 0x7f5f9c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 >> v1:172.21.15.142:6789/0 conn(0x7f5f9c0cac10 legacy=0x7f5f9c06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c15eb40 con 0x7f5f9c15a680 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f5f98001680 con 0x7f5f9c15a680 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 >> v1:172.21.15.133:6789/0 conn(0x7f5f9c15a680 legacy=0x7f5f9c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f88003980 0x7f5f88003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f88004380 0x7f5f88004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c15e860 con 0x7f5f880050f0 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8800c030 con 0x7f5f88003980 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8800c1f0 con 0x7f5f88004380 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2c29640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2428640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f88003980 0x7f5f88003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1c27640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f88004380 0x7f5f88004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2c29640 1 -- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f88004380 msgr2=0x7f5f88004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2c29640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f88004380 0x7f5f88004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2c29640 1 -- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f88003980 msgr2=0x7f5f88003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2c29640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f88003980 0x7f5f88003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa2c29640 1 -- 172.21.15.133:0/2635967964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88003530 con 0x7f5f880050f0 2023-12-18T10:23:08.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.790+0000 7f5fa1c27640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f88004380 0x7f5f88004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:08.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa2c29640 1 -- 172.21.15.133:0/2635967964 reap_dead start 2023-12-18T10:23:08.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa2c29640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f8800b990 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009fc0 tx=0x7f5f9401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ac53acc0a58004 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:08.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940a5cb0 con 0x7f5f880050f0 2023-12-18T10:23:08.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9400f040 con 0x7f5f880050f0 2023-12-18T10:23:08.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa1426640 1 -- 172.21.15.133:0/2635967964 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94003be0 con 0x7f5f880050f0 2023-12-18T10:23:08.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 -- 172.21.15.133:0/2635967964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 msgr2=0x7f5f8800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f8800b990 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009fc0 tx=0x7f5f9401cca0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 -- 172.21.15.133:0/2635967964 shutdown_connections 2023-12-18T10:23:08.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 --2- 172.21.15.133:0/2635967964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f8800b990 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 -- 172.21.15.133:0/2635967964 >> 172.21.15.133:0/2635967964 conn(0x7f5f9c06a3e0 msgr2=0x7f5f9c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:08.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 -- 172.21.15.133:0/2635967964 shutdown_connections 2023-12-18T10:23:08.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 -- 172.21.15.133:0/2635967964 wait complete. 2023-12-18T10:23:08.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 Processor -- start 2023-12-18T10:23:08.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.794+0000 7f5fa468c640 1 -- start start 2023-12-18T10:23:08.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f9c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f9c0b0e60 0x7f5f9c0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9c0adde0 0x7f5f9c0ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0ae7b0 con 0x7f5f880050f0 2023-12-18T10:23:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c1efd00 con 0x7f5f9c0b0e60 2023-12-18T10:23:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c1f0b10 con 0x7f5f9c0adde0 2023-12-18T10:23:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f9c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f9c0b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45360/0 (socket says 172.21.15.133:45360) 2023-12-18T10:23:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 -- 172.21.15.133:0/3006318011 learned_addr learned my addr 172.21.15.133:0/3006318011 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 -- 172.21.15.133:0/3006318011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9c0adde0 msgr2=0x7f5f9c0ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9c0adde0 0x7f5f9c0ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 -- 172.21.15.133:0/3006318011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f9c0b0e60 msgr2=0x7f5f9c0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f9c0b0e60 0x7f5f9c0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 -- 172.21.15.133:0/3006318011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c1eff40 con 0x7f5f880050f0 2023-12-18T10:23:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa2428640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f9c0b3bd0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5f980072c0 tx=0x7f5f98007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5f92ffd640 1 -- 172.21.15.133:0/3006318011 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9800f960 con 0x7f5f880050f0 2023-12-18T10:23:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5f92ffd640 1 -- 172.21.15.133:0/3006318011 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9800fae0 con 0x7f5f880050f0 2023-12-18T10:23:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5f92ffd640 1 -- 172.21.15.133:0/3006318011 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9800fe90 con 0x7f5f880050f0 2023-12-18T10:23:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c1f01e0 con 0x7f5f880050f0 2023-12-18T10:23:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c1f07a0 con 0x7f5f880050f0 2023-12-18T10:23:08.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c0735b0 con 0x7f5f880050f0 2023-12-18T10:23:08.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.798+0000 7f5f92ffd640 1 -- 172.21.15.133:0/3006318011 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5f98012350 con 0x7f5f880050f0 2023-12-18T10:23:08.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.802+0000 7f5f92ffd640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5f80065a60 0x7f5f80067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:08.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.802+0000 7f5f92ffd640 1 -- 172.21.15.133:0/3006318011 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5f98082920 con 0x7f5f880050f0 2023-12-18T10:23:08.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.802+0000 7f5fa1c27640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5f80065a60 0x7f5f80067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:08.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.802+0000 7f5fa1c27640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5f80065a60 0x7f5f80067f20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c007bd0 tx=0x7f5f8c007b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:08.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.806+0000 7f5f92ffd640 1 -- 172.21.15.133:0/3006318011 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5f98050450 con 0x7f5f880050f0 2023-12-18T10:23:08.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.954+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f9c04e000 con 0x7f5f880050f0 2023-12-18T10:23:08.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5f92ffd640 1 -- 172.21.15.133:0/3006318011 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+12643 (secure 0 0 0) 0x7f5f98053a70 con 0x7f5f880050f0 2023-12-18T10:23:08.961 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:08.961 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":75,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:23:08.250316+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5f80065a60 msgr2=0x7f5f80067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5f80065a60 0x7f5f80067f20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c007bd0 tx=0x7f5f8c007b20 comp rx=0 tx=0).stop 2023-12-18T10:23:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 msgr2=0x7f5f9c0b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f9c0b3bd0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5f980072c0 tx=0x7f5f98007780 comp rx=0 tx=0).stop 2023-12-18T10:23:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 shutdown_connections 2023-12-18T10:23:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5f80065a60 0x7f5f80067f20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5f9c0adde0 0x7f5f9c0ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f9c0b0e60 0x7f5f9c0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 --2- 172.21.15.133:0/3006318011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f880050f0 0x7f5f9c0b3bd0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:08.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 >> 172.21.15.133:0/3006318011 conn(0x7f5f9c06a3e0 msgr2=0x7f5f9c1588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:08.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 shutdown_connections 2023-12-18T10:23:08.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:08.958+0000 7f5fa468c640 1 -- 172.21.15.133:0/3006318011 wait complete. 2023-12-18T10:23:08.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:23:08.983 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:23:09.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.118+0000 7f416702d640 1 Processor -- start 2023-12-18T10:23:09.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f416702d640 1 -- start start 2023-12-18T10:23:09.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f416702d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4160071870 0x7f4160071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f416702d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f41600cbff0 0x7f41600cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f416702d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41600cc960 con 0x7f41600ca410 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f416702d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416015aab0 con 0x7f41600cbff0 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f416702d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160070df0 con 0x7f4160071870 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f41655ca640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f41600cbff0 0x7f41600cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f41655ca640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f41600cbff0 0x7f41600cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45362/0 (socket says 172.21.15.133:45362) 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f41655ca640 1 -- 172.21.15.133:0/707288305 learned_addr learned my addr 172.21.15.133:0/707288305 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f4157fff640 1 --2- 172.21.15.133:0/707288305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4160071870 0x7f4160071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f41655ca640 1 -- 172.21.15.133:0/707288305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4160071870 msgr2=0x7f4160071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f41655ca640 1 --2- 172.21.15.133:0/707288305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4160071870 0x7f4160071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f41655ca640 1 -- 172.21.15.133:0/707288305 >> v1:172.21.15.142:6789/0 conn(0x7f41600ca410 legacy=0x7f4160159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:09.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.122+0000 7f41655ca640 1 -- 172.21.15.133:0/707288305 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416015a4f0 con 0x7f41600cbff0 2023-12-18T10:23:09.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f41655ca640 1 --2- 172.21.15.133:0/707288305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f41600cc420 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4158009e50 tx=0x7f415801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f738518ac80582e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f41577fe640 1 -- 172.21.15.133:0/707288305 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580a5790 con 0x7f41600cbff0 2023-12-18T10:23:09.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f41577fe640 1 -- 172.21.15.133:0/707288305 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41580a58f0 con 0x7f41600cbff0 2023-12-18T10:23:09.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f41577fe640 1 -- 172.21.15.133:0/707288305 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580a5c80 con 0x7f41600cbff0 2023-12-18T10:23:09.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 -- 172.21.15.133:0/707288305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 msgr2=0x7f41600cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 --2- 172.21.15.133:0/707288305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f41600cc420 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4158009e50 tx=0x7f415801c910 comp rx=0 tx=0).stop 2023-12-18T10:23:09.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 -- 172.21.15.133:0/707288305 shutdown_connections 2023-12-18T10:23:09.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 --2- 172.21.15.133:0/707288305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f41600cc420 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 --2- 172.21.15.133:0/707288305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4160071870 0x7f4160071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 -- 172.21.15.133:0/707288305 >> 172.21.15.133:0/707288305 conn(0x7f416006a2a0 msgr2=0x7f41600aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:09.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 -- 172.21.15.133:0/707288305 shutdown_connections 2023-12-18T10:23:09.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 -- 172.21.15.133:0/707288305 wait complete. 2023-12-18T10:23:09.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 Processor -- start 2023-12-18T10:23:09.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.126+0000 7f416702d640 1 -- start start 2023-12-18T10:23:09.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4160071870 0x7f4160155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41600ca410 0x7f416013efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f4160140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41601403d0 con 0x7f41600cbff0 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416013f520 con 0x7f4160071870 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416013f7c0 con 0x7f41600ca410 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f4160140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f4160140860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45378/0 (socket says 172.21.15.133:45378) 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f4164dc9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4160071870 0x7f4160155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f4157fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41600ca410 0x7f416013efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 -- 172.21.15.133:0/3878951017 learned_addr learned my addr 172.21.15.133:0/3878951017 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 -- 172.21.15.133:0/3878951017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41600ca410 msgr2=0x7f416013efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41600ca410 0x7f416013efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 -- 172.21.15.133:0/3878951017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4160071870 msgr2=0x7f4160155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4160071870 0x7f4160155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 -- 172.21.15.133:0/3878951017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158009b30 con 0x7f41600cbff0 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41655ca640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f4160140860 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f41580af040 tx=0x7f41580196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41557fa640 1 -- 172.21.15.133:0/3878951017 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580b8670 con 0x7f41600cbff0 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41557fa640 1 -- 172.21.15.133:0/3878951017 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41580b87d0 con 0x7f41600cbff0 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416013faa0 con 0x7f41600cbff0 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f41557fa640 1 -- 172.21.15.133:0/3878951017 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580b8b60 con 0x7f41600cbff0 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4160140060 con 0x7f41600cbff0 2023-12-18T10:23:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.130+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4160140540 con 0x7f41600cbff0 2023-12-18T10:23:09.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.134+0000 7f41557fa640 1 -- 172.21.15.133:0/3878951017 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f41580b8cc0 con 0x7f41600cbff0 2023-12-18T10:23:09.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.134+0000 7f41557fa640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f414c065a60 0x7f414c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.134+0000 7f41557fa640 1 -- 172.21.15.133:0/3878951017 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f415811e490 con 0x7f41600cbff0 2023-12-18T10:23:09.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.134+0000 7f4164dc9640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f414c065a60 0x7f414c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.134+0000 7f4164dc9640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f414c065a60 0x7f414c067f20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f415c007fd0 tx=0x7f415c007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.138+0000 7f41557fa640 1 -- 172.21.15.133:0/3878951017 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f41580ec220 con 0x7f41600cbff0 2023-12-18T10:23:09.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4160158d10 con 0x7f41600cbff0 2023-12-18T10:23:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f41557fa640 1 -- 172.21.15.133:0/3878951017 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41580ef840 con 0x7f41600cbff0 2023-12-18T10:23:09.293 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:23:09.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f414c065a60 msgr2=0x7f414c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f414c065a60 0x7f414c067f20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f415c007fd0 tx=0x7f415c007e40 comp rx=0 tx=0).stop 2023-12-18T10:23:09.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 msgr2=0x7f4160140860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f4160140860 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f41580af040 tx=0x7f41580196b0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 shutdown_connections 2023-12-18T10:23:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f414c065a60 0x7f414c067f20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41600cbff0 0x7f4160140860 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41600ca410 0x7f416013efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 --2- 172.21.15.133:0/3878951017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4160071870 0x7f4160155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 >> 172.21.15.133:0/3878951017 conn(0x7f416006a2a0 msgr2=0x7f41601569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 shutdown_connections 2023-12-18T10:23:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.290+0000 7f416702d640 1 -- 172.21.15.133:0/3878951017 wait complete. 2023-12-18T10:23:09.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-18T10:23:09.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.446+0000 7f9c9da66640 1 Processor -- start 2023-12-18T10:23:09.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.446+0000 7f9c9da66640 1 -- start start 2023-12-18T10:23:09.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c9da66640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9c980ca000 0x7f9c98164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c9da66640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980c9460 con 0x7f9c9806c4f0 2023-12-18T10:23:09.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c9da66640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c981574a0 con 0x7f9c981570c0 2023-12-18T10:23:09.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c9da66640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980c8b30 con 0x7f9c980ca000 2023-12-18T10:23:09.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c8ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9c9806c4f0 0x7f9c980c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57904/0 (socket says 172.21.15.133:57904) 2023-12-18T10:23:09.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c8ffff640 1 -- 172.21.15.133:0/790060826 learned_addr learned my addr 172.21.15.133:0/790060826 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:09.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c97fff640 1 --2- 172.21.15.133:0/790060826 >> v2:172.21.15.142:3300/0 conn(0x7f9c980ca000 0x7f9c98164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c96ffd640 1 -- 172.21.15.133:0/790060826 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836972527 0 0) 0x7f9c980c9460 con 0x7f9c9806c4f0 2023-12-18T10:23:09.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c96ffd640 1 -- 172.21.15.133:0/790060826 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c84003530 con 0x7f9c9806c4f0 2023-12-18T10:23:09.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c97fff640 1 -- 172.21.15.133:0/790060826 >> v1:172.21.15.142:6789/0 conn(0x7f9c981570c0 legacy=0x7f9c9806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c97fff640 1 -- 172.21.15.133:0/790060826 >> v1:172.21.15.133:6789/0 conn(0x7f9c9806c4f0 legacy=0x7f9c980c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.450+0000 7f9c97fff640 1 -- 172.21.15.133:0/790060826 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980c8e10 con 0x7f9c980ca000 2023-12-18T10:23:09.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c97fff640 1 --2- 172.21.15.133:0/790060826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c980ca000 0x7f9c98164230 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009d90 tx=0x7f9c9001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a5d5b4284bdf08 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c96ffd640 1 -- 172.21.15.133:0/790060826 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900a5910 con 0x7f9c980ca000 2023-12-18T10:23:09.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c96ffd640 1 -- 172.21.15.133:0/790060826 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c900a5a70 con 0x7f9c980ca000 2023-12-18T10:23:09.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c96ffd640 1 -- 172.21.15.133:0/790060826 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900a5de0 con 0x7f9c980ca000 2023-12-18T10:23:09.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 -- 172.21.15.133:0/790060826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c980ca000 msgr2=0x7f9c98164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 --2- 172.21.15.133:0/790060826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c980ca000 0x7f9c98164230 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009d90 tx=0x7f9c9001c890 comp rx=0 tx=0).stop 2023-12-18T10:23:09.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 -- 172.21.15.133:0/790060826 shutdown_connections 2023-12-18T10:23:09.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 --2- 172.21.15.133:0/790060826 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c980ca000 0x7f9c98164230 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 -- 172.21.15.133:0/790060826 >> 172.21.15.133:0/790060826 conn(0x7f9c9806a3e0 msgr2=0x7f9c980afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:09.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 -- 172.21.15.133:0/790060826 shutdown_connections 2023-12-18T10:23:09.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 -- 172.21.15.133:0/790060826 wait complete. 2023-12-18T10:23:09.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 Processor -- start 2023-12-18T10:23:09.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.454+0000 7f9c9da66640 1 -- start start 2023-12-18T10:23:09.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c9806c4f0 0x7f9c980c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c980ca000 0x7f9c98153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c981570c0 0x7f9c981540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c981545e0 con 0x7f9c981570c0 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98154890 con 0x7f9c9806c4f0 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98154b70 con 0x7f9c980ca000 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c981570c0 0x7f9c981540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c981570c0 0x7f9c981540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45388/0 (socket says 172.21.15.133:45388) 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 -- 172.21.15.133:0/3065212651 learned_addr learned my addr 172.21.15.133:0/3065212651 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c8ffff640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c980ca000 0x7f9c98153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c977fe640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c9806c4f0 0x7f9c980c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 -- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c980ca000 msgr2=0x7f9c98153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c980ca000 0x7f9c98153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 -- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c9806c4f0 msgr2=0x7f9c980c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c9806c4f0 0x7f9c980c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 -- 172.21.15.133:0/3065212651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90009a70 con 0x7f9c981570c0 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c8ffff640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c980ca000 0x7f9c98153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c977fe640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c9806c4f0 0x7f9c980c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c97fff640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c981570c0 0x7f9c981540a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009d90 tx=0x7f9c90019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c94ff9640 1 -- 172.21.15.133:0/3065212651 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90003db0 con 0x7f9c981570c0 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c94ff9640 1 -- 172.21.15.133:0/3065212651 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90004040 con 0x7f9c981570c0 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c98154e50 con 0x7f9c981570c0 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c94ff9640 1 -- 172.21.15.133:0/3065212651 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900043f0 con 0x7f9c981570c0 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c98155410 con 0x7f9c981570c0 2023-12-18T10:23:09.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.458+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c980735b0 con 0x7f9c981570c0 2023-12-18T10:23:09.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.462+0000 7f9c94ff9640 1 -- 172.21.15.133:0/3065212651 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c900b4070 con 0x7f9c981570c0 2023-12-18T10:23:09.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.462+0000 7f9c94ff9640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9c78065a60 0x7f9c78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.462+0000 7f9c94ff9640 1 -- 172.21.15.133:0/3065212651 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9c9011d7d0 con 0x7f9c981570c0 2023-12-18T10:23:09.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.462+0000 7f9c977fe640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9c78065a60 0x7f9c78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.462+0000 7f9c977fe640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9c78065a60 0x7f9c78067f20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9c880016f0 tx=0x7f9c88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.466+0000 7f9c94ff9640 1 -- 172.21.15.133:0/3065212651 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9c900eb4d0 con 0x7f9c981570c0 2023-12-18T10:23:09.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.618+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9c9804e000 con 0x7f9c981570c0 2023-12-18T10:23:09.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.618+0000 7f9c94ff9640 1 -- 172.21.15.133:0/3065212651 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9c900eeaf0 con 0x7f9c981570c0 2023-12-18T10:23:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:09.623 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:23:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:23:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-18T10:23:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-18T10:23:09.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:09.623 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:23:09.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9c78065a60 msgr2=0x7f9c78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9c78065a60 0x7f9c78067f20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9c880016f0 tx=0x7f9c88009040 comp rx=0 tx=0).stop 2023-12-18T10:23:09.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c981570c0 msgr2=0x7f9c981540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c981570c0 0x7f9c981540a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009d90 tx=0x7f9c90019630 comp rx=0 tx=0).stop 2023-12-18T10:23:09.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 shutdown_connections 2023-12-18T10:23:09.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9c78065a60 0x7f9c78067f20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c981570c0 0x7f9c981540a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c980ca000 0x7f9c98153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 --2- 172.21.15.133:0/3065212651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c9806c4f0 0x7f9c980c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 >> 172.21.15.133:0/3065212651 conn(0x7f9c9806a3e0 msgr2=0x7f9c980aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:09.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 shutdown_connections 2023-12-18T10:23:09.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.622+0000 7f9c9da66640 1 -- 172.21.15.133:0/3065212651 wait complete. 2023-12-18T10:23:09.644 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-18T10:23:09.644 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-18T10:23:09.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7af8f640 1 Processor -- start 2023-12-18T10:23:09.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7af8f640 1 -- start start 2023-12-18T10:23:09.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7af8f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee7406d440 0x7fee7406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7af8f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee740ab190 0x7fee740ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7af8f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee740b28a0 con 0x7fee740ce5d0 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7af8f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7415ab30 con 0x7fee740ab190 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7af8f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee740b1c90 con 0x7fee7406d440 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7952c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee740ab190 0x7fee740ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7952c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee740ab190 0x7fee740ab5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45392/0 (socket says 172.21.15.133:45392) 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7952c640 1 -- 172.21.15.133:0/2901304514 learned_addr learned my addr 172.21.15.133:0/2901304514 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee73fff640 1 --2- 172.21.15.133:0/2901304514 >> v2:172.21.15.142:3300/0 conn(0x7fee7406d440 0x7fee7406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7952c640 1 -- 172.21.15.133:0/2901304514 >> v2:172.21.15.142:3300/0 conn(0x7fee7406d440 msgr2=0x7fee7406d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7952c640 1 --2- 172.21.15.133:0/2901304514 >> v2:172.21.15.142:3300/0 conn(0x7fee7406d440 0x7fee7406d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7952c640 1 -- 172.21.15.133:0/2901304514 >> v1:172.21.15.142:6789/0 conn(0x7fee740ce5d0 legacy=0x7fee740ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.782+0000 7fee7952c640 1 -- 172.21.15.133:0/2901304514 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee740b1f70 con 0x7fee740ab190 2023-12-18T10:23:09.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7952c640 1 --2- 172.21.15.133:0/2901304514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ab190 0x7fee740ab5e0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fee7406c360 tx=0x7fee6c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb968904e1adc72 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee737fe640 1 -- 172.21.15.133:0/2901304514 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0a5800 con 0x7fee740ab190 2023-12-18T10:23:09.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee737fe640 1 -- 172.21.15.133:0/2901304514 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c0a5960 con 0x7fee740ab190 2023-12-18T10:23:09.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee737fe640 1 -- 172.21.15.133:0/2901304514 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0a5cf0 con 0x7fee740ab190 2023-12-18T10:23:09.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7af8f640 1 -- 172.21.15.133:0/2901304514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ab190 msgr2=0x7fee740ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7af8f640 1 --2- 172.21.15.133:0/2901304514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ab190 0x7fee740ab5e0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fee7406c360 tx=0x7fee6c01c940 comp rx=0 tx=0).stop 2023-12-18T10:23:09.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7af8f640 1 -- 172.21.15.133:0/2901304514 shutdown_connections 2023-12-18T10:23:09.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7af8f640 1 --2- 172.21.15.133:0/2901304514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ab190 0x7fee740ab5e0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7af8f640 1 --2- 172.21.15.133:0/2901304514 >> v2:172.21.15.142:3300/0 conn(0x7fee7406d440 0x7fee7406d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7af8f640 1 -- 172.21.15.133:0/2901304514 >> 172.21.15.133:0/2901304514 conn(0x7fee74069e70 msgr2=0x7fee7406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:09.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7af8f640 1 -- 172.21.15.133:0/2901304514 shutdown_connections 2023-12-18T10:23:09.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.786+0000 7fee7af8f640 1 -- 172.21.15.133:0/2901304514 wait complete. 2023-12-18T10:23:09.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 Processor -- start 2023-12-18T10:23:09.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 -- start start 2023-12-18T10:23:09.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee7406d440 0x7fee74097af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee740ab190 0x7fee74152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ce5d0 0x7fee74164b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74164670 con 0x7fee740ce5d0 2023-12-18T10:23:09.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee74163d40 con 0x7fee7406d440 2023-12-18T10:23:09.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee74164020 con 0x7fee740ab190 2023-12-18T10:23:09.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ce5d0 0x7fee74164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ce5d0 0x7fee74164b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45408/0 (socket says 172.21.15.133:45408) 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 -- 172.21.15.133:0/4288931016 learned_addr learned my addr 172.21.15.133:0/4288931016 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee78d2b640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee7406d440 0x7fee74097af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee73fff640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee740ab190 0x7fee74152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 -- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee740ab190 msgr2=0x7fee74152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee740ab190 0x7fee74152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 -- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee7406d440 msgr2=0x7fee74097af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee7406d440 0x7fee74097af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 -- 172.21.15.133:0/4288931016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c009b30 con 0x7fee740ce5d0 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee78d2b640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee7406d440 0x7fee74097af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7952c640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ce5d0 0x7fee74164b00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009e20 tx=0x7fee6c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee717fa640 1 -- 172.21.15.133:0/4288931016 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0bd070 con 0x7fee740ce5d0 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee717fa640 1 -- 172.21.15.133:0/4288931016 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c0b8470 con 0x7fee740ce5d0 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee740b2eb0 con 0x7fee740ce5d0 2023-12-18T10:23:09.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee717fa640 1 -- 172.21.15.133:0/4288931016 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0b8840 con 0x7fee740ce5d0 2023-12-18T10:23:09.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.790+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7415a770 con 0x7fee740ce5d0 2023-12-18T10:23:09.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.794+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee740b2d10 con 0x7fee740ce5d0 2023-12-18T10:23:09.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.794+0000 7fee717fa640 1 -- 172.21.15.133:0/4288931016 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fee6c0b89a0 con 0x7fee740ce5d0 2023-12-18T10:23:09.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.794+0000 7fee717fa640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee60065a60 0x7fee60067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:09.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.794+0000 7fee717fa640 1 -- 172.21.15.133:0/4288931016 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fee6c11dc80 con 0x7fee740ce5d0 2023-12-18T10:23:09.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.794+0000 7fee78d2b640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee60065a60 0x7fee60067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:09.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.794+0000 7fee78d2b640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee60065a60 0x7fee60067f20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fee740c1e20 tx=0x7fee64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:09.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.798+0000 7fee717fa640 1 -- 172.21.15.133:0/4288931016 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fee740b2d10 con 0x7fee740ce5d0 2023-12-18T10:23:09.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:09.950+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fee740b2d10 con 0x7fee740ce5d0 2023-12-18T10:23:10.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.070+0000 7fee717fa640 1 -- 172.21.15.133:0/4288931016 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7fee740b2d10 con 0x7fee740ce5d0 2023-12-18T10:23:10.077 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-18T10:23:10.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee60065a60 msgr2=0x7fee60067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:10.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee60065a60 0x7fee60067f20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fee740c1e20 tx=0x7fee64009040 comp rx=0 tx=0).stop 2023-12-18T10:23:10.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ce5d0 msgr2=0x7fee74164b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:10.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ce5d0 0x7fee74164b00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009e20 tx=0x7fee6c0196e0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 shutdown_connections 2023-12-18T10:23:10.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee60065a60 0x7fee60067f20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee740ce5d0 0x7fee74164b00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee740ab190 0x7fee74152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 --2- 172.21.15.133:0/4288931016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee7406d440 0x7fee74097af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.074+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 >> 172.21.15.133:0/4288931016 conn(0x7fee74069e70 msgr2=0x7fee740c5470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:10.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.078+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 shutdown_connections 2023-12-18T10:23:10.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.078+0000 7fee7af8f640 1 -- 172.21.15.133:0/4288931016 wait complete. 2023-12-18T10:23:10.102 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-18T10:23:10.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.242+0000 7f644cd44640 1 Processor -- start 2023-12-18T10:23:10.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.242+0000 7f644cd44640 1 -- start start 2023-12-18T10:23:10.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f644cd44640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6448159440 0x7f644815da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:10.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f644cd44640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f644806bd00 0x7f644806c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:10.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f644cd44640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644806c680 con 0x7f64480cdb30 2023-12-18T10:23:10.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f644cd44640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644815df60 con 0x7f6448159440 2023-12-18T10:23:10.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f644cd44640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64480b0e00 con 0x7f644806bd00 2023-12-18T10:23:10.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f64477fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6448159440 0x7f644815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:10.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f6447fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f644806bd00 0x7f644806c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:10.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f64477fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6448159440 0x7f644815da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:55024/0 (socket says 172.21.15.133:55024) 2023-12-18T10:23:10.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f643ffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f64480cdb30 0x7f6448070c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:37082/0 (socket says 172.21.15.133:37082) 2023-12-18T10:23:10.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f64477fe640 1 -- 172.21.15.133:0/2396235231 learned_addr learned my addr 172.21.15.133:0/2396235231 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:10.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f6446ffd640 1 -- 172.21.15.133:0/2396235231 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409334335 0 0) 0x7f644806c680 con 0x7f64480cdb30 2023-12-18T10:23:10.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f6446ffd640 1 -- 172.21.15.133:0/2396235231 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6434003530 con 0x7f64480cdb30 2023-12-18T10:23:10.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f6447fff640 1 -- 172.21.15.133:0/2396235231 >> v2:172.21.15.142:3300/0 conn(0x7f6448159440 msgr2=0x7f644815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:10.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f6447fff640 1 --2- 172.21.15.133:0/2396235231 >> v2:172.21.15.142:3300/0 conn(0x7f6448159440 0x7f644815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f6447fff640 1 -- 172.21.15.133:0/2396235231 >> v1:172.21.15.142:6789/0 conn(0x7f64480cdb30 legacy=0x7f6448070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:10.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f6447fff640 1 -- 172.21.15.133:0/2396235231 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480ca7c0 con 0x7f644806bd00 2023-12-18T10:23:10.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.246+0000 7f64477fe640 1 --2- 172.21.15.133:0/2396235231 >> v2:172.21.15.142:3300/0 conn(0x7f6448159440 0x7f644815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:10.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f6447fff640 1 --2- 172.21.15.133:0/2396235231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f644806bd00 0x7f644806c140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6440009d90 tx=0x7f644001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc7476c9528d34d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:10.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f6446ffd640 1 -- 172.21.15.133:0/2396235231 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400a5950 con 0x7f644806bd00 2023-12-18T10:23:10.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f6446ffd640 1 -- 172.21.15.133:0/2396235231 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64400a5ab0 con 0x7f644806bd00 2023-12-18T10:23:10.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f6446ffd640 1 -- 172.21.15.133:0/2396235231 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400a5e20 con 0x7f644806bd00 2023-12-18T10:23:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- 172.21.15.133:0/2396235231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f644806bd00 msgr2=0x7f644806c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 --2- 172.21.15.133:0/2396235231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f644806bd00 0x7f644806c140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6440009d90 tx=0x7f644001c890 comp rx=0 tx=0).stop 2023-12-18T10:23:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- 172.21.15.133:0/2396235231 shutdown_connections 2023-12-18T10:23:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 --2- 172.21.15.133:0/2396235231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f644806bd00 0x7f644806c140 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 --2- 172.21.15.133:0/2396235231 >> v2:172.21.15.142:3300/0 conn(0x7f6448159440 0x7f644815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- 172.21.15.133:0/2396235231 >> 172.21.15.133:0/2396235231 conn(0x7f644806a350 msgr2=0x7f64480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- 172.21.15.133:0/2396235231 shutdown_connections 2023-12-18T10:23:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- 172.21.15.133:0/2396235231 wait complete. 2023-12-18T10:23:10.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 Processor -- start 2023-12-18T10:23:10.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- start start 2023-12-18T10:23:10.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f644806bd00 0x7f644814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:10.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64480cdb30 0x7f6448159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:10.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159440 0x7f6448149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480cb2e0 con 0x7f6448159440 2023-12-18T10:23:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480ca9f0 con 0x7f644806bd00 2023-12-18T10:23:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.250+0000 7f644cd44640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64480cac90 con 0x7f64480cdb30 2023-12-18T10:23:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f643ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64480cdb30 0x7f6448159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f644806bd00 0x7f644814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f6447fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159440 0x7f6448149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f644806bd00 0x7f644814b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:55032/0 (socket says 172.21.15.133:55032) 2023-12-18T10:23:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 -- 172.21.15.133:0/1090983777 learned_addr learned my addr 172.21.15.133:0/1090983777 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 -- 172.21.15.133:0/1090983777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64480cdb30 msgr2=0x7f6448159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64480cdb30 0x7f6448159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 -- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159440 msgr2=0x7f6448149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159440 0x7f6448149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 -- 172.21.15.133:0/1090983777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64380094d0 con 0x7f644806bd00 2023-12-18T10:23:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f64477fe640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f644806bd00 0x7f644814b4e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f643800e930 tx=0x7f643800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f6444ff9640 1 -- 172.21.15.133:0/1090983777 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800ca00 con 0x7f644806bd00 2023-12-18T10:23:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f6444ff9640 1 -- 172.21.15.133:0/1090983777 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800cb60 con 0x7f644806bd00 2023-12-18T10:23:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6440009a70 con 0x7f644806bd00 2023-12-18T10:23:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f6444ff9640 1 -- 172.21.15.133:0/1090983777 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438013470 con 0x7f644806bd00 2023-12-18T10:23:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64480cb020 con 0x7f644806bd00 2023-12-18T10:23:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644804e000 con 0x7f644806bd00 2023-12-18T10:23:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.254+0000 7f6444ff9640 1 -- 172.21.15.133:0/1090983777 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f64380135d0 con 0x7f644806bd00 2023-12-18T10:23:10.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.258+0000 7f6444ff9640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6428065a90 0x7f6428067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:10.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.258+0000 7f6444ff9640 1 -- 172.21.15.133:0/1090983777 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f6438083300 con 0x7f644806bd00 2023-12-18T10:23:10.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.258+0000 7f643ffff640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6428065a90 0x7f6428067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:10.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.258+0000 7f643ffff640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6428065a90 0x7f6428067f50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f64480ccce0 tx=0x7f6430007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:10.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.262+0000 7f6444ff9640 1 -- 172.21.15.133:0/1090983777 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6438050d70 con 0x7f644806bd00 2023-12-18T10:23:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:10.410+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f64481551b0 con 0x7f644806bd00 2023-12-18T10:23:11.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.082+0000 7f6444ff9640 1 -- 172.21.15.133:0/1090983777 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6438054390 con 0x7f644806bd00 2023-12-18T10:23:11.095 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-18T10:23:11.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6428065a90 msgr2=0x7f6428067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6428065a90 0x7f6428067f50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f64480ccce0 tx=0x7f6430007d00 comp rx=0 tx=0).stop 2023-12-18T10:23:11.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f644806bd00 msgr2=0x7f644814b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f644806bd00 0x7f644814b4e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f643800e930 tx=0x7f643800edf0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 shutdown_connections 2023-12-18T10:23:11.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6428065a90 0x7f6428067f50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6448159440 0x7f6448149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f64480cdb30 0x7f6448159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 --2- 172.21.15.133:0/1090983777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f644806bd00 0x7f644814b4e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 >> 172.21.15.133:0/1090983777 conn(0x7f644806a350 msgr2=0x7f64481542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:11.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 shutdown_connections 2023-12-18T10:23:11.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.094+0000 7f644cd44640 1 -- 172.21.15.133:0/1090983777 wait complete. 2023-12-18T10:23:11.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-18T10:23:11.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.262+0000 7fa2d2063640 1 Processor -- start 2023-12-18T10:23:11.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.262+0000 7fa2d2063640 1 -- start start 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2d2063640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 0x7fa2cc0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2d2063640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2cc165030 0x7fa2cc0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2d2063640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2cc0ced50 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2d2063640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc0cc980 con 0x7fa2cc165030 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2d2063640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc0cc090 con 0x7fa2cc160a60 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2cbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2cc165030 0x7fa2cc0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2cbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2cc165030 0x7fa2cc0cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44238/0 (socket says 172.21.15.133:44238) 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2cbfff640 1 -- 172.21.15.133:0/1247154790 learned_addr learned my addr 172.21.15.133:0/1247154790 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2cb7fe640 1 --2- 172.21.15.133:0/1247154790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 0x7fa2cc0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2cbfff640 1 -- 172.21.15.133:0/1247154790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 msgr2=0x7fa2cc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2cbfff640 1 --2- 172.21.15.133:0/1247154790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 0x7fa2cc0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2cbfff640 1 -- 172.21.15.133:0/1247154790 >> v1:172.21.15.133:6789/0 conn(0x7fa2cc0ce8f0 legacy=0x7fa2cc164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2cbfff640 1 -- 172.21.15.133:0/1247154790 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc0cc330 con 0x7fa2cc165030 2023-12-18T10:23:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.266+0000 7fa2caffd640 1 -- 172.21.15.133:0/1247154790 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328235888 0 0) 0x7fa2cc0ced50 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2cbfff640 1 --2- 172.21.15.133:0/1247154790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc165030 0x7fa2cc0cce10 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009e50 tx=0x7fa2c401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732c18eddb82bd2e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:11.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2caffd640 1 -- 172.21.15.133:0/1247154790 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40a5900 con 0x7fa2cc165030 2023-12-18T10:23:11.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2caffd640 1 -- 172.21.15.133:0/1247154790 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c40a5a60 con 0x7fa2cc165030 2023-12-18T10:23:11.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2caffd640 1 -- 172.21.15.133:0/1247154790 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40a5df0 con 0x7fa2cc165030 2023-12-18T10:23:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 -- 172.21.15.133:0/1247154790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc165030 msgr2=0x7fa2cc0cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1247154790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc165030 0x7fa2cc0cce10 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009e50 tx=0x7fa2c401ca10 comp rx=0 tx=0).stop 2023-12-18T10:23:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 -- 172.21.15.133:0/1247154790 shutdown_connections 2023-12-18T10:23:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1247154790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc165030 0x7fa2cc0cce10 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1247154790 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 0x7fa2cc0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 -- 172.21.15.133:0/1247154790 >> 172.21.15.133:0/1247154790 conn(0x7fa2cc06a2a0 msgr2=0x7fa2cc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 -- 172.21.15.133:0/1247154790 shutdown_connections 2023-12-18T10:23:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 -- 172.21.15.133:0/1247154790 wait complete. 2023-12-18T10:23:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 Processor -- start 2023-12-18T10:23:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.270+0000 7fa2d2063640 1 -- start start 2023-12-18T10:23:11.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0ce8f0 0x7fa2cc15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 0x7fa2cc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2cc165030 0x7fa2cc159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc0c71d0 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc15a120 con 0x7fa2cc165030 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc15b130 con 0x7fa2cc160a60 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0ce8f0 0x7fa2cc15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0ce8f0 0x7fa2cc15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44244/0 (socket says 172.21.15.133:44244) 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 -- 172.21.15.133:0/1269053693 learned_addr learned my addr 172.21.15.133:0/1269053693 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2c3fff640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 0x7fa2cc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cbfff640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2cc165030 0x7fa2cc159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 -- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 msgr2=0x7fa2cc1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 0x7fa2cc1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 -- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2cc165030 msgr2=0x7fa2cc159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2cc165030 0x7fa2cc159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 -- 172.21.15.133:0/1269053693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c4009b30 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cbfff640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2cc165030 0x7fa2cc159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2cb7fe640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0ce8f0 0x7fa2cc15c980 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00e930 tx=0x7fa2bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1269053693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc009690 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1269053693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc00ca00 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1269053693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00cd70 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc15a370 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc15a930 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.274+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc04e000 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.278+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1269053693 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa2bc013470 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.278+0000 7fa2c8ff9640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa2ac065a60 0x7fa2ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.278+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1269053693 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fa2bc0834b0 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.278+0000 7fa2c3fff640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa2ac065a60 0x7fa2ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.278+0000 7fa2c3fff640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa2ac065a60 0x7fa2ac067f20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc1fc550 tx=0x7fa2b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.282+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1269053693 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa2bc050f00 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.462+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa2cc0b0c00 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.470+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1269053693 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa2bc054520 con 0x7fa2cc0ce8f0 2023-12-18T10:23:11.474 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 11 and data pool 12 2023-12-18T10:23:11.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa2ac065a60 msgr2=0x7fa2ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa2ac065a60 0x7fa2ac067f20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc1fc550 tx=0x7fa2b4009040 comp rx=0 tx=0).stop 2023-12-18T10:23:11.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0ce8f0 msgr2=0x7fa2cc15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0ce8f0 0x7fa2cc15c980 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00e930 tx=0x7fa2bc00edf0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 shutdown_connections 2023-12-18T10:23:11.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa2ac065a60 0x7fa2ac067f20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2cc165030 0x7fa2cc159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2cc160a60 0x7fa2cc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 --2- 172.21.15.133:0/1269053693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0ce8f0 0x7fa2cc15c980 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.474+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 >> 172.21.15.133:0/1269053693 conn(0x7fa2cc06a2a0 msgr2=0x7fa2cc15fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:11.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.478+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 shutdown_connections 2023-12-18T10:23:11.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.478+0000 7fa2d2063640 1 -- 172.21.15.133:0/1269053693 wait complete. 2023-12-18T10:23:11.522 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:11.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.654+0000 7faa35125640 1 Processor -- start 2023-12-18T10:23:11.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.654+0000 7faa35125640 1 -- start start 2023-12-18T10:23:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.654+0000 7faa35125640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3015a680 0x7faa3015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.654+0000 7faa35125640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa3006fdb0 0x7faa30070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.654+0000 7faa35125640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3015f100 con 0x7faa300cac10 2023-12-18T10:23:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.654+0000 7faa35125640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa30070780 con 0x7faa3006fdb0 2023-12-18T10:23:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.654+0000 7faa35125640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa300ca7d0 con 0x7faa3015a680 2023-12-18T10:23:11.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2f59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa3006fdb0 0x7faa30070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2659c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faa300cac10 0x7faa3015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34002/0 (socket says 172.21.15.133:34002) 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2f59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa3006fdb0 0x7faa30070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44246/0 (socket says 172.21.15.133:44246) 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2659c640 1 -- 172.21.15.133:0/3017598013 learned_addr learned my addr 172.21.15.133:0/3017598013 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2ed9d640 1 --2- 172.21.15.133:0/3017598013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3015a680 0x7faa3015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2f59e640 1 -- 172.21.15.133:0/3017598013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3015a680 msgr2=0x7faa3015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2f59e640 1 --2- 172.21.15.133:0/3017598013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3015a680 0x7faa3015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2f59e640 1 -- 172.21.15.133:0/3017598013 >> v1:172.21.15.133:6789/0 conn(0x7faa300cac10 legacy=0x7faa3015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2f59e640 1 -- 172.21.15.133:0/3017598013 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3015e860 con 0x7faa3006fdb0 2023-12-18T10:23:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2e59c640 1 -- 172.21.15.133:0/3017598013 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256057648 0 0) 0x7faa3015f100 con 0x7faa300cac10 2023-12-18T10:23:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2f59e640 1 --2- 172.21.15.133:0/3017598013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3006fdb0 0x7faa30070240 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7faa28009d90 tx=0x7faa2801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04866a28175947c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2e59c640 1 -- 172.21.15.133:0/3017598013 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280a5980 con 0x7faa3006fdb0 2023-12-18T10:23:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2e59c640 1 -- 172.21.15.133:0/3017598013 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280a5ae0 con 0x7faa3006fdb0 2023-12-18T10:23:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.658+0000 7faa2e59c640 1 -- 172.21.15.133:0/3017598013 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280a5e70 con 0x7faa3006fdb0 2023-12-18T10:23:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- 172.21.15.133:0/3017598013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3006fdb0 msgr2=0x7faa30070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 --2- 172.21.15.133:0/3017598013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3006fdb0 0x7faa30070240 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7faa28009d90 tx=0x7faa2801c8c0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- 172.21.15.133:0/3017598013 shutdown_connections 2023-12-18T10:23:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 --2- 172.21.15.133:0/3017598013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3006fdb0 0x7faa30070240 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 --2- 172.21.15.133:0/3017598013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa3015a680 0x7faa3015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- 172.21.15.133:0/3017598013 >> 172.21.15.133:0/3017598013 conn(0x7faa3006a3e0 msgr2=0x7faa300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- 172.21.15.133:0/3017598013 shutdown_connections 2023-12-18T10:23:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- 172.21.15.133:0/3017598013 wait complete. 2023-12-18T10:23:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 Processor -- start 2023-12-18T10:23:11.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- start start 2023-12-18T10:23:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3006fdb0 0x7faa300c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa300cac10 0x7faa30152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3015a680 0x7faa301591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa300cd6a0 con 0x7faa3015a680 2023-12-18T10:23:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30157b20 con 0x7faa3006fdb0 2023-12-18T10:23:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa35125640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa300ccfe0 con 0x7faa300cac10 2023-12-18T10:23:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa2f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3015a680 0x7faa301591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa2f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3015a680 0x7faa301591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44258/0 (socket says 172.21.15.133:44258) 2023-12-18T10:23:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa2f59e640 1 -- 172.21.15.133:0/3293976287 learned_addr learned my addr 172.21.15.133:0/3293976287 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa2ed9d640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3006fdb0 0x7faa300c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.662+0000 7faa2659c640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa300cac10 0x7faa30152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa2f59e640 1 -- 172.21.15.133:0/3293976287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa300cac10 msgr2=0x7faa30152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa2f59e640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa300cac10 0x7faa30152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa2f59e640 1 -- 172.21.15.133:0/3293976287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3006fdb0 msgr2=0x7faa300c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa2f59e640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3006fdb0 0x7faa300c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa2f59e640 1 -- 172.21.15.133:0/3293976287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28009a70 con 0x7faa3015a680 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa2f59e640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3015a680 0x7faa301591a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7faa280b0040 tx=0x7faa28019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa27fff640 1 -- 172.21.15.133:0/3293976287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280b9860 con 0x7faa3015a680 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa27fff640 1 -- 172.21.15.133:0/3293976287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280b99c0 con 0x7faa3015a680 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa27fff640 1 -- 172.21.15.133:0/3293976287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280b9d50 con 0x7faa3015a680 2023-12-18T10:23:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa300cd2c0 con 0x7faa3015a680 2023-12-18T10:23:11.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa30152dc0 con 0x7faa3015a680 2023-12-18T10:23:11.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa300735b0 con 0x7faa3015a680 2023-12-18T10:23:11.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa27fff640 1 -- 172.21.15.133:0/3293976287 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa280ad440 con 0x7faa3015a680 2023-12-18T10:23:11.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.666+0000 7faa27fff640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa10065a60 0x7faa10067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.670+0000 7faa27fff640 1 -- 172.21.15.133:0/3293976287 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa2811e4d0 con 0x7faa3015a680 2023-12-18T10:23:11.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.670+0000 7faa2ed9d640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa10065a60 0x7faa10067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.670+0000 7faa2ed9d640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa10065a60 0x7faa10067f20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faa20007a60 tx=0x7faa20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:11.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.674+0000 7faa27fff640 1 -- 172.21.15.133:0/3293976287 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faa280ebdf0 con 0x7faa3015a680 2023-12-18T10:23:11.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.822+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa3015d180 con 0x7faa3015a680 2023-12-18T10:23:11.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa27fff640 1 -- 172.21.15.133:0/3293976287 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16370 (secure 0 0 0) 0x7faa280ef410 con 0x7faa3015a680 2023-12-18T10:23:11.829 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:11.829 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":78,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:23:11.467487+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:23:10.000470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-18T10:23:10.462940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa10065a60 msgr2=0x7faa10067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa10065a60 0x7faa10067f20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7faa20007a60 tx=0x7faa20008040 comp rx=0 tx=0).stop 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3015a680 msgr2=0x7faa301591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3015a680 0x7faa301591a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7faa280b0040 tx=0x7faa28019660 comp rx=0 tx=0).stop 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 shutdown_connections 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faa10065a60 0x7faa10067f20 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa3015a680 0x7faa301591a0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faa300cac10 0x7faa30152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 --2- 172.21.15.133:0/3293976287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa3006fdb0 0x7faa300c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 >> 172.21.15.133:0/3293976287 conn(0x7faa3006a3e0 msgr2=0x7faa3015c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 shutdown_connections 2023-12-18T10:23:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.826+0000 7faa35125640 1 -- 172.21.15.133:0/3293976287 wait complete. 2023-12-18T10:23:11.850 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:11.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.982+0000 7fe75ef39640 1 Processor -- start 2023-12-18T10:23:11.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ef39640 1 -- start start 2023-12-18T10:23:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ef39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe75815a680 0x7fe75815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ef39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe7580cac10 0x7fe75815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ef39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75815f100 con 0x7fe75815afa0 2023-12-18T10:23:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ef39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7580ca7d0 con 0x7fe75815a680 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ef39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75815e860 con 0x7fe7580cac10 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ccd5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe75815a680 0x7fe75815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ccd5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe75815a680 0x7fe75815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44260/0 (socket says 172.21.15.133:44260) 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ccd5640 1 -- 172.21.15.133:0/4026557376 learned_addr learned my addr 172.21.15.133:0/4026557376 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe74ffff640 1 --2- 172.21.15.133:0/4026557376 >> v2:172.21.15.142:3300/0 conn(0x7fe7580cac10 0x7fe75815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ccd5640 1 -- 172.21.15.133:0/4026557376 >> v2:172.21.15.142:3300/0 conn(0x7fe7580cac10 msgr2=0x7fe75815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ccd5640 1 --2- 172.21.15.133:0/4026557376 >> v2:172.21.15.142:3300/0 conn(0x7fe7580cac10 0x7fe75815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ccd5640 1 -- 172.21.15.133:0/4026557376 >> v1:172.21.15.142:6789/0 conn(0x7fe75815afa0 legacy=0x7fe75806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe75ccd5640 1 -- 172.21.15.133:0/4026557376 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75815eb40 con 0x7fe75815a680 2023-12-18T10:23:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.986+0000 7fe74ffff640 1 --2- 172.21.15.133:0/4026557376 >> v2:172.21.15.142:3300/0 conn(0x7fe7580cac10 0x7fe75815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:11.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ccd5640 1 --2- 172.21.15.133:0/4026557376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75815e160 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe754009870 tx=0x7fe75401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41545bd70d62dac2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:11.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe74f7fe640 1 -- 172.21.15.133:0/4026557376 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7540a7070 con 0x7fe75815a680 2023-12-18T10:23:11.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe74f7fe640 1 -- 172.21.15.133:0/4026557376 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7540ab430 con 0x7fe75815a680 2023-12-18T10:23:11.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe74f7fe640 1 -- 172.21.15.133:0/4026557376 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7540ab7c0 con 0x7fe75815a680 2023-12-18T10:23:11.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 -- 172.21.15.133:0/4026557376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 msgr2=0x7fe75815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 --2- 172.21.15.133:0/4026557376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75815e160 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe754009870 tx=0x7fe75401c430 comp rx=0 tx=0).stop 2023-12-18T10:23:11.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 -- 172.21.15.133:0/4026557376 shutdown_connections 2023-12-18T10:23:11.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 --2- 172.21.15.133:0/4026557376 >> v2:172.21.15.142:3300/0 conn(0x7fe7580cac10 0x7fe75815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 --2- 172.21.15.133:0/4026557376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75815e160 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 -- 172.21.15.133:0/4026557376 >> 172.21.15.133:0/4026557376 conn(0x7fe75806a3e0 msgr2=0x7fe7580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 -- 172.21.15.133:0/4026557376 shutdown_connections 2023-12-18T10:23:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 -- 172.21.15.133:0/4026557376 wait complete. 2023-12-18T10:23:11.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 Processor -- start 2023-12-18T10:23:11.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.990+0000 7fe75ef39640 1 -- start start 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7580cac10 0x7fe7580b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75814a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75815afa0 0x7fe7580c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c40f0 con 0x7fe75815a680 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c3200 con 0x7fe75815afa0 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c34e0 con 0x7fe7580cac10 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75814a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75814a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44272/0 (socket says 172.21.15.133:44272) 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 -- 172.21.15.133:0/3021179354 learned_addr learned my addr 172.21.15.133:0/3021179354 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ccd5640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7580cac10 0x7fe7580b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75d4d6640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75815afa0 0x7fe7580c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 -- 172.21.15.133:0/3021179354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7580cac10 msgr2=0x7fe7580b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7580cac10 0x7fe7580b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 -- 172.21.15.133:0/3021179354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75815afa0 msgr2=0x7fe7580c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75815afa0 0x7fe7580c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 -- 172.21.15.133:0/3021179354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7540094d0 con 0x7fe75815a680 2023-12-18T10:23:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74ffff640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75814a480 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe74800c7c0 tx=0x7fe74800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74d7fa640 1 -- 172.21.15.133:0/3021179354 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748007a30 con 0x7fe75815a680 2023-12-18T10:23:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74d7fa640 1 -- 172.21.15.133:0/3021179354 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe748007b90 con 0x7fe75815a680 2023-12-18T10:23:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe74d7fa640 1 -- 172.21.15.133:0/3021179354 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800ce70 con 0x7fe75815a680 2023-12-18T10:23:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7580c37c0 con 0x7fe75815a680 2023-12-18T10:23:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7580c3d80 con 0x7fe75815a680 2023-12-18T10:23:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.994+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7580735b0 con 0x7fe75815a680 2023-12-18T10:23:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.998+0000 7fe74d7fa640 1 -- 172.21.15.133:0/3021179354 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe7480113f0 con 0x7fe75815a680 2023-12-18T10:23:12.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.998+0000 7fe74d7fa640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe744065a60 0x7fe744067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:12.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.998+0000 7fe74d7fa640 1 -- 172.21.15.133:0/3021179354 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe748083860 con 0x7fe75815a680 2023-12-18T10:23:12.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.998+0000 7fe75ccd5640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe744065a60 0x7fe744067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:12.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:11.998+0000 7fe75ccd5640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe744065a60 0x7fe744067f20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe7540af000 tx=0x7fe754008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:12.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.002+0000 7fe74d7fa640 1 -- 172.21.15.133:0/3021179354 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe748051060 con 0x7fe75815a680 2023-12-18T10:23:12.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe75804e000 con 0x7fe75815a680 2023-12-18T10:23:12.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe74d7fa640 1 -- 172.21.15.133:0/3021179354 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16370 (secure 0 0 0) 0x7fe748054680 con 0x7fe75815a680 2023-12-18T10:23:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:12.162 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":78,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:23:11.467487+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:23:10.000470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-18T10:23:10.462940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:12.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe744065a60 msgr2=0x7fe744067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:12.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe744065a60 0x7fe744067f20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe7540af000 tx=0x7fe754008040 comp rx=0 tx=0).stop 2023-12-18T10:23:12.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 msgr2=0x7fe75814a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:12.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75814a480 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe74800c7c0 tx=0x7fe74800cc80 comp rx=0 tx=0).stop 2023-12-18T10:23:12.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 shutdown_connections 2023-12-18T10:23:12.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe744065a60 0x7fe744067f20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe75815afa0 0x7fe7580c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75815a680 0x7fe75814a480 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 --2- 172.21.15.133:0/3021179354 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe7580cac10 0x7fe7580b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 >> 172.21.15.133:0/3021179354 conn(0x7fe75806a3e0 msgr2=0x7fe7580ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:12.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 shutdown_connections 2023-12-18T10:23:12.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.158+0000 7fe75ef39640 1 -- 172.21.15.133:0/3021179354 wait complete. 2023-12-18T10:23:12.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-18T10:23:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0ea190a640 1 Processor -- start 2023-12-18T10:23:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0ea190a640 1 -- start start 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0ea190a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e9c0ca410 0x7f0e9c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0ea190a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0cbff0 0x7f0e9c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0ea190a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9c0cc930 con 0x7f0e9c159fb0 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0ea190a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c15aab0 con 0x7f0e9c0ca410 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0ea190a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c070df0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0e9affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e9c0ca410 0x7f0e9c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0e9affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e9c0ca410 0x7f0e9c159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44288/0 (socket says 172.21.15.133:44288) 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0e9affd640 1 -- 172.21.15.133:0/1832706712 learned_addr learned my addr 172.21.15.133:0/1832706712 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0e9b7fe640 1 --2- 172.21.15.133:0/1832706712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0cbff0 0x7f0e9c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0e9affd640 1 -- 172.21.15.133:0/1832706712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0cbff0 msgr2=0x7f0e9c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0e9affd640 1 --2- 172.21.15.133:0/1832706712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0cbff0 0x7f0e9c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0e9affd640 1 -- 172.21.15.133:0/1832706712 >> v1:172.21.15.142:6789/0 conn(0x7f0e9c159fb0 legacy=0x7f0e9c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:12.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.322+0000 7f0e9affd640 1 -- 172.21.15.133:0/1832706712 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c15a4f0 con 0x7f0e9c0ca410 2023-12-18T10:23:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0e9affd640 1 --2- 172.21.15.133:0/1832706712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0ca410 0x7f0e9c159a70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009870 tx=0x7f0e8c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce69298a7aab45c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0e99ffb640 1 -- 172.21.15.133:0/1832706712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0aa670 con 0x7f0e9c0ca410 2023-12-18T10:23:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0e99ffb640 1 -- 172.21.15.133:0/1832706712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c0aa7d0 con 0x7f0e9c0ca410 2023-12-18T10:23:12.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0e99ffb640 1 -- 172.21.15.133:0/1832706712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0aab60 con 0x7f0e9c0ca410 2023-12-18T10:23:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 -- 172.21.15.133:0/1832706712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0ca410 msgr2=0x7f0e9c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1832706712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0ca410 0x7f0e9c159a70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009870 tx=0x7f0e8c01c510 comp rx=0 tx=0).stop 2023-12-18T10:23:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 -- 172.21.15.133:0/1832706712 shutdown_connections 2023-12-18T10:23:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1832706712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0cbff0 0x7f0e9c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1832706712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0ca410 0x7f0e9c159a70 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 -- 172.21.15.133:0/1832706712 >> 172.21.15.133:0/1832706712 conn(0x7f0e9c06a2a0 msgr2=0x7f0e9c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 -- 172.21.15.133:0/1832706712 shutdown_connections 2023-12-18T10:23:12.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 -- 172.21.15.133:0/1832706712 wait complete. 2023-12-18T10:23:12.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.326+0000 7f0ea190a640 1 Processor -- start 2023-12-18T10:23:12.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 -- start start 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0ca410 0x7f0e9c0ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0cbff0 0x7f0e9c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c159fb0 0x7f0e9c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c1f55a0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c1f4920 con 0x7f0e9c0ca410 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c1f4c00 con 0x7f0e9c159fb0 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0cbff0 0x7f0e9c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0cbff0 0x7f0e9c0c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44302/0 (socket says 172.21.15.133:44302) 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 -- 172.21.15.133:0/1594241659 learned_addr learned my addr 172.21.15.133:0/1594241659 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9affd640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0ca410 0x7f0e9c0ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:12.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9b7fe640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c159fb0 0x7f0e9c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 -- 172.21.15.133:0/1594241659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c159fb0 msgr2=0x7f0e9c0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c159fb0 0x7f0e9c0c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 -- 172.21.15.133:0/1594241659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0ca410 msgr2=0x7f0e9c0ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0ca410 0x7f0e9c0ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 -- 172.21.15.133:0/1594241659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c0094d0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e9a7fc640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0cbff0 0x7f0e9c0c3e30 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c420 tx=0x7f0e9000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e83fff640 1 -- 172.21.15.133:0/1594241659 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900052d0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e83fff640 1 -- 172.21.15.133:0/1594241659 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90005430 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c1f4ee0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0e83fff640 1 -- 172.21.15.133:0/1594241659 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90003820 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c0ac8d0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.330+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c1f56e0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.334+0000 7f0e83fff640 1 -- 172.21.15.133:0/1594241659 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e90003980 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.334+0000 7f0e83fff640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e88065a90 0x7f0e88067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.334+0000 7f0e83fff640 1 -- 172.21.15.133:0/1594241659 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e900827f0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.334+0000 7f0e9affd640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e88065a90 0x7f0e88067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.334+0000 7f0e9affd640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e88065a90 0x7f0e88067f50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0ae000 tx=0x7f0e8c0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.338+0000 7f0e83fff640 1 -- 172.21.15.133:0/1594241659 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0e9c1f56e0 con 0x7f0e9c0cbff0 2023-12-18T10:23:12.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:12.526+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0e9c1f56e0 con 0x7f0e9c0cbff0 2023-12-18T10:23:13.066 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:23:13.066+0000 7f42dabad640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:23:13.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0e83fff640 1 -- 172.21.15.133:0/1594241659 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0e9c1f56e0 con 0x7f0e9c0cbff0 2023-12-18T10:23:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e88065a90 msgr2=0x7f0e88067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e88065a90 0x7f0e88067f50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0ae000 tx=0x7f0e8c0b5040 comp rx=0 tx=0).stop 2023-12-18T10:23:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0cbff0 msgr2=0x7f0e9c0c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0cbff0 0x7f0e9c0c3e30 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c420 tx=0x7f0e9000c8e0 comp rx=0 tx=0).stop 2023-12-18T10:23:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 shutdown_connections 2023-12-18T10:23:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e88065a90 0x7f0e88067f50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c159fb0 0x7f0e9c0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:13.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e9c0cbff0 0x7f0e9c0c3e30 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:13.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 --2- 172.21.15.133:0/1594241659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0ca410 0x7f0e9c0ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:13.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 >> 172.21.15.133:0/1594241659 conn(0x7f0e9c06a2a0 msgr2=0x7f0e9c0aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:13.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 shutdown_connections 2023-12-18T10:23:13.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.478+0000 7f0ea190a640 1 -- 172.21.15.133:0/1594241659 wait complete. 2023-12-18T10:23:13.504 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-18T10:23:13.504 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-18T10:23:13.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc3679f3640 1 Processor -- start 2023-12-18T10:23:13.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc3679f3640 1 -- start start 2023-12-18T10:23:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc3679f3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3600ceac0 0x7fc360164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc3679f3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600cc980 con 0x7fc360164e60 2023-12-18T10:23:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc3679f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600cc090 con 0x7fc360160a60 2023-12-18T10:23:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc3679f3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3600cc330 con 0x7fc3600ceac0 2023-12-18T10:23:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc364f8e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3600ceac0 0x7fc360164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc364f8e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3600ceac0 0x7fc360164920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44304/0 (socket says 172.21.15.133:44304) 2023-12-18T10:23:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc364f8e640 1 -- 172.21.15.133:0/2735983145 learned_addr learned my addr 172.21.15.133:0/2735983145 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc364f8e640 1 -- 172.21.15.133:0/2735983145 >> v1:172.21.15.142:6789/0 conn(0x7fc360160a60 legacy=0x7fc3600ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc364f8e640 1 -- 172.21.15.133:0/2735983145 >> v1:172.21.15.133:6789/0 conn(0x7fc360164e60 legacy=0x7fc3600cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc364f8e640 1 -- 172.21.15.133:0/2735983145 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600cc610 con 0x7fc3600ceac0 2023-12-18T10:23:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.642+0000 7fc357fff640 1 -- 172.21.15.133:0/2735983145 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387277964 0 0) 0x7fc3600cc980 con 0x7fc360164e60 2023-12-18T10:23:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc364f8e640 1 --2- 172.21.15.133:0/2735983145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3600ceac0 0x7fc360164920 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fc350009870 tx=0x7fc35001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffebfa4abb4e9354 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc357fff640 1 -- 172.21.15.133:0/2735983145 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360165480 con 0x7fc3600ceac0 2023-12-18T10:23:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc357fff640 1 -- 172.21.15.133:0/2735983145 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3500a9620 con 0x7fc3600ceac0 2023-12-18T10:23:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc357fff640 1 -- 172.21.15.133:0/2735983145 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500a99b0 con 0x7fc3600ceac0 2023-12-18T10:23:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc3679f3640 1 -- 172.21.15.133:0/2735983145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3600ceac0 msgr2=0x7fc360164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc3679f3640 1 --2- 172.21.15.133:0/2735983145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3600ceac0 0x7fc360164920 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fc350009870 tx=0x7fc35001c540 comp rx=0 tx=0).stop 2023-12-18T10:23:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc3679f3640 1 -- 172.21.15.133:0/2735983145 shutdown_connections 2023-12-18T10:23:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc3679f3640 1 --2- 172.21.15.133:0/2735983145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3600ceac0 0x7fc360164920 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc3679f3640 1 -- 172.21.15.133:0/2735983145 >> 172.21.15.133:0/2735983145 conn(0x7fc36006a2a0 msgr2=0x7fc3600aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc3679f3640 1 -- 172.21.15.133:0/2735983145 shutdown_connections 2023-12-18T10:23:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.646+0000 7fc3679f3640 1 -- 172.21.15.133:0/2735983145 wait complete. 2023-12-18T10:23:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 Processor -- start 2023-12-18T10:23:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 -- start start 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3600ceac0 0x7fc3600c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc360160a60 0x7fc3601fc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc360164e60 0x7fc3601fca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600b3da0 con 0x7fc360160a60 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600b4080 con 0x7fc360164e60 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36015de90 con 0x7fc3600ceac0 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc360160a60 0x7fc3601fc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc360160a60 0x7fc3601fc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44320/0 (socket says 172.21.15.133:44320) 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 -- 172.21.15.133:0/3191690642 learned_addr learned my addr 172.21.15.133:0/3191690642 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc36578f640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3600ceac0 0x7fc3600c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc365f90640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc360164e60 0x7fc3601fca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 -- 172.21.15.133:0/3191690642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3600ceac0 msgr2=0x7fc3600c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3600ceac0 0x7fc3600c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 -- 172.21.15.133:0/3191690642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc360164e60 msgr2=0x7fc3601fca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc360164e60 0x7fc3601fca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 -- 172.21.15.133:0/3191690642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500094d0 con 0x7fc360160a60 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc364f8e640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc360160a60 0x7fc3601fc4f0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ab040 tx=0x7fc35001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc355ffb640 1 -- 172.21.15.133:0/3191690642 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500bc650 con 0x7fc360160a60 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc355ffb640 1 -- 172.21.15.133:0/3191690642 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3500bc7d0 con 0x7fc360160a60 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc355ffb640 1 -- 172.21.15.133:0/3191690642 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500bcb80 con 0x7fc360160a60 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36015e170 con 0x7fc360160a60 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3600c80c0 con 0x7fc360160a60 2023-12-18T10:23:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.650+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3600c8370 con 0x7fc360160a60 2023-12-18T10:23:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.654+0000 7fc355ffb640 1 -- 172.21.15.133:0/3191690642 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3500bcce0 con 0x7fc360160a60 2023-12-18T10:23:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.654+0000 7fc355ffb640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc344065a60 0x7fc344067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:13.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.654+0000 7fc355ffb640 1 -- 172.21.15.133:0/3191690642 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc35011dae0 con 0x7fc360160a60 2023-12-18T10:23:13.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.654+0000 7fc36578f640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc344065a60 0x7fc344067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:13.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.654+0000 7fc36578f640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc344065a60 0x7fc344067f20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc35c000f70 tx=0x7fc35c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:13.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.658+0000 7fc355ffb640 1 -- 172.21.15.133:0/3191690642 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc3500eb350 con 0x7fc360160a60 2023-12-18T10:23:13.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:13.838+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc36015dfd0 con 0x7fc360160a60 2023-12-18T10:23:13.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-18T10:23:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.478+0000 7fc355ffb640 1 -- 172.21.15.133:0/3191690642 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc36015dfd0 con 0x7fc360160a60 2023-12-18T10:23:14.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc344065a60 msgr2=0x7fc344067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc344065a60 0x7fc344067f20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc35c000f70 tx=0x7fc35c009040 comp rx=0 tx=0).stop 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc360160a60 msgr2=0x7fc3601fc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc360160a60 0x7fc3601fc4f0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc3500ab040 tx=0x7fc35001ad80 comp rx=0 tx=0).stop 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 shutdown_connections 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc344065a60 0x7fc344067f20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc360164e60 0x7fc3601fca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc360160a60 0x7fc3601fc4f0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 --2- 172.21.15.133:0/3191690642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3600ceac0 0x7fc3600c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 >> 172.21.15.133:0/3191690642 conn(0x7fc36006a2a0 msgr2=0x7fc3600c1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 shutdown_connections 2023-12-18T10:23:14.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.482+0000 7fc3679f3640 1 -- 172.21.15.133:0/3191690642 wait complete. 2023-12-18T10:23:14.505 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-18T10:23:14.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.638+0000 7fb003d39640 1 Processor -- start 2023-12-18T10:23:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.638+0000 7fb003d39640 1 -- start start 2023-12-18T10:23:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.638+0000 7fb003d39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faffc0c1280 0x7faffc0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.638+0000 7fb003d39640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc06fdb0 con 0x7faffc0cb340 2023-12-18T10:23:14.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.638+0000 7fb003d39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faffc164820 con 0x7faffc160cc0 2023-12-18T10:23:14.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.638+0000 7fb003d39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faffc1654a0 con 0x7faffc0c1280 2023-12-18T10:23:14.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb0022d6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faffc0cb340 0x7faffc0cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34024/0 (socket says 172.21.15.133:34024) 2023-12-18T10:23:14.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb0022d6640 1 -- 172.21.15.133:0/1756098716 learned_addr learned my addr 172.21.15.133:0/1756098716 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:14.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb0012d4640 1 --2- 172.21.15.133:0/1756098716 >> v2:172.21.15.142:3300/0 conn(0x7faffc0c1280 0x7faffc0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:14.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb000ad3640 1 -- 172.21.15.133:0/1756098716 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327893737 0 0) 0x7faffc06fdb0 con 0x7faffc0cb340 2023-12-18T10:23:14.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb000ad3640 1 -- 172.21.15.133:0/1756098716 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe8003530 con 0x7faffc0cb340 2023-12-18T10:23:14.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb0012d4640 1 -- 172.21.15.133:0/1756098716 >> v1:172.21.15.142:6789/0 conn(0x7faffc160cc0 legacy=0x7faffc0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb0012d4640 1 -- 172.21.15.133:0/1756098716 >> v1:172.21.15.133:6789/0 conn(0x7faffc0cb340 legacy=0x7faffc0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb000ad3640 1 -- 172.21.15.133:0/1756098716 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2240633610 0 0) 0x7fafe8003530 con 0x7faffc0cb340 2023-12-18T10:23:14.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb0012d4640 1 -- 172.21.15.133:0/1756098716 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc164b00 con 0x7faffc0c1280 2023-12-18T10:23:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb0012d4640 1 --2- 172.21.15.133:0/1756098716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0c1280 0x7faffc0cc400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fafec0097c0 tx=0x7fafec01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d778bbea9112becb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb000ad3640 1 -- 172.21.15.133:0/1756098716 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4001a00 con 0x7faffc0c1280 2023-12-18T10:23:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb000ad3640 1 -- 172.21.15.133:0/1756098716 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec0a7050 con 0x7faffc0c1280 2023-12-18T10:23:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.642+0000 7fb000ad3640 1 -- 172.21.15.133:0/1756098716 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0ab620 con 0x7faffc0c1280 2023-12-18T10:23:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- 172.21.15.133:0/1756098716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0c1280 msgr2=0x7faffc0cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 --2- 172.21.15.133:0/1756098716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0c1280 0x7faffc0cc400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fafec0097c0 tx=0x7fafec01c310 comp rx=0 tx=0).stop 2023-12-18T10:23:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- 172.21.15.133:0/1756098716 shutdown_connections 2023-12-18T10:23:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 --2- 172.21.15.133:0/1756098716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0c1280 0x7faffc0cc400 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- 172.21.15.133:0/1756098716 >> 172.21.15.133:0/1756098716 conn(0x7faffc06a3e0 msgr2=0x7faffc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- 172.21.15.133:0/1756098716 shutdown_connections 2023-12-18T10:23:14.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- 172.21.15.133:0/1756098716 wait complete. 2023-12-18T10:23:14.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 Processor -- start 2023-12-18T10:23:14.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- start start 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0c1280 0x7faffc0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cb340 0x7faffc0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc160cc0 0x7faffc070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0b3660 con 0x7faffc160cc0 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0b3940 con 0x7faffc0cb340 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb003d39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faffc0b3c20 con 0x7faffc0c1280 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0022d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc160cc0 0x7faffc070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0022d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc160cc0 0x7faffc070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44334/0 (socket says 172.21.15.133:44334) 2023-12-18T10:23:14.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0022d6640 1 -- 172.21.15.133:0/1188440929 learned_addr learned my addr 172.21.15.133:0/1188440929 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb001ad5640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0c1280 0x7faffc0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0012d4640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cb340 0x7faffc0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0022d6640 1 -- 172.21.15.133:0/1188440929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0c1280 msgr2=0x7faffc0c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0022d6640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0c1280 0x7faffc0c48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0022d6640 1 -- 172.21.15.133:0/1188440929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cb340 msgr2=0x7faffc0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0022d6640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cb340 0x7faffc0af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.646+0000 7fb0022d6640 1 -- 172.21.15.133:0/1188440929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec009420 con 0x7faffc160cc0 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7fb0022d6640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc160cc0 0x7faffc070d00 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7faff40018a0 tx=0x7faff400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7faff27fc640 1 -- 172.21.15.133:0/1188440929 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4012400 con 0x7faffc160cc0 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7faff27fc640 1 -- 172.21.15.133:0/1188440929 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4012560 con 0x7faffc160cc0 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc0b3f00 con 0x7faffc160cc0 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7faff27fc640 1 -- 172.21.15.133:0/1188440929 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4012910 con 0x7faffc160cc0 2023-12-18T10:23:14.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc0b3280 con 0x7faffc160cc0 2023-12-18T10:23:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc0735b0 con 0x7faffc160cc0 2023-12-18T10:23:14.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7faff27fc640 1 -- 172.21.15.133:0/1188440929 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faff4012a70 con 0x7faffc160cc0 2023-12-18T10:23:14.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7faff27fc640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe0065a60 0x7fafe0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:14.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7faff27fc640 1 -- 172.21.15.133:0/1188440929 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faff4083960 con 0x7faffc160cc0 2023-12-18T10:23:14.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.650+0000 7fb001ad5640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe0065a60 0x7fafe0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:14.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.654+0000 7fb001ad5640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe0065a60 0x7fafe0067f20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faff8007fd0 tx=0x7faff8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:14.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.654+0000 7faff27fc640 1 -- 172.21.15.133:0/1188440929 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faff4051280 con 0x7faffc160cc0 2023-12-18T10:23:14.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faffc0b37a0 con 0x7faffc160cc0 2023-12-18T10:23:14.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7faff27fc640 1 -- 172.21.15.133:0/1188440929 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4720 (secure 0 0 0) 0x7faffc0b37a0 con 0x7faffc160cc0 2023-12-18T10:23:14.842 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:14.842 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7096,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7099,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:14.480956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:14.842 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe0065a60 msgr2=0x7fafe0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe0065a60 0x7fafe0067f20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7faff8007fd0 tx=0x7faff8009040 comp rx=0 tx=0).stop 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc160cc0 msgr2=0x7faffc070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc160cc0 0x7faffc070d00 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7faff40018a0 tx=0x7faff400a430 comp rx=0 tx=0).stop 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 shutdown_connections 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fafe0065a60 0x7fafe0067f20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faffc160cc0 0x7faffc070d00 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cb340 0x7faffc0af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 --2- 172.21.15.133:0/1188440929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0c1280 0x7faffc0c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 >> 172.21.15.133:0/1188440929 conn(0x7faffc06a3e0 msgr2=0x7faffc158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:14.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 shutdown_connections 2023-12-18T10:23:14.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.838+0000 7fb003d39640 1 -- 172.21.15.133:0/1188440929 wait complete. 2023-12-18T10:23:14.863 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:15.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.994+0000 7fec36d98640 1 Processor -- start 2023-12-18T10:23:15.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec36d98640 1 -- start start 2023-12-18T10:23:15.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec36d98640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec3015a680 0x7fec3015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec36d98640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3015f100 con 0x7fec300cac10 2023-12-18T10:23:15.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec36d98640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec300ca7d0 con 0x7fec3006fdb0 2023-12-18T10:23:15.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec36d98640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3015e860 con 0x7fec3015a680 2023-12-18T10:23:15.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec34b34640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec3015a680 0x7fec3015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec27fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fec300cac10 0x7fec3015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34036/0 (socket says 172.21.15.133:34036) 2023-12-18T10:23:15.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec34b34640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec3015a680 0x7fec3015e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44338/0 (socket says 172.21.15.133:44338) 2023-12-18T10:23:15.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec27fff640 1 -- 172.21.15.133:0/4175170350 learned_addr learned my addr 172.21.15.133:0/4175170350 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:15.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec34b34640 1 -- 172.21.15.133:0/4175170350 >> v1:172.21.15.142:6789/0 conn(0x7fec3006fdb0 legacy=0x7fec300c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec34b34640 1 -- 172.21.15.133:0/4175170350 >> v1:172.21.15.133:6789/0 conn(0x7fec300cac10 legacy=0x7fec3015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:14.998+0000 7fec34b34640 1 -- 172.21.15.133:0/4175170350 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3015eb40 con 0x7fec3015a680 2023-12-18T10:23:15.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec34b34640 1 --2- 172.21.15.133:0/4175170350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3015a680 0x7fec3015e160 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0097f0 tx=0x7fec2c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381434ed8ced91f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec277fe640 1 -- 172.21.15.133:0/4175170350 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0ab5f0 con 0x7fec3015a680 2023-12-18T10:23:15.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec277fe640 1 -- 172.21.15.133:0/4175170350 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c0ab750 con 0x7fec3015a680 2023-12-18T10:23:15.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec277fe640 1 -- 172.21.15.133:0/4175170350 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0abae0 con 0x7fec3015a680 2023-12-18T10:23:15.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 -- 172.21.15.133:0/4175170350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3015a680 msgr2=0x7fec3015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 --2- 172.21.15.133:0/4175170350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3015a680 0x7fec3015e160 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0097f0 tx=0x7fec2c01c3f0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 -- 172.21.15.133:0/4175170350 shutdown_connections 2023-12-18T10:23:15.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 --2- 172.21.15.133:0/4175170350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3015a680 0x7fec3015e160 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 -- 172.21.15.133:0/4175170350 >> 172.21.15.133:0/4175170350 conn(0x7fec3006a3e0 msgr2=0x7fec300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:15.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 -- 172.21.15.133:0/4175170350 shutdown_connections 2023-12-18T10:23:15.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 -- 172.21.15.133:0/4175170350 wait complete. 2023-12-18T10:23:15.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 Processor -- start 2023-12-18T10:23:15.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.002+0000 7fec36d98640 1 -- start start 2023-12-18T10:23:15.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3006fdb0 0x7fec301604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec300cac10 0x7fec301583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec3015a680 0x7fec30158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec300c31f0 con 0x7fec3006fdb0 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec300c5f70 con 0x7fec3015a680 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec300c7dc0 con 0x7fec300cac10 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3006fdb0 0x7fec301604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3006fdb0 0x7fec301604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44352/0 (socket says 172.21.15.133:44352) 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 -- 172.21.15.133:0/2618300346 learned_addr learned my addr 172.21.15.133:0/2618300346 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec27fff640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec300cac10 0x7fec301583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec35335640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec3015a680 0x7fec30158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 -- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec300cac10 msgr2=0x7fec301583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec300cac10 0x7fec301583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 -- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec3015a680 msgr2=0x7fec30158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec3015a680 0x7fec30158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 -- 172.21.15.133:0/2618300346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c009420 con 0x7fec3006fdb0 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec35335640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec3015a680 0x7fec30158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec34b34640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3006fdb0 0x7fec301604a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0ad040 tx=0x7fec2c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec257fa640 1 -- 172.21.15.133:0/2618300346 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0b5810 con 0x7fec3006fdb0 2023-12-18T10:23:15.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec257fa640 1 -- 172.21.15.133:0/2618300346 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c0b5990 con 0x7fec3006fdb0 2023-12-18T10:23:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec30070750 con 0x7fec3006fdb0 2023-12-18T10:23:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec257fa640 1 -- 172.21.15.133:0/2618300346 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c0b5d40 con 0x7fec3006fdb0 2023-12-18T10:23:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec300c8060 con 0x7fec3006fdb0 2023-12-18T10:23:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec300735b0 con 0x7fec3006fdb0 2023-12-18T10:23:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.006+0000 7fec257fa640 1 -- 172.21.15.133:0/2618300346 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fec2c0c83f0 con 0x7fec3006fdb0 2023-12-18T10:23:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.010+0000 7fec257fa640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fec1c065a60 0x7fec1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.010+0000 7fec257fa640 1 -- 172.21.15.133:0/2618300346 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fec2c0a8050 con 0x7fec3006fdb0 2023-12-18T10:23:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.010+0000 7fec27fff640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fec1c065a60 0x7fec1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.010+0000 7fec27fff640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fec1c065a60 0x7fec1c067f20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec3015d000 tx=0x7fec20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.014+0000 7fec257fa640 1 -- 172.21.15.133:0/2618300346 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fec2c0eb7f0 con 0x7fec3006fdb0 2023-12-18T10:23:15.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.170+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec30072e40 con 0x7fec3006fdb0 2023-12-18T10:23:15.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.170+0000 7fec257fa640 1 -- 172.21.15.133:0/2618300346 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16357 (secure 0 0 0) 0x7fec2c0eee10 con 0x7fec3006fdb0 2023-12-18T10:23:15.174 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:15.174 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:23:12.471181+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:23:10.000470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-18T10:23:10.462940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fec1c065a60 msgr2=0x7fec1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fec1c065a60 0x7fec1c067f20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec3015d000 tx=0x7fec20009040 comp rx=0 tx=0).stop 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3006fdb0 msgr2=0x7fec301604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3006fdb0 0x7fec301604a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0ad040 tx=0x7fec2c01ac30 comp rx=0 tx=0).stop 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 shutdown_connections 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fec1c065a60 0x7fec1c067f20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec3015a680 0x7fec30158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fec300cac10 0x7fec301583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 --2- 172.21.15.133:0/2618300346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec3006fdb0 0x7fec301604a0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 >> 172.21.15.133:0/2618300346 conn(0x7fec3006a3e0 msgr2=0x7fec3015c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 shutdown_connections 2023-12-18T10:23:15.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.174+0000 7fec36d98640 1 -- 172.21.15.133:0/2618300346 wait complete. 2023-12-18T10:23:15.196 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-18T10:23:15.197 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:23:15.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.330+0000 7f0e48325640 1 Processor -- start 2023-12-18T10:23:15.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.330+0000 7f0e48325640 1 -- start start 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e48325640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e4015a680 0x7f0e4015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e48325640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006fdb0 0x7f0e40070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e48325640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4015f100 con 0x7f0e400cac10 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e48325640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e40070780 con 0x7f0e4015a680 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e48325640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400ca7d0 con 0x7f0e4006fdb0 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e460c1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e4015a680 0x7f0e4015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e458c0640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0e400cac10 0x7f0e4015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34040/0 (socket says 172.21.15.133:34040) 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e458c0640 1 -- 172.21.15.133:0/1083797401 learned_addr learned my addr 172.21.15.133:0/1083797401 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e468c2640 1 --2- 172.21.15.133:0/1083797401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006fdb0 0x7f0e40070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e460c1640 1 -- 172.21.15.133:0/1083797401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006fdb0 msgr2=0x7f0e40070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:15.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e460c1640 1 --2- 172.21.15.133:0/1083797401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006fdb0 0x7f0e40070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e460c1640 1 -- 172.21.15.133:0/1083797401 >> v1:172.21.15.133:6789/0 conn(0x7f0e400cac10 legacy=0x7f0e4015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.334+0000 7f0e460c1640 1 -- 172.21.15.133:0/1083797401 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4015e860 con 0x7f0e4015a680 2023-12-18T10:23:15.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e460c1640 1 --2- 172.21.15.133:0/1083797401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4015a680 0x7f0e4015e160 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0097f0 tx=0x7f0e3c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f4e500d1fa1191 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e450bf640 1 -- 172.21.15.133:0/1083797401 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0ab5f0 con 0x7f0e4015a680 2023-12-18T10:23:15.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e450bf640 1 -- 172.21.15.133:0/1083797401 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0ab750 con 0x7f0e4015a680 2023-12-18T10:23:15.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e450bf640 1 -- 172.21.15.133:0/1083797401 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0abae0 con 0x7f0e4015a680 2023-12-18T10:23:15.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 -- 172.21.15.133:0/1083797401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4015a680 msgr2=0x7f0e4015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 --2- 172.21.15.133:0/1083797401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4015a680 0x7f0e4015e160 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0097f0 tx=0x7f0e3c01c3f0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 -- 172.21.15.133:0/1083797401 shutdown_connections 2023-12-18T10:23:15.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 --2- 172.21.15.133:0/1083797401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4006fdb0 0x7f0e40070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 --2- 172.21.15.133:0/1083797401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4015a680 0x7f0e4015e160 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 -- 172.21.15.133:0/1083797401 >> 172.21.15.133:0/1083797401 conn(0x7f0e4006a3e0 msgr2=0x7f0e400afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:15.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 -- 172.21.15.133:0/1083797401 shutdown_connections 2023-12-18T10:23:15.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 -- 172.21.15.133:0/1083797401 wait complete. 2023-12-18T10:23:15.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 Processor -- start 2023-12-18T10:23:15.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.338+0000 7f0e48325640 1 -- start start 2023-12-18T10:23:15.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4006fdb0 0x7f0e40152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e400cac10 0x7f0e400b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4015a680 0x7f0e400b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40153ef0 con 0x7f0e4006fdb0 2023-12-18T10:23:15.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40154140 con 0x7f0e400cac10 2023-12-18T10:23:15.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40154420 con 0x7f0e4015a680 2023-12-18T10:23:15.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4006fdb0 0x7f0e40152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4006fdb0 0x7f0e40152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44378/0 (socket says 172.21.15.133:44378) 2023-12-18T10:23:15.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 -- 172.21.15.133:0/1762421386 learned_addr learned my addr 172.21.15.133:0/1762421386 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:15.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e458c0640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e400cac10 0x7f0e400b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e468c2640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4015a680 0x7f0e400b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 -- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4015a680 msgr2=0x7f0e400b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4015a680 0x7f0e400b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 -- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e400cac10 msgr2=0x7f0e400b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e400cac10 0x7f0e400b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 -- 172.21.15.133:0/1762421386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009420 con 0x7f0e4006fdb0 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e468c2640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4015a680 0x7f0e400b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e458c0640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e400cac10 0x7f0e400b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e460c1640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4006fdb0 0x7f0e40152f40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0ad040 tx=0x7f0e3c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e36ffd640 1 -- 172.21.15.133:0/1762421386 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0bf610 con 0x7f0e4006fdb0 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e36ffd640 1 -- 172.21.15.133:0/1762421386 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0bf7b0 con 0x7f0e4006fdb0 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e40154700 con 0x7f0e4006fdb0 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e36ffd640 1 -- 172.21.15.133:0/1762421386 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0bfb60 con 0x7f0e4006fdb0 2023-12-18T10:23:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e40154cc0 con 0x7f0e4006fdb0 2023-12-18T10:23:15.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e400735b0 con 0x7f0e4006fdb0 2023-12-18T10:23:15.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.342+0000 7f0e36ffd640 1 -- 172.21.15.133:0/1762421386 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e3c0b5400 con 0x7f0e4006fdb0 2023-12-18T10:23:15.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.346+0000 7f0e36ffd640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e24065a90 0x7f0e24067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.346+0000 7f0e36ffd640 1 -- 172.21.15.133:0/1762421386 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e3c0a8050 con 0x7f0e4006fdb0 2023-12-18T10:23:15.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.346+0000 7f0e458c0640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e24065a90 0x7f0e24067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.346+0000 7f0e458c0640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e24065a90 0x7f0e24067f50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0e400c51b0 tx=0x7f0e30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.350+0000 7f0e36ffd640 1 -- 172.21.15.133:0/1762421386 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0e3c0eb420 con 0x7f0e4006fdb0 2023-12-18T10:23:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.494+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e400c8e10 con 0x7f0e24065a90 2023-12-18T10:23:15.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.502+0000 7f0e36ffd640 1 -- 172.21.15.133:0/1762421386 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288896 (secure 0 0 0) 0x7f0e30001c70 con 0x7f0e24065a90 2023-12-18T10:23:15.510 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:23:15.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e24065a90 msgr2=0x7f0e24067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e24065a90 0x7f0e24067f50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0e400c51b0 tx=0x7f0e30009040 comp rx=0 tx=0).stop 2023-12-18T10:23:15.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4006fdb0 msgr2=0x7f0e40152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4006fdb0 0x7f0e40152f40 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0ad040 tx=0x7f0e3c01ac30 comp rx=0 tx=0).stop 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 shutdown_connections 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e24065a90 0x7f0e24067f50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e4015a680 0x7f0e400b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e400cac10 0x7f0e400b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 --2- 172.21.15.133:0/1762421386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e4006fdb0 0x7f0e40152f40 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 >> 172.21.15.133:0/1762421386 conn(0x7f0e4006a3e0 msgr2=0x7f0e4015d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 shutdown_connections 2023-12-18T10:23:15.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.506+0000 7f0e48325640 1 -- 172.21.15.133:0/1762421386 wait complete. 2023-12-18T10:23:15.530 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2023-12-18T10:23:15.161973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248884,"kb_used_data":8692,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754725836,"statfs":{"total":773094113280,"available":772839256064,"internally_reserved":0,"allocated":8900608,"data_stored":4672008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.086466"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.748038+0000","last_change":"2023-12-18T10:23:11.510260+0000","last_active":"2023-12-18T10:23:12.748038+0000","last_peered":"2023-12-18T10:23:12.748038+0000","last_clean":"2023-12-18T10:23:12.748038+0000","last_became_active":"2023-12-18T10:23:11.509907+0000","last_became_peered":"2023-12-18T10:23:11.509907+0000","last_unstale":"2023-12-18T10:23:12.748038+0000","last_undegraded":"2023-12-18T10:23:12.748038+0000","last_fullsized":"2023-12-18T10:23:12.748038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:30:17.151255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481580+0000","last_change":"2023-12-18T10:23:11.497792+0000","last_active":"2023-12-18T10:23:12.481580+0000","last_peered":"2023-12-18T10:23:12.481580+0000","last_clean":"2023-12-18T10:23:12.481580+0000","last_became_active":"2023-12-18T10:23:11.497505+0000","last_became_peered":"2023-12-18T10:23:11.497505+0000","last_unstale":"2023-12-18T10:23:12.481580+0000","last_undegraded":"2023-12-18T10:23:12.481580+0000","last_fullsized":"2023-12-18T10:23:12.481580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:09:36.321828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581516+0000","last_change":"2023-12-18T10:23:11.497570+0000","last_active":"2023-12-18T10:23:12.581516+0000","last_peered":"2023-12-18T10:23:12.581516+0000","last_clean":"2023-12-18T10:23:12.581516+0000","last_became_active":"2023-12-18T10:23:11.497327+0000","last_became_peered":"2023-12-18T10:23:11.497327+0000","last_unstale":"2023-12-18T10:23:12.581516+0000","last_undegraded":"2023-12-18T10:23:12.581516+0000","last_fullsized":"2023-12-18T10:23:12.581516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:22.726345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.514606+0000","last_change":"2023-12-18T10:23:11.502992+0000","last_active":"2023-12-18T10:23:11.514606+0000","last_peered":"2023-12-18T10:23:11.514606+0000","last_clean":"2023-12-18T10:23:11.514606+0000","last_became_active":"2023-12-18T10:23:11.501660+0000","last_became_peered":"2023-12-18T10:23:11.501660+0000","last_unstale":"2023-12-18T10:23:11.514606+0000","last_undegraded":"2023-12-18T10:23:11.514606+0000","last_fullsized":"2023-12-18T10:23:11.514606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:25.776926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803566+0000","last_change":"2023-12-18T10:23:11.497715+0000","last_active":"2023-12-18T10:23:12.803566+0000","last_peered":"2023-12-18T10:23:12.803566+0000","last_clean":"2023-12-18T10:23:12.803566+0000","last_became_active":"2023-12-18T10:23:11.497478+0000","last_became_peered":"2023-12-18T10:23:11.497478+0000","last_unstale":"2023-12-18T10:23:12.803566+0000","last_undegraded":"2023-12-18T10:23:12.803566+0000","last_fullsized":"2023-12-18T10:23:12.803566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:21.256629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482524+0000","last_change":"2023-12-18T10:23:11.511774+0000","last_active":"2023-12-18T10:23:12.482524+0000","last_peered":"2023-12-18T10:23:12.482524+0000","last_clean":"2023-12-18T10:23:12.482524+0000","last_became_active":"2023-12-18T10:23:11.511441+0000","last_became_peered":"2023-12-18T10:23:11.511441+0000","last_unstale":"2023-12-18T10:23:12.482524+0000","last_undegraded":"2023-12-18T10:23:12.482524+0000","last_fullsized":"2023-12-18T10:23:12.482524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:42:35.336836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.500532+0000","last_change":"2023-12-18T10:23:11.493758+0000","last_active":"2023-12-18T10:23:11.500532+0000","last_peered":"2023-12-18T10:23:11.500532+0000","last_clean":"2023-12-18T10:23:11.500532+0000","last_became_active":"2023-12-18T10:23:11.493206+0000","last_became_peered":"2023-12-18T10:23:11.493206+0000","last_unstale":"2023-12-18T10:23:11.500532+0000","last_undegraded":"2023-12-18T10:23:11.500532+0000","last_fullsized":"2023-12-18T10:23:11.500532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:26:46.776078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803429+0000","last_change":"2023-12-18T10:23:11.490657+0000","last_active":"2023-12-18T10:23:12.803429+0000","last_peered":"2023-12-18T10:23:12.803429+0000","last_clean":"2023-12-18T10:23:12.803429+0000","last_became_active":"2023-12-18T10:23:11.490400+0000","last_became_peered":"2023-12-18T10:23:11.490400+0000","last_unstale":"2023-12-18T10:23:12.803429+0000","last_undegraded":"2023-12-18T10:23:12.803429+0000","last_fullsized":"2023-12-18T10:23:12.803429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:17:05.579871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.530047+0000","last_change":"2023-12-18T10:23:11.508724+0000","last_active":"2023-12-18T10:23:12.530047+0000","last_peered":"2023-12-18T10:23:12.530047+0000","last_clean":"2023-12-18T10:23:12.530047+0000","last_became_active":"2023-12-18T10:23:11.508409+0000","last_became_peered":"2023-12-18T10:23:11.508409+0000","last_unstale":"2023-12-18T10:23:12.530047+0000","last_undegraded":"2023-12-18T10:23:12.530047+0000","last_fullsized":"2023-12-18T10:23:12.530047+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:08:30.672587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.509571+0000","last_change":"2023-12-18T10:23:11.502837+0000","last_active":"2023-12-18T10:23:11.509571+0000","last_peered":"2023-12-18T10:23:11.509571+0000","last_clean":"2023-12-18T10:23:11.509571+0000","last_became_active":"2023-12-18T10:23:11.502554+0000","last_became_peered":"2023-12-18T10:23:11.502554+0000","last_unstale":"2023-12-18T10:23:11.509571+0000","last_undegraded":"2023-12-18T10:23:11.509571+0000","last_fullsized":"2023-12-18T10:23:11.509571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:08:30.672587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481551+0000","last_change":"2023-12-18T10:23:11.501659+0000","last_active":"2023-12-18T10:23:12.481551+0000","last_peered":"2023-12-18T10:23:12.481551+0000","last_clean":"2023-12-18T10:23:12.481551+0000","last_became_active":"2023-12-18T10:23:11.500973+0000","last_became_peered":"2023-12-18T10:23:11.500973+0000","last_unstale":"2023-12-18T10:23:12.481551+0000","last_undegraded":"2023-12-18T10:23:12.481551+0000","last_fullsized":"2023-12-18T10:23:12.481551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:37:30.533990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.514533+0000","last_change":"2023-12-18T10:23:11.504370+0000","last_active":"2023-12-18T10:23:11.514533+0000","last_peered":"2023-12-18T10:23:11.514533+0000","last_clean":"2023-12-18T10:23:11.514533+0000","last_became_active":"2023-12-18T10:23:11.504114+0000","last_became_peered":"2023-12-18T10:23:11.504114+0000","last_unstale":"2023-12-18T10:23:11.514533+0000","last_undegraded":"2023-12-18T10:23:11.514533+0000","last_fullsized":"2023-12-18T10:23:11.514533+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:11:49.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803571+0000","last_change":"2023-12-18T10:23:11.499906+0000","last_active":"2023-12-18T10:23:12.803571+0000","last_peered":"2023-12-18T10:23:12.803571+0000","last_clean":"2023-12-18T10:23:12.803571+0000","last_became_active":"2023-12-18T10:23:11.499659+0000","last_became_peered":"2023-12-18T10:23:11.499659+0000","last_unstale":"2023-12-18T10:23:12.803571+0000","last_undegraded":"2023-12-18T10:23:12.803571+0000","last_fullsized":"2023-12-18T10:23:12.803571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:23.801829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482587+0000","last_change":"2023-12-18T10:23:11.503419+0000","last_active":"2023-12-18T10:23:12.482587+0000","last_peered":"2023-12-18T10:23:12.482587+0000","last_clean":"2023-12-18T10:23:12.482587+0000","last_became_active":"2023-12-18T10:23:11.502835+0000","last_became_peered":"2023-12-18T10:23:11.502835+0000","last_unstale":"2023-12-18T10:23:12.482587+0000","last_undegraded":"2023-12-18T10:23:12.482587+0000","last_fullsized":"2023-12-18T10:23:12.482587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:14:20.523891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481103+0000","last_change":"2023-12-18T10:23:11.498799+0000","last_active":"2023-12-18T10:23:12.481103+0000","last_peered":"2023-12-18T10:23:12.481103+0000","last_clean":"2023-12-18T10:23:12.481103+0000","last_became_active":"2023-12-18T10:23:11.498493+0000","last_became_peered":"2023-12-18T10:23:11.498493+0000","last_unstale":"2023-12-18T10:23:12.481103+0000","last_undegraded":"2023-12-18T10:23:12.481103+0000","last_fullsized":"2023-12-18T10:23:12.481103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:44:33.560236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747658+0000","last_change":"2023-12-18T10:23:11.497178+0000","last_active":"2023-12-18T10:23:12.747658+0000","last_peered":"2023-12-18T10:23:12.747658+0000","last_clean":"2023-12-18T10:23:12.747658+0000","last_became_active":"2023-12-18T10:23:11.496893+0000","last_became_peered":"2023-12-18T10:23:11.496893+0000","last_unstale":"2023-12-18T10:23:12.747658+0000","last_undegraded":"2023-12-18T10:23:12.747658+0000","last_fullsized":"2023-12-18T10:23:12.747658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:46:41.666723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803686+0000","last_change":"2023-12-18T10:23:11.496750+0000","last_active":"2023-12-18T10:23:12.803686+0000","last_peered":"2023-12-18T10:23:12.803686+0000","last_clean":"2023-12-18T10:23:12.803686+0000","last_became_active":"2023-12-18T10:23:11.495001+0000","last_became_peered":"2023-12-18T10:23:11.495001+0000","last_unstale":"2023-12-18T10:23:12.803686+0000","last_undegraded":"2023-12-18T10:23:12.803686+0000","last_fullsized":"2023-12-18T10:23:12.803686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:16:01.250786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581404+0000","last_change":"2023-12-18T10:23:11.501115+0000","last_active":"2023-12-18T10:23:12.581404+0000","last_peered":"2023-12-18T10:23:12.581404+0000","last_clean":"2023-12-18T10:23:12.581404+0000","last_became_active":"2023-12-18T10:23:11.500874+0000","last_became_peered":"2023-12-18T10:23:11.500874+0000","last_unstale":"2023-12-18T10:23:12.581404+0000","last_undegraded":"2023-12-18T10:23:12.581404+0000","last_fullsized":"2023-12-18T10:23:12.581404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:29.294775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482613+0000","last_change":"2023-12-18T10:23:11.507594+0000","last_active":"2023-12-18T10:23:12.482613+0000","last_peered":"2023-12-18T10:23:12.482613+0000","last_clean":"2023-12-18T10:23:12.482613+0000","last_became_active":"2023-12-18T10:23:11.507169+0000","last_became_peered":"2023-12-18T10:23:11.507169+0000","last_unstale":"2023-12-18T10:23:12.482613+0000","last_undegraded":"2023-12-18T10:23:12.482613+0000","last_fullsized":"2023-12-18T10:23:12.482613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:09:36.321828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803657+0000","last_change":"2023-12-18T10:23:11.487409+0000","last_active":"2023-12-18T10:23:12.803657+0000","last_peered":"2023-12-18T10:23:12.803657+0000","last_clean":"2023-12-18T10:23:12.803657+0000","last_became_active":"2023-12-18T10:23:11.487162+0000","last_became_peered":"2023-12-18T10:23:11.487162+0000","last_unstale":"2023-12-18T10:23:12.803657+0000","last_undegraded":"2023-12-18T10:23:12.803657+0000","last_fullsized":"2023-12-18T10:23:12.803657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:35:38.892192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529872+0000","last_change":"2023-12-18T10:23:11.501696+0000","last_active":"2023-12-18T10:23:12.529872+0000","last_peered":"2023-12-18T10:23:12.529872+0000","last_clean":"2023-12-18T10:23:12.529872+0000","last_became_active":"2023-12-18T10:23:11.501239+0000","last_became_peered":"2023-12-18T10:23:11.501239+0000","last_unstale":"2023-12-18T10:23:12.529872+0000","last_undegraded":"2023-12-18T10:23:12.529872+0000","last_fullsized":"2023-12-18T10:23:12.529872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:46:41.666723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803572+0000","last_change":"2023-12-18T10:23:11.506275+0000","last_active":"2023-12-18T10:23:12.803572+0000","last_peered":"2023-12-18T10:23:12.803572+0000","last_clean":"2023-12-18T10:23:12.803572+0000","last_became_active":"2023-12-18T10:23:11.506018+0000","last_became_peered":"2023-12-18T10:23:11.506018+0000","last_unstale":"2023-12-18T10:23:12.803572+0000","last_undegraded":"2023-12-18T10:23:12.803572+0000","last_fullsized":"2023-12-18T10:23:12.803572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:51:36.183071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529697+0000","last_change":"2023-12-18T10:23:11.500885+0000","last_active":"2023-12-18T10:23:12.529697+0000","last_peered":"2023-12-18T10:23:12.529697+0000","last_clean":"2023-12-18T10:23:12.529697+0000","last_became_active":"2023-12-18T10:23:11.500509+0000","last_became_peered":"2023-12-18T10:23:11.500509+0000","last_unstale":"2023-12-18T10:23:12.529697+0000","last_undegraded":"2023-12-18T10:23:12.529697+0000","last_fullsized":"2023-12-18T10:23:12.529697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:34:10.807687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481072+0000","last_change":"2023-12-18T10:23:11.505944+0000","last_active":"2023-12-18T10:23:12.481072+0000","last_peered":"2023-12-18T10:23:12.481072+0000","last_clean":"2023-12-18T10:23:12.481072+0000","last_became_active":"2023-12-18T10:23:11.505686+0000","last_became_peered":"2023-12-18T10:23:11.505686+0000","last_unstale":"2023-12-18T10:23:12.481072+0000","last_undegraded":"2023-12-18T10:23:12.481072+0000","last_fullsized":"2023-12-18T10:23:12.481072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:38:11.123049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481756+0000","last_change":"2023-12-18T10:23:11.507025+0000","last_active":"2023-12-18T10:23:12.481756+0000","last_peered":"2023-12-18T10:23:12.481756+0000","last_clean":"2023-12-18T10:23:12.481756+0000","last_became_active":"2023-12-18T10:23:11.506727+0000","last_became_peered":"2023-12-18T10:23:11.506727+0000","last_unstale":"2023-12-18T10:23:12.481756+0000","last_undegraded":"2023-12-18T10:23:12.481756+0000","last_fullsized":"2023-12-18T10:23:12.481756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:17:58.957714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.514597+0000","last_change":"2023-12-18T10:23:11.505007+0000","last_active":"2023-12-18T10:23:11.514597+0000","last_peered":"2023-12-18T10:23:11.514597+0000","last_clean":"2023-12-18T10:23:11.514597+0000","last_became_active":"2023-12-18T10:23:11.504734+0000","last_became_peered":"2023-12-18T10:23:11.504734+0000","last_unstale":"2023-12-18T10:23:11.514597+0000","last_undegraded":"2023-12-18T10:23:11.514597+0000","last_fullsized":"2023-12-18T10:23:11.514597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:30:17.151255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747846+0000","last_change":"2023-12-18T10:23:11.506168+0000","last_active":"2023-12-18T10:23:12.747846+0000","last_peered":"2023-12-18T10:23:12.747846+0000","last_clean":"2023-12-18T10:23:12.747846+0000","last_became_active":"2023-12-18T10:23:11.505794+0000","last_became_peered":"2023-12-18T10:23:11.505794+0000","last_unstale":"2023-12-18T10:23:12.747846+0000","last_undegraded":"2023-12-18T10:23:12.747846+0000","last_fullsized":"2023-12-18T10:23:12.747846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:06.373241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803761+0000","last_change":"2023-12-18T10:23:11.497987+0000","last_active":"2023-12-18T10:23:12.803761+0000","last_peered":"2023-12-18T10:23:12.803761+0000","last_clean":"2023-12-18T10:23:12.803761+0000","last_became_active":"2023-12-18T10:23:11.497736+0000","last_became_peered":"2023-12-18T10:23:11.497736+0000","last_unstale":"2023-12-18T10:23:12.803761+0000","last_undegraded":"2023-12-18T10:23:12.803761+0000","last_fullsized":"2023-12-18T10:23:12.803761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:37:38.430587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481330+0000","last_change":"2023-12-18T10:23:11.503159+0000","last_active":"2023-12-18T10:23:12.481330+0000","last_peered":"2023-12-18T10:23:12.481330+0000","last_clean":"2023-12-18T10:23:12.481330+0000","last_became_active":"2023-12-18T10:23:11.502897+0000","last_became_peered":"2023-12-18T10:23:11.502897+0000","last_unstale":"2023-12-18T10:23:12.481330+0000","last_undegraded":"2023-12-18T10:23:12.481330+0000","last_fullsized":"2023-12-18T10:23:12.481330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:18:54.839761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747611+0000","last_change":"2023-12-18T10:23:11.507664+0000","last_active":"2023-12-18T10:23:12.747611+0000","last_peered":"2023-12-18T10:23:12.747611+0000","last_clean":"2023-12-18T10:23:12.747611+0000","last_became_active":"2023-12-18T10:23:11.507266+0000","last_became_peered":"2023-12-18T10:23:11.507266+0000","last_unstale":"2023-12-18T10:23:12.747611+0000","last_undegraded":"2023-12-18T10:23:12.747611+0000","last_fullsized":"2023-12-18T10:23:12.747611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:08:30.672587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581269+0000","last_change":"2023-12-18T10:23:11.483392+0000","last_active":"2023-12-18T10:23:12.581269+0000","last_peered":"2023-12-18T10:23:12.581269+0000","last_clean":"2023-12-18T10:23:12.581269+0000","last_became_active":"2023-12-18T10:23:11.483095+0000","last_became_peered":"2023-12-18T10:23:11.483095+0000","last_unstale":"2023-12-18T10:23:12.581269+0000","last_undegraded":"2023-12-18T10:23:12.581269+0000","last_fullsized":"2023-12-18T10:23:12.581269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:54:10.537184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747665+0000","last_change":"2023-12-18T10:23:11.497108+0000","last_active":"2023-12-18T10:23:12.747665+0000","last_peered":"2023-12-18T10:23:12.747665+0000","last_clean":"2023-12-18T10:23:12.747665+0000","last_became_active":"2023-12-18T10:23:11.496506+0000","last_became_peered":"2023-12-18T10:23:11.496506+0000","last_unstale":"2023-12-18T10:23:12.747665+0000","last_undegraded":"2023-12-18T10:23:12.747665+0000","last_fullsized":"2023-12-18T10:23:12.747665+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:11:49.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581369+0000","last_change":"2023-12-18T10:23:11.494762+0000","last_active":"2023-12-18T10:23:12.581369+0000","last_peered":"2023-12-18T10:23:12.581369+0000","last_clean":"2023-12-18T10:23:12.581369+0000","last_became_active":"2023-12-18T10:23:11.494360+0000","last_became_peered":"2023-12-18T10:23:11.494360+0000","last_unstale":"2023-12-18T10:23:12.581369+0000","last_undegraded":"2023-12-18T10:23:12.581369+0000","last_fullsized":"2023-12-18T10:23:12.581369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:55.277487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"78'4","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803753+0000","last_change":"2023-12-18T10:23:11.095742+0000","last_active":"2023-12-18T10:23:12.803753+0000","last_peered":"2023-12-18T10:23:12.803753+0000","last_clean":"2023-12-18T10:23:12.803753+0000","last_became_active":"2023-12-18T10:23:11.095435+0000","last_became_peered":"2023-12-18T10:23:11.095435+0000","last_unstale":"2023-12-18T10:23:12.803753+0000","last_undegraded":"2023-12-18T10:23:12.803753+0000","last_fullsized":"2023-12-18T10:23:12.803753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:53:37.711936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481199+0000","last_change":"2023-12-18T10:23:11.497488+0000","last_active":"2023-12-18T10:23:12.481199+0000","last_peered":"2023-12-18T10:23:12.481199+0000","last_clean":"2023-12-18T10:23:12.481199+0000","last_became_active":"2023-12-18T10:23:11.496294+0000","last_became_peered":"2023-12-18T10:23:11.496294+0000","last_unstale":"2023-12-18T10:23:12.481199+0000","last_undegraded":"2023-12-18T10:23:12.481199+0000","last_fullsized":"2023-12-18T10:23:12.481199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:46:41.666723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"78'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747973+0000","last_change":"2023-12-18T10:23:11.115859+0000","last_active":"2023-12-18T10:23:12.747973+0000","last_peered":"2023-12-18T10:23:12.747973+0000","last_clean":"2023-12-18T10:23:12.747973+0000","last_became_active":"2023-12-18T10:23:11.115537+0000","last_became_peered":"2023-12-18T10:23:11.115537+0000","last_unstale":"2023-12-18T10:23:12.747973+0000","last_undegraded":"2023-12-18T10:23:12.747973+0000","last_fullsized":"2023-12-18T10:23:12.747973+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:15.409763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529937+0000","last_change":"2023-12-18T10:23:11.512872+0000","last_active":"2023-12-18T10:23:12.529937+0000","last_peered":"2023-12-18T10:23:12.529937+0000","last_clean":"2023-12-18T10:23:12.529937+0000","last_became_active":"2023-12-18T10:23:11.512481+0000","last_became_peered":"2023-12-18T10:23:11.512481+0000","last_unstale":"2023-12-18T10:23:12.529937+0000","last_undegraded":"2023-12-18T10:23:12.529937+0000","last_fullsized":"2023-12-18T10:23:12.529937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:25.776926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"78'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747846+0000","last_change":"2023-12-18T10:23:11.106607+0000","last_active":"2023-12-18T10:23:12.747846+0000","last_peered":"2023-12-18T10:23:12.747846+0000","last_clean":"2023-12-18T10:23:12.747846+0000","last_became_active":"2023-12-18T10:23:11.106416+0000","last_became_peered":"2023-12-18T10:23:11.106416+0000","last_unstale":"2023-12-18T10:23:12.747846+0000","last_undegraded":"2023-12-18T10:23:12.747846+0000","last_fullsized":"2023-12-18T10:23:12.747846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:54:09.530497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529901+0000","last_change":"2023-12-18T10:23:11.501416+0000","last_active":"2023-12-18T10:23:12.529901+0000","last_peered":"2023-12-18T10:23:12.529901+0000","last_clean":"2023-12-18T10:23:12.529901+0000","last_became_active":"2023-12-18T10:23:11.501078+0000","last_became_peered":"2023-12-18T10:23:11.501078+0000","last_unstale":"2023-12-18T10:23:12.529901+0000","last_undegraded":"2023-12-18T10:23:12.529901+0000","last_fullsized":"2023-12-18T10:23:12.529901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:11:49.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.487540+0000","last_change":"2023-12-18T10:23:11.111965+0000","last_active":"2023-12-18T10:23:11.487540+0000","last_peered":"2023-12-18T10:23:11.487540+0000","last_clean":"2023-12-18T10:23:11.487540+0000","last_became_active":"2023-12-18T10:23:11.111234+0000","last_became_peered":"2023-12-18T10:23:11.111234+0000","last_unstale":"2023-12-18T10:23:11.487540+0000","last_undegraded":"2023-12-18T10:23:11.487540+0000","last_fullsized":"2023-12-18T10:23:11.487540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:42:20.248828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481437+0000","last_change":"2023-12-18T10:23:11.502180+0000","last_active":"2023-12-18T10:23:12.481437+0000","last_peered":"2023-12-18T10:23:12.481437+0000","last_clean":"2023-12-18T10:23:12.481437+0000","last_became_active":"2023-12-18T10:23:11.498317+0000","last_became_peered":"2023-12-18T10:23:11.498317+0000","last_unstale":"2023-12-18T10:23:12.481437+0000","last_undegraded":"2023-12-18T10:23:12.481437+0000","last_fullsized":"2023-12-18T10:23:12.481437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:20:44.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"78'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529974+0000","last_change":"2023-12-18T10:23:11.108935+0000","last_active":"2023-12-18T10:23:12.529974+0000","last_peered":"2023-12-18T10:23:12.529974+0000","last_clean":"2023-12-18T10:23:12.529974+0000","last_became_active":"2023-12-18T10:23:11.108600+0000","last_became_peered":"2023-12-18T10:23:11.108600+0000","last_unstale":"2023-12-18T10:23:12.529974+0000","last_undegraded":"2023-12-18T10:23:12.529974+0000","last_fullsized":"2023-12-18T10:23:12.529974+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:28.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481616+0000","last_change":"2023-12-18T10:23:11.496262+0000","last_active":"2023-12-18T10:23:12.481616+0000","last_peered":"2023-12-18T10:23:12.481616+0000","last_clean":"2023-12-18T10:23:12.481616+0000","last_became_active":"2023-12-18T10:23:11.495674+0000","last_became_peered":"2023-12-18T10:23:11.495674+0000","last_unstale":"2023-12-18T10:23:12.481616+0000","last_undegraded":"2023-12-18T10:23:12.481616+0000","last_fullsized":"2023-12-18T10:23:12.481616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:39:16.404479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.501140+0000","last_change":"2023-12-18T10:23:11.108701+0000","last_active":"2023-12-18T10:23:11.501140+0000","last_peered":"2023-12-18T10:23:11.501140+0000","last_clean":"2023-12-18T10:23:11.501140+0000","last_became_active":"2023-12-18T10:23:11.108359+0000","last_became_peered":"2023-12-18T10:23:11.108359+0000","last_unstale":"2023-12-18T10:23:11.501140+0000","last_undegraded":"2023-12-18T10:23:11.501140+0000","last_fullsized":"2023-12-18T10:23:11.501140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:15.409763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.530116+0000","last_change":"2023-12-18T10:23:11.509042+0000","last_active":"2023-12-18T10:23:12.530116+0000","last_peered":"2023-12-18T10:23:12.530116+0000","last_clean":"2023-12-18T10:23:12.530116+0000","last_became_active":"2023-12-18T10:23:11.508755+0000","last_became_peered":"2023-12-18T10:23:11.508755+0000","last_unstale":"2023-12-18T10:23:12.530116+0000","last_undegraded":"2023-12-18T10:23:12.530116+0000","last_fullsized":"2023-12-18T10:23:12.530116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:06.373241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481237+0000","last_change":"2023-12-18T10:23:11.102539+0000","last_active":"2023-12-18T10:23:12.481237+0000","last_peered":"2023-12-18T10:23:12.481237+0000","last_clean":"2023-12-18T10:23:12.481237+0000","last_became_active":"2023-12-18T10:23:11.102110+0000","last_became_peered":"2023-12-18T10:23:11.102110+0000","last_unstale":"2023-12-18T10:23:12.481237+0000","last_undegraded":"2023-12-18T10:23:12.481237+0000","last_fullsized":"2023-12-18T10:23:12.481237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:28.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.501965+0000","last_change":"2023-12-18T10:23:11.497181+0000","last_active":"2023-12-18T10:23:11.501965+0000","last_peered":"2023-12-18T10:23:11.501965+0000","last_clean":"2023-12-18T10:23:11.501965+0000","last_became_active":"2023-12-18T10:23:11.496742+0000","last_became_peered":"2023-12-18T10:23:11.496742+0000","last_unstale":"2023-12-18T10:23:11.501965+0000","last_undegraded":"2023-12-18T10:23:11.501965+0000","last_fullsized":"2023-12-18T10:23:11.501965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:12:30.223338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803477+0000","last_change":"2023-12-18T10:23:11.095331+0000","last_active":"2023-12-18T10:23:12.803477+0000","last_peered":"2023-12-18T10:23:12.803477+0000","last_clean":"2023-12-18T10:23:12.803477+0000","last_became_active":"2023-12-18T10:23:11.095042+0000","last_became_peered":"2023-12-18T10:23:11.095042+0000","last_unstale":"2023-12-18T10:23:12.803477+0000","last_undegraded":"2023-12-18T10:23:12.803477+0000","last_fullsized":"2023-12-18T10:23:12.803477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:30.424680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481072+0000","last_change":"2023-12-18T10:23:11.497160+0000","last_active":"2023-12-18T10:23:12.481072+0000","last_peered":"2023-12-18T10:23:12.481072+0000","last_clean":"2023-12-18T10:23:12.481072+0000","last_became_active":"2023-12-18T10:23:11.496585+0000","last_became_peered":"2023-12-18T10:23:11.496585+0000","last_unstale":"2023-12-18T10:23:12.481072+0000","last_undegraded":"2023-12-18T10:23:12.481072+0000","last_fullsized":"2023-12-18T10:23:12.481072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:00.814636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.748040+0000","last_change":"2023-12-18T10:23:11.113661+0000","last_active":"2023-12-18T10:23:12.748040+0000","last_peered":"2023-12-18T10:23:12.748040+0000","last_clean":"2023-12-18T10:23:12.748040+0000","last_became_active":"2023-12-18T10:23:11.113115+0000","last_became_peered":"2023-12-18T10:23:11.113115+0000","last_unstale":"2023-12-18T10:23:12.748040+0000","last_undegraded":"2023-12-18T10:23:12.748040+0000","last_fullsized":"2023-12-18T10:23:12.748040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:54.270800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.514670+0000","last_change":"2023-12-18T10:23:11.505212+0000","last_active":"2023-12-18T10:23:11.514670+0000","last_peered":"2023-12-18T10:23:11.514670+0000","last_clean":"2023-12-18T10:23:11.514670+0000","last_became_active":"2023-12-18T10:23:11.504929+0000","last_became_peered":"2023-12-18T10:23:11.504929+0000","last_unstale":"2023-12-18T10:23:11.514670+0000","last_undegraded":"2023-12-18T10:23:11.514670+0000","last_fullsized":"2023-12-18T10:23:11.514670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:38:25.078923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.494409+0000","last_change":"2023-12-18T10:23:11.110648+0000","last_active":"2023-12-18T10:23:11.494409+0000","last_peered":"2023-12-18T10:23:11.494409+0000","last_clean":"2023-12-18T10:23:11.494409+0000","last_became_active":"2023-12-18T10:23:11.110360+0000","last_became_peered":"2023-12-18T10:23:11.110360+0000","last_unstale":"2023-12-18T10:23:11.494409+0000","last_undegraded":"2023-12-18T10:23:11.494409+0000","last_fullsized":"2023-12-18T10:23:11.494409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:54:09.530497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482679+0000","last_change":"2023-12-18T10:23:11.503255+0000","last_active":"2023-12-18T10:23:12.482679+0000","last_peered":"2023-12-18T10:23:12.482679+0000","last_clean":"2023-12-18T10:23:12.482679+0000","last_became_active":"2023-12-18T10:23:11.499358+0000","last_became_peered":"2023-12-18T10:23:11.499358+0000","last_unstale":"2023-12-18T10:23:12.482679+0000","last_undegraded":"2023-12-18T10:23:12.482679+0000","last_fullsized":"2023-12-18T10:23:12.482679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:42.531608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"78'3","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803764+0000","last_change":"2023-12-18T10:23:11.103633+0000","last_active":"2023-12-18T10:23:12.803764+0000","last_peered":"2023-12-18T10:23:12.803764+0000","last_clean":"2023-12-18T10:23:12.803764+0000","last_became_active":"2023-12-18T10:23:11.103320+0000","last_became_peered":"2023-12-18T10:23:11.103320+0000","last_unstale":"2023-12-18T10:23:12.803764+0000","last_undegraded":"2023-12-18T10:23:12.803764+0000","last_fullsized":"2023-12-18T10:23:12.803764+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:20:58.591056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581353+0000","last_change":"2023-12-18T10:23:11.505383+0000","last_active":"2023-12-18T10:23:12.581353+0000","last_peered":"2023-12-18T10:23:12.581353+0000","last_clean":"2023-12-18T10:23:12.581353+0000","last_became_active":"2023-12-18T10:23:11.504734+0000","last_became_peered":"2023-12-18T10:23:11.504734+0000","last_unstale":"2023-12-18T10:23:12.581353+0000","last_undegraded":"2023-12-18T10:23:12.581353+0000","last_fullsized":"2023-12-18T10:23:12.581353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:12:02.577013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"78'6","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.512774+0000","last_change":"2023-12-18T10:23:11.115388+0000","last_active":"2023-12-18T10:23:11.512774+0000","last_peered":"2023-12-18T10:23:11.512774+0000","last_clean":"2023-12-18T10:23:11.512774+0000","last_became_active":"2023-12-18T10:23:11.115130+0000","last_became_peered":"2023-12-18T10:23:11.115130+0000","last_unstale":"2023-12-18T10:23:11.512774+0000","last_undegraded":"2023-12-18T10:23:11.512774+0000","last_fullsized":"2023-12-18T10:23:11.512774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:36:51.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.515294+0000","last_change":"2023-12-18T10:23:11.509666+0000","last_active":"2023-12-18T10:23:11.515294+0000","last_peered":"2023-12-18T10:23:11.515294+0000","last_clean":"2023-12-18T10:23:11.515294+0000","last_became_active":"2023-12-18T10:23:11.508907+0000","last_became_peered":"2023-12-18T10:23:11.508907+0000","last_unstale":"2023-12-18T10:23:11.515294+0000","last_undegraded":"2023-12-18T10:23:11.515294+0000","last_fullsized":"2023-12-18T10:23:11.515294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:24:47.602797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.503106+0000","last_change":"2023-12-18T10:23:11.108759+0000","last_active":"2023-12-18T10:23:11.503106+0000","last_peered":"2023-12-18T10:23:11.503106+0000","last_clean":"2023-12-18T10:23:11.503106+0000","last_became_active":"2023-12-18T10:23:11.108468+0000","last_became_peered":"2023-12-18T10:23:11.108468+0000","last_unstale":"2023-12-18T10:23:11.503106+0000","last_undegraded":"2023-12-18T10:23:11.503106+0000","last_fullsized":"2023-12-18T10:23:11.503106+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:54.270800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.495555+0000","last_change":"2023-12-18T10:23:11.484304+0000","last_active":"2023-12-18T10:23:11.495555+0000","last_peered":"2023-12-18T10:23:11.495555+0000","last_clean":"2023-12-18T10:23:11.495555+0000","last_became_active":"2023-12-18T10:23:11.483955+0000","last_became_peered":"2023-12-18T10:23:11.483955+0000","last_unstale":"2023-12-18T10:23:11.495555+0000","last_undegraded":"2023-12-18T10:23:11.495555+0000","last_fullsized":"2023-12-18T10:23:11.495555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:59.541904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747641+0000","last_change":"2023-12-18T10:23:11.107592+0000","last_active":"2023-12-18T10:23:12.747641+0000","last_peered":"2023-12-18T10:23:12.747641+0000","last_clean":"2023-12-18T10:23:12.747641+0000","last_became_active":"2023-12-18T10:23:11.107240+0000","last_became_peered":"2023-12-18T10:23:11.107240+0000","last_unstale":"2023-12-18T10:23:12.747641+0000","last_undegraded":"2023-12-18T10:23:12.747641+0000","last_fullsized":"2023-12-18T10:23:12.747641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:28.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.506234+0000","last_change":"2023-12-18T10:23:11.502074+0000","last_active":"2023-12-18T10:23:11.506234+0000","last_peered":"2023-12-18T10:23:11.506234+0000","last_clean":"2023-12-18T10:23:11.506234+0000","last_became_active":"2023-12-18T10:23:11.501721+0000","last_became_peered":"2023-12-18T10:23:11.501721+0000","last_unstale":"2023-12-18T10:23:11.506234+0000","last_undegraded":"2023-12-18T10:23:11.506234+0000","last_fullsized":"2023-12-18T10:23:11.506234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:43:13.012867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803517+0000","last_change":"2023-12-18T10:23:11.091625+0000","last_active":"2023-12-18T10:23:12.803517+0000","last_peered":"2023-12-18T10:23:12.803517+0000","last_clean":"2023-12-18T10:23:12.803517+0000","last_became_active":"2023-12-18T10:23:11.091034+0000","last_became_peered":"2023-12-18T10:23:11.091034+0000","last_unstale":"2023-12-18T10:23:12.803517+0000","last_undegraded":"2023-12-18T10:23:12.803517+0000","last_fullsized":"2023-12-18T10:23:12.803517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:32:44.964793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.512059+0000","last_change":"2023-12-18T10:23:11.508668+0000","last_active":"2023-12-18T10:23:11.512059+0000","last_peered":"2023-12-18T10:23:11.512059+0000","last_clean":"2023-12-18T10:23:11.512059+0000","last_became_active":"2023-12-18T10:23:11.508311+0000","last_became_peered":"2023-12-18T10:23:11.508311+0000","last_unstale":"2023-12-18T10:23:11.512059+0000","last_undegraded":"2023-12-18T10:23:11.512059+0000","last_fullsized":"2023-12-18T10:23:11.512059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:20.057661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"78'8","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481205+0000","last_change":"2023-12-18T10:23:11.114177+0000","last_active":"2023-12-18T10:23:12.481205+0000","last_peered":"2023-12-18T10:23:12.481205+0000","last_clean":"2023-12-18T10:23:12.481205+0000","last_became_active":"2023-12-18T10:23:11.113847+0000","last_became_peered":"2023-12-18T10:23:11.113847+0000","last_unstale":"2023-12-18T10:23:12.481205+0000","last_undegraded":"2023-12-18T10:23:12.481205+0000","last_fullsized":"2023-12-18T10:23:12.481205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:54:09.530497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482385+0000","last_change":"2023-12-18T10:23:11.496091+0000","last_active":"2023-12-18T10:23:12.482385+0000","last_peered":"2023-12-18T10:23:12.482385+0000","last_clean":"2023-12-18T10:23:12.482385+0000","last_became_active":"2023-12-18T10:23:11.495836+0000","last_became_peered":"2023-12-18T10:23:11.495836+0000","last_unstale":"2023-12-18T10:23:12.482385+0000","last_undegraded":"2023-12-18T10:23:12.482385+0000","last_fullsized":"2023-12-18T10:23:12.482385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:16:30.880667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"78'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.748097+0000","last_change":"2023-12-18T10:23:11.104712+0000","last_active":"2023-12-18T10:23:12.748097+0000","last_peered":"2023-12-18T10:23:12.748097+0000","last_clean":"2023-12-18T10:23:12.748097+0000","last_became_active":"2023-12-18T10:23:11.104202+0000","last_became_peered":"2023-12-18T10:23:11.104202+0000","last_unstale":"2023-12-18T10:23:12.748097+0000","last_undegraded":"2023-12-18T10:23:12.748097+0000","last_fullsized":"2023-12-18T10:23:12.748097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:06.325534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803427+0000","last_change":"2023-12-18T10:23:11.490563+0000","last_active":"2023-12-18T10:23:12.803427+0000","last_peered":"2023-12-18T10:23:12.803427+0000","last_clean":"2023-12-18T10:23:12.803427+0000","last_became_active":"2023-12-18T10:23:11.490213+0000","last_became_peered":"2023-12-18T10:23:11.490213+0000","last_unstale":"2023-12-18T10:23:12.803427+0000","last_undegraded":"2023-12-18T10:23:12.803427+0000","last_fullsized":"2023-12-18T10:23:12.803427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:43:03.706269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"78'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.530114+0000","last_change":"2023-12-18T10:23:11.104478+0000","last_active":"2023-12-18T10:23:12.530114+0000","last_peered":"2023-12-18T10:23:12.530114+0000","last_clean":"2023-12-18T10:23:12.530114+0000","last_became_active":"2023-12-18T10:23:11.104188+0000","last_became_peered":"2023-12-18T10:23:11.104188+0000","last_unstale":"2023-12-18T10:23:12.530114+0000","last_undegraded":"2023-12-18T10:23:12.530114+0000","last_fullsized":"2023-12-18T10:23:12.530114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:54.270800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803733+0000","last_change":"2023-12-18T10:23:11.497193+0000","last_active":"2023-12-18T10:23:12.803733+0000","last_peered":"2023-12-18T10:23:12.803733+0000","last_clean":"2023-12-18T10:23:12.803733+0000","last_became_active":"2023-12-18T10:23:11.496889+0000","last_became_peered":"2023-12-18T10:23:11.496889+0000","last_unstale":"2023-12-18T10:23:12.803733+0000","last_undegraded":"2023-12-18T10:23:12.803733+0000","last_fullsized":"2023-12-18T10:23:12.803733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:26:23.841250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"78'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803797+0000","last_change":"2023-12-18T10:23:11.111061+0000","last_active":"2023-12-18T10:23:12.803797+0000","last_peered":"2023-12-18T10:23:12.803797+0000","last_clean":"2023-12-18T10:23:12.803797+0000","last_became_active":"2023-12-18T10:23:11.110760+0000","last_became_peered":"2023-12-18T10:23:11.110760+0000","last_unstale":"2023-12-18T10:23:12.803797+0000","last_undegraded":"2023-12-18T10:23:12.803797+0000","last_fullsized":"2023-12-18T10:23:12.803797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:53:41.537733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482463+0000","last_change":"2023-12-18T10:23:11.508825+0000","last_active":"2023-12-18T10:23:12.482463+0000","last_peered":"2023-12-18T10:23:12.482463+0000","last_clean":"2023-12-18T10:23:12.482463+0000","last_became_active":"2023-12-18T10:23:11.508578+0000","last_became_peered":"2023-12-18T10:23:11.508578+0000","last_unstale":"2023-12-18T10:23:12.482463+0000","last_undegraded":"2023-12-18T10:23:12.482463+0000","last_fullsized":"2023-12-18T10:23:12.482463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:08:12.661297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581309+0000","last_change":"2023-12-18T10:23:11.105831+0000","last_active":"2023-12-18T10:23:12.581309+0000","last_peered":"2023-12-18T10:23:12.581309+0000","last_clean":"2023-12-18T10:23:12.581309+0000","last_became_active":"2023-12-18T10:23:11.105225+0000","last_became_peered":"2023-12-18T10:23:11.105225+0000","last_unstale":"2023-12-18T10:23:12.581309+0000","last_undegraded":"2023-12-18T10:23:12.581309+0000","last_fullsized":"2023-12-18T10:23:12.581309+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:58.535217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481457+0000","last_change":"2023-12-18T10:23:11.498127+0000","last_active":"2023-12-18T10:23:12.481457+0000","last_peered":"2023-12-18T10:23:12.481457+0000","last_clean":"2023-12-18T10:23:12.481457+0000","last_became_active":"2023-12-18T10:23:11.497821+0000","last_became_peered":"2023-12-18T10:23:11.497821+0000","last_unstale":"2023-12-18T10:23:12.481457+0000","last_undegraded":"2023-12-18T10:23:12.481457+0000","last_fullsized":"2023-12-18T10:23:12.481457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:08:12.661297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"78'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482475+0000","last_change":"2023-12-18T10:23:11.100388+0000","last_active":"2023-12-18T10:23:12.482475+0000","last_peered":"2023-12-18T10:23:12.482475+0000","last_clean":"2023-12-18T10:23:12.482475+0000","last_became_active":"2023-12-18T10:23:11.100111+0000","last_became_peered":"2023-12-18T10:23:11.100111+0000","last_unstale":"2023-12-18T10:23:12.482475+0000","last_undegraded":"2023-12-18T10:23:12.482475+0000","last_fullsized":"2023-12-18T10:23:12.482475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:18:53.833074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481793+0000","last_change":"2023-12-18T10:23:11.508886+0000","last_active":"2023-12-18T10:23:12.481793+0000","last_peered":"2023-12-18T10:23:12.481793+0000","last_clean":"2023-12-18T10:23:12.481793+0000","last_became_active":"2023-12-18T10:23:11.507929+0000","last_became_peered":"2023-12-18T10:23:11.507929+0000","last_unstale":"2023-12-18T10:23:12.481793+0000","last_undegraded":"2023-12-18T10:23:12.481793+0000","last_fullsized":"2023-12-18T10:23:12.481793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:11:35.875036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482375+0000","last_change":"2023-12-18T10:23:11.111371+0000","last_active":"2023-12-18T10:23:12.482375+0000","last_peered":"2023-12-18T10:23:12.482375+0000","last_clean":"2023-12-18T10:23:12.482375+0000","last_became_active":"2023-12-18T10:23:11.111139+0000","last_became_peered":"2023-12-18T10:23:11.111139+0000","last_unstale":"2023-12-18T10:23:12.482375+0000","last_undegraded":"2023-12-18T10:23:12.482375+0000","last_fullsized":"2023-12-18T10:23:12.482375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:35:59.807949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.502618+0000","last_change":"2023-12-18T10:23:11.500874+0000","last_active":"2023-12-18T10:23:11.502618+0000","last_peered":"2023-12-18T10:23:11.502618+0000","last_clean":"2023-12-18T10:23:11.502618+0000","last_became_active":"2023-12-18T10:23:11.500594+0000","last_became_peered":"2023-12-18T10:23:11.500594+0000","last_unstale":"2023-12-18T10:23:11.502618+0000","last_undegraded":"2023-12-18T10:23:11.502618+0000","last_fullsized":"2023-12-18T10:23:11.502618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:56:36.472903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482477+0000","last_change":"2023-12-18T10:23:11.111341+0000","last_active":"2023-12-18T10:23:12.482477+0000","last_peered":"2023-12-18T10:23:12.482477+0000","last_clean":"2023-12-18T10:23:12.482477+0000","last_became_active":"2023-12-18T10:23:11.111058+0000","last_became_peered":"2023-12-18T10:23:11.111058+0000","last_unstale":"2023-12-18T10:23:12.482477+0000","last_undegraded":"2023-12-18T10:23:12.482477+0000","last_fullsized":"2023-12-18T10:23:12.482477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:05.366554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529841+0000","last_change":"2023-12-18T10:23:11.496533+0000","last_active":"2023-12-18T10:23:12.529841+0000","last_peered":"2023-12-18T10:23:12.529841+0000","last_clean":"2023-12-18T10:23:12.529841+0000","last_became_active":"2023-12-18T10:23:11.496264+0000","last_became_peered":"2023-12-18T10:23:11.496264+0000","last_unstale":"2023-12-18T10:23:12.529841+0000","last_undegraded":"2023-12-18T10:23:12.529841+0000","last_fullsized":"2023-12-18T10:23:12.529841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:24.577958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.511489+0000","last_change":"2023-12-18T10:23:11.115339+0000","last_active":"2023-12-18T10:23:11.511489+0000","last_peered":"2023-12-18T10:23:11.511489+0000","last_clean":"2023-12-18T10:23:11.511489+0000","last_became_active":"2023-12-18T10:23:11.114928+0000","last_became_peered":"2023-12-18T10:23:11.114928+0000","last_unstale":"2023-12-18T10:23:11.511489+0000","last_undegraded":"2023-12-18T10:23:11.511489+0000","last_fullsized":"2023-12-18T10:23:11.511489+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:28.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.512253+0000","last_change":"2023-12-18T10:23:11.508725+0000","last_active":"2023-12-18T10:23:11.512253+0000","last_peered":"2023-12-18T10:23:11.512253+0000","last_clean":"2023-12-18T10:23:11.512253+0000","last_became_active":"2023-12-18T10:23:11.508343+0000","last_became_peered":"2023-12-18T10:23:11.508343+0000","last_unstale":"2023-12-18T10:23:11.512253+0000","last_undegraded":"2023-12-18T10:23:11.512253+0000","last_fullsized":"2023-12-18T10:23:11.512253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:06:24.727784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481857+0000","last_change":"2023-12-18T10:23:11.105058+0000","last_active":"2023-12-18T10:23:12.481857+0000","last_peered":"2023-12-18T10:23:12.481857+0000","last_clean":"2023-12-18T10:23:12.481857+0000","last_became_active":"2023-12-18T10:23:11.104739+0000","last_became_peered":"2023-12-18T10:23:11.104739+0000","last_unstale":"2023-12-18T10:23:12.481857+0000","last_undegraded":"2023-12-18T10:23:12.481857+0000","last_fullsized":"2023-12-18T10:23:12.481857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:54.270800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529840+0000","last_change":"2023-12-18T10:23:11.512509+0000","last_active":"2023-12-18T10:23:12.529840+0000","last_peered":"2023-12-18T10:23:12.529840+0000","last_clean":"2023-12-18T10:23:12.529840+0000","last_became_active":"2023-12-18T10:23:11.512229+0000","last_became_peered":"2023-12-18T10:23:11.512229+0000","last_unstale":"2023-12-18T10:23:12.529840+0000","last_undegraded":"2023-12-18T10:23:12.529840+0000","last_fullsized":"2023-12-18T10:23:12.529840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:30:17.151255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747964+0000","last_change":"2023-12-18T10:23:11.109385+0000","last_active":"2023-12-18T10:23:12.747964+0000","last_peered":"2023-12-18T10:23:12.747964+0000","last_clean":"2023-12-18T10:23:12.747964+0000","last_became_active":"2023-12-18T10:23:11.109127+0000","last_became_peered":"2023-12-18T10:23:11.109127+0000","last_unstale":"2023-12-18T10:23:12.747964+0000","last_undegraded":"2023-12-18T10:23:12.747964+0000","last_fullsized":"2023-12-18T10:23:12.747964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:21.719658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481354+0000","last_change":"2023-12-18T10:23:11.503412+0000","last_active":"2023-12-18T10:23:12.481354+0000","last_peered":"2023-12-18T10:23:12.481354+0000","last_clean":"2023-12-18T10:23:12.481354+0000","last_became_active":"2023-12-18T10:23:11.498690+0000","last_became_peered":"2023-12-18T10:23:11.498690+0000","last_unstale":"2023-12-18T10:23:12.481354+0000","last_undegraded":"2023-12-18T10:23:12.481354+0000","last_fullsized":"2023-12-18T10:23:12.481354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:19:14.467016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747780+0000","last_change":"2023-12-18T10:23:11.112910+0000","last_active":"2023-12-18T10:23:12.747780+0000","last_peered":"2023-12-18T10:23:12.747780+0000","last_clean":"2023-12-18T10:23:12.747780+0000","last_became_active":"2023-12-18T10:23:11.112618+0000","last_became_peered":"2023-12-18T10:23:11.112618+0000","last_unstale":"2023-12-18T10:23:12.747780+0000","last_undegraded":"2023-12-18T10:23:12.747780+0000","last_fullsized":"2023-12-18T10:23:12.747780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:12:01.570326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.510985+0000","last_change":"2023-12-18T10:23:11.504537+0000","last_active":"2023-12-18T10:23:11.510985+0000","last_peered":"2023-12-18T10:23:11.510985+0000","last_clean":"2023-12-18T10:23:11.510985+0000","last_became_active":"2023-12-18T10:23:11.504040+0000","last_became_peered":"2023-12-18T10:23:11.504040+0000","last_unstale":"2023-12-18T10:23:11.510985+0000","last_undegraded":"2023-12-18T10:23:11.510985+0000","last_fullsized":"2023-12-18T10:23:11.510985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:42:27.358692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.478079+0000","last_change":"2023-12-18T10:23:11.111909+0000","last_active":"2023-12-18T10:23:11.478079+0000","last_peered":"2023-12-18T10:23:11.478079+0000","last_clean":"2023-12-18T10:23:11.478079+0000","last_became_active":"2023-12-18T10:23:11.111039+0000","last_became_peered":"2023-12-18T10:23:11.111039+0000","last_unstale":"2023-12-18T10:23:11.478079+0000","last_undegraded":"2023-12-18T10:23:11.478079+0000","last_fullsized":"2023-12-18T10:23:11.478079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:27:01.279976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.501286+0000","last_change":"2023-12-18T10:23:11.497018+0000","last_active":"2023-12-18T10:23:11.501286+0000","last_peered":"2023-12-18T10:23:11.501286+0000","last_clean":"2023-12-18T10:23:11.501286+0000","last_became_active":"2023-12-18T10:23:11.496697+0000","last_became_peered":"2023-12-18T10:23:11.496697+0000","last_unstale":"2023-12-18T10:23:11.501286+0000","last_undegraded":"2023-12-18T10:23:11.501286+0000","last_fullsized":"2023-12-18T10:23:11.501286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:23:09.876457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803725+0000","last_change":"2023-12-18T10:23:11.098556+0000","last_active":"2023-12-18T10:23:12.803725+0000","last_peered":"2023-12-18T10:23:12.803725+0000","last_clean":"2023-12-18T10:23:12.803725+0000","last_became_active":"2023-12-18T10:23:11.098282+0000","last_became_peered":"2023-12-18T10:23:11.098282+0000","last_unstale":"2023-12-18T10:23:12.803725+0000","last_undegraded":"2023-12-18T10:23:12.803725+0000","last_fullsized":"2023-12-18T10:23:12.803725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:51:37.654691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581467+0000","last_change":"2023-12-18T10:23:11.500741+0000","last_active":"2023-12-18T10:23:12.581467+0000","last_peered":"2023-12-18T10:23:12.581467+0000","last_clean":"2023-12-18T10:23:12.581467+0000","last_became_active":"2023-12-18T10:23:11.500105+0000","last_became_peered":"2023-12-18T10:23:11.500105+0000","last_unstale":"2023-12-18T10:23:12.581467+0000","last_undegraded":"2023-12-18T10:23:12.581467+0000","last_fullsized":"2023-12-18T10:23:12.581467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:16.416450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.477869+0000","last_change":"2023-12-18T10:23:11.112372+0000","last_active":"2023-12-18T10:23:11.477869+0000","last_peered":"2023-12-18T10:23:11.477869+0000","last_clean":"2023-12-18T10:23:11.477869+0000","last_became_active":"2023-12-18T10:23:11.112005+0000","last_became_peered":"2023-12-18T10:23:11.112005+0000","last_unstale":"2023-12-18T10:23:11.477869+0000","last_undegraded":"2023-12-18T10:23:11.477869+0000","last_fullsized":"2023-12-18T10:23:11.477869+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:33:03.500287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581553+0000","last_change":"2023-12-18T10:23:11.491983+0000","last_active":"2023-12-18T10:23:12.581553+0000","last_peered":"2023-12-18T10:23:12.581553+0000","last_clean":"2023-12-18T10:23:12.581553+0000","last_became_active":"2023-12-18T10:23:11.491680+0000","last_became_peered":"2023-12-18T10:23:11.491680+0000","last_unstale":"2023-12-18T10:23:12.581553+0000","last_undegraded":"2023-12-18T10:23:12.581553+0000","last_fullsized":"2023-12-18T10:23:12.581553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:36.500279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581412+0000","last_change":"2023-12-18T10:23:11.108194+0000","last_active":"2023-12-18T10:23:12.581412+0000","last_peered":"2023-12-18T10:23:12.581412+0000","last_clean":"2023-12-18T10:23:12.581412+0000","last_became_active":"2023-12-18T10:23:11.107926+0000","last_became_peered":"2023-12-18T10:23:11.107926+0000","last_unstale":"2023-12-18T10:23:12.581412+0000","last_undegraded":"2023-12-18T10:23:12.581412+0000","last_fullsized":"2023-12-18T10:23:12.581412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:12:29.216651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.748003+0000","last_change":"2023-12-18T10:23:11.511299+0000","last_active":"2023-12-18T10:23:12.748003+0000","last_peered":"2023-12-18T10:23:12.748003+0000","last_clean":"2023-12-18T10:23:12.748003+0000","last_became_active":"2023-12-18T10:23:11.510975+0000","last_became_peered":"2023-12-18T10:23:11.510975+0000","last_unstale":"2023-12-18T10:23:12.748003+0000","last_undegraded":"2023-12-18T10:23:12.748003+0000","last_fullsized":"2023-12-18T10:23:12.748003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:25.776926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482763+0000","last_change":"2023-12-18T10:23:11.114773+0000","last_active":"2023-12-18T10:23:12.482763+0000","last_peered":"2023-12-18T10:23:12.482763+0000","last_clean":"2023-12-18T10:23:12.482763+0000","last_became_active":"2023-12-18T10:23:11.114480+0000","last_became_peered":"2023-12-18T10:23:11.114480+0000","last_unstale":"2023-12-18T10:23:12.482763+0000","last_undegraded":"2023-12-18T10:23:12.482763+0000","last_fullsized":"2023-12-18T10:23:12.482763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:23.571271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.486031+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:23:11.486031+0000","last_peered":"2023-12-18T10:23:11.486031+0000","last_clean":"2023-12-18T10:23:11.486031+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:23:11.486031+0000","last_undegraded":"2023-12-18T10:23:11.486031+0000","last_fullsized":"2023-12-18T10:23:11.486031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1564672,"data_stored":1032001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.85199999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":1.042},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":1.0049999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":1.081},{"interface":"front","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.53700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.90300000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90900000000000003,"5min":1.137,"15min":1.137},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.629}]},{"osd":6,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.95699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":436555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.82999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73999999999999999,"15min":0.872},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98299999999999998,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.77800000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68300000000000005,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94699999999999995,"5min":1.845,"15min":1.845},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73899999999999999,"15min":0.85299999999999998},"min":{"1min":0.58199999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88500000000000001,"5min":4.524,"15min":4.524},"last":0.86399999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73599999999999999,"15min":0.79200000000000004},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.97699999999999998,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71499999999999997,"15min":0.75900000000000001},"min":{"1min":0.57399999999999995,"5min":0.436,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":1.925,"15min":1.925},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.74299999999999999,"15min":0.82299999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95199999999999996,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75600000000000001,"15min":0.88},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.86199999999999999,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.054},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98199999999999998,"5min":1.101,"15min":1.101},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.70899999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92800000000000005,"5min":1.284,"15min":1.284},"last":0.90800000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.73899999999999999},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94699999999999995,"5min":1.129,"15min":1.129},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70699999999999996,"15min":0.752},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99299999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":958464,"data_stored":435025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.67000000000000004},"min":{"1min":0.37,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68200000000000005,"15min":0.748},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.50800000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.752},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.77000000000000002},"min":{"1min":0.499,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70699999999999996,"15min":0.79200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81200000000000006,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.81999999999999995,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.72299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90600000000000003,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.71799999999999997,"15min":0.94899999999999995},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65800000000000003,"15min":0.754},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88500000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67300000000000004,"15min":0.78200000000000003},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.79500000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":0.81299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88600000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":974848,"data_stored":436659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92800000000000005,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76300000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.131,"15min":1.131},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.52200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92900000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":1.008,"5min":1.032,"15min":1.032},"last":0.64900000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70999999999999996,"15min":0.71899999999999997},"min":{"1min":0.56699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96599999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.79500000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.435,"15min":0.435},"max":{"1min":0.77800000000000002,"5min":0.874,"15min":0.874},"last":0.70699999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.073,"15min":1.073},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.71399999999999997},"min":{"1min":0.51600000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":958464,"data_stored":435573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.438,"15min":0.43099999999999999},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84899999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.47099999999999997,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80200000000000005,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.47399999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.311},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.495}]},{"osd":2,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.036,"5min":1.254,"15min":1.254},"last":0.501},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61099999999999999,"15min":0.65900000000000003},"min":{"1min":0.46400000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.98899999999999999,"5min":1.772,"15min":1.772},"last":0.626}]},{"osd":4,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93700000000000006,"5min":1.01,"15min":1.01},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.47099999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.167,"5min":1.181,"15min":1.181},"last":0.55100000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73199999999999998,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92200000000000004,"5min":1.171,"15min":1.171},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.52200000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0549999999999999,"5min":1.069,"15min":1.069},"last":0.52700000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2230000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75700000000000001,"15min":0.78800000000000003},"min":{"1min":0.58799999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.747,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":966656,"data_stored":435733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.432,"15min":0.442},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66000000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.50600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.38},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.629,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.502}]},{"osd":3,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.79700000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97699999999999998,"5min":1.698,"15min":1.698},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.622,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89700000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93400000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54600000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.85999999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.0189999999999999,"5min":1.341,"15min":1.341},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.107,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.745,"15min":0.78700000000000003},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.93999999999999995,"5min":1.282,"15min":1.282},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.84199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":962560,"data_stored":435103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46999999999999997,"15min":0.59199999999999997},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.55300000000000005,"5min":3.976,"15min":3.976},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46400000000000002,"15min":0.51000000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.249}]},{"osd":2,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.52300000000000002,"15min":0.63100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.64600000000000002,"5min":3.786,"15min":3.786},"last":0.312},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.34000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59599999999999997,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.27000000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56299999999999994,"15min":0.66300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71099999999999997,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54500000000000004,"15min":0.65300000000000002},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67800000000000005,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.44}]},{"osd":4,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.80400000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.048,"5min":1.851,"15min":1.851},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78100000000000003,"15min":0.91200000000000003},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78800000000000003,"15min":0.89600000000000002},"min":{"1min":0.52400000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0189999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.89000000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76600000000000001,"15min":0.81699999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0369999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.996,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0269999999999999,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.499},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.82899999999999996},"min":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91600000000000004,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1548288,"data_stored":1025359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.48899999999999999},"min":{"1min":0.318,"5min":0.252,"15min":0.252},"max":{"1min":0.70699999999999996,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51200000000000001,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":1.456,"15min":1.456},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.623,"5min":1.595,"15min":1.595},"last":0.374},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.499,"15min":0.58099999999999996},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.464,"15min":2.464},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.53200000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68500000000000005,"5min":1.859,"15min":1.859},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.628},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74099999999999999,"5min":1.903,"15min":1.903},"last":0.434}]},{"osd":4,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.66000000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0329999999999999,"5min":1.494,"15min":1.494},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0760000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0469999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76200000000000001,"15min":0.81000000000000005},"min":{"1min":0.56899999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97099999999999997,"5min":1.544,"15min":1.544},"last":0.68100000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.746,"15min":0.80200000000000005},"min":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93100000000000005,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.78700000000000003},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92900000000000005,"5min":1.53,"15min":1.53},"last":1.002}]},{"osd":7,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.745,"15min":0.79500000000000004},"min":{"1min":0.61499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85899999999999999,"5min":1.556,"15min":1.556},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.621,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96899999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.95099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:23:15.536 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:23:15.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd2122d1640 1 Processor -- start 2023-12-18T10:23:15.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd2122d1640 1 -- start start 2023-12-18T10:23:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd2122d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c0cf0d0 0x7fd20c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd2122d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0cfa70 con 0x7fd20c15ca40 2023-12-18T10:23:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd2122d1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0d11c0 con 0x7fd20c1648d0 2023-12-18T10:23:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd2122d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0d0310 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd20c15ca40 0x7fd20c0cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34050/0 (socket says 172.21.15.133:34050) 2023-12-18T10:23:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20bfff640 1 -- 172.21.15.133:0/3947360037 learned_addr learned my addr 172.21.15.133:0/3947360037 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20b7fe640 1 --2- 172.21.15.133:0/3947360037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c0cf0d0 0x7fd20c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20affd640 1 -- 172.21.15.133:0/3947360037 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797186180 0 0) 0x7fd20c0cfa70 con 0x7fd20c15ca40 2023-12-18T10:23:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20affd640 1 -- 172.21.15.133:0/3947360037 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f4003530 con 0x7fd20c15ca40 2023-12-18T10:23:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20affd640 1 -- 172.21.15.133:0/3947360037 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437339239 0 0) 0x7fd20c0d11c0 con 0x7fd20c1648d0 2023-12-18T10:23:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20affd640 1 -- 172.21.15.133:0/3947360037 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd20c0cfa70 con 0x7fd20c1648d0 2023-12-18T10:23:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20b7fe640 1 -- 172.21.15.133:0/3947360037 >> v1:172.21.15.142:6789/0 conn(0x7fd20c1648d0 legacy=0x7fd20c166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20affd640 1 -- 172.21.15.133:0/3947360037 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3156979670 0 0) 0x7fd1f4003530 con 0x7fd20c15ca40 2023-12-18T10:23:15.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20b7fe640 1 -- 172.21.15.133:0/3947360037 >> v1:172.21.15.133:6789/0 conn(0x7fd20c15ca40 legacy=0x7fd20c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.706+0000 7fd20b7fe640 1 -- 172.21.15.133:0/3947360037 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0d05b0 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd20b7fe640 1 --2- 172.21.15.133:0/3947360037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c0cf0d0 0x7fd20c0cf530 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2000097d0 tx=0x7fd20001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67368e6ec0b11c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd20affd640 1 -- 172.21.15.133:0/3947360037 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc001800 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd20affd640 1 -- 172.21.15.133:0/3947360037 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2000ac440 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd20affd640 1 -- 172.21.15.133:0/3947360037 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000ac7d0 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd2122d1640 1 -- 172.21.15.133:0/3947360037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c0cf0d0 msgr2=0x7fd20c0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd2122d1640 1 --2- 172.21.15.133:0/3947360037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c0cf0d0 0x7fd20c0cf530 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2000097d0 tx=0x7fd20001c390 comp rx=0 tx=0).stop 2023-12-18T10:23:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd2122d1640 1 -- 172.21.15.133:0/3947360037 shutdown_connections 2023-12-18T10:23:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd2122d1640 1 --2- 172.21.15.133:0/3947360037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c0cf0d0 0x7fd20c0cf530 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd2122d1640 1 -- 172.21.15.133:0/3947360037 >> 172.21.15.133:0/3947360037 conn(0x7fd20c089fb0 msgr2=0x7fd20c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd2122d1640 1 -- 172.21.15.133:0/3947360037 shutdown_connections 2023-12-18T10:23:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.710+0000 7fd2122d1640 1 -- 172.21.15.133:0/3947360037 wait complete. 2023-12-18T10:23:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 Processor -- start 2023-12-18T10:23:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 -- start start 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cf0d0 0x7fd20c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c15ca40 0x7fd20c15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd20c1648d0 0x7fd20c15f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1572e0 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0c9810 con 0x7fd20c1648d0 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0cab00 con 0x7fd20c15ca40 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cf0d0 0x7fd20c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cf0d0 0x7fd20c156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44390/0 (socket says 172.21.15.133:44390) 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 -- 172.21.15.133:0/3290676617 learned_addr learned my addr 172.21.15.133:0/3290676617 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20b7fe640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c15ca40 0x7fd20c15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd21086e640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd20c1648d0 0x7fd20c15f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 -- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c15ca40 msgr2=0x7fd20c15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c15ca40 0x7fd20c15ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 -- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd20c1648d0 msgr2=0x7fd20c15f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd20c1648d0 0x7fd20c15f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 -- 172.21.15.133:0/3290676617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000093b0 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd21086e640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd20c1648d0 0x7fd20c15f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd20bfff640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cf0d0 0x7fd20c156da0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00c6d0 tx=0x7fd1fc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd208ff9640 1 -- 172.21.15.133:0/3290676617 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc007270 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd208ff9640 1 -- 172.21.15.133:0/3290676617 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0073f0 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c0c9a60 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd208ff9640 1 -- 172.21.15.133:0/3290676617 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0057b0 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c0ca020 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.714+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c0d1630 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.718+0000 7fd208ff9640 1 -- 172.21.15.133:0/3290676617 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd1fc005b20 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.718+0000 7fd208ff9640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd1f8065a90 0x7fd1f8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.718+0000 7fd208ff9640 1 -- 172.21.15.133:0/3290676617 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd1fc083290 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.718+0000 7fd20b7fe640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd1f8065a90 0x7fd1f8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.718+0000 7fd20b7fe640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd1f8065a90 0x7fd1f8067f50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd2000ae000 tx=0x7fd200008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:15.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.722+0000 7fd208ff9640 1 -- 172.21.15.133:0/3290676617 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd20c0d1630 con 0x7fd20c0cf0d0 2023-12-18T10:23:15.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.870+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd20c15ce20 con 0x7fd1f8065a90 2023-12-18T10:23:15.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.878+0000 7fd208ff9640 1 -- 172.21.15.133:0/3290676617 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288896 (secure 0 0 0) 0x7fd2000ac830 con 0x7fd1f8065a90 2023-12-18T10:23:15.884 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd1f8065a90 msgr2=0x7fd1f8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd1f8065a90 0x7fd1f8067f50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd2000ae000 tx=0x7fd200008040 comp rx=0 tx=0).stop 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cf0d0 msgr2=0x7fd20c156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cf0d0 0x7fd20c156da0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00c6d0 tx=0x7fd1fc00cb90 comp rx=0 tx=0).stop 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 shutdown_connections 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd1f8065a90 0x7fd1f8067f50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd20c1648d0 0x7fd20c15f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd20c15ca40 0x7fd20c15ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 --2- 172.21.15.133:0/3290676617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0cf0d0 0x7fd20c156da0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 >> 172.21.15.133:0/3290676617 conn(0x7fd20c089fb0 msgr2=0x7fd20c06c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 shutdown_connections 2023-12-18T10:23:15.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:15.882+0000 7fd2122d1640 1 -- 172.21.15.133:0/3290676617 wait complete. 2023-12-18T10:23:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2023-12-18T10:23:15.161973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248884,"kb_used_data":8692,"kb_used_omap":0,"kb_used_meta":240128,"kb_avail":754725836,"statfs":{"total":773094113280,"available":772839256064,"internally_reserved":0,"allocated":8900608,"data_stored":4672008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":245891072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.086466"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.748038+0000","last_change":"2023-12-18T10:23:11.510260+0000","last_active":"2023-12-18T10:23:12.748038+0000","last_peered":"2023-12-18T10:23:12.748038+0000","last_clean":"2023-12-18T10:23:12.748038+0000","last_became_active":"2023-12-18T10:23:11.509907+0000","last_became_peered":"2023-12-18T10:23:11.509907+0000","last_unstale":"2023-12-18T10:23:12.748038+0000","last_undegraded":"2023-12-18T10:23:12.748038+0000","last_fullsized":"2023-12-18T10:23:12.748038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:30:17.151255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481580+0000","last_change":"2023-12-18T10:23:11.497792+0000","last_active":"2023-12-18T10:23:12.481580+0000","last_peered":"2023-12-18T10:23:12.481580+0000","last_clean":"2023-12-18T10:23:12.481580+0000","last_became_active":"2023-12-18T10:23:11.497505+0000","last_became_peered":"2023-12-18T10:23:11.497505+0000","last_unstale":"2023-12-18T10:23:12.481580+0000","last_undegraded":"2023-12-18T10:23:12.481580+0000","last_fullsized":"2023-12-18T10:23:12.481580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:09:36.321828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581516+0000","last_change":"2023-12-18T10:23:11.497570+0000","last_active":"2023-12-18T10:23:12.581516+0000","last_peered":"2023-12-18T10:23:12.581516+0000","last_clean":"2023-12-18T10:23:12.581516+0000","last_became_active":"2023-12-18T10:23:11.497327+0000","last_became_peered":"2023-12-18T10:23:11.497327+0000","last_unstale":"2023-12-18T10:23:12.581516+0000","last_undegraded":"2023-12-18T10:23:12.581516+0000","last_fullsized":"2023-12-18T10:23:12.581516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:22.726345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.514606+0000","last_change":"2023-12-18T10:23:11.502992+0000","last_active":"2023-12-18T10:23:11.514606+0000","last_peered":"2023-12-18T10:23:11.514606+0000","last_clean":"2023-12-18T10:23:11.514606+0000","last_became_active":"2023-12-18T10:23:11.501660+0000","last_became_peered":"2023-12-18T10:23:11.501660+0000","last_unstale":"2023-12-18T10:23:11.514606+0000","last_undegraded":"2023-12-18T10:23:11.514606+0000","last_fullsized":"2023-12-18T10:23:11.514606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:25.776926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803566+0000","last_change":"2023-12-18T10:23:11.497715+0000","last_active":"2023-12-18T10:23:12.803566+0000","last_peered":"2023-12-18T10:23:12.803566+0000","last_clean":"2023-12-18T10:23:12.803566+0000","last_became_active":"2023-12-18T10:23:11.497478+0000","last_became_peered":"2023-12-18T10:23:11.497478+0000","last_unstale":"2023-12-18T10:23:12.803566+0000","last_undegraded":"2023-12-18T10:23:12.803566+0000","last_fullsized":"2023-12-18T10:23:12.803566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:21.256629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482524+0000","last_change":"2023-12-18T10:23:11.511774+0000","last_active":"2023-12-18T10:23:12.482524+0000","last_peered":"2023-12-18T10:23:12.482524+0000","last_clean":"2023-12-18T10:23:12.482524+0000","last_became_active":"2023-12-18T10:23:11.511441+0000","last_became_peered":"2023-12-18T10:23:11.511441+0000","last_unstale":"2023-12-18T10:23:12.482524+0000","last_undegraded":"2023-12-18T10:23:12.482524+0000","last_fullsized":"2023-12-18T10:23:12.482524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:42:35.336836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.500532+0000","last_change":"2023-12-18T10:23:11.493758+0000","last_active":"2023-12-18T10:23:11.500532+0000","last_peered":"2023-12-18T10:23:11.500532+0000","last_clean":"2023-12-18T10:23:11.500532+0000","last_became_active":"2023-12-18T10:23:11.493206+0000","last_became_peered":"2023-12-18T10:23:11.493206+0000","last_unstale":"2023-12-18T10:23:11.500532+0000","last_undegraded":"2023-12-18T10:23:11.500532+0000","last_fullsized":"2023-12-18T10:23:11.500532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:26:46.776078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803429+0000","last_change":"2023-12-18T10:23:11.490657+0000","last_active":"2023-12-18T10:23:12.803429+0000","last_peered":"2023-12-18T10:23:12.803429+0000","last_clean":"2023-12-18T10:23:12.803429+0000","last_became_active":"2023-12-18T10:23:11.490400+0000","last_became_peered":"2023-12-18T10:23:11.490400+0000","last_unstale":"2023-12-18T10:23:12.803429+0000","last_undegraded":"2023-12-18T10:23:12.803429+0000","last_fullsized":"2023-12-18T10:23:12.803429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:17:05.579871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.530047+0000","last_change":"2023-12-18T10:23:11.508724+0000","last_active":"2023-12-18T10:23:12.530047+0000","last_peered":"2023-12-18T10:23:12.530047+0000","last_clean":"2023-12-18T10:23:12.530047+0000","last_became_active":"2023-12-18T10:23:11.508409+0000","last_became_peered":"2023-12-18T10:23:11.508409+0000","last_unstale":"2023-12-18T10:23:12.530047+0000","last_undegraded":"2023-12-18T10:23:12.530047+0000","last_fullsized":"2023-12-18T10:23:12.530047+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:08:30.672587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.509571+0000","last_change":"2023-12-18T10:23:11.502837+0000","last_active":"2023-12-18T10:23:11.509571+0000","last_peered":"2023-12-18T10:23:11.509571+0000","last_clean":"2023-12-18T10:23:11.509571+0000","last_became_active":"2023-12-18T10:23:11.502554+0000","last_became_peered":"2023-12-18T10:23:11.502554+0000","last_unstale":"2023-12-18T10:23:11.509571+0000","last_undegraded":"2023-12-18T10:23:11.509571+0000","last_fullsized":"2023-12-18T10:23:11.509571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:08:30.672587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481551+0000","last_change":"2023-12-18T10:23:11.501659+0000","last_active":"2023-12-18T10:23:12.481551+0000","last_peered":"2023-12-18T10:23:12.481551+0000","last_clean":"2023-12-18T10:23:12.481551+0000","last_became_active":"2023-12-18T10:23:11.500973+0000","last_became_peered":"2023-12-18T10:23:11.500973+0000","last_unstale":"2023-12-18T10:23:12.481551+0000","last_undegraded":"2023-12-18T10:23:12.481551+0000","last_fullsized":"2023-12-18T10:23:12.481551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:37:30.533990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.514533+0000","last_change":"2023-12-18T10:23:11.504370+0000","last_active":"2023-12-18T10:23:11.514533+0000","last_peered":"2023-12-18T10:23:11.514533+0000","last_clean":"2023-12-18T10:23:11.514533+0000","last_became_active":"2023-12-18T10:23:11.504114+0000","last_became_peered":"2023-12-18T10:23:11.504114+0000","last_unstale":"2023-12-18T10:23:11.514533+0000","last_undegraded":"2023-12-18T10:23:11.514533+0000","last_fullsized":"2023-12-18T10:23:11.514533+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:11:49.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803571+0000","last_change":"2023-12-18T10:23:11.499906+0000","last_active":"2023-12-18T10:23:12.803571+0000","last_peered":"2023-12-18T10:23:12.803571+0000","last_clean":"2023-12-18T10:23:12.803571+0000","last_became_active":"2023-12-18T10:23:11.499659+0000","last_became_peered":"2023-12-18T10:23:11.499659+0000","last_unstale":"2023-12-18T10:23:12.803571+0000","last_undegraded":"2023-12-18T10:23:12.803571+0000","last_fullsized":"2023-12-18T10:23:12.803571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:20:23.801829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482587+0000","last_change":"2023-12-18T10:23:11.503419+0000","last_active":"2023-12-18T10:23:12.482587+0000","last_peered":"2023-12-18T10:23:12.482587+0000","last_clean":"2023-12-18T10:23:12.482587+0000","last_became_active":"2023-12-18T10:23:11.502835+0000","last_became_peered":"2023-12-18T10:23:11.502835+0000","last_unstale":"2023-12-18T10:23:12.482587+0000","last_undegraded":"2023-12-18T10:23:12.482587+0000","last_fullsized":"2023-12-18T10:23:12.482587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:14:20.523891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481103+0000","last_change":"2023-12-18T10:23:11.498799+0000","last_active":"2023-12-18T10:23:12.481103+0000","last_peered":"2023-12-18T10:23:12.481103+0000","last_clean":"2023-12-18T10:23:12.481103+0000","last_became_active":"2023-12-18T10:23:11.498493+0000","last_became_peered":"2023-12-18T10:23:11.498493+0000","last_unstale":"2023-12-18T10:23:12.481103+0000","last_undegraded":"2023-12-18T10:23:12.481103+0000","last_fullsized":"2023-12-18T10:23:12.481103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:44:33.560236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747658+0000","last_change":"2023-12-18T10:23:11.497178+0000","last_active":"2023-12-18T10:23:12.747658+0000","last_peered":"2023-12-18T10:23:12.747658+0000","last_clean":"2023-12-18T10:23:12.747658+0000","last_became_active":"2023-12-18T10:23:11.496893+0000","last_became_peered":"2023-12-18T10:23:11.496893+0000","last_unstale":"2023-12-18T10:23:12.747658+0000","last_undegraded":"2023-12-18T10:23:12.747658+0000","last_fullsized":"2023-12-18T10:23:12.747658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:46:41.666723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803686+0000","last_change":"2023-12-18T10:23:11.496750+0000","last_active":"2023-12-18T10:23:12.803686+0000","last_peered":"2023-12-18T10:23:12.803686+0000","last_clean":"2023-12-18T10:23:12.803686+0000","last_became_active":"2023-12-18T10:23:11.495001+0000","last_became_peered":"2023-12-18T10:23:11.495001+0000","last_unstale":"2023-12-18T10:23:12.803686+0000","last_undegraded":"2023-12-18T10:23:12.803686+0000","last_fullsized":"2023-12-18T10:23:12.803686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:16:01.250786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581404+0000","last_change":"2023-12-18T10:23:11.501115+0000","last_active":"2023-12-18T10:23:12.581404+0000","last_peered":"2023-12-18T10:23:12.581404+0000","last_clean":"2023-12-18T10:23:12.581404+0000","last_became_active":"2023-12-18T10:23:11.500874+0000","last_became_peered":"2023-12-18T10:23:11.500874+0000","last_unstale":"2023-12-18T10:23:12.581404+0000","last_undegraded":"2023-12-18T10:23:12.581404+0000","last_fullsized":"2023-12-18T10:23:12.581404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:29.294775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482613+0000","last_change":"2023-12-18T10:23:11.507594+0000","last_active":"2023-12-18T10:23:12.482613+0000","last_peered":"2023-12-18T10:23:12.482613+0000","last_clean":"2023-12-18T10:23:12.482613+0000","last_became_active":"2023-12-18T10:23:11.507169+0000","last_became_peered":"2023-12-18T10:23:11.507169+0000","last_unstale":"2023-12-18T10:23:12.482613+0000","last_undegraded":"2023-12-18T10:23:12.482613+0000","last_fullsized":"2023-12-18T10:23:12.482613+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:09:36.321828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803657+0000","last_change":"2023-12-18T10:23:11.487409+0000","last_active":"2023-12-18T10:23:12.803657+0000","last_peered":"2023-12-18T10:23:12.803657+0000","last_clean":"2023-12-18T10:23:12.803657+0000","last_became_active":"2023-12-18T10:23:11.487162+0000","last_became_peered":"2023-12-18T10:23:11.487162+0000","last_unstale":"2023-12-18T10:23:12.803657+0000","last_undegraded":"2023-12-18T10:23:12.803657+0000","last_fullsized":"2023-12-18T10:23:12.803657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:35:38.892192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529872+0000","last_change":"2023-12-18T10:23:11.501696+0000","last_active":"2023-12-18T10:23:12.529872+0000","last_peered":"2023-12-18T10:23:12.529872+0000","last_clean":"2023-12-18T10:23:12.529872+0000","last_became_active":"2023-12-18T10:23:11.501239+0000","last_became_peered":"2023-12-18T10:23:11.501239+0000","last_unstale":"2023-12-18T10:23:12.529872+0000","last_undegraded":"2023-12-18T10:23:12.529872+0000","last_fullsized":"2023-12-18T10:23:12.529872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:46:41.666723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803572+0000","last_change":"2023-12-18T10:23:11.506275+0000","last_active":"2023-12-18T10:23:12.803572+0000","last_peered":"2023-12-18T10:23:12.803572+0000","last_clean":"2023-12-18T10:23:12.803572+0000","last_became_active":"2023-12-18T10:23:11.506018+0000","last_became_peered":"2023-12-18T10:23:11.506018+0000","last_unstale":"2023-12-18T10:23:12.803572+0000","last_undegraded":"2023-12-18T10:23:12.803572+0000","last_fullsized":"2023-12-18T10:23:12.803572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:51:36.183071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529697+0000","last_change":"2023-12-18T10:23:11.500885+0000","last_active":"2023-12-18T10:23:12.529697+0000","last_peered":"2023-12-18T10:23:12.529697+0000","last_clean":"2023-12-18T10:23:12.529697+0000","last_became_active":"2023-12-18T10:23:11.500509+0000","last_became_peered":"2023-12-18T10:23:11.500509+0000","last_unstale":"2023-12-18T10:23:12.529697+0000","last_undegraded":"2023-12-18T10:23:12.529697+0000","last_fullsized":"2023-12-18T10:23:12.529697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:34:10.807687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481072+0000","last_change":"2023-12-18T10:23:11.505944+0000","last_active":"2023-12-18T10:23:12.481072+0000","last_peered":"2023-12-18T10:23:12.481072+0000","last_clean":"2023-12-18T10:23:12.481072+0000","last_became_active":"2023-12-18T10:23:11.505686+0000","last_became_peered":"2023-12-18T10:23:11.505686+0000","last_unstale":"2023-12-18T10:23:12.481072+0000","last_undegraded":"2023-12-18T10:23:12.481072+0000","last_fullsized":"2023-12-18T10:23:12.481072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:38:11.123049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481756+0000","last_change":"2023-12-18T10:23:11.507025+0000","last_active":"2023-12-18T10:23:12.481756+0000","last_peered":"2023-12-18T10:23:12.481756+0000","last_clean":"2023-12-18T10:23:12.481756+0000","last_became_active":"2023-12-18T10:23:11.506727+0000","last_became_peered":"2023-12-18T10:23:11.506727+0000","last_unstale":"2023-12-18T10:23:12.481756+0000","last_undegraded":"2023-12-18T10:23:12.481756+0000","last_fullsized":"2023-12-18T10:23:12.481756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:17:58.957714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.514597+0000","last_change":"2023-12-18T10:23:11.505007+0000","last_active":"2023-12-18T10:23:11.514597+0000","last_peered":"2023-12-18T10:23:11.514597+0000","last_clean":"2023-12-18T10:23:11.514597+0000","last_became_active":"2023-12-18T10:23:11.504734+0000","last_became_peered":"2023-12-18T10:23:11.504734+0000","last_unstale":"2023-12-18T10:23:11.514597+0000","last_undegraded":"2023-12-18T10:23:11.514597+0000","last_fullsized":"2023-12-18T10:23:11.514597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:30:17.151255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747846+0000","last_change":"2023-12-18T10:23:11.506168+0000","last_active":"2023-12-18T10:23:12.747846+0000","last_peered":"2023-12-18T10:23:12.747846+0000","last_clean":"2023-12-18T10:23:12.747846+0000","last_became_active":"2023-12-18T10:23:11.505794+0000","last_became_peered":"2023-12-18T10:23:11.505794+0000","last_unstale":"2023-12-18T10:23:12.747846+0000","last_undegraded":"2023-12-18T10:23:12.747846+0000","last_fullsized":"2023-12-18T10:23:12.747846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:06.373241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803761+0000","last_change":"2023-12-18T10:23:11.497987+0000","last_active":"2023-12-18T10:23:12.803761+0000","last_peered":"2023-12-18T10:23:12.803761+0000","last_clean":"2023-12-18T10:23:12.803761+0000","last_became_active":"2023-12-18T10:23:11.497736+0000","last_became_peered":"2023-12-18T10:23:11.497736+0000","last_unstale":"2023-12-18T10:23:12.803761+0000","last_undegraded":"2023-12-18T10:23:12.803761+0000","last_fullsized":"2023-12-18T10:23:12.803761+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:37:38.430587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481330+0000","last_change":"2023-12-18T10:23:11.503159+0000","last_active":"2023-12-18T10:23:12.481330+0000","last_peered":"2023-12-18T10:23:12.481330+0000","last_clean":"2023-12-18T10:23:12.481330+0000","last_became_active":"2023-12-18T10:23:11.502897+0000","last_became_peered":"2023-12-18T10:23:11.502897+0000","last_unstale":"2023-12-18T10:23:12.481330+0000","last_undegraded":"2023-12-18T10:23:12.481330+0000","last_fullsized":"2023-12-18T10:23:12.481330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:18:54.839761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747611+0000","last_change":"2023-12-18T10:23:11.507664+0000","last_active":"2023-12-18T10:23:12.747611+0000","last_peered":"2023-12-18T10:23:12.747611+0000","last_clean":"2023-12-18T10:23:12.747611+0000","last_became_active":"2023-12-18T10:23:11.507266+0000","last_became_peered":"2023-12-18T10:23:11.507266+0000","last_unstale":"2023-12-18T10:23:12.747611+0000","last_undegraded":"2023-12-18T10:23:12.747611+0000","last_fullsized":"2023-12-18T10:23:12.747611+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:08:30.672587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581269+0000","last_change":"2023-12-18T10:23:11.483392+0000","last_active":"2023-12-18T10:23:12.581269+0000","last_peered":"2023-12-18T10:23:12.581269+0000","last_clean":"2023-12-18T10:23:12.581269+0000","last_became_active":"2023-12-18T10:23:11.483095+0000","last_became_peered":"2023-12-18T10:23:11.483095+0000","last_unstale":"2023-12-18T10:23:12.581269+0000","last_undegraded":"2023-12-18T10:23:12.581269+0000","last_fullsized":"2023-12-18T10:23:12.581269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:54:10.537184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747665+0000","last_change":"2023-12-18T10:23:11.497108+0000","last_active":"2023-12-18T10:23:12.747665+0000","last_peered":"2023-12-18T10:23:12.747665+0000","last_clean":"2023-12-18T10:23:12.747665+0000","last_became_active":"2023-12-18T10:23:11.496506+0000","last_became_peered":"2023-12-18T10:23:11.496506+0000","last_unstale":"2023-12-18T10:23:12.747665+0000","last_undegraded":"2023-12-18T10:23:12.747665+0000","last_fullsized":"2023-12-18T10:23:12.747665+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:11:49.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581369+0000","last_change":"2023-12-18T10:23:11.494762+0000","last_active":"2023-12-18T10:23:12.581369+0000","last_peered":"2023-12-18T10:23:12.581369+0000","last_clean":"2023-12-18T10:23:12.581369+0000","last_became_active":"2023-12-18T10:23:11.494360+0000","last_became_peered":"2023-12-18T10:23:11.494360+0000","last_unstale":"2023-12-18T10:23:12.581369+0000","last_undegraded":"2023-12-18T10:23:12.581369+0000","last_fullsized":"2023-12-18T10:23:12.581369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:55.277487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"78'4","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803753+0000","last_change":"2023-12-18T10:23:11.095742+0000","last_active":"2023-12-18T10:23:12.803753+0000","last_peered":"2023-12-18T10:23:12.803753+0000","last_clean":"2023-12-18T10:23:12.803753+0000","last_became_active":"2023-12-18T10:23:11.095435+0000","last_became_peered":"2023-12-18T10:23:11.095435+0000","last_unstale":"2023-12-18T10:23:12.803753+0000","last_undegraded":"2023-12-18T10:23:12.803753+0000","last_fullsized":"2023-12-18T10:23:12.803753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:53:37.711936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481199+0000","last_change":"2023-12-18T10:23:11.497488+0000","last_active":"2023-12-18T10:23:12.481199+0000","last_peered":"2023-12-18T10:23:12.481199+0000","last_clean":"2023-12-18T10:23:12.481199+0000","last_became_active":"2023-12-18T10:23:11.496294+0000","last_became_peered":"2023-12-18T10:23:11.496294+0000","last_unstale":"2023-12-18T10:23:12.481199+0000","last_undegraded":"2023-12-18T10:23:12.481199+0000","last_fullsized":"2023-12-18T10:23:12.481199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:46:41.666723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"78'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747973+0000","last_change":"2023-12-18T10:23:11.115859+0000","last_active":"2023-12-18T10:23:12.747973+0000","last_peered":"2023-12-18T10:23:12.747973+0000","last_clean":"2023-12-18T10:23:12.747973+0000","last_became_active":"2023-12-18T10:23:11.115537+0000","last_became_peered":"2023-12-18T10:23:11.115537+0000","last_unstale":"2023-12-18T10:23:12.747973+0000","last_undegraded":"2023-12-18T10:23:12.747973+0000","last_fullsized":"2023-12-18T10:23:12.747973+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:15.409763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529937+0000","last_change":"2023-12-18T10:23:11.512872+0000","last_active":"2023-12-18T10:23:12.529937+0000","last_peered":"2023-12-18T10:23:12.529937+0000","last_clean":"2023-12-18T10:23:12.529937+0000","last_became_active":"2023-12-18T10:23:11.512481+0000","last_became_peered":"2023-12-18T10:23:11.512481+0000","last_unstale":"2023-12-18T10:23:12.529937+0000","last_undegraded":"2023-12-18T10:23:12.529937+0000","last_fullsized":"2023-12-18T10:23:12.529937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:25.776926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"78'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747846+0000","last_change":"2023-12-18T10:23:11.106607+0000","last_active":"2023-12-18T10:23:12.747846+0000","last_peered":"2023-12-18T10:23:12.747846+0000","last_clean":"2023-12-18T10:23:12.747846+0000","last_became_active":"2023-12-18T10:23:11.106416+0000","last_became_peered":"2023-12-18T10:23:11.106416+0000","last_unstale":"2023-12-18T10:23:12.747846+0000","last_undegraded":"2023-12-18T10:23:12.747846+0000","last_fullsized":"2023-12-18T10:23:12.747846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:54:09.530497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529901+0000","last_change":"2023-12-18T10:23:11.501416+0000","last_active":"2023-12-18T10:23:12.529901+0000","last_peered":"2023-12-18T10:23:12.529901+0000","last_clean":"2023-12-18T10:23:12.529901+0000","last_became_active":"2023-12-18T10:23:11.501078+0000","last_became_peered":"2023-12-18T10:23:11.501078+0000","last_unstale":"2023-12-18T10:23:12.529901+0000","last_undegraded":"2023-12-18T10:23:12.529901+0000","last_fullsized":"2023-12-18T10:23:12.529901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:11:49.874012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.487540+0000","last_change":"2023-12-18T10:23:11.111965+0000","last_active":"2023-12-18T10:23:11.487540+0000","last_peered":"2023-12-18T10:23:11.487540+0000","last_clean":"2023-12-18T10:23:11.487540+0000","last_became_active":"2023-12-18T10:23:11.111234+0000","last_became_peered":"2023-12-18T10:23:11.111234+0000","last_unstale":"2023-12-18T10:23:11.487540+0000","last_undegraded":"2023-12-18T10:23:11.487540+0000","last_fullsized":"2023-12-18T10:23:11.487540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:42:20.248828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481437+0000","last_change":"2023-12-18T10:23:11.502180+0000","last_active":"2023-12-18T10:23:12.481437+0000","last_peered":"2023-12-18T10:23:12.481437+0000","last_clean":"2023-12-18T10:23:12.481437+0000","last_became_active":"2023-12-18T10:23:11.498317+0000","last_became_peered":"2023-12-18T10:23:11.498317+0000","last_unstale":"2023-12-18T10:23:12.481437+0000","last_undegraded":"2023-12-18T10:23:12.481437+0000","last_fullsized":"2023-12-18T10:23:12.481437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:20:44.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"78'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529974+0000","last_change":"2023-12-18T10:23:11.108935+0000","last_active":"2023-12-18T10:23:12.529974+0000","last_peered":"2023-12-18T10:23:12.529974+0000","last_clean":"2023-12-18T10:23:12.529974+0000","last_became_active":"2023-12-18T10:23:11.108600+0000","last_became_peered":"2023-12-18T10:23:11.108600+0000","last_unstale":"2023-12-18T10:23:12.529974+0000","last_undegraded":"2023-12-18T10:23:12.529974+0000","last_fullsized":"2023-12-18T10:23:12.529974+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:28.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481616+0000","last_change":"2023-12-18T10:23:11.496262+0000","last_active":"2023-12-18T10:23:12.481616+0000","last_peered":"2023-12-18T10:23:12.481616+0000","last_clean":"2023-12-18T10:23:12.481616+0000","last_became_active":"2023-12-18T10:23:11.495674+0000","last_became_peered":"2023-12-18T10:23:11.495674+0000","last_unstale":"2023-12-18T10:23:12.481616+0000","last_undegraded":"2023-12-18T10:23:12.481616+0000","last_fullsized":"2023-12-18T10:23:12.481616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:39:16.404479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.501140+0000","last_change":"2023-12-18T10:23:11.108701+0000","last_active":"2023-12-18T10:23:11.501140+0000","last_peered":"2023-12-18T10:23:11.501140+0000","last_clean":"2023-12-18T10:23:11.501140+0000","last_became_active":"2023-12-18T10:23:11.108359+0000","last_became_peered":"2023-12-18T10:23:11.108359+0000","last_unstale":"2023-12-18T10:23:11.501140+0000","last_undegraded":"2023-12-18T10:23:11.501140+0000","last_fullsized":"2023-12-18T10:23:11.501140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:15.409763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.530116+0000","last_change":"2023-12-18T10:23:11.509042+0000","last_active":"2023-12-18T10:23:12.530116+0000","last_peered":"2023-12-18T10:23:12.530116+0000","last_clean":"2023-12-18T10:23:12.530116+0000","last_became_active":"2023-12-18T10:23:11.508755+0000","last_became_peered":"2023-12-18T10:23:11.508755+0000","last_unstale":"2023-12-18T10:23:12.530116+0000","last_undegraded":"2023-12-18T10:23:12.530116+0000","last_fullsized":"2023-12-18T10:23:12.530116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:06.373241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481237+0000","last_change":"2023-12-18T10:23:11.102539+0000","last_active":"2023-12-18T10:23:12.481237+0000","last_peered":"2023-12-18T10:23:12.481237+0000","last_clean":"2023-12-18T10:23:12.481237+0000","last_became_active":"2023-12-18T10:23:11.102110+0000","last_became_peered":"2023-12-18T10:23:11.102110+0000","last_unstale":"2023-12-18T10:23:12.481237+0000","last_undegraded":"2023-12-18T10:23:12.481237+0000","last_fullsized":"2023-12-18T10:23:12.481237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:28.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.501965+0000","last_change":"2023-12-18T10:23:11.497181+0000","last_active":"2023-12-18T10:23:11.501965+0000","last_peered":"2023-12-18T10:23:11.501965+0000","last_clean":"2023-12-18T10:23:11.501965+0000","last_became_active":"2023-12-18T10:23:11.496742+0000","last_became_peered":"2023-12-18T10:23:11.496742+0000","last_unstale":"2023-12-18T10:23:11.501965+0000","last_undegraded":"2023-12-18T10:23:11.501965+0000","last_fullsized":"2023-12-18T10:23:11.501965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:12:30.223338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803477+0000","last_change":"2023-12-18T10:23:11.095331+0000","last_active":"2023-12-18T10:23:12.803477+0000","last_peered":"2023-12-18T10:23:12.803477+0000","last_clean":"2023-12-18T10:23:12.803477+0000","last_became_active":"2023-12-18T10:23:11.095042+0000","last_became_peered":"2023-12-18T10:23:11.095042+0000","last_unstale":"2023-12-18T10:23:12.803477+0000","last_undegraded":"2023-12-18T10:23:12.803477+0000","last_fullsized":"2023-12-18T10:23:12.803477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:05:30.424680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481072+0000","last_change":"2023-12-18T10:23:11.497160+0000","last_active":"2023-12-18T10:23:12.481072+0000","last_peered":"2023-12-18T10:23:12.481072+0000","last_clean":"2023-12-18T10:23:12.481072+0000","last_became_active":"2023-12-18T10:23:11.496585+0000","last_became_peered":"2023-12-18T10:23:11.496585+0000","last_unstale":"2023-12-18T10:23:12.481072+0000","last_undegraded":"2023-12-18T10:23:12.481072+0000","last_fullsized":"2023-12-18T10:23:12.481072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:00.814636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.748040+0000","last_change":"2023-12-18T10:23:11.113661+0000","last_active":"2023-12-18T10:23:12.748040+0000","last_peered":"2023-12-18T10:23:12.748040+0000","last_clean":"2023-12-18T10:23:12.748040+0000","last_became_active":"2023-12-18T10:23:11.113115+0000","last_became_peered":"2023-12-18T10:23:11.113115+0000","last_unstale":"2023-12-18T10:23:12.748040+0000","last_undegraded":"2023-12-18T10:23:12.748040+0000","last_fullsized":"2023-12-18T10:23:12.748040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:54.270800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.514670+0000","last_change":"2023-12-18T10:23:11.505212+0000","last_active":"2023-12-18T10:23:11.514670+0000","last_peered":"2023-12-18T10:23:11.514670+0000","last_clean":"2023-12-18T10:23:11.514670+0000","last_became_active":"2023-12-18T10:23:11.504929+0000","last_became_peered":"2023-12-18T10:23:11.504929+0000","last_unstale":"2023-12-18T10:23:11.514670+0000","last_undegraded":"2023-12-18T10:23:11.514670+0000","last_fullsized":"2023-12-18T10:23:11.514670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:38:25.078923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.494409+0000","last_change":"2023-12-18T10:23:11.110648+0000","last_active":"2023-12-18T10:23:11.494409+0000","last_peered":"2023-12-18T10:23:11.494409+0000","last_clean":"2023-12-18T10:23:11.494409+0000","last_became_active":"2023-12-18T10:23:11.110360+0000","last_became_peered":"2023-12-18T10:23:11.110360+0000","last_unstale":"2023-12-18T10:23:11.494409+0000","last_undegraded":"2023-12-18T10:23:11.494409+0000","last_fullsized":"2023-12-18T10:23:11.494409+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:54:09.530497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482679+0000","last_change":"2023-12-18T10:23:11.503255+0000","last_active":"2023-12-18T10:23:12.482679+0000","last_peered":"2023-12-18T10:23:12.482679+0000","last_clean":"2023-12-18T10:23:12.482679+0000","last_became_active":"2023-12-18T10:23:11.499358+0000","last_became_peered":"2023-12-18T10:23:11.499358+0000","last_unstale":"2023-12-18T10:23:12.482679+0000","last_undegraded":"2023-12-18T10:23:12.482679+0000","last_fullsized":"2023-12-18T10:23:12.482679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:42.531608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"78'3","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803764+0000","last_change":"2023-12-18T10:23:11.103633+0000","last_active":"2023-12-18T10:23:12.803764+0000","last_peered":"2023-12-18T10:23:12.803764+0000","last_clean":"2023-12-18T10:23:12.803764+0000","last_became_active":"2023-12-18T10:23:11.103320+0000","last_became_peered":"2023-12-18T10:23:11.103320+0000","last_unstale":"2023-12-18T10:23:12.803764+0000","last_undegraded":"2023-12-18T10:23:12.803764+0000","last_fullsized":"2023-12-18T10:23:12.803764+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:20:58.591056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581353+0000","last_change":"2023-12-18T10:23:11.505383+0000","last_active":"2023-12-18T10:23:12.581353+0000","last_peered":"2023-12-18T10:23:12.581353+0000","last_clean":"2023-12-18T10:23:12.581353+0000","last_became_active":"2023-12-18T10:23:11.504734+0000","last_became_peered":"2023-12-18T10:23:11.504734+0000","last_unstale":"2023-12-18T10:23:12.581353+0000","last_undegraded":"2023-12-18T10:23:12.581353+0000","last_fullsized":"2023-12-18T10:23:12.581353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:12:02.577013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"78'6","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.512774+0000","last_change":"2023-12-18T10:23:11.115388+0000","last_active":"2023-12-18T10:23:11.512774+0000","last_peered":"2023-12-18T10:23:11.512774+0000","last_clean":"2023-12-18T10:23:11.512774+0000","last_became_active":"2023-12-18T10:23:11.115130+0000","last_became_peered":"2023-12-18T10:23:11.115130+0000","last_unstale":"2023-12-18T10:23:11.512774+0000","last_undegraded":"2023-12-18T10:23:11.512774+0000","last_fullsized":"2023-12-18T10:23:11.512774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:36:51.291509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.515294+0000","last_change":"2023-12-18T10:23:11.509666+0000","last_active":"2023-12-18T10:23:11.515294+0000","last_peered":"2023-12-18T10:23:11.515294+0000","last_clean":"2023-12-18T10:23:11.515294+0000","last_became_active":"2023-12-18T10:23:11.508907+0000","last_became_peered":"2023-12-18T10:23:11.508907+0000","last_unstale":"2023-12-18T10:23:11.515294+0000","last_undegraded":"2023-12-18T10:23:11.515294+0000","last_fullsized":"2023-12-18T10:23:11.515294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:24:47.602797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.503106+0000","last_change":"2023-12-18T10:23:11.108759+0000","last_active":"2023-12-18T10:23:11.503106+0000","last_peered":"2023-12-18T10:23:11.503106+0000","last_clean":"2023-12-18T10:23:11.503106+0000","last_became_active":"2023-12-18T10:23:11.108468+0000","last_became_peered":"2023-12-18T10:23:11.108468+0000","last_unstale":"2023-12-18T10:23:11.503106+0000","last_undegraded":"2023-12-18T10:23:11.503106+0000","last_fullsized":"2023-12-18T10:23:11.503106+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:54.270800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.495555+0000","last_change":"2023-12-18T10:23:11.484304+0000","last_active":"2023-12-18T10:23:11.495555+0000","last_peered":"2023-12-18T10:23:11.495555+0000","last_clean":"2023-12-18T10:23:11.495555+0000","last_became_active":"2023-12-18T10:23:11.483955+0000","last_became_peered":"2023-12-18T10:23:11.483955+0000","last_unstale":"2023-12-18T10:23:11.495555+0000","last_undegraded":"2023-12-18T10:23:11.495555+0000","last_fullsized":"2023-12-18T10:23:11.495555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:59.541904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747641+0000","last_change":"2023-12-18T10:23:11.107592+0000","last_active":"2023-12-18T10:23:12.747641+0000","last_peered":"2023-12-18T10:23:12.747641+0000","last_clean":"2023-12-18T10:23:12.747641+0000","last_became_active":"2023-12-18T10:23:11.107240+0000","last_became_peered":"2023-12-18T10:23:11.107240+0000","last_unstale":"2023-12-18T10:23:12.747641+0000","last_undegraded":"2023-12-18T10:23:12.747641+0000","last_fullsized":"2023-12-18T10:23:12.747641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:28.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.506234+0000","last_change":"2023-12-18T10:23:11.502074+0000","last_active":"2023-12-18T10:23:11.506234+0000","last_peered":"2023-12-18T10:23:11.506234+0000","last_clean":"2023-12-18T10:23:11.506234+0000","last_became_active":"2023-12-18T10:23:11.501721+0000","last_became_peered":"2023-12-18T10:23:11.501721+0000","last_unstale":"2023-12-18T10:23:11.506234+0000","last_undegraded":"2023-12-18T10:23:11.506234+0000","last_fullsized":"2023-12-18T10:23:11.506234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:43:13.012867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803517+0000","last_change":"2023-12-18T10:23:11.091625+0000","last_active":"2023-12-18T10:23:12.803517+0000","last_peered":"2023-12-18T10:23:12.803517+0000","last_clean":"2023-12-18T10:23:12.803517+0000","last_became_active":"2023-12-18T10:23:11.091034+0000","last_became_peered":"2023-12-18T10:23:11.091034+0000","last_unstale":"2023-12-18T10:23:12.803517+0000","last_undegraded":"2023-12-18T10:23:12.803517+0000","last_fullsized":"2023-12-18T10:23:12.803517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:32:44.964793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.512059+0000","last_change":"2023-12-18T10:23:11.508668+0000","last_active":"2023-12-18T10:23:11.512059+0000","last_peered":"2023-12-18T10:23:11.512059+0000","last_clean":"2023-12-18T10:23:11.512059+0000","last_became_active":"2023-12-18T10:23:11.508311+0000","last_became_peered":"2023-12-18T10:23:11.508311+0000","last_unstale":"2023-12-18T10:23:11.512059+0000","last_undegraded":"2023-12-18T10:23:11.512059+0000","last_fullsized":"2023-12-18T10:23:11.512059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:30:20.057661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"78'8","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481205+0000","last_change":"2023-12-18T10:23:11.114177+0000","last_active":"2023-12-18T10:23:12.481205+0000","last_peered":"2023-12-18T10:23:12.481205+0000","last_clean":"2023-12-18T10:23:12.481205+0000","last_became_active":"2023-12-18T10:23:11.113847+0000","last_became_peered":"2023-12-18T10:23:11.113847+0000","last_unstale":"2023-12-18T10:23:12.481205+0000","last_undegraded":"2023-12-18T10:23:12.481205+0000","last_fullsized":"2023-12-18T10:23:12.481205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:54:09.530497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482385+0000","last_change":"2023-12-18T10:23:11.496091+0000","last_active":"2023-12-18T10:23:12.482385+0000","last_peered":"2023-12-18T10:23:12.482385+0000","last_clean":"2023-12-18T10:23:12.482385+0000","last_became_active":"2023-12-18T10:23:11.495836+0000","last_became_peered":"2023-12-18T10:23:11.495836+0000","last_unstale":"2023-12-18T10:23:12.482385+0000","last_undegraded":"2023-12-18T10:23:12.482385+0000","last_fullsized":"2023-12-18T10:23:12.482385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:16:30.880667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"78'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.748097+0000","last_change":"2023-12-18T10:23:11.104712+0000","last_active":"2023-12-18T10:23:12.748097+0000","last_peered":"2023-12-18T10:23:12.748097+0000","last_clean":"2023-12-18T10:23:12.748097+0000","last_became_active":"2023-12-18T10:23:11.104202+0000","last_became_peered":"2023-12-18T10:23:11.104202+0000","last_unstale":"2023-12-18T10:23:12.748097+0000","last_undegraded":"2023-12-18T10:23:12.748097+0000","last_fullsized":"2023-12-18T10:23:12.748097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:52:06.325534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803427+0000","last_change":"2023-12-18T10:23:11.490563+0000","last_active":"2023-12-18T10:23:12.803427+0000","last_peered":"2023-12-18T10:23:12.803427+0000","last_clean":"2023-12-18T10:23:12.803427+0000","last_became_active":"2023-12-18T10:23:11.490213+0000","last_became_peered":"2023-12-18T10:23:11.490213+0000","last_unstale":"2023-12-18T10:23:12.803427+0000","last_undegraded":"2023-12-18T10:23:12.803427+0000","last_fullsized":"2023-12-18T10:23:12.803427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:43:03.706269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"78'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.530114+0000","last_change":"2023-12-18T10:23:11.104478+0000","last_active":"2023-12-18T10:23:12.530114+0000","last_peered":"2023-12-18T10:23:12.530114+0000","last_clean":"2023-12-18T10:23:12.530114+0000","last_became_active":"2023-12-18T10:23:11.104188+0000","last_became_peered":"2023-12-18T10:23:11.104188+0000","last_unstale":"2023-12-18T10:23:12.530114+0000","last_undegraded":"2023-12-18T10:23:12.530114+0000","last_fullsized":"2023-12-18T10:23:12.530114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:54.270800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803733+0000","last_change":"2023-12-18T10:23:11.497193+0000","last_active":"2023-12-18T10:23:12.803733+0000","last_peered":"2023-12-18T10:23:12.803733+0000","last_clean":"2023-12-18T10:23:12.803733+0000","last_became_active":"2023-12-18T10:23:11.496889+0000","last_became_peered":"2023-12-18T10:23:11.496889+0000","last_unstale":"2023-12-18T10:23:12.803733+0000","last_undegraded":"2023-12-18T10:23:12.803733+0000","last_fullsized":"2023-12-18T10:23:12.803733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:26:23.841250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"78'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803797+0000","last_change":"2023-12-18T10:23:11.111061+0000","last_active":"2023-12-18T10:23:12.803797+0000","last_peered":"2023-12-18T10:23:12.803797+0000","last_clean":"2023-12-18T10:23:12.803797+0000","last_became_active":"2023-12-18T10:23:11.110760+0000","last_became_peered":"2023-12-18T10:23:11.110760+0000","last_unstale":"2023-12-18T10:23:12.803797+0000","last_undegraded":"2023-12-18T10:23:12.803797+0000","last_fullsized":"2023-12-18T10:23:12.803797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:53:41.537733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482463+0000","last_change":"2023-12-18T10:23:11.508825+0000","last_active":"2023-12-18T10:23:12.482463+0000","last_peered":"2023-12-18T10:23:12.482463+0000","last_clean":"2023-12-18T10:23:12.482463+0000","last_became_active":"2023-12-18T10:23:11.508578+0000","last_became_peered":"2023-12-18T10:23:11.508578+0000","last_unstale":"2023-12-18T10:23:12.482463+0000","last_undegraded":"2023-12-18T10:23:12.482463+0000","last_fullsized":"2023-12-18T10:23:12.482463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:08:12.661297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581309+0000","last_change":"2023-12-18T10:23:11.105831+0000","last_active":"2023-12-18T10:23:12.581309+0000","last_peered":"2023-12-18T10:23:12.581309+0000","last_clean":"2023-12-18T10:23:12.581309+0000","last_became_active":"2023-12-18T10:23:11.105225+0000","last_became_peered":"2023-12-18T10:23:11.105225+0000","last_unstale":"2023-12-18T10:23:12.581309+0000","last_undegraded":"2023-12-18T10:23:12.581309+0000","last_fullsized":"2023-12-18T10:23:12.581309+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:58.535217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481457+0000","last_change":"2023-12-18T10:23:11.498127+0000","last_active":"2023-12-18T10:23:12.481457+0000","last_peered":"2023-12-18T10:23:12.481457+0000","last_clean":"2023-12-18T10:23:12.481457+0000","last_became_active":"2023-12-18T10:23:11.497821+0000","last_became_peered":"2023-12-18T10:23:11.497821+0000","last_unstale":"2023-12-18T10:23:12.481457+0000","last_undegraded":"2023-12-18T10:23:12.481457+0000","last_fullsized":"2023-12-18T10:23:12.481457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:08:12.661297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"78'2","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482475+0000","last_change":"2023-12-18T10:23:11.100388+0000","last_active":"2023-12-18T10:23:12.482475+0000","last_peered":"2023-12-18T10:23:12.482475+0000","last_clean":"2023-12-18T10:23:12.482475+0000","last_became_active":"2023-12-18T10:23:11.100111+0000","last_became_peered":"2023-12-18T10:23:11.100111+0000","last_unstale":"2023-12-18T10:23:12.482475+0000","last_undegraded":"2023-12-18T10:23:12.482475+0000","last_fullsized":"2023-12-18T10:23:12.482475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:18:53.833074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481793+0000","last_change":"2023-12-18T10:23:11.508886+0000","last_active":"2023-12-18T10:23:12.481793+0000","last_peered":"2023-12-18T10:23:12.481793+0000","last_clean":"2023-12-18T10:23:12.481793+0000","last_became_active":"2023-12-18T10:23:11.507929+0000","last_became_peered":"2023-12-18T10:23:11.507929+0000","last_unstale":"2023-12-18T10:23:12.481793+0000","last_undegraded":"2023-12-18T10:23:12.481793+0000","last_fullsized":"2023-12-18T10:23:12.481793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:11:35.875036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482375+0000","last_change":"2023-12-18T10:23:11.111371+0000","last_active":"2023-12-18T10:23:12.482375+0000","last_peered":"2023-12-18T10:23:12.482375+0000","last_clean":"2023-12-18T10:23:12.482375+0000","last_became_active":"2023-12-18T10:23:11.111139+0000","last_became_peered":"2023-12-18T10:23:11.111139+0000","last_unstale":"2023-12-18T10:23:12.482375+0000","last_undegraded":"2023-12-18T10:23:12.482375+0000","last_fullsized":"2023-12-18T10:23:12.482375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:35:59.807949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.502618+0000","last_change":"2023-12-18T10:23:11.500874+0000","last_active":"2023-12-18T10:23:11.502618+0000","last_peered":"2023-12-18T10:23:11.502618+0000","last_clean":"2023-12-18T10:23:11.502618+0000","last_became_active":"2023-12-18T10:23:11.500594+0000","last_became_peered":"2023-12-18T10:23:11.500594+0000","last_unstale":"2023-12-18T10:23:11.502618+0000","last_undegraded":"2023-12-18T10:23:11.502618+0000","last_fullsized":"2023-12-18T10:23:11.502618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:56:36.472903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482477+0000","last_change":"2023-12-18T10:23:11.111341+0000","last_active":"2023-12-18T10:23:12.482477+0000","last_peered":"2023-12-18T10:23:12.482477+0000","last_clean":"2023-12-18T10:23:12.482477+0000","last_became_active":"2023-12-18T10:23:11.111058+0000","last_became_peered":"2023-12-18T10:23:11.111058+0000","last_unstale":"2023-12-18T10:23:12.482477+0000","last_undegraded":"2023-12-18T10:23:12.482477+0000","last_fullsized":"2023-12-18T10:23:12.482477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:12:05.366554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529841+0000","last_change":"2023-12-18T10:23:11.496533+0000","last_active":"2023-12-18T10:23:12.529841+0000","last_peered":"2023-12-18T10:23:12.529841+0000","last_clean":"2023-12-18T10:23:12.529841+0000","last_became_active":"2023-12-18T10:23:11.496264+0000","last_became_peered":"2023-12-18T10:23:11.496264+0000","last_unstale":"2023-12-18T10:23:12.529841+0000","last_undegraded":"2023-12-18T10:23:12.529841+0000","last_fullsized":"2023-12-18T10:23:12.529841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:24.577958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.511489+0000","last_change":"2023-12-18T10:23:11.115339+0000","last_active":"2023-12-18T10:23:11.511489+0000","last_peered":"2023-12-18T10:23:11.511489+0000","last_clean":"2023-12-18T10:23:11.511489+0000","last_became_active":"2023-12-18T10:23:11.114928+0000","last_became_peered":"2023-12-18T10:23:11.114928+0000","last_unstale":"2023-12-18T10:23:11.511489+0000","last_undegraded":"2023-12-18T10:23:11.511489+0000","last_fullsized":"2023-12-18T10:23:11.511489+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:31:28.288088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.512253+0000","last_change":"2023-12-18T10:23:11.508725+0000","last_active":"2023-12-18T10:23:11.512253+0000","last_peered":"2023-12-18T10:23:11.512253+0000","last_clean":"2023-12-18T10:23:11.512253+0000","last_became_active":"2023-12-18T10:23:11.508343+0000","last_became_peered":"2023-12-18T10:23:11.508343+0000","last_unstale":"2023-12-18T10:23:11.512253+0000","last_undegraded":"2023-12-18T10:23:11.512253+0000","last_fullsized":"2023-12-18T10:23:11.512253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:06:24.727784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481857+0000","last_change":"2023-12-18T10:23:11.105058+0000","last_active":"2023-12-18T10:23:12.481857+0000","last_peered":"2023-12-18T10:23:12.481857+0000","last_clean":"2023-12-18T10:23:12.481857+0000","last_became_active":"2023-12-18T10:23:11.104739+0000","last_became_peered":"2023-12-18T10:23:11.104739+0000","last_unstale":"2023-12-18T10:23:12.481857+0000","last_undegraded":"2023-12-18T10:23:12.481857+0000","last_fullsized":"2023-12-18T10:23:12.481857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:27:54.270800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.529840+0000","last_change":"2023-12-18T10:23:11.512509+0000","last_active":"2023-12-18T10:23:12.529840+0000","last_peered":"2023-12-18T10:23:12.529840+0000","last_clean":"2023-12-18T10:23:12.529840+0000","last_became_active":"2023-12-18T10:23:11.512229+0000","last_became_peered":"2023-12-18T10:23:11.512229+0000","last_unstale":"2023-12-18T10:23:12.529840+0000","last_undegraded":"2023-12-18T10:23:12.529840+0000","last_fullsized":"2023-12-18T10:23:12.529840+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:30:17.151255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747964+0000","last_change":"2023-12-18T10:23:11.109385+0000","last_active":"2023-12-18T10:23:12.747964+0000","last_peered":"2023-12-18T10:23:12.747964+0000","last_clean":"2023-12-18T10:23:12.747964+0000","last_became_active":"2023-12-18T10:23:11.109127+0000","last_became_peered":"2023-12-18T10:23:11.109127+0000","last_unstale":"2023-12-18T10:23:12.747964+0000","last_undegraded":"2023-12-18T10:23:12.747964+0000","last_fullsized":"2023-12-18T10:23:12.747964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:21.719658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.481354+0000","last_change":"2023-12-18T10:23:11.503412+0000","last_active":"2023-12-18T10:23:12.481354+0000","last_peered":"2023-12-18T10:23:12.481354+0000","last_clean":"2023-12-18T10:23:12.481354+0000","last_became_active":"2023-12-18T10:23:11.498690+0000","last_became_peered":"2023-12-18T10:23:11.498690+0000","last_unstale":"2023-12-18T10:23:12.481354+0000","last_undegraded":"2023-12-18T10:23:12.481354+0000","last_fullsized":"2023-12-18T10:23:12.481354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:19:14.467016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.747780+0000","last_change":"2023-12-18T10:23:11.112910+0000","last_active":"2023-12-18T10:23:12.747780+0000","last_peered":"2023-12-18T10:23:12.747780+0000","last_clean":"2023-12-18T10:23:12.747780+0000","last_became_active":"2023-12-18T10:23:11.112618+0000","last_became_peered":"2023-12-18T10:23:11.112618+0000","last_unstale":"2023-12-18T10:23:12.747780+0000","last_undegraded":"2023-12-18T10:23:12.747780+0000","last_fullsized":"2023-12-18T10:23:12.747780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:12:01.570326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.510985+0000","last_change":"2023-12-18T10:23:11.504537+0000","last_active":"2023-12-18T10:23:11.510985+0000","last_peered":"2023-12-18T10:23:11.510985+0000","last_clean":"2023-12-18T10:23:11.510985+0000","last_became_active":"2023-12-18T10:23:11.504040+0000","last_became_peered":"2023-12-18T10:23:11.504040+0000","last_unstale":"2023-12-18T10:23:11.510985+0000","last_undegraded":"2023-12-18T10:23:11.510985+0000","last_fullsized":"2023-12-18T10:23:11.510985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:42:27.358692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.478079+0000","last_change":"2023-12-18T10:23:11.111909+0000","last_active":"2023-12-18T10:23:11.478079+0000","last_peered":"2023-12-18T10:23:11.478079+0000","last_clean":"2023-12-18T10:23:11.478079+0000","last_became_active":"2023-12-18T10:23:11.111039+0000","last_became_peered":"2023-12-18T10:23:11.111039+0000","last_unstale":"2023-12-18T10:23:11.478079+0000","last_undegraded":"2023-12-18T10:23:11.478079+0000","last_fullsized":"2023-12-18T10:23:11.478079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:27:01.279976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.501286+0000","last_change":"2023-12-18T10:23:11.497018+0000","last_active":"2023-12-18T10:23:11.501286+0000","last_peered":"2023-12-18T10:23:11.501286+0000","last_clean":"2023-12-18T10:23:11.501286+0000","last_became_active":"2023-12-18T10:23:11.496697+0000","last_became_peered":"2023-12-18T10:23:11.496697+0000","last_unstale":"2023-12-18T10:23:11.501286+0000","last_undegraded":"2023-12-18T10:23:11.501286+0000","last_fullsized":"2023-12-18T10:23:11.501286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:23:09.876457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.803725+0000","last_change":"2023-12-18T10:23:11.098556+0000","last_active":"2023-12-18T10:23:12.803725+0000","last_peered":"2023-12-18T10:23:12.803725+0000","last_clean":"2023-12-18T10:23:12.803725+0000","last_became_active":"2023-12-18T10:23:11.098282+0000","last_became_peered":"2023-12-18T10:23:11.098282+0000","last_unstale":"2023-12-18T10:23:12.803725+0000","last_undegraded":"2023-12-18T10:23:12.803725+0000","last_fullsized":"2023-12-18T10:23:12.803725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:51:37.654691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581467+0000","last_change":"2023-12-18T10:23:11.500741+0000","last_active":"2023-12-18T10:23:12.581467+0000","last_peered":"2023-12-18T10:23:12.581467+0000","last_clean":"2023-12-18T10:23:12.581467+0000","last_became_active":"2023-12-18T10:23:11.500105+0000","last_became_peered":"2023-12-18T10:23:11.500105+0000","last_unstale":"2023-12-18T10:23:12.581467+0000","last_undegraded":"2023-12-18T10:23:12.581467+0000","last_fullsized":"2023-12-18T10:23:12.581467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:16.416450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.477869+0000","last_change":"2023-12-18T10:23:11.112372+0000","last_active":"2023-12-18T10:23:11.477869+0000","last_peered":"2023-12-18T10:23:11.477869+0000","last_clean":"2023-12-18T10:23:11.477869+0000","last_became_active":"2023-12-18T10:23:11.112005+0000","last_became_peered":"2023-12-18T10:23:11.112005+0000","last_unstale":"2023-12-18T10:23:11.477869+0000","last_undegraded":"2023-12-18T10:23:11.477869+0000","last_fullsized":"2023-12-18T10:23:11.477869+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:33:03.500287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581553+0000","last_change":"2023-12-18T10:23:11.491983+0000","last_active":"2023-12-18T10:23:12.581553+0000","last_peered":"2023-12-18T10:23:12.581553+0000","last_clean":"2023-12-18T10:23:12.581553+0000","last_became_active":"2023-12-18T10:23:11.491680+0000","last_became_peered":"2023-12-18T10:23:11.491680+0000","last_unstale":"2023-12-18T10:23:12.581553+0000","last_undegraded":"2023-12-18T10:23:12.581553+0000","last_fullsized":"2023-12-18T10:23:12.581553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:36.500279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.581412+0000","last_change":"2023-12-18T10:23:11.108194+0000","last_active":"2023-12-18T10:23:12.581412+0000","last_peered":"2023-12-18T10:23:12.581412+0000","last_clean":"2023-12-18T10:23:12.581412+0000","last_became_active":"2023-12-18T10:23:11.107926+0000","last_became_peered":"2023-12-18T10:23:11.107926+0000","last_unstale":"2023-12-18T10:23:12.581412+0000","last_undegraded":"2023-12-18T10:23:12.581412+0000","last_fullsized":"2023-12-18T10:23:12.581412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:12:29.216651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.748003+0000","last_change":"2023-12-18T10:23:11.511299+0000","last_active":"2023-12-18T10:23:12.748003+0000","last_peered":"2023-12-18T10:23:12.748003+0000","last_clean":"2023-12-18T10:23:12.748003+0000","last_became_active":"2023-12-18T10:23:11.510975+0000","last_became_peered":"2023-12-18T10:23:11.510975+0000","last_unstale":"2023-12-18T10:23:12.748003+0000","last_undegraded":"2023-12-18T10:23:12.748003+0000","last_fullsized":"2023-12-18T10:23:12.748003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:11.075404+0000","last_clean_scrub_stamp":"2023-12-18T10:23:11.075404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:25.776926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-18T10:23:12.482763+0000","last_change":"2023-12-18T10:23:11.114773+0000","last_active":"2023-12-18T10:23:12.482763+0000","last_peered":"2023-12-18T10:23:12.482763+0000","last_clean":"2023-12-18T10:23:12.482763+0000","last_became_active":"2023-12-18T10:23:11.114480+0000","last_became_peered":"2023-12-18T10:23:11.114480+0000","last_unstale":"2023-12-18T10:23:12.482763+0000","last_undegraded":"2023-12-18T10:23:12.482763+0000","last_fullsized":"2023-12-18T10:23:12.482763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:23:10.068717+0000","last_clean_scrub_stamp":"2023-12-18T10:23:10.068717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:23.571271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":211,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-18T10:23:11.486031+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:23:11.486031+0000","last_peered":"2023-12-18T10:23:11.486031+0000","last_clean":"2023-12-18T10:23:11.486031+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:23:11.486031+0000","last_undegraded":"2023-12-18T10:23:11.486031+0000","last_fullsized":"2023-12-18T10:23:11.486031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1564672,"data_stored":1032001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.85199999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":1.042},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":1.0049999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":1.081},{"interface":"front","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.53700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.90300000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90900000000000003,"5min":1.137,"15min":1.137},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.629}]},{"osd":6,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.95699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":436555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.82999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":4.3760000000000003,"15min":4.3760000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73999999999999999,"15min":0.872},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98299999999999998,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.77800000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68300000000000005,"15min":0.748},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94699999999999995,"5min":1.845,"15min":1.845},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73899999999999999,"15min":0.85299999999999998},"min":{"1min":0.58199999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88500000000000001,"5min":4.524,"15min":4.524},"last":0.86399999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73599999999999999,"15min":0.79200000000000004},"min":{"1min":0.52900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.97699999999999998,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71499999999999997,"15min":0.75900000000000001},"min":{"1min":0.57399999999999995,"5min":0.436,"15min":0.436},"max":{"1min":0.91100000000000003,"5min":1.925,"15min":1.925},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.74299999999999999,"15min":0.82299999999999995},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95199999999999996,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.75600000000000001,"15min":0.88},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.86199999999999999,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.64000000000000001,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88200000000000001,"5min":1.054,"15min":1.054},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65500000000000003,"15min":0.68300000000000005},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.98199999999999998,"5min":1.101,"15min":1.101},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.79600000000000004,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.70899999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92800000000000005,"5min":1.284,"15min":1.284},"last":0.90800000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:22:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.73899999999999999},"min":{"1min":0.496,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94699999999999995,"5min":1.129,"15min":1.129},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70699999999999996,"15min":0.752},"min":{"1min":0.46500000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.99299999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":958464,"data_stored":435025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.67000000000000004},"min":{"1min":0.37,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68200000000000005,"15min":0.748},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.50800000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.752},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.77000000000000002},"min":{"1min":0.499,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70699999999999996,"15min":0.79200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81200000000000006,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.81999999999999995,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.72299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90600000000000003,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.71799999999999997,"15min":0.94899999999999995},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65800000000000003,"15min":0.754},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88500000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67300000000000004,"15min":0.78200000000000003},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.79500000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":0.81299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88600000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.749}]}]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":974848,"data_stored":436659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92800000000000005,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76300000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.131,"15min":1.131},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66800000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.52200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92900000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":1.008,"5min":1.032,"15min":1.032},"last":0.64900000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70999999999999996,"15min":0.71899999999999997},"min":{"1min":0.56699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96599999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.79500000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.435,"15min":0.435},"max":{"1min":0.77800000000000002,"5min":0.874,"15min":0.874},"last":0.70699999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.073,"15min":1.073},"last":0.68200000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.71399999999999997},"min":{"1min":0.51600000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":958464,"data_stored":435573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.438,"15min":0.43099999999999999},"min":{"1min":0.28499999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.84899999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.47099999999999997,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80200000000000005,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46000000000000002,"15min":0.47399999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.311},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.502,"15min":0.51100000000000001},"min":{"1min":0.371,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.495}]},{"osd":2,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55000000000000004,"15min":0.58499999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.036,"5min":1.254,"15min":1.254},"last":0.501},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61099999999999999,"15min":0.65900000000000003},"min":{"1min":0.46400000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.98899999999999999,"5min":1.772,"15min":1.772},"last":0.626}]},{"osd":4,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.51700000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93700000000000006,"5min":1.01,"15min":1.01},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.47099999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.167,"5min":1.181,"15min":1.181},"last":0.55100000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73199999999999998,"15min":0.752},"min":{"1min":0.60299999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92200000000000004,"5min":1.171,"15min":1.171},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.52200000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0549999999999999,"5min":1.069,"15min":1.069},"last":0.52700000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2230000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75700000000000001,"15min":0.78800000000000003},"min":{"1min":0.58799999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.747,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.53200000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":966656,"data_stored":435733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.432,"15min":0.442},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66000000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.314},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.50600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.38},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.629,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.502}]},{"osd":3,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.79700000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97699999999999998,"5min":1.698,"15min":1.698},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.622,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89700000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93400000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54600000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.85999999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.0189999999999999,"5min":1.341,"15min":1.341},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.107,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.745,"15min":0.78700000000000003},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.93999999999999995,"5min":1.282,"15min":1.282},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.84199999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":962560,"data_stored":435103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46999999999999997,"15min":0.59199999999999997},"min":{"1min":0.29499999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.55300000000000005,"5min":3.976,"15min":3.976},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46400000000000002,"15min":0.51000000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.63,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.249}]},{"osd":2,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.52300000000000002,"15min":0.63100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.64600000000000002,"5min":3.786,"15min":3.786},"last":0.312},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.34000000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59599999999999997,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.27000000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56299999999999994,"15min":0.66300000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.71099999999999997,"5min":3.6400000000000001,"15min":3.6400000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.54500000000000004,"15min":0.65300000000000002},"min":{"1min":0.36099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67800000000000005,"5min":3.2440000000000002,"15min":3.2440000000000002},"last":0.44}]},{"osd":4,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.75800000000000001,"15min":0.80400000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.048,"5min":1.851,"15min":1.851},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78100000000000003,"15min":0.91200000000000003},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78800000000000003,"15min":0.89600000000000002},"min":{"1min":0.52400000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.0189999999999999,"5min":4.1859999999999999,"15min":4.1859999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.51000000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.89000000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76600000000000001,"15min":0.81699999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0369999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.996,"5min":4.3529999999999998,"15min":4.3529999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.56299999999999994,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0269999999999999,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.499},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78600000000000003,"15min":0.82899999999999996},"min":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91600000000000004,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1548288,"data_stored":1025359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.48899999999999999},"min":{"1min":0.318,"5min":0.252,"15min":0.252},"max":{"1min":0.70699999999999996,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51200000000000001,"15min":0.54500000000000004},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":1.456,"15min":1.456},"last":0.39000000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.47999999999999998,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.623,"5min":1.595,"15min":1.595},"last":0.374},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.499,"15min":0.58099999999999996},"min":{"1min":0.30399999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.65500000000000003,"5min":2.464,"15min":2.464},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.53200000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68500000000000005,"5min":1.859,"15min":1.859},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.628},"min":{"1min":0.40799999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.74099999999999999,"5min":1.903,"15min":1.903},"last":0.434}]},{"osd":4,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.66000000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0329999999999999,"5min":1.494,"15min":1.494},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0089999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.0760000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.76100000000000001,"15min":0.755},"min":{"1min":0.58899999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0469999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76200000000000001,"15min":0.81000000000000005},"min":{"1min":0.56899999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97099999999999997,"5min":1.544,"15min":1.544},"last":0.68100000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.746,"15min":0.80200000000000005},"min":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93100000000000005,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.78700000000000003},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.92900000000000005,"5min":1.53,"15min":1.53},"last":1.002}]},{"osd":7,"last update":"Mon Dec 18 10:22:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.745,"15min":0.79500000000000004},"min":{"1min":0.61499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85899999999999999,"5min":1.556,"15min":1.556},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.621,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.96899999999999997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.95099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:23:15.909 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-18T10:23:15.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-18T10:23:16.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.090+0000 7fe770f25640 1 Processor -- start 2023-12-18T10:23:16.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.090+0000 7fe770f25640 1 -- start start 2023-12-18T10:23:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.090+0000 7fe770f25640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe76c158f20 0x7fe76c0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe770f25640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c0ca2e0 con 0x7fe76c0ad900 2023-12-18T10:23:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe770f25640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c0ca000 con 0x7fe76c0c9b40 2023-12-18T10:23:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe770f25640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c070700 con 0x7fe76c158f20 2023-12-18T10:23:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe763fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe76c0ad900 0x7fe76c0cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34066/0 (socket says 172.21.15.133:34066) 2023-12-18T10:23:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe763fff640 1 -- 172.21.15.133:0/4096677117 learned_addr learned my addr 172.21.15.133:0/4096677117 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe76a59c640 1 --2- 172.21.15.133:0/4096677117 >> v2:172.21.15.142:3300/0 conn(0x7fe76c158f20 0x7fe76c0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe769d9b640 1 -- 172.21.15.133:0/4096677117 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760915787 0 0) 0x7fe76c0ca2e0 con 0x7fe76c0ad900 2023-12-18T10:23:16.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe769d9b640 1 -- 172.21.15.133:0/4096677117 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe758003530 con 0x7fe76c0ad900 2023-12-18T10:23:16.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe76a59c640 1 -- 172.21.15.133:0/4096677117 >> v1:172.21.15.142:6789/0 conn(0x7fe76c0c9b40 legacy=0x7fe76c06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe76a59c640 1 -- 172.21.15.133:0/4096677117 >> v1:172.21.15.133:6789/0 conn(0x7fe76c0ad900 legacy=0x7fe76c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.094+0000 7fe76a59c640 1 -- 172.21.15.133:0/4096677117 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0709e0 con 0x7fe76c158f20 2023-12-18T10:23:16.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.098+0000 7fe76a59c640 1 --2- 172.21.15.133:0/4096677117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c158f20 0x7fe76c0714c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0097c0 tx=0x7fe75c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec9983c472d16921 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:16.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.098+0000 7fe769d9b640 1 -- 172.21.15.133:0/4096677117 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0ac620 con 0x7fe76c158f20 2023-12-18T10:23:16.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.098+0000 7fe769d9b640 1 -- 172.21.15.133:0/4096677117 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0ac780 con 0x7fe76c158f20 2023-12-18T10:23:16.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.098+0000 7fe769d9b640 1 -- 172.21.15.133:0/4096677117 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0acb10 con 0x7fe76c158f20 2023-12-18T10:23:16.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- 172.21.15.133:0/4096677117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c158f20 msgr2=0x7fe76c0714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 --2- 172.21.15.133:0/4096677117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c158f20 0x7fe76c0714c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0097c0 tx=0x7fe75c01c3c0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- 172.21.15.133:0/4096677117 shutdown_connections 2023-12-18T10:23:16.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 --2- 172.21.15.133:0/4096677117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c158f20 0x7fe76c0714c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- 172.21.15.133:0/4096677117 >> 172.21.15.133:0/4096677117 conn(0x7fe76c0ce450 msgr2=0x7fe76c0ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:16.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- 172.21.15.133:0/4096677117 shutdown_connections 2023-12-18T10:23:16.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- 172.21.15.133:0/4096677117 wait complete. 2023-12-18T10:23:16.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 Processor -- start 2023-12-18T10:23:16.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- start start 2023-12-18T10:23:16.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c0ad900 0x7fe76c151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c0c9b40 0x7fe76c155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe76c158f20 0x7fe76c1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c156390 con 0x7fe76c0ad900 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0b2f10 con 0x7fe76c0c9b40 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe770f25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0b31f0 con 0x7fe76c158f20 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe76a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c0ad900 0x7fe76c151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe76a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c0ad900 0x7fe76c151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44394/0 (socket says 172.21.15.133:44394) 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe76a59c640 1 -- 172.21.15.133:0/3501617223 learned_addr learned my addr 172.21.15.133:0/3501617223 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.102+0000 7fe763fff640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c0c9b40 0x7fe76c155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe76ad9d640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe76c158f20 0x7fe76c1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe76a59c640 1 -- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe76c158f20 msgr2=0x7fe76c1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe76a59c640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe76c158f20 0x7fe76c1510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe76a59c640 1 -- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c0c9b40 msgr2=0x7fe76c155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe76a59c640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c0c9b40 0x7fe76c155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe76a59c640 1 -- 172.21.15.133:0/3501617223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c009420 con 0x7fe76c0ad900 2023-12-18T10:23:16.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe76ad9d640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe76c158f20 0x7fe76c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:16.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe76a59c640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c0ad900 0x7fe76c151990 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0af040 tx=0x7fe75c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:16.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe762ffd640 1 -- 172.21.15.133:0/3501617223 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0b5410 con 0x7fe76c0ad900 2023-12-18T10:23:16.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe762ffd640 1 -- 172.21.15.133:0/3501617223 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0b5590 con 0x7fe76c0ad900 2023-12-18T10:23:16.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe762ffd640 1 -- 172.21.15.133:0/3501617223 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0b5940 con 0x7fe76c0ad900 2023-12-18T10:23:16.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c0b34d0 con 0x7fe76c0ad900 2023-12-18T10:23:16.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c151610 con 0x7fe76c0ad900 2023-12-18T10:23:16.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c0cf1a0 con 0x7fe76c0ad900 2023-12-18T10:23:16.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe762ffd640 1 -- 172.21.15.133:0/3501617223 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe75c0b3040 con 0x7fe76c0ad900 2023-12-18T10:23:16.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe762ffd640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe74c065a60 0x7fe74c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe762ffd640 1 -- 172.21.15.133:0/3501617223 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe75c11d2f0 con 0x7fe76c0ad900 2023-12-18T10:23:16.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.106+0000 7fe763fff640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe74c065a60 0x7fe74c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.110+0000 7fe763fff640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe74c065a60 0x7fe74c067f20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0ad170 tx=0x7fe754007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:16.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.110+0000 7fe762ffd640 1 -- 172.21.15.133:0/3501617223 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe75c0eac10 con 0x7fe76c0ad900 2023-12-18T10:23:16.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.314+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe76c1595a0 con 0x7fe76c0ad900 2023-12-18T10:23:16.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.318+0000 7fe762ffd640 1 -- 172.21.15.133:0/3501617223 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe76c1595a0 con 0x7fe76c0ad900 2023-12-18T10:23:16.323 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe74c065a60 msgr2=0x7fe74c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe74c065a60 0x7fe74c067f20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0ad170 tx=0x7fe754007d40 comp rx=0 tx=0).stop 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c0ad900 msgr2=0x7fe76c151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c0ad900 0x7fe76c151990 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0af040 tx=0x7fe75c019160 comp rx=0 tx=0).stop 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 shutdown_connections 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe74c065a60 0x7fe74c067f20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe76c158f20 0x7fe76c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe76c0c9b40 0x7fe76c155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 --2- 172.21.15.133:0/3501617223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe76c0ad900 0x7fe76c151990 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 >> 172.21.15.133:0/3501617223 conn(0x7fe76c0ce450 msgr2=0x7fe76c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 shutdown_connections 2023-12-18T10:23:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.322+0000 7fe770f25640 1 -- 172.21.15.133:0/3501617223 wait complete. 2023-12-18T10:23:16.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:16.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15fa739640 1 Processor -- start 2023-12-18T10:23:16.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15fa739640 1 -- start start 2023-12-18T10:23:16.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15fa739640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f15f415a0a0 0x7f15f415d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15fa739640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15f415a480 0x7f15f40cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15fa739640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f415d680 con 0x7f15f40cb050 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15fa739640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f40cd0f0 con 0x7f15f415a480 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15fa739640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f40cb4b0 con 0x7f15f415a0a0 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15f415a480 0x7f15f40cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15f415a480 0x7f15f40cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44396/0 (socket says 172.21.15.133:44396) 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f37fe640 1 -- 172.21.15.133:0/2471335662 learned_addr learned my addr 172.21.15.133:0/2471335662 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f8cd6640 1 --1- 172.21.15.133:0/2471335662 >> v1:172.21.15.133:6789/0 conn(0x7f15f40cb050 0x7f15f40b0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34078/0 (socket says 172.21.15.133:34078) 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f3fff640 1 --2- 172.21.15.133:0/2471335662 >> v2:172.21.15.142:3300/0 conn(0x7f15f415a0a0 0x7f15f415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f37fe640 1 -- 172.21.15.133:0/2471335662 >> v2:172.21.15.142:3300/0 conn(0x7f15f415a0a0 msgr2=0x7f15f415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f37fe640 1 --2- 172.21.15.133:0/2471335662 >> v2:172.21.15.142:3300/0 conn(0x7f15f415a0a0 0x7f15f415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f37fe640 1 -- 172.21.15.133:0/2471335662 >> v1:172.21.15.133:6789/0 conn(0x7f15f40cb050 legacy=0x7f15f40b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.478+0000 7f15f37fe640 1 -- 172.21.15.133:0/2471335662 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f415d920 con 0x7f15f415a480 2023-12-18T10:23:16.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15f37fe640 1 --2- 172.21.15.133:0/2471335662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f40cab10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f15f406cb10 tx=0x7f15e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316874ec3c0787d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:16.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15f2ffd640 1 -- 172.21.15.133:0/2471335662 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80ac640 con 0x7f15f415a480 2023-12-18T10:23:16.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15f2ffd640 1 -- 172.21.15.133:0/2471335662 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e80ac7a0 con 0x7f15f415a480 2023-12-18T10:23:16.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15f2ffd640 1 -- 172.21.15.133:0/2471335662 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80acb30 con 0x7f15f415a480 2023-12-18T10:23:16.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15fa739640 1 -- 172.21.15.133:0/2471335662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 msgr2=0x7f15f40cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15fa739640 1 --2- 172.21.15.133:0/2471335662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f40cab10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f15f406cb10 tx=0x7f15e801c4d0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15fa739640 1 -- 172.21.15.133:0/2471335662 shutdown_connections 2023-12-18T10:23:16.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15fa739640 1 --2- 172.21.15.133:0/2471335662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f40cab10 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15fa739640 1 --2- 172.21.15.133:0/2471335662 >> v2:172.21.15.142:3300/0 conn(0x7f15f415a0a0 0x7f15f415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15fa739640 1 -- 172.21.15.133:0/2471335662 >> 172.21.15.133:0/2471335662 conn(0x7f15f406cf80 msgr2=0x7f15f406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:16.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15fa739640 1 -- 172.21.15.133:0/2471335662 shutdown_connections 2023-12-18T10:23:16.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.482+0000 7f15fa739640 1 -- 172.21.15.133:0/2471335662 wait complete. 2023-12-18T10:23:16.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 Processor -- start 2023-12-18T10:23:16.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 -- start start 2023-12-18T10:23:16.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f40cb050 0x7f15f41492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f415a0a0 0x7f15f4165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f414d690 con 0x7f15f415a480 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4149810 con 0x7f15f40cb050 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40b0750 con 0x7f15f415a0a0 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f414feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44402/0 (socket says 172.21.15.133:44402) 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 -- 172.21.15.133:0/3122122980 learned_addr learned my addr 172.21.15.133:0/3122122980 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f3fff640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f40cb050 0x7f15f41492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 -- 172.21.15.133:0/3122122980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f415a0a0 msgr2=0x7f15f4165fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f415a0a0 0x7f15f4165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 -- 172.21.15.133:0/3122122980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f40cb050 msgr2=0x7f15f41492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f40cb050 0x7f15f41492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 -- 172.21.15.133:0/3122122980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80094d0 con 0x7f15f415a480 2023-12-18T10:23:16.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f3fff640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f40cb050 0x7f15f41492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:16.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f8cd6640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f414feb0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c700 tx=0x7f15ec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:16.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f0ff9640 1 -- 172.21.15.133:0/3122122980 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00ce10 con 0x7f15f415a480 2023-12-18T10:23:16.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f0ff9640 1 -- 172.21.15.133:0/3122122980 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec00a640 con 0x7f15f415a480 2023-12-18T10:23:16.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15f0ff9640 1 -- 172.21.15.133:0/3122122980 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00a9b0 con 0x7f15f415a480 2023-12-18T10:23:16.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f40b09f0 con 0x7f15f415a480 2023-12-18T10:23:16.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.486+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f40b0fb0 con 0x7f15f415a480 2023-12-18T10:23:16.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.490+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f414d7d0 con 0x7f15f415a480 2023-12-18T10:23:16.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.490+0000 7f15f0ff9640 1 -- 172.21.15.133:0/3122122980 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f15ec00ab10 con 0x7f15f415a480 2023-12-18T10:23:16.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.490+0000 7f15f0ff9640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f15e0065a60 0x7f15e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:16.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.490+0000 7f15f0ff9640 1 -- 172.21.15.133:0/3122122980 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f15ec082920 con 0x7f15f415a480 2023-12-18T10:23:16.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.490+0000 7f15f3fff640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f15e0065a60 0x7f15e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:16.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.490+0000 7f15f3fff640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f15e0065a60 0x7f15e0067f20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009ae0 tx=0x7f15e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:16.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.494+0000 7f15f0ff9640 1 -- 172.21.15.133:0/3122122980 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f15f414d7d0 con 0x7f15f415a480 2023-12-18T10:23:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15f414d7d0 con 0x7f15f415a480 2023-12-18T10:23:16.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15f0ff9640 1 -- 172.21.15.133:0/3122122980 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4720 (secure 0 0 0) 0x7f15f414d7d0 con 0x7f15f415a480 2023-12-18T10:23:16.677 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:16.678 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7096,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7099,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:14.480956+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7557},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:16.678 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2023-12-18T10:23:16.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f15e0065a60 msgr2=0x7f15e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f15e0065a60 0x7f15e0067f20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009ae0 tx=0x7f15e4008040 comp rx=0 tx=0).stop 2023-12-18T10:23:16.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 msgr2=0x7f15f414feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:16.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f414feb0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c700 tx=0x7f15ec00cbc0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 shutdown_connections 2023-12-18T10:23:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f15e0065a60 0x7f15e0067f20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15f415a480 0x7f15f414feb0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15f415a0a0 0x7f15f4165fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 --2- 172.21.15.133:0/3122122980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15f40cb050 0x7f15f41492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 >> 172.21.15.133:0/3122122980 conn(0x7f15f406cf80 msgr2=0x7f15f40cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 shutdown_connections 2023-12-18T10:23:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:16.674+0000 7f15fa739640 1 -- 172.21.15.133:0/3122122980 wait complete. 2023-12-18T10:23:17.100 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:23:11.467812+0000', 'modified': '2023-12-18T10:23:14.480956+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7557}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7557': {'gid': 7557, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/522841432', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 522841432}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 522841432}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:23:17.100 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-18T10:23:17.101 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-18T10:23:17.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c9ce5640 1 Processor -- start 2023-12-18T10:23:17.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c9ce5640 1 -- start start 2023-12-18T10:23:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c9ce5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29c415c9d0 0x7f29c40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c9ce5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29c40cdd40 0x7f29c4160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c9ce5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c4161060 0x7f29c406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c9ce5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c41603f0 con 0x7f29c415c9d0 2023-12-18T10:23:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c9ce5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c4160690 con 0x7f29c40cdd40 2023-12-18T10:23:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c9ce5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40b0d80 con 0x7f29c4161060 2023-12-18T10:23:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29c415c9d0 0x7f29c40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29c415c9d0 0x7f29c40cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44404/0 (socket says 172.21.15.133:44404) 2023-12-18T10:23:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c37fe640 1 -- 172.21.15.133:0/1550921691 learned_addr learned my addr 172.21.15.133:0/1550921691 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29bbfff640 1 --2- 172.21.15.133:0/1550921691 >> v2:172.21.15.142:3300/0 conn(0x7f29c40cdd40 0x7f29c4160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.238+0000 7f29c3fff640 1 --2- 172.21.15.133:0/1550921691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c4161060 0x7f29c406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c37fe640 1 -- 172.21.15.133:0/1550921691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c4161060 msgr2=0x7f29c406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c37fe640 1 --2- 172.21.15.133:0/1550921691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c4161060 0x7f29c406fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c37fe640 1 -- 172.21.15.133:0/1550921691 >> v2:172.21.15.142:3300/0 conn(0x7f29c40cdd40 msgr2=0x7f29c4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c37fe640 1 --2- 172.21.15.133:0/1550921691 >> v2:172.21.15.142:3300/0 conn(0x7f29c40cdd40 0x7f29c4160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c37fe640 1 -- 172.21.15.133:0/1550921691 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40ccb00 con 0x7f29c415c9d0 2023-12-18T10:23:17.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29bbfff640 1 --2- 172.21.15.133:0/1550921691 >> v2:172.21.15.142:3300/0 conn(0x7f29c40cdd40 0x7f29c4160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:17.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c37fe640 1 --2- 172.21.15.133:0/1550921691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40cc400 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f29c40c8ad0 tx=0x7f29b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f25d6db3e0c089 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c2ffd640 1 -- 172.21.15.133:0/1550921691 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40aa640 con 0x7f29c415c9d0 2023-12-18T10:23:17.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c2ffd640 1 -- 172.21.15.133:0/1550921691 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40aa7a0 con 0x7f29c415c9d0 2023-12-18T10:23:17.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c2ffd640 1 -- 172.21.15.133:0/1550921691 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40aab30 con 0x7f29c415c9d0 2023-12-18T10:23:17.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1550921691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 msgr2=0x7f29c40cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.242+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1550921691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40cc400 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f29c40c8ad0 tx=0x7f29b401c500 comp rx=0 tx=0).stop 2023-12-18T10:23:17.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1550921691 shutdown_connections 2023-12-18T10:23:17.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1550921691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c4161060 0x7f29c406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1550921691 >> v2:172.21.15.142:3300/0 conn(0x7f29c40cdd40 0x7f29c4160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1550921691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40cc400 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1550921691 >> 172.21.15.133:0/1550921691 conn(0x7f29c406a3e0 msgr2=0x7f29c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:17.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1550921691 shutdown_connections 2023-12-18T10:23:17.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1550921691 wait complete. 2023-12-18T10:23:17.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 Processor -- start 2023-12-18T10:23:17.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 -- start start 2023-12-18T10:23:17.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c40cdd40 0x7f29c40c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4161060 0x7f29c415e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40c8250 con 0x7f29c415c9d0 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40c7f70 con 0x7f29c4161060 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c9ce5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40c5f70 con 0x7f29c40cdd40 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44416/0 (socket says 172.21.15.133:44416) 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 -- 172.21.15.133:0/1585022272 learned_addr learned my addr 172.21.15.133:0/1585022272 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c37fe640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c40cdd40 0x7f29c40c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c3fff640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4161060 0x7f29c415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 -- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c40cdd40 msgr2=0x7f29c40c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c40cdd40 0x7f29c40c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 -- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4161060 msgr2=0x7f29c415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4161060 0x7f29c415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 -- 172.21.15.133:0/1585022272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40094d0 con 0x7f29c415c9d0 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c37fe640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c40cdd40 0x7f29c40c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c3fff640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4161060 0x7f29c415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29bbfff640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40c7890 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e810 tx=0x7f29ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.246+0000 7f29c0ff9640 1 -- 172.21.15.133:0/1585022272 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00c8d0 con 0x7f29c415c9d0 2023-12-18T10:23:17.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.250+0000 7f29c0ff9640 1 -- 172.21.15.133:0/1585022272 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00ca30 con 0x7f29c415c9d0 2023-12-18T10:23:17.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.250+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1585022272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c40c6250 con 0x7f29c415c9d0 2023-12-18T10:23:17.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.250+0000 7f29c0ff9640 1 -- 172.21.15.133:0/1585022272 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00cdc0 con 0x7f29c415c9d0 2023-12-18T10:23:17.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.250+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1585022272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c41522f0 con 0x7f29c415c9d0 2023-12-18T10:23:17.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.250+0000 7f29c0ff9640 1 -- 172.21.15.133:0/1585022272 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f29ac013410 con 0x7f29c415c9d0 2023-12-18T10:23:17.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.250+0000 7f29c0ff9640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29a4065a60 0x7f29a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c0ff9640 1 -- 172.21.15.133:0/1585022272 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29ac083100 con 0x7f29c415c9d0 2023-12-18T10:23:17.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 Processor -- start 2023-12-18T10:23:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29a4065a60 0x7f29a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- start start 2023-12-18T10:23:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29a4065a60 0x7f29a4067f20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f29b40ae000 tx=0x7f29b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd4fe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd4b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd4b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfd2d7c90 con 0x561cfd4fe070 2023-12-18T10:23:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfd309220 con 0x561cfd4fe990 2023-12-18T10:23:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cfd3067f0 con 0x561cfd4b41c0 2023-12-18T10:23:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd4fe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd4fe450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44428/0 (socket says 172.21.15.133:44428) 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 -- 172.21.15.133:0/2245339692 learned_addr learned my addr 172.21.15.133:0/2245339692 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c3fff640 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd4b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 -- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 msgr2=0x561cfd4b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29bbfff640 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd4b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd4b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 -- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 msgr2=0x561cfd4b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd4b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 -- 172.21.15.133:0/2245339692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cfcffe890 con 0x561cfd4fe070 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c3fff640 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd4b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29bbfff640 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd4b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29c37fe640 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd4fe450 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f29b4097fb0 tx=0x7f29b40a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9543315d07b14088 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29b97fa640 1 -- 172.21.15.133:0/2245339692 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40b36b0 con 0x561cfd4fe070 2023-12-18T10:23:17.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29b97fa640 1 -- 172.21.15.133:0/2245339692 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40bb040 con 0x561cfd4fe070 2023-12-18T10:23:17.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29b97fa640 1 -- 172.21.15.133:0/2245339692 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40b3a30 con 0x561cfd4fe070 2023-12-18T10:23:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- 172.21.15.133:0/2245339692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 msgr2=0x561cfd4fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd4fe450 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f29b4097fb0 tx=0x7f29b40a7000 comp rx=0 tx=0).stop 2023-12-18T10:23:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- 172.21.15.133:0/2245339692 shutdown_connections 2023-12-18T10:23:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd4b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd4b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 --2- 172.21.15.133:0/2245339692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd4fe450 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- 172.21.15.133:0/2245339692 >> 172.21.15.133:0/2245339692 conn(0x561cfd4ba950 msgr2=0x561cfd4b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- 172.21.15.133:0/2245339692 shutdown_connections 2023-12-18T10:23:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.254+0000 7f29cd03a000 1 -- 172.21.15.133:0/2245339692 wait complete. 2023-12-18T10:23:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 -- start start 2023-12-18T10:23:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 Processor -- start 2023-12-18T10:23:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd5057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd505d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe990 0x561cfd4ec030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfd3020e0 con 0x561cfd4fe070 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfd2a1310 con 0x561cfd4b41c0 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cfd2bf770 con 0x561cfd4fe990 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 10 client.0 _ll_register_callbacks cb 0x561cfd49fb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd505d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd505d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44434/0 (socket says 172.21.15.133:44434) 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 -- 172.21.15.133:0/165091761 learned_addr learned my addr 172.21.15.133:0/165091761 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29c3fff640 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe990 0x561cfd4ec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29c37fe640 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd5057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 -- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe990 msgr2=0x561cfd4ec030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe990 0x561cfd4ec030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 -- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 msgr2=0x561cfd5057f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd5057f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 -- 172.21.15.133:0/165091761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c40ccb00 con 0x561cfd4fe070 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29c37fe640 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd5057f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29bbfff640 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd505d30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f29ac081480 tx=0x7f29ac054e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a97ec252def54e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29a27fc640 1 -- 172.21.15.133:0/165091761 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac05c180 con 0x561cfd4fe070 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 -- 172.21.15.133:0/165091761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cfd2d1c10 con 0x561cfd4fe070 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29a27fc640 1 -- 172.21.15.133:0/165091761 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29ac07ce10 con 0x561cfd4fe070 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29a27fc640 1 -- 172.21.15.133:0/165091761 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29ac05c2e0 con 0x561cfd4fe070 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 10 client.7698 fetch_fsmap learned FSMap version 68 2023-12-18T10:23:17.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 -- 172.21.15.133:0/165091761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x561cfd2c7260 con 0x561cfd4fe070 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29a27fc640 1 -- 172.21.15.133:0/165091761 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac06f030 con 0x561cfd4fe070 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29a27fc640 1 -- 172.21.15.133:0/165091761 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 68) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f29ac05a220 con 0x561cfd4fe070 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 10 client.7698 fetch_fsmap finished waiting for FSMap version 68 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 10 client.7698 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 20 client.7698 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x561cfd4ecdd0 0x561cfd4ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 4 client.7698 mds_command: new command op to 7557 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29cd03a000 1 -- 172.21.15.133:0/165091761 --> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561cfd300a30 con 0x561cfd4ecdd0 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29c37fe640 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x561cfd4ecdd0 0x561cfd4ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29c37fe640 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x561cfd4ecdd0 0x561cfd4ed1b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97e5c570fc764d04 server_cookie=5b807ad2b1fede73 in_seq=0 out_seq=0 2023-12-18T10:23:17.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.258+0000 7f29a27fc640 10 client.7698 ms_handle_connect on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29a27fc640 1 -- 172.21.15.133:0/165091761 <== mds.0 v2:172.21.15.133:6835/522841432 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561cfd300a30 con 0x561cfd4ecdd0 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29a27fc640 10 client.7698 handle_command_reply: tid=0 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 client.7698 shutdown 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 -- 172.21.15.133:0/165091761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 msgr2=0x561cfd505d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd505d30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f29ac081480 tx=0x7f29ac054e70 comp rx=0 tx=0).stop 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 -- 172.21.15.133:0/165091761 shutdown_connections 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe990 0x561cfd4ec030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd505d30 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x561cfd4ecdd0 0x561cfd4ed1b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 --2- 172.21.15.133:0/165091761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd5057f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29a27fc640 0 client.7698 ms_handle_reset on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:17.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 -- 172.21.15.133:0/165091761 >> 172.21.15.133:0/165091761 conn(0x561cfd4ba950 msgr2=0x561cfd4b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:17.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 -- 172.21.15.133:0/165091761 shutdown_connections 2023-12-18T10:23:17.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 1 -- 172.21.15.133:0/165091761 wait complete. 2023-12-18T10:23:17.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.262+0000 7f29cd03a000 20 client.7698 trim_cache size 0 max 16384 2023-12-18T10:23:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 Processor -- start 2023-12-18T10:23:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- start start 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd5562f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd556830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd556d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfd4ba1b0 con 0x561cfd4fe070 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfcfbf940 con 0x561cfd4fe990 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cfd300f70 con 0x561cfd4b41c0 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd556830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd556830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44450/0 (socket says 172.21.15.133:44450) 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 -- 172.21.15.133:0/1516332199 learned_addr learned my addr 172.21.15.133:0/1516332199 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29c3fff640 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd556d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29c37fe640 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd5562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 -- 172.21.15.133:0/1516332199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 msgr2=0x561cfd5562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd5562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 -- 172.21.15.133:0/1516332199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 msgr2=0x561cfd556d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd556d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 -- 172.21.15.133:0/1516332199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cfd2ad3b0 con 0x561cfd4fe070 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29bbfff640 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd556830 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f29ac05c0e0 tx=0x7f29ac01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693dfdaa24bb0556 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29b9ffb640 1 -- 172.21.15.133:0/1516332199 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0094a0 con 0x561cfd4fe070 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29b9ffb640 1 -- 172.21.15.133:0/1516332199 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac06f070 con 0x561cfd4fe070 2023-12-18T10:23:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29b9ffb640 1 -- 172.21.15.133:0/1516332199 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac053f90 con 0x561cfd4fe070 2023-12-18T10:23:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- 172.21.15.133:0/1516332199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 msgr2=0x561cfd556830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd556830 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f29ac05c0e0 tx=0x7f29ac01e000 comp rx=0 tx=0).stop 2023-12-18T10:23:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- 172.21.15.133:0/1516332199 shutdown_connections 2023-12-18T10:23:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4fe990 0x561cfd556d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe070 0x561cfd556830 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 --2- 172.21.15.133:0/1516332199 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4b41c0 0x561cfd5562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- 172.21.15.133:0/1516332199 >> 172.21.15.133:0/1516332199 conn(0x561cfd4ba950 msgr2=0x561cfd50bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- 172.21.15.133:0/1516332199 shutdown_connections 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- 172.21.15.133:0/1516332199 wait complete. 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.278+0000 7f29cd03a000 1 -- start start 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 Processor -- start 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd55af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe070 0x561cfd55b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe990 0x561cfd53e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfd2f71f0 con 0x561cfd4fe990 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfd303670 con 0x561cfd4b41c0 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cfd2aa860 con 0x561cfd4fe070 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 10 client.0 _ll_register_callbacks cb 0x561cfd2b0640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe990 0x561cfd53e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe990 0x561cfd53e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44460/0 (socket says 172.21.15.133:44460) 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd55af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 -- 172.21.15.133:0/3153450249 learned_addr learned my addr 172.21.15.133:0/3153450249 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29bbfff640 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe070 0x561cfd55b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 -- 172.21.15.133:0/3153450249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe070 msgr2=0x561cfd55b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe070 0x561cfd55b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 -- 172.21.15.133:0/3153450249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 msgr2=0x561cfd55af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd55af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 -- 172.21.15.133:0/3153450249 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561cfd2c7260 con 0x561cfd4fe990 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c3fff640 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe990 0x561cfd53e940 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f29bc007920 tx=0x7f29bc007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b3a9b19dc7ef21 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29a27fc640 1 -- 172.21.15.133:0/3153450249 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc014ab0 con 0x561cfd4fe990 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29a27fc640 1 -- 172.21.15.133:0/3153450249 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29bc00e070 con 0x561cfd4fe990 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 -- 172.21.15.133:0/3153450249 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cfd4b8b70 con 0x561cfd4fe990 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29a27fc640 1 -- 172.21.15.133:0/3153450249 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29bc014c10 con 0x561cfd4fe990 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 10 client.7704 fetch_fsmap learned FSMap version 68 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 -- 172.21.15.133:0/3153450249 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x561cfcffecc0 con 0x561cfd4fe990 2023-12-18T10:23:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29a27fc640 1 -- 172.21.15.133:0/3153450249 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561cfd4b8b70 con 0x561cfd4fe990 2023-12-18T10:23:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29a27fc640 1 -- 172.21.15.133:0/3153450249 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 68) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f29bc017440 con 0x561cfd4fe990 2023-12-18T10:23:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 10 client.7704 fetch_fsmap finished waiting for FSMap version 68 2023-12-18T10:23:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 10 client.7704 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:23:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 20 client.7704 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x561cfd53ee80 0x561cfd53f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 4 client.7704 mds_command: new command op to 7557 tid=0[{"prefix": "status"}] 2023-12-18T10:23:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29cd03a000 1 -- 172.21.15.133:0/3153450249 --> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561cfd2c7e00 con 0x561cfd53ee80 2023-12-18T10:23:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c37fe640 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x561cfd53ee80 0x561cfd53f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29c37fe640 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x561cfd53ee80 0x561cfd53f260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb4e7715cba28246 server_cookie=15d5e3ebc375fe45 in_seq=0 out_seq=0 2023-12-18T10:23:17.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.282+0000 7f29a27fc640 10 client.7704 ms_handle_connect on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29a27fc640 1 -- 172.21.15.133:0/3153450249 <== mds.0 v2:172.21.15.133:6835/522841432 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561cfd2c7e00 con 0x561cfd53ee80 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29a27fc640 10 client.7704 handle_command_reply: tid=0 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 client.7704 shutdown 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 -- 172.21.15.133:0/3153450249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe990 msgr2=0x561cfd53e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe990 0x561cfd53e940 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f29bc007920 tx=0x7f29bc007de0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 -- 172.21.15.133:0/3153450249 shutdown_connections 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561cfd4fe990 0x561cfd53e940 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561cfd4fe070 0x561cfd55b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x561cfd53ee80 0x561cfd53f260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 --2- 172.21.15.133:0/3153450249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561cfd4b41c0 0x561cfd55af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29a27fc640 0 client.7704 ms_handle_reset on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 -- 172.21.15.133:0/3153450249 >> 172.21.15.133:0/3153450249 conn(0x561cfd4ba950 msgr2=0x561cfd4e9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 -- 172.21.15.133:0/3153450249 shutdown_connections 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 1 -- 172.21.15.133:0/3153450249 wait complete. 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29cd03a000 20 client.7704 trim_cache size 0 max 16384 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:23:17.294 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7557, 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 5.8192481760000003, 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 68, 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 79, 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 79, 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 10.077235487999999 2023-12-18T10:23:17.295 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:17.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29a4065a60 msgr2=0x7f29a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29a4065a60 0x7f29a4067f20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f29b40ae000 tx=0x7f29b4008040 comp rx=0 tx=0).stop 2023-12-18T10:23:17.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 msgr2=0x7f29c40c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40c7890 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e810 tx=0x7f29ac00ecd0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1585022272 shutdown_connections 2023-12-18T10:23:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f29a4065a60 0x7f29a4067f20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4161060 0x7f29c415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c415c9d0 0x7f29c40c7890 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 --2- 172.21.15.133:0/1585022272 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f29c40cdd40 0x7f29c40c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1585022272 >> 172.21.15.133:0/1585022272 conn(0x7f29c406a3e0 msgr2=0x7f29c40ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1585022272 shutdown_connections 2023-12-18T10:23:17.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.286+0000 7f29c9ce5640 1 -- 172.21.15.133:0/1585022272 wait complete. 2023-12-18T10:23:17.308 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:23:17.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde952fc640 1 Processor -- start 2023-12-18T10:23:17.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde952fc640 1 -- start start 2023-12-18T10:23:17.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde952fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fde900704c0 0x7fde9015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde952fc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9015f100 con 0x7fde9015a680 2023-12-18T10:23:17.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde952fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde900ca7d0 con 0x7fde900cac10 2023-12-18T10:23:17.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde952fc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9015e860 con 0x7fde900704c0 2023-12-18T10:23:17.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde8effd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fde9015a680 0x7fde9015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34080/0 (socket says 172.21.15.133:34080) 2023-12-18T10:23:17.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde8effd640 1 -- 172.21.15.133:0/4091510150 learned_addr learned my addr 172.21.15.133:0/4091510150 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:17.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde8f7fe640 1 --2- 172.21.15.133:0/4091510150 >> v2:172.21.15.133:3300/0 conn(0x7fde900704c0 0x7fde9015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde8dffb640 1 -- 172.21.15.133:0/4091510150 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088539253 0 0) 0x7fde9015f100 con 0x7fde9015a680 2023-12-18T10:23:17.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde8dffb640 1 -- 172.21.15.133:0/4091510150 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde78003530 con 0x7fde9015a680 2023-12-18T10:23:17.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde8f7fe640 1 -- 172.21.15.133:0/4091510150 >> v1:172.21.15.142:6789/0 conn(0x7fde900cac10 legacy=0x7fde9006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:17.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde8f7fe640 1 -- 172.21.15.133:0/4091510150 >> v1:172.21.15.133:6789/0 conn(0x7fde9015a680 legacy=0x7fde9015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.442+0000 7fde8f7fe640 1 -- 172.21.15.133:0/4091510150 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9015eb40 con 0x7fde900704c0 2023-12-18T10:23:17.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde8f7fe640 1 --2- 172.21.15.133:0/4091510150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde9015e160 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fde880097c0 tx=0x7fde8801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe25ba10c5490bb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde8dffb640 1 -- 172.21.15.133:0/4091510150 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880ac410 con 0x7fde900704c0 2023-12-18T10:23:17.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde8dffb640 1 -- 172.21.15.133:0/4091510150 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880ac570 con 0x7fde900704c0 2023-12-18T10:23:17.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde8dffb640 1 -- 172.21.15.133:0/4091510150 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880ac8e0 con 0x7fde900704c0 2023-12-18T10:23:17.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde952fc640 1 -- 172.21.15.133:0/4091510150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 msgr2=0x7fde9015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde952fc640 1 --2- 172.21.15.133:0/4091510150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde9015e160 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fde880097c0 tx=0x7fde8801c3b0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde952fc640 1 -- 172.21.15.133:0/4091510150 shutdown_connections 2023-12-18T10:23:17.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde952fc640 1 --2- 172.21.15.133:0/4091510150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde9015e160 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde952fc640 1 -- 172.21.15.133:0/4091510150 >> 172.21.15.133:0/4091510150 conn(0x7fde9006a3e0 msgr2=0x7fde900afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:17.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde952fc640 1 -- 172.21.15.133:0/4091510150 shutdown_connections 2023-12-18T10:23:17.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.446+0000 7fde952fc640 1 -- 172.21.15.133:0/4091510150 wait complete. 2023-12-18T10:23:17.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 Processor -- start 2023-12-18T10:23:17.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 -- start start 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde900b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde900cac10 0x7fde90159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9015a680 0x7fde90157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde90159f40 con 0x7fde900704c0 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde901588e0 con 0x7fde900cac10 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde900b1e00 con 0x7fde9015a680 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde900b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde900b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44482/0 (socket says 172.21.15.133:44482) 2023-12-18T10:23:17.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 -- 172.21.15.133:0/4054841616 learned_addr learned my addr 172.21.15.133:0/4054841616 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8f7fe640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9015a680 0x7fde90157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8e7fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde900cac10 0x7fde90159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 -- 172.21.15.133:0/4054841616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9015a680 msgr2=0x7fde90157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9015a680 0x7fde90157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 -- 172.21.15.133:0/4054841616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde900cac10 msgr2=0x7fde90159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde900cac10 0x7fde90159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 -- 172.21.15.133:0/4054841616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde88009420 con 0x7fde900704c0 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde8effd640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde900b1770 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fde8000caa0 tx=0x7fde8000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde777fe640 1 -- 172.21.15.133:0/4054841616 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000ac00 con 0x7fde900704c0 2023-12-18T10:23:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde777fe640 1 -- 172.21.15.133:0/4054841616 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8000ad60 con 0x7fde900704c0 2023-12-18T10:23:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde90149760 con 0x7fde900704c0 2023-12-18T10:23:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde777fe640 1 -- 172.21.15.133:0/4054841616 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80012620 con 0x7fde900704c0 2023-12-18T10:23:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.450+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde90149d20 con 0x7fde900704c0 2023-12-18T10:23:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.454+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde900735b0 con 0x7fde900704c0 2023-12-18T10:23:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.454+0000 7fde777fe640 1 -- 172.21.15.133:0/4054841616 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde80007070 con 0x7fde900704c0 2023-12-18T10:23:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.454+0000 7fde777fe640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde7c065a60 0x7fde7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.454+0000 7fde777fe640 1 -- 172.21.15.133:0/4054841616 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde800832f0 con 0x7fde900704c0 2023-12-18T10:23:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.454+0000 7fde8e7fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde7c065a60 0x7fde7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.454+0000 7fde8e7fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde7c065a60 0x7fde7c067f20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fde900c53a0 tx=0x7fde84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:17.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.458+0000 7fde777fe640 1 -- 172.21.15.133:0/4054841616 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fde80050ad0 con 0x7fde900704c0 2023-12-18T10:23:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.638+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fde9004e000 con 0x7fde900704c0 2023-12-18T10:23:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.638+0000 7fde777fe640 1 -- 172.21.15.133:0/4054841616 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde80017070 con 0x7fde900704c0 2023-12-18T10:23:17.643 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde7c065a60 msgr2=0x7fde7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde7c065a60 0x7fde7c067f20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fde900c53a0 tx=0x7fde84009040 comp rx=0 tx=0).stop 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 msgr2=0x7fde900b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde900b1770 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fde8000caa0 tx=0x7fde8000cf60 comp rx=0 tx=0).stop 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 shutdown_connections 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fde7c065a60 0x7fde7c067f20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fde9015a680 0x7fde90157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fde900cac10 0x7fde90159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 --2- 172.21.15.133:0/4054841616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde900704c0 0x7fde900b1770 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 >> 172.21.15.133:0/4054841616 conn(0x7fde9006a3e0 msgr2=0x7fde9006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 shutdown_connections 2023-12-18T10:23:17.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:17.642+0000 7fde952fc640 1 -- 172.21.15.133:0/4054841616 wait complete. 2023-12-18T10:23:17.663 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:23:17.663 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:23:17.663 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:23:17.664 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-18T10:23:17.664 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-18T10:23:17.664 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:23:17.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:23:17.664 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:23:17.664 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:23:17.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:17.664 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:23:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:23:17.674 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:23:17.674 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:23:17.674 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:23:17.674 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:23:17.674 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:23:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41838sec preferred_lft 41838sec 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:23:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:23:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:23:17.677 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-18T10:23:17.677 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-18T10:23:17.677 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:23:17.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:17.677 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:23:17.734 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:23:17.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:17.737 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:23:17.790 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:23:17.790 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:23:17.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:17.791 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:23:17.792 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:23:17.792 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:23:17.792 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:23:17.792 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:23:17.792 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:23:17.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:17.882 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:23:17.891 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-18T10:23:17.891 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-18T10:23:17.891 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:23:17.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:17.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-18T10:23:17.953 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-18T10:23:17.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:23:17.953 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-18T10:23:18.004 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:23:18.004 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:23:18.004 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:23:18.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:23:18.118 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:23:18.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:23:18.178 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:23:18.181 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:23:18.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:18.181 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:23:18.232 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:23:18.232 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-18T10:23:18.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:23:18.302 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:23:18.302 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:23:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:23:18.365 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:23:18.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:18.365 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:23:18.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:2023-12-18T10:23:18.370+0000 7f29c582b580 -1 init, newargv = 0x5601ae498f60 newargc=15 2023-12-18T10:23:18.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[56524]: starting ceph client 2023-12-18T10:23:18.382 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[56524]: starting fuse 2023-12-18T10:23:18.383 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:23:18.384 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:23:18.384 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.0")) 2023-12-18T10:23:18.385 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:23:18.503 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.0.56524.asok 2023-12-18T10:23:18.688 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.56524.asok 2023-12-18T10:23:18.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:18.688 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.56524.asok status 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "0", 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "56524", 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:18.856 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7722, 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 7722 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2148044150 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:18.857 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2148044150 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.7722 192.168.0.1:0/2148044150", 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/2148044150", 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 68, 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 79, 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:23:18.858 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:18.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:18.871 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:23:18.871 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-18T10:23:18.881 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:23:18.881 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-18T10:23:18.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:18.881 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:23:18.945 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-18T10:23:19.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda7257b640 1 Processor -- start 2023-12-18T10:23:19.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda7257b640 1 -- start start 2023-12-18T10:23:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda7257b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda6c0ca410 0x7fda6c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda7257b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:19.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda7257b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c0cc930 con 0x7fda6c159fb0 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda7257b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c15aab0 con 0x7fda6c0ca410 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda7257b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c070df0 con 0x7fda6c0cbff0 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda6bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda6c0ca410 0x7fda6c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda6bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda6c0ca410 0x7fda6c159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44488/0 (socket says 172.21.15.133:44488) 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda6bfff640 1 -- 172.21.15.133:0/1578817040 learned_addr learned my addr 172.21.15.133:0/1578817040 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda70b18640 1 --2- 172.21.15.133:0/1578817040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda6bfff640 1 -- 172.21.15.133:0/1578817040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 msgr2=0x7fda6c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda6bfff640 1 --2- 172.21.15.133:0/1578817040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda6bfff640 1 -- 172.21.15.133:0/1578817040 >> v1:172.21.15.142:6789/0 conn(0x7fda6c159fb0 legacy=0x7fda6c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda6bfff640 1 -- 172.21.15.133:0/1578817040 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c15a4f0 con 0x7fda6c0ca410 2023-12-18T10:23:19.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.130+0000 7fda70b18640 1 --2- 172.21.15.133:0/1578817040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda6bfff640 1 --2- 172.21.15.133:0/1578817040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c159a70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009870 tx=0x7fda5c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f046de81b87db4e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda6affd640 1 -- 172.21.15.133:0/1578817040 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0aa670 con 0x7fda6c0ca410 2023-12-18T10:23:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda6affd640 1 -- 172.21.15.133:0/1578817040 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c0aa7d0 con 0x7fda6c0ca410 2023-12-18T10:23:19.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda6affd640 1 -- 172.21.15.133:0/1578817040 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0aab60 con 0x7fda6c0ca410 2023-12-18T10:23:19.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 -- 172.21.15.133:0/1578817040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 msgr2=0x7fda6c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:19.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 --2- 172.21.15.133:0/1578817040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c159a70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009870 tx=0x7fda5c01c510 comp rx=0 tx=0).stop 2023-12-18T10:23:19.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 -- 172.21.15.133:0/1578817040 shutdown_connections 2023-12-18T10:23:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 --2- 172.21.15.133:0/1578817040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 --2- 172.21.15.133:0/1578817040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c159a70 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 -- 172.21.15.133:0/1578817040 >> 172.21.15.133:0/1578817040 conn(0x7fda6c06a2a0 msgr2=0x7fda6c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 -- 172.21.15.133:0/1578817040 shutdown_connections 2023-12-18T10:23:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 -- 172.21.15.133:0/1578817040 wait complete. 2023-12-18T10:23:19.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 Processor -- start 2023-12-18T10:23:19.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.134+0000 7fda7257b640 1 -- start start 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c159fb0 0x7fda6c14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c14f410 con 0x7fda6c0ca410 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c14f830 con 0x7fda6c159fb0 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c14e4e0 con 0x7fda6c0cbff0 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c148a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44492/0 (socket says 172.21.15.133:44492) 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 -- 172.21.15.133:0/3522206989 learned_addr learned my addr 172.21.15.133:0/3522206989 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda70b18640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c159fb0 0x7fda6c14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:19.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6b7fe640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:19.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 -- 172.21.15.133:0/3522206989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 msgr2=0x7fda6c14da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:19.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c14da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:19.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 -- 172.21.15.133:0/3522206989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c159fb0 msgr2=0x7fda6c14dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:19.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c159fb0 0x7fda6c14dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:19.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 -- 172.21.15.133:0/3522206989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c0094d0 con 0x7fda6c0ca410 2023-12-18T10:23:19.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda6bfff640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c148a70 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fda5c01abc0 tx=0x7fda5c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:19.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda68ff9640 1 -- 172.21.15.133:0/3522206989 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0b3800 con 0x7fda6c0ca410 2023-12-18T10:23:19.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda68ff9640 1 -- 172.21.15.133:0/3522206989 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c0b3980 con 0x7fda6c0ca410 2023-12-18T10:23:19.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c14e790 con 0x7fda6c0ca410 2023-12-18T10:23:19.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda68ff9640 1 -- 172.21.15.133:0/3522206989 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0b3d30 con 0x7fda6c0ca410 2023-12-18T10:23:19.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c14ed50 con 0x7fda6c0ca410 2023-12-18T10:23:19.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.138+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c14f550 con 0x7fda6c0ca410 2023-12-18T10:23:19.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.142+0000 7fda68ff9640 1 -- 172.21.15.133:0/3522206989 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fda5c0c7420 con 0x7fda6c0ca410 2023-12-18T10:23:19.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.142+0000 7fda68ff9640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda58065a60 0x7fda58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:19.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.142+0000 7fda68ff9640 1 -- 172.21.15.133:0/3522206989 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fda5c11ddb0 con 0x7fda6c0ca410 2023-12-18T10:23:19.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.142+0000 7fda6b7fe640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda58065a60 0x7fda58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:19.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.142+0000 7fda6b7fe640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda58065a60 0x7fda58067f20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fda6c150d60 tx=0x7fda60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:19.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.146+0000 7fda68ff9640 1 -- 172.21.15.133:0/3522206989 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fda5c0eb750 con 0x7fda6c0ca410 2023-12-18T10:23:19.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:19.326+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fda6c14f550 con 0x7fda6c0ca410 2023-12-18T10:23:20.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.002+0000 7fda68ff9640 1 -- 172.21.15.133:0/3522206989 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v69) v1 ==== 105+0+0 (secure 0 0 0) 0x7fda6c14f550 con 0x7fda6c0ca410 2023-12-18T10:23:20.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda58065a60 msgr2=0x7fda58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda58065a60 0x7fda58067f20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fda6c150d60 tx=0x7fda60009040 comp rx=0 tx=0).stop 2023-12-18T10:23:20.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 msgr2=0x7fda6c148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c148a70 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fda5c01abc0 tx=0x7fda5c01ad50 comp rx=0 tx=0).stop 2023-12-18T10:23:20.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 shutdown_connections 2023-12-18T10:23:20.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda58065a60 0x7fda58067f20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda6c159fb0 0x7fda6c14dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fda6c0cbff0 0x7fda6c14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 --2- 172.21.15.133:0/3522206989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda6c0ca410 0x7fda6c148a70 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 >> 172.21.15.133:0/3522206989 conn(0x7fda6c06a2a0 msgr2=0x7fda6c0ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:20.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 shutdown_connections 2023-12-18T10:23:20.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.006+0000 7fda7257b640 1 -- 172.21.15.133:0/3522206989 wait complete. 2023-12-18T10:23:20.035 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.170+0000 7fbc4f7bc640 1 Processor -- start 2023-12-18T10:23:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.170+0000 7fbc4f7bc640 1 -- start start 2023-12-18T10:23:20.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.170+0000 7fbc4f7bc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc480704c0 0x7fbc4815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:20.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.170+0000 7fbc4f7bc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4815f100 con 0x7fbc4815a680 2023-12-18T10:23:20.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.170+0000 7fbc4f7bc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc480ca7d0 con 0x7fbc480cac10 2023-12-18T10:23:20.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.170+0000 7fbc4f7bc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4815e860 con 0x7fbc480704c0 2023-12-18T10:23:20.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc4dd59640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc480704c0 0x7fbc4815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:20.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc4d558640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbc4815a680 0x7fbc4815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57076/0 (socket says 172.21.15.133:57076) 2023-12-18T10:23:20.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc4d558640 1 -- 172.21.15.133:0/477313244 learned_addr learned my addr 172.21.15.133:0/477313244 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:20.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc4dd59640 1 -- 172.21.15.133:0/477313244 >> v1:172.21.15.142:6789/0 conn(0x7fbc480cac10 legacy=0x7fbc4806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc4dd59640 1 -- 172.21.15.133:0/477313244 >> v1:172.21.15.133:6789/0 conn(0x7fbc4815a680 legacy=0x7fbc4815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc3ffff640 1 -- 172.21.15.133:0/477313244 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759837868 0 0) 0x7fbc4815f100 con 0x7fbc4815a680 2023-12-18T10:23:20.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc4dd59640 1 -- 172.21.15.133:0/477313244 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4815eb40 con 0x7fbc480704c0 2023-12-18T10:23:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc4dd59640 1 --2- 172.21.15.133:0/477313244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc4815e160 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009d90 tx=0x7fbc4001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1587672d02f031be server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc3ffff640 1 -- 172.21.15.133:0/477313244 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400a5980 con 0x7fbc480704c0 2023-12-18T10:23:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc3ffff640 1 -- 172.21.15.133:0/477313244 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400a5ae0 con 0x7fbc480704c0 2023-12-18T10:23:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.174+0000 7fbc3ffff640 1 -- 172.21.15.133:0/477313244 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400a5e70 con 0x7fbc480704c0 2023-12-18T10:23:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/477313244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 msgr2=0x7fbc4815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 --2- 172.21.15.133:0/477313244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc4815e160 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009d90 tx=0x7fbc4001c8c0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/477313244 shutdown_connections 2023-12-18T10:23:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 --2- 172.21.15.133:0/477313244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc4815e160 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/477313244 >> 172.21.15.133:0/477313244 conn(0x7fbc4806a3e0 msgr2=0x7fbc480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/477313244 shutdown_connections 2023-12-18T10:23:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/477313244 wait complete. 2023-12-18T10:23:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 Processor -- start 2023-12-18T10:23:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- start start 2023-12-18T10:23:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc48154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc480cac10 0x7fbc480b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4815a680 0x7fbc480cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4814e0c0 con 0x7fbc480704c0 2023-12-18T10:23:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480cce80 con 0x7fbc4815a680 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4f7bc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480cd0b0 con 0x7fbc480cac10 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4d558640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc48154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4d558640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc48154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59368/0 (socket says 172.21.15.133:59368) 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4d558640 1 -- 172.21.15.133:0/4218781652 learned_addr learned my addr 172.21.15.133:0/4218781652 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4cd57640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc480cac10 0x7fbc480b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4dd59640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4815a680 0x7fbc480cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4d558640 1 -- 172.21.15.133:0/4218781652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc480cac10 msgr2=0x7fbc480b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4d558640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc480cac10 0x7fbc480b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4d558640 1 -- 172.21.15.133:0/4218781652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4815a680 msgr2=0x7fbc480cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4d558640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4815a680 0x7fbc480cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.178+0000 7fbc4d558640 1 -- 172.21.15.133:0/4218781652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40009a70 con 0x7fbc480704c0 2023-12-18T10:23:20.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc4d558640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc48154f30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400c4d0 tx=0x7fbc4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:20.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc3dffb640 1 -- 172.21.15.133:0/4218781652 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc440074e0 con 0x7fbc480704c0 2023-12-18T10:23:20.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc3dffb640 1 -- 172.21.15.133:0/4218781652 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc44007640 con 0x7fbc480704c0 2023-12-18T10:23:20.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc3dffb640 1 -- 172.21.15.133:0/4218781652 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44004a30 con 0x7fbc480704c0 2023-12-18T10:23:20.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc480cd390 con 0x7fbc480704c0 2023-12-18T10:23:20.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc480cd950 con 0x7fbc480704c0 2023-12-18T10:23:20.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc480735b0 con 0x7fbc480704c0 2023-12-18T10:23:20.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc3dffb640 1 -- 172.21.15.133:0/4218781652 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc44004b90 con 0x7fbc480704c0 2023-12-18T10:23:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc3dffb640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc2c065a60 0x7fbc2c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc3dffb640 1 -- 172.21.15.133:0/4218781652 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbc44082400 con 0x7fbc480704c0 2023-12-18T10:23:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.182+0000 7fbc4cd57640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc2c065a60 0x7fbc2c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.186+0000 7fbc4cd57640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc2c065a60 0x7fbc2c067f20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbc480afba0 tx=0x7fbc38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:20.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.186+0000 7fbc3dffb640 1 -- 172.21.15.133:0/4218781652 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbc4404fc90 con 0x7fbc480704c0 2023-12-18T10:23:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.370+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc480adb70 con 0x7fbc480704c0 2023-12-18T10:23:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.370+0000 7fbc3dffb640 1 -- 172.21.15.133:0/4218781652 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fbc440532b0 con 0x7fbc480704c0 2023-12-18T10:23:20.375 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:20.375 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":69,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7096,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:20.003608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":7557,"mds_1":7099},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7099":{"gid":7099,"name":"a","rank":1,"incarnation":69,"state":"up:creating","state_seq":1,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:20.376 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 69 2023-12-18T10:23:20.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc2c065a60 msgr2=0x7fbc2c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc2c065a60 0x7fbc2c067f20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbc480afba0 tx=0x7fbc38009040 comp rx=0 tx=0).stop 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 msgr2=0x7fbc48154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc48154f30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400c4d0 tx=0x7fbc4400c990 comp rx=0 tx=0).stop 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 shutdown_connections 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc2c065a60 0x7fbc2c067f20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc4815a680 0x7fbc480cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc480cac10 0x7fbc480b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 --2- 172.21.15.133:0/4218781652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc480704c0 0x7fbc48154f30 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 >> 172.21.15.133:0/4218781652 conn(0x7fbc4806a3e0 msgr2=0x7fbc4815d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 shutdown_connections 2023-12-18T10:23:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:20.374+0000 7fbc4f7bc640 1 -- 172.21.15.133:0/4218781652 wait complete. 2023-12-18T10:23:20.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:23:11.467812+0000', 'modified': '2023-12-18T10:23:20.003608+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 7557, 'mds_1': 7099}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7099': {'gid': 7099, 'name': 'a', 'rank': 1, 'incarnation': 69, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.133:6836/1132580582', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1132580582}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 1132580582}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7557': {'gid': 7557, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/522841432', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 522841432}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 522841432}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:23:20.799 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7099:up:creating 2023-12-18T10:23:21.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.942+0000 7ff96a8f9640 1 Processor -- start 2023-12-18T10:23:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.942+0000 7ff96a8f9640 1 -- start start 2023-12-18T10:23:21.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.942+0000 7ff96a8f9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9641570c0 0x7ff96406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:21.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.942+0000 7ff96a8f9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9640ca000 0x7ff964070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:21.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.942+0000 7ff96a8f9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9640c9460 con 0x7ff96406c320 2023-12-18T10:23:21.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.942+0000 7ff96a8f9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96406c7a0 con 0x7ff9641570c0 2023-12-18T10:23:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.942+0000 7ff96a8f9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9641574a0 con 0x7ff9640ca000 2023-12-18T10:23:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff963fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9641570c0 0x7ff96406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff963fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9641570c0 0x7ff96406bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59370/0 (socket says 172.21.15.133:59370) 2023-12-18T10:23:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff963fff640 1 -- 172.21.15.133:0/421645501 learned_addr learned my addr 172.21.15.133:0/421645501 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff968e96640 1 --2- 172.21.15.133:0/421645501 >> v2:172.21.15.142:3300/0 conn(0x7ff9640ca000 0x7ff964070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff963fff640 1 -- 172.21.15.133:0/421645501 >> v2:172.21.15.142:3300/0 conn(0x7ff9640ca000 msgr2=0x7ff964070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff963fff640 1 --2- 172.21.15.133:0/421645501 >> v2:172.21.15.142:3300/0 conn(0x7ff9640ca000 0x7ff964070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff963fff640 1 -- 172.21.15.133:0/421645501 >> v1:172.21.15.142:6789/0 conn(0x7ff96406c320 legacy=0x7ff9640c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff963fff640 1 -- 172.21.15.133:0/421645501 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9640c8b30 con 0x7ff9641570c0 2023-12-18T10:23:21.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff963fff640 1 --2- 172.21.15.133:0/421645501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9641570c0 0x7ff96406bde0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff96406cf60 tx=0x7ff95401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d6dfb37a97e89a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:21.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff962ffd640 1 -- 172.21.15.133:0/421645501 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540ab640 con 0x7ff9641570c0 2023-12-18T10:23:21.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff962ffd640 1 -- 172.21.15.133:0/421645501 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9540a7070 con 0x7ff9641570c0 2023-12-18T10:23:21.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.946+0000 7ff962ffd640 1 -- 172.21.15.133:0/421645501 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540ab9c0 con 0x7ff9641570c0 2023-12-18T10:23:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- 172.21.15.133:0/421645501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9641570c0 msgr2=0x7ff96406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/421645501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9641570c0 0x7ff96406bde0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7ff96406cf60 tx=0x7ff95401c440 comp rx=0 tx=0).stop 2023-12-18T10:23:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- 172.21.15.133:0/421645501 shutdown_connections 2023-12-18T10:23:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/421645501 >> v2:172.21.15.142:3300/0 conn(0x7ff9640ca000 0x7ff964070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/421645501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9641570c0 0x7ff96406bde0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- 172.21.15.133:0/421645501 >> 172.21.15.133:0/421645501 conn(0x7ff96406a3e0 msgr2=0x7ff9640afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- 172.21.15.133:0/421645501 shutdown_connections 2023-12-18T10:23:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- 172.21.15.133:0/421645501 wait complete. 2023-12-18T10:23:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 Processor -- start 2023-12-18T10:23:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- start start 2023-12-18T10:23:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96406c320 0x7ff96414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9640ca000 0x7ff9640aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9641570c0 0x7ff9640af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff964158520 con 0x7ff9640ca000 2023-12-18T10:23:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9641553b0 con 0x7ff96406c320 2023-12-18T10:23:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff96a8f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9641575e0 con 0x7ff9641570c0 2023-12-18T10:23:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff9637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9640ca000 0x7ff9640aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff9637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9640ca000 0x7ff9640aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59374/0 (socket says 172.21.15.133:59374) 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff9637fe640 1 -- 172.21.15.133:0/1596721690 learned_addr learned my addr 172.21.15.133:0/1596721690 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff963fff640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96406c320 0x7ff96414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.950+0000 7ff968e96640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9641570c0 0x7ff9640af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff9637fe640 1 -- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9641570c0 msgr2=0x7ff9640af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff9637fe640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9641570c0 0x7ff9640af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff9637fe640 1 -- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96406c320 msgr2=0x7ff96414e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff9637fe640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96406c320 0x7ff96414e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff9637fe640 1 -- 172.21.15.133:0/1596721690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540094d0 con 0x7ff9640ca000 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff968e96640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9641570c0 0x7ff9640af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff9637fe640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9640ca000 0x7ff9640aeb40 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c3c0 tx=0x7ff95800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff960ff9640 1 -- 172.21.15.133:0/1596721690 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580052d0 con 0x7ff9640ca000 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff960ff9640 1 -- 172.21.15.133:0/1596721690 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff958005430 con 0x7ff9640ca000 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9641578a0 con 0x7ff9640ca000 2023-12-18T10:23:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff960ff9640 1 -- 172.21.15.133:0/1596721690 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958003840 con 0x7ff9640ca000 2023-12-18T10:23:21.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff964157e60 con 0x7ff9640ca000 2023-12-18T10:23:21.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9640735b0 con 0x7ff9640ca000 2023-12-18T10:23:21.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff960ff9640 1 -- 172.21.15.133:0/1596721690 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9580039a0 con 0x7ff9640ca000 2023-12-18T10:23:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff960ff9640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff950065a60 0x7ff950067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff960ff9640 1 -- 172.21.15.133:0/1596721690 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff958082810 con 0x7ff9640ca000 2023-12-18T10:23:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.954+0000 7ff963fff640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff950065a60 0x7ff950067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.958+0000 7ff963fff640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff950065a60 0x7ff950067f20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff9540af000 tx=0x7ff9540b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:21.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:21.958+0000 7ff960ff9640 1 -- 172.21.15.133:0/1596721690 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff9580500a0 con 0x7ff9640ca000 2023-12-18T10:23:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff96404e000 con 0x7ff9640ca000 2023-12-18T10:23:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff960ff9640 1 -- 172.21.15.133:0/1596721690 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4748 (secure 0 0 0) 0x7ff9580536c0 con 0x7ff9640ca000 2023-12-18T10:23:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:22.149 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:22.018893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7557,"mds_1":7099,"mds_2":7096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7096":{"gid":7096,"name":"d","rank":2,"incarnation":71,"state":"up:active","state_seq":5,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7099":{"gid":7099,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 72 2023-12-18T10:23:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff950065a60 msgr2=0x7ff950067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff950065a60 0x7ff950067f20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff9540af000 tx=0x7ff9540b6040 comp rx=0 tx=0).stop 2023-12-18T10:23:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9640ca000 msgr2=0x7ff9640aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9640ca000 0x7ff9640aeb40 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff95800c3c0 tx=0x7ff95800c880 comp rx=0 tx=0).stop 2023-12-18T10:23:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 shutdown_connections 2023-12-18T10:23:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff950065a60 0x7ff950067f20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9641570c0 0x7ff9640af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9640ca000 0x7ff9640aeb40 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 --2- 172.21.15.133:0/1596721690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff96406c320 0x7ff96414e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 >> 172.21.15.133:0/1596721690 conn(0x7ff96406a3e0 msgr2=0x7ff9640ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 shutdown_connections 2023-12-18T10:23:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.146+0000 7ff96a8f9640 1 -- 172.21.15.133:0/1596721690 wait complete. 2023-12-18T10:23:22.572 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:23:11.467812+0000', 'modified': '2023-12-18T10:23:22.018893+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 7557, 'mds_1': 7099, 'mds_2': 7096}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7096': {'gid': 7096, 'name': 'd', 'rank': 2, 'incarnation': 71, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.142:6834/1237569557', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6832', 'nonce': 1237569557}, {'type': 'v1', 'addr': '172.21.15.142:6834', 'nonce': 1237569557}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7099': {'gid': 7099, 'name': 'a', 'rank': 1, 'incarnation': 69, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6836/1132580582', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1132580582}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 1132580582}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7557': {'gid': 7557, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/522841432', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 522841432}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 522841432}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:23:22.572 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-18T10:23:22.573 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-18T10:23:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ecd1640 1 Processor -- start 2023-12-18T10:23:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ecd1640 1 -- start start 2023-12-18T10:23:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ecd1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8481570c0 0x7fd84806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ecd1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84806c320 0x7fd8480c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ecd1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8480c9460 con 0x7fd8480c9e30 2023-12-18T10:23:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ecd1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84806c7a0 con 0x7fd8481570c0 2023-12-18T10:23:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ecd1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481574a0 con 0x7fd84806c320 2023-12-18T10:23:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ca6d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8481570c0 0x7fd84806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ca6d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8481570c0 0x7fd84806bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59386/0 (socket says 172.21.15.133:59386) 2023-12-18T10:23:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.706+0000 7fd84ca6d640 1 -- 172.21.15.133:0/3108352792 learned_addr learned my addr 172.21.15.133:0/3108352792 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd83ffff640 1 --2- 172.21.15.133:0/3108352792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84806c320 0x7fd8480c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ca6d640 1 -- 172.21.15.133:0/3108352792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84806c320 msgr2=0x7fd8480c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/3108352792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84806c320 0x7fd8480c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ca6d640 1 -- 172.21.15.133:0/3108352792 >> v1:172.21.15.142:6789/0 conn(0x7fd8480c9e30 legacy=0x7fd84815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ca6d640 1 -- 172.21.15.133:0/3108352792 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480c8b30 con 0x7fd8481570c0 2023-12-18T10:23:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd83ffff640 1 --2- 172.21.15.133:0/3108352792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84806c320 0x7fd8480c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/3108352792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8481570c0 0x7fd84806bde0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fd844009870 tx=0x7fd84401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcec0a43e57e92a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd83f7fe640 1 -- 172.21.15.133:0/3108352792 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440aa620 con 0x7fd8481570c0 2023-12-18T10:23:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd83f7fe640 1 -- 172.21.15.133:0/3108352792 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8440aa780 con 0x7fd8481570c0 2023-12-18T10:23:22.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd83f7fe640 1 -- 172.21.15.133:0/3108352792 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440aab10 con 0x7fd8481570c0 2023-12-18T10:23:22.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ecd1640 1 -- 172.21.15.133:0/3108352792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8481570c0 msgr2=0x7fd84806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/3108352792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8481570c0 0x7fd84806bde0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fd844009870 tx=0x7fd84401c500 comp rx=0 tx=0).stop 2023-12-18T10:23:22.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ecd1640 1 -- 172.21.15.133:0/3108352792 shutdown_connections 2023-12-18T10:23:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/3108352792 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd84806c320 0x7fd8480c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/3108352792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8481570c0 0x7fd84806bde0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ecd1640 1 -- 172.21.15.133:0/3108352792 >> 172.21.15.133:0/3108352792 conn(0x7fd84806a3e0 msgr2=0x7fd8480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.710+0000 7fd84ecd1640 1 -- 172.21.15.133:0/3108352792 shutdown_connections 2023-12-18T10:23:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 -- 172.21.15.133:0/3108352792 wait complete. 2023-12-18T10:23:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 Processor -- start 2023-12-18T10:23:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 -- start start 2023-12-18T10:23:22.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84806c320 0x7fd848166df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8480c9e30 0x7fd84814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8481570c0 0x7fd84814e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848150360 con 0x7fd8480c9e30 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848165680 con 0x7fd84806c320 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ecd1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84814eda0 con 0x7fd8481570c0 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8480c9e30 0x7fd84814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8480c9e30 0x7fd84814f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59390/0 (socket says 172.21.15.133:59390) 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 -- 172.21.15.133:0/1729381362 learned_addr learned my addr 172.21.15.133:0/1729381362 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84806c320 0x7fd848166df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84d26e640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8481570c0 0x7fd84814e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 -- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8481570c0 msgr2=0x7fd84814e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8481570c0 0x7fd84814e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 -- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84806c320 msgr2=0x7fd848166df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84806c320 0x7fd848166df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 -- 172.21.15.133:0/1729381362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440094d0 con 0x7fd8480c9e30 2023-12-18T10:23:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd84d26e640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8481570c0 0x7fd84814e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.714+0000 7fd83ffff640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8480c9e30 0x7fd84814f9a0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c850 tx=0x7fd83800cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd83d7fa640 1 -- 172.21.15.133:0/1729381362 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838007830 con 0x7fd8480c9e30 2023-12-18T10:23:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd83d7fa640 1 -- 172.21.15.133:0/1729381362 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838007990 con 0x7fd8480c9e30 2023-12-18T10:23:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd83d7fa640 1 -- 172.21.15.133:0/1729381362 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838007d60 con 0x7fd8480c9e30 2023-12-18T10:23:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd84ecd1640 1 -- 172.21.15.133:0/1729381362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd848150080 con 0x7fd8480c9e30 2023-12-18T10:23:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd84ecd1640 1 -- 172.21.15.133:0/1729381362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8481652a0 con 0x7fd8480c9e30 2023-12-18T10:23:22.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd83d7fa640 1 -- 172.21.15.133:0/1729381362 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd8380113f0 con 0x7fd8480c9e30 2023-12-18T10:23:22.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd83d7fa640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd834065a90 0x7fd834067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd83d7fa640 1 -- 172.21.15.133:0/1729381362 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd8380833f0 con 0x7fd8480c9e30 2023-12-18T10:23:22.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd834065a90 0x7fd834067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd852032000 1 Processor -- start 2023-12-18T10:23:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.718+0000 7fd852032000 1 -- start start 2023-12-18T10:23:22.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd834065a90 0x7fd834067f50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd8440ae000 tx=0x7fd8440a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a22bf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a2274c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22755a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624a2098c90 con 0x5624a22bf070 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624a20ca220 con 0x5624a22751c0 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624a20c77f0 con 0x5624a22bf990 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a22bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a22bf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59406/0 (socket says 172.21.15.133:59406) 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 -- 172.21.15.133:0/3201352667 learned_addr learned my addr 172.21.15.133:0/3201352667 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84d26e640 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22755a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd83ffff640 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a2274c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 -- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 msgr2=0x5624a2274c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a2274c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 -- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 msgr2=0x5624a22755a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22755a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 -- 172.21.15.133:0/3201352667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624a1dbf890 con 0x5624a22bf070 2023-12-18T10:23:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84d26e640 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22755a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:22.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a22bf450 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd844009870 tx=0x7fd844004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0371872817360b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd82e7fc640 1 -- 172.21.15.133:0/3201352667 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440b3730 con 0x5624a22bf070 2023-12-18T10:23:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd82e7fc640 1 -- 172.21.15.133:0/3201352667 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8440c3070 con 0x5624a22bf070 2023-12-18T10:23:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd82e7fc640 1 -- 172.21.15.133:0/3201352667 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440b3a90 con 0x5624a22bf070 2023-12-18T10:23:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- 172.21.15.133:0/3201352667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 msgr2=0x5624a22bf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a22bf450 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd844009870 tx=0x7fd844004740 comp rx=0 tx=0).stop 2023-12-18T10:23:22.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- 172.21.15.133:0/3201352667 shutdown_connections 2023-12-18T10:23:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22755a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a2274c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 --2- 172.21.15.133:0/3201352667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a22bf450 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- 172.21.15.133:0/3201352667 >> 172.21.15.133:0/3201352667 conn(0x5624a227b950 msgr2=0x5624a2273560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- 172.21.15.133:0/3201352667 shutdown_connections 2023-12-18T10:23:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- 172.21.15.133:0/3201352667 wait complete. 2023-12-18T10:23:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 -- start start 2023-12-18T10:23:22.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.722+0000 7fd852032000 1 Processor -- start 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22751c0 0x5624a227a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf070 0x5624a2281080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a22815c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624a20c30e0 con 0x5624a22751c0 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624a2062310 con 0x5624a22bf070 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624a2080770 con 0x5624a22bf990 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 10 client.0 _ll_register_callbacks cb 0x5624a2260b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22751c0 0x5624a227a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22751c0 0x5624a227a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59422/0 (socket says 172.21.15.133:59422) 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 -- 172.21.15.133:0/2880205189 learned_addr learned my addr 172.21.15.133:0/2880205189 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84d26e640 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a22815c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd83ffff640 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf070 0x5624a2281080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 -- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 msgr2=0x5624a22815c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a22815c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 -- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf070 msgr2=0x5624a2281080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf070 0x5624a2281080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 -- 172.21.15.133:0/2880205189 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8440b9070 con 0x5624a22751c0 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22751c0 0x5624a227a710 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fd84401c9e0 tx=0x7fd84401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c95cea3ec199dc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd8277fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd8277fe640 1 -- 172.21.15.133:0/2880205189 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440b3770 con 0x5624a22751c0 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd8277fe640 1 -- 172.21.15.133:0/2880205189 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd8440d2c10 con 0x5624a22751c0 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 -- 172.21.15.133:0/2880205189 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624a2092c10 con 0x5624a22751c0 2023-12-18T10:23:22.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd8277fe640 1 -- 172.21.15.133:0/2880205189 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8440d2dd0 con 0x5624a22751c0 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 10 client.7755 fetch_fsmap learned FSMap version 72 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 -- 172.21.15.133:0/2880205189 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5624a2088260 con 0x5624a22751c0 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd8277fe640 1 -- 172.21.15.133:0/2880205189 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624a2092c10 con 0x5624a22751c0 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd8277fe640 1 -- 172.21.15.133:0/2880205189 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 72) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fd8440b38d0 con 0x5624a22751c0 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 10 client.7755 fetch_fsmap finished waiting for FSMap version 72 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 10 client.7755 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 20 client.7755 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x5624a22c68d0 0x5624a22c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 4 client.7755 mds_command: new command op to 7096 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd852032000 1 -- 172.21.15.133:0/2880205189 --> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624a20c1a30 con 0x5624a22c68d0 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd83ffff640 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x5624a22c68d0 0x5624a22c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd8277fe640 10 client.7755 ms_handle_connect on v2:172.21.15.142:6832/1237569557 2023-12-18T10:23:22.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.726+0000 7fd83ffff640 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x5624a22c68d0 0x5624a22c6cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9bd3c4cee8ef3c38 server_cookie=58cc3d6fae7b740f in_seq=0 out_seq=0 2023-12-18T10:23:22.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd8277fe640 1 -- 172.21.15.133:0/2880205189 <== mds.2 v2:172.21.15.142:6832/1237569557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5624a20c1a30 con 0x5624a22c68d0 2023-12-18T10:23:22.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd8277fe640 10 client.7755 handle_command_reply: tid=0 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 client.7755 shutdown 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 -- 172.21.15.133:0/2880205189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22751c0 msgr2=0x5624a227a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22751c0 0x5624a227a710 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fd84401c9e0 tx=0x7fd84401ad40 comp rx=0 tx=0).stop 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 -- 172.21.15.133:0/2880205189 shutdown_connections 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x5624a22c68d0 0x5624a22c6cb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a22815c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf070 0x5624a2281080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd8277fe640 0 client.7755 ms_handle_reset on v2:172.21.15.142:6832/1237569557 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 --2- 172.21.15.133:0/2880205189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22751c0 0x5624a227a710 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 -- 172.21.15.133:0/2880205189 >> 172.21.15.133:0/2880205189 conn(0x5624a227b950 msgr2=0x5624a2273c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 -- 172.21.15.133:0/2880205189 shutdown_connections 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 1 -- 172.21.15.133:0/2880205189 wait complete. 2023-12-18T10:23:22.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.730+0000 7fd852032000 20 client.7755 trim_cache size 0 max 16384 2023-12-18T10:23:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.742+0000 7fd852032000 1 Processor -- start 2023-12-18T10:23:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- start start 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22751c0 0x5624a2316ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2317410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf990 0x5624a2317950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624a1d80940 con 0x5624a22bf070 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624a20c08f0 con 0x5624a22bf990 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624a226c9d0 con 0x5624a22751c0 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2317410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2317410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59428/0 (socket says 172.21.15.133:59428) 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 -- 172.21.15.133:0/3195609735 learned_addr learned my addr 172.21.15.133:0/3195609735 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd84d26e640 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf990 0x5624a2317950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22751c0 0x5624a2316ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 -- 172.21.15.133:0/3195609735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22751c0 msgr2=0x5624a2316ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22751c0 0x5624a2316ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 -- 172.21.15.133:0/3195609735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf990 msgr2=0x5624a2317950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf990 0x5624a2317950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 -- 172.21.15.133:0/3195609735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624a206e3b0 con 0x5624a22bf070 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd83ffff640 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2317410 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c820 tx=0x7fd838083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81ab0c0a02d48f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd82effd640 1 -- 172.21.15.133:0/3195609735 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83807f070 con 0x5624a22bf070 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd82effd640 1 -- 172.21.15.133:0/3195609735 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838081910 con 0x5624a22bf070 2023-12-18T10:23:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd82effd640 1 -- 172.21.15.133:0/3195609735 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838052c30 con 0x5624a22bf070 2023-12-18T10:23:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- 172.21.15.133:0/3195609735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 msgr2=0x5624a2317410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2317410 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c820 tx=0x7fd838083040 comp rx=0 tx=0).stop 2023-12-18T10:23:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- 172.21.15.133:0/3195609735 shutdown_connections 2023-12-18T10:23:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22bf990 0x5624a2317950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2317410 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 --2- 172.21.15.133:0/3195609735 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22751c0 0x5624a2316ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- 172.21.15.133:0/3195609735 >> 172.21.15.133:0/3195609735 conn(0x5624a227b950 msgr2=0x5624a2280f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- 172.21.15.133:0/3195609735 shutdown_connections 2023-12-18T10:23:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- 172.21.15.133:0/3195609735 wait complete. 2023-12-18T10:23:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 -- start start 2023-12-18T10:23:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.746+0000 7fd852032000 1 Processor -- start 2023-12-18T10:23:22.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2300060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a23005a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624a20c5c40 con 0x5624a22bf070 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624a20bea50 con 0x5624a22751c0 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624a20c04e0 con 0x5624a22bf990 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 10 client.0 _ll_register_callbacks cb 0x5624a2071640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2300060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2300060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59436/0 (socket says 172.21.15.133:59436) 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 -- 172.21.15.133:0/766642827 learned_addr learned my addr 172.21.15.133:0/766642827 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd84d26e640 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a23005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 -- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 msgr2=0x5624a23005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a23005a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 -- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 msgr2=0x5624a22ffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22ffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 -- 172.21.15.133:0/766642827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8481652a0 con 0x5624a22bf070 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd83ffff640 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2300060 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fd838007410 tx=0x7fd8440b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1284f9d8664a56bb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 1 -- 172.21.15.133:0/766642827 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83806e070 con 0x5624a22bf070 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 1 -- 172.21.15.133:0/766642827 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd838080070 con 0x5624a22bf070 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- 172.21.15.133:0/766642827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624a2088e00 con 0x5624a22bf070 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 1 -- 172.21.15.133:0/766642827 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd83807f030 con 0x5624a22bf070 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 10 client.7761 fetch_fsmap learned FSMap version 72 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- 172.21.15.133:0/766642827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5624a1dbfcc0 con 0x5624a22bf070 2023-12-18T10:23:22.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 1 -- 172.21.15.133:0/766642827 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624a2088e00 con 0x5624a22bf070 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 1 -- 172.21.15.133:0/766642827 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 72) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fd838050fa0 con 0x5624a22bf070 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 10 client.7761 fetch_fsmap finished waiting for FSMap version 72 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 10 client.7761 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 20 client.7761 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x5624a2300ae0 0x5624a2300ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 4 client.7761 mds_command: new command op to 7096 tid=0[{"prefix": "status"}] 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- 172.21.15.133:0/766642827 --> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5624a20bc160 con 0x5624a2300ae0 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x5624a2300ae0 0x5624a2300ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 10 client.7761 ms_handle_connect on v2:172.21.15.142:6832/1237569557 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd84ca6d640 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x5624a2300ae0 0x5624a2300ec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf2aa59eb519af3 server_cookie=edff47996d720522 in_seq=0 out_seq=0 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 1 -- 172.21.15.133:0/766642827 <== mds.2 v2:172.21.15.142:6832/1237569557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5624a20bc160 con 0x5624a2300ae0 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 10 client.7761 handle_command_reply: tid=0 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 client.7761 shutdown 2023-12-18T10:23:22.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- 172.21.15.133:0/766642827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 msgr2=0x5624a2300060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2300060 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fd838007410 tx=0x7fd8440b5040 comp rx=0 tx=0).stop 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- 172.21.15.133:0/766642827 shutdown_connections 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x5624a2300ae0 0x5624a2300ec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5624a22bf990 0x5624a23005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5624a22bf070 0x5624a2300060 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd8277fe640 0 client.7761 ms_handle_reset on v2:172.21.15.142:6832/1237569557 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 --2- 172.21.15.133:0/766642827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5624a22751c0 0x5624a22ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- 172.21.15.133:0/766642827 >> 172.21.15.133:0/766642827 conn(0x5624a227b950 msgr2=0x5624a22bc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.750+0000 7fd852032000 1 -- 172.21.15.133:0/766642827 shutdown_connections 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd852032000 1 -- 172.21.15.133:0/766642827 wait complete. 2023-12-18T10:23:22.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd852032000 20 client.7761 trim_cache size 0 max 16384 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 2, 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7096, 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 1.7379095579999999, 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 72, 2023-12-18T10:23:22.761 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 79, 2023-12-18T10:23:22.762 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 79, 2023-12-18T10:23:22.762 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 15.545848762 2023-12-18T10:23:22.762 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:22.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 -- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd834065a90 msgr2=0x7fd834067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd834065a90 0x7fd834067f50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd8440ae000 tx=0x7fd8440a7000 comp rx=0 tx=0).stop 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 -- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8480c9e30 msgr2=0x7fd84814f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8480c9e30 0x7fd84814f9a0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c850 tx=0x7fd83800cd10 comp rx=0 tx=0).stop 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 -- 172.21.15.133:0/1729381362 shutdown_connections 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd834065a90 0x7fd834067f50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd8481570c0 0x7fd84814e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8480c9e30 0x7fd84814f9a0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 --2- 172.21.15.133:0/1729381362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd84806c320 0x7fd848166df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 -- 172.21.15.133:0/1729381362 >> 172.21.15.133:0/1729381362 conn(0x7fd84806a3e0 msgr2=0x7fd84815b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 -- 172.21.15.133:0/1729381362 shutdown_connections 2023-12-18T10:23:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.754+0000 7fd84ecd1640 1 -- 172.21.15.133:0/1729381362 wait complete. 2023-12-18T10:23:22.776 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-18T10:23:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787418f640 1 Processor -- start 2023-12-18T10:23:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787418f640 1 -- start start 2023-12-18T10:23:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787418f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f786c160cc0 0x7f786c0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787418f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787418f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786c06fdb0 con 0x7f786c0c17d0 2023-12-18T10:23:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787418f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c1654a0 con 0x7f786c160cc0 2023-12-18T10:23:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787418f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c1610a0 con 0x7f786c0c1280 2023-12-18T10:23:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f7871f2b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f786c160cc0 0x7f786c0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787172a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f7871f2b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f786c160cc0 0x7f786c0cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:42200/0 (socket says 172.21.15.133:42200) 2023-12-18T10:23:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787172a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c0cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:52002/0 (socket says 172.21.15.133:52002) 2023-12-18T10:23:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f787272c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f786c0c17d0 0x7f786c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:43154/0 (socket says 172.21.15.133:43154) 2023-12-18T10:23:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.910+0000 7f7871f2b640 1 -- 172.21.15.133:0/4197720474 learned_addr learned my addr 172.21.15.133:0/4197720474 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f7871f2b640 1 -- 172.21.15.133:0/4197720474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 msgr2=0x7f786c0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f7871f2b640 1 --2- 172.21.15.133:0/4197720474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c0cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f7871f2b640 1 -- 172.21.15.133:0/4197720474 >> v1:172.21.15.142:6789/0 conn(0x7f786c0c17d0 legacy=0x7f786c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f7871f2b640 1 -- 172.21.15.133:0/4197720474 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0cb6b0 con 0x7f786c160cc0 2023-12-18T10:23:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f787172a640 1 --2- 172.21.15.133:0/4197720474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:22.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f7871f2b640 1 --2- 172.21.15.133:0/4197720474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c160cc0 0x7f786c0cac30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f78680098a0 tx=0x7f786801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a85164514ddf2c41 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f7870f29640 1 -- 172.21.15.133:0/4197720474 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78680ac600 con 0x7f786c160cc0 2023-12-18T10:23:22.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f7870f29640 1 -- 172.21.15.133:0/4197720474 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78680a8050 con 0x7f786c160cc0 2023-12-18T10:23:22.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f7870f29640 1 -- 172.21.15.133:0/4197720474 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78680ac980 con 0x7f786c160cc0 2023-12-18T10:23:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f787418f640 1 -- 172.21.15.133:0/4197720474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c160cc0 msgr2=0x7f786c0cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.914+0000 7f787418f640 1 --2- 172.21.15.133:0/4197720474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c160cc0 0x7f786c0cac30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f78680098a0 tx=0x7f786801c460 comp rx=0 tx=0).stop 2023-12-18T10:23:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 -- 172.21.15.133:0/4197720474 shutdown_connections 2023-12-18T10:23:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 --2- 172.21.15.133:0/4197720474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 --2- 172.21.15.133:0/4197720474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c160cc0 0x7f786c0cac30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 -- 172.21.15.133:0/4197720474 >> 172.21.15.133:0/4197720474 conn(0x7f786c06a3e0 msgr2=0x7f786c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 -- 172.21.15.133:0/4197720474 shutdown_connections 2023-12-18T10:23:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 -- 172.21.15.133:0/4197720474 wait complete. 2023-12-18T10:23:22.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 Processor -- start 2023-12-18T10:23:22.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 -- start start 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c0c17d0 0x7f786c0b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f786c160cc0 0x7f786c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0b3810 con 0x7f786c160cc0 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c1597a0 con 0x7f786c0c17d0 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787418f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c159980 con 0x7f786c0c1280 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787272c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f786c160cc0 0x7f786c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787172a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c0c17d0 0x7f786c0b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f7871f2b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787272c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f786c160cc0 0x7f786c0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59438/0 (socket says 172.21.15.133:59438) 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787272c640 1 -- 172.21.15.133:0/4240510617 learned_addr learned my addr 172.21.15.133:0/4240510617 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787272c640 1 -- 172.21.15.133:0/4240510617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 msgr2=0x7f786c15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787272c640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c15b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787272c640 1 -- 172.21.15.133:0/4240510617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c0c17d0 msgr2=0x7f786c0b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787272c640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c0c17d0 0x7f786c0b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f787272c640 1 -- 172.21.15.133:0/4240510617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c009420 con 0x7f786c160cc0 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.918+0000 7f7871f2b640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:22.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f787272c640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f786c160cc0 0x7f786c0b3090 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f786400c7a0 tx=0x7f786400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f78627fc640 1 -- 172.21.15.133:0/4240510617 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400a640 con 0x7f786c160cc0 2023-12-18T10:23:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f78627fc640 1 -- 172.21.15.133:0/4240510617 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400a7a0 con 0x7f786c160cc0 2023-12-18T10:23:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f78627fc640 1 -- 172.21.15.133:0/4240510617 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400ab10 con 0x7f786c160cc0 2023-12-18T10:23:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f787418f640 1 -- 172.21.15.133:0/4240510617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78680094d0 con 0x7f786c160cc0 2023-12-18T10:23:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f787418f640 1 -- 172.21.15.133:0/4240510617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c15a220 con 0x7f786c160cc0 2023-12-18T10:23:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f78627fc640 1 -- 172.21.15.133:0/4240510617 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f786400ac70 con 0x7f786c160cc0 2023-12-18T10:23:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f78627fc640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.922+0000 7f78627fc640 1 -- 172.21.15.133:0/4240510617 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7864082b30 con 0x7f786c160cc0 2023-12-18T10:23:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f7871f2b640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 Processor -- start 2023-12-18T10:23:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- start start 2023-12-18T10:23:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f7871f2b640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f78680ae000 tx=0x7f78680a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 0x5616f5db8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5d6dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5d6e1c0 0x5616f5d6e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5b91c90 con 0x5616f5d6e1c0 2023-12-18T10:23:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5bc3220 con 0x5616f5db8070 2023-12-18T10:23:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616f5bc07f0 con 0x5616f5db8990 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5d6e1c0 0x5616f5d6e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5d6e1c0 0x5616f5d6e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59450/0 (socket says 172.21.15.133:59450) 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 -- 172.21.15.133:0/1187187444 learned_addr learned my addr 172.21.15.133:0/1187187444 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f7871f2b640 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 0x5616f5db8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787172a640 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5d6dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 -- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 msgr2=0x5616f5d6dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5d6dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 -- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 msgr2=0x5616f5db8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 0x5616f5db8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 -- 172.21.15.133:0/1187187444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616f58b8890 con 0x5616f5d6e1c0 2023-12-18T10:23:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787172a640 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5d6dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f787272c640 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5d6e1c0 0x5616f5d6e5a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7864054020 tx=0x7f7864053ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46793e506a2ab9e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f784f7fe640 1 -- 172.21.15.133:0/1187187444 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864057e10 con 0x5616f5d6e1c0 2023-12-18T10:23:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f784f7fe640 1 -- 172.21.15.133:0/1187187444 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786405bfc0 con 0x5616f5d6e1c0 2023-12-18T10:23:22.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f784f7fe640 1 -- 172.21.15.133:0/1187187444 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640507a0 con 0x5616f5d6e1c0 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- 172.21.15.133:0/1187187444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5d6e1c0 msgr2=0x5616f5d6e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5d6e1c0 0x5616f5d6e5a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7864054020 tx=0x7f7864053ce0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- 172.21.15.133:0/1187187444 shutdown_connections 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5d6e1c0 0x5616f5d6e5a0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5d6dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 --2- 172.21.15.133:0/1187187444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 0x5616f5db8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- 172.21.15.133:0/1187187444 >> 172.21.15.133:0/1187187444 conn(0x5616f5d74950 msgr2=0x5616f5d6c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- 172.21.15.133:0/1187187444 shutdown_connections 2023-12-18T10:23:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.926+0000 7f78774f1000 1 -- 172.21.15.133:0/1187187444 wait complete. 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 -- start start 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 Processor -- start 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 0x5616f5dbf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 0x5616f5dbfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8990 0x5616f5da6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5bbc0e0 con 0x5616f5db8990 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5b5b310 con 0x5616f5db8070 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616f5b79770 con 0x5616f5d6e1c0 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 10 client.0 _ll_register_callbacks cb 0x5616f5d59b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8990 0x5616f5da6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787172a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 0x5616f5dbfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f7871f2b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 0x5616f5dbf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8990 0x5616f5da6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59466/0 (socket says 172.21.15.133:59466) 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 -- 172.21.15.133:0/3951972744 learned_addr learned my addr 172.21.15.133:0/3951972744 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 -- 172.21.15.133:0/3951972744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 msgr2=0x5616f5dbf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 0x5616f5dbf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 -- 172.21.15.133:0/3951972744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 msgr2=0x5616f5dbfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 0x5616f5dbfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 -- 172.21.15.133:0/3951972744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c15a220 con 0x5616f5db8990 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f787272c640 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8990 0x5616f5da6030 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f786405a090 tx=0x7f7864001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46323ca5ffbbe42 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f784cff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f784cff9640 1 -- 172.21.15.133:0/3951972744 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864057e10 con 0x5616f5db8990 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f784cff9640 1 -- 172.21.15.133:0/3951972744 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7864053580 con 0x5616f5db8990 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 -- 172.21.15.133:0/3951972744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616f5b8bc10 con 0x5616f5db8990 2023-12-18T10:23:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f784cff9640 1 -- 172.21.15.133:0/3951972744 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7864053740 con 0x5616f5db8990 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 10 client.7770 fetch_fsmap learned FSMap version 72 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 -- 172.21.15.133:0/3951972744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5616f5b81260 con 0x5616f5db8990 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f784cff9640 1 -- 172.21.15.133:0/3951972744 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616f5b8bc10 con 0x5616f5db8990 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f784cff9640 1 -- 172.21.15.133:0/3951972744 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 72) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f786405bb30 con 0x5616f5db8990 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 10 client.7770 fetch_fsmap finished waiting for FSMap version 72 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 10 client.7770 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 20 client.7770 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x5616f5da6dd0 0x5616f5da71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 4 client.7770 mds_command: new command op to 7099 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.930+0000 7f78774f1000 1 -- 172.21.15.133:0/3951972744 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616f5bbaa30 con 0x5616f5da6dd0 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f7871f2b640 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x5616f5da6dd0 0x5616f5da71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f7871f2b640 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x5616f5da6dd0 0x5616f5da71b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d123921e2810fdaf server_cookie=60f1bb0cb89922cc in_seq=0 out_seq=0 2023-12-18T10:23:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f784cff9640 10 client.7770 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f784cff9640 1 -- 172.21.15.133:0/3951972744 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5616f5bbaa30 con 0x5616f5da6dd0 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f784cff9640 10 client.7770 handle_command_reply: tid=0 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 client.7770 shutdown 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 -- 172.21.15.133:0/3951972744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8990 msgr2=0x5616f5da6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8990 0x5616f5da6030 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f786405a090 tx=0x7f7864001260 comp rx=0 tx=0).stop 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 -- 172.21.15.133:0/3951972744 shutdown_connections 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x5616f5da6dd0 0x5616f5da71b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8990 0x5616f5da6030 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8070 0x5616f5dbfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 --2- 172.21.15.133:0/3951972744 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 0x5616f5dbf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f784cff9640 0 client.7770 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 -- 172.21.15.133:0/3951972744 >> 172.21.15.133:0/3951972744 conn(0x5616f5d74950 msgr2=0x5616f5d6cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 -- 172.21.15.133:0/3951972744 shutdown_connections 2023-12-18T10:23:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 1 -- 172.21.15.133:0/3951972744 wait complete. 2023-12-18T10:23:22.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.934+0000 7f78774f1000 20 client.7770 trim_cache size 0 max 16384 2023-12-18T10:23:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 Processor -- start 2023-12-18T10:23:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- start start 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5d6e1c0 0x5616f5e102f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e10830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5e10d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5d741b0 con 0x5616f5db8070 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5879940 con 0x5616f5d6e1c0 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616f5c8cb30 con 0x5616f5db8990 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e10830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e10830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59476/0 (socket says 172.21.15.133:59476) 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 -- 172.21.15.133:0/2629488553 learned_addr learned my addr 172.21.15.133:0/2629488553 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f7871f2b640 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5d6e1c0 0x5616f5e102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787272c640 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5e10d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 -- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 msgr2=0x5616f5e10d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5e10d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 -- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5d6e1c0 msgr2=0x5616f5e102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5d6e1c0 0x5616f5e102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 -- 172.21.15.133:0/2629488553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c1fd5f0 con 0x5616f5db8070 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f7871f2b640 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5d6e1c0 0x5616f5e102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787272c640 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5e10d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f787172a640 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e10830 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f785c0044d0 tx=0x7f785c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc51d52a8fc011ea server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f784ffff640 1 -- 172.21.15.133:0/2629488553 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c009e10 con 0x5616f5db8070 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f784ffff640 1 -- 172.21.15.133:0/2629488553 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c003e10 con 0x5616f5db8070 2023-12-18T10:23:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f784ffff640 1 -- 172.21.15.133:0/2629488553 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0206b0 con 0x5616f5db8070 2023-12-18T10:23:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- 172.21.15.133:0/2629488553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 msgr2=0x5616f5e10830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e10830 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f785c0044d0 tx=0x7f785c009190 comp rx=0 tx=0).stop 2023-12-18T10:23:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- 172.21.15.133:0/2629488553 shutdown_connections 2023-12-18T10:23:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5db8990 0x5616f5e10d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e10830 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 --2- 172.21.15.133:0/2629488553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5d6e1c0 0x5616f5e102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- 172.21.15.133:0/2629488553 >> 172.21.15.133:0/2629488553 conn(0x5616f5d74950 msgr2=0x5616f5dc5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- 172.21.15.133:0/2629488553 shutdown_connections 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.950+0000 7f78774f1000 1 -- 172.21.15.133:0/2629488553 wait complete. 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 -- start start 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 Processor -- start 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 0x5616f5e15b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8990 0x5616f5dca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5bb94e0 con 0x5616f5db8070 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616f5bffce0 con 0x5616f5db8990 2023-12-18T10:23:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616f5bbaf70 con 0x5616f5d6e1c0 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 10 client.0 _ll_register_callbacks cb 0x5616f5b6a640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59492/0 (socket says 172.21.15.133:59492) 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 -- 172.21.15.133:0/2165693128 learned_addr learned my addr 172.21.15.133:0/2165693128 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f7871f2b640 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 0x5616f5e15b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787272c640 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8990 0x5616f5dca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 -- 172.21.15.133:0/2165693128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 msgr2=0x5616f5e15b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 0x5616f5e15b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 -- 172.21.15.133:0/2165693128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8990 msgr2=0x5616f5dca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8990 0x5616f5dca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 -- 172.21.15.133:0/2165693128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c0041b0 con 0x5616f5db8070 2023-12-18T10:23:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f787172a640 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e160d0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x5616f5baee30 tx=0x7f785c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed72086bfd74cf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f784cff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f784cff9640 1 -- 172.21.15.133:0/2165693128 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c02b670 con 0x5616f5db8070 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 -- 172.21.15.133:0/2165693128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616f5b81e00 con 0x5616f5db8070 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f784cff9640 1 -- 172.21.15.133:0/2165693128 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f785c027070 con 0x5616f5db8070 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f784cff9640 1 -- 172.21.15.133:0/2165693128 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f785c02b7d0 con 0x5616f5db8070 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 10 client.7776 fetch_fsmap learned FSMap version 72 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 -- 172.21.15.133:0/2165693128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5616f5b673b0 con 0x5616f5db8070 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f784cff9640 1 -- 172.21.15.133:0/2165693128 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616f5b81e00 con 0x5616f5db8070 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f784cff9640 1 -- 172.21.15.133:0/2165693128 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 72) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f785c011030 con 0x5616f5db8070 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 10 client.7776 fetch_fsmap finished waiting for FSMap version 72 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 10 client.7776 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 20 client.7776 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x5616f5dca850 0x5616f5dcac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 4 client.7776 mds_command: new command op to 7099 tid=0[{"prefix": "status"}] 2023-12-18T10:23:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f78774f1000 1 -- 172.21.15.133:0/2165693128 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5616f5bb5160 con 0x5616f5dca850 2023-12-18T10:23:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.954+0000 7f7871f2b640 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x5616f5dca850 0x5616f5dcac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f7871f2b640 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x5616f5dca850 0x5616f5dcac30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5cd8f46f5bcd1c91 server_cookie=b78f0c7fc2c1e67a in_seq=0 out_seq=0 2023-12-18T10:23:22.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f784cff9640 10 client.7776 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f784cff9640 1 -- 172.21.15.133:0/2165693128 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5616f5bb5160 con 0x5616f5dca850 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f784cff9640 10 client.7776 handle_command_reply: tid=0 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 client.7776 shutdown 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 -- 172.21.15.133:0/2165693128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 msgr2=0x5616f5e160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e160d0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x5616f5baee30 tx=0x7f785c004740 comp rx=0 tx=0).stop 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 -- 172.21.15.133:0/2165693128 shutdown_connections 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x5616f5dca850 0x5616f5dcac30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616f5db8990 0x5616f5dca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5616f5db8070 0x5616f5e160d0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f784cff9640 0 client.7776 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 --2- 172.21.15.133:0/2165693128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5616f5d6e1c0 0x5616f5e15b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 -- 172.21.15.133:0/2165693128 >> 172.21.15.133:0/2165693128 conn(0x5616f5d74950 msgr2=0x5616f5da3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 -- 172.21.15.133:0/2165693128 shutdown_connections 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 1 -- 172.21.15.133:0/2165693128 wait complete. 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f78774f1000 20 client.7776 trim_cache size 0 max 16384 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 1, 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7099, 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:23:22.966 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:23:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:23:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 2.955713958, 2023-12-18T10:23:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 72, 2023-12-18T10:23:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 79, 2023-12-18T10:23:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 79, 2023-12-18T10:23:22.967 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 15.749509107 2023-12-18T10:23:22.967 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 -- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 msgr2=0x7f7850067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f78680ae000 tx=0x7f78680a7000 comp rx=0 tx=0).stop 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 -- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f786c160cc0 msgr2=0x7f786c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f786c160cc0 0x7f786c0b3090 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f786400c7a0 tx=0x7f786400cc60 comp rx=0 tx=0).stop 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 -- 172.21.15.133:0/4240510617 shutdown_connections 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7850065a60 0x7f7850067f20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f786c160cc0 0x7f786c0b3090 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f786c0c17d0 0x7f786c0b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 --2- 172.21.15.133:0/4240510617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f786c0c1280 0x7f786c15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 -- 172.21.15.133:0/4240510617 >> 172.21.15.133:0/4240510617 conn(0x7f786c06a3e0 msgr2=0x7f786c06ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 -- 172.21.15.133:0/4240510617 shutdown_connections 2023-12-18T10:23:22.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:22.958+0000 7f787418f640 1 -- 172.21.15.133:0/4240510617 wait complete. 2023-12-18T10:23:22.980 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-18T10:23:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d2de9640 1 Processor -- start 2023-12-18T10:23:23.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d2de9640 1 -- start start 2023-12-18T10:23:23.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d2de9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc0c1280 0x7ff6cc0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d2de9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6cc0cb340 0x7ff6cc0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d2de9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc06fdb0 con 0x7ff6cc160cc0 2023-12-18T10:23:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d2de9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc1654a0 con 0x7ff6cc0cb340 2023-12-18T10:23:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d2de9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1610a0 con 0x7ff6cc0c1280 2023-12-18T10:23:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d0b85640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff6cc160cc0 0x7ff6cc0cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57092/0 (socket says 172.21.15.133:57092) 2023-12-18T10:23:23.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d0b85640 1 -- 172.21.15.133:0/559265620 learned_addr learned my addr 172.21.15.133:0/559265620 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:23.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc0c1280 0x7ff6cc0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6d1386640 1 --2- 172.21.15.133:0/559265620 >> v2:172.21.15.142:3300/0 conn(0x7ff6cc0cb340 0x7ff6cc0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281495873 0 0) 0x7ff6cc06fdb0 con 0x7ff6cc160cc0 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc003530 con 0x7ff6cc160cc0 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3064042999 0 0) 0x7ff6bc003530 con 0x7ff6cc160cc0 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc0c1280 msgr2=0x7ff6cc0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc0c1280 0x7ff6cc0cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 >> v2:172.21.15.142:3300/0 conn(0x7ff6cc0cb340 msgr2=0x7ff6cc0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 --2- 172.21.15.133:0/559265620 >> v2:172.21.15.142:3300/0 conn(0x7ff6cc0cb340 0x7ff6cc0cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc164820 con 0x7ff6cc160cc0 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7ff6c0001680 con 0x7ff6cc160cc0 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 >> v1:172.21.15.133:6789/0 conn(0x7ff6cc160cc0 legacy=0x7ff6cc0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc0c1280 0x7ff6bc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6bc004d10 0x7ff6bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1654a0 con 0x7ff6bc003f00 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1610a0 con 0x7ff6bc004d10 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc00ba70 con 0x7ff6cc0c1280 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.118+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc0c1280 0x7ff6bc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6d1386640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6bc004d10 0x7ff6bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cbfff640 1 -- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc0c1280 msgr2=0x7ff6bc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc0c1280 0x7ff6bc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cbfff640 1 -- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6bc004d10 msgr2=0x7ff6bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6bc004d10 0x7ff6bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cbfff640 1 -- 172.21.15.133:0/559265620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc003530 con 0x7ff6bc003f00 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6bc0047d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009ae0 tx=0x7ff6b801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c8b8c95a98302 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80a5610 con 0x7ff6bc003f00 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b80a5770 con 0x7ff6bc003f00 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6cb7fe640 1 -- 172.21.15.133:0/559265620 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80a5b20 con 0x7ff6bc003f00 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6d2de9640 1 -- 172.21.15.133:0/559265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 msgr2=0x7ff6bc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.122+0000 7ff6d2de9640 1 --2- 172.21.15.133:0/559265620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6bc0047d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009ae0 tx=0x7ff6b801ca20 comp rx=0 tx=0).stop 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d1386640 1 -- 172.21.15.133:0/559265620 reap_dead start 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 -- 172.21.15.133:0/559265620 shutdown_connections 2023-12-18T10:23:23.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 -- 172.21.15.133:0/559265620 >> 172.21.15.133:0/559265620 conn(0x7ff6cc06a3e0 msgr2=0x7ff6cc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 -- 172.21.15.133:0/559265620 shutdown_connections 2023-12-18T10:23:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 -- 172.21.15.133:0/559265620 wait complete. 2023-12-18T10:23:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 Processor -- start 2023-12-18T10:23:23.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 -- start start 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6cc0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6cc0c2a70 0x7ff6cc15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc15f020 0x7ff6cc0c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0b2f40 con 0x7ff6bc003f00 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc15cb20 con 0x7ff6cc0c2a70 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d2de9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc15ce00 con 0x7ff6cc15f020 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d0b85640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6cc0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d0b85640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6cc0b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59514/0 (socket says 172.21.15.133:59514) 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d0b85640 1 -- 172.21.15.133:0/3037036900 learned_addr learned my addr 172.21.15.133:0/3037036900 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:23.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6cc0c2a70 0x7ff6cc15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d1386640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc15f020 0x7ff6cc0c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d0b85640 1 -- 172.21.15.133:0/3037036900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc15f020 msgr2=0x7ff6cc0c1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc15f020 0x7ff6cc0c1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d0b85640 1 -- 172.21.15.133:0/3037036900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6cc0c2a70 msgr2=0x7ff6cc15bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6cc0c2a70 0x7ff6cc15bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.126+0000 7ff6d0b85640 1 -- 172.21.15.133:0/3037036900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0b28f0 con 0x7ff6bc003f00 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6cc0b33d0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0007290 tx=0x7ff6c0007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6c97fa640 1 -- 172.21.15.133:0/3037036900 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000f940 con 0x7ff6bc003f00 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6c97fa640 1 -- 172.21.15.133:0/3037036900 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c000faa0 con 0x7ff6bc003f00 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6d2de9640 1 -- 172.21.15.133:0/3037036900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc0b2bd0 con 0x7ff6bc003f00 2023-12-18T10:23:23.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6c97fa640 1 -- 172.21.15.133:0/3037036900 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000fe50 con 0x7ff6bc003f00 2023-12-18T10:23:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6d2de9640 1 -- 172.21.15.133:0/3037036900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc15c6b0 con 0x7ff6bc003f00 2023-12-18T10:23:23.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6c97fa640 1 -- 172.21.15.133:0/3037036900 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff6c001d460 con 0x7ff6bc003f00 2023-12-18T10:23:23.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6c97fa640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6b0065a90 0x7ff6b0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6c97fa640 1 -- 172.21.15.133:0/3037036900 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6c00834a0 con 0x7ff6bc003f00 2023-12-18T10:23:23.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6b0065a90 0x7ff6b0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.130+0000 7ff6d613e000 1 Processor -- start 2023-12-18T10:23:23.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6b0065a90 0x7ff6b0067f50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80af000 tx=0x7ff6b80046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- start start 2023-12-18T10:23:23.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 0x55adee209450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1bec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee1bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adedfe2c90 con 0x55adee209990 2023-12-18T10:23:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adee014220 con 0x55adee209070 2023-12-18T10:23:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adee0117f0 con 0x55adee1bf1c0 2023-12-18T10:23:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1bec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1bec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59520/0 (socket says 172.21.15.133:59520) 2023-12-18T10:23:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 -- 172.21.15.133:0/1707617579 learned_addr learned my addr 172.21.15.133:0/1707617579 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 0x55adee209450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d1386640 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee1bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 -- 172.21.15.133:0/1707617579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 msgr2=0x55adee1bf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee1bf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 -- 172.21.15.133:0/1707617579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 msgr2=0x55adee209450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 0x55adee209450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 -- 172.21.15.133:0/1707617579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adedd09890 con 0x55adee209990 2023-12-18T10:23:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1bec80 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8098430 tx=0x7ff6b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c674cbcb22154d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6b67fc640 1 -- 172.21.15.133:0/1707617579 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80ad440 con 0x55adee209990 2023-12-18T10:23:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6b67fc640 1 -- 172.21.15.133:0/1707617579 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b80ad5a0 con 0x55adee209990 2023-12-18T10:23:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6b67fc640 1 -- 172.21.15.133:0/1707617579 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80ad910 con 0x55adee209990 2023-12-18T10:23:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- 172.21.15.133:0/1707617579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 msgr2=0x55adee1bec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1bec80 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8098430 tx=0x7ff6b8004740 comp rx=0 tx=0).stop 2023-12-18T10:23:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- 172.21.15.133:0/1707617579 shutdown_connections 2023-12-18T10:23:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee1bf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1bec80 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1707617579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 0x55adee209450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- 172.21.15.133:0/1707617579 >> 172.21.15.133:0/1707617579 conn(0x55adee1c5950 msgr2=0x55adee1bd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- 172.21.15.133:0/1707617579 shutdown_connections 2023-12-18T10:23:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- 172.21.15.133:0/1707617579 wait complete. 2023-12-18T10:23:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 -- start start 2023-12-18T10:23:23.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.134+0000 7ff6d613e000 1 Processor -- start 2023-12-18T10:23:23.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee1c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209070 0x55adee1c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adee00d0e0 con 0x55adee209070 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adedfac310 con 0x55adee209990 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adedfca770 con 0x55adee1bf1c0 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 10 client.0 _ll_register_callbacks cb 0x55adee1aab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209070 0x55adee1c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209070 0x55adee1c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59534/0 (socket says 172.21.15.133:59534) 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 -- 172.21.15.133:0/3124560720 learned_addr learned my addr 172.21.15.133:0/3124560720 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d1386640 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee1c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 -- 172.21.15.133:0/3124560720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 msgr2=0x55adee1c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee1c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 -- 172.21.15.133:0/3124560720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 msgr2=0x55adee1f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee1f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 -- 172.21.15.133:0/3124560720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc003530 con 0x55adee209070 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209070 0x55adee1c4ce0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8098430 tx=0x7ff6b80197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92234178c8b4396c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/3124560720 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80c2bf0 con 0x55adee209070 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 -- 172.21.15.133:0/3124560720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adedfdcc10 con 0x55adee209070 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/3124560720 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6b80c2d50 con 0x55adee209070 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/3124560720 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6b80ad440 con 0x55adee209070 2023-12-18T10:23:23.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 10 client.7788 fetch_fsmap learned FSMap version 72 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 -- 172.21.15.133:0/3124560720 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55adedfd2260 con 0x55adee209070 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/3124560720 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55adedfdcc10 con 0x55adee209070 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/3124560720 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 72) v1 ==== 3138+0+0 (secure 0 0 0) 0x7ff6b80bf050 con 0x55adee209070 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 10 client.7788 fetch_fsmap finished waiting for FSMap version 72 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 10 client.7788 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 20 client.7788 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x55adee1f7120 0x55adee21a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 4 client.7788 mds_command: new command op to 7557 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d613e000 1 -- 172.21.15.133:0/3124560720 --> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adee00ba30 con 0x55adee1f7120 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x55adee1f7120 0x55adee21a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x55adee1f7120 0x55adee21a320 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d16570d5f0138723 server_cookie=db0a7e952fd288e3 in_seq=0 out_seq=0 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.138+0000 7ff6ab7fe640 10 client.7788 ms_handle_connect on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/3124560720 <== mds.0 v2:172.21.15.133:6835/522841432 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55adee00ba30 con 0x55adee1f7120 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6ab7fe640 10 client.7788 handle_command_reply: tid=0 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 client.7788 shutdown 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 -- 172.21.15.133:0/3124560720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209070 msgr2=0x55adee1c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209070 0x55adee1c4ce0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8098430 tx=0x7ff6b80197c0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 -- 172.21.15.133:0/3124560720 shutdown_connections 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x55adee1f7120 0x55adee21a320 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee1f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209070 0x55adee1c4ce0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 --2- 172.21.15.133:0/3124560720 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee1c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6ab7fe640 0 client.7788 ms_handle_reset on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 -- 172.21.15.133:0/3124560720 >> 172.21.15.133:0/3124560720 conn(0x55adee1c5950 msgr2=0x55adee1bdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 -- 172.21.15.133:0/3124560720 shutdown_connections 2023-12-18T10:23:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 1 -- 172.21.15.133:0/3124560720 wait complete. 2023-12-18T10:23:23.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.142+0000 7ff6d613e000 20 client.7788 trim_cache size 0 max 16384 2023-12-18T10:23:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.154+0000 7ff6d613e000 1 Processor -- start 2023-12-18T10:23:23.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.154+0000 7ff6d613e000 1 -- start start 2023-12-18T10:23:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee1bf1c0 0x55adee208530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee209070 0x55adee208a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee21b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adedcca940 con 0x55adee1bf1c0 2023-12-18T10:23:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adee050ce0 con 0x55adee209990 2023-12-18T10:23:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adee1c1d70 con 0x55adee209070 2023-12-18T10:23:23.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee1bf1c0 0x55adee208530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee1bf1c0 0x55adee208530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59548/0 (socket says 172.21.15.133:59548) 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 -- 172.21.15.133:0/2618781513 learned_addr learned my addr 172.21.15.133:0/2618781513 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee209070 0x55adee208a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d1386640 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee21b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 -- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee209070 msgr2=0x55adee208a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee209070 0x55adee208a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 -- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 msgr2=0x55adee21b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee21b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 -- 172.21.15.133:0/2618781513 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc162bb0 con 0x55adee1bf1c0 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d1386640 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee21b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:23.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee1bf1c0 0x55adee208530 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0001940 tx=0x7ff6c0058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ab83efbc196450 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6b6ffd640 1 -- 172.21.15.133:0/2618781513 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0081900 con 0x55adee1bf1c0 2023-12-18T10:23:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6b6ffd640 1 -- 172.21.15.133:0/2618781513 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c0052ce0 con 0x55adee1bf1c0 2023-12-18T10:23:23.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6b6ffd640 1 -- 172.21.15.133:0/2618781513 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00830b0 con 0x55adee1bf1c0 2023-12-18T10:23:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- 172.21.15.133:0/2618781513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee1bf1c0 msgr2=0x55adee208530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee1bf1c0 0x55adee208530 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0001940 tx=0x7ff6c0058040 comp rx=0 tx=0).stop 2023-12-18T10:23:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- 172.21.15.133:0/2618781513 shutdown_connections 2023-12-18T10:23:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209990 0x55adee21b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee209070 0x55adee208a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 --2- 172.21.15.133:0/2618781513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee1bf1c0 0x55adee208530 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- 172.21.15.133:0/2618781513 >> 172.21.15.133:0/2618781513 conn(0x55adee1c5950 msgr2=0x55adee207e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- 172.21.15.133:0/2618781513 shutdown_connections 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- 172.21.15.133:0/2618781513 wait complete. 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 -- start start 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.158+0000 7ff6d613e000 1 Processor -- start 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee265230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 0x55adee1f2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adee00e670 con 0x55adee209990 2023-12-18T10:23:23.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adee0154b0 con 0x55adee209070 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adee008a50 con 0x55adee1bf1c0 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 10 client.0 _ll_register_callbacks cb 0x55adedfbb640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59552/0 (socket says 172.21.15.133:59552) 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 -- 172.21.15.133:0/1287468728 learned_addr learned my addr 172.21.15.133:0/1287468728 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee265230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6cbfff640 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 0x55adee1f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 -- 172.21.15.133:0/1287468728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 msgr2=0x55adee265230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee265230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 -- 172.21.15.133:0/1287468728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 msgr2=0x55adee1f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 0x55adee1f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 -- 172.21.15.133:0/1287468728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc15c6b0 con 0x55adee209990 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d1386640 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1f2ba0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0c1780 tx=0x7ff6c4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f40f6a9870215eb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/1287468728 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400e040 con 0x55adee209990 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/1287468728 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6c40189b0 con 0x55adee209990 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- 172.21.15.133:0/1287468728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adee1c2930 con 0x55adee209990 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/1287468728 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6c4018b70 con 0x55adee209990 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 10 client.7794 fetch_fsmap learned FSMap version 72 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- 172.21.15.133:0/1287468728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55adedfb83b0 con 0x55adee209990 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/1287468728 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55adee1c2930 con 0x55adee209990 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/1287468728 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 72) v1 ==== 3138+0+0 (secure 0 0 0) 0x7ff6c4014040 con 0x55adee209990 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 10 client.7794 fetch_fsmap finished waiting for FSMap version 72 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 10 client.7794 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:23:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 20 client.7794 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x55adee1f30e0 0x55adee1f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 4 client.7794 mds_command: new command op to 7557 tid=0[{"prefix": "status"}] 2023-12-18T10:23:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- 172.21.15.133:0/1287468728 --> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55adedfd2e00 con 0x55adee1f30e0 2023-12-18T10:23:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x55adee1f30e0 0x55adee1f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 10 client.7794 ms_handle_connect on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d0b85640 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x55adee1f30e0 0x55adee1f34c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ba3b27f61b48e5 server_cookie=cee8ceaf7112f1f5 in_seq=0 out_seq=0 2023-12-18T10:23:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 1 -- 172.21.15.133:0/1287468728 <== mds.0 v2:172.21.15.133:6835/522841432 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55adedfd2e00 con 0x55adee1f30e0 2023-12-18T10:23:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 10 client.7794 handle_command_reply: tid=0 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 client.7794 shutdown 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- 172.21.15.133:0/1287468728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 msgr2=0x55adee1f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1f2ba0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0c1780 tx=0x7ff6c4004470 comp rx=0 tx=0).stop 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- 172.21.15.133:0/1287468728 shutdown_connections 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adee209990 0x55adee1f2ba0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x55adee1f30e0 0x55adee1f34c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adee209070 0x55adee1f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 --2- 172.21.15.133:0/1287468728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55adee1bf1c0 0x55adee265230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6ab7fe640 0 client.7794 ms_handle_reset on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- 172.21.15.133:0/1287468728 >> 172.21.15.133:0/1287468728 conn(0x55adee1c5950 msgr2=0x55adee207e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.162+0000 7ff6d613e000 1 -- 172.21.15.133:0/1287468728 shutdown_connections 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d613e000 1 -- 172.21.15.133:0/1287468728 wait complete. 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d613e000 20 client.7794 trim_cache size 0 max 16384 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7557, 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:23:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:23:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 11.698542235, 2023-12-18T10:23:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 72, 2023-12-18T10:23:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 79, 2023-12-18T10:23:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 79, 2023-12-18T10:23:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 15.956529897999999 2023-12-18T10:23:23.175 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 -- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6b0065a90 msgr2=0x7ff6b0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6b0065a90 0x7ff6b0067f50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80af000 tx=0x7ff6b80046d0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 -- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 msgr2=0x7ff6cc0b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6cc0b33d0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0007290 tx=0x7ff6c0007750 comp rx=0 tx=0).stop 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 -- 172.21.15.133:0/3037036900 shutdown_connections 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff6b0065a90 0x7ff6b0067f50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6cc15f020 0x7ff6cc0c1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6cc0c2a70 0x7ff6cc15bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 --2- 172.21.15.133:0/3037036900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6bc003f00 0x7ff6cc0b33d0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 -- 172.21.15.133:0/3037036900 >> 172.21.15.133:0/3037036900 conn(0x7ff6cc06a3e0 msgr2=0x7ff6cc15d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:23.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 -- 172.21.15.133:0/3037036900 shutdown_connections 2023-12-18T10:23:23.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.166+0000 7ff6d2de9640 1 -- 172.21.15.133:0/3037036900 wait complete. 2023-12-18T10:23:23.188 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:23.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e91f3640 1 Processor -- start 2023-12-18T10:23:23.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e91f3640 1 -- start start 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e91f3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9e4157080 0x7ff9e40ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e91f3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9e40d0cc0 0x7ff9e40ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e91f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40d1320 con 0x7ff9e40cd730 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e91f3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e40d1130 con 0x7ff9e40d0cc0 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e91f3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e4157460 con 0x7ff9e4157080 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e359e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9e40d0cc0 0x7ff9e40ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e359e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9e40d0cc0 0x7ff9e40ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59554/0 (socket says 172.21.15.133:59554) 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e359e640 1 -- 172.21.15.133:0/1162449893 learned_addr learned my addr 172.21.15.133:0/1162449893 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e2d9d640 1 --2- 172.21.15.133:0/1162449893 >> v2:172.21.15.142:3300/0 conn(0x7ff9e4157080 0x7ff9e40ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e359e640 1 -- 172.21.15.133:0/1162449893 >> v2:172.21.15.142:3300/0 conn(0x7ff9e4157080 msgr2=0x7ff9e40ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:23.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e359e640 1 --2- 172.21.15.133:0/1162449893 >> v2:172.21.15.142:3300/0 conn(0x7ff9e4157080 0x7ff9e40ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e359e640 1 -- 172.21.15.133:0/1162449893 >> v1:172.21.15.142:6789/0 conn(0x7ff9e40cd730 legacy=0x7ff9e40d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.322+0000 7ff9e359e640 1 -- 172.21.15.133:0/1162449893 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40cc970 con 0x7ff9e40d0cc0 2023-12-18T10:23:23.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e359e640 1 --2- 172.21.15.133:0/1162449893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e40d0cc0 0x7ff9e40ce750 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009870 tx=0x7ff9dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d135d8db078c2764 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e259c640 1 -- 172.21.15.133:0/1162449893 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0aa430 con 0x7ff9e40d0cc0 2023-12-18T10:23:23.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e259c640 1 -- 172.21.15.133:0/1162449893 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0aa590 con 0x7ff9e40d0cc0 2023-12-18T10:23:23.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e259c640 1 -- 172.21.15.133:0/1162449893 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0aa920 con 0x7ff9e40d0cc0 2023-12-18T10:23:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e91f3640 1 -- 172.21.15.133:0/1162449893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e40d0cc0 msgr2=0x7ff9e40ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/1162449893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e40d0cc0 0x7ff9e40ce750 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009870 tx=0x7ff9dc01c4d0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e91f3640 1 -- 172.21.15.133:0/1162449893 shutdown_connections 2023-12-18T10:23:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/1162449893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e40d0cc0 0x7ff9e40ce750 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/1162449893 >> v2:172.21.15.142:3300/0 conn(0x7ff9e4157080 0x7ff9e40ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e91f3640 1 -- 172.21.15.133:0/1162449893 >> 172.21.15.133:0/1162449893 conn(0x7ff9e4069ca0 msgr2=0x7ff9e406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e91f3640 1 -- 172.21.15.133:0/1162449893 shutdown_connections 2023-12-18T10:23:23.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.326+0000 7ff9e91f3640 1 -- 172.21.15.133:0/1162449893 wait complete. 2023-12-18T10:23:23.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 Processor -- start 2023-12-18T10:23:23.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 -- start start 2023-12-18T10:23:23.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9e40cd730 0x7ff9e414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9e40d0cc0 0x7ff9e40c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e4157080 0x7ff9e4155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40ca5b0 con 0x7ff9e4157080 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40c2e20 con 0x7ff9e40cd730 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40c3100 con 0x7ff9e40d0cc0 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e4157080 0x7ff9e4155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e4157080 0x7ff9e4155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59570/0 (socket says 172.21.15.133:59570) 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 -- 172.21.15.133:0/2914935013 learned_addr learned my addr 172.21.15.133:0/2914935013 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e2d9d640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9e40cd730 0x7ff9e414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9da59c640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9e40d0cc0 0x7ff9e40c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 -- 172.21.15.133:0/2914935013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9e40d0cc0 msgr2=0x7ff9e40c23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9e40d0cc0 0x7ff9e40c23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 -- 172.21.15.133:0/2914935013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9e40cd730 msgr2=0x7ff9e414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9e40cd730 0x7ff9e414ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 -- 172.21.15.133:0/2914935013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0094d0 con 0x7ff9e4157080 2023-12-18T10:23:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e359e640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e4157080 0x7ff9e4155b30 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0ac040 tx=0x7ff9dc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9dbfff640 1 -- 172.21.15.133:0/2914935013 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0aa430 con 0x7ff9e4157080 2023-12-18T10:23:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9dbfff640 1 -- 172.21.15.133:0/2914935013 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0b3800 con 0x7ff9e4157080 2023-12-18T10:23:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9dbfff640 1 -- 172.21.15.133:0/2914935013 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0b3bb0 con 0x7ff9e4157080 2023-12-18T10:23:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.330+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e40c33e0 con 0x7ff9e4157080 2023-12-18T10:23:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.334+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e40b3010 con 0x7ff9e4157080 2023-12-18T10:23:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.334+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e40b3200 con 0x7ff9e4157080 2023-12-18T10:23:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.334+0000 7ff9dbfff640 1 -- 172.21.15.133:0/2914935013 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9dc0b3d10 con 0x7ff9e4157080 2023-12-18T10:23:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.334+0000 7ff9dbfff640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9c4065a60 0x7ff9c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.334+0000 7ff9dbfff640 1 -- 172.21.15.133:0/2914935013 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff9dc11d7f0 con 0x7ff9e4157080 2023-12-18T10:23:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.334+0000 7ff9e2d9d640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9c4065a60 0x7ff9c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:23.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.334+0000 7ff9e2d9d640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9c4065a60 0x7ff9c4067f20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff9e415c900 tx=0x7ff9d4009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.338+0000 7ff9dbfff640 1 -- 172.21.15.133:0/2914935013 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff9dc0eb080 con 0x7ff9e4157080 2023-12-18T10:23:23.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.522+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9e404e000 con 0x7ff9e4157080 2023-12-18T10:23:23.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.522+0000 7ff9dbfff640 1 -- 172.21.15.133:0/2914935013 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4748 (secure 0 0 0) 0x7ff9dc0ee6a0 con 0x7ff9e4157080 2023-12-18T10:23:23.527 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:23.527 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:22.018893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7557,"mds_1":7099,"mds_2":7096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7096":{"gid":7096,"name":"d","rank":2,"incarnation":71,"state":"up:active","state_seq":5,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7099":{"gid":7099,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:23.527 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 72 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9c4065a60 msgr2=0x7ff9c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9c4065a60 0x7ff9c4067f20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff9e415c900 tx=0x7ff9d4009830 comp rx=0 tx=0).stop 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e4157080 msgr2=0x7ff9e4155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e4157080 0x7ff9e4155b30 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0ac040 tx=0x7ff9dc01ad10 comp rx=0 tx=0).stop 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 shutdown_connections 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9c4065a60 0x7ff9c4067f20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e4157080 0x7ff9e4155b30 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9e40d0cc0 0x7ff9e40c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 --2- 172.21.15.133:0/2914935013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9e40cd730 0x7ff9e414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:23.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 >> 172.21.15.133:0/2914935013 conn(0x7ff9e4069ca0 msgr2=0x7ff9e40ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:23.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 shutdown_connections 2023-12-18T10:23:23.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:23.526+0000 7ff9e91f3640 1 -- 172.21.15.133:0/2914935013 wait complete. 2023-12-18T10:23:23.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:23.548 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:23:23.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:23.577 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:23:23.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:23.640 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-12-18T10:23:23.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:23.699 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-12-18T10:23:23.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:23.750 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-12-18T10:23:23.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:23:23.998 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:23:23.998 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:23:23.999 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:23:26.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:23:26.167 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:23:26.168 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:23:26.168 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:23:28.169 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:23:28.336 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:23:28.336 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:23:28.337 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:23:28.781 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:23:28.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:23:30.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:23:30.504 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:23:30.504 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:23:30.504 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:23:32.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:23:32.670 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-12-18T10:23:32.671 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:23:32.671 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:23:32.671 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:23:32.826 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:23:32.826 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:23:32.827 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:23:34.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:23:34.988 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:23:34.989 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:23:34.989 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:23:36.990 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:23:37.155 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:23:37.156 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:23:37.156 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:23:39.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:23:39.325 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:23:39.325 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:23:39.326 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:23:39.326 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:23:39.491 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2023-12-18T10:23:39.492 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:23:39.492 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:23:39.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2023-12-18T10:23:39.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.630+0000 7f7b417a6640 1 Processor -- start 2023-12-18T10:23:39.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.630+0000 7f7b417a6640 1 -- start start 2023-12-18T10:23:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b417a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b3c153020 0x7f7b3c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b417a6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7b3c1598d0 0x7f7b3c0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b417a6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c0ced20 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b417a6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c9730 con 0x7f7b3c153020 2023-12-18T10:23:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b417a6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c8e00 con 0x7f7b3c1598d0 2023-12-18T10:23:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b3affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b3c153020 0x7f7b3c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b3affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b3c153020 0x7f7b3c0c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60908/0 (socket says 172.21.15.133:60908) 2023-12-18T10:23:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b3affd640 1 -- 172.21.15.133:0/3879393765 learned_addr learned my addr 172.21.15.133:0/3879393765 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b327fc640 1 --2- 172.21.15.133:0/3879393765 >> v2:172.21.15.142:3300/0 conn(0x7f7b3c1598d0 0x7f7b3c0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b3affd640 1 -- 172.21.15.133:0/3879393765 >> v2:172.21.15.142:3300/0 conn(0x7f7b3c1598d0 msgr2=0x7f7b3c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b3affd640 1 --2- 172.21.15.133:0/3879393765 >> v2:172.21.15.142:3300/0 conn(0x7f7b3c1598d0 0x7f7b3c0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b3affd640 1 -- 172.21.15.133:0/3879393765 >> v1:172.21.15.142:6789/0 conn(0x7f7b3c0ce8d0 legacy=0x7f7b3c070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.634+0000 7f7b3affd640 1 -- 172.21.15.133:0/3879393765 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c0c90e0 con 0x7f7b3c153020 2023-12-18T10:23:39.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b3affd640 1 --2- 172.21.15.133:0/3879393765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c153020 0x7f7b3c0c9bc0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0ce340 tx=0x7f7b2401e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f0210c10540c1d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b3a7fc640 1 -- 172.21.15.133:0/3879393765 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24004230 con 0x7f7b3c153020 2023-12-18T10:23:39.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b3a7fc640 1 -- 172.21.15.133:0/3879393765 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240ab070 con 0x7f7b3c153020 2023-12-18T10:23:39.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b3a7fc640 1 -- 172.21.15.133:0/3879393765 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240a76f0 con 0x7f7b3c153020 2023-12-18T10:23:39.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- 172.21.15.133:0/3879393765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c153020 msgr2=0x7f7b3c0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 --2- 172.21.15.133:0/3879393765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c153020 0x7f7b3c0c9bc0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0ce340 tx=0x7f7b2401e860 comp rx=0 tx=0).stop 2023-12-18T10:23:39.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- 172.21.15.133:0/3879393765 shutdown_connections 2023-12-18T10:23:39.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 --2- 172.21.15.133:0/3879393765 >> v2:172.21.15.142:3300/0 conn(0x7f7b3c1598d0 0x7f7b3c0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 --2- 172.21.15.133:0/3879393765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c153020 0x7f7b3c0c9bc0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- 172.21.15.133:0/3879393765 >> 172.21.15.133:0/3879393765 conn(0x7f7b3c06a2a0 msgr2=0x7f7b3c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- 172.21.15.133:0/3879393765 shutdown_connections 2023-12-18T10:23:39.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- 172.21.15.133:0/3879393765 wait complete. 2023-12-18T10:23:39.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 Processor -- start 2023-12-18T10:23:39.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- start start 2023-12-18T10:23:39.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c0ce8d0 0x7f7b3c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3c153020 0x7f7b3c0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3c1598d0 0x7f7b3c0c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c8350 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0b21b0 con 0x7f7b3c1598d0 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.638+0000 7f7b417a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c8070 con 0x7f7b3c153020 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c0ce8d0 0x7f7b3c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c0ce8d0 0x7f7b3c0b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60912/0 (socket says 172.21.15.133:60912) 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b327fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3c153020 0x7f7b3c0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 -- 172.21.15.133:0/648120459 learned_addr learned my addr 172.21.15.133:0/648120459 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3b7fe640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3c1598d0 0x7f7b3c0c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 -- 172.21.15.133:0/648120459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3c153020 msgr2=0x7f7b3c0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3c153020 0x7f7b3c0c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 -- 172.21.15.133:0/648120459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3c1598d0 msgr2=0x7f7b3c0c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3c1598d0 0x7f7b3c0c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 -- 172.21.15.133:0/648120459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2400b780 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b3affd640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c0ce8d0 0x7f7b3c0b1c70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7b2401b470 tx=0x7f7b2401b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b33fff640 1 -- 172.21.15.133:0/648120459 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240a7900 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b33fff640 1 -- 172.21.15.133:0/648120459 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240a7a60 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b33fff640 1 -- 172.21.15.133:0/648120459 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240a7bf0 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b417a6640 1 -- 172.21.15.133:0/648120459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3c0b1190 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b417a6640 1 -- 172.21.15.133:0/648120459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c0b1750 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.642+0000 7f7b33fff640 1 -- 172.21.15.133:0/648120459 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7b240a7d50 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b33fff640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b1c065a90 0x7f7b1c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b33fff640 1 -- 172.21.15.133:0/648120459 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7b2411d870 con 0x7f7b3c0ce8d0 2023-12-18T10:23:39.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b1c065a90 0x7f7b1c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 Processor -- start 2023-12-18T10:23:39.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b1c065a90 0x7f7b1c067f50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0cd430 tx=0x7f7b2c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 -- start start 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c45a0 0x5636da979a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 0x5636da97a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636da842430 con 0x5636da9c45a0 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636da7d0460 con 0x5636da9c3c80 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636da7cda30 con 0x5636da979fc0 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c45a0 0x5636da979a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c45a0 0x5636da979a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60916/0 (socket says 172.21.15.133:60916) 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 -- 172.21.15.133:0/223775434 learned_addr learned my addr 172.21.15.133:0/223775434 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b3affd640 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b3b7fe640 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 0x5636da97a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 -- 172.21.15.133:0/223775434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 msgr2=0x5636da97a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 0x5636da97a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 -- 172.21.15.133:0/223775434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 msgr2=0x5636da9c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 -- 172.21.15.133:0/223775434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636da4c5e20 con 0x5636da9c45a0 2023-12-18T10:23:39.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b327fc640 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c45a0 0x5636da979a80 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c011e30 tx=0x7f7b2c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca34dbf27fd80b80 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b30ff9640 1 -- 172.21.15.133:0/223775434 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c01c040 con 0x5636da9c45a0 2023-12-18T10:23:39.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b30ff9640 1 -- 172.21.15.133:0/223775434 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c003830 con 0x5636da9c45a0 2023-12-18T10:23:39.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b30ff9640 1 -- 172.21.15.133:0/223775434 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c003ba0 con 0x5636da9c45a0 2023-12-18T10:23:39.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 -- 172.21.15.133:0/223775434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c45a0 msgr2=0x5636da979a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.646+0000 7f7b44b06000 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c45a0 0x5636da979a80 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c011e30 tx=0x7f7b2c014000 comp rx=0 tx=0).stop 2023-12-18T10:23:39.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- 172.21.15.133:0/223775434 shutdown_connections 2023-12-18T10:23:39.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 0x5636da97a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c45a0 0x5636da979a80 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 --2- 172.21.15.133:0/223775434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- 172.21.15.133:0/223775434 >> 172.21.15.133:0/223775434 conn(0x5636da778910 msgr2=0x5636da978360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- 172.21.15.133:0/223775434 shutdown_connections 2023-12-18T10:23:39.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- 172.21.15.133:0/223775434 wait complete. 2023-12-18T10:23:39.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- start start 2023-12-18T10:23:39.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 Processor -- start 2023-12-18T10:23:39.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 0x5636da9c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c3c80 0x5636da9c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c45a0 0x5636da9c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636da7c9320 con 0x5636da9c3c80 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636da7684f0 con 0x5636da9c45a0 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636da7866e0 con 0x5636da979fc0 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 10 client.0 _ll_register_callbacks cb 0x5636da965980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c3c80 0x5636da9c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c3c80 0x5636da9c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60922/0 (socket says 172.21.15.133:60922) 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 -- 172.21.15.133:0/2900928660 learned_addr learned my addr 172.21.15.133:0/2900928660 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b3affd640 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 0x5636da9c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b3b7fe640 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c45a0 0x5636da9c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 -- 172.21.15.133:0/2900928660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 msgr2=0x5636da9c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 0x5636da9c4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 -- 172.21.15.133:0/2900928660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c45a0 msgr2=0x5636da9c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c45a0 0x5636da9c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 -- 172.21.15.133:0/2900928660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c011b10 con 0x5636da9c3c80 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b327fc640 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c3c80 0x5636da9c4ec0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c024040 tx=0x7f7b2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed8c93379a13d55 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2900928660 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c022670 con 0x5636da9c3c80 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2900928660 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7b2c037c20 con 0x5636da9c3c80 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- 172.21.15.133:0/2900928660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636da786120 con 0x5636da9c3c80 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2900928660 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b2c037de0 con 0x5636da9c3c80 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 10 client.7812 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- 172.21.15.133:0/2900928660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5636da78e250 con 0x5636da9c3c80 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2900928660 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636da786120 con 0x5636da9c3c80 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2900928660 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f7b2c0227d0 con 0x5636da9c3c80 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 10 client.7812 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 10 client.7812 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 20 client.7812 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:39.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x5636da9d3840 0x5636da9d5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 4 client.7812 mds_command: new command op to 7557 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.650+0000 7f7b44b06000 1 -- 172.21.15.133:0/2900928660 --> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636da7c7c70 con 0x5636da9d3840 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b3affd640 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x5636da9d3840 0x5636da9d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b3affd640 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x5636da9d3840 0x5636da9d5c30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f0158c046cedca9 server_cookie=2ec48aba97ce3cae in_seq=0 out_seq=0 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b19ffb640 10 client.7812 ms_handle_connect on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2900928660 <== mds.0 v2:172.21.15.133:6835/522841432 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5636da7c7c70 con 0x5636da9d3840 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b19ffb640 10 client.7812 handle_command_reply: tid=0 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 client.7812 shutdown 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 -- 172.21.15.133:0/2900928660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c3c80 msgr2=0x5636da9c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c3c80 0x5636da9c4ec0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c024040 tx=0x7f7b2c004740 comp rx=0 tx=0).stop 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 -- 172.21.15.133:0/2900928660 shutdown_connections 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x5636da9d3840 0x5636da9d5c30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c45a0 0x5636da9c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b19ffb640 0 client.7812 ms_handle_reset on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:39.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da9c3c80 0x5636da9c4ec0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2900928660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da979fc0 0x5636da9c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 -- 172.21.15.133:0/2900928660 >> 172.21.15.133:0/2900928660 conn(0x5636da778910 msgr2=0x5636da978a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 -- 172.21.15.133:0/2900928660 shutdown_connections 2023-12-18T10:23:39.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 1 -- 172.21.15.133:0/2900928660 wait complete. 2023-12-18T10:23:39.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.654+0000 7f7b44b06000 20 client.7812 trim_cache size 0 max 16384 2023-12-18T10:23:39.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b44b06000 1 Processor -- start 2023-12-18T10:23:39.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b44b06000 1 -- start start 2023-12-18T10:23:39.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636da9d6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9d7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 0x5636da9bd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b44b06000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636da486aa0 con 0x5636da979fc0 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b44b06000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636da7c81b0 con 0x5636da9c3c80 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b44b06000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636da979ae0 con 0x5636da9c45a0 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636da9d6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636da9d6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60938/0 (socket says 172.21.15.133:60938) 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3affd640 1 -- 172.21.15.133:0/1837919653 learned_addr learned my addr 172.21.15.133:0/1837919653 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b327fc640 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9d7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3b7fe640 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 0x5636da9bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3affd640 1 -- 172.21.15.133:0/1837919653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 msgr2=0x5636da9bd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3affd640 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 0x5636da9bd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3affd640 1 -- 172.21.15.133:0/1837919653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 msgr2=0x5636da9d7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3affd640 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9d7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.666+0000 7f7b3affd640 1 -- 172.21.15.133:0/1837919653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636da7745a0 con 0x5636da979fc0 2023-12-18T10:23:39.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636da9d6c40 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7b24024e70 tx=0x7f7b2411ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6775edfb40dfedec server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b317fa640 1 -- 172.21.15.133:0/1837919653 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2411bcd0 con 0x5636da979fc0 2023-12-18T10:23:39.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b317fa640 1 -- 172.21.15.133:0/1837919653 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240ed0b0 con 0x5636da979fc0 2023-12-18T10:23:39.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b317fa640 1 -- 172.21.15.133:0/1837919653 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240eb420 con 0x5636da979fc0 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- 172.21.15.133:0/1837919653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 msgr2=0x5636da9d6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636da9d6c40 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f7b24024e70 tx=0x7f7b2411ba90 comp rx=0 tx=0).stop 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- 172.21.15.133:0/1837919653 shutdown_connections 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 0x5636da9bd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9d7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 --2- 172.21.15.133:0/1837919653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636da9d6c40 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- 172.21.15.133:0/1837919653 >> 172.21.15.133:0/1837919653 conn(0x5636da778910 msgr2=0x5636da97f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- 172.21.15.133:0/1837919653 shutdown_connections 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- 172.21.15.133:0/1837919653 wait complete. 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- start start 2023-12-18T10:23:39.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 Processor -- start 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636daa1d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 0x5636da9c0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636da787480 con 0x5636da979fc0 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636da7c6b30 con 0x5636da9c3c80 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636da898140 con 0x5636da9c45a0 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 10 client.0 _ll_register_callbacks cb 0x5636da780710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636daa1d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636daa1d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60948/0 (socket says 172.21.15.133:60948) 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 -- 172.21.15.133:0/2137120241 learned_addr learned my addr 172.21.15.133:0/2137120241 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b327fc640 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3b7fe640 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 0x5636da9c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 -- 172.21.15.133:0/2137120241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 msgr2=0x5636da9c0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 0x5636da9c0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 -- 172.21.15.133:0/2137120241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 msgr2=0x5636da9bfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9bfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 -- 172.21.15.133:0/2137120241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c0b1750 con 0x5636da979fc0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b3affd640 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636daa1d530 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7b240eea10 tx=0x7f7b240f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5fe7f8256e9fc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2137120241 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b241062e0 con 0x5636da979fc0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2137120241 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7b24107d00 con 0x5636da979fc0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b44b06000 1 -- 172.21.15.133:0/2137120241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5636da97d940 con 0x5636da979fc0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.670+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2137120241 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b240ee200 con 0x5636da979fc0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b44b06000 10 client.7818 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b44b06000 1 -- 172.21.15.133:0/2137120241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x5636da768110 con 0x5636da979fc0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2137120241 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5636da97d940 con 0x5636da979fc0 2023-12-18T10:23:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2137120241 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f7b240efd20 con 0x5636da979fc0 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b44b06000 10 client.7818 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b44b06000 10 client.7818 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b44b06000 20 client.7818 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x5636da9c06d0 0x5636da9c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b44b06000 4 client.7818 mds_command: new command op to 7557 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b44b06000 1 -- 172.21.15.133:0/2137120241 --> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5636da7926a0 con 0x5636da9c06d0 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b327fc640 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x5636da9c06d0 0x5636da9c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b327fc640 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x5636da9c06d0 0x5636da9c0ae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d3bd2ccd02a985e server_cookie=112e97214ece2776 in_seq=0 out_seq=0 2023-12-18T10:23:39.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.674+0000 7f7b19ffb640 10 client.7818 ms_handle_connect on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:39.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b19ffb640 1 -- 172.21.15.133:0/2137120241 <== mds.0 v2:172.21.15.133:6835/522841432 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5636da7926a0 con 0x5636da9c06d0 2023-12-18T10:23:39.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b19ffb640 10 client.7818 handle_command_reply: tid=0 2023-12-18T10:23:39.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 client.7818 shutdown 2023-12-18T10:23:39.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 -- 172.21.15.133:0/2137120241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 msgr2=0x5636daa1d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636daa1d530 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7b240eea10 tx=0x7f7b240f1040 comp rx=0 tx=0).stop 2023-12-18T10:23:39.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 -- 172.21.15.133:0/2137120241 shutdown_connections 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5636da9c45a0 0x5636da9c0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.133:6835/522841432,v1:172.21.15.133:6837/522841432] conn(0x5636da9c06d0 0x5636da9c0ae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5636da9c3c80 0x5636da9bfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 --2- 172.21.15.133:0/2137120241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5636da979fc0 0x5636daa1d530 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b19ffb640 0 client.7818 ms_handle_reset on v2:172.21.15.133:6835/522841432 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 -- 172.21.15.133:0/2137120241 >> 172.21.15.133:0/2137120241 conn(0x5636da778910 msgr2=0x5636da9d5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 -- 172.21.15.133:0/2137120241 shutdown_connections 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 1 -- 172.21.15.133:0/2137120241 wait complete. 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b44b06000 20 client.7818 trim_cache size 0 max 16384 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:39.691 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:23:39.692 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:23:39.692 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 -- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b1c065a90 msgr2=0x7f7b1c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b1c065a90 0x7f7b1c067f50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0cd430 tx=0x7f7b2c009190 comp rx=0 tx=0).stop 2023-12-18T10:23:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 -- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c0ce8d0 msgr2=0x7f7b3c0b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c0ce8d0 0x7f7b3c0b1c70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7b2401b470 tx=0x7f7b2401b600 comp rx=0 tx=0).stop 2023-12-18T10:23:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 -- 172.21.15.133:0/648120459 shutdown_connections 2023-12-18T10:23:39.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7b1c065a90 0x7f7b1c067f50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3c1598d0 0x7f7b3c0c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3c153020 0x7f7b3c0c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 --2- 172.21.15.133:0/648120459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b3c0ce8d0 0x7f7b3c0b1c70 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 -- 172.21.15.133:0/648120459 >> 172.21.15.133:0/648120459 conn(0x7f7b3c06a2a0 msgr2=0x7f7b3c0cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 -- 172.21.15.133:0/648120459 shutdown_connections 2023-12-18T10:23:39.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.690+0000 7f7b417a6640 1 -- 172.21.15.133:0/648120459 wait complete. 2023-12-18T10:23:39.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:1 flush journal 2023-12-18T10:23:39.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb1617b640 1 Processor -- start 2023-12-18T10:23:39.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb1617b640 1 -- start start 2023-12-18T10:23:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb1617b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdb100ca410 0x7fdb10159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb1617b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb100cbff0 0x7fdb100cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb1617b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb100cc930 con 0x7fdb10159fb0 2023-12-18T10:23:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb1617b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1015aab0 con 0x7fdb100ca410 2023-12-18T10:23:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb1617b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10070df0 con 0x7fdb100cbff0 2023-12-18T10:23:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdb100ca410 0x7fdb10159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdb100ca410 0x7fdb10159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:35630/0 (socket says 172.21.15.133:35630) 2023-12-18T10:23:39.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/3369611030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb100cbff0 0x7fdb100cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/3369611030 learned_addr learned my addr 172.21.15.133:0/3369611030 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0e7fc640 1 -- 172.21.15.133:0/3369611030 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508103731 0 0) 0x7fdb100cc930 con 0x7fdb10159fb0 2023-12-18T10:23:39.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0e7fc640 1 -- 172.21.15.133:0/3369611030 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf8003530 con 0x7fdb10159fb0 2023-12-18T10:23:39.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0ffff640 1 -- 172.21.15.133:0/3369611030 >> v2:172.21.15.142:3300/0 conn(0x7fdb100ca410 msgr2=0x7fdb10159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/3369611030 >> v2:172.21.15.142:3300/0 conn(0x7fdb100ca410 0x7fdb10159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0ffff640 1 -- 172.21.15.133:0/3369611030 >> v1:172.21.15.142:6789/0 conn(0x7fdb10159fb0 legacy=0x7fdb10071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0ffff640 1 -- 172.21.15.133:0/3369611030 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1015a4f0 con 0x7fdb100cbff0 2023-12-18T10:23:39.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.850+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/3369611030 >> v2:172.21.15.142:3300/0 conn(0x7fdb100ca410 0x7fdb10159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:39.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/3369611030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb100cbff0 0x7fdb100cc3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009d90 tx=0x7fdb0801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1180339b29778f68 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb0e7fc640 1 -- 172.21.15.133:0/3369611030 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080a59e0 con 0x7fdb100cbff0 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb0e7fc640 1 -- 172.21.15.133:0/3369611030 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb080a5b40 con 0x7fdb100cbff0 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb0e7fc640 1 -- 172.21.15.133:0/3369611030 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080ad440 con 0x7fdb100cbff0 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb1617b640 1 -- 172.21.15.133:0/3369611030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb100cbff0 msgr2=0x7fdb100cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb1617b640 1 --2- 172.21.15.133:0/3369611030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb100cbff0 0x7fdb100cc3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009d90 tx=0x7fdb0801c920 comp rx=0 tx=0).stop 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb1617b640 1 -- 172.21.15.133:0/3369611030 shutdown_connections 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb1617b640 1 --2- 172.21.15.133:0/3369611030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb100cbff0 0x7fdb100cc3f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb1617b640 1 --2- 172.21.15.133:0/3369611030 >> v2:172.21.15.142:3300/0 conn(0x7fdb100ca410 0x7fdb10159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb1617b640 1 -- 172.21.15.133:0/3369611030 >> 172.21.15.133:0/3369611030 conn(0x7fdb1006a2a0 msgr2=0x7fdb100aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb1617b640 1 -- 172.21.15.133:0/3369611030 shutdown_connections 2023-12-18T10:23:39.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.854+0000 7fdb1617b640 1 -- 172.21.15.133:0/3369611030 wait complete. 2023-12-18T10:23:39.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 Processor -- start 2023-12-18T10:23:39.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 -- start start 2023-12-18T10:23:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb100ca410 0x7fdb1015b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb100cbff0 0x7fdb10152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb10159fb0 0x7fdb100c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100a8560 con 0x7fdb100ca410 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1015be60 con 0x7fdb100cbff0 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100ad880 con 0x7fdb10159fb0 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb100ca410 0x7fdb1015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb100ca410 0x7fdb1015b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60950/0 (socket says 172.21.15.133:60950) 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/1419503754 learned_addr learned my addr 172.21.15.133:0/1419503754 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0effd640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb100cbff0 0x7fdb10152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb10159fb0 0x7fdb100c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/1419503754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb10159fb0 msgr2=0x7fdb100c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb10159fb0 0x7fdb100c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/1419503754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb100cbff0 msgr2=0x7fdb10152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb100cbff0 0x7fdb10152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/1419503754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb000094d0 con 0x7fdb100ca410 2023-12-18T10:23:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb100ca410 0x7fdb1015b920 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000e930 tx=0x7fdb0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdaf7fff640 1 -- 172.21.15.133:0/1419503754 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000ca00 con 0x7fdb100ca410 2023-12-18T10:23:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdaf7fff640 1 -- 172.21.15.133:0/1419503754 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000cb60 con 0x7fdb100ca410 2023-12-18T10:23:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 -- 172.21.15.133:0/1419503754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb08009a70 con 0x7fdb100ca410 2023-12-18T10:23:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdaf7fff640 1 -- 172.21.15.133:0/1419503754 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00013470 con 0x7fdb100ca410 2023-12-18T10:23:39.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.858+0000 7fdb1617b640 1 -- 172.21.15.133:0/1419503754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb100ad2c0 con 0x7fdb100ca410 2023-12-18T10:23:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdaf7fff640 1 -- 172.21.15.133:0/1419503754 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb000135d0 con 0x7fdb100ca410 2023-12-18T10:23:39.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdaf7fff640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdafc065a60 0x7fdafc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdaf7fff640 1 -- 172.21.15.133:0/1419503754 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb00083480 con 0x7fdb100ca410 2023-12-18T10:23:39.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdb0effd640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdafc065a60 0x7fdafc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdb194dd000 1 Processor -- start 2023-12-18T10:23:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdb0effd640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdafc065a60 0x7fdafc067f20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdb101563f0 tx=0x7fdb04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdb194dd000 1 -- start start 2023-12-18T10:23:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500cc80 0x55fd1500d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 0x55fd14fc2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.862+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd14fc33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd14e8b430 con 0x55fd1500cc80 2023-12-18T10:23:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd14e19460 con 0x55fd1500d5a0 2023-12-18T10:23:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd14e16a30 con 0x55fd14fc2fc0 2023-12-18T10:23:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500cc80 0x55fd1500d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500cc80 0x55fd1500d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60962/0 (socket says 172.21.15.133:60962) 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/2151180732 learned_addr learned my addr 172.21.15.133:0/2151180732 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0effd640 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 0x55fd14fc2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd14fc33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 msgr2=0x55fd14fc33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd14fc33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 msgr2=0x55fd14fc2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 0x55fd14fc2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/2151180732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd14b0ee20 con 0x55fd1500cc80 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd14fc33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500cc80 0x55fd1500d060 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fdb0005c460 tx=0x7fdb000543c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43c512636f992d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdaf57fa640 1 -- 172.21.15.133:0/2151180732 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0005c990 con 0x55fd1500cc80 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdaf57fa640 1 -- 172.21.15.133:0/2151180732 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb00052e00 con 0x55fd1500cc80 2023-12-18T10:23:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdaf57fa640 1 -- 172.21.15.133:0/2151180732 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000830b0 con 0x55fd1500cc80 2023-12-18T10:23:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- 172.21.15.133:0/2151180732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500cc80 msgr2=0x55fd1500d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500cc80 0x55fd1500d060 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fdb0005c460 tx=0x7fdb000543c0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- 172.21.15.133:0/2151180732 shutdown_connections 2023-12-18T10:23:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd14fc33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 0x55fd14fc2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 --2- 172.21.15.133:0/2151180732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500cc80 0x55fd1500d060 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- 172.21.15.133:0/2151180732 >> 172.21.15.133:0/2151180732 conn(0x55fd14dc1910 msgr2=0x55fd14fc1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- 172.21.15.133:0/2151180732 shutdown_connections 2023-12-18T10:23:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- 172.21.15.133:0/2151180732 wait complete. 2023-12-18T10:23:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- start start 2023-12-18T10:23:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 Processor -- start 2023-12-18T10:23:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd1500c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500cc80 0x55fd1500d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 0x55fd1500dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd14e12320 con 0x55fd14fc2fc0 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd14db14f0 con 0x55fd1500d5a0 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd14dcf6e0 con 0x55fd1500cc80 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.866+0000 7fdb194dd000 10 client.0 _ll_register_callbacks cb 0x55fd14fae980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd1500c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd1500c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60976/0 (socket says 172.21.15.133:60976) 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/1214025219 learned_addr learned my addr 172.21.15.133:0/1214025219 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0effd640 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500cc80 0x55fd1500d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 0x55fd1500dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/1214025219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500cc80 msgr2=0x55fd1500d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500cc80 0x55fd1500d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/1214025219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 msgr2=0x55fd1500dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 0x55fd1500dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/1214025219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb100ad2c0 con 0x55fd14fc2fc0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd1500c230 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fdb00083010 tx=0x7fdb00000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bc044dca90402a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 1 -- 172.21.15.133:0/1214025219 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000832b0 con 0x55fd14fc2fc0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 1 -- 172.21.15.133:0/1214025219 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb00053f50 con 0x55fd14fc2fc0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 -- 172.21.15.133:0/1214025219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd14dcf120 con 0x55fd14fc2fc0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 1 -- 172.21.15.133:0/1214025219 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb00054110 con 0x55fd14fc2fc0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 10 client.7827 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 -- 172.21.15.133:0/1214025219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55fd14dd7250 con 0x55fd14fc2fc0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 1 -- 172.21.15.133:0/1214025219 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb00071030 con 0x55fd14fc2fc0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 1 -- 172.21.15.133:0/1214025219 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fdb00011070 con 0x55fd14fc2fc0 2023-12-18T10:23:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 10 client.7827 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 10 client.7827 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.a 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 20 client.7827 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fd1500e8d0 0x55fd1500ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 4 client.7827 mds_command: new command op to 7099 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 -- 172.21.15.133:0/1214025219 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd14e10c70 con 0x55fd1500e8d0 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0effd640 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fd1500e8d0 0x55fd1500ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb0effd640 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fd1500e8d0 0x55fd1500ece0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f15dcdeac5a6430 server_cookie=bb33be611763b9e6 in_seq=0 out_seq=0 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 10 client.7827 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 1 -- 172.21.15.133:0/1214025219 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55fd14e10c70 con 0x55fd1500e8d0 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 10 client.7827 handle_command_reply: tid=0 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 client.7827 shutdown 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 -- 172.21.15.133:0/1214025219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 msgr2=0x55fd1500c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd1500c230 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fdb00083010 tx=0x7fdb00000bd0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 -- 172.21.15.133:0/1214025219 shutdown_connections 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fd1500e8d0 0x55fd1500ece0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500d5a0 0x55fd1500dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500cc80 0x55fd1500d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdaee7fc640 0 client.7827 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1214025219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd1500c230 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 -- 172.21.15.133:0/1214025219 >> 172.21.15.133:0/1214025219 conn(0x55fd14dc1910 msgr2=0x55fd14fc1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 -- 172.21.15.133:0/1214025219 shutdown_connections 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 1 -- 172.21.15.133:0/1214025219 wait complete. 2023-12-18T10:23:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.870+0000 7fdb194dd000 20 client.7827 trim_cache size 0 max 16384 2023-12-18T10:23:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.882+0000 7fdb194dd000 1 Processor -- start 2023-12-18T10:23:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.882+0000 7fdb194dd000 1 -- start start 2023-12-18T10:23:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd1500b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1500b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500d5a0 0x55fd1501d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd14acfaa0 con 0x55fd1500d5a0 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd14e1a6f0 con 0x55fd1500cc80 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd14fc2ae0 con 0x55fd14fc2fc0 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500d5a0 0x55fd1501d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500d5a0 0x55fd1501d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60984/0 (socket says 172.21.15.133:60984) 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 -- 172.21.15.133:0/1024418463 learned_addr learned my addr 172.21.15.133:0/1024418463 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0effd640 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1500b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd1500b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 -- 172.21.15.133:0/1024418463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 msgr2=0x55fd1500b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd1500b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 -- 172.21.15.133:0/1024418463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 msgr2=0x55fd1500b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1500b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 -- 172.21.15.133:0/1024418463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd14dbd5a0 con 0x55fd1500d5a0 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500d5a0 0x55fd1501d010 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009d90 tx=0x7fdb08004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1388799efbafdaa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdaf5ffb640 1 -- 172.21.15.133:0/1024418463 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080be070 con 0x55fd1500d5a0 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdaf5ffb640 1 -- 172.21.15.133:0/1024418463 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb080a58f0 con 0x55fd1500d5a0 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdaf5ffb640 1 -- 172.21.15.133:0/1024418463 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080ad660 con 0x55fd1500d5a0 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- 172.21.15.133:0/1024418463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500d5a0 msgr2=0x55fd1501d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500d5a0 0x55fd1501d010 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009d90 tx=0x7fdb08004ac0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- 172.21.15.133:0/1024418463 shutdown_connections 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd1500d5a0 0x55fd1501d010 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1500b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 --2- 172.21.15.133:0/1024418463 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd14fc2fc0 0x55fd1500b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- 172.21.15.133:0/1024418463 >> 172.21.15.133:0/1024418463 conn(0x55fd14dc1910 msgr2=0x55fd15019c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- 172.21.15.133:0/1024418463 shutdown_connections 2023-12-18T10:23:39.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- 172.21.15.133:0/1024418463 wait complete. 2023-12-18T10:23:39.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 -- start start 2023-12-18T10:23:39.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.886+0000 7fdb194dd000 1 Processor -- start 2023-12-18T10:23:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd15066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1501fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500d5a0 0x55fd150202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd14fc7770 con 0x55fd14fc2fc0 2023-12-18T10:23:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd14ee1140 con 0x55fd1500cc80 2023-12-18T10:23:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd14dd0480 con 0x55fd1500d5a0 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 10 client.0 _ll_register_callbacks cb 0x55fd14dc9710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd15066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd15066bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52972/0 (socket says 172.21.15.133:52972) 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/3287453358 learned_addr learned my addr 172.21.15.133:0/3287453358 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0effd640 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1501fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0ffff640 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500d5a0 0x55fd150202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500d5a0 msgr2=0x55fd150202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500d5a0 0x55fd150202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 msgr2=0x55fd1501fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1501fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 -- 172.21.15.133:0/3287453358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1015a4f0 con 0x55fd14fc2fc0 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0effd640 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1501fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0f7fe640 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd15066bd0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fdb0005c460 tx=0x7fdb0000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60beb0a80b86b40b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdaee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdaee7fc640 1 -- 172.21.15.133:0/3287453358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00083240 con 0x55fd14fc2fc0 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdaee7fc640 1 -- 172.21.15.133:0/3287453358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb00054a60 con 0x55fd14fc2fc0 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 -- 172.21.15.133:0/3287453358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd14fc6940 con 0x55fd14fc2fc0 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdaee7fc640 1 -- 172.21.15.133:0/3287453358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb0005c500 con 0x55fd14fc2fc0 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 10 client.7833 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 -- 172.21.15.133:0/3287453358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55fd14db1110 con 0x55fd14fc2fc0 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdaee7fc640 1 -- 172.21.15.133:0/3287453358 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fd14fc6940 con 0x55fd14fc2fc0 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdaee7fc640 1 -- 172.21.15.133:0/3287453358 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fdb0006f070 con 0x55fd14fc2fc0 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 10 client.7833 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 10 client.7833 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.a 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 20 client.7833 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fd15020810 0x55fd15020c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 4 client.7833 mds_command: new command op to 7099 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:23:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb194dd000 1 -- 172.21.15.133:0/3287453358 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fd14ddb6a0 con 0x55fd15020810 2023-12-18T10:23:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0effd640 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fd15020810 0x55fd15020c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdaee7fc640 10 client.7833 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.890+0000 7fdb0effd640 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fd15020810 0x55fd15020c20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=431b1671c251dcbd server_cookie=6aca859880e95d5e in_seq=0 out_seq=0 2023-12-18T10:23:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdaee7fc640 1 -- 172.21.15.133:0/3287453358 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fd14ddb6a0 con 0x55fd15020810 2023-12-18T10:23:39.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdaee7fc640 10 client.7833 handle_command_reply: tid=0 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 client.7833 shutdown 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 -- 172.21.15.133:0/3287453358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 msgr2=0x55fd15066bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd15066bd0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fdb0005c460 tx=0x7fdb0000cef0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 -- 172.21.15.133:0/3287453358 shutdown_connections 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fd15020810 0x55fd15020c20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fd1500d5a0 0x55fd150202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fd1500cc80 0x55fd1501fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 --2- 172.21.15.133:0/3287453358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fd14fc2fc0 0x55fd15066bd0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdaee7fc640 0 client.7833 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 -- 172.21.15.133:0/3287453358 >> 172.21.15.133:0/3287453358 conn(0x55fd14dc1910 msgr2=0x55fd1500a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 -- 172.21.15.133:0/3287453358 shutdown_connections 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 1 -- 172.21.15.133:0/3287453358 wait complete. 2023-12-18T10:23:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb194dd000 20 client.7833 trim_cache size 0 max 16384 2023-12-18T10:23:39.904 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:39.904 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:23:39.904 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:23:39.904 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 -- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdafc065a60 msgr2=0x7fdafc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdafc065a60 0x7fdafc067f20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdb101563f0 tx=0x7fdb04009040 comp rx=0 tx=0).stop 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 -- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb100ca410 msgr2=0x7fdb1015b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb100ca410 0x7fdb1015b920 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000e930 tx=0x7fdb0000edf0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 -- 172.21.15.133:0/1419503754 shutdown_connections 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdafc065a60 0x7fdafc067f20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb10159fb0 0x7fdb100c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb100cbff0 0x7fdb10152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 --2- 172.21.15.133:0/1419503754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb100ca410 0x7fdb1015b920 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 -- 172.21.15.133:0/1419503754 >> 172.21.15.133:0/1419503754 conn(0x7fdb1006a2a0 msgr2=0x7fdb100aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 -- 172.21.15.133:0/1419503754 shutdown_connections 2023-12-18T10:23:39.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:39.902+0000 7fdb1617b640 1 -- 172.21.15.133:0/1419503754 wait complete. 2023-12-18T10:23:39.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:2 flush journal 2023-12-18T10:23:40.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.062+0000 7f34acee5640 1 Processor -- start 2023-12-18T10:23:40.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.062+0000 7f34acee5640 1 -- start start 2023-12-18T10:23:40.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34acee5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34a815cae0 0x7f34a80d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34acee5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cf880 0x7f34a80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34acee5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a815cec0 con 0x7f34a80cde90 2023-12-18T10:23:40.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34acee5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a80d0530 con 0x7f34a815cae0 2023-12-18T10:23:40.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34acee5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80d0810 con 0x7f34a80cf880 2023-12-18T10:23:40.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34a659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34a815cae0 0x7f34a80d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f349ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f34a80cde90 0x7f34a80cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39976/0 (socket says 172.21.15.133:39976) 2023-12-18T10:23:40.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f349ffff640 1 -- 172.21.15.133:0/674977294 learned_addr learned my addr 172.21.15.133:0/674977294 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:40.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/674977294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cf880 0x7f34a80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34a659c640 1 -- 172.21.15.133:0/674977294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cf880 msgr2=0x7f34a80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34a659c640 1 --2- 172.21.15.133:0/674977294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cf880 0x7f34a80ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34a659c640 1 -- 172.21.15.133:0/674977294 >> v1:172.21.15.133:6789/0 conn(0x7f34a80cde90 legacy=0x7f34a80cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34a659c640 1 -- 172.21.15.133:0/674977294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80d0af0 con 0x7f34a815cae0 2023-12-18T10:23:40.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34a5d9b640 1 -- 172.21.15.133:0/674977294 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781902036 0 0) 0x7f34a815cec0 con 0x7f34a80cde90 2023-12-18T10:23:40.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.066+0000 7f34a659c640 1 --2- 172.21.15.133:0/674977294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80d12f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f34980097a0 tx=0x7f349801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10353695ea8e25a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34a5d9b640 1 -- 172.21.15.133:0/674977294 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34980ac620 con 0x7f34a815cae0 2023-12-18T10:23:40.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34a5d9b640 1 -- 172.21.15.133:0/674977294 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34980ac780 con 0x7f34a815cae0 2023-12-18T10:23:40.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34a5d9b640 1 -- 172.21.15.133:0/674977294 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34980acb10 con 0x7f34a815cae0 2023-12-18T10:23:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- 172.21.15.133:0/674977294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 msgr2=0x7f34a80d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 --2- 172.21.15.133:0/674977294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80d12f0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f34980097a0 tx=0x7f349801c430 comp rx=0 tx=0).stop 2023-12-18T10:23:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- 172.21.15.133:0/674977294 shutdown_connections 2023-12-18T10:23:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 --2- 172.21.15.133:0/674977294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cf880 0x7f34a80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 --2- 172.21.15.133:0/674977294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80d12f0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- 172.21.15.133:0/674977294 >> 172.21.15.133:0/674977294 conn(0x7f34a8089fb0 msgr2=0x7f34a80d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- 172.21.15.133:0/674977294 shutdown_connections 2023-12-18T10:23:40.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- 172.21.15.133:0/674977294 wait complete. 2023-12-18T10:23:40.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 Processor -- start 2023-12-18T10:23:40.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- start start 2023-12-18T10:23:40.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cde90 0x7f34a80c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a80cf880 0x7f34a80cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c8cc0 con 0x7f34a815cae0 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c6740 con 0x7f34a80cf880 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34acee5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c6a20 con 0x7f34a80cde90 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34a6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34a6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53000/0 (socket says 172.21.15.133:53000) 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34a6d9d640 1 -- 172.21.15.133:0/372738177 learned_addr learned my addr 172.21.15.133:0/372738177 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f349ffff640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a80cf880 0x7f34a80cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.070+0000 7f34a659c640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cde90 0x7f34a80c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f34a6d9d640 1 -- 172.21.15.133:0/372738177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cde90 msgr2=0x7f34a80c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cde90 0x7f34a80c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f34a6d9d640 1 -- 172.21.15.133:0/372738177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a80cf880 msgr2=0x7f34a80cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a80cf880 0x7f34a80cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f34a6d9d640 1 -- 172.21.15.133:0/372738177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980093b0 con 0x7f34a815cae0 2023-12-18T10:23:40.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80cc290 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f34a0007d80 tx=0x7f34a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f349effd640 1 -- 172.21.15.133:0/372738177 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0014420 con 0x7f34a815cae0 2023-12-18T10:23:40.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f349effd640 1 -- 172.21.15.133:0/372738177 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0014580 con 0x7f34a815cae0 2023-12-18T10:23:40.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f349effd640 1 -- 172.21.15.133:0/372738177 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0014930 con 0x7f34a815cae0 2023-12-18T10:23:40.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f34acee5640 1 -- 172.21.15.133:0/372738177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a80c6d00 con 0x7f34a815cae0 2023-12-18T10:23:40.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f34acee5640 1 -- 172.21.15.133:0/372738177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a80c62f0 con 0x7f34a815cae0 2023-12-18T10:23:40.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.074+0000 7f349effd640 1 -- 172.21.15.133:0/372738177 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34a0014a90 con 0x7f34a815cae0 2023-12-18T10:23:40.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349effd640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3488065a60 0x7f3488067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349effd640 1 -- 172.21.15.133:0/372738177 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f34a0083b90 con 0x7f34a815cae0 2023-12-18T10:23:40.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34a659c640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3488065a60 0x7f3488067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 Processor -- start 2023-12-18T10:23:40.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 -- start start 2023-12-18T10:23:40.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34a659c640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3488065a60 0x7f3488067f20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f34980ae000 tx=0x7f34980a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 0x56171a1a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a155a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56171a01e430 con 0x56171a1a05a0 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561719fac460 con 0x56171a155fc0 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561719fa9a30 con 0x56171a19fc80 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53008/0 (socket says 172.21.15.133:53008) 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 -- 172.21.15.133:0/1201885802 learned_addr learned my addr 172.21.15.133:0/1201885802 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34a659c640 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 0x56171a1a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 -- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 msgr2=0x56171a1a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 0x56171a1a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 -- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 msgr2=0x56171a1563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 -- 172.21.15.133:0/1201885802 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561719ca1e20 con 0x56171a1a05a0 2023-12-18T10:23:40.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:40.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f349ffff640 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a155a80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f34900011f0 tx=0x7f3490004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4651ce1f3020c0b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f3487fff640 1 -- 172.21.15.133:0/1201885802 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900018e0 con 0x56171a1a05a0 2023-12-18T10:23:40.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f3487fff640 1 -- 172.21.15.133:0/1201885802 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490001a40 con 0x56171a1a05a0 2023-12-18T10:23:40.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f3487fff640 1 -- 172.21.15.133:0/1201885802 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490012350 con 0x56171a1a05a0 2023-12-18T10:23:40.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 -- 172.21.15.133:0/1201885802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 msgr2=0x56171a155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a155a80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f34900011f0 tx=0x7f3490004bc0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 -- 172.21.15.133:0/1201885802 shutdown_connections 2023-12-18T10:23:40.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a155a80 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.078+0000 7f34b023d000 1 --2- 172.21.15.133:0/1201885802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 0x56171a1a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- 172.21.15.133:0/1201885802 >> 172.21.15.133:0/1201885802 conn(0x561719f54910 msgr2=0x56171a154360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- 172.21.15.133:0/1201885802 shutdown_connections 2023-12-18T10:23:40.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- 172.21.15.133:0/1201885802 wait complete. 2023-12-18T10:23:40.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- start start 2023-12-18T10:23:40.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 Processor -- start 2023-12-18T10:23:40.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1a0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a1a05a0 0x56171a1a1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561719fa5320 con 0x56171a19fc80 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561719f444f0 con 0x56171a155fc0 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561719f626e0 con 0x56171a1a05a0 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 10 client.0 _ll_register_callbacks cb 0x56171a141980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34a659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1a0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53010/0 (socket says 172.21.15.133:53010) 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 -- 172.21.15.133:0/2422821077 learned_addr learned my addr 172.21.15.133:0/2422821077 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a1a05a0 0x56171a1a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 -- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a1a05a0 msgr2=0x56171a1a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a1a05a0 0x56171a1a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 -- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 msgr2=0x56171a1a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 -- 172.21.15.133:0/2422821077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a80c62f0 con 0x56171a19fc80 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34a659c640 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f349ffff640 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1a0ec0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3490007830 tx=0x7f3490000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599ccce3242d06c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34857fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34857fa640 1 -- 172.21.15.133:0/2422821077 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490014860 con 0x56171a19fc80 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34857fa640 1 -- 172.21.15.133:0/2422821077 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f34900149c0 con 0x56171a19fc80 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- 172.21.15.133:0/2422821077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561719f62120 con 0x56171a19fc80 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34857fa640 1 -- 172.21.15.133:0/2422821077 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3490014bc0 con 0x56171a19fc80 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 10 client.7848 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.082+0000 7f34b023d000 1 -- 172.21.15.133:0/2422821077 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x7f34900072f0 con 0x56171a19fc80 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34857fa640 1 -- 172.21.15.133:0/2422821077 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561719f62120 con 0x56171a19fc80 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34857fa640 1 -- 172.21.15.133:0/2422821077 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3490028070 con 0x56171a19fc80 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 10 client.7848 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:40.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 10 client.7848 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.d 2023-12-18T10:23:40.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 20 client.7848 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:40.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x56171a1af840 0x56171a1b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 4 client.7848 mds_command: new command op to 7096 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:40.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 -- 172.21.15.133:0/2422821077 --> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561719fa3c70 con 0x56171a1af840 2023-12-18T10:23:40.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34a659c640 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x56171a1af840 0x56171a1b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34a659c640 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x56171a1af840 0x56171a1b1c30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d790265f13512210 server_cookie=1843f0a447c81798 in_seq=0 out_seq=0 2023-12-18T10:23:40.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34857fa640 10 client.7848 ms_handle_connect on v2:172.21.15.142:6832/1237569557 2023-12-18T10:23:40.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34857fa640 1 -- 172.21.15.133:0/2422821077 <== mds.2 v2:172.21.15.142:6832/1237569557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561719fa3c70 con 0x56171a1af840 2023-12-18T10:23:40.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34857fa640 10 client.7848 handle_command_reply: tid=0 2023-12-18T10:23:40.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 client.7848 shutdown 2023-12-18T10:23:40.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 -- 172.21.15.133:0/2422821077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 msgr2=0x56171a1a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1a0ec0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3490007830 tx=0x7f3490000ee0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 -- 172.21.15.133:0/2422821077 shutdown_connections 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x56171a1af840 0x56171a1b1c30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a1a05a0 0x56171a1a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1a0ec0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 --2- 172.21.15.133:0/2422821077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a1a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34857fa640 0 client.7848 ms_handle_reset on v2:172.21.15.142:6832/1237569557 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 -- 172.21.15.133:0/2422821077 >> 172.21.15.133:0/2422821077 conn(0x561719f54910 msgr2=0x56171a154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 -- 172.21.15.133:0/2422821077 shutdown_connections 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 1 -- 172.21.15.133:0/2422821077 wait complete. 2023-12-18T10:23:40.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.086+0000 7f34b023d000 20 client.7848 trim_cache size 0 max 16384 2023-12-18T10:23:40.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.098+0000 7f34b023d000 1 Processor -- start 2023-12-18T10:23:40.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.098+0000 7f34b023d000 1 -- start start 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.098+0000 7f34b023d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a155fc0 0x56171a1b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.098+0000 7f34b023d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.098+0000 7f34b023d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a1a05a0 0x56171a199010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.098+0000 7f34b023d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561719c62aa0 con 0x56171a19fc80 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.098+0000 7f34b023d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561719f63480 con 0x56171a1a05a0 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.098+0000 7f34b023d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56171a1ac3f0 con 0x56171a155fc0 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53016/0 (socket says 172.21.15.133:53016) 2023-12-18T10:23:40.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 -- 172.21.15.133:0/4190705230 learned_addr learned my addr 172.21.15.133:0/4190705230 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a1a05a0 0x56171a199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34a659c640 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a155fc0 0x56171a1b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 -- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a155fc0 msgr2=0x56171a1b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a155fc0 0x56171a1b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 -- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a1a05a0 msgr2=0x56171a199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a1a05a0 0x56171a199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 -- 172.21.15.133:0/4190705230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561719f6a250 con 0x56171a19fc80 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34a659c640 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a155fc0 0x56171a1b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1b3890 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3490029a60 tx=0x7f3490020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca5d16bc21a4343 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349cff9640 1 -- 172.21.15.133:0/4190705230 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490029ae0 con 0x56171a19fc80 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349cff9640 1 -- 172.21.15.133:0/4190705230 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490029c40 con 0x56171a19fc80 2023-12-18T10:23:40.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349cff9640 1 -- 172.21.15.133:0/4190705230 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900293a0 con 0x56171a19fc80 2023-12-18T10:23:40.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- 172.21.15.133:0/4190705230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 msgr2=0x56171a1b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1b3890 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3490029a60 tx=0x7f3490020000 comp rx=0 tx=0).stop 2023-12-18T10:23:40.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- 172.21.15.133:0/4190705230 shutdown_connections 2023-12-18T10:23:40.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a1a05a0 0x56171a199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a19fc80 0x56171a1b3890 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 --2- 172.21.15.133:0/4190705230 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a155fc0 0x56171a1b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- 172.21.15.133:0/4190705230 >> 172.21.15.133:0/4190705230 conn(0x561719f54910 msgr2=0x56171a1b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- 172.21.15.133:0/4190705230 shutdown_connections 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- 172.21.15.133:0/4190705230 wait complete. 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- start start 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 Processor -- start 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a19c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 0x56171a19c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56171a15a480 con 0x56171a1a05a0 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56171a074140 con 0x56171a155fc0 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561719fa2720 con 0x56171a19fc80 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34b023d000 10 client.0 _ll_register_callbacks cb 0x561719f5c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34a6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34a659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a19c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34a6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53024/0 (socket says 172.21.15.133:53024) 2023-12-18T10:23:40.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f34a6d9d640 1 -- 172.21.15.133:0/963953176 learned_addr learned my addr 172.21.15.133:0/963953176 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.102+0000 7f349ffff640 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 0x56171a19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34a6d9d640 1 -- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 msgr2=0x56171a19c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 0x56171a19c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34a6d9d640 1 -- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 msgr2=0x56171a19c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a19c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34a6d9d640 1 -- 172.21.15.133:0/963953176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900072f0 con 0x56171a1a05a0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34a6d9d640 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a19cc70 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f34a0055070 tx=0x7f34a005b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2d310ca52bee71 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34857fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34857fa640 1 -- 172.21.15.133:0/963953176 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a005cd80 con 0x56171a1a05a0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34857fa640 1 -- 172.21.15.133:0/963953176 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f34a0053540 con 0x56171a1a05a0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 1 -- 172.21.15.133:0/963953176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56171a1598e0 con 0x56171a1a05a0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34857fa640 1 -- 172.21.15.133:0/963953176 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34a0059ba0 con 0x56171a1a05a0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 10 client.7854 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 1 -- 172.21.15.133:0/963953176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x561719f505a0 con 0x56171a1a05a0 2023-12-18T10:23:40.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34857fa640 1 -- 172.21.15.133:0/963953176 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56171a1598e0 con 0x56171a1a05a0 2023-12-18T10:23:40.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34857fa640 1 -- 172.21.15.133:0/963953176 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f34a0005d20 con 0x56171a1a05a0 2023-12-18T10:23:40.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 10 client.7854 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:40.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 10 client.7854 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.d 2023-12-18T10:23:40.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 20 client.7854 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:40.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x56171a19d1b0 0x56171a19d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 4 client.7854 mds_command: new command op to 7096 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:23:40.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34b023d000 1 -- 172.21.15.133:0/963953176 --> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561719f6e6a0 con 0x56171a19d1b0 2023-12-18T10:23:40.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34a659c640 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x56171a19d1b0 0x56171a19d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34a659c640 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x56171a19d1b0 0x56171a19d590 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aeda39b5369f0ddd server_cookie=3b2bce3a05320ac2 in_seq=0 out_seq=0 2023-12-18T10:23:40.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.106+0000 7f34857fa640 10 client.7854 ms_handle_connect on v2:172.21.15.142:6832/1237569557 2023-12-18T10:23:40.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34857fa640 1 -- 172.21.15.133:0/963953176 <== mds.2 v2:172.21.15.142:6832/1237569557 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561719f6e6a0 con 0x56171a19d1b0 2023-12-18T10:23:40.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34857fa640 10 client.7854 handle_command_reply: tid=0 2023-12-18T10:23:40.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 client.7854 shutdown 2023-12-18T10:23:40.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 -- 172.21.15.133:0/963953176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 msgr2=0x56171a19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a19cc70 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f34a0055070 tx=0x7f34a005b050 comp rx=0 tx=0).stop 2023-12-18T10:23:40.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 -- 172.21.15.133:0/963953176 shutdown_connections 2023-12-18T10:23:40.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:6832/1237569557,v1:172.21.15.142:6834/1237569557] conn(0x56171a19d1b0 0x56171a19d590 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56171a1a05a0 0x56171a19cc70 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56171a19fc80 0x56171a19c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34857fa640 0 client.7854 ms_handle_reset on v2:172.21.15.142:6832/1237569557 2023-12-18T10:23:40.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 --2- 172.21.15.133:0/963953176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56171a155fc0 0x56171a19c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 -- 172.21.15.133:0/963953176 >> 172.21.15.133:0/963953176 conn(0x561719f54910 msgr2=0x56171a1b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 -- 172.21.15.133:0/963953176 shutdown_connections 2023-12-18T10:23:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 1 -- 172.21.15.133:0/963953176 wait complete. 2023-12-18T10:23:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.114+0000 7f34b023d000 20 client.7854 trim_cache size 0 max 16384 2023-12-18T10:23:40.117 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:23:40.117 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:23:40.117 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:23:40.117 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 -- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3488065a60 msgr2=0x7f3488067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3488065a60 0x7f3488067f20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f34980ae000 tx=0x7f34980a7000 comp rx=0 tx=0).stop 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 -- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 msgr2=0x7f34a80cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80cc290 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f34a0007d80 tx=0x7f34a000e4b0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 -- 172.21.15.133:0/372738177 shutdown_connections 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3488065a60 0x7f3488067f20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34a815cae0 0x7f34a80cc290 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34a80cf880 0x7f34a80cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 --2- 172.21.15.133:0/372738177 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34a80cde90 0x7f34a80c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 -- 172.21.15.133:0/372738177 >> 172.21.15.133:0/372738177 conn(0x7f34a8089fb0 msgr2=0x7f34a80cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 -- 172.21.15.133:0/372738177 shutdown_connections 2023-12-18T10:23:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.118+0000 7f34acee5640 1 -- 172.21.15.133:0/372738177 wait complete. 2023-12-18T10:23:40.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:40.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd2723e9640 1 Processor -- start 2023-12-18T10:23:40.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd2723e9640 1 -- start start 2023-12-18T10:23:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd2723e9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd26c0cf0d0 0x7fd26c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd2723e9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c0cfa70 con 0x7fd26c1648d0 2023-12-18T10:23:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd2723e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26c0d11c0 con 0x7fd26c15ca40 2023-12-18T10:23:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd2723e9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26c0d0310 con 0x7fd26c0cf0d0 2023-12-18T10:23:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd270986640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd26c1648d0 0x7fd26c166cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39984/0 (socket says 172.21.15.133:39984) 2023-12-18T10:23:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd270986640 1 -- 172.21.15.133:0/2500652621 learned_addr learned my addr 172.21.15.133:0/2500652621 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd26b7fe640 1 --2- 172.21.15.133:0/2500652621 >> v2:172.21.15.142:3300/0 conn(0x7fd26c0cf0d0 0x7fd26c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd26affd640 1 -- 172.21.15.133:0/2500652621 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291033222 0 0) 0x7fd26c0cfa70 con 0x7fd26c1648d0 2023-12-18T10:23:40.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd26affd640 1 -- 172.21.15.133:0/2500652621 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd254003530 con 0x7fd26c1648d0 2023-12-18T10:23:40.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd26affd640 1 -- 172.21.15.133:0/2500652621 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8478823 0 0) 0x7fd26c0d11c0 con 0x7fd26c15ca40 2023-12-18T10:23:40.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd26affd640 1 -- 172.21.15.133:0/2500652621 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd26c0cfa70 con 0x7fd26c15ca40 2023-12-18T10:23:40.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd26b7fe640 1 -- 172.21.15.133:0/2500652621 >> v1:172.21.15.142:6789/0 conn(0x7fd26c15ca40 legacy=0x7fd26c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd26b7fe640 1 -- 172.21.15.133:0/2500652621 >> v1:172.21.15.133:6789/0 conn(0x7fd26c1648d0 legacy=0x7fd26c166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.274+0000 7fd26b7fe640 1 -- 172.21.15.133:0/2500652621 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c0d05b0 con 0x7fd26c0cf0d0 2023-12-18T10:23:40.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd26b7fe640 1 --2- 172.21.15.133:0/2500652621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c0cf0d0 0x7fd26c0cf530 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd2600097a0 tx=0x7fd26001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f93932cacf8a6175 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd26affd640 1 -- 172.21.15.133:0/2500652621 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600a7070 con 0x7fd26c0cf0d0 2023-12-18T10:23:40.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd26affd640 1 -- 172.21.15.133:0/2500652621 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2600ab430 con 0x7fd26c0cf0d0 2023-12-18T10:23:40.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd26affd640 1 -- 172.21.15.133:0/2500652621 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600ab7a0 con 0x7fd26c0cf0d0 2023-12-18T10:23:40.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd2723e9640 1 -- 172.21.15.133:0/2500652621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c0cf0d0 msgr2=0x7fd26c0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd2723e9640 1 --2- 172.21.15.133:0/2500652621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c0cf0d0 0x7fd26c0cf530 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd2600097a0 tx=0x7fd26001c430 comp rx=0 tx=0).stop 2023-12-18T10:23:40.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd2723e9640 1 -- 172.21.15.133:0/2500652621 shutdown_connections 2023-12-18T10:23:40.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd2723e9640 1 --2- 172.21.15.133:0/2500652621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c0cf0d0 0x7fd26c0cf530 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd2723e9640 1 -- 172.21.15.133:0/2500652621 >> 172.21.15.133:0/2500652621 conn(0x7fd26c089fb0 msgr2=0x7fd26c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd2723e9640 1 -- 172.21.15.133:0/2500652621 shutdown_connections 2023-12-18T10:23:40.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.278+0000 7fd2723e9640 1 -- 172.21.15.133:0/2500652621 wait complete. 2023-12-18T10:23:40.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 Processor -- start 2023-12-18T10:23:40.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 -- start start 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd26c0cf0d0 0x7fd26c15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c15ca40 0x7fd26c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd26c1648d0 0x7fd26c0c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c15e500 con 0x7fd26c1648d0 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c15d8f0 con 0x7fd26c15ca40 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26c15dbd0 con 0x7fd26c0cf0d0 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd26c1648d0 0x7fd26c0c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd26c1648d0 0x7fd26c0c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53034/0 (socket says 172.21.15.133:53034) 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 -- 172.21.15.133:0/2789311016 learned_addr learned my addr 172.21.15.133:0/2789311016 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd26b7fe640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c15ca40 0x7fd26c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd26bfff640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd26c0cf0d0 0x7fd26c15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 -- 172.21.15.133:0/2789311016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd26c0cf0d0 msgr2=0x7fd26c15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd26c0cf0d0 0x7fd26c15cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 -- 172.21.15.133:0/2789311016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c15ca40 msgr2=0x7fd26c0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c15ca40 0x7fd26c0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 -- 172.21.15.133:0/2789311016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600093b0 con 0x7fd26c1648d0 2023-12-18T10:23:40.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd270986640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd26c1648d0 0x7fd26c0c6250 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fd26400ca80 tx=0x7fd26400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd268ff9640 1 -- 172.21.15.133:0/2789311016 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26400ab40 con 0x7fd26c1648d0 2023-12-18T10:23:40.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd268ff9640 1 -- 172.21.15.133:0/2789311016 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26400aca0 con 0x7fd26c1648d0 2023-12-18T10:23:40.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd268ff9640 1 -- 172.21.15.133:0/2789311016 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd264012620 con 0x7fd26c1648d0 2023-12-18T10:23:40.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd26c15deb0 con 0x7fd26c1648d0 2023-12-18T10:23:40.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.282+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd26c15d4e0 con 0x7fd26c1648d0 2023-12-18T10:23:40.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.286+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26c04e000 con 0x7fd26c1648d0 2023-12-18T10:23:40.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.286+0000 7fd268ff9640 1 -- 172.21.15.133:0/2789311016 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd264007070 con 0x7fd26c1648d0 2023-12-18T10:23:40.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.286+0000 7fd268ff9640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd258065a60 0x7fd258067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.286+0000 7fd268ff9640 1 -- 172.21.15.133:0/2789311016 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd264083090 con 0x7fd26c1648d0 2023-12-18T10:23:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.286+0000 7fd26bfff640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd258065a60 0x7fd258067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.286+0000 7fd26bfff640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd258065a60 0x7fd258067f20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0016b0 tx=0x7fd25c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.290+0000 7fd268ff9640 1 -- 172.21.15.133:0/2789311016 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd2640509b0 con 0x7fd26c1648d0 2023-12-18T10:23:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.470+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd26c15e640 con 0x7fd26c1648d0 2023-12-18T10:23:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.470+0000 7fd268ff9640 1 -- 172.21.15.133:0/2789311016 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4752 (secure 0 0 0) 0x7fd264017090 con 0x7fd26c1648d0 2023-12-18T10:23:40.471 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:40.471 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":74,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:37.268755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7557,"mds_1":7099,"mds_2":7096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7096":{"gid":7096,"name":"d","rank":2,"incarnation":71,"state":"up:active","state_seq":5,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7099":{"gid":7099,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:40.471 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 74 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd258065a60 msgr2=0x7fd258067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd258065a60 0x7fd258067f20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0016b0 tx=0x7fd25c009040 comp rx=0 tx=0).stop 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd26c1648d0 msgr2=0x7fd26c0c6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd26c1648d0 0x7fd26c0c6250 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fd26400ca80 tx=0x7fd26400cf40 comp rx=0 tx=0).stop 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 shutdown_connections 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd258065a60 0x7fd258067f20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd26c1648d0 0x7fd26c0c6250 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd26c15ca40 0x7fd26c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 --2- 172.21.15.133:0/2789311016 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd26c0cf0d0 0x7fd26c15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 >> 172.21.15.133:0/2789311016 conn(0x7fd26c089fb0 msgr2=0x7fd26c15bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 shutdown_connections 2023-12-18T10:23:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.474+0000 7fd2723e9640 1 -- 172.21.15.133:0/2789311016 wait complete. 2023-12-18T10:23:40.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub start /d1/d2/d3 2023-12-18T10:23:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84cb52640 1 Processor -- start 2023-12-18T10:23:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84cb52640 1 -- start start 2023-12-18T10:23:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84cb52640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb8480ca410 0x7fb848159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84cb52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480cbff0 0x7fb8480cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84cb52640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8480cc930 con 0x7fb848159fb0 2023-12-18T10:23:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84cb52640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84815aab0 con 0x7fb8480ca410 2023-12-18T10:23:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84cb52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb848070df0 con 0x7fb8480cbff0 2023-12-18T10:23:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb83dd9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb848159fb0 0x7fb848071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39996/0 (socket says 172.21.15.133:39996) 2023-12-18T10:23:40.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb83dd9b640 1 -- 172.21.15.133:0/1742708930 learned_addr learned my addr 172.21.15.133:0/1742708930 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:40.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb846d9d640 1 --2- 172.21.15.133:0/1742708930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480cbff0 0x7fb8480cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84659c640 1 --2- 172.21.15.133:0/1742708930 >> v2:172.21.15.142:3300/0 conn(0x7fb8480ca410 0x7fb848159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb845d9b640 1 -- 172.21.15.133:0/1742708930 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260919734 0 0) 0x7fb8480cc930 con 0x7fb848159fb0 2023-12-18T10:23:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb845d9b640 1 -- 172.21.15.133:0/1742708930 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb834005740 con 0x7fb848159fb0 2023-12-18T10:23:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb846d9d640 1 -- 172.21.15.133:0/1742708930 >> v2:172.21.15.142:3300/0 conn(0x7fb8480ca410 msgr2=0x7fb848159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb846d9d640 1 --2- 172.21.15.133:0/1742708930 >> v2:172.21.15.142:3300/0 conn(0x7fb8480ca410 0x7fb848159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb845d9b640 1 -- 172.21.15.133:0/1742708930 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 470499346 0 0) 0x7fb834005740 con 0x7fb848159fb0 2023-12-18T10:23:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb846d9d640 1 -- 172.21.15.133:0/1742708930 >> v1:172.21.15.133:6789/0 conn(0x7fb848159fb0 legacy=0x7fb848071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb846d9d640 1 -- 172.21.15.133:0/1742708930 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84815a4f0 con 0x7fb8480cbff0 2023-12-18T10:23:40.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.634+0000 7fb84659c640 1 --2- 172.21.15.133:0/1742708930 >> v2:172.21.15.142:3300/0 conn(0x7fb8480ca410 0x7fb848159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb846d9d640 1 --2- 172.21.15.133:0/1742708930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480cbff0 0x7fb8480cc3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8400097c0 tx=0x7fb84001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935a77dde37fa2dd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb845d9b640 1 -- 172.21.15.133:0/1742708930 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830001a20 con 0x7fb8480cbff0 2023-12-18T10:23:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb845d9b640 1 -- 172.21.15.133:0/1742708930 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400a7050 con 0x7fb8480cbff0 2023-12-18T10:23:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb845d9b640 1 -- 172.21.15.133:0/1742708930 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400ab620 con 0x7fb8480cbff0 2023-12-18T10:23:40.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb84cb52640 1 -- 172.21.15.133:0/1742708930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480cbff0 msgr2=0x7fb8480cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb84cb52640 1 --2- 172.21.15.133:0/1742708930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480cbff0 0x7fb8480cc3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8400097c0 tx=0x7fb84001c370 comp rx=0 tx=0).stop 2023-12-18T10:23:40.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb84cb52640 1 -- 172.21.15.133:0/1742708930 shutdown_connections 2023-12-18T10:23:40.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb84cb52640 1 --2- 172.21.15.133:0/1742708930 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480cbff0 0x7fb8480cc3f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb84cb52640 1 --2- 172.21.15.133:0/1742708930 >> v2:172.21.15.142:3300/0 conn(0x7fb8480ca410 0x7fb848159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb84cb52640 1 -- 172.21.15.133:0/1742708930 >> 172.21.15.133:0/1742708930 conn(0x7fb84806a2a0 msgr2=0x7fb8480aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb84cb52640 1 -- 172.21.15.133:0/1742708930 shutdown_connections 2023-12-18T10:23:40.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.638+0000 7fb84cb52640 1 -- 172.21.15.133:0/1742708930 wait complete. 2023-12-18T10:23:40.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 Processor -- start 2023-12-18T10:23:40.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 -- start start 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480ca410 0x7fb8480c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480cbff0 0x7fb84814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb848159fb0 0x7fb8480c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480c3e90 con 0x7fb848159fb0 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84814f840 con 0x7fb8480cbff0 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480c82f0 con 0x7fb8480ca410 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb846d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb848159fb0 0x7fb8480c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480ca410 0x7fb8480c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480ca410 0x7fb8480c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44666/0 (socket says 172.21.15.133:44666) 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 -- 172.21.15.133:0/2600026695 learned_addr learned my addr 172.21.15.133:0/2600026695 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb83dd9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480cbff0 0x7fb84814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb846d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb848159fb0 0x7fb8480c54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53036/0 (socket says 172.21.15.133:53036) 2023-12-18T10:23:40.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 -- 172.21.15.133:0/2600026695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480cbff0 msgr2=0x7fb84814e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 --2- 172.21.15.133:0/2600026695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480cbff0 0x7fb84814e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 -- 172.21.15.133:0/2600026695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb848159fb0 msgr2=0x7fb8480c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 --2- 172.21.15.133:0/2600026695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb848159fb0 0x7fb8480c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 -- 172.21.15.133:0/2600026695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009420 con 0x7fb8480ca410 2023-12-18T10:23:40.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb846d9d640 1 --2- 172.21.15.133:0/2600026695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb848159fb0 0x7fb8480c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:40.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84659c640 1 --2- 172.21.15.133:0/2600026695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb8480ca410 0x7fb8480c7db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb83800e9e0 tx=0x7fb83800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb83f7fe640 1 -- 172.21.15.133:0/2600026695 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800ca30 con 0x7fb8480ca410 2023-12-18T10:23:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb83f7fe640 1 -- 172.21.15.133:0/2600026695 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800cb90 con 0x7fb8480ca410 2023-12-18T10:23:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb83f7fe640 1 -- 172.21.15.133:0/2600026695 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838013470 con 0x7fb8480ca410 2023-12-18T10:23:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 -- 172.21.15.133:0/2600026695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb840009420 con 0x7fb8480ca410 2023-12-18T10:23:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.642+0000 7fb84cb52640 1 -- 172.21.15.133:0/2600026695 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84814fd70 con 0x7fb8480ca410 2023-12-18T10:23:40.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.646+0000 7fb83f7fe640 1 -- 172.21.15.133:0/2600026695 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8380135d0 con 0x7fb8480ca410 2023-12-18T10:23:40.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.646+0000 7fb83f7fe640 1 --2- 172.21.15.133:0/2600026695 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb828065a60 0x7fb828067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.646+0000 7fb83f7fe640 1 -- 172.21.15.133:0/2600026695 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8380834a0 con 0x7fb8480ca410 2023-12-18T10:23:40.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.646+0000 7fb83dd9b640 1 --2- 172.21.15.133:0/2600026695 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb828065a60 0x7fb828067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.646+0000 7fb84feb2000 1 Processor -- start 2023-12-18T10:23:40.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.646+0000 7fb83dd9b640 1 --2- 172.21.15.133:0/2600026695 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb828065a60 0x7fb828067f20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb830001590 tx=0x7fb830009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.646+0000 7fb84feb2000 1 -- start start 2023-12-18T10:23:40.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51834b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff51390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff5139610 0x559ff51399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f8c6c0 con 0x559ff51839f0 2023-12-18T10:23:40.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f890f0 con 0x559ff5139610 2023-12-18T10:23:40.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f866c0 con 0x559ff51830d0 2023-12-18T10:23:40.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51834b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb83dd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff51390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb846d9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff5139610 0x559ff51399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51834b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44680/0 (socket says 172.21.15.133:44680) 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 -- 172.21.15.133:0/3415762807 learned_addr learned my addr 172.21.15.133:0/3415762807 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 -- 172.21.15.133:0/3415762807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff5139610 msgr2=0x559ff51399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 --2- 172.21.15.133:0/3415762807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff5139610 0x559ff51399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 -- 172.21.15.133:0/3415762807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 msgr2=0x559ff51390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 --2- 172.21.15.133:0/3415762807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff51390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 -- 172.21.15.133:0/3415762807 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ff4c7ea80 con 0x559ff51830d0 2023-12-18T10:23:40.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84659c640 1 --2- 172.21.15.133:0/3415762807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51834b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb838050f80 tx=0x7fb8380544a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e92474c68c4f1629 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb827fff640 1 -- 172.21.15.133:0/3415762807 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83805c9b0 con 0x559ff51830d0 2023-12-18T10:23:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb827fff640 1 -- 172.21.15.133:0/3415762807 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838052e20 con 0x559ff51830d0 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb827fff640 1 -- 172.21.15.133:0/3415762807 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380830b0 con 0x559ff51830d0 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- 172.21.15.133:0/3415762807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 msgr2=0x559ff51834b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 --2- 172.21.15.133:0/3415762807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51834b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb838050f80 tx=0x7fb8380544a0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- 172.21.15.133:0/3415762807 shutdown_connections 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 --2- 172.21.15.133:0/3415762807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff5139610 0x559ff51399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 --2- 172.21.15.133:0/3415762807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff51390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 --2- 172.21.15.133:0/3415762807 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51834b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- 172.21.15.133:0/3415762807 >> 172.21.15.133:0/3415762807 conn(0x559ff51311b0 msgr2=0x559ff51335a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- 172.21.15.133:0/3415762807 shutdown_connections 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- 172.21.15.133:0/3415762807 wait complete. 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 -- start start 2023-12-18T10:23:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.650+0000 7fb84feb2000 1 Processor -- start 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff5139610 0x559ff51826b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 0x559ff5183fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff5184520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f81fb0 con 0x559ff51839f0 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f217b0 con 0x559ff51830d0 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f21450 con 0x559ff5139610 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 10 client.0 _ll_register_callbacks cb 0x559ff4fe4f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff5184520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff5184520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53066/0 (socket says 172.21.15.133:53066) 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 -- 172.21.15.133:0/2224382556 learned_addr learned my addr 172.21.15.133:0/2224382556 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb83dd9b640 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 0x559ff5183fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84659c640 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff5139610 0x559ff51826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 -- 172.21.15.133:0/2224382556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff5139610 msgr2=0x559ff51826b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff5139610 0x559ff51826b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 -- 172.21.15.133:0/2224382556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 msgr2=0x559ff5183fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 0x559ff5183fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 -- 172.21.15.133:0/2224382556 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84814fd70 con 0x559ff51839f0 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb846d9d640 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff5184520 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb84001aa20 tx=0x7fb84001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e652c3a8f0aa45 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 1 -- 172.21.15.133:0/2224382556 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400c0410 con 0x559ff51839f0 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 -- 172.21.15.133:0/2224382556 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ff4f542b0 con 0x559ff51839f0 2023-12-18T10:23:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 1 -- 172.21.15.133:0/2224382556 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8400c0570 con 0x559ff51839f0 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 1 -- 172.21.15.133:0/2224382556 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8400c0730 con 0x559ff51839f0 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 10 client.7872 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 -- 172.21.15.133:0/2224382556 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x559ff4f470d0 con 0x559ff51839f0 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 1 -- 172.21.15.133:0/2224382556 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ff4f542b0 con 0x559ff51839f0 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 1 -- 172.21.15.133:0/2224382556 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fb8400c0890 con 0x559ff51839f0 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 10 client.7872 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 10 client.7872 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 20 client.7872 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x559ff5184f30 0x559ff5185310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 4 client.7872 mds_command: new command op to 7099 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 -- 172.21.15.133:0/2224382556 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ff4f80900 con 0x559ff5184f30 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84659c640 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x559ff5184f30 0x559ff5185310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84659c640 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x559ff5184f30 0x559ff5185310 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b08ba4d07dc011c server_cookie=49ed86556a67e7a5 in_seq=0 out_seq=0 2023-12-18T10:23:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 10 client.7872 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 1 -- 172.21.15.133:0/2224382556 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559ff4f80900 con 0x559ff5184f30 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb8257fa640 10 client.7872 handle_command_reply: tid=0 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.654+0000 7fb84feb2000 1 client.7872 shutdown 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 -- 172.21.15.133:0/2224382556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 msgr2=0x559ff5184520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff5184520 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb84001aa20 tx=0x7fb84001abb0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 -- 172.21.15.133:0/2224382556 shutdown_connections 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x559ff5184f30 0x559ff5185310 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff51839f0 0x559ff5184520 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 0x559ff5183fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb8257fa640 0 client.7872 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2224382556 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff5139610 0x559ff51826b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 -- 172.21.15.133:0/2224382556 >> 172.21.15.133:0/2224382556 conn(0x559ff51311b0 msgr2=0x559ff513a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 -- 172.21.15.133:0/2224382556 shutdown_connections 2023-12-18T10:23:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 1 -- 172.21.15.133:0/2224382556 wait complete. 2023-12-18T10:23:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.658+0000 7fb84feb2000 20 client.7872 trim_cache size 0 max 16384 2023-12-18T10:23:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.670+0000 7fb84feb2000 1 Processor -- start 2023-12-18T10:23:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.670+0000 7fb84feb2000 1 -- start start 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.670+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51dbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.670+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51dc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.670+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51839f0 0x559ff51dc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.670+0000 7fb84feb2000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff4c3fb30 con 0x559ff5139610 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.670+0000 7fb84feb2000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff4fc66a0 con 0x559ff51839f0 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.670+0000 7fb84feb2000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f80e40 con 0x559ff51830d0 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51dbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51dbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53070/0 (socket says 172.21.15.133:53070) 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 -- 172.21.15.133:0/2958716237 learned_addr learned my addr 172.21.15.133:0/2958716237 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb83dd9b640 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51dc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb846d9d640 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51839f0 0x559ff51dc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 -- 172.21.15.133:0/2958716237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 msgr2=0x559ff51dc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51dc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 -- 172.21.15.133:0/2958716237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51839f0 msgr2=0x559ff51dc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51839f0 0x559ff51dc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 -- 172.21.15.133:0/2958716237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ff4f2d220 con 0x559ff5139610 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51dbb20 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb838083010 tx=0x7fb838017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50f16c46f05d8cd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb83cd99640 1 -- 172.21.15.133:0/2958716237 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838052c40 con 0x559ff5139610 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb83cd99640 1 -- 172.21.15.133:0/2958716237 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838052e20 con 0x559ff5139610 2023-12-18T10:23:40.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb83cd99640 1 -- 172.21.15.133:0/2958716237 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838051190 con 0x559ff5139610 2023-12-18T10:23:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- 172.21.15.133:0/2958716237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 msgr2=0x559ff51dbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51dbb20 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb838083010 tx=0x7fb838017000 comp rx=0 tx=0).stop 2023-12-18T10:23:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- 172.21.15.133:0/2958716237 shutdown_connections 2023-12-18T10:23:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51839f0 0x559ff51dc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51830d0 0x559ff51dc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2958716237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51dbb20 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- 172.21.15.133:0/2958716237 >> 172.21.15.133:0/2958716237 conn(0x559ff51311b0 msgr2=0x559ff513fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- 172.21.15.133:0/2958716237 shutdown_connections 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- 172.21.15.133:0/2958716237 wait complete. 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- start start 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 Processor -- start 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51960f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 0x559ff5196630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51839f0 0x559ff5196b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f4e610 con 0x559ff5139610 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f2ca60 con 0x559ff51830d0 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ff4f49ce0 con 0x559ff51839f0 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84feb2000 10 client.0 _ll_register_callbacks cb 0x559ff4f49f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53072/0 (socket says 172.21.15.133:53072) 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb84659c640 1 -- 172.21.15.133:0/2642269791 learned_addr learned my addr 172.21.15.133:0/2642269791 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb846d9d640 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51839f0 0x559ff5196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.674+0000 7fb83dd9b640 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 0x559ff5196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84659c640 1 -- 172.21.15.133:0/2642269791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51839f0 msgr2=0x559ff5196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84659c640 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51839f0 0x559ff5196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84659c640 1 -- 172.21.15.133:0/2642269791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 msgr2=0x559ff5196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84659c640 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 0x559ff5196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84659c640 1 -- 172.21.15.133:0/2642269791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ff4c7ea80 con 0x559ff5139610 2023-12-18T10:23:40.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84659c640 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51960f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb838050f80 tx=0x7fb838000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792da49c626f6f48 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:40.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 1 -- 172.21.15.133:0/2642269791 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838052c40 con 0x559ff5139610 2023-12-18T10:23:40.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 1 -- 172.21.15.133:0/2642269791 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8380830b0 con 0x559ff5139610 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 -- 172.21.15.133:0/2642269791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ff4f43230 con 0x559ff5139610 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 1 -- 172.21.15.133:0/2642269791 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8380832b0 con 0x559ff5139610 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 10 client.7878 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 -- 172.21.15.133:0/2642269791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x559ff4c7eeb0 con 0x559ff5139610 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 1 -- 172.21.15.133:0/2642269791 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ff4f43230 con 0x559ff5139610 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 1 -- 172.21.15.133:0/2642269791 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fb838011070 con 0x559ff5139610 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 10 client.7878 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 10 client.7878 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 20 client.7878 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x559ff5197500 0x559ff51e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 4 client.7878 mds_command: new command op to 7099 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3"}] 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 -- 172.21.15.133:0/2642269791 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3"}) v1 -- 0x559ff4f7b030 con 0x559ff5197500 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb83dd9b640 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x559ff5197500 0x559ff51e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb83dd9b640 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x559ff5197500 0x559ff51e7db0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35fa8e2d512f1c52 server_cookie=511dbae5293c8eff in_seq=0 out_seq=0 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 10 client.7878 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 1 -- 172.21.15.133:0/2642269791 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x559ff4f7b030 con 0x559ff5197500 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 10 client.7878 handle_command_reply: tid=0 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 client.7878 shutdown 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 -- 172.21.15.133:0/2642269791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 msgr2=0x559ff51960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51960f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb838050f80 tx=0x7fb838000bd0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 -- 172.21.15.133:0/2642269791 shutdown_connections 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x559ff5197500 0x559ff51e7db0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559ff51839f0 0x559ff5196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559ff51830d0 0x559ff5196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 --2- 172.21.15.133:0/2642269791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559ff5139610 0x559ff51960f0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb8257fa640 0 client.7878 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 -- 172.21.15.133:0/2642269791 >> 172.21.15.133:0/2642269791 conn(0x559ff51311b0 msgr2=0x559ff513a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 -- 172.21.15.133:0/2642269791 shutdown_connections 2023-12-18T10:23:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 1 -- 172.21.15.133:0/2642269791 wait complete. 2023-12-18T10:23:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.678+0000 7fb84feb2000 20 client.7878 trim_cache size 0 max 16384 2023-12-18T10:23:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:Error EXDEV: Not rank 0 2023-12-18T10:23:40.685 DEBUG:teuthology.orchestra.run:got remote process result: 18 2023-12-18T10:23:40.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub abort 2023-12-18T10:23:40.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01f31f0640 1 Processor -- start 2023-12-18T10:23:40.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01f31f0640 1 -- start start 2023-12-18T10:23:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01f31f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01ec071870 0x7f01ec071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01f31f0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f01ec0cbff0 0x7f01ec0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01f31f0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec0cc930 con 0x7f01ec0ca410 2023-12-18T10:23:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01f31f0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec15aab0 con 0x7f01ec071870 2023-12-18T10:23:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01f31f0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec070df0 con 0x7f01ec0cbff0 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01e3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01ec071870 0x7f01ec071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01e3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01ec071870 0x7f01ec071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53082/0 (socket says 172.21.15.133:53082) 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01e3fff640 1 -- 172.21.15.133:0/79674718 learned_addr learned my addr 172.21.15.133:0/79674718 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01f178d640 1 --2- 172.21.15.133:0/79674718 >> v2:172.21.15.142:3300/0 conn(0x7f01ec0cbff0 0x7f01ec0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01e37fe640 1 -- 172.21.15.133:0/79674718 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301175442 0 0) 0x7f01ec0cc930 con 0x7f01ec0ca410 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01e3fff640 1 -- 172.21.15.133:0/79674718 >> v2:172.21.15.142:3300/0 conn(0x7f01ec0cbff0 msgr2=0x7f01ec0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01e3fff640 1 --2- 172.21.15.133:0/79674718 >> v2:172.21.15.142:3300/0 conn(0x7f01ec0cbff0 0x7f01ec0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01e3fff640 1 -- 172.21.15.133:0/79674718 >> v1:172.21.15.142:6789/0 conn(0x7f01ec0ca410 legacy=0x7f01ec159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.826+0000 7f01e3fff640 1 -- 172.21.15.133:0/79674718 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec15a4f0 con 0x7f01ec071870 2023-12-18T10:23:40.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01e3fff640 1 --2- 172.21.15.133:0/79674718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec071870 0x7f01ec071d00 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c1ef0 tx=0x7f01dc01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55aadf43b3a5b421 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01e37fe640 1 -- 172.21.15.133:0/79674718 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0a7c70 con 0x7f01ec071870 2023-12-18T10:23:40.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01e37fe640 1 -- 172.21.15.133:0/79674718 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc0a7dd0 con 0x7f01ec071870 2023-12-18T10:23:40.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01e37fe640 1 -- 172.21.15.133:0/79674718 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0af660 con 0x7f01ec071870 2023-12-18T10:23:40.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01f31f0640 1 -- 172.21.15.133:0/79674718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec071870 msgr2=0x7f01ec071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01f31f0640 1 --2- 172.21.15.133:0/79674718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec071870 0x7f01ec071d00 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c1ef0 tx=0x7f01dc01eba0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01f31f0640 1 -- 172.21.15.133:0/79674718 shutdown_connections 2023-12-18T10:23:40.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01f31f0640 1 --2- 172.21.15.133:0/79674718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec071870 0x7f01ec071d00 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01f31f0640 1 --2- 172.21.15.133:0/79674718 >> v2:172.21.15.142:3300/0 conn(0x7f01ec0cbff0 0x7f01ec0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01f31f0640 1 -- 172.21.15.133:0/79674718 >> 172.21.15.133:0/79674718 conn(0x7f01ec06a2a0 msgr2=0x7f01ec0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01f31f0640 1 -- 172.21.15.133:0/79674718 shutdown_connections 2023-12-18T10:23:40.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.830+0000 7f01f31f0640 1 -- 172.21.15.133:0/79674718 wait complete. 2023-12-18T10:23:40.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 Processor -- start 2023-12-18T10:23:40.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 -- start start 2023-12-18T10:23:40.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec071870 0x7f01ec15b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec0ca410 0x7f01ec1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec0cbff0 0x7f01ec1f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1561d0 con 0x7f01ec071870 2023-12-18T10:23:40.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec155ef0 con 0x7f01ec0cbff0 2023-12-18T10:23:40.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0aba40 con 0x7f01ec0ca410 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec071870 0x7f01ec15b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec071870 0x7f01ec15b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53092/0 (socket says 172.21.15.133:53092) 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 -- 172.21.15.133:0/2453111858 learned_addr learned my addr 172.21.15.133:0/2453111858 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01e3fff640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec0ca410 0x7f01ec1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f178d640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec0cbff0 0x7f01ec1f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 -- 172.21.15.133:0/2453111858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec0ca410 msgr2=0x7f01ec1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01ec0ca410 0x7f01ec1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 -- 172.21.15.133:0/2453111858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec0cbff0 msgr2=0x7f01ec1f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec0cbff0 0x7f01ec1f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 -- 172.21.15.133:0/2453111858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc00b770 con 0x7f01ec071870 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f178d640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01ec0cbff0 0x7f01ec1f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:40.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec071870 0x7f01ec15b000 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f01e800c520 tx=0x7f01e800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01e17fa640 1 -- 172.21.15.133:0/2453111858 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e80052d0 con 0x7f01ec071870 2023-12-18T10:23:40.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01e17fa640 1 -- 172.21.15.133:0/2453111858 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e8005430 con 0x7f01ec071870 2023-12-18T10:23:40.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01e17fa640 1 -- 172.21.15.133:0/2453111858 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8012870 con 0x7f01ec071870 2023-12-18T10:23:40.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 -- 172.21.15.133:0/2453111858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec0abd20 con 0x7f01ec071870 2023-12-18T10:23:40.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.834+0000 7f01f31f0640 1 -- 172.21.15.133:0/2453111858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec15b540 con 0x7f01ec071870 2023-12-18T10:23:40.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.838+0000 7f01e17fa640 1 -- 172.21.15.133:0/2453111858 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f01e8003620 con 0x7f01ec071870 2023-12-18T10:23:40.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.838+0000 7f01e17fa640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f01d8065a60 0x7f01d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.838+0000 7f01e17fa640 1 -- 172.21.15.133:0/2453111858 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f01e8082870 con 0x7f01ec071870 2023-12-18T10:23:40.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.838+0000 7f01e3fff640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f01d8065a60 0x7f01d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.838+0000 7f01f6555000 1 Processor -- start 2023-12-18T10:23:40.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.838+0000 7f01f6555000 1 -- start start 2023-12-18T10:23:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.838+0000 7f01e3fff640 1 --2- 172.21.15.133:0/2453111858 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f01d8065a60 0x7f01d8067f20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0b1000 tx=0x7f01dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 0x561560c5cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c12510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 0x561560c12e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561560adae70 con 0x561560c5d010 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561560a69400 con 0x561560c12a50 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561560a669d0 con 0x561560c5c6f0 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c12510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c12510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53096/0 (socket says 172.21.15.133:53096) 2023-12-18T10:23:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 -- 172.21.15.133:0/4278930260 learned_addr learned my addr 172.21.15.133:0/4278930260 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f178d640 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 0x561560c12e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 0x561560c5cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 -- 172.21.15.133:0/4278930260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 msgr2=0x561560c5cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 0x561560c5cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 -- 172.21.15.133:0/4278930260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 msgr2=0x561560c12e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 0x561560c12e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 -- 172.21.15.133:0/4278930260 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56156075ed70 con 0x561560c5d010 2023-12-18T10:23:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01e3fff640 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c12510 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f01dc01b7b0 tx=0x7f01dc0a9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e4aa85955cec75 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01d27fc640 1 -- 172.21.15.133:0/4278930260 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0bf040 con 0x561560c5d010 2023-12-18T10:23:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01d27fc640 1 -- 172.21.15.133:0/4278930260 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc0baba0 con 0x561560c5d010 2023-12-18T10:23:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01d27fc640 1 -- 172.21.15.133:0/4278930260 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0af440 con 0x561560c5d010 2023-12-18T10:23:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- 172.21.15.133:0/4278930260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 msgr2=0x561560c12510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c12510 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f01dc01b7b0 tx=0x7f01dc0a9070 comp rx=0 tx=0).stop 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- 172.21.15.133:0/4278930260 shutdown_connections 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 0x561560c12e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c12510 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 --2- 172.21.15.133:0/4278930260 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 0x561560c5cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- 172.21.15.133:0/4278930260 >> 172.21.15.133:0/4278930260 conn(0x561560c18fd0 msgr2=0x561560c10df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- 172.21.15.133:0/4278930260 shutdown_connections 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- 172.21.15.133:0/4278930260 wait complete. 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 -- start start 2023-12-18T10:23:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.842+0000 7f01f6555000 1 Processor -- start 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 0x561560c63c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 0x561560c64170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c1d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561560a622c0 con 0x561560c5d010 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561560a1f6a0 con 0x561560c12a50 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561560a1f340 con 0x561560c5c6f0 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 10 client.0 _ll_register_callbacks cb 0x561560bfe3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c1d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c1d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53100/0 (socket says 172.21.15.133:53100) 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 -- 172.21.15.133:0/1530156673 learned_addr learned my addr 172.21.15.133:0/1530156673 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 0x561560c63c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01e3fff640 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 0x561560c64170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 -- 172.21.15.133:0/1530156673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 msgr2=0x561560c64170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 0x561560c64170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 -- 172.21.15.133:0/1530156673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 msgr2=0x561560c63c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 0x561560c63c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 -- 172.21.15.133:0/1530156673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec15a4f0 con 0x561560c5d010 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f178d640 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c1d8c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f01e4007d70 tx=0x7f01e4014690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f684e09bc15c9019 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 1 -- 172.21.15.133:0/1530156673 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400e030 con 0x561560c5d010 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- 172.21.15.133:0/1530156673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561560a60c10 con 0x561560c5d010 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 1 -- 172.21.15.133:0/1530156673 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f01e400f070 con 0x561560c5d010 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 1 -- 172.21.15.133:0/1530156673 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01e4007e60 con 0x561560c5d010 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 10 client.7890 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- 172.21.15.133:0/1530156673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x561560a27240 con 0x561560c5d010 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 1 -- 172.21.15.133:0/1530156673 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561560a60c10 con 0x561560c5d010 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 1 -- 172.21.15.133:0/1530156673 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f01e4021440 con 0x561560c5d010 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 10 client.7890 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 10 client.7890 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 20 client.7890 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x561560c1e630 0x561560c1ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 4 client.7890 mds_command: new command op to 7099 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- 172.21.15.133:0/1530156673 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561560a671b0 con 0x561560c1e630 2023-12-18T10:23:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x561560c1e630 0x561560c1ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 10 client.7890 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x561560c1e630 0x561560c1ea10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5b351ba08ab3975 server_cookie=74325403d78c1497 in_seq=0 out_seq=0 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 1 -- 172.21.15.133:0/1530156673 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561560a671b0 con 0x561560c1e630 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 10 client.7890 handle_command_reply: tid=0 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 client.7890 shutdown 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- 172.21.15.133:0/1530156673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 msgr2=0x561560c1d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c1d8c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f01e4007d70 tx=0x7f01e4014690 comp rx=0 tx=0).stop 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- 172.21.15.133:0/1530156673 shutdown_connections 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x561560c1e630 0x561560c1ea10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c5d010 0x561560c1d8c0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c5c6f0 0x561560c64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 --2- 172.21.15.133:0/1530156673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c12a50 0x561560c63c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01cb7fe640 0 client.7890 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.846+0000 7f01f6555000 1 -- 172.21.15.133:0/1530156673 >> 172.21.15.133:0/1530156673 conn(0x561560c18fd0 msgr2=0x561560c114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.850+0000 7f01f6555000 1 -- 172.21.15.133:0/1530156673 shutdown_connections 2023-12-18T10:23:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.850+0000 7f01f6555000 1 -- 172.21.15.133:0/1530156673 wait complete. 2023-12-18T10:23:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.850+0000 7f01f6555000 20 client.7890 trim_cache size 0 max 16384 2023-12-18T10:23:40.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f6555000 1 Processor -- start 2023-12-18T10:23:40.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f6555000 1 -- start start 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f6555000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c18fd0 0x561560c5b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f6555000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c12a50 0x561560c5b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f6555000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560c5d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f6555000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56156071f9f0 con 0x561560c18fd0 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f6555000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615609feec0 con 0x561560c5c6f0 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f6555000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561560c69cb0 con 0x561560c12a50 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c18fd0 0x561560c5b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c18fd0 0x561560c5b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53106/0 (socket says 172.21.15.133:53106) 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 -- 172.21.15.133:0/2197444128 learned_addr learned my addr 172.21.15.133:0/2197444128 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f178d640 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560c5d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01e3fff640 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c12a50 0x561560c5b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 -- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c12a50 msgr2=0x561560c5b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c12a50 0x561560c5b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 -- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 msgr2=0x561560c5d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560c5d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 -- 172.21.15.133:0/2197444128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561560a0d590 con 0x561560c18fd0 2023-12-18T10:23:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f178d640 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560c5d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c18fd0 0x561560c5b210 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f01e8053d10 tx=0x7f01e8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f92ec432f679e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01d2ffd640 1 -- 172.21.15.133:0/2197444128 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8052230 con 0x561560c18fd0 2023-12-18T10:23:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01d2ffd640 1 -- 172.21.15.133:0/2197444128 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e80504e0 con 0x561560c18fd0 2023-12-18T10:23:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.862+0000 7f01d2ffd640 1 -- 172.21.15.133:0/2197444128 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e806b2d0 con 0x561560c18fd0 2023-12-18T10:23:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- 172.21.15.133:0/2197444128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c18fd0 msgr2=0x561560c5b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c18fd0 0x561560c5b210 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f01e8053d10 tx=0x7f01e8005040 comp rx=0 tx=0).stop 2023-12-18T10:23:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- 172.21.15.133:0/2197444128 shutdown_connections 2023-12-18T10:23:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560c5d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c12a50 0x561560c5b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 --2- 172.21.15.133:0/2197444128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c18fd0 0x561560c5b210 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- 172.21.15.133:0/2197444128 >> 172.21.15.133:0/2197444128 conn(0x561560c17f60 msgr2=0x561560c59af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- 172.21.15.133:0/2197444128 shutdown_connections 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- 172.21.15.133:0/2197444128 wait complete. 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- start start 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 Processor -- start 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c12a50 0x561560cb8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c18fd0 0x561560cb8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560cb8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561560a6a690 con 0x561560c12a50 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561560a61150 con 0x561560c5c6f0 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561560a5c660 con 0x561560c18fd0 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 10 client.0 _ll_register_callbacks cb 0x561560a10820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c12a50 0x561560cb8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c12a50 0x561560cb8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53114/0 (socket says 172.21.15.133:53114) 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 -- 172.21.15.133:0/163655154 learned_addr learned my addr 172.21.15.133:0/163655154 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01e3fff640 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c18fd0 0x561560cb8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f178d640 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560cb8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 -- 172.21.15.133:0/163655154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c18fd0 msgr2=0x561560cb8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c18fd0 0x561560cb8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 -- 172.21.15.133:0/163655154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 msgr2=0x561560cb8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560cb8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 -- 172.21.15.133:0/163655154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec15b540 con 0x561560c12a50 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f0f8c640 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c12a50 0x561560cb8100 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f01e80502d0 tx=0x7f01e8001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136c90362b2e6c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01cb7fe640 1 -- 172.21.15.133:0/163655154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e805ba70 con 0x561560c12a50 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01cb7fe640 1 -- 172.21.15.133:0/163655154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f01e8050650 con 0x561560c12a50 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- 172.21.15.133:0/163655154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561560c161c0 con 0x561560c12a50 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01cb7fe640 1 -- 172.21.15.133:0/163655154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01e8070280 con 0x561560c12a50 2023-12-18T10:23:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 10 client.7896 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01f6555000 1 -- 172.21.15.133:0/163655154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x561560a01100 con 0x561560c12a50 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.866+0000 7f01cb7fe640 1 -- 172.21.15.133:0/163655154 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e8075020 con 0x561560c12a50 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01cb7fe640 1 -- 172.21.15.133:0/163655154 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f01e804fbc0 con 0x561560c12a50 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 10 client.7896 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 10 client.7896 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 20 client.7896 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x561560c5d010 0x561560cb6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 4 client.7896 mds_command: new command op to 7099 tid=0[{"prefix": "scrub abort"}] 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 -- 172.21.15.133:0/163655154 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x561560a11cc0 con 0x561560c5d010 2023-12-18T10:23:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01e3fff640 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x561560c5d010 0x561560cb6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01e3fff640 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x561560c5d010 0x561560cb6660 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3dcd93f210229e4b server_cookie=8c5af4ab1d815af in_seq=0 out_seq=0 2023-12-18T10:23:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01cb7fe640 10 client.7896 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01cb7fe640 1 -- 172.21.15.133:0/163655154 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x561560a11cc0 con 0x561560c5d010 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01cb7fe640 10 client.7896 handle_command_reply: tid=0 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 client.7896 shutdown 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 -- 172.21.15.133:0/163655154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c12a50 msgr2=0x561560cb8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c12a50 0x561560cb8100 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f01e80502d0 tx=0x7f01e8001090 comp rx=0 tx=0).stop 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 -- 172.21.15.133:0/163655154 shutdown_connections 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x561560c5d010 0x561560cb6660 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561560c5c6f0 0x561560cb8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561560c18fd0 0x561560cb8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01cb7fe640 0 client.7896 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 --2- 172.21.15.133:0/163655154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561560c12a50 0x561560cb8100 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 -- 172.21.15.133:0/163655154 >> 172.21.15.133:0/163655154 conn(0x561560c17f60 msgr2=0x561560c59260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 -- 172.21.15.133:0/163655154 shutdown_connections 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 1 -- 172.21.15.133:0/163655154 wait complete. 2023-12-18T10:23:40.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:40.870+0000 7f01f6555000 20 client.7896 trim_cache size 0 max 16384 2023-12-18T10:23:40.874 INFO:teuthology.orchestra.run.smithi133.stderr:Error EXDEV: Not rank 0 2023-12-18T10:23:40.876 DEBUG:teuthology.orchestra.run:got remote process result: 18 2023-12-18T10:23:40.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub pause 2023-12-18T10:23:41.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6ea2525640 1 Processor -- start 2023-12-18T10:23:41.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6ea2525640 1 -- start start 2023-12-18T10:23:41.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6ea2525640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e9c0cde90 0x7f6e9c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6ea2525640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6e9c0cf170 0x7f6e9c0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6ea2525640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c15cec0 con 0x7f6e9c15cae0 2023-12-18T10:23:41.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6ea2525640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c0cfb40 con 0x7f6e9c0cde90 2023-12-18T10:23:41.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6ea2525640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c0d0530 con 0x7f6e9c0cf170 2023-12-18T10:23:41.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6e9c15cae0 0x7f6e9c0d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40000/0 (socket says 172.21.15.133:40000) 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9bfff640 1 -- 172.21.15.133:0/4072505930 learned_addr learned my addr 172.21.15.133:0/4072505930 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/4072505930 >> v2:172.21.15.133:3300/0 conn(0x7f6e9c0cde90 0x7f6e9c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/4072505930 >> v2:172.21.15.142:3300/0 conn(0x7f6e9c0cf170 0x7f6e9c0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9affd640 1 -- 172.21.15.133:0/4072505930 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102026386 0 0) 0x7f6e9c15cec0 con 0x7f6e9c15cae0 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9affd640 1 -- 172.21.15.133:0/4072505930 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e84003530 con 0x7f6e9c15cae0 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/4072505930 >> v2:172.21.15.142:3300/0 conn(0x7f6e9c0cf170 msgr2=0x7f6e9c0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/4072505930 >> v2:172.21.15.142:3300/0 conn(0x7f6e9c0cf170 0x7f6e9c0cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/4072505930 >> v1:172.21.15.133:6789/0 conn(0x7f6e9c15cae0 legacy=0x7f6e9c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.018+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/4072505930 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0d0810 con 0x7f6e9c0cde90 2023-12-18T10:23:41.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/4072505930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e9c0cde90 0x7f6e9c0ce2f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0d0310 tx=0x7f6e9001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6c79340363120d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6e9affd640 1 -- 172.21.15.133:0/4072505930 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900a7070 con 0x7f6e9c0cde90 2023-12-18T10:23:41.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6e9affd640 1 -- 172.21.15.133:0/4072505930 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900ab430 con 0x7f6e9c0cde90 2023-12-18T10:23:41.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6e9affd640 1 -- 172.21.15.133:0/4072505930 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900ab7a0 con 0x7f6e9c0cde90 2023-12-18T10:23:41.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6ea2525640 1 -- 172.21.15.133:0/4072505930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e9c0cde90 msgr2=0x7f6e9c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6ea2525640 1 --2- 172.21.15.133:0/4072505930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e9c0cde90 0x7f6e9c0ce2f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0d0310 tx=0x7f6e9001c430 comp rx=0 tx=0).stop 2023-12-18T10:23:41.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6ea2525640 1 -- 172.21.15.133:0/4072505930 shutdown_connections 2023-12-18T10:23:41.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6ea2525640 1 --2- 172.21.15.133:0/4072505930 >> v2:172.21.15.142:3300/0 conn(0x7f6e9c0cf170 0x7f6e9c0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6ea2525640 1 --2- 172.21.15.133:0/4072505930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e9c0cde90 0x7f6e9c0ce2f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6ea2525640 1 -- 172.21.15.133:0/4072505930 >> 172.21.15.133:0/4072505930 conn(0x7f6e9c089fb0 msgr2=0x7f6e9c0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6ea2525640 1 -- 172.21.15.133:0/4072505930 shutdown_connections 2023-12-18T10:23:41.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.022+0000 7f6ea2525640 1 -- 172.21.15.133:0/4072505930 wait complete. 2023-12-18T10:23:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 Processor -- start 2023-12-18T10:23:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 -- start start 2023-12-18T10:23:41.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e9c0cde90 0x7f6e9c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e9c0cf170 0x7f6e9c1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e9c15cae0 0x7f6e9c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c15f8a0 con 0x7f6e9c0cde90 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0c77c0 con 0x7f6e9c0cf170 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0c7aa0 con 0x7f6e9c15cae0 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e9c0cde90 0x7f6e9c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e9c0cde90 0x7f6e9c15e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53118/0 (socket says 172.21.15.133:53118) 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 -- 172.21.15.133:0/96107641 learned_addr learned my addr 172.21.15.133:0/96107641 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/96107641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e9c0cf170 0x7f6e9c1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/96107641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e9c15cae0 0x7f6e9c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 -- 172.21.15.133:0/96107641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e9c15cae0 msgr2=0x7f6e9c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/96107641 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e9c15cae0 0x7f6e9c0b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 -- 172.21.15.133:0/96107641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e9c0cf170 msgr2=0x7f6e9c1553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/96107641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e9c0cf170 0x7f6e9c1553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 -- 172.21.15.133:0/96107641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90009420 con 0x7f6e9c0cde90 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/96107641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e9c0cde90 0x7f6e9c15e8b0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c400 tx=0x7f6e8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e98ff9640 1 -- 172.21.15.133:0/96107641 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c0074e0 con 0x7f6e9c0cde90 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e98ff9640 1 -- 172.21.15.133:0/96107641 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c007660 con 0x7f6e9c0cde90 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6e98ff9640 1 -- 172.21.15.133:0/96107641 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c0059f0 con 0x7f6e9c0cde90 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 -- 172.21.15.133:0/96107641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c0c7d80 con 0x7f6e9c0cde90 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.026+0000 7f6ea2525640 1 -- 172.21.15.133:0/96107641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c0c8340 con 0x7f6e9c0cde90 2023-12-18T10:23:41.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e98ff9640 1 -- 172.21.15.133:0/96107641 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e8c005b50 con 0x7f6e9c0cde90 2023-12-18T10:23:41.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e98ff9640 1 --2- 172.21.15.133:0/96107641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e88065a60 0x7f6e88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e98ff9640 1 -- 172.21.15.133:0/96107641 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e8c0828e0 con 0x7f6e9c0cde90 2023-12-18T10:23:41.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/96107641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e88065a60 0x7f6e88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea588f000 1 Processor -- start 2023-12-18T10:23:41.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea588f000 1 -- start start 2023-12-18T10:23:41.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/96107641 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e88065a60 0x7f6e88067f20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6e900af000 tx=0x7f6e900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8c010 0x55fa53c41510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53c41e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea588f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa53b09e70 con 0x55fa53c8c010 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea588f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a98400 con 0x55fa53c8b6f0 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea588f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a959d0 con 0x55fa53c41a50 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e9b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8c010 0x55fa53c41510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e9b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8c010 0x55fa53c41510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53126/0 (socket says 172.21.15.133:53126) 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/2041090982 learned_addr learned my addr 172.21.15.133:0/2041090982 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.030+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53c41e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 msgr2=0x55fa53c41e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53c41e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8b6f0 msgr2=0x55fa53c8bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/2041090982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa5378dd70 con 0x55fa53c8c010 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8c010 0x55fa53c41510 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6e9001a060 tx=0x7f6e90004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4361853062433b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e81ffb640 1 -- 172.21.15.133:0/2041090982 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900c06d0 con 0x55fa53c8c010 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e81ffb640 1 -- 172.21.15.133:0/2041090982 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900c5070 con 0x55fa53c8c010 2023-12-18T10:23:41.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e81ffb640 1 -- 172.21.15.133:0/2041090982 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900c0a30 con 0x55fa53c8c010 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- 172.21.15.133:0/2041090982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8c010 msgr2=0x55fa53c41510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8c010 0x55fa53c41510 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6e9001a060 tx=0x7f6e90004740 comp rx=0 tx=0).stop 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- 172.21.15.133:0/2041090982 shutdown_connections 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53c41e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8c010 0x55fa53c41510 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 --2- 172.21.15.133:0/2041090982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- 172.21.15.133:0/2041090982 >> 172.21.15.133:0/2041090982 conn(0x55fa53c47fd0 msgr2=0x55fa53c3fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- 172.21.15.133:0/2041090982 shutdown_connections 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- 172.21.15.133:0/2041090982 wait complete. 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- start start 2023-12-18T10:23:41.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 Processor -- start 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53c92a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c92f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8c010 0x55fa53c4c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a912c0 con 0x55fa53c8b6f0 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a4e6a0 con 0x55fa53c8c010 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a4e340 con 0x55fa53c41a50 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea588f000 10 client.0 _ll_register_callbacks cb 0x55fa53c2d3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c92f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c92f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53132/0 (socket says 172.21.15.133:53132) 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/1228953622 learned_addr learned my addr 172.21.15.133:0/1228953622 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53c92a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.034+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8c010 0x55fa53c4c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/1228953622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 msgr2=0x55fa53c92a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53c92a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/1228953622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8c010 msgr2=0x55fa53c4c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8c010 0x55fa53c4c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e9b7fe640 1 -- 172.21.15.133:0/1228953622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c0c8340 con 0x55fa53c8b6f0 2023-12-18T10:23:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c92f90 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f6e9001c910 tx=0x7f6e9001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41bf481be36efc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 1 -- 172.21.15.133:0/1228953622 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900c0770 con 0x55fa53c8b6f0 2023-12-18T10:23:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 1 -- 172.21.15.133:0/1228953622 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e900d4c10 con 0x55fa53c8b6f0 2023-12-18T10:23:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 -- 172.21.15.133:0/1228953622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa53a8fc10 con 0x55fa53c8b6f0 2023-12-18T10:23:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 1 -- 172.21.15.133:0/1228953622 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e900d4dd0 con 0x55fa53c8b6f0 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 10 client.7911 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 -- 172.21.15.133:0/1228953622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x7f6e900bb070 con 0x55fa53c8b6f0 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 1 -- 172.21.15.133:0/1228953622 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa53a8fc10 con 0x55fa53c8b6f0 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 1 -- 172.21.15.133:0/1228953622 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f6e900c08d0 con 0x55fa53c8b6f0 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 10 client.7911 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 10 client.7911 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 20 client.7911 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fa53c4d660 0x55fa53c4da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 4 client.7911 mds_command: new command op to 7099 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 -- 172.21.15.133:0/1228953622 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa53a961b0 con 0x55fa53c4d660 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fa53c4d660 0x55fa53c4da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 10 client.7911 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fa53c4d660 0x55fa53c4da40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac359e5a378a91d9 server_cookie=3695d482f30f3228 in_seq=0 out_seq=0 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 1 -- 172.21.15.133:0/1228953622 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55fa53a961b0 con 0x55fa53c4d660 2023-12-18T10:23:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 10 client.7911 handle_command_reply: tid=0 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 client.7911 shutdown 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 -- 172.21.15.133:0/1228953622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 msgr2=0x55fa53c92f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c92f90 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f6e9001c910 tx=0x7f6e9001ac70 comp rx=0 tx=0).stop 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 -- 172.21.15.133:0/1228953622 shutdown_connections 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fa53c4d660 0x55fa53c4da40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c8c010 0x55fa53c4c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c92f90 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6e7affd640 0 client.7911 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 --2- 172.21.15.133:0/1228953622 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53c92a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 -- 172.21.15.133:0/1228953622 >> 172.21.15.133:0/1228953622 conn(0x55fa53c47fd0 msgr2=0x55fa53c404f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 -- 172.21.15.133:0/1228953622 shutdown_connections 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 1 -- 172.21.15.133:0/1228953622 wait complete. 2023-12-18T10:23:41.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.038+0000 7f6ea588f000 20 client.7911 trim_cache size 0 max 16384 2023-12-18T10:23:41.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 Processor -- start 2023-12-18T10:23:41.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- start start 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c47fd0 0x55fa53c8a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c41a50 0x55fa53c8a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa5374e9f0 con 0x55fa53c8b6f0 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a8cc30 con 0x55fa53c41a50 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a2dec0 con 0x55fa53c47fd0 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53136/0 (socket says 172.21.15.133:53136) 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 -- 172.21.15.133:0/434660425 learned_addr learned my addr 172.21.15.133:0/434660425 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c47fd0 0x55fa53c8a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c41a50 0x55fa53c8a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 -- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c47fd0 msgr2=0x55fa53c8a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c47fd0 0x55fa53c8a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 -- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c41a50 msgr2=0x55fa53c8a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c41a50 0x55fa53c8a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 -- 172.21.15.133:0/434660425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa53a56240 con 0x55fa53c8b6f0 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c47fd0 0x55fa53c8a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6e9b7fe640 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c41a50 0x55fa53c8a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8c3f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f6e940177f0 tx=0x7f6e94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b153daa02b1fd555 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6e827fc640 1 -- 172.21.15.133:0/434660425 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400e040 con 0x55fa53c8b6f0 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6e827fc640 1 -- 172.21.15.133:0/434660425 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e94017e90 con 0x55fa53c8b6f0 2023-12-18T10:23:41.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6e827fc640 1 -- 172.21.15.133:0/434660425 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94015d30 con 0x55fa53c8b6f0 2023-12-18T10:23:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- 172.21.15.133:0/434660425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 msgr2=0x55fa53c8c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8c3f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f6e940177f0 tx=0x7f6e94009750 comp rx=0 tx=0).stop 2023-12-18T10:23:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- 172.21.15.133:0/434660425 shutdown_connections 2023-12-18T10:23:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8c3f0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c41a50 0x55fa53c8a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 --2- 172.21.15.133:0/434660425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c47fd0 0x55fa53c8a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- 172.21.15.133:0/434660425 >> 172.21.15.133:0/434660425 conn(0x55fa53c47250 msgr2=0x55fa53c88b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- 172.21.15.133:0/434660425 shutdown_connections 2023-12-18T10:23:41.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.054+0000 7f6ea588f000 1 -- 172.21.15.133:0/434660425 wait complete. 2023-12-18T10:23:41.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 -- start start 2023-12-18T10:23:41.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 Processor -- start 2023-12-18T10:23:41.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53ce9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c47fd0 0x55fa53ce9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a8b660 con 0x55fa53c8b6f0 2023-12-18T10:23:41.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a90150 con 0x55fa53c47fd0 2023-12-18T10:23:41.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa53a93e20 con 0x55fa53c41a50 2023-12-18T10:23:41.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 10 client.0 _ll_register_callbacks cb 0x55fa53a3f820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:41.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53152/0 (socket says 172.21.15.133:53152) 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e9b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c47fd0 0x55fa53ce9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 -- 172.21.15.133:0/3649709596 learned_addr learned my addr 172.21.15.133:0/3649709596 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53ce9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 -- 172.21.15.133:0/3649709596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 msgr2=0x55fa53ce9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53ce9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 -- 172.21.15.133:0/3649709596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c47fd0 msgr2=0x55fa53ce9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c47fd0 0x55fa53ce9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 -- 172.21.15.133:0/3649709596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e940174d0 con 0x55fa53c8b6f0 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea0ac2640 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8f5d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6e94000f90 tx=0x7f6e94004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285e4ef8edacebaf server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e7affd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e7affd640 1 -- 172.21.15.133:0/3649709596 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400e050 con 0x55fa53c8b6f0 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e7affd640 1 -- 172.21.15.133:0/3649709596 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e94020710 con 0x55fa53c8b6f0 2023-12-18T10:23:41.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 -- 172.21.15.133:0/3649709596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa53c45160 con 0x55fa53c8b6f0 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e7affd640 1 -- 172.21.15.133:0/3649709596 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e94020910 con 0x55fa53c8b6f0 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 10 client.7917 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 -- 172.21.15.133:0/3649709596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55fa53a3c590 con 0x55fa53c8b6f0 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e7affd640 1 -- 172.21.15.133:0/3649709596 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa53c45160 con 0x55fa53c8b6f0 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e7affd640 1 -- 172.21.15.133:0/3649709596 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f6e94020a70 con 0x55fa53c8b6f0 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 10 client.7917 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 10 client.7917 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 20 client.7917 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fa53c8c010 0x55fa53c8fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 4 client.7917 mds_command: new command op to 7099 tid=0[{"prefix": "scrub pause"}] 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6ea588f000 1 -- 172.21.15.133:0/3649709596 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x55fa53a40cc0 con 0x55fa53c8c010 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.058+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fa53c8c010 0x55fa53c8fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6e9bfff640 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fa53c8c010 0x55fa53c8fb10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6a8b8e9e3689e51 server_cookie=3648732ec3e313a in_seq=0 out_seq=0 2023-12-18T10:23:41.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6e7affd640 10 client.7917 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:41.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6e7affd640 1 -- 172.21.15.133:0/3649709596 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x55fa53a40cc0 con 0x55fa53c8c010 2023-12-18T10:23:41.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6e7affd640 10 client.7917 handle_command_reply: tid=0 2023-12-18T10:23:41.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 client.7917 shutdown 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 -- 172.21.15.133:0/3649709596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 msgr2=0x55fa53c8f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8f5d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f6e94000f90 tx=0x7f6e94004ac0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 -- 172.21.15.133:0/3649709596 shutdown_connections 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x55fa53c8c010 0x55fa53c8fb10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fa53c8b6f0 0x55fa53c8f5d0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6e7affd640 0 client.7917 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fa53c47fd0 0x55fa53ce9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 --2- 172.21.15.133:0/3649709596 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fa53c41a50 0x55fa53ce9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 -- 172.21.15.133:0/3649709596 >> 172.21.15.133:0/3649709596 conn(0x55fa53c47250 msgr2=0x55fa53c88290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 -- 172.21.15.133:0/3649709596 shutdown_connections 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 1 -- 172.21.15.133:0/3649709596 wait complete. 2023-12-18T10:23:41.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.062+0000 7f6ea588f000 20 client.7917 trim_cache size 0 max 16384 2023-12-18T10:23:41.065 INFO:teuthology.orchestra.run.smithi133.stderr:Error EXDEV: Not rank 0 2023-12-18T10:23:41.067 DEBUG:teuthology.orchestra.run:got remote process result: 18 2023-12-18T10:23:41.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a scrub resume 2023-12-18T10:23:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92f420640 1 Processor -- start 2023-12-18T10:23:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92f420640 1 -- start start 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92f420640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9280ceac0 0x7fb928164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92f420640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb928164e60 0x7fb9280cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92f420640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9280cc980 con 0x7fb928160a60 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92f420640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9280cc090 con 0x7fb928164e60 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92f420640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280cc330 con 0x7fb9280ceac0 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d1bc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb928160a60 0x7fb9280ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40006/0 (socket says 172.21.15.133:40006) 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d1bc640 1 -- 172.21.15.133:0/2243734896 learned_addr learned my addr 172.21.15.133:0/2243734896 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/2243734896 >> v2:172.21.15.142:3300/0 conn(0x7fb928164e60 0x7fb9280cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9280ceac0 0x7fb928164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250130746 0 0) 0x7fb9280cc980 con 0x7fb928160a60 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb914003530 con 0x7fb928160a60 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3652051840 0 0) 0x7fb914003530 con 0x7fb928160a60 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9280ceac0 msgr2=0x7fb928164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9280ceac0 0x7fb928164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 >> v2:172.21.15.142:3300/0 conn(0x7fb928164e60 msgr2=0x7fb9280cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 --2- 172.21.15.133:0/2243734896 >> v2:172.21.15.142:3300/0 conn(0x7fb928164e60 0x7fb9280cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280cc610 con 0x7fb928160a60 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fb924001680 con 0x7fb928160a60 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 >> v1:172.21.15.133:6789/0 conn(0x7fb928160a60 legacy=0x7fb9280ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb914003980 0x7fb914003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9140047d0 0x7fb914004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb914005190 0x7fb91400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280cc090 con 0x7fb914003980 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280cc330 con 0x7fb914005190 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91400bed0 con 0x7fb9140047d0 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9280ceac0 0x7fb928164920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb914003980 0x7fb914003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb914005190 0x7fb91400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9140047d0 0x7fb914004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d1bc640 1 -- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9140047d0 msgr2=0x7fb914004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9140047d0 0x7fb914004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d1bc640 1 -- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb914005190 msgr2=0x7fb91400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb914005190 0x7fb91400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d1bc640 1 -- 172.21.15.133:0/2243734896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914003530 con 0x7fb914003980 2023-12-18T10:23:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.210+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb914005190 0x7fb91400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:41.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb914003980 0x7fb914003da0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb92400c270 tx=0x7fb92401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca914c16e7f323ec server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924005ae0 con 0x7fb914003980 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924005c40 con 0x7fb914003980 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb91ffff640 1 -- 172.21.15.133:0/2243734896 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240a5840 con 0x7fb914003980 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb92f420640 1 -- 172.21.15.133:0/2243734896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb914003980 msgr2=0x7fb914003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb92f420640 1 --2- 172.21.15.133:0/2243734896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb914003980 0x7fb914003da0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb92400c270 tx=0x7fb92401cbf0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb92d9bd640 1 -- 172.21.15.133:0/2243734896 reap_dead start 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb92f420640 1 -- 172.21.15.133:0/2243734896 shutdown_connections 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb92f420640 1 -- 172.21.15.133:0/2243734896 >> 172.21.15.133:0/2243734896 conn(0x7fb92806a2a0 msgr2=0x7fb9280aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb92f420640 1 -- 172.21.15.133:0/2243734896 shutdown_connections 2023-12-18T10:23:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.214+0000 7fb92f420640 1 -- 172.21.15.133:0/2243734896 wait complete. 2023-12-18T10:23:41.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 Processor -- start 2023-12-18T10:23:41.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 -- start start 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb914003980 0x7fb9280c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb928162270 0x7fb9281f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb928163000 0x7fb928163480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9281639c0 con 0x7fb928163000 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280c3f10 con 0x7fb928162270 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9280c41f0 con 0x7fb914003980 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb928163000 0x7fb928163480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb928162270 0x7fb9281f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb928163000 0x7fb928163480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53160/0 (socket says 172.21.15.133:53160) 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 -- 172.21.15.133:0/1027973444 learned_addr learned my addr 172.21.15.133:0/1027973444 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d1bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb914003980 0x7fb9280c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 -- 172.21.15.133:0/1027973444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb914003980 msgr2=0x7fb9280c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/1027973444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb914003980 0x7fb9280c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 -- 172.21.15.133:0/1027973444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb928162270 msgr2=0x7fb9281f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/1027973444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb928162270 0x7fb9281f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 -- 172.21.15.133:0/1027973444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280c44d0 con 0x7fb928163000 2023-12-18T10:23:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/1027973444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb928163000 0x7fb928163480 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb9280c8f10 tx=0x7fb920010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb91dffb640 1 -- 172.21.15.133:0/1027973444 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92000e050 con 0x7fb928163000 2023-12-18T10:23:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb91dffb640 1 -- 172.21.15.133:0/1027973444 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92000f040 con 0x7fb928163000 2023-12-18T10:23:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb91dffb640 1 -- 172.21.15.133:0/1027973444 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200039a0 con 0x7fb928163000 2023-12-18T10:23:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 -- 172.21.15.133:0/1027973444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9280c47b0 con 0x7fb928163000 2023-12-18T10:23:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.218+0000 7fb92f420640 1 -- 172.21.15.133:0/1027973444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9281626f0 con 0x7fb928163000 2023-12-18T10:23:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.222+0000 7fb91dffb640 1 -- 172.21.15.133:0/1027973444 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb920003b00 con 0x7fb928163000 2023-12-18T10:23:41.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.222+0000 7fb91dffb640 1 --2- 172.21.15.133:0/1027973444 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb90c065a60 0x7fb90c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.222+0000 7fb91dffb640 1 -- 172.21.15.133:0/1027973444 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb920083760 con 0x7fb928163000 2023-12-18T10:23:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.222+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/1027973444 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb90c065a60 0x7fb90c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.222+0000 7fb93277e000 1 Processor -- start 2023-12-18T10:23:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- start start 2023-12-18T10:23:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/1027973444 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb90c065a60 0x7fb90c067f20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb9240ab000 tx=0x7fb9240a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de39c20 0x56247de3a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de3a540 0x56247ddefa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247ddf0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247dcb83d0 con 0x56247de3a540 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247dc46400 con 0x56247de39c20 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56247dc439d0 con 0x56247ddeff60 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de3a540 0x56247ddefa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de3a540 0x56247ddefa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53164/0 (socket says 172.21.15.133:53164) 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 -- 172.21.15.133:0/148282963 learned_addr learned my addr 172.21.15.133:0/148282963 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de39c20 0x56247de3a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247ddf0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 -- 172.21.15.133:0/148282963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 msgr2=0x56247ddf0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247ddf0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 -- 172.21.15.133:0/148282963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de39c20 msgr2=0x56247de3a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de39c20 0x56247de3a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 -- 172.21.15.133:0/148282963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56247d93bdc0 con 0x56247de3a540 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de3a540 0x56247ddefa20 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fb918009af0 tx=0x7fb918009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fb57185a396e2d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb90affd640 1 -- 172.21.15.133:0/148282963 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918014dd0 con 0x56247de3a540 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb90affd640 1 -- 172.21.15.133:0/148282963 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918004030 con 0x56247de3a540 2023-12-18T10:23:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb90affd640 1 -- 172.21.15.133:0/148282963 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9180043a0 con 0x56247de3a540 2023-12-18T10:23:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- 172.21.15.133:0/148282963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de3a540 msgr2=0x56247ddefa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de3a540 0x56247ddefa20 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fb918009af0 tx=0x7fb918009190 comp rx=0 tx=0).stop 2023-12-18T10:23:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- 172.21.15.133:0/148282963 shutdown_connections 2023-12-18T10:23:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247ddf0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de3a540 0x56247ddefa20 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 --2- 172.21.15.133:0/148282963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de39c20 0x56247de3a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- 172.21.15.133:0/148282963 >> 172.21.15.133:0/148282963 conn(0x56247dbee8b0 msgr2=0x56247ddee300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- 172.21.15.133:0/148282963 shutdown_connections 2023-12-18T10:23:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- 172.21.15.133:0/148282963 wait complete. 2023-12-18T10:23:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 -- start start 2023-12-18T10:23:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.226+0000 7fb93277e000 1 Processor -- start 2023-12-18T10:23:41.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de41060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de415a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247ddfadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247dc3f2c0 con 0x56247de39c20 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247dbde490 con 0x56247de3a540 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56247dbfc680 con 0x56247ddeff60 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 10 client.0 _ll_register_callbacks cb 0x56247dddb920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53166/0 (socket says 172.21.15.133:53166) 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 -- 172.21.15.133:0/1121928248 learned_addr learned my addr 172.21.15.133:0/1121928248 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de41060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247ddfadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 -- 172.21.15.133:0/1121928248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 msgr2=0x56247de41060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de41060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 -- 172.21.15.133:0/1121928248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 msgr2=0x56247ddfadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247ddfadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 -- 172.21.15.133:0/1121928248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb918009420 con 0x56247de39c20 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de415a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb91800a010 tx=0x7fb9180046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4a78e009645f14 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb903fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb903fff640 1 -- 172.21.15.133:0/1121928248 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918004440 con 0x56247de39c20 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb903fff640 1 -- 172.21.15.133:0/1121928248 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb91801a030 con 0x56247de39c20 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 -- 172.21.15.133:0/1121928248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56247dbfc0c0 con 0x56247de39c20 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb903fff640 1 -- 172.21.15.133:0/1121928248 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb918003620 con 0x56247de39c20 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 10 client.7929 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 -- 172.21.15.133:0/1121928248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x56247dc041f0 con 0x56247de39c20 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb903fff640 1 -- 172.21.15.133:0/1121928248 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56247dbfc0c0 con 0x56247de39c20 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb903fff640 1 -- 172.21.15.133:0/1121928248 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fb918028070 con 0x56247de39c20 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 10 client.7929 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 10 client.7929 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 20 client.7929 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x56247ddfbb60 0x56247ddfbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 4 client.7929 mds_command: new command op to 7099 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:23:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb93277e000 1 -- 172.21.15.133:0/1121928248 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56247dc3dc10 con 0x56247ddfbb60 2023-12-18T10:23:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x56247ddfbb60 0x56247ddfbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb903fff640 10 client.7929 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.230+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x56247ddfbb60 0x56247ddfbf40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b331f5a5dd27b8fc server_cookie=f31221e80a9b5087 in_seq=0 out_seq=0 2023-12-18T10:23:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb903fff640 1 -- 172.21.15.133:0/1121928248 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56247dc3dc10 con 0x56247ddfbb60 2023-12-18T10:23:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb903fff640 10 client.7929 handle_command_reply: tid=0 2023-12-18T10:23:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 client.7929 shutdown 2023-12-18T10:23:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 -- 172.21.15.133:0/1121928248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 msgr2=0x56247de415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de415a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fb91800a010 tx=0x7fb9180046d0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 -- 172.21.15.133:0/1121928248 shutdown_connections 2023-12-18T10:23:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x56247ddfbb60 0x56247ddfbf40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247ddfadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de415a0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 --2- 172.21.15.133:0/1121928248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de41060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb903fff640 0 client.7929 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 -- 172.21.15.133:0/1121928248 >> 172.21.15.133:0/1121928248 conn(0x56247dbee8b0 msgr2=0x56247ddeea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 -- 172.21.15.133:0/1121928248 shutdown_connections 2023-12-18T10:23:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 1 -- 172.21.15.133:0/1121928248 wait complete. 2023-12-18T10:23:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.234+0000 7fb93277e000 20 client.7929 trim_cache size 0 max 16384 2023-12-18T10:23:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb93277e000 1 Processor -- start 2023-12-18T10:23:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb93277e000 1 -- start start 2023-12-18T10:23:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb93277e000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de917b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb93277e000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de91cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb93277e000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247de92230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb93277e000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247d8fca40 con 0x56247de39c20 2023-12-18T10:23:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb93277e000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247dc05260 con 0x56247de3a540 2023-12-18T10:23:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb93277e000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56247ddefa80 con 0x56247ddeff60 2023-12-18T10:23:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de91cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de91cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53176/0 (socket says 172.21.15.133:53176) 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb92c9bb640 1 -- 172.21.15.133:0/3193050390 learned_addr learned my addr 172.21.15.133:0/3193050390 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.246+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247de92230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de917b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 -- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 msgr2=0x56247de917b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de917b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 -- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 msgr2=0x56247de92230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247de92230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 -- 172.21.15.133:0/3193050390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56247dbea540 con 0x56247de39c20 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247de92230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de91cf0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb9180091b0 tx=0x7fb918021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b2f9dd879c5ea3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb90b7fe640 1 -- 172.21.15.133:0/3193050390 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918004240 con 0x56247de39c20 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb90b7fe640 1 -- 172.21.15.133:0/3193050390 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918025040 con 0x56247de39c20 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb90b7fe640 1 -- 172.21.15.133:0/3193050390 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91801f430 con 0x56247de39c20 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- 172.21.15.133:0/3193050390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 msgr2=0x56247de91cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de91cf0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fb9180091b0 tx=0x7fb918021070 comp rx=0 tx=0).stop 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- 172.21.15.133:0/3193050390 shutdown_connections 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247de3a540 0x56247de92230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de91cf0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 --2- 172.21.15.133:0/3193050390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247ddeff60 0x56247de917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- 172.21.15.133:0/3193050390 >> 172.21.15.133:0/3193050390 conn(0x56247dbee8b0 msgr2=0x56247de36110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- 172.21.15.133:0/3193050390 shutdown_connections 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- 172.21.15.133:0/3193050390 wait complete. 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- start start 2023-12-18T10:23:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 Processor -- start 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247ddeff60 0x56247de96e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247de3a540 0x56247de3c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247dbfd420 con 0x56247de39c20 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247dd0e0e0 con 0x56247ddeff60 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56247dc3cad0 con 0x56247de3a540 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb93277e000 10 client.0 _ll_register_callbacks cb 0x56247dbf66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53188/0 (socket says 172.21.15.133:53188) 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92c9bb640 1 -- 172.21.15.133:0/2168811176 learned_addr learned my addr 172.21.15.133:0/2168811176 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247ddeff60 0x56247de96e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.250+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247de3a540 0x56247de3c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92d1bc640 1 -- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247de3a540 msgr2=0x56247de3c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247de3a540 0x56247de3c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92d1bc640 1 -- 172.21.15.133:0/2168811176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 msgr2=0x56247de973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92d1bc640 1 -- 172.21.15.133:0/2168811176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56247dc041f0 con 0x56247ddeff60 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92d9bd640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247de3a540 0x56247de3c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92d1bc640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247ddeff60 0x56247de96e70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb924009000 tx=0x7fb9240199e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b73372dc48a890c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 1 -- 172.21.15.133:0/2168811176 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240cd070 con 0x56247ddeff60 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 1 -- 172.21.15.133:0/2168811176 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb924001600 con 0x56247ddeff60 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 -- 172.21.15.133:0/2168811176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56247ddf3880 con 0x56247ddeff60 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 1 -- 172.21.15.133:0/2168811176 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9240c0040 con 0x56247ddeff60 2023-12-18T10:23:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 10 client.7423 fetch_fsmap learned FSMap version 74 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 -- 172.21.15.133:0/2168811176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x56247dbde0b0 con 0x56247ddeff60 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 1 -- 172.21.15.133:0/2168811176 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56247ddf3880 con 0x56247ddeff60 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 1 -- 172.21.15.133:0/2168811176 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 74) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fb9240c6040 con 0x56247ddeff60 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 10 client.7423 fetch_fsmap finished waiting for FSMap version 74 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 10 client.7423 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 20 client.7423 populate_metadata read hostname 'smithi133' 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x56247de3cdc0 0x56247de3d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 4 client.7423 mds_command: new command op to 7099 tid=0[{"prefix": "scrub resume"}] 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 -- 172.21.15.133:0/2168811176 --> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x56247dc08640 con 0x56247de3cdc0 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x56247de3cdc0 0x56247de3d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb92c9bb640 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x56247de3cdc0 0x56247de3d1a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=714cbaec03d688ae server_cookie=19b39ede5838a73 in_seq=0 out_seq=0 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 10 client.7423 ms_handle_connect on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 1 -- 172.21.15.133:0/2168811176 <== mds.1 v2:172.21.15.133:6834/1132580582 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x56247dc08640 con 0x56247de3cdc0 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 10 client.7423 handle_command_reply: tid=0 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 client.7423 shutdown 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 -- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247ddeff60 msgr2=0x56247de96e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247ddeff60 0x56247de96e70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb924009000 tx=0x7fb9240199e0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 -- 172.21.15.133:0/2168811176 shutdown_connections 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.133:6834/1132580582,v1:172.21.15.133:6836/1132580582] conn(0x56247de3cdc0 0x56247de3d1a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56247de3a540 0x56247de3c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56247de39c20 0x56247de973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb903fff640 0 client.7423 ms_handle_reset on v2:172.21.15.133:6834/1132580582 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 --2- 172.21.15.133:0/2168811176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56247ddeff60 0x56247de96e70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 -- 172.21.15.133:0/2168811176 >> 172.21.15.133:0/2168811176 conn(0x56247dbee8b0 msgr2=0x56247de369a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 -- 172.21.15.133:0/2168811176 shutdown_connections 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 1 -- 172.21.15.133:0/2168811176 wait complete. 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.254+0000 7fb93277e000 20 client.7423 trim_cache size 0 max 16384 2023-12-18T10:23:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:Error EXDEV: Not rank 0 2023-12-18T10:23:41.261 DEBUG:teuthology.orchestra.run:got remote process result: 18 2023-12-18T10:23:41.262 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:23:41.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:23:41.307 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:23:41.367 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:23:41.367 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:23:41.367 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:41.376 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.554+0000 7f0eb9da2640 1 Processor -- start 2023-12-18T10:23:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.554+0000 7f0eb9da2640 1 -- start start 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb9da2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 0x7f0eb406ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb9da2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb40cc6c0 0x7f0eb40ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb9da2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb40cbc70 con 0x7f0eb40afd10 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb9da2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40c3bb0 con 0x7f0eb40cc6c0 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb9da2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40c3e90 con 0x7f0eb406fb60 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb95a1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb40cc6c0 0x7f0eb40ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb95a1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb40cc6c0 0x7f0eb40ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53190/0 (socket says 172.21.15.133:53190) 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb95a1640 1 -- 172.21.15.133:0/3331581626 learned_addr learned my addr 172.21.15.133:0/3331581626 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb3fff640 1 --2- 172.21.15.133:0/3331581626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 0x7f0eb406ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb95a1640 1 -- 172.21.15.133:0/3331581626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 msgr2=0x7f0eb406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb95a1640 1 --2- 172.21.15.133:0/3331581626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 0x7f0eb406ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb95a1640 1 -- 172.21.15.133:0/3331581626 >> v1:172.21.15.142:6789/0 conn(0x7f0eb40afd10 legacy=0x7f0eb40b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.558+0000 7f0eb95a1640 1 -- 172.21.15.133:0/3331581626 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40cbec0 con 0x7f0eb40cc6c0 2023-12-18T10:23:41.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb95a1640 1 --2- 172.21.15.133:0/3331581626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40cc6c0 0x7f0eb40ccb50 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00d150 tx=0x7f0eac01ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76aae1afbee40ed8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb37fe640 1 -- 172.21.15.133:0/3331581626 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac00b2d0 con 0x7f0eb40cc6c0 2023-12-18T10:23:41.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb37fe640 1 -- 172.21.15.133:0/3331581626 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac00b430 con 0x7f0eb40cc6c0 2023-12-18T10:23:41.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb37fe640 1 -- 172.21.15.133:0/3331581626 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0a7cb0 con 0x7f0eb40cc6c0 2023-12-18T10:23:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 -- 172.21.15.133:0/3331581626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40cc6c0 msgr2=0x7f0eb40ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/3331581626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40cc6c0 0x7f0eb40ccb50 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00d150 tx=0x7f0eac01ebe0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 -- 172.21.15.133:0/3331581626 shutdown_connections 2023-12-18T10:23:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/3331581626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40cc6c0 0x7f0eb40ccb50 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/3331581626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 0x7f0eb406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 -- 172.21.15.133:0/3331581626 >> 172.21.15.133:0/3331581626 conn(0x7f0eb40ce130 msgr2=0x7f0eb40ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 -- 172.21.15.133:0/3331581626 shutdown_connections 2023-12-18T10:23:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 -- 172.21.15.133:0/3331581626 wait complete. 2023-12-18T10:23:41.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 Processor -- start 2023-12-18T10:23:41.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.562+0000 7f0eb9da2640 1 -- start start 2023-12-18T10:23:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 0x7f0eb41f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40afd10 0x7f0eb40c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40cc6c0 0x7f0eb4070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb41636c0 con 0x7f0eb40afd10 2023-12-18T10:23:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb41f49f0 con 0x7f0eb40cc6c0 2023-12-18T10:23:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40c7670 con 0x7f0eb406fb60 2023-12-18T10:23:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40afd10 0x7f0eb40c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40afd10 0x7f0eb40c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53192/0 (socket says 172.21.15.133:53192) 2023-12-18T10:23:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 -- 172.21.15.133:0/1906836878 learned_addr learned my addr 172.21.15.133:0/1906836878 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb8da0640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 0x7f0eb41f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb95a1640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40cc6c0 0x7f0eb4070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 -- 172.21.15.133:0/1906836878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 msgr2=0x7f0eb41f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 0x7f0eb41f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 -- 172.21.15.133:0/1906836878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40cc6c0 msgr2=0x7f0eb4070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40cc6c0 0x7f0eb4070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 -- 172.21.15.133:0/1906836878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac00bd40 con 0x7f0eb40afd10 2023-12-18T10:23:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb3fff640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40afd10 0x7f0eb40c6ba0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000d800 tx=0x7f0ea000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb17fa640 1 -- 172.21.15.133:0/1906836878 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000b6c0 con 0x7f0eb40afd10 2023-12-18T10:23:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb17fa640 1 -- 172.21.15.133:0/1906836878 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000b860 con 0x7f0eb40afd10 2023-12-18T10:23:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb17fa640 1 -- 172.21.15.133:0/1906836878 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000bc10 con 0x7f0eb40afd10 2023-12-18T10:23:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb4162ab0 con 0x7f0eb40afd10 2023-12-18T10:23:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb4163070 con 0x7f0eb40afd10 2023-12-18T10:23:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb413f620 con 0x7f0eb40afd10 2023-12-18T10:23:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.566+0000 7f0eb17fa640 1 -- 172.21.15.133:0/1906836878 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0ea001e460 con 0x7f0eb40afd10 2023-12-18T10:23:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.570+0000 7f0eb17fa640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e98065a60 0x7f0e98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.570+0000 7f0eb17fa640 1 -- 172.21.15.133:0/1906836878 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0ea0083770 con 0x7f0eb40afd10 2023-12-18T10:23:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.570+0000 7f0eb8da0640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e98065a60 0x7f0e98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.570+0000 7f0eb8da0640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e98065a60 0x7f0e98067f20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8007fd0 tx=0x7f0ea8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.574+0000 7f0eb17fa640 1 -- 172.21.15.133:0/1906836878 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0ea00510a0 con 0x7f0eb40afd10 2023-12-18T10:23:41.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.722+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eb4163870 con 0x7f0eb40afd10 2023-12-18T10:23:41.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb17fa640 1 -- 172.21.15.133:0/1906836878 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16357 (secure 0 0 0) 0x7f0ea00546c0 con 0x7f0eb40afd10 2023-12-18T10:23:41.725 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:41.726 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:23:12.471181+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:23:10.000470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-18T10:23:10.462940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:41.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e98065a60 msgr2=0x7f0e98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e98065a60 0x7f0e98067f20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8007fd0 tx=0x7f0ea8009040 comp rx=0 tx=0).stop 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40afd10 msgr2=0x7f0eb40c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40afd10 0x7f0eb40c6ba0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000d800 tx=0x7f0ea000dcc0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 shutdown_connections 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e98065a60 0x7f0e98067f20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40cc6c0 0x7f0eb4070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40afd10 0x7f0eb40c6ba0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 --2- 172.21.15.133:0/1906836878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0eb406fb60 0x7f0eb41f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 >> 172.21.15.133:0/1906836878 conn(0x7f0eb40ce130 msgr2=0x7f0eb4159a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 shutdown_connections 2023-12-18T10:23:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.726+0000 7f0eb9da2640 1 -- 172.21.15.133:0/1906836878 wait complete. 2023-12-18T10:23:41.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:23:10.000470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:23:10.462940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:23:41.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:23:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a988c640 1 Processor -- start 2023-12-18T10:23:41.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a988c640 1 -- start start 2023-12-18T10:23:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a988c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa0a415cae0 0x7fa0a40d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a988c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 0x7fa0a40ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a988c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0a40cf170 0x7fa0a40cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a988c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a40cfb40 con 0x7fa0a40cf170 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a988c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a415cec0 con 0x7fa0a415cae0 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a988c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40d0530 con 0x7fa0a40cde90 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0a40cf170 0x7fa0a40cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0a40cf170 0x7fa0a40cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53194/0 (socket says 172.21.15.133:53194) 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a37fe640 1 -- 172.21.15.133:0/383609747 learned_addr learned my addr 172.21.15.133:0/383609747 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a2ffd640 1 --2- 172.21.15.133:0/383609747 >> v2:172.21.15.142:3300/0 conn(0x7fa0a415cae0 0x7fa0a40d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a27fc640 1 --2- 172.21.15.133:0/383609747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 0x7fa0a40ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a37fe640 1 -- 172.21.15.133:0/383609747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 msgr2=0x7fa0a40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a37fe640 1 --2- 172.21.15.133:0/383609747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 0x7fa0a40ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a37fe640 1 -- 172.21.15.133:0/383609747 >> v2:172.21.15.142:3300/0 conn(0x7fa0a415cae0 msgr2=0x7fa0a40d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a37fe640 1 --2- 172.21.15.133:0/383609747 >> v2:172.21.15.142:3300/0 conn(0x7fa0a415cae0 0x7fa0a40d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a37fe640 1 -- 172.21.15.133:0/383609747 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40d0810 con 0x7fa0a40cf170 2023-12-18T10:23:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.890+0000 7fa0a2ffd640 1 --2- 172.21.15.133:0/383609747 >> v2:172.21.15.142:3300/0 conn(0x7fa0a415cae0 0x7fa0a40d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a37fe640 1 --2- 172.21.15.133:0/383609747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40cf170 0x7fa0a40cf600 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa0a406a520 tx=0x7fa09c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3c79eb7be2228f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a1ffb640 1 -- 172.21.15.133:0/383609747 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0a5820 con 0x7fa0a40cf170 2023-12-18T10:23:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a1ffb640 1 -- 172.21.15.133:0/383609747 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c0a5980 con 0x7fa0a40cf170 2023-12-18T10:23:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a1ffb640 1 -- 172.21.15.133:0/383609747 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0a5d10 con 0x7fa0a40cf170 2023-12-18T10:23:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 -- 172.21.15.133:0/383609747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40cf170 msgr2=0x7fa0a40cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 --2- 172.21.15.133:0/383609747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40cf170 0x7fa0a40cf600 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa0a406a520 tx=0x7fa09c01c9a0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 -- 172.21.15.133:0/383609747 shutdown_connections 2023-12-18T10:23:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 --2- 172.21.15.133:0/383609747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40cf170 0x7fa0a40cf600 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 --2- 172.21.15.133:0/383609747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 0x7fa0a40ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 --2- 172.21.15.133:0/383609747 >> v2:172.21.15.142:3300/0 conn(0x7fa0a415cae0 0x7fa0a40d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 -- 172.21.15.133:0/383609747 >> 172.21.15.133:0/383609747 conn(0x7fa0a4089fb0 msgr2=0x7fa0a40d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 -- 172.21.15.133:0/383609747 shutdown_connections 2023-12-18T10:23:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 -- 172.21.15.133:0/383609747 wait complete. 2023-12-18T10:23:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.894+0000 7fa0a988c640 1 Processor -- start 2023-12-18T10:23:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 -- start start 2023-12-18T10:23:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 0x7fa0a4155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40cf170 0x7fa0a415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a415cae0 0x7fa0a415d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415d600 con 0x7fa0a415cae0 2023-12-18T10:23:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415f8a0 con 0x7fa0a40cf170 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415f2a0 con 0x7fa0a40cde90 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a415cae0 0x7fa0a415d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a415cae0 0x7fa0a415d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53208/0 (socket says 172.21.15.133:53208) 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 -- 172.21.15.133:0/3701155553 learned_addr learned my addr 172.21.15.133:0/3701155553 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a2ffd640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 0x7fa0a4155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a27fc640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40cf170 0x7fa0a415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 -- 172.21.15.133:0/3701155553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 msgr2=0x7fa0a4155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 0x7fa0a4155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 -- 172.21.15.133:0/3701155553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40cf170 msgr2=0x7fa0a415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40cf170 0x7fa0a415d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 -- 172.21.15.133:0/3701155553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009b30 con 0x7fa0a415cae0 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a37fe640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a415cae0 0x7fa0a415d8c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0af040 tx=0x7fa09c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa08bfff640 1 -- 172.21.15.133:0/3701155553 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0b8670 con 0x7fa0a415cae0 2023-12-18T10:23:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa08bfff640 1 -- 172.21.15.133:0/3701155553 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c0b87f0 con 0x7fa0a415cae0 2023-12-18T10:23:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa08bfff640 1 -- 172.21.15.133:0/3701155553 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0b8ba0 con 0x7fa0a415cae0 2023-12-18T10:23:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a415f580 con 0x7fa0a415cae0 2023-12-18T10:23:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a415fe40 con 0x7fa0a415cae0 2023-12-18T10:23:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.898+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a40b55c0 con 0x7fa0a415cae0 2023-12-18T10:23:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.902+0000 7fa08bfff640 1 -- 172.21.15.133:0/3701155553 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa09c0b8d00 con 0x7fa0a415cae0 2023-12-18T10:23:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.902+0000 7fa08bfff640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa090065a60 0x7fa090067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.902+0000 7fa08bfff640 1 -- 172.21.15.133:0/3701155553 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa09c11e720 con 0x7fa0a415cae0 2023-12-18T10:23:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.902+0000 7fa0a2ffd640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa090065a60 0x7fa090067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.902+0000 7fa0a2ffd640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa090065a60 0x7fa090067f20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa094006fd0 tx=0x7fa094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:41.906+0000 7fa08bfff640 1 -- 172.21.15.133:0/3701155553 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa0a40b55c0 con 0x7fa0a415cae0 2023-12-18T10:23:42.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.062+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0a40b55c0 con 0x7fa0a415cae0 2023-12-18T10:23:42.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.062+0000 7fa08bfff640 1 -- 172.21.15.133:0/3701155553 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0a40b55c0 con 0x7fa0a415cae0 2023-12-18T10:23:42.064 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa090065a60 msgr2=0x7fa090067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa090065a60 0x7fa090067f20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa094006fd0 tx=0x7fa094008040 comp rx=0 tx=0).stop 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a415cae0 msgr2=0x7fa0a415d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a415cae0 0x7fa0a415d8c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0af040 tx=0x7fa09c019740 comp rx=0 tx=0).stop 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 shutdown_connections 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa090065a60 0x7fa090067f20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a415cae0 0x7fa0a415d8c0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa0a40cf170 0x7fa0a415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 --2- 172.21.15.133:0/3701155553 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa0a40cde90 0x7fa0a4155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 >> 172.21.15.133:0/3701155553 conn(0x7fa0a4089fb0 msgr2=0x7fa0a40b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 shutdown_connections 2023-12-18T10:23:42.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.066+0000 7fa0a988c640 1 -- 172.21.15.133:0/3701155553 wait complete. 2023-12-18T10:23:42.085 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:23:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f76c4640 1 Processor -- start 2023-12-18T10:23:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f76c4640 1 -- start start 2023-12-18T10:23:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f76c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f0164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f76c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f00cc980 con 0x7f43f0164e60 2023-12-18T10:23:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f76c4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f00cc090 con 0x7f43f0160a60 2023-12-18T10:23:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f76c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00cc330 con 0x7f43f00ceac0 2023-12-18T10:23:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f5c61640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f43f0164e60 0x7f43f00cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40020/0 (socket says 172.21.15.133:40020) 2023-12-18T10:23:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f5c61640 1 -- 172.21.15.133:0/2349170493 learned_addr learned my addr 172.21.15.133:0/2349170493 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f4c5f640 1 --2- 172.21.15.133:0/2349170493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f0164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43e7fff640 1 -- 172.21.15.133:0/2349170493 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272866833 0 0) 0x7f43f00cc980 con 0x7f43f0164e60 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43e7fff640 1 -- 172.21.15.133:0/2349170493 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43dc003530 con 0x7f43f0164e60 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43e7fff640 1 -- 172.21.15.133:0/2349170493 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942245396 0 0) 0x7f43f00cc090 con 0x7f43f0160a60 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43e7fff640 1 -- 172.21.15.133:0/2349170493 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f00cc980 con 0x7f43f0160a60 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f4c5f640 1 -- 172.21.15.133:0/2349170493 >> v1:172.21.15.142:6789/0 conn(0x7f43f0160a60 legacy=0x7f43f00ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f4c5f640 1 -- 172.21.15.133:0/2349170493 >> v1:172.21.15.133:6789/0 conn(0x7f43f0164e60 legacy=0x7f43f00cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43e7fff640 1 -- 172.21.15.133:0/2349170493 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2057872371 0 0) 0x7f43dc003530 con 0x7f43f0164e60 2023-12-18T10:23:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.226+0000 7f43f4c5f640 1 -- 172.21.15.133:0/2349170493 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f00cc610 con 0x7f43f00ceac0 2023-12-18T10:23:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43f4c5f640 1 --2- 172.21.15.133:0/2349170493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f0164920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009820 tx=0x7f43e001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4aa7b329655ce51 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43e7fff640 1 -- 172.21.15.133:0/2349170493 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8001a00 con 0x7f43f00ceac0 2023-12-18T10:23:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43e7fff640 1 -- 172.21.15.133:0/2349170493 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e00ad460 con 0x7f43f00ceac0 2023-12-18T10:23:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43e7fff640 1 -- 172.21.15.133:0/2349170493 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00ad7d0 con 0x7f43f00ceac0 2023-12-18T10:23:42.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43f76c4640 1 -- 172.21.15.133:0/2349170493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 msgr2=0x7f43f0164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43f76c4640 1 --2- 172.21.15.133:0/2349170493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f0164920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009820 tx=0x7f43e001c3c0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43f76c4640 1 -- 172.21.15.133:0/2349170493 shutdown_connections 2023-12-18T10:23:42.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43f76c4640 1 --2- 172.21.15.133:0/2349170493 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f0164920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43f76c4640 1 -- 172.21.15.133:0/2349170493 >> 172.21.15.133:0/2349170493 conn(0x7f43f006a2a0 msgr2=0x7f43f00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43f76c4640 1 -- 172.21.15.133:0/2349170493 shutdown_connections 2023-12-18T10:23:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.230+0000 7f43f76c4640 1 -- 172.21.15.133:0/2349170493 wait complete. 2023-12-18T10:23:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 Processor -- start 2023-12-18T10:23:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 -- start start 2023-12-18T10:23:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f00c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f0160a60 0x7f43f015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f0164e60 0x7f43f015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f015f460 con 0x7f43f0160a60 2023-12-18T10:23:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f0162500 con 0x7f43f0164e60 2023-12-18T10:23:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f01627e0 con 0x7f43f00ceac0 2023-12-18T10:23:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f0160a60 0x7f43f015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f0160a60 0x7f43f015e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53216/0 (socket says 172.21.15.133:53216) 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 -- 172.21.15.133:0/4220004650 learned_addr learned my addr 172.21.15.133:0/4220004650 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f5460640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f00c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f5c61640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f0164e60 0x7f43f015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 -- 172.21.15.133:0/4220004650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 msgr2=0x7f43f00c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f00c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 -- 172.21.15.133:0/4220004650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f0164e60 msgr2=0x7f43f015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f0164e60 0x7f43f015ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 -- 172.21.15.133:0/4220004650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0009420 con 0x7f43f0160a60 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f4c5f640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f0160a60 0x7f43f015e9e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b0040 tx=0x7f43e0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43e5ffb640 1 -- 172.21.15.133:0/4220004650 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00bb070 con 0x7f43f0160a60 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43e5ffb640 1 -- 172.21.15.133:0/4220004650 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e0003830 con 0x7f43f0160a60 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43e5ffb640 1 -- 172.21.15.133:0/4220004650 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0003ba0 con 0x7f43f0160a60 2023-12-18T10:23:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f0162ac0 con 0x7f43f0160a60 2023-12-18T10:23:42.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.234+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f00c6a40 con 0x7f43f0160a60 2023-12-18T10:23:42.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.238+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f004e000 con 0x7f43f0160a60 2023-12-18T10:23:42.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.238+0000 7f43e5ffb640 1 -- 172.21.15.133:0/4220004650 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f43e00b4040 con 0x7f43f0160a60 2023-12-18T10:23:42.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.238+0000 7f43e5ffb640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f43d4065a60 0x7f43d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.238+0000 7f43e5ffb640 1 -- 172.21.15.133:0/4220004650 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f43e011cb50 con 0x7f43f0160a60 2023-12-18T10:23:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.238+0000 7f43f5460640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f43d4065a60 0x7f43d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.238+0000 7f43f5460640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f43d4065a60 0x7f43d4067f20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0011f0 tx=0x7f43ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.242+0000 7f43e5ffb640 1 -- 172.21.15.133:0/4220004650 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f43e00ea470 con 0x7f43f0160a60 2023-12-18T10:23:42.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.390+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43f00b0c00 con 0x7f43f0160a60 2023-12-18T10:23:42.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.390+0000 7f43e5ffb640 1 -- 172.21.15.133:0/4220004650 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43e00eda90 con 0x7f43f0160a60 2023-12-18T10:23:42.392 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:23:42.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f43d4065a60 msgr2=0x7f43d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f43d4065a60 0x7f43d4067f20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0011f0 tx=0x7f43ec009040 comp rx=0 tx=0).stop 2023-12-18T10:23:42.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f0160a60 msgr2=0x7f43f015e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f0160a60 0x7f43f015e9e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b0040 tx=0x7f43e0019160 comp rx=0 tx=0).stop 2023-12-18T10:23:42.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 shutdown_connections 2023-12-18T10:23:42.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f43d4065a60 0x7f43d4067f20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43f0164e60 0x7f43f015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f0160a60 0x7f43f015e9e0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 --2- 172.21.15.133:0/4220004650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43f00ceac0 0x7f43f00c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 >> 172.21.15.133:0/4220004650 conn(0x7f43f006a2a0 msgr2=0x7f43f006fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:42.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 shutdown_connections 2023-12-18T10:23:42.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.394+0000 7f43f76c4640 1 -- 172.21.15.133:0/4220004650 wait complete. 2023-12-18T10:23:42.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:23:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f6253bb3640 1 Processor -- start 2023-12-18T10:23:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f6253bb3640 1 -- start start 2023-12-18T10:23:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f6253bb3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f624c071870 0x7f624c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f6253bb3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0cbff0 0x7f624c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f6253bb3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c0cc930 con 0x7f624c0ca410 2023-12-18T10:23:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f6253bb3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c15aab0 con 0x7f624c071870 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f6253bb3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c070df0 con 0x7f624c0cbff0 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f625114e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f624c071870 0x7f624c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f625194f640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f624c0ca410 0x7f624c159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40036/0 (socket says 172.21.15.133:40036) 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f625194f640 1 -- 172.21.15.133:0/3357747002 learned_addr learned my addr 172.21.15.133:0/3357747002 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f6252150640 1 --2- 172.21.15.133:0/3357747002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0cbff0 0x7f624c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f625114e640 1 -- 172.21.15.133:0/3357747002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0cbff0 msgr2=0x7f624c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f625114e640 1 --2- 172.21.15.133:0/3357747002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0cbff0 0x7f624c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f625114e640 1 -- 172.21.15.133:0/3357747002 >> v1:172.21.15.133:6789/0 conn(0x7f624c0ca410 legacy=0x7f624c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.554+0000 7f625114e640 1 -- 172.21.15.133:0/3357747002 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c15a4f0 con 0x7f624c071870 2023-12-18T10:23:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f625114e640 1 --2- 172.21.15.133:0/3357747002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c071870 0x7f624c071d00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f623c0097c0 tx=0x7f623c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dce8a424e75658b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f625094d640 1 -- 172.21.15.133:0/3357747002 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c0ab650 con 0x7f624c071870 2023-12-18T10:23:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f625094d640 1 -- 172.21.15.133:0/3357747002 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c0ab7b0 con 0x7f624c071870 2023-12-18T10:23:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f625094d640 1 -- 172.21.15.133:0/3357747002 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c0abb40 con 0x7f624c071870 2023-12-18T10:23:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f6253bb3640 1 -- 172.21.15.133:0/3357747002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c071870 msgr2=0x7f624c071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f6253bb3640 1 --2- 172.21.15.133:0/3357747002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c071870 0x7f624c071d00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f623c0097c0 tx=0x7f623c01c450 comp rx=0 tx=0).stop 2023-12-18T10:23:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f6253bb3640 1 -- 172.21.15.133:0/3357747002 shutdown_connections 2023-12-18T10:23:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f6253bb3640 1 --2- 172.21.15.133:0/3357747002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0cbff0 0x7f624c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f6253bb3640 1 --2- 172.21.15.133:0/3357747002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c071870 0x7f624c071d00 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f6253bb3640 1 -- 172.21.15.133:0/3357747002 >> 172.21.15.133:0/3357747002 conn(0x7f624c06a2a0 msgr2=0x7f624c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f6253bb3640 1 -- 172.21.15.133:0/3357747002 shutdown_connections 2023-12-18T10:23:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.558+0000 7f6253bb3640 1 -- 172.21.15.133:0/3357747002 wait complete. 2023-12-18T10:23:42.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 Processor -- start 2023-12-18T10:23:42.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 -- start start 2023-12-18T10:23:42.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624c071870 0x7f624c14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0ca410 0x7f624c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c0cbff0 0x7f624c149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c14fb60 con 0x7f624c0cbff0 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c14ea20 con 0x7f624c071870 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c14fde0 con 0x7f624c0ca410 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6252150640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c0cbff0 0x7f624c149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f625194f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624c071870 0x7f624c14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f625194f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624c071870 0x7f624c14f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:59464/0 (socket says 172.21.15.133:59464) 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f625194f640 1 -- 172.21.15.133:0/13700141 learned_addr learned my addr 172.21.15.133:0/13700141 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6252150640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c0cbff0 0x7f624c149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53244/0 (socket says 172.21.15.133:53244) 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f625114e640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0ca410 0x7f624c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6252150640 1 -- 172.21.15.133:0/13700141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0ca410 msgr2=0x7f624c14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6252150640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0ca410 0x7f624c14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6252150640 1 -- 172.21.15.133:0/13700141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624c071870 msgr2=0x7f624c14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6252150640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624c071870 0x7f624c14f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6252150640 1 -- 172.21.15.133:0/13700141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c009420 con 0x7f624c0cbff0 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f625194f640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624c071870 0x7f624c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6252150640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c0cbff0 0x7f624c149840 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f6244007d90 tx=0x7f624400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f62427fc640 1 -- 172.21.15.133:0/13700141 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244018070 con 0x7f624c0cbff0 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f62427fc640 1 -- 172.21.15.133:0/13700141 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624400edd0 con 0x7f624c0cbff0 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c14da00 con 0x7f624c0cbff0 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f62427fc640 1 -- 172.21.15.133:0/13700141 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244003bc0 con 0x7f624c0cbff0 2023-12-18T10:23:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c14dfc0 con 0x7f624c0cbff0 2023-12-18T10:23:42.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.562+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c14e1b0 con 0x7f624c0cbff0 2023-12-18T10:23:42.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.566+0000 7f62427fc640 1 -- 172.21.15.133:0/13700141 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6244014420 con 0x7f624c0cbff0 2023-12-18T10:23:42.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.566+0000 7f62427fc640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6230065a90 0x7f6230067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.566+0000 7f62427fc640 1 -- 172.21.15.133:0/13700141 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62440834a0 con 0x7f624c0cbff0 2023-12-18T10:23:42.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.566+0000 7f625194f640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6230065a90 0x7f6230067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.566+0000 7f625194f640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6230065a90 0x7f6230067f50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6248000f70 tx=0x7f6248009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.570+0000 7f62427fc640 1 -- 172.21.15.133:0/13700141 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6244050d30 con 0x7f624c0cbff0 2023-12-18T10:23:42.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.718+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f624c04e000 con 0x7f624c0cbff0 2023-12-18T10:23:42.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.718+0000 7f62427fc640 1 -- 172.21.15.133:0/13700141 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6244054350 con 0x7f624c0cbff0 2023-12-18T10:23:42.718 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:23:42.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6230065a90 msgr2=0x7f6230067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6230065a90 0x7f6230067f50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6248000f70 tx=0x7f6248009040 comp rx=0 tx=0).stop 2023-12-18T10:23:42.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c0cbff0 msgr2=0x7f624c149840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c0cbff0 0x7f624c149840 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f6244007d90 tx=0x7f624400e4b0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 shutdown_connections 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6230065a90 0x7f6230067f50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c0cbff0 0x7f624c149840 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f624c0ca410 0x7f624c14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 --2- 172.21.15.133:0/13700141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624c071870 0x7f624c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 >> 172.21.15.133:0/13700141 conn(0x7f624c06a2a0 msgr2=0x7f624c15bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 shutdown_connections 2023-12-18T10:23:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.722+0000 7f6253bb3640 1 -- 172.21.15.133:0/13700141 wait complete. 2023-12-18T10:23:42.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:23:42.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe8934b6640 1 Processor -- start 2023-12-18T10:23:42.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe8934b6640 1 -- start start 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe8934b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe88c06c4f0 0x7fe88c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe8934b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe88c0c9e30 0x7fe88c0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe8934b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c0c9460 con 0x7fe88c1570c0 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe8934b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88c1574a0 con 0x7fe88c06c4f0 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe8934b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88c0c8b30 con 0x7fe88c0c9e30 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe890a51640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe88c06c4f0 0x7fe88c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe890a51640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe88c06c4f0 0x7fe88c0c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53250/0 (socket says 172.21.15.133:53250) 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe890a51640 1 -- 172.21.15.133:0/2752938914 learned_addr learned my addr 172.21.15.133:0/2752938914 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:42.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe891a53640 1 --2- 172.21.15.133:0/2752938914 >> v2:172.21.15.142:3300/0 conn(0x7fe88c0c9e30 0x7fe88c0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe890a51640 1 -- 172.21.15.133:0/2752938914 >> v2:172.21.15.142:3300/0 conn(0x7fe88c0c9e30 msgr2=0x7fe88c0ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:42.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe890a51640 1 --2- 172.21.15.133:0/2752938914 >> v2:172.21.15.142:3300/0 conn(0x7fe88c0c9e30 0x7fe88c0ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe890a51640 1 -- 172.21.15.133:0/2752938914 >> v1:172.21.15.142:6789/0 conn(0x7fe88c1570c0 legacy=0x7fe88c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.878+0000 7fe890a51640 1 -- 172.21.15.133:0/2752938914 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0c8e10 con 0x7fe88c06c4f0 2023-12-18T10:23:42.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe890a51640 1 --2- 172.21.15.133:0/2752938914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0c98f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe88c06fb70 tx=0x7fe87c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912b1a5084ef2d38 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe883fff640 1 -- 172.21.15.133:0/2752938914 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0ab600 con 0x7fe88c06c4f0 2023-12-18T10:23:42.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe883fff640 1 -- 172.21.15.133:0/2752938914 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c0ab760 con 0x7fe88c06c4f0 2023-12-18T10:23:42.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe883fff640 1 -- 172.21.15.133:0/2752938914 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0abaf0 con 0x7fe88c06c4f0 2023-12-18T10:23:42.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe8934b6640 1 -- 172.21.15.133:0/2752938914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 msgr2=0x7fe88c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe8934b6640 1 --2- 172.21.15.133:0/2752938914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0c98f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fe88c06fb70 tx=0x7fe87c01c440 comp rx=0 tx=0).stop 2023-12-18T10:23:42.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe8934b6640 1 -- 172.21.15.133:0/2752938914 shutdown_connections 2023-12-18T10:23:42.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe8934b6640 1 --2- 172.21.15.133:0/2752938914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0c98f0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe8934b6640 1 --2- 172.21.15.133:0/2752938914 >> v2:172.21.15.142:3300/0 conn(0x7fe88c0c9e30 0x7fe88c0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe8934b6640 1 -- 172.21.15.133:0/2752938914 >> 172.21.15.133:0/2752938914 conn(0x7fe88c06a3e0 msgr2=0x7fe88c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:42.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe8934b6640 1 -- 172.21.15.133:0/2752938914 shutdown_connections 2023-12-18T10:23:42.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.882+0000 7fe8934b6640 1 -- 172.21.15.133:0/2752938914 wait complete. 2023-12-18T10:23:42.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 Processor -- start 2023-12-18T10:23:42.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 -- start start 2023-12-18T10:23:42.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88c0c9e30 0x7fe88c0a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe88c1570c0 0x7fe88c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0a79d0 con 0x7fe88c06c4f0 2023-12-18T10:23:42.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c155270 con 0x7fe88c0c9e30 2023-12-18T10:23:42.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0a7c50 con 0x7fe88c1570c0 2023-12-18T10:23:42.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0a8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53260/0 (socket says 172.21.15.133:53260) 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 -- 172.21.15.133:0/3832305527 learned_addr learned my addr 172.21.15.133:0/3832305527 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891a53640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe88c1570c0 0x7fe88c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe890a51640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88c0c9e30 0x7fe88c0a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 -- 172.21.15.133:0/3832305527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe88c1570c0 msgr2=0x7fe88c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe88c1570c0 0x7fe88c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 -- 172.21.15.133:0/3832305527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88c0c9e30 msgr2=0x7fe88c0a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88c0c9e30 0x7fe88c0a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 -- 172.21.15.133:0/3832305527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0094d0 con 0x7fe88c06c4f0 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe891252640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0a8cf0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c3c0 tx=0x7fe88800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe881ffb640 1 -- 172.21.15.133:0/3832305527 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8880052d0 con 0x7fe88c06c4f0 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe881ffb640 1 -- 172.21.15.133:0/3832305527 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe888005430 con 0x7fe88c06c4f0 2023-12-18T10:23:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe881ffb640 1 -- 172.21.15.133:0/3832305527 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888003840 con 0x7fe88c06c4f0 2023-12-18T10:23:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c0a7f30 con 0x7fe88c06c4f0 2023-12-18T10:23:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.886+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c0a84f0 con 0x7fe88c06c4f0 2023-12-18T10:23:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.890+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c0735b0 con 0x7fe88c06c4f0 2023-12-18T10:23:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.890+0000 7fe881ffb640 1 -- 172.21.15.133:0/3832305527 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8880039a0 con 0x7fe88c06c4f0 2023-12-18T10:23:42.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.890+0000 7fe881ffb640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe870065a60 0x7fe870067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:42.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.890+0000 7fe881ffb640 1 -- 172.21.15.133:0/3832305527 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe888082770 con 0x7fe88c06c4f0 2023-12-18T10:23:42.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.890+0000 7fe890a51640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe870065a60 0x7fe870067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:42.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.890+0000 7fe890a51640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe870065a60 0x7fe870067f20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0af000 tx=0x7fe87c0b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:42.894+0000 7fe881ffb640 1 -- 172.21.15.133:0/3832305527 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe888050090 con 0x7fe88c06c4f0 2023-12-18T10:23:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.058+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe88c04e000 con 0x7fe88c06c4f0 2023-12-18T10:23:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.058+0000 7fe881ffb640 1 -- 172.21.15.133:0/3832305527 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8880536b0 con 0x7fe88c06c4f0 2023-12-18T10:23:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:23:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe870065a60 msgr2=0x7fe870067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe870065a60 0x7fe870067f20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0af000 tx=0x7fe87c0b6040 comp rx=0 tx=0).stop 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 msgr2=0x7fe88c0a8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0a8cf0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe88800c3c0 tx=0x7fe88800c880 comp rx=0 tx=0).stop 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 shutdown_connections 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe870065a60 0x7fe870067f20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe88c1570c0 0x7fe88c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe88c0c9e30 0x7fe88c0a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 --2- 172.21.15.133:0/3832305527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe88c06c4f0 0x7fe88c0a8cf0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 >> 172.21.15.133:0/3832305527 conn(0x7fe88c06a3e0 msgr2=0x7fe88c0af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 shutdown_connections 2023-12-18T10:23:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.062+0000 7fe8934b6640 1 -- 172.21.15.133:0/3832305527 wait complete. 2023-12-18T10:23:43.081 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:23:43.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:43.081 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-18T10:23:43.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[56524]: fuse finished with error 0 and tester_r 0 2023-12-18T10:23:43.103 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:23:43.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:43.103 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-18T10:23:43.190 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:23:43.190 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:43.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:23:43.200 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:23:43.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:43.200 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-18T10:23:43.248 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-18T10:23:43.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:23:43.250 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:23:43.250 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:43.259 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:23:43.259 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:23:43.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:43.259 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-18T10:23:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-18T10:23:43.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:23:43.312 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:23:43.313 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:43.322 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:23:43.322 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:23:43.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:23:43.322 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-18T10:23:43.372 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-18T10:23:43.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:23:43.374 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:43.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.514+0000 7fc5d0f36640 1 Processor -- start 2023-12-18T10:23:43.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.514+0000 7fc5d0f36640 1 -- start start 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5d0f36640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5cc15c730 0x7fc5cc0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5d0f36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cea00 0x7fc5cc0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5d0f36640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc0b65c0 con 0x7fc5cc0cd3a0 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5d0f36640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc15cb10 con 0x7fc5cc15c730 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5d0f36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0b84c0 con 0x7fc5cc0cea00 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5cc15c730 0x7fc5cc0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5cb7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5cc15c730 0x7fc5cc0b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53266/0 (socket says 172.21.15.133:53266) 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5cb7fe640 1 -- 172.21.15.133:0/1902962380 learned_addr learned my addr 172.21.15.133:0/1902962380 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:43.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5caffd640 1 --2- 172.21.15.133:0/1902962380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cea00 0x7fc5cc0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5cb7fe640 1 -- 172.21.15.133:0/1902962380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cea00 msgr2=0x7fc5cc0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:43.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5cb7fe640 1 --2- 172.21.15.133:0/1902962380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cea00 0x7fc5cc0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5cb7fe640 1 -- 172.21.15.133:0/1902962380 >> v1:172.21.15.142:6789/0 conn(0x7fc5cc0cd3a0 legacy=0x7fc5cc0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5cb7fe640 1 -- 172.21.15.133:0/1902962380 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0cd960 con 0x7fc5cc15c730 2023-12-18T10:23:43.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5caffd640 1 --2- 172.21.15.133:0/1902962380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cea00 0x7fc5cc0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:43.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.518+0000 7fc5cb7fe640 1 --2- 172.21.15.133:0/1902962380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0b7f80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009870 tx=0x7fc5bc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3798528204411be7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:43.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5ca7fc640 1 -- 172.21.15.133:0/1902962380 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0a8a30 con 0x7fc5cc15c730 2023-12-18T10:23:43.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5ca7fc640 1 -- 172.21.15.133:0/1902962380 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0a8b90 con 0x7fc5cc15c730 2023-12-18T10:23:43.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5ca7fc640 1 -- 172.21.15.133:0/1902962380 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0b0440 con 0x7fc5cc15c730 2023-12-18T10:23:43.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1902962380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 msgr2=0x7fc5cc0b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1902962380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0b7f80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009870 tx=0x7fc5bc01ed30 comp rx=0 tx=0).stop 2023-12-18T10:23:43.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1902962380 shutdown_connections 2023-12-18T10:23:43.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1902962380 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cea00 0x7fc5cc0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1902962380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0b7f80 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1902962380 >> 172.21.15.133:0/1902962380 conn(0x7fc5cc06b120 msgr2=0x7fc5cc06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:43.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1902962380 shutdown_connections 2023-12-18T10:23:43.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1902962380 wait complete. 2023-12-18T10:23:43.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 Processor -- start 2023-12-18T10:23:43.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- start start 2023-12-18T10:23:43.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cd3a0 0x7fc5cc152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5cc0cea00 0x7fc5cc0c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc141c70 con 0x7fc5cc15c730 2023-12-18T10:23:43.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0b7a20 con 0x7fc5cc0cea00 2023-12-18T10:23:43.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5d0f36640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc140ff0 con 0x7fc5cc0cd3a0 2023-12-18T10:23:43.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.522+0000 7fc5cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cb7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cd3a0 0x7fc5cc152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53274/0 (socket says 172.21.15.133:53274) 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cbfff640 1 -- 172.21.15.133:0/1998979625 learned_addr learned my addr 172.21.15.133:0/1998979625 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5caffd640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5cc0cea00 0x7fc5cc0c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cbfff640 1 -- 172.21.15.133:0/1998979625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cd3a0 msgr2=0x7fc5cc152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cbfff640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cd3a0 0x7fc5cc152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cbfff640 1 -- 172.21.15.133:0/1998979625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5cc0cea00 msgr2=0x7fc5cc0c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cbfff640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5cc0cea00 0x7fc5cc0c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cbfff640 1 -- 172.21.15.133:0/1998979625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0094d0 con 0x7fc5cc15c730 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cbfff640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0c5020 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400c7a0 tx=0x7fc5c400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5b3fff640 1 -- 172.21.15.133:0/1998979625 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4003ba0 con 0x7fc5cc15c730 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5b3fff640 1 -- 172.21.15.133:0/1998979625 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c4003d00 con 0x7fc5cc15c730 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5b3fff640 1 -- 172.21.15.133:0/1998979625 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400aa30 con 0x7fc5cc15c730 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc1412d0 con 0x7fc5cc15c730 2023-12-18T10:23:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc141890 con 0x7fc5cc15c730 2023-12-18T10:23:43.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc141db0 con 0x7fc5cc15c730 2023-12-18T10:23:43.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5b3fff640 1 -- 172.21.15.133:0/1998979625 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc5c400ab90 con 0x7fc5cc15c730 2023-12-18T10:23:43.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5b3fff640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc5b8065a90 0x7fc5b8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5b3fff640 1 -- 172.21.15.133:0/1998979625 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc5c4082f80 con 0x7fc5cc15c730 2023-12-18T10:23:43.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.526+0000 7fc5cb7fe640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc5b8065a90 0x7fc5b8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.530+0000 7fc5cb7fe640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc5b8065a90 0x7fc5b8067f50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0b2000 tx=0x7fc5bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:43.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.530+0000 7fc5b3fff640 1 -- 172.21.15.133:0/1998979625 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc5cc141db0 con 0x7fc5cc15c730 2023-12-18T10:23:43.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5cc141db0 con 0x7fc5cc15c730 2023-12-18T10:23:43.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5b3fff640 1 -- 172.21.15.133:0/1998979625 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4754 (secure 0 0 0) 0x7fc5cc141db0 con 0x7fc5cc15c730 2023-12-18T10:23:43.713 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:43.713 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:43.019018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7557,"mds_1":7099,"mds_2":7096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7096":{"gid":7096,"name":"d","rank":2,"incarnation":71,"state":"up:active","state_seq":5,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7099":{"gid":7099,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:43.714 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 75 2023-12-18T10:23:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc5b8065a90 msgr2=0x7fc5b8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc5b8065a90 0x7fc5b8067f50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc0b2000 tx=0x7fc5bc009040 comp rx=0 tx=0).stop 2023-12-18T10:23:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 msgr2=0x7fc5cc0c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0c5020 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400c7a0 tx=0x7fc5c400cc60 comp rx=0 tx=0).stop 2023-12-18T10:23:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 shutdown_connections 2023-12-18T10:23:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc5b8065a90 0x7fc5b8067f50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc15c730 0x7fc5cc0c5020 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5cc0cea00 0x7fc5cc0c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 --2- 172.21.15.133:0/1998979625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5cc0cd3a0 0x7fc5cc152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 >> 172.21.15.133:0/1998979625 conn(0x7fc5cc06b120 msgr2=0x7fc5cc0c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 shutdown_connections 2023-12-18T10:23:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.714+0000 7fc5d0f36640 1 -- 172.21.15.133:0/1998979625 wait complete. 2023-12-18T10:23:43.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:43.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.870+0000 7f8104fb3640 1 Processor -- start 2023-12-18T10:23:43.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.870+0000 7f8104fb3640 1 -- start start 2023-12-18T10:23:43.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f8104fb3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8100070510 0x7f8100158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f8104fb3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8100070b80 con 0x7f81000caa70 2023-12-18T10:23:43.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f8104fb3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8100070e60 con 0x7f810015c800 2023-12-18T10:23:43.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f8104fb3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81000709a0 con 0x7f8100070510 2023-12-18T10:23:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80fed9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f81000caa70 0x7f81000caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40050/0 (socket says 172.21.15.133:40050) 2023-12-18T10:23:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80fed9d640 1 -- 172.21.15.133:0/170605577 learned_addr learned my addr 172.21.15.133:0/170605577 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80f5d9b640 1 --2- 172.21.15.133:0/170605577 >> v2:172.21.15.142:3300/0 conn(0x7f8100070510 0x7f8100158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80fdd9b640 1 -- 172.21.15.133:0/170605577 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649026056 0 0) 0x7f8100070b80 con 0x7f81000caa70 2023-12-18T10:23:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80fdd9b640 1 -- 172.21.15.133:0/170605577 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ec003530 con 0x7f81000caa70 2023-12-18T10:23:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80fdd9b640 1 -- 172.21.15.133:0/170605577 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927322634 0 0) 0x7f8100070e60 con 0x7f810015c800 2023-12-18T10:23:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80fdd9b640 1 -- 172.21.15.133:0/170605577 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8100070b80 con 0x7f810015c800 2023-12-18T10:23:43.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80f5d9b640 1 -- 172.21.15.133:0/170605577 >> v1:172.21.15.142:6789/0 conn(0x7f810015c800 legacy=0x7f81000b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80f5d9b640 1 -- 172.21.15.133:0/170605577 >> v1:172.21.15.133:6789/0 conn(0x7f81000caa70 legacy=0x7f81000caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.874+0000 7f80f5d9b640 1 -- 172.21.15.133:0/170605577 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100071140 con 0x7f8100070510 2023-12-18T10:23:43.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f80f5d9b640 1 --2- 172.21.15.133:0/170605577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8100070510 0x7f8100158c20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009d90 tx=0x7f80e801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d30bdb6592b5c4cf server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f80fdd9b640 1 -- 172.21.15.133:0/170605577 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80a5920 con 0x7f8100070510 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f80fdd9b640 1 -- 172.21.15.133:0/170605577 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e80a5a80 con 0x7f8100070510 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f80fdd9b640 1 -- 172.21.15.133:0/170605577 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80a5df0 con 0x7f8100070510 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 -- 172.21.15.133:0/170605577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8100070510 msgr2=0x7f8100158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 --2- 172.21.15.133:0/170605577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8100070510 0x7f8100158c20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009d90 tx=0x7f80e801c950 comp rx=0 tx=0).stop 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 -- 172.21.15.133:0/170605577 shutdown_connections 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 --2- 172.21.15.133:0/170605577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8100070510 0x7f8100158c20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 -- 172.21.15.133:0/170605577 >> 172.21.15.133:0/170605577 conn(0x7f810006a3e0 msgr2=0x7f81000afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 -- 172.21.15.133:0/170605577 shutdown_connections 2023-12-18T10:23:43.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 -- 172.21.15.133:0/170605577 wait complete. 2023-12-18T10:23:43.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 Processor -- start 2023-12-18T10:23:43.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.878+0000 7f8104fb3640 1 -- start start 2023-12-18T10:23:43.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8100070510 0x7f810014ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81000caa70 0x7f81000ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810015c800 0x7f81000c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81000c6820 con 0x7f8100070510 2023-12-18T10:23:43.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81000c6b00 con 0x7f81000caa70 2023-12-18T10:23:43.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81000c6de0 con 0x7f810015c800 2023-12-18T10:23:43.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8100070510 0x7f810014ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8100070510 0x7f810014ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53278/0 (socket says 172.21.15.133:53278) 2023-12-18T10:23:43.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 -- 172.21.15.133:0/41714937 learned_addr learned my addr 172.21.15.133:0/41714937 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:43.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fed9d640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810015c800 0x7f81000c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80f5d9b640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81000caa70 0x7f81000ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 -- 172.21.15.133:0/41714937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810015c800 msgr2=0x7f81000c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810015c800 0x7f81000c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 -- 172.21.15.133:0/41714937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81000caa70 msgr2=0x7f81000ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81000caa70 0x7f81000ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 -- 172.21.15.133:0/41714937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009a70 con 0x7f8100070510 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80fe59c640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8100070510 0x7f810014ab40 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c430 tx=0x7f80f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80f77fe640 1 -- 172.21.15.133:0/41714937 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f00052d0 con 0x7f8100070510 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80f77fe640 1 -- 172.21.15.133:0/41714937 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f0005450 con 0x7f8100070510 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81000c8800 con 0x7f8100070510 2023-12-18T10:23:43.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f80f77fe640 1 -- 172.21.15.133:0/41714937 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0003840 con 0x7f8100070510 2023-12-18T10:23:43.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81000c73a0 con 0x7f8100070510 2023-12-18T10:23:43.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.882+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81000735b0 con 0x7f8100070510 2023-12-18T10:23:43.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.886+0000 7f80f77fe640 1 -- 172.21.15.133:0/41714937 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80f00039a0 con 0x7f8100070510 2023-12-18T10:23:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.886+0000 7f80f77fe640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80e0065a60 0x7f80e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:43.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.886+0000 7f80f77fe640 1 -- 172.21.15.133:0/41714937 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f80f00828e0 con 0x7f8100070510 2023-12-18T10:23:43.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.886+0000 7f80f5d9b640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80e0065a60 0x7f80e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:43.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.886+0000 7f80f5d9b640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80e0065a60 0x7f80e0067f20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f80e80af000 tx=0x7f80e80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:43.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:43.890+0000 7f80f77fe640 1 -- 172.21.15.133:0/41714937 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f80f0050170 con 0x7f8100070510 2023-12-18T10:23:44.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f810004e000 con 0x7f8100070510 2023-12-18T10:23:44.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f80f77fe640 1 -- 172.21.15.133:0/41714937 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16357 (secure 0 0 0) 0x7f80f0017090 con 0x7f8100070510 2023-12-18T10:23:44.046 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:44.046 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:23:12.471181+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:23:10.000470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-18T10:23:10.462940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:44.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80e0065a60 msgr2=0x7f80e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80e0065a60 0x7f80e0067f20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f80e80af000 tx=0x7f80e80a7070 comp rx=0 tx=0).stop 2023-12-18T10:23:44.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8100070510 msgr2=0x7f810014ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8100070510 0x7f810014ab40 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f80f000c430 tx=0x7f80f000c8f0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 shutdown_connections 2023-12-18T10:23:44.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80e0065a60 0x7f80e0067f20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f810015c800 0x7f81000c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81000caa70 0x7f81000ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 --2- 172.21.15.133:0/41714937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8100070510 0x7f810014ab40 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.046+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 >> 172.21.15.133:0/41714937 conn(0x7f810006a3e0 msgr2=0x7f8100155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:44.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.050+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 shutdown_connections 2023-12-18T10:23:44.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.050+0000 7f8104fb3640 1 -- 172.21.15.133:0/41714937 wait complete. 2023-12-18T10:23:44.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:23:10.000470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:23:10.462940+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:23:44.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:23:44.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76c2041640 1 Processor -- start 2023-12-18T10:23:44.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76c2041640 1 -- start start 2023-12-18T10:23:44.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76c2041640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76bc153020 0x7f76bc0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76c2041640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76bc0ceaa0 0x7f76bc070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76c2041640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76bc0c9730 con 0x7f76bc1598d0 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76c2041640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc0c8e00 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76c2041640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc0c90e0 con 0x7f76bc153020 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76bbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76bc0ceaa0 0x7f76bc070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76baffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f76bc1598d0 0x7f76bc0ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40056/0 (socket says 172.21.15.133:40056) 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76baffd640 1 -- 172.21.15.133:0/1790211507 learned_addr learned my addr 172.21.15.133:0/1790211507 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76bb7fe640 1 --2- 172.21.15.133:0/1790211507 >> v2:172.21.15.142:3300/0 conn(0x7f76bc153020 0x7f76bc0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76bbfff640 1 -- 172.21.15.133:0/1790211507 >> v2:172.21.15.142:3300/0 conn(0x7f76bc153020 msgr2=0x7f76bc0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76bbfff640 1 --2- 172.21.15.133:0/1790211507 >> v2:172.21.15.142:3300/0 conn(0x7f76bc153020 0x7f76bc0c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76bbfff640 1 -- 172.21.15.133:0/1790211507 >> v1:172.21.15.133:6789/0 conn(0x7f76bc1598d0 legacy=0x7f76bc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76ba7fc640 1 -- 172.21.15.133:0/1790211507 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998406249 0 0) 0x7f76bc0c9730 con 0x7f76bc1598d0 2023-12-18T10:23:44.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.210+0000 7f76bbfff640 1 -- 172.21.15.133:0/1790211507 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc0c93c0 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76bbfff640 1 --2- 172.21.15.133:0/1790211507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc070590 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0cbf10 tx=0x7f76b401c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967353cf813bce59 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76ba7fc640 1 -- 172.21.15.133:0/1790211507 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b40a57f0 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76ba7fc640 1 -- 172.21.15.133:0/1790211507 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b40a5950 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76ba7fc640 1 -- 172.21.15.133:0/1790211507 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b40a5ce0 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76c2041640 1 -- 172.21.15.133:0/1790211507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 msgr2=0x7f76bc070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76c2041640 1 --2- 172.21.15.133:0/1790211507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc070590 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0cbf10 tx=0x7f76b401c790 comp rx=0 tx=0).stop 2023-12-18T10:23:44.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76c2041640 1 -- 172.21.15.133:0/1790211507 shutdown_connections 2023-12-18T10:23:44.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76c2041640 1 --2- 172.21.15.133:0/1790211507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc070590 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76c2041640 1 --2- 172.21.15.133:0/1790211507 >> v2:172.21.15.142:3300/0 conn(0x7f76bc153020 0x7f76bc0c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76c2041640 1 -- 172.21.15.133:0/1790211507 >> 172.21.15.133:0/1790211507 conn(0x7f76bc06a2a0 msgr2=0x7f76bc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:44.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76c2041640 1 -- 172.21.15.133:0/1790211507 shutdown_connections 2023-12-18T10:23:44.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.214+0000 7f76c2041640 1 -- 172.21.15.133:0/1790211507 wait complete. 2023-12-18T10:23:44.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 Processor -- start 2023-12-18T10:23:44.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 -- start start 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc165c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76bc153020 0x7f76bc0af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76bc1598d0 0x7f76bc1496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc154700 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc1537a0 con 0x7f76bc153020 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc153a80 con 0x7f76bc1598d0 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc165c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53298/0 (socket says 172.21.15.133:53298) 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 -- 172.21.15.133:0/2169729549 learned_addr learned my addr 172.21.15.133:0/2169729549 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 -- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76bc1598d0 msgr2=0x7f76bc1496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bbfff640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76bc1598d0 0x7f76bc1496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76baffd640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76bc153020 0x7f76bc0af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76bc1598d0 0x7f76bc1496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 -- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76bc153020 msgr2=0x7f76bc0af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76bc153020 0x7f76bc0af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 -- 172.21.15.133:0/2169729549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009a70 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bbfff640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76bc1598d0 0x7f76bc1496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76baffd640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76bc153020 0x7f76bc0af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76bb7fe640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc165c10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e930 tx=0x7f76ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76a3fff640 1 -- 172.21.15.133:0/2169729549 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac009690 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76a3fff640 1 -- 172.21.15.133:0/2169729549 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac00ca00 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc153d60 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76a3fff640 1 -- 172.21.15.133:0/2169729549 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00cd70 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc154320 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.218+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc154970 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.222+0000 7f76a3fff640 1 -- 172.21.15.133:0/2169729549 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f76ac013470 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.222+0000 7f76a3fff640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76a8065a60 0x7f76a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.222+0000 7f76a3fff640 1 -- 172.21.15.133:0/2169729549 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f76ac083530 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.222+0000 7f76baffd640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76a8065a60 0x7f76a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.222+0000 7f76baffd640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76a8065a60 0x7f76a8067f20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f76bc1585f0 tx=0x7f76b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.226+0000 7f76a3fff640 1 -- 172.21.15.133:0/2169729549 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f76ac050e60 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76bc04e000 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76a3fff640 1 -- 172.21.15.133:0/2169729549 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76ac054480 con 0x7f76bc0ceaa0 2023-12-18T10:23:44.377 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76a8065a60 msgr2=0x7f76a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76a8065a60 0x7f76a8067f20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f76bc1585f0 tx=0x7f76b0009040 comp rx=0 tx=0).stop 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 msgr2=0x7f76bc165c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc165c10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e930 tx=0x7f76ac00edf0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 shutdown_connections 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f76a8065a60 0x7f76a8067f20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f76bc1598d0 0x7f76bc1496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76bc153020 0x7f76bc0af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 --2- 172.21.15.133:0/2169729549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76bc0ceaa0 0x7f76bc165c10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 >> 172.21.15.133:0/2169729549 conn(0x7f76bc06a2a0 msgr2=0x7f76bc156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 shutdown_connections 2023-12-18T10:23:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.378+0000 7f76c2041640 1 -- 172.21.15.133:0/2169729549 wait complete. 2023-12-18T10:23:44.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:23:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.538+0000 7f6c3d7f0640 1 Processor -- start 2023-12-18T10:23:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.538+0000 7f6c3d7f0640 1 -- start start 2023-12-18T10:23:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c3d7f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3815cbd0 0x7f6c381610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c3d7f0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c380ced90 con 0x7f6c380b2780 2023-12-18T10:23:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c3d7f0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c380cf220 con 0x7f6c380cc7f0 2023-12-18T10:23:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c3d7f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3815cfb0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c377fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6c380b2780 0x7f6c3806b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40072/0 (socket says 172.21.15.133:40072) 2023-12-18T10:23:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c377fe640 1 -- 172.21.15.133:0/1191277771 learned_addr learned my addr 172.21.15.133:0/1191277771 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c36ffd640 1 --2- 172.21.15.133:0/1191277771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3815cbd0 0x7f6c381610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c367fc640 1 -- 172.21.15.133:0/1191277771 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010502114 0 0) 0x7f6c380ced90 con 0x7f6c380b2780 2023-12-18T10:23:44.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c367fc640 1 -- 172.21.15.133:0/1191277771 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c24003530 con 0x7f6c380b2780 2023-12-18T10:23:44.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c367fc640 1 -- 172.21.15.133:0/1191277771 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749933125 0 0) 0x7f6c380cf220 con 0x7f6c380cc7f0 2023-12-18T10:23:44.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c36ffd640 1 -- 172.21.15.133:0/1191277771 >> v1:172.21.15.142:6789/0 conn(0x7f6c380cc7f0 legacy=0x7f6c380b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c36ffd640 1 -- 172.21.15.133:0/1191277771 >> v1:172.21.15.133:6789/0 conn(0x7f6c380b2780 legacy=0x7f6c3806b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.542+0000 7f6c36ffd640 1 -- 172.21.15.133:0/1191277771 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c380ccc50 con 0x7f6c3815cbd0 2023-12-18T10:23:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c36ffd640 1 --2- 172.21.15.133:0/1191277771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3815cbd0 0x7f6c381610f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097d0 tx=0x7f6c2801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b2c6e899769f603 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c367fc640 1 -- 172.21.15.133:0/1191277771 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280a8050 con 0x7f6c3815cbd0 2023-12-18T10:23:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c367fc640 1 -- 172.21.15.133:0/1191277771 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c280ac5f0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c367fc640 1 -- 172.21.15.133:0/1191277771 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280ac960 con 0x7f6c3815cbd0 2023-12-18T10:23:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/1191277771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3815cbd0 msgr2=0x7f6c381610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c3d7f0640 1 --2- 172.21.15.133:0/1191277771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3815cbd0 0x7f6c381610f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097d0 tx=0x7f6c2801c4a0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/1191277771 shutdown_connections 2023-12-18T10:23:44.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c3d7f0640 1 --2- 172.21.15.133:0/1191277771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c3815cbd0 0x7f6c381610f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/1191277771 >> 172.21.15.133:0/1191277771 conn(0x7f6c380cd070 msgr2=0x7f6c380cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:44.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/1191277771 shutdown_connections 2023-12-18T10:23:44.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/1191277771 wait complete. 2023-12-18T10:23:44.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.546+0000 7f6c3d7f0640 1 Processor -- start 2023-12-18T10:23:44.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 -- start start 2023-12-18T10:23:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c380b2780 0x7f6c380c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c380cc7f0 0x7f6c380c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c3815cbd0 0x7f6c380b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380c9880 con 0x7f6c3815cbd0 2023-12-18T10:23:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380c9b60 con 0x7f6c380b2780 2023-12-18T10:23:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380c9e40 con 0x7f6c380cc7f0 2023-12-18T10:23:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c3815cbd0 0x7f6c380b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c3815cbd0 0x7f6c380b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53302/0 (socket says 172.21.15.133:53302) 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 -- 172.21.15.133:0/386092040 learned_addr learned my addr 172.21.15.133:0/386092040 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c36ffd640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c380b2780 0x7f6c380c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c2e7fc640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c380cc7f0 0x7f6c380c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 -- 172.21.15.133:0/386092040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c380cc7f0 msgr2=0x7f6c380c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c380cc7f0 0x7f6c380c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 -- 172.21.15.133:0/386092040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c380b2780 msgr2=0x7f6c380c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c380b2780 0x7f6c380c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 -- 172.21.15.133:0/386092040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c280093b0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c377fe640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c3815cbd0 0x7f6c380b0d80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000cb40 tx=0x7f6c3000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c2ffff640 1 -- 172.21.15.133:0/386092040 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000aca0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c2ffff640 1 -- 172.21.15.133:0/386092040 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3000ae00 con 0x7f6c3815cbd0 2023-12-18T10:23:44.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c2ffff640 1 -- 172.21.15.133:0/386092040 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30012620 con 0x7f6c3815cbd0 2023-12-18T10:23:44.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c380ca120 con 0x7f6c3815cbd0 2023-12-18T10:23:44.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c380b12c0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.550+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3804e000 con 0x7f6c3815cbd0 2023-12-18T10:23:44.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.554+0000 7f6c2ffff640 1 -- 172.21.15.133:0/386092040 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6c30007070 con 0x7f6c3815cbd0 2023-12-18T10:23:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.554+0000 7f6c2ffff640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6c18065a60 0x7f6c18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.554+0000 7f6c2ffff640 1 -- 172.21.15.133:0/386092040 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6c300833c0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.554+0000 7f6c36ffd640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6c18065a60 0x7f6c18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.554+0000 7f6c36ffd640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6c18065a60 0x7f6c18067f20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6c280ae000 tx=0x7f6c280a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.558+0000 7f6c2ffff640 1 -- 172.21.15.133:0/386092040 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6c30050ba0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.706+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c380c99c0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.706+0000 7f6c2ffff640 1 -- 172.21.15.133:0/386092040 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c380c99c0 con 0x7f6c3815cbd0 2023-12-18T10:23:44.707 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:23:44.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6c18065a60 msgr2=0x7f6c18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6c18065a60 0x7f6c18067f20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6c280ae000 tx=0x7f6c280a7000 comp rx=0 tx=0).stop 2023-12-18T10:23:44.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c3815cbd0 msgr2=0x7f6c380b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c3815cbd0 0x7f6c380b0d80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000cb40 tx=0x7f6c3000a060 comp rx=0 tx=0).stop 2023-12-18T10:23:44.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 shutdown_connections 2023-12-18T10:23:44.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6c18065a60 0x7f6c18067f20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c3815cbd0 0x7f6c380b0d80 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6c380cc7f0 0x7f6c380c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 --2- 172.21.15.133:0/386092040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c380b2780 0x7f6c380c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 >> 172.21.15.133:0/386092040 conn(0x7f6c380cd070 msgr2=0x7f6c380b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:44.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 shutdown_connections 2023-12-18T10:23:44.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.710+0000 7f6c3d7f0640 1 -- 172.21.15.133:0/386092040 wait complete. 2023-12-18T10:23:44.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:23:44.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fee00695640 1 Processor -- start 2023-12-18T10:23:44.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fee00695640 1 -- start start 2023-12-18T10:23:44.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fee00695640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fee00695640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fedf8159fb0 0x7fedf8071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fee00695640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedf8071db0 0x7fedf80cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fee00695640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf815aab0 con 0x7fedf8071db0 2023-12-18T10:23:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fee00695640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf8070df0 con 0x7fedf8159fb0 2023-12-18T10:23:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fee00695640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf815a4f0 con 0x7fedf80ca410 2023-12-18T10:23:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfec32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedf8071db0 0x7fedf80cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfec32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedf8071db0 0x7fedf80cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53306/0 (socket says 172.21.15.133:53306) 2023-12-18T10:23:44.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfec32640 1 -- 172.21.15.133:0/3181716947 learned_addr learned my addr 172.21.15.133:0/3181716947 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfe431640 1 --2- 172.21.15.133:0/3181716947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfdc30640 1 --2- 172.21.15.133:0/3181716947 >> v2:172.21.15.142:3300/0 conn(0x7fedf8159fb0 0x7fedf8071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfec32640 1 -- 172.21.15.133:0/3181716947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 msgr2=0x7fedf8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfec32640 1 --2- 172.21.15.133:0/3181716947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfec32640 1 -- 172.21.15.133:0/3181716947 >> v2:172.21.15.142:3300/0 conn(0x7fedf8159fb0 msgr2=0x7fedf8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfec32640 1 --2- 172.21.15.133:0/3181716947 >> v2:172.21.15.142:3300/0 conn(0x7fedf8159fb0 0x7fedf8071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.870+0000 7fedfec32640 1 -- 172.21.15.133:0/3181716947 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf815a7d0 con 0x7fedf8071db0 2023-12-18T10:23:44.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fedfec32640 1 --2- 172.21.15.133:0/3181716947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cbff0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fedf806df10 tx=0x7fedf001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc258bdc3974013 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fedfd42f640 1 -- 172.21.15.133:0/3181716947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a5730 con 0x7fedf8071db0 2023-12-18T10:23:44.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fedfd42f640 1 -- 172.21.15.133:0/3181716947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00a5890 con 0x7fedf8071db0 2023-12-18T10:23:44.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fedfd42f640 1 -- 172.21.15.133:0/3181716947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a5c20 con 0x7fedf8071db0 2023-12-18T10:23:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 -- 172.21.15.133:0/3181716947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 msgr2=0x7fedf80cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 --2- 172.21.15.133:0/3181716947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cbff0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fedf806df10 tx=0x7fedf001c9a0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 -- 172.21.15.133:0/3181716947 shutdown_connections 2023-12-18T10:23:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 --2- 172.21.15.133:0/3181716947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cbff0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 --2- 172.21.15.133:0/3181716947 >> v2:172.21.15.142:3300/0 conn(0x7fedf8159fb0 0x7fedf8071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 --2- 172.21.15.133:0/3181716947 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 -- 172.21.15.133:0/3181716947 >> 172.21.15.133:0/3181716947 conn(0x7fedf806a2a0 msgr2=0x7fedf80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 -- 172.21.15.133:0/3181716947 shutdown_connections 2023-12-18T10:23:44.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.874+0000 7fee00695640 1 -- 172.21.15.133:0/3181716947 wait complete. 2023-12-18T10:23:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 Processor -- start 2023-12-18T10:23:44.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 -- start start 2023-12-18T10:23:44.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf8159fb0 0x7fedf814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8155f40 con 0x7fedf8071db0 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80cf330 con 0x7fedf8159fb0 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf81552c0 con 0x7fedf80ca410 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53318/0 (socket says 172.21.15.133:53318) 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 -- 172.21.15.133:0/3397523583 learned_addr learned my addr 172.21.15.133:0/3397523583 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfdc30640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfec32640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf8159fb0 0x7fedf814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 -- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 msgr2=0x7fedf8156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 -- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf8159fb0 msgr2=0x7fedf814fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf8159fb0 0x7fedf814fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:44.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 -- 172.21.15.133:0/3397523583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf0009b30 con 0x7fedf8071db0 2023-12-18T10:23:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfec32640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf8159fb0 0x7fedf814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfdc30640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedfe431640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cedf0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fedf400d800 tx=0x7fedf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedeeffd640 1 -- 172.21.15.133:0/3397523583 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400b6c0 con 0x7fedf8071db0 2023-12-18T10:23:44.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedeeffd640 1 -- 172.21.15.133:0/3397523583 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf400b820 con 0x7fedf8071db0 2023-12-18T10:23:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf81555a0 con 0x7fedf8071db0 2023-12-18T10:23:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fedeeffd640 1 -- 172.21.15.133:0/3397523583 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400bb90 con 0x7fedf8071db0 2023-12-18T10:23:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.878+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf8155b60 con 0x7fedf8071db0 2023-12-18T10:23:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.882+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf81561b0 con 0x7fedf8071db0 2023-12-18T10:23:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.882+0000 7fedeeffd640 1 -- 172.21.15.133:0/3397523583 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fedf400bcf0 con 0x7fedf8071db0 2023-12-18T10:23:44.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.882+0000 7fedeeffd640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feddc065a60 0x7feddc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:44.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.882+0000 7fedeeffd640 1 -- 172.21.15.133:0/3397523583 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fedf40837f0 con 0x7fedf8071db0 2023-12-18T10:23:44.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.882+0000 7fedfdc30640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feddc065a60 0x7feddc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:44.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.882+0000 7fedfdc30640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feddc065a60 0x7feddc067f20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fedf80c9ea0 tx=0x7fede8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:44.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:44.886+0000 7fedeeffd640 1 -- 172.21.15.133:0/3397523583 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fedf40510e0 con 0x7fedf8071db0 2023-12-18T10:23:45.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.034+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fedf804e000 con 0x7fedf8071db0 2023-12-18T10:23:45.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fedeeffd640 1 -- 172.21.15.133:0/3397523583 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7fedf4011340 con 0x7fedf8071db0 2023-12-18T10:23:45.037 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:23:45.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feddc065a60 msgr2=0x7feddc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feddc065a60 0x7feddc067f20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fedf80c9ea0 tx=0x7fede8008040 comp rx=0 tx=0).stop 2023-12-18T10:23:45.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 msgr2=0x7fedf80cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cedf0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fedf400d800 tx=0x7fedf400dcc0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 shutdown_connections 2023-12-18T10:23:45.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feddc065a60 0x7feddc067f20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf8159fb0 0x7fedf814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80ca410 0x7fedf8156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 --2- 172.21.15.133:0/3397523583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedf8071db0 0x7fedf80cedf0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 >> 172.21.15.133:0/3397523583 conn(0x7fedf806a2a0 msgr2=0x7fedf80ac540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:45.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 shutdown_connections 2023-12-18T10:23:45.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.038+0000 7fee00695640 1 -- 172.21.15.133:0/3397523583 wait complete. 2023-12-18T10:23:45.058 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:45.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7f5711640 1 Processor -- start 2023-12-18T10:23:45.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7f5711640 1 -- start start 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7f5711640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7f00ae040 0x7ff7f006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7f5711640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f006d170 0x7ff7f00cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7f5711640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7f00ce290 0x7ff7f00c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7f5711640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00ce720 con 0x7ff7f00ce290 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7f5711640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f00cccf0 con 0x7ff7f00ae040 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7f5711640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00ae420 con 0x7ff7f006d170 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7ef7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7f00ce290 0x7ff7f00c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7ef7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7f00ce290 0x7ff7f00c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53320/0 (socket says 172.21.15.133:53320) 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7ef7fe640 1 -- 172.21.15.133:0/83315361 learned_addr learned my addr 172.21.15.133:0/83315361 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:45.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7e67fc640 1 --2- 172.21.15.133:0/83315361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f006d170 0x7ff7f00cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7eeffd640 1 --2- 172.21.15.133:0/83315361 >> v2:172.21.15.142:3300/0 conn(0x7ff7f00ae040 0x7ff7f006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7ef7fe640 1 -- 172.21.15.133:0/83315361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f006d170 msgr2=0x7ff7f00cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:45.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7ef7fe640 1 --2- 172.21.15.133:0/83315361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f006d170 0x7ff7f00cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7ef7fe640 1 -- 172.21.15.133:0/83315361 >> v2:172.21.15.142:3300/0 conn(0x7ff7f00ae040 msgr2=0x7ff7f006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:45.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7ef7fe640 1 --2- 172.21.15.133:0/83315361 >> v2:172.21.15.142:3300/0 conn(0x7ff7f00ae040 0x7ff7f006cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7ef7fe640 1 -- 172.21.15.133:0/83315361 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00ccf90 con 0x7ff7f00ce290 2023-12-18T10:23:45.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.198+0000 7ff7eeffd640 1 --2- 172.21.15.133:0/83315361 >> v2:172.21.15.142:3300/0 conn(0x7ff7f00ae040 0x7ff7f006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:45.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7ef7fe640 1 --2- 172.21.15.133:0/83315361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f00ce290 0x7ff7f00c9920 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b4d00 tx=0x7ff7e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a23c8887dfffc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7ee7fc640 1 -- 172.21.15.133:0/83315361 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80ac600 con 0x7ff7f00ce290 2023-12-18T10:23:45.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7ee7fc640 1 -- 172.21.15.133:0/83315361 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e80a8050 con 0x7ff7f00ce290 2023-12-18T10:23:45.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7ee7fc640 1 -- 172.21.15.133:0/83315361 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80ac980 con 0x7ff7f00ce290 2023-12-18T10:23:45.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 -- 172.21.15.133:0/83315361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f00ce290 msgr2=0x7ff7f00c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 --2- 172.21.15.133:0/83315361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f00ce290 0x7ff7f00c9920 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00b4d00 tx=0x7ff7e801c4d0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 -- 172.21.15.133:0/83315361 shutdown_connections 2023-12-18T10:23:45.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 --2- 172.21.15.133:0/83315361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f00ce290 0x7ff7f00c9920 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 --2- 172.21.15.133:0/83315361 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f006d170 0x7ff7f00cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 --2- 172.21.15.133:0/83315361 >> v2:172.21.15.142:3300/0 conn(0x7ff7f00ae040 0x7ff7f006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 -- 172.21.15.133:0/83315361 >> 172.21.15.133:0/83315361 conn(0x7ff7f00cb610 msgr2=0x7ff7f00cba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:45.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 -- 172.21.15.133:0/83315361 shutdown_connections 2023-12-18T10:23:45.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.202+0000 7ff7f5711640 1 -- 172.21.15.133:0/83315361 wait complete. 2023-12-18T10:23:45.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 Processor -- start 2023-12-18T10:23:45.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 -- start start 2023-12-18T10:23:45.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f006d170 0x7ff7f0154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7f00ae040 0x7ff7f015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f00ce290 0x7ff7f0154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f00b3b20 con 0x7ff7f006d170 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f015bbf0 con 0x7ff7f00ae040 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f015be90 con 0x7ff7f00ce290 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f006d170 0x7ff7f0154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f006d170 0x7ff7f0154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53334/0 (socket says 172.21.15.133:53334) 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 -- 172.21.15.133:0/3258514731 learned_addr learned my addr 172.21.15.133:0/3258514731 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7e67fc640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7f00ae040 0x7ff7f015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7ef7fe640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f00ce290 0x7ff7f0154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 -- 172.21.15.133:0/3258514731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f00ce290 msgr2=0x7ff7f0154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f00ce290 0x7ff7f0154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 -- 172.21.15.133:0/3258514731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7f00ae040 msgr2=0x7ff7f015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7f00ae040 0x7ff7f015b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 -- 172.21.15.133:0/3258514731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e80094d0 con 0x7ff7f006d170 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7eeffd640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f006d170 0x7ff7f0154c40 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c7c0 tx=0x7ff7e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7e7fff640 1 -- 172.21.15.133:0/3258514731 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0007a30 con 0x7ff7f006d170 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7e7fff640 1 -- 172.21.15.133:0/3258514731 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e0007b90 con 0x7ff7f006d170 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7e7fff640 1 -- 172.21.15.133:0/3258514731 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000ce70 con 0x7ff7f006d170 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f00af790 con 0x7ff7f006d170 2023-12-18T10:23:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f015b6c0 con 0x7ff7f006d170 2023-12-18T10:23:45.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.206+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f015b970 con 0x7ff7f006d170 2023-12-18T10:23:45.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.210+0000 7ff7e7fff640 1 -- 172.21.15.133:0/3258514731 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff7e00193f0 con 0x7ff7f006d170 2023-12-18T10:23:45.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.210+0000 7ff7e7fff640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff7d0065a60 0x7ff7d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.210+0000 7ff7e7fff640 1 -- 172.21.15.133:0/3258514731 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff7e00837e0 con 0x7ff7f006d170 2023-12-18T10:23:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.210+0000 7ff7e67fc640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff7d0065a60 0x7ff7d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.210+0000 7ff7e67fc640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff7d0065a60 0x7ff7d0067f20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8003fd0 tx=0x7ff7d80039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.214+0000 7ff7e7fff640 1 -- 172.21.15.133:0/3258514731 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff7e0050fc0 con 0x7ff7f006d170 2023-12-18T10:23:45.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.394+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7f00afc40 con 0x7ff7f006d170 2023-12-18T10:23:45.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.394+0000 7ff7e7fff640 1 -- 172.21.15.133:0/3258514731 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4754 (secure 0 0 0) 0x7ff7e00545e0 con 0x7ff7f006d170 2023-12-18T10:23:45.397 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:45.397 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:43.019018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7557,"mds_1":7099,"mds_2":7096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7096":{"gid":7096,"name":"d","rank":2,"incarnation":71,"state":"up:active","state_seq":5,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7099":{"gid":7099,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 75 2023-12-18T10:23:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff7d0065a60 msgr2=0x7ff7d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff7d0065a60 0x7ff7d0067f20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8003fd0 tx=0x7ff7d80039a0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f006d170 msgr2=0x7ff7f0154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f006d170 0x7ff7f0154c40 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c7c0 tx=0x7ff7e000cc80 comp rx=0 tx=0).stop 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 shutdown_connections 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff7d0065a60 0x7ff7d0067f20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff7f00ce290 0x7ff7f0154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7f00ae040 0x7ff7f015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 --2- 172.21.15.133:0/3258514731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7f006d170 0x7ff7f0154c40 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 >> 172.21.15.133:0/3258514731 conn(0x7ff7f00cb610 msgr2=0x7ff7f006d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 shutdown_connections 2023-12-18T10:23:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.398+0000 7ff7f5711640 1 -- 172.21.15.133:0/3258514731 wait complete. 2023-12-18T10:23:45.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:45.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.554+0000 7f0f84673640 1 Processor -- start 2023-12-18T10:23:45.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.554+0000 7f0f84673640 1 -- start start 2023-12-18T10:23:45.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.554+0000 7f0f84673640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f7c15a680 0x7f0f7c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f84673640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f84673640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c15f100 con 0x7f0f7c0cac10 2023-12-18T10:23:45.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f84673640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c070780 con 0x7f0f7c15a680 2023-12-18T10:23:45.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f84673640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0ca7d0 con 0x7f0f7c06fdb0 2023-12-18T10:23:45.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f8240f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f7c15a680 0x7f0f7c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f82c10640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f8240f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0f7c15a680 0x7f0f7c15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:59592/0 (socket says 172.21.15.133:59592) 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f8240f640 1 -- 172.21.15.133:0/2813321484 learned_addr learned my addr 172.21.15.133:0/2813321484 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f81c0e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0f7c0cac10 0x7f0f7c15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:37294/0 (socket says 172.21.15.133:37294) 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f8140d640 1 -- 172.21.15.133:0/2813321484 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354532550 0 0) 0x7f0f7c15f100 con 0x7f0f7c0cac10 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f8140d640 1 -- 172.21.15.133:0/2813321484 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f68003530 con 0x7f0f7c0cac10 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f82c10640 1 -- 172.21.15.133:0/2813321484 >> v2:172.21.15.142:3300/0 conn(0x7f0f7c15a680 msgr2=0x7f0f7c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f82c10640 1 --2- 172.21.15.133:0/2813321484 >> v2:172.21.15.142:3300/0 conn(0x7f0f7c15a680 0x7f0f7c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f82c10640 1 -- 172.21.15.133:0/2813321484 >> v1:172.21.15.142:6789/0 conn(0x7f0f7c0cac10 legacy=0x7f0f7c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f82c10640 1 -- 172.21.15.133:0/2813321484 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c15e860 con 0x7f0f7c06fdb0 2023-12-18T10:23:45.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.558+0000 7f0f8240f640 1 --2- 172.21.15.133:0/2813321484 >> v2:172.21.15.142:3300/0 conn(0x7f0f7c15a680 0x7f0f7c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:45.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f82c10640 1 --2- 172.21.15.133:0/2813321484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c070240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009dc0 tx=0x7f0f7401c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ad747222ba1f721 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f8140d640 1 -- 172.21.15.133:0/2813321484 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740a5960 con 0x7f0f7c06fdb0 2023-12-18T10:23:45.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f8140d640 1 -- 172.21.15.133:0/2813321484 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f740a5ac0 con 0x7f0f7c06fdb0 2023-12-18T10:23:45.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f8140d640 1 -- 172.21.15.133:0/2813321484 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740a5e30 con 0x7f0f7c06fdb0 2023-12-18T10:23:45.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- 172.21.15.133:0/2813321484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 msgr2=0x7f0f7c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 --2- 172.21.15.133:0/2813321484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c070240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009dc0 tx=0x7f0f7401c8a0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- 172.21.15.133:0/2813321484 shutdown_connections 2023-12-18T10:23:45.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 --2- 172.21.15.133:0/2813321484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c070240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 --2- 172.21.15.133:0/2813321484 >> v2:172.21.15.142:3300/0 conn(0x7f0f7c15a680 0x7f0f7c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- 172.21.15.133:0/2813321484 >> 172.21.15.133:0/2813321484 conn(0x7f0f7c06a3e0 msgr2=0x7f0f7c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:45.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- 172.21.15.133:0/2813321484 shutdown_connections 2023-12-18T10:23:45.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- 172.21.15.133:0/2813321484 wait complete. 2023-12-18T10:23:45.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 Processor -- start 2023-12-18T10:23:45.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- start start 2023-12-18T10:23:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c06bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f7c0cac10 0x7f0f7c152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7c15a680 0x7f0f7c1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0af700 con 0x7f0f7c0cac10 2023-12-18T10:23:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c151dd0 con 0x7f0f7c15a680 2023-12-18T10:23:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.562+0000 7f0f84673640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0afc30 con 0x7f0f7c06fdb0 2023-12-18T10:23:45.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f7c0cac10 0x7f0f7c152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f82c10640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7c15a680 0x7f0f7c1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f7c0cac10 0x7f0f7c152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53338/0 (socket says 172.21.15.133:53338) 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 -- 172.21.15.133:0/1766084302 learned_addr learned my addr 172.21.15.133:0/1766084302 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f8240f640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c06bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 -- 172.21.15.133:0/1766084302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 msgr2=0x7f0f7c06bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c06bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 -- 172.21.15.133:0/1766084302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7c15a680 msgr2=0x7f0f7c1486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7c15a680 0x7f0f7c1486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 -- 172.21.15.133:0/1766084302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f780094d0 con 0x7f0f7c0cac10 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f82c10640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7c15a680 0x7f0f7c1486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f81c0e640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f7c0cac10 0x7f0f7c152260 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c460 tx=0x7f0f6c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f72ffd640 1 -- 172.21.15.133:0/1766084302 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c007480 con 0x7f0f7c0cac10 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f72ffd640 1 -- 172.21.15.133:0/1766084302 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c007600 con 0x7f0f7c0cac10 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f74009a70 con 0x7f0f7c0cac10 2023-12-18T10:23:45.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f72ffd640 1 -- 172.21.15.133:0/1766084302 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c004a30 con 0x7f0f7c0cac10 2023-12-18T10:23:45.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c0af950 con 0x7f0f7c0cac10 2023-12-18T10:23:45.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c0735b0 con 0x7f0f7c0cac10 2023-12-18T10:23:45.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.566+0000 7f0f72ffd640 1 -- 172.21.15.133:0/1766084302 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0f6c004b90 con 0x7f0f7c0cac10 2023-12-18T10:23:45.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.570+0000 7f0f72ffd640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f60065a90 0x7f0f60067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.570+0000 7f0f72ffd640 1 -- 172.21.15.133:0/1766084302 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0f6c0824b0 con 0x7f0f7c0cac10 2023-12-18T10:23:45.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.570+0000 7f0f8240f640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f60065a90 0x7f0f60067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.570+0000 7f0f8240f640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f60065a90 0x7f0f60067f50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0f78006cb0 tx=0x7f0f78009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.574+0000 7f0f72ffd640 1 -- 172.21.15.133:0/1766084302 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0f6c04fd40 con 0x7f0f7c0cac10 2023-12-18T10:23:45.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.722+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f7c04e000 con 0x7f0f7c0cac10 2023-12-18T10:23:45.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.722+0000 7f0f72ffd640 1 -- 172.21.15.133:0/1766084302 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16357 (secure 0 0 0) 0x7f0f6c053360 con 0x7f0f7c0cac10 2023-12-18T10:23:45.724 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:45.724 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:23:12.471181+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:23:10.000470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-18T10:23:10.462940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:45.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f60065a90 msgr2=0x7f0f60067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f60065a90 0x7f0f60067f50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0f78006cb0 tx=0x7f0f78009240 comp rx=0 tx=0).stop 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f7c0cac10 msgr2=0x7f0f7c152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f7c0cac10 0x7f0f7c152260 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c460 tx=0x7f0f6c00c920 comp rx=0 tx=0).stop 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 shutdown_connections 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0f60065a90 0x7f0f60067f50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f7c15a680 0x7f0f7c1486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f7c0cac10 0x7f0f7c152260 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 --2- 172.21.15.133:0/1766084302 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f7c06fdb0 0x7f0f7c06bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 >> 172.21.15.133:0/1766084302 conn(0x7f0f7c06a3e0 msgr2=0x7f0f7c153940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 shutdown_connections 2023-12-18T10:23:45.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.726+0000 7f0f84673640 1 -- 172.21.15.133:0/1766084302 wait complete. 2023-12-18T10:23:45.745 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-18T10:23:45.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:45.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.882+0000 7f7695066640 1 Processor -- start 2023-12-18T10:23:45.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.882+0000 7f7695066640 1 -- start start 2023-12-18T10:23:45.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.882+0000 7f7695066640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f76901570c0 0x7f769006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.882+0000 7f7695066640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76900c9460 con 0x7f769006c320 2023-12-18T10:23:45.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.882+0000 7f7695066640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76901574a0 con 0x7f76900ca000 2023-12-18T10:23:45.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.882+0000 7f7695066640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769006c7a0 con 0x7f76901570c0 2023-12-18T10:23:45.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f7687fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f769006c320 0x7f76900c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40080/0 (socket says 172.21.15.133:40080) 2023-12-18T10:23:45.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f7687fff640 1 -- 172.21.15.133:0/2268474712 learned_addr learned my addr 172.21.15.133:0/2268474712 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768ed9d640 1 --2- 172.21.15.133:0/2268474712 >> v2:172.21.15.142:3300/0 conn(0x7f76901570c0 0x7f769006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394199802 0 0) 0x7f76900c9460 con 0x7f769006c320 2023-12-18T10:23:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f767c003530 con 0x7f769006c320 2023-12-18T10:23:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972050902 0 0) 0x7f767c003530 con 0x7f769006c320 2023-12-18T10:23:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 >> v2:172.21.15.142:3300/0 conn(0x7f76901570c0 msgr2=0x7f769006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 --2- 172.21.15.133:0/2268474712 >> v2:172.21.15.142:3300/0 conn(0x7f76901570c0 0x7f769006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 >> v1:172.21.15.142:6789/0 conn(0x7f76900ca000 legacy=0x7f7690070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900c8b30 con 0x7f769006c320 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f7678001680 con 0x7f769006c320 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 >> v1:172.21.15.133:6789/0 conn(0x7f769006c320 legacy=0x7f76900c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c003980 0x7f767c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f767c0047d0 0x7f767c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c005190 0x7f767c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769006c7a0 con 0x7f767c0047d0 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c00c130 con 0x7f767c003980 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c00c2f0 con 0x7f767c005190 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768ed9d640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c003980 0x7f767c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f7687fff640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f767c0047d0 0x7f767c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768f59e640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c005190 0x7f767c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768ed9d640 1 -- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c005190 msgr2=0x7f767c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768ed9d640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c005190 0x7f767c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768ed9d640 1 -- 172.21.15.133:0/2268474712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f767c0047d0 msgr2=0x7f767c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:45.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768ed9d640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f767c0047d0 0x7f767c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768ed9d640 1 -- 172.21.15.133:0/2268474712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c003530 con 0x7f767c003980 2023-12-18T10:23:45.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f7687fff640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f767c0047d0 0x7f767c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:45.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.886+0000 7f768f59e640 1 -- 172.21.15.133:0/2268474712 reap_dead start 2023-12-18T10:23:45.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f768ed9d640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c003980 0x7f767c003da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7680009ae0 tx=0x7f768001cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4329c865cbc8659 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800a5790 con 0x7f767c003980 2023-12-18T10:23:45.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76800a58f0 con 0x7f767c003980 2023-12-18T10:23:45.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f768e59c640 1 -- 172.21.15.133:0/2268474712 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800a5ca0 con 0x7f767c003980 2023-12-18T10:23:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 -- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c003980 msgr2=0x7f767c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c003980 0x7f767c003da0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7680009ae0 tx=0x7f768001cb00 comp rx=0 tx=0).stop 2023-12-18T10:23:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 -- 172.21.15.133:0/2268474712 shutdown_connections 2023-12-18T10:23:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 --2- 172.21.15.133:0/2268474712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c003980 0x7f767c003da0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 -- 172.21.15.133:0/2268474712 >> 172.21.15.133:0/2268474712 conn(0x7f769006a3e0 msgr2=0x7f76900afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 -- 172.21.15.133:0/2268474712 shutdown_connections 2023-12-18T10:23:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 -- 172.21.15.133:0/2268474712 wait complete. 2023-12-18T10:23:45.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 Processor -- start 2023-12-18T10:23:45.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.890+0000 7f7695066640 1 -- start start 2023-12-18T10:23:45.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c003980 0x7f769015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76901580d0 0x7f76901ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76900c7600 0x7f76900c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76900c7fc0 con 0x7f76900c7600 2023-12-18T10:23:45.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76900c1ff0 con 0x7f76901580d0 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7690159210 con 0x7f767c003980 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76900c7600 0x7f76900c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76900c7600 0x7f76900c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53344/0 (socket says 172.21.15.133:53344) 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 -- 172.21.15.133:0/3698472657 learned_addr learned my addr 172.21.15.133:0/3698472657 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7687fff640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76901580d0 0x7f76901ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768ed9d640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c003980 0x7f769015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 -- 172.21.15.133:0/3698472657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c003980 msgr2=0x7f769015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c003980 0x7f769015b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 -- 172.21.15.133:0/3698472657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76901580d0 msgr2=0x7f76901ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76901580d0 0x7f76901ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 -- 172.21.15.133:0/3698472657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690158600 con 0x7f76900c7600 2023-12-18T10:23:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f768f59e640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76900c7600 0x7f76900c7a80 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f76900b06e0 tx=0x7f768800fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f76877fe640 1 -- 172.21.15.133:0/3698472657 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688003b90 con 0x7f76900c7600 2023-12-18T10:23:45.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f76877fe640 1 -- 172.21.15.133:0/3698472657 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7688003d10 con 0x7f76900c7600 2023-12-18T10:23:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f76877fe640 1 -- 172.21.15.133:0/3698472657 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688005310 con 0x7f76900c7600 2023-12-18T10:23:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76901588e0 con 0x7f76900c7600 2023-12-18T10:23:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7690158ea0 con 0x7f76900c7600 2023-12-18T10:23:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7690159060 con 0x7f76900c7600 2023-12-18T10:23:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.894+0000 7f76877fe640 1 -- 172.21.15.133:0/3698472657 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7688005470 con 0x7f76900c7600 2023-12-18T10:23:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.898+0000 7f76877fe640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7670065a60 0x7f7670067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.898+0000 7f76877fe640 1 -- 172.21.15.133:0/3698472657 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f76880831f0 con 0x7f76900c7600 2023-12-18T10:23:45.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.898+0000 7f768ed9d640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7670065a60 0x7f7670067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:45.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.898+0000 7f768ed9d640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7670065a60 0x7f7670067f20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f76800af000 tx=0x7f76800046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:45.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:45.902+0000 7f76877fe640 1 -- 172.21.15.133:0/3698472657 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f76880509f0 con 0x7f76900c7600 2023-12-18T10:23:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.082+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76900735b0 con 0x7f76900c7600 2023-12-18T10:23:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.082+0000 7f76877fe640 1 -- 172.21.15.133:0/3698472657 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4754 (secure 0 0 0) 0x7f7688054010 con 0x7f76900c7600 2023-12-18T10:23:46.084 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:46.084 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:43.019018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7557,"mds_1":7099,"mds_2":7096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7096":{"gid":7096,"name":"d","rank":2,"incarnation":71,"state":"up:active","state_seq":5,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7099":{"gid":7099,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:46.084 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 75 2023-12-18T10:23:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7670065a60 msgr2=0x7f7670067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7670065a60 0x7f7670067f20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f76800af000 tx=0x7f76800046d0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76900c7600 msgr2=0x7f76900c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76900c7600 0x7f76900c7a80 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f76900b06e0 tx=0x7f768800fd40 comp rx=0 tx=0).stop 2023-12-18T10:23:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 shutdown_connections 2023-12-18T10:23:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7670065a60 0x7f7670067f20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76900c7600 0x7f76900c7a80 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76901580d0 0x7f76901ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 --2- 172.21.15.133:0/3698472657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c003980 0x7f769015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 >> 172.21.15.133:0/3698472657 conn(0x7f769006a3e0 msgr2=0x7f76900cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 shutdown_connections 2023-12-18T10:23:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.086+0000 7f7695066640 1 -- 172.21.15.133:0/3698472657 wait complete. 2023-12-18T10:23:46.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.242+0000 7f897b0e5640 1 Processor -- start 2023-12-18T10:23:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.242+0000 7f897b0e5640 1 -- start start 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f897b0e5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f897415c9d0 0x7f89740cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f897b0e5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89740cdd40 0x7f8974160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f897b0e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8974161060 0x7f897406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f897b0e5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89741603f0 con 0x7f89740cdd40 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f897b0e5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8974160690 con 0x7f897415c9d0 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f897b0e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89740b0d80 con 0x7f8974161060 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8973fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89740cdd40 0x7f8974160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8973fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89740cdd40 0x7f8974160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53348/0 (socket says 172.21.15.133:53348) 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8973fff640 1 -- 172.21.15.133:0/2576594714 learned_addr learned my addr 172.21.15.133:0/2576594714 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8979682640 1 --2- 172.21.15.133:0/2576594714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8974161060 0x7f897406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8978e81640 1 --2- 172.21.15.133:0/2576594714 >> v2:172.21.15.142:3300/0 conn(0x7f897415c9d0 0x7f89740cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8973fff640 1 -- 172.21.15.133:0/2576594714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8974161060 msgr2=0x7f897406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8973fff640 1 --2- 172.21.15.133:0/2576594714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8974161060 0x7f897406fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8973fff640 1 -- 172.21.15.133:0/2576594714 >> v2:172.21.15.142:3300/0 conn(0x7f897415c9d0 msgr2=0x7f89740cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8973fff640 1 --2- 172.21.15.133:0/2576594714 >> v2:172.21.15.142:3300/0 conn(0x7f897415c9d0 0x7f89740cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8973fff640 1 -- 172.21.15.133:0/2576594714 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89740ccb00 con 0x7f89740cdd40 2023-12-18T10:23:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8979682640 1 --2- 172.21.15.133:0/2576594714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8974161060 0x7f897406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.246+0000 7f8978e81640 1 --2- 172.21.15.133:0/2576594714 >> v2:172.21.15.142:3300/0 conn(0x7f897415c9d0 0x7f89740cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f8973fff640 1 --2- 172.21.15.133:0/2576594714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89740cdd40 0x7f8974160b20 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f897406cff0 tx=0x7f896001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90fe3fd004518bd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f89737fe640 1 -- 172.21.15.133:0/2576594714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600aa640 con 0x7f89740cdd40 2023-12-18T10:23:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f89737fe640 1 -- 172.21.15.133:0/2576594714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89600aa7a0 con 0x7f89740cdd40 2023-12-18T10:23:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f89737fe640 1 -- 172.21.15.133:0/2576594714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600aab30 con 0x7f89740cdd40 2023-12-18T10:23:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- 172.21.15.133:0/2576594714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89740cdd40 msgr2=0x7f8974160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 --2- 172.21.15.133:0/2576594714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89740cdd40 0x7f8974160b20 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f897406cff0 tx=0x7f896001c500 comp rx=0 tx=0).stop 2023-12-18T10:23:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- 172.21.15.133:0/2576594714 shutdown_connections 2023-12-18T10:23:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 --2- 172.21.15.133:0/2576594714 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8974161060 0x7f897406fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 --2- 172.21.15.133:0/2576594714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89740cdd40 0x7f8974160b20 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 --2- 172.21.15.133:0/2576594714 >> v2:172.21.15.142:3300/0 conn(0x7f897415c9d0 0x7f89740cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- 172.21.15.133:0/2576594714 >> 172.21.15.133:0/2576594714 conn(0x7f897406a3e0 msgr2=0x7f89740afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- 172.21.15.133:0/2576594714 shutdown_connections 2023-12-18T10:23:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- 172.21.15.133:0/2576594714 wait complete. 2023-12-18T10:23:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 Processor -- start 2023-12-18T10:23:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- start start 2023-12-18T10:23:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740cdd40 0x7f897414b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f897415c9d0 0x7f897414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974161060 0x7f89740acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897414bb90 con 0x7f897415c9d0 2023-12-18T10:23:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89741587a0 con 0x7f8974161060 2023-12-18T10:23:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.250+0000 7f897b0e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89741584c0 con 0x7f89740cdd40 2023-12-18T10:23:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f897415c9d0 0x7f897414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f897415c9d0 0x7f897414b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53358/0 (socket says 172.21.15.133:53358) 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 -- 172.21.15.133:0/3659118136 learned_addr learned my addr 172.21.15.133:0/3659118136 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8979682640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974161060 0x7f89740acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8978e81640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740cdd40 0x7f897414b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 -- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740cdd40 msgr2=0x7f897414b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740cdd40 0x7f897414b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 -- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974161060 msgr2=0x7f89740acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974161060 0x7f89740acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 -- 172.21.15.133:0/3659118136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600094d0 con 0x7f897415c9d0 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8978e81640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740cdd40 0x7f897414b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f8973fff640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f897415c9d0 0x7f897414b650 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f896001abb0 tx=0x7f896001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f89717fa640 1 -- 172.21.15.133:0/3659118136 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600bd5f0 con 0x7f897415c9d0 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f89717fa640 1 -- 172.21.15.133:0/3659118136 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89600bd750 con 0x7f897415c9d0 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89740c7390 con 0x7f897415c9d0 2023-12-18T10:23:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f89717fa640 1 -- 172.21.15.133:0/3659118136 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89600bdb00 con 0x7f897415c9d0 2023-12-18T10:23:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89740c7950 con 0x7f897415c9d0 2023-12-18T10:23:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89740735b0 con 0x7f897415c9d0 2023-12-18T10:23:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f89717fa640 1 -- 172.21.15.133:0/3659118136 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f89600a8050 con 0x7f897415c9d0 2023-12-18T10:23:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.254+0000 7f89717fa640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8958065a60 0x7f8958067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.258+0000 7f89717fa640 1 -- 172.21.15.133:0/3659118136 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f896011db40 con 0x7f897415c9d0 2023-12-18T10:23:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.258+0000 7f8978e81640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8958065a60 0x7f8958067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.258+0000 7f8978e81640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8958065a60 0x7f8958067f20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8968006fd0 tx=0x7f8968008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.258+0000 7f89717fa640 1 -- 172.21.15.133:0/3659118136 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f89600eb4f0 con 0x7f897415c9d0 2023-12-18T10:23:46.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.438+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f897404e000 con 0x7f897415c9d0 2023-12-18T10:23:46.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.438+0000 7f89717fa640 1 -- 172.21.15.133:0/3659118136 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4754 (secure 0 0 0) 0x7f89600eeb10 con 0x7f897415c9d0 2023-12-18T10:23:46.440 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:46.440 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:23:11.467812+0000","modified":"2023-12-18T10:23:43.019018+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7557,"mds_1":7099,"mds_2":7096},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7096":{"gid":7096,"name":"d","rank":2,"incarnation":71,"state":"up:active","state_seq":5,"addr":"172.21.15.142:6834/1237569557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1237569557},{"type":"v1","addr":"172.21.15.142:6834","nonce":1237569557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7099":{"gid":7099,"name":"a","rank":1,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6836/1132580582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1132580582},{"type":"v1","addr":"172.21.15.133:6836","nonce":1132580582}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7557":{"gid":7557,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/522841432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":522841432},{"type":"v1","addr":"172.21.15.133:6837","nonce":522841432}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-18T10:23:46.440 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 75 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8958065a60 msgr2=0x7f8958067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8958065a60 0x7f8958067f20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8968006fd0 tx=0x7f8968008040 comp rx=0 tx=0).stop 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f897415c9d0 msgr2=0x7f897414b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f897415c9d0 0x7f897414b650 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f896001abb0 tx=0x7f896001ad40 comp rx=0 tx=0).stop 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 shutdown_connections 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8958065a60 0x7f8958067f20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8974161060 0x7f89740acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f897415c9d0 0x7f897414b650 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 --2- 172.21.15.133:0/3659118136 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f89740cdd40 0x7f897414b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 >> 172.21.15.133:0/3659118136 conn(0x7f897406a3e0 msgr2=0x7f89740ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 shutdown_connections 2023-12-18T10:23:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.442+0000 7f897b0e5640 1 -- 172.21.15.133:0/3659118136 wait complete. 2023-12-18T10:23:46.461 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:23:46.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.598+0000 7f82f072c640 1 Processor -- start 2023-12-18T10:23:46.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.598+0000 7f82f072c640 1 -- start start 2023-12-18T10:23:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.598+0000 7f82f072c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f82e81570c0 0x7f82e806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.598+0000 7f82f072c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82e80ca000 0x7f82e8070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.598+0000 7f82f072c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e80c9460 con 0x7f82e806c320 2023-12-18T10:23:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.598+0000 7f82f072c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e806c7a0 con 0x7f82e80ca000 2023-12-18T10:23:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.598+0000 7f82f072c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e81574a0 con 0x7f82e81570c0 2023-12-18T10:23:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82eecc9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82e80ca000 0x7f82e8070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82eecc9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82e80ca000 0x7f82e8070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53374/0 (socket says 172.21.15.133:53374) 2023-12-18T10:23:46.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82eecc9640 1 -- 172.21.15.133:0/942532643 learned_addr learned my addr 172.21.15.133:0/942532643 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:46.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82ee4c8640 1 --2- 172.21.15.133:0/942532643 >> v2:172.21.15.142:3300/0 conn(0x7f82e81570c0 0x7f82e806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82eecc9640 1 -- 172.21.15.133:0/942532643 >> v2:172.21.15.142:3300/0 conn(0x7f82e81570c0 msgr2=0x7f82e806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:46.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82eecc9640 1 --2- 172.21.15.133:0/942532643 >> v2:172.21.15.142:3300/0 conn(0x7f82e81570c0 0x7f82e806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82eecc9640 1 -- 172.21.15.133:0/942532643 >> v1:172.21.15.142:6789/0 conn(0x7f82e806c320 legacy=0x7f82e80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82eecc9640 1 -- 172.21.15.133:0/942532643 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e80c8b30 con 0x7f82e80ca000 2023-12-18T10:23:46.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82eecc9640 1 --2- 172.21.15.133:0/942532643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e8070df0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f82e806e280 tx=0x7f82e001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e369457e9b1b325 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82ed4c6640 1 -- 172.21.15.133:0/942532643 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e00a57d0 con 0x7f82e80ca000 2023-12-18T10:23:46.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82ed4c6640 1 -- 172.21.15.133:0/942532643 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e00a5930 con 0x7f82e80ca000 2023-12-18T10:23:46.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.602+0000 7f82ed4c6640 1 -- 172.21.15.133:0/942532643 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e00a5cc0 con 0x7f82e80ca000 2023-12-18T10:23:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- 172.21.15.133:0/942532643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 msgr2=0x7f82e8070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 --2- 172.21.15.133:0/942532643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e8070df0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f82e806e280 tx=0x7f82e001c910 comp rx=0 tx=0).stop 2023-12-18T10:23:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- 172.21.15.133:0/942532643 shutdown_connections 2023-12-18T10:23:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 --2- 172.21.15.133:0/942532643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e8070df0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 --2- 172.21.15.133:0/942532643 >> v2:172.21.15.142:3300/0 conn(0x7f82e81570c0 0x7f82e806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- 172.21.15.133:0/942532643 >> 172.21.15.133:0/942532643 conn(0x7f82e806a3e0 msgr2=0x7f82e80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- 172.21.15.133:0/942532643 shutdown_connections 2023-12-18T10:23:46.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- 172.21.15.133:0/942532643 wait complete. 2023-12-18T10:23:46.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 Processor -- start 2023-12-18T10:23:46.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- start start 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e806c320 0x7f82e8166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e80c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e81570c0 0x7f82e80c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80c82d0 con 0x7f82e80ca000 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80c6950 con 0x7f82e81570c0 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82f072c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80c6060 con 0x7f82e806c320 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82edcc7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e80c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82edcc7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e80c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53380/0 (socket says 172.21.15.133:53380) 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82edcc7640 1 -- 172.21.15.133:0/3372584503 learned_addr learned my addr 172.21.15.133:0/3372584503 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82ee4c8640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e806c320 0x7f82e8166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82eecc9640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e81570c0 0x7f82e80c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82edcc7640 1 -- 172.21.15.133:0/3372584503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e806c320 msgr2=0x7f82e8166ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82edcc7640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e806c320 0x7f82e8166ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82edcc7640 1 -- 172.21.15.133:0/3372584503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e81570c0 msgr2=0x7f82e80c03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82edcc7640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e81570c0 0x7f82e80c03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.606+0000 7f82edcc7640 1 -- 172.21.15.133:0/3372584503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009b30 con 0x7f82e80ca000 2023-12-18T10:23:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82edcc7640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e80c6de0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c370 tx=0x7f82d800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82deffd640 1 -- 172.21.15.133:0/3372584503 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80052d0 con 0x7f82e80ca000 2023-12-18T10:23:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82deffd640 1 -- 172.21.15.133:0/3372584503 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8005430 con 0x7f82e80ca000 2023-12-18T10:23:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e80c8010 con 0x7f82e80ca000 2023-12-18T10:23:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82deffd640 1 -- 172.21.15.133:0/3372584503 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8007260 con 0x7f82e80ca000 2023-12-18T10:23:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e80c65e0 con 0x7f82e80ca000 2023-12-18T10:23:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e80735b0 con 0x7f82e80ca000 2023-12-18T10:23:46.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82deffd640 1 -- 172.21.15.133:0/3372584503 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f82d80073c0 con 0x7f82e80ca000 2023-12-18T10:23:46.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82deffd640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82cc065a60 0x7f82cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82deffd640 1 -- 172.21.15.133:0/3372584503 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f82d8082590 con 0x7f82e80ca000 2023-12-18T10:23:46.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.610+0000 7f82ee4c8640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82cc065a60 0x7f82cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.614+0000 7f82ee4c8640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82cc065a60 0x7f82cc067f20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009b60 tx=0x7f82e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.614+0000 7f82deffd640 1 -- 172.21.15.133:0/3372584503 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f82d804fec0 con 0x7f82e80ca000 2023-12-18T10:23:46.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.766+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82e804e000 con 0x7f82e80ca000 2023-12-18T10:23:46.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.766+0000 7f82deffd640 1 -- 172.21.15.133:0/3372584503 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16357 (secure 0 0 0) 0x7f82d80534e0 con 0x7f82e80ca000 2023-12-18T10:23:46.766 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:46.766 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:23:12.471181+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:23:10.000470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-18T10:23:10.462940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:23:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82cc065a60 msgr2=0x7f82cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82cc065a60 0x7f82cc067f20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009b60 tx=0x7f82e4009190 comp rx=0 tx=0).stop 2023-12-18T10:23:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 msgr2=0x7f82e80c6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e80c6de0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c370 tx=0x7f82d800c830 comp rx=0 tx=0).stop 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 shutdown_connections 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f82cc065a60 0x7f82cc067f20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82e81570c0 0x7f82e80c03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e80ca000 0x7f82e80c6de0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 --2- 172.21.15.133:0/3372584503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82e806c320 0x7f82e8166ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 >> 172.21.15.133:0/3372584503 conn(0x7f82e806a3e0 msgr2=0x7f82e80c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 shutdown_connections 2023-12-18T10:23:46.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.770+0000 7f82f072c640 1 -- 172.21.15.133:0/3372584503 wait complete. 2023-12-18T10:23:46.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-18T10:23:46.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b0b4b6640 1 Processor -- start 2023-12-18T10:23:46.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b0b4b6640 1 -- start start 2023-12-18T10:23:46.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b0b4b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b04160cc0 0x7f8b040cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b0b4b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b040c1280 0x7f8b040cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b0b4b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0406fdb0 con 0x7f8b040c17d0 2023-12-18T10:23:46.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b0b4b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b041654a0 con 0x7f8b040c1280 2023-12-18T10:23:46.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b0b4b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b041610a0 con 0x7f8b04160cc0 2023-12-18T10:23:46.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b08a51640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b040c1280 0x7f8b040cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b08a51640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b040c1280 0x7f8b040cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53384/0 (socket says 172.21.15.133:53384) 2023-12-18T10:23:46.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.926+0000 7f8b08a51640 1 -- 172.21.15.133:0/518664639 learned_addr learned my addr 172.21.15.133:0/518664639 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:46.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8b09252640 1 --2- 172.21.15.133:0/518664639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b04160cc0 0x7f8b040cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8b08a51640 1 -- 172.21.15.133:0/518664639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b04160cc0 msgr2=0x7f8b040cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:46.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8b08a51640 1 --2- 172.21.15.133:0/518664639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b04160cc0 0x7f8b040cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8b08a51640 1 -- 172.21.15.133:0/518664639 >> v1:172.21.15.142:6789/0 conn(0x7f8b040c17d0 legacy=0x7f8b0406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8b08a51640 1 -- 172.21.15.133:0/518664639 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b040cb6b0 con 0x7f8b040c1280 2023-12-18T10:23:46.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8b08a51640 1 --2- 172.21.15.133:0/518664639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c1280 0x7f8b040cb170 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8af40098a0 tx=0x7f8af401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ed15f1c0c5f1a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8afbfff640 1 -- 172.21.15.133:0/518664639 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af40ac600 con 0x7f8b040c1280 2023-12-18T10:23:46.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8afbfff640 1 -- 172.21.15.133:0/518664639 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af40a8050 con 0x7f8b040c1280 2023-12-18T10:23:46.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8afbfff640 1 -- 172.21.15.133:0/518664639 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af40ac980 con 0x7f8b040c1280 2023-12-18T10:23:46.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/518664639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c1280 msgr2=0x7f8b040cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.930+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/518664639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c1280 0x7f8b040cb170 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8af40098a0 tx=0x7f8af401c460 comp rx=0 tx=0).stop 2023-12-18T10:23:46.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/518664639 shutdown_connections 2023-12-18T10:23:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/518664639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c1280 0x7f8b040cb170 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/518664639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b04160cc0 0x7f8b040cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/518664639 >> 172.21.15.133:0/518664639 conn(0x7f8b0406a3e0 msgr2=0x7f8b040afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/518664639 shutdown_connections 2023-12-18T10:23:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/518664639 wait complete. 2023-12-18T10:23:46.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 Processor -- start 2023-12-18T10:23:46.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 -- start start 2023-12-18T10:23:46.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b040c1280 0x7f8b040ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c17d0 0x7f8b04159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b04160cc0 0x7f8b040b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0415a1f0 con 0x7f8b040c17d0 2023-12-18T10:23:46.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04162dc0 con 0x7f8b04160cc0 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b0b4b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b040b1440 con 0x7f8b040c1280 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c17d0 0x7f8b04159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c17d0 0x7f8b04159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53400/0 (socket says 172.21.15.133:53400) 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 -- 172.21.15.133:0/2424796080 learned_addr learned my addr 172.21.15.133:0/2424796080 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b09a53640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b04160cc0 0x7f8b040b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b09252640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b040c1280 0x7f8b040ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 -- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b040c1280 msgr2=0x7f8b040ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b040c1280 0x7f8b040ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 -- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b04160cc0 msgr2=0x7f8b040b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b04160cc0 0x7f8b040b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 -- 172.21.15.133:0/2424796080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40094d0 con 0x7f8b040c17d0 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b09a53640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b04160cc0 0x7f8b040b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.934+0000 7f8b08a51640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c17d0 0x7f8b04159cb0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8af401a090 tx=0x7f8af401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8af9ffb640 1 -- 172.21.15.133:0/2424796080 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af40b7650 con 0x7f8b040c17d0 2023-12-18T10:23:46.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8af9ffb640 1 -- 172.21.15.133:0/2424796080 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af40b77b0 con 0x7f8b040c17d0 2023-12-18T10:23:46.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8af9ffb640 1 -- 172.21.15.133:0/2424796080 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af40b7b20 con 0x7f8b040c17d0 2023-12-18T10:23:46.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0415a400 con 0x7f8b040c17d0 2023-12-18T10:23:46.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b04162a50 con 0x7f8b040c17d0 2023-12-18T10:23:46.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b040735b0 con 0x7f8b040c17d0 2023-12-18T10:23:46.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8af9ffb640 1 -- 172.21.15.133:0/2424796080 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8af40b3070 con 0x7f8b040c17d0 2023-12-18T10:23:46.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8af9ffb640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ae8065a60 0x7f8ae8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:46.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8af9ffb640 1 -- 172.21.15.133:0/2424796080 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8af411d860 con 0x7f8b040c17d0 2023-12-18T10:23:46.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.938+0000 7f8b09252640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ae8065a60 0x7f8ae8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:46.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.942+0000 7f8b09252640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ae8065a60 0x7f8ae8067f20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8b000079c0 tx=0x7f8b00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:46.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:46.942+0000 7f8af9ffb640 1 -- 172.21.15.133:0/2424796080 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8af40eb160 con 0x7f8b040c17d0 2023-12-18T10:23:47.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.126+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8b040adc70 con 0x7f8b040c17d0 2023-12-18T10:23:47.127 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:23:47.126+0000 7f3ba99e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-18T10:23:47.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8af9ffb640 1 -- 172.21.15.133:0/2424796080 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8af40ee780 con 0x7f8b040c17d0 2023-12-18T10:23:47.136 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-18T10:23:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ae8065a60 msgr2=0x7f8ae8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ae8065a60 0x7f8ae8067f20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8b000079c0 tx=0x7f8b00008040 comp rx=0 tx=0).stop 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c17d0 msgr2=0x7f8b04159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c17d0 0x7f8b04159cb0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8af401a090 tx=0x7f8af401aca0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 shutdown_connections 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8ae8065a60 0x7f8ae8067f20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b04160cc0 0x7f8b040b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b040c17d0 0x7f8b04159cb0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 --2- 172.21.15.133:0/2424796080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8b040c1280 0x7f8b040ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 >> 172.21.15.133:0/2424796080 conn(0x7f8b0406a3e0 msgr2=0x7f8b040715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 shutdown_connections 2023-12-18T10:23:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.138+0000 7f8b0b4b6640 1 -- 172.21.15.133:0/2424796080 wait complete. 2023-12-18T10:23:47.155 INFO:tasks.ceph.mds.c.smithi133.stderr: -8114> 2023-12-18T10:23:13.066+0000 7f42dabad640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:23:47.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-18T10:23:47.186 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:23:47.190 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:23:47.216 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:23:47.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.314+0000 7f77bfe20640 1 Processor -- start 2023-12-18T10:23:47.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.314+0000 7f77bfe20640 1 -- start start 2023-12-18T10:23:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77bfe20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 0x7f77b80c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77bfe20640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77b80ce3b0 0x7f77b80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77bfe20640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b80c9390 con 0x7f77b81582d0 2023-12-18T10:23:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77bfe20640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b80ced80 con 0x7f77b80ce3b0 2023-12-18T10:23:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77bfe20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b815aee0 con 0x7f77b8070820 2023-12-18T10:23:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77be3bd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77b80ce3b0 0x7f77b80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:47.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77be3bd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77b80ce3b0 0x7f77b80ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53452/0 (socket says 172.21.15.133:53452) 2023-12-18T10:23:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77be3bd640 1 -- 172.21.15.133:0/827164897 learned_addr learned my addr 172.21.15.133:0/827164897 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77bdbbc640 1 --1- 172.21.15.133:0/827164897 >> v1:172.21.15.142:6789/0 conn(0x7f77b81582d0 0x7f77b80ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:37350/0 (socket says 172.21.15.133:37350) 2023-12-18T10:23:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77bd3bb640 1 --2- 172.21.15.133:0/827164897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 0x7f77b80c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77be3bd640 1 -- 172.21.15.133:0/827164897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 msgr2=0x7f77b80c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77be3bd640 1 --2- 172.21.15.133:0/827164897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 0x7f77b80c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77be3bd640 1 -- 172.21.15.133:0/827164897 >> v1:172.21.15.142:6789/0 conn(0x7f77b81582d0 legacy=0x7f77b80ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77be3bd640 1 -- 172.21.15.133:0/827164897 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b815b1c0 con 0x7f77b80ce3b0 2023-12-18T10:23:47.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.318+0000 7f77bcbba640 1 -- 172.21.15.133:0/827164897 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435660101 0 0) 0x7f77b80c9390 con 0x7f77b81582d0 2023-12-18T10:23:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77be3bd640 1 --2- 172.21.15.133:0/827164897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b80ce3b0 0x7f77b80ce840 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009e50 tx=0x7f77b001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92c6d2342b381e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bcbba640 1 -- 172.21.15.133:0/827164897 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00a58a0 con 0x7f77b80ce3b0 2023-12-18T10:23:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bcbba640 1 -- 172.21.15.133:0/827164897 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b00a5a00 con 0x7f77b80ce3b0 2023-12-18T10:23:47.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bcbba640 1 -- 172.21.15.133:0/827164897 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00a5d90 con 0x7f77b80ce3b0 2023-12-18T10:23:47.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- 172.21.15.133:0/827164897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b80ce3b0 msgr2=0x7f77b80ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:47.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 --2- 172.21.15.133:0/827164897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b80ce3b0 0x7f77b80ce840 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009e50 tx=0x7f77b001c9e0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- 172.21.15.133:0/827164897 shutdown_connections 2023-12-18T10:23:47.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 --2- 172.21.15.133:0/827164897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b80ce3b0 0x7f77b80ce840 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 --2- 172.21.15.133:0/827164897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 0x7f77b80c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- 172.21.15.133:0/827164897 >> 172.21.15.133:0/827164897 conn(0x7f77b806a2a0 msgr2=0x7f77b80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:47.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- 172.21.15.133:0/827164897 shutdown_connections 2023-12-18T10:23:47.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- 172.21.15.133:0/827164897 wait complete. 2023-12-18T10:23:47.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 Processor -- start 2023-12-18T10:23:47.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- start start 2023-12-18T10:23:47.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 0x7f77b80c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:47.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b80ce3b0 0x7f77b80c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:47.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b81582d0 0x7f77b80c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:47.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80c2490 con 0x7f77b81582d0 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80c44d0 con 0x7f77b80ce3b0 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bfe20640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b80c47b0 con 0x7f77b8070820 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77be3bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b81582d0 0x7f77b80c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bdbbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 0x7f77b80c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77be3bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b81582d0 0x7f77b80c04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53466/0 (socket says 172.21.15.133:53466) 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77be3bd640 1 -- 172.21.15.133:0/3662873906 learned_addr learned my addr 172.21.15.133:0/3662873906 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.322+0000 7f77bd3bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b80ce3b0 0x7f77b80c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77be3bd640 1 -- 172.21.15.133:0/3662873906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 msgr2=0x7f77b80c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77be3bd640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 0x7f77b80c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77be3bd640 1 -- 172.21.15.133:0/3662873906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b80ce3b0 msgr2=0x7f77b80c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77be3bd640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b80ce3b0 0x7f77b80c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77be3bd640 1 -- 172.21.15.133:0/3662873906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0009b30 con 0x7f77b81582d0 2023-12-18T10:23:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77be3bd640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b81582d0 0x7f77b80c04c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f77b00af040 tx=0x7f77b0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77ae7fc640 1 -- 172.21.15.133:0/3662873906 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00b8670 con 0x7f77b81582d0 2023-12-18T10:23:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77ae7fc640 1 -- 172.21.15.133:0/3662873906 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b00b87d0 con 0x7f77b81582d0 2023-12-18T10:23:47.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b80c4a90 con 0x7f77b81582d0 2023-12-18T10:23:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77ae7fc640 1 -- 172.21.15.133:0/3662873906 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00b8b80 con 0x7f77b81582d0 2023-12-18T10:23:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b80c55a0 con 0x7f77b81582d0 2023-12-18T10:23:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b80c5790 con 0x7f77b81582d0 2023-12-18T10:23:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77ae7fc640 1 -- 172.21.15.133:0/3662873906 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77b00b8ce0 con 0x7f77b81582d0 2023-12-18T10:23:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77ae7fc640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f779c065a60 0x7f779c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77ae7fc640 1 -- 172.21.15.133:0/3662873906 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f77b011e940 con 0x7f77b81582d0 2023-12-18T10:23:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.326+0000 7f77bdbbc640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f779c065a60 0x7f779c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.330+0000 7f77bdbbc640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f779c065a60 0x7f779c067f20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000f70 tx=0x7f77b4007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:47.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.330+0000 7f77ae7fc640 1 -- 172.21.15.133:0/3662873906 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f77b00ec0d0 con 0x7f77b81582d0 2023-12-18T10:23:47.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:47.514+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77b804e000 con 0x7f77b81582d0 2023-12-18T10:23:48.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.138+0000 7f77ae7fc640 1 -- 172.21.15.133:0/3662873906 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) v1 ==== 104+0+0 (secure 0 0 0) 0x7f77b00ef6f0 con 0x7f77b81582d0 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f779c065a60 msgr2=0x7f779c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f779c065a60 0x7f779c067f20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000f70 tx=0x7f77b4007df0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b81582d0 msgr2=0x7f77b80c04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b81582d0 0x7f77b80c04c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f77b00af040 tx=0x7f77b0019780 comp rx=0 tx=0).stop 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 shutdown_connections 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f779c065a60 0x7f779c067f20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b81582d0 0x7f77b80c04c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b80ce3b0 0x7f77b80c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 --2- 172.21.15.133:0/3662873906 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f77b8070820 0x7f77b80c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 >> 172.21.15.133:0/3662873906 conn(0x7f77b806a2a0 msgr2=0x7f77b80c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:48.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 shutdown_connections 2023-12-18T10:23:48.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.142+0000 7f77bfe20640 1 -- 172.21.15.133:0/3662873906 wait complete. 2023-12-18T10:23:48.165 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-18T10:23:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.350+0000 7f0c1d7e9640 1 Processor -- start 2023-12-18T10:23:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.350+0000 7f0c1d7e9640 1 -- start start 2023-12-18T10:23:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.350+0000 7f0c1d7e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b23a0 0x7f0c1806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c1d7e9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c1815c590 0x7f0c1815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c1d7e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c180cadd0 con 0x7f0c180b2780 2023-12-18T10:23:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c1d7e9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1806ee00 con 0x7f0c1815c590 2023-12-18T10:23:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c1d7e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1806eb20 con 0x7f0c180b23a0 2023-12-18T10:23:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c16ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b23a0 0x7f0c1806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c177fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c1815c590 0x7f0c1815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c16ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b23a0 0x7f0c1806ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:45182/0 (socket says 172.21.15.133:45182) 2023-12-18T10:23:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c16ffd640 1 -- 172.21.15.133:0/1255890909 learned_addr learned my addr 172.21.15.133:0/1255890909 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c16ffd640 1 -- 172.21.15.133:0/1255890909 >> v2:172.21.15.142:3300/0 conn(0x7f0c1815c590 msgr2=0x7f0c1815ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c16ffd640 1 --2- 172.21.15.133:0/1255890909 >> v2:172.21.15.142:3300/0 conn(0x7f0c1815c590 0x7f0c1815ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c16ffd640 1 -- 172.21.15.133:0/1255890909 >> v1:172.21.15.142:6789/0 conn(0x7f0c180b2780 legacy=0x7f0c1806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:48.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.354+0000 7f0c16ffd640 1 -- 172.21.15.133:0/1255890909 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180cb070 con 0x7f0c180b23a0 2023-12-18T10:23:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c16ffd640 1 --2- 172.21.15.133:0/1255890909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b23a0 0x7f0c1806ddf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c080098a0 tx=0x7f0c0801ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d955b86d302ac793 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c167fc640 1 -- 172.21.15.133:0/1255890909 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080a8a10 con 0x7f0c180b23a0 2023-12-18T10:23:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c167fc640 1 -- 172.21.15.133:0/1255890909 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c080a8b70 con 0x7f0c180b23a0 2023-12-18T10:23:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c167fc640 1 -- 172.21.15.133:0/1255890909 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080b0440 con 0x7f0c180b23a0 2023-12-18T10:23:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/1255890909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b23a0 msgr2=0x7f0c1806ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/1255890909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b23a0 0x7f0c1806ddf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c080098a0 tx=0x7f0c0801ed10 comp rx=0 tx=0).stop 2023-12-18T10:23:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/1255890909 shutdown_connections 2023-12-18T10:23:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/1255890909 >> v2:172.21.15.142:3300/0 conn(0x7f0c1815c590 0x7f0c1815ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/1255890909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b23a0 0x7f0c1806ddf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/1255890909 >> 172.21.15.133:0/1255890909 conn(0x7f0c180cd0e0 msgr2=0x7f0c180cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/1255890909 shutdown_connections 2023-12-18T10:23:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/1255890909 wait complete. 2023-12-18T10:23:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 Processor -- start 2023-12-18T10:23:48.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- start start 2023-12-18T10:23:48.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c180b23a0 0x7f0c180c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:48.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b2780 0x7f0c181581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:48.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c1815c590 0x7f0c180c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:48.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180c8990 con 0x7f0c1815c590 2023-12-18T10:23:48.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c181586f0 con 0x7f0c180b23a0 2023-12-18T10:23:48.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.358+0000 7f0c1d7e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c180c7d10 con 0x7f0c180b2780 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c1815c590 0x7f0c180c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c1815c590 0x7f0c180c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53480/0 (socket says 172.21.15.133:53480) 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 -- 172.21.15.133:0/2392058351 learned_addr learned my addr 172.21.15.133:0/2392058351 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c16ffd640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c180b23a0 0x7f0c180c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c0ffff640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b2780 0x7f0c181581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 -- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b2780 msgr2=0x7f0c181581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b2780 0x7f0c181581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 -- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c180b23a0 msgr2=0x7f0c180c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c180b23a0 0x7f0c180c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 -- 172.21.15.133:0/2392058351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c080094d0 con 0x7f0c1815c590 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c16ffd640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c180b23a0 0x7f0c180c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c177fe640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c1815c590 0x7f0c180c8db0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000efc0 tx=0x7f0c1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:48.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c0f7fe640 1 -- 172.21.15.133:0/2392058351 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c10009ba0 con 0x7f0c1815c590 2023-12-18T10:23:48.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c0f7fe640 1 -- 172.21.15.133:0/2392058351 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000f040 con 0x7f0c1815c590 2023-12-18T10:23:48.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c0f7fe640 1 -- 172.21.15.133:0/2392058351 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c100146c0 con 0x7f0c1815c590 2023-12-18T10:23:48.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c180c7ff0 con 0x7f0c1815c590 2023-12-18T10:23:48.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c180c85b0 con 0x7f0c1815c590 2023-12-18T10:23:48.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c180c8ad0 con 0x7f0c1815c590 2023-12-18T10:23:48.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.362+0000 7f0c0f7fe640 1 -- 172.21.15.133:0/2392058351 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c10014820 con 0x7f0c1815c590 2023-12-18T10:23:48.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.366+0000 7f0c0f7fe640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bf8065a60 0x7f0bf8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:48.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.366+0000 7f0c0f7fe640 1 -- 172.21.15.133:0/2392058351 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f0c10084080 con 0x7f0c1815c590 2023-12-18T10:23:48.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.366+0000 7f0c16ffd640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bf8065a60 0x7f0bf8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:48.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.366+0000 7f0c16ffd640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bf8065a60 0x7f0bf8067f20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0c080b2000 tx=0x7f0c08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:48.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.370+0000 7f0c0f7fe640 1 -- 172.21.15.133:0/2392058351 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0c100518b0 con 0x7f0c1815c590 2023-12-18T10:23:48.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:48.522+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c180cb320 con 0x7f0c1815c590 2023-12-18T10:23:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.146+0000 7f0c0f7fe640 1 -- 172.21.15.133:0/2392058351 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0c100180d0 con 0x7f0c1815c590 2023-12-18T10:23:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bf8065a60 msgr2=0x7f0bf8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bf8065a60 0x7f0bf8067f20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0c080b2000 tx=0x7f0c08008040 comp rx=0 tx=0).stop 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c1815c590 msgr2=0x7f0c180c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c1815c590 0x7f0c180c8db0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f0c1000efc0 tx=0x7f0c1000c490 comp rx=0 tx=0).stop 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 shutdown_connections 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bf8065a60 0x7f0bf8067f20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c1815c590 0x7f0c180c8db0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c180b2780 0x7f0c181581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 --2- 172.21.15.133:0/2392058351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c180b23a0 0x7f0c180c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.150+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 >> 172.21.15.133:0/2392058351 conn(0x7f0c180cd0e0 msgr2=0x7f0c180b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:49.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.154+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 shutdown_connections 2023-12-18T10:23:49.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.154+0000 7f0c1d7e9640 1 -- 172.21.15.133:0/2392058351 wait complete. 2023-12-18T10:23:49.178 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-18T10:23:49.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.318+0000 7feb964df640 1 Processor -- start 2023-12-18T10:23:49.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb964df640 1 -- start start 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb964df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb964df640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb900c89f0 0x7feb900c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb964df640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb900ad6e0 con 0x7feb900ca200 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb964df640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb90159b20 con 0x7feb900c89f0 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb964df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb900ad9c0 con 0x7feb900ce6a0 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb94a7c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb900c89f0 0x7feb900c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb94a7c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb900c89f0 0x7feb900c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53484/0 (socket says 172.21.15.133:53484) 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb94a7c640 1 -- 172.21.15.133:0/1291957650 learned_addr learned my addr 172.21.15.133:0/1291957650 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb8f7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feb900ca200 0x7feb900cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40086/0 (socket says 172.21.15.133:40086) 2023-12-18T10:23:49.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb94a7c640 1 -- 172.21.15.133:0/1291957650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 msgr2=0x7feb900ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:49.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb8ffff640 1 --2- 172.21.15.133:0/1291957650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:49.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb94a7c640 1 --2- 172.21.15.133:0/1291957650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb94a7c640 1 -- 172.21.15.133:0/1291957650 >> v1:172.21.15.133:6789/0 conn(0x7feb900ca200 legacy=0x7feb900cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:49.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb94a7c640 1 -- 172.21.15.133:0/1291957650 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9006be20 con 0x7feb900c89f0 2023-12-18T10:23:49.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb8effd640 1 -- 172.21.15.133:0/1291957650 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014906093 0 0) 0x7feb900ad6e0 con 0x7feb900ca200 2023-12-18T10:23:49.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.322+0000 7feb8ffff640 1 --2- 172.21.15.133:0/1291957650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb94a7c640 1 --2- 172.21.15.133:0/1291957650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb900c8e80 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7feb88009e50 tx=0x7feb8801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb737d2de8741a7a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb8effd640 1 -- 172.21.15.133:0/1291957650 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880a58a0 con 0x7feb900c89f0 2023-12-18T10:23:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb8effd640 1 -- 172.21.15.133:0/1291957650 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880a5a00 con 0x7feb900c89f0 2023-12-18T10:23:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb8effd640 1 -- 172.21.15.133:0/1291957650 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880a5d90 con 0x7feb900c89f0 2023-12-18T10:23:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 -- 172.21.15.133:0/1291957650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 msgr2=0x7feb900c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 --2- 172.21.15.133:0/1291957650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb900c8e80 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7feb88009e50 tx=0x7feb8801c9e0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 -- 172.21.15.133:0/1291957650 shutdown_connections 2023-12-18T10:23:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 --2- 172.21.15.133:0/1291957650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb900c8e80 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 --2- 172.21.15.133:0/1291957650 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 -- 172.21.15.133:0/1291957650 >> 172.21.15.133:0/1291957650 conn(0x7feb90069e70 msgr2=0x7feb9006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 -- 172.21.15.133:0/1291957650 shutdown_connections 2023-12-18T10:23:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 -- 172.21.15.133:0/1291957650 wait complete. 2023-12-18T10:23:49.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 Processor -- start 2023-12-18T10:23:49.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.326+0000 7feb964df640 1 -- start start 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb90097a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb900ca200 0x7feb90158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9015a910 con 0x7feb900c89f0 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb90159d00 con 0x7feb900ca200 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb90159fe0 con 0x7feb900ce6a0 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb90097a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb90097a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53496/0 (socket says 172.21.15.133:53496) 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 -- 172.21.15.133:0/2413282008 learned_addr learned my addr 172.21.15.133:0/2413282008 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8f7fe640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb900ca200 0x7feb90158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:49.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 -- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 msgr2=0x7feb900add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb94a7c640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 -- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb900ca200 msgr2=0x7feb90158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb900ca200 0x7feb90158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 -- 172.21.15.133:0/2413282008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009b30 con 0x7feb900c89f0 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8f7fe640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb900ca200 0x7feb90158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb94a7c640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8ffff640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb90097a60 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c7c0 tx=0x7feb8000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8cff9640 1 -- 172.21.15.133:0/2413282008 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80007a30 con 0x7feb900c89f0 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8cff9640 1 -- 172.21.15.133:0/2413282008 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80007b90 con 0x7feb900c89f0 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8cff9640 1 -- 172.21.15.133:0/2413282008 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000ce70 con 0x7feb900c89f0 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9006cd60 con 0x7feb900c89f0 2023-12-18T10:23:49.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9015a5a0 con 0x7feb900c89f0 2023-12-18T10:23:49.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9004e070 con 0x7feb900c89f0 2023-12-18T10:23:49.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.330+0000 7feb8cff9640 1 -- 172.21.15.133:0/2413282008 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb800113f0 con 0x7feb900c89f0 2023-12-18T10:23:49.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.334+0000 7feb8cff9640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb7c065a60 0x7feb7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:49.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.334+0000 7feb8cff9640 1 -- 172.21.15.133:0/2413282008 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5849+0+0 (secure 0 0 0) 0x7feb800836b0 con 0x7feb900c89f0 2023-12-18T10:23:49.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.334+0000 7feb8f7fe640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb7c065a60 0x7feb7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:49.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.334+0000 7feb8f7fe640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb7c065a60 0x7feb7c067f20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7feb901510e0 tx=0x7feb84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:49.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.338+0000 7feb8cff9640 1 -- 172.21.15.133:0/2413282008 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feb80050fe0 con 0x7feb900c89f0 2023-12-18T10:23:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:49.486+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb900b15a0 con 0x7feb900c89f0 2023-12-18T10:23:50.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.162+0000 7feb8cff9640 1 -- 172.21.15.133:0/2413282008 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 169+0+0 (secure 0 0 0) 0x7feb80054600 con 0x7feb900c89f0 2023-12-18T10:23:50.163 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-18T10:23:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb7c065a60 msgr2=0x7feb7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb7c065a60 0x7feb7c067f20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7feb901510e0 tx=0x7feb84009040 comp rx=0 tx=0).stop 2023-12-18T10:23:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 msgr2=0x7feb90097a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb90097a60 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c7c0 tx=0x7feb8000cc80 comp rx=0 tx=0).stop 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 shutdown_connections 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb7c065a60 0x7feb7c067f20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb900ce6a0 0x7feb900add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb900ca200 0x7feb90158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 --2- 172.21.15.133:0/2413282008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb900c89f0 0x7feb90097a60 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 >> 172.21.15.133:0/2413282008 conn(0x7feb90069e70 msgr2=0x7feb90159170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 shutdown_connections 2023-12-18T10:23:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.166+0000 7feb964df640 1 -- 172.21.15.133:0/2413282008 wait complete. 2023-12-18T10:23:50.187 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-18T10:23:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.338+0000 7f9ee170a640 1 Processor -- start 2023-12-18T10:23:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.338+0000 7f9ee170a640 1 -- start start 2023-12-18T10:23:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9ee170a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9edc15c910 0x7f9edc161240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9ee170a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0cad80 con 0x7f9edc06afc0 2023-12-18T10:23:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9ee170a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0cb020 con 0x7f9edc0b2780 2023-12-18T10:23:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9ee170a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc0cf1d0 con 0x7f9edc15c910 2023-12-18T10:23:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9edaffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9edc15c910 0x7f9edc161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9edaffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9edc15c910 0x7f9edc161240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38914/0 (socket says 172.21.15.133:38914) 2023-12-18T10:23:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9ed27fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9edc06afc0 0x7f9edc0b2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33420/0 (socket says 172.21.15.133:33420) 2023-12-18T10:23:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9edaffd640 1 -- 172.21.15.133:0/841306646 learned_addr learned my addr 172.21.15.133:0/841306646 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9edaffd640 1 -- 172.21.15.133:0/841306646 >> v1:172.21.15.142:6789/0 conn(0x7f9edc0b2780 legacy=0x7f9edc0cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9edaffd640 1 -- 172.21.15.133:0/841306646 >> v1:172.21.15.133:6789/0 conn(0x7f9edc06afc0 legacy=0x7f9edc0b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9edaffd640 1 -- 172.21.15.133:0/841306646 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0ce930 con 0x7f9edc15c910 2023-12-18T10:23:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.342+0000 7f9eda7fc640 1 -- 172.21.15.133:0/841306646 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442846393 0 0) 0x7f9edc0cad80 con 0x7f9edc06afc0 2023-12-18T10:23:50.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9edaffd640 1 --2- 172.21.15.133:0/841306646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc15c910 0x7f9edc161240 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009860 tx=0x7f9ecc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8459d088b7ae7442 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:50.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9eda7fc640 1 -- 172.21.15.133:0/841306646 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0aa650 con 0x7f9edc15c910 2023-12-18T10:23:50.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9eda7fc640 1 -- 172.21.15.133:0/841306646 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0aa7b0 con 0x7f9edc15c910 2023-12-18T10:23:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9eda7fc640 1 -- 172.21.15.133:0/841306646 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0aab40 con 0x7f9edc15c910 2023-12-18T10:23:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 -- 172.21.15.133:0/841306646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc15c910 msgr2=0x7f9edc161240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 --2- 172.21.15.133:0/841306646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc15c910 0x7f9edc161240 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009860 tx=0x7f9ecc01c4f0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 -- 172.21.15.133:0/841306646 shutdown_connections 2023-12-18T10:23:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 --2- 172.21.15.133:0/841306646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc15c910 0x7f9edc161240 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 -- 172.21.15.133:0/841306646 >> 172.21.15.133:0/841306646 conn(0x7f9edc0cd070 msgr2=0x7f9edc0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 -- 172.21.15.133:0/841306646 shutdown_connections 2023-12-18T10:23:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 -- 172.21.15.133:0/841306646 wait complete. 2023-12-18T10:23:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 Processor -- start 2023-12-18T10:23:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.346+0000 7f9ee170a640 1 -- start start 2023-12-18T10:23:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc06afc0 0x7f9edc14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9edc0b2780 0x7f9edc150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9edc15c910 0x7f9edc157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc15c1e0 con 0x7f9edc06afc0 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc15bc60 con 0x7f9edc0b2780 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc1575b0 con 0x7f9edc15c910 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc06afc0 0x7f9edc14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc06afc0 0x7f9edc14f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38916/0 (socket says 172.21.15.133:38916) 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 -- 172.21.15.133:0/3205728324 learned_addr learned my addr 172.21.15.133:0/3205728324 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ed27fc640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9edc0b2780 0x7f9edc150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edb7fe640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9edc15c910 0x7f9edc157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 -- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9edc15c910 msgr2=0x7f9edc157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9edc15c910 0x7f9edc157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 -- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9edc0b2780 msgr2=0x7f9edc150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9edc0b2780 0x7f9edc150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 -- 172.21.15.133:0/3205728324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc009470 con 0x7f9edc06afc0 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edb7fe640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9edc15c910 0x7f9edc157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9edaffd640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc06afc0 0x7f9edc14f8b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0ac040 tx=0x7f9ecc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ed3fff640 1 -- 172.21.15.133:0/3205728324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc004030 con 0x7f9edc06afc0 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ed3fff640 1 -- 172.21.15.133:0/3205728324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0b7070 con 0x7f9edc06afc0 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc0b5eb0 con 0x7f9edc06afc0 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ed3fff640 1 -- 172.21.15.133:0/3205728324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0043b0 con 0x7f9edc06afc0 2023-12-18T10:23:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc157850 con 0x7f9edc06afc0 2023-12-18T10:23:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc157410 con 0x7f9edc06afc0 2023-12-18T10:23:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.350+0000 7f9ed3fff640 1 -- 172.21.15.133:0/3205728324 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ecc003620 con 0x7f9edc06afc0 2023-12-18T10:23:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.354+0000 7f9ed3fff640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9ebc065a60 0x7f9ebc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.354+0000 7f9ed3fff640 1 -- 172.21.15.133:0/3205728324 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f9ecc11d690 con 0x7f9edc06afc0 2023-12-18T10:23:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.354+0000 7f9ed27fc640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9ebc065a60 0x7f9ebc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.354+0000 7f9ed27fc640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9ebc065a60 0x7f9ebc067f20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0c4030 tx=0x7f9ec4007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:50.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.358+0000 7f9ed3fff640 1 -- 172.21.15.133:0/3205728324 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9edc157410 con 0x7f9edc06afc0 2023-12-18T10:23:50.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.506+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9edc157410 con 0x7f9edc06afc0 2023-12-18T10:23:50.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ed3fff640 1 -- 172.21.15.133:0/3205728324 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9edc157410 con 0x7f9edc06afc0 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9ebc065a60 msgr2=0x7f9ebc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9ebc065a60 0x7f9ebc067f20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0c4030 tx=0x7f9ec4007240 comp rx=0 tx=0).stop 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc06afc0 msgr2=0x7f9edc14f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc06afc0 0x7f9edc14f8b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0ac040 tx=0x7f9ecc01ad30 comp rx=0 tx=0).stop 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 shutdown_connections 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9ebc065a60 0x7f9ebc067f20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9edc15c910 0x7f9edc157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9edc0b2780 0x7f9edc150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 --2- 172.21.15.133:0/3205728324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9edc06afc0 0x7f9edc14f8b0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 >> 172.21.15.133:0/3205728324 conn(0x7f9edc0cd070 msgr2=0x7f9edc15dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 shutdown_connections 2023-12-18T10:23:50.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.514+0000 7f9ee170a640 1 -- 172.21.15.133:0/3205728324 wait complete. 2023-12-18T10:23:50.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2023-12-18T10:23:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.670+0000 7f50103f0640 1 Processor -- start 2023-12-18T10:23:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.670+0000 7f50103f0640 1 -- start start 2023-12-18T10:23:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f50103f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f500815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f50103f0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500815f100 con 0x7f500806fdb0 2023-12-18T10:23:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f50103f0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080ca7d0 con 0x7f500815a680 2023-12-18T10:23:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f50103f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500815e860 con 0x7f50080cac10 2023-12-18T10:23:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500d98b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f500815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500e98d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f500806fdb0 0x7f50080c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33430/0 (socket says 172.21.15.133:33430) 2023-12-18T10:23:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500e18c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f500815a680 0x7f500815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:42722/0 (socket says 172.21.15.133:42722) 2023-12-18T10:23:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500e98d640 1 -- 172.21.15.133:0/3360760860 learned_addr learned my addr 172.21.15.133:0/3360760860 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500d18a640 1 -- 172.21.15.133:0/3360760860 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305518736 0 0) 0x7f50080ca7d0 con 0x7f500815a680 2023-12-18T10:23:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500d18a640 1 -- 172.21.15.133:0/3360760860 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff4003530 con 0x7f500815a680 2023-12-18T10:23:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500d18a640 1 -- 172.21.15.133:0/3360760860 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738561266 0 0) 0x7f500815f100 con 0x7f500806fdb0 2023-12-18T10:23:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500d98b640 1 -- 172.21.15.133:0/3360760860 >> v1:172.21.15.142:6789/0 conn(0x7f500815a680 legacy=0x7f500815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500d98b640 1 -- 172.21.15.133:0/3360760860 >> v1:172.21.15.133:6789/0 conn(0x7f500806fdb0 legacy=0x7f50080c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.674+0000 7f500d98b640 1 -- 172.21.15.133:0/3360760860 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500815eb40 con 0x7f50080cac10 2023-12-18T10:23:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f500d98b640 1 --2- 172.21.15.133:0/3360760860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f500815e160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80097f0 tx=0x7f4ff801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc15c450c1de51 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f500d18a640 1 -- 172.21.15.133:0/3360760860 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80a7070 con 0x7f50080cac10 2023-12-18T10:23:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f500d18a640 1 -- 172.21.15.133:0/3360760860 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff80ab430 con 0x7f50080cac10 2023-12-18T10:23:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f500d18a640 1 -- 172.21.15.133:0/3360760860 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80ab7c0 con 0x7f50080cac10 2023-12-18T10:23:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- 172.21.15.133:0/3360760860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 msgr2=0x7f500815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 --2- 172.21.15.133:0/3360760860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f500815e160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80097f0 tx=0x7f4ff801c430 comp rx=0 tx=0).stop 2023-12-18T10:23:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- 172.21.15.133:0/3360760860 shutdown_connections 2023-12-18T10:23:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 --2- 172.21.15.133:0/3360760860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f500815e160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- 172.21.15.133:0/3360760860 >> 172.21.15.133:0/3360760860 conn(0x7f500806a3e0 msgr2=0x7f50080afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- 172.21.15.133:0/3360760860 shutdown_connections 2023-12-18T10:23:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- 172.21.15.133:0/3360760860 wait complete. 2023-12-18T10:23:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 Processor -- start 2023-12-18T10:23:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- start start 2023-12-18T10:23:50.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500806fdb0 0x7f5008157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f50081516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f500815a680 0x7f50081550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008157180 con 0x7f500815a680 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008157bc0 con 0x7f500806fdb0 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.678+0000 7f50103f0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5008151c30 con 0x7f50080cac10 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f500815a680 0x7f50081550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f500815a680 0x7f50081550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38918/0 (socket says 172.21.15.133:38918) 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 -- 172.21.15.133:0/373535436 learned_addr learned my addr 172.21.15.133:0/373535436 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500d98b640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f50081516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e18c640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500806fdb0 0x7f5008157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 -- 172.21.15.133:0/373535436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 msgr2=0x7f50081516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f50081516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 -- 172.21.15.133:0/373535436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500806fdb0 msgr2=0x7f5008157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500806fdb0 0x7f5008157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 -- 172.21.15.133:0/373535436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8009420 con 0x7f500815a680 2023-12-18T10:23:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f500e98d640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f500815a680 0x7f50081550f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f500000c780 tx=0x7f500000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f4ffeffd640 1 -- 172.21.15.133:0/373535436 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000ce90 con 0x7f500815a680 2023-12-18T10:23:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f4ffeffd640 1 -- 172.21.15.133:0/373535436 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500000a5e0 con 0x7f500815a680 2023-12-18T10:23:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f4ffeffd640 1 -- 172.21.15.133:0/373535436 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500000a970 con 0x7f500815a680 2023-12-18T10:23:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5008156570 con 0x7f500815a680 2023-12-18T10:23:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5008156b30 con 0x7f500815a680 2023-12-18T10:23:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50080735b0 con 0x7f500815a680 2023-12-18T10:23:50.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f4ffeffd640 1 -- 172.21.15.133:0/373535436 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f500000aad0 con 0x7f500815a680 2023-12-18T10:23:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f4ffeffd640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fec065a90 0x7f4fec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.682+0000 7f4ffeffd640 1 -- 172.21.15.133:0/373535436 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f5000082470 con 0x7f500815a680 2023-12-18T10:23:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.686+0000 7f500e18c640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fec065a90 0x7f4fec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:50.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.686+0000 7f500e18c640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fec065a90 0x7f4fec067f50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5004000f70 tx=0x7f5004007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:50.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.690+0000 7f4ffeffd640 1 -- 172.21.15.133:0/373535436 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f500004ff50 con 0x7f500815a680 2023-12-18T10:23:50.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:50.890+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) v1 -- 0x7f500804e000 con 0x7f500815a680 2023-12-18T10:23:51.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f4ffeffd640 1 -- 172.21.15.133:0/373535436 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v305) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5000053570 con 0x7f500815a680 2023-12-18T10:23:51.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fec065a90 msgr2=0x7f4fec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fec065a90 0x7f4fec067f50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5004000f70 tx=0x7f5004007d00 comp rx=0 tx=0).stop 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f500815a680 msgr2=0x7f50081550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f500815a680 0x7f50081550f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f500000c780 tx=0x7f500000cc40 comp rx=0 tx=0).stop 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 shutdown_connections 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4fec065a90 0x7f4fec067f50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f500815a680 0x7f50081550f0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f50080cac10 0x7f50081516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 --2- 172.21.15.133:0/373535436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f500806fdb0 0x7f5008157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 >> 172.21.15.133:0/373535436 conn(0x7f500806a3e0 msgr2=0x7f50080adde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 shutdown_connections 2023-12-18T10:23:51.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.162+0000 7f50103f0640 1 -- 172.21.15.133:0/373535436 wait complete. 2023-12-18T10:23:51.182 INFO:tasks.cephfs_test_runner:test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-12-18T10:23:51.182 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-12-18T10:23:51.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2023-12-18T10:23:51.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7ed2c640 1 Processor -- start 2023-12-18T10:23:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7ed2c640 1 -- start start 2023-12-18T10:23:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7ed2c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2f7815ca40 0x7f2f780cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7ed2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780ce3f0 0x7f2f780cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7ed2c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f780cf610 0x7f2f781605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7ed2c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f780cfa70 con 0x7f2f780cf610 2023-12-18T10:23:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7ed2c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f780d11c0 con 0x7f2f7815ca40 2023-12-18T10:23:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7ed2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f780d0310 con 0x7f2f780ce3f0 2023-12-18T10:23:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7d2c9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f780cf610 0x7f2f781605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7d2c9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f780cf610 0x7f2f781605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38920/0 (socket says 172.21.15.133:38920) 2023-12-18T10:23:51.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7d2c9640 1 -- 172.21.15.133:0/311264834 learned_addr learned my addr 172.21.15.133:0/311264834 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:51.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7cac8640 1 --2- 172.21.15.133:0/311264834 >> v2:172.21.15.142:3300/0 conn(0x7f2f7815ca40 0x7f2f780cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:51.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f6ffff640 1 --2- 172.21.15.133:0/311264834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780ce3f0 0x7f2f780cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:51.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7d2c9640 1 -- 172.21.15.133:0/311264834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780ce3f0 msgr2=0x7f2f780cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:51.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7d2c9640 1 --2- 172.21.15.133:0/311264834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780ce3f0 0x7f2f780cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7d2c9640 1 -- 172.21.15.133:0/311264834 >> v2:172.21.15.142:3300/0 conn(0x7f2f7815ca40 msgr2=0x7f2f780cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:23:51.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7d2c9640 1 --2- 172.21.15.133:0/311264834 >> v2:172.21.15.142:3300/0 conn(0x7f2f7815ca40 0x7f2f780cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.322+0000 7f2f7d2c9640 1 -- 172.21.15.133:0/311264834 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f780d05b0 con 0x7f2f780cf610 2023-12-18T10:23:51.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7d2c9640 1 --2- 172.21.15.133:0/311264834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780cf610 0x7f2f781605b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f2f780736e0 tx=0x7f2f7001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505f357bf3e542e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:51.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f6f7fe640 1 -- 172.21.15.133:0/311264834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700a5590 con 0x7f2f780cf610 2023-12-18T10:23:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f6f7fe640 1 -- 172.21.15.133:0/311264834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f700a56f0 con 0x7f2f780cf610 2023-12-18T10:23:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f6f7fe640 1 -- 172.21.15.133:0/311264834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700a5a80 con 0x7f2f780cf610 2023-12-18T10:23:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/311264834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780cf610 msgr2=0x7f2f781605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:51.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/311264834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780cf610 0x7f2f781605b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f2f780736e0 tx=0x7f2f7001c710 comp rx=0 tx=0).stop 2023-12-18T10:23:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/311264834 shutdown_connections 2023-12-18T10:23:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/311264834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780cf610 0x7f2f781605b0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/311264834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780ce3f0 0x7f2f780cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/311264834 >> v2:172.21.15.142:3300/0 conn(0x7f2f7815ca40 0x7f2f780cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/311264834 >> 172.21.15.133:0/311264834 conn(0x7f2f78089fb0 msgr2=0x7f2f780d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/311264834 shutdown_connections 2023-12-18T10:23:51.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.326+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/311264834 wait complete. 2023-12-18T10:23:51.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 Processor -- start 2023-12-18T10:23:51.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 -- start start 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780ce3f0 0x7f2f7814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780cf610 0x7f2f78158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f7815ca40 0x7f2f7814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7815f900 con 0x7f2f780ce3f0 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7815ed30 con 0x7f2f7815ca40 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7815ef60 con 0x7f2f780cf610 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780ce3f0 0x7f2f7814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780ce3f0 0x7f2f7814c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38922/0 (socket says 172.21.15.133:38922) 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 -- 172.21.15.133:0/2536114216 learned_addr learned my addr 172.21.15.133:0/2536114216 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:51.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7d2c9640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f7815ca40 0x7f2f7814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f6ffff640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780cf610 0x7f2f78158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 -- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780cf610 msgr2=0x7f2f78158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780cf610 0x7f2f78158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 -- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f7815ca40 msgr2=0x7f2f7814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f7815ca40 0x7f2f7814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 -- 172.21.15.133:0/2536114216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009b30 con 0x7f2f780ce3f0 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7d2c9640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f7815ca40 0x7f2f7814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f6ffff640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780cf610 0x7f2f78158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:51.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7cac8640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780ce3f0 0x7f2f7814c7c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400d800 tx=0x7f2f7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:51.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f6d7fa640 1 -- 172.21.15.133:0/2536114216 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74018070 con 0x7f2f780ce3f0 2023-12-18T10:23:51.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f6d7fa640 1 -- 172.21.15.133:0/2536114216 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f740059a0 con 0x7f2f780ce3f0 2023-12-18T10:23:51.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f6d7fa640 1 -- 172.21.15.133:0/2536114216 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74005b50 con 0x7f2f780ce3f0 2023-12-18T10:23:51.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7815f240 con 0x7f2f780ce3f0 2023-12-18T10:23:51.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.330+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7814cec0 con 0x7f2f780ce3f0 2023-12-18T10:23:51.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.334+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7815fb70 con 0x7f2f780ce3f0 2023-12-18T10:23:51.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.334+0000 7f2f6d7fa640 1 -- 172.21.15.133:0/2536114216 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2f74005cb0 con 0x7f2f780ce3f0 2023-12-18T10:23:51.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.334+0000 7f2f6d7fa640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f64065a60 0x7f2f64067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:51.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.334+0000 7f2f6d7fa640 1 -- 172.21.15.133:0/2536114216 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f2f74082fe0 con 0x7f2f780ce3f0 2023-12-18T10:23:51.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.334+0000 7f2f6ffff640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f64065a60 0x7f2f64067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:51.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.334+0000 7f2f6ffff640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f64065a60 0x7f2f64067f20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2f78156270 tx=0x7f2f68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.338+0000 7f2f6d7fa640 1 -- 172.21.15.133:0/2536114216 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2f74050a10 con 0x7f2f780ce3f0 2023-12-18T10:23:51.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:51.542+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) v1 -- 0x7f2f7804e000 con 0x7f2f780ce3f0 2023-12-18T10:23:52.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.162+0000 7f2f6d7fa640 1 -- 172.21.15.133:0/2536114216 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v306) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2f74054030 con 0x7f2f780ce3f0 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f64065a60 msgr2=0x7f2f64067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f64065a60 0x7f2f64067f20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2f78156270 tx=0x7f2f68008040 comp rx=0 tx=0).stop 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780ce3f0 msgr2=0x7f2f7814c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780ce3f0 0x7f2f7814c7c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400d800 tx=0x7f2f7400dcc0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 shutdown_connections 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f64065a60 0x7f2f64067f20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f7815ca40 0x7f2f7814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f780cf610 0x7f2f78158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 --2- 172.21.15.133:0/2536114216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f780ce3f0 0x7f2f7814c7c0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 >> 172.21.15.133:0/2536114216 conn(0x7f2f78089fb0 msgr2=0x7f2f780d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 shutdown_connections 2023-12-18T10:23:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.166+0000 7f2f7ed2c640 1 -- 172.21.15.133:0/2536114216 wait complete. 2023-12-18T10:23:52.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-18T10:23:52.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc4695640 1 Processor -- start 2023-12-18T10:23:52.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc4695640 1 -- start start 2023-12-18T10:23:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc4695640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4dbc0cf880 0x7f4dbc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc4695640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc15cec0 con 0x7f4dbc15cae0 2023-12-18T10:23:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc4695640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc0d0530 con 0x7f4dbc0cde90 2023-12-18T10:23:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc4695640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc0d0810 con 0x7f4dbc0cf880 2023-12-18T10:23:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc2431640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4dbc15cae0 0x7f4dbc0d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33442/0 (socket says 172.21.15.133:33442) 2023-12-18T10:23:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc2431640 1 -- 172.21.15.133:0/2536048422 learned_addr learned my addr 172.21.15.133:0/2536048422 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.326+0000 7f4dc2c32640 1 --2- 172.21.15.133:0/2536048422 >> v2:172.21.15.142:3300/0 conn(0x7f4dbc0cf880 0x7f4dbc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc142f640 1 -- 172.21.15.133:0/2536048422 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954683818 0 0) 0x7f4dbc15cec0 con 0x7f4dbc15cae0 2023-12-18T10:23:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc142f640 1 -- 172.21.15.133:0/2536048422 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da8003530 con 0x7f4dbc15cae0 2023-12-18T10:23:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc2c32640 1 -- 172.21.15.133:0/2536048422 >> v1:172.21.15.142:6789/0 conn(0x7f4dbc0cde90 legacy=0x7f4dbc0cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc2c32640 1 -- 172.21.15.133:0/2536048422 >> v1:172.21.15.133:6789/0 conn(0x7f4dbc15cae0 legacy=0x7f4dbc0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc142f640 1 -- 172.21.15.133:0/2536048422 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3325623278 0 0) 0x7f4da8003530 con 0x7f4dbc15cae0 2023-12-18T10:23:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc2c32640 1 -- 172.21.15.133:0/2536048422 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc0d0af0 con 0x7f4dbc0cf880 2023-12-18T10:23:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc2c32640 1 --2- 172.21.15.133:0/2536048422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 0x7f4dbc0ce2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009d90 tx=0x7f4db401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=634b84b258bd1f8c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc142f640 1 -- 172.21.15.133:0/2536048422 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40a5a00 con 0x7f4dbc0cf880 2023-12-18T10:23:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc142f640 1 -- 172.21.15.133:0/2536048422 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40a5b60 con 0x7f4dbc0cf880 2023-12-18T10:23:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.330+0000 7f4dc142f640 1 -- 172.21.15.133:0/2536048422 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40ad440 con 0x7f4dbc0cf880 2023-12-18T10:23:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- 172.21.15.133:0/2536048422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 msgr2=0x7f4dbc0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 --2- 172.21.15.133:0/2536048422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 0x7f4dbc0ce2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009d90 tx=0x7f4db401c920 comp rx=0 tx=0).stop 2023-12-18T10:23:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- 172.21.15.133:0/2536048422 shutdown_connections 2023-12-18T10:23:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 --2- 172.21.15.133:0/2536048422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 0x7f4dbc0ce2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- 172.21.15.133:0/2536048422 >> 172.21.15.133:0/2536048422 conn(0x7f4dbc089fb0 msgr2=0x7f4dbc0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- 172.21.15.133:0/2536048422 shutdown_connections 2023-12-18T10:23:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- 172.21.15.133:0/2536048422 wait complete. 2023-12-18T10:23:52.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 Processor -- start 2023-12-18T10:23:52.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- start start 2023-12-18T10:23:52.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dbc0cde90 0x7f4dbc0c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 0x7f4dbc0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc15cae0 0x7f4dbc15f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0cc840 con 0x7f4dbc0cde90 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc15d970 con 0x7f4dbc0cf880 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc4695640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc15e9a0 con 0x7f4dbc15cae0 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc2431640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dbc0cde90 0x7f4dbc0c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc2431640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dbc0cde90 0x7f4dbc0c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38926/0 (socket says 172.21.15.133:38926) 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc2431640 1 -- 172.21.15.133:0/1446192294 learned_addr learned my addr 172.21.15.133:0/1446192294 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc1c30640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 0x7f4dbc0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc2c32640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc15cae0 0x7f4dbc15f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.334+0000 7f4dc2431640 1 -- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc15cae0 msgr2=0x7f4dbc15f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc2431640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc15cae0 0x7f4dbc15f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc2431640 1 -- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 msgr2=0x7f4dbc0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc2431640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 0x7f4dbc0cc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc2431640 1 -- 172.21.15.133:0/1446192294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009a70 con 0x7f4dbc0cde90 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc2c32640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc15cae0 0x7f4dbc15f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:52.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc1c30640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 0x7f4dbc0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:23:52.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc2431640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dbc0cde90 0x7f4dbc0c8b10 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f4db800c3c0 tx=0x7f4db800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:52.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4db2ffd640 1 -- 172.21.15.133:0/1446192294 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80074e0 con 0x7f4dbc0cde90 2023-12-18T10:23:52.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4db2ffd640 1 -- 172.21.15.133:0/1446192294 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8007660 con 0x7f4dbc0cde90 2023-12-18T10:23:52.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4db2ffd640 1 -- 172.21.15.133:0/1446192294 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db80059d0 con 0x7f4dbc0cde90 2023-12-18T10:23:52.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc15dbe0 con 0x7f4dbc0cde90 2023-12-18T10:23:52.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc15e1a0 con 0x7f4dbc0cde90 2023-12-18T10:23:52.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc04e000 con 0x7f4dbc0cde90 2023-12-18T10:23:52.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4db2ffd640 1 -- 172.21.15.133:0/1446192294 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4db8005b30 con 0x7f4dbc0cde90 2023-12-18T10:23:52.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4db2ffd640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4da0065a90 0x7f4da0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4db2ffd640 1 -- 172.21.15.133:0/1446192294 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f4db80826c0 con 0x7f4dbc0cde90 2023-12-18T10:23:52.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.338+0000 7f4dc1c30640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4da0065a90 0x7f4da0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.342+0000 7f4dc1c30640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4da0065a90 0x7f4da0067f50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc1f8dd0 tx=0x7f4dac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:52.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.342+0000 7f4db2ffd640 1 -- 172.21.15.133:0/1446192294 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4db80500f0 con 0x7f4dbc0cde90 2023-12-18T10:23:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.494+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4dbc072890 con 0x7f4dbc0cde90 2023-12-18T10:23:52.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4db2ffd640 1 -- 172.21.15.133:0/1446192294 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4db8017020 con 0x7f4dbc0cde90 2023-12-18T10:23:52.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4da0065a90 msgr2=0x7f4da0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4da0065a90 0x7f4da0067f50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc1f8dd0 tx=0x7f4dac009040 comp rx=0 tx=0).stop 2023-12-18T10:23:52.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dbc0cde90 msgr2=0x7f4dbc0c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dbc0cde90 0x7f4dbc0c8b10 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f4db800c3c0 tx=0x7f4db800c880 comp rx=0 tx=0).stop 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 shutdown_connections 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4da0065a90 0x7f4da0067f50 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4dbc15cae0 0x7f4dbc15f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4dbc0cf880 0x7f4dbc0cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 --2- 172.21.15.133:0/1446192294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dbc0cde90 0x7f4dbc0c8b10 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 >> 172.21.15.133:0/1446192294 conn(0x7f4dbc089fb0 msgr2=0x7f4dbc157710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 shutdown_connections 2023-12-18T10:23:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.502+0000 7f4dc4695640 1 -- 172.21.15.133:0/1446192294 wait complete. 2023-12-18T10:23:52.521 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:23:52.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:23:52.594 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:23:52.639 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:23:52.640 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:23:52.640 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:52.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:23:52.649 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:23:52.649 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:52.689 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:23:52.689 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:23:52.689 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:52.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:23:52.700 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:23:52.700 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:23:52.740 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:23:52.741 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-18T10:23:52.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:23:52.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.878+0000 7f3c56ff0640 1 Processor -- start 2023-12-18T10:23:52.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c56ff0640 1 -- start start 2023-12-18T10:23:52.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c56ff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c500ca000 0x7f3c50164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c56ff0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c500c9460 con 0x7f3c501570c0 2023-12-18T10:23:52.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c56ff0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c501574a0 con 0x7f3c5006c4f0 2023-12-18T10:23:52.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c56ff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500c8b30 con 0x7f3c500ca000 2023-12-18T10:23:52.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c54d8c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3c501570c0 0x7f3c5006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33458/0 (socket says 172.21.15.133:33458) 2023-12-18T10:23:52.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c54d8c640 1 -- 172.21.15.133:0/1340708755 learned_addr learned my addr 172.21.15.133:0/1340708755 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:52.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c5558d640 1 --2- 172.21.15.133:0/1340708755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c500ca000 0x7f3c50164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c4f7fe640 1 -- 172.21.15.133:0/1340708755 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150072098 0 0) 0x7f3c500c9460 con 0x7f3c501570c0 2023-12-18T10:23:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c4f7fe640 1 -- 172.21.15.133:0/1340708755 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c40003530 con 0x7f3c501570c0 2023-12-18T10:23:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c4f7fe640 1 -- 172.21.15.133:0/1340708755 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520916495 0 0) 0x7f3c501574a0 con 0x7f3c5006c4f0 2023-12-18T10:23:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c4f7fe640 1 -- 172.21.15.133:0/1340708755 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c500c9460 con 0x7f3c5006c4f0 2023-12-18T10:23:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c5558d640 1 -- 172.21.15.133:0/1340708755 >> v1:172.21.15.142:6789/0 conn(0x7f3c5006c4f0 legacy=0x7f3c500c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c4f7fe640 1 -- 172.21.15.133:0/1340708755 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1195756040 0 0) 0x7f3c40003530 con 0x7f3c501570c0 2023-12-18T10:23:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c5558d640 1 -- 172.21.15.133:0/1340708755 >> v1:172.21.15.133:6789/0 conn(0x7f3c501570c0 legacy=0x7f3c5006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.882+0000 7f3c5558d640 1 -- 172.21.15.133:0/1340708755 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500c8e10 con 0x7f3c500ca000 2023-12-18T10:23:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c5558d640 1 --2- 172.21.15.133:0/1340708755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c500ca000 0x7f3c50164230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009dc0 tx=0x7f3c4801c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd6ce5921af7f8c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c4f7fe640 1 -- 172.21.15.133:0/1340708755 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44001680 con 0x7f3c500ca000 2023-12-18T10:23:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c4f7fe640 1 -- 172.21.15.133:0/1340708755 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c480a55d0 con 0x7f3c500ca000 2023-12-18T10:23:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c4f7fe640 1 -- 172.21.15.133:0/1340708755 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480a5940 con 0x7f3c500ca000 2023-12-18T10:23:52.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c56ff0640 1 -- 172.21.15.133:0/1340708755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c500ca000 msgr2=0x7f3c50164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c56ff0640 1 --2- 172.21.15.133:0/1340708755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c500ca000 0x7f3c50164230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009dc0 tx=0x7f3c4801c7d0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c56ff0640 1 -- 172.21.15.133:0/1340708755 shutdown_connections 2023-12-18T10:23:52.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c56ff0640 1 --2- 172.21.15.133:0/1340708755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c500ca000 0x7f3c50164230 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c56ff0640 1 -- 172.21.15.133:0/1340708755 >> 172.21.15.133:0/1340708755 conn(0x7f3c5006a3e0 msgr2=0x7f3c500afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:52.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c56ff0640 1 -- 172.21.15.133:0/1340708755 shutdown_connections 2023-12-18T10:23:52.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.886+0000 7f3c56ff0640 1 -- 172.21.15.133:0/1340708755 wait complete. 2023-12-18T10:23:52.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 Processor -- start 2023-12-18T10:23:52.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 -- start start 2023-12-18T10:23:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5006c4f0 0x7f3c501595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c500ca000 0x7f3c5014f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c501570c0 0x7f3c50150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c50159b30 con 0x7f3c501570c0 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5014fdd0 con 0x7f3c500ca000 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5014eb60 con 0x7f3c5006c4f0 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c501570c0 0x7f3c50150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c501570c0 0x7f3c50150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38942/0 (socket says 172.21.15.133:38942) 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 -- 172.21.15.133:0/2080069161 learned_addr learned my addr 172.21.15.133:0/2080069161 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c54d8c640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5006c4f0 0x7f3c501595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c4ffff640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c500ca000 0x7f3c5014f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 -- 172.21.15.133:0/2080069161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5006c4f0 msgr2=0x7f3c501595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5006c4f0 0x7f3c501595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 -- 172.21.15.133:0/2080069161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c500ca000 msgr2=0x7f3c5014f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c500ca000 0x7f3c5014f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 -- 172.21.15.133:0/2080069161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009a70 con 0x7f3c501570c0 2023-12-18T10:23:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c5558d640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c501570c0 0x7f3c50150f00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f3c4801ccb0 tx=0x7f3c48019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c4d7fa640 1 -- 172.21.15.133:0/2080069161 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48009450 con 0x7f3c501570c0 2023-12-18T10:23:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c4d7fa640 1 -- 172.21.15.133:0/2080069161 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c480a5950 con 0x7f3c501570c0 2023-12-18T10:23:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c4d7fa640 1 -- 172.21.15.133:0/2080069161 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480a5ce0 con 0x7f3c501570c0 2023-12-18T10:23:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c50150020 con 0x7f3c501570c0 2023-12-18T10:23:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5014edb0 con 0x7f3c501570c0 2023-12-18T10:23:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.890+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c500735b0 con 0x7f3c501570c0 2023-12-18T10:23:52.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.894+0000 7f3c4d7fa640 1 -- 172.21.15.133:0/2080069161 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c48004040 con 0x7f3c501570c0 2023-12-18T10:23:52.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.894+0000 7f3c4d7fa640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c34065a60 0x7f3c34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:52.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.894+0000 7f3c4d7fa640 1 -- 172.21.15.133:0/2080069161 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f3c4811e070 con 0x7f3c501570c0 2023-12-18T10:23:52.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.894+0000 7f3c54d8c640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c34065a60 0x7f3c34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:52.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.894+0000 7f3c54d8c640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c34065a60 0x7f3c34067f20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000fe0 tx=0x7f3c44001cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:52.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:52.898+0000 7f3c4d7fa640 1 -- 172.21.15.133:0/2080069161 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3c480ef6f0 con 0x7f3c501570c0 2023-12-18T10:23:53.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.078+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c5004e000 con 0x7f3c501570c0 2023-12-18T10:23:53.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.078+0000 7f3c4d7fa640 1 -- 172.21.15.133:0/2080069161 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f3c480b2df0 con 0x7f3c501570c0 2023-12-18T10:23:53.080 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:23:53.080 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2708981377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2708981377},{"type":"v1","addr":"172.21.15.142:6835","nonce":2708981377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7537,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/1054834295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1054834295},{"type":"v1","addr":"172.21.15.142:6834","nonce":1054834295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":8043,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3319812204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3319812204},{"type":"v1","addr":"172.21.15.133:6835","nonce":3319812204}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":8052,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2024850807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2024850807},{"type":"v1","addr":"172.21.15.133:6837","nonce":2024850807}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[]} 2023-12-18T10:23:53.080 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 77 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c34065a60 msgr2=0x7f3c34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c34065a60 0x7f3c34067f20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000fe0 tx=0x7f3c44001cc0 comp rx=0 tx=0).stop 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c501570c0 msgr2=0x7f3c50150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c501570c0 0x7f3c50150f00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f3c4801ccb0 tx=0x7f3c48019570 comp rx=0 tx=0).stop 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 shutdown_connections 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c34065a60 0x7f3c34067f20 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c501570c0 0x7f3c50150f00 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c500ca000 0x7f3c5014f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 --2- 172.21.15.133:0/2080069161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3c5006c4f0 0x7f3c501595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 >> 172.21.15.133:0/2080069161 conn(0x7f3c5006a3e0 msgr2=0x7f3c500c1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 shutdown_connections 2023-12-18T10:23:53.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:53.082+0000 7f3c56ff0640 1 -- 172.21.15.133:0/2080069161 wait complete. 2023-12-18T10:23:53.101 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-18T10:23:53.101 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-18T10:23:53.101 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-18T10:23:53.101 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:23:53.102 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-18T10:23:53.102 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-18T10:23:53.102 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-18T10:23:53.102 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:23:53.102 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-18T10:23:53.102 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-18T10:23:53.102 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-18T10:23:53.103 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:23:53.103 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-18T10:23:53.103 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-18T10:23:53.103 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-18T10:23:53.103 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:23:53.115 INFO:tasks.ceph.mds.c:Stopped 2023-12-18T10:23:53.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-18T10:23:53.122 INFO:tasks.ceph.mds.b:Stopped 2023-12-18T10:23:53.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-18T10:23:53.123 INFO:tasks.ceph.mds.d:Stopped 2023-12-18T10:23:53.123 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-18T10:23:53.163 INFO:tasks.ceph.mds.c:Started 2023-12-18T10:23:53.163 DEBUG:teuthology.parallel:result is None 2023-12-18T10:23:53.167 INFO:tasks.ceph.mds.b:Started 2023-12-18T10:23:53.167 DEBUG:teuthology.parallel:result is None 2023-12-18T10:23:53.169 INFO:tasks.ceph.mds.d:Started 2023-12-18T10:23:53.169 DEBUG:teuthology.parallel:result is None 2023-12-18T10:23:53.247 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:23:53.263 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:23:53.263 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:23:54.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-18T10:23:58.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:23:58.854 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:23:59.115 INFO:tasks.ceph.mds.a:Stopped 2023-12-18T10:23:59.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-18T10:23:59.119 INFO:tasks.ceph.mds.a:Started 2023-12-18T10:23:59.120 DEBUG:teuthology.parallel:result is None 2023-12-18T10:23:59.120 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-18T10:23:59.214 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:23:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe68d796640 1 Processor -- start 2023-12-18T10:23:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe68d796640 1 -- start start 2023-12-18T10:23:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe68d796640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe6880cb180 0x7fe688070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe68d796640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe688070b80 con 0x7fe688158c20 2023-12-18T10:23:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe68d796640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe688070e60 con 0x7fe68815c800 2023-12-18T10:23:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe68d796640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe688071140 con 0x7fe6880cb180 2023-12-18T10:23:59.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe686ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe688158c20 0x7fe6880caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33480/0 (socket says 172.21.15.133:33480) 2023-12-18T10:23:59.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe686ffd640 1 -- 172.21.15.133:0/70347378 learned_addr learned my addr 172.21.15.133:0/70347378 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:23:59.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe6867fc640 1 --2- 172.21.15.133:0/70347378 >> v2:172.21.15.142:3300/0 conn(0x7fe6880cb180 0x7fe688070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:59.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.274+0000 7fe685ffb640 1 -- 172.21.15.133:0/70347378 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616613560 0 0) 0x7fe688070b80 con 0x7fe688158c20 2023-12-18T10:23:59.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe685ffb640 1 -- 172.21.15.133:0/70347378 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe670003530 con 0x7fe688158c20 2023-12-18T10:23:59.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe6867fc640 1 -- 172.21.15.133:0/70347378 >> v1:172.21.15.142:6789/0 conn(0x7fe68815c800 legacy=0x7fe6880ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:59.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe685ffb640 1 -- 172.21.15.133:0/70347378 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160115565 0 0) 0x7fe688070e60 con 0x7fe68815c800 2023-12-18T10:23:59.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe6867fc640 1 -- 172.21.15.133:0/70347378 >> v1:172.21.15.133:6789/0 conn(0x7fe688158c20 legacy=0x7fe6880caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:59.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe6867fc640 1 -- 172.21.15.133:0/70347378 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688071420 con 0x7fe6880cb180 2023-12-18T10:23:59.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe6867fc640 1 --2- 172.21.15.133:0/70347378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6880cb180 0x7fe688070510 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0097c0 tx=0x7fe67c01ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a86b3c1d8ecfb69 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:59.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe685ffb640 1 -- 172.21.15.133:0/70347378 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0ad660 con 0x7fe6880cb180 2023-12-18T10:23:59.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe685ffb640 1 -- 172.21.15.133:0/70347378 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c0ad7c0 con 0x7fe6880cb180 2023-12-18T10:23:59.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe685ffb640 1 -- 172.21.15.133:0/70347378 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0adb50 con 0x7fe6880cb180 2023-12-18T10:23:59.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.278+0000 7fe68d796640 1 -- 172.21.15.133:0/70347378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6880cb180 msgr2=0x7fe688070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:59.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 --2- 172.21.15.133:0/70347378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6880cb180 0x7fe688070510 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0097c0 tx=0x7fe67c01ce20 comp rx=0 tx=0).stop 2023-12-18T10:23:59.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 -- 172.21.15.133:0/70347378 shutdown_connections 2023-12-18T10:23:59.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 --2- 172.21.15.133:0/70347378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6880cb180 0x7fe688070510 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:59.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 -- 172.21.15.133:0/70347378 >> 172.21.15.133:0/70347378 conn(0x7fe68806a3e0 msgr2=0x7fe6880afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:23:59.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 -- 172.21.15.133:0/70347378 shutdown_connections 2023-12-18T10:23:59.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 -- 172.21.15.133:0/70347378 wait complete. 2023-12-18T10:23:59.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 Processor -- start 2023-12-18T10:23:59.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 -- start start 2023-12-18T10:23:59.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6880cb180 0x7fe68814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe688158c20 0x7fe6880c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe68815c800 0x7fe6880aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880c5560 con 0x7fe6880cb180 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880c5840 con 0x7fe688158c20 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe68d796640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880c5b20 con 0x7fe68815c800 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe686ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6880cb180 0x7fe68814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe6867fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe688158c20 0x7fe6880c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe6867fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe688158c20 0x7fe6880c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:43730/0 (socket says 172.21.15.133:43730) 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe6867fc640 1 -- 172.21.15.133:0/3523572449 learned_addr learned my addr 172.21.15.133:0/3523572449 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.282+0000 7fe6877fe640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe68815c800 0x7fe6880aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe6867fc640 1 -- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe68815c800 msgr2=0x7fe6880aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:59.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe6867fc640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe68815c800 0x7fe6880aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe6867fc640 1 -- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6880cb180 msgr2=0x7fe68814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe6867fc640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6880cb180 0x7fe68814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe6867fc640 1 -- 172.21.15.133:0/3523572449 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c009420 con 0x7fe688158c20 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe6877fe640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe68815c800 0x7fe6880aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe686ffd640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6880cb180 0x7fe68814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe6867fc640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe688158c20 0x7fe6880c7dc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe67c019ff0 tx=0x7fe67c019160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe66f7fe640 1 -- 172.21.15.133:0/3523572449 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0b6610 con 0x7fe688158c20 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe66f7fe640 1 -- 172.21.15.133:0/3523572449 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c0b6770 con 0x7fe688158c20 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe66f7fe640 1 -- 172.21.15.133:0/3523572449 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0b6ae0 con 0x7fe688158c20 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6880c8800 con 0x7fe688158c20 2023-12-18T10:23:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6880b22b0 con 0x7fe688158c20 2023-12-18T10:23:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6880735b0 con 0x7fe688158c20 2023-12-18T10:23:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe66f7fe640 1 -- 172.21.15.133:0/3523572449 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe67c0b4040 con 0x7fe688158c20 2023-12-18T10:23:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe66f7fe640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe674065a60 0x7fe674067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:23:59.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.286+0000 7fe66f7fe640 1 -- 172.21.15.133:0/3523572449 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe67c11d360 con 0x7fe688158c20 2023-12-18T10:23:59.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.290+0000 7fe686ffd640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe674065a60 0x7fe674067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:23:59.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.290+0000 7fe686ffd640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe674065a60 0x7fe674067f20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe678005890 tx=0x7fe678009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:23:59.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.290+0000 7fe66f7fe640 1 -- 172.21.15.133:0/3523572449 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe67c0eaed0 con 0x7fe688158c20 2023-12-18T10:23:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:23:59.458+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe68804e000 con 0x7fe688158c20 2023-12-18T10:24:00.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe66f7fe640 1 -- 172.21.15.133:0/3523572449 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe67c0ee4f0 con 0x7fe688158c20 2023-12-18T10:24:00.248 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-18T10:24:00.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe674065a60 msgr2=0x7fe674067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe674065a60 0x7fe674067f20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe678005890 tx=0x7fe678009040 comp rx=0 tx=0).stop 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe688158c20 msgr2=0x7fe6880c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe688158c20 0x7fe6880c7dc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe67c019ff0 tx=0x7fe67c019160 comp rx=0 tx=0).stop 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 shutdown_connections 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe674065a60 0x7fe674067f20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe68815c800 0x7fe6880aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe688158c20 0x7fe6880c7dc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 --2- 172.21.15.133:0/3523572449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6880cb180 0x7fe68814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 >> 172.21.15.133:0/3523572449 conn(0x7fe68806a3e0 msgr2=0x7fe688154740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 shutdown_connections 2023-12-18T10:24:00.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.250+0000 7fe68d796640 1 -- 172.21.15.133:0/3523572449 wait complete. 2023-12-18T10:24:00.273 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-18T10:24:00.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.414+0000 7f23e8ef0640 1 Processor -- start 2023-12-18T10:24:00.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.414+0000 7f23e8ef0640 1 -- start start 2023-12-18T10:24:00.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e8ef0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23e415c730 0x7f23e40b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e8ef0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23e40cea00 0x7f23e40cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e8ef0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 0x7f23e40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e8ef0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e415cb10 con 0x7f23e415c730 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e8ef0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e40b84c0 con 0x7f23e40cea00 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e8ef0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40cd960 con 0x7f23e40cd3a0 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23e415c730 0x7f23e40b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23e415c730 0x7f23e40b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33144/0 (socket says 172.21.15.133:33144) 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 -- 172.21.15.133:0/1341551860 learned_addr learned my addr 172.21.15.133:0/1341551860 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e3fff640 1 --2- 172.21.15.133:0/1341551860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 0x7f23e40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e2ffd640 1 --2- 172.21.15.133:0/1341551860 >> v2:172.21.15.142:3300/0 conn(0x7f23e40cea00 0x7f23e40cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 -- 172.21.15.133:0/1341551860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 msgr2=0x7f23e40cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 --2- 172.21.15.133:0/1341551860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 0x7f23e40cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 -- 172.21.15.133:0/1341551860 >> v2:172.21.15.142:3300/0 conn(0x7f23e40cea00 msgr2=0x7f23e40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 --2- 172.21.15.133:0/1341551860 >> v2:172.21.15.142:3300/0 conn(0x7f23e40cea00 0x7f23e40cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 -- 172.21.15.133:0/1341551860 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e40cdc40 con 0x7f23e415c730 2023-12-18T10:24:00.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e37fe640 1 --2- 172.21.15.133:0/1341551860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e40b7f80 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f23e40d29c0 tx=0x7f23d401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951c440790fde529 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:00.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e27fc640 1 -- 172.21.15.133:0/1341551860 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40a89b0 con 0x7f23e415c730 2023-12-18T10:24:00.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.418+0000 7f23e27fc640 1 -- 172.21.15.133:0/1341551860 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d40a8b10 con 0x7f23e415c730 2023-12-18T10:24:00.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e27fc640 1 -- 172.21.15.133:0/1341551860 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40a8ea0 con 0x7f23e415c730 2023-12-18T10:24:00.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- 172.21.15.133:0/1341551860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 msgr2=0x7f23e40b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/1341551860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e40b7f80 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f23e40d29c0 tx=0x7f23d401ecf0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- 172.21.15.133:0/1341551860 shutdown_connections 2023-12-18T10:24:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/1341551860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 0x7f23e40cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/1341551860 >> v2:172.21.15.142:3300/0 conn(0x7f23e40cea00 0x7f23e40cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/1341551860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e40b7f80 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- 172.21.15.133:0/1341551860 >> 172.21.15.133:0/1341551860 conn(0x7f23e406b120 msgr2=0x7f23e406b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- 172.21.15.133:0/1341551860 shutdown_connections 2023-12-18T10:24:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- 172.21.15.133:0/1341551860 wait complete. 2023-12-18T10:24:00.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 Processor -- start 2023-12-18T10:24:00.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- start start 2023-12-18T10:24:00.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 0x7f23e414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40cea00 0x7f23e414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e41495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e415e700 con 0x7f23e415c730 2023-12-18T10:24:00.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e414cc30 con 0x7f23e40cea00 2023-12-18T10:24:00.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e8ef0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e414ad90 con 0x7f23e40cd3a0 2023-12-18T10:24:00.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e41495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e37fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 0x7f23e414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e41495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33152/0 (socket says 172.21.15.133:33152) 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e3fff640 1 -- 172.21.15.133:0/225459081 learned_addr learned my addr 172.21.15.133:0/225459081 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.422+0000 7f23e2ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40cea00 0x7f23e414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e3fff640 1 -- 172.21.15.133:0/225459081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 msgr2=0x7f23e414a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e3fff640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 0x7f23e414a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e3fff640 1 -- 172.21.15.133:0/225459081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40cea00 msgr2=0x7f23e414f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e3fff640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40cea00 0x7f23e414f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e3fff640 1 -- 172.21.15.133:0/225459081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d40094d0 con 0x7f23e415c730 2023-12-18T10:24:00.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e3fff640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e41495c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f23dc007d50 tx=0x7f23dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:00.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23cbfff640 1 -- 172.21.15.133:0/225459081 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc014420 con 0x7f23e415c730 2023-12-18T10:24:00.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23cbfff640 1 -- 172.21.15.133:0/225459081 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc0145a0 con 0x7f23e415c730 2023-12-18T10:24:00.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e415ddd0 con 0x7f23e415c730 2023-12-18T10:24:00.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23cbfff640 1 -- 172.21.15.133:0/225459081 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc014950 con 0x7f23e415c730 2023-12-18T10:24:00.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e415e390 con 0x7f23e415c730 2023-12-18T10:24:00.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e415e8b0 con 0x7f23e415c730 2023-12-18T10:24:00.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23cbfff640 1 -- 172.21.15.133:0/225459081 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f23dc014ab0 con 0x7f23e415c730 2023-12-18T10:24:00.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23cbfff640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f23d0065a60 0x7f23d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23cbfff640 1 -- 172.21.15.133:0/225459081 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f23dc083710 con 0x7f23e415c730 2023-12-18T10:24:00.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.426+0000 7f23e37fe640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f23d0065a60 0x7f23d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.430+0000 7f23e37fe640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f23d0065a60 0x7f23d0067f20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f23d40b2000 tx=0x7f23d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:00.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.430+0000 7f23cbfff640 1 -- 172.21.15.133:0/225459081 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f23e415e8b0 con 0x7f23e415c730 2023-12-18T10:24:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.630+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f23e415e8b0 con 0x7f23e415c730 2023-12-18T10:24:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23cbfff640 1 -- 172.21.15.133:0/225459081 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f23e415e8b0 con 0x7f23e415c730 2023-12-18T10:24:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:00.632 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-18T10:24:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-18T10:24:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlq/3QHRAAeGrWPAL1IMuRSsb9HM8t0Q==", 2023-12-18T10:24:00.632 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBleUoUKhAA7KQ881Hp59b6BfYF5Mc8Rw==", 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:24:00.633 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlsRoJJRAAYgbCztPYO/qzR7wJgYhPqQ==", 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.634 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlr0paMRAAUlbr607Vw8Yc0/S1EvLUUA==", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAgHIBlbTjYDhAA2KUnOrWIaGtzxXx9T64djw==", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.635 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjHIBlr8a1FhAAGRT54akJvp65F8xxu9Mw1g==", 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAmHIBlv+HSHBAAxDHSTox1AtpTMfCNbatjzA==", 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:24:00.636 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApHIBlj5xPIxAAkZglsOO2rg+8kXVIb+JK+w==", 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAvHIBlhQRmKxAAahzzO4gYz5LHWhvFvZlOAA==", 2023-12-18T10:24:00.637 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyHIBlatiUMhAAk0X1zO+dYOu5hMZvGBJNkQ==", 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.638 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1HIBl86v0OBAA70FwnvAugWtLupto+cbBjg==", 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA5HIBlZAYVBBAAa0V4jDTdYV8TBoNR7SenjQ==", 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlugNkNRAADsDapfYnOr+gcvgQ4394aA==", 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.640 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlM7J1AxAAgoKo5xm3Wz4xWjPX4Mpn0A==", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlrzVcOxAAwwd6eFzNGehg/4chJq1qJA==", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:24:00.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlRgxmCRAAN/aEmPSonvc17SvLB1GdXQ==", 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-18T10:24:00.642 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAbHIBlJHzPORAAQupFGwV6/izxeyNlnyeMSA==", 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlDP4UFhAA8KB7vRFpeBSRad2GRiKh/A==", 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.643 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBl+lIiEhAAx9zNJbwPBf7oGsFzDJKxEw==", 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-18T10:24:00.644 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f23d0065a60 msgr2=0x7f23d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f23d0065a60 0x7f23d0067f20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f23d40b2000 tx=0x7f23d4009040 comp rx=0 tx=0).stop 2023-12-18T10:24:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 msgr2=0x7f23e41495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e41495c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f23dc007d50 tx=0x7f23dc00e4b0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 shutdown_connections 2023-12-18T10:24:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f23d0065a60 0x7f23d0067f20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e415c730 0x7f23e41495c0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e40cea00 0x7f23e414f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 --2- 172.21.15.133:0/225459081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e40cd3a0 0x7f23e414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 >> 172.21.15.133:0/225459081 conn(0x7f23e406b120 msgr2=0x7f23e406b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 shutdown_connections 2023-12-18T10:24:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.634+0000 7f23e8ef0640 1 -- 172.21.15.133:0/225459081 wait complete. 2023-12-18T10:24:00.653 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:24:00.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.790+0000 7f8c3082d640 1 Processor -- start 2023-12-18T10:24:00.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.790+0000 7f8c3082d640 1 -- start start 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.790+0000 7f8c3082d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 0x7f8c2c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.790+0000 7f8c3082d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c15f100 con 0x7f8c2c06fdb0 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.790+0000 7f8c3082d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0ca7d0 con 0x7f8c2c0cac10 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.790+0000 7f8c3082d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c15e860 con 0x7f8c2c15a680 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2ad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8c2c06fdb0 0x7f8c2c0c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58810/0 (socket says 172.21.15.133:58810) 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2ad9d640 1 -- 172.21.15.133:0/573969351 learned_addr learned my addr 172.21.15.133:0/573969351 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2a59c640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 0x7f8c2c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152540554 0 0) 0x7f8c2c15f100 con 0x7f8c2c06fdb0 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c18003530 con 0x7f8c2c06fdb0 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219019060 0 0) 0x7f8c2c0ca7d0 con 0x7f8c2c0cac10 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c15f100 con 0x7f8c2c0cac10 2023-12-18T10:24:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 183956482 0 0) 0x7f8c18003530 con 0x7f8c2c06fdb0 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 msgr2=0x7f8c2c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 0x7f8c2c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 >> v1:172.21.15.142:6789/0 conn(0x7f8c2c0cac10 legacy=0x7f8c2c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c15eb40 con 0x7f8c2c06fdb0 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f8c24001680 con 0x7f8c2c06fdb0 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 >> v1:172.21.15.133:6789/0 conn(0x7f8c2c06fdb0 legacy=0x7f8c2c0c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c18003b40 0x7f8c18003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 0x7f8c180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c15e860 con 0x7f8c18004d10 2023-12-18T10:24:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1800ba90 con 0x7f8c18003b40 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1800bc50 con 0x7f8c2c15a680 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2ad9d640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2a59c640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c18003b40 0x7f8c18003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c21d9b640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 0x7f8c180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2ad9d640 1 -- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 msgr2=0x7f8c180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2ad9d640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 0x7f8c180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2ad9d640 1 -- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c18003b40 msgr2=0x7f8c18003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2ad9d640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c18003b40 0x7f8c18003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c2ad9d640 1 -- 172.21.15.133:0/573969351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18003530 con 0x7f8c18004d10 2023-12-18T10:24:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.794+0000 7f8c21d9b640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c15a680 0x7f8c180047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:00.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c2ad9d640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c18005190 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c160 tx=0x7f8c2401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93492f1a86448fc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:00.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240058e0 con 0x7f8c18004d10 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c24005a60 con 0x7f8c18004d10 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c29d9b640 1 -- 172.21.15.133:0/573969351 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24005e10 con 0x7f8c18004d10 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c3082d640 1 -- 172.21.15.133:0/573969351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 msgr2=0x7f8c18005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c3082d640 1 --2- 172.21.15.133:0/573969351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c18005190 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c160 tx=0x7f8c2401cba0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c2ad9d640 1 -- 172.21.15.133:0/573969351 reap_dead start 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c3082d640 1 -- 172.21.15.133:0/573969351 shutdown_connections 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c3082d640 1 -- 172.21.15.133:0/573969351 >> 172.21.15.133:0/573969351 conn(0x7f8c2c06a3e0 msgr2=0x7f8c2c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c3082d640 1 -- 172.21.15.133:0/573969351 shutdown_connections 2023-12-18T10:24:00.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c3082d640 1 -- 172.21.15.133:0/573969351 wait complete. 2023-12-18T10:24:00.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c3082d640 1 Processor -- start 2023-12-18T10:24:00.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.798+0000 7f8c3082d640 1 -- start start 2023-12-18T10:24:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c2c1f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c1506e0 0x7f8c2c0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c2c150b60 0x7f8c2c0abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c6f90 con 0x7f8c18004d10 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c60f0 con 0x7f8c2c150b60 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c6940 con 0x7f8c2c1506e0 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c2c1f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c2c1f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33182/0 (socket says 172.21.15.133:33182) 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 -- 172.21.15.133:0/3895437864 learned_addr learned my addr 172.21.15.133:0/3895437864 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c21d9b640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c1506e0 0x7f8c2c0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2ad9d640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c2c150b60 0x7f8c2c0abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 -- 172.21.15.133:0/3895437864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c1506e0 msgr2=0x7f8c2c0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c1506e0 0x7f8c2c0ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 -- 172.21.15.133:0/3895437864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c2c150b60 msgr2=0x7f8c2c0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c2c150b60 0x7f8c2c0abde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 -- 172.21.15.133:0/3895437864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0c6c20 con 0x7f8c18004d10 2023-12-18T10:24:00.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c2a59c640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c2c1f2130 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009f90 tx=0x7f8c1c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:00.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c237fe640 1 -- 172.21.15.133:0/3895437864 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00e040 con 0x7f8c18004d10 2023-12-18T10:24:00.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c237fe640 1 -- 172.21.15.133:0/3895437864 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00f040 con 0x7f8c18004d10 2023-12-18T10:24:00.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c0c63d0 con 0x7f8c18004d10 2023-12-18T10:24:00.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c237fe640 1 -- 172.21.15.133:0/3895437864 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c015870 con 0x7f8c18004d10 2023-12-18T10:24:00.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0c5600 con 0x7f8c18004d10 2023-12-18T10:24:00.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c0735b0 con 0x7f8c18004d10 2023-12-18T10:24:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.802+0000 7f8c237fe640 1 -- 172.21.15.133:0/3895437864 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8c1c0159d0 con 0x7f8c18004d10 2023-12-18T10:24:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.806+0000 7f8c237fe640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c0c065a60 0x7f8c0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.806+0000 7f8c237fe640 1 -- 172.21.15.133:0/3895437864 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8c1c083be0 con 0x7f8c18004d10 2023-12-18T10:24:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.806+0000 7f8c21d9b640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c0c065a60 0x7f8c0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.806+0000 7f8c21d9b640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c0c065a60 0x7f8c0c067f20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0c2cf0 tx=0x7f8c14007200 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:00.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.810+0000 7f8c237fe640 1 -- 172.21.15.133:0/3895437864 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8c1c051850 con 0x7f8c18004d10 2023-12-18T10:24:00.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-18T10:24:00.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.958+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c2c04e000 con 0x7f8c18004d10 2023-12-18T10:24:00.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c237fe640 1 -- 172.21.15.133:0/3895437864 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+12643 (secure 0 0 0) 0x7f8c1c00fea0 con 0x7f8c18004d10 2023-12-18T10:24:00.961 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:00.961 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":87,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:24:00.240386+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:24:00.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c0c065a60 msgr2=0x7f8c0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c0c065a60 0x7f8c0c067f20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0c2cf0 tx=0x7f8c14007200 comp rx=0 tx=0).stop 2023-12-18T10:24:00.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 msgr2=0x7f8c2c1f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c2c1f2130 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009f90 tx=0x7f8c1c00f580 comp rx=0 tx=0).stop 2023-12-18T10:24:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 shutdown_connections 2023-12-18T10:24:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8c0c065a60 0x7f8c0c067f20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c2c150b60 0x7f8c2c0abde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8c2c1506e0 0x7f8c2c0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 --2- 172.21.15.133:0/3895437864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c18004d10 0x7f8c2c1f2130 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 >> 172.21.15.133:0/3895437864 conn(0x7f8c2c06a3e0 msgr2=0x7f8c2c15b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:00.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 shutdown_connections 2023-12-18T10:24:00.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:00.962+0000 7f8c3082d640 1 -- 172.21.15.133:0/3895437864 wait complete. 2023-12-18T10:24:00.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:24:00.982 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:24:01.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226c760640 1 Processor -- start 2023-12-18T10:24:01.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226c760640 1 -- start start 2023-12-18T10:24:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226c760640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f22641582d0 0x7f22640c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226c760640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2264070820 0x7f22640ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226c760640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 0x7f22640ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226c760640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22640ced80 con 0x7f2264070820 2023-12-18T10:24:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226c760640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22640c9390 con 0x7f22641582d0 2023-12-18T10:24:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226c760640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226415aee0 con 0x7f22640ce3b0 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f2269cfb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2264070820 0x7f22640ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f2269cfb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2264070820 0x7f22640ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33188/0 (socket says 172.21.15.133:33188) 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f2269cfb640 1 -- 172.21.15.133:0/1991839605 learned_addr learned my addr 172.21.15.133:0/1991839605 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226a4fc640 1 --2- 172.21.15.133:0/1991839605 >> v2:172.21.15.142:3300/0 conn(0x7f22641582d0 0x7f22640c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f226acfd640 1 --2- 172.21.15.133:0/1991839605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 0x7f22640ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f2269cfb640 1 -- 172.21.15.133:0/1991839605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 msgr2=0x7f22640ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f2269cfb640 1 --2- 172.21.15.133:0/1991839605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 0x7f22640ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f2269cfb640 1 -- 172.21.15.133:0/1991839605 >> v2:172.21.15.142:3300/0 conn(0x7f22641582d0 msgr2=0x7f22640c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f2269cfb640 1 --2- 172.21.15.133:0/1991839605 >> v2:172.21.15.142:3300/0 conn(0x7f22641582d0 0x7f22640c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.126+0000 7f2269cfb640 1 -- 172.21.15.133:0/1991839605 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226415b1c0 con 0x7f2264070820 2023-12-18T10:24:01.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f2269cfb640 1 --2- 172.21.15.133:0/1991839605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2264070820 0x7f22640ca5f0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f22640cf000 tx=0x7f225401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55081df5bbe5467 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f22694fa640 1 -- 172.21.15.133:0/1991839605 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540aa5f0 con 0x7f2264070820 2023-12-18T10:24:01.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f22694fa640 1 -- 172.21.15.133:0/1991839605 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540aa750 con 0x7f2264070820 2023-12-18T10:24:01.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f22694fa640 1 -- 172.21.15.133:0/1991839605 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540aaae0 con 0x7f2264070820 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 -- 172.21.15.133:0/1991839605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2264070820 msgr2=0x7f22640ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 --2- 172.21.15.133:0/1991839605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2264070820 0x7f22640ca5f0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f22640cf000 tx=0x7f225401c4d0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 -- 172.21.15.133:0/1991839605 shutdown_connections 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 --2- 172.21.15.133:0/1991839605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 0x7f22640ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 --2- 172.21.15.133:0/1991839605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2264070820 0x7f22640ca5f0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 --2- 172.21.15.133:0/1991839605 >> v2:172.21.15.142:3300/0 conn(0x7f22641582d0 0x7f22640c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 -- 172.21.15.133:0/1991839605 >> 172.21.15.133:0/1991839605 conn(0x7f226406a2a0 msgr2=0x7f22640aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 -- 172.21.15.133:0/1991839605 shutdown_connections 2023-12-18T10:24:01.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.130+0000 7f226c760640 1 -- 172.21.15.133:0/1991839605 wait complete. 2023-12-18T10:24:01.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 Processor -- start 2023-12-18T10:24:01.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 -- start start 2023-12-18T10:24:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2264070820 0x7f226415d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 0x7f226414a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22641582d0 0x7f226406c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226415deb0 con 0x7f22641582d0 2023-12-18T10:24:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226415c440 con 0x7f2264070820 2023-12-18T10:24:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226415e0e0 con 0x7f22640ce3b0 2023-12-18T10:24:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22641582d0 0x7f226406c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22641582d0 0x7f226406c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33190/0 (socket says 172.21.15.133:33190) 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 -- 172.21.15.133:0/4215984538 learned_addr learned my addr 172.21.15.133:0/4215984538 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f2269cfb640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 0x7f226414a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226a4fc640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2264070820 0x7f226415d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 -- 172.21.15.133:0/4215984538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 msgr2=0x7f226414a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 0x7f226414a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 -- 172.21.15.133:0/4215984538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2264070820 msgr2=0x7f226415d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2264070820 0x7f226415d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 -- 172.21.15.133:0/4215984538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22540094d0 con 0x7f22641582d0 2023-12-18T10:24:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226acfd640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22641582d0 0x7f226406c3a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f225c007e40 tx=0x7f225c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f225affd640 1 -- 172.21.15.133:0/4215984538 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c014620 con 0x7f22641582d0 2023-12-18T10:24:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f225affd640 1 -- 172.21.15.133:0/4215984538 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c00ee90 con 0x7f22641582d0 2023-12-18T10:24:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f225affd640 1 -- 172.21.15.133:0/4215984538 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0149e0 con 0x7f22641582d0 2023-12-18T10:24:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226415e3c0 con 0x7f22641582d0 2023-12-18T10:24:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226415e980 con 0x7f22641582d0 2023-12-18T10:24:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.134+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226404e000 con 0x7f22641582d0 2023-12-18T10:24:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.138+0000 7f225affd640 1 -- 172.21.15.133:0/4215984538 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f225c014b40 con 0x7f22641582d0 2023-12-18T10:24:01.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.138+0000 7f225affd640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2248065a90 0x7f2248067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.138+0000 7f225affd640 1 -- 172.21.15.133:0/4215984538 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f225c083770 con 0x7f22641582d0 2023-12-18T10:24:01.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.138+0000 7f226a4fc640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2248065a90 0x7f2248067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.138+0000 7f226a4fc640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2248065a90 0x7f2248067f50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2260009a40 tx=0x7f2260009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.142+0000 7f225affd640 1 -- 172.21.15.133:0/4215984538 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f225c0513e0 con 0x7f22641582d0 2023-12-18T10:24:01.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.298+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22640b0c00 con 0x7f22641582d0 2023-12-18T10:24:01.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.298+0000 7f225affd640 1 -- 172.21.15.133:0/4215984538 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f225c054a00 con 0x7f22641582d0 2023-12-18T10:24:01.299 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:24:01.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2248065a90 msgr2=0x7f2248067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2248065a90 0x7f2248067f50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2260009a40 tx=0x7f2260009190 comp rx=0 tx=0).stop 2023-12-18T10:24:01.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22641582d0 msgr2=0x7f226406c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22641582d0 0x7f226406c3a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f225c007e40 tx=0x7f225c00e4b0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 shutdown_connections 2023-12-18T10:24:01.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2248065a90 0x7f2248067f50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22641582d0 0x7f226406c3a0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f22640ce3b0 0x7f226414a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 --2- 172.21.15.133:0/4215984538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2264070820 0x7f226415d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 >> 172.21.15.133:0/4215984538 conn(0x7f226406a2a0 msgr2=0x7f22640cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:01.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 shutdown_connections 2023-12-18T10:24:01.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.302+0000 7f226c760640 1 -- 172.21.15.133:0/4215984538 wait complete. 2023-12-18T10:24:01.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-18T10:24:01.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff3701a5640 1 Processor -- start 2023-12-18T10:24:01.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff3701a5640 1 -- start start 2023-12-18T10:24:01.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff3701a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff36815caf0 0x7ff3680cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff3701a5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3680cdc20 0x7ff3680717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff3701a5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3680ccde0 con 0x7ff368069ca0 2023-12-18T10:24:01.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff3701a5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680cc820 con 0x7ff3680cdc20 2023-12-18T10:24:01.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff3701a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680ccb00 con 0x7ff36815caf0 2023-12-18T10:24:01.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff36e742640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3680cdc20 0x7ff3680717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff36e742640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3680cdc20 0x7ff3680717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33196/0 (socket says 172.21.15.133:33196) 2023-12-18T10:24:01.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff36e742640 1 -- 172.21.15.133:0/730449831 learned_addr learned my addr 172.21.15.133:0/730449831 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:01.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff36d740640 1 --2- 172.21.15.133:0/730449831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff36815caf0 0x7ff3680cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff36e742640 1 -- 172.21.15.133:0/730449831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff36815caf0 msgr2=0x7ff3680cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:01.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff36e742640 1 --2- 172.21.15.133:0/730449831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff36815caf0 0x7ff3680cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff36e742640 1 -- 172.21.15.133:0/730449831 >> v1:172.21.15.142:6789/0 conn(0x7ff368069ca0 legacy=0x7ff36806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:01.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.458+0000 7ff36e742640 1 -- 172.21.15.133:0/730449831 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff368070ff0 con 0x7ff3680cdc20 2023-12-18T10:24:01.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff36e742640 1 --2- 172.21.15.133:0/730449831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3680cdc20 0x7ff3680717f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ff360009e50 tx=0x7ff36001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f067593860a8353 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff36cf3f640 1 -- 172.21.15.133:0/730449831 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3600a58d0 con 0x7ff3680cdc20 2023-12-18T10:24:01.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff36cf3f640 1 -- 172.21.15.133:0/730449831 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3600a5a30 con 0x7ff3680cdc20 2023-12-18T10:24:01.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff36cf3f640 1 -- 172.21.15.133:0/730449831 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3600a5dc0 con 0x7ff3680cdc20 2023-12-18T10:24:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff3701a5640 1 -- 172.21.15.133:0/730449831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3680cdc20 msgr2=0x7ff3680717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff3701a5640 1 --2- 172.21.15.133:0/730449831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3680cdc20 0x7ff3680717f0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7ff360009e50 tx=0x7ff36001c9e0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff3701a5640 1 -- 172.21.15.133:0/730449831 shutdown_connections 2023-12-18T10:24:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff3701a5640 1 --2- 172.21.15.133:0/730449831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3680cdc20 0x7ff3680717f0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff3701a5640 1 --2- 172.21.15.133:0/730449831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff36815caf0 0x7ff3680cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff3701a5640 1 -- 172.21.15.133:0/730449831 >> 172.21.15.133:0/730449831 conn(0x7ff36806cf80 msgr2=0x7ff36806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff3701a5640 1 -- 172.21.15.133:0/730449831 shutdown_connections 2023-12-18T10:24:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.462+0000 7ff3701a5640 1 -- 172.21.15.133:0/730449831 wait complete. 2023-12-18T10:24:01.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 Processor -- start 2023-12-18T10:24:01.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 -- start start 2023-12-18T10:24:01.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff368069ca0 0x7ff368151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680cdc20 0x7ff368152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36815caf0 0x7ff3681552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff368153900 con 0x7ff36815caf0 2023-12-18T10:24:01.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff368153060 con 0x7ff368069ca0 2023-12-18T10:24:01.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff368153340 con 0x7ff3680cdc20 2023-12-18T10:24:01.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36815caf0 0x7ff3681552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36815caf0 0x7ff3681552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33202/0 (socket says 172.21.15.133:33202) 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 -- 172.21.15.133:0/2361404537 learned_addr learned my addr 172.21.15.133:0/2361404537 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36df41640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff368069ca0 0x7ff368151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36d740640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680cdc20 0x7ff368152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 -- 172.21.15.133:0/2361404537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680cdc20 msgr2=0x7ff368152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680cdc20 0x7ff368152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 -- 172.21.15.133:0/2361404537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff368069ca0 msgr2=0x7ff368151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff368069ca0 0x7ff368151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 -- 172.21.15.133:0/2361404537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff360009b30 con 0x7ff36815caf0 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff36e742640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36815caf0 0x7ff3681552e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ff3600af040 tx=0x7ff360019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff35e7fc640 1 -- 172.21.15.133:0/2361404537 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3600b8880 con 0x7ff36815caf0 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff35e7fc640 1 -- 172.21.15.133:0/2361404537 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3600b8a20 con 0x7ff36815caf0 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff35e7fc640 1 -- 172.21.15.133:0/2361404537 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3600b8dd0 con 0x7ff36815caf0 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff368153620 con 0x7ff36815caf0 2023-12-18T10:24:01.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.466+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff368153d30 con 0x7ff36815caf0 2023-12-18T10:24:01.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.470+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36804e000 con 0x7ff36815caf0 2023-12-18T10:24:01.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.470+0000 7ff35e7fc640 1 -- 172.21.15.133:0/2361404537 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff3600c3460 con 0x7ff36815caf0 2023-12-18T10:24:01.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.470+0000 7ff35e7fc640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff34c065a60 0x7ff34c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.470+0000 7ff35e7fc640 1 -- 172.21.15.133:0/2361404537 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff36011eff0 con 0x7ff36815caf0 2023-12-18T10:24:01.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.470+0000 7ff36df41640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff34c065a60 0x7ff34c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.470+0000 7ff36df41640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff34c065a60 0x7ff34c067f20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff364007fd0 tx=0x7ff364009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.474+0000 7ff35e7fc640 1 -- 172.21.15.133:0/2361404537 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff3600ecdd0 con 0x7ff36815caf0 2023-12-18T10:24:01.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.622+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff3680b23b0 con 0x7ff36815caf0 2023-12-18T10:24:01.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff35e7fc640 1 -- 172.21.15.133:0/2361404537 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v87) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff3600f03f0 con 0x7ff36815caf0 2023-12-18T10:24:01.625 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:01.625 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:24:01.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:24:01.625 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-18T10:24:01.625 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-18T10:24:01.625 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:01.625 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:24:01.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff34c065a60 msgr2=0x7ff34c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff34c065a60 0x7ff34c067f20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff364007fd0 tx=0x7ff364009040 comp rx=0 tx=0).stop 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36815caf0 msgr2=0x7ff3681552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36815caf0 0x7ff3681552e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ff3600af040 tx=0x7ff360019780 comp rx=0 tx=0).stop 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 shutdown_connections 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff34c065a60 0x7ff34c067f20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff36815caf0 0x7ff3681552e0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff3680cdc20 0x7ff368152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 --2- 172.21.15.133:0/2361404537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff368069ca0 0x7ff368151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 >> 172.21.15.133:0/2361404537 conn(0x7ff36806cf80 msgr2=0x7ff368160400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 shutdown_connections 2023-12-18T10:24:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.626+0000 7ff3701a5640 1 -- 172.21.15.133:0/2361404537 wait complete. 2023-12-18T10:24:01.645 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-18T10:24:01.646 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-18T10:24:01.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.790+0000 7f7f6912c640 1 Processor -- start 2023-12-18T10:24:01.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.790+0000 7f7f6912c640 1 -- start start 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f6912c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f640ce6a0 0x7f7f640ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f6912c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f640ca200 0x7f7f640cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f6912c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f6415d180 0x7f7f6415d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f6912c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f64159b20 con 0x7f7f640ca200 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f6912c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f640cefc0 con 0x7f7f640ce6a0 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f6912c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640ad6e0 con 0x7f7f6415d180 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f640ca200 0x7f7f640cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f640ca200 0x7f7f640cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33204/0 (socket says 172.21.15.133:33204) 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 -- 172.21.15.133:0/1873274539 learned_addr learned my addr 172.21.15.133:0/1873274539 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:01.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f62d9d640 1 --2- 172.21.15.133:0/1873274539 >> v2:172.21.15.142:3300/0 conn(0x7f7f640ce6a0 0x7f7f640ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f6359e640 1 --2- 172.21.15.133:0/1873274539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f6415d180 0x7f7f6415d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 -- 172.21.15.133:0/1873274539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f6415d180 msgr2=0x7f7f6415d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:01.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 --2- 172.21.15.133:0/1873274539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f6415d180 0x7f7f6415d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 -- 172.21.15.133:0/1873274539 >> v2:172.21.15.142:3300/0 conn(0x7f7f640ce6a0 msgr2=0x7f7f640ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:01.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 --2- 172.21.15.133:0/1873274539 >> v2:172.21.15.142:3300/0 conn(0x7f7f640ce6a0 0x7f7f640ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 -- 172.21.15.133:0/1873274539 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640ad9c0 con 0x7f7f640ca200 2023-12-18T10:24:01.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f6359e640 1 --2- 172.21.15.133:0/1873274539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f6415d180 0x7f7f6415d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:01.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.794+0000 7f7f5a59c640 1 --2- 172.21.15.133:0/1873274539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ca200 0x7f7f640cea80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009870 tx=0x7f7f4c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b093089a47f13b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6259c640 1 -- 172.21.15.133:0/1873274539 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0aa5f0 con 0x7f7f640ca200 2023-12-18T10:24:01.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6259c640 1 -- 172.21.15.133:0/1873274539 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0aa750 con 0x7f7f640ca200 2023-12-18T10:24:01.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6259c640 1 -- 172.21.15.133:0/1873274539 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0aaae0 con 0x7f7f640ca200 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- 172.21.15.133:0/1873274539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ca200 msgr2=0x7f7f640cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 --2- 172.21.15.133:0/1873274539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ca200 0x7f7f640cea80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009870 tx=0x7f7f4c01c4d0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- 172.21.15.133:0/1873274539 shutdown_connections 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 --2- 172.21.15.133:0/1873274539 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f6415d180 0x7f7f6415d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 --2- 172.21.15.133:0/1873274539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ca200 0x7f7f640cea80 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 --2- 172.21.15.133:0/1873274539 >> v2:172.21.15.142:3300/0 conn(0x7f7f640ce6a0 0x7f7f640ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- 172.21.15.133:0/1873274539 >> 172.21.15.133:0/1873274539 conn(0x7f7f64069e70 msgr2=0x7f7f6406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- 172.21.15.133:0/1873274539 shutdown_connections 2023-12-18T10:24:01.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- 172.21.15.133:0/1873274539 wait complete. 2023-12-18T10:24:01.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 Processor -- start 2023-12-18T10:24:01.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- start start 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f640ca200 0x7f7f64097680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ce6a0 0x7f7f64090610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f6415d180 0x7f7f64158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64158990 con 0x7f7f640ce6a0 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64157d30 con 0x7f7f6415d180 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.798+0000 7f7f6912c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f64157ff0 con 0x7f7f640ca200 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ce6a0 0x7f7f64090610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ce6a0 0x7f7f64090610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33218/0 (socket says 172.21.15.133:33218) 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 -- 172.21.15.133:0/48045283 learned_addr learned my addr 172.21.15.133:0/48045283 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f6359e640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f6415d180 0x7f7f64158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f62d9d640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f640ca200 0x7f7f64097680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 -- 172.21.15.133:0/48045283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f640ca200 msgr2=0x7f7f64097680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f640ca200 0x7f7f64097680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 -- 172.21.15.133:0/48045283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f6415d180 msgr2=0x7f7f64158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f6415d180 0x7f7f64158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 -- 172.21.15.133:0/48045283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c0094d0 con 0x7f7f640ce6a0 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5a59c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ce6a0 0x7f7f64090610 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c01ab80 tx=0x7f7f4c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5bfff640 1 -- 172.21.15.133:0/48045283 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0b3800 con 0x7f7f640ce6a0 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5bfff640 1 -- 172.21.15.133:0/48045283 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0b3980 con 0x7f7f640ce6a0 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f641582d0 con 0x7f7f640ce6a0 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5bfff640 1 -- 172.21.15.133:0/48045283 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0b3d30 con 0x7f7f640ce6a0 2023-12-18T10:24:01.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f64097bc0 con 0x7f7f640ce6a0 2023-12-18T10:24:01.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f64158ad0 con 0x7f7f640ce6a0 2023-12-18T10:24:01.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.802+0000 7f7f5bfff640 1 -- 172.21.15.133:0/48045283 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f4c0c6390 con 0x7f7f640ce6a0 2023-12-18T10:24:01.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.806+0000 7f7f5bfff640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f44065a60 0x7f7f44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:01.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.806+0000 7f7f5bfff640 1 -- 172.21.15.133:0/48045283 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7f4c0a7070 con 0x7f7f640ce6a0 2023-12-18T10:24:01.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.806+0000 7f7f62d9d640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f44065a60 0x7f7f44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:01.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.806+0000 7f7f62d9d640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f44065a60 0x7f7f44067f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7f540039f0 tx=0x7f7f54009790 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:01.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.810+0000 7f7f5bfff640 1 -- 172.21.15.133:0/48045283 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7f64158ad0 con 0x7f7f640ce6a0 2023-12-18T10:24:01.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:01.962+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7f64158ad0 con 0x7f7f640ce6a0 2023-12-18T10:24:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.250+0000 7f7f5bfff640 1 -- 172.21.15.133:0/48045283 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v88) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7f64158ad0 con 0x7f7f640ce6a0 2023-12-18T10:24:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-18T10:24:02.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.254+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f44065a60 msgr2=0x7f7f44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:02.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.254+0000 7f7f6912c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f44065a60 0x7f7f44067f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7f540039f0 tx=0x7f7f54009790 comp rx=0 tx=0).stop 2023-12-18T10:24:02.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.254+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ce6a0 msgr2=0x7f7f64090610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:02.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.254+0000 7f7f6912c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ce6a0 0x7f7f64090610 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c01ab80 tx=0x7f7f4c01ad10 comp rx=0 tx=0).stop 2023-12-18T10:24:02.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.258+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 shutdown_connections 2023-12-18T10:24:02.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.258+0000 7f7f6912c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7f44065a60 0x7f7f44067f20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.258+0000 7f7f6912c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f6415d180 0x7f7f64158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.258+0000 7f7f6912c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f640ce6a0 0x7f7f64090610 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.258+0000 7f7f6912c640 1 --2- 172.21.15.133:0/48045283 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f640ca200 0x7f7f64097680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.258+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 >> 172.21.15.133:0/48045283 conn(0x7f7f64069e70 msgr2=0x7f7f640ac700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:02.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.258+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 shutdown_connections 2023-12-18T10:24:02.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.258+0000 7f7f6912c640 1 -- 172.21.15.133:0/48045283 wait complete. 2023-12-18T10:24:02.278 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-18T10:24:02.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.422+0000 7f3965edf640 1 Processor -- start 2023-12-18T10:24:02.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.422+0000 7f3965edf640 1 -- start start 2023-12-18T10:24:02.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f3965edf640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39600702d0 0x7f39600706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:02.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f3965edf640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3960155410 con 0x7f396015b530 2023-12-18T10:24:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f3965edf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396015ea60 con 0x7f396015e4f0 2023-12-18T10:24:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f3965edf640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3960070bf0 con 0x7f39600702d0 2023-12-18T10:24:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f396015b530 0x7f39600afed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58826/0 (socket says 172.21.15.133:58826) 2023-12-18T10:24:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395ffff640 1 -- 172.21.15.133:0/3835555252 learned_addr learned my addr 172.21.15.133:0/3835555252 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395f7fe640 1 --2- 172.21.15.133:0/3835555252 >> v2:172.21.15.142:3300/0 conn(0x7f39600702d0 0x7f39600706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261458386 0 0) 0x7f3960155410 con 0x7f396015b530 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3948003530 con 0x7f396015b530 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128592763 0 0) 0x7f3948003530 con 0x7f396015b530 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 >> v2:172.21.15.142:3300/0 conn(0x7f39600702d0 msgr2=0x7f39600706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 --2- 172.21.15.133:0/3835555252 >> v2:172.21.15.142:3300/0 conn(0x7f39600702d0 0x7f39600706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 >> v1:172.21.15.142:6789/0 conn(0x7f396015e4f0 legacy=0x7f39600cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396015ed40 con 0x7f396015b530 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f3958001a00 con 0x7f396015b530 2023-12-18T10:24:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 >> v1:172.21.15.133:6789/0 conn(0x7f396015b530 legacy=0x7f39600afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3948003980 0x7f3948003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480047d0 0x7f3948004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3948005190 0x7f394800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960070bf0 con 0x7f39480047d0 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394800c030 con 0x7f3948005190 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394800c1f0 con 0x7f3948003980 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395f7fe640 1 --2- 172.21.15.133:0/3835555252 >> v2:172.21.15.142:3300/0 conn(0x7f39600702d0 0x7f39600706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395effd640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480047d0 0x7f3948004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395ffff640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3948005190 0x7f394800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395f7fe640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3948003980 0x7f3948003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395effd640 1 -- 172.21.15.133:0/3835555252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3948003980 msgr2=0x7f3948003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395effd640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3948003980 0x7f3948003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395effd640 1 -- 172.21.15.133:0/3835555252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3948005190 msgr2=0x7f394800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:02.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395effd640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3948005190 0x7f394800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395effd640 1 -- 172.21.15.133:0/3835555252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948003530 con 0x7f39480047d0 2023-12-18T10:24:02.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.426+0000 7f395ffff640 1 -- 172.21.15.133:0/3835555252 reap_dead start 2023-12-18T10:24:02.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f395effd640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480047d0 0x7f3948004c50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3954001780 tx=0x7f395401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e3dc83e1b69a7f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:02.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540a4ea0 con 0x7f39480047d0 2023-12-18T10:24:02.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39540a7050 con 0x7f39480047d0 2023-12-18T10:24:02.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f395e7fc640 1 -- 172.21.15.133:0/3835555252 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954003600 con 0x7f39480047d0 2023-12-18T10:24:02.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f3965edf640 1 -- 172.21.15.133:0/3835555252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480047d0 msgr2=0x7f3948004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:02.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f3965edf640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480047d0 0x7f3948004c50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f3954001780 tx=0x7f395401c3e0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f3965edf640 1 -- 172.21.15.133:0/3835555252 shutdown_connections 2023-12-18T10:24:02.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f3965edf640 1 --2- 172.21.15.133:0/3835555252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39480047d0 0x7f3948004c50 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f3965edf640 1 -- 172.21.15.133:0/3835555252 >> 172.21.15.133:0/3835555252 conn(0x7f39600ce450 msgr2=0x7f39600ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:02.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f3965edf640 1 -- 172.21.15.133:0/3835555252 shutdown_connections 2023-12-18T10:24:02.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.430+0000 7f3965edf640 1 -- 172.21.15.133:0/3835555252 wait complete. 2023-12-18T10:24:02.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 Processor -- start 2023-12-18T10:24:02.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 -- start start 2023-12-18T10:24:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39480047d0 0x7f39600c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39600c4300 0x7f3960153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39600c4780 0x7f3960153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600b2a40 con 0x7f39600c4780 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600b20c0 con 0x7f39600c4300 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600b1de0 con 0x7f39480047d0 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39600c4780 0x7f3960153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395effd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39600c4300 0x7f3960153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395effd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39600c4300 0x7f3960153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:59056/0 (socket says 172.21.15.133:59056) 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395effd640 1 -- 172.21.15.133:0/4068679884 learned_addr learned my addr 172.21.15.133:0/4068679884 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395f7fe640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39480047d0 0x7f39600c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395ffff640 1 -- 172.21.15.133:0/4068679884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39480047d0 msgr2=0x7f39600c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395ffff640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39480047d0 0x7f39600c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395ffff640 1 -- 172.21.15.133:0/4068679884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39600c4300 msgr2=0x7f3960153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395ffff640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39600c4300 0x7f3960153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395ffff640 1 -- 172.21.15.133:0/4068679884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600b2ce0 con 0x7f39600c4780 2023-12-18T10:24:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395effd640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39600c4300 0x7f3960153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f395ffff640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39600c4780 0x7f3960153d90 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f396015b910 tx=0x7f3958011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3947fff640 1 -- 172.21.15.133:0/4068679884 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580137a0 con 0x7f39600c4780 2023-12-18T10:24:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3947fff640 1 -- 172.21.15.133:0/4068679884 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958013900 con 0x7f39600c4780 2023-12-18T10:24:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3947fff640 1 -- 172.21.15.133:0/4068679884 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958013cb0 con 0x7f39600c4780 2023-12-18T10:24:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39600b2fc0 con 0x7f39600c4780 2023-12-18T10:24:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39600b1070 con 0x7f39600c4780 2023-12-18T10:24:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.434+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39600b3200 con 0x7f39600c4780 2023-12-18T10:24:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.438+0000 7f3947fff640 1 -- 172.21.15.133:0/4068679884 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3958014370 con 0x7f39600c4780 2023-12-18T10:24:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.438+0000 7f3947fff640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f394c065a60 0x7f394c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.438+0000 7f3947fff640 1 -- 172.21.15.133:0/4068679884 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f3958085790 con 0x7f39600c4780 2023-12-18T10:24:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.438+0000 7f395f7fe640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f394c065a60 0x7f394c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:02.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.438+0000 7f395f7fe640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f394c065a60 0x7f394c067f20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f396006ef20 tx=0x7f3950008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.442+0000 7f3947fff640 1 -- 172.21.15.133:0/4068679884 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39600b3200 con 0x7f39600c4780 2023-12-18T10:24:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:02.590+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f39600b31b0 con 0x7f39600c4780 2023-12-18T10:24:03.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.262+0000 7f3947fff640 1 -- 172.21.15.133:0/4068679884 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v89) v1 ==== 170+0+0 (secure 0 0 0) 0x7f395801c070 con 0x7f39600c4780 2023-12-18T10:24:03.260 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-18T10:24:03.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.266+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f394c065a60 msgr2=0x7f394c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.266+0000 7f3965edf640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f394c065a60 0x7f394c067f20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f396006ef20 tx=0x7f3950008040 comp rx=0 tx=0).stop 2023-12-18T10:24:03.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.266+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39600c4780 msgr2=0x7f3960153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.266+0000 7f3965edf640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39600c4780 0x7f3960153d90 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f396015b910 tx=0x7f3958011930 comp rx=0 tx=0).stop 2023-12-18T10:24:03.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.270+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 shutdown_connections 2023-12-18T10:24:03.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.270+0000 7f3965edf640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f394c065a60 0x7f394c067f20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.270+0000 7f3965edf640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39600c4780 0x7f3960153d90 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.270+0000 7f3965edf640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39600c4300 0x7f3960153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.270+0000 7f3965edf640 1 --2- 172.21.15.133:0/4068679884 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39480047d0 0x7f39600c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.270+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 >> 172.21.15.133:0/4068679884 conn(0x7f39600ce450 msgr2=0x7f39600aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:03.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.274+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 shutdown_connections 2023-12-18T10:24:03.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.274+0000 7f3965edf640 1 -- 172.21.15.133:0/4068679884 wait complete. 2023-12-18T10:24:03.304 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-18T10:24:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85f82d640 1 Processor -- start 2023-12-18T10:24:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85f82d640 1 -- start start 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85f82d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc85815a960 0x7fc8580cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85f82d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 0x7fc8580cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85f82d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8580ce9d0 con 0x7fc85815e540 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85f82d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85815ed90 con 0x7fc85815a960 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85f82d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85815f070 con 0x7fc8580b2780 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85d5c9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc85815a960 0x7fc8580cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85cdc8640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc85815e540 0x7fc8580b2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58830/0 (socket says 172.21.15.133:58830) 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85cdc8640 1 -- 172.21.15.133:0/824045031 learned_addr learned my addr 172.21.15.133:0/824045031 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85ddca640 1 --2- 172.21.15.133:0/824045031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 0x7fc8580cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85d5c9640 1 -- 172.21.15.133:0/824045031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 msgr2=0x7fc8580cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85d5c9640 1 --2- 172.21.15.133:0/824045031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 0x7fc8580cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85d5c9640 1 -- 172.21.15.133:0/824045031 >> v1:172.21.15.133:6789/0 conn(0x7fc85815e540 legacy=0x7fc8580b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc85d5c9640 1 -- 172.21.15.133:0/824045031 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85815f350 con 0x7fc85815a960 2023-12-18T10:24:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.446+0000 7fc84ffff640 1 -- 172.21.15.133:0/824045031 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456912046 0 0) 0x7fc8580ce9d0 con 0x7fc85815e540 2023-12-18T10:24:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85d5c9640 1 --2- 172.21.15.133:0/824045031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815a960 0x7fc8580cb700 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc8540097a0 tx=0x7fc85401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c03c565271bb6f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc84ffff640 1 -- 172.21.15.133:0/824045031 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540ab600 con 0x7fc85815a960 2023-12-18T10:24:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc84ffff640 1 -- 172.21.15.133:0/824045031 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8540a7050 con 0x7fc85815a960 2023-12-18T10:24:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc84ffff640 1 -- 172.21.15.133:0/824045031 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540ab980 con 0x7fc85815a960 2023-12-18T10:24:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- 172.21.15.133:0/824045031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815a960 msgr2=0x7fc8580cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 --2- 172.21.15.133:0/824045031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815a960 0x7fc8580cb700 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc8540097a0 tx=0x7fc85401c3a0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- 172.21.15.133:0/824045031 shutdown_connections 2023-12-18T10:24:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 --2- 172.21.15.133:0/824045031 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 0x7fc8580cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 --2- 172.21.15.133:0/824045031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815a960 0x7fc8580cb700 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- 172.21.15.133:0/824045031 >> 172.21.15.133:0/824045031 conn(0x7fc8580cd070 msgr2=0x7fc8580cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- 172.21.15.133:0/824045031 shutdown_connections 2023-12-18T10:24:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- 172.21.15.133:0/824045031 wait complete. 2023-12-18T10:24:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 Processor -- start 2023-12-18T10:24:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- start start 2023-12-18T10:24:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 0x7fc8580c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc85815a960 0x7fc8580c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815e540 0x7fc8580ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580c6780 con 0x7fc85815e540 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580c9350 con 0x7fc85815a960 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.454+0000 7fc85f82d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580c95f0 con 0x7fc8580b2780 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815e540 0x7fc8580ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815e540 0x7fc8580ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33274/0 (socket says 172.21.15.133:33274) 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 -- 172.21.15.133:0/1327873357 learned_addr learned my addr 172.21.15.133:0/1327873357 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85d5c9640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 0x7fc8580c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85cdc8640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc85815a960 0x7fc8580c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 -- 172.21.15.133:0/1327873357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 msgr2=0x7fc8580c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 0x7fc8580c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 -- 172.21.15.133:0/1327873357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc85815a960 msgr2=0x7fc8580c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc85815a960 0x7fc8580c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 -- 172.21.15.133:0/1327873357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8540093b0 con 0x7fc85815e540 2023-12-18T10:24:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85ddca640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815e540 0x7fc8580ca3b0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc850007e30 tx=0x7fc85000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc84dffb640 1 -- 172.21.15.133:0/1327873357 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850014620 con 0x7fc85815e540 2023-12-18T10:24:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc84dffb640 1 -- 172.21.15.133:0/1327873357 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85000ee90 con 0x7fc85815e540 2023-12-18T10:24:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc84dffb640 1 -- 172.21.15.133:0/1327873357 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500149c0 con 0x7fc85815e540 2023-12-18T10:24:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8580c98d0 con 0x7fc85815e540 2023-12-18T10:24:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8580c9e90 con 0x7fc85815e540 2023-12-18T10:24:03.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85804e000 con 0x7fc85815e540 2023-12-18T10:24:03.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.458+0000 7fc84dffb640 1 -- 172.21.15.133:0/1327873357 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc850014b20 con 0x7fc85815e540 2023-12-18T10:24:03.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.462+0000 7fc84dffb640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc83c065a60 0x7fc83c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.462+0000 7fc84dffb640 1 -- 172.21.15.133:0/1327873357 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fc850083b20 con 0x7fc85815e540 2023-12-18T10:24:03.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.462+0000 7fc85d5c9640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc83c065a60 0x7fc83c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.462+0000 7fc85d5c9640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc83c065a60 0x7fc83c067f20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc8540ad000 tx=0x7fc8540a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.466+0000 7fc84dffb640 1 -- 172.21.15.133:0/1327873357 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc850051410 con 0x7fc85815e540 2023-12-18T10:24:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.646+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc8580cdf80 con 0x7fc85815e540 2023-12-18T10:24:03.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.654+0000 7fc84dffb640 1 -- 172.21.15.133:0/1327873357 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v80) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc850054a30 con 0x7fc85815e540 2023-12-18T10:24:03.656 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 13 and data pool 14 2023-12-18T10:24:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc83c065a60 msgr2=0x7fc83c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc83c065a60 0x7fc83c067f20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc8540ad000 tx=0x7fc8540a6000 comp rx=0 tx=0).stop 2023-12-18T10:24:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815e540 msgr2=0x7fc8580ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815e540 0x7fc8580ca3b0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc850007e30 tx=0x7fc85000e4b0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 shutdown_connections 2023-12-18T10:24:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc83c065a60 0x7fc83c067f20 secure :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc8540ad000 tx=0x7fc8540a6000 comp rx=0 tx=0).stop 2023-12-18T10:24:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc85815e540 0x7fc8580ca3b0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc85815a960 0x7fc8580c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 --2- 172.21.15.133:0/1327873357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc8580b2780 0x7fc8580c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.666+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 >> 172.21.15.133:0/1327873357 conn(0x7fc8580cd070 msgr2=0x7fc8580cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:03.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.674+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 shutdown_connections 2023-12-18T10:24:03.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.678+0000 7fc85f82d640 1 -- 172.21.15.133:0/1327873357 wait complete. 2023-12-18T10:24:03.710 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:24:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.846+0000 7ffa0c539640 1 Processor -- start 2023-12-18T10:24:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.846+0000 7ffa0c539640 1 -- start start 2023-12-18T10:24:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa0c539640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffa040ca000 0x7ffa04164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa0c539640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa040c9460 con 0x7ffa0406c4f0 2023-12-18T10:24:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa0c539640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa041574a0 con 0x7ffa041570c0 2023-12-18T10:24:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa0c539640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa040c8b30 con 0x7ffa040ca000 2023-12-18T10:24:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa09ad4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffa0406c4f0 0x7ffa040c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58832/0 (socket says 172.21.15.133:58832) 2023-12-18T10:24:03.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa09ad4640 1 -- 172.21.15.133:0/3082378450 learned_addr learned my addr 172.21.15.133:0/3082378450 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa0aad6640 1 --2- 172.21.15.133:0/3082378450 >> v2:172.21.15.142:3300/0 conn(0x7ffa040ca000 0x7ffa04164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa092d3640 1 -- 172.21.15.133:0/3082378450 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754208734 0 0) 0x7ffa040c9460 con 0x7ffa0406c4f0 2023-12-18T10:24:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa092d3640 1 -- 172.21.15.133:0/3082378450 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9f0003530 con 0x7ffa0406c4f0 2023-12-18T10:24:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa092d3640 1 -- 172.21.15.133:0/3082378450 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726488107 0 0) 0x7ffa041574a0 con 0x7ffa041570c0 2023-12-18T10:24:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa092d3640 1 -- 172.21.15.133:0/3082378450 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa040c9460 con 0x7ffa041570c0 2023-12-18T10:24:03.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa0aad6640 1 -- 172.21.15.133:0/3082378450 >> v1:172.21.15.142:6789/0 conn(0x7ffa041570c0 legacy=0x7ffa0406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa0aad6640 1 -- 172.21.15.133:0/3082378450 >> v1:172.21.15.133:6789/0 conn(0x7ffa0406c4f0 legacy=0x7ffa040c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.850+0000 7ffa0aad6640 1 -- 172.21.15.133:0/3082378450 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa040c8e10 con 0x7ffa040ca000 2023-12-18T10:24:03.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0aad6640 1 --2- 172.21.15.133:0/3082378450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa040ca000 0x7ffa04164230 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009d90 tx=0x7ff9fc01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b099ef59d1fd005b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:03.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa092d3640 1 -- 172.21.15.133:0/3082378450 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0a5910 con 0x7ffa040ca000 2023-12-18T10:24:03.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa092d3640 1 -- 172.21.15.133:0/3082378450 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc0a5a70 con 0x7ffa040ca000 2023-12-18T10:24:03.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa092d3640 1 -- 172.21.15.133:0/3082378450 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc0a5e00 con 0x7ffa040ca000 2023-12-18T10:24:03.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0c539640 1 -- 172.21.15.133:0/3082378450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa040ca000 msgr2=0x7ffa04164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0c539640 1 --2- 172.21.15.133:0/3082378450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa040ca000 0x7ffa04164230 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc009d90 tx=0x7ff9fc01c890 comp rx=0 tx=0).stop 2023-12-18T10:24:03.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0c539640 1 -- 172.21.15.133:0/3082378450 shutdown_connections 2023-12-18T10:24:03.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0c539640 1 --2- 172.21.15.133:0/3082378450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa040ca000 0x7ffa04164230 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0c539640 1 -- 172.21.15.133:0/3082378450 >> 172.21.15.133:0/3082378450 conn(0x7ffa0406a3e0 msgr2=0x7ffa040afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:03.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0c539640 1 -- 172.21.15.133:0/3082378450 shutdown_connections 2023-12-18T10:24:03.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0c539640 1 -- 172.21.15.133:0/3082378450 wait complete. 2023-12-18T10:24:03.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.854+0000 7ffa0c539640 1 Processor -- start 2023-12-18T10:24:03.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 -- start start 2023-12-18T10:24:03.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa0406c4f0 0x7ffa04159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa040ca000 0x7ffa04157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa041570c0 0x7ffa040abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0414fc10 con 0x7ffa0406c4f0 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0414f930 con 0x7ffa041570c0 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa04167b40 con 0x7ffa040ca000 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa0406c4f0 0x7ffa04159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa0406c4f0 0x7ffa04159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33288/0 (socket says 172.21.15.133:33288) 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 -- 172.21.15.133:0/3376834620 learned_addr learned my addr 172.21.15.133:0/3376834620 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa09ad4640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa040ca000 0x7ffa04157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0aad6640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa041570c0 0x7ffa040abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 -- 172.21.15.133:0/3376834620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa040ca000 msgr2=0x7ffa04157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa040ca000 0x7ffa04157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 -- 172.21.15.133:0/3376834620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa041570c0 msgr2=0x7ffa040abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa041570c0 0x7ffa040abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 -- 172.21.15.133:0/3376834620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc009a70 con 0x7ffa0406c4f0 2023-12-18T10:24:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0a2d5640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa0406c4f0 0x7ffa04159ee0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c490 tx=0x7ffa0000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ff9faffd640 1 -- 172.21.15.133:0/3376834620 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa000052d0 con 0x7ffa0406c4f0 2023-12-18T10:24:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ff9faffd640 1 -- 172.21.15.133:0/3376834620 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa00005430 con 0x7ffa0406c4f0 2023-12-18T10:24:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ff9faffd640 1 -- 172.21.15.133:0/3376834620 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00012870 con 0x7ffa0406c4f0 2023-12-18T10:24:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa04167e20 con 0x7ffa0406c4f0 2023-12-18T10:24:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0415a420 con 0x7ffa0406c4f0 2023-12-18T10:24:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.858+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa040735b0 con 0x7ffa0406c4f0 2023-12-18T10:24:03.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.862+0000 7ff9faffd640 1 -- 172.21.15.133:0/3376834620 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa000129d0 con 0x7ffa0406c4f0 2023-12-18T10:24:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.862+0000 7ff9faffd640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9e8065a60 0x7ff9e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.862+0000 7ff9faffd640 1 -- 172.21.15.133:0/3376834620 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ffa00082ea0 con 0x7ffa0406c4f0 2023-12-18T10:24:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.862+0000 7ffa09ad4640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9e8065a60 0x7ff9e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.862+0000 7ffa09ad4640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9e8065a60 0x7ff9e8067f20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffa04072fc0 tx=0x7ff9f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:03.866+0000 7ff9faffd640 1 -- 172.21.15.133:0/3376834620 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffa00050680 con 0x7ffa0406c4f0 2023-12-18T10:24:04.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.018+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa04167970 con 0x7ffa0406c4f0 2023-12-18T10:24:04.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.018+0000 7ff9faffd640 1 -- 172.21.15.133:0/3376834620 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16310 (secure 0 0 0) 0x7ffa00053ca0 con 0x7ffa0406c4f0 2023-12-18T10:24:04.018 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:04.018 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":90,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:24:03.648796+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:24:02.009135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-18T10:24:02.637830+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:24:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9e8065a60 msgr2=0x7ff9e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9e8065a60 0x7ff9e8067f20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffa04072fc0 tx=0x7ff9f4009040 comp rx=0 tx=0).stop 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa0406c4f0 msgr2=0x7ffa04159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa0406c4f0 0x7ffa04159ee0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c490 tx=0x7ffa0000c950 comp rx=0 tx=0).stop 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 shutdown_connections 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff9e8065a60 0x7ff9e8067f20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa041570c0 0x7ffa040abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffa040ca000 0x7ffa04157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 --2- 172.21.15.133:0/3376834620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa0406c4f0 0x7ffa04159ee0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 >> 172.21.15.133:0/3376834620 conn(0x7ffa0406a3e0 msgr2=0x7ffa040c2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 shutdown_connections 2023-12-18T10:24:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.022+0000 7ffa0c539640 1 -- 172.21.15.133:0/3376834620 wait complete. 2023-12-18T10:24:04.040 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:24:04.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.178+0000 7f7e695c0640 1 Processor -- start 2023-12-18T10:24:04.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.178+0000 7f7e695c0640 1 -- start start 2023-12-18T10:24:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.178+0000 7f7e695c0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7e6406c4f0 0x7f7e640c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.178+0000 7f7e695c0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e640c9e30 0x7f7e640ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.178+0000 7f7e695c0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e640c9460 con 0x7f7e641570c0 2023-12-18T10:24:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e695c0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e641574a0 con 0x7f7e640c9e30 2023-12-18T10:24:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e695c0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e640c8b30 con 0x7f7e6406c4f0 2023-12-18T10:24:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e637fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e640c9e30 0x7f7e640ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e62ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7e641570c0 0x7f7e6406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58836/0 (socket says 172.21.15.133:58836) 2023-12-18T10:24:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e62ffd640 1 -- 172.21.15.133:0/1941439190 learned_addr learned my addr 172.21.15.133:0/1941439190 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e627fc640 1 --2- 172.21.15.133:0/1941439190 >> v2:172.21.15.142:3300/0 conn(0x7f7e6406c4f0 0x7f7e640c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e637fe640 1 -- 172.21.15.133:0/1941439190 >> v2:172.21.15.142:3300/0 conn(0x7f7e6406c4f0 msgr2=0x7f7e640c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e637fe640 1 --2- 172.21.15.133:0/1941439190 >> v2:172.21.15.142:3300/0 conn(0x7f7e6406c4f0 0x7f7e640c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e637fe640 1 -- 172.21.15.133:0/1941439190 >> v1:172.21.15.133:6789/0 conn(0x7f7e641570c0 legacy=0x7f7e6406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e61ffb640 1 -- 172.21.15.133:0/1941439190 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231408269 0 0) 0x7f7e640c9460 con 0x7f7e641570c0 2023-12-18T10:24:04.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e637fe640 1 -- 172.21.15.133:0/1941439190 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640c8e10 con 0x7f7e640c9e30 2023-12-18T10:24:04.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e627fc640 1 --2- 172.21.15.133:0/1941439190 >> v2:172.21.15.142:3300/0 conn(0x7f7e6406c4f0 0x7f7e640c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:04.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e637fe640 1 --2- 172.21.15.133:0/1941439190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e640c9e30 0x7f7e640ca2c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f7e640ce330 tx=0x7f7e5c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c82f2ede07e4e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:04.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e61ffb640 1 -- 172.21.15.133:0/1941439190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0a59d0 con 0x7f7e640c9e30 2023-12-18T10:24:04.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e61ffb640 1 -- 172.21.15.133:0/1941439190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c0a5b30 con 0x7f7e640c9e30 2023-12-18T10:24:04.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.182+0000 7f7e61ffb640 1 -- 172.21.15.133:0/1941439190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0ad440 con 0x7f7e640c9e30 2023-12-18T10:24:04.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- 172.21.15.133:0/1941439190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e640c9e30 msgr2=0x7f7e640ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 --2- 172.21.15.133:0/1941439190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e640c9e30 0x7f7e640ca2c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f7e640ce330 tx=0x7f7e5c01c910 comp rx=0 tx=0).stop 2023-12-18T10:24:04.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- 172.21.15.133:0/1941439190 shutdown_connections 2023-12-18T10:24:04.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 --2- 172.21.15.133:0/1941439190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e640c9e30 0x7f7e640ca2c0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 --2- 172.21.15.133:0/1941439190 >> v2:172.21.15.142:3300/0 conn(0x7f7e6406c4f0 0x7f7e640c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- 172.21.15.133:0/1941439190 >> 172.21.15.133:0/1941439190 conn(0x7f7e6406a3e0 msgr2=0x7f7e640afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:04.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- 172.21.15.133:0/1941439190 shutdown_connections 2023-12-18T10:24:04.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- 172.21.15.133:0/1941439190 wait complete. 2023-12-18T10:24:04.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 Processor -- start 2023-12-18T10:24:04.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- start start 2023-12-18T10:24:04.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e6406c4f0 0x7f7e64150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e640c9e30 0x7f7e640c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e641570c0 0x7f7e6414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640c3e70 con 0x7f7e641570c0 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64150b50 con 0x7f7e6406c4f0 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e695c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6414ff40 con 0x7f7e640c9e30 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e641570c0 0x7f7e6414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e641570c0 0x7f7e6414f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33316/0 (socket says 172.21.15.133:33316) 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e637fe640 1 -- 172.21.15.133:0/2514281785 learned_addr learned my addr 172.21.15.133:0/2514281785 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e62ffd640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e6406c4f0 0x7f7e64150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.186+0000 7f7e627fc640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e640c9e30 0x7f7e640c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e637fe640 1 -- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e640c9e30 msgr2=0x7f7e640c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e637fe640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e640c9e30 0x7f7e640c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e637fe640 1 -- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e6406c4f0 msgr2=0x7f7e64150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e637fe640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e6406c4f0 0x7f7e64150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e637fe640 1 -- 172.21.15.133:0/2514281785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009a70 con 0x7f7e641570c0 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e627fc640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e640c9e30 0x7f7e640c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e637fe640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e641570c0 0x7f7e6414f440 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c019520 tx=0x7f7e5c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e4b7fe640 1 -- 172.21.15.133:0/2514281785 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0b7610 con 0x7f7e641570c0 2023-12-18T10:24:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e4b7fe640 1 -- 172.21.15.133:0/2514281785 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c0b7770 con 0x7f7e641570c0 2023-12-18T10:24:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e64150220 con 0x7f7e641570c0 2023-12-18T10:24:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e4b7fe640 1 -- 172.21.15.133:0/2514281785 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0b7ae0 con 0x7f7e641570c0 2023-12-18T10:24:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e641507e0 con 0x7f7e641570c0 2023-12-18T10:24:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e640735b0 con 0x7f7e641570c0 2023-12-18T10:24:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e4b7fe640 1 -- 172.21.15.133:0/2514281785 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e5c0b4050 con 0x7f7e641570c0 2023-12-18T10:24:04.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e4b7fe640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e50065a60 0x7f7e50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e4b7fe640 1 -- 172.21.15.133:0/2514281785 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7e5c11e5d0 con 0x7f7e641570c0 2023-12-18T10:24:04.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.190+0000 7f7e62ffd640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e50065a60 0x7f7e50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.194+0000 7f7e62ffd640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e50065a60 0x7f7e50067f20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000f70 tx=0x7f7e54007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.194+0000 7f7e4b7fe640 1 -- 172.21.15.133:0/2514281785 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7e5c0ebef0 con 0x7f7e641570c0 2023-12-18T10:24:04.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.346+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e64150cc0 con 0x7f7e641570c0 2023-12-18T10:24:04.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e4b7fe640 1 -- 172.21.15.133:0/2514281785 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16310 (secure 0 0 0) 0x7f7e5c009450 con 0x7f7e641570c0 2023-12-18T10:24:04.349 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:04.349 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":90,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:24:03.648796+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:24:02.009135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-18T10:24:02.637830+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:24:04.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e50065a60 msgr2=0x7f7e50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e50065a60 0x7f7e50067f20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7e54000f70 tx=0x7f7e54007df0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e641570c0 msgr2=0x7f7e6414f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e641570c0 0x7f7e6414f440 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c019520 tx=0x7f7e5c0196b0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 shutdown_connections 2023-12-18T10:24:04.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7e50065a60 0x7f7e50067f20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e641570c0 0x7f7e6414f440 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7e640c9e30 0x7f7e640c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 --2- 172.21.15.133:0/2514281785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e6406c4f0 0x7f7e64150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 >> 172.21.15.133:0/2514281785 conn(0x7f7e6406a3e0 msgr2=0x7f7e6415bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:04.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 shutdown_connections 2023-12-18T10:24:04.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.350+0000 7f7e695c0640 1 -- 172.21.15.133:0/2514281785 wait complete. 2023-12-18T10:24:04.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-18T10:24:04.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.510+0000 7fd557ef9640 1 Processor -- start 2023-12-18T10:24:04.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.510+0000 7fd557ef9640 1 -- start start 2023-12-18T10:24:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.510+0000 7fd557ef9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd550160a60 0x7fd5500ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.510+0000 7fd557ef9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5500ce8f0 0x7fd550164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.510+0000 7fd557ef9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5500ced50 con 0x7fd550164e60 2023-12-18T10:24:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd557ef9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5500cc980 con 0x7fd5500ce8f0 2023-12-18T10:24:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd557ef9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5500cc090 con 0x7fd550160a60 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd555494640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5500ce8f0 0x7fd550164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd556496640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd550164e60 0x7fd5500cad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58840/0 (socket says 172.21.15.133:58840) 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd556496640 1 -- 172.21.15.133:0/2429445064 learned_addr learned my addr 172.21.15.133:0/2429445064 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd555c95640 1 --2- 172.21.15.133:0/2429445064 >> v2:172.21.15.142:3300/0 conn(0x7fd550160a60 0x7fd5500ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd554c93640 1 -- 172.21.15.133:0/2429445064 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736384963 0 0) 0x7fd5500ced50 con 0x7fd550164e60 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd554c93640 1 -- 172.21.15.133:0/2429445064 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd53c003530 con 0x7fd550164e60 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd555494640 1 -- 172.21.15.133:0/2429445064 >> v2:172.21.15.142:3300/0 conn(0x7fd550160a60 msgr2=0x7fd5500ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd555494640 1 --2- 172.21.15.133:0/2429445064 >> v2:172.21.15.142:3300/0 conn(0x7fd550160a60 0x7fd5500ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd555494640 1 -- 172.21.15.133:0/2429445064 >> v1:172.21.15.133:6789/0 conn(0x7fd550164e60 legacy=0x7fd5500cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd555494640 1 -- 172.21.15.133:0/2429445064 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5500cc330 con 0x7fd5500ce8f0 2023-12-18T10:24:04.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd555494640 1 --2- 172.21.15.133:0/2429445064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5500ce8f0 0x7fd550164920 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fd5500b07c0 tx=0x7fd54001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d214f76d74b2c85 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:04.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd554c93640 1 -- 172.21.15.133:0/2429445064 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400ab650 con 0x7fd5500ce8f0 2023-12-18T10:24:04.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd554c93640 1 -- 172.21.15.133:0/2429445064 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400ab7b0 con 0x7fd5500ce8f0 2023-12-18T10:24:04.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.514+0000 7fd554c93640 1 -- 172.21.15.133:0/2429445064 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400abb20 con 0x7fd5500ce8f0 2023-12-18T10:24:04.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- 172.21.15.133:0/2429445064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5500ce8f0 msgr2=0x7fd550164920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 --2- 172.21.15.133:0/2429445064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5500ce8f0 0x7fd550164920 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fd5500b07c0 tx=0x7fd54001c430 comp rx=0 tx=0).stop 2023-12-18T10:24:04.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- 172.21.15.133:0/2429445064 shutdown_connections 2023-12-18T10:24:04.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 --2- 172.21.15.133:0/2429445064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5500ce8f0 0x7fd550164920 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 --2- 172.21.15.133:0/2429445064 >> v2:172.21.15.142:3300/0 conn(0x7fd550160a60 0x7fd5500ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- 172.21.15.133:0/2429445064 >> 172.21.15.133:0/2429445064 conn(0x7fd55006a2a0 msgr2=0x7fd5500aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:04.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- 172.21.15.133:0/2429445064 shutdown_connections 2023-12-18T10:24:04.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- 172.21.15.133:0/2429445064 wait complete. 2023-12-18T10:24:04.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 Processor -- start 2023-12-18T10:24:04.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- start start 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5500ce8f0 0x7fd5501574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd550160a60 0x7fd55015ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550164e60 0x7fd550163390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5501564b0 con 0x7fd550160a60 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550156790 con 0x7fd5500ce8f0 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd557ef9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd550156a70 con 0x7fd550164e60 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd555494640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd550160a60 0x7fd55015ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd555494640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd550160a60 0x7fd55015ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33348/0 (socket says 172.21.15.133:33348) 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd555494640 1 -- 172.21.15.133:0/1681049989 learned_addr learned my addr 172.21.15.133:0/1681049989 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd555c95640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5500ce8f0 0x7fd5501574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd556496640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550164e60 0x7fd550163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd555494640 1 -- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550164e60 msgr2=0x7fd550163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.518+0000 7fd555494640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550164e60 0x7fd550163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd555494640 1 -- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5500ce8f0 msgr2=0x7fd5501574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:04.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd555494640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5500ce8f0 0x7fd5501574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:04.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd555494640 1 -- 172.21.15.133:0/1681049989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540009420 con 0x7fd550160a60 2023-12-18T10:24:04.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd556496640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550164e60 0x7fd550163390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:04.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd555494640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd550160a60 0x7fd55015ab70 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd54001aae0 tx=0x7fd54001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd5467fc640 1 -- 172.21.15.133:0/1681049989 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400bf610 con 0x7fd550160a60 2023-12-18T10:24:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd5467fc640 1 -- 172.21.15.133:0/1681049989 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400bf770 con 0x7fd550160a60 2023-12-18T10:24:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd5467fc640 1 -- 172.21.15.133:0/1681049989 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400bfae0 con 0x7fd550160a60 2023-12-18T10:24:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd550156d50 con 0x7fd550160a60 2023-12-18T10:24:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd550155fb0 con 0x7fd550160a60 2023-12-18T10:24:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55004e000 con 0x7fd550160a60 2023-12-18T10:24:04.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd5467fc640 1 -- 172.21.15.133:0/1681049989 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd5400b5400 con 0x7fd550160a60 2023-12-18T10:24:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd5467fc640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd5467fc640 1 -- 172.21.15.133:0/1681049989 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd54011dea0 con 0x7fd550160a60 2023-12-18T10:24:04.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.522+0000 7fd555c95640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:04.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.526+0000 7fd555c95640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd5500b4110 tx=0x7fd54c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:04.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.526+0000 7fd5467fc640 1 -- 172.21.15.133:0/1681049989 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd5400eb680 con 0x7fd550160a60 2023-12-18T10:24:04.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:04.710+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd550157200 con 0x7fd550160a60 2023-12-18T10:24:05.193 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-18T10:24:05.194+0000 7f23d4af2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:24:05.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.670+0000 7fd5467fc640 1 -- 172.21.15.133:0/1681049989 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd5400eeca0 con 0x7fd550160a60 2023-12-18T10:24:05.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 msgr2=0x7fd534067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:05.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd5500b4110 tx=0x7fd54c008040 comp rx=0 tx=0).stop 2023-12-18T10:24:05.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd550160a60 msgr2=0x7fd55015ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd550160a60 0x7fd55015ab70 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd54001aae0 tx=0x7fd54001ac70 comp rx=0 tx=0).stop 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 shutdown_connections 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550164e60 0x7fd550163390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd550160a60 0x7fd55015ab70 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 --2- 172.21.15.133:0/1681049989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5500ce8f0 0x7fd5501574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 >> 172.21.15.133:0/1681049989 conn(0x7fd55006a2a0 msgr2=0x7fd5500c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 shutdown_connections 2023-12-18T10:24:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.674+0000 7fd557ef9640 1 -- 172.21.15.133:0/1681049989 wait complete. 2023-12-18T10:24:05.697 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-18T10:24:05.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-18T10:24:05.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdabec41640 1 Processor -- start 2023-12-18T10:24:05.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdabec41640 1 -- start start 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdabec41640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdab8153020 0x7fdab80c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdabec41640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab80c9730 con 0x7fdab81598d0 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdabec41640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab80cbc80 con 0x7fdab80ce390 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdabec41640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab80b0db0 con 0x7fdab8153020 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdab81598d0 0x7fdab80b06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58850/0 (socket says 172.21.15.133:58850) 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab7fff640 1 -- 172.21.15.133:0/2993560274 learned_addr learned my addr 172.21.15.133:0/2993560274 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdabc9dd640 1 --2- 172.21.15.133:0/2993560274 >> v2:172.21.15.142:3300/0 conn(0x7fdab8153020 0x7fdab80c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681412379 0 0) 0x7fdab80c9730 con 0x7fdab81598d0 2023-12-18T10:24:05.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa8003530 con 0x7fdab81598d0 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3310179099 0 0) 0x7fdaa8003530 con 0x7fdab81598d0 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 >> v2:172.21.15.142:3300/0 conn(0x7fdab8153020 msgr2=0x7fdab80c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 --2- 172.21.15.133:0/2993560274 >> v2:172.21.15.142:3300/0 conn(0x7fdab8153020 0x7fdab80c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 >> v1:172.21.15.142:6789/0 conn(0x7fdab80ce390 legacy=0x7fdab8070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80c8e00 con 0x7fdab81598d0 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fdaa4001680 con 0x7fdab81598d0 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 >> v1:172.21.15.133:6789/0 conn(0x7fdab81598d0 legacy=0x7fdab80b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8003980 0x7fdaa8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80047d0 0x7fdaa8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8005260 0x7fdaa800ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:05.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80b0db0 con 0x7fdaa8005260 2023-12-18T10:24:05.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8010590 con 0x7fdaa8003980 2023-12-18T10:24:05.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8010750 con 0x7fdaa80047d0 2023-12-18T10:24:05.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.842+0000 7fdabd1de640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8005260 0x7fdaa800ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:05.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdabc9dd640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8003980 0x7fdaa8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:05.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdab7fff640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80047d0 0x7fdaa8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:05.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdabd1de640 1 -- 172.21.15.133:0/2993560274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80047d0 msgr2=0x7fdaa8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:05.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdabd1de640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa80047d0 0x7fdaa8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdabd1de640 1 -- 172.21.15.133:0/2993560274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8003980 msgr2=0x7fdaa8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:05.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdabd1de640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaa8003980 0x7fdaa8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdabd1de640 1 -- 172.21.15.133:0/2993560274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa8003530 con 0x7fdaa8005260 2023-12-18T10:24:05.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdabd1de640 1 -- 172.21.15.133:0/2993560274 reap_dead start 2023-12-18T10:24:05.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdabd1de640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8005260 0x7fdaa800ffa0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fdab0001e70 tx=0x7fdab001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e524295d3da2490f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:05.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0003b80 con 0x7fdaa8005260 2023-12-18T10:24:05.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab0003d20 con 0x7fdaa8005260 2023-12-18T10:24:05.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.846+0000 7fdab77fe640 1 -- 172.21.15.133:0/2993560274 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab0005310 con 0x7fdaa8005260 2023-12-18T10:24:05.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- 172.21.15.133:0/2993560274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8005260 msgr2=0x7fdaa800ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:05.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8005260 0x7fdaa800ffa0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fdab0001e70 tx=0x7fdab001c730 comp rx=0 tx=0).stop 2023-12-18T10:24:05.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- 172.21.15.133:0/2993560274 shutdown_connections 2023-12-18T10:24:05.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 --2- 172.21.15.133:0/2993560274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8005260 0x7fdaa800ffa0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- 172.21.15.133:0/2993560274 >> 172.21.15.133:0/2993560274 conn(0x7fdab806a2a0 msgr2=0x7fdab80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:05.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- 172.21.15.133:0/2993560274 shutdown_connections 2023-12-18T10:24:05.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- 172.21.15.133:0/2993560274 wait complete. 2023-12-18T10:24:05.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 Processor -- start 2023-12-18T10:24:05.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- start start 2023-12-18T10:24:05.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa8005260 0x7fdab80c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:05.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8149b00 0x7fdab8148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:05.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdab8149f80 0x7fdab8148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:05.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80c3840 con 0x7fdab8149b00 2023-12-18T10:24:05.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80c3ae0 con 0x7fdab8149f80 2023-12-18T10:24:05.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabec41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80c3dc0 con 0x7fdaa8005260 2023-12-18T10:24:05.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdab7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8149b00 0x7fdab8148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdab7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8149b00 0x7fdab8148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33362/0 (socket says 172.21.15.133:33362) 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdab7fff640 1 -- 172.21.15.133:0/3795779222 learned_addr learned my addr 172.21.15.133:0/3795779222 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabc9dd640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa8005260 0x7fdab80c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdabd1de640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdab8149f80 0x7fdab8148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdab7fff640 1 -- 172.21.15.133:0/3795779222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa8005260 msgr2=0x7fdab80c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdab7fff640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa8005260 0x7fdab80c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdab7fff640 1 -- 172.21.15.133:0/3795779222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdab8149f80 msgr2=0x7fdab8148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdab7fff640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdab8149f80 0x7fdab8148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.850+0000 7fdab7fff640 1 -- 172.21.15.133:0/3795779222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80c40a0 con 0x7fdab8149b00 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdab7fff640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8149b00 0x7fdab8148410 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40072c0 tx=0x7fdaa40076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdab57fa640 1 -- 172.21.15.133:0/3795779222 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400f940 con 0x7fdab8149b00 2023-12-18T10:24:05.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdab57fa640 1 -- 172.21.15.133:0/3795779222 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa400faa0 con 0x7fdab8149b00 2023-12-18T10:24:05.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab80c4380 con 0x7fdab8149b00 2023-12-18T10:24:05.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdab57fa640 1 -- 172.21.15.133:0/3795779222 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400fe50 con 0x7fdab8149b00 2023-12-18T10:24:05.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab80b3660 con 0x7fdab8149b00 2023-12-18T10:24:05.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab804e000 con 0x7fdab8149b00 2023-12-18T10:24:05.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdab57fa640 1 -- 172.21.15.133:0/3795779222 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdaa401d460 con 0x7fdab8149b00 2023-12-18T10:24:05.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdab57fa640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda9c065a60 0x7fda9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:05.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdab57fa640 1 -- 172.21.15.133:0/3795779222 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdaa4083330 con 0x7fdab8149b00 2023-12-18T10:24:05.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.854+0000 7fdabc9dd640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda9c065a60 0x7fda9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:05.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.858+0000 7fdabc9dd640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda9c065a60 0x7fda9c067f20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009b60 tx=0x7fdaac009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:05.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:05.858+0000 7fdab57fa640 1 -- 172.21.15.133:0/3795779222 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdaa4050b10 con 0x7fdab8149b00 2023-12-18T10:24:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:06.046+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdab80c4830 con 0x7fdab8149b00 2023-12-18T10:24:07.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.026+0000 7fdab57fa640 1 -- 172.21.15.133:0/3795779222 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdaa4054130 con 0x7fdab8149b00 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda9c065a60 msgr2=0x7fda9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda9c065a60 0x7fda9c067f20 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009b60 tx=0x7fdaac009190 comp rx=0 tx=0).stop 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8149b00 msgr2=0x7fdab8148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8149b00 0x7fdab8148410 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40072c0 tx=0x7fdaa40076c0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 shutdown_connections 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fda9c065a60 0x7fda9c067f20 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdab8149f80 0x7fdab8148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8149b00 0x7fdab8148410 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 --2- 172.21.15.133:0/3795779222 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdaa8005260 0x7fdab80c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 >> 172.21.15.133:0/3795779222 conn(0x7fdab806a2a0 msgr2=0x7fdab80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 shutdown_connections 2023-12-18T10:24:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.030+0000 7fdabec41640 1 -- 172.21.15.133:0/3795779222 wait complete. 2023-12-18T10:24:07.053 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-18T10:24:07.053 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:07.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.194+0000 7f62fd82d640 1 Processor -- start 2023-12-18T10:24:07.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62fd82d640 1 -- start start 2023-12-18T10:24:07.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62fd82d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f62f806c4f0 0x7f62f80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62fd82d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f80c9e30 0x7f62f80ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62fd82d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f80c9460 con 0x7f62f81570c0 2023-12-18T10:24:07.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62fd82d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f81574a0 con 0x7f62f80c9e30 2023-12-18T10:24:07.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62fd82d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f80c8b30 con 0x7f62f806c4f0 2023-12-18T10:24:07.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f80c9e30 0x7f62f80ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62f80c9e30 0x7f62f80ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33364/0 (socket says 172.21.15.133:33364) 2023-12-18T10:24:07.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f77fe640 1 -- 172.21.15.133:0/3596510735 learned_addr learned my addr 172.21.15.133:0/3596510735 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:07.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f77fe640 1 -- 172.21.15.133:0/3596510735 >> v2:172.21.15.142:3300/0 conn(0x7f62f806c4f0 msgr2=0x7f62f80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:07.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f67fc640 1 --2- 172.21.15.133:0/3596510735 >> v2:172.21.15.142:3300/0 conn(0x7f62f806c4f0 0x7f62f80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f77fe640 1 --2- 172.21.15.133:0/3596510735 >> v2:172.21.15.142:3300/0 conn(0x7f62f806c4f0 0x7f62f80c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f77fe640 1 -- 172.21.15.133:0/3596510735 >> v1:172.21.15.133:6789/0 conn(0x7f62f81570c0 legacy=0x7f62f806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f77fe640 1 -- 172.21.15.133:0/3596510735 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80c8e10 con 0x7f62f80c9e30 2023-12-18T10:24:07.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f5ffb640 1 -- 172.21.15.133:0/3596510735 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930402714 0 0) 0x7f62f80c9460 con 0x7f62f81570c0 2023-12-18T10:24:07.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.198+0000 7f62f67fc640 1 --2- 172.21.15.133:0/3596510735 >> v2:172.21.15.142:3300/0 conn(0x7f62f806c4f0 0x7f62f80c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:07.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62f77fe640 1 --2- 172.21.15.133:0/3596510735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f80c9e30 0x7f62f80ca2c0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f62f80ce330 tx=0x7f62f001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c023a673c87e8d76 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62f5ffb640 1 -- 172.21.15.133:0/3596510735 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00a5790 con 0x7f62f80c9e30 2023-12-18T10:24:07.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62f5ffb640 1 -- 172.21.15.133:0/3596510735 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f00a58f0 con 0x7f62f80c9e30 2023-12-18T10:24:07.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62f5ffb640 1 -- 172.21.15.133:0/3596510735 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00a5c80 con 0x7f62f80c9e30 2023-12-18T10:24:07.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 -- 172.21.15.133:0/3596510735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f80c9e30 msgr2=0x7f62f80ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 --2- 172.21.15.133:0/3596510735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f80c9e30 0x7f62f80ca2c0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f62f80ce330 tx=0x7f62f001c910 comp rx=0 tx=0).stop 2023-12-18T10:24:07.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 -- 172.21.15.133:0/3596510735 shutdown_connections 2023-12-18T10:24:07.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 --2- 172.21.15.133:0/3596510735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f80c9e30 0x7f62f80ca2c0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 --2- 172.21.15.133:0/3596510735 >> v2:172.21.15.142:3300/0 conn(0x7f62f806c4f0 0x7f62f80c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 -- 172.21.15.133:0/3596510735 >> 172.21.15.133:0/3596510735 conn(0x7f62f806a3e0 msgr2=0x7f62f80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:07.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 -- 172.21.15.133:0/3596510735 shutdown_connections 2023-12-18T10:24:07.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 -- 172.21.15.133:0/3596510735 wait complete. 2023-12-18T10:24:07.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 Processor -- start 2023-12-18T10:24:07.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.202+0000 7f62fd82d640 1 -- start start 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f806c4f0 0x7f62f815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f80c9e30 0x7f62f814a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f81570c0 0x7f62f814a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80c5430 con 0x7f62f81570c0 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f814ab80 con 0x7f62f806c4f0 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8154be0 con 0x7f62f80c9e30 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f81570c0 0x7f62f814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f81570c0 0x7f62f814a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33378/0 (socket says 172.21.15.133:33378) 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 -- 172.21.15.133:0/1353573773 learned_addr learned my addr 172.21.15.133:0/1353573773 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f6ffd640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f806c4f0 0x7f62f815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f67fc640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f80c9e30 0x7f62f814a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 -- 172.21.15.133:0/1353573773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f80c9e30 msgr2=0x7f62f814a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f80c9e30 0x7f62f814a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 -- 172.21.15.133:0/1353573773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f806c4f0 msgr2=0x7f62f815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f806c4f0 0x7f62f815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 -- 172.21.15.133:0/1353573773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0009b30 con 0x7f62f81570c0 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62f77fe640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f81570c0 0x7f62f814a640 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f62f0019520 tx=0x7f62f00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62dffff640 1 -- 172.21.15.133:0/1353573773 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00b8670 con 0x7f62f81570c0 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62dffff640 1 -- 172.21.15.133:0/1353573773 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f00b87f0 con 0x7f62f81570c0 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62dffff640 1 -- 172.21.15.133:0/1353573773 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f00b8ba0 con 0x7f62f81570c0 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f8154ec0 con 0x7f62f81570c0 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f80c5920 con 0x7f62f81570c0 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.206+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f80735b0 con 0x7f62f81570c0 2023-12-18T10:24:07.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.210+0000 7f62dffff640 1 -- 172.21.15.133:0/1353573773 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f62f00b8d00 con 0x7f62f81570c0 2023-12-18T10:24:07.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.210+0000 7f62dffff640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e4065a60 0x7f62e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.210+0000 7f62dffff640 1 -- 172.21.15.133:0/1353573773 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62f011e850 con 0x7f62f81570c0 2023-12-18T10:24:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.210+0000 7f62f6ffd640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e4065a60 0x7f62e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.210+0000 7f62f6ffd640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e4065a60 0x7f62e4067f20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f62e8007fd0 tx=0x7f62e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.214+0000 7f62dffff640 1 -- 172.21.15.133:0/1353573773 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f62f00ec190 con 0x7f62f81570c0 2023-12-18T10:24:07.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.394+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62f804e000 con 0x7f62f81570c0 2023-12-18T10:24:07.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.394+0000 7f62dffff640 1 -- 172.21.15.133:0/1353573773 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4720 (secure 0 0 0) 0x7f62f00bc090 con 0x7f62f81570c0 2023-12-18T10:24:07.395 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:07.395 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:07.023465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:07.395 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 84 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e4065a60 msgr2=0x7f62e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e4065a60 0x7f62e4067f20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f62e8007fd0 tx=0x7f62e8009040 comp rx=0 tx=0).stop 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f81570c0 msgr2=0x7f62f814a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f81570c0 0x7f62f814a640 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f62f0019520 tx=0x7f62f00196b0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 shutdown_connections 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f62e4065a60 0x7f62e4067f20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62f81570c0 0x7f62f814a640 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62f80c9e30 0x7f62f814a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 --2- 172.21.15.133:0/1353573773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62f806c4f0 0x7f62f815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 >> 172.21.15.133:0/1353573773 conn(0x7f62f806a3e0 msgr2=0x7f62f8158270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 shutdown_connections 2023-12-18T10:24:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.398+0000 7f62fd82d640 1 -- 172.21.15.133:0/1353573773 wait complete. 2023-12-18T10:24:07.416 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:24:07.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.554+0000 7f60e53f3640 1 Processor -- start 2023-12-18T10:24:07.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.554+0000 7f60e53f3640 1 -- start start 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60e53f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 0x7f60e006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60e53f3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f60e00ca000 0x7f60e0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60e53f3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e00c9460 con 0x7f60e006c320 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60e53f3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e006c7a0 con 0x7f60e00ca000 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60e53f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01574a0 con 0x7f60e01570c0 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60d67fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f60e006c320 0x7f60e00c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58862/0 (socket says 172.21.15.133:58862) 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60d67fc640 1 -- 172.21.15.133:0/3901775237 learned_addr learned my addr 172.21.15.133:0/3901775237 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60deffd640 1 --2- 172.21.15.133:0/3901775237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 0x7f60e006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60df7fe640 1 --2- 172.21.15.133:0/3901775237 >> v2:172.21.15.142:3300/0 conn(0x7f60e00ca000 0x7f60e0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60de7fc640 1 -- 172.21.15.133:0/3901775237 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246949544 0 0) 0x7f60e00c9460 con 0x7f60e006c320 2023-12-18T10:24:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60de7fc640 1 -- 172.21.15.133:0/3901775237 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c0005740 con 0x7f60e006c320 2023-12-18T10:24:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60deffd640 1 -- 172.21.15.133:0/3901775237 >> v2:172.21.15.142:3300/0 conn(0x7f60e00ca000 msgr2=0x7f60e0070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60deffd640 1 --2- 172.21.15.133:0/3901775237 >> v2:172.21.15.142:3300/0 conn(0x7f60e00ca000 0x7f60e0070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60deffd640 1 -- 172.21.15.133:0/3901775237 >> v1:172.21.15.133:6789/0 conn(0x7f60e006c320 legacy=0x7f60e00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.558+0000 7f60deffd640 1 -- 172.21.15.133:0/3901775237 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00c8b30 con 0x7f60e01570c0 2023-12-18T10:24:07.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60deffd640 1 --2- 172.21.15.133:0/3901775237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 0x7f60e006bde0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60d00097c0 tx=0x7f60d001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaeca55e0109a3b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60de7fc640 1 -- 172.21.15.133:0/3901775237 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d00ac620 con 0x7f60e01570c0 2023-12-18T10:24:07.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60de7fc640 1 -- 172.21.15.133:0/3901775237 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d00ac780 con 0x7f60e01570c0 2023-12-18T10:24:07.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60de7fc640 1 -- 172.21.15.133:0/3901775237 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d00acb10 con 0x7f60e01570c0 2023-12-18T10:24:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- 172.21.15.133:0/3901775237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 msgr2=0x7f60e006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 --2- 172.21.15.133:0/3901775237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 0x7f60e006bde0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60d00097c0 tx=0x7f60d001c3c0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- 172.21.15.133:0/3901775237 shutdown_connections 2023-12-18T10:24:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 --2- 172.21.15.133:0/3901775237 >> v2:172.21.15.142:3300/0 conn(0x7f60e00ca000 0x7f60e0070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 --2- 172.21.15.133:0/3901775237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 0x7f60e006bde0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- 172.21.15.133:0/3901775237 >> 172.21.15.133:0/3901775237 conn(0x7f60e006a3e0 msgr2=0x7f60e00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- 172.21.15.133:0/3901775237 shutdown_connections 2023-12-18T10:24:07.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- 172.21.15.133:0/3901775237 wait complete. 2023-12-18T10:24:07.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 Processor -- start 2023-12-18T10:24:07.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- start start 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e006c320 0x7f60e01f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e00ca000 0x7f60e01583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 0x7f60e01588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00cafa0 con 0x7f60e00ca000 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01597d0 con 0x7f60e006c320 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.562+0000 7f60e53f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0158f30 con 0x7f60e01570c0 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e00ca000 0x7f60e01583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e00ca000 0x7f60e01583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33390/0 (socket says 172.21.15.133:33390) 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 -- 172.21.15.133:0/1711007333 learned_addr learned my addr 172.21.15.133:0/1711007333 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60deffd640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e006c320 0x7f60e01f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 -- 172.21.15.133:0/1711007333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 msgr2=0x7f60e01588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 0x7f60e01588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 -- 172.21.15.133:0/1711007333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e006c320 msgr2=0x7f60e01f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e006c320 0x7f60e01f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 -- 172.21.15.133:0/1711007333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0009420 con 0x7f60e00ca000 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60deffd640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e006c320 0x7f60e01f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d67fc640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e00ca000 0x7f60e01583b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f60c800c3a0 tx=0x7f60c800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d7fff640 1 -- 172.21.15.133:0/1711007333 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c8005cf0 con 0x7f60e00ca000 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d7fff640 1 -- 172.21.15.133:0/1711007333 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c8005e50 con 0x7f60e00ca000 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d7fff640 1 -- 172.21.15.133:0/1711007333 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c80072d0 con 0x7f60e00ca000 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e0159210 con 0x7f60e00ca000 2023-12-18T10:24:07.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e01f5d90 con 0x7f60e00ca000 2023-12-18T10:24:07.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e00735b0 con 0x7f60e00ca000 2023-12-18T10:24:07.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d7fff640 1 -- 172.21.15.133:0/1711007333 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f60c8007430 con 0x7f60e00ca000 2023-12-18T10:24:07.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.566+0000 7f60d7fff640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f60c4065a60 0x7f60c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.570+0000 7f60d7fff640 1 -- 172.21.15.133:0/1711007333 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f60c8082700 con 0x7f60e00ca000 2023-12-18T10:24:07.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.570+0000 7f60deffd640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f60c4065a60 0x7f60c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.570+0000 7f60deffd640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f60c4065a60 0x7f60c4067f20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f60d00ae000 tx=0x7f60d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.570+0000 7f60d7fff640 1 -- 172.21.15.133:0/1711007333 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f60c80500c0 con 0x7f60e00ca000 2023-12-18T10:24:07.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.722+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e00cb150 con 0x7f60e00ca000 2023-12-18T10:24:07.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.722+0000 7f60d7fff640 1 -- 172.21.15.133:0/1711007333 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16297 (secure 0 0 0) 0x7f60e00cb150 con 0x7f60e00ca000 2023-12-18T10:24:07.723 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:07.723 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":91,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:24:04.651633+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:24:02.009135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-18T10:24:02.637830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:24:07.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f60c4065a60 msgr2=0x7f60c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f60c4065a60 0x7f60c4067f20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f60d00ae000 tx=0x7f60d0008040 comp rx=0 tx=0).stop 2023-12-18T10:24:07.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e00ca000 msgr2=0x7f60e01583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e00ca000 0x7f60e01583b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f60c800c3a0 tx=0x7f60c800c860 comp rx=0 tx=0).stop 2023-12-18T10:24:07.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 shutdown_connections 2023-12-18T10:24:07.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f60c4065a60 0x7f60c4067f20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f60e01570c0 0x7f60e01588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e00ca000 0x7f60e01583b0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 --2- 172.21.15.133:0/1711007333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e006c320 0x7f60e01f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 >> 172.21.15.133:0/1711007333 conn(0x7f60e006a3e0 msgr2=0x7f60e0152750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:07.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 shutdown_connections 2023-12-18T10:24:07.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.726+0000 7f60e53f3640 1 -- 172.21.15.133:0/1711007333 wait complete. 2023-12-18T10:24:07.745 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-18T10:24:07.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:24:07.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.882+0000 7f987ba8c640 1 Processor -- start 2023-12-18T10:24:07.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.882+0000 7f987ba8c640 1 -- start start 2023-12-18T10:24:07.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f987ba8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987406c4f0 0x7f98740c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f987ba8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f98740c9e30 0x7f9874070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f987ba8c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98740c9460 con 0x7f98741570c0 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f987ba8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98741574a0 con 0x7f98740c9e30 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f987ba8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98740c8b30 con 0x7f987406c4f0 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f987a029640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f98740c9e30 0x7f9874070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f9879027640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987406c4f0 0x7f98740c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f9879027640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987406c4f0 0x7f98740c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:41864/0 (socket says 172.21.15.133:41864) 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f9879027640 1 -- 172.21.15.133:0/945954890 learned_addr learned my addr 172.21.15.133:0/945954890 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f987a029640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f98740c9e30 0x7f9874070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:59184/0 (socket says 172.21.15.133:59184) 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f9879027640 1 -- 172.21.15.133:0/945954890 >> v2:172.21.15.142:3300/0 conn(0x7f98740c9e30 msgr2=0x7f9874070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f9879027640 1 --2- 172.21.15.133:0/945954890 >> v2:172.21.15.142:3300/0 conn(0x7f98740c9e30 0x7f9874070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f9879027640 1 -- 172.21.15.133:0/945954890 >> v1:172.21.15.142:6789/0 conn(0x7f98741570c0 legacy=0x7f987406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.886+0000 7f9879027640 1 -- 172.21.15.133:0/945954890 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740c8e10 con 0x7f987406c4f0 2023-12-18T10:24:07.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f9879027640 1 --2- 172.21.15.133:0/945954890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987406c4f0 0x7f98740c98f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9864009870 tx=0x7f986401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3224f00be5843e34 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f9878826640 1 -- 172.21.15.133:0/945954890 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a9400 con 0x7f987406c4f0 2023-12-18T10:24:07.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f9878826640 1 -- 172.21.15.133:0/945954890 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98640a9560 con 0x7f987406c4f0 2023-12-18T10:24:07.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f9878826640 1 -- 172.21.15.133:0/945954890 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a98f0 con 0x7f987406c4f0 2023-12-18T10:24:07.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 -- 172.21.15.133:0/945954890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987406c4f0 msgr2=0x7f98740c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 --2- 172.21.15.133:0/945954890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987406c4f0 0x7f98740c98f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9864009870 tx=0x7f986401c540 comp rx=0 tx=0).stop 2023-12-18T10:24:07.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 -- 172.21.15.133:0/945954890 shutdown_connections 2023-12-18T10:24:07.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 --2- 172.21.15.133:0/945954890 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f987406c4f0 0x7f98740c98f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 --2- 172.21.15.133:0/945954890 >> v2:172.21.15.142:3300/0 conn(0x7f98740c9e30 0x7f9874070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 -- 172.21.15.133:0/945954890 >> 172.21.15.133:0/945954890 conn(0x7f987406a3e0 msgr2=0x7f98740afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:07.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 -- 172.21.15.133:0/945954890 shutdown_connections 2023-12-18T10:24:07.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 -- 172.21.15.133:0/945954890 wait complete. 2023-12-18T10:24:07.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.890+0000 7f987ba8c640 1 Processor -- start 2023-12-18T10:24:07.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 -- start start 2023-12-18T10:24:07.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987406c4f0 0x7f98741507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98740c9e30 0x7f98740c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98741570c0 0x7f98740c1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9874150d30 con 0x7f98741570c0 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741484f0 con 0x7f987406c4f0 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987415a570 con 0x7f98740c9e30 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98741570c0 0x7f98740c1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98741570c0 0x7f98740c1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33396/0 (socket says 172.21.15.133:33396) 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 -- 172.21.15.133:0/2472140153 learned_addr learned my addr 172.21.15.133:0/2472140153 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f9879828640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987406c4f0 0x7f98741507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f9879027640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98740c9e30 0x7f98740c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 -- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98740c9e30 msgr2=0x7f98740c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98740c9e30 0x7f98740c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 -- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987406c4f0 msgr2=0x7f98741507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:07.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987406c4f0 0x7f98741507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:07.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 -- 172.21.15.133:0/2472140153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98640094d0 con 0x7f98741570c0 2023-12-18T10:24:07.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f9879828640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987406c4f0 0x7f98741507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:07.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987a029640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98741570c0 0x7f98740c1e90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f986c00efc0 tx=0x7f986c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f986a7fc640 1 -- 172.21.15.133:0/2472140153 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c014480 con 0x7f98741570c0 2023-12-18T10:24:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f986a7fc640 1 -- 172.21.15.133:0/2472140153 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c00f040 con 0x7f98741570c0 2023-12-18T10:24:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f986a7fc640 1 -- 172.21.15.133:0/2472140153 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c014820 con 0x7f98741570c0 2023-12-18T10:24:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98740ca670 con 0x7f98741570c0 2023-12-18T10:24:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9874151200 con 0x7f98741570c0 2023-12-18T10:24:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.894+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98740735b0 con 0x7f98741570c0 2023-12-18T10:24:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.898+0000 7f986a7fc640 1 -- 172.21.15.133:0/2472140153 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f986c014980 con 0x7f98741570c0 2023-12-18T10:24:07.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.898+0000 7f986a7fc640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:07.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.898+0000 7f986a7fc640 1 -- 172.21.15.133:0/2472140153 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f986c083d60 con 0x7f98741570c0 2023-12-18T10:24:07.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.898+0000 7f9879828640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:07.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.898+0000 7f9879828640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9870007fd0 tx=0x7f9870009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:07.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:07.902+0000 7f986a7fc640 1 -- 172.21.15.133:0/2472140153 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f986c0515f0 con 0x7f98741570c0 2023-12-18T10:24:08.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.050+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98740ca8a0 con 0x7f9858065a60 2023-12-18T10:24:08.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.058+0000 7f986a7fc640 1 -- 172.21.15.133:0/2472140153 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278582 (secure 0 0 0) 0x7f9870001cc0 con 0x7f9858065a60 2023-12-18T10:24:08.062 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:08.063 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:24:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 msgr2=0x7f9858067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9870007fd0 tx=0x7f9870009040 comp rx=0 tx=0).stop 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98741570c0 msgr2=0x7f98740c1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98741570c0 0x7f98740c1e90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f986c00efc0 tx=0x7f986c00c490 comp rx=0 tx=0).stop 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 shutdown_connections 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98741570c0 0x7f98740c1e90 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98740c9e30 0x7f98740c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 --2- 172.21.15.133:0/2472140153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987406c4f0 0x7f98741507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 >> 172.21.15.133:0/2472140153 conn(0x7f987406a3e0 msgr2=0x7f98740ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 shutdown_connections 2023-12-18T10:24:08.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.062+0000 7f987ba8c640 1 -- 172.21.15.133:0/2472140153 wait complete. 2023-12-18T10:24:08.081 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2023-12-18T10:24:07.172901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257988,"kb_used_data":9604,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716732,"statfs":{"total":773094113280,"available":772829933568,"internally_reserved":0,"allocated":9834496,"data_stored":5123701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921265"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.263166+0000","last_change":"2023-12-18T10:24:02.263166+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.263166+0000","last_undegraded":"2023-12-18T10:24:02.263166+0000","last_fullsized":"2023-12-18T10:24:02.263166+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:08:11.656004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.265424+0000","last_change":"2023-12-18T10:24:02.265424+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.265424+0000","last_undegraded":"2023-12-18T10:24:02.265424+0000","last_fullsized":"2023-12-18T10:24:02.265424+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:02.334119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258239+0000","last_change":"2023-12-18T10:24:02.258239+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258239+0000","last_undegraded":"2023-12-18T10:24:02.258239+0000","last_fullsized":"2023-12-18T10:24:02.258239+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:58:29.376027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.263112+0000","last_change":"2023-12-18T10:24:02.263112+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.263112+0000","last_undegraded":"2023-12-18T10:24:02.263112+0000","last_fullsized":"2023-12-18T10:24:02.263112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:04:22.904429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264863+0000","last_change":"2023-12-18T10:24:02.264863+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264863+0000","last_undegraded":"2023-12-18T10:24:02.264863+0000","last_fullsized":"2023-12-18T10:24:02.264863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257145+0000","last_change":"2023-12-18T10:24:02.257145+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257145+0000","last_undegraded":"2023-12-18T10:24:02.257145+0000","last_fullsized":"2023-12-18T10:24:02.257145+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:04:01.282465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254021+0000","last_change":"2023-12-18T10:24:02.254021+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254021+0000","last_undegraded":"2023-12-18T10:24:02.254021+0000","last_fullsized":"2023-12-18T10:24:02.254021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:43.485098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258982+0000","last_change":"2023-12-18T10:24:02.258982+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258982+0000","last_undegraded":"2023-12-18T10:24:02.258982+0000","last_fullsized":"2023-12-18T10:24:02.258982+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.259431+0000","last_change":"2023-12-18T10:24:02.259431+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.259431+0000","last_undegraded":"2023-12-18T10:24:02.259431+0000","last_fullsized":"2023-12-18T10:24:02.259431+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:37:23.747065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254013+0000","last_change":"2023-12-18T10:24:02.254013+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254013+0000","last_undegraded":"2023-12-18T10:24:02.254013+0000","last_fullsized":"2023-12-18T10:24:02.254013+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:53.568002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.266031+0000","last_change":"2023-12-18T10:24:02.266031+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.266031+0000","last_undegraded":"2023-12-18T10:24:02.266031+0000","last_fullsized":"2023-12-18T10:24:02.266031+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:20.153111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260300+0000","last_change":"2023-12-18T10:24:02.260300+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260300+0000","last_undegraded":"2023-12-18T10:24:02.260300+0000","last_fullsized":"2023-12-18T10:24:02.260300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:51:34.076185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258161+0000","last_change":"2023-12-18T10:24:02.258161+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258161+0000","last_undegraded":"2023-12-18T10:24:02.258161+0000","last_fullsized":"2023-12-18T10:24:02.258161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260304+0000","last_change":"2023-12-18T10:24:02.260304+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260304+0000","last_undegraded":"2023-12-18T10:24:02.260304+0000","last_fullsized":"2023-12-18T10:24:02.260304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:55.218379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257136+0000","last_change":"2023-12-18T10:24:02.257136+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257136+0000","last_undegraded":"2023-12-18T10:24:02.257136+0000","last_fullsized":"2023-12-18T10:24:02.257136+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:21.447878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257099+0000","last_change":"2023-12-18T10:24:02.257099+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257099+0000","last_undegraded":"2023-12-18T10:24:02.257099+0000","last_fullsized":"2023-12-18T10:24:02.257099+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:28:44.825382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262569+0000","last_change":"2023-12-18T10:24:02.262569+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262569+0000","last_undegraded":"2023-12-18T10:24:02.262569+0000","last_fullsized":"2023-12-18T10:24:02.262569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:55.131352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258282+0000","last_change":"2023-12-18T10:24:02.258282+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258282+0000","last_undegraded":"2023-12-18T10:24:02.258282+0000","last_fullsized":"2023-12-18T10:24:02.258282+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:33:48.009673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.265516+0000","last_change":"2023-12-18T10:24:02.265516+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.265516+0000","last_undegraded":"2023-12-18T10:24:02.265516+0000","last_fullsized":"2023-12-18T10:24:02.265516+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258846+0000","last_change":"2023-12-18T10:24:02.258846+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258846+0000","last_undegraded":"2023-12-18T10:24:02.258846+0000","last_fullsized":"2023-12-18T10:24:02.258846+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:22:32.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254886+0000","last_change":"2023-12-18T10:24:02.254886+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254886+0000","last_undegraded":"2023-12-18T10:24:02.254886+0000","last_fullsized":"2023-12-18T10:24:02.254886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:43:26.508524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258538+0000","last_change":"2023-12-18T10:24:02.258538+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258538+0000","last_undegraded":"2023-12-18T10:24:02.258538+0000","last_fullsized":"2023-12-18T10:24:02.258538+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:02:35.397564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254944+0000","last_change":"2023-12-18T10:24:02.254944+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254944+0000","last_undegraded":"2023-12-18T10:24:02.254944+0000","last_fullsized":"2023-12-18T10:24:02.254944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:15:11.695579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258219+0000","last_change":"2023-12-18T10:24:02.258219+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258219+0000","last_undegraded":"2023-12-18T10:24:02.258219+0000","last_fullsized":"2023-12-18T10:24:02.258219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264857+0000","last_change":"2023-12-18T10:24:02.264857+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264857+0000","last_undegraded":"2023-12-18T10:24:02.264857+0000","last_fullsized":"2023-12-18T10:24:02.264857+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264945+0000","last_change":"2023-12-18T10:24:02.264945+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264945+0000","last_undegraded":"2023-12-18T10:24:02.264945+0000","last_fullsized":"2023-12-18T10:24:02.264945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262562+0000","last_change":"2023-12-18T10:24:02.262562+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262562+0000","last_undegraded":"2023-12-18T10:24:02.262562+0000","last_fullsized":"2023-12-18T10:24:02.262562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:01:00.828132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260280+0000","last_change":"2023-12-18T10:24:02.260280+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260280+0000","last_undegraded":"2023-12-18T10:24:02.260280+0000","last_fullsized":"2023-12-18T10:24:02.260280+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:40.810447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258917+0000","last_change":"2023-12-18T10:24:02.258917+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258917+0000","last_undegraded":"2023-12-18T10:24:02.258917+0000","last_fullsized":"2023-12-18T10:24:02.258917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:46:44.625658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262402+0000","last_change":"2023-12-18T10:24:02.262402+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262402+0000","last_undegraded":"2023-12-18T10:24:02.262402+0000","last_fullsized":"2023-12-18T10:24:02.262402+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:49:26.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258161+0000","last_change":"2023-12-18T10:24:02.258161+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258161+0000","last_undegraded":"2023-12-18T10:24:02.258161+0000","last_fullsized":"2023-12-18T10:24:02.258161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257194+0000","last_change":"2023-12-18T10:24:02.257194+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257194+0000","last_undegraded":"2023-12-18T10:24:02.257194+0000","last_fullsized":"2023-12-18T10:24:02.257194+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:06:25.659280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":219,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-18T10:24:00.251718+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:24:00.251718+0000","last_peered":"2023-12-18T10:24:00.251718+0000","last_clean":"2023-12-18T10:24:00.251718+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:24:00.251718+0000","last_undegraded":"2023-12-18T10:24:00.251718+0000","last_fullsized":"2023-12-18T10:24:00.251718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1679360,"data_stored":1085540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.627}]},{"osd":2,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.53700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90900000000000003,"5min":1.137,"15min":1.137},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.81399999999999995},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89500000000000002,"5min":0.93100000000000005,"15min":4.3760000000000003},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.85499999999999998},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":0.91400000000000003,"5min":0.98299999999999998,"15min":4.4669999999999996},"last":0.92600000000000005}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":4.524},"last":0.88300000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71499999999999997,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92300000000000004,"5min":0.97699999999999998,"15min":2.2709999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.925},"last":0.80700000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.81399999999999995},"min":{"1min":0.60999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70399999999999996,"15min":0.86299999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.90500000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.054},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.101},"last":0.628}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.284},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0880000000000001,"15min":1.129},"last":0.754},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69899999999999995,"15min":0.749},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0820000000000001},"last":0.77300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.67000000000000004},"min":{"1min":0.37,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68200000000000005,"15min":0.748},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.752},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.77000000000000002},"min":{"1min":0.499,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70699999999999996,"15min":0.79200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81200000000000006,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.91700000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.81999999999999995,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.72299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90600000000000003,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.94499999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.71799999999999997,"15min":0.94899999999999995},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65800000000000003,"15min":0.754},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88500000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.876},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67300000000000004,"15min":0.78200000000000003},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":0.81299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88600000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":1.0900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92800000000000005,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.85799999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.131,"15min":1.131},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.83999999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.52200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92900000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":1.008,"5min":1.032,"15min":1.032},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70999999999999996,"15min":0.71899999999999997},"min":{"1min":0.56699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96599999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.89800000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.435,"15min":0.435},"max":{"1min":0.77800000000000002,"5min":0.874,"15min":0.874},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.073,"15min":1.073},"last":1.0109999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.71399999999999997},"min":{"1min":0.51600000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.503},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.65800000000000003,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.46700000000000003},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.49199999999999999,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76000000000000001,"5min":1.036,"15min":1.254},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":0.72199999999999998,"5min":0.98899999999999999,"15min":1.772},"last":0.67600000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.98099999999999998,"15min":1.01},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":1.167,"15min":1.181},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71499999999999997,"15min":0.746},"min":{"1min":0.53700000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":1.171,"15min":1.171},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68100000000000005,"15min":0.70699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80000000000000004,"5min":1.0549999999999999,"15min":1.069},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73299999999999998,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85499999999999998,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.77900000000000003},"min":{"1min":0.55700000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.81299999999999994,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.82999999999999996,"5min":1.26,"15min":1.26},"last":0.626}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.432,"15min":0.442},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66000000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.50600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.5},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.629,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.79700000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97699999999999998,"5min":1.698,"15min":1.698},"last":0.878},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.622,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89700000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93400000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54600000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.85999999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.94799999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.0189999999999999,"5min":1.341,"15min":1.341},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.107,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.745,"15min":0.78700000000000003},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.93999999999999995,"5min":1.282,"15min":1.282},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.41699999999999998,"15min":0.57499999999999996},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.48999999999999999,"5min":1.7150000000000001,"15min":3.976},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.442,"15min":0.503},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47299999999999998,"15min":0.61399999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":3.2370000000000001,"15min":3.786},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47999999999999998,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86799999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.64900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93100000000000005,"5min":2.1589999999999998,"15min":3.6400000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.63900000000000001},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91800000000000004,"5min":1.9399999999999999,"15min":3.2440000000000002},"last":0.67900000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.79800000000000004},"min":{"1min":0.56200000000000006,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93000000000000005,"5min":1.7889999999999999,"15min":1.851},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72999999999999998,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.6539999999999999,"15min":4.5129999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.874,"5min":1.6100000000000001,"15min":4.1859999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74399999999999999,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98299999999999998,"5min":1.823,"15min":2.0699999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.91300000000000003},"min":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.47099999999999997},"max":{"1min":0.93999999999999995,"5min":1.6850000000000001,"15min":4.3529999999999998},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91000000000000003,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.623},{"interface":"front","average":{"1min":0.754,"5min":0.76600000000000001,"15min":0.82199999999999995},"min":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.04,"5min":1.8799999999999999,"15min":1.9770000000000001},"last":0.88}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1679360,"data_stored":1085540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44400000000000001,"15min":0.48499999999999999},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82999999999999996,"5min":0.92900000000000005,"15min":1.456},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.53500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":1.0589999999999999,"15min":1.595},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.57099999999999995},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68400000000000005,"5min":0.748,"15min":2.464},"last":0.54600000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.52700000000000002},"min":{"1min":0.309,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.859},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.621},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.90000000000000002,"15min":1.903},"last":0.64800000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0760000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.93500000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77200000000000002,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.2589999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.746,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.79500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.278,"15min":1.5700000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.0389999999999999,"15min":1.53},"last":0.76500000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":1.349,"15min":1.556},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.032,"15min":1.2909999999999999},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:24:08.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:24:08.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393fbbe640 1 Processor -- start 2023-12-18T10:24:08.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393fbbe640 1 -- start start 2023-12-18T10:24:08.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393fbbe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f393815c860 0x7f39380d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393fbbe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380cddc0 con 0x7f39380ce250 2023-12-18T10:24:08.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393fbbe640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380cffa0 con 0x7f393815cc40 2023-12-18T10:24:08.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393fbbe640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39380cd770 con 0x7f393815c860 2023-12-18T10:24:08.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393e15b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f39380ce250 0x7f39380d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58876/0 (socket says 172.21.15.133:58876) 2023-12-18T10:24:08.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393e15b640 1 -- 172.21.15.133:0/3211152019 learned_addr learned my addr 172.21.15.133:0/3211152019 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:08.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393d95a640 1 --2- 172.21.15.133:0/3211152019 >> v2:172.21.15.142:3300/0 conn(0x7f393815c860 0x7f39380d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393c958640 1 -- 172.21.15.133:0/3211152019 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333063523 0 0) 0x7f39380cddc0 con 0x7f39380ce250 2023-12-18T10:24:08.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393c958640 1 -- 172.21.15.133:0/3211152019 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3924003530 con 0x7f39380ce250 2023-12-18T10:24:08.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393c958640 1 -- 172.21.15.133:0/3211152019 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2850842264 0 0) 0x7f3924003530 con 0x7f39380ce250 2023-12-18T10:24:08.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393d95a640 1 -- 172.21.15.133:0/3211152019 >> v1:172.21.15.142:6789/0 conn(0x7f393815cc40 legacy=0x7f39380cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393d95a640 1 -- 172.21.15.133:0/3211152019 >> v1:172.21.15.133:6789/0 conn(0x7f39380ce250 legacy=0x7f39380d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.262+0000 7f393d95a640 1 -- 172.21.15.133:0/3211152019 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380cda50 con 0x7f393815c860 2023-12-18T10:24:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393d95a640 1 --2- 172.21.15.133:0/3211152019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815c860 0x7f39380d2da0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f39340097a0 tx=0x7f393401eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e86487fe9eac58d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:08.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393c958640 1 -- 172.21.15.133:0/3211152019 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930001a00 con 0x7f393815c860 2023-12-18T10:24:08.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393c958640 1 -- 172.21.15.133:0/3211152019 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340a85f0 con 0x7f393815c860 2023-12-18T10:24:08.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393c958640 1 -- 172.21.15.133:0/3211152019 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340a8980 con 0x7f393815c860 2023-12-18T10:24:08.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393fbbe640 1 -- 172.21.15.133:0/3211152019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815c860 msgr2=0x7f39380d2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393fbbe640 1 --2- 172.21.15.133:0/3211152019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815c860 0x7f39380d2da0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f39340097a0 tx=0x7f393401eb70 comp rx=0 tx=0).stop 2023-12-18T10:24:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393fbbe640 1 -- 172.21.15.133:0/3211152019 shutdown_connections 2023-12-18T10:24:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393fbbe640 1 --2- 172.21.15.133:0/3211152019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815c860 0x7f39380d2da0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393fbbe640 1 -- 172.21.15.133:0/3211152019 >> 172.21.15.133:0/3211152019 conn(0x7f3938089fb0 msgr2=0x7f393809baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393fbbe640 1 -- 172.21.15.133:0/3211152019 shutdown_connections 2023-12-18T10:24:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.266+0000 7f393fbbe640 1 -- 172.21.15.133:0/3211152019 wait complete. 2023-12-18T10:24:08.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 Processor -- start 2023-12-18T10:24:08.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 -- start start 2023-12-18T10:24:08.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39380ce250 0x7f39380b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f393815c860 0x7f39380b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815cc40 0x7f39380b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380b5ef0 con 0x7f39380ce250 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380b61d0 con 0x7f393815cc40 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380b64b0 con 0x7f393815c860 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39380ce250 0x7f39380b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39380ce250 0x7f39380b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33406/0 (socket says 172.21.15.133:33406) 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 -- 172.21.15.133:0/1908863602 learned_addr learned my addr 172.21.15.133:0/1908863602 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393e15b640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815cc40 0x7f39380b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d159640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f393815c860 0x7f39380b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 -- 172.21.15.133:0/1908863602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f393815c860 msgr2=0x7f39380b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f393815c860 0x7f39380b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 -- 172.21.15.133:0/1908863602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815cc40 msgr2=0x7f39380b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815cc40 0x7f39380b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 -- 172.21.15.133:0/1908863602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340093b0 con 0x7f39380ce250 2023-12-18T10:24:08.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393d95a640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39380ce250 0x7f39380b7d90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f3934009890 tx=0x7f393401b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:08.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f392e7fc640 1 -- 172.21.15.133:0/1908863602 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934005ba0 con 0x7f39380ce250 2023-12-18T10:24:08.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f392e7fc640 1 -- 172.21.15.133:0/1908863602 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934005d00 con 0x7f39380ce250 2023-12-18T10:24:08.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f392e7fc640 1 -- 172.21.15.133:0/1908863602 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340b0870 con 0x7f39380ce250 2023-12-18T10:24:08.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39380b6790 con 0x7f39380ce250 2023-12-18T10:24:08.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.270+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39380c7770 con 0x7f39380ce250 2023-12-18T10:24:08.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.274+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393804e000 con 0x7f39380ce250 2023-12-18T10:24:08.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.274+0000 7f392e7fc640 1 -- 172.21.15.133:0/1908863602 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39340b7040 con 0x7f39380ce250 2023-12-18T10:24:08.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.274+0000 7f392e7fc640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f391c065a60 0x7f391c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.274+0000 7f392e7fc640 1 -- 172.21.15.133:0/1908863602 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f393411fc70 con 0x7f39380ce250 2023-12-18T10:24:08.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.274+0000 7f393d159640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f391c065a60 0x7f391c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.274+0000 7f393d159640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f391c065a60 0x7f391c067f20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f39380cb610 tx=0x7f3928009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:08.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.278+0000 7f392e7fc640 1 -- 172.21.15.133:0/1908863602 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39340ed4e0 con 0x7f39380ce250 2023-12-18T10:24:08.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.426+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39380ce6a0 con 0x7f391c065a60 2023-12-18T10:24:08.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.434+0000 7f392e7fc640 1 -- 172.21.15.133:0/1908863602 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278582 (secure 0 0 0) 0x7f3928001380 con 0x7f391c065a60 2023-12-18T10:24:08.437 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:08.438 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:24:08.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f391c065a60 msgr2=0x7f391c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f391c065a60 0x7f391c067f20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f39380cb610 tx=0x7f3928009040 comp rx=0 tx=0).stop 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39380ce250 msgr2=0x7f39380b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39380ce250 0x7f39380b7d90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f3934009890 tx=0x7f393401b910 comp rx=0 tx=0).stop 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 shutdown_connections 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f391c065a60 0x7f391c067f20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f393815cc40 0x7f39380b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f393815c860 0x7f39380b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 --2- 172.21.15.133:0/1908863602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39380ce250 0x7f39380b7d90 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 >> 172.21.15.133:0/1908863602 conn(0x7f3938089fb0 msgr2=0x7f393815f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 shutdown_connections 2023-12-18T10:24:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.438+0000 7f393fbbe640 1 -- 172.21.15.133:0/1908863602 wait complete. 2023-12-18T10:24:08.457 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2023-12-18T10:24:07.172901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257988,"kb_used_data":9604,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716732,"statfs":{"total":773094113280,"available":772829933568,"internally_reserved":0,"allocated":9834496,"data_stored":5123701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921265"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.263166+0000","last_change":"2023-12-18T10:24:02.263166+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.263166+0000","last_undegraded":"2023-12-18T10:24:02.263166+0000","last_fullsized":"2023-12-18T10:24:02.263166+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:08:11.656004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.265424+0000","last_change":"2023-12-18T10:24:02.265424+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.265424+0000","last_undegraded":"2023-12-18T10:24:02.265424+0000","last_fullsized":"2023-12-18T10:24:02.265424+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:02.334119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258239+0000","last_change":"2023-12-18T10:24:02.258239+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258239+0000","last_undegraded":"2023-12-18T10:24:02.258239+0000","last_fullsized":"2023-12-18T10:24:02.258239+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:58:29.376027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.263112+0000","last_change":"2023-12-18T10:24:02.263112+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.263112+0000","last_undegraded":"2023-12-18T10:24:02.263112+0000","last_fullsized":"2023-12-18T10:24:02.263112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:04:22.904429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264863+0000","last_change":"2023-12-18T10:24:02.264863+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264863+0000","last_undegraded":"2023-12-18T10:24:02.264863+0000","last_fullsized":"2023-12-18T10:24:02.264863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257145+0000","last_change":"2023-12-18T10:24:02.257145+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257145+0000","last_undegraded":"2023-12-18T10:24:02.257145+0000","last_fullsized":"2023-12-18T10:24:02.257145+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:04:01.282465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254021+0000","last_change":"2023-12-18T10:24:02.254021+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254021+0000","last_undegraded":"2023-12-18T10:24:02.254021+0000","last_fullsized":"2023-12-18T10:24:02.254021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:43.485098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258982+0000","last_change":"2023-12-18T10:24:02.258982+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258982+0000","last_undegraded":"2023-12-18T10:24:02.258982+0000","last_fullsized":"2023-12-18T10:24:02.258982+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.259431+0000","last_change":"2023-12-18T10:24:02.259431+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.259431+0000","last_undegraded":"2023-12-18T10:24:02.259431+0000","last_fullsized":"2023-12-18T10:24:02.259431+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:37:23.747065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254013+0000","last_change":"2023-12-18T10:24:02.254013+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254013+0000","last_undegraded":"2023-12-18T10:24:02.254013+0000","last_fullsized":"2023-12-18T10:24:02.254013+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:53.568002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.266031+0000","last_change":"2023-12-18T10:24:02.266031+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.266031+0000","last_undegraded":"2023-12-18T10:24:02.266031+0000","last_fullsized":"2023-12-18T10:24:02.266031+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:20.153111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260300+0000","last_change":"2023-12-18T10:24:02.260300+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260300+0000","last_undegraded":"2023-12-18T10:24:02.260300+0000","last_fullsized":"2023-12-18T10:24:02.260300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:51:34.076185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258161+0000","last_change":"2023-12-18T10:24:02.258161+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258161+0000","last_undegraded":"2023-12-18T10:24:02.258161+0000","last_fullsized":"2023-12-18T10:24:02.258161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260304+0000","last_change":"2023-12-18T10:24:02.260304+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260304+0000","last_undegraded":"2023-12-18T10:24:02.260304+0000","last_fullsized":"2023-12-18T10:24:02.260304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:55.218379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257136+0000","last_change":"2023-12-18T10:24:02.257136+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257136+0000","last_undegraded":"2023-12-18T10:24:02.257136+0000","last_fullsized":"2023-12-18T10:24:02.257136+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:21.447878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257099+0000","last_change":"2023-12-18T10:24:02.257099+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257099+0000","last_undegraded":"2023-12-18T10:24:02.257099+0000","last_fullsized":"2023-12-18T10:24:02.257099+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:28:44.825382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262569+0000","last_change":"2023-12-18T10:24:02.262569+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262569+0000","last_undegraded":"2023-12-18T10:24:02.262569+0000","last_fullsized":"2023-12-18T10:24:02.262569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:55.131352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258282+0000","last_change":"2023-12-18T10:24:02.258282+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258282+0000","last_undegraded":"2023-12-18T10:24:02.258282+0000","last_fullsized":"2023-12-18T10:24:02.258282+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:33:48.009673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.265516+0000","last_change":"2023-12-18T10:24:02.265516+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.265516+0000","last_undegraded":"2023-12-18T10:24:02.265516+0000","last_fullsized":"2023-12-18T10:24:02.265516+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258846+0000","last_change":"2023-12-18T10:24:02.258846+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258846+0000","last_undegraded":"2023-12-18T10:24:02.258846+0000","last_fullsized":"2023-12-18T10:24:02.258846+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:22:32.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254886+0000","last_change":"2023-12-18T10:24:02.254886+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254886+0000","last_undegraded":"2023-12-18T10:24:02.254886+0000","last_fullsized":"2023-12-18T10:24:02.254886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:43:26.508524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258538+0000","last_change":"2023-12-18T10:24:02.258538+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258538+0000","last_undegraded":"2023-12-18T10:24:02.258538+0000","last_fullsized":"2023-12-18T10:24:02.258538+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:02:35.397564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254944+0000","last_change":"2023-12-18T10:24:02.254944+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254944+0000","last_undegraded":"2023-12-18T10:24:02.254944+0000","last_fullsized":"2023-12-18T10:24:02.254944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:15:11.695579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258219+0000","last_change":"2023-12-18T10:24:02.258219+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258219+0000","last_undegraded":"2023-12-18T10:24:02.258219+0000","last_fullsized":"2023-12-18T10:24:02.258219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264857+0000","last_change":"2023-12-18T10:24:02.264857+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264857+0000","last_undegraded":"2023-12-18T10:24:02.264857+0000","last_fullsized":"2023-12-18T10:24:02.264857+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264945+0000","last_change":"2023-12-18T10:24:02.264945+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264945+0000","last_undegraded":"2023-12-18T10:24:02.264945+0000","last_fullsized":"2023-12-18T10:24:02.264945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262562+0000","last_change":"2023-12-18T10:24:02.262562+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262562+0000","last_undegraded":"2023-12-18T10:24:02.262562+0000","last_fullsized":"2023-12-18T10:24:02.262562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:01:00.828132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260280+0000","last_change":"2023-12-18T10:24:02.260280+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260280+0000","last_undegraded":"2023-12-18T10:24:02.260280+0000","last_fullsized":"2023-12-18T10:24:02.260280+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:40.810447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258917+0000","last_change":"2023-12-18T10:24:02.258917+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258917+0000","last_undegraded":"2023-12-18T10:24:02.258917+0000","last_fullsized":"2023-12-18T10:24:02.258917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:46:44.625658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262402+0000","last_change":"2023-12-18T10:24:02.262402+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262402+0000","last_undegraded":"2023-12-18T10:24:02.262402+0000","last_fullsized":"2023-12-18T10:24:02.262402+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:49:26.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258161+0000","last_change":"2023-12-18T10:24:02.258161+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258161+0000","last_undegraded":"2023-12-18T10:24:02.258161+0000","last_fullsized":"2023-12-18T10:24:02.258161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257194+0000","last_change":"2023-12-18T10:24:02.257194+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257194+0000","last_undegraded":"2023-12-18T10:24:02.257194+0000","last_fullsized":"2023-12-18T10:24:02.257194+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:06:25.659280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":219,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-18T10:24:00.251718+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:24:00.251718+0000","last_peered":"2023-12-18T10:24:00.251718+0000","last_clean":"2023-12-18T10:24:00.251718+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:24:00.251718+0000","last_undegraded":"2023-12-18T10:24:00.251718+0000","last_fullsized":"2023-12-18T10:24:00.251718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1679360,"data_stored":1085540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.627}]},{"osd":2,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.53700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90900000000000003,"5min":1.137,"15min":1.137},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.81399999999999995},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89500000000000002,"5min":0.93100000000000005,"15min":4.3760000000000003},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.85499999999999998},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":0.91400000000000003,"5min":0.98299999999999998,"15min":4.4669999999999996},"last":0.92600000000000005}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":4.524},"last":0.88300000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71499999999999997,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92300000000000004,"5min":0.97699999999999998,"15min":2.2709999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.925},"last":0.80700000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.81399999999999995},"min":{"1min":0.60999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70399999999999996,"15min":0.86299999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.90500000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.054},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.101},"last":0.628}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.284},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0880000000000001,"15min":1.129},"last":0.754},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69899999999999995,"15min":0.749},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0820000000000001},"last":0.77300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.67000000000000004},"min":{"1min":0.37,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68200000000000005,"15min":0.748},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.752},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.77000000000000002},"min":{"1min":0.499,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70699999999999996,"15min":0.79200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81200000000000006,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.91700000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.81999999999999995,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.72299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90600000000000003,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.94499999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.71799999999999997,"15min":0.94899999999999995},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65800000000000003,"15min":0.754},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88500000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.876},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67300000000000004,"15min":0.78200000000000003},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":0.81299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88600000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":1.0900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92800000000000005,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.85799999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.131,"15min":1.131},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.83999999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.52200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92900000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":1.008,"5min":1.032,"15min":1.032},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70999999999999996,"15min":0.71899999999999997},"min":{"1min":0.56699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96599999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.89800000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.435,"15min":0.435},"max":{"1min":0.77800000000000002,"5min":0.874,"15min":0.874},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.073,"15min":1.073},"last":1.0109999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.71399999999999997},"min":{"1min":0.51600000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.503},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.65800000000000003,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.46700000000000003},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.49199999999999999,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76000000000000001,"5min":1.036,"15min":1.254},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":0.72199999999999998,"5min":0.98899999999999999,"15min":1.772},"last":0.67600000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.98099999999999998,"15min":1.01},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":1.167,"15min":1.181},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71499999999999997,"15min":0.746},"min":{"1min":0.53700000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":1.171,"15min":1.171},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68100000000000005,"15min":0.70699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80000000000000004,"5min":1.0549999999999999,"15min":1.069},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73299999999999998,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85499999999999998,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.77900000000000003},"min":{"1min":0.55700000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.81299999999999994,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.82999999999999996,"5min":1.26,"15min":1.26},"last":0.626}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.432,"15min":0.442},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66000000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.50600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.5},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.629,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.79700000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97699999999999998,"5min":1.698,"15min":1.698},"last":0.878},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.622,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89700000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93400000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54600000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.85999999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.94799999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.0189999999999999,"5min":1.341,"15min":1.341},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.107,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.745,"15min":0.78700000000000003},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.93999999999999995,"5min":1.282,"15min":1.282},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.41699999999999998,"15min":0.57499999999999996},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.48999999999999999,"5min":1.7150000000000001,"15min":3.976},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.442,"15min":0.503},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47299999999999998,"15min":0.61399999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":3.2370000000000001,"15min":3.786},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47999999999999998,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86799999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.64900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93100000000000005,"5min":2.1589999999999998,"15min":3.6400000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.63900000000000001},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91800000000000004,"5min":1.9399999999999999,"15min":3.2440000000000002},"last":0.67900000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.79800000000000004},"min":{"1min":0.56200000000000006,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93000000000000005,"5min":1.7889999999999999,"15min":1.851},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72999999999999998,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.6539999999999999,"15min":4.5129999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.874,"5min":1.6100000000000001,"15min":4.1859999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74399999999999999,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98299999999999998,"5min":1.823,"15min":2.0699999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.91300000000000003},"min":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.47099999999999997},"max":{"1min":0.93999999999999995,"5min":1.6850000000000001,"15min":4.3529999999999998},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91000000000000003,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.623},{"interface":"front","average":{"1min":0.754,"5min":0.76600000000000001,"15min":0.82199999999999995},"min":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.04,"5min":1.8799999999999999,"15min":1.9770000000000001},"last":0.88}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1679360,"data_stored":1085540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44400000000000001,"15min":0.48499999999999999},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82999999999999996,"5min":0.92900000000000005,"15min":1.456},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.53500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":1.0589999999999999,"15min":1.595},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.57099999999999995},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68400000000000005,"5min":0.748,"15min":2.464},"last":0.54600000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.52700000000000002},"min":{"1min":0.309,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.859},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.621},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.90000000000000002,"15min":1.903},"last":0.64800000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0760000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.93500000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77200000000000002,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.2589999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.746,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.79500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.278,"15min":1.5700000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.0389999999999999,"15min":1.53},"last":0.76500000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":1.349,"15min":1.556},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.032,"15min":1.2909999999999999},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:24:08.462 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:24:08.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e11604640 1 Processor -- start 2023-12-18T10:24:08.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e11604640 1 -- start start 2023-12-18T10:24:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e11604640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6e0c0b0460 0x7f6e0c15ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e11604640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e0c15aa10 0x7f6e0c15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e11604640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c15e000 con 0x7f6e0c06fc80 2023-12-18T10:24:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e11604640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c15e5c0 con 0x7f6e0c15aa10 2023-12-18T10:24:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e11604640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c15b4d0 con 0x7f6e0c0b0460 2023-12-18T10:24:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e0c15aa10 0x7f6e0c15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e0c15aa10 0x7f6e0c15ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33420/0 (socket says 172.21.15.133:33420) 2023-12-18T10:24:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0a7fc640 1 -- 172.21.15.133:0/1914355121 learned_addr learned my addr 172.21.15.133:0/1914355121 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0b7fe640 1 --1- 172.21.15.133:0/1914355121 >> v1:172.21.15.133:6789/0 conn(0x7f6e0c06fc80 0x7f6e0c0c87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58890/0 (socket says 172.21.15.133:58890) 2023-12-18T10:24:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0affd640 1 --2- 172.21.15.133:0/1914355121 >> v2:172.21.15.142:3300/0 conn(0x7f6e0c0b0460 0x7f6e0c15ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0a7fc640 1 -- 172.21.15.133:0/1914355121 >> v2:172.21.15.142:3300/0 conn(0x7f6e0c0b0460 msgr2=0x7f6e0c15ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0a7fc640 1 --2- 172.21.15.133:0/1914355121 >> v2:172.21.15.142:3300/0 conn(0x7f6e0c0b0460 0x7f6e0c15ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0a7fc640 1 -- 172.21.15.133:0/1914355121 >> v1:172.21.15.133:6789/0 conn(0x7f6e0c06fc80 legacy=0x7f6e0c0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.642+0000 7f6e0a7fc640 1 -- 172.21.15.133:0/1914355121 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c15b7b0 con 0x7f6e0c15aa10 2023-12-18T10:24:08.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e0a7fc640 1 --2- 172.21.15.133:0/1914355121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c15ae90 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0cdf70 tx=0x7f6e0001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d10f189f29963d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:08.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e09ffb640 1 -- 172.21.15.133:0/1914355121 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000ab660 con 0x7f6e0c15aa10 2023-12-18T10:24:08.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e09ffb640 1 -- 172.21.15.133:0/1914355121 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e000ab7c0 con 0x7f6e0c15aa10 2023-12-18T10:24:08.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e09ffb640 1 -- 172.21.15.133:0/1914355121 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000abb50 con 0x7f6e0c15aa10 2023-12-18T10:24:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e11604640 1 -- 172.21.15.133:0/1914355121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 msgr2=0x7f6e0c15ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e11604640 1 --2- 172.21.15.133:0/1914355121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c15ae90 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0cdf70 tx=0x7f6e0001c440 comp rx=0 tx=0).stop 2023-12-18T10:24:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e11604640 1 -- 172.21.15.133:0/1914355121 shutdown_connections 2023-12-18T10:24:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e11604640 1 --2- 172.21.15.133:0/1914355121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c15ae90 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e11604640 1 --2- 172.21.15.133:0/1914355121 >> v2:172.21.15.142:3300/0 conn(0x7f6e0c0b0460 0x7f6e0c15ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e11604640 1 -- 172.21.15.133:0/1914355121 >> 172.21.15.133:0/1914355121 conn(0x7f6e0c06a2a0 msgr2=0x7f6e0c0cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e11604640 1 -- 172.21.15.133:0/1914355121 shutdown_connections 2023-12-18T10:24:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.646+0000 7f6e11604640 1 -- 172.21.15.133:0/1914355121 wait complete. 2023-12-18T10:24:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 Processor -- start 2023-12-18T10:24:08.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 -- start start 2023-12-18T10:24:08.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e0c06fc80 0x7f6e0c14c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e0c0b0460 0x7f6e0c1f98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c1f9e00 con 0x7f6e0c15aa10 2023-12-18T10:24:08.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0cc2c0 con 0x7f6e0c06fc80 2023-12-18T10:24:08.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0cc5a0 con 0x7f6e0c0b0460 2023-12-18T10:24:08.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c0ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33430/0 (socket says 172.21.15.133:33430) 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 -- 172.21.15.133:0/999191686 learned_addr learned my addr 172.21.15.133:0/999191686 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0a7fc640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e0c0b0460 0x7f6e0c1f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0affd640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e0c06fc80 0x7f6e0c14c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 -- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e0c0b0460 msgr2=0x7f6e0c1f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e0c0b0460 0x7f6e0c1f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 -- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e0c06fc80 msgr2=0x7f6e0c14c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e0c06fc80 0x7f6e0c14c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 -- 172.21.15.133:0/999191686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000094d0 con 0x7f6e0c15aa10 2023-12-18T10:24:08.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0affd640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e0c06fc80 0x7f6e0c14c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:08.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e0b7fe640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c0ca8e0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c700 tx=0x7f6e0400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:08.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6df37fe640 1 -- 172.21.15.133:0/999191686 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400ce10 con 0x7f6e0c15aa10 2023-12-18T10:24:08.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6df37fe640 1 -- 172.21.15.133:0/999191686 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0400a640 con 0x7f6e0c15aa10 2023-12-18T10:24:08.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c070620 con 0x7f6e0c15aa10 2023-12-18T10:24:08.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6df37fe640 1 -- 172.21.15.133:0/999191686 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400a9b0 con 0x7f6e0c15aa10 2023-12-18T10:24:08.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.650+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c0ccb60 con 0x7f6e0c15aa10 2023-12-18T10:24:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.654+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c04e000 con 0x7f6e0c15aa10 2023-12-18T10:24:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.654+0000 7f6df37fe640 1 -- 172.21.15.133:0/999191686 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e0400ab10 con 0x7f6e0c15aa10 2023-12-18T10:24:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.654+0000 7f6df37fe640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6df8065a60 0x7f6df8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.654+0000 7f6df37fe640 1 -- 172.21.15.133:0/999191686 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e040829b0 con 0x7f6e0c15aa10 2023-12-18T10:24:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.654+0000 7f6e0affd640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6df8065a60 0x7f6df8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:08.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.654+0000 7f6e0affd640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6df8065a60 0x7f6df8067f20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007a70 tx=0x7f6dfc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:08.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.658+0000 7f6df37fe640 1 -- 172.21.15.133:0/999191686 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6e040502e0 con 0x7f6e0c15aa10 2023-12-18T10:24:08.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.806+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e0c0cc710 con 0x7f6df8065a60 2023-12-18T10:24:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.810+0000 7f6df37fe640 1 -- 172.21.15.133:0/999191686 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278582 (secure 0 0 0) 0x7f6e0c0cc710 con 0x7f6df8065a60 2023-12-18T10:24:08.814 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:08.815 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:24:08.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6df8065a60 msgr2=0x7f6df8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6df8065a60 0x7f6df8067f20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007a70 tx=0x7f6dfc008040 comp rx=0 tx=0).stop 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 msgr2=0x7f6e0c0ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c0ca8e0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c700 tx=0x7f6e0400cbc0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 shutdown_connections 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6df8065a60 0x7f6df8067f20 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c15aa10 0x7f6e0c0ca8e0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e0c0b0460 0x7f6e0c1f98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 --2- 172.21.15.133:0/999191686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e0c06fc80 0x7f6e0c14c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 >> 172.21.15.133:0/999191686 conn(0x7f6e0c06a2a0 msgr2=0x7f6e0c158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 shutdown_connections 2023-12-18T10:24:08.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:08.814+0000 7f6e11604640 1 -- 172.21.15.133:0/999191686 wait complete. 2023-12-18T10:24:08.834 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2023-12-18T10:24:07.172901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257988,"kb_used_data":9604,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716732,"statfs":{"total":773094113280,"available":772829933568,"internally_reserved":0,"allocated":9834496,"data_stored":5123701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921265"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.263166+0000","last_change":"2023-12-18T10:24:02.263166+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.263166+0000","last_undegraded":"2023-12-18T10:24:02.263166+0000","last_fullsized":"2023-12-18T10:24:02.263166+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:08:11.656004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.265424+0000","last_change":"2023-12-18T10:24:02.265424+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.265424+0000","last_undegraded":"2023-12-18T10:24:02.265424+0000","last_fullsized":"2023-12-18T10:24:02.265424+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:02.334119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258239+0000","last_change":"2023-12-18T10:24:02.258239+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258239+0000","last_undegraded":"2023-12-18T10:24:02.258239+0000","last_fullsized":"2023-12-18T10:24:02.258239+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:58:29.376027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.263112+0000","last_change":"2023-12-18T10:24:02.263112+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.263112+0000","last_undegraded":"2023-12-18T10:24:02.263112+0000","last_fullsized":"2023-12-18T10:24:02.263112+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:04:22.904429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264863+0000","last_change":"2023-12-18T10:24:02.264863+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264863+0000","last_undegraded":"2023-12-18T10:24:02.264863+0000","last_fullsized":"2023-12-18T10:24:02.264863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257145+0000","last_change":"2023-12-18T10:24:02.257145+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257145+0000","last_undegraded":"2023-12-18T10:24:02.257145+0000","last_fullsized":"2023-12-18T10:24:02.257145+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:04:01.282465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254021+0000","last_change":"2023-12-18T10:24:02.254021+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254021+0000","last_undegraded":"2023-12-18T10:24:02.254021+0000","last_fullsized":"2023-12-18T10:24:02.254021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:43.485098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258982+0000","last_change":"2023-12-18T10:24:02.258982+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258982+0000","last_undegraded":"2023-12-18T10:24:02.258982+0000","last_fullsized":"2023-12-18T10:24:02.258982+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.259431+0000","last_change":"2023-12-18T10:24:02.259431+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.259431+0000","last_undegraded":"2023-12-18T10:24:02.259431+0000","last_fullsized":"2023-12-18T10:24:02.259431+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:37:23.747065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254013+0000","last_change":"2023-12-18T10:24:02.254013+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254013+0000","last_undegraded":"2023-12-18T10:24:02.254013+0000","last_fullsized":"2023-12-18T10:24:02.254013+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:53.568002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.266031+0000","last_change":"2023-12-18T10:24:02.266031+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.266031+0000","last_undegraded":"2023-12-18T10:24:02.266031+0000","last_fullsized":"2023-12-18T10:24:02.266031+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:20.153111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260300+0000","last_change":"2023-12-18T10:24:02.260300+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260300+0000","last_undegraded":"2023-12-18T10:24:02.260300+0000","last_fullsized":"2023-12-18T10:24:02.260300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:51:34.076185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258161+0000","last_change":"2023-12-18T10:24:02.258161+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258161+0000","last_undegraded":"2023-12-18T10:24:02.258161+0000","last_fullsized":"2023-12-18T10:24:02.258161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260304+0000","last_change":"2023-12-18T10:24:02.260304+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260304+0000","last_undegraded":"2023-12-18T10:24:02.260304+0000","last_fullsized":"2023-12-18T10:24:02.260304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:55.218379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257136+0000","last_change":"2023-12-18T10:24:02.257136+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257136+0000","last_undegraded":"2023-12-18T10:24:02.257136+0000","last_fullsized":"2023-12-18T10:24:02.257136+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:21.447878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257099+0000","last_change":"2023-12-18T10:24:02.257099+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257099+0000","last_undegraded":"2023-12-18T10:24:02.257099+0000","last_fullsized":"2023-12-18T10:24:02.257099+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:28:44.825382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262569+0000","last_change":"2023-12-18T10:24:02.262569+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262569+0000","last_undegraded":"2023-12-18T10:24:02.262569+0000","last_fullsized":"2023-12-18T10:24:02.262569+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:55.131352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258282+0000","last_change":"2023-12-18T10:24:02.258282+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258282+0000","last_undegraded":"2023-12-18T10:24:02.258282+0000","last_fullsized":"2023-12-18T10:24:02.258282+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:33:48.009673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.265516+0000","last_change":"2023-12-18T10:24:02.265516+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.265516+0000","last_undegraded":"2023-12-18T10:24:02.265516+0000","last_fullsized":"2023-12-18T10:24:02.265516+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258846+0000","last_change":"2023-12-18T10:24:02.258846+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258846+0000","last_undegraded":"2023-12-18T10:24:02.258846+0000","last_fullsized":"2023-12-18T10:24:02.258846+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:22:32.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254886+0000","last_change":"2023-12-18T10:24:02.254886+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254886+0000","last_undegraded":"2023-12-18T10:24:02.254886+0000","last_fullsized":"2023-12-18T10:24:02.254886+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:43:26.508524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258538+0000","last_change":"2023-12-18T10:24:02.258538+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258538+0000","last_undegraded":"2023-12-18T10:24:02.258538+0000","last_fullsized":"2023-12-18T10:24:02.258538+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:02:35.397564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.254944+0000","last_change":"2023-12-18T10:24:02.254944+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.254944+0000","last_undegraded":"2023-12-18T10:24:02.254944+0000","last_fullsized":"2023-12-18T10:24:02.254944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:15:11.695579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258219+0000","last_change":"2023-12-18T10:24:02.258219+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258219+0000","last_undegraded":"2023-12-18T10:24:02.258219+0000","last_fullsized":"2023-12-18T10:24:02.258219+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264857+0000","last_change":"2023-12-18T10:24:02.264857+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264857+0000","last_undegraded":"2023-12-18T10:24:02.264857+0000","last_fullsized":"2023-12-18T10:24:02.264857+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.264945+0000","last_change":"2023-12-18T10:24:02.264945+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.264945+0000","last_undegraded":"2023-12-18T10:24:02.264945+0000","last_fullsized":"2023-12-18T10:24:02.264945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262562+0000","last_change":"2023-12-18T10:24:02.262562+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262562+0000","last_undegraded":"2023-12-18T10:24:02.262562+0000","last_fullsized":"2023-12-18T10:24:02.262562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:01:00.828132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.260280+0000","last_change":"2023-12-18T10:24:02.260280+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.260280+0000","last_undegraded":"2023-12-18T10:24:02.260280+0000","last_fullsized":"2023-12-18T10:24:02.260280+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:40.810447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258917+0000","last_change":"2023-12-18T10:24:02.258917+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258917+0000","last_undegraded":"2023-12-18T10:24:02.258917+0000","last_fullsized":"2023-12-18T10:24:02.258917+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:46:44.625658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.262402+0000","last_change":"2023-12-18T10:24:02.262402+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.262402+0000","last_undegraded":"2023-12-18T10:24:02.262402+0000","last_fullsized":"2023-12-18T10:24:02.262402+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:49:26.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.258161+0000","last_change":"2023-12-18T10:24:02.258161+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.258161+0000","last_undegraded":"2023-12-18T10:24:02.258161+0000","last_fullsized":"2023-12-18T10:24:02.258161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:24:03.251788+0000","last_change":"2023-12-18T10:24:03.251788+0000","last_active":"2023-12-18T10:24:03.251788+0000","last_peered":"2023-12-18T10:24:03.251788+0000","last_clean":"2023-12-18T10:24:03.251788+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:03.251788+0000","last_undegraded":"2023-12-18T10:24:03.251788+0000","last_fullsized":"2023-12-18T10:24:03.251788+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":88,"state":"creating+peering","last_fresh":"2023-12-18T10:24:02.257194+0000","last_change":"2023-12-18T10:24:02.257194+0000","last_active":"2023-12-18T10:24:02.247092+0000","last_peered":"2023-12-18T10:24:02.247092+0000","last_clean":"2023-12-18T10:24:02.247092+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:24:02.257194+0000","last_undegraded":"2023-12-18T10:24:02.257194+0000","last_fullsized":"2023-12-18T10:24:02.257194+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:06:25.659280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":219,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-12-18T10:24:00.251718+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:24:00.251718+0000","last_peered":"2023-12-18T10:24:00.251718+0000","last_clean":"2023-12-18T10:24:00.251718+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:24:00.251718+0000","last_undegraded":"2023-12-18T10:24:00.251718+0000","last_fullsized":"2023-12-18T10:24:00.251718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1679360,"data_stored":1085540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.627}]},{"osd":2,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61399999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.53700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90900000000000003,"5min":1.137,"15min":1.137},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.80100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.81399999999999995},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89500000000000002,"5min":0.93100000000000005,"15min":4.3760000000000003},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.85499999999999998},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":0.91400000000000003,"5min":0.98299999999999998,"15min":4.4669999999999996},"last":0.92600000000000005}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":4.524},"last":0.88300000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71499999999999997,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92300000000000004,"5min":0.97699999999999998,"15min":2.2709999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.925},"last":0.80700000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.81399999999999995},"min":{"1min":0.60999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70399999999999996,"15min":0.86299999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.90500000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.054},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.101},"last":0.628}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.284},"last":0.59899999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0880000000000001,"15min":1.129},"last":0.754},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69899999999999995,"15min":0.749},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0820000000000001},"last":0.77300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64600000000000002,"15min":0.67000000000000004},"min":{"1min":0.37,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.873,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68200000000000005,"15min":0.748},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68400000000000005,"15min":0.752},"min":{"1min":0.38300000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.84399999999999997,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.66400000000000003,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83699999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69299999999999995,"15min":0.77000000000000002},"min":{"1min":0.499,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70699999999999996,"15min":0.79200000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.81200000000000006,"5min":3.2730000000000001,"15min":3.2730000000000001},"last":0.91700000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.81999999999999995,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.72299999999999998,"15min":0.81699999999999995},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90600000000000003,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":0.94499999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.71799999999999997,"15min":0.94899999999999995},"min":{"1min":0.374,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80300000000000005,"5min":8.9740000000000002,"15min":8.9740000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67600000000000005,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65800000000000003,"15min":0.754},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88500000000000001,"5min":2.9060000000000001,"15min":2.9060000000000001},"last":0.876},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67300000000000004,"15min":0.78200000000000003},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.89800000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:23:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.86299999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70799999999999996,"15min":0.81299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.88600000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":1.0900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.65800000000000003,"15min":0.67000000000000004},"min":{"1min":0.34200000000000003,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88100000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69499999999999995,"15min":0.70499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92800000000000005,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.85799999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71399999999999997,"15min":0.71199999999999997},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97099999999999997,"5min":1.131,"15min":1.131},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66700000000000004,"15min":0.68000000000000005},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.90300000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.83999999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.52200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.92900000000000005,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":1.008,"5min":1.032,"15min":1.032},"last":0.70899999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70999999999999996,"15min":0.71899999999999997},"min":{"1min":0.56699999999999995,"5min":0.499,"15min":0.499},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96599999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.89800000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91900000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.624,"15min":0.65200000000000002},"min":{"1min":0.443,"5min":0.435,"15min":0.435},"max":{"1min":0.77800000000000002,"5min":0.874,"15min":0.874},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.67900000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.073,"15min":1.073},"last":1.0109999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:23:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.71399999999999997},"min":{"1min":0.51600000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.70999999999999996,"15min":0.73699999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1073152,"data_stored":489035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.503},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.65800000000000003,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.46700000000000003},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.49199999999999999,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71099999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76000000000000001,"5min":1.036,"15min":1.254},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":0.72199999999999998,"5min":0.98899999999999999,"15min":1.772},"last":0.67600000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.98099999999999998,"15min":1.01},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":1.167,"15min":1.181},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71499999999999997,"15min":0.746},"min":{"1min":0.53700000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":1.171,"15min":1.171},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68100000000000005,"15min":0.70699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80000000000000004,"5min":1.0549999999999999,"15min":1.069},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73299999999999998,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85499999999999998,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.77900000000000003},"min":{"1min":0.55700000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.81299999999999994,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.82999999999999996,"5min":1.26,"15min":1.26},"last":0.626}]}]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.432,"15min":0.442},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66000000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47799999999999998,"15min":0.50600000000000001},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68899999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.5},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.629,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.63500000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.46400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.45800000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.79700000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97699999999999998,"5min":1.698,"15min":1.698},"last":0.878},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.622,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89700000000000002,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93400000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76800000000000002,"15min":0.81399999999999995},"min":{"1min":0.54600000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.85999999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.94799999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.58699999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.0189999999999999,"5min":1.341,"15min":1.341},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.107,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.78600000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:23:01 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.745,"15min":0.78700000000000003},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":0.93999999999999995,"5min":1.282,"15min":1.282},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56599999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.91800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":1060,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1085440,"data_stored":495172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.41699999999999998,"15min":0.57499999999999996},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.48999999999999999,"5min":1.7150000000000001,"15min":3.976},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.442,"15min":0.503},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47299999999999998,"15min":0.61399999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":3.2370000000000001,"15min":3.786},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47999999999999998,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86799999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.64900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93100000000000005,"5min":2.1589999999999998,"15min":3.6400000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.63900000000000001},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91800000000000004,"5min":1.9399999999999999,"15min":3.2440000000000002},"last":0.67900000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.79800000000000004},"min":{"1min":0.56200000000000006,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93000000000000005,"5min":1.7889999999999999,"15min":1.851},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72999999999999998,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.6539999999999999,"15min":4.5129999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.874,"5min":1.6100000000000001,"15min":4.1859999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74399999999999999,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98299999999999998,"5min":1.823,"15min":2.0699999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.91300000000000003},"min":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.47099999999999997},"max":{"1min":0.93999999999999995,"5min":1.6850000000000001,"15min":4.3529999999999998},"last":0.70099999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91000000000000003,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.623},{"interface":"front","average":{"1min":0.754,"5min":0.76600000000000001,"15min":0.82199999999999995},"min":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.04,"5min":1.8799999999999999,"15min":1.9770000000000001},"last":0.88}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32688,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339152,"statfs":{"total":96636764160,"available":96603291648,"internally_reserved":0,"allocated":1679360,"data_stored":1085540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44400000000000001,"15min":0.48499999999999999},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82999999999999996,"5min":0.92900000000000005,"15min":1.456},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.53500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":1.0589999999999999,"15min":1.595},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.57099999999999995},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68400000000000005,"5min":0.748,"15min":2.464},"last":0.54600000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.52700000000000002},"min":{"1min":0.309,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.859},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.621},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.90000000000000002,"15min":1.903},"last":0.64800000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0760000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.93500000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77200000000000002,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.2589999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.746,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.59099999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.79500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.278,"15min":1.5700000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.0389999999999999,"15min":1.53},"last":0.76500000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":1.349,"15min":1.556},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.032,"15min":1.2909999999999999},"last":0.89600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:24:08.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-12-18T10:24:08.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-12-18T10:24:08.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.263166+0000', 'last_change': '2023-12-18T10:24:02.263166+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.263166+0000', 'last_undegraded': '2023-12-18T10:24:02.263166+0000', 'last_fullsized': '2023-12-18T10:24:02.263166+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T19:08:11.656004+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.265424+0000', 'last_change': '2023-12-18T10:24:02.265424+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.265424+0000', 'last_undegraded': '2023-12-18T10:24:02.265424+0000', 'last_fullsized': '2023-12-18T10:24:02.265424+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T21:55:02.334119+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258239+0000', 'last_change': '2023-12-18T10:24:02.258239+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258239+0000', 'last_undegraded': '2023-12-18T10:24:02.258239+0000', 'last_fullsized': '2023-12-18T10:24:02.258239+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T14:58:29.376027+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-18T10:24:08.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.263112+0000', 'last_change': '2023-12-18T10:24:02.263112+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.263112+0000', 'last_undegraded': '2023-12-18T10:24:02.263112+0000', 'last_fullsized': '2023-12-18T10:24:02.263112+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T13:04:22.904429+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.264863+0000', 'last_change': '2023-12-18T10:24:02.264863+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.264863+0000', 'last_undegraded': '2023-12-18T10:24:02.264863+0000', 'last_fullsized': '2023-12-18T10:24:02.264863+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.257145+0000', 'last_change': '2023-12-18T10:24:02.257145+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.257145+0000', 'last_undegraded': '2023-12-18T10:24:02.257145+0000', 'last_fullsized': '2023-12-18T10:24:02.257145+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T21:04:01.282465+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-12-18T10:24:08.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.254021+0000', 'last_change': '2023-12-18T10:24:02.254021+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.254021+0000', 'last_undegraded': '2023-12-18T10:24:02.254021+0000', 'last_fullsized': '2023-12-18T10:24:02.254021+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T18:35:43.485098+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258982+0000', 'last_change': '2023-12-18T10:24:02.258982+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258982+0000', 'last_undegraded': '2023-12-18T10:24:02.258982+0000', 'last_fullsized': '2023-12-18T10:24:02.258982+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.259431+0000', 'last_change': '2023-12-18T10:24:02.259431+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.259431+0000', 'last_undegraded': '2023-12-18T10:24:02.259431+0000', 'last_fullsized': '2023-12-18T10:24:02.259431+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T19:37:23.747065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.254013+0000', 'last_change': '2023-12-18T10:24:02.254013+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.254013+0000', 'last_undegraded': '2023-12-18T10:24:02.254013+0000', 'last_fullsized': '2023-12-18T10:24:02.254013+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T14:15:53.568002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.266031+0000', 'last_change': '2023-12-18T10:24:02.266031+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.266031+0000', 'last_undegraded': '2023-12-18T10:24:02.266031+0000', 'last_fullsized': '2023-12-18T10:24:02.266031+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T12:57:20.153111+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-12-18T10:24:08.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.260300+0000', 'last_change': '2023-12-18T10:24:02.260300+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.260300+0000', 'last_undegraded': '2023-12-18T10:24:02.260300+0000', 'last_fullsized': '2023-12-18T10:24:02.260300+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T21:51:34.076185+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258161+0000', 'last_change': '2023-12-18T10:24:02.258161+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258161+0000', 'last_undegraded': '2023-12-18T10:24:02.258161+0000', 'last_fullsized': '2023-12-18T10:24:02.258161+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.260304+0000', 'last_change': '2023-12-18T10:24:02.260304+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.260304+0000', 'last_undegraded': '2023-12-18T10:24:02.260304+0000', 'last_fullsized': '2023-12-18T10:24:02.260304+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T12:29:55.218379+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-12-18T10:24:08.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.257136+0000', 'last_change': '2023-12-18T10:24:02.257136+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.257136+0000', 'last_undegraded': '2023-12-18T10:24:02.257136+0000', 'last_fullsized': '2023-12-18T10:24:02.257136+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T13:07:21.447878+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.257099+0000', 'last_change': '2023-12-18T10:24:02.257099+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.257099+0000', 'last_undegraded': '2023-12-18T10:24:02.257099+0000', 'last_fullsized': '2023-12-18T10:24:02.257099+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T10:28:44.825382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.262569+0000', 'last_change': '2023-12-18T10:24:02.262569+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.262569+0000', 'last_undegraded': '2023-12-18T10:24:02.262569+0000', 'last_fullsized': '2023-12-18T10:24:02.262569+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T12:58:55.131352+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-18T10:24:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258282+0000', 'last_change': '2023-12-18T10:24:02.258282+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258282+0000', 'last_undegraded': '2023-12-18T10:24:02.258282+0000', 'last_fullsized': '2023-12-18T10:24:02.258282+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T12:33:48.009673+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.265516+0000', 'last_change': '2023-12-18T10:24:02.265516+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.265516+0000', 'last_undegraded': '2023-12-18T10:24:02.265516+0000', 'last_fullsized': '2023-12-18T10:24:02.265516+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-12-18T10:24:08.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258846+0000', 'last_change': '2023-12-18T10:24:02.258846+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258846+0000', 'last_undegraded': '2023-12-18T10:24:02.258846+0000', 'last_fullsized': '2023-12-18T10:24:02.258846+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T22:22:32.233941+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.254886+0000', 'last_change': '2023-12-18T10:24:02.254886+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.254886+0000', 'last_undegraded': '2023-12-18T10:24:02.254886+0000', 'last_fullsized': '2023-12-18T10:24:02.254886+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T14:43:26.508524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258538+0000', 'last_change': '2023-12-18T10:24:02.258538+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258538+0000', 'last_undegraded': '2023-12-18T10:24:02.258538+0000', 'last_fullsized': '2023-12-18T10:24:02.258538+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T22:02:35.397564+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.254944+0000', 'last_change': '2023-12-18T10:24:02.254944+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.254944+0000', 'last_undegraded': '2023-12-18T10:24:02.254944+0000', 'last_fullsized': '2023-12-18T10:24:02.254944+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T13:15:11.695579+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258219+0000', 'last_change': '2023-12-18T10:24:02.258219+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258219+0000', 'last_undegraded': '2023-12-18T10:24:02.258219+0000', 'last_fullsized': '2023-12-18T10:24:02.258219+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.264857+0000', 'last_change': '2023-12-18T10:24:02.264857+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.264857+0000', 'last_undegraded': '2023-12-18T10:24:02.264857+0000', 'last_fullsized': '2023-12-18T10:24:02.264857+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-18T10:24:08.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.264945+0000', 'last_change': '2023-12-18T10:24:02.264945+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.264945+0000', 'last_undegraded': '2023-12-18T10:24:02.264945+0000', 'last_fullsized': '2023-12-18T10:24:02.264945+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.262562+0000', 'last_change': '2023-12-18T10:24:02.262562+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.262562+0000', 'last_undegraded': '2023-12-18T10:24:02.262562+0000', 'last_fullsized': '2023-12-18T10:24:02.262562+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T15:01:00.828132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.260280+0000', 'last_change': '2023-12-18T10:24:02.260280+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.260280+0000', 'last_undegraded': '2023-12-18T10:24:02.260280+0000', 'last_fullsized': '2023-12-18T10:24:02.260280+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T15:37:40.810447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258917+0000', 'last_change': '2023-12-18T10:24:02.258917+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258917+0000', 'last_undegraded': '2023-12-18T10:24:02.258917+0000', 'last_fullsized': '2023-12-18T10:24:02.258917+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T12:46:44.625658+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.262402+0000', 'last_change': '2023-12-18T10:24:02.262402+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.262402+0000', 'last_undegraded': '2023-12-18T10:24:02.262402+0000', 'last_fullsized': '2023-12-18T10:24:02.262402+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T10:49:26.193363+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-12-18T10:24:08.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.258161+0000', 'last_change': '2023-12-18T10:24:02.258161+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.258161+0000', 'last_undegraded': '2023-12-18T10:24:02.258161+0000', 'last_fullsized': '2023-12-18T10:24:02.258161+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-18T10:24:08.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-12-18T10:24:08.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-18T10:24:03.251788+0000', 'last_change': '2023-12-18T10:24:03.251788+0000', 'last_active': '2023-12-18T10:24:03.251788+0000', 'last_peered': '2023-12-18T10:24:03.251788+0000', 'last_clean': '2023-12-18T10:24:03.251788+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:03.251788+0000', 'last_undegraded': '2023-12-18T10:24:03.251788+0000', 'last_fullsized': '2023-12-18T10:24:03.251788+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:03.251788+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-18T10:24:08.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-12-18T10:24:08.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 88, 'state': 'creating+peering', 'last_fresh': '2023-12-18T10:24:02.257194+0000', 'last_change': '2023-12-18T10:24:02.257194+0000', 'last_active': '2023-12-18T10:24:02.247092+0000', 'last_peered': '2023-12-18T10:24:02.247092+0000', 'last_clean': '2023-12-18T10:24:02.247092+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-18T10:24:02.257194+0000', 'last_undegraded': '2023-12-18T10:24:02.257194+0000', 'last_fullsized': '2023-12-18T10:24:02.257194+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'last_clean_scrub_stamp': '2023-12-18T10:24:02.247092+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-19T22:06:25.659280+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-18T10:24:08.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:09.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.010+0000 7ff40ef6d640 1 Processor -- start 2023-12-18T10:24:09.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.010+0000 7ff40ef6d640 1 -- start start 2023-12-18T10:24:09.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff40ef6d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4080cf0d0 0x7ff4080cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff40ef6d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff4081648d0 0x7ff408166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff40ef6d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080cfa70 con 0x7ff40815ca40 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff40ef6d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080d11c0 con 0x7ff4080cf0d0 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff40ef6d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080d0310 con 0x7ff4081648d0 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff40cd09640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff40815ca40 0x7ff4080cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58896/0 (socket says 172.21.15.133:58896) 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff40cd09640 1 -- 172.21.15.133:0/3524635164 learned_addr learned my addr 172.21.15.133:0/3524635164 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff407fff640 1 --2- 172.21.15.133:0/3524635164 >> v2:172.21.15.133:3300/0 conn(0x7ff4080cf0d0 0x7ff4080cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff40d50a640 1 --2- 172.21.15.133:0/3524635164 >> v2:172.21.15.142:3300/0 conn(0x7ff4081648d0 0x7ff408166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff4077fe640 1 -- 172.21.15.133:0/3524635164 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987182866 0 0) 0x7ff4080cfa70 con 0x7ff40815ca40 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff4077fe640 1 -- 172.21.15.133:0/3524635164 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f8003530 con 0x7ff40815ca40 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff407fff640 1 -- 172.21.15.133:0/3524635164 >> v2:172.21.15.142:3300/0 conn(0x7ff4081648d0 msgr2=0x7ff408166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff407fff640 1 --2- 172.21.15.133:0/3524635164 >> v2:172.21.15.142:3300/0 conn(0x7ff4081648d0 0x7ff408166cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff407fff640 1 -- 172.21.15.133:0/3524635164 >> v1:172.21.15.133:6789/0 conn(0x7ff40815ca40 legacy=0x7ff4080cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.014+0000 7ff407fff640 1 -- 172.21.15.133:0/3524635164 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080d05b0 con 0x7ff4080cf0d0 2023-12-18T10:24:09.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff407fff640 1 --2- 172.21.15.133:0/3524635164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4080cf0d0 0x7ff4080cf530 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7ff40808ca20 tx=0x7ff3f401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8759ecc6a42a5b42 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:09.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff4077fe640 1 -- 172.21.15.133:0/3524635164 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40ab610 con 0x7ff4080cf0d0 2023-12-18T10:24:09.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff4077fe640 1 -- 172.21.15.133:0/3524635164 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f40ab770 con 0x7ff4080cf0d0 2023-12-18T10:24:09.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff4077fe640 1 -- 172.21.15.133:0/3524635164 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40abae0 con 0x7ff4080cf0d0 2023-12-18T10:24:09.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 -- 172.21.15.133:0/3524635164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4080cf0d0 msgr2=0x7ff4080cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/3524635164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4080cf0d0 0x7ff4080cf530 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7ff40808ca20 tx=0x7ff3f401c410 comp rx=0 tx=0).stop 2023-12-18T10:24:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 -- 172.21.15.133:0/3524635164 shutdown_connections 2023-12-18T10:24:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/3524635164 >> v2:172.21.15.142:3300/0 conn(0x7ff4081648d0 0x7ff408166cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/3524635164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4080cf0d0 0x7ff4080cf530 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 -- 172.21.15.133:0/3524635164 >> 172.21.15.133:0/3524635164 conn(0x7ff408089fb0 msgr2=0x7ff4080d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 -- 172.21.15.133:0/3524635164 shutdown_connections 2023-12-18T10:24:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 -- 172.21.15.133:0/3524635164 wait complete. 2023-12-18T10:24:09.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 Processor -- start 2023-12-18T10:24:09.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.018+0000 7ff40ef6d640 1 -- start start 2023-12-18T10:24:09.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4080cf0d0 0x7ff408163b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff40815ca40 0x7ff408155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4081648d0 0x7ff4080b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081636f0 con 0x7ff4081648d0 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408162a70 con 0x7ff4080cf0d0 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408162d50 con 0x7ff40815ca40 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4081648d0 0x7ff4080b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4081648d0 0x7ff4080b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33454/0 (socket says 172.21.15.133:33454) 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 -- 172.21.15.133:0/291390497 learned_addr learned my addr 172.21.15.133:0/291390497 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40cd09640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4080cf0d0 0x7ff408163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff407fff640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff40815ca40 0x7ff408155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 -- 172.21.15.133:0/291390497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff40815ca40 msgr2=0x7ff408155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff40815ca40 0x7ff408155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 -- 172.21.15.133:0/291390497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4080cf0d0 msgr2=0x7ff408163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4080cf0d0 0x7ff408163b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 -- 172.21.15.133:0/291390497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f40093b0 con 0x7ff4081648d0 2023-12-18T10:24:09.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40d50a640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4081648d0 0x7ff4080b0360 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ef90 tx=0x7ff40000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:09.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff4057fa640 1 -- 172.21.15.133:0/291390497 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff400009bf0 con 0x7ff4081648d0 2023-12-18T10:24:09.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff4057fa640 1 -- 172.21.15.133:0/291390497 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000f040 con 0x7ff4081648d0 2023-12-18T10:24:09.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff4057fa640 1 -- 172.21.15.133:0/291390497 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000146c0 con 0x7ff4081648d0 2023-12-18T10:24:09.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff408163030 con 0x7ff4081648d0 2023-12-18T10:24:09.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080b08a0 con 0x7ff4081648d0 2023-12-18T10:24:09.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff408163830 con 0x7ff4081648d0 2023-12-18T10:24:09.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.022+0000 7ff4057fa640 1 -- 172.21.15.133:0/291390497 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff400014820 con 0x7ff4081648d0 2023-12-18T10:24:09.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.026+0000 7ff4057fa640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff3ec065a90 0x7ff3ec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.026+0000 7ff4057fa640 1 -- 172.21.15.133:0/291390497 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff400083fe0 con 0x7ff4081648d0 2023-12-18T10:24:09.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.026+0000 7ff40cd09640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff3ec065a90 0x7ff3ec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.026+0000 7ff40cd09640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff3ec065a90 0x7ff3ec067f50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc001370 tx=0x7ff3fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:09.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.030+0000 7ff4057fa640 1 -- 172.21.15.133:0/291390497 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff408163830 con 0x7ff4081648d0 2023-12-18T10:24:09.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.234+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff408163830 con 0x7ff4081648d0 2023-12-18T10:24:09.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.234+0000 7ff4057fa640 1 -- 172.21.15.133:0/291390497 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1270 (secure 0 0 0) 0x7ff400018510 con 0x7ff4081648d0 2023-12-18T10:24:09.234 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:09.235 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":389,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":264179712,"bytes_avail":772829933568,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":84,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-12-18T10:23:47.169360+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff3ec065a90 msgr2=0x7ff3ec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff3ec065a90 0x7ff3ec067f50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc001370 tx=0x7ff3fc009040 comp rx=0 tx=0).stop 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4081648d0 msgr2=0x7ff4080b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4081648d0 0x7ff4080b0360 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7ff40000ef90 tx=0x7ff40000c490 comp rx=0 tx=0).stop 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 shutdown_connections 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff3ec065a90 0x7ff3ec067f50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4081648d0 0x7ff4080b0360 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff40815ca40 0x7ff408155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 --2- 172.21.15.133:0/291390497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff4080cf0d0 0x7ff408163b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 >> 172.21.15.133:0/291390497 conn(0x7ff408089fb0 msgr2=0x7ff40815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:09.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 shutdown_connections 2023-12-18T10:24:09.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.238+0000 7ff40ef6d640 1 -- 172.21.15.133:0/291390497 wait complete. 2023-12-18T10:24:09.256 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-18T10:24:09.256 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:24:09.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f48389b3640 1 Processor -- start 2023-12-18T10:24:09.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f48389b3640 1 -- start start 2023-12-18T10:24:09.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f48389b3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48340cac10 0x7f483415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f48389b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f483406fdb0 0x7f4834070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f48389b3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483415f100 con 0x7f483415a680 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f48389b3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4834070780 con 0x7f48340cac10 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f48389b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48340ca7d0 con 0x7f483406fdb0 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f483259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f483415a680 0x7f483415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58906/0 (socket says 172.21.15.133:58906) 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f483259c640 1 -- 172.21.15.133:0/4161697001 learned_addr learned my addr 172.21.15.133:0/4161697001 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4832d9d640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f483406fdb0 0x7f4834070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4829d9b640 1 --2- 172.21.15.133:0/4161697001 >> v2:172.21.15.142:3300/0 conn(0x7f48340cac10 0x7f483415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152778822 0 0) 0x7f483415f100 con 0x7f483415a680 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4820003530 con 0x7f483415a680 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279652260 0 0) 0x7f4820003530 con 0x7f483415a680 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f483406fdb0 msgr2=0x7f4834070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4831d9b640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f483406fdb0 0x7f4834070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 >> v2:172.21.15.142:3300/0 conn(0x7f48340cac10 msgr2=0x7f483415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.394+0000 7f4831d9b640 1 --2- 172.21.15.133:0/4161697001 >> v2:172.21.15.142:3300/0 conn(0x7f48340cac10 0x7f483415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483415e860 con 0x7f483415a680 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f4824001a00 con 0x7f483415a680 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 >> v1:172.21.15.133:6789/0 conn(0x7f483415a680 legacy=0x7f483415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4820003980 0x7f4820003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48200047d0 0x7f4820004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f483406fdb0 0x7f4820005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834070780 con 0x7f4820003980 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48340ca7d0 con 0x7f48200047d0 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482000b9c0 con 0x7f483406fdb0 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f483259c640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4820003980 0x7f4820003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4832d9d640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f483406fdb0 0x7f4820005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f4829d9b640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48200047d0 0x7f4820004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f483259c640 1 -- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f483406fdb0 msgr2=0x7f4820005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f483259c640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f483406fdb0 0x7f4820005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f483259c640 1 -- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48200047d0 msgr2=0x7f4820004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:09.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f483259c640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48200047d0 0x7f4820004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f483259c640 1 -- 172.21.15.133:0/4161697001 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820003530 con 0x7f4820003980 2023-12-18T10:24:09.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.398+0000 7f483259c640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4820003980 0x7f4820003da0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f482400a8d0 tx=0x7f482401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdbb65705d30277 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:09.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48240ad630 con 0x7f4820003980 2023-12-18T10:24:09.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48240a8070 con 0x7f4820003980 2023-12-18T10:24:09.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f4831d9b640 1 -- 172.21.15.133:0/4161697001 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48240ad9d0 con 0x7f4820003980 2023-12-18T10:24:09.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 -- 172.21.15.133:0/4161697001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4820003980 msgr2=0x7f4820003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 --2- 172.21.15.133:0/4161697001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4820003980 0x7f4820003da0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f482400a8d0 tx=0x7f482401d380 comp rx=0 tx=0).stop 2023-12-18T10:24:09.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f4832d9d640 1 -- 172.21.15.133:0/4161697001 reap_dead start 2023-12-18T10:24:09.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 -- 172.21.15.133:0/4161697001 shutdown_connections 2023-12-18T10:24:09.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 -- 172.21.15.133:0/4161697001 >> 172.21.15.133:0/4161697001 conn(0x7f483406a3e0 msgr2=0x7f48340afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:09.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 -- 172.21.15.133:0/4161697001 shutdown_connections 2023-12-18T10:24:09.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 -- 172.21.15.133:0/4161697001 wait complete. 2023-12-18T10:24:09.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 Processor -- start 2023-12-18T10:24:09.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 -- start start 2023-12-18T10:24:09.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.402+0000 7f48389b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820003980 0x7f4834158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f48389b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340c14a0 0x7f48341f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f48389b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48340c1920 0x7f48341f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f48389b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48340b21f0 con 0x7f48340c14a0 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f48389b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48340c21e0 con 0x7f4820003980 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f48389b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48340b1e50 con 0x7f48340c1920 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340c14a0 0x7f48341f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340c14a0 0x7f48341f70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33478/0 (socket says 172.21.15.133:33478) 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 -- 172.21.15.133:0/491823929 learned_addr learned my addr 172.21.15.133:0/491823929 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f483259c640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820003980 0x7f4834158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4832d9d640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48340c1920 0x7f48341f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 -- 172.21.15.133:0/491823929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48340c1920 msgr2=0x7f48341f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48340c1920 0x7f48341f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 -- 172.21.15.133:0/491823929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820003980 msgr2=0x7f4834158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820003980 0x7f4834158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 -- 172.21.15.133:0/491823929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340c2cf0 con 0x7f48340c14a0 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f4829d9b640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340c14a0 0x7f48341f70c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f481c0119d0 tx=0x7f481c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f482b7fe640 1 -- 172.21.15.133:0/491823929 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c00faf0 con 0x7f48340c14a0 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f482b7fe640 1 -- 172.21.15.133:0/491823929 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c00fc50 con 0x7f48340c14a0 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f482b7fe640 1 -- 172.21.15.133:0/491823929 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c014440 con 0x7f48340c14a0 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483415f9c0 con 0x7f48340c14a0 2023-12-18T10:24:09.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483415ff60 con 0x7f48340c14a0 2023-12-18T10:24:09.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48340735b0 con 0x7f48340c14a0 2023-12-18T10:24:09.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.406+0000 7f482b7fe640 1 -- 172.21.15.133:0/491823929 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f481c0145a0 con 0x7f48340c14a0 2023-12-18T10:24:09.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.410+0000 7f482b7fe640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4814065a90 0x7f4814067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:09.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.410+0000 7f482b7fe640 1 -- 172.21.15.133:0/491823929 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f481c083960 con 0x7f48340c14a0 2023-12-18T10:24:09.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.410+0000 7f483259c640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4814065a90 0x7f4814067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:09.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.410+0000 7f483259c640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4814065a90 0x7f4814067f50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f48240ad000 tx=0x7f4824001d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:09.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.414+0000 7f482b7fe640 1 -- 172.21.15.133:0/491823929 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f481c051290 con 0x7f48340c14a0 2023-12-18T10:24:09.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.558+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48340c8e10 con 0x7f4814065a90 2023-12-18T10:24:09.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.566+0000 7f482b7fe640 1 -- 172.21.15.133:0/491823929 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289503 (secure 0 0 0) 0x7f48240018c0 con 0x7f4814065a90 2023-12-18T10:24:09.568 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:09.569 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:24:09.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4814065a90 msgr2=0x7f4814067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4814065a90 0x7f4814067f50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f48240ad000 tx=0x7f4824001d90 comp rx=0 tx=0).stop 2023-12-18T10:24:09.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340c14a0 msgr2=0x7f48341f70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340c14a0 0x7f48341f70c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f481c0119d0 tx=0x7f481c011dd0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 shutdown_connections 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4814065a90 0x7f4814067f50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48340c1920 0x7f48341f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340c14a0 0x7f48341f70c0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 --2- 172.21.15.133:0/491823929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4820003980 0x7f4834158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 >> 172.21.15.133:0/491823929 conn(0x7f483406a3e0 msgr2=0x7f48340ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 shutdown_connections 2023-12-18T10:24:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:09.570+0000 7f48389b3640 1 -- 172.21.15.133:0/491823929 wait complete. 2023-12-18T10:24:09.588 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2023-12-18T10:24:09.173226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258376,"kb_used_data":9992,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716344,"statfs":{"total":773094113280,"available":772829536256,"internally_reserved":0,"allocated":10231808,"data_stored":5309316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001144"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181047+0000","last_change":"2023-12-18T10:24:03.677597+0000","last_active":"2023-12-18T10:24:05.181047+0000","last_peered":"2023-12-18T10:24:05.181047+0000","last_clean":"2023-12-18T10:24:05.181047+0000","last_became_active":"2023-12-18T10:24:03.677222+0000","last_became_peered":"2023-12-18T10:24:03.677222+0000","last_unstale":"2023-12-18T10:24:05.181047+0000","last_undegraded":"2023-12-18T10:24:05.181047+0000","last_fullsized":"2023-12-18T10:24:05.181047+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:51:37.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182403+0000","last_change":"2023-12-18T10:24:03.679554+0000","last_active":"2023-12-18T10:24:05.182403+0000","last_peered":"2023-12-18T10:24:05.182403+0000","last_clean":"2023-12-18T10:24:05.182403+0000","last_became_active":"2023-12-18T10:24:03.679285+0000","last_became_peered":"2023-12-18T10:24:03.679285+0000","last_unstale":"2023-12-18T10:24:05.182403+0000","last_undegraded":"2023-12-18T10:24:05.182403+0000","last_fullsized":"2023-12-18T10:24:05.182403+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:56.223075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181095+0000","last_change":"2023-12-18T10:24:03.688043+0000","last_active":"2023-12-18T10:24:05.181095+0000","last_peered":"2023-12-18T10:24:05.181095+0000","last_clean":"2023-12-18T10:24:05.181095+0000","last_became_active":"2023-12-18T10:24:03.687794+0000","last_became_peered":"2023-12-18T10:24:03.687794+0000","last_unstale":"2023-12-18T10:24:05.181095+0000","last_undegraded":"2023-12-18T10:24:05.181095+0000","last_fullsized":"2023-12-18T10:24:05.181095+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:46:31.988419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180428+0000","last_change":"2023-12-18T10:24:03.687786+0000","last_active":"2023-12-18T10:24:05.180428+0000","last_peered":"2023-12-18T10:24:05.180428+0000","last_clean":"2023-12-18T10:24:05.180428+0000","last_became_active":"2023-12-18T10:24:03.684087+0000","last_became_peered":"2023-12-18T10:24:03.684087+0000","last_unstale":"2023-12-18T10:24:05.180428+0000","last_undegraded":"2023-12-18T10:24:05.180428+0000","last_fullsized":"2023-12-18T10:24:05.180428+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:03.338814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182583+0000","last_change":"2023-12-18T10:24:03.681861+0000","last_active":"2023-12-18T10:24:05.182583+0000","last_peered":"2023-12-18T10:24:05.182583+0000","last_clean":"2023-12-18T10:24:05.182583+0000","last_became_active":"2023-12-18T10:24:03.681160+0000","last_became_peered":"2023-12-18T10:24:03.681160+0000","last_unstale":"2023-12-18T10:24:05.182583+0000","last_undegraded":"2023-12-18T10:24:05.182583+0000","last_fullsized":"2023-12-18T10:24:05.182583+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:19:38.852286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899066+0000","last_change":"2023-12-18T10:24:03.685346+0000","last_active":"2023-12-18T10:24:04.899066+0000","last_peered":"2023-12-18T10:24:04.899066+0000","last_clean":"2023-12-18T10:24:04.899066+0000","last_became_active":"2023-12-18T10:24:03.685020+0000","last_became_peered":"2023-12-18T10:24:03.685020+0000","last_unstale":"2023-12-18T10:24:04.899066+0000","last_undegraded":"2023-12-18T10:24:04.899066+0000","last_fullsized":"2023-12-18T10:24:04.899066+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:51.946051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182117+0000","last_change":"2023-12-18T10:24:03.674455+0000","last_active":"2023-12-18T10:24:05.182117+0000","last_peered":"2023-12-18T10:24:05.182117+0000","last_clean":"2023-12-18T10:24:05.182117+0000","last_became_active":"2023-12-18T10:24:03.674183+0000","last_became_peered":"2023-12-18T10:24:03.674183+0000","last_unstale":"2023-12-18T10:24:05.182117+0000","last_undegraded":"2023-12-18T10:24:05.182117+0000","last_fullsized":"2023-12-18T10:24:05.182117+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:54.572697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180326+0000","last_change":"2023-12-18T10:24:03.687797+0000","last_active":"2023-12-18T10:24:05.180326+0000","last_peered":"2023-12-18T10:24:05.180326+0000","last_clean":"2023-12-18T10:24:05.180326+0000","last_became_active":"2023-12-18T10:24:03.684984+0000","last_became_peered":"2023-12-18T10:24:03.684984+0000","last_unstale":"2023-12-18T10:24:05.180326+0000","last_undegraded":"2023-12-18T10:24:05.180326+0000","last_fullsized":"2023-12-18T10:24:05.180326+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:16.345573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183338+0000","last_change":"2023-12-18T10:24:03.680933+0000","last_active":"2023-12-18T10:24:05.183338+0000","last_peered":"2023-12-18T10:24:05.183338+0000","last_clean":"2023-12-18T10:24:05.183338+0000","last_became_active":"2023-12-18T10:24:03.680027+0000","last_became_peered":"2023-12-18T10:24:03.680027+0000","last_unstale":"2023-12-18T10:24:05.183338+0000","last_undegraded":"2023-12-18T10:24:05.183338+0000","last_fullsized":"2023-12-18T10:24:05.183338+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:43:37.283520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659415+0000","last_change":"2023-12-18T10:24:03.695207+0000","last_active":"2023-12-18T10:24:04.659415+0000","last_peered":"2023-12-18T10:24:04.659415+0000","last_clean":"2023-12-18T10:24:04.659415+0000","last_became_active":"2023-12-18T10:24:03.692815+0000","last_became_peered":"2023-12-18T10:24:03.692815+0000","last_unstale":"2023-12-18T10:24:04.659415+0000","last_undegraded":"2023-12-18T10:24:04.659415+0000","last_fullsized":"2023-12-18T10:24:04.659415+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:19:52.878248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183172+0000","last_change":"2023-12-18T10:24:03.684586+0000","last_active":"2023-12-18T10:24:05.183172+0000","last_peered":"2023-12-18T10:24:05.183172+0000","last_clean":"2023-12-18T10:24:05.183172+0000","last_became_active":"2023-12-18T10:24:03.684170+0000","last_became_peered":"2023-12-18T10:24:03.684170+0000","last_unstale":"2023-12-18T10:24:05.183172+0000","last_undegraded":"2023-12-18T10:24:05.183172+0000","last_fullsized":"2023-12-18T10:24:05.183172+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:16:44.861634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659117+0000","last_change":"2023-12-18T10:24:03.674982+0000","last_active":"2023-12-18T10:24:04.659117+0000","last_peered":"2023-12-18T10:24:04.659117+0000","last_clean":"2023-12-18T10:24:04.659117+0000","last_became_active":"2023-12-18T10:24:03.674720+0000","last_became_peered":"2023-12-18T10:24:03.674720+0000","last_unstale":"2023-12-18T10:24:04.659117+0000","last_undegraded":"2023-12-18T10:24:04.659117+0000","last_fullsized":"2023-12-18T10:24:04.659117+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:35:08.717170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180872+0000","last_change":"2023-12-18T10:24:03.676067+0000","last_active":"2023-12-18T10:24:05.180872+0000","last_peered":"2023-12-18T10:24:05.180872+0000","last_clean":"2023-12-18T10:24:05.180872+0000","last_became_active":"2023-12-18T10:24:03.675777+0000","last_became_peered":"2023-12-18T10:24:03.675777+0000","last_unstale":"2023-12-18T10:24:05.180872+0000","last_undegraded":"2023-12-18T10:24:05.180872+0000","last_fullsized":"2023-12-18T10:24:05.180872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:04.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182204+0000","last_change":"2023-12-18T10:24:03.695295+0000","last_active":"2023-12-18T10:24:05.182204+0000","last_peered":"2023-12-18T10:24:05.182204+0000","last_clean":"2023-12-18T10:24:05.182204+0000","last_became_active":"2023-12-18T10:24:03.694982+0000","last_became_peered":"2023-12-18T10:24:03.694982+0000","last_unstale":"2023-12-18T10:24:05.182204+0000","last_undegraded":"2023-12-18T10:24:05.182204+0000","last_fullsized":"2023-12-18T10:24:05.182204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:46:14.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180684+0000","last_change":"2023-12-18T10:24:03.684406+0000","last_active":"2023-12-18T10:24:05.180684+0000","last_peered":"2023-12-18T10:24:05.180684+0000","last_clean":"2023-12-18T10:24:05.180684+0000","last_became_active":"2023-12-18T10:24:03.684099+0000","last_became_peered":"2023-12-18T10:24:03.684099+0000","last_unstale":"2023-12-18T10:24:05.180684+0000","last_undegraded":"2023-12-18T10:24:05.180684+0000","last_fullsized":"2023-12-18T10:24:05.180684+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:22:33.238637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.898983+0000","last_change":"2023-12-18T10:24:03.672927+0000","last_active":"2023-12-18T10:24:04.898983+0000","last_peered":"2023-12-18T10:24:04.898983+0000","last_clean":"2023-12-18T10:24:04.898983+0000","last_became_active":"2023-12-18T10:24:03.672653+0000","last_became_peered":"2023-12-18T10:24:03.672653+0000","last_unstale":"2023-12-18T10:24:04.898983+0000","last_undegraded":"2023-12-18T10:24:04.898983+0000","last_fullsized":"2023-12-18T10:24:04.898983+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:03:09.852070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899389+0000","last_change":"2023-12-18T10:24:03.674737+0000","last_active":"2023-12-18T10:24:04.899389+0000","last_peered":"2023-12-18T10:24:04.899389+0000","last_clean":"2023-12-18T10:24:04.899389+0000","last_became_active":"2023-12-18T10:24:03.674468+0000","last_became_peered":"2023-12-18T10:24:03.674468+0000","last_unstale":"2023-12-18T10:24:04.899389+0000","last_undegraded":"2023-12-18T10:24:04.899389+0000","last_fullsized":"2023-12-18T10:24:04.899389+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:22.931778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180935+0000","last_change":"2023-12-18T10:24:03.678191+0000","last_active":"2023-12-18T10:24:05.180935+0000","last_peered":"2023-12-18T10:24:05.180935+0000","last_clean":"2023-12-18T10:24:05.180935+0000","last_became_active":"2023-12-18T10:24:03.677928+0000","last_became_peered":"2023-12-18T10:24:03.677928+0000","last_unstale":"2023-12-18T10:24:05.180935+0000","last_undegraded":"2023-12-18T10:24:05.180935+0000","last_fullsized":"2023-12-18T10:24:05.180935+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:46:14.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183202+0000","last_change":"2023-12-18T10:24:03.695220+0000","last_active":"2023-12-18T10:24:05.183202+0000","last_peered":"2023-12-18T10:24:05.183202+0000","last_clean":"2023-12-18T10:24:05.183202+0000","last_became_active":"2023-12-18T10:24:03.694887+0000","last_became_peered":"2023-12-18T10:24:03.694887+0000","last_unstale":"2023-12-18T10:24:05.183202+0000","last_undegraded":"2023-12-18T10:24:05.183202+0000","last_fullsized":"2023-12-18T10:24:05.183202+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:30:15.783567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180518+0000","last_change":"2023-12-18T10:24:03.683731+0000","last_active":"2023-12-18T10:24:05.180518+0000","last_peered":"2023-12-18T10:24:05.180518+0000","last_clean":"2023-12-18T10:24:05.180518+0000","last_became_active":"2023-12-18T10:24:03.681618+0000","last_became_peered":"2023-12-18T10:24:03.681618+0000","last_unstale":"2023-12-18T10:24:05.180518+0000","last_undegraded":"2023-12-18T10:24:05.180518+0000","last_fullsized":"2023-12-18T10:24:05.180518+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:39.392543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182421+0000","last_change":"2023-12-18T10:24:03.682062+0000","last_active":"2023-12-18T10:24:05.182421+0000","last_peered":"2023-12-18T10:24:05.182421+0000","last_clean":"2023-12-18T10:24:05.182421+0000","last_became_active":"2023-12-18T10:24:03.681517+0000","last_became_peered":"2023-12-18T10:24:03.681517+0000","last_unstale":"2023-12-18T10:24:05.182421+0000","last_undegraded":"2023-12-18T10:24:05.182421+0000","last_fullsized":"2023-12-18T10:24:05.182421+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:38:11.711182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182259+0000","last_change":"2023-12-18T10:24:03.694565+0000","last_active":"2023-12-18T10:24:05.182259+0000","last_peered":"2023-12-18T10:24:05.182259+0000","last_clean":"2023-12-18T10:24:05.182259+0000","last_became_active":"2023-12-18T10:24:03.694205+0000","last_became_peered":"2023-12-18T10:24:03.694205+0000","last_unstale":"2023-12-18T10:24:05.182259+0000","last_undegraded":"2023-12-18T10:24:05.182259+0000","last_fullsized":"2023-12-18T10:24:05.182259+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:52:14.855733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659246+0000","last_change":"2023-12-18T10:24:03.694176+0000","last_active":"2023-12-18T10:24:04.659246+0000","last_peered":"2023-12-18T10:24:04.659246+0000","last_clean":"2023-12-18T10:24:04.659246+0000","last_became_active":"2023-12-18T10:24:03.693857+0000","last_became_peered":"2023-12-18T10:24:03.693857+0000","last_unstale":"2023-12-18T10:24:04.659246+0000","last_undegraded":"2023-12-18T10:24:04.659246+0000","last_fullsized":"2023-12-18T10:24:04.659246+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:14:25.187465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180174+0000","last_change":"2023-12-18T10:24:03.680445+0000","last_active":"2023-12-18T10:24:05.180174+0000","last_peered":"2023-12-18T10:24:05.180174+0000","last_clean":"2023-12-18T10:24:05.180174+0000","last_became_active":"2023-12-18T10:24:03.680190+0000","last_became_peered":"2023-12-18T10:24:03.680190+0000","last_unstale":"2023-12-18T10:24:05.180174+0000","last_undegraded":"2023-12-18T10:24:05.180174+0000","last_fullsized":"2023-12-18T10:24:05.180174+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:39:41.724333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182704+0000","last_change":"2023-12-18T10:24:03.677136+0000","last_active":"2023-12-18T10:24:05.182704+0000","last_peered":"2023-12-18T10:24:05.182704+0000","last_clean":"2023-12-18T10:24:05.182704+0000","last_became_active":"2023-12-18T10:24:03.676802+0000","last_became_peered":"2023-12-18T10:24:03.676802+0000","last_unstale":"2023-12-18T10:24:05.182704+0000","last_undegraded":"2023-12-18T10:24:05.182704+0000","last_fullsized":"2023-12-18T10:24:05.182704+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:54.572697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183206+0000","last_change":"2023-12-18T10:24:03.698103+0000","last_active":"2023-12-18T10:24:05.183206+0000","last_peered":"2023-12-18T10:24:05.183206+0000","last_clean":"2023-12-18T10:24:05.183206+0000","last_became_active":"2023-12-18T10:24:03.697865+0000","last_became_peered":"2023-12-18T10:24:03.697865+0000","last_unstale":"2023-12-18T10:24:05.183206+0000","last_undegraded":"2023-12-18T10:24:05.183206+0000","last_fullsized":"2023-12-18T10:24:05.183206+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:51:37.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659327+0000","last_change":"2023-12-18T10:24:03.673272+0000","last_active":"2023-12-18T10:24:04.659327+0000","last_peered":"2023-12-18T10:24:04.659327+0000","last_clean":"2023-12-18T10:24:04.659327+0000","last_became_active":"2023-12-18T10:24:03.671626+0000","last_became_peered":"2023-12-18T10:24:03.671626+0000","last_unstale":"2023-12-18T10:24:04.659327+0000","last_undegraded":"2023-12-18T10:24:04.659327+0000","last_fullsized":"2023-12-18T10:24:04.659327+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:02:39.874263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180632+0000","last_change":"2023-12-18T10:24:03.685174+0000","last_active":"2023-12-18T10:24:05.180632+0000","last_peered":"2023-12-18T10:24:05.180632+0000","last_clean":"2023-12-18T10:24:05.180632+0000","last_became_active":"2023-12-18T10:24:03.684923+0000","last_became_peered":"2023-12-18T10:24:03.684923+0000","last_unstale":"2023-12-18T10:24:05.180632+0000","last_undegraded":"2023-12-18T10:24:05.180632+0000","last_fullsized":"2023-12-18T10:24:05.180632+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:46:45.630354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182681+0000","last_change":"2023-12-18T10:24:03.675461+0000","last_active":"2023-12-18T10:24:05.182681+0000","last_peered":"2023-12-18T10:24:05.182681+0000","last_clean":"2023-12-18T10:24:05.182681+0000","last_became_active":"2023-12-18T10:24:03.675229+0000","last_became_peered":"2023-12-18T10:24:03.675229+0000","last_unstale":"2023-12-18T10:24:05.182681+0000","last_undegraded":"2023-12-18T10:24:05.182681+0000","last_fullsized":"2023-12-18T10:24:05.182681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:15:43.525146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182399+0000","last_change":"2023-12-18T10:24:03.680796+0000","last_active":"2023-12-18T10:24:05.182399+0000","last_peered":"2023-12-18T10:24:05.182399+0000","last_clean":"2023-12-18T10:24:05.182399+0000","last_became_active":"2023-12-18T10:24:03.680521+0000","last_became_peered":"2023-12-18T10:24:03.680521+0000","last_unstale":"2023-12-18T10:24:05.182399+0000","last_undegraded":"2023-12-18T10:24:05.182399+0000","last_fullsized":"2023-12-18T10:24:05.182399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:14:19.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181637+0000","last_change":"2023-12-18T10:24:03.692366+0000","last_active":"2023-12-18T10:24:05.181637+0000","last_peered":"2023-12-18T10:24:05.181637+0000","last_clean":"2023-12-18T10:24:05.181637+0000","last_became_active":"2023-12-18T10:24:03.691908+0000","last_became_peered":"2023-12-18T10:24:03.691908+0000","last_unstale":"2023-12-18T10:24:05.181637+0000","last_undegraded":"2023-12-18T10:24:05.181637+0000","last_fullsized":"2023-12-18T10:24:05.181637+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:41.815143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899031+0000","last_change":"2023-12-18T10:24:03.672939+0000","last_active":"2023-12-18T10:24:04.899031+0000","last_peered":"2023-12-18T10:24:04.899031+0000","last_clean":"2023-12-18T10:24:04.899031+0000","last_became_active":"2023-12-18T10:24:03.672337+0000","last_became_peered":"2023-12-18T10:24:03.672337+0000","last_unstale":"2023-12-18T10:24:04.899031+0000","last_undegraded":"2023-12-18T10:24:04.899031+0000","last_fullsized":"2023-12-18T10:24:04.899031+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:23.018805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899497+0000","last_change":"2023-12-18T10:24:03.686931+0000","last_active":"2023-12-18T10:24:04.899497+0000","last_peered":"2023-12-18T10:24:04.899497+0000","last_clean":"2023-12-18T10:24:04.899497+0000","last_became_active":"2023-12-18T10:24:03.686663+0000","last_became_peered":"2023-12-18T10:24:03.686663+0000","last_unstale":"2023-12-18T10:24:04.899497+0000","last_undegraded":"2023-12-18T10:24:04.899497+0000","last_fullsized":"2023-12-18T10:24:04.899497+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:43:37.283520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"90'4","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.690455+0000","last_change":"2023-12-18T10:24:03.289449+0000","last_active":"2023-12-18T10:24:03.690455+0000","last_peered":"2023-12-18T10:24:03.690455+0000","last_clean":"2023-12-18T10:24:03.690455+0000","last_became_active":"2023-12-18T10:24:03.289126+0000","last_became_peered":"2023-12-18T10:24:03.289126+0000","last_unstale":"2023-12-18T10:24:03.690455+0000","last_undegraded":"2023-12-18T10:24:03.690455+0000","last_fullsized":"2023-12-18T10:24:03.690455+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:08:11.656004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899296+0000","last_change":"2023-12-18T10:24:03.677686+0000","last_active":"2023-12-18T10:24:04.899296+0000","last_peered":"2023-12-18T10:24:04.899296+0000","last_clean":"2023-12-18T10:24:04.899296+0000","last_became_active":"2023-12-18T10:24:03.677525+0000","last_became_peered":"2023-12-18T10:24:03.677525+0000","last_unstale":"2023-12-18T10:24:04.899296+0000","last_undegraded":"2023-12-18T10:24:04.899296+0000","last_fullsized":"2023-12-18T10:24:04.899296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:48:46.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.691500+0000","last_change":"2023-12-18T10:24:03.291993+0000","last_active":"2023-12-18T10:24:03.691500+0000","last_peered":"2023-12-18T10:24:03.691500+0000","last_clean":"2023-12-18T10:24:03.691500+0000","last_became_active":"2023-12-18T10:24:03.291439+0000","last_became_peered":"2023-12-18T10:24:03.291439+0000","last_unstale":"2023-12-18T10:24:03.691500+0000","last_undegraded":"2023-12-18T10:24:03.691500+0000","last_fullsized":"2023-12-18T10:24:03.691500+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:02.334119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182756+0000","last_change":"2023-12-18T10:24:03.694183+0000","last_active":"2023-12-18T10:24:05.182756+0000","last_peered":"2023-12-18T10:24:05.182756+0000","last_clean":"2023-12-18T10:24:05.182756+0000","last_became_active":"2023-12-18T10:24:03.693887+0000","last_became_peered":"2023-12-18T10:24:03.693887+0000","last_unstale":"2023-12-18T10:24:05.182756+0000","last_undegraded":"2023-12-18T10:24:05.182756+0000","last_fullsized":"2023-12-18T10:24:05.182756+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:25:43.594240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.689854+0000","last_change":"2023-12-18T10:24:03.288810+0000","last_active":"2023-12-18T10:24:03.689854+0000","last_peered":"2023-12-18T10:24:03.689854+0000","last_clean":"2023-12-18T10:24:03.689854+0000","last_became_active":"2023-12-18T10:24:03.288536+0000","last_became_peered":"2023-12-18T10:24:03.288536+0000","last_unstale":"2023-12-18T10:24:03.689854+0000","last_undegraded":"2023-12-18T10:24:03.689854+0000","last_fullsized":"2023-12-18T10:24:03.689854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:58:29.376027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899445+0000","last_change":"2023-12-18T10:24:03.678814+0000","last_active":"2023-12-18T10:24:04.899445+0000","last_peered":"2023-12-18T10:24:04.899445+0000","last_clean":"2023-12-18T10:24:04.899445+0000","last_became_active":"2023-12-18T10:24:03.678515+0000","last_became_peered":"2023-12-18T10:24:03.678515+0000","last_unstale":"2023-12-18T10:24:04.899445+0000","last_undegraded":"2023-12-18T10:24:04.899445+0000","last_fullsized":"2023-12-18T10:24:04.899445+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:44:35.701361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.693933+0000","last_change":"2023-12-18T10:24:03.288716+0000","last_active":"2023-12-18T10:24:03.693933+0000","last_peered":"2023-12-18T10:24:03.693933+0000","last_clean":"2023-12-18T10:24:03.693933+0000","last_became_active":"2023-12-18T10:24:03.288442+0000","last_became_peered":"2023-12-18T10:24:03.288442+0000","last_unstale":"2023-12-18T10:24:03.693933+0000","last_undegraded":"2023-12-18T10:24:03.693933+0000","last_fullsized":"2023-12-18T10:24:03.693933+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:04:22.904429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180383+0000","last_change":"2023-12-18T10:24:03.685309+0000","last_active":"2023-12-18T10:24:05.180383+0000","last_peered":"2023-12-18T10:24:05.180383+0000","last_clean":"2023-12-18T10:24:05.180383+0000","last_became_active":"2023-12-18T10:24:03.684470+0000","last_became_peered":"2023-12-18T10:24:03.684470+0000","last_unstale":"2023-12-18T10:24:05.180383+0000","last_undegraded":"2023-12-18T10:24:05.180383+0000","last_fullsized":"2023-12-18T10:24:05.180383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:58:30.380723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.690864+0000","last_change":"2023-12-18T10:24:03.278043+0000","last_active":"2023-12-18T10:24:03.690864+0000","last_peered":"2023-12-18T10:24:03.690864+0000","last_clean":"2023-12-18T10:24:03.690864+0000","last_became_active":"2023-12-18T10:24:03.277733+0000","last_became_peered":"2023-12-18T10:24:03.277733+0000","last_unstale":"2023-12-18T10:24:03.690864+0000","last_undegraded":"2023-12-18T10:24:03.690864+0000","last_fullsized":"2023-12-18T10:24:03.690864+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659286+0000","last_change":"2023-12-18T10:24:03.680306+0000","last_active":"2023-12-18T10:24:04.659286+0000","last_peered":"2023-12-18T10:24:04.659286+0000","last_clean":"2023-12-18T10:24:04.659286+0000","last_became_active":"2023-12-18T10:24:03.678265+0000","last_became_peered":"2023-12-18T10:24:03.678265+0000","last_unstale":"2023-12-18T10:24:04.659286+0000","last_undegraded":"2023-12-18T10:24:04.659286+0000","last_fullsized":"2023-12-18T10:24:04.659286+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:12.577624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.684271+0000","last_change":"2023-12-18T10:24:03.279428+0000","last_active":"2023-12-18T10:24:03.684271+0000","last_peered":"2023-12-18T10:24:03.684271+0000","last_clean":"2023-12-18T10:24:03.684271+0000","last_became_active":"2023-12-18T10:24:03.279152+0000","last_became_peered":"2023-12-18T10:24:03.279152+0000","last_unstale":"2023-12-18T10:24:03.684271+0000","last_undegraded":"2023-12-18T10:24:03.684271+0000","last_fullsized":"2023-12-18T10:24:03.684271+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:04:01.282465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899050+0000","last_change":"2023-12-18T10:24:03.675828+0000","last_active":"2023-12-18T10:24:04.899050+0000","last_peered":"2023-12-18T10:24:04.899050+0000","last_clean":"2023-12-18T10:24:04.899050+0000","last_became_active":"2023-12-18T10:24:03.675574+0000","last_became_peered":"2023-12-18T10:24:03.675574+0000","last_unstale":"2023-12-18T10:24:04.899050+0000","last_undegraded":"2023-12-18T10:24:04.899050+0000","last_fullsized":"2023-12-18T10:24:04.899050+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:46:14.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.670362+0000","last_change":"2023-12-18T10:24:03.285798+0000","last_active":"2023-12-18T10:24:03.670362+0000","last_peered":"2023-12-18T10:24:03.670362+0000","last_clean":"2023-12-18T10:24:03.670362+0000","last_became_active":"2023-12-18T10:24:03.285491+0000","last_became_peered":"2023-12-18T10:24:03.285491+0000","last_unstale":"2023-12-18T10:24:03.670362+0000","last_undegraded":"2023-12-18T10:24:03.670362+0000","last_fullsized":"2023-12-18T10:24:03.670362+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:43.485098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180958+0000","last_change":"2023-12-18T10:24:03.683692+0000","last_active":"2023-12-18T10:24:05.180958+0000","last_peered":"2023-12-18T10:24:05.180958+0000","last_clean":"2023-12-18T10:24:05.180958+0000","last_became_active":"2023-12-18T10:24:03.682461+0000","last_became_peered":"2023-12-18T10:24:03.682461+0000","last_unstale":"2023-12-18T10:24:05.180958+0000","last_undegraded":"2023-12-18T10:24:05.180958+0000","last_fullsized":"2023-12-18T10:24:05.180958+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:36.499841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.661573+0000","last_change":"2023-12-18T10:24:03.287773+0000","last_active":"2023-12-18T10:24:03.661573+0000","last_peered":"2023-12-18T10:24:03.661573+0000","last_clean":"2023-12-18T10:24:03.661573+0000","last_became_active":"2023-12-18T10:24:03.286960+0000","last_became_peered":"2023-12-18T10:24:03.286960+0000","last_unstale":"2023-12-18T10:24:03.661573+0000","last_undegraded":"2023-12-18T10:24:03.661573+0000","last_fullsized":"2023-12-18T10:24:03.661573+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183055+0000","last_change":"2023-12-18T10:24:03.676822+0000","last_active":"2023-12-18T10:24:05.183055+0000","last_peered":"2023-12-18T10:24:05.183055+0000","last_clean":"2023-12-18T10:24:05.183055+0000","last_became_active":"2023-12-18T10:24:03.676402+0000","last_became_peered":"2023-12-18T10:24:03.676402+0000","last_unstale":"2023-12-18T10:24:05.183055+0000","last_undegraded":"2023-12-18T10:24:05.183055+0000","last_fullsized":"2023-12-18T10:24:05.183055+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:34:49.654703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.671200+0000","last_change":"2023-12-18T10:24:03.289992+0000","last_active":"2023-12-18T10:24:03.671200+0000","last_peered":"2023-12-18T10:24:03.671200+0000","last_clean":"2023-12-18T10:24:03.671200+0000","last_became_active":"2023-12-18T10:24:03.289678+0000","last_became_peered":"2023-12-18T10:24:03.289678+0000","last_unstale":"2023-12-18T10:24:03.671200+0000","last_undegraded":"2023-12-18T10:24:03.671200+0000","last_fullsized":"2023-12-18T10:24:03.671200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:37:23.747065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182410+0000","last_change":"2023-12-18T10:24:03.687118+0000","last_active":"2023-12-18T10:24:05.182410+0000","last_peered":"2023-12-18T10:24:05.182410+0000","last_clean":"2023-12-18T10:24:05.182410+0000","last_became_active":"2023-12-18T10:24:03.686749+0000","last_became_peered":"2023-12-18T10:24:03.686749+0000","last_unstale":"2023-12-18T10:24:05.182410+0000","last_undegraded":"2023-12-18T10:24:05.182410+0000","last_fullsized":"2023-12-18T10:24:05.182410+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:58:17.984865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.673612+0000","last_change":"2023-12-18T10:24:03.279579+0000","last_active":"2023-12-18T10:24:03.673612+0000","last_peered":"2023-12-18T10:24:03.673612+0000","last_clean":"2023-12-18T10:24:03.673612+0000","last_became_active":"2023-12-18T10:24:03.279279+0000","last_became_peered":"2023-12-18T10:24:03.279279+0000","last_unstale":"2023-12-18T10:24:03.673612+0000","last_undegraded":"2023-12-18T10:24:03.673612+0000","last_fullsized":"2023-12-18T10:24:03.673612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:53.568002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181029+0000","last_change":"2023-12-18T10:24:03.676318+0000","last_active":"2023-12-18T10:24:05.181029+0000","last_peered":"2023-12-18T10:24:05.181029+0000","last_clean":"2023-12-18T10:24:05.181029+0000","last_became_active":"2023-12-18T10:24:03.676066+0000","last_became_peered":"2023-12-18T10:24:03.676066+0000","last_unstale":"2023-12-18T10:24:05.181029+0000","last_undegraded":"2023-12-18T10:24:05.181029+0000","last_fullsized":"2023-12-18T10:24:05.181029+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:52:14.855733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"90'3","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.697000+0000","last_change":"2023-12-18T10:24:03.283429+0000","last_active":"2023-12-18T10:24:03.697000+0000","last_peered":"2023-12-18T10:24:03.697000+0000","last_clean":"2023-12-18T10:24:03.697000+0000","last_became_active":"2023-12-18T10:24:03.282898+0000","last_became_peered":"2023-12-18T10:24:03.282898+0000","last_unstale":"2023-12-18T10:24:03.697000+0000","last_undegraded":"2023-12-18T10:24:03.697000+0000","last_fullsized":"2023-12-18T10:24:03.697000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:20.153111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180659+0000","last_change":"2023-12-18T10:24:03.684528+0000","last_active":"2023-12-18T10:24:05.180659+0000","last_peered":"2023-12-18T10:24:05.180659+0000","last_clean":"2023-12-18T10:24:05.180659+0000","last_became_active":"2023-12-18T10:24:03.682495+0000","last_became_peered":"2023-12-18T10:24:03.682495+0000","last_unstale":"2023-12-18T10:24:05.180659+0000","last_undegraded":"2023-12-18T10:24:05.180659+0000","last_fullsized":"2023-12-18T10:24:05.180659+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:37:24.751761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"90'6","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.694884+0000","last_change":"2023-12-18T10:24:03.290588+0000","last_active":"2023-12-18T10:24:03.694884+0000","last_peered":"2023-12-18T10:24:03.694884+0000","last_clean":"2023-12-18T10:24:03.694884+0000","last_became_active":"2023-12-18T10:24:03.290300+0000","last_became_peered":"2023-12-18T10:24:03.290300+0000","last_unstale":"2023-12-18T10:24:03.694884+0000","last_undegraded":"2023-12-18T10:24:03.694884+0000","last_fullsized":"2023-12-18T10:24:03.694884+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:51:34.076185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180426+0000","last_change":"2023-12-18T10:24:03.687601+0000","last_active":"2023-12-18T10:24:05.180426+0000","last_peered":"2023-12-18T10:24:05.180426+0000","last_clean":"2023-12-18T10:24:05.180426+0000","last_became_active":"2023-12-18T10:24:03.684712+0000","last_became_peered":"2023-12-18T10:24:03.684712+0000","last_unstale":"2023-12-18T10:24:05.180426+0000","last_undegraded":"2023-12-18T10:24:05.180426+0000","last_fullsized":"2023-12-18T10:24:05.180426+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:33:49.014369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.693914+0000","last_change":"2023-12-18T10:24:03.287220+0000","last_active":"2023-12-18T10:24:03.693914+0000","last_peered":"2023-12-18T10:24:03.693914+0000","last_clean":"2023-12-18T10:24:03.693914+0000","last_became_active":"2023-12-18T10:24:03.286914+0000","last_became_peered":"2023-12-18T10:24:03.286914+0000","last_unstale":"2023-12-18T10:24:03.693914+0000","last_undegraded":"2023-12-18T10:24:03.693914+0000","last_fullsized":"2023-12-18T10:24:03.693914+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182203+0000","last_change":"2023-12-18T10:24:03.684746+0000","last_active":"2023-12-18T10:24:05.182203+0000","last_peered":"2023-12-18T10:24:05.182203+0000","last_clean":"2023-12-18T10:24:05.182203+0000","last_became_active":"2023-12-18T10:24:03.684299+0000","last_became_peered":"2023-12-18T10:24:03.684299+0000","last_unstale":"2023-12-18T10:24:05.182203+0000","last_undegraded":"2023-12-18T10:24:05.182203+0000","last_fullsized":"2023-12-18T10:24:05.182203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:48:46.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.656927+0000","last_change":"2023-12-18T10:24:03.278785+0000","last_active":"2023-12-18T10:24:03.656927+0000","last_peered":"2023-12-18T10:24:03.656927+0000","last_clean":"2023-12-18T10:24:03.656927+0000","last_became_active":"2023-12-18T10:24:03.278478+0000","last_became_peered":"2023-12-18T10:24:03.278478+0000","last_unstale":"2023-12-18T10:24:03.656927+0000","last_undegraded":"2023-12-18T10:24:03.656927+0000","last_fullsized":"2023-12-18T10:24:03.656927+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:55.218379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.658848+0000","last_change":"2023-12-18T10:24:03.692930+0000","last_active":"2023-12-18T10:24:04.658848+0000","last_peered":"2023-12-18T10:24:04.658848+0000","last_clean":"2023-12-18T10:24:04.658848+0000","last_became_active":"2023-12-18T10:24:03.692683+0000","last_became_peered":"2023-12-18T10:24:03.692683+0000","last_unstale":"2023-12-18T10:24:04.658848+0000","last_undegraded":"2023-12-18T10:24:04.658848+0000","last_fullsized":"2023-12-18T10:24:04.658848+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:25.172762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.664711+0000","last_change":"2023-12-18T10:24:03.288434+0000","last_active":"2023-12-18T10:24:03.664711+0000","last_peered":"2023-12-18T10:24:03.664711+0000","last_clean":"2023-12-18T10:24:03.664711+0000","last_became_active":"2023-12-18T10:24:03.288129+0000","last_became_peered":"2023-12-18T10:24:03.288129+0000","last_unstale":"2023-12-18T10:24:03.664711+0000","last_undegraded":"2023-12-18T10:24:03.664711+0000","last_fullsized":"2023-12-18T10:24:03.664711+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:21.447878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659062+0000","last_change":"2023-12-18T10:24:03.681650+0000","last_active":"2023-12-18T10:24:04.659062+0000","last_peered":"2023-12-18T10:24:04.659062+0000","last_clean":"2023-12-18T10:24:04.659062+0000","last_became_active":"2023-12-18T10:24:03.681395+0000","last_became_peered":"2023-12-18T10:24:03.681395+0000","last_unstale":"2023-12-18T10:24:04.659062+0000","last_undegraded":"2023-12-18T10:24:04.659062+0000","last_fullsized":"2023-12-18T10:24:04.659062+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:31:14.079660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"90'8","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.696729+0000","last_change":"2023-12-18T10:24:03.282660+0000","last_active":"2023-12-18T10:24:03.696729+0000","last_peered":"2023-12-18T10:24:03.696729+0000","last_clean":"2023-12-18T10:24:03.696729+0000","last_became_active":"2023-12-18T10:24:03.282375+0000","last_became_peered":"2023-12-18T10:24:03.282375+0000","last_unstale":"2023-12-18T10:24:03.696729+0000","last_undegraded":"2023-12-18T10:24:03.696729+0000","last_fullsized":"2023-12-18T10:24:03.696729+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:28:44.825382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899170+0000","last_change":"2023-12-18T10:24:03.686451+0000","last_active":"2023-12-18T10:24:04.899170+0000","last_peered":"2023-12-18T10:24:04.899170+0000","last_clean":"2023-12-18T10:24:04.899170+0000","last_became_active":"2023-12-18T10:24:03.686028+0000","last_became_peered":"2023-12-18T10:24:03.686028+0000","last_unstale":"2023-12-18T10:24:04.899170+0000","last_undegraded":"2023-12-18T10:24:04.899170+0000","last_fullsized":"2023-12-18T10:24:04.899170+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:14:19.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.679354+0000","last_change":"2023-12-18T10:24:03.288612+0000","last_active":"2023-12-18T10:24:03.679354+0000","last_peered":"2023-12-18T10:24:03.679354+0000","last_clean":"2023-12-18T10:24:03.679354+0000","last_became_active":"2023-12-18T10:24:03.288333+0000","last_became_peered":"2023-12-18T10:24:03.288333+0000","last_unstale":"2023-12-18T10:24:03.679354+0000","last_undegraded":"2023-12-18T10:24:03.679354+0000","last_fullsized":"2023-12-18T10:24:03.679354+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:55.131352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659611+0000","last_change":"2023-12-18T10:24:03.673007+0000","last_active":"2023-12-18T10:24:04.659611+0000","last_peered":"2023-12-18T10:24:04.659611+0000","last_clean":"2023-12-18T10:24:04.659611+0000","last_became_active":"2023-12-18T10:24:03.672668+0000","last_became_peered":"2023-12-18T10:24:03.672668+0000","last_unstale":"2023-12-18T10:24:04.659611+0000","last_undegraded":"2023-12-18T10:24:04.659611+0000","last_fullsized":"2023-12-18T10:24:04.659611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:51:47.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.689256+0000","last_change":"2023-12-18T10:24:03.286475+0000","last_active":"2023-12-18T10:24:03.689256+0000","last_peered":"2023-12-18T10:24:03.689256+0000","last_clean":"2023-12-18T10:24:03.689256+0000","last_became_active":"2023-12-18T10:24:03.285640+0000","last_became_peered":"2023-12-18T10:24:03.285640+0000","last_unstale":"2023-12-18T10:24:03.689256+0000","last_undegraded":"2023-12-18T10:24:03.689256+0000","last_fullsized":"2023-12-18T10:24:03.689256+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:33:48.009673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183193+0000","last_change":"2023-12-18T10:24:03.683331+0000","last_active":"2023-12-18T10:24:05.183193+0000","last_peered":"2023-12-18T10:24:05.183193+0000","last_clean":"2023-12-18T10:24:05.183193+0000","last_became_active":"2023-12-18T10:24:03.678860+0000","last_became_peered":"2023-12-18T10:24:03.678860+0000","last_unstale":"2023-12-18T10:24:05.183193+0000","last_undegraded":"2023-12-18T10:24:05.183193+0000","last_fullsized":"2023-12-18T10:24:05.183193+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:39:41.724333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.697991+0000","last_change":"2023-12-18T10:24:03.282269+0000","last_active":"2023-12-18T10:24:03.697991+0000","last_peered":"2023-12-18T10:24:03.697991+0000","last_clean":"2023-12-18T10:24:03.697991+0000","last_became_active":"2023-12-18T10:24:03.281990+0000","last_became_peered":"2023-12-18T10:24:03.281990+0000","last_unstale":"2023-12-18T10:24:03.697991+0000","last_undegraded":"2023-12-18T10:24:03.697991+0000","last_fullsized":"2023-12-18T10:24:03.697991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899097+0000","last_change":"2023-12-18T10:24:03.690975+0000","last_active":"2023-12-18T10:24:04.899097+0000","last_peered":"2023-12-18T10:24:04.899097+0000","last_clean":"2023-12-18T10:24:04.899097+0000","last_became_active":"2023-12-18T10:24:03.690729+0000","last_became_peered":"2023-12-18T10:24:03.690729+0000","last_unstale":"2023-12-18T10:24:04.899097+0000","last_undegraded":"2023-12-18T10:24:04.899097+0000","last_fullsized":"2023-12-18T10:24:04.899097+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.677639+0000","last_change":"2023-12-18T10:24:03.284496+0000","last_active":"2023-12-18T10:24:03.677639+0000","last_peered":"2023-12-18T10:24:03.677639+0000","last_clean":"2023-12-18T10:24:03.677639+0000","last_became_active":"2023-12-18T10:24:03.283573+0000","last_became_peered":"2023-12-18T10:24:03.283573+0000","last_unstale":"2023-12-18T10:24:03.677639+0000","last_undegraded":"2023-12-18T10:24:03.677639+0000","last_fullsized":"2023-12-18T10:24:03.677639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:22:32.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181698+0000","last_change":"2023-12-18T10:24:03.678240+0000","last_active":"2023-12-18T10:24:05.181698+0000","last_peered":"2023-12-18T10:24:05.181698+0000","last_clean":"2023-12-18T10:24:05.181698+0000","last_became_active":"2023-12-18T10:24:03.677955+0000","last_became_peered":"2023-12-18T10:24:03.677955+0000","last_unstale":"2023-12-18T10:24:05.181698+0000","last_undegraded":"2023-12-18T10:24:05.181698+0000","last_fullsized":"2023-12-18T10:24:05.181698+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:51:35.080881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.666496+0000","last_change":"2023-12-18T10:24:03.282173+0000","last_active":"2023-12-18T10:24:03.666496+0000","last_peered":"2023-12-18T10:24:03.666496+0000","last_clean":"2023-12-18T10:24:03.666496+0000","last_became_active":"2023-12-18T10:24:03.280631+0000","last_became_peered":"2023-12-18T10:24:03.280631+0000","last_unstale":"2023-12-18T10:24:03.666496+0000","last_undegraded":"2023-12-18T10:24:03.666496+0000","last_fullsized":"2023-12-18T10:24:03.666496+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:43:26.508524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181792+0000","last_change":"2023-12-18T10:24:03.695386+0000","last_active":"2023-12-18T10:24:05.181792+0000","last_peered":"2023-12-18T10:24:05.181792+0000","last_clean":"2023-12-18T10:24:05.181792+0000","last_became_active":"2023-12-18T10:24:03.695124+0000","last_became_peered":"2023-12-18T10:24:03.695124+0000","last_unstale":"2023-12-18T10:24:05.181792+0000","last_undegraded":"2023-12-18T10:24:05.181792+0000","last_fullsized":"2023-12-18T10:24:05.181792+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:21.157806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.668377+0000","last_change":"2023-12-18T10:24:03.285860+0000","last_active":"2023-12-18T10:24:03.668377+0000","last_peered":"2023-12-18T10:24:03.668377+0000","last_clean":"2023-12-18T10:24:03.668377+0000","last_became_active":"2023-12-18T10:24:03.285251+0000","last_became_peered":"2023-12-18T10:24:03.285251+0000","last_unstale":"2023-12-18T10:24:03.668377+0000","last_undegraded":"2023-12-18T10:24:03.668377+0000","last_fullsized":"2023-12-18T10:24:03.668377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:02:35.397564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899179+0000","last_change":"2023-12-18T10:24:03.667581+0000","last_active":"2023-12-18T10:24:04.899179+0000","last_peered":"2023-12-18T10:24:04.899179+0000","last_clean":"2023-12-18T10:24:04.899179+0000","last_became_active":"2023-12-18T10:24:03.666916+0000","last_became_peered":"2023-12-18T10:24:03.666916+0000","last_unstale":"2023-12-18T10:24:04.899179+0000","last_undegraded":"2023-12-18T10:24:04.899179+0000","last_fullsized":"2023-12-18T10:24:04.899179+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:26:30.624215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.665395+0000","last_change":"2023-12-18T10:24:03.280333+0000","last_active":"2023-12-18T10:24:03.665395+0000","last_peered":"2023-12-18T10:24:03.665395+0000","last_clean":"2023-12-18T10:24:03.665395+0000","last_became_active":"2023-12-18T10:24:03.280070+0000","last_became_peered":"2023-12-18T10:24:03.280070+0000","last_unstale":"2023-12-18T10:24:03.665395+0000","last_undegraded":"2023-12-18T10:24:03.665395+0000","last_fullsized":"2023-12-18T10:24:03.665395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:15:11.695579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659420+0000","last_change":"2023-12-18T10:24:03.679837+0000","last_active":"2023-12-18T10:24:04.659420+0000","last_peered":"2023-12-18T10:24:04.659420+0000","last_clean":"2023-12-18T10:24:04.659420+0000","last_became_active":"2023-12-18T10:24:03.679109+0000","last_became_peered":"2023-12-18T10:24:03.679109+0000","last_unstale":"2023-12-18T10:24:04.659420+0000","last_undegraded":"2023-12-18T10:24:04.659420+0000","last_fullsized":"2023-12-18T10:24:04.659420+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:23:45.810533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.687308+0000","last_change":"2023-12-18T10:24:03.292542+0000","last_active":"2023-12-18T10:24:03.687308+0000","last_peered":"2023-12-18T10:24:03.687308+0000","last_clean":"2023-12-18T10:24:03.687308+0000","last_became_active":"2023-12-18T10:24:03.292268+0000","last_became_peered":"2023-12-18T10:24:03.292268+0000","last_unstale":"2023-12-18T10:24:03.687308+0000","last_undegraded":"2023-12-18T10:24:03.687308+0000","last_fullsized":"2023-12-18T10:24:03.687308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899406+0000","last_change":"2023-12-18T10:24:03.687204+0000","last_active":"2023-12-18T10:24:04.899406+0000","last_peered":"2023-12-18T10:24:04.899406+0000","last_clean":"2023-12-18T10:24:04.899406+0000","last_became_active":"2023-12-18T10:24:03.686465+0000","last_became_peered":"2023-12-18T10:24:03.686465+0000","last_unstale":"2023-12-18T10:24:04.899406+0000","last_undegraded":"2023-12-18T10:24:04.899406+0000","last_fullsized":"2023-12-18T10:24:04.899406+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:38:11.711182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.663527+0000","last_change":"2023-12-18T10:24:03.283236+0000","last_active":"2023-12-18T10:24:03.663527+0000","last_peered":"2023-12-18T10:24:03.663527+0000","last_clean":"2023-12-18T10:24:03.663527+0000","last_became_active":"2023-12-18T10:24:03.282944+0000","last_became_peered":"2023-12-18T10:24:03.282944+0000","last_unstale":"2023-12-18T10:24:03.663527+0000","last_undegraded":"2023-12-18T10:24:03.663527+0000","last_fullsized":"2023-12-18T10:24:03.663527+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899314+0000","last_change":"2023-12-18T10:24:03.677980+0000","last_active":"2023-12-18T10:24:04.899314+0000","last_peered":"2023-12-18T10:24:04.899314+0000","last_clean":"2023-12-18T10:24:04.899314+0000","last_became_active":"2023-12-18T10:24:03.675813+0000","last_became_peered":"2023-12-18T10:24:03.675813+0000","last_unstale":"2023-12-18T10:24:04.899314+0000","last_undegraded":"2023-12-18T10:24:04.899314+0000","last_fullsized":"2023-12-18T10:24:04.899314+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:16:44.861634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.665921+0000","last_change":"2023-12-18T10:24:03.283229+0000","last_active":"2023-12-18T10:24:03.665921+0000","last_peered":"2023-12-18T10:24:03.665921+0000","last_clean":"2023-12-18T10:24:03.665921+0000","last_became_active":"2023-12-18T10:24:03.282527+0000","last_became_peered":"2023-12-18T10:24:03.282527+0000","last_unstale":"2023-12-18T10:24:03.665921+0000","last_undegraded":"2023-12-18T10:24:03.665921+0000","last_fullsized":"2023-12-18T10:24:03.665921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182810+0000","last_change":"2023-12-18T10:24:03.685636+0000","last_active":"2023-12-18T10:24:05.182810+0000","last_peered":"2023-12-18T10:24:05.182810+0000","last_clean":"2023-12-18T10:24:05.182810+0000","last_became_active":"2023-12-18T10:24:03.685374+0000","last_became_peered":"2023-12-18T10:24:03.685374+0000","last_unstale":"2023-12-18T10:24:05.182810+0000","last_undegraded":"2023-12-18T10:24:05.182810+0000","last_fullsized":"2023-12-18T10:24:05.182810+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:44.489794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.662577+0000","last_change":"2023-12-18T10:24:03.289304+0000","last_active":"2023-12-18T10:24:03.662577+0000","last_peered":"2023-12-18T10:24:03.662577+0000","last_clean":"2023-12-18T10:24:03.662577+0000","last_became_active":"2023-12-18T10:24:03.289002+0000","last_became_peered":"2023-12-18T10:24:03.289002+0000","last_unstale":"2023-12-18T10:24:03.662577+0000","last_undegraded":"2023-12-18T10:24:03.662577+0000","last_fullsized":"2023-12-18T10:24:03.662577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:01:00.828132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.658719+0000","last_change":"2023-12-18T10:24:03.678574+0000","last_active":"2023-12-18T10:24:04.658719+0000","last_peered":"2023-12-18T10:24:04.658719+0000","last_clean":"2023-12-18T10:24:04.658719+0000","last_became_active":"2023-12-18T10:24:03.678308+0000","last_became_peered":"2023-12-18T10:24:03.678308+0000","last_unstale":"2023-12-18T10:24:04.658719+0000","last_undegraded":"2023-12-18T10:24:04.658719+0000","last_fullsized":"2023-12-18T10:24:04.658719+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:20:28.314333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.656806+0000","last_change":"2023-12-18T10:24:03.281372+0000","last_active":"2023-12-18T10:24:03.656806+0000","last_peered":"2023-12-18T10:24:03.656806+0000","last_clean":"2023-12-18T10:24:03.656806+0000","last_became_active":"2023-12-18T10:24:03.281115+0000","last_became_peered":"2023-12-18T10:24:03.281115+0000","last_unstale":"2023-12-18T10:24:03.656806+0000","last_undegraded":"2023-12-18T10:24:03.656806+0000","last_fullsized":"2023-12-18T10:24:03.656806+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:40.810447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180219+0000","last_change":"2023-12-18T10:24:03.694300+0000","last_active":"2023-12-18T10:24:05.180219+0000","last_peered":"2023-12-18T10:24:05.180219+0000","last_clean":"2023-12-18T10:24:05.180219+0000","last_became_active":"2023-12-18T10:24:03.693737+0000","last_became_peered":"2023-12-18T10:24:03.693737+0000","last_unstale":"2023-12-18T10:24:05.180219+0000","last_undegraded":"2023-12-18T10:24:05.180219+0000","last_fullsized":"2023-12-18T10:24:05.180219+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:34:49.654703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.668154+0000","last_change":"2023-12-18T10:24:03.283881+0000","last_active":"2023-12-18T10:24:03.668154+0000","last_peered":"2023-12-18T10:24:03.668154+0000","last_clean":"2023-12-18T10:24:03.668154+0000","last_became_active":"2023-12-18T10:24:03.283588+0000","last_became_peered":"2023-12-18T10:24:03.283588+0000","last_unstale":"2023-12-18T10:24:03.668154+0000","last_undegraded":"2023-12-18T10:24:03.668154+0000","last_fullsized":"2023-12-18T10:24:03.668154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:46:44.625658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659248+0000","last_change":"2023-12-18T10:24:03.688049+0000","last_active":"2023-12-18T10:24:04.659248+0000","last_peered":"2023-12-18T10:24:04.659248+0000","last_clean":"2023-12-18T10:24:04.659248+0000","last_became_active":"2023-12-18T10:24:03.687746+0000","last_became_peered":"2023-12-18T10:24:03.687746+0000","last_unstale":"2023-12-18T10:24:04.659248+0000","last_undegraded":"2023-12-18T10:24:04.659248+0000","last_fullsized":"2023-12-18T10:24:04.659248+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:51.149076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.663387+0000","last_change":"2023-12-18T10:24:03.287178+0000","last_active":"2023-12-18T10:24:03.663387+0000","last_peered":"2023-12-18T10:24:03.663387+0000","last_clean":"2023-12-18T10:24:03.663387+0000","last_became_active":"2023-12-18T10:24:03.286818+0000","last_became_peered":"2023-12-18T10:24:03.286818+0000","last_unstale":"2023-12-18T10:24:03.663387+0000","last_undegraded":"2023-12-18T10:24:03.663387+0000","last_fullsized":"2023-12-18T10:24:03.663387+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:49:26.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899283+0000","last_change":"2023-12-18T10:24:03.674118+0000","last_active":"2023-12-18T10:24:04.899283+0000","last_peered":"2023-12-18T10:24:04.899283+0000","last_clean":"2023-12-18T10:24:04.899283+0000","last_became_active":"2023-12-18T10:24:03.673869+0000","last_became_peered":"2023-12-18T10:24:03.673869+0000","last_unstale":"2023-12-18T10:24:04.899283+0000","last_undegraded":"2023-12-18T10:24:04.899283+0000","last_fullsized":"2023-12-18T10:24:04.899283+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:19:38.852286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.666336+0000","last_change":"2023-12-18T10:24:03.285821+0000","last_active":"2023-12-18T10:24:03.666336+0000","last_peered":"2023-12-18T10:24:03.666336+0000","last_clean":"2023-12-18T10:24:03.666336+0000","last_became_active":"2023-12-18T10:24:03.285378+0000","last_became_peered":"2023-12-18T10:24:03.285378+0000","last_unstale":"2023-12-18T10:24:03.666336+0000","last_undegraded":"2023-12-18T10:24:03.666336+0000","last_fullsized":"2023-12-18T10:24:03.666336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182479+0000","last_change":"2023-12-18T10:24:03.677567+0000","last_active":"2023-12-18T10:24:05.182479+0000","last_peered":"2023-12-18T10:24:05.182479+0000","last_clean":"2023-12-18T10:24:05.182479+0000","last_became_active":"2023-12-18T10:24:03.677068+0000","last_became_peered":"2023-12-18T10:24:03.677068+0000","last_unstale":"2023-12-18T10:24:05.182479+0000","last_undegraded":"2023-12-18T10:24:05.182479+0000","last_fullsized":"2023-12-18T10:24:05.182479+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:42:24.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.666264+0000","last_change":"2023-12-18T10:24:03.281646+0000","last_active":"2023-12-18T10:24:03.666264+0000","last_peered":"2023-12-18T10:24:03.666264+0000","last_clean":"2023-12-18T10:24:03.666264+0000","last_became_active":"2023-12-18T10:24:03.281197+0000","last_became_peered":"2023-12-18T10:24:03.281197+0000","last_unstale":"2023-12-18T10:24:03.666264+0000","last_undegraded":"2023-12-18T10:24:03.666264+0000","last_fullsized":"2023-12-18T10:24:03.666264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:06:25.659280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.661962+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:24:03.661962+0000","last_peered":"2023-12-18T10:24:03.661962+0000","last_clean":"2023-12-18T10:24:03.661962+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:24:03.661962+0000","last_undegraded":"2023-12-18T10:24:03.661962+0000","last_fullsized":"2023-12-18T10:24:03.661962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1724416,"data_stored":1105906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.53700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68400000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90900000000000003,"5min":1.137,"15min":1.137},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.623}]},{"osd":6,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.71199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1142784,"data_stored":517650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.81399999999999995},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89500000000000002,"5min":0.93100000000000005,"15min":4.3760000000000003},"last":1.018},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.85499999999999998},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":0.91400000000000003,"5min":0.98299999999999998,"15min":4.4669999999999996},"last":0.98999999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":4.524},"last":1.179}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71499999999999997,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92300000000000004,"5min":0.97699999999999998,"15min":2.2709999999999999},"last":1.121},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.925},"last":1.0940000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.81399999999999995},"min":{"1min":0.60999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70399999999999996,"15min":0.86299999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.81100000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.054},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.101},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.284},"last":0.84599999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0880000000000001,"15min":1.129},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69899999999999995,"15min":0.749},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0820000000000001},"last":0.89500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1122304,"data_stored":515482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66600000000000004},"min":{"1min":0.47199999999999998,"5min":0.37,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.93999999999999995,"15min":1.0900000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66900000000000004,"15min":0.74399999999999999},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65700000000000003,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":3.3100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76200000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.98899999999999999,"5min":0.99399999999999999,"15min":2.9449999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67800000000000005,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.90500000000000003,"5min":0.93500000000000005,"15min":2.0699999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.80300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63,"15min":0.92000000000000004},"min":{"1min":0.38800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85599999999999998,"5min":0.94399999999999995,"15min":8.9740000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67600000000000005,"15min":0.69399999999999995},"min":{"1min":0.48999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":1.0109999999999999,"15min":1.2370000000000001},"last":0.83399999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61899999999999999,"15min":0.74099999999999999},"min":{"1min":0.40100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.876,"5min":0.93200000000000005,"15min":2.9060000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.76900000000000002},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.96399999999999997,"5min":1.042,"15min":3.3319999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63400000000000001,"15min":0.68600000000000005},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":1.042,"15min":1.1830000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67400000000000004,"15min":0.80200000000000005},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.81299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":515642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86599999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.85799999999999998,"5min":0.92800000000000005,"15min":1.1739999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":1.004,"15min":1.131},"last":0.745},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65900000000000003,"15min":0.67700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83999999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70899999999999996,"15min":0.71499999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.79800000000000004,"5min":1.008,"15min":1.032},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69699999999999995,"15min":0.71499999999999997},"min":{"1min":0.54600000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.77600000000000002,"5min":0.94499999999999995,"15min":0.999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.53500000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89800000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80700000000000005,"5min":0.91900000000000004,"15min":0.97399999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86799999999999999,"5min":0.874,"15min":0.874},"last":0.72999999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.627,"15min":0.67500000000000004},"min":{"1min":0.48599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86799999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.72299999999999998},"min":{"1min":0.46000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.073},"last":0.71799999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67300000000000004,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48399999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.042},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":0.93300000000000005,"15min":1.1479999999999999},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1122304,"data_stored":515482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.503},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.65800000000000003,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.44900000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.46700000000000003},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.49199999999999999,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76000000000000001,"5min":1.036,"15min":1.254},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":0.72199999999999998,"5min":0.98899999999999999,"15min":1.772},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.98099999999999998,"15min":1.01},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":1.167,"15min":1.181},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71499999999999997,"15min":0.746},"min":{"1min":0.53700000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":1.171,"15min":1.171},"last":0.621},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68100000000000005,"15min":0.70699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80000000000000004,"5min":1.0549999999999999,"15min":1.069},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73299999999999998,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85499999999999998,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.77900000000000003},"min":{"1min":0.55700000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.81299999999999994,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.82999999999999996,"5min":1.26,"15min":1.26},"last":0.71699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1122304,"data_stored":515482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.42299999999999999,"15min":0.439},"min":{"1min":0.28499999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.56000000000000005,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46300000000000002,"15min":0.501},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.89700000000000002},"last":0.33300000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.49399999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48899999999999999,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77100000000000002,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.61899999999999999,"5min":0.65700000000000003,"15min":0.92000000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52800000000000002,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":1.1599999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72899999999999998,"15min":0.79000000000000004},"min":{"1min":0.51500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":1.0469999999999999,"15min":1.698},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96699999999999997,"5min":1.0820000000000001,"15min":1.4219999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90000000000000002,"5min":0.96099999999999997,"15min":1.3069999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.747,"15min":0.80700000000000005},"min":{"1min":0.56000000000000005,"5min":0.54600000000000004,"15min":0.51600000000000001},"max":{"1min":0.99099999999999999,"5min":1.085,"15min":1.7549999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.92600000000000005,"5min":1.0680000000000001,"15min":1.341},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73799999999999999,"15min":0.77500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97399999999999998,"5min":1.107,"15min":1.3939999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.78100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":1.048,"15min":1.282},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.56599999999999995,"15min":0.47099999999999997},"max":{"1min":1.0029999999999999,"5min":1.093,"15min":1.4530000000000001},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":1126400,"data_stored":515552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.41699999999999998,"15min":0.57499999999999996},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.48999999999999999,"5min":1.7150000000000001,"15min":3.976},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.442,"15min":0.503},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47299999999999998,"15min":0.61399999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":3.2370000000000001,"15min":3.786},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47999999999999998,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86799999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.64900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93100000000000005,"5min":2.1589999999999998,"15min":3.6400000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.63900000000000001},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91800000000000004,"5min":1.9399999999999999,"15min":3.2440000000000002},"last":0.44700000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.79800000000000004},"min":{"1min":0.56200000000000006,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93000000000000005,"5min":1.7889999999999999,"15min":1.851},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72999999999999998,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.6539999999999999,"15min":4.5129999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.874,"5min":1.6100000000000001,"15min":4.1859999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74399999999999999,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98299999999999998,"5min":1.823,"15min":2.0699999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.91300000000000003},"min":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.47099999999999997},"max":{"1min":0.93999999999999995,"5min":1.6850000000000001,"15min":4.3529999999999998},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91000000000000003,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.76600000000000001,"15min":0.82199999999999995},"min":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.04,"5min":1.8799999999999999,"15min":1.9770000000000001},"last":0.78700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1740800,"data_stored":1108120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44400000000000001,"15min":0.48499999999999999},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82999999999999996,"5min":0.92900000000000005,"15min":1.456},"last":0.375}]},{"osd":2,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.53500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":1.0589999999999999,"15min":1.595},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.57099999999999995},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68400000000000005,"5min":0.748,"15min":2.464},"last":0.33600000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.52700000000000002},"min":{"1min":0.309,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.859},"last":0.313},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.621},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.90000000000000002,"15min":1.903},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0760000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77200000000000002,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.2589999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.746,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.78000000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.79500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.278,"15min":1.5700000000000001},"last":0.748},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.0389999999999999,"15min":1.53},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":1.349,"15min":1.556},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.032,"15min":1.2909999999999999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:24:12.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:24:12.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.742+0000 7f285e4f9640 1 Processor -- start 2023-12-18T10:24:12.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.742+0000 7f285e4f9640 1 -- start start 2023-12-18T10:24:12.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.742+0000 7f285e4f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 0x7f285806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.742+0000 7f285e4f9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f285806c320 0x7f28580c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.742+0000 7f285e4f9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28580c9460 con 0x7f28580c9e30 2023-12-18T10:24:12.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.742+0000 7f285e4f9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285806c7a0 con 0x7f285806c320 2023-12-18T10:24:12.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.742+0000 7f285e4f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28581574a0 con 0x7f28581570c0 2023-12-18T10:24:12.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f285ca96640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28580c9e30 0x7f285815d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53894/0 (socket says 172.21.15.133:53894) 2023-12-18T10:24:12.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f285ca96640 1 -- 172.21.15.133:0/2593897670 learned_addr learned my addr 172.21.15.133:0/2593897670 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f28577fe640 1 --2- 172.21.15.133:0/2593897670 >> v2:172.21.15.142:3300/0 conn(0x7f285806c320 0x7f28580c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2857fff640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 0x7f285806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835249819 0 0) 0x7f28580c9460 con 0x7f28580c9e30 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2840003530 con 0x7f28580c9e30 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2717639657 0 0) 0x7f2840003530 con 0x7f28580c9e30 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 msgr2=0x7f285806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 0x7f285806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 >> v2:172.21.15.142:3300/0 conn(0x7f285806c320 msgr2=0x7f28580c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 --2- 172.21.15.133:0/2593897670 >> v2:172.21.15.142:3300/0 conn(0x7f285806c320 0x7f28580c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580c8b30 con 0x7f28580c9e30 2023-12-18T10:24:12.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f2850001a00 con 0x7f28580c9e30 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 >> v1:172.21.15.133:6789/0 conn(0x7f28580c9e30 legacy=0x7f285815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2840003980 0x7f2840003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 0x7f28400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840004d10 0x7f2840005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285806c7a0 con 0x7f2840003980 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28581574a0 con 0x7f2840004d10 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284000b990 con 0x7f28581570c0 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2857fff640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2840003980 0x7f2840003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f28577fe640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 0x7f28400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f285ca96640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840004d10 0x7f2840005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2857fff640 1 -- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 msgr2=0x7f28400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2857fff640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 0x7f28400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2857fff640 1 -- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840004d10 msgr2=0x7f2840005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:12.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2857fff640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840004d10 0x7f2840005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f2857fff640 1 -- 172.21.15.133:0/2593897670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840003530 con 0x7f2840003980 2023-12-18T10:24:12.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f285ca96640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840004d10 0x7f2840005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:12.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.746+0000 7f28577fe640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581570c0 0x7f28400047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:12.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f2857fff640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2840003980 0x7f2840003da0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2848009ae0 tx=0x7f284801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ad831ad8401650 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:12.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480a6510 con 0x7f2840003980 2023-12-18T10:24:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28480a6670 con 0x7f2840003980 2023-12-18T10:24:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f2856ffd640 1 -- 172.21.15.133:0/2593897670 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480a6a20 con 0x7f2840003980 2023-12-18T10:24:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285e4f9640 1 -- 172.21.15.133:0/2593897670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2840003980 msgr2=0x7f2840003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:12.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285e4f9640 1 --2- 172.21.15.133:0/2593897670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2840003980 0x7f2840003da0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2848009ae0 tx=0x7f284801ca20 comp rx=0 tx=0).stop 2023-12-18T10:24:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285ca96640 1 -- 172.21.15.133:0/2593897670 reap_dead start 2023-12-18T10:24:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285e4f9640 1 -- 172.21.15.133:0/2593897670 shutdown_connections 2023-12-18T10:24:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285e4f9640 1 -- 172.21.15.133:0/2593897670 >> 172.21.15.133:0/2593897670 conn(0x7f285806a3e0 msgr2=0x7f28580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285e4f9640 1 -- 172.21.15.133:0/2593897670 shutdown_connections 2023-12-18T10:24:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285e4f9640 1 -- 172.21.15.133:0/2593897670 wait complete. 2023-12-18T10:24:12.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285e4f9640 1 Processor -- start 2023-12-18T10:24:12.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.750+0000 7f285e4f9640 1 -- start start 2023-12-18T10:24:12.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840003980 0x7f28580c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581f53c0 0x7f28580cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28580cd840 0x7f2858153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28581555a0 con 0x7f28580cd840 2023-12-18T10:24:12.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580cdcc0 con 0x7f2840003980 2023-12-18T10:24:12.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28580c7b10 con 0x7f28581f53c0 2023-12-18T10:24:12.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28580cd840 0x7f2858153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28580cd840 0x7f2858153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59058/0 (socket says 172.21.15.133:59058) 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 -- 172.21.15.133:0/3037572691 learned_addr learned my addr 172.21.15.133:0/3037572691 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f28577fe640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581f53c0 0x7f28580cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f2857fff640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840003980 0x7f28580c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 -- 172.21.15.133:0/3037572691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581f53c0 msgr2=0x7f28580cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581f53c0 0x7f28580cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 -- 172.21.15.133:0/3037572691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840003980 msgr2=0x7f28580c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840003980 0x7f28580c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 -- 172.21.15.133:0/3037572691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580c7db0 con 0x7f28580cd840 2023-12-18T10:24:12.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285ca96640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28580cd840 0x7f2858153820 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2850000f90 tx=0x7f285000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:12.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f2854ff9640 1 -- 172.21.15.133:0/3037572691 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000eb90 con 0x7f28580cd840 2023-12-18T10:24:12.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f2854ff9640 1 -- 172.21.15.133:0/3037572691 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285000ecf0 con 0x7f28580cd840 2023-12-18T10:24:12.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28580c8090 con 0x7f28580cd840 2023-12-18T10:24:12.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f2854ff9640 1 -- 172.21.15.133:0/3037572691 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850013620 con 0x7f28580cd840 2023-12-18T10:24:12.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2858153300 con 0x7f28580cd840 2023-12-18T10:24:12.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28580735b0 con 0x7f28580cd840 2023-12-18T10:24:12.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.754+0000 7f2854ff9640 1 -- 172.21.15.133:0/3037572691 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2850013780 con 0x7f28580cd840 2023-12-18T10:24:12.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.758+0000 7f2854ff9640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2844065a60 0x7f2844067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:12.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.758+0000 7f2854ff9640 1 -- 172.21.15.133:0/3037572691 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2850083680 con 0x7f28580cd840 2023-12-18T10:24:12.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.758+0000 7f2857fff640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2844065a60 0x7f2844067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:12.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.758+0000 7f2857fff640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2844065a60 0x7f2844067f20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f28480af000 tx=0x7f28480046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:12.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.762+0000 7f2854ff9640 1 -- 172.21.15.133:0/3037572691 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2850050f10 con 0x7f28580cd840 2023-12-18T10:24:12.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.906+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28580ca8a0 con 0x7f2844065a60 2023-12-18T10:24:12.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.914+0000 7f2854ff9640 1 -- 172.21.15.133:0/3037572691 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289503 (secure 0 0 0) 0x7f28480bf090 con 0x7f2844065a60 2023-12-18T10:24:12.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:12.919 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:24:12.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2844065a60 msgr2=0x7f2844067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:12.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2844065a60 0x7f2844067f20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f28480af000 tx=0x7f28480046d0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28580cd840 msgr2=0x7f2858153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:12.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28580cd840 0x7f2858153820 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2850000f90 tx=0x7f285000e530 comp rx=0 tx=0).stop 2023-12-18T10:24:12.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 shutdown_connections 2023-12-18T10:24:12.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2844065a60 0x7f2844067f20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28580cd840 0x7f2858153820 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f28581f53c0 0x7f28580cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 --2- 172.21.15.133:0/3037572691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2840003980 0x7f28580c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:12.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 >> 172.21.15.133:0/3037572691 conn(0x7f285806a3e0 msgr2=0x7f28580c40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:12.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 shutdown_connections 2023-12-18T10:24:12.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:12.918+0000 7f285e4f9640 1 -- 172.21.15.133:0/3037572691 wait complete. 2023-12-18T10:24:12.938 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2023-12-18T10:24:11.173728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258376,"kb_used_data":9992,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754716344,"statfs":{"total":773094113280,"available":772829536256,"internally_reserved":0,"allocated":10231808,"data_stored":5309316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.914003"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181047+0000","last_change":"2023-12-18T10:24:03.677597+0000","last_active":"2023-12-18T10:24:05.181047+0000","last_peered":"2023-12-18T10:24:05.181047+0000","last_clean":"2023-12-18T10:24:05.181047+0000","last_became_active":"2023-12-18T10:24:03.677222+0000","last_became_peered":"2023-12-18T10:24:03.677222+0000","last_unstale":"2023-12-18T10:24:05.181047+0000","last_undegraded":"2023-12-18T10:24:05.181047+0000","last_fullsized":"2023-12-18T10:24:05.181047+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:51:37.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182403+0000","last_change":"2023-12-18T10:24:03.679554+0000","last_active":"2023-12-18T10:24:05.182403+0000","last_peered":"2023-12-18T10:24:05.182403+0000","last_clean":"2023-12-18T10:24:05.182403+0000","last_became_active":"2023-12-18T10:24:03.679285+0000","last_became_peered":"2023-12-18T10:24:03.679285+0000","last_unstale":"2023-12-18T10:24:05.182403+0000","last_undegraded":"2023-12-18T10:24:05.182403+0000","last_fullsized":"2023-12-18T10:24:05.182403+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:56.223075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181095+0000","last_change":"2023-12-18T10:24:03.688043+0000","last_active":"2023-12-18T10:24:05.181095+0000","last_peered":"2023-12-18T10:24:05.181095+0000","last_clean":"2023-12-18T10:24:05.181095+0000","last_became_active":"2023-12-18T10:24:03.687794+0000","last_became_peered":"2023-12-18T10:24:03.687794+0000","last_unstale":"2023-12-18T10:24:05.181095+0000","last_undegraded":"2023-12-18T10:24:05.181095+0000","last_fullsized":"2023-12-18T10:24:05.181095+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:46:31.988419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180428+0000","last_change":"2023-12-18T10:24:03.687786+0000","last_active":"2023-12-18T10:24:05.180428+0000","last_peered":"2023-12-18T10:24:05.180428+0000","last_clean":"2023-12-18T10:24:05.180428+0000","last_became_active":"2023-12-18T10:24:03.684087+0000","last_became_peered":"2023-12-18T10:24:03.684087+0000","last_unstale":"2023-12-18T10:24:05.180428+0000","last_undegraded":"2023-12-18T10:24:05.180428+0000","last_fullsized":"2023-12-18T10:24:05.180428+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:03.338814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182583+0000","last_change":"2023-12-18T10:24:03.681861+0000","last_active":"2023-12-18T10:24:05.182583+0000","last_peered":"2023-12-18T10:24:05.182583+0000","last_clean":"2023-12-18T10:24:05.182583+0000","last_became_active":"2023-12-18T10:24:03.681160+0000","last_became_peered":"2023-12-18T10:24:03.681160+0000","last_unstale":"2023-12-18T10:24:05.182583+0000","last_undegraded":"2023-12-18T10:24:05.182583+0000","last_fullsized":"2023-12-18T10:24:05.182583+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:19:38.852286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899066+0000","last_change":"2023-12-18T10:24:03.685346+0000","last_active":"2023-12-18T10:24:04.899066+0000","last_peered":"2023-12-18T10:24:04.899066+0000","last_clean":"2023-12-18T10:24:04.899066+0000","last_became_active":"2023-12-18T10:24:03.685020+0000","last_became_peered":"2023-12-18T10:24:03.685020+0000","last_unstale":"2023-12-18T10:24:04.899066+0000","last_undegraded":"2023-12-18T10:24:04.899066+0000","last_fullsized":"2023-12-18T10:24:04.899066+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:51.946051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182117+0000","last_change":"2023-12-18T10:24:03.674455+0000","last_active":"2023-12-18T10:24:05.182117+0000","last_peered":"2023-12-18T10:24:05.182117+0000","last_clean":"2023-12-18T10:24:05.182117+0000","last_became_active":"2023-12-18T10:24:03.674183+0000","last_became_peered":"2023-12-18T10:24:03.674183+0000","last_unstale":"2023-12-18T10:24:05.182117+0000","last_undegraded":"2023-12-18T10:24:05.182117+0000","last_fullsized":"2023-12-18T10:24:05.182117+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:54.572697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180326+0000","last_change":"2023-12-18T10:24:03.687797+0000","last_active":"2023-12-18T10:24:05.180326+0000","last_peered":"2023-12-18T10:24:05.180326+0000","last_clean":"2023-12-18T10:24:05.180326+0000","last_became_active":"2023-12-18T10:24:03.684984+0000","last_became_peered":"2023-12-18T10:24:03.684984+0000","last_unstale":"2023-12-18T10:24:05.180326+0000","last_undegraded":"2023-12-18T10:24:05.180326+0000","last_fullsized":"2023-12-18T10:24:05.180326+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:16.345573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183338+0000","last_change":"2023-12-18T10:24:03.680933+0000","last_active":"2023-12-18T10:24:05.183338+0000","last_peered":"2023-12-18T10:24:05.183338+0000","last_clean":"2023-12-18T10:24:05.183338+0000","last_became_active":"2023-12-18T10:24:03.680027+0000","last_became_peered":"2023-12-18T10:24:03.680027+0000","last_unstale":"2023-12-18T10:24:05.183338+0000","last_undegraded":"2023-12-18T10:24:05.183338+0000","last_fullsized":"2023-12-18T10:24:05.183338+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:43:37.283520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659415+0000","last_change":"2023-12-18T10:24:03.695207+0000","last_active":"2023-12-18T10:24:04.659415+0000","last_peered":"2023-12-18T10:24:04.659415+0000","last_clean":"2023-12-18T10:24:04.659415+0000","last_became_active":"2023-12-18T10:24:03.692815+0000","last_became_peered":"2023-12-18T10:24:03.692815+0000","last_unstale":"2023-12-18T10:24:04.659415+0000","last_undegraded":"2023-12-18T10:24:04.659415+0000","last_fullsized":"2023-12-18T10:24:04.659415+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:19:52.878248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183172+0000","last_change":"2023-12-18T10:24:03.684586+0000","last_active":"2023-12-18T10:24:05.183172+0000","last_peered":"2023-12-18T10:24:05.183172+0000","last_clean":"2023-12-18T10:24:05.183172+0000","last_became_active":"2023-12-18T10:24:03.684170+0000","last_became_peered":"2023-12-18T10:24:03.684170+0000","last_unstale":"2023-12-18T10:24:05.183172+0000","last_undegraded":"2023-12-18T10:24:05.183172+0000","last_fullsized":"2023-12-18T10:24:05.183172+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:16:44.861634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659117+0000","last_change":"2023-12-18T10:24:03.674982+0000","last_active":"2023-12-18T10:24:04.659117+0000","last_peered":"2023-12-18T10:24:04.659117+0000","last_clean":"2023-12-18T10:24:04.659117+0000","last_became_active":"2023-12-18T10:24:03.674720+0000","last_became_peered":"2023-12-18T10:24:03.674720+0000","last_unstale":"2023-12-18T10:24:04.659117+0000","last_undegraded":"2023-12-18T10:24:04.659117+0000","last_fullsized":"2023-12-18T10:24:04.659117+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:35:08.717170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180872+0000","last_change":"2023-12-18T10:24:03.676067+0000","last_active":"2023-12-18T10:24:05.180872+0000","last_peered":"2023-12-18T10:24:05.180872+0000","last_clean":"2023-12-18T10:24:05.180872+0000","last_became_active":"2023-12-18T10:24:03.675777+0000","last_became_peered":"2023-12-18T10:24:03.675777+0000","last_unstale":"2023-12-18T10:24:05.180872+0000","last_undegraded":"2023-12-18T10:24:05.180872+0000","last_fullsized":"2023-12-18T10:24:05.180872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:04.820575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182204+0000","last_change":"2023-12-18T10:24:03.695295+0000","last_active":"2023-12-18T10:24:05.182204+0000","last_peered":"2023-12-18T10:24:05.182204+0000","last_clean":"2023-12-18T10:24:05.182204+0000","last_became_active":"2023-12-18T10:24:03.694982+0000","last_became_peered":"2023-12-18T10:24:03.694982+0000","last_unstale":"2023-12-18T10:24:05.182204+0000","last_undegraded":"2023-12-18T10:24:05.182204+0000","last_fullsized":"2023-12-18T10:24:05.182204+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:46:14.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180684+0000","last_change":"2023-12-18T10:24:03.684406+0000","last_active":"2023-12-18T10:24:05.180684+0000","last_peered":"2023-12-18T10:24:05.180684+0000","last_clean":"2023-12-18T10:24:05.180684+0000","last_became_active":"2023-12-18T10:24:03.684099+0000","last_became_peered":"2023-12-18T10:24:03.684099+0000","last_unstale":"2023-12-18T10:24:05.180684+0000","last_undegraded":"2023-12-18T10:24:05.180684+0000","last_fullsized":"2023-12-18T10:24:05.180684+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:22:33.238637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.898983+0000","last_change":"2023-12-18T10:24:03.672927+0000","last_active":"2023-12-18T10:24:04.898983+0000","last_peered":"2023-12-18T10:24:04.898983+0000","last_clean":"2023-12-18T10:24:04.898983+0000","last_became_active":"2023-12-18T10:24:03.672653+0000","last_became_peered":"2023-12-18T10:24:03.672653+0000","last_unstale":"2023-12-18T10:24:04.898983+0000","last_undegraded":"2023-12-18T10:24:04.898983+0000","last_fullsized":"2023-12-18T10:24:04.898983+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:03:09.852070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899389+0000","last_change":"2023-12-18T10:24:03.674737+0000","last_active":"2023-12-18T10:24:04.899389+0000","last_peered":"2023-12-18T10:24:04.899389+0000","last_clean":"2023-12-18T10:24:04.899389+0000","last_became_active":"2023-12-18T10:24:03.674468+0000","last_became_peered":"2023-12-18T10:24:03.674468+0000","last_unstale":"2023-12-18T10:24:04.899389+0000","last_undegraded":"2023-12-18T10:24:04.899389+0000","last_fullsized":"2023-12-18T10:24:04.899389+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:54:22.931778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180935+0000","last_change":"2023-12-18T10:24:03.678191+0000","last_active":"2023-12-18T10:24:05.180935+0000","last_peered":"2023-12-18T10:24:05.180935+0000","last_clean":"2023-12-18T10:24:05.180935+0000","last_became_active":"2023-12-18T10:24:03.677928+0000","last_became_peered":"2023-12-18T10:24:03.677928+0000","last_unstale":"2023-12-18T10:24:05.180935+0000","last_undegraded":"2023-12-18T10:24:05.180935+0000","last_fullsized":"2023-12-18T10:24:05.180935+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:46:14.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183202+0000","last_change":"2023-12-18T10:24:03.695220+0000","last_active":"2023-12-18T10:24:05.183202+0000","last_peered":"2023-12-18T10:24:05.183202+0000","last_clean":"2023-12-18T10:24:05.183202+0000","last_became_active":"2023-12-18T10:24:03.694887+0000","last_became_peered":"2023-12-18T10:24:03.694887+0000","last_unstale":"2023-12-18T10:24:05.183202+0000","last_undegraded":"2023-12-18T10:24:05.183202+0000","last_fullsized":"2023-12-18T10:24:05.183202+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:30:15.783567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180518+0000","last_change":"2023-12-18T10:24:03.683731+0000","last_active":"2023-12-18T10:24:05.180518+0000","last_peered":"2023-12-18T10:24:05.180518+0000","last_clean":"2023-12-18T10:24:05.180518+0000","last_became_active":"2023-12-18T10:24:03.681618+0000","last_became_peered":"2023-12-18T10:24:03.681618+0000","last_unstale":"2023-12-18T10:24:05.180518+0000","last_undegraded":"2023-12-18T10:24:05.180518+0000","last_fullsized":"2023-12-18T10:24:05.180518+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:39.392543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182421+0000","last_change":"2023-12-18T10:24:03.682062+0000","last_active":"2023-12-18T10:24:05.182421+0000","last_peered":"2023-12-18T10:24:05.182421+0000","last_clean":"2023-12-18T10:24:05.182421+0000","last_became_active":"2023-12-18T10:24:03.681517+0000","last_became_peered":"2023-12-18T10:24:03.681517+0000","last_unstale":"2023-12-18T10:24:05.182421+0000","last_undegraded":"2023-12-18T10:24:05.182421+0000","last_fullsized":"2023-12-18T10:24:05.182421+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:38:11.711182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182259+0000","last_change":"2023-12-18T10:24:03.694565+0000","last_active":"2023-12-18T10:24:05.182259+0000","last_peered":"2023-12-18T10:24:05.182259+0000","last_clean":"2023-12-18T10:24:05.182259+0000","last_became_active":"2023-12-18T10:24:03.694205+0000","last_became_peered":"2023-12-18T10:24:03.694205+0000","last_unstale":"2023-12-18T10:24:05.182259+0000","last_undegraded":"2023-12-18T10:24:05.182259+0000","last_fullsized":"2023-12-18T10:24:05.182259+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:52:14.855733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659246+0000","last_change":"2023-12-18T10:24:03.694176+0000","last_active":"2023-12-18T10:24:04.659246+0000","last_peered":"2023-12-18T10:24:04.659246+0000","last_clean":"2023-12-18T10:24:04.659246+0000","last_became_active":"2023-12-18T10:24:03.693857+0000","last_became_peered":"2023-12-18T10:24:03.693857+0000","last_unstale":"2023-12-18T10:24:04.659246+0000","last_undegraded":"2023-12-18T10:24:04.659246+0000","last_fullsized":"2023-12-18T10:24:04.659246+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:14:25.187465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180174+0000","last_change":"2023-12-18T10:24:03.680445+0000","last_active":"2023-12-18T10:24:05.180174+0000","last_peered":"2023-12-18T10:24:05.180174+0000","last_clean":"2023-12-18T10:24:05.180174+0000","last_became_active":"2023-12-18T10:24:03.680190+0000","last_became_peered":"2023-12-18T10:24:03.680190+0000","last_unstale":"2023-12-18T10:24:05.180174+0000","last_undegraded":"2023-12-18T10:24:05.180174+0000","last_fullsized":"2023-12-18T10:24:05.180174+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:39:41.724333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182704+0000","last_change":"2023-12-18T10:24:03.677136+0000","last_active":"2023-12-18T10:24:05.182704+0000","last_peered":"2023-12-18T10:24:05.182704+0000","last_clean":"2023-12-18T10:24:05.182704+0000","last_became_active":"2023-12-18T10:24:03.676802+0000","last_became_peered":"2023-12-18T10:24:03.676802+0000","last_unstale":"2023-12-18T10:24:05.182704+0000","last_undegraded":"2023-12-18T10:24:05.182704+0000","last_fullsized":"2023-12-18T10:24:05.182704+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:54.572697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183206+0000","last_change":"2023-12-18T10:24:03.698103+0000","last_active":"2023-12-18T10:24:05.183206+0000","last_peered":"2023-12-18T10:24:05.183206+0000","last_clean":"2023-12-18T10:24:05.183206+0000","last_became_active":"2023-12-18T10:24:03.697865+0000","last_became_peered":"2023-12-18T10:24:03.697865+0000","last_unstale":"2023-12-18T10:24:05.183206+0000","last_undegraded":"2023-12-18T10:24:05.183206+0000","last_fullsized":"2023-12-18T10:24:05.183206+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:51:37.283542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659327+0000","last_change":"2023-12-18T10:24:03.673272+0000","last_active":"2023-12-18T10:24:04.659327+0000","last_peered":"2023-12-18T10:24:04.659327+0000","last_clean":"2023-12-18T10:24:04.659327+0000","last_became_active":"2023-12-18T10:24:03.671626+0000","last_became_peered":"2023-12-18T10:24:03.671626+0000","last_unstale":"2023-12-18T10:24:04.659327+0000","last_undegraded":"2023-12-18T10:24:04.659327+0000","last_fullsized":"2023-12-18T10:24:04.659327+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:02:39.874263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180632+0000","last_change":"2023-12-18T10:24:03.685174+0000","last_active":"2023-12-18T10:24:05.180632+0000","last_peered":"2023-12-18T10:24:05.180632+0000","last_clean":"2023-12-18T10:24:05.180632+0000","last_became_active":"2023-12-18T10:24:03.684923+0000","last_became_peered":"2023-12-18T10:24:03.684923+0000","last_unstale":"2023-12-18T10:24:05.180632+0000","last_undegraded":"2023-12-18T10:24:05.180632+0000","last_fullsized":"2023-12-18T10:24:05.180632+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:46:45.630354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182681+0000","last_change":"2023-12-18T10:24:03.675461+0000","last_active":"2023-12-18T10:24:05.182681+0000","last_peered":"2023-12-18T10:24:05.182681+0000","last_clean":"2023-12-18T10:24:05.182681+0000","last_became_active":"2023-12-18T10:24:03.675229+0000","last_became_peered":"2023-12-18T10:24:03.675229+0000","last_unstale":"2023-12-18T10:24:05.182681+0000","last_undegraded":"2023-12-18T10:24:05.182681+0000","last_fullsized":"2023-12-18T10:24:05.182681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:15:43.525146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182399+0000","last_change":"2023-12-18T10:24:03.680796+0000","last_active":"2023-12-18T10:24:05.182399+0000","last_peered":"2023-12-18T10:24:05.182399+0000","last_clean":"2023-12-18T10:24:05.182399+0000","last_became_active":"2023-12-18T10:24:03.680521+0000","last_became_peered":"2023-12-18T10:24:03.680521+0000","last_unstale":"2023-12-18T10:24:05.182399+0000","last_undegraded":"2023-12-18T10:24:05.182399+0000","last_fullsized":"2023-12-18T10:24:05.182399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:14:19.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181637+0000","last_change":"2023-12-18T10:24:03.692366+0000","last_active":"2023-12-18T10:24:05.181637+0000","last_peered":"2023-12-18T10:24:05.181637+0000","last_clean":"2023-12-18T10:24:05.181637+0000","last_became_active":"2023-12-18T10:24:03.691908+0000","last_became_peered":"2023-12-18T10:24:03.691908+0000","last_unstale":"2023-12-18T10:24:05.181637+0000","last_undegraded":"2023-12-18T10:24:05.181637+0000","last_fullsized":"2023-12-18T10:24:05.181637+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:41.815143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899031+0000","last_change":"2023-12-18T10:24:03.672939+0000","last_active":"2023-12-18T10:24:04.899031+0000","last_peered":"2023-12-18T10:24:04.899031+0000","last_clean":"2023-12-18T10:24:04.899031+0000","last_became_active":"2023-12-18T10:24:03.672337+0000","last_became_peered":"2023-12-18T10:24:03.672337+0000","last_unstale":"2023-12-18T10:24:04.899031+0000","last_undegraded":"2023-12-18T10:24:04.899031+0000","last_fullsized":"2023-12-18T10:24:04.899031+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:23.018805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899497+0000","last_change":"2023-12-18T10:24:03.686931+0000","last_active":"2023-12-18T10:24:04.899497+0000","last_peered":"2023-12-18T10:24:04.899497+0000","last_clean":"2023-12-18T10:24:04.899497+0000","last_became_active":"2023-12-18T10:24:03.686663+0000","last_became_peered":"2023-12-18T10:24:03.686663+0000","last_unstale":"2023-12-18T10:24:04.899497+0000","last_undegraded":"2023-12-18T10:24:04.899497+0000","last_fullsized":"2023-12-18T10:24:04.899497+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:43:37.283520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"90'4","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.690455+0000","last_change":"2023-12-18T10:24:03.289449+0000","last_active":"2023-12-18T10:24:03.690455+0000","last_peered":"2023-12-18T10:24:03.690455+0000","last_clean":"2023-12-18T10:24:03.690455+0000","last_became_active":"2023-12-18T10:24:03.289126+0000","last_became_peered":"2023-12-18T10:24:03.289126+0000","last_unstale":"2023-12-18T10:24:03.690455+0000","last_undegraded":"2023-12-18T10:24:03.690455+0000","last_fullsized":"2023-12-18T10:24:03.690455+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:08:11.656004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899296+0000","last_change":"2023-12-18T10:24:03.677686+0000","last_active":"2023-12-18T10:24:04.899296+0000","last_peered":"2023-12-18T10:24:04.899296+0000","last_clean":"2023-12-18T10:24:04.899296+0000","last_became_active":"2023-12-18T10:24:03.677525+0000","last_became_peered":"2023-12-18T10:24:03.677525+0000","last_unstale":"2023-12-18T10:24:04.899296+0000","last_undegraded":"2023-12-18T10:24:04.899296+0000","last_fullsized":"2023-12-18T10:24:04.899296+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:48:46.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.691500+0000","last_change":"2023-12-18T10:24:03.291993+0000","last_active":"2023-12-18T10:24:03.691500+0000","last_peered":"2023-12-18T10:24:03.691500+0000","last_clean":"2023-12-18T10:24:03.691500+0000","last_became_active":"2023-12-18T10:24:03.291439+0000","last_became_peered":"2023-12-18T10:24:03.291439+0000","last_unstale":"2023-12-18T10:24:03.691500+0000","last_undegraded":"2023-12-18T10:24:03.691500+0000","last_fullsized":"2023-12-18T10:24:03.691500+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:55:02.334119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182756+0000","last_change":"2023-12-18T10:24:03.694183+0000","last_active":"2023-12-18T10:24:05.182756+0000","last_peered":"2023-12-18T10:24:05.182756+0000","last_clean":"2023-12-18T10:24:05.182756+0000","last_became_active":"2023-12-18T10:24:03.693887+0000","last_became_peered":"2023-12-18T10:24:03.693887+0000","last_unstale":"2023-12-18T10:24:05.182756+0000","last_undegraded":"2023-12-18T10:24:05.182756+0000","last_fullsized":"2023-12-18T10:24:05.182756+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:25:43.594240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.689854+0000","last_change":"2023-12-18T10:24:03.288810+0000","last_active":"2023-12-18T10:24:03.689854+0000","last_peered":"2023-12-18T10:24:03.689854+0000","last_clean":"2023-12-18T10:24:03.689854+0000","last_became_active":"2023-12-18T10:24:03.288536+0000","last_became_peered":"2023-12-18T10:24:03.288536+0000","last_unstale":"2023-12-18T10:24:03.689854+0000","last_undegraded":"2023-12-18T10:24:03.689854+0000","last_fullsized":"2023-12-18T10:24:03.689854+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:58:29.376027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899445+0000","last_change":"2023-12-18T10:24:03.678814+0000","last_active":"2023-12-18T10:24:04.899445+0000","last_peered":"2023-12-18T10:24:04.899445+0000","last_clean":"2023-12-18T10:24:04.899445+0000","last_became_active":"2023-12-18T10:24:03.678515+0000","last_became_peered":"2023-12-18T10:24:03.678515+0000","last_unstale":"2023-12-18T10:24:04.899445+0000","last_undegraded":"2023-12-18T10:24:04.899445+0000","last_fullsized":"2023-12-18T10:24:04.899445+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:44:35.701361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.693933+0000","last_change":"2023-12-18T10:24:03.288716+0000","last_active":"2023-12-18T10:24:03.693933+0000","last_peered":"2023-12-18T10:24:03.693933+0000","last_clean":"2023-12-18T10:24:03.693933+0000","last_became_active":"2023-12-18T10:24:03.288442+0000","last_became_peered":"2023-12-18T10:24:03.288442+0000","last_unstale":"2023-12-18T10:24:03.693933+0000","last_undegraded":"2023-12-18T10:24:03.693933+0000","last_fullsized":"2023-12-18T10:24:03.693933+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:04:22.904429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180383+0000","last_change":"2023-12-18T10:24:03.685309+0000","last_active":"2023-12-18T10:24:05.180383+0000","last_peered":"2023-12-18T10:24:05.180383+0000","last_clean":"2023-12-18T10:24:05.180383+0000","last_became_active":"2023-12-18T10:24:03.684470+0000","last_became_peered":"2023-12-18T10:24:03.684470+0000","last_unstale":"2023-12-18T10:24:05.180383+0000","last_undegraded":"2023-12-18T10:24:05.180383+0000","last_fullsized":"2023-12-18T10:24:05.180383+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:58:30.380723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.690864+0000","last_change":"2023-12-18T10:24:03.278043+0000","last_active":"2023-12-18T10:24:03.690864+0000","last_peered":"2023-12-18T10:24:03.690864+0000","last_clean":"2023-12-18T10:24:03.690864+0000","last_became_active":"2023-12-18T10:24:03.277733+0000","last_became_peered":"2023-12-18T10:24:03.277733+0000","last_unstale":"2023-12-18T10:24:03.690864+0000","last_undegraded":"2023-12-18T10:24:03.690864+0000","last_fullsized":"2023-12-18T10:24:03.690864+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659286+0000","last_change":"2023-12-18T10:24:03.680306+0000","last_active":"2023-12-18T10:24:04.659286+0000","last_peered":"2023-12-18T10:24:04.659286+0000","last_clean":"2023-12-18T10:24:04.659286+0000","last_became_active":"2023-12-18T10:24:03.678265+0000","last_became_peered":"2023-12-18T10:24:03.678265+0000","last_unstale":"2023-12-18T10:24:04.659286+0000","last_undegraded":"2023-12-18T10:24:04.659286+0000","last_fullsized":"2023-12-18T10:24:04.659286+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:12.577624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.684271+0000","last_change":"2023-12-18T10:24:03.279428+0000","last_active":"2023-12-18T10:24:03.684271+0000","last_peered":"2023-12-18T10:24:03.684271+0000","last_clean":"2023-12-18T10:24:03.684271+0000","last_became_active":"2023-12-18T10:24:03.279152+0000","last_became_peered":"2023-12-18T10:24:03.279152+0000","last_unstale":"2023-12-18T10:24:03.684271+0000","last_undegraded":"2023-12-18T10:24:03.684271+0000","last_fullsized":"2023-12-18T10:24:03.684271+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:04:01.282465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899050+0000","last_change":"2023-12-18T10:24:03.675828+0000","last_active":"2023-12-18T10:24:04.899050+0000","last_peered":"2023-12-18T10:24:04.899050+0000","last_clean":"2023-12-18T10:24:04.899050+0000","last_became_active":"2023-12-18T10:24:03.675574+0000","last_became_peered":"2023-12-18T10:24:03.675574+0000","last_unstale":"2023-12-18T10:24:04.899050+0000","last_undegraded":"2023-12-18T10:24:04.899050+0000","last_fullsized":"2023-12-18T10:24:04.899050+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:46:14.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.670362+0000","last_change":"2023-12-18T10:24:03.285798+0000","last_active":"2023-12-18T10:24:03.670362+0000","last_peered":"2023-12-18T10:24:03.670362+0000","last_clean":"2023-12-18T10:24:03.670362+0000","last_became_active":"2023-12-18T10:24:03.285491+0000","last_became_peered":"2023-12-18T10:24:03.285491+0000","last_unstale":"2023-12-18T10:24:03.670362+0000","last_undegraded":"2023-12-18T10:24:03.670362+0000","last_fullsized":"2023-12-18T10:24:03.670362+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:43.485098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180958+0000","last_change":"2023-12-18T10:24:03.683692+0000","last_active":"2023-12-18T10:24:05.180958+0000","last_peered":"2023-12-18T10:24:05.180958+0000","last_clean":"2023-12-18T10:24:05.180958+0000","last_became_active":"2023-12-18T10:24:03.682461+0000","last_became_peered":"2023-12-18T10:24:03.682461+0000","last_unstale":"2023-12-18T10:24:05.180958+0000","last_undegraded":"2023-12-18T10:24:05.180958+0000","last_fullsized":"2023-12-18T10:24:05.180958+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:36.499841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.661573+0000","last_change":"2023-12-18T10:24:03.287773+0000","last_active":"2023-12-18T10:24:03.661573+0000","last_peered":"2023-12-18T10:24:03.661573+0000","last_clean":"2023-12-18T10:24:03.661573+0000","last_became_active":"2023-12-18T10:24:03.286960+0000","last_became_peered":"2023-12-18T10:24:03.286960+0000","last_unstale":"2023-12-18T10:24:03.661573+0000","last_undegraded":"2023-12-18T10:24:03.661573+0000","last_fullsized":"2023-12-18T10:24:03.661573+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183055+0000","last_change":"2023-12-18T10:24:03.676822+0000","last_active":"2023-12-18T10:24:05.183055+0000","last_peered":"2023-12-18T10:24:05.183055+0000","last_clean":"2023-12-18T10:24:05.183055+0000","last_became_active":"2023-12-18T10:24:03.676402+0000","last_became_peered":"2023-12-18T10:24:03.676402+0000","last_unstale":"2023-12-18T10:24:05.183055+0000","last_undegraded":"2023-12-18T10:24:05.183055+0000","last_fullsized":"2023-12-18T10:24:05.183055+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:34:49.654703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.671200+0000","last_change":"2023-12-18T10:24:03.289992+0000","last_active":"2023-12-18T10:24:03.671200+0000","last_peered":"2023-12-18T10:24:03.671200+0000","last_clean":"2023-12-18T10:24:03.671200+0000","last_became_active":"2023-12-18T10:24:03.289678+0000","last_became_peered":"2023-12-18T10:24:03.289678+0000","last_unstale":"2023-12-18T10:24:03.671200+0000","last_undegraded":"2023-12-18T10:24:03.671200+0000","last_fullsized":"2023-12-18T10:24:03.671200+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:37:23.747065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182410+0000","last_change":"2023-12-18T10:24:03.687118+0000","last_active":"2023-12-18T10:24:05.182410+0000","last_peered":"2023-12-18T10:24:05.182410+0000","last_clean":"2023-12-18T10:24:05.182410+0000","last_became_active":"2023-12-18T10:24:03.686749+0000","last_became_peered":"2023-12-18T10:24:03.686749+0000","last_unstale":"2023-12-18T10:24:05.182410+0000","last_undegraded":"2023-12-18T10:24:05.182410+0000","last_fullsized":"2023-12-18T10:24:05.182410+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:58:17.984865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.673612+0000","last_change":"2023-12-18T10:24:03.279579+0000","last_active":"2023-12-18T10:24:03.673612+0000","last_peered":"2023-12-18T10:24:03.673612+0000","last_clean":"2023-12-18T10:24:03.673612+0000","last_became_active":"2023-12-18T10:24:03.279279+0000","last_became_peered":"2023-12-18T10:24:03.279279+0000","last_unstale":"2023-12-18T10:24:03.673612+0000","last_undegraded":"2023-12-18T10:24:03.673612+0000","last_fullsized":"2023-12-18T10:24:03.673612+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:15:53.568002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181029+0000","last_change":"2023-12-18T10:24:03.676318+0000","last_active":"2023-12-18T10:24:05.181029+0000","last_peered":"2023-12-18T10:24:05.181029+0000","last_clean":"2023-12-18T10:24:05.181029+0000","last_became_active":"2023-12-18T10:24:03.676066+0000","last_became_peered":"2023-12-18T10:24:03.676066+0000","last_unstale":"2023-12-18T10:24:05.181029+0000","last_undegraded":"2023-12-18T10:24:05.181029+0000","last_fullsized":"2023-12-18T10:24:05.181029+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:52:14.855733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"90'3","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.697000+0000","last_change":"2023-12-18T10:24:03.283429+0000","last_active":"2023-12-18T10:24:03.697000+0000","last_peered":"2023-12-18T10:24:03.697000+0000","last_clean":"2023-12-18T10:24:03.697000+0000","last_became_active":"2023-12-18T10:24:03.282898+0000","last_became_peered":"2023-12-18T10:24:03.282898+0000","last_unstale":"2023-12-18T10:24:03.697000+0000","last_undegraded":"2023-12-18T10:24:03.697000+0000","last_fullsized":"2023-12-18T10:24:03.697000+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:20.153111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180659+0000","last_change":"2023-12-18T10:24:03.684528+0000","last_active":"2023-12-18T10:24:05.180659+0000","last_peered":"2023-12-18T10:24:05.180659+0000","last_clean":"2023-12-18T10:24:05.180659+0000","last_became_active":"2023-12-18T10:24:03.682495+0000","last_became_peered":"2023-12-18T10:24:03.682495+0000","last_unstale":"2023-12-18T10:24:05.180659+0000","last_undegraded":"2023-12-18T10:24:05.180659+0000","last_fullsized":"2023-12-18T10:24:05.180659+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:37:24.751761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"90'6","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.694884+0000","last_change":"2023-12-18T10:24:03.290588+0000","last_active":"2023-12-18T10:24:03.694884+0000","last_peered":"2023-12-18T10:24:03.694884+0000","last_clean":"2023-12-18T10:24:03.694884+0000","last_became_active":"2023-12-18T10:24:03.290300+0000","last_became_peered":"2023-12-18T10:24:03.290300+0000","last_unstale":"2023-12-18T10:24:03.694884+0000","last_undegraded":"2023-12-18T10:24:03.694884+0000","last_fullsized":"2023-12-18T10:24:03.694884+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:51:34.076185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180426+0000","last_change":"2023-12-18T10:24:03.687601+0000","last_active":"2023-12-18T10:24:05.180426+0000","last_peered":"2023-12-18T10:24:05.180426+0000","last_clean":"2023-12-18T10:24:05.180426+0000","last_became_active":"2023-12-18T10:24:03.684712+0000","last_became_peered":"2023-12-18T10:24:03.684712+0000","last_unstale":"2023-12-18T10:24:05.180426+0000","last_undegraded":"2023-12-18T10:24:05.180426+0000","last_fullsized":"2023-12-18T10:24:05.180426+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:33:49.014369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.693914+0000","last_change":"2023-12-18T10:24:03.287220+0000","last_active":"2023-12-18T10:24:03.693914+0000","last_peered":"2023-12-18T10:24:03.693914+0000","last_clean":"2023-12-18T10:24:03.693914+0000","last_became_active":"2023-12-18T10:24:03.286914+0000","last_became_peered":"2023-12-18T10:24:03.286914+0000","last_unstale":"2023-12-18T10:24:03.693914+0000","last_undegraded":"2023-12-18T10:24:03.693914+0000","last_fullsized":"2023-12-18T10:24:03.693914+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182203+0000","last_change":"2023-12-18T10:24:03.684746+0000","last_active":"2023-12-18T10:24:05.182203+0000","last_peered":"2023-12-18T10:24:05.182203+0000","last_clean":"2023-12-18T10:24:05.182203+0000","last_became_active":"2023-12-18T10:24:03.684299+0000","last_became_peered":"2023-12-18T10:24:03.684299+0000","last_unstale":"2023-12-18T10:24:05.182203+0000","last_undegraded":"2023-12-18T10:24:05.182203+0000","last_fullsized":"2023-12-18T10:24:05.182203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:48:46.791043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.656927+0000","last_change":"2023-12-18T10:24:03.278785+0000","last_active":"2023-12-18T10:24:03.656927+0000","last_peered":"2023-12-18T10:24:03.656927+0000","last_clean":"2023-12-18T10:24:03.656927+0000","last_became_active":"2023-12-18T10:24:03.278478+0000","last_became_peered":"2023-12-18T10:24:03.278478+0000","last_unstale":"2023-12-18T10:24:03.656927+0000","last_undegraded":"2023-12-18T10:24:03.656927+0000","last_fullsized":"2023-12-18T10:24:03.656927+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:29:55.218379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.658848+0000","last_change":"2023-12-18T10:24:03.692930+0000","last_active":"2023-12-18T10:24:04.658848+0000","last_peered":"2023-12-18T10:24:04.658848+0000","last_clean":"2023-12-18T10:24:04.658848+0000","last_became_active":"2023-12-18T10:24:03.692683+0000","last_became_peered":"2023-12-18T10:24:03.692683+0000","last_unstale":"2023-12-18T10:24:04.658848+0000","last_undegraded":"2023-12-18T10:24:04.658848+0000","last_fullsized":"2023-12-18T10:24:04.658848+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:48:25.172762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.664711+0000","last_change":"2023-12-18T10:24:03.288434+0000","last_active":"2023-12-18T10:24:03.664711+0000","last_peered":"2023-12-18T10:24:03.664711+0000","last_clean":"2023-12-18T10:24:03.664711+0000","last_became_active":"2023-12-18T10:24:03.288129+0000","last_became_peered":"2023-12-18T10:24:03.288129+0000","last_unstale":"2023-12-18T10:24:03.664711+0000","last_undegraded":"2023-12-18T10:24:03.664711+0000","last_fullsized":"2023-12-18T10:24:03.664711+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:07:21.447878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659062+0000","last_change":"2023-12-18T10:24:03.681650+0000","last_active":"2023-12-18T10:24:04.659062+0000","last_peered":"2023-12-18T10:24:04.659062+0000","last_clean":"2023-12-18T10:24:04.659062+0000","last_became_active":"2023-12-18T10:24:03.681395+0000","last_became_peered":"2023-12-18T10:24:03.681395+0000","last_unstale":"2023-12-18T10:24:04.659062+0000","last_undegraded":"2023-12-18T10:24:04.659062+0000","last_fullsized":"2023-12-18T10:24:04.659062+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:31:14.079660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"90'8","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.696729+0000","last_change":"2023-12-18T10:24:03.282660+0000","last_active":"2023-12-18T10:24:03.696729+0000","last_peered":"2023-12-18T10:24:03.696729+0000","last_clean":"2023-12-18T10:24:03.696729+0000","last_became_active":"2023-12-18T10:24:03.282375+0000","last_became_peered":"2023-12-18T10:24:03.282375+0000","last_unstale":"2023-12-18T10:24:03.696729+0000","last_undegraded":"2023-12-18T10:24:03.696729+0000","last_fullsized":"2023-12-18T10:24:03.696729+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:28:44.825382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899170+0000","last_change":"2023-12-18T10:24:03.686451+0000","last_active":"2023-12-18T10:24:04.899170+0000","last_peered":"2023-12-18T10:24:04.899170+0000","last_clean":"2023-12-18T10:24:04.899170+0000","last_became_active":"2023-12-18T10:24:03.686028+0000","last_became_peered":"2023-12-18T10:24:03.686028+0000","last_unstale":"2023-12-18T10:24:04.899170+0000","last_undegraded":"2023-12-18T10:24:04.899170+0000","last_fullsized":"2023-12-18T10:24:04.899170+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:14:19.662108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.679354+0000","last_change":"2023-12-18T10:24:03.288612+0000","last_active":"2023-12-18T10:24:03.679354+0000","last_peered":"2023-12-18T10:24:03.679354+0000","last_clean":"2023-12-18T10:24:03.679354+0000","last_became_active":"2023-12-18T10:24:03.288333+0000","last_became_peered":"2023-12-18T10:24:03.288333+0000","last_unstale":"2023-12-18T10:24:03.679354+0000","last_undegraded":"2023-12-18T10:24:03.679354+0000","last_fullsized":"2023-12-18T10:24:03.679354+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:58:55.131352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659611+0000","last_change":"2023-12-18T10:24:03.673007+0000","last_active":"2023-12-18T10:24:04.659611+0000","last_peered":"2023-12-18T10:24:04.659611+0000","last_clean":"2023-12-18T10:24:04.659611+0000","last_became_active":"2023-12-18T10:24:03.672668+0000","last_became_peered":"2023-12-18T10:24:03.672668+0000","last_unstale":"2023-12-18T10:24:04.659611+0000","last_undegraded":"2023-12-18T10:24:04.659611+0000","last_fullsized":"2023-12-18T10:24:04.659611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:51:47.024337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.689256+0000","last_change":"2023-12-18T10:24:03.286475+0000","last_active":"2023-12-18T10:24:03.689256+0000","last_peered":"2023-12-18T10:24:03.689256+0000","last_clean":"2023-12-18T10:24:03.689256+0000","last_became_active":"2023-12-18T10:24:03.285640+0000","last_became_peered":"2023-12-18T10:24:03.285640+0000","last_unstale":"2023-12-18T10:24:03.689256+0000","last_undegraded":"2023-12-18T10:24:03.689256+0000","last_fullsized":"2023-12-18T10:24:03.689256+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:33:48.009673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.183193+0000","last_change":"2023-12-18T10:24:03.683331+0000","last_active":"2023-12-18T10:24:05.183193+0000","last_peered":"2023-12-18T10:24:05.183193+0000","last_clean":"2023-12-18T10:24:05.183193+0000","last_became_active":"2023-12-18T10:24:03.678860+0000","last_became_peered":"2023-12-18T10:24:03.678860+0000","last_unstale":"2023-12-18T10:24:05.183193+0000","last_undegraded":"2023-12-18T10:24:05.183193+0000","last_fullsized":"2023-12-18T10:24:05.183193+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:39:41.724333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"90'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.697991+0000","last_change":"2023-12-18T10:24:03.282269+0000","last_active":"2023-12-18T10:24:03.697991+0000","last_peered":"2023-12-18T10:24:03.697991+0000","last_clean":"2023-12-18T10:24:03.697991+0000","last_became_active":"2023-12-18T10:24:03.281990+0000","last_became_peered":"2023-12-18T10:24:03.281990+0000","last_unstale":"2023-12-18T10:24:03.697991+0000","last_undegraded":"2023-12-18T10:24:03.697991+0000","last_fullsized":"2023-12-18T10:24:03.697991+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:34:15.340877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899097+0000","last_change":"2023-12-18T10:24:03.690975+0000","last_active":"2023-12-18T10:24:04.899097+0000","last_peered":"2023-12-18T10:24:04.899097+0000","last_clean":"2023-12-18T10:24:04.899097+0000","last_became_active":"2023-12-18T10:24:03.690729+0000","last_became_peered":"2023-12-18T10:24:03.690729+0000","last_unstale":"2023-12-18T10:24:04.899097+0000","last_undegraded":"2023-12-18T10:24:04.899097+0000","last_fullsized":"2023-12-18T10:24:04.899097+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:17:03.872268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.677639+0000","last_change":"2023-12-18T10:24:03.284496+0000","last_active":"2023-12-18T10:24:03.677639+0000","last_peered":"2023-12-18T10:24:03.677639+0000","last_clean":"2023-12-18T10:24:03.677639+0000","last_became_active":"2023-12-18T10:24:03.283573+0000","last_became_peered":"2023-12-18T10:24:03.283573+0000","last_unstale":"2023-12-18T10:24:03.677639+0000","last_undegraded":"2023-12-18T10:24:03.677639+0000","last_fullsized":"2023-12-18T10:24:03.677639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:22:32.233941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181698+0000","last_change":"2023-12-18T10:24:03.678240+0000","last_active":"2023-12-18T10:24:05.181698+0000","last_peered":"2023-12-18T10:24:05.181698+0000","last_clean":"2023-12-18T10:24:05.181698+0000","last_became_active":"2023-12-18T10:24:03.677955+0000","last_became_peered":"2023-12-18T10:24:03.677955+0000","last_unstale":"2023-12-18T10:24:05.181698+0000","last_undegraded":"2023-12-18T10:24:05.181698+0000","last_fullsized":"2023-12-18T10:24:05.181698+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:51:35.080881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.666496+0000","last_change":"2023-12-18T10:24:03.282173+0000","last_active":"2023-12-18T10:24:03.666496+0000","last_peered":"2023-12-18T10:24:03.666496+0000","last_clean":"2023-12-18T10:24:03.666496+0000","last_became_active":"2023-12-18T10:24:03.280631+0000","last_became_peered":"2023-12-18T10:24:03.280631+0000","last_unstale":"2023-12-18T10:24:03.666496+0000","last_undegraded":"2023-12-18T10:24:03.666496+0000","last_fullsized":"2023-12-18T10:24:03.666496+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:43:26.508524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.181792+0000","last_change":"2023-12-18T10:24:03.695386+0000","last_active":"2023-12-18T10:24:05.181792+0000","last_peered":"2023-12-18T10:24:05.181792+0000","last_clean":"2023-12-18T10:24:05.181792+0000","last_became_active":"2023-12-18T10:24:03.695124+0000","last_became_peered":"2023-12-18T10:24:03.695124+0000","last_unstale":"2023-12-18T10:24:05.181792+0000","last_undegraded":"2023-12-18T10:24:05.181792+0000","last_fullsized":"2023-12-18T10:24:05.181792+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:57:21.157806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.668377+0000","last_change":"2023-12-18T10:24:03.285860+0000","last_active":"2023-12-18T10:24:03.668377+0000","last_peered":"2023-12-18T10:24:03.668377+0000","last_clean":"2023-12-18T10:24:03.668377+0000","last_became_active":"2023-12-18T10:24:03.285251+0000","last_became_peered":"2023-12-18T10:24:03.285251+0000","last_unstale":"2023-12-18T10:24:03.668377+0000","last_undegraded":"2023-12-18T10:24:03.668377+0000","last_fullsized":"2023-12-18T10:24:03.668377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:02:35.397564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899179+0000","last_change":"2023-12-18T10:24:03.667581+0000","last_active":"2023-12-18T10:24:04.899179+0000","last_peered":"2023-12-18T10:24:04.899179+0000","last_clean":"2023-12-18T10:24:04.899179+0000","last_became_active":"2023-12-18T10:24:03.666916+0000","last_became_peered":"2023-12-18T10:24:03.666916+0000","last_unstale":"2023-12-18T10:24:04.899179+0000","last_undegraded":"2023-12-18T10:24:04.899179+0000","last_fullsized":"2023-12-18T10:24:04.899179+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:26:30.624215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.665395+0000","last_change":"2023-12-18T10:24:03.280333+0000","last_active":"2023-12-18T10:24:03.665395+0000","last_peered":"2023-12-18T10:24:03.665395+0000","last_clean":"2023-12-18T10:24:03.665395+0000","last_became_active":"2023-12-18T10:24:03.280070+0000","last_became_peered":"2023-12-18T10:24:03.280070+0000","last_unstale":"2023-12-18T10:24:03.665395+0000","last_undegraded":"2023-12-18T10:24:03.665395+0000","last_fullsized":"2023-12-18T10:24:03.665395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:15:11.695579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659420+0000","last_change":"2023-12-18T10:24:03.679837+0000","last_active":"2023-12-18T10:24:04.659420+0000","last_peered":"2023-12-18T10:24:04.659420+0000","last_clean":"2023-12-18T10:24:04.659420+0000","last_became_active":"2023-12-18T10:24:03.679109+0000","last_became_peered":"2023-12-18T10:24:03.679109+0000","last_unstale":"2023-12-18T10:24:04.659420+0000","last_undegraded":"2023-12-18T10:24:04.659420+0000","last_fullsized":"2023-12-18T10:24:04.659420+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:23:45.810533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"90'2","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.687308+0000","last_change":"2023-12-18T10:24:03.292542+0000","last_active":"2023-12-18T10:24:03.687308+0000","last_peered":"2023-12-18T10:24:03.687308+0000","last_clean":"2023-12-18T10:24:03.687308+0000","last_became_active":"2023-12-18T10:24:03.292268+0000","last_became_peered":"2023-12-18T10:24:03.292268+0000","last_unstale":"2023-12-18T10:24:03.687308+0000","last_undegraded":"2023-12-18T10:24:03.687308+0000","last_fullsized":"2023-12-18T10:24:03.687308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899406+0000","last_change":"2023-12-18T10:24:03.687204+0000","last_active":"2023-12-18T10:24:04.899406+0000","last_peered":"2023-12-18T10:24:04.899406+0000","last_clean":"2023-12-18T10:24:04.899406+0000","last_became_active":"2023-12-18T10:24:03.686465+0000","last_became_peered":"2023-12-18T10:24:03.686465+0000","last_unstale":"2023-12-18T10:24:04.899406+0000","last_undegraded":"2023-12-18T10:24:04.899406+0000","last_fullsized":"2023-12-18T10:24:04.899406+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:38:11.711182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.663527+0000","last_change":"2023-12-18T10:24:03.283236+0000","last_active":"2023-12-18T10:24:03.663527+0000","last_peered":"2023-12-18T10:24:03.663527+0000","last_clean":"2023-12-18T10:24:03.663527+0000","last_became_active":"2023-12-18T10:24:03.282944+0000","last_became_peered":"2023-12-18T10:24:03.282944+0000","last_unstale":"2023-12-18T10:24:03.663527+0000","last_undegraded":"2023-12-18T10:24:03.663527+0000","last_fullsized":"2023-12-18T10:24:03.663527+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:14:35.495145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899314+0000","last_change":"2023-12-18T10:24:03.677980+0000","last_active":"2023-12-18T10:24:04.899314+0000","last_peered":"2023-12-18T10:24:04.899314+0000","last_clean":"2023-12-18T10:24:04.899314+0000","last_became_active":"2023-12-18T10:24:03.675813+0000","last_became_peered":"2023-12-18T10:24:03.675813+0000","last_unstale":"2023-12-18T10:24:04.899314+0000","last_undegraded":"2023-12-18T10:24:04.899314+0000","last_fullsized":"2023-12-18T10:24:04.899314+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:16:44.861634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.665921+0000","last_change":"2023-12-18T10:24:03.283229+0000","last_active":"2023-12-18T10:24:03.665921+0000","last_peered":"2023-12-18T10:24:03.665921+0000","last_clean":"2023-12-18T10:24:03.665921+0000","last_became_active":"2023-12-18T10:24:03.282527+0000","last_became_peered":"2023-12-18T10:24:03.282527+0000","last_unstale":"2023-12-18T10:24:03.665921+0000","last_undegraded":"2023-12-18T10:24:03.665921+0000","last_fullsized":"2023-12-18T10:24:03.665921+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:38.387847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182810+0000","last_change":"2023-12-18T10:24:03.685636+0000","last_active":"2023-12-18T10:24:05.182810+0000","last_peered":"2023-12-18T10:24:05.182810+0000","last_clean":"2023-12-18T10:24:05.182810+0000","last_became_active":"2023-12-18T10:24:03.685374+0000","last_became_peered":"2023-12-18T10:24:03.685374+0000","last_unstale":"2023-12-18T10:24:05.182810+0000","last_undegraded":"2023-12-18T10:24:05.182810+0000","last_fullsized":"2023-12-18T10:24:05.182810+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:35:44.489794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.662577+0000","last_change":"2023-12-18T10:24:03.289304+0000","last_active":"2023-12-18T10:24:03.662577+0000","last_peered":"2023-12-18T10:24:03.662577+0000","last_clean":"2023-12-18T10:24:03.662577+0000","last_became_active":"2023-12-18T10:24:03.289002+0000","last_became_peered":"2023-12-18T10:24:03.289002+0000","last_unstale":"2023-12-18T10:24:03.662577+0000","last_undegraded":"2023-12-18T10:24:03.662577+0000","last_fullsized":"2023-12-18T10:24:03.662577+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:01:00.828132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.658719+0000","last_change":"2023-12-18T10:24:03.678574+0000","last_active":"2023-12-18T10:24:04.658719+0000","last_peered":"2023-12-18T10:24:04.658719+0000","last_clean":"2023-12-18T10:24:04.658719+0000","last_became_active":"2023-12-18T10:24:03.678308+0000","last_became_peered":"2023-12-18T10:24:03.678308+0000","last_unstale":"2023-12-18T10:24:04.658719+0000","last_undegraded":"2023-12-18T10:24:04.658719+0000","last_fullsized":"2023-12-18T10:24:04.658719+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:20:28.314333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.656806+0000","last_change":"2023-12-18T10:24:03.281372+0000","last_active":"2023-12-18T10:24:03.656806+0000","last_peered":"2023-12-18T10:24:03.656806+0000","last_clean":"2023-12-18T10:24:03.656806+0000","last_became_active":"2023-12-18T10:24:03.281115+0000","last_became_peered":"2023-12-18T10:24:03.281115+0000","last_unstale":"2023-12-18T10:24:03.656806+0000","last_undegraded":"2023-12-18T10:24:03.656806+0000","last_fullsized":"2023-12-18T10:24:03.656806+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:37:40.810447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.180219+0000","last_change":"2023-12-18T10:24:03.694300+0000","last_active":"2023-12-18T10:24:05.180219+0000","last_peered":"2023-12-18T10:24:05.180219+0000","last_clean":"2023-12-18T10:24:05.180219+0000","last_became_active":"2023-12-18T10:24:03.693737+0000","last_became_peered":"2023-12-18T10:24:03.693737+0000","last_unstale":"2023-12-18T10:24:05.180219+0000","last_undegraded":"2023-12-18T10:24:05.180219+0000","last_fullsized":"2023-12-18T10:24:05.180219+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:34:49.654703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.668154+0000","last_change":"2023-12-18T10:24:03.283881+0000","last_active":"2023-12-18T10:24:03.668154+0000","last_peered":"2023-12-18T10:24:03.668154+0000","last_clean":"2023-12-18T10:24:03.668154+0000","last_became_active":"2023-12-18T10:24:03.283588+0000","last_became_peered":"2023-12-18T10:24:03.283588+0000","last_unstale":"2023-12-18T10:24:03.668154+0000","last_undegraded":"2023-12-18T10:24:03.668154+0000","last_fullsized":"2023-12-18T10:24:03.668154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:46:44.625658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.659248+0000","last_change":"2023-12-18T10:24:03.688049+0000","last_active":"2023-12-18T10:24:04.659248+0000","last_peered":"2023-12-18T10:24:04.659248+0000","last_clean":"2023-12-18T10:24:04.659248+0000","last_became_active":"2023-12-18T10:24:03.687746+0000","last_became_peered":"2023-12-18T10:24:03.687746+0000","last_unstale":"2023-12-18T10:24:04.659248+0000","last_undegraded":"2023-12-18T10:24:04.659248+0000","last_fullsized":"2023-12-18T10:24:04.659248+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:32:51.149076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.663387+0000","last_change":"2023-12-18T10:24:03.287178+0000","last_active":"2023-12-18T10:24:03.663387+0000","last_peered":"2023-12-18T10:24:03.663387+0000","last_clean":"2023-12-18T10:24:03.663387+0000","last_became_active":"2023-12-18T10:24:03.286818+0000","last_became_peered":"2023-12-18T10:24:03.286818+0000","last_unstale":"2023-12-18T10:24:03.663387+0000","last_undegraded":"2023-12-18T10:24:03.663387+0000","last_fullsized":"2023-12-18T10:24:03.663387+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:49:26.193363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:04.899283+0000","last_change":"2023-12-18T10:24:03.674118+0000","last_active":"2023-12-18T10:24:04.899283+0000","last_peered":"2023-12-18T10:24:04.899283+0000","last_clean":"2023-12-18T10:24:04.899283+0000","last_became_active":"2023-12-18T10:24:03.673869+0000","last_became_peered":"2023-12-18T10:24:03.673869+0000","last_unstale":"2023-12-18T10:24:04.899283+0000","last_undegraded":"2023-12-18T10:24:04.899283+0000","last_fullsized":"2023-12-18T10:24:04.899283+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:19:38.852286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.666336+0000","last_change":"2023-12-18T10:24:03.285821+0000","last_active":"2023-12-18T10:24:03.666336+0000","last_peered":"2023-12-18T10:24:03.666336+0000","last_clean":"2023-12-18T10:24:03.666336+0000","last_became_active":"2023-12-18T10:24:03.285378+0000","last_became_peered":"2023-12-18T10:24:03.285378+0000","last_unstale":"2023-12-18T10:24:03.666336+0000","last_undegraded":"2023-12-18T10:24:03.666336+0000","last_fullsized":"2023-12-18T10:24:03.666336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:00:03.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-12-18T10:24:05.182479+0000","last_change":"2023-12-18T10:24:03.677567+0000","last_active":"2023-12-18T10:24:05.182479+0000","last_peered":"2023-12-18T10:24:05.182479+0000","last_clean":"2023-12-18T10:24:05.182479+0000","last_became_active":"2023-12-18T10:24:03.677068+0000","last_became_peered":"2023-12-18T10:24:03.677068+0000","last_unstale":"2023-12-18T10:24:05.182479+0000","last_undegraded":"2023-12-18T10:24:05.182479+0000","last_fullsized":"2023-12-18T10:24:05.182479+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:03.251788+0000","last_clean_scrub_stamp":"2023-12-18T10:24:03.251788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:42:24.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.666264+0000","last_change":"2023-12-18T10:24:03.281646+0000","last_active":"2023-12-18T10:24:03.666264+0000","last_peered":"2023-12-18T10:24:03.666264+0000","last_clean":"2023-12-18T10:24:03.666264+0000","last_became_active":"2023-12-18T10:24:03.281197+0000","last_became_peered":"2023-12-18T10:24:03.281197+0000","last_unstale":"2023-12-18T10:24:03.666264+0000","last_undegraded":"2023-12-18T10:24:03.666264+0000","last_fullsized":"2023-12-18T10:24:03.666264+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:24:02.247092+0000","last_clean_scrub_stamp":"2023-12-18T10:24:02.247092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:06:25.659280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":222,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-12-18T10:24:03.661962+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:24:03.661962+0000","last_peered":"2023-12-18T10:24:03.661962+0000","last_clean":"2023-12-18T10:24:03.661962+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:24:03.661962+0000","last_undegraded":"2023-12-18T10:24:03.661962+0000","last_fullsized":"2023-12-18T10:24:03.661962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1684,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1724416,"data_stored":1105906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.626,"15min":0.63500000000000001},"min":{"1min":0.39900000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.41999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.68100000000000005},"min":{"1min":0.44500000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65900000000000003,"15min":0.64300000000000002},"min":{"1min":0.53700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.48199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68400000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.40500000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67200000000000004,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90900000000000003,"5min":1.137,"15min":1.137},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61899999999999999,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.623}]},{"osd":6,"last update":"Mon Dec 18 10:23:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.54700000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.71199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1142784,"data_stored":517650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65600000000000003,"15min":0.81399999999999995},"min":{"1min":0.44,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89500000000000002,"5min":0.93100000000000005,"15min":4.3760000000000003},"last":1.018},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.85499999999999998},"min":{"1min":0.52900000000000003,"5min":0.43099999999999999,"15min":0.41199999999999998},"max":{"1min":0.91400000000000003,"5min":0.98299999999999998,"15min":4.4669999999999996},"last":0.98999999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66400000000000003,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":4.524},"last":1.179}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71499999999999997,"15min":0.78500000000000003},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92300000000000004,"5min":0.97699999999999998,"15min":2.2709999999999999},"last":1.121},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69799999999999995,"15min":0.753},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.925},"last":1.0940000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.81399999999999995},"min":{"1min":0.60999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91800000000000004,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70399999999999996,"15min":0.86299999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.81100000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63400000000000001,"15min":0.65800000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.054},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.68000000000000005},"min":{"1min":0.438,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95699999999999996,"5min":1.0049999999999999,"15min":1.101},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.64300000000000002},"min":{"1min":0.45200000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.284},"last":0.84599999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0369999999999999,"5min":1.0880000000000001,"15min":1.129},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.69899999999999995,"15min":0.749},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0820000000000001},"last":0.89500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1122304,"data_stored":515482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66600000000000004},"min":{"1min":0.47199999999999998,"5min":0.37,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.93999999999999995,"15min":1.0900000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66900000000000004,"15min":0.74399999999999999},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65700000000000003,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.88500000000000001,"5min":0.92500000000000004,"15min":3.3100000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.65500000000000003,"15min":0.66500000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76200000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.76100000000000001},"min":{"1min":0.45700000000000002,"5min":0.39800000000000002,"15min":0.34799999999999998},"max":{"1min":0.98899999999999999,"5min":0.99399999999999999,"15min":2.9449999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.67800000000000005,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.90500000000000003,"5min":0.93500000000000005,"15min":2.0699999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.80300000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63,"15min":0.92000000000000004},"min":{"1min":0.38800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.85599999999999998,"5min":0.94399999999999995,"15min":8.9740000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67600000000000005,"15min":0.69399999999999995},"min":{"1min":0.48999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84499999999999997,"5min":1.0109999999999999,"15min":1.2370000000000001},"last":0.83399999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61899999999999999,"15min":0.74099999999999999},"min":{"1min":0.40100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.876,"5min":0.93200000000000005,"15min":2.9060000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63400000000000001,"15min":0.76900000000000002},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.96399999999999997,"5min":1.042,"15min":3.3319999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63400000000000001,"15min":0.68600000000000005},"min":{"1min":0.502,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84999999999999998,"5min":1.042,"15min":1.1830000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67400000000000004,"15min":0.80200000000000005},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.81299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1130496,"data_stored":515642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.86599999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.85799999999999998,"5min":0.92800000000000005,"15min":1.1739999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":1.004,"15min":1.131},"last":0.745},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65900000000000003,"15min":0.67700000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83999999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80400000000000005,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70899999999999996,"15min":0.71499999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.79800000000000004,"5min":1.008,"15min":1.032},"last":0.68400000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.69699999999999995,"15min":0.71499999999999997},"min":{"1min":0.54600000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.77600000000000002,"5min":0.94499999999999995,"15min":0.999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.53500000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89800000000000002,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80700000000000005,"5min":0.91900000000000004,"15min":0.97399999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.65000000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86799999999999999,"5min":0.874,"15min":0.874},"last":0.72999999999999998}]},{"osd":6,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.627,"15min":0.67500000000000004},"min":{"1min":0.48599999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86799999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68100000000000005,"15min":0.72299999999999998},"min":{"1min":0.46000000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.073},"last":0.71799999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67300000000000004,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48399999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.042},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.73399999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":0.93300000000000005,"15min":1.1479999999999999},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1122304,"data_stored":515482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42299999999999999,"15min":0.42599999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45100000000000001,"15min":0.503},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.65800000000000003,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.44900000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.441,"15min":0.46700000000000003},"min":{"1min":0.29299999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55200000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.49199999999999999,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71099999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.57899999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76000000000000001,"5min":1.036,"15min":1.254},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.436,"15min":0.436},"max":{"1min":0.72199999999999998,"5min":0.98899999999999999,"15min":1.772},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.98099999999999998,"15min":1.01},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.69999999999999996,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84999999999999998,"5min":1.167,"15min":1.181},"last":0.64000000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71499999999999997,"15min":0.746},"min":{"1min":0.53700000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":1.171,"15min":1.171},"last":0.621},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68100000000000005,"15min":0.70699999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.80000000000000004,"5min":1.0549999999999999,"15min":1.069},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73299999999999998,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.85499999999999998,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73099999999999998,"15min":0.77900000000000003},"min":{"1min":0.55700000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.70399999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.81299999999999994,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72899999999999998,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.82999999999999996,"5min":1.26,"15min":1.26},"last":0.71699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":1122304,"data_stored":515482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.42299999999999999,"15min":0.439},"min":{"1min":0.28499999999999998,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.56000000000000005,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46300000000000002,"15min":0.501},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.89700000000000002},"last":0.33300000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.49399999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48899999999999999,"15min":0.53700000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77100000000000002,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47499999999999998,"15min":0.48599999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.61899999999999999,"5min":0.65700000000000003,"15min":0.92000000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52800000000000002,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69999999999999996,"5min":0.79000000000000004,"15min":1.1599999999999999},"last":0.44600000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72899999999999998,"15min":0.79000000000000004},"min":{"1min":0.51500000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":1.0469999999999999,"15min":1.698},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.96699999999999997,"5min":1.0820000000000001,"15min":1.4219999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.70899999999999996,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90000000000000002,"5min":0.96099999999999997,"15min":1.3069999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.747,"15min":0.80700000000000005},"min":{"1min":0.56000000000000005,"5min":0.54600000000000004,"15min":0.51600000000000001},"max":{"1min":0.99099999999999999,"5min":1.085,"15min":1.7549999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.746,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.92600000000000005,"5min":1.0680000000000001,"15min":1.341},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73799999999999999,"15min":0.77500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97399999999999998,"5min":1.107,"15min":1.3939999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.78100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":1.048,"15min":1.282},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.56599999999999995,"15min":0.47099999999999997},"max":{"1min":1.0029999999999999,"5min":1.093,"15min":1.4530000000000001},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":1100,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":1126400,"data_stored":515552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.41699999999999998,"15min":0.57499999999999996},"min":{"1min":0.26100000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.48999999999999999,"5min":1.7150000000000001,"15min":3.976},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.442,"15min":0.503},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.55600000000000005,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47299999999999998,"15min":0.61399999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58599999999999997,"5min":3.2370000000000001,"15min":3.786},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47999999999999998,"15min":0.51500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86799999999999999,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.64900000000000002},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93100000000000005,"5min":2.1589999999999998,"15min":3.6400000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.505,"15min":0.63900000000000001},"min":{"1min":0.379,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.91800000000000004,"5min":1.9399999999999999,"15min":3.2440000000000002},"last":0.44700000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.79800000000000004},"min":{"1min":0.56200000000000006,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93000000000000005,"5min":1.7889999999999999,"15min":1.851},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72999999999999998,"15min":0.89500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.6539999999999999,"15min":4.5129999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.88},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.874,"5min":1.6100000000000001,"15min":4.1859999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.77900000000000003},"min":{"1min":0.52100000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.55200000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74399999999999999,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98299999999999998,"5min":1.823,"15min":2.0699999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.91300000000000003},"min":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.47099999999999997},"max":{"1min":0.93999999999999995,"5min":1.6850000000000001,"15min":4.3529999999999998},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:24:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.78900000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.91000000000000003,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.76600000000000001,"15min":0.82199999999999995},"min":{"1min":0.57699999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.04,"5min":1.8799999999999999,"15min":1.9770000000000001},"last":0.78700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1740800,"data_stored":1108120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44400000000000001,"15min":0.48499999999999999},"min":{"1min":0.29799999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.82999999999999996,"5min":0.92900000000000005,"15min":1.456},"last":0.375}]},{"osd":2,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45800000000000002,"15min":0.53500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":1.0589999999999999,"15min":1.595},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46999999999999997,"15min":0.57099999999999995},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68400000000000005,"5min":0.748,"15min":2.464},"last":0.33600000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47499999999999998,"15min":0.52700000000000002},"min":{"1min":0.309,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.859},"last":0.313},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.621},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77700000000000002,"5min":0.90000000000000002,"15min":1.903},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1080000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0760000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.77200000000000002,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.2589999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.746,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.78000000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.79500000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.278,"15min":1.5700000000000001},"last":0.748},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.54300000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.0389999999999999,"15min":1.53},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:24:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72699999999999998,"15min":0.78900000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":1.349,"15min":1.556},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.032,"15min":1.2909999999999999},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:24:12.943 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-18T10:24:12.943 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-18T10:24:13.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.122+0000 7f3cb0f5e640 1 Processor -- start 2023-12-18T10:24:13.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.122+0000 7f3cb0f5e640 1 -- start start 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3cb0f5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e0b0 0x7f3cac06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3cb0f5e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3cac15e530 0x7f3cac070210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3cb0f5e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac0c91d0 con 0x7f3cac15b760 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3cb0f5e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac15f0c0 con 0x7f3cac15e530 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3cb0f5e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac15eb00 con 0x7f3cac15e0b0 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3cab7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3cac15b760 0x7f3cac0c9660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53908/0 (socket says 172.21.15.133:53908) 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3cab7fe640 1 -- 172.21.15.133:0/3461471602 learned_addr learned my addr 172.21.15.133:0/3461471602 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3caaffd640 1 --2- 172.21.15.133:0/3461471602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e0b0 0x7f3cac06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3cabfff640 1 --2- 172.21.15.133:0/3461471602 >> v2:172.21.15.142:3300/0 conn(0x7f3cac15e530 0x7f3cac070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3caa7fc640 1 -- 172.21.15.133:0/3461471602 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990081669 0 0) 0x7f3cac0c91d0 con 0x7f3cac15b760 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3caa7fc640 1 -- 172.21.15.133:0/3461471602 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c94003530 con 0x7f3cac15b760 2023-12-18T10:24:13.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3caaffd640 1 -- 172.21.15.133:0/3461471602 >> v2:172.21.15.142:3300/0 conn(0x7f3cac15e530 msgr2=0x7f3cac070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3caaffd640 1 --2- 172.21.15.133:0/3461471602 >> v2:172.21.15.142:3300/0 conn(0x7f3cac15e530 0x7f3cac070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3caaffd640 1 -- 172.21.15.133:0/3461471602 >> v1:172.21.15.133:6789/0 conn(0x7f3cac15b760 legacy=0x7f3cac0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.126+0000 7f3caaffd640 1 -- 172.21.15.133:0/3461471602 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac15ede0 con 0x7f3cac15e0b0 2023-12-18T10:24:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3caaffd640 1 --2- 172.21.15.133:0/3461471602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e0b0 0x7f3cac06fcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00097c0 tx=0x7f3ca001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=effead773265d1b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3caa7fc640 1 -- 172.21.15.133:0/3461471602 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00ab600 con 0x7f3cac15e0b0 2023-12-18T10:24:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3caa7fc640 1 -- 172.21.15.133:0/3461471602 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca00a7050 con 0x7f3cac15e0b0 2023-12-18T10:24:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3caa7fc640 1 -- 172.21.15.133:0/3461471602 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca00ab980 con 0x7f3cac15e0b0 2023-12-18T10:24:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3461471602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e0b0 msgr2=0x7f3cac06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3461471602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e0b0 0x7f3cac06fcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00097c0 tx=0x7f3ca001c3f0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3461471602 shutdown_connections 2023-12-18T10:24:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3461471602 >> v2:172.21.15.142:3300/0 conn(0x7f3cac15e530 0x7f3cac070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3461471602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e0b0 0x7f3cac06fcd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3461471602 >> 172.21.15.133:0/3461471602 conn(0x7f3cac06a350 msgr2=0x7f3cac0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3461471602 shutdown_connections 2023-12-18T10:24:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3461471602 wait complete. 2023-12-18T10:24:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 Processor -- start 2023-12-18T10:24:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.130+0000 7f3cb0f5e640 1 -- start start 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cac15b760 0x7f3cac0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cac15e0b0 0x7f3cac13ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e530 0x7f3cac14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0cbe90 con 0x7f3cac15b760 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0b3f50 con 0x7f3cac15e0b0 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac13f4d0 con 0x7f3cac15e530 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cac15b760 0x7f3cac0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cac15b760 0x7f3cac0b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59070/0 (socket says 172.21.15.133:59070) 2023-12-18T10:24:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 -- 172.21.15.133:0/3836924430 learned_addr learned my addr 172.21.15.133:0/3836924430 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3caaffd640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cac15e0b0 0x7f3cac13ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cabfff640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e530 0x7f3cac14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 -- 172.21.15.133:0/3836924430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e530 msgr2=0x7f3cac14f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e530 0x7f3cac14f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 -- 172.21.15.133:0/3836924430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cac15e0b0 msgr2=0x7f3cac13ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cac15e0b0 0x7f3cac13ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 -- 172.21.15.133:0/3836924430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca0009420 con 0x7f3cac15b760 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cab7fe640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cac15b760 0x7f3cac0b3a10 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00c4d0 tx=0x7f3c9c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3c93fff640 1 -- 172.21.15.133:0/3836924430 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c005cf0 con 0x7f3cac15b760 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3c93fff640 1 -- 172.21.15.133:0/3836924430 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c005e50 con 0x7f3cac15b760 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3c93fff640 1 -- 172.21.15.133:0/3836924430 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c007270 con 0x7f3cac15b760 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac0cc0a0 con 0x7f3cac15b760 2023-12-18T10:24:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac0cc660 con 0x7f3cac15b760 2023-12-18T10:24:13.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac04e000 con 0x7f3cac15b760 2023-12-18T10:24:13.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.134+0000 7f3c93fff640 1 -- 172.21.15.133:0/3836924430 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c9c0073d0 con 0x7f3cac15b760 2023-12-18T10:24:13.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.138+0000 7f3c93fff640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c98065a60 0x7f3c98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.138+0000 7f3c93fff640 1 -- 172.21.15.133:0/3836924430 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3c9c082850 con 0x7f3cac15b760 2023-12-18T10:24:13.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.138+0000 7f3caaffd640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c98065a60 0x7f3c98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.138+0000 7f3caaffd640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c98065a60 0x7f3c98067f20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00ad000 tx=0x7f3ca0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.142+0000 7f3c93fff640 1 -- 172.21.15.133:0/3836924430 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3c9c0500e0 con 0x7f3cac15b760 2023-12-18T10:24:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.346+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3cac071f70 con 0x7f3cac15b760 2023-12-18T10:24:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.350+0000 7f3c93fff640 1 -- 172.21.15.133:0/3836924430 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3c9c053700 con 0x7f3cac15b760 2023-12-18T10:24:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-18T10:24:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c98065a60 msgr2=0x7f3c98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c98065a60 0x7f3c98067f20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00ad000 tx=0x7f3ca0008040 comp rx=0 tx=0).stop 2023-12-18T10:24:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cac15b760 msgr2=0x7f3cac0b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cac15b760 0x7f3cac0b3a10 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00c4d0 tx=0x7f3c9c00c990 comp rx=0 tx=0).stop 2023-12-18T10:24:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 shutdown_connections 2023-12-18T10:24:13.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3c98065a60 0x7f3c98067f20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3cac15e530 0x7f3cac14f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3cac15e0b0 0x7f3cac13ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 --2- 172.21.15.133:0/3836924430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cac15b760 0x7f3cac0b3a10 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 >> 172.21.15.133:0/3836924430 conn(0x7f3cac06a350 msgr2=0x7f3cac072840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 shutdown_connections 2023-12-18T10:24:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.354+0000 7f3cb0f5e640 1 -- 172.21.15.133:0/3836924430 wait complete. 2023-12-18T10:24:13.371 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:13.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd35e3f3640 1 Processor -- start 2023-12-18T10:24:13.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd35e3f3640 1 -- start start 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd35e3f3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd35815a680 0x7fd35815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd35e3f3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3580cac10 0x7fd35815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd35e3f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35815f100 con 0x7fd35815afa0 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd35e3f3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580ca7d0 con 0x7fd3580cac10 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd35e3f3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35815e860 con 0x7fd35815a680 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd3577fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3580cac10 0x7fd35815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd3577fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3580cac10 0x7fd35815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59078/0 (socket says 172.21.15.133:59078) 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd3577fe640 1 -- 172.21.15.133:0/3950891152 learned_addr learned my addr 172.21.15.133:0/3950891152 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd357fff640 1 --2- 172.21.15.133:0/3950891152 >> v2:172.21.15.142:3300/0 conn(0x7fd35815a680 0x7fd35815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd3577fe640 1 -- 172.21.15.133:0/3950891152 >> v2:172.21.15.142:3300/0 conn(0x7fd35815a680 msgr2=0x7fd35815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd3577fe640 1 --2- 172.21.15.133:0/3950891152 >> v2:172.21.15.142:3300/0 conn(0x7fd35815a680 0x7fd35815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd3577fe640 1 -- 172.21.15.133:0/3950891152 >> v1:172.21.15.142:6789/0 conn(0x7fd35815afa0 legacy=0x7fd35806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.510+0000 7fd3577fe640 1 -- 172.21.15.133:0/3950891152 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35815eb40 con 0x7fd3580cac10 2023-12-18T10:24:13.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd3577fe640 1 --2- 172.21.15.133:0/3950891152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3580cac10 0x7fd35815aa60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009870 tx=0x7fd34c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9317382ae6769fda server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd356ffd640 1 -- 172.21.15.133:0/3950891152 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0ad680 con 0x7fd3580cac10 2023-12-18T10:24:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd356ffd640 1 -- 172.21.15.133:0/3950891152 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c0ad7e0 con 0x7fd3580cac10 2023-12-18T10:24:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd356ffd640 1 -- 172.21.15.133:0/3950891152 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0adb70 con 0x7fd3580cac10 2023-12-18T10:24:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd35e3f3640 1 -- 172.21.15.133:0/3950891152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3580cac10 msgr2=0x7fd35815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/3950891152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3580cac10 0x7fd35815aa60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009870 tx=0x7fd34c01c470 comp rx=0 tx=0).stop 2023-12-18T10:24:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd35e3f3640 1 -- 172.21.15.133:0/3950891152 shutdown_connections 2023-12-18T10:24:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/3950891152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3580cac10 0x7fd35815aa60 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/3950891152 >> v2:172.21.15.142:3300/0 conn(0x7fd35815a680 0x7fd35815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd35e3f3640 1 -- 172.21.15.133:0/3950891152 >> 172.21.15.133:0/3950891152 conn(0x7fd35806a3e0 msgr2=0x7fd3580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd35e3f3640 1 -- 172.21.15.133:0/3950891152 shutdown_connections 2023-12-18T10:24:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.514+0000 7fd35e3f3640 1 -- 172.21.15.133:0/3950891152 wait complete. 2023-12-18T10:24:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 Processor -- start 2023-12-18T10:24:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 -- start start 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3580cac10 0x7fd358154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd35815a680 0x7fd358153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd35815afa0 0x7fd3580ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358153ea0 con 0x7fd35815afa0 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358155ec0 con 0x7fd3580cac10 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3581558e0 con 0x7fd35815a680 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd35815afa0 0x7fd3580ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd357fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3580cac10 0x7fd358154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd3577fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd35815a680 0x7fd358153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd35815afa0 0x7fd3580ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59082/0 (socket says 172.21.15.133:59082) 2023-12-18T10:24:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 -- 172.21.15.133:0/1187144963 learned_addr learned my addr 172.21.15.133:0/1187144963 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 -- 172.21.15.133:0/1187144963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd35815a680 msgr2=0x7fd358153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd35815a680 0x7fd358153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 -- 172.21.15.133:0/1187144963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3580cac10 msgr2=0x7fd358154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3580cac10 0x7fd358154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 -- 172.21.15.133:0/1187144963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c0094d0 con 0x7fd35815afa0 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35c990640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd35815afa0 0x7fd3580ccf80 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c790 tx=0x7fd35000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd354ff9640 1 -- 172.21.15.133:0/1187144963 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000cea0 con 0x7fd35815afa0 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd354ff9640 1 -- 172.21.15.133:0/1187144963 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350003b80 con 0x7fd35815afa0 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd354ff9640 1 -- 172.21.15.133:0/1187144963 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000a7f0 con 0x7fd35815afa0 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3580c2f70 con 0x7fd35815afa0 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.518+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd358155b50 con 0x7fd35815afa0 2023-12-18T10:24:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.522+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3580735b0 con 0x7fd35815afa0 2023-12-18T10:24:13.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.522+0000 7fd354ff9640 1 -- 172.21.15.133:0/1187144963 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd35000a950 con 0x7fd35815afa0 2023-12-18T10:24:13.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.522+0000 7fd354ff9640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd344065a60 0x7fd344067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:13.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.522+0000 7fd354ff9640 1 -- 172.21.15.133:0/1187144963 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd350082fe0 con 0x7fd35815afa0 2023-12-18T10:24:13.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.522+0000 7fd357fff640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd344065a60 0x7fd344067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.522+0000 7fd357fff640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd344065a60 0x7fd344067f20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd348009b60 tx=0x7fd348009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:13.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.526+0000 7fd354ff9640 1 -- 172.21.15.133:0/1187144963 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd350050870 con 0x7fd35815afa0 2023-12-18T10:24:13.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.706+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3580b4050 con 0x7fd35815afa0 2023-12-18T10:24:13.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.706+0000 7fd354ff9640 1 -- 172.21.15.133:0/1187144963 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4720 (secure 0 0 0) 0x7fd350053e90 con 0x7fd35815afa0 2023-12-18T10:24:13.706 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:13.706 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8118,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:07.023465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:13.706 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 84 2023-12-18T10:24:13.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd344065a60 msgr2=0x7fd344067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd344065a60 0x7fd344067f20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd348009b60 tx=0x7fd348009190 comp rx=0 tx=0).stop 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd35815afa0 msgr2=0x7fd3580ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd35815afa0 0x7fd3580ccf80 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c790 tx=0x7fd35000cc50 comp rx=0 tx=0).stop 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 shutdown_connections 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd344065a60 0x7fd344067f20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd35815afa0 0x7fd3580ccf80 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd35815a680 0x7fd358153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 --2- 172.21.15.133:0/1187144963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3580cac10 0x7fd358154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 >> 172.21.15.133:0/1187144963 conn(0x7fd35806a3e0 msgr2=0x7fd3580ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 shutdown_connections 2023-12-18T10:24:13.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:13.710+0000 7fd35e3f3640 1 -- 172.21.15.133:0/1187144963 wait complete. 2023-12-18T10:24:14.130 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:24:03.649144+0000', 'modified': '2023-12-18T10:24:07.023465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8127': {'gid': 8127, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2531300469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2531300469}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2531300469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:24:14.131 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-18T10:24:14.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-18T10:24:14.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.274+0000 7fdc13020640 1 Processor -- start 2023-12-18T10:24:14.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.274+0000 7fdc13020640 1 -- start start 2023-12-18T10:24:14.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.274+0000 7fdc13020640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.274+0000 7fdc13020640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdc0c0cac10 0x7fdc0c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.274+0000 7fdc13020640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc0c15afa0 0x7fdc0c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.274+0000 7fdc13020640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c15f100 con 0x7fdc0c15afa0 2023-12-18T10:24:14.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.274+0000 7fdc13020640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c0ca7d0 con 0x7fdc0c0cac10 2023-12-18T10:24:14.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.274+0000 7fdc13020640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c15e860 con 0x7fdc0c15a680 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc0c15afa0 0x7fdc0c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc0c15afa0 0x7fdc0c06fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59086/0 (socket says 172.21.15.133:59086) 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 -- 172.21.15.133:0/4138044552 learned_addr learned my addr 172.21.15.133:0/4138044552 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc0bfff640 1 --2- 172.21.15.133:0/4138044552 >> v2:172.21.15.142:3300/0 conn(0x7fdc0c0cac10 0x7fdc0c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/4138044552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 -- 172.21.15.133:0/4138044552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 msgr2=0x7fdc0c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 --2- 172.21.15.133:0/4138044552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 -- 172.21.15.133:0/4138044552 >> v2:172.21.15.142:3300/0 conn(0x7fdc0c0cac10 msgr2=0x7fdc0c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 --2- 172.21.15.133:0/4138044552 >> v2:172.21.15.142:3300/0 conn(0x7fdc0c0cac10 0x7fdc0c15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 -- 172.21.15.133:0/4138044552 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c15eb40 con 0x7fdc0c15afa0 2023-12-18T10:24:14.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/4138044552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:14.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc115bd640 1 --2- 172.21.15.133:0/4138044552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c06fdb0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c06cf60 tx=0x7fdc0401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a40a25c09dba4d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc0b7fe640 1 -- 172.21.15.133:0/4138044552 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040a56d0 con 0x7fdc0c15afa0 2023-12-18T10:24:14.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc0b7fe640 1 -- 172.21.15.133:0/4138044552 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040a5830 con 0x7fdc0c15afa0 2023-12-18T10:24:14.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.278+0000 7fdc0b7fe640 1 -- 172.21.15.133:0/4138044552 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040a5bc0 con 0x7fdc0c15afa0 2023-12-18T10:24:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- 172.21.15.133:0/4138044552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 msgr2=0x7fdc0c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 --2- 172.21.15.133:0/4138044552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c06fdb0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c06cf60 tx=0x7fdc0401c940 comp rx=0 tx=0).stop 2023-12-18T10:24:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- 172.21.15.133:0/4138044552 shutdown_connections 2023-12-18T10:24:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 --2- 172.21.15.133:0/4138044552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c06fdb0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 --2- 172.21.15.133:0/4138044552 >> v2:172.21.15.142:3300/0 conn(0x7fdc0c0cac10 0x7fdc0c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 --2- 172.21.15.133:0/4138044552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- 172.21.15.133:0/4138044552 >> 172.21.15.133:0/4138044552 conn(0x7fdc0c06a3e0 msgr2=0x7fdc0c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:14.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- 172.21.15.133:0/4138044552 shutdown_connections 2023-12-18T10:24:14.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- 172.21.15.133:0/4138044552 wait complete. 2023-12-18T10:24:14.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 Processor -- start 2023-12-18T10:24:14.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- start start 2023-12-18T10:24:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0c0cac10 0x7fdc0c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c0cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0cd720 con 0x7fdc0c15afa0 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c145c80 con 0x7fdc0c0cac10 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc13020640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0ccaa0 con 0x7fdc0c15a680 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c0cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c0cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59100/0 (socket says 172.21.15.133:59100) 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc115bd640 1 -- 172.21.15.133:0/3660484587 learned_addr learned my addr 172.21.15.133:0/3660484587 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc0bfff640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.282+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0c0cac10 0x7fdc0c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc115bd640 1 -- 172.21.15.133:0/3660484587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 msgr2=0x7fdc0c145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc115bd640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc115bd640 1 -- 172.21.15.133:0/3660484587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0c0cac10 msgr2=0x7fdc0c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc115bd640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0c0cac10 0x7fdc0c0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc115bd640 1 -- 172.21.15.133:0/3660484587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04009b30 con 0x7fdc0c15afa0 2023-12-18T10:24:14.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc115bd640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c0cc050 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdc040af040 tx=0x7fdc040196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc097fa640 1 -- 172.21.15.133:0/3660484587 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040b8640 con 0x7fdc0c15afa0 2023-12-18T10:24:14.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc097fa640 1 -- 172.21.15.133:0/3660484587 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040b87a0 con 0x7fdc0c15afa0 2023-12-18T10:24:14.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc097fa640 1 -- 172.21.15.133:0/3660484587 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040b8b10 con 0x7fdc0c15afa0 2023-12-18T10:24:14.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc13020640 1 -- 172.21.15.133:0/3660484587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c0ccd80 con 0x7fdc0c15afa0 2023-12-18T10:24:14.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc13020640 1 -- 172.21.15.133:0/3660484587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c0cd340 con 0x7fdc0c15afa0 2023-12-18T10:24:14.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc097fa640 1 -- 172.21.15.133:0/3660484587 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdc040b8c70 con 0x7fdc0c15afa0 2023-12-18T10:24:14.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc097fa640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdbf0065a60 0x7fdbf0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc097fa640 1 -- 172.21.15.133:0/3660484587 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc0411e340 con 0x7fdc0c15afa0 2023-12-18T10:24:14.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.286+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdbf0065a60 0x7fdbf0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 Processor -- start 2023-12-18T10:24:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdbf0065a60 0x7fdbf0067f20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006e90 tx=0x7fdc00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- start start 2023-12-18T10:24:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 0x561f2b0e8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8990 0x561f2b09dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b09e1c0 0x561f2b09e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f2aec1c90 con 0x561f2b09e1c0 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f2aef3220 con 0x561f2b0e8990 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f2aef07f0 con 0x561f2b0e8070 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b09e1c0 0x561f2b09e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b09e1c0 0x561f2b09e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59106/0 (socket says 172.21.15.133:59106) 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 -- 172.21.15.133:0/4292746804 learned_addr learned my addr 172.21.15.133:0/4292746804 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 0x561f2b0e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc0bfff640 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8990 0x561f2b09dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 -- 172.21.15.133:0/4292746804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 msgr2=0x561f2b0e8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 0x561f2b0e8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 -- 172.21.15.133:0/4292746804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8990 msgr2=0x561f2b09dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8990 0x561f2b09dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 -- 172.21.15.133:0/4292746804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f2abe8890 con 0x561f2b09e1c0 2023-12-18T10:24:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc115bd640 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b09e1c0 0x561f2b09e5a0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fdc040090a0 tx=0x7fdc040ef520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b6c7cded156c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdbf67fc640 1 -- 172.21.15.133:0/4292746804 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040f36a0 con 0x561f2b09e1c0 2023-12-18T10:24:14.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdbf67fc640 1 -- 172.21.15.133:0/4292746804 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040f7850 con 0x561f2b09e1c0 2023-12-18T10:24:14.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdbf67fc640 1 -- 172.21.15.133:0/4292746804 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040edcc0 con 0x561f2b09e1c0 2023-12-18T10:24:14.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- 172.21.15.133:0/4292746804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b09e1c0 msgr2=0x561f2b09e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b09e1c0 0x561f2b09e5a0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fdc040090a0 tx=0x7fdc040ef520 comp rx=0 tx=0).stop 2023-12-18T10:24:14.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- 172.21.15.133:0/4292746804 shutdown_connections 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b09e1c0 0x561f2b09e5a0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8990 0x561f2b09dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 --2- 172.21.15.133:0/4292746804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 0x561f2b0e8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- 172.21.15.133:0/4292746804 >> 172.21.15.133:0/4292746804 conn(0x561f2b0a4950 msgr2=0x561f2b09c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- 172.21.15.133:0/4292746804 shutdown_connections 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.290+0000 7fdc16379000 1 -- 172.21.15.133:0/4292746804 wait complete. 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 -- start start 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 Processor -- start 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 0x561f2b0a9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 0x561f2b0a9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f2aeec0e0 con 0x561f2b0e8990 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f2ae8b310 con 0x561f2b0e8070 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f2aea9770 con 0x561f2b09e1c0 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 10 client.0 _ll_register_callbacks cb 0x561f2b089b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59120/0 (socket says 172.21.15.133:59120) 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 -- 172.21.15.133:0/3038390341 learned_addr learned my addr 172.21.15.133:0/3038390341 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 0x561f2b0a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc0bfff640 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 0x561f2b0a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 -- 172.21.15.133:0/3038390341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 msgr2=0x561f2b0a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 0x561f2b0a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 -- 172.21.15.133:0/3038390341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 msgr2=0x561f2b0a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 0x561f2b0a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 -- 172.21.15.133:0/3038390341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c0cd340 con 0x561f2b0e8990 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc115bd640 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0a9ab0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401ce20 tx=0x7fdc0411e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f703e3f3e4c9900b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdbeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/3038390341 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040f7850 con 0x561f2b0e8990 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/3038390341 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc0411c030 con 0x561f2b0e8990 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 -- 172.21.15.133:0/3038390341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f2aebbc10 con 0x561f2b0e8990 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/3038390341 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc040f36a0 con 0x561f2b0e8990 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 10 client.8286 fetch_fsmap learned FSMap version 84 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 -- 172.21.15.133:0/3038390341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x561f2aeb1260 con 0x561f2b0e8990 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/3038390341 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f2aebbc10 con 0x561f2b0e8990 2023-12-18T10:24:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/3038390341 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 84) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdc04005d20 con 0x561f2b0e8990 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 10 client.8286 fetch_fsmap finished waiting for FSMap version 84 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 10 client.8286 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 20 client.8286 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x561f2b0f7310 0x561f2b0f9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 4 client.8286 mds_command: new command op to 8127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc16379000 1 -- 172.21.15.133:0/3038390341 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f2aeeaa30 con 0x561f2b0f7310 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x561f2b0f7310 0x561f2b0f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdbeb7fe640 10 client.8286 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:14.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.294+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x561f2b0f7310 0x561f2b0f9700 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb965afa2a23c08 server_cookie=e6b32d7a6014520a in_seq=0 out_seq=0 2023-12-18T10:24:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/3038390341 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561f2aeeaa30 con 0x561f2b0f7310 2023-12-18T10:24:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdbeb7fe640 10 client.8286 handle_command_reply: tid=0 2023-12-18T10:24:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 client.8286 shutdown 2023-12-18T10:24:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 -- 172.21.15.133:0/3038390341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 msgr2=0x561f2b0a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0a9ab0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401ce20 tx=0x7fdc0411e070 comp rx=0 tx=0).stop 2023-12-18T10:24:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 -- 172.21.15.133:0/3038390341 shutdown_connections 2023-12-18T10:24:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x561f2b0f7310 0x561f2b0f9700 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0a9ab0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 0x561f2b0a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 --2- 172.21.15.133:0/3038390341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 0x561f2b0a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdbeb7fe640 0 client.8286 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 -- 172.21.15.133:0/3038390341 >> 172.21.15.133:0/3038390341 conn(0x561f2b0a4950 msgr2=0x561f2b09cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 -- 172.21.15.133:0/3038390341 shutdown_connections 2023-12-18T10:24:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 1 -- 172.21.15.133:0/3038390341 wait complete. 2023-12-18T10:24:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.298+0000 7fdc16379000 20 client.8286 trim_cache size 0 max 16384 2023-12-18T10:24:14.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 Processor -- start 2023-12-18T10:24:14.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- start start 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b09e1c0 0x561f2b0fa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 0x561f2b0fac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f2aba9940 con 0x561f2b0e8990 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f2b0a2620 con 0x561f2b09e1c0 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f2aeeec40 con 0x561f2b0e8070 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0e09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59136/0 (socket says 172.21.15.133:59136) 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 -- 172.21.15.133:0/2692779855 learned_addr learned my addr 172.21.15.133:0/2692779855 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc0bfff640 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 0x561f2b0fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b09e1c0 0x561f2b0fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 -- 172.21.15.133:0/2692779855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 msgr2=0x561f2b0fac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 0x561f2b0fac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 -- 172.21.15.133:0/2692779855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b09e1c0 msgr2=0x561f2b0fa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b09e1c0 0x561f2b0fa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 -- 172.21.15.133:0/2692779855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f2ae973b0 con 0x561f2b0e8990 2023-12-18T10:24:14.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc115bd640 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0e09d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fdc040090a0 tx=0x7fdc040f3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc0147177ff734f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdbf6ffd640 1 -- 172.21.15.133:0/2692779855 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040a56d0 con 0x561f2b0e8990 2023-12-18T10:24:14.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdbf6ffd640 1 -- 172.21.15.133:0/2692779855 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040f36a0 con 0x561f2b0e8990 2023-12-18T10:24:14.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdbf6ffd640 1 -- 172.21.15.133:0/2692779855 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040f7850 con 0x561f2b0e8990 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- 172.21.15.133:0/2692779855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 msgr2=0x561f2b0e09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0e09d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fdc040090a0 tx=0x7fdc040f3000 comp rx=0 tx=0).stop 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- 172.21.15.133:0/2692779855 shutdown_connections 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b0e09d0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b0e8070 0x561f2b0fac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 --2- 172.21.15.133:0/2692779855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b09e1c0 0x561f2b0fa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- 172.21.15.133:0/2692779855 >> 172.21.15.133:0/2692779855 conn(0x561f2b0a4950 msgr2=0x561f2b0a3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- 172.21.15.133:0/2692779855 shutdown_connections 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- 172.21.15.133:0/2692779855 wait complete. 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 -- start start 2023-12-18T10:24:14.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.314+0000 7fdc16379000 1 Processor -- start 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 0x561f2b145080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 0x561f2b1475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b149b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f2aee98f0 con 0x561f2b0e8990 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f2aeeaf70 con 0x561f2b0e8070 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f2aef44b0 con 0x561f2b09e1c0 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 10 client.0 _ll_register_callbacks cb 0x561f2ae9a640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59148/0 (socket says 172.21.15.133:59148) 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 -- 172.21.15.133:0/867450088 learned_addr learned my addr 172.21.15.133:0/867450088 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc0bfff640 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 0x561f2b1475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 0x561f2b145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 -- 172.21.15.133:0/867450088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 msgr2=0x561f2b145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 0x561f2b145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 -- 172.21.15.133:0/867450088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 msgr2=0x561f2b1475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 0x561f2b1475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 -- 172.21.15.133:0/867450088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f2aeb1260 con 0x561f2b0e8990 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc115bd640 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b149b20 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401ce20 tx=0x7fdc04009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141e57f957cd84c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/867450088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040f73c0 con 0x561f2b0e8990 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/867450088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc0411c040 con 0x561f2b0e8990 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- 172.21.15.133:0/867450088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f2b0a1930 con 0x561f2b0e8990 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/867450088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc040f7520 con 0x561f2b0e8990 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 10 client.8292 fetch_fsmap learned FSMap version 84 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- 172.21.15.133:0/867450088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x561f2abe8cc0 con 0x561f2b0e8990 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/867450088 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f2b0a1930 con 0x561f2b0e8990 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/867450088 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 84) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fdc04005d20 con 0x561f2b0e8990 2023-12-18T10:24:14.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 10 client.8292 fetch_fsmap finished waiting for FSMap version 84 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 10 client.8292 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 20 client.8292 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x561f2b14a060 0x561f2b14c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 4 client.8292 mds_command: new command op to 8127 tid=0[{"prefix": "status"}] 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- 172.21.15.133:0/867450088 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561f2aeb1e00 con 0x561f2b14a060 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x561f2b14a060 0x561f2b14c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc10dbc640 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x561f2b14a060 0x561f2b14c450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca30a141d4968151 server_cookie=b4e928e21b543e16 in_seq=0 out_seq=0 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 10 client.8292 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 1 -- 172.21.15.133:0/867450088 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x561f2aeb1e00 con 0x561f2b14a060 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 10 client.8292 handle_command_reply: tid=0 2023-12-18T10:24:14.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 client.8292 shutdown 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- 172.21.15.133:0/867450088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 msgr2=0x561f2b149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b149b20 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401ce20 tx=0x7fdc04009810 comp rx=0 tx=0).stop 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- 172.21.15.133:0/867450088 shutdown_connections 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x561f2b14a060 0x561f2b14c450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561f2b0e8990 0x561f2b149b20 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f2b0e8070 0x561f2b1475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdbeb7fe640 0 client.8292 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 --2- 172.21.15.133:0/867450088 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561f2b09e1c0 0x561f2b145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- 172.21.15.133:0/867450088 >> 172.21.15.133:0/867450088 conn(0x561f2b0a4950 msgr2=0x561f2b0f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- 172.21.15.133:0/867450088 shutdown_connections 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.318+0000 7fdc16379000 1 -- 172.21.15.133:0/867450088 wait complete. 2023-12-18T10:24:14.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc16379000 20 client.8292 trim_cache size 0 max 16384 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 8127, 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 10.669144181, 2023-12-18T10:24:14.328 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 84, 2023-12-18T10:24:14.329 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 91, 2023-12-18T10:24:14.329 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 91, 2023-12-18T10:24:14.329 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 15.101083869 2023-12-18T10:24:14.329 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 -- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdbf0065a60 msgr2=0x7fdbf0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdbf0065a60 0x7fdbf0067f20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdc00006e90 tx=0x7fdc00008040 comp rx=0 tx=0).stop 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 -- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 msgr2=0x7fdc0c0cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c0cc050 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdc040af040 tx=0x7fdc040196e0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 -- 172.21.15.133:0/3660484587 shutdown_connections 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdbf0065a60 0x7fdbf0067f20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc0c15afa0 0x7fdc0c0cc050 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdc0c15a680 0x7fdc0c145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 --2- 172.21.15.133:0/3660484587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc0c0cac10 0x7fdc0c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 -- 172.21.15.133:0/3660484587 >> 172.21.15.133:0/3660484587 conn(0x7fdc0c06a3e0 msgr2=0x7fdc0c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 -- 172.21.15.133:0/3660484587 shutdown_connections 2023-12-18T10:24:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.322+0000 7fdc13020640 1 -- 172.21.15.133:0/3660484587 wait complete. 2023-12-18T10:24:14.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:24:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9872cf9640 1 Processor -- start 2023-12-18T10:24:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9872cf9640 1 -- start start 2023-12-18T10:24:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9872cf9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f986c15a680 0x7f986c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9872cf9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c06fdb0 0x7f986c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9872cf9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c15f100 con 0x7f986c0cac10 2023-12-18T10:24:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9872cf9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c070780 con 0x7f986c15a680 2023-12-18T10:24:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9872cf9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0ca7d0 con 0x7f986c06fdb0 2023-12-18T10:24:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9863fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f986c0cac10 0x7f986c15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53922/0 (socket says 172.21.15.133:53922) 2023-12-18T10:24:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9863fff640 1 -- 172.21.15.133:0/260501263 learned_addr learned my addr 172.21.15.133:0/260501263 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9871296640 1 --2- 172.21.15.133:0/260501263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c06fdb0 0x7f986c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9870a95640 1 --2- 172.21.15.133:0/260501263 >> v2:172.21.15.142:3300/0 conn(0x7f986c15a680 0x7f986c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f98637fe640 1 -- 172.21.15.133:0/260501263 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841525706 0 0) 0x7f986c15f100 con 0x7f986c0cac10 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f98637fe640 1 -- 172.21.15.133:0/260501263 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9854003530 con 0x7f986c0cac10 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9871296640 1 -- 172.21.15.133:0/260501263 >> v2:172.21.15.142:3300/0 conn(0x7f986c15a680 msgr2=0x7f986c15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9871296640 1 --2- 172.21.15.133:0/260501263 >> v2:172.21.15.142:3300/0 conn(0x7f986c15a680 0x7f986c15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f98637fe640 1 -- 172.21.15.133:0/260501263 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 645543568 0 0) 0x7f9854003530 con 0x7f986c0cac10 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9871296640 1 -- 172.21.15.133:0/260501263 >> v1:172.21.15.133:6789/0 conn(0x7f986c0cac10 legacy=0x7f986c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.478+0000 7f9871296640 1 -- 172.21.15.133:0/260501263 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c15e860 con 0x7f986c06fdb0 2023-12-18T10:24:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9871296640 1 --2- 172.21.15.133:0/260501263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c06fdb0 0x7f986c070240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9864009dc0 tx=0x7f986401c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3593f486330d78e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f98637fe640 1 -- 172.21.15.133:0/260501263 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c001680 con 0x7f986c06fdb0 2023-12-18T10:24:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f98637fe640 1 -- 172.21.15.133:0/260501263 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98640a5600 con 0x7f986c06fdb0 2023-12-18T10:24:14.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f98637fe640 1 -- 172.21.15.133:0/260501263 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a5990 con 0x7f986c06fdb0 2023-12-18T10:24:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9872cf9640 1 -- 172.21.15.133:0/260501263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c06fdb0 msgr2=0x7f986c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9872cf9640 1 --2- 172.21.15.133:0/260501263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c06fdb0 0x7f986c070240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9864009dc0 tx=0x7f986401c7c0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9872cf9640 1 -- 172.21.15.133:0/260501263 shutdown_connections 2023-12-18T10:24:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9872cf9640 1 --2- 172.21.15.133:0/260501263 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c06fdb0 0x7f986c070240 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9872cf9640 1 --2- 172.21.15.133:0/260501263 >> v2:172.21.15.142:3300/0 conn(0x7f986c15a680 0x7f986c15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9872cf9640 1 -- 172.21.15.133:0/260501263 >> 172.21.15.133:0/260501263 conn(0x7f986c06a3e0 msgr2=0x7f986c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:14.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9872cf9640 1 -- 172.21.15.133:0/260501263 shutdown_connections 2023-12-18T10:24:14.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.482+0000 7f9872cf9640 1 -- 172.21.15.133:0/260501263 wait complete. 2023-12-18T10:24:14.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 Processor -- start 2023-12-18T10:24:14.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 -- start start 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f986c06fdb0 0x7f986c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f986c0cac10 0x7f986c1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c15a680 0x7f986c158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0c47d0 con 0x7f986c0cac10 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0c3ea0 con 0x7f986c06fdb0 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0c4180 con 0x7f986c15a680 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f986c0cac10 0x7f986c1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f986c0cac10 0x7f986c1570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59164/0 (socket says 172.21.15.133:59164) 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 -- 172.21.15.133:0/2588308071 learned_addr learned my addr 172.21.15.133:0/2588308071 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9870a95640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f986c06fdb0 0x7f986c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9871296640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c15a680 0x7f986c158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 -- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c15a680 msgr2=0x7f986c158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c15a680 0x7f986c158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 -- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f986c06fdb0 msgr2=0x7f986c0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f986c06fdb0 0x7f986c0c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 -- 172.21.15.133:0/2588308071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864009a70 con 0x7f986c0cac10 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9870a95640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f986c06fdb0 0x7f986c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9863fff640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f986c0cac10 0x7f986c1570b0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f985c0011f0 tx=0x7f985c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f98617fa640 1 -- 172.21.15.133:0/2588308071 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c005ae0 con 0x7f986c0cac10 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f98617fa640 1 -- 172.21.15.133:0/2588308071 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c005c60 con 0x7f986c0cac10 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f98617fa640 1 -- 172.21.15.133:0/2588308071 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0072b0 con 0x7f986c0cac10 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c0c4460 con 0x7f986c0cac10 2023-12-18T10:24:14.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.486+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c159e00 con 0x7f986c0cac10 2023-12-18T10:24:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.490+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c0735b0 con 0x7f986c0cac10 2023-12-18T10:24:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.490+0000 7f98617fa640 1 -- 172.21.15.133:0/2588308071 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f985c007410 con 0x7f986c0cac10 2023-12-18T10:24:14.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.490+0000 7f98617fa640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.490+0000 7f98617fa640 1 -- 172.21.15.133:0/2588308071 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f985c0829f0 con 0x7f986c0cac10 2023-12-18T10:24:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.490+0000 7f9870a95640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:14.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.490+0000 7f9870a95640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9868009bb0 tx=0x7f9868008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:14.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.494+0000 7f98617fa640 1 -- 172.21.15.133:0/2588308071 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f985c050310 con 0x7f986c0cac10 2023-12-18T10:24:14.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f986c04e000 con 0x7f986c0cac10 2023-12-18T10:24:14.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f98617fa640 1 -- 172.21.15.133:0/2588308071 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f985c017020 con 0x7f986c0cac10 2023-12-18T10:24:14.677 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 msgr2=0x7f9858067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9868009bb0 tx=0x7f9868008040 comp rx=0 tx=0).stop 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f986c0cac10 msgr2=0x7f986c1570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f986c0cac10 0x7f986c1570b0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f985c0011f0 tx=0x7f985c00cc00 comp rx=0 tx=0).stop 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 shutdown_connections 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9858065a60 0x7f9858067f20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f986c15a680 0x7f986c158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f986c0cac10 0x7f986c1570b0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 --2- 172.21.15.133:0/2588308071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f986c06fdb0 0x7f986c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 >> 172.21.15.133:0/2588308071 conn(0x7f986c06a3e0 msgr2=0x7f986c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 shutdown_connections 2023-12-18T10:24:14.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:14.678+0000 7f9872cf9640 1 -- 172.21.15.133:0/2588308071 wait complete. 2023-12-18T10:24:14.697 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:24:14.697 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:24:14.698 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:24:14.698 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-18T10:24:14.698 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-18T10:24:14.698 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:24:14.698 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:24:14.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:24:14.698 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:24:14.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:14.698 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:24:14.709 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41781sec preferred_lft 41781sec 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:24:14.710 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-18T10:24:14.711 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-18T10:24:14.712 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:24:14.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:14.712 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:24:14.773 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:24:14.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:14.776 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:24:14.830 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:24:14.830 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:24:14.830 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:24:14.830 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:24:14.831 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:24:14.831 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:24:14.831 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:24:14.831 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:24:14.831 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:24:14.831 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:24:14.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:14.831 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:24:14.831 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:24:14.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:24:14.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:24:14.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:24:14.832 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:24:14.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:14.921 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:24:14.930 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-18T10:24:14.931 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-18T10:24:14.931 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:24:14.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:14.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-18T10:24:14.991 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-18T10:24:14.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:24:14.991 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-18T10:24:15.044 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:24:15.044 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:24:15.044 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:24:15.099 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:24:15.160 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:24:15.160 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:24:15.222 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:24:15.223 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:24:15.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:15.224 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:24:15.279 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:24:15.280 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-18T10:24:15.326 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:24:15.348 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:24:15.348 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:24:15.411 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:24:15.412 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:24:15.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:15.413 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:24:15.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:2023-12-18T10:24:15.422+0000 7f3cb0b05580 -1 init, newargv = 0x5594163d6de0 newargc=15 2023-12-18T10:24:15.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[58681]: starting ceph client 2023-12-18T10:24:15.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[58681]: starting fuse 2023-12-18T10:24:15.431 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:24:15.431 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:24:15.431 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:24:15.432 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.0")) 2023-12-18T10:24:15.433 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:24:15.558 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.0.58681.asok 2023-12-18T10:24:15.743 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58681.asok 2023-12-18T10:24:15.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:15.743 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58681.asok status 2023-12-18T10:24:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:24:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:24:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:24:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "0", 2023-12-18T10:24:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:24:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "58681", 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 8307, 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 8307 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:24:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3227893836 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3227893836 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.8307 192.168.0.1:0/3227893836", 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/3227893836", 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 84, 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 91, 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:24:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:24:15.915 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:24:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:15.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:15.927 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:24:15.927 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-18T10:24:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:24:15.937 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-18T10:24:15.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:15.937 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:24:16.003 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-18T10:24:16.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a688c640 1 Processor -- start 2023-12-18T10:24:16.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a688c640 1 -- start start 2023-12-18T10:24:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a688c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00ceaa0 0x7f13a0070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a688c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a00c9730 con 0x7f13a0153020 2023-12-18T10:24:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a688c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a00c8e00 con 0x7f13a01598d0 2023-12-18T10:24:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a688c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00c90e0 con 0x7f13a00ceaa0 2023-12-18T10:24:16.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f139ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f13a0153020 0x7f13a00c9bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53932/0 (socket says 172.21.15.133:53932) 2023-12-18T10:24:16.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f139ffff640 1 -- 172.21.15.133:0/4015996841 learned_addr learned my addr 172.21.15.133:0/4015996841 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:16.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a4e29640 1 --2- 172.21.15.133:0/4015996841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00ceaa0 0x7f13a0070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:16.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f139effd640 1 -- 172.21.15.133:0/4015996841 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989100163 0 0) 0x7f13a00c9730 con 0x7f13a0153020 2023-12-18T10:24:16.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f139effd640 1 -- 172.21.15.133:0/4015996841 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1388003530 con 0x7f13a0153020 2023-12-18T10:24:16.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f139effd640 1 -- 172.21.15.133:0/4015996841 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370179913 0 0) 0x7f13a00c8e00 con 0x7f13a01598d0 2023-12-18T10:24:16.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f139effd640 1 -- 172.21.15.133:0/4015996841 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a00c9730 con 0x7f13a01598d0 2023-12-18T10:24:16.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a4e29640 1 -- 172.21.15.133:0/4015996841 >> v1:172.21.15.142:6789/0 conn(0x7f13a01598d0 legacy=0x7f13a00ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:16.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a4e29640 1 -- 172.21.15.133:0/4015996841 >> v1:172.21.15.133:6789/0 conn(0x7f13a0153020 legacy=0x7f13a00c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:16.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.189+0000 7f13a4e29640 1 -- 172.21.15.133:0/4015996841 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a00c93c0 con 0x7f13a00ceaa0 2023-12-18T10:24:16.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f13a4e29640 1 --2- 172.21.15.133:0/4015996841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00ceaa0 0x7f13a0070590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1398009dc0 tx=0x7f139801c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbaccfc2ce47f721 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:16.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f139effd640 1 -- 172.21.15.133:0/4015996841 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980a5850 con 0x7f13a00ceaa0 2023-12-18T10:24:16.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f139effd640 1 -- 172.21.15.133:0/4015996841 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13980a59b0 con 0x7f13a00ceaa0 2023-12-18T10:24:16.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f139effd640 1 -- 172.21.15.133:0/4015996841 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980a5d40 con 0x7f13a00ceaa0 2023-12-18T10:24:16.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f13a688c640 1 -- 172.21.15.133:0/4015996841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00ceaa0 msgr2=0x7f13a0070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:16.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f13a688c640 1 --2- 172.21.15.133:0/4015996841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00ceaa0 0x7f13a0070590 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1398009dc0 tx=0x7f139801c850 comp rx=0 tx=0).stop 2023-12-18T10:24:16.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f13a688c640 1 -- 172.21.15.133:0/4015996841 shutdown_connections 2023-12-18T10:24:16.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f13a688c640 1 --2- 172.21.15.133:0/4015996841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a00ceaa0 0x7f13a0070590 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:16.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f13a688c640 1 -- 172.21.15.133:0/4015996841 >> 172.21.15.133:0/4015996841 conn(0x7f13a006a2a0 msgr2=0x7f13a00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:16.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f13a688c640 1 -- 172.21.15.133:0/4015996841 shutdown_connections 2023-12-18T10:24:16.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.193+0000 7f13a688c640 1 -- 172.21.15.133:0/4015996841 wait complete. 2023-12-18T10:24:16.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 Processor -- start 2023-12-18T10:24:16.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 -- start start 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00ceaa0 0x7f13a0151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a0153020 0x7f13a00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a01598d0 0x7f13a0157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0155920 con 0x7f13a01598d0 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0153af0 con 0x7f13a00ceaa0 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a01f5d10 con 0x7f13a0153020 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a01598d0 0x7f13a0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a01598d0 0x7f13a0157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59176/0 (socket says 172.21.15.133:59176) 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 -- 172.21.15.133:0/1527343333 learned_addr learned my addr 172.21.15.133:0/1527343333 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f139ffff640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00ceaa0 0x7f13a0151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f139f7fe640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a0153020 0x7f13a00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:16.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 -- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a0153020 msgr2=0x7f13a00b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a0153020 0x7f13a00b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 -- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00ceaa0 msgr2=0x7f13a0151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00ceaa0 0x7f13a0151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 -- 172.21.15.133:0/1527343333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398009a70 con 0x7f13a01598d0 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f139f7fe640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a0153020 0x7f13a00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f139ffff640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00ceaa0 0x7f13a0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a4e29640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a01598d0 0x7f13a0157100 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f139801a480 tx=0x7f13980195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f139cff9640 1 -- 172.21.15.133:0/1527343333 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980b9650 con 0x7f13a01598d0 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f139cff9640 1 -- 172.21.15.133:0/1527343333 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13980b97b0 con 0x7f13a01598d0 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f139cff9640 1 -- 172.21.15.133:0/1527343333 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13980b9b20 con 0x7f13a01598d0 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a01f5ff0 con 0x7f13a01598d0 2023-12-18T10:24:16.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.197+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a0155540 con 0x7f13a01598d0 2023-12-18T10:24:16.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.201+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a01550c0 con 0x7f13a01598d0 2023-12-18T10:24:16.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.201+0000 7f139cff9640 1 -- 172.21.15.133:0/1527343333 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f13980b9c80 con 0x7f13a01598d0 2023-12-18T10:24:16.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.201+0000 7f139cff9640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f138c065a60 0x7f138c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:16.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.201+0000 7f139cff9640 1 -- 172.21.15.133:0/1527343333 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f139811e4f0 con 0x7f13a01598d0 2023-12-18T10:24:16.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.201+0000 7f139ffff640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f138c065a60 0x7f138c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:16.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.201+0000 7f139ffff640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f138c065a60 0x7f138c067f20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1390000f70 tx=0x7f1390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:16.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.205+0000 7f139cff9640 1 -- 172.21.15.133:0/1527343333 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f13a01550c0 con 0x7f13a01598d0 2023-12-18T10:24:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:16.389+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f13a0155a60 con 0x7f13a01598d0 2023-12-18T10:24:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.029+0000 7f139cff9640 1 -- 172.21.15.133:0/1527343333 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v85) v1 ==== 105+0+0 (secure 0 0 0) 0x7f13a0155a60 con 0x7f13a01598d0 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f138c065a60 msgr2=0x7f138c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f138c065a60 0x7f138c067f20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1390000f70 tx=0x7f1390009040 comp rx=0 tx=0).stop 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a01598d0 msgr2=0x7f13a0157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a01598d0 0x7f13a0157100 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f139801a480 tx=0x7f13980195f0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 shutdown_connections 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f138c065a60 0x7f138c067f20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a01598d0 0x7f13a0157100 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f13a0153020 0x7f13a00b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 --2- 172.21.15.133:0/1527343333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13a00ceaa0 0x7f13a0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 >> 172.21.15.133:0/1527343333 conn(0x7f13a006a2a0 msgr2=0x7f13a0152680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 shutdown_connections 2023-12-18T10:24:17.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.033+0000 7f13a688c640 1 -- 172.21.15.133:0/1527343333 wait complete. 2023-12-18T10:24:17.058 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.193+0000 7f08ab579640 1 Processor -- start 2023-12-18T10:24:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08ab579640 1 -- start start 2023-12-18T10:24:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08ab579640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f08a40c33d0 0x7f08a40c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08ab579640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08a40afd10 0x7f08a40b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08ab579640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a40c4550 con 0x7f08a4160bd0 2023-12-18T10:24:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08ab579640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40b06e0 con 0x7f08a40afd10 2023-12-18T10:24:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08ab579640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40c86f0 con 0x7f08a40c33d0 2023-12-18T10:24:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08aad78640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08a40afd10 0x7f08a40b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08aad78640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08a40afd10 0x7f08a40b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59178/0 (socket says 172.21.15.133:59178) 2023-12-18T10:24:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08aad78640 1 -- 172.21.15.133:0/1469880177 learned_addr learned my addr 172.21.15.133:0/1469880177 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08a9d76640 1 --2- 172.21.15.133:0/1469880177 >> v2:172.21.15.142:3300/0 conn(0x7f08a40c33d0 0x7f08a40c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08aad78640 1 -- 172.21.15.133:0/1469880177 >> v2:172.21.15.142:3300/0 conn(0x7f08a40c33d0 msgr2=0x7f08a40c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08aad78640 1 --2- 172.21.15.133:0/1469880177 >> v2:172.21.15.142:3300/0 conn(0x7f08a40c33d0 0x7f08a40c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08aad78640 1 -- 172.21.15.133:0/1469880177 >> v1:172.21.15.142:6789/0 conn(0x7f08a4160bd0 legacy=0x7f08a4165000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08aad78640 1 -- 172.21.15.133:0/1469880177 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40c4f20 con 0x7f08a40afd10 2023-12-18T10:24:17.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.197+0000 7f08a9d76640 1 --2- 172.21.15.133:0/1469880177 >> v2:172.21.15.142:3300/0 conn(0x7f08a40c33d0 0x7f08a40c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08aad78640 1 --2- 172.21.15.133:0/1469880177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a40afd10 0x7f08a40b01a0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f08a4072110 tx=0x7f089c01f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abaf224abf2ec654 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08a9575640 1 -- 172.21.15.133:0/1469880177 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0af400 con 0x7f08a40afd10 2023-12-18T10:24:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08a9575640 1 -- 172.21.15.133:0/1469880177 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c0ab050 con 0x7f08a40afd10 2023-12-18T10:24:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08a9575640 1 -- 172.21.15.133:0/1469880177 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0af780 con 0x7f08a40afd10 2023-12-18T10:24:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 -- 172.21.15.133:0/1469880177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a40afd10 msgr2=0x7f08a40b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 --2- 172.21.15.133:0/1469880177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a40afd10 0x7f08a40b01a0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f08a4072110 tx=0x7f089c01f180 comp rx=0 tx=0).stop 2023-12-18T10:24:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 -- 172.21.15.133:0/1469880177 shutdown_connections 2023-12-18T10:24:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 --2- 172.21.15.133:0/1469880177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a40afd10 0x7f08a40b01a0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 --2- 172.21.15.133:0/1469880177 >> v2:172.21.15.142:3300/0 conn(0x7f08a40c33d0 0x7f08a40c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 -- 172.21.15.133:0/1469880177 >> 172.21.15.133:0/1469880177 conn(0x7f08a40ce130 msgr2=0x7f08a40ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 -- 172.21.15.133:0/1469880177 shutdown_connections 2023-12-18T10:24:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 -- 172.21.15.133:0/1469880177 wait complete. 2023-12-18T10:24:17.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 Processor -- start 2023-12-18T10:24:17.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.201+0000 7f08ab579640 1 -- start start 2023-12-18T10:24:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08a40afd10 0x7f08a4159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08a40c33d0 0x7f08a4157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a4160bd0 0x7f08a41fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41581f0 con 0x7f08a4160bd0 2023-12-18T10:24:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4158490 con 0x7f08a40afd10 2023-12-18T10:24:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a4158770 con 0x7f08a40c33d0 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a4160bd0 0x7f08a41fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a4160bd0 0x7f08a41fa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59186/0 (socket says 172.21.15.133:59186) 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 -- 172.21.15.133:0/4192212054 learned_addr learned my addr 172.21.15.133:0/4192212054 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aa577640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08a40afd10 0x7f08a4159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08a9d76640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08a40c33d0 0x7f08a4157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 -- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08a40c33d0 msgr2=0x7f08a4157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08a40c33d0 0x7f08a4157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 -- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08a40afd10 msgr2=0x7f08a4159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08a40afd10 0x7f08a4159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 -- 172.21.15.133:0/4192212054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c009b30 con 0x7f08a4160bd0 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aa577640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08a40afd10 0x7f08a4159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08aad78640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a4160bd0 0x7f08a41fa5f0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f089c01cdb0 tx=0x7f089c01bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f089affd640 1 -- 172.21.15.133:0/4192212054 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0afdc0 con 0x7f08a4160bd0 2023-12-18T10:24:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f089affd640 1 -- 172.21.15.133:0/4192212054 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c009510 con 0x7f08a4160bd0 2023-12-18T10:24:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f089affd640 1 -- 172.21.15.133:0/4192212054 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0ba660 con 0x7f08a4160bd0 2023-12-18T10:24:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a4158a50 con 0x7f08a4160bd0 2023-12-18T10:24:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a41fa0d0 con 0x7f08a4160bd0 2023-12-18T10:24:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.205+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a41fa2c0 con 0x7f08a4160bd0 2023-12-18T10:24:17.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.209+0000 7f089affd640 1 -- 172.21.15.133:0/4192212054 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f089c0b6040 con 0x7f08a4160bd0 2023-12-18T10:24:17.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.209+0000 7f089affd640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0888065a60 0x7f0888067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:17.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.209+0000 7f089affd640 1 -- 172.21.15.133:0/4192212054 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f089c121610 con 0x7f08a4160bd0 2023-12-18T10:24:17.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.209+0000 7f08aa577640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0888065a60 0x7f0888067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:17.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.209+0000 7f08aa577640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0888065a60 0x7f0888067f20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f08a00098b0 tx=0x7f08a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:17.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.213+0000 7f089affd640 1 -- 172.21.15.133:0/4192212054 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f089c0eee90 con 0x7f08a4160bd0 2023-12-18T10:24:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.393+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08a404e850 con 0x7f08a4160bd0 2023-12-18T10:24:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.393+0000 7f089affd640 1 -- 172.21.15.133:0/4192212054 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f089c0f24b0 con 0x7f08a4160bd0 2023-12-18T10:24:17.394 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:17.395 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8109,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:17.032743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":8127,"mds_1":8118},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:creating","state_seq":1,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 86 2023-12-18T10:24:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0888065a60 msgr2=0x7f0888067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0888065a60 0x7f0888067f20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f08a00098b0 tx=0x7f08a0008040 comp rx=0 tx=0).stop 2023-12-18T10:24:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a4160bd0 msgr2=0x7f08a41fa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a4160bd0 0x7f08a41fa5f0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f089c01cdb0 tx=0x7f089c01bf20 comp rx=0 tx=0).stop 2023-12-18T10:24:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 shutdown_connections 2023-12-18T10:24:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0888065a60 0x7f0888067f20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08a4160bd0 0x7f08a41fa5f0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08a40c33d0 0x7f08a4157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 --2- 172.21.15.133:0/4192212054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08a40afd10 0x7f08a4159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 >> 172.21.15.133:0/4192212054 conn(0x7f08a40ce130 msgr2=0x7f08a40af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 shutdown_connections 2023-12-18T10:24:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:17.397+0000 7f08ab579640 1 -- 172.21.15.133:0/4192212054 wait complete. 2023-12-18T10:24:17.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:24:03.649144+0000', 'modified': '2023-12-18T10:24:17.032743+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 8127, 'mds_1': 8118}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8118': {'gid': 8118, 'name': 'b', 'rank': 1, 'incarnation': 86, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.142:6835/4118520914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 4118520914}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 4118520914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8127': {'gid': 8127, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2531300469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2531300469}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2531300469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:24:17.817 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8118:up:creating 2023-12-18T10:24:18.819 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:18.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b6398640 1 Processor -- start 2023-12-18T10:24:18.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b6398640 1 -- start start 2023-12-18T10:24:18.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b6398640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7b015ca40 0x7fd7b00cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:18.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b6398640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7b00cf7e0 0x7fd7b01668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:18.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b6398640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00d11c0 con 0x7fd7b00ce3f0 2023-12-18T10:24:18.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b6398640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b00d0310 con 0x7fd7b00cf7e0 2023-12-18T10:24:18.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b6398640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b00d05b0 con 0x7fd7b015ca40 2023-12-18T10:24:18.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b4935640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7b00cf7e0 0x7fd7b01668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b4935640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7b00cf7e0 0x7fd7b01668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59188/0 (socket says 172.21.15.133:59188) 2023-12-18T10:24:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b4935640 1 -- 172.21.15.133:0/793100853 learned_addr learned my addr 172.21.15.133:0/793100853 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7affff640 1 --2- 172.21.15.133:0/793100853 >> v2:172.21.15.142:3300/0 conn(0x7fd7b015ca40 0x7fd7b00cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b4935640 1 -- 172.21.15.133:0/793100853 >> v2:172.21.15.142:3300/0 conn(0x7fd7b015ca40 msgr2=0x7fd7b00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b4935640 1 --2- 172.21.15.133:0/793100853 >> v2:172.21.15.142:3300/0 conn(0x7fd7b015ca40 0x7fd7b00cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b4935640 1 -- 172.21.15.133:0/793100853 >> v1:172.21.15.142:6789/0 conn(0x7fd7b00ce3f0 legacy=0x7fd7b00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7b4935640 1 -- 172.21.15.133:0/793100853 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00d0890 con 0x7fd7b00cf7e0 2023-12-18T10:24:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.965+0000 7fd7affff640 1 --2- 172.21.15.133:0/793100853 >> v2:172.21.15.142:3300/0 conn(0x7fd7b015ca40 0x7fd7b00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b4935640 1 --2- 172.21.15.133:0/793100853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b00cf7e0 0x7fd7b01668e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00736e0 tx=0x7fd7a801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a852d2fb0c3d9c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:18.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7aeffd640 1 -- 172.21.15.133:0/793100853 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80a5850 con 0x7fd7b00cf7e0 2023-12-18T10:24:18.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7aeffd640 1 -- 172.21.15.133:0/793100853 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a80a59b0 con 0x7fd7b00cf7e0 2023-12-18T10:24:18.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7aeffd640 1 -- 172.21.15.133:0/793100853 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80a5d40 con 0x7fd7b00cf7e0 2023-12-18T10:24:18.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b6398640 1 -- 172.21.15.133:0/793100853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b00cf7e0 msgr2=0x7fd7b01668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:18.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b6398640 1 --2- 172.21.15.133:0/793100853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b00cf7e0 0x7fd7b01668e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00736e0 tx=0x7fd7a801c990 comp rx=0 tx=0).stop 2023-12-18T10:24:18.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b6398640 1 -- 172.21.15.133:0/793100853 shutdown_connections 2023-12-18T10:24:18.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b6398640 1 --2- 172.21.15.133:0/793100853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b00cf7e0 0x7fd7b01668e0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:18.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b6398640 1 --2- 172.21.15.133:0/793100853 >> v2:172.21.15.142:3300/0 conn(0x7fd7b015ca40 0x7fd7b00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:18.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b6398640 1 -- 172.21.15.133:0/793100853 >> 172.21.15.133:0/793100853 conn(0x7fd7b0089fb0 msgr2=0x7fd7b00d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:18.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b6398640 1 -- 172.21.15.133:0/793100853 shutdown_connections 2023-12-18T10:24:18.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.969+0000 7fd7b6398640 1 -- 172.21.15.133:0/793100853 wait complete. 2023-12-18T10:24:18.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 Processor -- start 2023-12-18T10:24:18.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 -- start start 2023-12-18T10:24:18.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7b00ce3f0 0x7fd7b01551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:18.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7b00cf7e0 0x7fd7b01541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:18.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b015ca40 0x7fd7b015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00c9f00 con 0x7fd7b015ca40 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b0155810 con 0x7fd7b00ce3f0 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b0155af0 con 0x7fd7b00cf7e0 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b015ca40 0x7fd7b015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b015ca40 0x7fd7b015b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59190/0 (socket says 172.21.15.133:59190) 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 -- 172.21.15.133:0/65688850 learned_addr learned my addr 172.21.15.133:0/65688850 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7affff640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7b00ce3f0 0x7fd7b01551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7af7fe640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7b00cf7e0 0x7fd7b01541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:18.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 -- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7b00cf7e0 msgr2=0x7fd7b01541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:18.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7b00cf7e0 0x7fd7b01541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:18.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 -- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7b00ce3f0 msgr2=0x7fd7b01551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:18.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7b00ce3f0 0x7fd7b01551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:18.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 -- 172.21.15.133:0/65688850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8009b30 con 0x7fd7b015ca40 2023-12-18T10:24:18.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7affff640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7b00ce3f0 0x7fd7b01551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:18.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b4935640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b015ca40 0x7fd7b015b380 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80af040 tx=0x7fd7a8019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:18.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7acff9640 1 -- 172.21.15.133:0/65688850 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80b8670 con 0x7fd7b015ca40 2023-12-18T10:24:18.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7acff9640 1 -- 172.21.15.133:0/65688850 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a80b87d0 con 0x7fd7b015ca40 2023-12-18T10:24:18.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b00c98b0 con 0x7fd7b015ca40 2023-12-18T10:24:18.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7acff9640 1 -- 172.21.15.133:0/65688850 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80b8b80 con 0x7fd7b015ca40 2023-12-18T10:24:18.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.973+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b015b8c0 con 0x7fd7b015ca40 2023-12-18T10:24:18.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.977+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b004e000 con 0x7fd7b015ca40 2023-12-18T10:24:18.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.977+0000 7fd7acff9640 1 -- 172.21.15.133:0/65688850 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd7a80b8ce0 con 0x7fd7b015ca40 2023-12-18T10:24:18.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.977+0000 7fd7acff9640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd79c065a60 0x7fd79c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:18.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.977+0000 7fd7acff9640 1 -- 172.21.15.133:0/65688850 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd7a811e870 con 0x7fd7b015ca40 2023-12-18T10:24:18.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.977+0000 7fd7affff640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd79c065a60 0x7fd79c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:18.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.977+0000 7fd7affff640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd79c065a60 0x7fd79c067f20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000a990 tx=0x7fd7a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:18.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:18.981+0000 7fd7acff9640 1 -- 172.21.15.133:0/65688850 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd7a80ec1a0 con 0x7fd7b015ca40 2023-12-18T10:24:19.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7b00ca040 con 0x7fd7b015ca40 2023-12-18T10:24:19.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7acff9640 1 -- 172.21.15.133:0/65688850 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fd7a80ef7c0 con 0x7fd7b015ca40 2023-12-18T10:24:19.169 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:19.170 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:19.048222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:19.170 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 89 2023-12-18T10:24:19.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd79c065a60 msgr2=0x7fd79c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd79c065a60 0x7fd79c067f20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000a990 tx=0x7fd7a0008040 comp rx=0 tx=0).stop 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b015ca40 msgr2=0x7fd7b015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b015ca40 0x7fd7b015b380 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80af040 tx=0x7fd7a8019730 comp rx=0 tx=0).stop 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 shutdown_connections 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd79c065a60 0x7fd79c067f20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7b015ca40 0x7fd7b015b380 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd7b00cf7e0 0x7fd7b01541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 --2- 172.21.15.133:0/65688850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7b00ce3f0 0x7fd7b01551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 >> 172.21.15.133:0/65688850 conn(0x7fd7b0089fb0 msgr2=0x7fd7b00b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 shutdown_connections 2023-12-18T10:24:19.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.169+0000 7fd7b6398640 1 -- 172.21.15.133:0/65688850 wait complete. 2023-12-18T10:24:19.594 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:24:03.649144+0000', 'modified': '2023-12-18T10:24:19.048222+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 8127, 'mds_1': 8118, 'mds_2': 8109}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8109': {'gid': 8109, 'name': 'c', 'rank': 2, 'incarnation': 88, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.133:6835/1695888167', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1695888167}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1695888167}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8118': {'gid': 8118, 'name': 'b', 'rank': 1, 'incarnation': 86, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.142:6835/4118520914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 4118520914}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 4118520914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8127': {'gid': 8127, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2531300469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2531300469}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2531300469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:24:19.594 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-18T10:24:19.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-18T10:24:19.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e96196640 1 Processor -- start 2023-12-18T10:24:19.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e96196640 1 -- start start 2023-12-18T10:24:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e96196640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e9015a680 0x7f1e9015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e96196640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e9006fdb0 0x7f1e90070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e96196640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9015f100 con 0x7f1e900cac10 2023-12-18T10:24:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e96196640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e90070780 con 0x7f1e9015a680 2023-12-18T10:24:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e96196640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e900ca7d0 con 0x7f1e9006fdb0 2023-12-18T10:24:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8effd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1e900cac10 0x7f1e9015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53940/0 (socket says 172.21.15.133:53940) 2023-12-18T10:24:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e9015a680 0x7f1e9015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8effd640 1 -- 172.21.15.133:0/1934061608 learned_addr learned my addr 172.21.15.133:0/1934061608 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/1934061608 >> v2:172.21.15.142:3300/0 conn(0x7f1e9006fdb0 0x7f1e90070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8e7fc640 1 -- 172.21.15.133:0/1934061608 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622865257 0 0) 0x7f1e9015f100 con 0x7f1e900cac10 2023-12-18T10:24:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8e7fc640 1 -- 172.21.15.133:0/1934061608 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e78003530 con 0x7f1e900cac10 2023-12-18T10:24:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8f7fe640 1 -- 172.21.15.133:0/1934061608 >> v2:172.21.15.142:3300/0 conn(0x7f1e9006fdb0 msgr2=0x7f1e90070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/1934061608 >> v2:172.21.15.142:3300/0 conn(0x7f1e9006fdb0 0x7f1e90070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8f7fe640 1 -- 172.21.15.133:0/1934061608 >> v1:172.21.15.133:6789/0 conn(0x7f1e900cac10 legacy=0x7f1e9015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.741+0000 7f1e8f7fe640 1 -- 172.21.15.133:0/1934061608 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9015e860 con 0x7f1e9015a680 2023-12-18T10:24:19.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/1934061608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e9015e160 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009d90 tx=0x7f1e8001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d50009d0982a65 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e8e7fc640 1 -- 172.21.15.133:0/1934061608 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800a5940 con 0x7f1e9015a680 2023-12-18T10:24:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e8e7fc640 1 -- 172.21.15.133:0/1934061608 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e800a5aa0 con 0x7f1e9015a680 2023-12-18T10:24:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e8e7fc640 1 -- 172.21.15.133:0/1934061608 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800a5e30 con 0x7f1e9015a680 2023-12-18T10:24:19.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e96196640 1 -- 172.21.15.133:0/1934061608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 msgr2=0x7f1e9015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e96196640 1 --2- 172.21.15.133:0/1934061608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e9015e160 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009d90 tx=0x7f1e8001c880 comp rx=0 tx=0).stop 2023-12-18T10:24:19.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e96196640 1 -- 172.21.15.133:0/1934061608 shutdown_connections 2023-12-18T10:24:19.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e96196640 1 --2- 172.21.15.133:0/1934061608 >> v2:172.21.15.142:3300/0 conn(0x7f1e9006fdb0 0x7f1e90070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e96196640 1 --2- 172.21.15.133:0/1934061608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e9015e160 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e96196640 1 -- 172.21.15.133:0/1934061608 >> 172.21.15.133:0/1934061608 conn(0x7f1e9006a3e0 msgr2=0x7f1e900afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e96196640 1 -- 172.21.15.133:0/1934061608 shutdown_connections 2023-12-18T10:24:19.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.745+0000 7f1e96196640 1 -- 172.21.15.133:0/1934061608 wait complete. 2023-12-18T10:24:19.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 Processor -- start 2023-12-18T10:24:19.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 -- start start 2023-12-18T10:24:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e9006fdb0 0x7f1e900acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e900cac10 0x7f1e90151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e90151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900ad400 con 0x7f1e9015a680 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900cc4a0 con 0x7f1e9006fdb0 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e900ac3e0 con 0x7f1e900cac10 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e90151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e90151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59222/0 (socket says 172.21.15.133:59222) 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 -- 172.21.15.133:0/2032965670 learned_addr learned my addr 172.21.15.133:0/2032965670 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8effd640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e900cac10 0x7f1e90151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e9006fdb0 0x7f1e900acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 -- 172.21.15.133:0/2032965670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e900cac10 msgr2=0x7f1e90151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e900cac10 0x7f1e90151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 -- 172.21.15.133:0/2032965670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e9006fdb0 msgr2=0x7f1e900acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e9006fdb0 0x7f1e900acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 -- 172.21.15.133:0/2032965670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e80009a70 con 0x7f1e9015a680 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e90151880 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800d560 tx=0x7f1e8800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e77fff640 1 -- 172.21.15.133:0/2032965670 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880125f0 con 0x7f1e9015a680 2023-12-18T10:24:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e77fff640 1 -- 172.21.15.133:0/2032965670 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e88012770 con 0x7f1e9015a680 2023-12-18T10:24:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e77fff640 1 -- 172.21.15.133:0/2032965670 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88012b20 con 0x7f1e9015a680 2023-12-18T10:24:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 -- 172.21.15.133:0/2032965670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e900ac6c0 con 0x7f1e9015a680 2023-12-18T10:24:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.749+0000 7f1e96196640 1 -- 172.21.15.133:0/2032965670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e900cc780 con 0x7f1e9015a680 2023-12-18T10:24:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e77fff640 1 -- 172.21.15.133:0/2032965670 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e88012c80 con 0x7f1e9015a680 2023-12-18T10:24:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e77fff640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e7c065a60 0x7f1e7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e77fff640 1 -- 172.21.15.133:0/2032965670 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e880837a0 con 0x7f1e9015a680 2023-12-18T10:24:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e7c065a60 0x7f1e7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e994e5000 1 Processor -- start 2023-12-18T10:24:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e994e5000 1 -- start start 2023-12-18T10:24:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e7c065a60 0x7f1e7c067f20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1e800af000 tx=0x7f1e800a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c19b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 0x55b43c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 0x55b43c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e994e5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43bf74c90 con 0x55b43c19b070 2023-12-18T10:24:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e994e5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43bfa6220 con 0x55b43c1511c0 2023-12-18T10:24:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e994e5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b43bfa37f0 con 0x55b43c19b990 2023-12-18T10:24:19.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e8f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c19b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e8f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c19b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59224/0 (socket says 172.21.15.133:59224) 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e8f7fe640 1 -- 172.21.15.133:0/2138591204 learned_addr learned my addr 172.21.15.133:0/2138591204 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 0x55b43c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.753+0000 7f1e8effd640 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 0x55b43c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8f7fe640 1 -- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 msgr2=0x55b43c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 0x55b43c150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8f7fe640 1 -- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 msgr2=0x55b43c1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 0x55b43c1515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8f7fe640 1 -- 172.21.15.133:0/2138591204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b43bc9b890 con 0x55b43c19b070 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8effd640 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 0x55b43c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c19b450 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f1e80000f90 tx=0x7f1e80004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc66daa1379ef7b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e75ffb640 1 -- 172.21.15.133:0/2138591204 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800b8bd0 con 0x55b43c19b070 2023-12-18T10:24:19.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e75ffb640 1 -- 172.21.15.133:0/2138591204 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e800b8d30 con 0x55b43c19b070 2023-12-18T10:24:19.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e75ffb640 1 -- 172.21.15.133:0/2138591204 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800b8ea0 con 0x55b43c19b070 2023-12-18T10:24:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- 172.21.15.133:0/2138591204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 msgr2=0x55b43c19b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c19b450 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f1e80000f90 tx=0x7f1e80004ac0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- 172.21.15.133:0/2138591204 shutdown_connections 2023-12-18T10:24:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 0x55b43c1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 0x55b43c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 --2- 172.21.15.133:0/2138591204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c19b450 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- 172.21.15.133:0/2138591204 >> 172.21.15.133:0/2138591204 conn(0x55b43c157950 msgr2=0x55b43c14f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- 172.21.15.133:0/2138591204 shutdown_connections 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- 172.21.15.133:0/2138591204 wait complete. 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- start start 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 Processor -- start 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b990 0x55b43c189030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43bf9f0e0 con 0x55b43c19b070 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43bf3e310 con 0x55b43c19b990 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b43bf5c770 con 0x55b43c1511c0 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e994e5000 10 client.0 _ll_register_callbacks cb 0x55b43c13cb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1a2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59234/0 (socket says 172.21.15.133:59234) 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8effd640 1 -- 172.21.15.133:0/495367333 learned_addr learned my addr 172.21.15.133:0/495367333 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.757+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b990 0x55b43c189030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8effd640 1 -- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 msgr2=0x55b43c1a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8effd640 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8effd640 1 -- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b990 msgr2=0x55b43c189030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8effd640 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b990 0x55b43c189030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8effd640 1 -- 172.21.15.133:0/495367333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9015e860 con 0x55b43c19b070 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8effd640 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1a2d30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f1e840074a0 tx=0x7f1e840015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9315495be8b3ab02 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/495367333 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840077a0 con 0x55b43c19b070 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/495367333 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e84016c50 con 0x55b43c19b070 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 -- 172.21.15.133:0/495367333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b43bf6ec10 con 0x55b43c19b070 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/495367333 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e84016e10 con 0x55b43c19b070 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 10 client.8340 fetch_fsmap learned FSMap version 89 2023-12-18T10:24:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 -- 172.21.15.133:0/495367333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55b43bf64260 con 0x55b43c19b070 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/495367333 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b43bf6ec10 con 0x55b43c19b070 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/495367333 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 89) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f1e840143c0 con 0x55b43c19b070 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 10 client.8340 fetch_fsmap finished waiting for FSMap version 89 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 10 client.8340 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 20 client.8340 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x55b43c189da0 0x55b43c18a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 4 client.8340 mds_command: new command op to 8109 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 -- 172.21.15.133:0/495367333 --> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b43bf9da30 con 0x55b43c189da0 2023-12-18T10:24:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x55b43c189da0 0x55b43c18a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x55b43c189da0 0x55b43c18a180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f133bad8319453fc server_cookie=afc78d736d13bf62 in_seq=0 out_seq=0 2023-12-18T10:24:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 10 client.8340 ms_handle_connect on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/495367333 <== mds.2 v2:172.21.15.133:6834/1695888167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b43bf9da30 con 0x55b43c189da0 2023-12-18T10:24:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 10 client.8340 handle_command_reply: tid=0 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 client.8340 shutdown 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 -- 172.21.15.133:0/495367333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 msgr2=0x55b43c1a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1a2d30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f1e840074a0 tx=0x7f1e840015f0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 -- 172.21.15.133:0/495367333 shutdown_connections 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x55b43c189da0 0x55b43c18a180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b990 0x55b43c189030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e6e7fc640 0 client.8340 ms_handle_reset on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1a2d30 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 --2- 172.21.15.133:0/495367333 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 -- 172.21.15.133:0/495367333 >> 172.21.15.133:0/495367333 conn(0x55b43c157950 msgr2=0x55b43c14fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 -- 172.21.15.133:0/495367333 shutdown_connections 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 1 -- 172.21.15.133:0/495367333 wait complete. 2023-12-18T10:24:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.761+0000 7f1e994e5000 20 client.8340 trim_cache size 0 max 16384 2023-12-18T10:24:19.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e994e5000 1 Processor -- start 2023-12-18T10:24:19.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e994e5000 1 -- start start 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 0x55b43c1f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1f3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 0x55b43c1f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e994e5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43c1571b0 con 0x55b43c19b070 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e994e5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43bc5c940 con 0x55b43c1511c0 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e994e5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b43bf6ca80 con 0x55b43c19b990 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1f3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59242/0 (socket says 172.21.15.133:59242) 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 -- 172.21.15.133:0/3174695312 learned_addr learned my addr 172.21.15.133:0/3174695312 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 -- 172.21.15.133:0/3174695312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 msgr2=0x55b43c1f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 --2- 172.21.15.133:0/3174695312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 0x55b43c1f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 -- 172.21.15.133:0/3174695312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 msgr2=0x55b43c1f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 --2- 172.21.15.133:0/3174695312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 0x55b43c1f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 -- 172.21.15.133:0/3174695312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b43bf4a3b0 con 0x55b43c19b070 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e8effd640 1 --2- 172.21.15.133:0/3174695312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1f3830 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1e840011f0 tx=0x7f1e84010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938e2e09e8aacfca server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e767fc640 1 -- 172.21.15.133:0/3174695312 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84001af0 con 0x55b43c19b070 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e767fc640 1 -- 172.21.15.133:0/3174695312 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e84014920 con 0x55b43c19b070 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.777+0000 7f1e767fc640 1 -- 172.21.15.133:0/3174695312 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84020e20 con 0x55b43c19b070 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- 172.21.15.133:0/3174695312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 msgr2=0x55b43c1f3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 --2- 172.21.15.133:0/3174695312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1f3830 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1e840011f0 tx=0x7f1e84010000 comp rx=0 tx=0).stop 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- 172.21.15.133:0/3174695312 shutdown_connections 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 --2- 172.21.15.133:0/3174695312 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c19b990 0x55b43c1f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 --2- 172.21.15.133:0/3174695312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b070 0x55b43c1f3830 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 --2- 172.21.15.133:0/3174695312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c1511c0 0x55b43c1f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- 172.21.15.133:0/3174695312 >> 172.21.15.133:0/3174695312 conn(0x55b43c157950 msgr2=0x55b43c1a8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- 172.21.15.133:0/3174695312 shutdown_connections 2023-12-18T10:24:19.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- 172.21.15.133:0/3174695312 wait complete. 2023-12-18T10:24:19.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- start start 2023-12-18T10:24:19.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 Processor -- start 2023-12-18T10:24:19.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1dc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b070 0x55b43c1dc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b990 0x55b43c1dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43bf44770 con 0x55b43c19b990 2023-12-18T10:24:19.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b43bfa0670 con 0x55b43c19b070 2023-12-18T10:24:19.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b43bfe2ce0 con 0x55b43c1511c0 2023-12-18T10:24:19.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 10 client.0 _ll_register_callbacks cb 0x55b43bf4d640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b990 0x55b43c1dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b990 0x55b43c1dcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59254/0 (socket says 172.21.15.133:59254) 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 -- 172.21.15.133:0/155478352 learned_addr learned my addr 172.21.15.133:0/155478352 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1dc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8effd640 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b070 0x55b43c1dc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 -- 172.21.15.133:0/155478352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 msgr2=0x55b43c1dc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1dc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 -- 172.21.15.133:0/155478352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b070 msgr2=0x55b43c1dc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b070 0x55b43c1dc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 -- 172.21.15.133:0/155478352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b43bf64260 con 0x55b43c19b990 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e8ffff640 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b990 0x55b43c1dcde0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800dfd0 tx=0x7f1e88054940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388ce3f87166222 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/155478352 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88058b00 con 0x55b43c19b990 2023-12-18T10:24:19.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/155478352 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e8805ccb0 con 0x55b43c19b990 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- 172.21.15.133:0/155478352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b43bf64e00 con 0x55b43c19b990 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/155478352 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e8806c100 con 0x55b43c19b990 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 10 client.8346 fetch_fsmap learned FSMap version 89 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 1 -- 172.21.15.133:0/155478352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55b43bc9bcc0 con 0x55b43c19b990 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/155478352 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b43bf64e00 con 0x55b43c19b990 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/155478352 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 89) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f1e880541c0 con 0x55b43c19b990 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 10 client.8346 fetch_fsmap finished waiting for FSMap version 89 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 10 client.8346 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.781+0000 7f1e994e5000 20 client.8346 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x55b43c1dd320 0x55b43c200590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 4 client.8346 mds_command: new command op to 8109 tid=0[{"prefix": "status"}] 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 -- 172.21.15.133:0/155478352 --> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b43bf98160 con 0x55b43c1dd320 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x55b43c1dd320 0x55b43c200590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e8f7fe640 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x55b43c1dd320 0x55b43c200590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6953d4ba5818600c server_cookie=8719b1013304cf0 in_seq=0 out_seq=0 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e6e7fc640 10 client.8346 ms_handle_connect on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e6e7fc640 1 -- 172.21.15.133:0/155478352 <== mds.2 v2:172.21.15.133:6834/1695888167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55b43bf98160 con 0x55b43c1dd320 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e6e7fc640 10 client.8346 handle_command_reply: tid=0 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 client.8346 shutdown 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 -- 172.21.15.133:0/155478352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b990 msgr2=0x55b43c1dcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b990 0x55b43c1dcde0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800dfd0 tx=0x7f1e88054940 comp rx=0 tx=0).stop 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 -- 172.21.15.133:0/155478352 shutdown_connections 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x55b43c1dd320 0x55b43c200590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b43c19b990 0x55b43c1dcde0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b43c19b070 0x55b43c1dc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e6e7fc640 0 client.8346 ms_handle_reset on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 --2- 172.21.15.133:0/155478352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b43c1511c0 0x55b43c1dc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 -- 172.21.15.133:0/155478352 >> 172.21.15.133:0/155478352 conn(0x55b43c157950 msgr2=0x55b43c186180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 -- 172.21.15.133:0/155478352 shutdown_connections 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 1 -- 172.21.15.133:0/155478352 wait complete. 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e994e5000 20 client.8346 trim_cache size 0 max 16384 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 2, 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 8109, 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 1.738209933, 2023-12-18T10:24:19.789 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 89, 2023-12-18T10:24:19.790 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 91, 2023-12-18T10:24:19.790 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 91, 2023-12-18T10:24:19.790 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 26.533981678 2023-12-18T10:24:19.790 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:19.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 -- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e7c065a60 msgr2=0x7f1e7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e7c065a60 0x7f1e7c067f20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1e800af000 tx=0x7f1e800a7070 comp rx=0 tx=0).stop 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 -- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 msgr2=0x7f1e90151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e90151880 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800d560 tx=0x7f1e8800da20 comp rx=0 tx=0).stop 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 -- 172.21.15.133:0/2032965670 shutdown_connections 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e7c065a60 0x7f1e7c067f20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9015a680 0x7f1e90151880 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e900cac10 0x7f1e90151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 --2- 172.21.15.133:0/2032965670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e9006fdb0 0x7f1e900acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 -- 172.21.15.133:0/2032965670 >> 172.21.15.133:0/2032965670 conn(0x7f1e9006a3e0 msgr2=0x7f1e9015c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 -- 172.21.15.133:0/2032965670 shutdown_connections 2023-12-18T10:24:19.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.785+0000 7f1e96196640 1 -- 172.21.15.133:0/2032965670 wait complete. 2023-12-18T10:24:19.804 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-18T10:24:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.941+0000 7f2e4ff8f640 1 Processor -- start 2023-12-18T10:24:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.941+0000 7f2e4ff8f640 1 -- start start 2023-12-18T10:24:19.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.941+0000 7f2e4ff8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e4815a680 0x7f2e4815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.941+0000 7f2e4ff8f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e4806fdb0 0x7f2e48070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.941+0000 7f2e4ff8f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4815f100 con 0x7f2e480cac10 2023-12-18T10:24:19.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.941+0000 7f2e4ff8f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e48070780 con 0x7f2e4806fdb0 2023-12-18T10:24:19.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.941+0000 7f2e4ff8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480ca7d0 con 0x7f2e4815a680 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4d52a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e480cac10 0x7f2e4815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37382/0 (socket says 172.21.15.133:37382) 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4d52a640 1 -- 172.21.15.133:0/1315234645 learned_addr learned my addr 172.21.15.133:0/1315234645 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/1315234645 >> v2:172.21.15.142:3300/0 conn(0x7f2e4806fdb0 0x7f2e48070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/1315234645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e4815a680 0x7f2e4815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4cd29640 1 -- 172.21.15.133:0/1315234645 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920580435 0 0) 0x7f2e4815f100 con 0x7f2e480cac10 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4cd29640 1 -- 172.21.15.133:0/1315234645 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e34003530 con 0x7f2e480cac10 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4e52c640 1 -- 172.21.15.133:0/1315234645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e4815a680 msgr2=0x7f2e4815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/1315234645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e4815a680 0x7f2e4815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4e52c640 1 -- 172.21.15.133:0/1315234645 >> v1:172.21.15.133:6789/0 conn(0x7f2e480cac10 legacy=0x7f2e4815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4e52c640 1 -- 172.21.15.133:0/1315234645 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4815e860 con 0x7f2e4806fdb0 2023-12-18T10:24:19.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/1315234645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4806fdb0 0x7f2e48070240 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009d90 tx=0x7f2e4001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=624eb08a2f1752f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4cd29640 1 -- 172.21.15.133:0/1315234645 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400a5980 con 0x7f2e4806fdb0 2023-12-18T10:24:19.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4cd29640 1 -- 172.21.15.133:0/1315234645 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e400a5ae0 con 0x7f2e4806fdb0 2023-12-18T10:24:19.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.945+0000 7f2e4cd29640 1 -- 172.21.15.133:0/1315234645 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400a5e50 con 0x7f2e4806fdb0 2023-12-18T10:24:19.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/1315234645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4806fdb0 msgr2=0x7f2e48070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/1315234645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4806fdb0 0x7f2e48070240 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009d90 tx=0x7f2e4001c8c0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/1315234645 shutdown_connections 2023-12-18T10:24:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/1315234645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4806fdb0 0x7f2e48070240 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/1315234645 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e4815a680 0x7f2e4815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/1315234645 >> 172.21.15.133:0/1315234645 conn(0x7f2e4806a3e0 msgr2=0x7f2e480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/1315234645 shutdown_connections 2023-12-18T10:24:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/1315234645 wait complete. 2023-12-18T10:24:19.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 Processor -- start 2023-12-18T10:24:19.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- start start 2023-12-18T10:24:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e4806fdb0 0x7f2e480af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e480cac10 0x7f2e4806c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4815a680 0x7f2e48151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48158170 con 0x7f2e4806fdb0 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48158450 con 0x7f2e4815a680 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4ff8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48149410 con 0x7f2e480cac10 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4dd2b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e4806fdb0 0x7f2e480af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4dd2b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e4806fdb0 0x7f2e480af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40958/0 (socket says 172.21.15.133:40958) 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.949+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/3654134375 learned_addr learned my addr 172.21.15.133:0/3654134375 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/3654134375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e480cac10 msgr2=0x7f2e4806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e480cac10 0x7f2e4806c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/3654134375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4815a680 msgr2=0x7f2e48151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4815a680 0x7f2e48151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/3654134375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40009a70 con 0x7f2e4806fdb0 2023-12-18T10:24:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e4806fdb0 0x7f2e480af420 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400e930 tx=0x7f2e4400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e3e7fc640 1 -- 172.21.15.133:0/3654134375 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400ca00 con 0x7f2e4806fdb0 2023-12-18T10:24:19.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e3e7fc640 1 -- 172.21.15.133:0/3654134375 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4400cb60 con 0x7f2e4806fdb0 2023-12-18T10:24:19.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e3e7fc640 1 -- 172.21.15.133:0/3654134375 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44013470 con 0x7f2e4806fdb0 2023-12-18T10:24:19.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/3654134375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e481496f0 con 0x7f2e4806fdb0 2023-12-18T10:24:19.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/3654134375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e480c6ab0 con 0x7f2e4806fdb0 2023-12-18T10:24:19.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.953+0000 7f2e3e7fc640 1 -- 172.21.15.133:0/3654134375 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2e440135d0 con 0x7f2e4806fdb0 2023-12-18T10:24:19.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e3e7fc640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e2c065a60 0x7f2e2c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e3e7fc640 1 -- 172.21.15.133:0/3654134375 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e440835a0 con 0x7f2e4806fdb0 2023-12-18T10:24:19.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e2c065a60 0x7f2e2c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 Processor -- start 2023-12-18T10:24:19.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- start start 2023-12-18T10:24:19.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e2c065a60 0x7f2e2c067f20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2e38007fd0 tx=0x7f2e38007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c43b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c4368c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c418cc90 con 0x55c7c43691c0 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c41be220 con 0x55c7c43b3070 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7c41bb7f0 con 0x55c7c43b3990 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40962/0 (socket says 172.21.15.133:40962) 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 -- 172.21.15.133:0/1499855673 learned_addr learned my addr 172.21.15.133:0/1499855673 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c43b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c4368c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 -- 172.21.15.133:0/1499855673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 msgr2=0x55c7c4368c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c4368c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 -- 172.21.15.133:0/1499855673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 msgr2=0x55c7c43b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c43b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 -- 172.21.15.133:0/1499855673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7c3eb3890 con 0x55c7c43691c0 2023-12-18T10:24:19.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43695a0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f2e4001a4f0 tx=0x7f2e40004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b362f52980bd49 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e2b7fe640 1 -- 172.21.15.133:0/1499855673 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400a5980 con 0x55c7c43691c0 2023-12-18T10:24:19.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e2b7fe640 1 -- 172.21.15.133:0/1499855673 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e400039a0 con 0x55c7c43691c0 2023-12-18T10:24:19.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e2b7fe640 1 -- 172.21.15.133:0/1499855673 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40003d70 con 0x55c7c43691c0 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- 172.21.15.133:0/1499855673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 msgr2=0x55c7c43695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43695a0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f2e4001a4f0 tx=0x7f2e40004a50 comp rx=0 tx=0).stop 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- 172.21.15.133:0/1499855673 shutdown_connections 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43695a0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c4368c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1499855673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c43b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- 172.21.15.133:0/1499855673 >> 172.21.15.133:0/1499855673 conn(0x55c7c436f950 msgr2=0x55c7c4367560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- 172.21.15.133:0/1499855673 shutdown_connections 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.957+0000 7f2e532ee000 1 -- 172.21.15.133:0/1499855673 wait complete. 2023-12-18T10:24:19.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 -- start start 2023-12-18T10:24:19.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 Processor -- start 2023-12-18T10:24:19.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43691c0 0x55c7c43ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43b3070 0x55c7c43bad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c43a1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c41b70e0 con 0x55c7c43b3070 2023-12-18T10:24:19.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c4156310 con 0x55c7c43691c0 2023-12-18T10:24:19.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7c4174770 con 0x55c7c43b3990 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 10 client.0 _ll_register_callbacks cb 0x55c7c4354b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43b3070 0x55c7c43bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43b3070 0x55c7c43bad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40968/0 (socket says 172.21.15.133:40968) 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 -- 172.21.15.133:0/1094317869 learned_addr learned my addr 172.21.15.133:0/1094317869 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43691c0 0x55c7c43ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c43a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 -- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 msgr2=0x55c7c43a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c43a1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 -- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43691c0 msgr2=0x55c7c43ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43691c0 0x55c7c43ba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 -- 172.21.15.133:0/1094317869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4815e860 con 0x55c7c43b3070 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43b3070 0x55c7c43bad30 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f2e4815d640 tx=0x7f2e38000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c23aac6a2b4fa1b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e28ff9640 1 -- 172.21.15.133:0/1094317869 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3801b050 con 0x55c7c43b3070 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 -- 172.21.15.133:0/1094317869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7c4186c10 con 0x55c7c43b3070 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e28ff9640 1 -- 172.21.15.133:0/1094317869 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e38021660 con 0x55c7c43b3070 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e28ff9640 1 -- 172.21.15.133:0/1094317869 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e38021820 con 0x55c7c43b3070 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 10 client.8358 fetch_fsmap learned FSMap version 89 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 -- 172.21.15.133:0/1094317869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55c7c417c260 con 0x55c7c43b3070 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e28ff9640 1 -- 172.21.15.133:0/1094317869 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7c4186c10 con 0x55c7c43b3070 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e28ff9640 1 -- 172.21.15.133:0/1094317869 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 89) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f2e38021980 con 0x55c7c43b3070 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 10 client.8358 fetch_fsmap finished waiting for FSMap version 89 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 10 client.8358 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 20 client.8358 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55c7c43a1d70 0x55c7c43a2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 4 client.8358 mds_command: new command op to 8118 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:19.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.961+0000 7f2e532ee000 1 -- 172.21.15.133:0/1094317869 --> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7c41b5a30 con 0x55c7c43a1d70 2023-12-18T10:24:19.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55c7c43a1d70 0x55c7c43a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55c7c43a1d70 0x55c7c43a2150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4bb343009d46c73 server_cookie=321990c7907aa6db in_seq=0 out_seq=0 2023-12-18T10:24:19.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e28ff9640 10 client.8358 ms_handle_connect on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e28ff9640 1 -- 172.21.15.133:0/1094317869 <== mds.1 v2:172.21.15.142:6833/4118520914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c7c41b5a30 con 0x55c7c43a1d70 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e28ff9640 10 client.8358 handle_command_reply: tid=0 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 client.8358 shutdown 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 -- 172.21.15.133:0/1094317869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43b3070 msgr2=0x55c7c43bad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43b3070 0x55c7c43bad30 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f2e4815d640 tx=0x7f2e38000ee0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 -- 172.21.15.133:0/1094317869 shutdown_connections 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55c7c43a1d70 0x55c7c43a2150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c43a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43b3070 0x55c7c43bad30 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 --2- 172.21.15.133:0/1094317869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43691c0 0x55c7c43ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 -- 172.21.15.133:0/1094317869 >> 172.21.15.133:0/1094317869 conn(0x55c7c436f950 msgr2=0x55c7c4367c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e28ff9640 0 client.8358 ms_handle_reset on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:19.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 -- 172.21.15.133:0/1094317869 shutdown_connections 2023-12-18T10:24:19.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 1 -- 172.21.15.133:0/1094317869 wait complete. 2023-12-18T10:24:19.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.965+0000 7f2e532ee000 20 client.8358 trim_cache size 0 max 16384 2023-12-18T10:24:19.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 Processor -- start 2023-12-18T10:24:19.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 -- start start 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c440b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c440b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c440bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c3e74940 con 0x55c7c43691c0 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c41b5f70 con 0x55c7c43b3070 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7c41face0 con 0x55c7c43b3990 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c440b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c440b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40978/0 (socket says 172.21.15.133:40978) 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/979027554 learned_addr learned my addr 172.21.15.133:0/979027554 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 msgr2=0x55c7c440bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c440bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c440b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c440bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 msgr2=0x55c7c440b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c440b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/979027554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7c41623b0 con 0x55c7c43691c0 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c440bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c440b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c440b2f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2e44054a90 tx=0x7f2e44083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7fb1b9fedc3fbc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e2bfff640 1 -- 172.21.15.133:0/979027554 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44052d00 con 0x55c7c43691c0 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e2bfff640 1 -- 172.21.15.133:0/979027554 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44052ea0 con 0x55c7c43691c0 2023-12-18T10:24:19.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e2bfff640 1 -- 172.21.15.133:0/979027554 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4405c650 con 0x55c7c43691c0 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 -- 172.21.15.133:0/979027554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 msgr2=0x55c7c440b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.981+0000 7f2e532ee000 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c440b2f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2e44054a90 tx=0x7f2e44083040 comp rx=0 tx=0).stop 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- 172.21.15.133:0/979027554 shutdown_connections 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c440bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c440b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 --2- 172.21.15.133:0/979027554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c440b2f0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- 172.21.15.133:0/979027554 >> 172.21.15.133:0/979027554 conn(0x55c7c436f950 msgr2=0x55c7c43c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- 172.21.15.133:0/979027554 shutdown_connections 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- 172.21.15.133:0/979027554 wait complete. 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- start start 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 Processor -- start 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c43f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c43f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c436e9e0 con 0x55c7c43691c0 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7c41b1660 con 0x55c7c43b3070 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7c415f860 con 0x55c7c43b3990 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 10 client.0 _ll_register_callbacks cb 0x55c7c4165640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43f3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40994/0 (socket says 172.21.15.133:40994) 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/4008868034 learned_addr learned my addr 172.21.15.133:0/4008868034 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c43f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4e52c640 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c43f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 msgr2=0x55c7c43f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c43f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 msgr2=0x55c7c43f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c43f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 -- 172.21.15.133:0/4008868034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e480c6ab0 con 0x55c7c43691c0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e4dd2b640 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43f3d60 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2e44051000 tx=0x7f2e3800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17476b2646b70e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e28ff9640 1 -- 172.21.15.133:0/4008868034 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4405c650 con 0x55c7c43691c0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e28ff9640 1 -- 172.21.15.133:0/4008868034 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2e4405c7b0 con 0x55c7c43691c0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- 172.21.15.133:0/4008868034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7c417ce00 con 0x55c7c43691c0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e28ff9640 1 -- 172.21.15.133:0/4008868034 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e44081300 con 0x55c7c43691c0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 10 client.8364 fetch_fsmap learned FSMap version 89 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- 172.21.15.133:0/4008868034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x55c7c3eb3cc0 con 0x55c7c43691c0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e28ff9640 1 -- 172.21.15.133:0/4008868034 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7c417ce00 con 0x55c7c43691c0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e28ff9640 1 -- 172.21.15.133:0/4008868034 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 89) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f2e44011070 con 0x55c7c43691c0 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 10 client.8364 fetch_fsmap finished waiting for FSMap version 89 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 10 client.8364 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-18T10:24:19.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 20 client.8364 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:19.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55c7c43f4d20 0x55c7c43f5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:19.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 4 client.8364 mds_command: new command op to 8118 tid=0[{"prefix": "status"}] 2023-12-18T10:24:19.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.985+0000 7f2e532ee000 1 -- 172.21.15.133:0/4008868034 --> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7c41b0160 con 0x55c7c43f4d20 2023-12-18T10:24:19.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55c7c43f4d20 0x55c7c43f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:19.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4d52a640 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55c7c43f4d20 0x55c7c43f5100 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13477a2b262ff5c server_cookie=3a2100bdb0ec2fd9 in_seq=0 out_seq=0 2023-12-18T10:24:19.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e28ff9640 10 client.8364 ms_handle_connect on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:19.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e28ff9640 1 -- 172.21.15.133:0/4008868034 <== mds.1 v2:172.21.15.142:6833/4118520914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c7c41b0160 con 0x55c7c43f4d20 2023-12-18T10:24:19.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e28ff9640 10 client.8364 handle_command_reply: tid=0 2023-12-18T10:24:19.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 client.8364 shutdown 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 -- 172.21.15.133:0/4008868034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 msgr2=0x55c7c43f3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43f3d60 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2e44051000 tx=0x7f2e3800f000 comp rx=0 tx=0).stop 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 -- 172.21.15.133:0/4008868034 shutdown_connections 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55c7c43f4d20 0x55c7c43f5100 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c7c43b3990 0x55c7c43f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c7c43b3070 0x55c7c43f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 --2- 172.21.15.133:0/4008868034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7c43691c0 0x55c7c43f3d60 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 -- 172.21.15.133:0/4008868034 >> 172.21.15.133:0/4008868034 conn(0x55c7c436f950 msgr2=0x55c7c439e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e28ff9640 0 client.8364 ms_handle_reset on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 -- 172.21.15.133:0/4008868034 shutdown_connections 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 1 -- 172.21.15.133:0/4008868034 wait complete. 2023-12-18T10:24:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e532ee000 20 client.8364 trim_cache size 0 max 16384 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 1, 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 8118, 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 2.956302682, 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 89, 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 91, 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 91, 2023-12-18T10:24:19.994 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 26.722217995000001 2023-12-18T10:24:19.995 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:19.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e2c065a60 msgr2=0x7f2e2c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e2c065a60 0x7f2e2c067f20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2e38007fd0 tx=0x7f2e38007900 comp rx=0 tx=0).stop 2023-12-18T10:24:19.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e4806fdb0 msgr2=0x7f2e480af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:19.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e4806fdb0 0x7f2e480af420 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400e930 tx=0x7f2e4400edf0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/3654134375 shutdown_connections 2023-12-18T10:24:19.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e2c065a60 0x7f2e2c067f20 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e4815a680 0x7f2e48151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e480cac10 0x7f2e4806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 --2- 172.21.15.133:0/3654134375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e4806fdb0 0x7f2e480af420 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/3654134375 >> 172.21.15.133:0/3654134375 conn(0x7f2e4806a3e0 msgr2=0x7f2e4815db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/3654134375 shutdown_connections 2023-12-18T10:24:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:19.989+0000 7f2e4ff8f640 1 -- 172.21.15.133:0/3654134375 wait complete. 2023-12-18T10:24:20.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-18T10:24:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1db125640 1 Processor -- start 2023-12-18T10:24:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1db125640 1 -- start start 2023-12-18T10:24:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1db125640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1d40cf530 0x7fc1d4168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1db125640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d40d11c0 con 0x7fc1d40cf0d0 2023-12-18T10:24:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1db125640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d40d0310 con 0x7fc1d415ca40 2023-12-18T10:24:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1db125640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d40d05b0 con 0x7fc1d40cf530 2023-12-18T10:24:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1cbfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc1d40cf0d0 0x7fc1d41648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37388/0 (socket says 172.21.15.133:37388) 2023-12-18T10:24:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1d96c2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1d40cf530 0x7fc1d4168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1cbfff640 1 -- 172.21.15.133:0/2946073989 learned_addr learned my addr 172.21.15.133:0/2946073989 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:20.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1cb7fe640 1 -- 172.21.15.133:0/2946073989 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833215343 0 0) 0x7fc1d40d11c0 con 0x7fc1d40cf0d0 2023-12-18T10:24:20.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1d96c2640 1 -- 172.21.15.133:0/2946073989 >> v1:172.21.15.142:6789/0 conn(0x7fc1d415ca40 legacy=0x7fc1d40cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1d96c2640 1 -- 172.21.15.133:0/2946073989 >> v1:172.21.15.133:6789/0 conn(0x7fc1d40cf0d0 legacy=0x7fc1d41648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.149+0000 7fc1d96c2640 1 -- 172.21.15.133:0/2946073989 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40d0890 con 0x7fc1d40cf530 2023-12-18T10:24:20.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/2946073989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4168000 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009d90 tx=0x7fc1cc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4696a2497d6644 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1cb7fe640 1 -- 172.21.15.133:0/2946073989 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0a59a0 con 0x7fc1d40cf530 2023-12-18T10:24:20.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1cb7fe640 1 -- 172.21.15.133:0/2946073989 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0a5b00 con 0x7fc1d40cf530 2023-12-18T10:24:20.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1cb7fe640 1 -- 172.21.15.133:0/2946073989 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0a5e90 con 0x7fc1d40cf530 2023-12-18T10:24:20.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1db125640 1 -- 172.21.15.133:0/2946073989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 msgr2=0x7fc1d4168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1db125640 1 --2- 172.21.15.133:0/2946073989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4168000 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009d90 tx=0x7fc1cc01c8e0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1db125640 1 -- 172.21.15.133:0/2946073989 shutdown_connections 2023-12-18T10:24:20.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1db125640 1 --2- 172.21.15.133:0/2946073989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4168000 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1db125640 1 -- 172.21.15.133:0/2946073989 >> 172.21.15.133:0/2946073989 conn(0x7fc1d4089fb0 msgr2=0x7fc1d40d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:20.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1db125640 1 -- 172.21.15.133:0/2946073989 shutdown_connections 2023-12-18T10:24:20.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.153+0000 7fc1db125640 1 -- 172.21.15.133:0/2946073989 wait complete. 2023-12-18T10:24:20.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 Processor -- start 2023-12-18T10:24:20.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 -- start start 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1d40cf0d0 0x7fc1d414f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1d415ca40 0x7fc1d41519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d4153240 con 0x7fc1d40cf530 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40c9810 con 0x7fc1d40cf0d0 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d41538a0 con 0x7fc1d415ca40 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1d8ec1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1d40cf0d0 0x7fc1d414f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41018/0 (socket says 172.21.15.133:41018) 2023-12-18T10:24:20.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 -- 172.21.15.133:0/1867704174 learned_addr learned my addr 172.21.15.133:0/1867704174 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1d415ca40 0x7fc1d41519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 -- 172.21.15.133:0/1867704174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1d415ca40 msgr2=0x7fc1d41519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1d415ca40 0x7fc1d41519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 -- 172.21.15.133:0/1867704174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1d40cf0d0 msgr2=0x7fc1d414f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1d40cf0d0 0x7fc1d414f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 -- 172.21.15.133:0/1867704174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc009a70 con 0x7fc1d40cf530 2023-12-18T10:24:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4151470 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c430 tx=0x7fc1c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1c97fa640 1 -- 172.21.15.133:0/1867704174 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40074e0 con 0x7fc1d40cf530 2023-12-18T10:24:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1c97fa640 1 -- 172.21.15.133:0/1867704174 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c4007640 con 0x7fc1d40cf530 2023-12-18T10:24:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1c97fa640 1 -- 172.21.15.133:0/1867704174 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40059d0 con 0x7fc1d40cf530 2023-12-18T10:24:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 -- 172.21.15.133:0/1867704174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d40c9a60 con 0x7fc1d40cf530 2023-12-18T10:24:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.157+0000 7fc1db125640 1 -- 172.21.15.133:0/1867704174 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d40ca300 con 0x7fc1d40cf530 2023-12-18T10:24:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.161+0000 7fc1c97fa640 1 -- 172.21.15.133:0/1867704174 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc1c4005b30 con 0x7fc1d40cf530 2023-12-18T10:24:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.161+0000 7fc1c97fa640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc1c0065a60 0x7fc1c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.161+0000 7fc1c97fa640 1 -- 172.21.15.133:0/1867704174 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc1c4082850 con 0x7fc1d40cf530 2023-12-18T10:24:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.161+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc1c0065a60 0x7fc1c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.161+0000 7fc1de484000 1 Processor -- start 2023-12-18T10:24:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.161+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc1c0065a60 0x7fc1c0067f20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40b4140 tx=0x7fc1d0007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.161+0000 7fc1de484000 1 -- start start 2023-12-18T10:24:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c128d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d990 0x5604c1242c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c12435a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c1066c90 con 0x5604c128d070 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c1098220 con 0x5604c128d990 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604c10957f0 con 0x5604c12431c0 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c128d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c128d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41034/0 (socket says 172.21.15.133:41034) 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 -- 172.21.15.133:0/1979787117 learned_addr learned my addr 172.21.15.133:0/1979787117 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d990 0x5604c1242c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c12435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 -- 172.21.15.133:0/1979787117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 msgr2=0x5604c12435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c12435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 -- 172.21.15.133:0/1979787117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d990 msgr2=0x5604c1242c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d990 0x5604c1242c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 -- 172.21.15.133:0/1979787117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604c0d8d890 con 0x5604c128d070 2023-12-18T10:24:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c128d450 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000fb70 tx=0x7fc1d0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efac8b5b1333a149 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1baffd640 1 -- 172.21.15.133:0/1979787117 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0014ca0 con 0x5604c128d070 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1baffd640 1 -- 172.21.15.133:0/1979787117 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0019070 con 0x5604c128d070 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1baffd640 1 -- 172.21.15.133:0/1979787117 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0020440 con 0x5604c128d070 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- 172.21.15.133:0/1979787117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 msgr2=0x5604c128d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c128d450 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000fb70 tx=0x7fc1d0012000 comp rx=0 tx=0).stop 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- 172.21.15.133:0/1979787117 shutdown_connections 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c12435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d990 0x5604c1242c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 --2- 172.21.15.133:0/1979787117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c128d450 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- 172.21.15.133:0/1979787117 >> 172.21.15.133:0/1979787117 conn(0x5604c1249950 msgr2=0x5604c1241560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- 172.21.15.133:0/1979787117 shutdown_connections 2023-12-18T10:24:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- 172.21.15.133:0/1979787117 wait complete. 2023-12-18T10:24:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 -- start start 2023-12-18T10:24:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 Processor -- start 2023-12-18T10:24:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.165+0000 7fc1de484000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c1248740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c124f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c124f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c10910e0 con 0x5604c128d990 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c1030310 con 0x5604c128d070 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604c104e770 con 0x5604c12431c0 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 10 client.0 _ll_register_callbacks cb 0x5604c122eb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c124f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c124f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41038/0 (socket says 172.21.15.133:41038) 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 -- 172.21.15.133:0/2376625318 learned_addr learned my addr 172.21.15.133:0/2376625318 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c1248740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c124f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 -- 172.21.15.133:0/2376625318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 msgr2=0x5604c1248740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c1248740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 -- 172.21.15.133:0/2376625318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 msgr2=0x5604c124f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c124f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 -- 172.21.15.133:0/2376625318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d000f850 con 0x5604c128d990 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c124f5c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc01a510 tx=0x7fc1cc01b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df712ff0024362b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 1 -- 172.21.15.133:0/2376625318 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0a5960 con 0x5604c128d990 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 1 -- 172.21.15.133:0/2376625318 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc1cc0ad9f0 con 0x5604c128d990 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- 172.21.15.133:0/2376625318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604c1060c10 con 0x5604c128d990 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 1 -- 172.21.15.133:0/2376625318 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1cc0adbb0 con 0x5604c128d990 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 10 client.8379 fetch_fsmap learned FSMap version 89 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- 172.21.15.133:0/2376625318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x5604c1056260 con 0x5604c128d990 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 1 -- 172.21.15.133:0/2376625318 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604c1060c10 con 0x5604c128d990 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 1 -- 172.21.15.133:0/2376625318 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 89) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fc1cc0add10 con 0x5604c128d990 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 10 client.8379 fetch_fsmap finished waiting for FSMap version 89 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 10 client.8379 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:24:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 20 client.8379 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5604c12948d0 0x5604c1294cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 4 client.8379 mds_command: new command op to 8127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- 172.21.15.133:0/2376625318 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604c108fa30 con 0x5604c12948d0 2023-12-18T10:24:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5604c12948d0 0x5604c1294cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 10 client.8379 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5604c12948d0 0x5604c1294cb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b43aa49b1b31abdd server_cookie=2bf9d3f38dad8f4b in_seq=0 out_seq=0 2023-12-18T10:24:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 1 -- 172.21.15.133:0/2376625318 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5604c108fa30 con 0x5604c12948d0 2023-12-18T10:24:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 10 client.8379 handle_command_reply: tid=0 2023-12-18T10:24:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 client.8379 shutdown 2023-12-18T10:24:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- 172.21.15.133:0/2376625318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 msgr2=0x5604c124f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c124f5c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc01a510 tx=0x7fc1cc01b120 comp rx=0 tx=0).stop 2023-12-18T10:24:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- 172.21.15.133:0/2376625318 shutdown_connections 2023-12-18T10:24:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5604c12948d0 0x5604c1294cb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c124f5c0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c124f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1b37fe640 0 client.8379 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 --2- 172.21.15.133:0/2376625318 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c1248740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- 172.21.15.133:0/2376625318 >> 172.21.15.133:0/2376625318 conn(0x5604c1249950 msgr2=0x5604c1241c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.169+0000 7fc1de484000 1 -- 172.21.15.133:0/2376625318 shutdown_connections 2023-12-18T10:24:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.173+0000 7fc1de484000 1 -- 172.21.15.133:0/2376625318 wait complete. 2023-12-18T10:24:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.173+0000 7fc1de484000 20 client.8379 trim_cache size 0 max 16384 2023-12-18T10:24:20.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.185+0000 7fc1de484000 1 Processor -- start 2023-12-18T10:24:20.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.185+0000 7fc1de484000 1 -- start start 2023-12-18T10:24:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.185+0000 7fc1de484000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c12e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.185+0000 7fc1de484000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c12e5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.185+0000 7fc1de484000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c12e5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.185+0000 7fc1de484000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c0d4e940 con 0x5604c128d990 2023-12-18T10:24:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.185+0000 7fc1de484000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c10d4ce0 con 0x5604c128d070 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.185+0000 7fc1de484000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604c105ea80 con 0x5604c12431c0 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c12e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c12e5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41040/0 (socket says 172.21.15.133:41040) 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 -- 172.21.15.133:0/3935488751 learned_addr learned my addr 172.21.15.133:0/3935488751 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c12e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c12e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 -- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 msgr2=0x5604c12e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c12e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 -- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 msgr2=0x5604c12e5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c12e5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 -- 172.21.15.133:0/3935488751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604c103c3b0 con 0x5604c128d990 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c12e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c12e5950 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc01b160 tx=0x7fc1cc0ba040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2448953f215b09ba server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1bb7fe640 1 -- 172.21.15.133:0/3935488751 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0b8720 con 0x5604c128d990 2023-12-18T10:24:20.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1bb7fe640 1 -- 172.21.15.133:0/3935488751 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0b8880 con 0x5604c128d990 2023-12-18T10:24:20.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1bb7fe640 1 -- 172.21.15.133:0/3935488751 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0b8cb0 con 0x5604c128d990 2023-12-18T10:24:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- 172.21.15.133:0/3935488751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 msgr2=0x5604c12e5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c12e5950 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc01b160 tx=0x7fc1cc0ba040 comp rx=0 tx=0).stop 2023-12-18T10:24:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- 172.21.15.133:0/3935488751 shutdown_connections 2023-12-18T10:24:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d990 0x5604c12e5950 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c128d070 0x5604c12e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 --2- 172.21.15.133:0/3935488751 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c12431c0 0x5604c12e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- 172.21.15.133:0/3935488751 >> 172.21.15.133:0/3935488751 conn(0x5604c1249950 msgr2=0x5604c124ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:20.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- 172.21.15.133:0/3935488751 shutdown_connections 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- 172.21.15.133:0/3935488751 wait complete. 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- start start 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 Processor -- start 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c12431c0 0x5604c12cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c12cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c128d990 0x5604c12ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c108e4e0 con 0x5604c128d070 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c1248790 con 0x5604c12431c0 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604c102e2a0 con 0x5604c128d990 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1de484000 10 client.0 _ll_register_callbacks cb 0x5604c103f640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c12cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c12cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41044/0 (socket says 172.21.15.133:41044) 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 -- 172.21.15.133:0/917980397 learned_addr learned my addr 172.21.15.133:0/917980397 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:20.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c12431c0 0x5604c12cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c128d990 0x5604c12ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 -- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c128d990 msgr2=0x5604c12ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c128d990 0x5604c12ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 -- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c12431c0 msgr2=0x5604c12cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c12431c0 0x5604c12cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1cbfff640 1 -- 172.21.15.133:0/917980397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604c1056260 con 0x5604c128d070 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.189+0000 7fc1d96c2640 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c128d990 0x5604c12ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1cbfff640 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c12cde80 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4001140 tx=0x7fc1c405be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b23b74e1f3d3e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 1 -- 172.21.15.133:0/917980397 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c405bba0 con 0x5604c128d070 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 1 -- 172.21.15.133:0/917980397 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc1c404fcf0 con 0x5604c128d070 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 -- 172.21.15.133:0/917980397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604c1056e00 con 0x5604c128d070 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 1 -- 172.21.15.133:0/917980397 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1c404fed0 con 0x5604c128d070 2023-12-18T10:24:20.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 10 client.8385 fetch_fsmap learned FSMap version 89 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 -- 172.21.15.133:0/917980397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) v3 -- 0x5604c0d8dcc0 con 0x5604c128d070 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 1 -- 172.21.15.133:0/917980397 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604c1056e00 con 0x5604c128d070 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 1 -- 172.21.15.133:0/917980397 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 89) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fc1c4052e60 con 0x5604c128d070 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 10 client.8385 fetch_fsmap finished waiting for FSMap version 89 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 10 client.8385 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 20 client.8385 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5604c12ce900 0x5604c12cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 4 client.8385 mds_command: new command op to 8127 tid=0[{"prefix": "status"}] 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 -- 172.21.15.133:0/917980397 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604c108a160 con 0x5604c12ce900 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5604c12ce900 0x5604c12cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 10 client.8385 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1d8ec1640 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5604c12ce900 0x5604c12cece0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65307d050fff627c server_cookie=69bb6f197a0bebd in_seq=0 out_seq=0 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 1 -- 172.21.15.133:0/917980397 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5604c108a160 con 0x5604c12ce900 2023-12-18T10:24:20.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 10 client.8385 handle_command_reply: tid=0 2023-12-18T10:24:20.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 client.8385 shutdown 2023-12-18T10:24:20.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 -- 172.21.15.133:0/917980397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 msgr2=0x5604c12cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c12cde80 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4001140 tx=0x7fc1c405be30 comp rx=0 tx=0).stop 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 -- 172.21.15.133:0/917980397 shutdown_connections 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5604c12ce900 0x5604c12cece0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5604c128d990 0x5604c12ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5604c128d070 0x5604c12cde80 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 --2- 172.21.15.133:0/917980397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5604c12431c0 0x5604c12cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1b37fe640 0 client.8385 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 -- 172.21.15.133:0/917980397 >> 172.21.15.133:0/917980397 conn(0x5604c1249950 msgr2=0x5604c128a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 -- 172.21.15.133:0/917980397 shutdown_connections 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 1 -- 172.21.15.133:0/917980397 wait complete. 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1de484000 20 client.8385 trim_cache size 0 max 16384 2023-12-18T10:24:20.198 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 8127, 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 16.543568335, 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 89, 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 91, 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 91, 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 20.975507489000002 2023-12-18T10:24:20.199 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:20.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 -- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc1c0065a60 msgr2=0x7fc1c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc1c0065a60 0x7fc1c0067f20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40b4140 tx=0x7fc1d0007e90 comp rx=0 tx=0).stop 2023-12-18T10:24:20.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 -- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 msgr2=0x7fc1d4151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4151470 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c430 tx=0x7fc1c400c8f0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 -- 172.21.15.133:0/1867704174 shutdown_connections 2023-12-18T10:24:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc1c0065a60 0x7fc1c0067f20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1d415ca40 0x7fc1d41519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d40cf530 0x7fc1d4151470 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 --2- 172.21.15.133:0/1867704174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1d40cf0d0 0x7fc1d414f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 -- 172.21.15.133:0/1867704174 >> 172.21.15.133:0/1867704174 conn(0x7fc1d4089fb0 msgr2=0x7fc1d40b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 -- 172.21.15.133:0/1867704174 shutdown_connections 2023-12-18T10:24:20.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.193+0000 7fc1db125640 1 -- 172.21.15.133:0/1867704174 wait complete. 2023-12-18T10:24:20.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:20.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.349+0000 7f2c73b2c640 1 Processor -- start 2023-12-18T10:24:20.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.349+0000 7f2c73b2c640 1 -- start start 2023-12-18T10:24:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c73b2c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2c6c158c20 0x7f2c6c070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c73b2c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c070b80 con 0x7f2c6c15c800 2023-12-18T10:24:20.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c73b2c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c070e60 con 0x7f2c6c0cb180 2023-12-18T10:24:20.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c73b2c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c071140 con 0x7f2c6c158c20 2023-12-18T10:24:20.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c718c8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2c6c158c20 0x7f2c6c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c710c7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2c6c15c800 0x7f2c6c0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37404/0 (socket says 172.21.15.133:37404) 2023-12-18T10:24:20.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c710c7640 1 -- 172.21.15.133:0/3557000887 learned_addr learned my addr 172.21.15.133:0/3557000887 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:20.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c718c8640 1 -- 172.21.15.133:0/3557000887 >> v1:172.21.15.142:6789/0 conn(0x7f2c6c0cb180 legacy=0x7f2c6c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:20.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c718c8640 1 -- 172.21.15.133:0/3557000887 >> v1:172.21.15.133:6789/0 conn(0x7f2c6c15c800 legacy=0x7f2c6c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c718c8640 1 -- 172.21.15.133:0/3557000887 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c071420 con 0x7f2c6c158c20 2023-12-18T10:24:20.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.353+0000 7f2c708c6640 1 -- 172.21.15.133:0/3557000887 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198861521 0 0) 0x7f2c6c070b80 con 0x7f2c6c15c800 2023-12-18T10:24:20.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c718c8640 1 --2- 172.21.15.133:0/3557000887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c158c20 0x7f2c6c070510 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f2c680097c0 tx=0x7f2c6801cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105c5a037cc221f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c708c6640 1 -- 172.21.15.133:0/3557000887 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680ab600 con 0x7f2c6c158c20 2023-12-18T10:24:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c708c6640 1 -- 172.21.15.133:0/3557000887 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c680a7050 con 0x7f2c6c158c20 2023-12-18T10:24:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c708c6640 1 -- 172.21.15.133:0/3557000887 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680ab980 con 0x7f2c6c158c20 2023-12-18T10:24:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 -- 172.21.15.133:0/3557000887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c158c20 msgr2=0x7f2c6c070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 --2- 172.21.15.133:0/3557000887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c158c20 0x7f2c6c070510 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f2c680097c0 tx=0x7f2c6801cde0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 -- 172.21.15.133:0/3557000887 shutdown_connections 2023-12-18T10:24:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 --2- 172.21.15.133:0/3557000887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c158c20 0x7f2c6c070510 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 -- 172.21.15.133:0/3557000887 >> 172.21.15.133:0/3557000887 conn(0x7f2c6c06a3e0 msgr2=0x7f2c6c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 -- 172.21.15.133:0/3557000887 shutdown_connections 2023-12-18T10:24:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 -- 172.21.15.133:0/3557000887 wait complete. 2023-12-18T10:24:20.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 Processor -- start 2023-12-18T10:24:20.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.357+0000 7f2c73b2c640 1 -- start start 2023-12-18T10:24:20.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c0cb180 0x7f2c6c149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6c158c20 0x7f2c6c14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c6c15c800 0x7f2c6c14cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c149d50 con 0x7f2c6c0cb180 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c15b5a0 con 0x7f2c6c158c20 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c15b880 con 0x7f2c6c15c800 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c0cb180 0x7f2c6c149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c0cb180 0x7f2c6c149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41060/0 (socket says 172.21.15.133:41060) 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 -- 172.21.15.133:0/6094584 learned_addr learned my addr 172.21.15.133:0/6094584 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c710c7640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6c158c20 0x7f2c6c14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c720c9640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c6c15c800 0x7f2c6c14cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 -- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c6c15c800 msgr2=0x7f2c6c14cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c6c15c800 0x7f2c6c14cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 -- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6c158c20 msgr2=0x7f2c6c14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6c158c20 0x7f2c6c14c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 -- 172.21.15.133:0/6094584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68009420 con 0x7f2c6c0cb180 2023-12-18T10:24:20.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c710c7640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6c158c20 0x7f2c6c14c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:20.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c718c8640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c0cb180 0x7f2c6c149810 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f2c68000c10 tx=0x7f2c6801abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c627fc640 1 -- 172.21.15.133:0/6094584 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68004220 con 0x7f2c6c0cb180 2023-12-18T10:24:20.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c627fc640 1 -- 172.21.15.133:0/6094584 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68004380 con 0x7f2c6c0cb180 2023-12-18T10:24:20.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c627fc640 1 -- 172.21.15.133:0/6094584 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68003820 con 0x7f2c6c0cb180 2023-12-18T10:24:20.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c0c8800 con 0x7f2c6c0cb180 2023-12-18T10:24:20.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c15be40 con 0x7f2c6c0cb180 2023-12-18T10:24:20.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c0735b0 con 0x7f2c6c0cb180 2023-12-18T10:24:20.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.361+0000 7f2c627fc640 1 -- 172.21.15.133:0/6094584 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2c68003980 con 0x7f2c6c0cb180 2023-12-18T10:24:20.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.365+0000 7f2c627fc640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c50065a60 0x7f2c50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:20.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.365+0000 7f2c627fc640 1 -- 172.21.15.133:0/6094584 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c6811d8a0 con 0x7f2c6c0cb180 2023-12-18T10:24:20.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.365+0000 7f2c710c7640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c50065a60 0x7f2c50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:20.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.365+0000 7f2c710c7640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c50065a60 0x7f2c50067f20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c1f4000 tx=0x7f2c5c007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:20.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.369+0000 7f2c627fc640 1 -- 172.21.15.133:0/6094584 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2c680eb080 con 0x7f2c6c0cb180 2023-12-18T10:24:20.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.545+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c6c04e000 con 0x7f2c6c0cb180 2023-12-18T10:24:20.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c627fc640 1 -- 172.21.15.133:0/6094584 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f2c680b0020 con 0x7f2c6c0cb180 2023-12-18T10:24:20.548 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:20.548 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":89,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:19.048222+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:20.548 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 89 2023-12-18T10:24:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c50065a60 msgr2=0x7f2c50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c50065a60 0x7f2c50067f20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c1f4000 tx=0x7f2c5c007cb0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c0cb180 msgr2=0x7f2c6c149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c0cb180 0x7f2c6c149810 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f2c68000c10 tx=0x7f2c6801abc0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 shutdown_connections 2023-12-18T10:24:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c50065a60 0x7f2c50067f20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2c6c15c800 0x7f2c6c14cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c6c158c20 0x7f2c6c14c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 --2- 172.21.15.133:0/6094584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c6c0cb180 0x7f2c6c149810 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 >> 172.21.15.133:0/6094584 conn(0x7f2c6c06a3e0 msgr2=0x7f2c6c0aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 shutdown_connections 2023-12-18T10:24:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:20.549+0000 7f2c73b2c640 1 -- 172.21.15.133:0/6094584 wait complete. 2023-12-18T10:24:20.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:20.569 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:24:20.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:20.600 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:24:20.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:20.660 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-12-18T10:24:20.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:20.714 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-12-18T10:24:20.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:20.766 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-12-18T10:24:20.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:24:21.012 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:24:21.013 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:24:21.013 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:24:23.014 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:24:23.178 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:24:23.178 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:24:23.178 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:24:25.180 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:24:25.345 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:24:25.345 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:24:25.345 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:24:27.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:24:27.512 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:24:27.512 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:24:27.512 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:24:29.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:24:29.113 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:24:29.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:24:29.678 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-12-18T10:24:29.679 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:24:29.679 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:24:29.679 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:24:29.844 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:24:29.844 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:24:29.844 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:24:31.846 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:24:32.011 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:24:32.012 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:24:32.012 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:24:34.013 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:24:34.181 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:24:34.181 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:24:34.182 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:24:36.183 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2023-12-18T10:24:36.349 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-12-18T10:24:36.350 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:24:36.350 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:24:36.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:24:36.516 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:24:36.516 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:24:36.516 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:24:36.517 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-12-18T10:24:36.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.653+0000 7f0fcbe95640 1 Processor -- start 2023-12-18T10:24:36.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fcbe95640 1 -- start start 2023-12-18T10:24:36.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fcbe95640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0fc4071870 0x7f0fc4071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fcbe95640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc4070df0 con 0x7f0fc40ca410 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fcbe95640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc415a4f0 con 0x7f0fc40cbff0 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fcbe95640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc415aab0 con 0x7f0fc4071870 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc9c31640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0fc40ca410 0x7f0fc4159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:51078/0 (socket says 172.21.15.133:51078) 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc9c31640 1 -- 172.21.15.133:0/4129007424 learned_addr learned my addr 172.21.15.133:0/4129007424 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc9430640 1 --2- 172.21.15.133:0/4129007424 >> v2:172.21.15.142:3300/0 conn(0x7f0fc4071870 0x7f0fc4071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc8c2f640 1 -- 172.21.15.133:0/4129007424 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196043284 0 0) 0x7f0fc4070df0 con 0x7f0fc40ca410 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc8c2f640 1 -- 172.21.15.133:0/4129007424 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fb0003530 con 0x7f0fc40ca410 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc8c2f640 1 -- 172.21.15.133:0/4129007424 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783680777 0 0) 0x7f0fc415a4f0 con 0x7f0fc40cbff0 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc8c2f640 1 -- 172.21.15.133:0/4129007424 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc4070df0 con 0x7f0fc40cbff0 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc9430640 1 -- 172.21.15.133:0/4129007424 >> v1:172.21.15.142:6789/0 conn(0x7f0fc40cbff0 legacy=0x7f0fc40ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc9430640 1 -- 172.21.15.133:0/4129007424 >> v1:172.21.15.133:6789/0 conn(0x7f0fc40ca410 legacy=0x7f0fc4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.657+0000 7f0fc9430640 1 -- 172.21.15.133:0/4129007424 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc415a7d0 con 0x7f0fc4071870 2023-12-18T10:24:36.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fc9430640 1 --2- 172.21.15.133:0/4129007424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc4071870 0x7f0fc4071d00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40097c0 tx=0x7f0fb401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92c4c3c71d46e3e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fc8c2f640 1 -- 172.21.15.133:0/4129007424 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40ab650 con 0x7f0fc4071870 2023-12-18T10:24:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fc8c2f640 1 -- 172.21.15.133:0/4129007424 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb40ab7b0 con 0x7f0fc4071870 2023-12-18T10:24:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fc8c2f640 1 -- 172.21.15.133:0/4129007424 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40abb20 con 0x7f0fc4071870 2023-12-18T10:24:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fcbe95640 1 -- 172.21.15.133:0/4129007424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc4071870 msgr2=0x7f0fc4071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fcbe95640 1 --2- 172.21.15.133:0/4129007424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc4071870 0x7f0fc4071d00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40097c0 tx=0x7f0fb401c450 comp rx=0 tx=0).stop 2023-12-18T10:24:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fcbe95640 1 -- 172.21.15.133:0/4129007424 shutdown_connections 2023-12-18T10:24:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fcbe95640 1 --2- 172.21.15.133:0/4129007424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc4071870 0x7f0fc4071d00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fcbe95640 1 -- 172.21.15.133:0/4129007424 >> 172.21.15.133:0/4129007424 conn(0x7f0fc406a2a0 msgr2=0x7f0fc40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fcbe95640 1 -- 172.21.15.133:0/4129007424 shutdown_connections 2023-12-18T10:24:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fcbe95640 1 -- 172.21.15.133:0/4129007424 wait complete. 2023-12-18T10:24:36.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.661+0000 7f0fcbe95640 1 Processor -- start 2023-12-18T10:24:36.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 -- start start 2023-12-18T10:24:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc4071870 0x7f0fc4149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc40ca410 0x7f0fc40c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc40cbff0 0x7f0fc4156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c1d00 con 0x7f0fc40ca410 2023-12-18T10:24:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c2630 con 0x7f0fc40cbff0 2023-12-18T10:24:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c2910 con 0x7f0fc4071870 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc40ca410 0x7f0fc40c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc40ca410 0x7f0fc40c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45914/0 (socket says 172.21.15.133:45914) 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 -- 172.21.15.133:0/3485632977 learned_addr learned my addr 172.21.15.133:0/3485632977 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc4071870 0x7f0fc4149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fca432640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc40cbff0 0x7f0fc4156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 -- 172.21.15.133:0/3485632977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc4071870 msgr2=0x7f0fc4149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc4071870 0x7f0fc4149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 -- 172.21.15.133:0/3485632977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc40cbff0 msgr2=0x7f0fc4156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc40cbff0 0x7f0fc4156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 -- 172.21.15.133:0/3485632977 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009420 con 0x7f0fc40ca410 2023-12-18T10:24:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fc9430640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc40ca410 0x7f0fc40c1f50 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4019060 tx=0x7f0fb401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fba7fc640 1 -- 172.21.15.133:0/3485632977 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40bf610 con 0x7f0fc40ca410 2023-12-18T10:24:36.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fba7fc640 1 -- 172.21.15.133:0/3485632977 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb40bf770 con 0x7f0fc40ca410 2023-12-18T10:24:36.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fba7fc640 1 -- 172.21.15.133:0/3485632977 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40bfae0 con 0x7f0fc40ca410 2023-12-18T10:24:36.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 -- 172.21.15.133:0/3485632977 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc40cc960 con 0x7f0fc40ca410 2023-12-18T10:24:36.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.665+0000 7f0fcbe95640 1 -- 172.21.15.133:0/3485632977 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40c02c0 con 0x7f0fc40ca410 2023-12-18T10:24:36.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fba7fc640 1 -- 172.21.15.133:0/3485632977 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0fb40b5400 con 0x7f0fc40ca410 2023-12-18T10:24:36.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fba7fc640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fa8065a60 0x7f0fa8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fba7fc640 1 -- 172.21.15.133:0/3485632977 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fb411dde0 con 0x7f0fc40ca410 2023-12-18T10:24:36.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fa8065a60 0x7f0fa8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fcf206000 1 Processor -- start 2023-12-18T10:24:36.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fa8065a60 0x7f0fa8067f20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0007fd0 tx=0x7f0fc0007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fcf206000 1 -- start start 2023-12-18T10:24:36.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 0x5647e9e31060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9de6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9de73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fcf206000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647e9caf430 con 0x5647e9e315a0 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fcf206000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647e9c3d460 con 0x5647e9de6fc0 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fcf206000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647e9c3aa30 con 0x5647e9e30c80 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9de6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9de6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45930/0 (socket says 172.21.15.133:45930) 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 -- 172.21.15.133:0/1617328441 learned_addr learned my addr 172.21.15.133:0/1617328441 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fca432640 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9de73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 0x5647e9e31060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 -- 172.21.15.133:0/1617328441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 msgr2=0x5647e9e31060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 0x5647e9e31060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 -- 172.21.15.133:0/1617328441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 msgr2=0x5647e9de73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9de73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 -- 172.21.15.133:0/1617328441 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647e9932e20 con 0x5647e9e315a0 2023-12-18T10:24:36.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.669+0000 7f0fc9430640 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9de6a80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40ef350 tx=0x7f0fb4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4ad926f8c374ad server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fa77fe640 1 -- 172.21.15.133:0/1617328441 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40f3140 con 0x5647e9e315a0 2023-12-18T10:24:36.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fa77fe640 1 -- 172.21.15.133:0/1617328441 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb40f72f0 con 0x5647e9e315a0 2023-12-18T10:24:36.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fa77fe640 1 -- 172.21.15.133:0/1617328441 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40ebad0 con 0x5647e9e315a0 2023-12-18T10:24:36.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- 172.21.15.133:0/1617328441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 msgr2=0x5647e9de6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9de6a80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40ef350 tx=0x7f0fb4009190 comp rx=0 tx=0).stop 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- 172.21.15.133:0/1617328441 shutdown_connections 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9de73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9de6a80 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 --2- 172.21.15.133:0/1617328441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 0x5647e9e31060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- 172.21.15.133:0/1617328441 >> 172.21.15.133:0/1617328441 conn(0x5647e9be5910 msgr2=0x5647e9de5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- 172.21.15.133:0/1617328441 shutdown_connections 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- 172.21.15.133:0/1617328441 wait complete. 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- start start 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 Processor -- start 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9de6fc0 0x5647e9e31b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 0x5647e9e320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e325e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647e9c36320 con 0x5647e9e315a0 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647e9bd54f0 con 0x5647e9e30c80 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647e9bf36e0 con 0x5647e9de6fc0 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fcf206000 10 client.0 _ll_register_callbacks cb 0x5647e9dd2980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e325e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45940/0 (socket says 172.21.15.133:45940) 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 -- 172.21.15.133:0/2675303233 learned_addr learned my addr 172.21.15.133:0/2675303233 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fc9430640 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 0x5647e9e320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9de6fc0 0x5647e9e31b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 -- 172.21.15.133:0/2675303233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9de6fc0 msgr2=0x5647e9e31b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9de6fc0 0x5647e9e31b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 -- 172.21.15.133:0/2675303233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 msgr2=0x5647e9e320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 0x5647e9e320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 -- 172.21.15.133:0/2675303233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40c02c0 con 0x5647e9e315a0 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fca432640 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e325e0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc012890 tx=0x7f0fbc012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cec2573137ff53 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.673+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2675303233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc002080 con 0x5647e9e315a0 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 -- 172.21.15.133:0/2675303233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647e9bf3120 con 0x5647e9e315a0 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2675303233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fbc003b90 con 0x5647e9e315a0 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2675303233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fbc003d50 con 0x5647e9e315a0 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 10 client.8406 fetch_fsmap learned FSMap version 91 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 -- 172.21.15.133:0/2675303233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x5647e9bfb250 con 0x5647e9e315a0 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2675303233 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5647e9bf3120 con 0x5647e9e315a0 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2675303233 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 91) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0fbc010820 con 0x5647e9e315a0 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 10 client.8406 fetch_fsmap finished waiting for FSMap version 91 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 10 client.8406 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 20 client.8406 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5647e9e40840 0x5647e9e42c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 4 client.8406 mds_command: new command op to 8127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 -- 172.21.15.133:0/2675303233 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647e9c34c70 con 0x5647e9e40840 2023-12-18T10:24:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5647e9e40840 0x5647e9e42c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5647e9e40840 0x5647e9e42c30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a41751835d8d62c server_cookie=44e4efe110eec74e in_seq=0 out_seq=0 2023-12-18T10:24:36.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fa4ff9640 10 client.8406 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2675303233 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5647e9c34c70 con 0x5647e9e40840 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fa4ff9640 10 client.8406 handle_command_reply: tid=0 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 client.8406 shutdown 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 -- 172.21.15.133:0/2675303233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 msgr2=0x5647e9e325e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e325e0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc012890 tx=0x7f0fbc012d50 comp rx=0 tx=0).stop 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 -- 172.21.15.133:0/2675303233 shutdown_connections 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5647e9e40840 0x5647e9e42c30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e325e0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 0x5647e9e320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2675303233 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9de6fc0 0x5647e9e31b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fa4ff9640 0 client.8406 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:36.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 -- 172.21.15.133:0/2675303233 >> 172.21.15.133:0/2675303233 conn(0x5647e9be5910 msgr2=0x5647e9de5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 -- 172.21.15.133:0/2675303233 shutdown_connections 2023-12-18T10:24:36.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 1 -- 172.21.15.133:0/2675303233 wait complete. 2023-12-18T10:24:36.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.677+0000 7f0fcf206000 20 client.8406 trim_cache size 0 max 16384 2023-12-18T10:24:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.689+0000 7f0fcf206000 1 Processor -- start 2023-12-18T10:24:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.689+0000 7f0fcf206000 1 -- start start 2023-12-18T10:24:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.689+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9de6fc0 0x5647e9e43c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.689+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 0x5647e9e44180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.689+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e315a0 0x5647e9e2a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647e98f3aa0 con 0x5647e9de6fc0 2023-12-18T10:24:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647e9c794d0 con 0x5647e9e30c80 2023-12-18T10:24:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647e9d05140 con 0x5647e9e315a0 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9de6fc0 0x5647e9e43c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9de6fc0 0x5647e9e43c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45942/0 (socket says 172.21.15.133:45942) 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 -- 172.21.15.133:0/61676817 learned_addr learned my addr 172.21.15.133:0/61676817 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 -- 172.21.15.133:0/61676817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e315a0 msgr2=0x5647e9e2a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/61676817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e315a0 0x5647e9e2a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 -- 172.21.15.133:0/61676817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 msgr2=0x5647e9e44180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/61676817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 0x5647e9e44180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 -- 172.21.15.133:0/61676817 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647e9be15a0 con 0x5647e9de6fc0 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/61676817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9de6fc0 0x5647e9e43c40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0001980 tx=0x7f0fc000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d1764d761745d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fa7fff640 1 -- 172.21.15.133:0/61676817 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0030070 con 0x5647e9de6fc0 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fa7fff640 1 -- 172.21.15.133:0/61676817 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc0025040 con 0x5647e9de6fc0 2023-12-18T10:24:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fa7fff640 1 -- 172.21.15.133:0/61676817 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0024070 con 0x5647e9de6fc0 2023-12-18T10:24:36.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- 172.21.15.133:0/61676817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9de6fc0 msgr2=0x5647e9e43c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 --2- 172.21.15.133:0/61676817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9de6fc0 0x5647e9e43c40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0001980 tx=0x7f0fc000a000 comp rx=0 tx=0).stop 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- 172.21.15.133:0/61676817 shutdown_connections 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 --2- 172.21.15.133:0/61676817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e315a0 0x5647e9e2a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 --2- 172.21.15.133:0/61676817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9e30c80 0x5647e9e44180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 --2- 172.21.15.133:0/61676817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9de6fc0 0x5647e9e43c40 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- 172.21.15.133:0/61676817 >> 172.21.15.133:0/61676817 conn(0x5647e9be5910 msgr2=0x5647e9dec250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- 172.21.15.133:0/61676817 shutdown_connections 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- 172.21.15.133:0/61676817 wait complete. 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- start start 2023-12-18T10:24:36.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 Processor -- start 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9e8ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 0x5647e9e8f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e2cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647e9de6ae0 con 0x5647e9e315a0 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647e9c33b30 con 0x5647e9de6fc0 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647e9c31c90 con 0x5647e9e30c80 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.693+0000 7f0fcf206000 10 client.0 _ll_register_callbacks cb 0x5647e9bed710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fca432640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e2cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fc9c31640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9e8ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fc9430640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 0x5647e9e8f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fc9c31640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9e8ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:58760/0 (socket says 172.21.15.133:58760) 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fc9c31640 1 -- 172.21.15.133:0/2877480871 learned_addr learned my addr 172.21.15.133:0/2877480871 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fca432640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e2cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45944/0 (socket says 172.21.15.133:45944) 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fca432640 1 -- 172.21.15.133:0/2877480871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 msgr2=0x5647e9e8f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fca432640 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 0x5647e9e8f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fca432640 1 -- 172.21.15.133:0/2877480871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 msgr2=0x5647e9e8ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fca432640 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9e8ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fca432640 1 -- 172.21.15.133:0/2877480871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc0019040 con 0x5647e9e315a0 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9e8ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fca432640 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e2cc50 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc021040 tx=0x7f0fbc0014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84cff232cd3b500 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2877480871 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc003d90 con 0x5647e9e315a0 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2877480871 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fbc010d80 con 0x5647e9e315a0 2023-12-18T10:24:36.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 1 -- 172.21.15.133:0/2877480871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647e9dea940 con 0x5647e9e315a0 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2877480871 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fbc010610 con 0x5647e9e315a0 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 10 client.8412 fetch_fsmap learned FSMap version 91 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 1 -- 172.21.15.133:0/2877480871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x5647e9bd5110 con 0x5647e9e315a0 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2877480871 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5647e9dea940 con 0x5647e9e315a0 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2877480871 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 91) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0fbc02e060 con 0x5647e9e315a0 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 10 client.8412 fetch_fsmap finished waiting for FSMap version 91 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 10 client.8412 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 20 client.8412 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5647e9e2d190 0x5647e9e2d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 4 client.8412 mds_command: new command op to 8127 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fcf206000 1 -- 172.21.15.133:0/2877480871 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5647e9bff6a0 con 0x5647e9e2d190 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5647e9e2d190 0x5647e9e2d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fc9c31640 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5647e9e2d190 0x5647e9e2d5a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb5e78ec2142ff9 server_cookie=fee478181783182d in_seq=0 out_seq=0 2023-12-18T10:24:36.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.697+0000 7f0fa4ff9640 10 client.8412 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:36.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fa4ff9640 1 -- 172.21.15.133:0/2877480871 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5647e9bff6a0 con 0x5647e9e2d190 2023-12-18T10:24:36.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fa4ff9640 10 client.8412 handle_command_reply: tid=0 2023-12-18T10:24:36.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 client.8412 shutdown 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 -- 172.21.15.133:0/2877480871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 msgr2=0x5647e9e2cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e2cc50 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc021040 tx=0x7f0fbc0014e0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 -- 172.21.15.133:0/2877480871 shutdown_connections 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5647e9e2d190 0x5647e9e2d5a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5647e9e315a0 0x5647e9e2cc50 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5647e9e30c80 0x5647e9e8f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fa4ff9640 0 client.8412 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 --2- 172.21.15.133:0/2877480871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647e9de6fc0 0x5647e9e8ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 -- 172.21.15.133:0/2877480871 >> 172.21.15.133:0/2877480871 conn(0x5647e9be5910 msgr2=0x5647e9e42c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 -- 172.21.15.133:0/2877480871 shutdown_connections 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 1 -- 172.21.15.133:0/2877480871 wait complete. 2023-12-18T10:24:36.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcf206000 20 client.8412 trim_cache size 0 max 16384 2023-12-18T10:24:36.714 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:36.714 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:24:36.714 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:24:36.714 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 -- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fa8065a60 msgr2=0x7f0fa8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fa8065a60 0x7f0fa8067f20 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0007fd0 tx=0x7f0fc0007d60 comp rx=0 tx=0).stop 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 -- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc40ca410 msgr2=0x7f0fc40c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc40ca410 0x7f0fc40c1f50 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4019060 tx=0x7f0fb401ac90 comp rx=0 tx=0).stop 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 -- 172.21.15.133:0/3485632977 shutdown_connections 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0fa8065a60 0x7f0fa8067f20 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0fc40cbff0 0x7f0fc4156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fc40ca410 0x7f0fc40c1f50 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 --2- 172.21.15.133:0/3485632977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0fc4071870 0x7f0fc4149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 -- 172.21.15.133:0/3485632977 >> 172.21.15.133:0/3485632977 conn(0x7f0fc406a2a0 msgr2=0x7f0fc41581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 -- 172.21.15.133:0/3485632977 shutdown_connections 2023-12-18T10:24:36.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.713+0000 7f0fcbe95640 1 -- 172.21.15.133:0/3485632977 wait complete. 2023-12-18T10:24:36.731 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 flush journal 2023-12-18T10:24:36.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.869+0000 7feb78ff0640 1 Processor -- start 2023-12-18T10:24:36.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.869+0000 7feb78ff0640 1 -- start start 2023-12-18T10:24:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb78ff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb740ca410 0x7feb74159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb78ff0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb740cbff0 0x7feb740cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb78ff0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb74070df0 con 0x7feb74159fb0 2023-12-18T10:24:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb78ff0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7415aab0 con 0x7feb740cbff0 2023-12-18T10:24:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb78ff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb740cc980 con 0x7feb740ca410 2023-12-18T10:24:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb72d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb740cbff0 0x7feb740cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb72d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb740cbff0 0x7feb740cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45952/0 (socket says 172.21.15.133:45952) 2023-12-18T10:24:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb72d9d640 1 -- 172.21.15.133:0/2296456079 learned_addr learned my addr 172.21.15.133:0/2296456079 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb7259c640 1 --2- 172.21.15.133:0/2296456079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb740ca410 0x7feb74159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb72d9d640 1 -- 172.21.15.133:0/2296456079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb740ca410 msgr2=0x7feb74159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb72d9d640 1 --2- 172.21.15.133:0/2296456079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb740ca410 0x7feb74159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb72d9d640 1 -- 172.21.15.133:0/2296456079 >> v1:172.21.15.142:6789/0 conn(0x7feb74159fb0 legacy=0x7feb74071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.873+0000 7feb72d9d640 1 -- 172.21.15.133:0/2296456079 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7415a4f0 con 0x7feb740cbff0 2023-12-18T10:24:36.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb72d9d640 1 --2- 172.21.15.133:0/2296456079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb740cc440 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009e50 tx=0x7feb6c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8dc05b486a279f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb71d9b640 1 -- 172.21.15.133:0/2296456079 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0a58a0 con 0x7feb740cbff0 2023-12-18T10:24:36.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb71d9b640 1 -- 172.21.15.133:0/2296456079 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c0a5a00 con 0x7feb740cbff0 2023-12-18T10:24:36.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb71d9b640 1 -- 172.21.15.133:0/2296456079 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0a5d90 con 0x7feb740cbff0 2023-12-18T10:24:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 -- 172.21.15.133:0/2296456079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 msgr2=0x7feb740cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2296456079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb740cc440 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009e50 tx=0x7feb6c01c9e0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 -- 172.21.15.133:0/2296456079 shutdown_connections 2023-12-18T10:24:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2296456079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb740cc440 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2296456079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb740ca410 0x7feb74159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 -- 172.21.15.133:0/2296456079 >> 172.21.15.133:0/2296456079 conn(0x7feb7406a2a0 msgr2=0x7feb740aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 -- 172.21.15.133:0/2296456079 shutdown_connections 2023-12-18T10:24:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 -- 172.21.15.133:0/2296456079 wait complete. 2023-12-18T10:24:36.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 Processor -- start 2023-12-18T10:24:36.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.877+0000 7feb78ff0640 1 -- start start 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb78ff0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb740ca410 0x7feb740af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb78ff0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb74152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb78ff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb74159fb0 0x7feb740c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb78ff0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb740c2f20 con 0x7feb740cbff0 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb78ff0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb740c1f50 con 0x7feb740ca410 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb78ff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb740adad0 con 0x7feb74159fb0 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb74152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb74152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45956/0 (socket says 172.21.15.133:45956) 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 -- 172.21.15.133:0/2079466476 learned_addr learned my addr 172.21.15.133:0/2079466476 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb7259c640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb740ca410 0x7feb740af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb72d9d640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb74159fb0 0x7feb740c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 -- 172.21.15.133:0/2079466476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb74159fb0 msgr2=0x7feb740c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb74159fb0 0x7feb740c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 -- 172.21.15.133:0/2079466476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb740ca410 msgr2=0x7feb740af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb740ca410 0x7feb740af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 -- 172.21.15.133:0/2079466476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c009b30 con 0x7feb740cbff0 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6bfff640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb74152150 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00c500 tx=0x7feb5c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6affd640 1 -- 172.21.15.133:0/2079466476 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c005220 con 0x7feb740cbff0 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6affd640 1 -- 172.21.15.133:0/2079466476 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c005380 con 0x7feb740cbff0 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6affd640 1 -- 172.21.15.133:0/2079466476 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c007270 con 0x7feb740cbff0 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb78ff0640 1 -- 172.21.15.133:0/2079466476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb740c2960 con 0x7feb740cbff0 2023-12-18T10:24:36.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb78ff0640 1 -- 172.21.15.133:0/2079466476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb740c2160 con 0x7feb740cbff0 2023-12-18T10:24:36.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.881+0000 7feb6affd640 1 -- 172.21.15.133:0/2079466476 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb5c0073d0 con 0x7feb740cbff0 2023-12-18T10:24:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb6affd640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb6affd640 1 -- 172.21.15.133:0/2079466476 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb5c082a60 con 0x7feb740cbff0 2023-12-18T10:24:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 Processor -- start 2023-12-18T10:24:36.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7feb740af620 tx=0x7feb64009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 -- start start 2023-12-18T10:24:36.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b87c80 0x55ef21b88060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b885a0 0x55ef21b3da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 0x55ef21b3e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef21a06430 con 0x55ef21b87c80 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef21994460 con 0x55ef21b885a0 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef21991a30 con 0x55ef21b3dfc0 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b87c80 0x55ef21b88060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b87c80 0x55ef21b88060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45962/0 (socket says 172.21.15.133:45962) 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 -- 172.21.15.133:0/4002258850 learned_addr learned my addr 172.21.15.133:0/4002258850 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb72d9d640 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 0x55ef21b3e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb6bfff640 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b885a0 0x55ef21b3da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 -- 172.21.15.133:0/4002258850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 msgr2=0x55ef21b3e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 0x55ef21b3e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 -- 172.21.15.133:0/4002258850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b885a0 msgr2=0x55ef21b3da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b885a0 0x55ef21b3da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 -- 172.21.15.133:0/4002258850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef21689e20 con 0x55ef21b87c80 2023-12-18T10:24:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7259c640 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b87c80 0x55ef21b88060 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7feb64011d80 tx=0x7feb64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7562b7ebf2a8aedf server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb53fff640 1 -- 172.21.15.133:0/4002258850 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64014bd0 con 0x55ef21b87c80 2023-12-18T10:24:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb53fff640 1 -- 172.21.15.133:0/4002258850 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64014d30 con 0x55ef21b87c80 2023-12-18T10:24:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb53fff640 1 -- 172.21.15.133:0/4002258850 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64014ea0 con 0x55ef21b87c80 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 -- 172.21.15.133:0/4002258850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b87c80 msgr2=0x55ef21b88060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.885+0000 7feb7c353000 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b87c80 0x55ef21b88060 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7feb64011d80 tx=0x7feb64014000 comp rx=0 tx=0).stop 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- 172.21.15.133:0/4002258850 shutdown_connections 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 0x55ef21b3e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b885a0 0x55ef21b3da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 --2- 172.21.15.133:0/4002258850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b87c80 0x55ef21b88060 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- 172.21.15.133:0/4002258850 >> 172.21.15.133:0/4002258850 conn(0x55ef2193c910 msgr2=0x55ef21b3c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- 172.21.15.133:0/4002258850 shutdown_connections 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- 172.21.15.133:0/4002258850 wait complete. 2023-12-18T10:24:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- start start 2023-12-18T10:24:36.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 Processor -- start 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21b8f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b88980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2198d320 con 0x55ef21b3dfc0 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2192c4f0 con 0x55ef21b87c80 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef2194a6e0 con 0x55ef21b885a0 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 10 client.0 _ll_register_callbacks cb 0x55ef21b29980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45978/0 (socket says 172.21.15.133:45978) 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 -- 172.21.15.133:0/1278519843 learned_addr learned my addr 172.21.15.133:0/1278519843 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb6bfff640 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21b8f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb72d9d640 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b88980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 -- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 msgr2=0x55ef21b88980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b88980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 -- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 msgr2=0x55ef21b8f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21b8f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 -- 172.21.15.133:0/1278519843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb64011a60 con 0x55ef21b3dfc0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7259c640 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8f0c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7feb64014810 tx=0x7feb64004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2772c07d9fac888a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb517fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb517fa640 1 -- 172.21.15.133:0/1278519843 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6402e070 con 0x55ef21b3dfc0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb517fa640 1 -- 172.21.15.133:0/1278519843 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb6401c040 con 0x55ef21b3dfc0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- 172.21.15.133:0/1278519843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef2194a120 con 0x55ef21b3dfc0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb517fa640 1 -- 172.21.15.133:0/1278519843 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb64003620 con 0x55ef21b3dfc0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 10 client.8424 fetch_fsmap learned FSMap version 91 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.889+0000 7feb7c353000 1 -- 172.21.15.133:0/1278519843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55ef21952250 con 0x55ef21b3dfc0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb517fa640 1 -- 172.21.15.133:0/1278519843 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ef2194a120 con 0x55ef21b3dfc0 2023-12-18T10:24:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb517fa640 1 -- 172.21.15.133:0/1278519843 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 91) v1 ==== 3150+0+0 (secure 0 0 0) 0x7feb64003780 con 0x55ef21b3dfc0 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 10 client.8424 fetch_fsmap finished waiting for FSMap version 91 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 10 client.8424 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 20 client.8424 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55ef21b896f0 0x55ef21b89b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 4 client.8424 mds_command: new command op to 8118 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 -- 172.21.15.133:0/1278519843 --> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef2198bc70 con 0x55ef21b896f0 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb6bfff640 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55ef21b896f0 0x55ef21b89b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb517fa640 10 client.8424 ms_handle_connect on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb6bfff640 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55ef21b896f0 0x55ef21b89b00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c5b9b79530be56d server_cookie=9102dd17e1f9913a in_seq=0 out_seq=0 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb517fa640 1 -- 172.21.15.133:0/1278519843 <== mds.1 v2:172.21.15.142:6833/4118520914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ef2198bc70 con 0x55ef21b896f0 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb517fa640 10 client.8424 handle_command_reply: tid=0 2023-12-18T10:24:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 client.8424 shutdown 2023-12-18T10:24:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 -- 172.21.15.133:0/1278519843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 msgr2=0x55ef21b8f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8f0c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7feb64014810 tx=0x7feb64004740 comp rx=0 tx=0).stop 2023-12-18T10:24:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 -- 172.21.15.133:0/1278519843 shutdown_connections 2023-12-18T10:24:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55ef21b896f0 0x55ef21b89b00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b88980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21b8f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 --2- 172.21.15.133:0/1278519843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8f0c0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb517fa640 0 client.8424 ms_handle_reset on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 -- 172.21.15.133:0/1278519843 >> 172.21.15.133:0/1278519843 conn(0x55ef2193c910 msgr2=0x55ef21b3ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 -- 172.21.15.133:0/1278519843 shutdown_connections 2023-12-18T10:24:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 1 -- 172.21.15.133:0/1278519843 wait complete. 2023-12-18T10:24:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.893+0000 7feb7c353000 20 client.8424 trim_cache size 0 max 16384 2023-12-18T10:24:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7c353000 1 Processor -- start 2023-12-18T10:24:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7c353000 1 -- start start 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7c353000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7c353000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21b8d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7c353000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b81010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7c353000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2164aaa0 con 0x55ef21b3dfc0 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7c353000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef219956f0 con 0x55ef21b87c80 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7c353000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef21a44e50 con 0x55ef21b885a0 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45986/0 (socket says 172.21.15.133:45986) 2023-12-18T10:24:36.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.905+0000 7feb7259c640 1 -- 172.21.15.133:0/3465010061 learned_addr learned my addr 172.21.15.133:0/3465010061 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb6bfff640 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21b8d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb72d9d640 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b81010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7259c640 1 -- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 msgr2=0x55ef21b81010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7259c640 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b81010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7259c640 1 -- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 msgr2=0x55ef21b8d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7259c640 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21b8d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7259c640 1 -- 172.21.15.133:0/3465010061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef219385a0 con 0x55ef21b3dfc0 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb72d9d640 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b81010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7259c640 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8caf0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7feb640047c0 tx=0x7feb6402b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78f9fb18e3fcde1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb68ff9640 1 -- 172.21.15.133:0/3465010061 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64003820 con 0x55ef21b3dfc0 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb68ff9640 1 -- 172.21.15.133:0/3465010061 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64004240 con 0x55ef21b3dfc0 2023-12-18T10:24:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb68ff9640 1 -- 172.21.15.133:0/3465010061 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64032610 con 0x55ef21b3dfc0 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- 172.21.15.133:0/3465010061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 msgr2=0x55ef21b8caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8caf0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7feb640047c0 tx=0x7feb6402b050 comp rx=0 tx=0).stop 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- 172.21.15.133:0/3465010061 shutdown_connections 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b885a0 0x55ef21b81010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21b8d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 --2- 172.21.15.133:0/3465010061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b3dfc0 0x55ef21b8caf0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- 172.21.15.133:0/3465010061 >> 172.21.15.133:0/3465010061 conn(0x55ef2193c910 msgr2=0x55ef21b431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- 172.21.15.133:0/3465010061 shutdown_connections 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- 172.21.15.133:0/3465010061 wait complete. 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- start start 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 Processor -- start 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 0x55ef21be51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21be5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b885a0 0x55ef21b83740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef21a5c140 con 0x55ef21b885a0 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef2198ab30 con 0x55ef21b87c80 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef21b3dae0 con 0x55ef21b3dfc0 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7c353000 10 client.0 _ll_register_callbacks cb 0x55ef21944710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb72d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b885a0 0x55ef21b83740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb72d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b885a0 0x55ef21b83740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45998/0 (socket says 172.21.15.133:45998) 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb72d9d640 1 -- 172.21.15.133:0/4283979728 learned_addr learned my addr 172.21.15.133:0/4283979728 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb7259c640 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 0x55ef21be51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.909+0000 7feb6bfff640 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21be5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb72d9d640 1 -- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 msgr2=0x55ef21be51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb72d9d640 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 0x55ef21be51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb72d9d640 1 -- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 msgr2=0x55ef21be5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:36.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb72d9d640 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21be5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb72d9d640 1 -- 172.21.15.133:0/4283979728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef21952250 con 0x55ef21b885a0 2023-12-18T10:24:36.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb72d9d640 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b885a0 0x55ef21b83740 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0af040 tx=0x7feb6c01b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25714ef44e28583c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:36.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb517fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:36.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb517fa640 1 -- 172.21.15.133:0/4283979728 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0c0680 con 0x55ef21b885a0 2023-12-18T10:24:36.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb517fa640 1 -- 172.21.15.133:0/4283979728 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb6c0bb040 con 0x55ef21b885a0 2023-12-18T10:24:36.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 1 -- 172.21.15.133:0/4283979728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef219566a0 con 0x55ef21b885a0 2023-12-18T10:24:36.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb517fa640 1 -- 172.21.15.133:0/4283979728 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb6c0c07e0 con 0x55ef21b885a0 2023-12-18T10:24:36.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 10 client.8430 fetch_fsmap learned FSMap version 91 2023-12-18T10:24:36.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 1 -- 172.21.15.133:0/4283979728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55ef2192c110 con 0x55ef21b885a0 2023-12-18T10:24:36.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb517fa640 1 -- 172.21.15.133:0/4283979728 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ef219566a0 con 0x55ef21b885a0 2023-12-18T10:24:36.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb517fa640 1 -- 172.21.15.133:0/4283979728 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 91) v1 ==== 3150+0+0 (secure 0 0 0) 0x7feb6c0c0940 con 0x55ef21b885a0 2023-12-18T10:24:36.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 10 client.8430 fetch_fsmap finished waiting for FSMap version 91 2023-12-18T10:24:36.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 10 client.8430 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-12-18T10:24:36.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 20 client.8430 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:36.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55ef21b83c80 0x55ef21b84090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:36.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 4 client.8430 mds_command: new command op to 8118 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:24:36.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7c353000 1 -- 172.21.15.133:0/4283979728 --> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ef219863a0 con 0x55ef21b83c80 2023-12-18T10:24:36.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7259c640 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55ef21b83c80 0x55ef21b84090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:36.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb7259c640 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55ef21b83c80 0x55ef21b84090 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6eb549c445285875 server_cookie=2436a20decb868d8 in_seq=0 out_seq=0 2023-12-18T10:24:36.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.913+0000 7feb517fa640 10 client.8430 ms_handle_connect on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:36.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb517fa640 1 -- 172.21.15.133:0/4283979728 <== mds.1 v2:172.21.15.142:6833/4118520914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ef219863a0 con 0x55ef21b83c80 2023-12-18T10:24:36.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb517fa640 10 client.8430 handle_command_reply: tid=0 2023-12-18T10:24:36.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 client.8430 shutdown 2023-12-18T10:24:36.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 -- 172.21.15.133:0/4283979728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b885a0 msgr2=0x55ef21b83740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b885a0 0x55ef21b83740 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0af040 tx=0x7feb6c01b220 comp rx=0 tx=0).stop 2023-12-18T10:24:36.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 -- 172.21.15.133:0/4283979728 shutdown_connections 2023-12-18T10:24:36.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55ef21b83c80 0x55ef21b84090 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ef21b885a0 0x55ef21b83740 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef21b87c80 0x55ef21be5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 --2- 172.21.15.133:0/4283979728 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ef21b3dfc0 0x55ef21be51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb517fa640 0 client.8430 ms_handle_reset on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:36.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 -- 172.21.15.133:0/4283979728 >> 172.21.15.133:0/4283979728 conn(0x55ef2193c910 msgr2=0x55ef21b438f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 -- 172.21.15.133:0/4283979728 shutdown_connections 2023-12-18T10:24:36.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 1 -- 172.21.15.133:0/4283979728 wait complete. 2023-12-18T10:24:36.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb7c353000 20 client.8430 trim_cache size 0 max 16384 2023-12-18T10:24:36.924 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:36.924 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:24:36.924 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:24:36.924 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:36.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb78ff0640 1 -- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 msgr2=0x7feb54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7feb740af620 tx=0x7feb64009190 comp rx=0 tx=0).stop 2023-12-18T10:24:36.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb78ff0640 1 -- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 msgr2=0x7feb74152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:36.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.921+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb74152150 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00c500 tx=0x7feb5c00c9c0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.925+0000 7feb78ff0640 1 -- 172.21.15.133:0/2079466476 shutdown_connections 2023-12-18T10:24:36.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.925+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feb54065a60 0x7feb54067f20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.925+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feb74159fb0 0x7feb740c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.925+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb740cbff0 0x7feb74152150 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.925+0000 7feb78ff0640 1 --2- 172.21.15.133:0/2079466476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb740ca410 0x7feb740af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:36.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.925+0000 7feb78ff0640 1 -- 172.21.15.133:0/2079466476 >> 172.21.15.133:0/2079466476 conn(0x7feb7406a2a0 msgr2=0x7feb74156780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:36.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.925+0000 7feb78ff0640 1 -- 172.21.15.133:0/2079466476 shutdown_connections 2023-12-18T10:24:36.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:36.925+0000 7feb78ff0640 1 -- 172.21.15.133:0/2079466476 wait complete. 2023-12-18T10:24:36.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 flush journal 2023-12-18T10:24:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6f056d640 1 Processor -- start 2023-12-18T10:24:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6f056d640 1 -- start start 2023-12-18T10:24:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6f056d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6f056d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6e80cbff0 0x7fc6e80cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6f056d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e8070df0 con 0x7fc6e8159fb0 2023-12-18T10:24:37.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6f056d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e815aab0 con 0x7fc6e80cbff0 2023-12-18T10:24:37.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6f056d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80cc980 con 0x7fc6e80ca410 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6eeb0a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6e80cbff0 0x7fc6e80cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6ee309640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6eeb0a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc6e80cbff0 0x7fc6e80cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:58824/0 (socket says 172.21.15.133:58824) 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.081+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/2730422471 learned_addr learned my addr 172.21.15.133:0/2730422471 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/2730422471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 msgr2=0x7fc6e8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/2730422471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e8159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/2730422471 >> v1:172.21.15.142:6789/0 conn(0x7fc6e8159fb0 legacy=0x7fc6e8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/2730422471 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e815a4f0 con 0x7fc6e80cbff0 2023-12-18T10:24:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6ed307640 1 -- 172.21.15.133:0/2730422471 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532213866 0 0) 0x7fc6e8070df0 con 0x7fc6e8159fb0 2023-12-18T10:24:37.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/2730422471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 0x7fc6e80cc440 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d150 tx=0x7fc6e001ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da78cf82f91f7574 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:37.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6ed307640 1 -- 172.21.15.133:0/2730422471 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000b2d0 con 0x7fc6e80cbff0 2023-12-18T10:24:37.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6ed307640 1 -- 172.21.15.133:0/2730422471 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000b430 con 0x7fc6e80cbff0 2023-12-18T10:24:37.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6ed307640 1 -- 172.21.15.133:0/2730422471 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00a7cd0 con 0x7fc6e80cbff0 2023-12-18T10:24:37.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6f056d640 1 -- 172.21.15.133:0/2730422471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 msgr2=0x7fc6e80cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.085+0000 7fc6f056d640 1 --2- 172.21.15.133:0/2730422471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 0x7fc6e80cc440 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d150 tx=0x7fc6e001ebe0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 -- 172.21.15.133:0/2730422471 shutdown_connections 2023-12-18T10:24:37.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 --2- 172.21.15.133:0/2730422471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 0x7fc6e80cc440 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 --2- 172.21.15.133:0/2730422471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 -- 172.21.15.133:0/2730422471 >> 172.21.15.133:0/2730422471 conn(0x7fc6e806a2a0 msgr2=0x7fc6e80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:37.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 -- 172.21.15.133:0/2730422471 shutdown_connections 2023-12-18T10:24:37.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 -- 172.21.15.133:0/2730422471 wait complete. 2023-12-18T10:24:37.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 Processor -- start 2023-12-18T10:24:37.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 -- start start 2023-12-18T10:24:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 0x7fc6e814dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e8159fb0 0x7fc6e814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8157b20 con 0x7fc6e8159fb0 2023-12-18T10:24:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8157e00 con 0x7fc6e80cbff0 2023-12-18T10:24:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6f056d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81580e0 con 0x7fc6e80ca410 2023-12-18T10:24:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e8159fb0 0x7fc6e814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6ee309640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e8159fb0 0x7fc6e814f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46004/0 (socket says 172.21.15.133:46004) 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6ee309640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e815b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:59658/0 (socket says 172.21.15.133:59658) 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/3520319510 learned_addr learned my addr 172.21.15.133:0/3520319510 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6edb08640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 0x7fc6e814dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/3520319510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 msgr2=0x7fc6e815b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e815b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/3520319510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 msgr2=0x7fc6e814dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 0x7fc6e814dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/3520319510 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e000bd40 con 0x7fc6e8159fb0 2023-12-18T10:24:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.089+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e8159fb0 0x7fc6e814f6e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00b1040 tx=0x7fc6e001b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.093+0000 7fc6deffd640 1 -- 172.21.15.133:0/3520319510 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0003ba0 con 0x7fc6e8159fb0 2023-12-18T10:24:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.093+0000 7fc6deffd640 1 -- 172.21.15.133:0/3520319510 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0003d00 con 0x7fc6e8159fb0 2023-12-18T10:24:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.093+0000 7fc6deffd640 1 -- 172.21.15.133:0/3520319510 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0004220 con 0x7fc6e8159fb0 2023-12-18T10:24:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.093+0000 7fc6f056d640 1 -- 172.21.15.133:0/3520319510 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e81583c0 con 0x7fc6e8159fb0 2023-12-18T10:24:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.093+0000 7fc6f056d640 1 -- 172.21.15.133:0/3520319510 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e815b820 con 0x7fc6e8159fb0 2023-12-18T10:24:37.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.093+0000 7fc6deffd640 1 -- 172.21.15.133:0/3520319510 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc6e0004380 con 0x7fc6e8159fb0 2023-12-18T10:24:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.093+0000 7fc6deffd640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6cc065a60 0x7fc6cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.093+0000 7fc6deffd640 1 -- 172.21.15.133:0/3520319510 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6e011dfb0 con 0x7fc6e8159fb0 2023-12-18T10:24:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6ee309640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6cc065a60 0x7fc6cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 Processor -- start 2023-12-18T10:24:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6ee309640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6cc065a60 0x7fc6cc067f20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009ac0 tx=0x7fc6e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- start start 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60181c80 0x559c60182060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c60137a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 0x559c601383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c60000430 con 0x559c601825a0 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c5ff8e460 con 0x559c60181c80 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c5ff8ba30 con 0x559c60137fc0 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c60137a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c60137a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46016/0 (socket says 172.21.15.133:46016) 2023-12-18T10:24:37.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 -- 172.21.15.133:0/2882346220 learned_addr learned my addr 172.21.15.133:0/2882346220 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 0x559c601383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6ee309640 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60181c80 0x559c60182060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 -- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 msgr2=0x559c601383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 0x559c601383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 -- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60181c80 msgr2=0x559c60182060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60181c80 0x559c60182060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 -- 172.21.15.133:0/2882346220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c5fc83e20 con 0x559c601825a0 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6ee309640 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60181c80 0x559c60182060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6edb08640 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c60137a80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8007fd0 tx=0x7fc6d8007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4397cdb338255aac server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6cbfff640 1 -- 172.21.15.133:0/2882346220 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80052e0 con 0x559c601825a0 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6cbfff640 1 -- 172.21.15.133:0/2882346220 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8005440 con 0x559c601825a0 2023-12-18T10:24:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6cbfff640 1 -- 172.21.15.133:0/2882346220 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800fa40 con 0x559c601825a0 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- 172.21.15.133:0/2882346220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 msgr2=0x559c60137a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c60137a80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8007fd0 tx=0x7fc6d8007d40 comp rx=0 tx=0).stop 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- 172.21.15.133:0/2882346220 shutdown_connections 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 0x559c601383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c60137a80 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/2882346220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60181c80 0x559c60182060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- 172.21.15.133:0/2882346220 >> 172.21.15.133:0/2882346220 conn(0x559c5ff36910 msgr2=0x559c60136360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- 172.21.15.133:0/2882346220 shutdown_connections 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.097+0000 7fc6f38c8000 1 -- 172.21.15.133:0/2882346220 wait complete. 2023-12-18T10:24:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 -- start start 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 Processor -- start 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 0x559c60182980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60181c80 0x559c60182ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c60183400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c5ff87320 con 0x559c60181c80 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c5ff264f0 con 0x559c601825a0 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c5ff446e0 con 0x559c60137fc0 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 10 client.0 _ll_register_callbacks cb 0x559c60123980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60181c80 0x559c60182ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60181c80 0x559c60182ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46018/0 (socket says 172.21.15.133:46018) 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 -- 172.21.15.133:0/4190811917 learned_addr learned my addr 172.21.15.133:0/4190811917 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6ee309640 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 0x559c60182980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c60183400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 -- 172.21.15.133:0/4190811917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 msgr2=0x559c60182980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 0x559c60182980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 -- 172.21.15.133:0/4190811917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 msgr2=0x559c60183400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c60183400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 -- 172.21.15.133:0/4190811917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d8001530 con 0x559c60181c80 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6edb08640 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60181c80 0x559c60182ec0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8007d80 tx=0x7fc6d8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cfab07008f5b4a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6c97fa640 1 -- 172.21.15.133:0/4190811917 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8007050 con 0x559c60181c80 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6c97fa640 1 -- 172.21.15.133:0/4190811917 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6d80071b0 con 0x559c60181c80 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 -- 172.21.15.133:0/4190811917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c5ff44120 con 0x559c60181c80 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6c97fa640 1 -- 172.21.15.133:0/4190811917 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6d8007390 con 0x559c60181c80 2023-12-18T10:24:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 10 client.8439 fetch_fsmap learned FSMap version 91 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 -- 172.21.15.133:0/4190811917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x559c5ff4c250 con 0x559c60181c80 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6c97fa640 1 -- 172.21.15.133:0/4190811917 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c5ff44120 con 0x559c60181c80 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6c97fa640 1 -- 172.21.15.133:0/4190811917 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 91) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fc6d8012070 con 0x559c60181c80 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 10 client.8439 fetch_fsmap finished waiting for FSMap version 91 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 10 client.8439 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.c 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 20 client.8439 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x559c60191840 0x559c60193c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 4 client.8439 mds_command: new command op to 8109 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6f38c8000 1 -- 172.21.15.133:0/4190811917 --> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c5ff85c70 con 0x559c60191840 2023-12-18T10:24:37.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.101+0000 7fc6ee309640 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x559c60191840 0x559c60193c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6ee309640 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x559c60191840 0x559c60193c30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ac36163d7510212 server_cookie=6874a6ad6304aa0b in_seq=0 out_seq=0 2023-12-18T10:24:37.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6c97fa640 10 client.8439 ms_handle_connect on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:37.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6c97fa640 1 -- 172.21.15.133:0/4190811917 <== mds.2 v2:172.21.15.133:6834/1695888167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559c5ff85c70 con 0x559c60191840 2023-12-18T10:24:37.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6c97fa640 10 client.8439 handle_command_reply: tid=0 2023-12-18T10:24:37.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 client.8439 shutdown 2023-12-18T10:24:37.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 -- 172.21.15.133:0/4190811917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60181c80 msgr2=0x559c60182ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60181c80 0x559c60182ec0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8007d80 tx=0x7fc6d8000ee0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 -- 172.21.15.133:0/4190811917 shutdown_connections 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x559c60191840 0x559c60193c30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c60183400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60181c80 0x559c60182ec0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6c97fa640 0 client.8439 ms_handle_reset on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/4190811917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60137fc0 0x559c60182980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 -- 172.21.15.133:0/4190811917 >> 172.21.15.133:0/4190811917 conn(0x559c5ff36910 msgr2=0x559c60136a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 -- 172.21.15.133:0/4190811917 shutdown_connections 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 1 -- 172.21.15.133:0/4190811917 wait complete. 2023-12-18T10:24:37.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.105+0000 7fc6f38c8000 20 client.8439 trim_cache size 0 max 16384 2023-12-18T10:24:37.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6f38c8000 1 Processor -- start 2023-12-18T10:24:37.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6f38c8000 1 -- start start 2023-12-18T10:24:37.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60137fc0 0x559c60194c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 0x559c60195180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c6017b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c5fc44aa0 con 0x559c60137fc0 2023-12-18T10:24:37.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c5ff84b30 con 0x559c601825a0 2023-12-18T10:24:37.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c5ff861b0 con 0x559c60181c80 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60137fc0 0x559c60194c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60137fc0 0x559c60194c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46030/0 (socket says 172.21.15.133:46030) 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 -- 172.21.15.133:0/1728115209 learned_addr learned my addr 172.21.15.133:0/1728115209 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6edb08640 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 0x559c60195180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c6017b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 -- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 msgr2=0x559c60195180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 0x559c60195180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 -- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 msgr2=0x559c6017b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c6017b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 -- 172.21.15.133:0/1728115209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c5ff325a0 con 0x559c60137fc0 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c6017b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6ee309640 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60137fc0 0x559c60194c40 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4011a70 tx=0x7fc6e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74f206f5a7bec7c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6dcff9640 1 -- 172.21.15.133:0/1728115209 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e401c040 con 0x559c60137fc0 2023-12-18T10:24:37.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6dcff9640 1 -- 172.21.15.133:0/1728115209 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e402a300 con 0x559c60137fc0 2023-12-18T10:24:37.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.117+0000 7fc6dcff9640 1 -- 172.21.15.133:0/1728115209 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4003960 con 0x559c60137fc0 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1728115209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60137fc0 msgr2=0x559c60194c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60137fc0 0x559c60194c40 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4011a70 tx=0x7fc6e4016000 comp rx=0 tx=0).stop 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1728115209 shutdown_connections 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c601825a0 0x559c6017b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 0x559c60195180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1728115209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c60137fc0 0x559c60194c40 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1728115209 >> 172.21.15.133:0/1728115209 conn(0x559c5ff36910 msgr2=0x559c6013d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1728115209 shutdown_connections 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1728115209 wait complete. 2023-12-18T10:24:37.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- start start 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 Processor -- start 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60137fc0 0x559c601db5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 0x559c6017e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c6017e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c6018eec0 con 0x559c601825a0 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c5ff84720 con 0x559c60137fc0 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c60183900 con 0x559c60181c80 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 10 client.0 _ll_register_callbacks cb 0x559c5ff3e710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c6017e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c6017e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46038/0 (socket says 172.21.15.133:46038) 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/1568799006 learned_addr learned my addr 172.21.15.133:0/1568799006 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:37.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6ee309640 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60137fc0 0x559c601db5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6edb08640 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 0x559c6017e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/1568799006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 msgr2=0x559c6017e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 0x559c6017e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/1568799006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60137fc0 msgr2=0x559c601db5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60137fc0 0x559c601db5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 -- 172.21.15.133:0/1568799006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e40041e0 con 0x559c601825a0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6eeb0a640 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c6017e730 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fc6e001c810 tx=0x7fc6e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53bc7c1ba836f4b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6c97fa640 1 -- 172.21.15.133:0/1568799006 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0004830 con 0x559c601825a0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6c97fa640 1 -- 172.21.15.133:0/1568799006 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6e00ee9f0 con 0x559c601825a0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1568799006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c6013b8e0 con 0x559c601825a0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6c97fa640 1 -- 172.21.15.133:0/1568799006 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6e00eebb0 con 0x559c601825a0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 10 client.8445 fetch_fsmap learned FSMap version 91 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.121+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1568799006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x559c5ff26110 con 0x559c601825a0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6c97fa640 1 -- 172.21.15.133:0/1568799006 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c6013b8e0 con 0x559c601825a0 2023-12-18T10:24:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6c97fa640 1 -- 172.21.15.133:0/1568799006 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 91) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fc6e0005d20 con 0x559c601825a0 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6f38c8000 10 client.8445 fetch_fsmap finished waiting for FSMap version 91 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6f38c8000 10 client.8445 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.c 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6f38c8000 20 client.8445 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x559c6017ec70 0x559c6017f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6f38c8000 4 client.8445 mds_command: new command op to 8109 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1568799006 --> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559c5ff506a0 con 0x559c6017ec70 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6ee309640 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x559c6017ec70 0x559c6017f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6ee309640 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x559c6017ec70 0x559c6017f080 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=99a48a5a9c5ef873 server_cookie=e19cec018424b67e in_seq=0 out_seq=0 2023-12-18T10:24:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.125+0000 7fc6c97fa640 10 client.8445 ms_handle_connect on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6c97fa640 1 -- 172.21.15.133:0/1568799006 <== mds.2 v2:172.21.15.133:6834/1695888167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559c5ff506a0 con 0x559c6017ec70 2023-12-18T10:24:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6c97fa640 10 client.8445 handle_command_reply: tid=0 2023-12-18T10:24:37.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 client.8445 shutdown 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1568799006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 msgr2=0x559c6017e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c6017e730 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fc6e001c810 tx=0x7fc6e000b040 comp rx=0 tx=0).stop 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1568799006 shutdown_connections 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x559c6017ec70 0x559c6017f080 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x559c601825a0 0x559c6017e730 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x559c60181c80 0x559c6017e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 --2- 172.21.15.133:0/1568799006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559c60137fc0 0x559c601db5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6c97fa640 0 client.8445 ms_handle_reset on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1568799006 >> 172.21.15.133:0/1568799006 conn(0x559c5ff36910 msgr2=0x559c60193c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1568799006 shutdown_connections 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 1 -- 172.21.15.133:0/1568799006 wait complete. 2023-12-18T10:24:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f38c8000 20 client.8445 trim_cache size 0 max 16384 2023-12-18T10:24:37.134 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:37.134 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:24:37.134 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:24:37.134 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 -- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6cc065a60 msgr2=0x7fc6cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6cc065a60 0x7fc6cc067f20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009ac0 tx=0x7fc6e4009190 comp rx=0 tx=0).stop 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 -- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e8159fb0 msgr2=0x7fc6e814f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e8159fb0 0x7fc6e814f6e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00b1040 tx=0x7fc6e001b980 comp rx=0 tx=0).stop 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 -- 172.21.15.133:0/3520319510 shutdown_connections 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6cc065a60 0x7fc6cc067f20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e8159fb0 0x7fc6e814f6e0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6e80cbff0 0x7fc6e814dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 --2- 172.21.15.133:0/3520319510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6e80ca410 0x7fc6e815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 -- 172.21.15.133:0/3520319510 >> 172.21.15.133:0/3520319510 conn(0x7fc6e806a2a0 msgr2=0x7fc6e80aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 -- 172.21.15.133:0/3520319510 shutdown_connections 2023-12-18T10:24:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:37.133+0000 7fc6f056d640 1 -- 172.21.15.133:0/3520319510 wait complete. 2023-12-18T10:24:37.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:24:37.152 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-12-18T10:24:37.185 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/ 2023-12-18T10:24:37.186 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4 2023-12-18T10:24:37.186 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5 2023-12-18T10:24:37.186 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6 2023-12-18T10:24:37.186 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7 2023-12-18T10:24:37.186 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-12-18T10:24:37.187 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:24:37.187 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:24:37.187 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:24:37.187 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:37.187 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-12-18T10:24:37.187 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:24:37.295 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627778 2023-12-18T10:24:37.485 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:24:37.485 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:24:37.485 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:24:37.485 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:37.485 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-12-18T10:24:37.485 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:24:37.594 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627779 2023-12-18T10:24:37.784 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:24:37.784 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:24:37.784 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:24:37.784 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:37.784 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-12-18T10:24:37.784 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:24:37.892 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627780 2023-12-18T10:24:38.080 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:24:38.080 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:24:38.080 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:24:38.080 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:38.080 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-12-18T10:24:38.080 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:24:38.187 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627781 2023-12-18T10:24:38.376 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:24:38.376 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:24:38.376 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:24:38.376 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:38.376 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-12-18T10:24:38.376 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:24:38.487 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627782 2023-12-18T10:24:38.676 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:24:38.676 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:24:38.676 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:24:38.676 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:24:38.676 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-12-18T10:24:38.676 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:24:38.783 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627783 2023-12-18T10:24:38.972 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2023-12-18T10:24:39.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a487fa080 1 Processor -- start 2023-12-18T10:24:39.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a487fa080 1 -- start start 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a487fa080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d661220 0x55f91d6e6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a487fa080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d663190 0x55f91d6e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a487fa080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d7092b0 0x55f91d6e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a487fa080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f91d5df9c0 con 0x55f91d663190 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a487fa080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f91d57b4d0 con 0x55f91d661220 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a487fa080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f91d57b1d0 con 0x55f91d7092b0 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a45b13640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d663190 0x55f91d6e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a45b13640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d663190 0x55f91d6e9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46052/0 (socket says 172.21.15.133:46052) 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a45b13640 1 -- 172.21.15.133:0/2046161986 learned_addr learned my addr 172.21.15.133:0/2046161986 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a46314640 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d661220 0x55f91d6e6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a46b15640 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d7092b0 0x55f91d6e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a45b13640 1 -- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d7092b0 msgr2=0x55f91d6e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a45b13640 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d7092b0 0x55f91d6e9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a45b13640 1 -- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d661220 msgr2=0x55f91d6e6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a45b13640 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d661220 0x55f91d6e6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a45b13640 1 -- 172.21.15.133:0/2046161986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c005d30 con 0x55f91d663190 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a46b15640 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d7092b0 0x55f91d6e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.061+0000 7f7a46314640 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d661220 0x55f91d6e6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a45b13640 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d663190 0x55f91d6e9700 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00a530 tx=0x7f7a3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad87b30c9a1829b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a44b11640 1 -- 172.21.15.133:0/2046161986 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c009420 con 0x55f91d663190 2023-12-18T10:24:39.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a44b11640 1 -- 172.21.15.133:0/2046161986 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c009580 con 0x55f91d663190 2023-12-18T10:24:39.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a44b11640 1 -- 172.21.15.133:0/2046161986 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c009910 con 0x55f91d663190 2023-12-18T10:24:39.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- 172.21.15.133:0/2046161986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d663190 msgr2=0x55f91d6e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d663190 0x55f91d6e9700 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00a530 tx=0x7f7a3c003030 comp rx=0 tx=0).stop 2023-12-18T10:24:39.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- 172.21.15.133:0/2046161986 shutdown_connections 2023-12-18T10:24:39.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d7092b0 0x55f91d6e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d663190 0x55f91d6e9700 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 --2- 172.21.15.133:0/2046161986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d661220 0x55f91d6e6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- 172.21.15.133:0/2046161986 >> 172.21.15.133:0/2046161986 conn(0x55f91d65fe00 msgr2=0x55f91d664cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- 172.21.15.133:0/2046161986 shutdown_connections 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- 172.21.15.133:0/2046161986 wait complete. 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 Processor -- start 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- start start 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d661220 0x55f91d6e8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d663190 0x55f91d635060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d7092b0 0x55f91d6feec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f91d571e40 con 0x55f91d7092b0 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f91d6e8c60 con 0x55f91d663190 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a487fa080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f91d706500 con 0x55f91d661220 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d7092b0 0x55f91d6feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d7092b0 0x55f91d6feec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46062/0 (socket says 172.21.15.133:46062) 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 -- 172.21.15.133:0/3018335122 learned_addr learned my addr 172.21.15.133:0/3018335122 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a45b13640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d663190 0x55f91d635060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46314640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d661220 0x55f91d6e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 -- 172.21.15.133:0/3018335122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d661220 msgr2=0x55f91d6e8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f91d661220 0x55f91d6e8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 -- 172.21.15.133:0/3018335122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d663190 msgr2=0x55f91d635060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f91d663190 0x55f91d635060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 -- 172.21.15.133:0/3018335122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f91d58a070 con 0x55f91d7092b0 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.065+0000 7f7a46b15640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d7092b0 0x55f91d6feec0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000d240 tx=0x7f7a4000d700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a377fe640 1 -- 172.21.15.133:0/3018335122 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000de70 con 0x55f91d7092b0 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a377fe640 1 -- 172.21.15.133:0/3018335122 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a400032e0 con 0x55f91d7092b0 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a377fe640 1 -- 172.21.15.133:0/3018335122 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40001660 con 0x55f91d7092b0 2023-12-18T10:24:39.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f91d57d4b0 con 0x55f91d7092b0 2023-12-18T10:24:39.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f91d57cf10 con 0x55f91d7092b0 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a377fe640 1 -- 172.21.15.133:0/3018335122 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7a400017c0 con 0x55f91d7092b0 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a377fe640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a28064440 0x7f7a28066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a377fe640 1 -- 172.21.15.133:0/3018335122 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7a40081750 con 0x55f91d7092b0 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a46314640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a28064440 0x7f7a28066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a487fa080 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55f91d6355a0 0x55f91d67a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 13.12 13:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x55f91d704900 con 0x55f91d6355a0 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a45b13640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55f91d6355a0 0x55f91d67a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.069+0000 7f7a46314640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a28064440 0x7f7a28066900 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000fe0 tx=0x7f7a380018f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a45b13640 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55f91d6355a0 0x55f91d67a9d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a45b13640 1 -- 172.21.15.133:0/3018335122 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v91'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f7a3c0c4040 con 0x55f91d6355a0 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55f91d6355a0 msgr2=0x55f91d67a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x55f91d6355a0 0x55f91d67a9d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a28064440 msgr2=0x7f7a28066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a28064440 0x7f7a28066900 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000fe0 tx=0x7f7a380018f0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d7092b0 msgr2=0x55f91d6feec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 --2- 172.21.15.133:0/3018335122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f91d7092b0 0x55f91d6feec0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000d240 tx=0x7f7a4000d700 comp rx=0 tx=0).stop 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a46b15640 1 -- 172.21.15.133:0/3018335122 reap_dead start 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 shutdown_connections 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 >> 172.21.15.133:0/3018335122 conn(0x55f91d65fe00 msgr2=0x55f91d664cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 shutdown_connections 2023-12-18T10:24:39.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.073+0000 7f7a487fa080 1 -- 172.21.15.133:0/3018335122 wait complete. 2023-12-18T10:24:39.078 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2023-12-18T10:24:39.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 Processor -- start 2023-12-18T10:24:39.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- start start 2023-12-18T10:24:39.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 0x563c26ae5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26a5e190 0x563c26a54940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26b042b0 0x563c26a54e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c269764d0 con 0x563c26b042b0 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c269761d0 con 0x563c26a5e190 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c2696ce40 con 0x563c26a5c930 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26b042b0 0x563c26a54e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26b042b0 0x563c26a54e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46082/0 (socket says 172.21.15.133:46082) 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc2fd4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 0x563c26ae5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc27d3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26a5e190 0x563c26a54940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 -- 172.21.15.133:0/12048467 learned_addr learned my addr 172.21.15.133:0/12048467 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 -- 172.21.15.133:0/12048467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 msgr2=0x563c26ae5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 --2- 172.21.15.133:0/12048467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 0x563c26ae5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 -- 172.21.15.133:0/12048467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26a5e190 msgr2=0x563c26a54940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 --2- 172.21.15.133:0/12048467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26a5e190 0x563c26a54940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 -- 172.21.15.133:0/12048467 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc00a100 con 0x563c26b042b0 2023-12-18T10:24:39.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc37d5640 1 --2- 172.21.15.133:0/12048467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26b042b0 0x563c26a54e80 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ae040 tx=0x7fbfbc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26eebc796baa682 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc17d1640 1 -- 172.21.15.133:0/12048467 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0a3b50 con 0x563c26b042b0 2023-12-18T10:24:39.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc17d1640 1 -- 172.21.15.133:0/12048467 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc0ab440 con 0x563c26b042b0 2023-12-18T10:24:39.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc17d1640 1 -- 172.21.15.133:0/12048467 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc0ab7b0 con 0x563c26b042b0 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- 172.21.15.133:0/12048467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26b042b0 msgr2=0x563c26a54e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 --2- 172.21.15.133:0/12048467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26b042b0 0x563c26a54e80 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0ae040 tx=0x7fbfbc0033b0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- 172.21.15.133:0/12048467 shutdown_connections 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 --2- 172.21.15.133:0/12048467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26b042b0 0x563c26a54e80 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 --2- 172.21.15.133:0/12048467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26a5e190 0x563c26a54940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 --2- 172.21.15.133:0/12048467 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 0x563c26ae5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- 172.21.15.133:0/12048467 >> 172.21.15.133:0/12048467 conn(0x563c26a5ae00 msgr2=0x563c26a5ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- 172.21.15.133:0/12048467 shutdown_connections 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.169+0000 7fbfc54ba080 1 -- 172.21.15.133:0/12048467 wait complete. 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 Processor -- start 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 -- start start 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 0x563c26a57560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26a5e190 0x563c26a57aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26b042b0 0x563c26a57fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c26a5a420 con 0x563c26a5e190 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c26b002f0 con 0x563c26b042b0 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c26a59500 con 0x563c26a5c930 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc27d3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26a5e190 0x563c26a57aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc2fd4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 0x563c26a57560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc2fd4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 0x563c26a57560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:59742/0 (socket says 172.21.15.133:59742) 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc2fd4640 1 -- 172.21.15.133:0/549453660 learned_addr learned my addr 172.21.15.133:0/549453660 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc27d3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26a5e190 0x563c26a57aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46092/0 (socket says 172.21.15.133:46092) 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc37d5640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26b042b0 0x563c26a57fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc27d3640 1 -- 172.21.15.133:0/549453660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 msgr2=0x563c26a57560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc27d3640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563c26a5c930 0x563c26a57560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc27d3640 1 -- 172.21.15.133:0/549453660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26b042b0 msgr2=0x563c26a57fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc27d3640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563c26b042b0 0x563c26a57fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc27d3640 1 -- 172.21.15.133:0/549453660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c2699f210 con 0x563c26a5e190 2023-12-18T10:24:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc27d3640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26a5e190 0x563c26a57aa0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8000c10 tx=0x7fbfb800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfabfff640 1 -- 172.21.15.133:0/549453660 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8001c40 con 0x563c26a5e190 2023-12-18T10:24:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfabfff640 1 -- 172.21.15.133:0/549453660 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb80106c0 con 0x563c26a5e190 2023-12-18T10:24:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfabfff640 1 -- 172.21.15.133:0/549453660 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8010a70 con 0x563c26a5e190 2023-12-18T10:24:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c26985070 con 0x563c26a5e190 2023-12-18T10:24:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.173+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c269784b0 con 0x563c26a5e190 2023-12-18T10:24:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfabfff640 1 -- 172.21.15.133:0/549453660 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbfb8010bd0 con 0x563c26a5e190 2023-12-18T10:24:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfabfff640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfb0064440 0x7fbfb0066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfabfff640 1 -- 172.21.15.133:0/549453660 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbfb80828e0 con 0x563c26a5e190 2023-12-18T10:24:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfc2fd4640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfb0064440 0x7fbfb0066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfc54ba080 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x563c26a58f80 0x563c26a716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- osd_op(unknown.0.0:1 13.12 13:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x563c26a72db0 con 0x563c26a58f80 2023-12-18T10:24:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfc37d5640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x563c26a58f80 0x563c26a716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfc2fd4640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfb0064440 0x7fbfb0066900 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005640 tx=0x7fbfb400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.177+0000 7fbfc37d5640 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x563c26a58f80 0x563c26a716b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc37d5640 1 -- 172.21.15.133:0/549453660 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v91'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fbfbc0ab5b0 con 0x563c26a58f80 2023-12-18T10:24:39.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x563c26a58f80 msgr2=0x563c26a716b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x563c26a58f80 0x563c26a716b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfb0064440 msgr2=0x7fbfb0066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfb0064440 0x7fbfb0066900 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4005640 tx=0x7fbfb400c040 comp rx=0 tx=0).stop 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26a5e190 msgr2=0x563c26a57aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 --2- 172.21.15.133:0/549453660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c26a5e190 0x563c26a57aa0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8000c10 tx=0x7fbfb800c9a0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc37d5640 1 -- 172.21.15.133:0/549453660 reap_dead start 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 shutdown_connections 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 >> 172.21.15.133:0/549453660 conn(0x563c26a5ae00 msgr2=0x563c26ae5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 shutdown_connections 2023-12-18T10:24:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.181+0000 7fbfc54ba080 1 -- 172.21.15.133:0/549453660 wait complete. 2023-12-18T10:24:39.185 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2023-12-18T10:24:39.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9aba84c080 1 Processor -- start 2023-12-18T10:24:39.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9aba84c080 1 -- start start 2023-12-18T10:24:39.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9aba84c080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa0002270 0x55dd9c0bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9aba84c080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd9c02bce0 0x55dd9c02c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9aba84c080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd9c0b7ed0 0x55dd9c0b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9aba84c080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9bf304d0 con 0x7f9aa0002270 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9aba84c080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9bf301d0 con 0x55dd9c02bce0 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9aba84c080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd9bf26e40 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa0002270 0x55dd9c0bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa0002270 0x55dd9c0bbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46118/0 (socket says 172.21.15.133:46118) 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 -- 172.21.15.133:0/4181761379 learned_addr learned my addr 172.21.15.133:0/4181761379 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 -- 172.21.15.133:0/4181761379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd9c0b7ed0 msgr2=0x55dd9c0b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd9c0b7ed0 0x55dd9c0b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 -- 172.21.15.133:0/4181761379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd9c02bce0 msgr2=0x55dd9c02c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab6fc8640 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd9c02bce0 0x55dd9c02c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd9c02bce0 0x55dd9c02c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 -- 172.21.15.133:0/4181761379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd9bf3f070 con 0x7f9aa0002270 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab6fc8640 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd9c02bce0 0x55dd9c02c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab77c9640 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa0002270 0x55dd9c0bbad0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f9aa801b870 tx=0x55dd9c0341d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4b8d73033a81ee server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab5fc6640 1 -- 172.21.15.133:0/4181761379 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8000ee0 con 0x7f9aa0002270 2023-12-18T10:24:39.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab5fc6640 1 -- 172.21.15.133:0/4181761379 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8001440 con 0x7f9aa0002270 2023-12-18T10:24:39.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.277+0000 7f9ab5fc6640 1 -- 172.21.15.133:0/4181761379 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80a48f0 con 0x7f9aa0002270 2023-12-18T10:24:39.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- 172.21.15.133:0/4181761379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa0002270 msgr2=0x55dd9c0bbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa0002270 0x55dd9c0bbad0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f9aa801b870 tx=0x55dd9c0341d0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- 172.21.15.133:0/4181761379 shutdown_connections 2023-12-18T10:24:39.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd9c0b7ed0 0x55dd9c0b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd9c02bce0 0x55dd9c02c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 --2- 172.21.15.133:0/4181761379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa0002270 0x55dd9c0bbad0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- 172.21.15.133:0/4181761379 >> 172.21.15.133:0/4181761379 conn(0x55dd9c014e00 msgr2=0x55dd9c0bb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- 172.21.15.133:0/4181761379 shutdown_connections 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- 172.21.15.133:0/4181761379 wait complete. 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 Processor -- start 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- start start 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd9c02bce0 0x55dd9c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd9c0b7ed0 0x55dd9c0bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa0002270 0x55dd9c0bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c030700 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c0309a0 con 0x7f9aa0002270 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd9c030c40 con 0x55dd9c02bce0 2023-12-18T10:24:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd9c0b7ed0 0x55dd9c0bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd9c0b7ed0 0x55dd9c0bcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46122/0 (socket says 172.21.15.133:46122) 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 -- 172.21.15.133:0/1788433403 learned_addr learned my addr 172.21.15.133:0/1788433403 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab77c9640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd9c02bce0 0x55dd9c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab7fca640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa0002270 0x55dd9c0bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 -- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd9c02bce0 msgr2=0x55dd9c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd9c02bce0 0x55dd9c0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 -- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa0002270 msgr2=0x55dd9c0bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa0002270 0x55dd9c0bd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 -- 172.21.15.133:0/1788433403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0001e20 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab6fc8640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd9c0b7ed0 0x55dd9c0bcc60 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f9aac007870 tx=0x7f9aac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab4fc4640 1 -- 172.21.15.133:0/1788433403 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac006d80 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab4fc4640 1 -- 172.21.15.133:0/1788433403 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac010070 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9ab4fc4640 1 -- 172.21.15.133:0/1788433403 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac006ee0 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd9bf324b0 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.281+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd9bf31f10 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9ab4fc4640 1 -- 172.21.15.133:0/1788433403 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9aac016690 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9ab4fc4640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4064440 0x7f9aa4066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9ab4fc4640 1 -- 172.21.15.133:0/1788433403 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9aac082430 con 0x55dd9c0b7ed0 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9ab77c9640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4064440 0x7f9aa4066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9aba84c080 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x55dd9c0b4180 0x55dd9c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 --> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] -- osd_op(unknown.0.0:1 13.5 13:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x55dd9c0b4d00 con 0x55dd9c0b4180 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9ab7fca640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x55dd9c0b4180 0x55dd9c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9ab77c9640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4064440 0x7f9aa4066900 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80ae040 tx=0x7f9aa80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.285+0000 7f9ab7fca640 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x55dd9c0b4180 0x55dd9c0b47c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9ab7fca640 1 -- 172.21.15.133:0/1788433403 <== osd.4 v2:172.21.15.142:6800/38344 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v91'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ab0002720 con 0x55dd9c0b4180 2023-12-18T10:24:39.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x55dd9c0b4180 msgr2=0x55dd9c0b47c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x55dd9c0b4180 0x55dd9c0b47c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4064440 msgr2=0x7f9aa4066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9aa4064440 0x7f9aa4066900 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80ae040 tx=0x7f9aa80a6000 comp rx=0 tx=0).stop 2023-12-18T10:24:39.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd9c0b7ed0 msgr2=0x55dd9c0bcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 --2- 172.21.15.133:0/1788433403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd9c0b7ed0 0x55dd9c0bcc60 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f9aac007870 tx=0x7f9aac007d30 comp rx=0 tx=0).stop 2023-12-18T10:24:39.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9ab7fca640 1 -- 172.21.15.133:0/1788433403 reap_dead start 2023-12-18T10:24:39.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 shutdown_connections 2023-12-18T10:24:39.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 >> 172.21.15.133:0/1788433403 conn(0x55dd9c014e00 msgr2=0x55dd9bfeb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 shutdown_connections 2023-12-18T10:24:39.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.289+0000 7f9aba84c080 1 -- 172.21.15.133:0/1788433403 wait complete. 2023-12-18T10:24:39.293 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2023-12-18T10:24:39.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.337+0000 7fb05b7e8080 1 Processor -- start 2023-12-18T10:24:39.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.337+0000 7fb05b7e8080 1 -- start start 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24bf220 0x55f7f24bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24c1190 0x55f7f2562b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 0x55f7f24943b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f23d94d0 con 0x55f7f24bf220 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f23d91d0 con 0x55f7f25672b0 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7f23cfe40 con 0x55f7f24c1190 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24bf220 0x55f7f24bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24bf220 0x55f7f24bcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46136/0 (socket says 172.21.15.133:46136) 2023-12-18T10:24:39.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 -- 172.21.15.133:0/2606278240 learned_addr learned my addr 172.21.15.133:0/2606278240 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb058b03640 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24c1190 0x55f7f2562b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059b05640 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 0x55f7f24943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 -- 172.21.15.133:0/2606278240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24c1190 msgr2=0x55f7f2562b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24c1190 0x55f7f2562b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 -- 172.21.15.133:0/2606278240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 msgr2=0x55f7f24943b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 0x55f7f24943b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 -- 172.21.15.133:0/2606278240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05400a1c0 con 0x55f7f24bf220 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb059304640 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24bf220 0x55f7f24bcf20 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00a4a0 tx=0x7fb04c00a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545f118e09781a30 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb04b7fe640 1 -- 172.21.15.133:0/2606278240 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00b8d0 con 0x55f7f24bf220 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb04b7fe640 1 -- 172.21.15.133:0/2606278240 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c00ba50 con 0x55f7f24bf220 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb04b7fe640 1 -- 172.21.15.133:0/2606278240 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00be00 con 0x55f7f24bf220 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- 172.21.15.133:0/2606278240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24bf220 msgr2=0x55f7f24bcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24bf220 0x55f7f24bcf20 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00a4a0 tx=0x7fb04c00a960 comp rx=0 tx=0).stop 2023-12-18T10:24:39.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- 172.21.15.133:0/2606278240 shutdown_connections 2023-12-18T10:24:39.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 0x55f7f24943b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24c1190 0x55f7f2562b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 --2- 172.21.15.133:0/2606278240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24bf220 0x55f7f24bcf20 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- 172.21.15.133:0/2606278240 >> 172.21.15.133:0/2606278240 conn(0x55f7f24bde00 msgr2=0x55f7f24962e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- 172.21.15.133:0/2606278240 shutdown_connections 2023-12-18T10:24:39.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- 172.21.15.133:0/2606278240 wait complete. 2023-12-18T10:24:39.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 Processor -- start 2023-12-18T10:24:39.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.341+0000 7fb05b7e8080 1 -- start start 2023-12-18T10:24:39.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb05b7e8080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24bf220 0x55f7f26011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb05b7e8080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24c1190 0x55f7f26016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb05b7e8080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 0x55f7f24b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb05b7e8080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f2562080 con 0x55f7f24c1190 2023-12-18T10:24:39.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb05b7e8080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7f2562320 con 0x55f7f25672b0 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb05b7e8080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7f25625c0 con 0x55f7f24bf220 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24c1190 0x55f7f26016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24c1190 0x55f7f26016f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46142/0 (socket says 172.21.15.133:46142) 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 -- 172.21.15.133:0/4291291178 learned_addr learned my addr 172.21.15.133:0/4291291178 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb059b05640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 0x55f7f24b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb059304640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24bf220 0x55f7f26011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 -- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24bf220 msgr2=0x55f7f26011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55f7f24bf220 0x55f7f26011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 -- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 msgr2=0x55f7f24b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f7f25672b0 0x55f7f24b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 -- 172.21.15.133:0/4291291178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c005cd0 con 0x55f7f24c1190 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb058b03640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24c1190 0x55f7f26016f0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fb050008800 tx=0x7fb050008cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb04a7fc640 1 -- 172.21.15.133:0/4291291178 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050011040 con 0x55f7f24c1190 2023-12-18T10:24:39.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb04a7fc640 1 -- 172.21.15.133:0/4291291178 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050006d80 con 0x55f7f24c1190 2023-12-18T10:24:39.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f7f23e8070 con 0x55f7f24c1190 2023-12-18T10:24:39.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb04a7fc640 1 -- 172.21.15.133:0/4291291178 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050016680 con 0x55f7f24c1190 2023-12-18T10:24:39.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7f23db4b0 con 0x55f7f24c1190 2023-12-18T10:24:39.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.345+0000 7fb04a7fc640 1 -- 172.21.15.133:0/4291291178 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb0500167e0 con 0x55f7f24c1190 2023-12-18T10:24:39.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb04a7fc640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb03c064410 0x7fb03c0668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb04a7fc640 1 -- 172.21.15.133:0/4291291178 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb0500820c0 con 0x55f7f24c1190 2023-12-18T10:24:39.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb059304640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb03c064410 0x7fb03c0668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55f7f2561860 0x55f7f2602170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 --> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] -- osd_op(unknown.0.0:1 13.9 13:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x55f7f26026b0 con 0x55f7f2561860 2023-12-18T10:24:39.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb059304640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb03c064410 0x7fb03c0668d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00a390 tx=0x7fb04c00af90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb059b05640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55f7f2561860 0x55f7f2602170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb059b05640 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55f7f2561860 0x55f7f2602170 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb059b05640 1 -- 172.21.15.133:0/4291291178 <== osd.5 v2:172.21.15.142:6808/38345 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v91'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb0540a8070 con 0x55f7f2561860 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55f7f2561860 msgr2=0x55f7f2602170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x55f7f2561860 0x55f7f2602170 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb03c064410 msgr2=0x7fb03c0668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb03c064410 0x7fb03c0668d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00a390 tx=0x7fb04c00af90 comp rx=0 tx=0).stop 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24c1190 msgr2=0x55f7f26016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 --2- 172.21.15.133:0/4291291178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f7f24c1190 0x55f7f26016f0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fb050008800 tx=0x7fb050008cc0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb059b05640 1 -- 172.21.15.133:0/4291291178 reap_dead start 2023-12-18T10:24:39.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 shutdown_connections 2023-12-18T10:24:39.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 >> 172.21.15.133:0/4291291178 conn(0x55f7f24bde00 msgr2=0x55f7f255e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 shutdown_connections 2023-12-18T10:24:39.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.349+0000 7fb05b7e8080 1 -- 172.21.15.133:0/4291291178 wait complete. 2023-12-18T10:24:39.355 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2023-12-18T10:24:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 Processor -- start 2023-12-18T10:24:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 -- start start 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 0x5641adea9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 0x5641adea5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641adda74d0 con 0x5641ade905f0 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641adda71d0 con 0x5641ade93690 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641add9de40 con 0x5641ade90210 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46160/0 (socket says 172.21.15.133:46160) 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 -- 172.21.15.133:0/3910158881 learned_addr learned my addr 172.21.15.133:0/3910158881 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3d16640 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 0x5641adea9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d4517640 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 0x5641adea5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 -- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 msgr2=0x5641adea9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 0x5641adea9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 -- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 msgr2=0x5641adea5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 0x5641adea5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 -- 172.21.15.133:0/3910158881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8005d30 con 0x5641ade905f0 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d4517640 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 0x5641adea5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3d16640 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 0x5641adea9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d3515640 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea58c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f41c80b2040 tx=0x7f41c8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb7b73f45e13769 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d2513640 1 -- 172.21.15.133:0/3910158881 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80b9640 con 0x5641ade905f0 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d2513640 1 -- 172.21.15.133:0/3910158881 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c80b97a0 con 0x5641ade905f0 2023-12-18T10:24:39.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d2513640 1 -- 172.21.15.133:0/3910158881 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80b9b50 con 0x5641ade905f0 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 -- 172.21.15.133:0/3910158881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 msgr2=0x5641adea58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea58c0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f41c80b2040 tx=0x7f41c8003030 comp rx=0 tx=0).stop 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 -- 172.21.15.133:0/3910158881 shutdown_connections 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 0x5641adea5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea58c0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 --2- 172.21.15.133:0/3910158881 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 0x5641adea9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.445+0000 7f41d61fc080 1 -- 172.21.15.133:0/3910158881 >> 172.21.15.133:0/3910158881 conn(0x5641ade5eb50 msgr2=0x5641adea9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 -- 172.21.15.133:0/3910158881 shutdown_connections 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 -- 172.21.15.133:0/3910158881 wait complete. 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 Processor -- start 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 -- start start 2023-12-18T10:24:39.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 0x5641adf32c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 0x5641adea4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641adfcc9f0 con 0x5641ade905f0 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641adfc3030 con 0x5641ade93690 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641adfccc50 con 0x5641ade90210 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46174/0 (socket says 172.21.15.133:46174) 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 -- 172.21.15.133:0/47438852 learned_addr learned my addr 172.21.15.133:0/47438852 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d4517640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 0x5641adea4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3d16640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 0x5641adf32c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 -- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 msgr2=0x5641adf32c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5641ade90210 0x5641adf32c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 -- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 msgr2=0x5641adea4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5641ade93690 0x5641adea4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 -- 172.21.15.133:0/47438852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641addd0210 con 0x5641ade905f0 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d3515640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea4400 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f41c801a790 tx=0x7f41c801a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d1511640 1 -- 172.21.15.133:0/47438852 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80a7510 con 0x5641ade905f0 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d1511640 1 -- 172.21.15.133:0/47438852 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c80cb6a0 con 0x5641ade905f0 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d1511640 1 -- 172.21.15.133:0/47438852 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80cba50 con 0x5641ade905f0 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5641addb6070 con 0x5641ade905f0 2023-12-18T10:24:39.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.449+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641adda94b0 con 0x5641ade905f0 2023-12-18T10:24:39.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d1511640 1 -- 172.21.15.133:0/47438852 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f41c80cbbb0 con 0x5641ade905f0 2023-12-18T10:24:39.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d1511640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f41c0064410 0x7f41c00668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d1511640 1 -- 172.21.15.133:0/47438852 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f41c80c6070 con 0x5641ade905f0 2023-12-18T10:24:39.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d3d16640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f41c0064410 0x7f41c00668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d61fc080 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5641adfcd630 0x5641adfcda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 --> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] -- osd_op(unknown.0.0:1 13.5 13:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x5641adfcdf80 con 0x5641adfcd630 2023-12-18T10:24:39.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d4517640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5641adfcd630 0x5641adfcda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d3d16640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f41c0064410 0x7f41c00668d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f41c4001ec0 tx=0x7f41c40017c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.453+0000 7f41d4517640 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5641adfcd630 0x5641adfcda40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d4517640 1 -- 172.21.15.133:0/47438852 <== osd.4 v2:172.21.15.142:6800/38344 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v91'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f41cc0106f0 con 0x5641adfcd630 2023-12-18T10:24:39.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5641adfcd630 msgr2=0x5641adfcda40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5641adfcd630 0x5641adfcda40 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f41c0064410 msgr2=0x7f41c00668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f41c0064410 0x7f41c00668d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f41c4001ec0 tx=0x7f41c40017c0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 msgr2=0x5641adea4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 --2- 172.21.15.133:0/47438852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5641ade905f0 0x5641adea4400 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f41c801a790 tx=0x7f41c801a920 comp rx=0 tx=0).stop 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d4517640 1 -- 172.21.15.133:0/47438852 reap_dead start 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 shutdown_connections 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 >> 172.21.15.133:0/47438852 conn(0x5641ade5eb50 msgr2=0x5641ade93aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 shutdown_connections 2023-12-18T10:24:39.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.457+0000 7f41d61fc080 1 -- 172.21.15.133:0/47438852 wait complete. 2023-12-18T10:24:39.460 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2023-12-18T10:24:39.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.505+0000 7fb6c3e2b080 1 Processor -- start 2023-12-18T10:24:39.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.505+0000 7fb6c3e2b080 1 -- start start 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.505+0000 7fb6c3e2b080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f809210 0x55668f8aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.505+0000 7fb6c3e2b080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f8095f0 0x55668f8af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.505+0000 7fb6c3e2b080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f823a30 0x55668f89a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.505+0000 7fb6c3e2b080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55668f7201d0 con 0x55668f809210 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.505+0000 7fb6c3e2b080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55668f716e40 con 0x55668f8095f0 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.505+0000 7fb6c3e2b080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55668f8ad7d0 con 0x55668f823a30 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f809210 0x55668f8aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f809210 0x55668f8aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46194/0 (socket says 172.21.15.133:46194) 2023-12-18T10:24:39.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 -- 172.21.15.133:0/3149916867 learned_addr learned my addr 172.21.15.133:0/3149916867 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1144640 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f8095f0 0x55668f8af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c2146640 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f823a30 0x55668f89a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 -- 172.21.15.133:0/3149916867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f823a30 msgr2=0x55668f89a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f823a30 0x55668f89a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 -- 172.21.15.133:0/3149916867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f8095f0 msgr2=0x55668f8af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f8095f0 0x55668f8af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 -- 172.21.15.133:0/3149916867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc00a1c0 con 0x55668f809210 2023-12-18T10:24:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c1945640 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f809210 0x55668f8aec30 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40098d0 tx=0x7fb6b4005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4004d71b7b7a4711 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6b3fff640 1 -- 172.21.15.133:0/3149916867 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400f040 con 0x55668f809210 2023-12-18T10:24:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6b3fff640 1 -- 172.21.15.133:0/3149916867 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b4008d40 con 0x55668f809210 2023-12-18T10:24:39.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6b3fff640 1 -- 172.21.15.133:0/3149916867 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40146a0 con 0x55668f809210 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3149916867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f809210 msgr2=0x55668f8aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f809210 0x55668f8aec30 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40098d0 tx=0x7fb6b4005a10 comp rx=0 tx=0).stop 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3149916867 shutdown_connections 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f823a30 0x55668f89a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f8095f0 0x55668f8af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 --2- 172.21.15.133:0/3149916867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f809210 0x55668f8aec30 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3149916867 >> 172.21.15.133:0/3149916867 conn(0x55668f7d7b50 msgr2=0x55668f80a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3149916867 shutdown_connections 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3149916867 wait complete. 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 Processor -- start 2023-12-18T10:24:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- start start 2023-12-18T10:24:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f809210 0x55668f948630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f8095f0 0x55668f948b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f823a30 0x55668f9353c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55668f9490b0 con 0x55668f8095f0 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55668f822480 con 0x55668f823a30 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.509+0000 7fb6c3e2b080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55668f822720 con 0x55668f809210 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f8095f0 0x55668f948b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f8095f0 0x55668f948b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46210/0 (socket says 172.21.15.133:46210) 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 -- 172.21.15.133:0/3481181391 learned_addr learned my addr 172.21.15.133:0/3481181391 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c2146640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f823a30 0x55668f9353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1945640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f809210 0x55668f948630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 -- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f809210 msgr2=0x55668f948630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55668f809210 0x55668f948630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 -- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f823a30 msgr2=0x55668f9353c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55668f823a30 0x55668f9353c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 -- 172.21.15.133:0/3481181391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b40094a0 con 0x55668f8095f0 2023-12-18T10:24:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c1144640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f8095f0 0x55668f948b70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80086e0 tx=0x7fb6b8008ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6b2ffd640 1 -- 172.21.15.133:0/3481181391 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800f040 con 0x55668f8095f0 2023-12-18T10:24:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6b2ffd640 1 -- 172.21.15.133:0/3481181391 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b8010990 con 0x55668f8095f0 2023-12-18T10:24:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6b2ffd640 1 -- 172.21.15.133:0/3481181391 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8010d00 con 0x55668f8095f0 2023-12-18T10:24:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55668f749210 con 0x55668f8095f0 2023-12-18T10:24:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55668f72f070 con 0x55668f8095f0 2023-12-18T10:24:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6b2ffd640 1 -- 172.21.15.133:0/3481181391 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb6b8015450 con 0x55668f8095f0 2023-12-18T10:24:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6b2ffd640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb6a4064410 0x7fb6a40668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.513+0000 7fb6b2ffd640 1 -- 172.21.15.133:0/3481181391 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb6b8082a30 con 0x55668f8095f0 2023-12-18T10:24:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c1945640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb6a4064410 0x7fb6a40668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55668f935df0 0x55668f9466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 --> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] -- osd_op(unknown.0.0:1 13.1d 13:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x55668f821f00 con 0x55668f935df0 2023-12-18T10:24:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c2146640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55668f935df0 0x55668f9466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c1945640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb6a4064410 0x7fb6a40668d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009870 tx=0x7fb6b4011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c2146640 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55668f935df0 0x55668f9466a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c2146640 1 -- 172.21.15.133:0/3481181391 <== osd.7 v2:172.21.15.142:6816/38355 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v91'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb6bc0a89d0 con 0x55668f935df0 2023-12-18T10:24:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55668f935df0 msgr2=0x55668f9466a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x55668f935df0 0x55668f9466a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb6a4064410 msgr2=0x7fb6a40668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb6a4064410 0x7fb6a40668d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009870 tx=0x7fb6b4011000 comp rx=0 tx=0).stop 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f8095f0 msgr2=0x55668f948b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 --2- 172.21.15.133:0/3481181391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55668f8095f0 0x55668f948b70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80086e0 tx=0x7fb6b8008ba0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c2146640 1 -- 172.21.15.133:0/3481181391 reap_dead start 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 shutdown_connections 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 >> 172.21.15.133:0/3481181391 conn(0x55668f7d7b50 msgr2=0x55668f8af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 shutdown_connections 2023-12-18T10:24:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.517+0000 7fb6c3e2b080 1 -- 172.21.15.133:0/3481181391 wait complete. 2023-12-18T10:24:39.523 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /d1/d2/d3 recursive,force 2023-12-18T10:24:39.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d796d640 1 Processor -- start 2023-12-18T10:24:39.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d796d640 1 -- start start 2023-12-18T10:24:39.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d796d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9d006be20 0x7fe9d00c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d796d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9d00c18b0 0x7fe9d00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d796d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d00c1cb0 con 0x7fe9d0160e90 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d796d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d00b20a0 con 0x7fe9d00c18b0 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d796d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d00b2380 con 0x7fe9d006be20 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d5f0a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9d00c18b0 0x7fe9d00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d5f0a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9d00c18b0 0x7fe9d00cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46226/0 (socket says 172.21.15.133:46226) 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/3150490402 learned_addr learned my addr 172.21.15.133:0/3150490402 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/3150490402 >> v2:172.21.15.142:3300/0 conn(0x7fe9d006be20 0x7fe9d00c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/3150490402 >> v2:172.21.15.142:3300/0 conn(0x7fe9d006be20 msgr2=0x7fe9d00c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/3150490402 >> v2:172.21.15.142:3300/0 conn(0x7fe9d006be20 0x7fe9d00c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/3150490402 >> v1:172.21.15.142:6789/0 conn(0x7fe9d0160e90 legacy=0x7fe9d0165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.709+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/3150490402 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00cc5b0 con 0x7fe9d00c18b0 2023-12-18T10:24:39.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/3150490402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d00c18b0 0x7fe9d00cd090 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00b3470 tx=0x7fe9c801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05e11571e134a3f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9c7fff640 1 -- 172.21.15.133:0/3150490402 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80a5780 con 0x7fe9d00c18b0 2023-12-18T10:24:39.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9c7fff640 1 -- 172.21.15.133:0/3150490402 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c80a58e0 con 0x7fe9d00c18b0 2023-12-18T10:24:39.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9c7fff640 1 -- 172.21.15.133:0/3150490402 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80a5c70 con 0x7fe9d00c18b0 2023-12-18T10:24:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d796d640 1 -- 172.21.15.133:0/3150490402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d00c18b0 msgr2=0x7fe9d00cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3150490402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d00c18b0 0x7fe9d00cd090 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00b3470 tx=0x7fe9c801c9d0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d796d640 1 -- 172.21.15.133:0/3150490402 shutdown_connections 2023-12-18T10:24:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3150490402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d00c18b0 0x7fe9d00cd090 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3150490402 >> v2:172.21.15.142:3300/0 conn(0x7fe9d006be20 0x7fe9d00c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d796d640 1 -- 172.21.15.133:0/3150490402 >> 172.21.15.133:0/3150490402 conn(0x7fe9d0069e70 msgr2=0x7fe9d006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d796d640 1 -- 172.21.15.133:0/3150490402 shutdown_connections 2023-12-18T10:24:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.713+0000 7fe9d796d640 1 -- 172.21.15.133:0/3150490402 wait complete. 2023-12-18T10:24:39.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 Processor -- start 2023-12-18T10:24:39.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 -- start start 2023-12-18T10:24:39.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d006be20 0x7fe9d0097810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d00c18b0 0x7fe9d00ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d0160e90 0x7fe9d00ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d015bc20 con 0x7fe9d0160e90 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00ac340 con 0x7fe9d006be20 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00ac620 con 0x7fe9d00c18b0 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d0160e90 0x7fe9d00ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d0160e90 0x7fe9d00ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46238/0 (socket says 172.21.15.133:46238) 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/3239163682 learned_addr learned my addr 172.21.15.133:0/3239163682 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5709640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d006be20 0x7fe9d0097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d00c18b0 0x7fe9d00ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/3239163682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d00c18b0 msgr2=0x7fe9d00ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d00c18b0 0x7fe9d00ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/3239163682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d006be20 msgr2=0x7fe9d0097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d006be20 0x7fe9d0097810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/3239163682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8009b30 con 0x7fe9d0160e90 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d0160e90 0x7fe9d00ab6d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80af040 tx=0x7fe9c8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9c5ffb640 1 -- 172.21.15.133:0/3239163682 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80b8670 con 0x7fe9d0160e90 2023-12-18T10:24:39.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9c5ffb640 1 -- 172.21.15.133:0/3239163682 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c80b87d0 con 0x7fe9d0160e90 2023-12-18T10:24:39.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9c5ffb640 1 -- 172.21.15.133:0/3239163682 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80b8b80 con 0x7fe9d0160e90 2023-12-18T10:24:39.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 -- 172.21.15.133:0/3239163682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d00ac900 con 0x7fe9d0160e90 2023-12-18T10:24:39.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.717+0000 7fe9d796d640 1 -- 172.21.15.133:0/3239163682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d0151600 con 0x7fe9d0160e90 2023-12-18T10:24:39.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9c5ffb640 1 -- 172.21.15.133:0/3239163682 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe9c80b8ce0 con 0x7fe9d0160e90 2023-12-18T10:24:39.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9c5ffb640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9b4065a60 0x7fe9b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9c5ffb640 1 -- 172.21.15.133:0/3239163682 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe9c811e690 con 0x7fe9d0160e90 2023-12-18T10:24:39.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9d5709640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9b4065a60 0x7fe9b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9d5709640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9b4065a60 0x7fe9b4067f20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00ad3e0 tx=0x7fe9cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9dacd2000 1 Processor -- start 2023-12-18T10:24:39.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9dacd2000 1 -- start start 2023-12-18T10:24:39.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b151799e0 0x562b15179dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b1512fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 0x562b15130340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b14ff7b00 con 0x562b1517a300 2023-12-18T10:24:39.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b14f85140 con 0x562b1512ff60 2023-12-18T10:24:39.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b14f82710 con 0x562b151799e0 2023-12-18T10:24:39.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9d4f08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b1512fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9d4f08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b1512fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46248/0 (socket says 172.21.15.133:46248) 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.721+0000 7fe9d4f08640 1 -- 172.21.15.133:0/933075212 learned_addr learned my addr 172.21.15.133:0/933075212 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 0x562b15130340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d5709640 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b151799e0 0x562b15179dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 -- 172.21.15.133:0/933075212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b151799e0 msgr2=0x562b15179dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b151799e0 0x562b15179dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 -- 172.21.15.133:0/933075212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 msgr2=0x562b15130340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 0x562b15130340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 -- 172.21.15.133:0/933075212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b14c7ac90 con 0x562b1517a300 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b1512fa20 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fe9d01fc560 tx=0x7fe9c0009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3253f8118437607b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9b2ffd640 1 -- 172.21.15.133:0/933075212 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0011cf0 con 0x562b1517a300 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9b2ffd640 1 -- 172.21.15.133:0/933075212 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0011e50 con 0x562b1517a300 2023-12-18T10:24:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9b2ffd640 1 -- 172.21.15.133:0/933075212 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0004230 con 0x562b1517a300 2023-12-18T10:24:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- 172.21.15.133:0/933075212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 msgr2=0x562b1512fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b1512fa20 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fe9d01fc560 tx=0x7fe9c0009f70 comp rx=0 tx=0).stop 2023-12-18T10:24:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- 172.21.15.133:0/933075212 shutdown_connections 2023-12-18T10:24:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 0x562b15130340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b1512fa20 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/933075212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b151799e0 0x562b15179dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- 172.21.15.133:0/933075212 >> 172.21.15.133:0/933075212 conn(0x562b1512bf10 msgr2=0x562b1512e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- 172.21.15.133:0/933075212 shutdown_connections 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- 172.21.15.133:0/933075212 wait complete. 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- start start 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 Processor -- start 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 0x562b15135120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b151799e0 0x562b1513b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 0x562b1513bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b14f7e000 con 0x562b151799e0 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b14f1d980 con 0x562b1512ff60 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b14f1d620 con 0x562b1517a300 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9dacd2000 10 client.0 _ll_register_callbacks cb 0x562b14f77940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b151799e0 0x562b1513b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b151799e0 0x562b1513b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46252/0 (socket says 172.21.15.133:46252) 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d4f08640 1 -- 172.21.15.133:0/2995763399 learned_addr learned my addr 172.21.15.133:0/2995763399 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d5709640 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 0x562b15135120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.725+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 0x562b1513bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9d4f08640 1 -- 172.21.15.133:0/2995763399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 msgr2=0x562b1513bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 0x562b1513bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9d4f08640 1 -- 172.21.15.133:0/2995763399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 msgr2=0x562b15135120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 0x562b15135120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9d4f08640 1 -- 172.21.15.133:0/2995763399 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c0009740 con 0x562b151799e0 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b151799e0 0x562b1513b7e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000c10 tx=0x7fe9c0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bfc1ac3f8aaf4e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 1 -- 172.21.15.133:0/2995763399 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0025070 con 0x562b151799e0 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2995763399 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b14f3f4f0 con 0x562b151799e0 2023-12-18T10:24:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 1 -- 172.21.15.133:0/2995763399 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe9c0003620 con 0x562b151799e0 2023-12-18T10:24:39.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 1 -- 172.21.15.133:0/2995763399 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9c0003820 con 0x562b151799e0 2023-12-18T10:24:39.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 10 client.8517 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:39.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2995763399 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x562b14f43390 con 0x562b151799e0 2023-12-18T10:24:39.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 1 -- 172.21.15.133:0/2995763399 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b14f3f4f0 con 0x562b151799e0 2023-12-18T10:24:39.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 1 -- 172.21.15.133:0/2995763399 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe9c0003980 con 0x562b151799e0 2023-12-18T10:24:39.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 10 client.8517 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:39.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 10 client.8517 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 20 client.8517 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x562b15180e20 0x562b15181230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 4 client.8517 mds_command: new command op to 8127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2995763399 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b14f82ef0 con 0x562b15180e20 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9d5709640 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x562b15180e20 0x562b15181230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9d5709640 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x562b15180e20 0x562b15181230 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cb72306a3dd248b server_cookie=ae691657b0d1fbe2 in_seq=0 out_seq=0 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 10 client.8517 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 1 -- 172.21.15.133:0/2995763399 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x562b14f82ef0 con 0x562b15180e20 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 10 client.8517 handle_command_reply: tid=0 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 client.8517 shutdown 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2995763399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b151799e0 msgr2=0x562b1513b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b151799e0 0x562b1513b7e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0000c10 tx=0x7fe9c0004740 comp rx=0 tx=0).stop 2023-12-18T10:24:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2995763399 shutdown_connections 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x562b15180e20 0x562b15181230 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 0x562b1513bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b151799e0 0x562b1513b7e0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9abfff640 0 client.8517 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2995763399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b1512ff60 0x562b15135120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2995763399 >> 172.21.15.133:0/2995763399 conn(0x562b1512bf10 msgr2=0x562b1512eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2995763399 shutdown_connections 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2995763399 wait complete. 2023-12-18T10:24:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.729+0000 7fe9dacd2000 20 client.8517 trim_cache size 0 max 16384 2023-12-18T10:24:39.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9dacd2000 1 Processor -- start 2023-12-18T10:24:39.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9dacd2000 1 -- start start 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1512ff60 0x562b1513a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 0x562b1513acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 0x562b1517a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b14c3bd40 con 0x562b1512ff60 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b14f7b400 con 0x562b151799e0 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b1512b8b0 con 0x562b1517a300 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1512ff60 0x562b1513a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1512ff60 0x562b1513a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46260/0 (socket says 172.21.15.133:46260) 2023-12-18T10:24:39.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 -- 172.21.15.133:0/2645265476 learned_addr learned my addr 172.21.15.133:0/2645265476 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 0x562b1517a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 0x562b1513acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 -- 172.21.15.133:0/2645265476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 msgr2=0x562b1517a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 0x562b1517a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 -- 172.21.15.133:0/2645265476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 msgr2=0x562b1513acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 0x562b1513acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 -- 172.21.15.133:0/2645265476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b14f294e0 con 0x562b1512ff60 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9d5709640 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1512ff60 0x562b1513a790 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00fa10 tx=0x7fe9cc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0df358298eaa5f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9b37fe640 1 -- 172.21.15.133:0/2645265476 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0248b0 con 0x562b1512ff60 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9b37fe640 1 -- 172.21.15.133:0/2645265476 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc024a10 con 0x562b1512ff60 2023-12-18T10:24:39.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.745+0000 7fe9b37fe640 1 -- 172.21.15.133:0/2645265476 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc024d80 con 0x562b1512ff60 2023-12-18T10:24:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2645265476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1512ff60 msgr2=0x562b1513a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1512ff60 0x562b1513a790 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00fa10 tx=0x7fe9cc012000 comp rx=0 tx=0).stop 2023-12-18T10:24:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2645265476 shutdown_connections 2023-12-18T10:24:39.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1517a300 0x562b1517a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 0x562b1513acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/2645265476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1512ff60 0x562b1513a790 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2645265476 >> 172.21.15.133:0/2645265476 conn(0x562b1512bf10 msgr2=0x562b1512f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2645265476 shutdown_connections 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- 172.21.15.133:0/2645265476 wait complete. 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- start start 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 Processor -- start 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1512ff60 0x562b151ba910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 0x562b151bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b151bb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b14f79970 con 0x562b1517a300 2023-12-18T10:24:39.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b14f7b810 con 0x562b151799e0 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b14f82000 con 0x562b1512ff60 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 10 client.0 _ll_register_callbacks cb 0x562b14f87610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b151bb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b151bb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46270/0 (socket says 172.21.15.133:46270) 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/1660364115 learned_addr learned my addr 172.21.15.133:0/1660364115 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5709640 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1512ff60 0x562b151ba910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d4f08640 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 0x562b151bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/1660364115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1512ff60 msgr2=0x562b151ba910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1512ff60 0x562b151ba910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/1660364115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 msgr2=0x562b151bb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 0x562b151bb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 -- 172.21.15.133:0/1660364115 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d00c1cb0 con 0x562b1517a300 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9d5f0a640 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b151bb5f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe9c801cf40 tx=0x7fe9c8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c145ad3c8652fb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9abfff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9abfff640 1 -- 172.21.15.133:0/1660364115 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c811cea0 con 0x562b1517a300 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9abfff640 1 -- 172.21.15.133:0/1660364115 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe9c80ef3e0 con 0x562b1517a300 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- 172.21.15.133:0/1660364115 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b15133e80 con 0x562b1517a300 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9abfff640 1 -- 172.21.15.133:0/1660364115 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9c80ef5a0 con 0x562b1517a300 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 10 client.8523 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- 172.21.15.133:0/1660364115 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x562b14c7b0c0 con 0x562b1517a300 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9abfff640 1 -- 172.21.15.133:0/1660364115 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b15133e80 con 0x562b1517a300 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9abfff640 1 -- 172.21.15.133:0/1660364115 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe9c8005d20 con 0x562b1517a300 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 10 client.8523 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:39.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 10 client.8523 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 20 client.8523 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x562b151bbb30 0x562b151bbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 4 client.8523 mds_command: new command op to 8127 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2023-12-18T10:24:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.749+0000 7fe9dacd2000 1 -- 172.21.15.133:0/1660364115 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x562b14f47cf0 con 0x562b151bbb30 2023-12-18T10:24:39.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d5709640 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x562b151bbb30 0x562b151bbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.756 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-12-18T10:24:39.754+0000 7faf7f44b640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-12-18T10:24:20.596686+0000 1=0+1) n(v2 rc2023-12-18T10:24:20.819738+0000 4=0+4) (inest lock) (iversion lock) caps={8307=pAsLsXsFs/-@7},l=8307 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x56276a1cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.596686+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.819738+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.596686+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-12-18T10:24:20.819738+0000 4=0+4)","error_str":""},"return_code":-61} 2023-12-18T10:24:39.756 INFO:tasks.ceph.mds.b.smithi142.stderr:2023-12-18T10:24:39.754+0000 7faf85457640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-12-18T10:24:20.598630+0000 1=0+1) n(v1 rc2023-12-18T10:24:20.819738+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={8307=pAsLsXsFs/-@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x56276a1cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.598630+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.600643+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.598630+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-12-18T10:24:20.819738+0000 3=0+3)","error_str":""},"return_code":-61} 2023-12-18T10:24:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d5709640 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x562b151bbb30 0x562b151bbf40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e03808917dd727 server_cookie=a2c7d5194fd21863 in_seq=0 out_seq=0 2023-12-18T10:24:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9abfff640 10 client.8523 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9abfff640 1 -- 172.21.15.133:0/1660364115 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562b14f47cf0 con 0x562b151bbb30 2023-12-18T10:24:39.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9abfff640 10 client.8523 handle_command_reply: tid=0 2023-12-18T10:24:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 client.8523 shutdown 2023-12-18T10:24:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 -- 172.21.15.133:0/1660364115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 msgr2=0x562b151bb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b151bb5f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe9c801cf40 tx=0x7fe9c8009040 comp rx=0 tx=0).stop 2023-12-18T10:24:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 -- 172.21.15.133:0/1660364115 shutdown_connections 2023-12-18T10:24:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x562b151bbb30 0x562b151bbf40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b1517a300 0x562b151bb5f0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b151799e0 0x562b151bb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.757 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-18T10:24:39.753+0000 7f23d12eb640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-12-18T10:24:20.592620+0000 1=0+1) n(v3 rc2023-12-18T10:24:20.819738+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={8307=pAsLsXsFsx/AsLsXsFsx@9},l=8307 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x555f8a050580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.592620+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.819738+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.592620+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-12-18T10:24:20.819738+0000 6=0+6)","error_str":""},"return_code":-61} 2023-12-18T10:24:39.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 --2- 172.21.15.133:0/1660364115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b1512ff60 0x562b151ba910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 -- 172.21.15.133:0/1660364115 >> 172.21.15.133:0/1660364115 conn(0x562b1512bf10 msgr2=0x562b151787d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9abfff640 0 client.8523 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:39.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 -- 172.21.15.133:0/1660364115 shutdown_connections 2023-12-18T10:24:39.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 1 -- 172.21.15.133:0/1660364115 wait complete. 2023-12-18T10:24:39.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9dacd2000 20 client.8523 trim_cache size 0 max 16384 2023-12-18T10:24:39.759 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fd33397d640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-12-18T10:24:20.600643+0000 1=0+1) n(v0 rc2023-12-18T10:24:20.600643+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={8307=pAsLsXsFsx/-@6},l=8307 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e965d11b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.600643+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.600643+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.600643+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-18T10:24:20.600643+0000 2=0+2)","error_str":""},"return_code":-61} 2023-12-18T10:24:39.759 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fd33397d640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (iversion lock) caps={8307=pAsLsXsFs/-@3},l=8307 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55e965d12100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-12-18T10:24:39.759 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:39.759 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2023-12-18T10:24:39.759 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_tag": "6c914697-d827-4ecd-9e50-1715a20121d0", 2023-12-18T10:24:39.759 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": "asynchronous" 2023-12-18T10:24:39.759 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:39.760 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-18T10:24:39.753+0000 7f23d72f7640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-12-18T10:24:20.594752+0000 1=0+1) n(v4 rc2023-12-18T10:24:20.819738+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={8307=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x555f8a050b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.594752+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.819738+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.594752+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-12-18T10:24:20.819738+0000 5=0+5)","error_str":""},"return_code":-61} 2023-12-18T10:24:39.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 -- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9b4065a60 msgr2=0x7fe9b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9b4065a60 0x7fe9b4067f20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00ad3e0 tx=0x7fe9cc009040 comp rx=0 tx=0).stop 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 -- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d0160e90 msgr2=0x7fe9d00ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d0160e90 0x7fe9d00ab6d0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80af040 tx=0x7fe9c8019770 comp rx=0 tx=0).stop 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 -- 172.21.15.133:0/3239163682 shutdown_connections 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9b4065a60 0x7fe9b4067f20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9d0160e90 0x7fe9d00ab6d0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9d00c18b0 0x7fe9d00ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 --2- 172.21.15.133:0/3239163682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9d006be20 0x7fe9d0097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 -- 172.21.15.133:0/3239163682 >> 172.21.15.133:0/3239163682 conn(0x7fe9d0069e70 msgr2=0x7fe9d006c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 -- 172.21.15.133:0/3239163682 shutdown_connections 2023-12-18T10:24:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.753+0000 7fe9d796d640 1 -- 172.21.15.133:0/3239163682 wait complete. 2023-12-18T10:24:39.773 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub pause 2023-12-18T10:24:39.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f63388df640 1 Processor -- start 2023-12-18T10:24:39.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f63388df640 1 -- start start 2023-12-18T10:24:39.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f63388df640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f63341582d0 0x7f63340c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f63388df640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63340ce3b0 0x7f63340ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f63388df640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63340c9390 con 0x7f6334070820 2023-12-18T10:24:39.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f63388df640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63340ced60 con 0x7f63340ce3b0 2023-12-18T10:24:39.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f63388df640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633415aee0 con 0x7f63341582d0 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f6332d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63340ce3b0 0x7f63340ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f633259c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f63341582d0 0x7f63340c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f633259c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f63341582d0 0x7f63340c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:56782/0 (socket says 172.21.15.133:56782) 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f633259c640 1 -- 172.21.15.133:0/879057243 learned_addr learned my addr 172.21.15.133:0/879057243 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f6329d9b640 1 --1- 172.21.15.133:0/879057243 >> v1:172.21.15.142:6789/0 conn(0x7f6334070820 0x7f63340ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:35034/0 (socket says 172.21.15.133:35034) 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f633259c640 1 -- 172.21.15.133:0/879057243 >> v2:172.21.15.133:3300/0 conn(0x7f63340ce3b0 msgr2=0x7f63340ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f633259c640 1 --2- 172.21.15.133:0/879057243 >> v2:172.21.15.133:3300/0 conn(0x7f63340ce3b0 0x7f63340ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f633259c640 1 -- 172.21.15.133:0/879057243 >> v1:172.21.15.142:6789/0 conn(0x7f6334070820 legacy=0x7f63340ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f633259c640 1 -- 172.21.15.133:0/879057243 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633415b1c0 con 0x7f63341582d0 2023-12-18T10:24:39.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.913+0000 7f6332d9d640 1 --2- 172.21.15.133:0/879057243 >> v2:172.21.15.133:3300/0 conn(0x7f63340ce3b0 0x7f63340ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:39.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f633259c640 1 --2- 172.21.15.133:0/879057243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63341582d0 0x7f63340c8e50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f63340cf000 tx=0x7f632401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3437a435111d4f2e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f6331d9b640 1 -- 172.21.15.133:0/879057243 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240aa430 con 0x7f63341582d0 2023-12-18T10:24:39.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f6331d9b640 1 -- 172.21.15.133:0/879057243 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63240aa590 con 0x7f63341582d0 2023-12-18T10:24:39.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f6331d9b640 1 -- 172.21.15.133:0/879057243 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240aa920 con 0x7f63341582d0 2023-12-18T10:24:39.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f63388df640 1 -- 172.21.15.133:0/879057243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63341582d0 msgr2=0x7f63340c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f63388df640 1 --2- 172.21.15.133:0/879057243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63341582d0 0x7f63340c8e50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f63340cf000 tx=0x7f632401c4d0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f63388df640 1 -- 172.21.15.133:0/879057243 shutdown_connections 2023-12-18T10:24:39.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f63388df640 1 --2- 172.21.15.133:0/879057243 >> v2:172.21.15.133:3300/0 conn(0x7f63340ce3b0 0x7f63340ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f63388df640 1 --2- 172.21.15.133:0/879057243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63341582d0 0x7f63340c8e50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f63388df640 1 -- 172.21.15.133:0/879057243 >> 172.21.15.133:0/879057243 conn(0x7f633406a2a0 msgr2=0x7f63340aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f63388df640 1 -- 172.21.15.133:0/879057243 shutdown_connections 2023-12-18T10:24:39.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.917+0000 7f63388df640 1 -- 172.21.15.133:0/879057243 wait complete. 2023-12-18T10:24:39.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 Processor -- start 2023-12-18T10:24:39.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 -- start start 2023-12-18T10:24:39.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6334070820 0x7f633414fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63340ce3b0 0x7f63341647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63341582d0 0x7f6334151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6334163740 con 0x7f63340ce3b0 2023-12-18T10:24:39.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63341639e0 con 0x7f6334070820 2023-12-18T10:24:39.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6334163cc0 con 0x7f63341582d0 2023-12-18T10:24:39.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63340ce3b0 0x7f63341647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63340ce3b0 0x7f63341647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33194/0 (socket says 172.21.15.133:33194) 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 -- 172.21.15.133:0/1908596216 learned_addr learned my addr 172.21.15.133:0/1908596216 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f633259c640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6334070820 0x7f633414fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6332d9d640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63341582d0 0x7f6334151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 -- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63341582d0 msgr2=0x7f6334151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63341582d0 0x7f6334151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 -- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6334070820 msgr2=0x7f633414fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6334070820 0x7f633414fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 -- 172.21.15.133:0/1908596216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009a70 con 0x7f63340ce3b0 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f633259c640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6334070820 0x7f633414fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:39.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f6329d9b640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63340ce3b0 0x7f63341647a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f631c00c490 tx=0x7f631c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f632b7fe640 1 -- 172.21.15.133:0/1908596216 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c0074e0 con 0x7f63340ce3b0 2023-12-18T10:24:39.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f632b7fe640 1 -- 172.21.15.133:0/1908596216 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c007640 con 0x7f63340ce3b0 2023-12-18T10:24:39.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f632b7fe640 1 -- 172.21.15.133:0/1908596216 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c004a10 con 0x7f63340ce3b0 2023-12-18T10:24:39.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 -- 172.21.15.133:0/1908596216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63240094d0 con 0x7f63340ce3b0 2023-12-18T10:24:39.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.921+0000 7f63388df640 1 -- 172.21.15.133:0/1908596216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6334164280 con 0x7f63340ce3b0 2023-12-18T10:24:39.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.925+0000 7f632b7fe640 1 -- 172.21.15.133:0/1908596216 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f631c004b70 con 0x7f63340ce3b0 2023-12-18T10:24:39.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.925+0000 7f632b7fe640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6314065a60 0x7f6314067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.925+0000 7f632b7fe640 1 -- 172.21.15.133:0/1908596216 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f631c082ce0 con 0x7f63340ce3b0 2023-12-18T10:24:39.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.925+0000 7f633259c640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6314065a60 0x7f6314067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.925+0000 7f633bc35000 1 Processor -- start 2023-12-18T10:24:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.925+0000 7f633bc35000 1 -- start start 2023-12-18T10:24:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.925+0000 7f633259c640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6314065a60 0x7f6314067f20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f63240ae000 tx=0x7f63240b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee10c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee10c540 0x5611ee0c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee0c1f60 0x5611ee0c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611edf8a3d0 con 0x5611ee0c1f60 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611edf18400 con 0x5611ee10bc20 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611edf159d0 con 0x5611ee10c540 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee0c1f60 0x5611ee0c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee0c1f60 0x5611ee0c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33210/0 (socket says 172.21.15.133:33210) 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 -- 172.21.15.133:0/3682513053 learned_addr learned my addr 172.21.15.133:0/3682513053 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6329d9b640 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee10c540 0x5611ee0c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633259c640 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee10c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 -- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee10c540 msgr2=0x5611ee0c1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee10c540 0x5611ee0c1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 -- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 msgr2=0x5611ee10c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee10c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 -- 172.21.15.133:0/3682513053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611edc0ddc0 con 0x5611ee0c1f60 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633259c640 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee10c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6332d9d640 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee0c1f60 0x5611ee0c2340 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f632c0115b0 tx=0x7f632c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a1c926d6b631c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6313fff640 1 -- 172.21.15.133:0/3682513053 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00e040 con 0x5611ee0c1f60 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6313fff640 1 -- 172.21.15.133:0/3682513053 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00f040 con 0x5611ee0c1f60 2023-12-18T10:24:39.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f6313fff640 1 -- 172.21.15.133:0/3682513053 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c003e00 con 0x5611ee0c1f60 2023-12-18T10:24:39.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- 172.21.15.133:0/3682513053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee0c1f60 msgr2=0x5611ee0c2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee0c1f60 0x5611ee0c2340 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f632c0115b0 tx=0x7f632c009750 comp rx=0 tx=0).stop 2023-12-18T10:24:39.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- 172.21.15.133:0/3682513053 shutdown_connections 2023-12-18T10:24:39.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee0c1f60 0x5611ee0c2340 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee10c540 0x5611ee0c1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 --2- 172.21.15.133:0/3682513053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee10c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- 172.21.15.133:0/3682513053 >> 172.21.15.133:0/3682513053 conn(0x5611edec08b0 msgr2=0x5611ee0c0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- 172.21.15.133:0/3682513053 shutdown_connections 2023-12-18T10:24:39.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- 172.21.15.133:0/3682513053 wait complete. 2023-12-18T10:24:39.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 -- start start 2023-12-18T10:24:39.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.929+0000 7f633bc35000 1 Processor -- start 2023-12-18T10:24:39.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee0c1f60 0x5611ee113160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee10c540 0x5611ee0ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611edf112c0 con 0x5611ee10c540 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611edeb0490 con 0x5611ee10bc20 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611edece680 con 0x5611ee0c1f60 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 10 client.0 _ll_register_callbacks cb 0x5611ee0ad920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee10c540 0x5611ee0ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6329d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee10c540 0x5611ee0ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33220/0 (socket says 172.21.15.133:33220) 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 -- 172.21.15.133:0/1214188627 learned_addr learned my addr 172.21.15.133:0/1214188627 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633259c640 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee0c1f60 0x5611ee113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 -- 172.21.15.133:0/1214188627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee0c1f60 msgr2=0x5611ee113160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee0c1f60 0x5611ee113160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 -- 172.21.15.133:0/1214188627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 msgr2=0x5611ee1136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee1136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 -- 172.21.15.133:0/1214188627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c011290 con 0x5611ee10c540 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6329d9b640 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f6332d9d640 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee10c540 0x5611ee0ccdf0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f632c009790 tx=0x7f632c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20506289f9a97cb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 1 -- 172.21.15.133:0/1214188627 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c023070 con 0x5611ee10c540 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 1 -- 172.21.15.133:0/1214188627 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f632c015bc0 con 0x5611ee10c540 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- 172.21.15.133:0/1214188627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611edece0c0 con 0x5611ee10c540 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 1 -- 172.21.15.133:0/1214188627 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f632c00e040 con 0x5611ee10c540 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 10 client.8535 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- 172.21.15.133:0/1214188627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x5611eded61f0 con 0x5611ee10c540 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 1 -- 172.21.15.133:0/1214188627 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611edece0c0 con 0x5611ee10c540 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 1 -- 172.21.15.133:0/1214188627 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f632c004020 con 0x5611ee10c540 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 10 client.8535 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 10 client.8535 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:39.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 20 client.8535 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:39.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5611ee0cdb90 0x5611ee0cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 4 client.8535 mds_command: new command op to 8127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:39.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- 172.21.15.133:0/1214188627 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611edf0fc10 con 0x5611ee0cdb90 2023-12-18T10:24:39.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633259c640 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5611ee0cdb90 0x5611ee0cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 10 client.8535 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:39.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633259c640 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5611ee0cdb90 0x5611ee0cdfa0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8707b597fa5d276 server_cookie=714d96eb74a9df0a in_seq=0 out_seq=0 2023-12-18T10:24:39.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 1 -- 172.21.15.133:0/1214188627 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5611edf0fc10 con 0x5611ee0cdb90 2023-12-18T10:24:39.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 10 client.8535 handle_command_reply: tid=0 2023-12-18T10:24:39.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 client.8535 shutdown 2023-12-18T10:24:39.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- 172.21.15.133:0/1214188627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee10c540 msgr2=0x5611ee0ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee10c540 0x5611ee0ccdf0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f632c009790 tx=0x7f632c004ac0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- 172.21.15.133:0/1214188627 shutdown_connections 2023-12-18T10:24:39.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5611ee0cdb90 0x5611ee0cdfa0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee10c540 0x5611ee0ccdf0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee10bc20 0x5611ee1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 --2- 172.21.15.133:0/1214188627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611ee0c1f60 0x5611ee113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f63117fa640 0 client.8535 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:39.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.933+0000 7f633bc35000 1 -- 172.21.15.133:0/1214188627 >> 172.21.15.133:0/1214188627 conn(0x5611edec08b0 msgr2=0x5611ee0c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.937+0000 7f633bc35000 1 -- 172.21.15.133:0/1214188627 shutdown_connections 2023-12-18T10:24:39.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.937+0000 7f633bc35000 1 -- 172.21.15.133:0/1214188627 wait complete. 2023-12-18T10:24:39.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.937+0000 7f633bc35000 20 client.8535 trim_cache size 0 max 16384 2023-12-18T10:24:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633bc35000 1 Processor -- start 2023-12-18T10:24:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633bc35000 1 -- start start 2023-12-18T10:24:39.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633bc35000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee10b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633bc35000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 0x5611ee10b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633bc35000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 0x5611ee10f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633bc35000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611edbcea40 con 0x5611ee112990 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633bc35000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611edfc8df0 con 0x5611ee0c1f60 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633bc35000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611edfe00e0 con 0x5611edec08b0 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee10b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee10b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33222/0 (socket says 172.21.15.133:33222) 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 -- 172.21.15.133:0/3098956459 learned_addr learned my addr 172.21.15.133:0/3098956459 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f6329d9b640 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 0x5611ee10b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f6332d9d640 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 0x5611ee10f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 -- 172.21.15.133:0/3098956459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 msgr2=0x5611ee10b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 0x5611ee10b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 -- 172.21.15.133:0/3098956459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 msgr2=0x5611ee10f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 0x5611ee10f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 -- 172.21.15.133:0/3098956459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611edebc540 con 0x5611ee112990 2023-12-18T10:24:39.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f633259c640 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee10b180 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f6324008010 tx=0x7f6324004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470931ad3d153278 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f6328d99640 1 -- 172.21.15.133:0/3098956459 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240cc020 con 0x5611ee112990 2023-12-18T10:24:39.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f6328d99640 1 -- 172.21.15.133:0/3098956459 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63240c4040 con 0x5611ee112990 2023-12-18T10:24:39.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.949+0000 7f6328d99640 1 -- 172.21.15.133:0/3098956459 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240cc380 con 0x5611ee112990 2023-12-18T10:24:39.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- 172.21.15.133:0/3098956459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 msgr2=0x5611ee10b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee10b180 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f6324008010 tx=0x7f6324004740 comp rx=0 tx=0).stop 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- 172.21.15.133:0/3098956459 shutdown_connections 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 0x5611ee10f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 0x5611ee10b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 --2- 172.21.15.133:0/3098956459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee10b180 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- 172.21.15.133:0/3098956459 >> 172.21.15.133:0/3098956459 conn(0x5611ee112410 msgr2=0x5611ee0c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- 172.21.15.133:0/3098956459 shutdown_connections 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- 172.21.15.133:0/3098956459 wait complete. 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- start start 2023-12-18T10:24:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 Processor -- start 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 0x5611ee171c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 0x5611ee108630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee108b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611edecf420 con 0x5611ee112990 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611edf0cc30 con 0x5611ee0c1f60 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611edf0e6c0 con 0x5611edec08b0 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 10 client.0 _ll_register_callbacks cb 0x5611edec86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee108b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee108b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33232/0 (socket says 172.21.15.133:33232) 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 -- 172.21.15.133:0/2490788195 learned_addr learned my addr 172.21.15.133:0/2490788195 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633259c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 0x5611ee171c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6329d9b640 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 0x5611ee108630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 -- 172.21.15.133:0/2490788195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 msgr2=0x5611ee171c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 0x5611ee171c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 -- 172.21.15.133:0/2490788195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 msgr2=0x5611ee108630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 0x5611ee108630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 -- 172.21.15.133:0/2490788195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633415b1c0 con 0x5611ee112990 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f6332d9d640 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee108b70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f632c002240 tx=0x7f632c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f093dbed346505a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f63117fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f63117fa640 1 -- 172.21.15.133:0/2490788195 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00e070 con 0x5611ee112990 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f63117fa640 1 -- 172.21.15.133:0/2490788195 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f632c0097c0 con 0x5611ee112990 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- 172.21.15.133:0/2490788195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611ee0c5880 con 0x5611ee112990 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f63117fa640 1 -- 172.21.15.133:0/2490788195 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f632c004490 con 0x5611ee112990 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 10 client.8541 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.953+0000 7f633bc35000 1 -- 172.21.15.133:0/2490788195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x5611edeb00b0 con 0x5611ee112990 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63117fa640 1 -- 172.21.15.133:0/2490788195 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611ee0c5880 con 0x5611ee112990 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63117fa640 1 -- 172.21.15.133:0/2490788195 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f632c003eb0 con 0x5611ee112990 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 10 client.8541 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 10 client.8541 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 20 client.8541 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5611ee10bc20 0x5611ee1090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 4 client.8541 mds_command: new command op to 8127 tid=0[{"prefix": "scrub pause"}] 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 -- 172.21.15.133:0/2490788195 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x5611ededa640 con 0x5611ee10bc20 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633259c640 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5611ee10bc20 0x5611ee1090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633259c640 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5611ee10bc20 0x5611ee1090b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20c3ff73c49ee76 server_cookie=65eb9edc08683062 in_seq=0 out_seq=0 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63117fa640 10 client.8541 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63117fa640 1 -- 172.21.15.133:0/2490788195 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5611ededa640 con 0x5611ee10bc20 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63117fa640 10 client.8541 handle_command_reply: tid=0 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 client.8541 shutdown 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 -- 172.21.15.133:0/2490788195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 msgr2=0x5611ee108b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee108b70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f632c002240 tx=0x7f632c00b040 comp rx=0 tx=0).stop 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 -- 172.21.15.133:0/2490788195 shutdown_connections 2023-12-18T10:24:39.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x5611ee10bc20 0x5611ee1090b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5611ee112990 0x5611ee108b70 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5611ee0c1f60 0x5611ee108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63117fa640 0 client.8541 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 --2- 172.21.15.133:0/2490788195 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5611edec08b0 0x5611ee171c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 -- 172.21.15.133:0/2490788195 >> 172.21.15.133:0/2490788195 conn(0x5611ee112410 msgr2=0x5611ee0c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 -- 172.21.15.133:0/2490788195 shutdown_connections 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 1 -- 172.21.15.133:0/2490788195 wait complete. 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f633bc35000 20 client.8541 trim_cache size 0 max 16384 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:24:39.961 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:39.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 -- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6314065a60 msgr2=0x7f6314067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6314065a60 0x7f6314067f20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f63240ae000 tx=0x7f63240b5040 comp rx=0 tx=0).stop 2023-12-18T10:24:39.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 -- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63340ce3b0 msgr2=0x7f63341647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:39.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63340ce3b0 0x7f63341647a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f631c00c490 tx=0x7f631c00c890 comp rx=0 tx=0).stop 2023-12-18T10:24:39.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 -- 172.21.15.133:0/1908596216 shutdown_connections 2023-12-18T10:24:39.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6314065a60 0x7f6314067f20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f63341582d0 0x7f6334151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63340ce3b0 0x7f63341647a0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 --2- 172.21.15.133:0/1908596216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6334070820 0x7f633414fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:39.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 -- 172.21.15.133:0/1908596216 >> 172.21.15.133:0/1908596216 conn(0x7f633406a2a0 msgr2=0x7f63340ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:39.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 -- 172.21.15.133:0/1908596216 shutdown_connections 2023-12-18T10:24:39.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:39.957+0000 7f63388df640 1 -- 172.21.15.133:0/1908596216 wait complete. 2023-12-18T10:24:39.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 scrub status 2023-12-18T10:24:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49ced87640 1 Processor -- start 2023-12-18T10:24:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49ced87640 1 -- start start 2023-12-18T10:24:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49ced87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c80ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49ced87640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49c8164fe0 0x7f49c80c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49ced87640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c8161000 con 0x7f49c80c87e0 2023-12-18T10:24:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49ced87640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c80cb7e0 con 0x7f49c8164fe0 2023-12-18T10:24:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49ced87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80c9160 con 0x7f49c80cb400 2023-12-18T10:24:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49cd584640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f49c80c87e0 0x7f49c81648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49882/0 (socket says 172.21.15.133:49882) 2023-12-18T10:24:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49cd584640 1 -- 172.21.15.133:0/117428781 learned_addr learned my addr 172.21.15.133:0/117428781 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.117+0000 7f49ce586640 1 --2- 172.21.15.133:0/117428781 >> v2:172.21.15.133:3300/0 conn(0x7f49c8164fe0 0x7f49c80c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49cdd85640 1 --2- 172.21.15.133:0/117428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c80ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ce586640 1 -- 172.21.15.133:0/117428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 msgr2=0x7f49c80ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ccd83640 1 -- 172.21.15.133:0/117428781 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779595959 0 0) 0x7f49b8001120 con 0x7f49c80c87e0 2023-12-18T10:24:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ce586640 1 --2- 172.21.15.133:0/117428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c80ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ce586640 1 -- 172.21.15.133:0/117428781 >> v1:172.21.15.133:6789/0 conn(0x7f49c80c87e0 legacy=0x7f49c81648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ce586640 1 -- 172.21.15.133:0/117428781 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80cc180 con 0x7f49c8164fe0 2023-12-18T10:24:40.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49cdd85640 1 --2- 172.21.15.133:0/117428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c80ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ce586640 1 --2- 172.21.15.133:0/117428781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c80c8c20 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009d90 tx=0x7f49c001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a337081e5726eb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ccd83640 1 -- 172.21.15.133:0/117428781 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00a5900 con 0x7f49c8164fe0 2023-12-18T10:24:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ccd83640 1 -- 172.21.15.133:0/117428781 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c00a5a60 con 0x7f49c8164fe0 2023-12-18T10:24:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ccd83640 1 -- 172.21.15.133:0/117428781 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00a5df0 con 0x7f49c8164fe0 2023-12-18T10:24:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ced87640 1 -- 172.21.15.133:0/117428781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 msgr2=0x7f49c80c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ced87640 1 --2- 172.21.15.133:0/117428781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c80c8c20 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009d90 tx=0x7f49c001c950 comp rx=0 tx=0).stop 2023-12-18T10:24:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ced87640 1 -- 172.21.15.133:0/117428781 shutdown_connections 2023-12-18T10:24:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ced87640 1 --2- 172.21.15.133:0/117428781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c80c8c20 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ced87640 1 --2- 172.21.15.133:0/117428781 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c80ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.121+0000 7f49ced87640 1 -- 172.21.15.133:0/117428781 >> 172.21.15.133:0/117428781 conn(0x7f49c80afd80 msgr2=0x7f49c80b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 -- 172.21.15.133:0/117428781 shutdown_connections 2023-12-18T10:24:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 -- 172.21.15.133:0/117428781 wait complete. 2023-12-18T10:24:40.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 Processor -- start 2023-12-18T10:24:40.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 -- start start 2023-12-18T10:24:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80c87e0 0x7f49c80c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c8147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c815df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80c5840 con 0x7f49c8164fe0 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c8155940 con 0x7f49c80c87e0 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ced87640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c8155c20 con 0x7f49c80cb400 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c815df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c815df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33252/0 (socket says 172.21.15.133:33252) 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 -- 172.21.15.133:0/170952176 learned_addr learned my addr 172.21.15.133:0/170952176 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49cd584640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c8147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49cdd85640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80c87e0 0x7f49c80c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 -- 172.21.15.133:0/170952176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 msgr2=0x7f49c8147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c8147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 -- 172.21.15.133:0/170952176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80c87e0 msgr2=0x7f49c80c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80c87e0 0x7f49c80c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 -- 172.21.15.133:0/170952176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0009a70 con 0x7f49c8164fe0 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49ce586640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c815df60 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f49c001a580 tx=0x7f49c00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.125+0000 7f49be7fc640 1 -- 172.21.15.133:0/170952176 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00bd070 con 0x7f49c8164fe0 2023-12-18T10:24:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49be7fc640 1 -- 172.21.15.133:0/170952176 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c00ad650 con 0x7f49c8164fe0 2023-12-18T10:24:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49ced87640 1 -- 172.21.15.133:0/170952176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c8155f00 con 0x7f49c8164fe0 2023-12-18T10:24:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49be7fc640 1 -- 172.21.15.133:0/170952176 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00ada40 con 0x7f49c8164fe0 2023-12-18T10:24:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49ced87640 1 -- 172.21.15.133:0/170952176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c815e4a0 con 0x7f49c8164fe0 2023-12-18T10:24:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49be7fc640 1 -- 172.21.15.133:0/170952176 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f49c00b4070 con 0x7f49c8164fe0 2023-12-18T10:24:40.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49be7fc640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f49ac065a60 0x7f49ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49be7fc640 1 -- 172.21.15.133:0/170952176 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f49c011da50 con 0x7f49c8164fe0 2023-12-18T10:24:40.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49cdd85640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f49ac065a60 0x7f49ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49d333a000 1 Processor -- start 2023-12-18T10:24:40.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49d333a000 1 -- start start 2023-12-18T10:24:40.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.129+0000 7f49cdd85640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f49ac065a60 0x7f49ac067f20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009950 tx=0x7f49c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b822605060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b8225baa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 0x55b8225bb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b822483430 con 0x55b8226055a0 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b822411460 con 0x55b8225bafc0 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b82240ea30 con 0x55b822604c80 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b8225baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b8225baa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33262/0 (socket says 172.21.15.133:33262) 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 -- 172.21.15.133:0/2062908184 learned_addr learned my addr 172.21.15.133:0/2062908184 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cdd85640 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b822605060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49ce586640 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 0x55b8225bb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 -- 172.21.15.133:0/2062908184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 msgr2=0x55b822605060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b822605060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 -- 172.21.15.133:0/2062908184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 msgr2=0x55b8225bb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 0x55b8225bb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 -- 172.21.15.133:0/2062908184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b822106e20 con 0x55b8226055a0 2023-12-18T10:24:40.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49cd584640 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b8225baa80 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f49b80074a0 tx=0x7f49b8004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc59fca0fe594c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49ab7fe640 1 -- 172.21.15.133:0/2062908184 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b80076b0 con 0x55b8226055a0 2023-12-18T10:24:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49ab7fe640 1 -- 172.21.15.133:0/2062908184 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8001a30 con 0x55b8226055a0 2023-12-18T10:24:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49ab7fe640 1 -- 172.21.15.133:0/2062908184 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8012350 con 0x55b8226055a0 2023-12-18T10:24:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- 172.21.15.133:0/2062908184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 msgr2=0x55b8225baa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b8225baa80 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f49b80074a0 tx=0x7f49b8004bc0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- 172.21.15.133:0/2062908184 shutdown_connections 2023-12-18T10:24:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 0x55b8225bb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b8225baa80 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 --2- 172.21.15.133:0/2062908184 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b822605060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- 172.21.15.133:0/2062908184 >> 172.21.15.133:0/2062908184 conn(0x55b8223b9910 msgr2=0x55b8225b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- 172.21.15.133:0/2062908184 shutdown_connections 2023-12-18T10:24:40.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- 172.21.15.133:0/2062908184 wait complete. 2023-12-18T10:24:40.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 -- start start 2023-12-18T10:24:40.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.133+0000 7f49d333a000 1 Processor -- start 2023-12-18T10:24:40.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8225bafc0 0x55b8226045b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b822604c80 0x55b822605980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b822605ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82240a320 con 0x55b8226055a0 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8223a94f0 con 0x55b822604c80 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8223c76e0 con 0x55b8225bafc0 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 10 client.0 _ll_register_callbacks cb 0x55b8225a6980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b822605ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b822605ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33266/0 (socket says 172.21.15.133:33266) 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 -- 172.21.15.133:0/1494672375 learned_addr learned my addr 172.21.15.133:0/1494672375 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49cdd85640 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8225bafc0 0x55b8226045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49cd584640 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b822604c80 0x55b822605980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 -- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8225bafc0 msgr2=0x55b8226045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8225bafc0 0x55b8226045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 -- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b822604c80 msgr2=0x55b822605980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b822604c80 0x55b822605980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 -- 172.21.15.133:0/1494672375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b8007100 con 0x55b8226055a0 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49ce586640 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b822605ec0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009d90 tx=0x7f49c00ef200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83d5e29a8f086e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 1 -- 172.21.15.133:0/1494672375 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c00ed520 con 0x55b8226055a0 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 1 -- 172.21.15.133:0/1494672375 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f49c00f6b60 con 0x55b8226055a0 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 -- 172.21.15.133:0/1494672375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8223c7120 con 0x55b8226055a0 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 1 -- 172.21.15.133:0/1494672375 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49c00f6d20 con 0x55b8226055a0 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 10 client.8556 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:40.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 -- 172.21.15.133:0/1494672375 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55b8223cf250 con 0x55b8226055a0 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 1 -- 172.21.15.133:0/1494672375 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b8223c7120 con 0x55b8226055a0 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 1 -- 172.21.15.133:0/1494672375 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f49c0005d20 con 0x55b8226055a0 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 10 client.8556 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 10 client.8556 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 20 client.8556 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55b822606c30 0x55b822617120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 4 client.8556 mds_command: new command op to 8118 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49d333a000 1 -- 172.21.15.133:0/1494672375 --> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b822408c70 con 0x55b822606c30 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49cdd85640 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55b822606c30 0x55b822617120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49cdd85640 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55b822606c30 0x55b822617120 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d653964d3a16873d server_cookie=8aeb8cd3b12949ad in_seq=0 out_seq=0 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 10 client.8556 ms_handle_connect on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 1 -- 172.21.15.133:0/1494672375 <== mds.1 v2:172.21.15.142:6833/4118520914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b822408c70 con 0x55b822606c30 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.137+0000 7f49a8ff9640 10 client.8556 handle_command_reply: tid=0 2023-12-18T10:24:40.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 client.8556 shutdown 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 -- 172.21.15.133:0/1494672375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 msgr2=0x55b822605ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b822605ec0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009d90 tx=0x7f49c00ef200 comp rx=0 tx=0).stop 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 -- 172.21.15.133:0/1494672375 shutdown_connections 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55b822606c30 0x55b822617120 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8226055a0 0x55b822605ec0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b822604c80 0x55b822605980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 --2- 172.21.15.133:0/1494672375 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8225bafc0 0x55b8226045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49a8ff9640 0 client.8556 ms_handle_reset on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 -- 172.21.15.133:0/1494672375 >> 172.21.15.133:0/1494672375 conn(0x55b8223b9910 msgr2=0x55b8225b9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 -- 172.21.15.133:0/1494672375 shutdown_connections 2023-12-18T10:24:40.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 1 -- 172.21.15.133:0/1494672375 wait complete. 2023-12-18T10:24:40.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.141+0000 7f49d333a000 20 client.8556 trim_cache size 0 max 16384 2023-12-18T10:24:40.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49d333a000 1 Processor -- start 2023-12-18T10:24:40.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49d333a000 1 -- start start 2023-12-18T10:24:40.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49d333a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8223b9910 0x55b822618130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49d333a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 0x55b822618670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49d333a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b8225fe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49d333a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8220c7aa0 con 0x55b8223b9910 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49d333a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8223ae040 con 0x55b8225bafc0 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49d333a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b822605bb0 con 0x55b822604c80 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49cdd85640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8223b9910 0x55b822618130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49cdd85640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8223b9910 0x55b822618130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33270/0 (socket says 172.21.15.133:33270) 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49cdd85640 1 -- 172.21.15.133:0/330305952 learned_addr learned my addr 172.21.15.133:0/330305952 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49ce586640 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b8225fe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.153+0000 7f49cd584640 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 0x55b822618670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cdd85640 1 -- 172.21.15.133:0/330305952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 msgr2=0x55b8225fe010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cdd85640 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b8225fe010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cdd85640 1 -- 172.21.15.133:0/330305952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 msgr2=0x55b822618670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cdd85640 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 0x55b822618670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cdd85640 1 -- 172.21.15.133:0/330305952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80c8080 con 0x55b8223b9910 2023-12-18T10:24:40.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cdd85640 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8223b9910 0x55b822618130 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x55b8224062f0 tx=0x7f49c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9784379cf4afd158 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49abfff640 1 -- 172.21.15.133:0/330305952 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4028040 con 0x55b8223b9910 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49abfff640 1 -- 172.21.15.133:0/330305952 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c4011a40 con 0x55b8223b9910 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49abfff640 1 -- 172.21.15.133:0/330305952 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c4003d60 con 0x55b8223b9910 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- 172.21.15.133:0/330305952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8223b9910 msgr2=0x55b822618130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8223b9910 0x55b822618130 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x55b8224062f0 tx=0x7f49c4017000 comp rx=0 tx=0).stop 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- 172.21.15.133:0/330305952 shutdown_connections 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b8225fe010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8225bafc0 0x55b822618670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 --2- 172.21.15.133:0/330305952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8223b9910 0x55b822618130 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- 172.21.15.133:0/330305952 >> 172.21.15.133:0/330305952 conn(0x55b8225c05a0 msgr2=0x55b822611fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- 172.21.15.133:0/330305952 shutdown_connections 2023-12-18T10:24:40.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- 172.21.15.133:0/330305952 wait complete. 2023-12-18T10:24:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- start start 2023-12-18T10:24:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 Processor -- start 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8223b9910 0x55b82265f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8225bafc0 0x55b822600c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b822601190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8224126f0 con 0x55b8225bafc0 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8225baae0 con 0x55b8223b9910 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b822405c90 con 0x55b822604c80 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49d333a000 10 client.0 _ll_register_callbacks cb 0x55b8223c1710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cd584640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8225bafc0 0x55b822600c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cdd85640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8223b9910 0x55b82265f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cd584640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8225bafc0 0x55b822600c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33276/0 (socket says 172.21.15.133:33276) 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cd584640 1 -- 172.21.15.133:0/3806815357 learned_addr learned my addr 172.21.15.133:0/3806815357 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49ce586640 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b822601190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cd584640 1 -- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 msgr2=0x55b822601190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cd584640 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b822601190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.157+0000 7f49cd584640 1 -- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8223b9910 msgr2=0x55b82265f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49cd584640 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8223b9910 0x55b82265f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49cd584640 1 -- 172.21.15.133:0/3806815357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c400e040 con 0x55b8225bafc0 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49cd584640 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8225bafc0 0x55b822600c50 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f49b80070d0 tx=0x7f49b8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3638916f9ec6d3a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 1 -- 172.21.15.133:0/3806815357 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b80076b0 con 0x55b8225bafc0 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 1 -- 172.21.15.133:0/3806815357 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f49b8007880 con 0x55b8225bafc0 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 -- 172.21.15.133:0/3806815357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8225be8e0 con 0x55b8225bafc0 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 1 -- 172.21.15.133:0/3806815357 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49b80159a0 con 0x55b8225bafc0 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 10 client.8562 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 -- 172.21.15.133:0/3806815357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55b8223b55a0 con 0x55b8225bafc0 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 1 -- 172.21.15.133:0/3806815357 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b8225be8e0 con 0x55b8225bafc0 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 1 -- 172.21.15.133:0/3806815357 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f49b8012070 con 0x55b8225bafc0 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 10 client.8562 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 10 client.8562 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 20 client.8562 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55b8226055a0 0x55b8226016d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 4 client.8562 mds_command: new command op to 8118 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 -- 172.21.15.133:0/3806815357 --> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b8223d36a0 con 0x55b8226055a0 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49cdd85640 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55b8226055a0 0x55b8226016d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49cdd85640 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55b8226055a0 0x55b8226016d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f92497c5be54bb5 server_cookie=baf3d836d22371db in_seq=0 out_seq=0 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 10 client.8562 ms_handle_connect on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 1 -- 172.21.15.133:0/3806815357 <== mds.1 v2:172.21.15.142:6833/4118520914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55b8223d36a0 con 0x55b8226055a0 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 10 client.8562 handle_command_reply: tid=0 2023-12-18T10:24:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 client.8562 shutdown 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 -- 172.21.15.133:0/3806815357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8225bafc0 msgr2=0x55b822600c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8225bafc0 0x55b822600c50 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f49b80070d0 tx=0x7f49b8000ee0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 -- 172.21.15.133:0/3806815357 shutdown_connections 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55b8226055a0 0x55b8226016d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b822604c80 0x55b822601190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8225bafc0 0x55b822600c50 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49a8ff9640 0 client.8562 ms_handle_reset on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 --2- 172.21.15.133:0/3806815357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8223b9910 0x55b82265f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 -- 172.21.15.133:0/3806815357 >> 172.21.15.133:0/3806815357 conn(0x55b8225c05a0 msgr2=0x55b822617120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 -- 172.21.15.133:0/3806815357 shutdown_connections 2023-12-18T10:24:40.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 1 -- 172.21.15.133:0/3806815357 wait complete. 2023-12-18T10:24:40.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49d333a000 20 client.8562 trim_cache size 0 max 16384 2023-12-18T10:24:40.166 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:40.166 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:24:40.166 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:24:40.166 INFO:teuthology.orchestra.run.smithi133.stdout: "6c914697-d827-4ecd-9e50-1715a20121d0": { 2023-12-18T10:24:40.166 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:24:40.166 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "6c914697-d827-4ecd-9e50-1715a20121d0", 2023-12-18T10:24:40.166 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:24:40.167 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:40.167 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:40.167 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:40.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 -- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f49ac065a60 msgr2=0x7f49ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f49ac065a60 0x7f49ac067f20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009950 tx=0x7f49c4008040 comp rx=0 tx=0).stop 2023-12-18T10:24:40.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 -- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 msgr2=0x7f49c815df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c815df60 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f49c001a580 tx=0x7f49c00196f0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 -- 172.21.15.133:0/170952176 shutdown_connections 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f49ac065a60 0x7f49ac067f20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8164fe0 0x7f49c815df60 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49c80cb400 0x7f49c8147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 --2- 172.21.15.133:0/170952176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49c80c87e0 0x7f49c80c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 -- 172.21.15.133:0/170952176 >> 172.21.15.133:0/170952176 conn(0x7f49c80afd80 msgr2=0x7f49c80cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 -- 172.21.15.133:0/170952176 shutdown_connections 2023-12-18T10:24:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.161+0000 7f49ced87640 1 -- 172.21.15.133:0/170952176 wait complete. 2023-12-18T10:24:40.181 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:24:40.182 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 scrub status 2023-12-18T10:24:40.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4134ab6640 1 Processor -- start 2023-12-18T10:24:40.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4134ab6640 1 -- start start 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4134ab6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4134ab6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4130159fb0 0x7f4130071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4134ab6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4130070df0 con 0x7f4130071db0 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4134ab6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413015aab0 con 0x7f4130159fb0 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4134ab6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413015a4f0 con 0x7f41300ca410 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4125d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4130159fb0 0x7f4130071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f412e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4125d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4130159fb0 0x7f4130071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:56906/0 (socket says 172.21.15.133:56906) 2023-12-18T10:24:40.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4125d9b640 1 -- 172.21.15.133:0/2772444547 learned_addr learned my addr 172.21.15.133:0/2772444547 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f412ed9d640 1 --1- 172.21.15.133:0/2772444547 >> v1:172.21.15.142:6789/0 conn(0x7f4130071db0 0x7f41300cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:35042/0 (socket says 172.21.15.133:35042) 2023-12-18T10:24:40.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.321+0000 7f4125d9b640 1 -- 172.21.15.133:0/2772444547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 msgr2=0x7f4130159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4125d9b640 1 --2- 172.21.15.133:0/2772444547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4125d9b640 1 -- 172.21.15.133:0/2772444547 >> v1:172.21.15.142:6789/0 conn(0x7f4130071db0 legacy=0x7f41300cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f412dd9b640 1 -- 172.21.15.133:0/2772444547 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081719845 0 0) 0x7f4130070df0 con 0x7f4130071db0 2023-12-18T10:24:40.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4125d9b640 1 -- 172.21.15.133:0/2772444547 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413015a7d0 con 0x7f4130159fb0 2023-12-18T10:24:40.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f412e59c640 1 --2- 172.21.15.133:0/2772444547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:40.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4125d9b640 1 --2- 172.21.15.133:0/2772444547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 0x7f4130071870 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f411800bb10 tx=0x7f411801ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7234c96e865782d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f412dd9b640 1 -- 172.21.15.133:0/2772444547 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180a7cb0 con 0x7f4130159fb0 2023-12-18T10:24:40.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f412dd9b640 1 -- 172.21.15.133:0/2772444547 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41180a7e10 con 0x7f4130159fb0 2023-12-18T10:24:40.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f412dd9b640 1 -- 172.21.15.133:0/2772444547 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180af660 con 0x7f4130159fb0 2023-12-18T10:24:40.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4134ab6640 1 -- 172.21.15.133:0/2772444547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 msgr2=0x7f4130071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4134ab6640 1 --2- 172.21.15.133:0/2772444547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 0x7f4130071870 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f411800bb10 tx=0x7f411801ebe0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4134ab6640 1 -- 172.21.15.133:0/2772444547 shutdown_connections 2023-12-18T10:24:40.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4134ab6640 1 --2- 172.21.15.133:0/2772444547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 0x7f4130071870 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4134ab6640 1 --2- 172.21.15.133:0/2772444547 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4134ab6640 1 -- 172.21.15.133:0/2772444547 >> 172.21.15.133:0/2772444547 conn(0x7f413006a2a0 msgr2=0x7f41300aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4134ab6640 1 -- 172.21.15.133:0/2772444547 shutdown_connections 2023-12-18T10:24:40.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.325+0000 7f4134ab6640 1 -- 172.21.15.133:0/2772444547 wait complete. 2023-12-18T10:24:40.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4134ab6640 1 Processor -- start 2023-12-18T10:24:40.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4134ab6640 1 -- start start 2023-12-18T10:24:40.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4134ab6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130071db0 0x7f41300c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4134ab6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4134ab6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 0x7f41301532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4134ab6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130154720 con 0x7f4130071db0 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4134ab6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300c8140 con 0x7f4130159fb0 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4134ab6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4130153810 con 0x7f41300ca410 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130071db0 0x7f41300c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130071db0 0x7f41300c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33278/0 (socket says 172.21.15.133:33278) 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 -- 172.21.15.133:0/4111487771 learned_addr learned my addr 172.21.15.133:0/4111487771 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412ed9d640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 0x7f41301532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f4125d9b640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 -- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 msgr2=0x7f4130154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 -- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 msgr2=0x7f41301532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 0x7f41301532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 -- 172.21.15.133:0/4111487771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4120009420 con 0x7f4130071db0 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412ed9d640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 0x7f41301532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.329+0000 7f412e59c640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130071db0 0x7f41300c7060 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f412000ebe0 tx=0x7f412000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.333+0000 7f41277fe640 1 -- 172.21.15.133:0/4111487771 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000eee0 con 0x7f4130071db0 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.333+0000 7f41277fe640 1 -- 172.21.15.133:0/4111487771 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412000cc30 con 0x7f4130071db0 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.333+0000 7f41277fe640 1 -- 172.21.15.133:0/4111487771 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120013470 con 0x7f4130071db0 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.333+0000 7f4134ab6640 1 -- 172.21.15.133:0/4111487771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411800b770 con 0x7f4130071db0 2023-12-18T10:24:40.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.333+0000 7f4134ab6640 1 -- 172.21.15.133:0/4111487771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4130153d80 con 0x7f4130071db0 2023-12-18T10:24:40.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.333+0000 7f41277fe640 1 -- 172.21.15.133:0/4111487771 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f41200135d0 con 0x7f4130071db0 2023-12-18T10:24:40.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.333+0000 7f41277fe640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4110065a60 0x7f4110067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f41277fe640 1 -- 172.21.15.133:0/4111487771 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4120083960 con 0x7f4130071db0 2023-12-18T10:24:40.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4110065a60 0x7f4110067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 Processor -- start 2023-12-18T10:24:40.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- start start 2023-12-18T10:24:40.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4110065a60 0x7f4110067f20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f41180b1000 tx=0x7f41180a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70306a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e703073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e701cf430 con 0x555e703515a0 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e7015d460 con 0x555e70350c80 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e7015aa30 con 0x555e70306fc0 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70306a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70306a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33292/0 (socket says 172.21.15.133:33292) 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 -- 172.21.15.133:0/936396234 learned_addr learned my addr 172.21.15.133:0/936396234 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f412ed9d640 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e703073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f412e59c640 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 -- 172.21.15.133:0/936396234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 msgr2=0x555e703073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e703073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 -- 172.21.15.133:0/936396234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 msgr2=0x555e70351060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 -- 172.21.15.133:0/936396234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e6fe52e20 con 0x555e703515a0 2023-12-18T10:24:40.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4125d9b640 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70306a80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f41180b2040 tx=0x7f4118004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a6828482ee3cdb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f410ffff640 1 -- 172.21.15.133:0/936396234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180b9d10 con 0x555e703515a0 2023-12-18T10:24:40.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f410ffff640 1 -- 172.21.15.133:0/936396234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41180b9e70 con 0x555e703515a0 2023-12-18T10:24:40.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f410ffff640 1 -- 172.21.15.133:0/936396234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180ce660 con 0x555e703515a0 2023-12-18T10:24:40.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- 172.21.15.133:0/936396234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 msgr2=0x555e70306a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70306a80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f41180b2040 tx=0x7f4118004740 comp rx=0 tx=0).stop 2023-12-18T10:24:40.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- 172.21.15.133:0/936396234 shutdown_connections 2023-12-18T10:24:40.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e703073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70306a80 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 --2- 172.21.15.133:0/936396234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- 172.21.15.133:0/936396234 >> 172.21.15.133:0/936396234 conn(0x555e70105910 msgr2=0x555e70305360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- 172.21.15.133:0/936396234 shutdown_connections 2023-12-18T10:24:40.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.337+0000 7f4137e11000 1 -- 172.21.15.133:0/936396234 wait complete. 2023-12-18T10:24:40.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 -- start start 2023-12-18T10:24:40.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 Processor -- start 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e70350260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70351ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e70156320 con 0x555e703515a0 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e700f54f0 con 0x555e70350c80 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e701136e0 con 0x555e70306fc0 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 10 client.0 _ll_register_callbacks cb 0x555e702f2980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f412ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70351ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f412e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e70350260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f412ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70351ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33300/0 (socket says 172.21.15.133:33300) 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4125d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f412ed9d640 1 -- 172.21.15.133:0/1727754693 learned_addr learned my addr 172.21.15.133:0/1727754693 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4125d9b640 1 -- 172.21.15.133:0/1727754693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 msgr2=0x555e70350260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4125d9b640 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e70350260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4125d9b640 1 -- 172.21.15.133:0/1727754693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 msgr2=0x555e70351ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4125d9b640 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70351ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4125d9b640 1 -- 172.21.15.133:0/1727754693 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413015a7d0 con 0x555e70350c80 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4125d9b640 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351980 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f411801c810 tx=0x7f411801d420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f07e53dc298c878 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f410d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f410d7fa640 1 -- 172.21.15.133:0/1727754693 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180db670 con 0x555e70350c80 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f410d7fa640 1 -- 172.21.15.133:0/1727754693 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f41180db7d0 con 0x555e70350c80 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 -- 172.21.15.133:0/1727754693 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e70113120 con 0x555e70350c80 2023-12-18T10:24:40.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f410d7fa640 1 -- 172.21.15.133:0/1727754693 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41180db990 con 0x555e70350c80 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 10 client.8002 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 -- 172.21.15.133:0/1727754693 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x555e7011b250 con 0x555e70350c80 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f410d7fa640 1 -- 172.21.15.133:0/1727754693 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555e70113120 con 0x555e70350c80 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f410d7fa640 1 -- 172.21.15.133:0/1727754693 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f41180c1070 con 0x555e70350c80 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 10 client.8002 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 10 client.8002 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.c 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 20 client.8002 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x555e703528d0 0x555e70352cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 4 client.8002 mds_command: new command op to 8109 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.341+0000 7f4137e11000 1 -- 172.21.15.133:0/1727754693 --> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e70154c70 con 0x555e703528d0 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f412e59c640 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x555e703528d0 0x555e70352cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f412e59c640 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x555e703528d0 0x555e70352cb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a7745bbaf2abfbd server_cookie=701335f53a2bb306 in_seq=0 out_seq=0 2023-12-18T10:24:40.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f410d7fa640 10 client.8002 ms_handle_connect on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:40.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f410d7fa640 1 -- 172.21.15.133:0/1727754693 <== mds.2 v2:172.21.15.133:6834/1695888167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x555e70154c70 con 0x555e703528d0 2023-12-18T10:24:40.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f410d7fa640 10 client.8002 handle_command_reply: tid=0 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 client.8002 shutdown 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 -- 172.21.15.133:0/1727754693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 msgr2=0x555e70351980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351980 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f411801c810 tx=0x7f411801d420 comp rx=0 tx=0).stop 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 -- 172.21.15.133:0/1727754693 shutdown_connections 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x555e703528d0 0x555e70352cb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e703515a0 0x555e70351ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70350c80 0x555e70351980 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 --2- 172.21.15.133:0/1727754693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e70350260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f410d7fa640 0 client.8002 ms_handle_reset on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 -- 172.21.15.133:0/1727754693 >> 172.21.15.133:0/1727754693 conn(0x555e70105910 msgr2=0x555e70305a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 -- 172.21.15.133:0/1727754693 shutdown_connections 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 1 -- 172.21.15.133:0/1727754693 wait complete. 2023-12-18T10:24:40.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.345+0000 7f4137e11000 20 client.8002 trim_cache size 0 max 16384 2023-12-18T10:24:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 Processor -- start 2023-12-18T10:24:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- start start 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e7034f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e7034f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e703515a0 0x555e70360f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e6fe13aa0 con 0x555e70350c80 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e701551b0 con 0x555e703515a0 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e70225140 con 0x555e70306fc0 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e7034f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e7034f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33306/0 (socket says 172.21.15.133:33306) 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 -- 172.21.15.133:0/2028542666 learned_addr learned my addr 172.21.15.133:0/2028542666 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f412e59c640 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e7034f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f412ed9d640 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e703515a0 0x555e70360f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 -- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 msgr2=0x555e7034f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e7034f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 -- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e703515a0 msgr2=0x555e70360f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e703515a0 0x555e70360f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 -- 172.21.15.133:0/2028542666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e701015a0 con 0x555e70350c80 2023-12-18T10:24:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f412ed9d640 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e703515a0 0x555e70360f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f412e59c640 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e7034f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:40.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4125d9b640 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e7034f580 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f411801ea10 tx=0x7f41180d4070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b78f02a340f464 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4124d99640 1 -- 172.21.15.133:0/2028542666 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180db670 con 0x555e70350c80 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4124d99640 1 -- 172.21.15.133:0/2028542666 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41180db7d0 con 0x555e70350c80 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4124d99640 1 -- 172.21.15.133:0/2028542666 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180b98d0 con 0x555e70350c80 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- 172.21.15.133:0/2028542666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 msgr2=0x555e7034f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e7034f580 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f411801ea10 tx=0x7f41180d4070 comp rx=0 tx=0).stop 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- 172.21.15.133:0/2028542666 shutdown_connections 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e703515a0 0x555e70360f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e7034f580 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 --2- 172.21.15.133:0/2028542666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e70306fc0 0x555e7034f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- 172.21.15.133:0/2028542666 >> 172.21.15.133:0/2028542666 conn(0x555e70105910 msgr2=0x555e7035d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- 172.21.15.133:0/2028542666 shutdown_connections 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- 172.21.15.133:0/2028542666 wait complete. 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 -- start start 2023-12-18T10:24:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.361+0000 7f4137e11000 1 Processor -- start 2023-12-18T10:24:40.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70306fc0 0x555e703916b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e70392110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e703515a0 0x555e70392650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e70306ae0 con 0x555e70350c80 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e70153b30 con 0x555e70306fc0 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e70153720 con 0x555e703515a0 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 10 client.0 _ll_register_callbacks cb 0x555e7010d710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e70392110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f412e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70306fc0 0x555e703916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e70392110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33318/0 (socket says 172.21.15.133:33318) 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 -- 172.21.15.133:0/3092514794 learned_addr learned my addr 172.21.15.133:0/3092514794 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f412ed9d640 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e703515a0 0x555e70392650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 -- 172.21.15.133:0/3092514794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e703515a0 msgr2=0x555e70392650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e703515a0 0x555e70392650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 -- 172.21.15.133:0/3092514794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70306fc0 msgr2=0x555e703916b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70306fc0 0x555e703916b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 -- 172.21.15.133:0/3092514794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e7011b250 con 0x555e70350c80 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f412e59c640 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70306fc0 0x555e703916b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4125d9b640 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e70392110 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f41180a7b00 tx=0x7f41180a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75939a23048c37f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 1 -- 172.21.15.133:0/3092514794 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180af850 con 0x555e70350c80 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 1 -- 172.21.15.133:0/3092514794 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f41180f1c20 con 0x555e70350c80 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- 172.21.15.133:0/3092514794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e7030a940 con 0x555e70350c80 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 1 -- 172.21.15.133:0/3092514794 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41180b98d0 con 0x555e70350c80 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 10 client.8577 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- 172.21.15.133:0/3092514794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x555e700f5110 con 0x555e70350c80 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 1 -- 172.21.15.133:0/3092514794 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555e7030a940 con 0x555e70350c80 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 1 -- 172.21.15.133:0/3092514794 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f41180c1070 con 0x555e70350c80 2023-12-18T10:24:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 10 client.8577 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 10 client.8577 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.c 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 20 client.8577 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x555e70392b90 0x555e70392f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 4 client.8577 mds_command: new command op to 8109 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- 172.21.15.133:0/3092514794 --> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555e7011f6a0 con 0x555e70392b90 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f412e59c640 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x555e70392b90 0x555e70392f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 10 client.8577 ms_handle_connect on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f412e59c640 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x555e70392b90 0x555e70392f70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=682ae3cf8efabb93 server_cookie=5840162b4de00c32 in_seq=0 out_seq=0 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 1 -- 172.21.15.133:0/3092514794 <== mds.2 v2:172.21.15.133:6834/1695888167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x555e7011f6a0 con 0x555e70392b90 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 10 client.8577 handle_command_reply: tid=0 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 client.8577 shutdown 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- 172.21.15.133:0/3092514794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 msgr2=0x555e70392110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e70392110 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f41180a7b00 tx=0x7f41180a9000 comp rx=0 tx=0).stop 2023-12-18T10:24:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- 172.21.15.133:0/3092514794 shutdown_connections 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x555e70392b90 0x555e70392f70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555e703515a0 0x555e70392650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555e70350c80 0x555e70392110 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 --2- 172.21.15.133:0/3092514794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e70306fc0 0x555e703916b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- 172.21.15.133:0/3092514794 >> 172.21.15.133:0/3092514794 conn(0x555e70105910 msgr2=0x555e7034e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f410d7fa640 0 client.8577 ms_handle_reset on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.365+0000 7f4137e11000 1 -- 172.21.15.133:0/3092514794 shutdown_connections 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4137e11000 1 -- 172.21.15.133:0/3092514794 wait complete. 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4137e11000 20 client.8577 trim_cache size 0 max 16384 2023-12-18T10:24:40.372 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: "6c914697-d827-4ecd-9e50-1715a20121d0": { 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "6c914697-d827-4ecd-9e50-1715a20121d0", 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:40.373 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 -- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4110065a60 msgr2=0x7f4110067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4110065a60 0x7f4110067f20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f41180b1000 tx=0x7f41180a9070 comp rx=0 tx=0).stop 2023-12-18T10:24:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 -- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130071db0 msgr2=0x7f41300c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130071db0 0x7f41300c7060 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f412000ebe0 tx=0x7f412000c520 comp rx=0 tx=0).stop 2023-12-18T10:24:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 -- 172.21.15.133:0/4111487771 shutdown_connections 2023-12-18T10:24:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4110065a60 0x7f4110067f20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4130159fb0 0x7f41301532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41300ca410 0x7f4130154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 --2- 172.21.15.133:0/4111487771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4130071db0 0x7f41300c7060 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 -- 172.21.15.133:0/4111487771 >> 172.21.15.133:0/4111487771 conn(0x7f413006a2a0 msgr2=0x7f413015aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 -- 172.21.15.133:0/4111487771 shutdown_connections 2023-12-18T10:24:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.369+0000 7f4134ab6640 1 -- 172.21.15.133:0/4111487771 wait complete. 2023-12-18T10:24:40.387 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:24:40.387 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-12-18T10:24:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c13e95640 1 Processor -- start 2023-12-18T10:24:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c13e95640 1 -- start start 2023-12-18T10:24:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c13e95640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c0c0ceac0 0x7f4c0c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c13e95640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c0c9390 con 0x7f4c0c070820 2023-12-18T10:24:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c13e95640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c15aee0 con 0x7f4c0c1582d0 2023-12-18T10:24:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c13e95640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c15b1c0 con 0x7f4c0c0ceac0 2023-12-18T10:24:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c12432640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c0c0ceac0 0x7f4c0c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c11430640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4c0c070820 0x7f4c0c0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49892/0 (socket says 172.21.15.133:49892) 2023-12-18T10:24:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c11430640 1 -- 172.21.15.133:0/3737057846 learned_addr learned my addr 172.21.15.133:0/3737057846 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c11c31640 1 --1- 172.21.15.133:0/3737057846 >> v1:172.21.15.142:6789/0 conn(0x7f4c0c1582d0 0x7f4c0c0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:35052/0 (socket says 172.21.15.133:35052) 2023-12-18T10:24:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c12432640 1 -- 172.21.15.133:0/3737057846 >> v1:172.21.15.142:6789/0 conn(0x7f4c0c1582d0 legacy=0x7f4c0c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c12432640 1 -- 172.21.15.133:0/3737057846 >> v1:172.21.15.133:6789/0 conn(0x7f4c0c070820 legacy=0x7f4c0c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c12432640 1 -- 172.21.15.133:0/3737057846 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c15b4a0 con 0x7f4c0c0ceac0 2023-12-18T10:24:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.529+0000 7f4c10c2f640 1 -- 172.21.15.133:0/3737057846 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227922011 0 0) 0x7f4c0c0c9390 con 0x7f4c0c070820 2023-12-18T10:24:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c12432640 1 --2- 172.21.15.133:0/3737057846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c0ceac0 0x7f4c0c0c8e50 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009d90 tx=0x7f4c0401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1df8b454ee69cd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c10c2f640 1 -- 172.21.15.133:0/3737057846 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040a5a00 con 0x7f4c0c0ceac0 2023-12-18T10:24:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c10c2f640 1 -- 172.21.15.133:0/3737057846 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c040a5b60 con 0x7f4c0c0ceac0 2023-12-18T10:24:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c10c2f640 1 -- 172.21.15.133:0/3737057846 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040ad440 con 0x7f4c0c0ceac0 2023-12-18T10:24:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c13e95640 1 -- 172.21.15.133:0/3737057846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c0ceac0 msgr2=0x7f4c0c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c13e95640 1 --2- 172.21.15.133:0/3737057846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c0ceac0 0x7f4c0c0c8e50 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009d90 tx=0x7f4c0401c920 comp rx=0 tx=0).stop 2023-12-18T10:24:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c13e95640 1 -- 172.21.15.133:0/3737057846 shutdown_connections 2023-12-18T10:24:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c13e95640 1 --2- 172.21.15.133:0/3737057846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c0ceac0 0x7f4c0c0c8e50 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c13e95640 1 -- 172.21.15.133:0/3737057846 >> 172.21.15.133:0/3737057846 conn(0x7f4c0c06a2a0 msgr2=0x7f4c0c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c13e95640 1 -- 172.21.15.133:0/3737057846 shutdown_connections 2023-12-18T10:24:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c13e95640 1 -- 172.21.15.133:0/3737057846 wait complete. 2023-12-18T10:24:40.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.533+0000 7f4c13e95640 1 Processor -- start 2023-12-18T10:24:40.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 -- start start 2023-12-18T10:24:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c070820 0x7f4c0c1f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c0ceac0 0x7f4c0c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c1582d0 0x7f4c0c0c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1f6f20 con 0x7f4c0c1582d0 2023-12-18T10:24:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1481a0 con 0x7f4c0c0ceac0 2023-12-18T10:24:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c155aa0 con 0x7f4c0c070820 2023-12-18T10:24:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c1582d0 0x7f4c0c0c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c1582d0 0x7f4c0c0c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33340/0 (socket says 172.21.15.133:33340) 2023-12-18T10:24:40.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 -- 172.21.15.133:0/3792210406 learned_addr learned my addr 172.21.15.133:0/3792210406 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c11430640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c0ceac0 0x7f4c0c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c11c31640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c070820 0x7f4c0c1f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 -- 172.21.15.133:0/3792210406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c070820 msgr2=0x7f4c0c1f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c070820 0x7f4c0c1f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 -- 172.21.15.133:0/3792210406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c0ceac0 msgr2=0x7f4c0c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c0ceac0 0x7f4c0c1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 -- 172.21.15.133:0/3792210406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c04009a70 con 0x7f4c0c1582d0 2023-12-18T10:24:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c12432640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c1582d0 0x7f4c0c0c1f50 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f4c04019530 tx=0x7f4c040196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c027fc640 1 -- 172.21.15.133:0/3792210406 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040ade20 con 0x7f4c0c1582d0 2023-12-18T10:24:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c027fc640 1 -- 172.21.15.133:0/3792210406 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c040b7410 con 0x7f4c0c1582d0 2023-12-18T10:24:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 -- 172.21.15.133:0/3792210406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c155d60 con 0x7f4c0c1582d0 2023-12-18T10:24:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c027fc640 1 -- 172.21.15.133:0/3792210406 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040b77c0 con 0x7f4c0c1582d0 2023-12-18T10:24:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.537+0000 7f4c13e95640 1 -- 172.21.15.133:0/3792210406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c156320 con 0x7f4c0c1582d0 2023-12-18T10:24:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c027fc640 1 -- 172.21.15.133:0/3792210406 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4c040b4050 con 0x7f4c0c1582d0 2023-12-18T10:24:40.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c027fc640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bf0065a60 0x7f4bf0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c027fc640 1 -- 172.21.15.133:0/3792210406 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4c0411e6e0 con 0x7f4c0c1582d0 2023-12-18T10:24:40.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c11c31640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bf0065a60 0x7f4bf0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c17205000 1 Processor -- start 2023-12-18T10:24:40.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c17205000 1 -- start start 2023-12-18T10:24:40.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c11c31640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bf0065a60 0x7f4bf0067f20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4c08000f70 tx=0x7f4c08007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c17205000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c17205000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c377e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c17205000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3783d0 0x55ca8c3787b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c17205000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c23c430 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c17205000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1ca460 con 0x55ca8c3c27f0 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c17205000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1c7a30 con 0x55ca8c3783d0 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.541+0000 7f4c11c31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11c31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33352/0 (socket says 172.21.15.133:33352) 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11c31640 1 -- 172.21.15.133:0/571063917 learned_addr learned my addr 172.21.15.133:0/571063917 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11430640 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c377e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c12432640 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3783d0 0x55ca8c3787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11c31640 1 -- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3783d0 msgr2=0x55ca8c3787b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11c31640 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3783d0 0x55ca8c3787b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11c31640 1 -- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 msgr2=0x55ca8c377e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11c31640 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c377e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11c31640 1 -- 172.21.15.133:0/571063917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca8bebfe20 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11430640 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c377e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:40.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11c31640 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c22b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f4c08007610 tx=0x7f4c08012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3ce943f4f9ea55 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4bef7fe640 1 -- 172.21.15.133:0/571063917 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08007700 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4bef7fe640 1 -- 172.21.15.133:0/571063917 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08015110 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4bef7fe640 1 -- 172.21.15.133:0/571063917 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08015bc0 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- 172.21.15.133:0/571063917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 msgr2=0x55ca8c3c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c22b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f4c08007610 tx=0x7f4c08012000 comp rx=0 tx=0).stop 2023-12-18T10:24:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- 172.21.15.133:0/571063917 shutdown_connections 2023-12-18T10:24:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3783d0 0x55ca8c3787b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c377e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 --2- 172.21.15.133:0/571063917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c22b0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- 172.21.15.133:0/571063917 >> 172.21.15.133:0/571063917 conn(0x55ca8c172910 msgr2=0x55ca8c372360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- 172.21.15.133:0/571063917 shutdown_connections 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- 172.21.15.133:0/571063917 wait complete. 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- start start 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 Processor -- start 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c3c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c27f0 0x55ca8c3af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1c3320 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1624f0 con 0x55ca8c3783d0 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1806e0 con 0x55ca8c3c27f0 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c17205000 10 client.0 _ll_register_callbacks cb 0x55ca8c35f980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.545+0000 7f4c11430640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11430640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33366/0 (socket says 172.21.15.133:33366) 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11430640 1 -- 172.21.15.133:0/950668448 learned_addr learned my addr 172.21.15.133:0/950668448 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11430640 1 -- 172.21.15.133:0/950668448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c27f0 msgr2=0x55ca8c3af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11430640 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c27f0 0x55ca8c3af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11c31640 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c3c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11430640 1 -- 172.21.15.133:0/950668448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 msgr2=0x55ca8c3c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11430640 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c3c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11430640 1 -- 172.21.15.133:0/950668448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc00f040 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11c31640 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c3c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11430640 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c9ba0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc000c10 tx=0x7f4bfc011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e3aa52bffa183c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 1 -- 172.21.15.133:0/950668448 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc011e50 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 -- 172.21.15.133:0/950668448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca8c180120 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 1 -- 172.21.15.133:0/950668448 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4bfc015680 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 1 -- 172.21.15.133:0/950668448 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bfc015840 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 10 client.8592 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 -- 172.21.15.133:0/950668448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x7f4c0800f040 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 1 -- 172.21.15.133:0/950668448 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca8c180120 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 1 -- 172.21.15.133:0/950668448 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f4bfc0159a0 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 10 client.8592 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 10 client.8592 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 20 client.8592 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55ca8c3b0210 0x55ca8c3b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 4 client.8592 mds_command: new command op to 8127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 -- 172.21.15.133:0/950668448 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca8c1c1c70 con 0x55ca8c3b0210 2023-12-18T10:24:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11c31640 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55ca8c3b0210 0x55ca8c3b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 10 client.8592 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:40.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c11c31640 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55ca8c3b0210 0x55ca8c3b0620 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e1c4141c99055ad server_cookie=4187a03e583555bc in_seq=0 out_seq=0 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 1 -- 172.21.15.133:0/950668448 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ca8c1c1c70 con 0x55ca8c3b0210 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 10 client.8592 handle_command_reply: tid=0 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 client.8592 shutdown 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 -- 172.21.15.133:0/950668448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 msgr2=0x55ca8c3c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c9ba0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc000c10 tx=0x7f4bfc011620 comp rx=0 tx=0).stop 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 -- 172.21.15.133:0/950668448 shutdown_connections 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55ca8c3b0210 0x55ca8c3b0620 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c27f0 0x55ca8c3af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c1ed0 0x55ca8c3c9ba0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4becff9640 0 client.8592 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 --2- 172.21.15.133:0/950668448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c3c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 -- 172.21.15.133:0/950668448 >> 172.21.15.133:0/950668448 conn(0x55ca8c172910 msgr2=0x55ca8c371ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 -- 172.21.15.133:0/950668448 shutdown_connections 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 1 -- 172.21.15.133:0/950668448 wait complete. 2023-12-18T10:24:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.549+0000 7f4c17205000 20 client.8592 trim_cache size 0 max 16384 2023-12-18T10:24:40.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c17205000 1 Processor -- start 2023-12-18T10:24:40.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c17205000 1 -- start start 2023-12-18T10:24:40.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c17205000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c378ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c17205000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 0x55ca8c379400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c17205000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c17205000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8be80aa0 con 0x55ca8c3c27f0 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c17205000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1c21b0 con 0x55ca8c3783d0 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c17205000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1c0b30 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33380/0 (socket says 172.21.15.133:33380) 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 -- 172.21.15.133:0/897777574 learned_addr learned my addr 172.21.15.133:0/897777574 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c11430640 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 0x55ca8c379400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 -- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 msgr2=0x55ca8c379400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c11c31640 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c378ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 0x55ca8c379400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 -- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 msgr2=0x55ca8c378ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c378ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 -- 172.21.15.133:0/897777574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca8c188250 con 0x55ca8c3c27f0 2023-12-18T10:24:40.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c11c31640 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c378ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:40.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4c12432640 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d2830 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009d90 tx=0x7f4c040ef4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d6eed9405d7333 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4beffff640 1 -- 172.21.15.133:0/897777574 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040bb020 con 0x55ca8c3c27f0 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4beffff640 1 -- 172.21.15.133:0/897777574 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0411ce90 con 0x55ca8c3c27f0 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.565+0000 7f4beffff640 1 -- 172.21.15.133:0/897777574 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040f39b0 con 0x55ca8c3c27f0 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- 172.21.15.133:0/897777574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c27f0 msgr2=0x55ca8c3d2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d2830 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009d90 tx=0x7f4c040ef4e0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- 172.21.15.133:0/897777574 shutdown_connections 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d2830 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 0x55ca8c379400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 --2- 172.21.15.133:0/897777574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3783d0 0x55ca8c378ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- 172.21.15.133:0/897777574 >> 172.21.15.133:0/897777574 conn(0x55ca8c172910 msgr2=0x55ca8c3787b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- 172.21.15.133:0/897777574 shutdown_connections 2023-12-18T10:24:40.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- 172.21.15.133:0/897777574 wait complete. 2023-12-18T10:24:40.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- start start 2023-12-18T10:24:40.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 Processor -- start 2023-12-18T10:24:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3783d0 0x55ca8c4204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 0x55ca8c420a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c3c08a0 con 0x55ca8c3783d0 2023-12-18T10:24:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1c7320 con 0x55ca8c3c27f0 2023-12-18T10:24:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ca8c1cb6f0 con 0x55ca8c3c1ed0 2023-12-18T10:24:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 10 client.0 _ll_register_callbacks cb 0x55ca8c17a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3783d0 0x55ca8c4204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3783d0 0x55ca8c4204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33398/0 (socket says 172.21.15.133:33398) 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 -- 172.21.15.133:0/1134114798 learned_addr learned my addr 172.21.15.133:0/1134114798 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c12432640 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11430640 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 0x55ca8c420a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 -- 172.21.15.133:0/1134114798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 msgr2=0x55ca8c420a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 0x55ca8c420a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 -- 172.21.15.133:0/1134114798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 msgr2=0x55ca8c3d5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 -- 172.21.15.133:0/1134114798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c156320 con 0x55ca8c3783d0 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c11c31640 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3783d0 0x55ca8c4204c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f4c08014000 tx=0x7f4c08000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c090997328558a41 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4becff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4becff9640 1 -- 172.21.15.133:0/1134114798 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08028040 con 0x55ca8c3783d0 2023-12-18T10:24:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- 172.21.15.133:0/1134114798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca8c3806c0 con 0x55ca8c3783d0 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4becff9640 1 -- 172.21.15.133:0/1134114798 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4c08007e40 con 0x55ca8c3783d0 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4becff9640 1 -- 172.21.15.133:0/1134114798 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c0802e410 con 0x55ca8c3783d0 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 10 client.8598 fetch_fsmap learned FSMap version 92 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4c17205000 1 -- 172.21.15.133:0/1134114798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55ca8c16e5a0 con 0x55ca8c3783d0 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.569+0000 7f4becff9640 1 -- 172.21.15.133:0/1134114798 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca8c3806c0 con 0x55ca8c3783d0 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4becff9640 1 -- 172.21.15.133:0/1134114798 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 92) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f4c08015b50 con 0x55ca8c3783d0 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 10 client.8598 fetch_fsmap finished waiting for FSMap version 92 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 10 client.8598 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 20 client.8598 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55ca8c3d59b0 0x55ca8c3d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 4 client.8598 mds_command: new command op to 8127 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 -- 172.21.15.133:0/1134114798 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ca8c18c6a0 con 0x55ca8c3d59b0 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c11430640 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55ca8c3d59b0 0x55ca8c3d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c11430640 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55ca8c3d59b0 0x55ca8c3d5dc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f601f83f1e9dcdb0 server_cookie=eae596cd628c82fc in_seq=0 out_seq=0 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4becff9640 10 client.8598 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4becff9640 1 -- 172.21.15.133:0/1134114798 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55ca8c18c6a0 con 0x55ca8c3d59b0 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4becff9640 10 client.8598 handle_command_reply: tid=0 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 client.8598 shutdown 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 -- 172.21.15.133:0/1134114798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3783d0 msgr2=0x55ca8c4204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3783d0 0x55ca8c4204c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f4c08014000 tx=0x7f4c08000ee0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 -- 172.21.15.133:0/1134114798 shutdown_connections 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55ca8c3d59b0 0x55ca8c3d5dc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca8c3c27f0 0x55ca8c3d5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ca8c3c1ed0 0x55ca8c420a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 --2- 172.21.15.133:0/1134114798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca8c3783d0 0x55ca8c4204c0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4becff9640 0 client.8598 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 -- 172.21.15.133:0/1134114798 >> 172.21.15.133:0/1134114798 conn(0x55ca8c172910 msgr2=0x55ca8c3790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 -- 172.21.15.133:0/1134114798 shutdown_connections 2023-12-18T10:24:40.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 1 -- 172.21.15.133:0/1134114798 wait complete. 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c17205000 20 client.8598 trim_cache size 0 max 16384 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout: "6c914697-d827-4ecd-9e50-1715a20121d0": { 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "6c914697-d827-4ecd-9e50-1715a20121d0", 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:40.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:40.578 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:40.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 -- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bf0065a60 msgr2=0x7f4bf0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bf0065a60 0x7f4bf0067f20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4c08000f70 tx=0x7f4c08007c90 comp rx=0 tx=0).stop 2023-12-18T10:24:40.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 -- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c1582d0 msgr2=0x7f4c0c0c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c1582d0 0x7f4c0c0c1f50 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f4c04019530 tx=0x7f4c040196c0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 -- 172.21.15.133:0/3792210406 shutdown_connections 2023-12-18T10:24:40.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4bf0065a60 0x7f4bf0067f20 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c0c1582d0 0x7f4c0c0c1f50 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0c0ceac0 0x7f4c0c1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 --2- 172.21.15.133:0/3792210406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4c0c070820 0x7f4c0c1f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 -- 172.21.15.133:0/3792210406 >> 172.21.15.133:0/3792210406 conn(0x7f4c0c06a2a0 msgr2=0x7f4c0c1586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 -- 172.21.15.133:0/3792210406 shutdown_connections 2023-12-18T10:24:40.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.573+0000 7f4c13e95640 1 -- 172.21.15.133:0/3792210406 wait complete. 2023-12-18T10:24:40.592 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:24:40.592 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.729+0000 7f9a37266640 1 Processor -- start 2023-12-18T10:24:40.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.729+0000 7f9a37266640 1 -- start start 2023-12-18T10:24:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a37266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a300ca000 0x7f9a30164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a37266640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a300c9460 con 0x7f9a3006c4f0 2023-12-18T10:24:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a37266640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a301574a0 con 0x7f9a301570c0 2023-12-18T10:24:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a37266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300c8b30 con 0x7f9a300ca000 2023-12-18T10:24:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a34801640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9a3006c4f0 0x7f9a300c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49896/0 (socket says 172.21.15.133:49896) 2023-12-18T10:24:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a34801640 1 -- 172.21.15.133:0/1972543963 learned_addr learned my addr 172.21.15.133:0/1972543963 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a35803640 1 --2- 172.21.15.133:0/1972543963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a300ca000 0x7f9a30164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a27fff640 1 -- 172.21.15.133:0/1972543963 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683458248 0 0) 0x7f9a301574a0 con 0x7f9a301570c0 2023-12-18T10:24:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a27fff640 1 -- 172.21.15.133:0/1972543963 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a1c005740 con 0x7f9a301570c0 2023-12-18T10:24:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a27fff640 1 -- 172.21.15.133:0/1972543963 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866663087 0 0) 0x7f9a300c9460 con 0x7f9a3006c4f0 2023-12-18T10:24:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a27fff640 1 -- 172.21.15.133:0/1972543963 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a301574a0 con 0x7f9a3006c4f0 2023-12-18T10:24:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a35803640 1 -- 172.21.15.133:0/1972543963 >> v1:172.21.15.142:6789/0 conn(0x7f9a301570c0 legacy=0x7f9a3006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a35803640 1 -- 172.21.15.133:0/1972543963 >> v1:172.21.15.133:6789/0 conn(0x7f9a3006c4f0 legacy=0x7f9a300c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.733+0000 7f9a35803640 1 -- 172.21.15.133:0/1972543963 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a300c8e10 con 0x7f9a300ca000 2023-12-18T10:24:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a35803640 1 --2- 172.21.15.133:0/1972543963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a300ca000 0x7f9a30164230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009dc0 tx=0x7f9a2801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2785ed31751790a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a27fff640 1 -- 172.21.15.133:0/1972543963 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280a5830 con 0x7f9a300ca000 2023-12-18T10:24:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a27fff640 1 -- 172.21.15.133:0/1972543963 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280a5990 con 0x7f9a300ca000 2023-12-18T10:24:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a27fff640 1 -- 172.21.15.133:0/1972543963 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280a5d20 con 0x7f9a300ca000 2023-12-18T10:24:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 -- 172.21.15.133:0/1972543963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a300ca000 msgr2=0x7f9a30164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 --2- 172.21.15.133:0/1972543963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a300ca000 0x7f9a30164230 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009dc0 tx=0x7f9a2801c8b0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 -- 172.21.15.133:0/1972543963 shutdown_connections 2023-12-18T10:24:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 --2- 172.21.15.133:0/1972543963 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a300ca000 0x7f9a30164230 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 -- 172.21.15.133:0/1972543963 >> 172.21.15.133:0/1972543963 conn(0x7f9a3006a3e0 msgr2=0x7f9a300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 -- 172.21.15.133:0/1972543963 shutdown_connections 2023-12-18T10:24:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 -- 172.21.15.133:0/1972543963 wait complete. 2023-12-18T10:24:40.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 Processor -- start 2023-12-18T10:24:40.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.737+0000 7f9a37266640 1 -- start start 2023-12-18T10:24:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3006c4f0 0x7f9a301f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300ca000 0x7f9a300c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a301570c0 0x7f9a300c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a301f5da0 con 0x7f9a301570c0 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a301f53d0 con 0x7f9a300ca000 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300c5fb0 con 0x7f9a3006c4f0 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a301570c0 0x7f9a300c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a301570c0 0x7f9a300c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33408/0 (socket says 172.21.15.133:33408) 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 -- 172.21.15.133:0/2566827206 learned_addr learned my addr 172.21.15.133:0/2566827206 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a34801640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300ca000 0x7f9a300c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35002640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3006c4f0 0x7f9a301f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 -- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3006c4f0 msgr2=0x7f9a301f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3006c4f0 0x7f9a301f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 -- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300ca000 msgr2=0x7f9a300c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300ca000 0x7f9a300c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 -- 172.21.15.133:0/2566827206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28009a70 con 0x7f9a301570c0 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a34801640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300ca000 0x7f9a300c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a35803640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a301570c0 0x7f9a300c73e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f9a280194c0 tx=0x7f9a28019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a25ffb640 1 -- 172.21.15.133:0/2566827206 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280ad640 con 0x7f9a301570c0 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a25ffb640 1 -- 172.21.15.133:0/2566827206 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280ad7a0 con 0x7f9a301570c0 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a300c8260 con 0x7f9a301570c0 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a25ffb640 1 -- 172.21.15.133:0/2566827206 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280adb10 con 0x7f9a301570c0 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a301f4d80 con 0x7f9a301570c0 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.741+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a300735b0 con 0x7f9a301570c0 2023-12-18T10:24:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.745+0000 7f9a25ffb640 1 -- 172.21.15.133:0/2566827206 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9a280b4070 con 0x7f9a301570c0 2023-12-18T10:24:40.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.745+0000 7f9a25ffb640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9a14065a60 0x7f9a14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:40.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.745+0000 7f9a25ffb640 1 -- 172.21.15.133:0/2566827206 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9a2811dfb0 con 0x7f9a301570c0 2023-12-18T10:24:40.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.745+0000 7f9a35002640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9a14065a60 0x7f9a14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:40.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.745+0000 7f9a35002640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9a14065a60 0x7f9a14067f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c007fd0 tx=0x7f9a2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.749+0000 7f9a25ffb640 1 -- 172.21.15.133:0/2566827206 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9a280eb820 con 0x7f9a301570c0 2023-12-18T10:24:40.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.929+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a301f5580 con 0x7f9a301570c0 2023-12-18T10:24:40.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.929+0000 7f9a25ffb640 1 -- 172.21.15.133:0/2566827206 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4754 (secure 0 0 0) 0x7f9a301f5580 con 0x7f9a301570c0 2023-12-18T10:24:40.931 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:40.931 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:38.326608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:40.931 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 92 2023-12-18T10:24:40.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9a14065a60 msgr2=0x7f9a14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9a14065a60 0x7f9a14067f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c007fd0 tx=0x7f9a2c009040 comp rx=0 tx=0).stop 2023-12-18T10:24:40.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a301570c0 msgr2=0x7f9a300c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:40.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a301570c0 0x7f9a300c73e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f9a280194c0 tx=0x7f9a28019650 comp rx=0 tx=0).stop 2023-12-18T10:24:40.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 shutdown_connections 2023-12-18T10:24:40.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9a14065a60 0x7f9a14067f20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a301570c0 0x7f9a300c73e0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a300ca000 0x7f9a300c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 --2- 172.21.15.133:0/2566827206 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a3006c4f0 0x7f9a301f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:40.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 >> 172.21.15.133:0/2566827206 conn(0x7f9a3006a3e0 msgr2=0x7f9a300cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:40.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 shutdown_connections 2023-12-18T10:24:40.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:40.933+0000 7f9a37266640 1 -- 172.21.15.133:0/2566827206 wait complete. 2023-12-18T10:24:40.952 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:40.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:41.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc277b640 1 Processor -- start 2023-12-18T10:24:41.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc277b640 1 -- start start 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc277b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc15ca40 0x7fdbbc0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc277b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdbbc0ce3f0 0x7fdbbc0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc277b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0cf610 0x7fdbbc1605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc277b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc0cfa70 con 0x7fdbbc0cf610 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc277b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc0d11c0 con 0x7fdbbc0ce3f0 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc277b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0d0310 con 0x7fdbbc15ca40 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc0d18640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0cf610 0x7fdbbc1605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc0d18640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0cf610 0x7fdbbc1605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33410/0 (socket says 172.21.15.133:33410) 2023-12-18T10:24:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc0d18640 1 -- 172.21.15.133:0/738159898 learned_addr learned my addr 172.21.15.133:0/738159898 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbbb7fe640 1 --2- 172.21.15.133:0/738159898 >> v2:172.21.15.142:3300/0 conn(0x7fdbbc0ce3f0 0x7fdbbc0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbbbfff640 1 --2- 172.21.15.133:0/738159898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc15ca40 0x7fdbbc0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc0d18640 1 -- 172.21.15.133:0/738159898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc15ca40 msgr2=0x7fdbbc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc0d18640 1 --2- 172.21.15.133:0/738159898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc15ca40 0x7fdbbc0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc0d18640 1 -- 172.21.15.133:0/738159898 >> v2:172.21.15.142:3300/0 conn(0x7fdbbc0ce3f0 msgr2=0x7fdbbc0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc0d18640 1 --2- 172.21.15.133:0/738159898 >> v2:172.21.15.142:3300/0 conn(0x7fdbbc0ce3f0 0x7fdbbc0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbc0d18640 1 -- 172.21.15.133:0/738159898 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0d05b0 con 0x7fdbbc0cf610 2023-12-18T10:24:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbbb7fe640 1 --2- 172.21.15.133:0/738159898 >> v2:172.21.15.142:3300/0 conn(0x7fdbbc0ce3f0 0x7fdbbc0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.089+0000 7fdbbbfff640 1 --2- 172.21.15.133:0/738159898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc15ca40 0x7fdbbc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:41.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc0d18640 1 --2- 172.21.15.133:0/738159898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc1605b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0b52a0 tx=0x7fdbb401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfc639c51f154ee server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:41.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbbaffd640 1 -- 172.21.15.133:0/738159898 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40a5590 con 0x7fdbbc0cf610 2023-12-18T10:24:41.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbbaffd640 1 -- 172.21.15.133:0/738159898 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40a56f0 con 0x7fdbbc0cf610 2023-12-18T10:24:41.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbbaffd640 1 -- 172.21.15.133:0/738159898 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40a5a80 con 0x7fdbbc0cf610 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 -- 172.21.15.133:0/738159898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 msgr2=0x7fdbbc1605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 --2- 172.21.15.133:0/738159898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc1605b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0b52a0 tx=0x7fdbb401c710 comp rx=0 tx=0).stop 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 -- 172.21.15.133:0/738159898 shutdown_connections 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 --2- 172.21.15.133:0/738159898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc1605b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 --2- 172.21.15.133:0/738159898 >> v2:172.21.15.142:3300/0 conn(0x7fdbbc0ce3f0 0x7fdbbc0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 --2- 172.21.15.133:0/738159898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc15ca40 0x7fdbbc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 -- 172.21.15.133:0/738159898 >> 172.21.15.133:0/738159898 conn(0x7fdbbc089fb0 msgr2=0x7fdbbc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 -- 172.21.15.133:0/738159898 shutdown_connections 2023-12-18T10:24:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.093+0000 7fdbc277b640 1 -- 172.21.15.133:0/738159898 wait complete. 2023-12-18T10:24:41.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 Processor -- start 2023-12-18T10:24:41.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 -- start start 2023-12-18T10:24:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc0ce3f0 0x7fdbbc151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbbc15ca40 0x7fdbbc155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc154970 con 0x7fdbbc0cf610 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0c6360 con 0x7fdbbc15ca40 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc152df0 con 0x7fdbbc0ce3f0 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33414/0 (socket says 172.21.15.133:33414) 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 -- 172.21.15.133:0/921925891 learned_addr learned my addr 172.21.15.133:0/921925891 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbbfff640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc0ce3f0 0x7fdbbc151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc0d18640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbbc15ca40 0x7fdbbc155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 -- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc0ce3f0 msgr2=0x7fdbbc151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc0ce3f0 0x7fdbbc151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 -- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbbc15ca40 msgr2=0x7fdbbc155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbbc15ca40 0x7fdbbc155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 -- 172.21.15.133:0/921925891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009b30 con 0x7fdbbc0cf610 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc0d18640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbbc15ca40 0x7fdbbc155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbbb7fe640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc152410 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000c7c0 tx=0x7fdbb000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbb8ff9640 1 -- 172.21.15.133:0/921925891 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0005ba0 con 0x7fdbbc0cf610 2023-12-18T10:24:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbb8ff9640 1 -- 172.21.15.133:0/921925891 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0005d00 con 0x7fdbbc0cf610 2023-12-18T10:24:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc1530d0 con 0x7fdbbc0cf610 2023-12-18T10:24:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbb8ff9640 1 -- 172.21.15.133:0/921925891 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0006250 con 0x7fdbbc0cf610 2023-12-18T10:24:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc152150 con 0x7fdbbc0cf610 2023-12-18T10:24:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.097+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc154ab0 con 0x7fdbbc0cf610 2023-12-18T10:24:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.101+0000 7fdbb8ff9640 1 -- 172.21.15.133:0/921925891 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdbb00063b0 con 0x7fdbbc0cf610 2023-12-18T10:24:41.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.101+0000 7fdbb8ff9640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdba8065a60 0x7fdba8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:41.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.101+0000 7fdbb8ff9640 1 -- 172.21.15.133:0/921925891 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdbb0083220 con 0x7fdbbc0cf610 2023-12-18T10:24:41.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.101+0000 7fdbbbfff640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdba8065a60 0x7fdba8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:41.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.101+0000 7fdbbbfff640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdba8065a60 0x7fdba8067f20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00a990 tx=0x7fdbac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:41.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.105+0000 7fdbb8ff9640 1 -- 172.21.15.133:0/921925891 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdbb0050a10 con 0x7fdbbc0cf610 2023-12-18T10:24:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.305+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdbbc04e000 con 0x7fdbbc0cf610 2023-12-18T10:24:41.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbb8ff9640 1 -- 172.21.15.133:0/921925891 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1337 (secure 0 0 0) 0x7fdbb0054030 con 0x7fdbbc0cf610 2023-12-18T10:24:41.308 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:41.308 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":421,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694751,"bytes_used":264871936,"bytes_avail":772829241344,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9810,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":92,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-12-18T10:23:47.169360+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:41.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdba8065a60 msgr2=0x7fdba8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:41.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdba8065a60 0x7fdba8067f20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00a990 tx=0x7fdbac008040 comp rx=0 tx=0).stop 2023-12-18T10:24:41.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 msgr2=0x7fdbbc152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:41.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc152410 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000c7c0 tx=0x7fdbb000cc80 comp rx=0 tx=0).stop 2023-12-18T10:24:41.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 shutdown_connections 2023-12-18T10:24:41.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdba8065a60 0x7fdba8067f20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbbc15ca40 0x7fdbbc155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc0cf610 0x7fdbbc152410 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 --2- 172.21.15.133:0/921925891 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdbbc0ce3f0 0x7fdbbc151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 >> 172.21.15.133:0/921925891 conn(0x7fdbbc089fb0 msgr2=0x7fdbbc15bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 shutdown_connections 2023-12-18T10:24:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:41.309+0000 7fdbc277b640 1 -- 172.21.15.133:0/921925891 wait complete. 2023-12-18T10:24:41.329 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-12-18T10:24:42.330 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:42.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.477+0000 7f7dcc5c0640 1 Processor -- start 2023-12-18T10:24:42.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.477+0000 7f7dcc5c0640 1 -- start start 2023-12-18T10:24:42.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcc5c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc406c4f0 0x7f7dc40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcc5c0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7dc40c9e30 0x7f7dc4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcc5c0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc40c9460 con 0x7f7dc41570c0 2023-12-18T10:24:42.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcc5c0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc41574a0 con 0x7f7dc40c9e30 2023-12-18T10:24:42.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcc5c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40c8b30 con 0x7f7dc406c4f0 2023-12-18T10:24:42.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcab5d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7dc40c9e30 0x7f7dc4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcab5d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7dc40c9e30 0x7f7dc4070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33424/0 (socket says 172.21.15.133:33424) 2023-12-18T10:24:42.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcab5d640 1 -- 172.21.15.133:0/4253334062 learned_addr learned my addr 172.21.15.133:0/4253334062 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:42.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dc9b5b640 1 --2- 172.21.15.133:0/4253334062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc406c4f0 0x7f7dc40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcab5d640 1 -- 172.21.15.133:0/4253334062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc406c4f0 msgr2=0x7f7dc40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:42.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcab5d640 1 --2- 172.21.15.133:0/4253334062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc406c4f0 0x7f7dc40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcab5d640 1 -- 172.21.15.133:0/4253334062 >> v1:172.21.15.142:6789/0 conn(0x7f7dc41570c0 legacy=0x7f7dc406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcab5d640 1 -- 172.21.15.133:0/4253334062 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40c8e10 con 0x7f7dc40c9e30 2023-12-18T10:24:42.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.481+0000 7f7dcab5d640 1 --2- 172.21.15.133:0/4253334062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc40c9e30 0x7f7dc4070df0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009e50 tx=0x7f7dbc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bc0b11040630f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:42.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dc935a640 1 -- 172.21.15.133:0/4253334062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0a58e0 con 0x7f7dc40c9e30 2023-12-18T10:24:42.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dc935a640 1 -- 172.21.15.133:0/4253334062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc0a5a40 con 0x7f7dc40c9e30 2023-12-18T10:24:42.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dc935a640 1 -- 172.21.15.133:0/4253334062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0a5dd0 con 0x7f7dc40c9e30 2023-12-18T10:24:42.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/4253334062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc40c9e30 msgr2=0x7f7dc4070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/4253334062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc40c9e30 0x7f7dc4070df0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009e50 tx=0x7f7dbc01ca10 comp rx=0 tx=0).stop 2023-12-18T10:24:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/4253334062 shutdown_connections 2023-12-18T10:24:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/4253334062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc40c9e30 0x7f7dc4070df0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/4253334062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc406c4f0 0x7f7dc40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/4253334062 >> 172.21.15.133:0/4253334062 conn(0x7f7dc406a3e0 msgr2=0x7f7dc40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/4253334062 shutdown_connections 2023-12-18T10:24:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/4253334062 wait complete. 2023-12-18T10:24:42.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 Processor -- start 2023-12-18T10:24:42.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.485+0000 7f7dcc5c0640 1 -- start start 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc406c4f0 0x7f7dc41f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc40c9e30 0x7f7dc40c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc41570c0 0x7f7dc40c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41f8b50 con 0x7f7dc41570c0 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40c4990 con 0x7f7dc406c4f0 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40c4c70 con 0x7f7dc40c9e30 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc41570c0 0x7f7dc40c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dca35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc406c4f0 0x7f7dc41f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc41570c0 0x7f7dc40c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33436/0 (socket says 172.21.15.133:33436) 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 -- 172.21.15.133:0/3456618100 learned_addr learned my addr 172.21.15.133:0/3456618100 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dc9b5b640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc40c9e30 0x7f7dc40c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 -- 172.21.15.133:0/3456618100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc40c9e30 msgr2=0x7f7dc40c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc40c9e30 0x7f7dc40c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 -- 172.21.15.133:0/3456618100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc406c4f0 msgr2=0x7f7dc41f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc406c4f0 0x7f7dc41f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 -- 172.21.15.133:0/3456618100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009b30 con 0x7f7dc41570c0 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcab5d640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc41570c0 0x7f7dc40c4380 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0af040 tx=0x7f7dbc0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dbaffd640 1 -- 172.21.15.133:0/3456618100 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc007880 con 0x7f7dc41570c0 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dbaffd640 1 -- 172.21.15.133:0/3456618100 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc007a00 con 0x7f7dc41570c0 2023-12-18T10:24:42.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dbaffd640 1 -- 172.21.15.133:0/3456618100 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc007db0 con 0x7f7dc41570c0 2023-12-18T10:24:42.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc41f8500 con 0x7f7dc41570c0 2023-12-18T10:24:42.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc415a310 con 0x7f7dc41570c0 2023-12-18T10:24:42.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc40735b0 con 0x7f7dc41570c0 2023-12-18T10:24:42.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.489+0000 7f7dbaffd640 1 -- 172.21.15.133:0/3456618100 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7dbc0b8440 con 0x7f7dc41570c0 2023-12-18T10:24:42.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.493+0000 7f7dbaffd640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7da8065a90 0x7f7da8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.493+0000 7f7dbaffd640 1 -- 172.21.15.133:0/3456618100 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7dbc11edd0 con 0x7f7dc41570c0 2023-12-18T10:24:42.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.493+0000 7f7dca35c640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7da8065a90 0x7f7da8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.493+0000 7f7dca35c640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7da8065a90 0x7f7da8067f50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4159b50 tx=0x7f7dc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:42.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.497+0000 7f7dbaffd640 1 -- 172.21.15.133:0/3456618100 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7dbc0ec790 con 0x7f7dc41570c0 2023-12-18T10:24:42.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.673+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7dc404e000 con 0x7f7dc41570c0 2023-12-18T10:24:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dbaffd640 1 -- 172.21.15.133:0/3456618100 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4754 (secure 0 0 0) 0x7f7dbc0efdb0 con 0x7f7dc41570c0 2023-12-18T10:24:42.676 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:42.676 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:38.326608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 92 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7da8065a90 msgr2=0x7f7da8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7da8065a90 0x7f7da8067f50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4159b50 tx=0x7f7dc0009040 comp rx=0 tx=0).stop 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc41570c0 msgr2=0x7f7dc40c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc41570c0 0x7f7dc40c4380 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0af040 tx=0x7f7dbc0197b0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 shutdown_connections 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7da8065a90 0x7f7da8067f50 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dc41570c0 0x7f7dc40c4380 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7dc40c9e30 0x7f7dc40c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 --2- 172.21.15.133:0/3456618100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7dc406c4f0 0x7f7dc41f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 >> 172.21.15.133:0/3456618100 conn(0x7f7dc406a3e0 msgr2=0x7f7dc414f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:42.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 shutdown_connections 2023-12-18T10:24:42.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.677+0000 7f7dcc5c0640 1 -- 172.21.15.133:0/3456618100 wait complete. 2023-12-18T10:24:42.697 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:42.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:42.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f456a925640 1 Processor -- start 2023-12-18T10:24:42.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f456a925640 1 -- start start 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f456a925640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4564158c20 0x7f4564070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f456a925640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45640cb180 0x7f45640ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f456a925640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4564070b80 con 0x7f456415c800 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f456a925640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4564070e60 con 0x7f4564158c20 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f456a925640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4564071140 con 0x7f45640cb180 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f4563fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4564158c20 0x7f4564070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f4563fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4564158c20 0x7f4564070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33444/0 (socket says 172.21.15.133:33444) 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f4563fff640 1 -- 172.21.15.133:0/2532186028 learned_addr learned my addr 172.21.15.133:0/2532186028 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:42.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.833+0000 7f4568ec2640 1 --2- 172.21.15.133:0/2532186028 >> v2:172.21.15.142:3300/0 conn(0x7f45640cb180 0x7f45640ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4563fff640 1 -- 172.21.15.133:0/2532186028 >> v2:172.21.15.142:3300/0 conn(0x7f45640cb180 msgr2=0x7f45640ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:42.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4563fff640 1 --2- 172.21.15.133:0/2532186028 >> v2:172.21.15.142:3300/0 conn(0x7f45640cb180 0x7f45640ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4563fff640 1 -- 172.21.15.133:0/2532186028 >> v1:172.21.15.142:6789/0 conn(0x7f456415c800 legacy=0x7f45640caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4563fff640 1 -- 172.21.15.133:0/2532186028 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4564071420 con 0x7f4564158c20 2023-12-18T10:24:42.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4568ec2640 1 --2- 172.21.15.133:0/2532186028 >> v2:172.21.15.142:3300/0 conn(0x7f45640cb180 0x7f45640ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:42.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4563fff640 1 --2- 172.21.15.133:0/2532186028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4564158c20 0x7f4564070510 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f45640c53c0 tx=0x7f455401f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1374208e0c7291b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:42.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4562ffd640 1 -- 172.21.15.133:0/2532186028 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540a7b80 con 0x7f4564158c20 2023-12-18T10:24:42.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4562ffd640 1 -- 172.21.15.133:0/2532186028 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45540a7ce0 con 0x7f4564158c20 2023-12-18T10:24:42.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.837+0000 7f4562ffd640 1 -- 172.21.15.133:0/2532186028 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540af660 con 0x7f4564158c20 2023-12-18T10:24:42.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- 172.21.15.133:0/2532186028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4564158c20 msgr2=0x7f4564070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 --2- 172.21.15.133:0/2532186028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4564158c20 0x7f4564070510 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f45640c53c0 tx=0x7f455401f570 comp rx=0 tx=0).stop 2023-12-18T10:24:42.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- 172.21.15.133:0/2532186028 shutdown_connections 2023-12-18T10:24:42.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 --2- 172.21.15.133:0/2532186028 >> v2:172.21.15.142:3300/0 conn(0x7f45640cb180 0x7f45640ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 --2- 172.21.15.133:0/2532186028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4564158c20 0x7f4564070510 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- 172.21.15.133:0/2532186028 >> 172.21.15.133:0/2532186028 conn(0x7f456406a3e0 msgr2=0x7f45640afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:42.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- 172.21.15.133:0/2532186028 shutdown_connections 2023-12-18T10:24:42.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- 172.21.15.133:0/2532186028 wait complete. 2023-12-18T10:24:42.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 Processor -- start 2023-12-18T10:24:42.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- start start 2023-12-18T10:24:42.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45640cb180 0x7f4564146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564158c20 0x7f456415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456415c800 0x7f456414ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456414da30 con 0x7f45640cb180 2023-12-18T10:24:42.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456415b9d0 con 0x7f456415c800 2023-12-18T10:24:42.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f456a925640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456415bcb0 con 0x7f4564158c20 2023-12-18T10:24:42.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4563fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45640cb180 0x7f4564146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4563fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45640cb180 0x7f4564146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33446/0 (socket says 172.21.15.133:33446) 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4563fff640 1 -- 172.21.15.133:0/4270589519 learned_addr learned my addr 172.21.15.133:0/4270589519 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4568ec2640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456415c800 0x7f456414ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f45637fe640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564158c20 0x7f456415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4563fff640 1 -- 172.21.15.133:0/4270589519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564158c20 msgr2=0x7f456415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4563fff640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564158c20 0x7f456415b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4563fff640 1 -- 172.21.15.133:0/4270589519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456415c800 msgr2=0x7f456414ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4563fff640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456415c800 0x7f456414ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.841+0000 7f4563fff640 1 -- 172.21.15.133:0/4270589519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455400b770 con 0x7f45640cb180 2023-12-18T10:24:42.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f4563fff640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45640cb180 0x7f4564146750 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f455401b720 tx=0x7f455401b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:42.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f4560ff9640 1 -- 172.21.15.133:0/4270589519 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554006ee0 con 0x7f45640cb180 2023-12-18T10:24:42.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f4560ff9640 1 -- 172.21.15.133:0/4270589519 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45540afe80 con 0x7f45640cb180 2023-12-18T10:24:42.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f4560ff9640 1 -- 172.21.15.133:0/4270589519 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540ba620 con 0x7f45640cb180 2023-12-18T10:24:42.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45640c8800 con 0x7f45640cb180 2023-12-18T10:24:42.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456415b630 con 0x7f45640cb180 2023-12-18T10:24:42.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45640735b0 con 0x7f45640cb180 2023-12-18T10:24:42.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f4560ff9640 1 -- 172.21.15.133:0/4270589519 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45540b6040 con 0x7f45640cb180 2023-12-18T10:24:42.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f4560ff9640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4550065a60 0x7f4550067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:42.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f4560ff9640 1 -- 172.21.15.133:0/4270589519 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4554120670 con 0x7f45640cb180 2023-12-18T10:24:42.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.845+0000 7f45637fe640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4550065a60 0x7f4550067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:42.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.849+0000 7f45637fe640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4550065a60 0x7f4550067f20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4564136d70 tx=0x7f4558009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:42.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:42.849+0000 7f4560ff9640 1 -- 172.21.15.133:0/4270589519 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45540edf00 con 0x7f45640cb180 2023-12-18T10:24:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.053+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f456404e000 con 0x7f45640cb180 2023-12-18T10:24:43.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.053+0000 7f4560ff9640 1 -- 172.21.15.133:0/4270589519 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1337 (secure 0 0 0) 0x7f45540f1520 con 0x7f45640cb180 2023-12-18T10:24:43.053 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:43.054 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":422,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694751,"bytes_used":264871936,"bytes_avail":772829241344,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9213,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":92,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-12-18T10:23:47.169360+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4550065a60 msgr2=0x7f4550067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4550065a60 0x7f4550067f20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4564136d70 tx=0x7f4558009040 comp rx=0 tx=0).stop 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45640cb180 msgr2=0x7f4564146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45640cb180 0x7f4564146750 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f455401b720 tx=0x7f455401b8b0 comp rx=0 tx=0).stop 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 shutdown_connections 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4550065a60 0x7f4550067f20 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456415c800 0x7f456414ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564158c20 0x7f456415b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 --2- 172.21.15.133:0/4270589519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45640cb180 0x7f4564146750 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 >> 172.21.15.133:0/4270589519 conn(0x7f456406a3e0 msgr2=0x7f45640cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 shutdown_connections 2023-12-18T10:24:43.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:43.057+0000 7f456a925640 1 -- 172.21.15.133:0/4270589519 wait complete. 2023-12-18T10:24:43.075 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-12-18T10:24:44.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.217+0000 7fab0238f640 1 Processor -- start 2023-12-18T10:24:44.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.217+0000 7fab0238f640 1 -- start start 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7fab0238f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faafc158c20 0x7faafc070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7fab0238f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faafc15c800 0x7faafc0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7fab0238f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc0cafb0 0x7faafc06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7fab0238f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc0cb440 con 0x7faafc158c20 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7fab0238f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc070b80 con 0x7faafc15c800 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7fab0238f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc070e60 con 0x7faafc0cafb0 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faafc158c20 0x7faafc070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faafc158c20 0x7faafc070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33448/0 (socket says 172.21.15.133:33448) 2023-12-18T10:24:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafbfff640 1 -- 172.21.15.133:0/1014903279 learned_addr learned my addr 172.21.15.133:0/1014903279 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7fab0092c640 1 --2- 172.21.15.133:0/1014903279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc0cafb0 0x7faafc06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafb7fe640 1 --2- 172.21.15.133:0/1014903279 >> v2:172.21.15.142:3300/0 conn(0x7faafc15c800 0x7faafc0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafbfff640 1 -- 172.21.15.133:0/1014903279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc0cafb0 msgr2=0x7faafc06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafbfff640 1 --2- 172.21.15.133:0/1014903279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc0cafb0 0x7faafc06bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafbfff640 1 -- 172.21.15.133:0/1014903279 >> v2:172.21.15.142:3300/0 conn(0x7faafc15c800 msgr2=0x7faafc0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafbfff640 1 --2- 172.21.15.133:0/1014903279 >> v2:172.21.15.142:3300/0 conn(0x7faafc15c800 0x7faafc0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.221+0000 7faafbfff640 1 -- 172.21.15.133:0/1014903279 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc071140 con 0x7faafc158c20 2023-12-18T10:24:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7faafbfff640 1 --2- 172.21.15.133:0/1014903279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc070510 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7faafc0cbc00 tx=0x7faaec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5dde267bd3bfa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7faafaffd640 1 -- 172.21.15.133:0/1014903279 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec0ad680 con 0x7faafc158c20 2023-12-18T10:24:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7faafaffd640 1 -- 172.21.15.133:0/1014903279 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec0ad7e0 con 0x7faafc158c20 2023-12-18T10:24:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7faafaffd640 1 -- 172.21.15.133:0/1014903279 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec0adb70 con 0x7faafc158c20 2023-12-18T10:24:44.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 -- 172.21.15.133:0/1014903279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 msgr2=0x7faafc070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 --2- 172.21.15.133:0/1014903279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc070510 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7faafc0cbc00 tx=0x7faaec01c440 comp rx=0 tx=0).stop 2023-12-18T10:24:44.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 -- 172.21.15.133:0/1014903279 shutdown_connections 2023-12-18T10:24:44.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 --2- 172.21.15.133:0/1014903279 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc0cafb0 0x7faafc06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 --2- 172.21.15.133:0/1014903279 >> v2:172.21.15.142:3300/0 conn(0x7faafc15c800 0x7faafc0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 --2- 172.21.15.133:0/1014903279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc070510 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 -- 172.21.15.133:0/1014903279 >> 172.21.15.133:0/1014903279 conn(0x7faafc06a3e0 msgr2=0x7faafc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 -- 172.21.15.133:0/1014903279 shutdown_connections 2023-12-18T10:24:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.225+0000 7fab0238f640 1 -- 172.21.15.133:0/1014903279 wait complete. 2023-12-18T10:24:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 Processor -- start 2023-12-18T10:24:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 -- start start 2023-12-18T10:24:44.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faafc0cafb0 0x7faafc14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc15c800 0x7faafc0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc1513d0 con 0x7faafc158c20 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc159180 con 0x7faafc0cafb0 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc1506d0 con 0x7faafc15c800 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc0b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33458/0 (socket says 172.21.15.133:33458) 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 -- 172.21.15.133:0/3566143097 learned_addr learned my addr 172.21.15.133:0/3566143097 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafbfff640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faafc0cafb0 0x7faafc14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0092c640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc15c800 0x7faafc0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 -- 172.21.15.133:0/3566143097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc15c800 msgr2=0x7faafc0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc15c800 0x7faafc0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 -- 172.21.15.133:0/3566143097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faafc0cafb0 msgr2=0x7faafc14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faafc0cafb0 0x7faafc14f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 -- 172.21.15.133:0/3566143097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0094d0 con 0x7faafc158c20 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faafb7fe640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc0b0e60 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7faaf000d5f0 tx=0x7faaf000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:44.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faaf8ff9640 1 -- 172.21.15.133:0/3566143097 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00125f0 con 0x7faafc158c20 2023-12-18T10:24:44.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faaf8ff9640 1 -- 172.21.15.133:0/3566143097 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0012750 con 0x7faafc158c20 2023-12-18T10:24:44.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7faaf8ff9640 1 -- 172.21.15.133:0/3566143097 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0012ae0 con 0x7faafc158c20 2023-12-18T10:24:44.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc0c8800 con 0x7faafc158c20 2023-12-18T10:24:44.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.229+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc150c90 con 0x7faafc158c20 2023-12-18T10:24:44.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.233+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc0735b0 con 0x7faafc158c20 2023-12-18T10:24:44.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.233+0000 7faaf8ff9640 1 -- 172.21.15.133:0/3566143097 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faaf0012c40 con 0x7faafc158c20 2023-12-18T10:24:44.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.233+0000 7faaf8ff9640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faae8065a60 0x7faae8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.233+0000 7faaf8ff9640 1 -- 172.21.15.133:0/3566143097 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faaf0083670 con 0x7faafc158c20 2023-12-18T10:24:44.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.233+0000 7faafbfff640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faae8065a60 0x7faae8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.233+0000 7faafbfff640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faae8065a60 0x7faae8067f20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7faaec0af000 tx=0x7faaec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:44.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.237+0000 7faaf8ff9640 1 -- 172.21.15.133:0/3566143097 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faaf0050f80 con 0x7faafc158c20 2023-12-18T10:24:44.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.417+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faafc04e000 con 0x7faafc158c20 2023-12-18T10:24:44.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.417+0000 7faaf8ff9640 1 -- 172.21.15.133:0/3566143097 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4754 (secure 0 0 0) 0x7faaf0007380 con 0x7faafc158c20 2023-12-18T10:24:44.417 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:44.418 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:38.326608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":7,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:44.418 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 92 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.417+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faae8065a60 msgr2=0x7faae8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.417+0000 7fab0238f640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faae8065a60 0x7faae8067f20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7faaec0af000 tx=0x7faaec0a7000 comp rx=0 tx=0).stop 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.417+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 msgr2=0x7faafc0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.417+0000 7fab0238f640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc0b0e60 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7faaf000d5f0 tx=0x7faaf000dab0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.421+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 shutdown_connections 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.421+0000 7fab0238f640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7faae8065a60 0x7faae8067f20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.421+0000 7fab0238f640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faafc15c800 0x7faafc0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.421+0000 7fab0238f640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faafc158c20 0x7faafc0b0e60 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.421+0000 7fab0238f640 1 --2- 172.21.15.133:0/3566143097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faafc0cafb0 0x7faafc14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.421+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 >> 172.21.15.133:0/3566143097 conn(0x7faafc06a3e0 msgr2=0x7faafc0ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.421+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 shutdown_connections 2023-12-18T10:24:44.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.421+0000 7fab0238f640 1 -- 172.21.15.133:0/3566143097 wait complete. 2023-12-18T10:24:44.439 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:44.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:44.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.573+0000 7f4cbd56d640 1 Processor -- start 2023-12-18T10:24:44.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.573+0000 7f4cbd56d640 1 -- start start 2023-12-18T10:24:44.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cbd56d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cb815a680 0x7f4cb815e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cbd56d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb815f100 con 0x7f4cb806fdb0 2023-12-18T10:24:44.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cbd56d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb80ca7d0 con 0x7f4cb80cac10 2023-12-18T10:24:44.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cbd56d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb815e860 con 0x7f4cb815a680 2023-12-18T10:24:44.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb77fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4cb806fdb0 0x7f4cb80c9330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49900/0 (socket says 172.21.15.133:49900) 2023-12-18T10:24:44.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb77fe640 1 -- 172.21.15.133:0/2461751044 learned_addr learned my addr 172.21.15.133:0/2461751044 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945557607 0 0) 0x7f4cb815f100 con 0x7f4cb806fdb0 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb6ffd640 1 --2- 172.21.15.133:0/2461751044 >> v2:172.21.15.142:3300/0 conn(0x7f4cb815a680 0x7f4cb815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca4003530 con 0x7f4cb806fdb0 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3345551136 0 0) 0x7f4ca4003530 con 0x7f4cb806fdb0 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 >> v2:172.21.15.142:3300/0 conn(0x7f4cb815a680 msgr2=0x7f4cb815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 --2- 172.21.15.133:0/2461751044 >> v2:172.21.15.142:3300/0 conn(0x7f4cb815a680 0x7f4cb815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 >> v1:172.21.15.142:6789/0 conn(0x7f4cb80cac10 legacy=0x7f4cb815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb815eb40 con 0x7f4cb806fdb0 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f4cb0001a00 con 0x7f4cb806fdb0 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 >> v1:172.21.15.133:6789/0 conn(0x7f4cb806fdb0 legacy=0x7f4cb80c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca4003980 0x7f4ca4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ca40047d0 0x7f4ca4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca4005190 0x7f4ca400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb815e860 con 0x7f4ca40047d0 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca400c130 con 0x7f4ca4003980 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca400c2f0 con 0x7f4ca4005190 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cae7fc640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ca40047d0 0x7f4ca4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb6ffd640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca4003980 0x7f4ca4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb77fe640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca4005190 0x7f4ca400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cae7fc640 1 -- 172.21.15.133:0/2461751044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca4005190 msgr2=0x7f4ca400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cae7fc640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca4005190 0x7f4ca400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cae7fc640 1 -- 172.21.15.133:0/2461751044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca4003980 msgr2=0x7f4ca4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cae7fc640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ca4003980 0x7f4ca4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cae7fc640 1 -- 172.21.15.133:0/2461751044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4003530 con 0x7f4ca40047d0 2023-12-18T10:24:44.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.577+0000 7f4cb77fe640 1 -- 172.21.15.133:0/2461751044 reap_dead start 2023-12-18T10:24:44.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cae7fc640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ca40047d0 0x7f4ca4004c50 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8001780 tx=0x7f4ca801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d77e3db3e5fc1f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:44.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80052d0 con 0x7f4ca40047d0 2023-12-18T10:24:44.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca80a7050 con 0x7f4ca40047d0 2023-12-18T10:24:44.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cb67fc640 1 -- 172.21.15.133:0/2461751044 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8003600 con 0x7f4ca40047d0 2023-12-18T10:24:44.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cbd56d640 1 -- 172.21.15.133:0/2461751044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ca40047d0 msgr2=0x7f4ca4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cbd56d640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ca40047d0 0x7f4ca4004c50 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8001780 tx=0x7f4ca801c3b0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cbd56d640 1 -- 172.21.15.133:0/2461751044 shutdown_connections 2023-12-18T10:24:44.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cbd56d640 1 --2- 172.21.15.133:0/2461751044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ca40047d0 0x7f4ca4004c50 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cbd56d640 1 -- 172.21.15.133:0/2461751044 >> 172.21.15.133:0/2461751044 conn(0x7f4cb806a3e0 msgr2=0x7f4cb80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:44.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cbd56d640 1 -- 172.21.15.133:0/2461751044 shutdown_connections 2023-12-18T10:24:44.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.581+0000 7f4cbd56d640 1 -- 172.21.15.133:0/2461751044 wait complete. 2023-12-18T10:24:44.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 Processor -- start 2023-12-18T10:24:44.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 -- start start 2023-12-18T10:24:44.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca40047d0 0x7f4cb81544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cb80c49d0 0x7f4cb8155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cb81439d0 0x7f4cb80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8155a20 con 0x7f4cb81439d0 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8154da0 con 0x7f4cb80c49d0 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8155080 con 0x7f4ca40047d0 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cb81439d0 0x7f4cb80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cb81439d0 0x7f4cb80aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33486/0 (socket says 172.21.15.133:33486) 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 -- 172.21.15.133:0/3170420656 learned_addr learned my addr 172.21.15.133:0/3170420656 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb6ffd640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca40047d0 0x7f4cb81544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cae7fc640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cb80c49d0 0x7f4cb8155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 -- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca40047d0 msgr2=0x7f4cb81544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca40047d0 0x7f4cb81544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 -- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cb80c49d0 msgr2=0x7f4cb8155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cb80c49d0 0x7f4cb8155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 -- 172.21.15.133:0/3170420656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb8155360 con 0x7f4cb81439d0 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb6ffd640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca40047d0 0x7f4cb81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cb77fe640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cb81439d0 0x7f4cb80aec60 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80718f0 tx=0x7f4cb000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4caffff640 1 -- 172.21.15.133:0/3170420656 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000eb90 con 0x7f4cb81439d0 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4caffff640 1 -- 172.21.15.133:0/3170420656 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb000ecf0 con 0x7f4cb81439d0 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4caffff640 1 -- 172.21.15.133:0/3170420656 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0013660 con 0x7f4cb81439d0 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb8155640 con 0x7f4cb81439d0 2023-12-18T10:24:44.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.585+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb8156380 con 0x7f4cb81439d0 2023-12-18T10:24:44.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.589+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb80735b0 con 0x7f4cb81439d0 2023-12-18T10:24:44.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.589+0000 7f4caffff640 1 -- 172.21.15.133:0/3170420656 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4cb00137c0 con 0x7f4cb81439d0 2023-12-18T10:24:44.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.589+0000 7f4caffff640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c98065a60 0x7f4c98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:44.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.589+0000 7f4caffff640 1 -- 172.21.15.133:0/3170420656 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4cb0083760 con 0x7f4cb81439d0 2023-12-18T10:24:44.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.589+0000 7f4cb6ffd640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c98065a60 0x7f4c98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:44.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.589+0000 7f4cb6ffd640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c98065a60 0x7f4c98067f20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009c60 tx=0x7f4ca0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:44.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.593+0000 7f4caffff640 1 -- 172.21.15.133:0/3170420656 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4cb0050ff0 con 0x7f4cb81439d0 2023-12-18T10:24:44.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4cb81557d0 con 0x7f4cb81439d0 2023-12-18T10:24:44.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4caffff640 1 -- 172.21.15.133:0/3170420656 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1337 (secure 0 0 0) 0x7f4cb0054610 con 0x7f4cb81439d0 2023-12-18T10:24:44.796 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:44.796 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":424,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695325,"bytes_used":264871936,"bytes_avail":772829241344,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9469,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":92,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-12-18T10:23:47.169360+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:44.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c98065a60 msgr2=0x7f4c98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c98065a60 0x7f4c98067f20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009c60 tx=0x7f4ca0008040 comp rx=0 tx=0).stop 2023-12-18T10:24:44.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cb81439d0 msgr2=0x7f4cb80aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cb81439d0 0x7f4cb80aec60 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80718f0 tx=0x7f4cb000e530 comp rx=0 tx=0).stop 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 shutdown_connections 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4c98065a60 0x7f4c98067f20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cb81439d0 0x7f4cb80aec60 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cb80c49d0 0x7f4cb8155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 --2- 172.21.15.133:0/3170420656 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ca40047d0 0x7f4cb81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 >> 172.21.15.133:0/3170420656 conn(0x7f4cb806a3e0 msgr2=0x7f4cb815d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 shutdown_connections 2023-12-18T10:24:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:44.797+0000 7f4cbd56d640 1 -- 172.21.15.133:0/3170420656 wait complete. 2023-12-18T10:24:44.817 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-12-18T10:24:45.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:45.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.961+0000 7fd54c90b640 1 Processor -- start 2023-12-18T10:24:45.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.961+0000 7fd54c90b640 1 -- start start 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.961+0000 7fd54c90b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480ce7e0 0x7fd5480ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.961+0000 7fd54c90b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5480cd2b0 0x7fd54806b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.961+0000 7fd54c90b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5480cd6f0 con 0x7fd5480ce400 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.961+0000 7fd54c90b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd548161160 con 0x7fd5480cd2b0 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.961+0000 7fd54c90b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5481608d0 con 0x7fd5480ce7e0 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd547fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5480cd2b0 0x7fd54806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd547fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5480cd2b0 0x7fd54806b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33498/0 (socket says 172.21.15.133:33498) 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd547fff640 1 -- 172.21.15.133:0/1880336032 learned_addr learned my addr 172.21.15.133:0/1880336032 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd546ffd640 1 --2- 172.21.15.133:0/1880336032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480ce7e0 0x7fd5480ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd547fff640 1 -- 172.21.15.133:0/1880336032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480ce7e0 msgr2=0x7fd5480ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:45.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd547fff640 1 --2- 172.21.15.133:0/1880336032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480ce7e0 0x7fd5480ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:45.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd547fff640 1 -- 172.21.15.133:0/1880336032 >> v1:172.21.15.142:6789/0 conn(0x7fd5480ce400 legacy=0x7fd5481601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:45.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd547fff640 1 -- 172.21.15.133:0/1880336032 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548160ba0 con 0x7fd5480cd2b0 2023-12-18T10:24:45.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd547fff640 1 --2- 172.21.15.133:0/1880336032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480cd2b0 0x7fd54806b750 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fd540009e50 tx=0x7fd54001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68127a6789ff1f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:45.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd5467fc640 1 -- 172.21.15.133:0/1880336032 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400a5810 con 0x7fd5480cd2b0 2023-12-18T10:24:45.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd5467fc640 1 -- 172.21.15.133:0/1880336032 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400a5970 con 0x7fd5480cd2b0 2023-12-18T10:24:45.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.965+0000 7fd5467fc640 1 -- 172.21.15.133:0/1880336032 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400a5d00 con 0x7fd5480cd2b0 2023-12-18T10:24:45.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- 172.21.15.133:0/1880336032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480cd2b0 msgr2=0x7fd54806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:45.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 --2- 172.21.15.133:0/1880336032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480cd2b0 0x7fd54806b750 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fd540009e50 tx=0x7fd54001c950 comp rx=0 tx=0).stop 2023-12-18T10:24:45.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- 172.21.15.133:0/1880336032 shutdown_connections 2023-12-18T10:24:45.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 --2- 172.21.15.133:0/1880336032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480cd2b0 0x7fd54806b750 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:45.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 --2- 172.21.15.133:0/1880336032 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480ce7e0 0x7fd5480ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:45.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- 172.21.15.133:0/1880336032 >> 172.21.15.133:0/1880336032 conn(0x7fd548069ca0 msgr2=0x7fd54806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:45.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- 172.21.15.133:0/1880336032 shutdown_connections 2023-12-18T10:24:45.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- 172.21.15.133:0/1880336032 wait complete. 2023-12-18T10:24:45.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 Processor -- start 2023-12-18T10:24:45.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- start start 2023-12-18T10:24:45.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480cd2b0 0x7fd5480aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:45.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480ce400 0x7fd5480c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:45.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5480ce7e0 0x7fd5480b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:45.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480b4f60 con 0x7fd5480ce400 2023-12-18T10:24:45.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480af490 con 0x7fd5480ce7e0 2023-12-18T10:24:45.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd54c90b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480b42e0 con 0x7fd5480cd2b0 2023-12-18T10:24:45.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd546ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480ce400 0x7fd5480c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:45.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd546ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480ce400 0x7fd5480c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33512/0 (socket says 172.21.15.133:33512) 2023-12-18T10:24:45.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd546ffd640 1 -- 172.21.15.133:0/2158335010 learned_addr learned my addr 172.21.15.133:0/2158335010 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:45.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd5477fe640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480cd2b0 0x7fd5480aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:45.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd547fff640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5480ce7e0 0x7fd5480b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:45.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd546ffd640 1 -- 172.21.15.133:0/2158335010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480cd2b0 msgr2=0x7fd5480aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:45.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd546ffd640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480cd2b0 0x7fd5480aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:45.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd546ffd640 1 -- 172.21.15.133:0/2158335010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5480ce7e0 msgr2=0x7fd5480b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:45.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd546ffd640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5480ce7e0 0x7fd5480b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:45.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.969+0000 7fd546ffd640 1 -- 172.21.15.133:0/2158335010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540009b30 con 0x7fd5480ce400 2023-12-18T10:24:45.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd546ffd640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480ce400 0x7fd5480c4ae0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00d800 tx=0x7fd53c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:45.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd52ffff640 1 -- 172.21.15.133:0/2158335010 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00b6c0 con 0x7fd5480ce400 2023-12-18T10:24:45.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd52ffff640 1 -- 172.21.15.133:0/2158335010 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00b820 con 0x7fd5480ce400 2023-12-18T10:24:45.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5480b45c0 con 0x7fd5480ce400 2023-12-18T10:24:45.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd52ffff640 1 -- 172.21.15.133:0/2158335010 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00bb90 con 0x7fd5480ce400 2023-12-18T10:24:45.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5480b4b80 con 0x7fd5480ce400 2023-12-18T10:24:45.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5480b51d0 con 0x7fd5480ce400 2023-12-18T10:24:45.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd52ffff640 1 -- 172.21.15.133:0/2158335010 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd53c00bcf0 con 0x7fd5480ce400 2023-12-18T10:24:45.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd52ffff640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:45.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd52ffff640 1 -- 172.21.15.133:0/2158335010 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd53c0836a0 con 0x7fd5480ce400 2023-12-18T10:24:45.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.973+0000 7fd5477fe640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:45.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.977+0000 7fd5477fe640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd538001770 tx=0x7fd538009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:45.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:45.977+0000 7fd52ffff640 1 -- 172.21.15.133:0/2158335010 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd53c050fc0 con 0x7fd5480ce400 2023-12-18T10:24:46.045 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:24:46.045+0000 7f3bac1eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-18T10:24:46.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.165+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd54804e850 con 0x7fd5480ce400 2023-12-18T10:24:46.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.165+0000 7fd52ffff640 1 -- 172.21.15.133:0/2158335010 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4755 (secure 0 0 0) 0x7fd53c0545e0 con 0x7fd5480ce400 2023-12-18T10:24:46.167 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:46.167 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:46.047801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:46.168 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 93 2023-12-18T10:24:46.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 msgr2=0x7fd534067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd538001770 tx=0x7fd538009040 comp rx=0 tx=0).stop 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480ce400 msgr2=0x7fd5480c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480ce400 0x7fd5480c4ae0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00d800 tx=0x7fd53c00dcc0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 shutdown_connections 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5480ce7e0 0x7fd5480b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5480ce400 0x7fd5480c4ae0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 --2- 172.21.15.133:0/2158335010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5480cd2b0 0x7fd5480aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 >> 172.21.15.133:0/2158335010 conn(0x7fd548069ca0 msgr2=0x7fd5480cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 shutdown_connections 2023-12-18T10:24:46.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.169+0000 7fd54c90b640 1 -- 172.21.15.133:0/2158335010 wait complete. 2023-12-18T10:24:46.188 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:46.188 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:46.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f4e3f3640 1 Processor -- start 2023-12-18T10:24:46.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f4e3f3640 1 -- start start 2023-12-18T10:24:46.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f4e3f3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f4815c9d0 0x7f3f480cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f4e3f3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f4806fdb0 0x7f3f48070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f4e3f3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f48160690 con 0x7f3f480cdd40 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f4e3f3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f481603f0 con 0x7f3f4815c9d0 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f4e3f3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f48070740 con 0x7f3f4806fdb0 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f47fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f4815c9d0 0x7f3f480cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f47fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f4815c9d0 0x7f3f480cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33520/0 (socket says 172.21.15.133:33520) 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f47fff640 1 -- 172.21.15.133:0/3882632847 learned_addr learned my addr 172.21.15.133:0/3882632847 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f4c990640 1 --2- 172.21.15.133:0/3882632847 >> v2:172.21.15.142:3300/0 conn(0x7f3f4806fdb0 0x7f3f48070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f47fff640 1 -- 172.21.15.133:0/3882632847 >> v2:172.21.15.142:3300/0 conn(0x7f3f4806fdb0 msgr2=0x7f3f48070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f47fff640 1 --2- 172.21.15.133:0/3882632847 >> v2:172.21.15.142:3300/0 conn(0x7f3f4806fdb0 0x7f3f48070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f47fff640 1 -- 172.21.15.133:0/3882632847 >> v1:172.21.15.142:6789/0 conn(0x7f3f480cdd40 legacy=0x7f3f48160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:46.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.325+0000 7f3f47fff640 1 -- 172.21.15.133:0/3882632847 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480b0d80 con 0x7f3f4815c9d0 2023-12-18T10:24:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f47fff640 1 --2- 172.21.15.133:0/3882632847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f4815c9d0 0x7f3f480cc400 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f3f480c8a40 tx=0x7f3f3801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f6c791a17789ed server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f46ffd640 1 -- 172.21.15.133:0/3882632847 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380aa680 con 0x7f3f4815c9d0 2023-12-18T10:24:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f46ffd640 1 -- 172.21.15.133:0/3882632847 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380aa7e0 con 0x7f3f4815c9d0 2023-12-18T10:24:46.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f46ffd640 1 -- 172.21.15.133:0/3882632847 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380aab70 con 0x7f3f4815c9d0 2023-12-18T10:24:46.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/3882632847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f4815c9d0 msgr2=0x7f3f480cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:46.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/3882632847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f4815c9d0 0x7f3f480cc400 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f3f480c8a40 tx=0x7f3f3801c500 comp rx=0 tx=0).stop 2023-12-18T10:24:46.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/3882632847 shutdown_connections 2023-12-18T10:24:46.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/3882632847 >> v2:172.21.15.142:3300/0 conn(0x7f3f4806fdb0 0x7f3f48070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/3882632847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f4815c9d0 0x7f3f480cc400 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/3882632847 >> 172.21.15.133:0/3882632847 conn(0x7f3f4806a3e0 msgr2=0x7f3f480afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:46.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/3882632847 shutdown_connections 2023-12-18T10:24:46.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.329+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/3882632847 wait complete. 2023-12-18T10:24:46.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 Processor -- start 2023-12-18T10:24:46.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 -- start start 2023-12-18T10:24:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f4806fdb0 0x7f3f48157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f480cdd40 0x7f3f48157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f4815c9d0 0x7f3f48152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4815bca0 con 0x7f3f480cdd40 2023-12-18T10:24:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4815b2b0 con 0x7f3f4806fdb0 2023-12-18T10:24:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4815ae20 con 0x7f3f4815c9d0 2023-12-18T10:24:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f480cdd40 0x7f3f48157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:46.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f480cdd40 0x7f3f48157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33528/0 (socket says 172.21.15.133:33528) 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 -- 172.21.15.133:0/4126380995 learned_addr learned my addr 172.21.15.133:0/4126380995 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f47fff640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f4806fdb0 0x7f3f48157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4c990640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f4815c9d0 0x7f3f48152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 -- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f4815c9d0 msgr2=0x7f3f48152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f4815c9d0 0x7f3f48152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 -- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f4806fdb0 msgr2=0x7f3f48157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f4806fdb0 0x7f3f48157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 -- 172.21.15.133:0/4126380995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380094d0 con 0x7f3f480cdd40 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f47fff640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f4806fdb0 0x7f3f48157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f477fe640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f480cdd40 0x7f3f48157a50 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c500 tx=0x7f3f3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f44ff9640 1 -- 172.21.15.133:0/4126380995 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c005220 con 0x7f3f480cdd40 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f44ff9640 1 -- 172.21.15.133:0/4126380995 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c005380 con 0x7f3f480cdd40 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f44ff9640 1 -- 172.21.15.133:0/4126380995 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c007270 con 0x7f3f480cdd40 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f481613b0 con 0x7f3f480cdd40 2023-12-18T10:24:46.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.333+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4815a4f0 con 0x7f3f480cdd40 2023-12-18T10:24:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.337+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f480735b0 con 0x7f3f480cdd40 2023-12-18T10:24:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.337+0000 7f3f44ff9640 1 -- 172.21.15.133:0/4126380995 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3f3c0073d0 con 0x7f3f480cdd40 2023-12-18T10:24:46.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.337+0000 7f3f44ff9640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f34065a90 0x7f3f34067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:46.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.337+0000 7f3f44ff9640 1 -- 172.21.15.133:0/4126380995 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f3c082c80 con 0x7f3f480cdd40 2023-12-18T10:24:46.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.337+0000 7f3f47fff640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f34065a90 0x7f3f34067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:46.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.337+0000 7f3f47fff640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f34065a90 0x7f3f34067f50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3f380ae000 tx=0x7f3f380a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:46.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.341+0000 7f3f44ff9640 1 -- 172.21.15.133:0/4126380995 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3f3c050470 con 0x7f3f480cdd40 2023-12-18T10:24:46.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.541+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3f4815af90 con 0x7f3f480cdd40 2023-12-18T10:24:46.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f44ff9640 1 -- 172.21.15.133:0/4126380995 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1924 (secure 0 0 0) 0x7f3f3c053a90 con 0x7f3f480cdd40 2023-12-18T10:24:46.544 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:46.544 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":426,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695325,"bytes_used":264871936,"bytes_avail":772829241344,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6398,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":93,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-12-18T10:24:45.181922+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:46.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f34065a90 msgr2=0x7f3f34067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:46.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f34065a90 0x7f3f34067f50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3f380ae000 tx=0x7f3f380a7000 comp rx=0 tx=0).stop 2023-12-18T10:24:46.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f480cdd40 msgr2=0x7f3f48157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:46.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f480cdd40 0x7f3f48157a50 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c500 tx=0x7f3f3c00c9c0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 shutdown_connections 2023-12-18T10:24:46.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f34065a90 0x7f3f34067f50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f4815c9d0 0x7f3f48152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f480cdd40 0x7f3f48157a50 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 --2- 172.21.15.133:0/4126380995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f4806fdb0 0x7f3f48157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:46.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 >> 172.21.15.133:0/4126380995 conn(0x7f3f4806a3e0 msgr2=0x7f3f480ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:46.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 shutdown_connections 2023-12-18T10:24:46.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:46.545+0000 7f3f4e3f3640 1 -- 172.21.15.133:0/4126380995 wait complete. 2023-12-18T10:24:46.565 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:24:47.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:47.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.705+0000 7efccee1f640 1 Processor -- start 2023-12-18T10:24:47.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.705+0000 7efccee1f640 1 -- start start 2023-12-18T10:24:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efccee1f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcc806c4f0 0x7efcc80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efccee1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc80c9e30 0x7efcc8070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:47.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efccee1f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc80c9460 con 0x7efcc81570c0 2023-12-18T10:24:47.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efccee1f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc81574a0 con 0x7efcc806c4f0 2023-12-18T10:24:47.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efccee1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc80c8b30 con 0x7efcc80c9e30 2023-12-18T10:24:47.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcccbbb640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efcc81570c0 0x7efcc806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49910/0 (socket says 172.21.15.133:49910) 2023-12-18T10:24:47.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcccbbb640 1 -- 172.21.15.133:0/122359588 learned_addr learned my addr 172.21.15.133:0/122359588 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:47.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcc7fff640 1 --2- 172.21.15.133:0/122359588 >> v2:172.21.15.133:3300/0 conn(0x7efcc806c4f0 0x7efcc80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efccd3bc640 1 --2- 172.21.15.133:0/122359588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc80c9e30 0x7efcc8070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcc77fe640 1 -- 172.21.15.133:0/122359588 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392801500 0 0) 0x7efcc80c9460 con 0x7efcc81570c0 2023-12-18T10:24:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcc77fe640 1 -- 172.21.15.133:0/122359588 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb8005740 con 0x7efcc81570c0 2023-12-18T10:24:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcc7fff640 1 -- 172.21.15.133:0/122359588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc80c9e30 msgr2=0x7efcc8070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcc7fff640 1 --2- 172.21.15.133:0/122359588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc80c9e30 0x7efcc8070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcc7fff640 1 -- 172.21.15.133:0/122359588 >> v1:172.21.15.133:6789/0 conn(0x7efcc81570c0 legacy=0x7efcc806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efcc7fff640 1 -- 172.21.15.133:0/122359588 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc80c8e10 con 0x7efcc806c4f0 2023-12-18T10:24:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.709+0000 7efccd3bc640 1 --2- 172.21.15.133:0/122359588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc80c9e30 0x7efcc8070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efcc7fff640 1 --2- 172.21.15.133:0/122359588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc80c98f0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7efcb40097c0 tx=0x7efcb401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba5c35ab0e31bda server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efcc77fe640 1 -- 172.21.15.133:0/122359588 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40ab680 con 0x7efcc806c4f0 2023-12-18T10:24:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efcc77fe640 1 -- 172.21.15.133:0/122359588 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40ab7e0 con 0x7efcc806c4f0 2023-12-18T10:24:47.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efcc77fe640 1 -- 172.21.15.133:0/122359588 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40abb50 con 0x7efcc806c4f0 2023-12-18T10:24:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 -- 172.21.15.133:0/122359588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 msgr2=0x7efcc80c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 --2- 172.21.15.133:0/122359588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc80c98f0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7efcb40097c0 tx=0x7efcb401c480 comp rx=0 tx=0).stop 2023-12-18T10:24:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 -- 172.21.15.133:0/122359588 shutdown_connections 2023-12-18T10:24:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 --2- 172.21.15.133:0/122359588 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc80c9e30 0x7efcc8070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 --2- 172.21.15.133:0/122359588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc80c98f0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 -- 172.21.15.133:0/122359588 >> 172.21.15.133:0/122359588 conn(0x7efcc806a3e0 msgr2=0x7efcc80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:47.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 -- 172.21.15.133:0/122359588 shutdown_connections 2023-12-18T10:24:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 -- 172.21.15.133:0/122359588 wait complete. 2023-12-18T10:24:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 Processor -- start 2023-12-18T10:24:47.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.713+0000 7efccee1f640 1 -- start start 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc8142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc80c9e30 0x7efcc8144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc81570c0 0x7efcc8144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc80abab0 con 0x7efcc806c4f0 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc81f84d0 con 0x7efcc80c9e30 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc81f87b0 con 0x7efcc81570c0 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc8142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc8142d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33534/0 (socket says 172.21.15.133:33534) 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 -- 172.21.15.133:0/2488474428 learned_addr learned my addr 172.21.15.133:0/2488474428 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccd3bc640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc81570c0 0x7efcc8144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcc7fff640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc80c9e30 0x7efcc8144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 -- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc81570c0 msgr2=0x7efcc8144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc81570c0 0x7efcc8144c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 -- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc80c9e30 msgr2=0x7efcc8144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc80c9e30 0x7efcc8144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 -- 172.21.15.133:0/2488474428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4009420 con 0x7efcc806c4f0 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcc7fff640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc80c9e30 0x7efcc8144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcccbbb640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc8142d00 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c3c0 tx=0x7efcbc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcc57fa640 1 -- 172.21.15.133:0/2488474428 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc005cf0 con 0x7efcc806c4f0 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcc57fa640 1 -- 172.21.15.133:0/2488474428 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc005e50 con 0x7efcc806c4f0 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcc57fa640 1 -- 172.21.15.133:0/2488474428 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc0072f0 con 0x7efcc806c4f0 2023-12-18T10:24:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc81f8a90 con 0x7efcc806c4f0 2023-12-18T10:24:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc81f5230 con 0x7efcc806c4f0 2023-12-18T10:24:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc80735b0 con 0x7efcc806c4f0 2023-12-18T10:24:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.717+0000 7efcc57fa640 1 -- 172.21.15.133:0/2488474428 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efcbc007450 con 0x7efcc806c4f0 2023-12-18T10:24:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.721+0000 7efcc57fa640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcac065a60 0x7efcac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.721+0000 7efcc57fa640 1 -- 172.21.15.133:0/2488474428 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6145+0+0 (secure 0 0 0) 0x7efcbc082a50 con 0x7efcc806c4f0 2023-12-18T10:24:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.721+0000 7efcc7fff640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcac065a60 0x7efcac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.721+0000 7efcc7fff640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcac065a60 0x7efcac067f20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efcb40af000 tx=0x7efcb40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:47.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.721+0000 7efcc57fa640 1 -- 172.21.15.133:0/2488474428 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efcbc050120 con 0x7efcc806c4f0 2023-12-18T10:24:47.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcc81f8f40 con 0x7efcc806c4f0 2023-12-18T10:24:47.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efcc57fa640 1 -- 172.21.15.133:0/2488474428 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4756 (secure 0 0 0) 0x7efcc81f8f40 con 0x7efcc806c4f0 2023-12-18T10:24:47.904 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:47.904 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:47.057153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:47.905 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 94 2023-12-18T10:24:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcac065a60 msgr2=0x7efcac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:47.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcac065a60 0x7efcac067f20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efcb40af000 tx=0x7efcb40a7000 comp rx=0 tx=0).stop 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 msgr2=0x7efcc8142d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc8142d00 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c3c0 tx=0x7efcbc00c880 comp rx=0 tx=0).stop 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 shutdown_connections 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7efcac065a60 0x7efcac067f20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efcc81570c0 0x7efcc8144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efcc80c9e30 0x7efcc8144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 --2- 172.21.15.133:0/2488474428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc806c4f0 0x7efcc8142d00 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 >> 172.21.15.133:0/2488474428 conn(0x7efcc806a3e0 msgr2=0x7efcc80caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 shutdown_connections 2023-12-18T10:24:47.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:47.905+0000 7efccee1f640 1 -- 172.21.15.133:0/2488474428 wait complete. 2023-12-18T10:24:47.925 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:47.925 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:48.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.061+0000 7f3dfd4ca640 1 Processor -- start 2023-12-18T10:24:48.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.061+0000 7f3dfd4ca640 1 -- start start 2023-12-18T10:24:48.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3dfd4ca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df80b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3dfd4ca640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3df80cea00 0x7f3df80cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3dfd4ca640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df80b65c0 con 0x7f3df80cd3a0 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3dfd4ca640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df815cb10 con 0x7f3df80cea00 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3dfd4ca640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80b84c0 con 0x7f3df815c730 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df80b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df77fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3df80cea00 0x7f3df80cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df80b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:35820/0 (socket says 172.21.15.133:35820) 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df77fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3df80cea00 0x7f3df80cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:57184/0 (socket says 172.21.15.133:57184) 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3dfccc9640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3df80cd3a0 0x7f3df80b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:35128/0 (socket says 172.21.15.133:35128) 2023-12-18T10:24:48.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df7fff640 1 -- 172.21.15.133:0/3313524700 learned_addr learned my addr 172.21.15.133:0/3313524700 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df6ffd640 1 -- 172.21.15.133:0/3313524700 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895507618 0 0) 0x7f3df80b65c0 con 0x7f3df80cd3a0 2023-12-18T10:24:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df6ffd640 1 -- 172.21.15.133:0/3313524700 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de0003530 con 0x7f3df80cd3a0 2023-12-18T10:24:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df77fe640 1 -- 172.21.15.133:0/3313524700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 msgr2=0x7f3df80b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df77fe640 1 --2- 172.21.15.133:0/3313524700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df80b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df77fe640 1 -- 172.21.15.133:0/3313524700 >> v1:172.21.15.142:6789/0 conn(0x7f3df80cd3a0 legacy=0x7f3df80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df77fe640 1 -- 172.21.15.133:0/3313524700 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80cd960 con 0x7f3df80cea00 2023-12-18T10:24:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.065+0000 7f3df7fff640 1 --2- 172.21.15.133:0/3313524700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df80b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:48.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.069+0000 7f3df77fe640 1 --2- 172.21.15.133:0/3313524700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cea00 0x7f3df80cef60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0097c0 tx=0x7f3dec01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37bfef5b54f7bf6f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3df6ffd640 1 -- 172.21.15.133:0/3313524700 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0a8970 con 0x7f3df80cea00 2023-12-18T10:24:48.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3df6ffd640 1 -- 172.21.15.133:0/3313524700 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec0a8ad0 con 0x7f3df80cea00 2023-12-18T10:24:48.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3df6ffd640 1 -- 172.21.15.133:0/3313524700 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0a8e60 con 0x7f3df80cea00 2023-12-18T10:24:48.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/3313524700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cea00 msgr2=0x7f3df80cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/3313524700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cea00 0x7f3df80cef60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0097c0 tx=0x7f3dec01ec70 comp rx=0 tx=0).stop 2023-12-18T10:24:48.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/3313524700 shutdown_connections 2023-12-18T10:24:48.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/3313524700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cea00 0x7f3df80cef60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/3313524700 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df80b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/3313524700 >> 172.21.15.133:0/3313524700 conn(0x7f3df806b120 msgr2=0x7f3df806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/3313524700 shutdown_connections 2023-12-18T10:24:48.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/3313524700 wait complete. 2023-12-18T10:24:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 Processor -- start 2023-12-18T10:24:48.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.073+0000 7f3dfd4ca640 1 -- start start 2023-12-18T10:24:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3dfd4ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cd3a0 0x7f3df8159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3dfd4ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3df80cea00 0x7f3df81f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3dfd4ca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df81f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3dfd4ca640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df81f4a30 con 0x7f3df80cea00 2023-12-18T10:24:48.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3dfd4ca640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80ca030 con 0x7f3df80cd3a0 2023-12-18T10:24:48.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3dfd4ca640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80c8490 con 0x7f3df815c730 2023-12-18T10:24:48.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cd3a0 0x7f3df8159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3df80cea00 0x7f3df81f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cd3a0 0x7f3df8159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:57196/0 (socket says 172.21.15.133:57196) 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df7fff640 1 -- 172.21.15.133:0/500454480 learned_addr learned my addr 172.21.15.133:0/500454480 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3dfccc9640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df81f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df77fe640 1 -- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 msgr2=0x7f3df81f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df77fe640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df81f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df77fe640 1 -- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cd3a0 msgr2=0x7f3df8159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df77fe640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cd3a0 0x7f3df8159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df77fe640 1 -- 172.21.15.133:0/500454480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80094d0 con 0x7f3df80cea00 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3dfccc9640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df81f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:48.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df7fff640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cd3a0 0x7f3df8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:48.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.077+0000 7f3df77fe640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3df80cea00 0x7f3df81f3fb0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0af000 tx=0x7f3dec01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.081+0000 7f3df4ff9640 1 -- 172.21.15.133:0/500454480 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0bd070 con 0x7f3df80cea00 2023-12-18T10:24:48.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.081+0000 7f3df4ff9640 1 -- 172.21.15.133:0/500454480 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec0b0ba0 con 0x7f3df80cea00 2023-12-18T10:24:48.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.081+0000 7f3df4ff9640 1 -- 172.21.15.133:0/500454480 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0b9430 con 0x7f3df80cea00 2023-12-18T10:24:48.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.081+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec009420 con 0x7f3df80cea00 2023-12-18T10:24:48.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.081+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df815dd90 con 0x7f3df80cea00 2023-12-18T10:24:48.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.081+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df80ca1c0 con 0x7f3df80cea00 2023-12-18T10:24:48.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.081+0000 7f3df4ff9640 1 -- 172.21.15.133:0/500454480 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3dec0b7040 con 0x7f3df80cea00 2023-12-18T10:24:48.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.085+0000 7f3df4ff9640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3de4065a60 0x7f3de4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.085+0000 7f3df4ff9640 1 -- 172.21.15.133:0/500454480 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f3dec1205f0 con 0x7f3df80cea00 2023-12-18T10:24:48.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.085+0000 7f3df7fff640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3de4065a60 0x7f3de4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.085+0000 7f3df7fff640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3de4065a60 0x7f3de4067f20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3de80113d0 tx=0x7f3de8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.089+0000 7f3df4ff9640 1 -- 172.21.15.133:0/500454480 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3dec0ede90 con 0x7f3df80cea00 2023-12-18T10:24:48.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.293+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3df8066c50 con 0x7f3df80cea00 2023-12-18T10:24:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.293+0000 7f3df4ff9640 1 -- 172.21.15.133:0/500454480 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1965 (secure 0 0 0) 0x7f3dec0b57c0 con 0x7f3df80cea00 2023-12-18T10:24:48.295 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:48.295 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":428,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695325,"bytes_used":264871936,"bytes_avail":772829241344,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7678,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2023-12-18T10:24:47.182262+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3de4065a60 msgr2=0x7f3de4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3de4065a60 0x7f3de4067f20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3de80113d0 tx=0x7f3de8009240 comp rx=0 tx=0).stop 2023-12-18T10:24:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3df80cea00 msgr2=0x7f3df81f3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3df80cea00 0x7f3df81f3fb0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0af000 tx=0x7f3dec01ba10 comp rx=0 tx=0).stop 2023-12-18T10:24:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 shutdown_connections 2023-12-18T10:24:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3de4065a60 0x7f3de4067f20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3df815c730 0x7f3df81f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3df80cea00 0x7f3df81f3fb0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 --2- 172.21.15.133:0/500454480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3df80cd3a0 0x7f3df8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 >> 172.21.15.133:0/500454480 conn(0x7f3df806b120 msgr2=0x7f3df80b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 shutdown_connections 2023-12-18T10:24:48.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.297+0000 7f3dfd4ca640 1 -- 172.21.15.133:0/500454480 wait complete. 2023-12-18T10:24:48.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:24:48.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub resume 2023-12-18T10:24:48.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.457+0000 7f9c21404640 1 Processor -- start 2023-12-18T10:24:48.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.457+0000 7f9c21404640 1 -- start start 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.457+0000 7f9c21404640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c1c1593f0 0x7f9c1c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.457+0000 7f9c21404640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9c1c0ce590 0x7f9c1c0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.457+0000 7f9c21404640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c0b17e0 con 0x7f9c1c0706e0 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.457+0000 7f9c21404640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c071b50 con 0x7f9c1c1593f0 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.457+0000 7f9c21404640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c071e30 con 0x7f9c1c0ce590 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c1c1593f0 0x7f9c1c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c127fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9c1c0706e0 0x7f9c1c0cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49914/0 (socket says 172.21.15.133:49914) 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c127fc640 1 -- 172.21.15.133:0/1404028725 learned_addr learned my addr 172.21.15.133:0/1404028725 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/1404028725 >> v2:172.21.15.142:3300/0 conn(0x7f9c1c0ce590 0x7f9c1c0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1affd640 1 -- 172.21.15.133:0/1404028725 >> v2:172.21.15.142:3300/0 conn(0x7f9c1c0ce590 msgr2=0x7f9c1c0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1affd640 1 --2- 172.21.15.133:0/1404028725 >> v2:172.21.15.142:3300/0 conn(0x7f9c1c0ce590 0x7f9c1c0b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1affd640 1 -- 172.21.15.133:0/1404028725 >> v1:172.21.15.133:6789/0 conn(0x7f9c1c0706e0 legacy=0x7f9c1c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1affd640 1 -- 172.21.15.133:0/1404028725 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c0b1190 con 0x7f9c1c1593f0 2023-12-18T10:24:48.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1a7fc640 1 -- 172.21.15.133:0/1404028725 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625350313 0 0) 0x7f9c1c0b17e0 con 0x7f9c1c0706e0 2023-12-18T10:24:48.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1affd640 1 --2- 172.21.15.133:0/1404028725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c0b1c70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ca300 tx=0x7f9c0c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b675e344916287a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1a7fc640 1 -- 172.21.15.133:0/1404028725 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0b3200 con 0x7f9c1c1593f0 2023-12-18T10:24:48.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1a7fc640 1 -- 172.21.15.133:0/1404028725 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c0a5930 con 0x7f9c1c1593f0 2023-12-18T10:24:48.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.461+0000 7f9c1a7fc640 1 -- 172.21.15.133:0/1404028725 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0a5cc0 con 0x7f9c1c1593f0 2023-12-18T10:24:48.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- 172.21.15.133:0/1404028725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 msgr2=0x7f9c1c0b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 --2- 172.21.15.133:0/1404028725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c0b1c70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ca300 tx=0x7f9c0c01c850 comp rx=0 tx=0).stop 2023-12-18T10:24:48.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- 172.21.15.133:0/1404028725 shutdown_connections 2023-12-18T10:24:48.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 --2- 172.21.15.133:0/1404028725 >> v2:172.21.15.142:3300/0 conn(0x7f9c1c0ce590 0x7f9c1c0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 --2- 172.21.15.133:0/1404028725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c0b1c70 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- 172.21.15.133:0/1404028725 >> 172.21.15.133:0/1404028725 conn(0x7f9c1c06d8d0 msgr2=0x7f9c1c069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- 172.21.15.133:0/1404028725 shutdown_connections 2023-12-18T10:24:48.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- 172.21.15.133:0/1404028725 wait complete. 2023-12-18T10:24:48.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 Processor -- start 2023-12-18T10:24:48.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- start start 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c1c0706e0 0x7f9c1c14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c1c0ce590 0x7f9c1c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c1480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c149bd0 con 0x7f9c1c1593f0 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c1f7f70 con 0x7f9c1c0ce590 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c21404640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c148a20 con 0x7f9c1c0706e0 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c1b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c1480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c1b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c1480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33560/0 (socket says 172.21.15.133:33560) 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/1746007629 learned_addr learned my addr 172.21.15.133:0/1746007629 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c127fc640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c1c0ce590 0x7f9c1c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c1affd640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c1c0706e0 0x7f9c1c14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/1746007629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c1c0706e0 msgr2=0x7f9c1c14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c1c0706e0 0x7f9c1c14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/1746007629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c1c0ce590 msgr2=0x7f9c1c1441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.465+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c1c0ce590 0x7f9c1c1441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.469+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/1746007629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c009a70 con 0x7f9c1c1593f0 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.469+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c1480d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400d800 tx=0x7f9c1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.469+0000 7f9c13fff640 1 -- 172.21.15.133:0/1746007629 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400b660 con 0x7f9c1c1593f0 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.469+0000 7f9c13fff640 1 -- 172.21.15.133:0/1746007629 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1400b7c0 con 0x7f9c1c1593f0 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.469+0000 7f9c13fff640 1 -- 172.21.15.133:0/1746007629 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400bb70 con 0x7f9c1c1593f0 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.469+0000 7f9c21404640 1 -- 172.21.15.133:0/1746007629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1c149de0 con 0x7f9c1c1593f0 2023-12-18T10:24:48.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.469+0000 7f9c21404640 1 -- 172.21.15.133:0/1746007629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c14a3a0 con 0x7f9c1c1593f0 2023-12-18T10:24:48.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.469+0000 7f9c13fff640 1 -- 172.21.15.133:0/1746007629 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c1400bcd0 con 0x7f9c1c1593f0 2023-12-18T10:24:48.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c13fff640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9bfc065a90 0x7f9bfc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c13fff640 1 -- 172.21.15.133:0/1746007629 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f9c140836a0 con 0x7f9c1c1593f0 2023-12-18T10:24:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c1affd640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9bfc065a90 0x7f9bfc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 Processor -- start 2023-12-18T10:24:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 -- start start 2023-12-18T10:24:48.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c1affd640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9bfc065a90 0x7f9bfc067f50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0af000 tx=0x7f9c0c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 0x55dd7b33e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b2f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 0x55dd7b2f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b1bc430 con 0x55dd7b33e5a0 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b14a460 con 0x55dd7b33dc80 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b147a30 con 0x55dd7b2f3fc0 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b2f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b2f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33562/0 (socket says 172.21.15.133:33562) 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 -- 172.21.15.133:0/2648053574 learned_addr learned my addr 172.21.15.133:0/2648053574 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c1affd640 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 0x55dd7b33e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 0x55dd7b2f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 -- 172.21.15.133:0/2648053574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 msgr2=0x55dd7b2f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 0x55dd7b2f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 -- 172.21.15.133:0/2648053574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 msgr2=0x55dd7b33e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 0x55dd7b33e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 -- 172.21.15.133:0/2648053574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd7ae3fe20 con 0x55dd7b33e5a0 2023-12-18T10:24:48.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c127fc640 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b2f3a80 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0c9470 tx=0x7f9c04004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5debb60f444df5eb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c10ff9640 1 -- 172.21.15.133:0/2648053574 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c040071b0 con 0x55dd7b33e5a0 2023-12-18T10:24:48.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c10ff9640 1 -- 172.21.15.133:0/2648053574 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c040018b0 con 0x55dd7b33e5a0 2023-12-18T10:24:48.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c10ff9640 1 -- 172.21.15.133:0/2648053574 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04001c20 con 0x55dd7b33e5a0 2023-12-18T10:24:48.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 -- 172.21.15.133:0/2648053574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 msgr2=0x55dd7b2f3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b2f3a80 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0c9470 tx=0x7f9c04004bc0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 -- 172.21.15.133:0/2648053574 shutdown_connections 2023-12-18T10:24:48.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 0x55dd7b2f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b2f3a80 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 --2- 172.21.15.133:0/2648053574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 0x55dd7b33e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.473+0000 7f9c24772000 1 -- 172.21.15.133:0/2648053574 >> 172.21.15.133:0/2648053574 conn(0x55dd7b0f2910 msgr2=0x55dd7b2f2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- 172.21.15.133:0/2648053574 shutdown_connections 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- 172.21.15.133:0/2648053574 wait complete. 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- start start 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 Processor -- start 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33dc80 0x55dd7b33e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b33eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b143320 con 0x55dd7b33e5a0 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b0e24f0 con 0x55dd7b2f3fc0 2023-12-18T10:24:48.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b1006e0 con 0x55dd7b33dc80 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 10 client.0 _ll_register_callbacks cb 0x55dd7b2df980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b33eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b33eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33564/0 (socket says 172.21.15.133:33564) 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1affd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/845045028 learned_addr learned my addr 172.21.15.133:0/845045028 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c127fc640 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33dc80 0x55dd7b33e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/845045028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33dc80 msgr2=0x55dd7b33e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33dc80 0x55dd7b33e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/845045028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 msgr2=0x55dd7b33d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/845045028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c04007310 con 0x55dd7b33e5a0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b33eec0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400b4b0 tx=0x7f9c14058aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80599540714733b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9bf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/845045028 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1405c8b0 con 0x55dd7b33e5a0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/845045028 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f9c14055b70 con 0x55dd7b33e5a0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- 172.21.15.133:0/845045028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd7b100120 con 0x55dd7b33e5a0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/845045028 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c14055d30 con 0x55dd7b33e5a0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 10 client.8673 fetch_fsmap learned FSMap version 95 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- 172.21.15.133:0/845045028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x55dd7b108250 con 0x55dd7b33e5a0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/845045028 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dd7b100120 con 0x55dd7b33e5a0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/845045028 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 95) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f9c1407bb50 con 0x55dd7b33e5a0 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 10 client.8673 fetch_fsmap finished waiting for FSMap version 95 2023-12-18T10:24:48.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 10 client.8673 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:48.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 20 client.8673 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:48.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55dd7b33f8d0 0x55dd7b33fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 4 client.8673 mds_command: new command op to 8127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:48.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c24772000 1 -- 172.21.15.133:0/845045028 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd7b141c70 con 0x55dd7b33f8d0 2023-12-18T10:24:48.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.477+0000 7f9c1affd640 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55dd7b33f8d0 0x55dd7b33fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c1affd640 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55dd7b33f8d0 0x55dd7b33fce0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d4d56780b9b080b server_cookie=44df6ad23c5636 in_seq=0 out_seq=0 2023-12-18T10:24:48.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9bf9ffb640 10 client.8673 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:48.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/845045028 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55dd7b141c70 con 0x55dd7b33f8d0 2023-12-18T10:24:48.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9bf9ffb640 10 client.8673 handle_command_reply: tid=0 2023-12-18T10:24:48.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 client.8673 shutdown 2023-12-18T10:24:48.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 -- 172.21.15.133:0/845045028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 msgr2=0x55dd7b33eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b33eec0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400b4b0 tx=0x7f9c14058aa0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 -- 172.21.15.133:0/845045028 shutdown_connections 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55dd7b33f8d0 0x55dd7b33fce0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b33eec0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33dc80 0x55dd7b33e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9bf9ffb640 0 client.8673 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 --2- 172.21.15.133:0/845045028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 -- 172.21.15.133:0/845045028 >> 172.21.15.133:0/845045028 conn(0x55dd7b0f2910 msgr2=0x55dd7b2f2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 -- 172.21.15.133:0/845045028 shutdown_connections 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 1 -- 172.21.15.133:0/845045028 wait complete. 2023-12-18T10:24:48.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.481+0000 7f9c24772000 20 client.8673 trim_cache size 0 max 16384 2023-12-18T10:24:48.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.493+0000 7f9c24772000 1 Processor -- start 2023-12-18T10:24:48.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.493+0000 7f9c24772000 1 -- start start 2023-12-18T10:24:48.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33dc80 0x55dd7b33bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33e5a0 0x55dd7b34e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7ae00aa0 con 0x55dd7b33dc80 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b13ec90 con 0x55dd7b2f3fc0 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b1b7d70 con 0x55dd7b33e5a0 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33dc80 0x55dd7b33bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33dc80 0x55dd7b33bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33578/0 (socket says 172.21.15.133:33578) 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 -- 172.21.15.133:0/3974569135 learned_addr learned my addr 172.21.15.133:0/3974569135 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33e5a0 0x55dd7b34e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c1affd640 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 -- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33e5a0 msgr2=0x55dd7b34e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33e5a0 0x55dd7b34e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 -- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 msgr2=0x55dd7b33b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 -- 172.21.15.133:0/3974569135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd7b0ee5a0 con 0x55dd7b33dc80 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c1affd640 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33e5a0 0x55dd7b34e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33dc80 0x55dd7b33bb90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007600 tx=0x7f9c0400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b144e90b8134658 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c117fa640 1 -- 172.21.15.133:0/3974569135 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04001ab0 con 0x55dd7b33dc80 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c117fa640 1 -- 172.21.15.133:0/3974569135 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c04001c10 con 0x55dd7b33dc80 2023-12-18T10:24:48.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c117fa640 1 -- 172.21.15.133:0/3974569135 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04014650 con 0x55dd7b33dc80 2023-12-18T10:24:48.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- 172.21.15.133:0/3974569135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33dc80 msgr2=0x55dd7b33bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33dc80 0x55dd7b33bb90 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007600 tx=0x7f9c0400c000 comp rx=0 tx=0).stop 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- 172.21.15.133:0/3974569135 shutdown_connections 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b33e5a0 0x55dd7b34e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33dc80 0x55dd7b33bb90 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- 172.21.15.133:0/3974569135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b2f3fc0 0x55dd7b33b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- 172.21.15.133:0/3974569135 >> 172.21.15.133:0/3974569135 conn(0x55dd7b0f2910 msgr2=0x55dd7b339f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- 172.21.15.133:0/3974569135 shutdown_connections 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- 172.21.15.133:0/3974569135 wait complete. 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- start start 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 Processor -- start 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 0x55dd7b353e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 0x55dd7b353110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b350880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b0e8820 con 0x55dd7b33e5a0 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b140720 con 0x55dd7b33dc80 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd7b2f84b0 con 0x55dd7b2f3fc0 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c24772000 10 client.0 _ll_register_callbacks cb 0x55dd7b0fa710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c1b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b350880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c1b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b350880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33590/0 (socket says 172.21.15.133:33590) 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/3802862080 learned_addr learned my addr 172.21.15.133:0/3802862080 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.497+0000 7f9c127fc640 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 0x55dd7b353110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1affd640 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 0x55dd7b353e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/3802862080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 msgr2=0x55dd7b353e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 0x55dd7b353e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/3802862080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 msgr2=0x55dd7b353110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 0x55dd7b353110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1b7fe640 1 -- 172.21.15.133:0/3802862080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd7ae3fe20 con 0x55dd7b33e5a0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1b7fe640 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b350880 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9c1405c610 tx=0x7f9c14051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4d30cd7a4b1a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/3802862080 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14054c80 con 0x55dd7b33e5a0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/3802862080 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f9c14050a00 con 0x55dd7b33e5a0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 -- 172.21.15.133:0/3802862080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd7b2f78e0 con 0x55dd7b33e5a0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/3802862080 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c14050bc0 con 0x55dd7b33e5a0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 10 client.8679 fetch_fsmap learned FSMap version 95 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 -- 172.21.15.133:0/3802862080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x55dd7b0e2110 con 0x55dd7b33e5a0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/3802862080 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dd7b2f78e0 con 0x55dd7b33e5a0 2023-12-18T10:24:48.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/3802862080 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 95) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f9c14053b70 con 0x55dd7b33e5a0 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 10 client.8679 fetch_fsmap finished waiting for FSMap version 95 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 10 client.8679 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 20 client.8679 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55dd7b350dc0 0x55dd7b3511d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 4 client.8679 mds_command: new command op to 8127 tid=0[{"prefix": "scrub resume"}] 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 -- 172.21.15.133:0/3802862080 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x55dd7b10c6a0 con 0x55dd7b350dc0 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1affd640 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55dd7b350dc0 0x55dd7b3511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c1affd640 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55dd7b350dc0 0x55dd7b3511d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dee771c6de232da8 server_cookie=562e50151c5f4411 in_seq=0 out_seq=0 2023-12-18T10:24:48.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 10 client.8679 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:48.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 1 -- 172.21.15.133:0/3802862080 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55dd7b10c6a0 con 0x55dd7b350dc0 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 10 client.8679 handle_command_reply: tid=0 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 client.8679 shutdown 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 -- 172.21.15.133:0/3802862080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 msgr2=0x55dd7b350880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b350880 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9c1405c610 tx=0x7f9c14051000 comp rx=0 tx=0).stop 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 -- 172.21.15.133:0/3802862080 shutdown_connections 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55dd7b350dc0 0x55dd7b3511d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dd7b33e5a0 0x55dd7b350880 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dd7b33dc80 0x55dd7b353110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 --2- 172.21.15.133:0/3802862080 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dd7b2f3fc0 0x55dd7b353e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9bf9ffb640 0 client.8679 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:48.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 -- 172.21.15.133:0/3802862080 >> 172.21.15.133:0/3802862080 conn(0x55dd7b0f2910 msgr2=0x55dd7b33c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 -- 172.21.15.133:0/3802862080 shutdown_connections 2023-12-18T10:24:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 1 -- 172.21.15.133:0/3802862080 wait complete. 2023-12-18T10:24:48.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c24772000 20 client.8679 trim_cache size 0 max 16384 2023-12-18T10:24:48.508 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:48.508 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:24:48.508 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:48.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 -- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9bfc065a90 msgr2=0x7f9bfc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9bfc065a90 0x7f9bfc067f50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0af000 tx=0x7f9c0c0a7070 comp rx=0 tx=0).stop 2023-12-18T10:24:48.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 -- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 msgr2=0x7f9c1c1480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c1480d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400d800 tx=0x7f9c1400dcc0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 -- 172.21.15.133:0/1746007629 shutdown_connections 2023-12-18T10:24:48.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9bfc065a90 0x7f9bfc067f50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c1c1593f0 0x7f9c1c1480d0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9c1c0ce590 0x7f9c1c1441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 --2- 172.21.15.133:0/1746007629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9c1c0706e0 0x7f9c1c14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.501+0000 7f9c21404640 1 -- 172.21.15.133:0/1746007629 >> 172.21.15.133:0/1746007629 conn(0x7f9c1c06d8d0 msgr2=0x7f9c1c0b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.505+0000 7f9c21404640 1 -- 172.21.15.133:0/1746007629 shutdown_connections 2023-12-18T10:24:48.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.505+0000 7f9c21404640 1 -- 172.21.15.133:0/1746007629 wait complete. 2023-12-18T10:24:48.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 scrub status 2023-12-18T10:24:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc984d8640 1 Processor -- start 2023-12-18T10:24:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc984d8640 1 -- start start 2023-12-18T10:24:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc984d8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc900ca410 0x7fbc90159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc984d8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc90070df0 con 0x7fbc900cbff0 2023-12-18T10:24:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc984d8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9015a4f0 con 0x7fbc90159fb0 2023-12-18T10:24:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc984d8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9015aab0 con 0x7fbc900ca410 2023-12-18T10:24:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc96a75640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbc900cbff0 0x7fbc900ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49916/0 (socket says 172.21.15.133:49916) 2023-12-18T10:24:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc96a75640 1 -- 172.21.15.133:0/92375143 learned_addr learned my addr 172.21.15.133:0/92375143 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.661+0000 7fbc96274640 1 --2- 172.21.15.133:0/92375143 >> v2:172.21.15.142:3300/0 conn(0x7fbc900ca410 0x7fbc90159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc95272640 1 -- 172.21.15.133:0/92375143 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007139463 0 0) 0x7fbc90070df0 con 0x7fbc900cbff0 2023-12-18T10:24:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc95272640 1 -- 172.21.15.133:0/92375143 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc7c005740 con 0x7fbc900cbff0 2023-12-18T10:24:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc96274640 1 -- 172.21.15.133:0/92375143 >> v1:172.21.15.142:6789/0 conn(0x7fbc90159fb0 legacy=0x7fbc90071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc96274640 1 -- 172.21.15.133:0/92375143 >> v1:172.21.15.133:6789/0 conn(0x7fbc900cbff0 legacy=0x7fbc900ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc96274640 1 -- 172.21.15.133:0/92375143 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9015a7d0 con 0x7fbc900ca410 2023-12-18T10:24:48.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc96274640 1 --2- 172.21.15.133:0/92375143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900ca410 0x7fbc90159a70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0097c0 tx=0x7fbc8c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bec78e00435c1e87 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc95272640 1 -- 172.21.15.133:0/92375143 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c004230 con 0x7fbc900ca410 2023-12-18T10:24:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc95272640 1 -- 172.21.15.133:0/92375143 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c0a7050 con 0x7fbc900ca410 2023-12-18T10:24:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc95272640 1 -- 172.21.15.133:0/92375143 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c003620 con 0x7fbc900ca410 2023-12-18T10:24:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc984d8640 1 -- 172.21.15.133:0/92375143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900ca410 msgr2=0x7fbc90159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.665+0000 7fbc984d8640 1 --2- 172.21.15.133:0/92375143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900ca410 0x7fbc90159a70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0097c0 tx=0x7fbc8c01c450 comp rx=0 tx=0).stop 2023-12-18T10:24:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 -- 172.21.15.133:0/92375143 shutdown_connections 2023-12-18T10:24:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 --2- 172.21.15.133:0/92375143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900ca410 0x7fbc90159a70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 -- 172.21.15.133:0/92375143 >> 172.21.15.133:0/92375143 conn(0x7fbc9006a2a0 msgr2=0x7fbc900aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 -- 172.21.15.133:0/92375143 shutdown_connections 2023-12-18T10:24:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 -- 172.21.15.133:0/92375143 wait complete. 2023-12-18T10:24:48.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 Processor -- start 2023-12-18T10:24:48.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 -- start start 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc900ca410 0x7fbc9014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900cbff0 0x7fbc90152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc90159fb0 0x7fbc900ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900adeb0 con 0x7fbc90159fb0 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900ae190 con 0x7fbc900cbff0 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc984d8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900ae470 con 0x7fbc900ca410 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc90159fb0 0x7fbc900ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc90159fb0 0x7fbc900ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33606/0 (socket says 172.21.15.133:33606) 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 -- 172.21.15.133:0/2005152616 learned_addr learned my addr 172.21.15.133:0/2005152616 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96274640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc900ca410 0x7fbc9014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc95a73640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900cbff0 0x7fbc90152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 -- 172.21.15.133:0/2005152616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc900ca410 msgr2=0x7fbc9014a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc900ca410 0x7fbc9014a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 -- 172.21.15.133:0/2005152616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900cbff0 msgr2=0x7fbc90152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900cbff0 0x7fbc90152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 -- 172.21.15.133:0/2005152616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c009420 con 0x7fbc90159fb0 2023-12-18T10:24:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.669+0000 7fbc96a75640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc90159fb0 0x7fbc900ab8a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800cb40 tx=0x7fbc8800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc86ffd640 1 -- 172.21.15.133:0/2005152616 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800aca0 con 0x7fbc90159fb0 2023-12-18T10:24:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc86ffd640 1 -- 172.21.15.133:0/2005152616 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800ae00 con 0x7fbc90159fb0 2023-12-18T10:24:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc86ffd640 1 -- 172.21.15.133:0/2005152616 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88012620 con 0x7fbc90159fb0 2023-12-18T10:24:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc984d8640 1 -- 172.21.15.133:0/2005152616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc900cc960 con 0x7fbc90159fb0 2023-12-18T10:24:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc984d8640 1 -- 172.21.15.133:0/2005152616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc900aea30 con 0x7fbc90159fb0 2023-12-18T10:24:48.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc86ffd640 1 -- 172.21.15.133:0/2005152616 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc88007070 con 0x7fbc90159fb0 2023-12-18T10:24:48.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc86ffd640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc74065a60 0x7fbc74067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc86ffd640 1 -- 172.21.15.133:0/2005152616 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fbc88083380 con 0x7fbc90159fb0 2023-12-18T10:24:48.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc96274640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc74065a60 0x7fbc74067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc9b5ff000 1 Processor -- start 2023-12-18T10:24:48.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.673+0000 7fbc9b5ff000 1 -- start start 2023-12-18T10:24:48.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc74065a60 0x7fbc74067f20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0ad000 tx=0x7fbc8c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563167385a0 0x5563166eda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563166edfc0 0x5563166ee3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563165b6430 con 0x556316737c80 2023-12-18T10:24:48.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556316544460 con 0x5563167385a0 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556316541a30 con 0x5563166edfc0 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33608/0 (socket says 172.21.15.133:33608) 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 -- 172.21.15.133:0/3188564025 learned_addr learned my addr 172.21.15.133:0/3188564025 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc95a73640 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563167385a0 0x5563166eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96a75640 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563166edfc0 0x5563166ee3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 -- 172.21.15.133:0/3188564025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563166edfc0 msgr2=0x5563166ee3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563166edfc0 0x5563166ee3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 -- 172.21.15.133:0/3188564025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563167385a0 msgr2=0x5563166eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563167385a0 0x5563166eda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 -- 172.21.15.133:0/3188564025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556316239e20 con 0x556316737c80 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc96274640 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738060 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0097c0 tx=0x7fbc8c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42b075cf9376d78 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc73fff640 1 -- 172.21.15.133:0/3188564025 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0038e0 con 0x556316737c80 2023-12-18T10:24:48.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc73fff640 1 -- 172.21.15.133:0/3188564025 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c0c5070 con 0x556316737c80 2023-12-18T10:24:48.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc73fff640 1 -- 172.21.15.133:0/3188564025 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c003c40 con 0x556316737c80 2023-12-18T10:24:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/3188564025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 msgr2=0x556316738060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738060 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0097c0 tx=0x7fbc8c004740 comp rx=0 tx=0).stop 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/3188564025 shutdown_connections 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563166edfc0 0x5563166ee3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563167385a0 0x5563166eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/3188564025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738060 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/3188564025 >> 172.21.15.133:0/3188564025 conn(0x5563164ec910 msgr2=0x5563166ec360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/3188564025 shutdown_connections 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/3188564025 wait complete. 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 -- start start 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.677+0000 7fbc9b5ff000 1 Processor -- start 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x5563167372d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316738ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55631653d320 con 0x556316737c80 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563164dc4f0 con 0x5563166edfc0 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563164fa6e0 con 0x5563167385a0 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 10 client.0 _ll_register_callbacks cb 0x5563166d9980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33622/0 (socket says 172.21.15.133:33622) 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 -- 172.21.15.133:0/2256226343 learned_addr learned my addr 172.21.15.133:0/2256226343 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc96274640 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x5563167372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc96a75640 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316738ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 -- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 msgr2=0x556316738ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316738ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 -- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 msgr2=0x5563167372d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x5563167372d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 -- 172.21.15.133:0/2256226343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9015a7d0 con 0x556316737c80 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc95a73640 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738980 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fbc9015a420 tx=0x7fbc80012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed5148cb31ee8b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc717fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc717fa640 1 -- 172.21.15.133:0/2256226343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8001a030 con 0x556316737c80 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc717fa640 1 -- 172.21.15.133:0/2256226343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fbc8001b070 con 0x556316737c80 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/2256226343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563164fa120 con 0x556316737c80 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc717fa640 1 -- 172.21.15.133:0/2256226343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc80012e60 con 0x556316737c80 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 10 client.8691 fetch_fsmap learned FSMap version 95 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/2256226343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x556316502250 con 0x556316737c80 2023-12-18T10:24:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc717fa640 1 -- 172.21.15.133:0/2256226343 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc80025020 con 0x556316737c80 2023-12-18T10:24:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc717fa640 1 -- 172.21.15.133:0/2256226343 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 95) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fbc80005320 con 0x556316737c80 2023-12-18T10:24:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 10 client.8691 fetch_fsmap finished waiting for FSMap version 95 2023-12-18T10:24:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 10 client.8691 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-12-18T10:24:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 20 client.8691 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x5563167398d0 0x556316739ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 4 client.8691 mds_command: new command op to 8118 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/2256226343 --> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55631653bc70 con 0x5563167398d0 2023-12-18T10:24:48.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc96274640 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x5563167398d0 0x556316739ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc96274640 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x5563167398d0 0x556316739ce0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=921e91fee18e1223 server_cookie=d6a1543a98bff6c in_seq=0 out_seq=0 2023-12-18T10:24:48.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.681+0000 7fbc717fa640 10 client.8691 ms_handle_connect on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc717fa640 1 -- 172.21.15.133:0/2256226343 <== mds.1 v2:172.21.15.142:6833/4118520914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55631653bc70 con 0x5563167398d0 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc717fa640 10 client.8691 handle_command_reply: tid=0 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 client.8691 shutdown 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/2256226343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 msgr2=0x556316738980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738980 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fbc9015a420 tx=0x7fbc80012690 comp rx=0 tx=0).stop 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/2256226343 shutdown_connections 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x5563167398d0 0x556316739ce0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316738ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316738980 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/2256226343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x5563167372d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/2256226343 >> 172.21.15.133:0/2256226343 conn(0x5563164ec910 msgr2=0x5563166eca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc717fa640 0 client.8691 ms_handle_reset on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/2256226343 shutdown_connections 2023-12-18T10:24:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/2256226343 wait complete. 2023-12-18T10:24:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.685+0000 7fbc9b5ff000 20 client.8691 trim_cache size 0 max 16384 2023-12-18T10:24:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc9b5ff000 1 Processor -- start 2023-12-18T10:24:48.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc9b5ff000 1 -- start start 2023-12-18T10:24:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x556316736040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316736580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316747f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563161faaa0 con 0x556316737c80 2023-12-18T10:24:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556316541320 con 0x5563166edfc0 2023-12-18T10:24:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563166edae0 con 0x5563167385a0 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.697+0000 7fbc95a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316736580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316736580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33632/0 (socket says 172.21.15.133:33632) 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 -- 172.21.15.133:0/1246873225 learned_addr learned my addr 172.21.15.133:0/1246873225 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc96274640 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x556316736040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc96a75640 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316747f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 -- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 msgr2=0x556316747f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316747f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 -- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 msgr2=0x556316736040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x556316736040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 -- 172.21.15.133:0/1246873225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563164e85a0 con 0x556316737c80 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc96a75640 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316747f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316736580 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fbc80013010 tx=0x7fbc8000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2a5fef69589d6e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc84ff9640 1 -- 172.21.15.133:0/1246873225 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8001a070 con 0x556316737c80 2023-12-18T10:24:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc84ff9640 1 -- 172.21.15.133:0/1246873225 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc80025040 con 0x556316737c80 2023-12-18T10:24:48.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc84ff9640 1 -- 172.21.15.133:0/1246873225 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80001b60 con 0x556316737c80 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1246873225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 msgr2=0x556316736580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316736580 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fbc80013010 tx=0x7fbc8000c000 comp rx=0 tx=0).stop 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1246873225 shutdown_connections 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5563167385a0 0x556316747f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556316737c80 0x556316736580 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1246873225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x556316736040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1246873225 >> 172.21.15.133:0/1246873225 conn(0x5563164ec910 msgr2=0x556316744c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1246873225 shutdown_connections 2023-12-18T10:24:48.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1246873225 wait complete. 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- start start 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 Processor -- start 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x556316791fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563167385a0 0x55631674abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55631674b110 0x55631674b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55631660c140 con 0x5563167385a0 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563164fb480 con 0x5563166edfc0 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55631653a720 con 0x55631674b110 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc9b5ff000 10 client.0 _ll_register_callbacks cb 0x5563164f4710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563167385a0 0x55631674abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563167385a0 0x55631674abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33648/0 (socket says 172.21.15.133:33648) 2023-12-18T10:24:48.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc96274640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x556316791fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc95a73640 1 -- 172.21.15.133:0/1242115985 learned_addr learned my addr 172.21.15.133:0/1242115985 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.701+0000 7fbc96a75640 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55631674b110 0x55631674b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc95a73640 1 -- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55631674b110 msgr2=0x55631674b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc95a73640 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55631674b110 0x55631674b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc95a73640 1 -- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 msgr2=0x556316791fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc95a73640 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x556316791fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc95a73640 1 -- 172.21.15.133:0/1242115985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556316502250 con 0x5563167385a0 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc95a73640 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563167385a0 0x55631674abd0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x556316540680 tx=0x7fbc80001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ece71acebfb527 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 1 -- 172.21.15.133:0/1242115985 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80031070 con 0x5563167385a0 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 1 -- 172.21.15.133:0/1242115985 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fbc80026080 con 0x5563167385a0 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1242115985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563166f1940 con 0x5563167385a0 2023-12-18T10:24:48.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 1 -- 172.21.15.133:0/1242115985 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc80001d70 con 0x5563167385a0 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 10 client.8697 fetch_fsmap learned FSMap version 95 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1242115985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x5563164dc110 con 0x5563167385a0 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 1 -- 172.21.15.133:0/1242115985 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5563166f1940 con 0x5563167385a0 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 1 -- 172.21.15.133:0/1242115985 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 95) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fbc800073d0 con 0x5563167385a0 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 10 client.8697 fetch_fsmap finished waiting for FSMap version 95 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 10 client.8697 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.b 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 20 client.8697 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55631674ba30 0x55631674be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 4 client.8697 mds_command: new command op to 8118 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1242115985 --> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5563165066a0 con 0x55631674ba30 2023-12-18T10:24:48.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc96274640 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55631674ba30 0x55631674be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc96274640 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55631674ba30 0x55631674be10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e3e57527cb4acfd1 server_cookie=e2f48657bb7156ba in_seq=0 out_seq=0 2023-12-18T10:24:48.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 10 client.8697 ms_handle_connect on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:48.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 1 -- 172.21.15.133:0/1242115985 <== mds.1 v2:172.21.15.142:6833/4118520914 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5563165066a0 con 0x55631674ba30 2023-12-18T10:24:48.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 10 client.8697 handle_command_reply: tid=0 2023-12-18T10:24:48.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 client.8697 shutdown 2023-12-18T10:24:48.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1242115985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563167385a0 msgr2=0x55631674abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563167385a0 0x55631674abd0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x556316540680 tx=0x7fbc80001130 comp rx=0 tx=0).stop 2023-12-18T10:24:48.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1242115985 shutdown_connections 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:6833/4118520914,v1:172.21.15.142:6835/4118520914] conn(0x55631674ba30 0x55631674be10 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55631674b110 0x55631674b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5563167385a0 0x55631674abd0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc717fa640 0 client.8697 ms_handle_reset on v2:172.21.15.142:6833/4118520914 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 --2- 172.21.15.133:0/1242115985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563166edfc0 0x556316791fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1242115985 >> 172.21.15.133:0/1242115985 conn(0x5563164ec910 msgr2=0x556316744c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1242115985 shutdown_connections 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 1 -- 172.21.15.133:0/1242115985 wait complete. 2023-12-18T10:24:48.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc9b5ff000 20 client.8697 trim_cache size 0 max 16384 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout: "6c914697-d827-4ecd-9e50-1715a20121d0": { 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "6c914697-d827-4ecd-9e50-1715a20121d0", 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:48.712 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:48.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 -- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc74065a60 msgr2=0x7fbc74067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc74065a60 0x7fbc74067f20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0ad000 tx=0x7fbc8c0a6000 comp rx=0 tx=0).stop 2023-12-18T10:24:48.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 -- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc90159fb0 msgr2=0x7fbc900ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc90159fb0 0x7fbc900ab8a0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800cb40 tx=0x7fbc8800a060 comp rx=0 tx=0).stop 2023-12-18T10:24:48.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 -- 172.21.15.133:0/2005152616 shutdown_connections 2023-12-18T10:24:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc74065a60 0x7fbc74067f20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc90159fb0 0x7fbc900ab8a0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc900cbff0 0x7fbc90152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 --2- 172.21.15.133:0/2005152616 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc900ca410 0x7fbc9014a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 -- 172.21.15.133:0/2005152616 >> 172.21.15.133:0/2005152616 conn(0x7fbc9006a2a0 msgr2=0x7fbc900aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.705+0000 7fbc984d8640 1 -- 172.21.15.133:0/2005152616 shutdown_connections 2023-12-18T10:24:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.709+0000 7fbc984d8640 1 -- 172.21.15.133:0/2005152616 wait complete. 2023-12-18T10:24:48.725 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:24:48.726 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 scrub status 2023-12-18T10:24:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.865+0000 7fd556779640 1 Processor -- start 2023-12-18T10:24:48.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.865+0000 7fd556779640 1 -- start start 2023-12-18T10:24:48.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.865+0000 7fd556779640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5501609c0 0x7fd550071a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.865+0000 7fd556779640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 0x7fd55006bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.865+0000 7fd556779640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd550165760 con 0x7fd5501651f0 2023-12-18T10:24:48.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.865+0000 7fd556779640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5500cac20 con 0x7fd5501609c0 2023-12-18T10:24:48.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.865+0000 7fd556779640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500ce460 con 0x7fd550160da0 2023-12-18T10:24:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.865+0000 7fd555777640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5501609c0 0x7fd550071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd555777640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5501609c0 0x7fd550071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33652/0 (socket says 172.21.15.133:33652) 2023-12-18T10:24:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd555777640 1 -- 172.21.15.133:0/4049374085 learned_addr learned my addr 172.21.15.133:0/4049374085 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd554f76640 1 --2- 172.21.15.133:0/4049374085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 0x7fd55006bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd555777640 1 -- 172.21.15.133:0/4049374085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 msgr2=0x7fd55006bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd555777640 1 --2- 172.21.15.133:0/4049374085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 0x7fd55006bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd555777640 1 -- 172.21.15.133:0/4049374085 >> v1:172.21.15.142:6789/0 conn(0x7fd5501651f0 legacy=0x7fd550070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd555777640 1 -- 172.21.15.133:0/4049374085 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55006cb60 con 0x7fd5501609c0 2023-12-18T10:24:48.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd555777640 1 --2- 172.21.15.133:0/4049374085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd550071a90 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0098a0 tx=0x7fd54c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36df86bcbe906538 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd547fff640 1 -- 172.21.15.133:0/4049374085 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0ab600 con 0x7fd5501609c0 2023-12-18T10:24:48.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd547fff640 1 -- 172.21.15.133:0/4049374085 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c0a7050 con 0x7fd5501609c0 2023-12-18T10:24:48.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.869+0000 7fd547fff640 1 -- 172.21.15.133:0/4049374085 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0ab980 con 0x7fd5501609c0 2023-12-18T10:24:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- 172.21.15.133:0/4049374085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 msgr2=0x7fd550071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 --2- 172.21.15.133:0/4049374085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd550071a90 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0098a0 tx=0x7fd54c01c400 comp rx=0 tx=0).stop 2023-12-18T10:24:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- 172.21.15.133:0/4049374085 shutdown_connections 2023-12-18T10:24:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 --2- 172.21.15.133:0/4049374085 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 0x7fd55006bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 --2- 172.21.15.133:0/4049374085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd550071a90 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- 172.21.15.133:0/4049374085 >> 172.21.15.133:0/4049374085 conn(0x7fd55006d8d0 msgr2=0x7fd550069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- 172.21.15.133:0/4049374085 shutdown_connections 2023-12-18T10:24:48.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- 172.21.15.133:0/4049374085 wait complete. 2023-12-18T10:24:48.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 Processor -- start 2023-12-18T10:24:48.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- start start 2023-12-18T10:24:48.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd5501537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 0x7fd5501442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5501651f0 0x7fd5500cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550158830 con 0x7fd5501609c0 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5501535e0 con 0x7fd5501651f0 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd556779640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd550157c60 con 0x7fd550160da0 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555777640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd5501537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555777640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd5501537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33662/0 (socket says 172.21.15.133:33662) 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555777640 1 -- 172.21.15.133:0/4070352565 learned_addr learned my addr 172.21.15.133:0/4070352565 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd554f76640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 0x7fd5501442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555f78640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5501651f0 0x7fd5500cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555777640 1 -- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 msgr2=0x7fd5501442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555777640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 0x7fd5501442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555777640 1 -- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5501651f0 msgr2=0x7fd5500cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555777640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5501651f0 0x7fd5500cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555777640 1 -- 172.21.15.133:0/4070352565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0094d0 con 0x7fd5501609c0 2023-12-18T10:24:48.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.873+0000 7fd555f78640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5501651f0 0x7fd5500cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:48.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.877+0000 7fd555777640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd5501537a0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0098a0 tx=0x7fd54c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.877+0000 7fd545ffb640 1 -- 172.21.15.133:0/4070352565 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0b6420 con 0x7fd5501609c0 2023-12-18T10:24:48.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.877+0000 7fd545ffb640 1 -- 172.21.15.133:0/4070352565 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c0a4e90 con 0x7fd5501609c0 2023-12-18T10:24:48.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.877+0000 7fd545ffb640 1 -- 172.21.15.133:0/4070352565 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0b67c0 con 0x7fd5501609c0 2023-12-18T10:24:48.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.877+0000 7fd556779640 1 -- 172.21.15.133:0/4070352565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd550158c50 con 0x7fd5501609c0 2023-12-18T10:24:48.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.877+0000 7fd556779640 1 -- 172.21.15.133:0/4070352565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5501447f0 con 0x7fd5501609c0 2023-12-18T10:24:48.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.877+0000 7fd545ffb640 1 -- 172.21.15.133:0/4070352565 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd54c0b2040 con 0x7fd5501609c0 2023-12-18T10:24:48.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd545ffb640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd545ffb640 1 -- 172.21.15.133:0/4070352565 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd54c11d530 con 0x7fd5501609c0 2023-12-18T10:24:48.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd554f76640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 Processor -- start 2023-12-18T10:24:48.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- start start 2023-12-18T10:24:48.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd554f76640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd5501647b0 tx=0x7fd540009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad1c80 0x556282ad2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad25a0 0x556282a87a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282a87fc0 0x556282a883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556282950430 con 0x556282a87fc0 2023-12-18T10:24:48.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562828de460 con 0x556282ad1c80 2023-12-18T10:24:48.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562828dba30 con 0x556282ad25a0 2023-12-18T10:24:48.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282a87fc0 0x556282a883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282a87fc0 0x556282a883a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33672/0 (socket says 172.21.15.133:33672) 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 -- 172.21.15.133:0/3067725347 learned_addr learned my addr 172.21.15.133:0/3067725347 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd554f76640 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad25a0 0x556282a87a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555777640 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad1c80 0x556282ad2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 -- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad25a0 msgr2=0x556282a87a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad25a0 0x556282a87a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 -- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad1c80 msgr2=0x556282ad2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad1c80 0x556282ad2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 -- 172.21.15.133:0/3067725347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562825d3e20 con 0x556282a87fc0 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555777640 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad1c80 0x556282ad2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd555f78640 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282a87fc0 0x556282a883a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd548001d20 tx=0x7fd5480021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a4e3801a16f5ff server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd532ffd640 1 -- 172.21.15.133:0/3067725347 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548003b90 con 0x556282a87fc0 2023-12-18T10:24:48.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd532ffd640 1 -- 172.21.15.133:0/3067725347 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548003cf0 con 0x556282a87fc0 2023-12-18T10:24:48.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd532ffd640 1 -- 172.21.15.133:0/3067725347 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54800eb20 con 0x556282a87fc0 2023-12-18T10:24:48.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- 172.21.15.133:0/3067725347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282a87fc0 msgr2=0x556282a883a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282a87fc0 0x556282a883a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd548001d20 tx=0x7fd5480021e0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- 172.21.15.133:0/3067725347 shutdown_connections 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282a87fc0 0x556282a883a0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad25a0 0x556282a87a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/3067725347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad1c80 0x556282ad2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- 172.21.15.133:0/3067725347 >> 172.21.15.133:0/3067725347 conn(0x556282886910 msgr2=0x556282a86360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- 172.21.15.133:0/3067725347 shutdown_connections 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.881+0000 7fd55ad4a000 1 -- 172.21.15.133:0/3067725347 wait complete. 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 -- start start 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 Processor -- start 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282a87fc0 0x556282ad2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad1c80 0x556282ad30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad25a0 0x556282ad35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562828d7320 con 0x556282ad25a0 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562828764f0 con 0x556282a87fc0 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562828946e0 con 0x556282ad1c80 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 10 client.0 _ll_register_callbacks cb 0x556282a73980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad25a0 0x556282ad35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555777640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282a87fc0 0x556282ad2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad25a0 0x556282ad35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33680/0 (socket says 172.21.15.133:33680) 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 -- 172.21.15.133:0/2725091565 learned_addr learned my addr 172.21.15.133:0/2725091565 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd554f76640 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad1c80 0x556282ad30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 -- 172.21.15.133:0/2725091565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad1c80 msgr2=0x556282ad30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad1c80 0x556282ad30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 -- 172.21.15.133:0/2725091565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282a87fc0 msgr2=0x556282ad2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282a87fc0 0x556282ad2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 -- 172.21.15.133:0/2725091565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54800f040 con 0x556282ad25a0 2023-12-18T10:24:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555777640 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282a87fc0 0x556282ad2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555f78640 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad25a0 0x556282ad35e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd548009010 tx=0x7fd548001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0ce0e268d05a27 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd52bfff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd52bfff640 1 -- 172.21.15.133:0/2725091565 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548006d70 con 0x556282ad25a0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2725091565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556282894120 con 0x556282ad25a0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd52bfff640 1 -- 172.21.15.133:0/2725091565 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd54800e920 con 0x556282ad25a0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd52bfff640 1 -- 172.21.15.133:0/2725091565 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd54800eae0 con 0x556282ad25a0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 10 client.8709 fetch_fsmap learned FSMap version 95 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2725091565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x55628289c250 con 0x556282ad25a0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd52bfff640 1 -- 172.21.15.133:0/2725091565 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556282894120 con 0x556282ad25a0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd52bfff640 1 -- 172.21.15.133:0/2725091565 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 95) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fd54800ec40 con 0x556282ad25a0 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 10 client.8709 fetch_fsmap finished waiting for FSMap version 95 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 10 client.8709 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.c 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 20 client.8709 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x556282ad3ff0 0x556282ae3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 4 client.8709 mds_command: new command op to 8109 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2725091565 --> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562828d5c70 con 0x556282ad3ff0 2023-12-18T10:24:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.885+0000 7fd555777640 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x556282ad3ff0 0x556282ae3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd52bfff640 10 client.8709 ms_handle_connect on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:48.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd555777640 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x556282ad3ff0 0x556282ae3850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45dd94dc153ae9db server_cookie=a6e91ff18abfd10 in_seq=0 out_seq=0 2023-12-18T10:24:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd52bfff640 1 -- 172.21.15.133:0/2725091565 <== mds.2 v2:172.21.15.133:6834/1695888167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5562828d5c70 con 0x556282ad3ff0 2023-12-18T10:24:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd52bfff640 10 client.8709 handle_command_reply: tid=0 2023-12-18T10:24:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 client.8709 shutdown 2023-12-18T10:24:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2725091565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad25a0 msgr2=0x556282ad35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad25a0 0x556282ad35e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fd548009010 tx=0x7fd548001260 comp rx=0 tx=0).stop 2023-12-18T10:24:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2725091565 shutdown_connections 2023-12-18T10:24:48.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x556282ad3ff0 0x556282ae3850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad25a0 0x556282ad35e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282ad1c80 0x556282ad30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd52bfff640 0 client.8709 ms_handle_reset on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2725091565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282a87fc0 0x556282ad2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2725091565 >> 172.21.15.133:0/2725091565 conn(0x556282886910 msgr2=0x556282a86a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2725091565 shutdown_connections 2023-12-18T10:24:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2725091565 wait complete. 2023-12-18T10:24:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.889+0000 7fd55ad4a000 20 client.8709 trim_cache size 0 max 16384 2023-12-18T10:24:48.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.901+0000 7fd55ad4a000 1 Processor -- start 2023-12-18T10:24:48.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.901+0000 7fd55ad4a000 1 -- start start 2023-12-18T10:24:48.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 0x556282ae4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282ae4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282acb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556282594aa0 con 0x556282ad1c80 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55628298ee50 con 0x556282ad25a0 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562828d9e80 con 0x556282a87fc0 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282ae4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282ae4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33696/0 (socket says 172.21.15.133:33696) 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 -- 172.21.15.133:0/1112647512 learned_addr learned my addr 172.21.15.133:0/1112647512 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd555777640 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 0x556282ae4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd555f78640 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282acb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 -- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 msgr2=0x556282ae4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 0x556282ae4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 -- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 msgr2=0x556282acb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282acb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 -- 172.21.15.133:0/1112647512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562828825a0 con 0x556282ad1c80 2023-12-18T10:24:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd555f78640 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282acb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd554f76640 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282ae4da0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fd540011fa0 tx=0x7fd540014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1466c47e7c42620 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd5337fe640 1 -- 172.21.15.133:0/1112647512 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54001c040 con 0x556282ad1c80 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd5337fe640 1 -- 172.21.15.133:0/1112647512 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540003a30 con 0x556282ad1c80 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd5337fe640 1 -- 172.21.15.133:0/1112647512 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540003da0 con 0x556282ad1c80 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- 172.21.15.133:0/1112647512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 msgr2=0x556282ae4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282ae4da0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fd540011fa0 tx=0x7fd540014000 comp rx=0 tx=0).stop 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- 172.21.15.133:0/1112647512 shutdown_connections 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282acb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282ae4da0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/1112647512 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 0x556282ae4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- 172.21.15.133:0/1112647512 >> 172.21.15.133:0/1112647512 conn(0x556282886910 msgr2=0x556282a8d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- 172.21.15.133:0/1112647512 shutdown_connections 2023-12-18T10:24:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- 172.21.15.133:0/1112647512 wait complete. 2023-12-18T10:24:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 -- start start 2023-12-18T10:24:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.905+0000 7fd55ad4a000 1 Processor -- start 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 0x556282b13330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282b13d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282b142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556282ade6a0 con 0x556282ad1c80 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562829a6140 con 0x556282ad25a0 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556282a87ae0 con 0x556282a87fc0 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 10 client.0 _ll_register_callbacks cb 0x55628288e710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282b13d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282b13d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33698/0 (socket says 172.21.15.133:33698) 2023-12-18T10:24:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 -- 172.21.15.133:0/2340657565 learned_addr learned my addr 172.21.15.133:0/2340657565 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd555f78640 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282b142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd555777640 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 0x556282b13330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 -- 172.21.15.133:0/2340657565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 msgr2=0x556282b13330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 0x556282b13330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 -- 172.21.15.133:0/2340657565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 msgr2=0x556282b142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282b142d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 -- 172.21.15.133:0/2340657565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd540011c50 con 0x556282ad1c80 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd554f76640 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282b13d90 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd540012010 tx=0x7fd540004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61316167dd1fca5b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 1 -- 172.21.15.133:0/2340657565 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540031070 con 0x556282ad1c80 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 1 -- 172.21.15.133:0/2340657565 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd5400149e0 con 0x556282ad1c80 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2340657565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556282a8b8e0 con 0x556282ad1c80 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 1 -- 172.21.15.133:0/2340657565 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd540011af0 con 0x556282ad1c80 2023-12-18T10:24:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 10 client.8715 fetch_fsmap learned FSMap version 95 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2340657565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x556282876110 con 0x556282ad1c80 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 1 -- 172.21.15.133:0/2340657565 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556282a8b8e0 con 0x556282ad1c80 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 1 -- 172.21.15.133:0/2340657565 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 95) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fd540014ba0 con 0x556282ad1c80 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 10 client.8715 fetch_fsmap finished waiting for FSMap version 95 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 10 client.8715 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.c 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 20 client.8715 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x556282b14810 0x556282b14bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 4 client.8715 mds_command: new command op to 8109 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2340657565 --> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5562828a06a0 con 0x556282b14810 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd555777640 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x556282b14810 0x556282b14bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd555777640 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x556282b14810 0x556282b14bf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b7ec56c31aba2a9 server_cookie=9757d1392f754de8 in_seq=0 out_seq=0 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 10 client.8715 ms_handle_connect on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 1 -- 172.21.15.133:0/2340657565 <== mds.2 v2:172.21.15.133:6834/1695888167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5562828a06a0 con 0x556282b14810 2023-12-18T10:24:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 10 client.8715 handle_command_reply: tid=0 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 client.8715 shutdown 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2340657565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 msgr2=0x556282b13d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282b13d90 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd540012010 tx=0x7fd540004740 comp rx=0 tx=0).stop 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2340657565 shutdown_connections 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.133:6834/1695888167,v1:172.21.15.133:6835/1695888167] conn(0x556282b14810 0x556282b14bf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556282ad25a0 0x556282b142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556282ad1c80 0x556282b13d90 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 --2- 172.21.15.133:0/2340657565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556282a87fc0 0x556282b13330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd52bfff640 0 client.8715 ms_handle_reset on v2:172.21.15.133:6834/1695888167 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2340657565 >> 172.21.15.133:0/2340657565 conn(0x556282886910 msgr2=0x556282ae3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2340657565 shutdown_connections 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 1 -- 172.21.15.133:0/2340657565 wait complete. 2023-12-18T10:24:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.909+0000 7fd55ad4a000 20 client.8715 trim_cache size 0 max 16384 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout: "6c914697-d827-4ecd-9e50-1715a20121d0": { 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "6c914697-d827-4ecd-9e50-1715a20121d0", 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:48.915 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 -- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 msgr2=0x7fd534067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd5501647b0 tx=0x7fd540009190 comp rx=0 tx=0).stop 2023-12-18T10:24:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 -- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 msgr2=0x7fd5501537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd5501537a0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0098a0 tx=0x7fd54c01ac40 comp rx=0 tx=0).stop 2023-12-18T10:24:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 -- 172.21.15.133:0/4070352565 shutdown_connections 2023-12-18T10:24:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd534065a60 0x7fd534067f20 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5501651f0 0x7fd5500cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd550160da0 0x7fd5501442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 --2- 172.21.15.133:0/4070352565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5501609c0 0x7fd5501537a0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 -- 172.21.15.133:0/4070352565 >> 172.21.15.133:0/4070352565 conn(0x7fd55006d8d0 msgr2=0x7fd5500add00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 -- 172.21.15.133:0/4070352565 shutdown_connections 2023-12-18T10:24:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:48.913+0000 7fd556779640 1 -- 172.21.15.133:0/4070352565 wait complete. 2023-12-18T10:24:48.930 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:24:48.930 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-12-18T10:24:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.069+0000 7fd82278f640 1 Processor -- start 2023-12-18T10:24:49.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.069+0000 7fd82278f640 1 -- start start 2023-12-18T10:24:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.069+0000 7fd82278f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c0cde90 0x7fd81c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.069+0000 7fd82278f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c15cec0 con 0x7fd81c0cf170 2023-12-18T10:24:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.069+0000 7fd82278f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c0d0530 con 0x7fd81c15cae0 2023-12-18T10:24:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.069+0000 7fd82278f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0d0810 con 0x7fd81c0cde90 2023-12-18T10:24:49.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd820d2c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd81c0cf170 0x7fd81c06add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49926/0 (socket says 172.21.15.133:49926) 2023-12-18T10:24:49.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd820d2c640 1 -- 172.21.15.133:0/649440262 learned_addr learned my addr 172.21.15.133:0/649440262 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:49.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/649440262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c0cde90 0x7fd81c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81affd640 1 -- 172.21.15.133:0/649440262 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964134736 0 0) 0x7fd81c15cec0 con 0x7fd81c0cf170 2023-12-18T10:24:49.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81affd640 1 -- 172.21.15.133:0/649440262 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd804003530 con 0x7fd81c0cf170 2023-12-18T10:24:49.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81affd640 1 -- 172.21.15.133:0/649440262 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645907542 0 0) 0x7fd81c0d0530 con 0x7fd81c15cae0 2023-12-18T10:24:49.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81affd640 1 -- 172.21.15.133:0/649440262 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd81c15cec0 con 0x7fd81c15cae0 2023-12-18T10:24:49.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81affd640 1 -- 172.21.15.133:0/649440262 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230344989 0 0) 0x7fd804003530 con 0x7fd81c0cf170 2023-12-18T10:24:49.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81b7fe640 1 -- 172.21.15.133:0/649440262 >> v1:172.21.15.142:6789/0 conn(0x7fd81c15cae0 legacy=0x7fd81c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81b7fe640 1 -- 172.21.15.133:0/649440262 >> v1:172.21.15.133:6789/0 conn(0x7fd81c0cf170 legacy=0x7fd81c06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81b7fe640 1 -- 172.21.15.133:0/649440262 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c0d0af0 con 0x7fd81c0cde90 2023-12-18T10:24:49.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.073+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/649440262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c0cde90 0x7fd81c0ce2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8100097f0 tx=0x7fd81001ce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb0f2603d2d8dcd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd81affd640 1 -- 172.21.15.133:0/649440262 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814001a00 con 0x7fd81c0cde90 2023-12-18T10:24:49.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd81affd640 1 -- 172.21.15.133:0/649440262 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8100a7050 con 0x7fd81c0cde90 2023-12-18T10:24:49.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd81affd640 1 -- 172.21.15.133:0/649440262 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810004250 con 0x7fd81c0cde90 2023-12-18T10:24:49.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 -- 172.21.15.133:0/649440262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c0cde90 msgr2=0x7fd81c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 --2- 172.21.15.133:0/649440262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c0cde90 0x7fd81c0ce2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8100097f0 tx=0x7fd81001ce10 comp rx=0 tx=0).stop 2023-12-18T10:24:49.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 -- 172.21.15.133:0/649440262 shutdown_connections 2023-12-18T10:24:49.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 --2- 172.21.15.133:0/649440262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c0cde90 0x7fd81c0ce2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 -- 172.21.15.133:0/649440262 >> 172.21.15.133:0/649440262 conn(0x7fd81c089fb0 msgr2=0x7fd81c0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 -- 172.21.15.133:0/649440262 shutdown_connections 2023-12-18T10:24:49.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 -- 172.21.15.133:0/649440262 wait complete. 2023-12-18T10:24:49.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 Processor -- start 2023-12-18T10:24:49.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.077+0000 7fd82278f640 1 -- start start 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd82278f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd81c0cde90 0x7fd81c151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd82278f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd81c0cf170 0x7fd81c0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd82278f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c15cae0 0x7fd81c0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd82278f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c155190 con 0x7fd81c0cde90 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd82278f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c151a70 con 0x7fd81c0cf170 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd82278f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c159070 con 0x7fd81c15cae0 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd81c0cde90 0x7fd81c151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd81c0cde90 0x7fd81c151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33706/0 (socket says 172.21.15.133:33706) 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 -- 172.21.15.133:0/3418939162 learned_addr learned my addr 172.21.15.133:0/3418939162 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd820d2c640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c15cae0 0x7fd81c0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd81c0cf170 0x7fd81c0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 -- 172.21.15.133:0/3418939162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c15cae0 msgr2=0x7fd81c0b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c15cae0 0x7fd81c0b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 -- 172.21.15.133:0/3418939162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd81c0cf170 msgr2=0x7fd81c0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd81c0cf170 0x7fd81c0b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 -- 172.21.15.133:0/3418939162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd810009420 con 0x7fd81c0cde90 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd81bfff640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd81c0cde90 0x7fd81c151530 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00c420 tx=0x7fd80c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd818ff9640 1 -- 172.21.15.133:0/3418939162 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0052d0 con 0x7fd81c0cde90 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd818ff9640 1 -- 172.21.15.133:0/3418939162 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c005430 con 0x7fd81c0cde90 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd82278f640 1 -- 172.21.15.133:0/3418939162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81c158a60 con 0x7fd81c0cde90 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd818ff9640 1 -- 172.21.15.133:0/3418939162 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c003870 con 0x7fd81c0cde90 2023-12-18T10:24:49.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.081+0000 7fd82278f640 1 -- 172.21.15.133:0/3418939162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81c0cc5a0 con 0x7fd81c0cde90 2023-12-18T10:24:49.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd818ff9640 1 -- 172.21.15.133:0/3418939162 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd80c0039d0 con 0x7fd81c0cde90 2023-12-18T10:24:49.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd818ff9640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd808065a60 0x7fd808067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd818ff9640 1 -- 172.21.15.133:0/3418939162 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd80c082870 con 0x7fd81c0cde90 2023-12-18T10:24:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd808065a60 0x7fd808067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd825aef000 1 Processor -- start 2023-12-18T10:24:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd825aef000 1 -- start start 2023-12-18T10:24:49.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd808065a60 0x7fd808067f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd8100ad000 tx=0x7fd810004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd825aef000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da8c80 0x55d6f2da9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd825aef000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2d5ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd825aef000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2d5f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd825aef000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2c27430 con 0x55d6f2d5efc0 2023-12-18T10:24:49.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd825aef000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2bb5460 con 0x55d6f2da95a0 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd825aef000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2bb2a30 con 0x55d6f2da8c80 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2d5f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da8c80 0x55d6f2da9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2d5f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33716/0 (socket says 172.21.15.133:33716) 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 -- 172.21.15.133:0/3339529822 learned_addr learned my addr 172.21.15.133:0/3339529822 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/3339529822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2d5ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 -- 172.21.15.133:0/3339529822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da8c80 msgr2=0x55d6f2da9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 --2- 172.21.15.133:0/3339529822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da8c80 0x55d6f2da9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 -- 172.21.15.133:0/3339529822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 msgr2=0x55d6f2d5ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 --2- 172.21.15.133:0/3339529822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2d5ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 -- 172.21.15.133:0/3339529822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6f28aae20 con 0x55d6f2d5efc0 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.085+0000 7fd820d2c640 1 --2- 172.21.15.133:0/3339529822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2d5f3a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd81400f520 tx=0x7fd81400f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40c8f7e5912b07a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd801ffb640 1 -- 172.21.15.133:0/3339529822 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8140072e0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd801ffb640 1 -- 172.21.15.133:0/3339529822 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd814007440 con 0x55d6f2d5efc0 2023-12-18T10:24:49.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd801ffb640 1 -- 172.21.15.133:0/3339529822 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8140077b0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- 172.21.15.133:0/3339529822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 msgr2=0x55d6f2d5f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 --2- 172.21.15.133:0/3339529822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2d5f3a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd81400f520 tx=0x7fd81400f9e0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- 172.21.15.133:0/3339529822 shutdown_connections 2023-12-18T10:24:49.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 --2- 172.21.15.133:0/3339529822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2d5f3a0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 --2- 172.21.15.133:0/3339529822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2d5ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 --2- 172.21.15.133:0/3339529822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da8c80 0x55d6f2da9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- 172.21.15.133:0/3339529822 >> 172.21.15.133:0/3339529822 conn(0x55d6f2b5d910 msgr2=0x55d6f2d5d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- 172.21.15.133:0/3339529822 shutdown_connections 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- 172.21.15.133:0/3339529822 wait complete. 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- start start 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 Processor -- start 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2d5efc0 0x55d6f2da9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2da8c80 0x55d6f2da9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2daa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2bae320 con 0x55d6f2da8c80 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2b4d4f0 con 0x55d6f2da95a0 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2b6b6e0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd825aef000 10 client.0 _ll_register_callbacks cb 0x55d6f2d4a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2da8c80 0x55d6f2da9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2da8c80 0x55d6f2da9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33720/0 (socket says 172.21.15.133:33720) 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 -- 172.21.15.133:0/4005950349 learned_addr learned my addr 172.21.15.133:0/4005950349 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81bfff640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2d5efc0 0x55d6f2da9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 -- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2d5efc0 msgr2=0x55d6f2da9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd820d2c640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2daa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2d5efc0 0x55d6f2da9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 -- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 msgr2=0x55d6f2daa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2daa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 -- 172.21.15.133:0/4005950349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81400f1d0 con 0x55d6f2da8c80 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81bfff640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2d5efc0 0x55d6f2da9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd820d2c640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2daa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2da8c80 0x55d6f2da9ec0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd8100ae040 tx=0x7fd81001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af357c7b042c30d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.089+0000 7fd7faffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 1 -- 172.21.15.133:0/4005950349 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8100b6650 con 0x55d6f2da8c80 2023-12-18T10:24:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 1 -- 172.21.15.133:0/4005950349 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd8100ba070 con 0x55d6f2da8c80 2023-12-18T10:24:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 -- 172.21.15.133:0/4005950349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6f2b6b120 con 0x55d6f2da8c80 2023-12-18T10:24:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 1 -- 172.21.15.133:0/4005950349 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8100b67b0 con 0x55d6f2da8c80 2023-12-18T10:24:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 10 client.8727 fetch_fsmap learned FSMap version 95 2023-12-18T10:24:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 -- 172.21.15.133:0/4005950349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x55d6f2b73250 con 0x55d6f2da8c80 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 1 -- 172.21.15.133:0/4005950349 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6f2b6b120 con 0x55d6f2da8c80 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 1 -- 172.21.15.133:0/4005950349 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 95) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fd8100b6910 con 0x55d6f2da8c80 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 10 client.8727 fetch_fsmap finished waiting for FSMap version 95 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 10 client.8727 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 20 client.8727 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55d6f2db8840 0x55d6f2dbac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 4 client.8727 mds_command: new command op to 8127 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 -- 172.21.15.133:0/4005950349 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6f2bacc70 con 0x55d6f2db8840 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd81bfff640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55d6f2db8840 0x55d6f2dbac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd81bfff640 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55d6f2db8840 0x55d6f2dbac30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2b976f0117cfc7c server_cookie=4ca0be24e7c53ae5 in_seq=0 out_seq=0 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 10 client.8727 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 1 -- 172.21.15.133:0/4005950349 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55d6f2bacc70 con 0x55d6f2db8840 2023-12-18T10:24:49.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 10 client.8727 handle_command_reply: tid=0 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 client.8727 shutdown 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 -- 172.21.15.133:0/4005950349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2da8c80 msgr2=0x55d6f2da9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2da8c80 0x55d6f2da9ec0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd8100ae040 tx=0x7fd81001c3b0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 -- 172.21.15.133:0/4005950349 shutdown_connections 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55d6f2db8840 0x55d6f2dbac30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da95a0 0x55d6f2daa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2da8c80 0x55d6f2da9ec0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 --2- 172.21.15.133:0/4005950349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2d5efc0 0x55d6f2da9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd7faffd640 0 client.8727 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 -- 172.21.15.133:0/4005950349 >> 172.21.15.133:0/4005950349 conn(0x55d6f2b5d910 msgr2=0x55d6f2d5da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 -- 172.21.15.133:0/4005950349 shutdown_connections 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 1 -- 172.21.15.133:0/4005950349 wait complete. 2023-12-18T10:24:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.093+0000 7fd825aef000 20 client.8727 trim_cache size 0 max 16384 2023-12-18T10:24:49.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 Processor -- start 2023-12-18T10:24:49.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- start start 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2dbbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 0x55d6f2dbc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 0x55d6f2da2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f286baa0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2bb0e80 con 0x55d6f2da8c80 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2bf14d0 con 0x55d6f2da95a0 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2dbbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2dbbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33722/0 (socket says 172.21.15.133:33722) 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 -- 172.21.15.133:0/1904033817 learned_addr learned my addr 172.21.15.133:0/1904033817 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 -- 172.21.15.133:0/1904033817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 msgr2=0x55d6f2da2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 --2- 172.21.15.133:0/1904033817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 0x55d6f2da2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 -- 172.21.15.133:0/1904033817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 msgr2=0x55d6f2dbc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 --2- 172.21.15.133:0/1904033817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 0x55d6f2dbc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 -- 172.21.15.133:0/1904033817 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6f2b595a0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd81bfff640 1 --2- 172.21.15.133:0/1904033817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2dbbc40 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fd80c080bd0 tx=0x7fd80c082040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6918905f72fc4e27 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd8027fc640 1 -- 172.21.15.133:0/1904033817 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c080c50 con 0x55d6f2d5efc0 2023-12-18T10:24:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd8027fc640 1 -- 172.21.15.133:0/1904033817 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c052170 con 0x55d6f2d5efc0 2023-12-18T10:24:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd8027fc640 1 -- 172.21.15.133:0/1904033817 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0504e0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- 172.21.15.133:0/1904033817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 msgr2=0x55d6f2dbbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 --2- 172.21.15.133:0/1904033817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2dbbc40 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fd80c080bd0 tx=0x7fd80c082040 comp rx=0 tx=0).stop 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- 172.21.15.133:0/1904033817 shutdown_connections 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 --2- 172.21.15.133:0/1904033817 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 0x55d6f2da2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 --2- 172.21.15.133:0/1904033817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 0x55d6f2dbc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 --2- 172.21.15.133:0/1904033817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2dbbc40 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- 172.21.15.133:0/1904033817 >> 172.21.15.133:0/1904033817 conn(0x55d6f2b5d910 msgr2=0x55d6f2d64220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- 172.21.15.133:0/1904033817 shutdown_connections 2023-12-18T10:24:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- 172.21.15.133:0/1904033817 wait complete. 2023-12-18T10:24:49.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.109+0000 7fd825aef000 1 -- start start 2023-12-18T10:24:49.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 Processor -- start 2023-12-18T10:24:49.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2e044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 0x55d6f2e04a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 0x55d6f2e04f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2bab720 con 0x55d6f2d5efc0 2023-12-18T10:24:49.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2ba9c90 con 0x55d6f2da8c80 2023-12-18T10:24:49.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6f2b742c0 con 0x55d6f2da95a0 2023-12-18T10:24:49.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 10 client.0 _ll_register_callbacks cb 0x55d6f2b65710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2e044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2e044d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33724/0 (socket says 172.21.15.133:33724) 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 -- 172.21.15.133:0/2643320450 learned_addr learned my addr 172.21.15.133:0/2643320450 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 0x55d6f2e04a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd820d2c640 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 0x55d6f2e04f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 -- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 msgr2=0x55d6f2e04f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 0x55d6f2e04f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 -- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 msgr2=0x55d6f2e04a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 0x55d6f2e04a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 -- 172.21.15.133:0/2643320450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81c0cc5a0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 0x55d6f2e04a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81bfff640 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2e044d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0502d0 tx=0x7fd8100a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777340eb018ac7b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 1 -- 172.21.15.133:0/2643320450 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c05b870 con 0x55d6f2d5efc0 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 1 -- 172.21.15.133:0/2643320450 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd80c05b9d0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 -- 172.21.15.133:0/2643320450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6f2d62940 con 0x55d6f2d5efc0 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 1 -- 172.21.15.133:0/2643320450 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd80c071bd0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 10 client.8733 fetch_fsmap learned FSMap version 95 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 -- 172.21.15.133:0/2643320450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) v3 -- 0x55d6f2b4d110 con 0x55d6f2d5efc0 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 1 -- 172.21.15.133:0/2643320450 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6f2d62940 con 0x55d6f2d5efc0 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 1 -- 172.21.15.133:0/2643320450 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 95) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fd80c04fbc0 con 0x55d6f2d5efc0 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 10 client.8733 fetch_fsmap finished waiting for FSMap version 95 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 10 client.8733 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 20 client.8733 populate_metadata read hostname 'smithi133' 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55d6f2e02950 0x55d6f2e02d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 4 client.8733 mds_command: new command op to 8127 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 -- 172.21.15.133:0/2643320450 --> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d6f2b776a0 con 0x55d6f2e02950 2023-12-18T10:24:49.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55d6f2e02950 0x55d6f2e02d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd81b7fe640 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55d6f2e02950 0x55d6f2e02d60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f7e010c74f70b40 server_cookie=3bd89935a303ac4c in_seq=0 out_seq=0 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 10 client.8733 ms_handle_connect on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 1 -- 172.21.15.133:0/2643320450 <== mds.0 v2:172.21.15.133:6836/2531300469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55d6f2b776a0 con 0x55d6f2e02950 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd7faffd640 10 client.8733 handle_command_reply: tid=0 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.113+0000 7fd825aef000 1 client.8733 shutdown 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 -- 172.21.15.133:0/2643320450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 msgr2=0x55d6f2e044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2e044d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0502d0 tx=0x7fd8100a6000 comp rx=0 tx=0).stop 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 -- 172.21.15.133:0/2643320450 shutdown_connections 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.133:6836/2531300469,v1:172.21.15.133:6837/2531300469] conn(0x55d6f2e02950 0x55d6f2e02d60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d6f2da95a0 0x55d6f2e04f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6f2da8c80 0x55d6f2e04a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 --2- 172.21.15.133:0/2643320450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d6f2d5efc0 0x55d6f2e044d0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 -- 172.21.15.133:0/2643320450 >> 172.21.15.133:0/2643320450 conn(0x55d6f2b5d910 msgr2=0x55d6f2dbac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd7faffd640 0 client.8733 ms_handle_reset on v2:172.21.15.133:6836/2531300469 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 -- 172.21.15.133:0/2643320450 shutdown_connections 2023-12-18T10:24:49.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 1 -- 172.21.15.133:0/2643320450 wait complete. 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd825aef000 20 client.8733 trim_cache size 0 max 16384 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "6c914697-d827-4ecd-9e50-1715a20121d0": { 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "6c914697-d827-4ecd-9e50-1715a20121d0", 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:24:49.120 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:24:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 -- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd808065a60 msgr2=0x7fd808067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd808065a60 0x7fd808067f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd8100ad000 tx=0x7fd810004740 comp rx=0 tx=0).stop 2023-12-18T10:24:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 -- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd81c0cde90 msgr2=0x7fd81c151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd81c0cde90 0x7fd81c151530 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00c420 tx=0x7fd80c00c8e0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 -- 172.21.15.133:0/3418939162 shutdown_connections 2023-12-18T10:24:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd808065a60 0x7fd808067f20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd81c15cae0 0x7fd81c0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd81c0cf170 0x7fd81c0b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 --2- 172.21.15.133:0/3418939162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd81c0cde90 0x7fd81c151530 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 -- 172.21.15.133:0/3418939162 >> 172.21.15.133:0/3418939162 conn(0x7fd81c089fb0 msgr2=0x7fd81c0d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 -- 172.21.15.133:0/3418939162 shutdown_connections 2023-12-18T10:24:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.117+0000 7fd82278f640 1 -- 172.21.15.133:0/3418939162 wait complete. 2023-12-18T10:24:49.135 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:24:49.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:49.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.273+0000 7f340298f640 1 Processor -- start 2023-12-18T10:24:49.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.273+0000 7f340298f640 1 -- start start 2023-12-18T10:24:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.273+0000 7f340298f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33fc158c20 0x7f33fc070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.273+0000 7f340298f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc15c800 0x7f33fc0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f340298f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc0cb440 con 0x7f33fc0cafb0 2023-12-18T10:24:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f340298f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc070b80 con 0x7f33fc158c20 2023-12-18T10:24:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f340298f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc070e60 con 0x7f33fc15c800 2023-12-18T10:24:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33fc158c20 0x7f33fc070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33fc158c20 0x7f33fc070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33726/0 (socket says 172.21.15.133:33726) 2023-12-18T10:24:49.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fbfff640 1 -- 172.21.15.133:0/1891679838 learned_addr learned my addr 172.21.15.133:0/1891679838 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fb7fe640 1 --2- 172.21.15.133:0/1891679838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc15c800 0x7f33fc0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fbfff640 1 -- 172.21.15.133:0/1891679838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc15c800 msgr2=0x7f33fc0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fbfff640 1 --2- 172.21.15.133:0/1891679838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc15c800 0x7f33fc0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fbfff640 1 -- 172.21.15.133:0/1891679838 >> v1:172.21.15.142:6789/0 conn(0x7f33fc0cafb0 legacy=0x7f33fc06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fbfff640 1 -- 172.21.15.133:0/1891679838 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc071140 con 0x7f33fc158c20 2023-12-18T10:24:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.277+0000 7f33fbfff640 1 --2- 172.21.15.133:0/1891679838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc070510 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009870 tx=0x7f33ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481b9db3f9b00298 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f33faffd640 1 -- 172.21.15.133:0/1891679838 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0ab600 con 0x7f33fc158c20 2023-12-18T10:24:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f33faffd640 1 -- 172.21.15.133:0/1891679838 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec0a7050 con 0x7f33fc158c20 2023-12-18T10:24:49.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f33faffd640 1 -- 172.21.15.133:0/1891679838 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0ab980 con 0x7f33fc158c20 2023-12-18T10:24:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- 172.21.15.133:0/1891679838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 msgr2=0x7f33fc070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 --2- 172.21.15.133:0/1891679838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc070510 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009870 tx=0x7f33ec01c480 comp rx=0 tx=0).stop 2023-12-18T10:24:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- 172.21.15.133:0/1891679838 shutdown_connections 2023-12-18T10:24:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 --2- 172.21.15.133:0/1891679838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc15c800 0x7f33fc0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 --2- 172.21.15.133:0/1891679838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc070510 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- 172.21.15.133:0/1891679838 >> 172.21.15.133:0/1891679838 conn(0x7f33fc06a3e0 msgr2=0x7f33fc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- 172.21.15.133:0/1891679838 shutdown_connections 2023-12-18T10:24:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- 172.21.15.133:0/1891679838 wait complete. 2023-12-18T10:24:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 Processor -- start 2023-12-18T10:24:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- start start 2023-12-18T10:24:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc0cafb0 0x7f33fc0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc1473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc15c800 0x7f33fc1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0b2440 con 0x7f33fc158c20 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc145d60 con 0x7f33fc15c800 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f340298f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc146040 con 0x7f33fc0cafb0 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.281+0000 7f33fb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc1473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc1473a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33728/0 (socket says 172.21.15.133:33728) 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fb7fe640 1 -- 172.21.15.133:0/1934492976 learned_addr learned my addr 172.21.15.133:0/1934492976 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fbfff640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc0cafb0 0x7f33fc0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f3400f2c640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc15c800 0x7f33fc1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fb7fe640 1 -- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc0cafb0 msgr2=0x7f33fc0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fb7fe640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc0cafb0 0x7f33fc0b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fb7fe640 1 -- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc15c800 msgr2=0x7f33fc1478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fb7fe640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc15c800 0x7f33fc1478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fb7fe640 1 -- 172.21.15.133:0/1934492976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0094d0 con 0x7f33fc158c20 2023-12-18T10:24:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f3400f2c640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc15c800 0x7f33fc1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fb7fe640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc1473a0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f33f000e930 tx=0x7f33f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33f8ff9640 1 -- 172.21.15.133:0/1934492976 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0009690 con 0x7f33fc158c20 2023-12-18T10:24:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33f8ff9640 1 -- 172.21.15.133:0/1934492976 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f000ca00 con 0x7f33fc158c20 2023-12-18T10:24:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33f8ff9640 1 -- 172.21.15.133:0/1934492976 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f000cd70 con 0x7f33fc158c20 2023-12-18T10:24:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc0c8800 con 0x7f33fc158c20 2023-12-18T10:24:49.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc0b20d0 con 0x7f33fc158c20 2023-12-18T10:24:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc0735b0 con 0x7f33fc158c20 2023-12-18T10:24:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33f8ff9640 1 -- 172.21.15.133:0/1934492976 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f33f0013470 con 0x7f33fc158c20 2023-12-18T10:24:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33f8ff9640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33e8065a60 0x7f33e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33f8ff9640 1 -- 172.21.15.133:0/1934492976 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f33f0083550 con 0x7f33fc158c20 2023-12-18T10:24:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.285+0000 7f33fbfff640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33e8065a60 0x7f33e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.289+0000 7f33fbfff640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33e8065a60 0x7f33e8067f20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0ad000 tx=0x7f33ec0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.289+0000 7f33f8ff9640 1 -- 172.21.15.133:0/1934492976 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f33f0050eb0 con 0x7f33fc158c20 2023-12-18T10:24:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.469+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33fc1f4a40 con 0x7f33fc158c20 2023-12-18T10:24:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.469+0000 7f33f8ff9640 1 -- 172.21.15.133:0/1934492976 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f33f00544d0 con 0x7f33fc158c20 2023-12-18T10:24:49.471 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:49.471 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33e8065a60 msgr2=0x7f33e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33e8065a60 0x7f33e8067f20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f33ec0ad000 tx=0x7f33ec0a6000 comp rx=0 tx=0).stop 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 msgr2=0x7f33fc1473a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc1473a0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f33f000e930 tx=0x7f33f000edf0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 shutdown_connections 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f33e8065a60 0x7f33e8067f20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33fc15c800 0x7f33fc1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33fc158c20 0x7f33fc1473a0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 --2- 172.21.15.133:0/1934492976 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33fc0cafb0 0x7f33fc0b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 >> 172.21.15.133:0/1934492976 conn(0x7f33fc06a3e0 msgr2=0x7f33fc0af200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 shutdown_connections 2023-12-18T10:24:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.473+0000 7f340298f640 1 -- 172.21.15.133:0/1934492976 wait complete. 2023-12-18T10:24:49.492 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:49.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:49.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.629+0000 7f0440666640 1 Processor -- start 2023-12-18T10:24:49.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.629+0000 7f0440666640 1 -- start start 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f0440666640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 0x7f043806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f0440666640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f043806c320 0x7f04380c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f0440666640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04380c9460 con 0x7f04380c9e30 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f0440666640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043806c7a0 con 0x7f043806c320 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f0440666640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04381574a0 con 0x7f04381570c0 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043ec03640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f04380c9e30 0x7f043815d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49932/0 (socket says 172.21.15.133:49932) 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043ec03640 1 -- 172.21.15.133:0/904277991 learned_addr learned my addr 172.21.15.133:0/904277991 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043e402640 1 --2- 172.21.15.133:0/904277991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 0x7f043806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043dc01640 1 --2- 172.21.15.133:0/904277991 >> v2:172.21.15.142:3300/0 conn(0x7f043806c320 0x7f04380c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043d400640 1 -- 172.21.15.133:0/904277991 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537816975 0 0) 0x7f04380c9460 con 0x7f04380c9e30 2023-12-18T10:24:49.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043d400640 1 -- 172.21.15.133:0/904277991 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0424003530 con 0x7f04380c9e30 2023-12-18T10:24:49.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043dc01640 1 -- 172.21.15.133:0/904277991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 msgr2=0x7f043806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:49.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043dc01640 1 --2- 172.21.15.133:0/904277991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 0x7f043806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043dc01640 1 -- 172.21.15.133:0/904277991 >> v1:172.21.15.133:6789/0 conn(0x7f04380c9e30 legacy=0x7f043815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.633+0000 7f043dc01640 1 -- 172.21.15.133:0/904277991 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04380c8b30 con 0x7f043806c320 2023-12-18T10:24:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f043dc01640 1 --2- 172.21.15.133:0/904277991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f043806c320 0x7f04380c98f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f04280097c0 tx=0x7f042801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8a407b7ef84250 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f043d400640 1 -- 172.21.15.133:0/904277991 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04280ab600 con 0x7f043806c320 2023-12-18T10:24:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f043d400640 1 -- 172.21.15.133:0/904277991 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04280a7050 con 0x7f043806c320 2023-12-18T10:24:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f043d400640 1 -- 172.21.15.133:0/904277991 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04280ab980 con 0x7f043806c320 2023-12-18T10:24:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f0440666640 1 -- 172.21.15.133:0/904277991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f043806c320 msgr2=0x7f04380c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f0440666640 1 --2- 172.21.15.133:0/904277991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f043806c320 0x7f04380c98f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f04280097c0 tx=0x7f042801c3c0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f0440666640 1 -- 172.21.15.133:0/904277991 shutdown_connections 2023-12-18T10:24:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f0440666640 1 --2- 172.21.15.133:0/904277991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f043806c320 0x7f04380c98f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f0440666640 1 --2- 172.21.15.133:0/904277991 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 0x7f043806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f0440666640 1 -- 172.21.15.133:0/904277991 >> 172.21.15.133:0/904277991 conn(0x7f043806a3e0 msgr2=0x7f04380afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f0440666640 1 -- 172.21.15.133:0/904277991 shutdown_connections 2023-12-18T10:24:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.637+0000 7f0440666640 1 -- 172.21.15.133:0/904277991 wait complete. 2023-12-18T10:24:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 Processor -- start 2023-12-18T10:24:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 -- start start 2023-12-18T10:24:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f043806c320 0x7f0438152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04380c9e30 0x7f04381f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 0x7f04381575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04380cb2f0 con 0x7f043806c320 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04381f5b20 con 0x7f04380c9e30 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04381f5560 con 0x7f04381570c0 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f043806c320 0x7f0438152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f043806c320 0x7f0438152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33732/0 (socket says 172.21.15.133:33732) 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 -- 172.21.15.133:0/2981406877 learned_addr learned my addr 172.21.15.133:0/2981406877 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043dc01640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04380c9e30 0x7f04381f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043ec03640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 0x7f04381575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 -- 172.21.15.133:0/2981406877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 msgr2=0x7f04381575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 0x7f04381575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 -- 172.21.15.133:0/2981406877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04380c9e30 msgr2=0x7f04381f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04380c9e30 0x7f04381f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 -- 172.21.15.133:0/2981406877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0428009420 con 0x7f043806c320 2023-12-18T10:24:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f043e402640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f043806c320 0x7f0438152500 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f043400e930 tx=0x7f043400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f042effd640 1 -- 172.21.15.133:0/2981406877 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434009690 con 0x7f043806c320 2023-12-18T10:24:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f042effd640 1 -- 172.21.15.133:0/2981406877 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043400ca00 con 0x7f043806c320 2023-12-18T10:24:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f042effd640 1 -- 172.21.15.133:0/2981406877 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400cd70 con 0x7f043806c320 2023-12-18T10:24:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04381f5840 con 0x7f043806c320 2023-12-18T10:24:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0438152a40 con 0x7f043806c320 2023-12-18T10:24:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.641+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04380735b0 con 0x7f043806c320 2023-12-18T10:24:49.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.645+0000 7f042effd640 1 -- 172.21.15.133:0/2981406877 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0434013470 con 0x7f043806c320 2023-12-18T10:24:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.645+0000 7f042effd640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f041c065a60 0x7f041c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.645+0000 7f042effd640 1 -- 172.21.15.133:0/2981406877 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f0434083530 con 0x7f043806c320 2023-12-18T10:24:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.645+0000 7f043dc01640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f041c065a60 0x7f041c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.645+0000 7f043dc01640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f041c065a60 0x7f041c067f20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f04280ad000 tx=0x7f0428008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:49.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.649+0000 7f042effd640 1 -- 172.21.15.133:0/2981406877 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0434050e90 con 0x7f043806c320 2023-12-18T10:24:49.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.849+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f04380cb560 con 0x7f043806c320 2023-12-18T10:24:49.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.849+0000 7f042effd640 1 -- 172.21.15.133:0/2981406877 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1965 (secure 0 0 0) 0x7f04340544b0 con 0x7f043806c320 2023-12-18T10:24:49.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:49.851 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":429,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695325,"bytes_used":264871936,"bytes_avail":772829241344,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7678,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2023-12-18T10:24:47.182262+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:49.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f041c065a60 msgr2=0x7f041c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f041c065a60 0x7f041c067f20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f04280ad000 tx=0x7f0428008040 comp rx=0 tx=0).stop 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f043806c320 msgr2=0x7f0438152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f043806c320 0x7f0438152500 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f043400e930 tx=0x7f043400edf0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 shutdown_connections 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f041c065a60 0x7f041c067f20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04381570c0 0x7f04381575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04380c9e30 0x7f04381f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 --2- 172.21.15.133:0/2981406877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f043806c320 0x7f0438152500 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 >> 172.21.15.133:0/2981406877 conn(0x7f043806a3e0 msgr2=0x7f04380c1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 shutdown_connections 2023-12-18T10:24:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:49.853+0000 7f0440666640 1 -- 172.21.15.133:0/2981406877 wait complete. 2023-12-18T10:24:49.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'b': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:24:50.872 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:51.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f80286f9640 1 Processor -- start 2023-12-18T10:24:51.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f80286f9640 1 -- start start 2023-12-18T10:24:51.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f80286f9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80200cf530 0x7f8020168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f80286f9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80200d11c0 con 0x7f802015ca40 2023-12-18T10:24:51.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f80286f9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80200d0310 con 0x7f80200cf0d0 2023-12-18T10:24:51.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f80286f9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200d05b0 con 0x7f80200cf530 2023-12-18T10:24:51.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f8026495640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f802015ca40 0x7f80200cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59554/0 (socket says 172.21.15.133:59554) 2023-12-18T10:24:51.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f8026495640 1 -- 172.21.15.133:0/850046283 learned_addr learned my addr 172.21.15.133:0/850046283 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:51.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f8026c96640 1 --2- 172.21.15.133:0/850046283 >> v2:172.21.15.133:3300/0 conn(0x7f80200cf530 0x7f8020168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f8025493640 1 -- 172.21.15.133:0/850046283 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868869072 0 0) 0x7f80200d11c0 con 0x7f802015ca40 2023-12-18T10:24:51.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f8025493640 1 -- 172.21.15.133:0/850046283 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f800c003530 con 0x7f802015ca40 2023-12-18T10:24:51.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f8026c96640 1 -- 172.21.15.133:0/850046283 >> v1:172.21.15.142:6789/0 conn(0x7f80200cf0d0 legacy=0x7f80201648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f8026c96640 1 -- 172.21.15.133:0/850046283 >> v1:172.21.15.133:6789/0 conn(0x7f802015ca40 legacy=0x7f80200cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.017+0000 7f8026c96640 1 -- 172.21.15.133:0/850046283 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80200d0890 con 0x7f80200cf530 2023-12-18T10:24:51.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f8026c96640 1 --2- 172.21.15.133:0/850046283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf530 0x7f8020168000 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f8018009d90 tx=0x7f801801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8ca2cb41f800f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:51.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f8025493640 1 -- 172.21.15.133:0/850046283 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180a59e0 con 0x7f80200cf530 2023-12-18T10:24:51.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f8025493640 1 -- 172.21.15.133:0/850046283 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80180a5b40 con 0x7f80200cf530 2023-12-18T10:24:51.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f8025493640 1 -- 172.21.15.133:0/850046283 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80180ad440 con 0x7f80200cf530 2023-12-18T10:24:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f80286f9640 1 -- 172.21.15.133:0/850046283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf530 msgr2=0x7f8020168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f80286f9640 1 --2- 172.21.15.133:0/850046283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf530 0x7f8020168000 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f8018009d90 tx=0x7f801801c920 comp rx=0 tx=0).stop 2023-12-18T10:24:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f80286f9640 1 -- 172.21.15.133:0/850046283 shutdown_connections 2023-12-18T10:24:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f80286f9640 1 --2- 172.21.15.133:0/850046283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf530 0x7f8020168000 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f80286f9640 1 -- 172.21.15.133:0/850046283 >> 172.21.15.133:0/850046283 conn(0x7f8020089fb0 msgr2=0x7f80200d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f80286f9640 1 -- 172.21.15.133:0/850046283 shutdown_connections 2023-12-18T10:24:51.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.021+0000 7f80286f9640 1 -- 172.21.15.133:0/850046283 wait complete. 2023-12-18T10:24:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 Processor -- start 2023-12-18T10:24:51.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 -- start start 2023-12-18T10:24:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf0d0 0x7f8020151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80200cf530 0x7f80201532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802015ca40 0x7f80200c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020152ea0 con 0x7f80200cf0d0 2023-12-18T10:24:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020151f40 con 0x7f802015ca40 2023-12-18T10:24:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8020152220 con 0x7f80200cf530 2023-12-18T10:24:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf0d0 0x7f8020151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf0d0 0x7f8020151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54444/0 (socket says 172.21.15.133:54444) 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 -- 172.21.15.133:0/2652672422 learned_addr learned my addr 172.21.15.133:0/2652672422 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026c96640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802015ca40 0x7f80200c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 -- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80200cf530 msgr2=0x7f80201532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8025c94640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80200cf530 0x7f80201532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80200cf530 0x7f80201532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 -- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802015ca40 msgr2=0x7f80200c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802015ca40 0x7f80200c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 -- 172.21.15.133:0/2652672422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009a70 con 0x7f80200cf0d0 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026c96640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802015ca40 0x7f80200c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8025c94640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80200cf530 0x7f80201532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8026495640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf0d0 0x7f8020151000 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f801c001270 tx=0x7f801c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8016ffd640 1 -- 172.21.15.133:0/2652672422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c007270 con 0x7f80200cf0d0 2023-12-18T10:24:51.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8016ffd640 1 -- 172.21.15.133:0/2652672422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c0073d0 con 0x7f80200cf0d0 2023-12-18T10:24:51.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8020152500 con 0x7f80200cf0d0 2023-12-18T10:24:51.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f8016ffd640 1 -- 172.21.15.133:0/2652672422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00ce50 con 0x7f80200cf0d0 2023-12-18T10:24:51.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.025+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8020152ac0 con 0x7f80200cf0d0 2023-12-18T10:24:51.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.029+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802004e000 con 0x7f80200cf0d0 2023-12-18T10:24:51.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.029+0000 7f8016ffd640 1 -- 172.21.15.133:0/2652672422 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f801c0057b0 con 0x7f80200cf0d0 2023-12-18T10:24:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.029+0000 7f8016ffd640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8004065a60 0x7f8004067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.029+0000 7f8016ffd640 1 -- 172.21.15.133:0/2652672422 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f801c082990 con 0x7f80200cf0d0 2023-12-18T10:24:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.029+0000 7f8025c94640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8004065a60 0x7f8004067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.029+0000 7f8025c94640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8004065a60 0x7f8004067f20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f80201678e0 tx=0x7f8010009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:51.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.033+0000 7f8016ffd640 1 -- 172.21.15.133:0/2652672422 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f801c053c10 con 0x7f80200cf0d0 2023-12-18T10:24:51.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.217+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f802006cc80 con 0x7f80200cf0d0 2023-12-18T10:24:51.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.217+0000 7f8016ffd640 1 -- 172.21.15.133:0/2652672422 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f801c017070 con 0x7f80200cf0d0 2023-12-18T10:24:51.218 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:51.218 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:51.218 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8004065a60 msgr2=0x7f8004067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8004065a60 0x7f8004067f20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f80201678e0 tx=0x7f8010009040 comp rx=0 tx=0).stop 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf0d0 msgr2=0x7f8020151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf0d0 0x7f8020151000 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f801c001270 tx=0x7f801c00cb10 comp rx=0 tx=0).stop 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 shutdown_connections 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8004065a60 0x7f8004067f20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f802015ca40 0x7f80200c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80200cf530 0x7f80201532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 --2- 172.21.15.133:0/2652672422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80200cf0d0 0x7f8020151000 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 >> 172.21.15.133:0/2652672422 conn(0x7f8020089fb0 msgr2=0x7f8020154340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 shutdown_connections 2023-12-18T10:24:51.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.221+0000 7f80286f9640 1 -- 172.21.15.133:0/2652672422 wait complete. 2023-12-18T10:24:51.241 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:51.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:51.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdfd39640 1 Processor -- start 2023-12-18T10:24:51.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdfd39640 1 -- start start 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdfd39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd815a8a0 0x7f4cd80b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdfd39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4cd8069ca0 0x7f4cd806a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdfd39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4cd80cbc40 0x7f4cd80cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdfd39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd815ac80 con 0x7f4cd8069ca0 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdfd39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd8071ed0 con 0x7f4cd80cbc40 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdfd39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd806a620 con 0x7f4cd815a8a0 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdd2d4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4cd8069ca0 0x7f4cd806a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdd2d4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4cd8069ca0 0x7f4cd806a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54446/0 (socket says 172.21.15.133:54446) 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdd2d4640 1 -- 172.21.15.133:0/3961038388 learned_addr learned my addr 172.21.15.133:0/3961038388 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cddad5640 1 --2- 172.21.15.133:0/3961038388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd815a8a0 0x7f4cd80b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cde2d6640 1 --2- 172.21.15.133:0/3961038388 >> v2:172.21.15.142:3300/0 conn(0x7f4cd80cbc40 0x7f4cd80cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdd2d4640 1 -- 172.21.15.133:0/3961038388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd815a8a0 msgr2=0x7f4cd80b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:51.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.381+0000 7f4cdd2d4640 1 --2- 172.21.15.133:0/3961038388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd815a8a0 0x7f4cd80b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdd2d4640 1 -- 172.21.15.133:0/3961038388 >> v2:172.21.15.142:3300/0 conn(0x7f4cd80cbc40 msgr2=0x7f4cd80cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:51.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdd2d4640 1 --2- 172.21.15.133:0/3961038388 >> v2:172.21.15.142:3300/0 conn(0x7f4cd80cbc40 0x7f4cd80cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdd2d4640 1 -- 172.21.15.133:0/3961038388 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8072360 con 0x7f4cd8069ca0 2023-12-18T10:24:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdd2d4640 1 --2- 172.21.15.133:0/3961038388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd806a0e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8070e70 tx=0x7f4cc801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60938eefeccd8b09 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:51.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdcad3640 1 -- 172.21.15.133:0/3961038388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80a89b0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdcad3640 1 -- 172.21.15.133:0/3961038388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc80a8b10 con 0x7f4cd8069ca0 2023-12-18T10:24:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdcad3640 1 -- 172.21.15.133:0/3961038388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80a8ea0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdfd39640 1 -- 172.21.15.133:0/3961038388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 msgr2=0x7f4cd806a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/3961038388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd806a0e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8070e70 tx=0x7f4cc801ecf0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdfd39640 1 -- 172.21.15.133:0/3961038388 shutdown_connections 2023-12-18T10:24:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/3961038388 >> v2:172.21.15.142:3300/0 conn(0x7f4cd80cbc40 0x7f4cd80cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/3961038388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd806a0e0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/3961038388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd815a8a0 0x7f4cd80b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.385+0000 7f4cdfd39640 1 -- 172.21.15.133:0/3961038388 >> 172.21.15.133:0/3961038388 conn(0x7f4cd806cf80 msgr2=0x7f4cd806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 -- 172.21.15.133:0/3961038388 shutdown_connections 2023-12-18T10:24:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 -- 172.21.15.133:0/3961038388 wait complete. 2023-12-18T10:24:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 Processor -- start 2023-12-18T10:24:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 -- start start 2023-12-18T10:24:51.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd80ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd80cbc40 0x7f4cd80cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd815a8a0 0x7f4cd81e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80c79b0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80abde0 con 0x7f4cd815a8a0 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80c7680 con 0x7f4cd80cbc40 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd80ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd80ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54450/0 (socket says 172.21.15.133:54450) 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 -- 172.21.15.133:0/2795916093 learned_addr learned my addr 172.21.15.133:0/2795916093 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdd2d4640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd80cbc40 0x7f4cd80cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cde2d6640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd815a8a0 0x7f4cd81e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 -- 172.21.15.133:0/2795916093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd80cbc40 msgr2=0x7f4cd80cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd80cbc40 0x7f4cd80cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 -- 172.21.15.133:0/2795916093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd815a8a0 msgr2=0x7f4cd81e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd815a8a0 0x7f4cd81e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 -- 172.21.15.133:0/2795916093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc80094d0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cddad5640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd80ab8a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400e870 tx=0x7f4cd400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cce7fc640 1 -- 172.21.15.133:0/2795916093 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4009510 con 0x7f4cd8069ca0 2023-12-18T10:24:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cce7fc640 1 -- 172.21.15.133:0/2795916093 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd400eec0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cce7fc640 1 -- 172.21.15.133:0/2795916093 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400cb40 con 0x7f4cd8069ca0 2023-12-18T10:24:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.389+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd80cdb20 con 0x7f4cd8069ca0 2023-12-18T10:24:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.393+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd80ce0e0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.393+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd80c77f0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.393+0000 7f4cce7fc640 1 -- 172.21.15.133:0/2795916093 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4cd400cca0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.393+0000 7f4cce7fc640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4cbc065a60 0x7f4cbc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:51.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.393+0000 7f4cce7fc640 1 -- 172.21.15.133:0/2795916093 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4cd40833a0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.393+0000 7f4cdd2d4640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4cbc065a60 0x7f4cbc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:51.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.393+0000 7f4cdd2d4640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4cbc065a60 0x7f4cbc067f20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80b2000 tx=0x7f4cc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:51.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.397+0000 7f4cce7fc640 1 -- 172.21.15.133:0/2795916093 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4cd80c77f0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4cd80c77f0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cce7fc640 1 -- 172.21.15.133:0/2795916093 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2035 (secure 0 0 0) 0x7f4cd80c77f0 con 0x7f4cd8069ca0 2023-12-18T10:24:51.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:51.601 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":431,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":93},{"state_name":"peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700657,"bytes_used":264941568,"bytes_avail":772829171712,"bytes_total":773094113280,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2023-12-18T10:24:51.182909+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4cbc065a60 msgr2=0x7f4cbc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4cbc065a60 0x7f4cbc067f20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80b2000 tx=0x7f4cc8008040 comp rx=0 tx=0).stop 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 msgr2=0x7f4cd80ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd80ab8a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400e870 tx=0x7f4cd400ec70 comp rx=0 tx=0).stop 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 shutdown_connections 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4cbc065a60 0x7f4cbc067f20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4cd815a8a0 0x7f4cd81e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4cd80cbc40 0x7f4cd80cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 --2- 172.21.15.133:0/2795916093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd8069ca0 0x7f4cd80ab8a0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 >> 172.21.15.133:0/2795916093 conn(0x7f4cd806cf80 msgr2=0x7f4cd80b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 shutdown_connections 2023-12-18T10:24:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:51.601+0000 7f4cdfd39640 1 -- 172.21.15.133:0/2795916093 wait complete. 2023-12-18T10:24:51.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'b': 'idle+waiting paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:24:52.623 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.769+0000 7f6b5aeb6640 1 Processor -- start 2023-12-18T10:24:52.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.769+0000 7f6b5aeb6640 1 -- start start 2023-12-18T10:24:52.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.769+0000 7f6b5aeb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 0x7f6b54070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:52.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.769+0000 7f6b5aeb6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b540cb180 0x7f6b540ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:52.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.769+0000 7f6b5aeb6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b54070b80 con 0x7f6b5415c800 2023-12-18T10:24:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.769+0000 7f6b5aeb6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b54070e60 con 0x7f6b540cb180 2023-12-18T10:24:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.769+0000 7f6b5aeb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b54071140 con 0x7f6b54158c20 2023-12-18T10:24:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b59453640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b540cb180 0x7f6b540ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b59453640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b540cb180 0x7f6b540ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54452/0 (socket says 172.21.15.133:54452) 2023-12-18T10:24:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b59453640 1 -- 172.21.15.133:0/1968708074 learned_addr learned my addr 172.21.15.133:0/1968708074 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b58c52640 1 --2- 172.21.15.133:0/1968708074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 0x7f6b54070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:52.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b59453640 1 -- 172.21.15.133:0/1968708074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 msgr2=0x7f6b54070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b59453640 1 --2- 172.21.15.133:0/1968708074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 0x7f6b54070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b59453640 1 -- 172.21.15.133:0/1968708074 >> v1:172.21.15.142:6789/0 conn(0x7f6b5415c800 legacy=0x7f6b540caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:52.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b59453640 1 -- 172.21.15.133:0/1968708074 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54071420 con 0x7f6b540cb180 2023-12-18T10:24:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b59453640 1 --2- 172.21.15.133:0/1968708074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b540cb180 0x7f6b540ccc10 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009e50 tx=0x7f6b4c01e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a53ead46d8a68c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b4b7fe640 1 -- 172.21.15.133:0/1968708074 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0a68e0 con 0x7f6b540cb180 2023-12-18T10:24:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b4b7fe640 1 -- 172.21.15.133:0/1968708074 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c0a6a40 con 0x7f6b540cb180 2023-12-18T10:24:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.773+0000 7f6b4b7fe640 1 -- 172.21.15.133:0/1968708074 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0a6dd0 con 0x7f6b540cb180 2023-12-18T10:24:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/1968708074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b540cb180 msgr2=0x7f6b540ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/1968708074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b540cb180 0x7f6b540ccc10 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c009e50 tx=0x7f6b4c01e4c0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/1968708074 shutdown_connections 2023-12-18T10:24:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/1968708074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b540cb180 0x7f6b540ccc10 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/1968708074 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 0x7f6b54070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/1968708074 >> 172.21.15.133:0/1968708074 conn(0x7f6b5406a3e0 msgr2=0x7f6b540afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:52.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/1968708074 shutdown_connections 2023-12-18T10:24:52.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/1968708074 wait complete. 2023-12-18T10:24:52.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 Processor -- start 2023-12-18T10:24:52.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- start start 2023-12-18T10:24:52.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b540cb180 0x7f6b5414a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:52.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 0x7f6b5414bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b5415c800 0x7f6b540c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b541512a0 con 0x7f6b5415c800 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5414a730 con 0x7f6b540cb180 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b5aeb6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5414c140 con 0x7f6b54158c20 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.777+0000 7f6b59453640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b5415c800 0x7f6b540c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b58c52640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b540cb180 0x7f6b5414a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b58c52640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b540cb180 0x7f6b5414a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:33770/0 (socket says 172.21.15.133:33770) 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b58c52640 1 -- 172.21.15.133:0/3563553668 learned_addr learned my addr 172.21.15.133:0/3563553668 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b59453640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b5415c800 0x7f6b540c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54462/0 (socket says 172.21.15.133:54462) 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b4bfff640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 0x7f6b5414bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b59453640 1 -- 172.21.15.133:0/3563553668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 msgr2=0x7f6b5414bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b59453640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 0x7f6b5414bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b59453640 1 -- 172.21.15.133:0/3563553668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b540cb180 msgr2=0x7f6b5414a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b59453640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b540cb180 0x7f6b5414a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b59453640 1 -- 172.21.15.133:0/3563553668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c009b30 con 0x7f6b5415c800 2023-12-18T10:24:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b59453640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b5415c800 0x7f6b540c7d30 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0ac000 tx=0x7f6b4c01c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b497fa640 1 -- 172.21.15.133:0/3563553668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0bc070 con 0x7f6b5415c800 2023-12-18T10:24:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b497fa640 1 -- 172.21.15.133:0/3563553668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c009210 con 0x7f6b5415c800 2023-12-18T10:24:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b497fa640 1 -- 172.21.15.133:0/3563553668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c007820 con 0x7f6b5415c800 2023-12-18T10:24:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b540c8800 con 0x7f6b5415c800 2023-12-18T10:24:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b540c8270 con 0x7f6b5415c800 2023-12-18T10:24:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b540735b0 con 0x7f6b5415c800 2023-12-18T10:24:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b497fa640 1 -- 172.21.15.133:0/3563553668 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b4c007980 con 0x7f6b5415c800 2023-12-18T10:24:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b497fa640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b40065a60 0x7f6b40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.781+0000 7f6b497fa640 1 -- 172.21.15.133:0/3563553668 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f6b4c11dae0 con 0x7f6b5415c800 2023-12-18T10:24:52.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.785+0000 7f6b58c52640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b40065a60 0x7f6b40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:52.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.785+0000 7f6b58c52640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b40065a60 0x7f6b40067f20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009c20 tx=0x7f6b50009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:52.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.785+0000 7f6b497fa640 1 -- 172.21.15.133:0/3563553668 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b4c0eb380 con 0x7f6b5415c800 2023-12-18T10:24:52.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.969+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b5404e000 con 0x7f6b5415c800 2023-12-18T10:24:52.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.969+0000 7f6b497fa640 1 -- 172.21.15.133:0/3563553668 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f6b4c0ee9a0 con 0x7f6b5415c800 2023-12-18T10:24:52.970 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:52.970 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:52.970 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b40065a60 msgr2=0x7f6b40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b40065a60 0x7f6b40067f20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009c20 tx=0x7f6b50009190 comp rx=0 tx=0).stop 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b5415c800 msgr2=0x7f6b540c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b5415c800 0x7f6b540c7d30 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c0ac000 tx=0x7f6b4c01c2a0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 shutdown_connections 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b40065a60 0x7f6b40067f20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b5415c800 0x7f6b540c7d30 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b54158c20 0x7f6b5414bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 --2- 172.21.15.133:0/3563553668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b540cb180 0x7f6b5414a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:52.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 >> 172.21.15.133:0/3563553668 conn(0x7f6b5406a3e0 msgr2=0x7f6b540ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:52.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 shutdown_connections 2023-12-18T10:24:52.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:52.973+0000 7f6b5aeb6640 1 -- 172.21.15.133:0/3563553668 wait complete. 2023-12-18T10:24:52.991 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:52.991 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:53.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa4921e9640 1 Processor -- start 2023-12-18T10:24:53.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa4921e9640 1 -- start start 2023-12-18T10:24:53.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa4921e9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa48c1570c0 0x7fa48c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:53.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa4921e9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa48c0ca000 0x7fa48c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:53.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa4921e9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c0c9460 con 0x7fa48c06c320 2023-12-18T10:24:53.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa4921e9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c06c7a0 con 0x7fa48c0ca000 2023-12-18T10:24:53.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa4921e9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c1574a0 con 0x7fa48c1570c0 2023-12-18T10:24:53.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa48bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa48c0ca000 0x7fa48c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:53.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa48bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa48c0ca000 0x7fa48c070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54478/0 (socket says 172.21.15.133:54478) 2023-12-18T10:24:53.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa48bfff640 1 -- 172.21.15.133:0/1768521196 learned_addr learned my addr 172.21.15.133:0/1768521196 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:53.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa48b7fe640 1 --2- 172.21.15.133:0/1768521196 >> v2:172.21.15.142:3300/0 conn(0x7fa48c1570c0 0x7fa48c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:53.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa48bfff640 1 -- 172.21.15.133:0/1768521196 >> v2:172.21.15.142:3300/0 conn(0x7fa48c1570c0 msgr2=0x7fa48c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:53.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa48bfff640 1 --2- 172.21.15.133:0/1768521196 >> v2:172.21.15.142:3300/0 conn(0x7fa48c1570c0 0x7fa48c06bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa48bfff640 1 -- 172.21.15.133:0/1768521196 >> v1:172.21.15.142:6789/0 conn(0x7fa48c06c320 legacy=0x7fa48c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:53.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.129+0000 7fa48bfff640 1 -- 172.21.15.133:0/1768521196 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0c8b30 con 0x7fa48c0ca000 2023-12-18T10:24:53.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa48bfff640 1 --2- 172.21.15.133:0/1768521196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c0ca000 0x7fa48c070df0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fa48c06e280 tx=0x7fa48401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d466fc881b5369 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:53.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa48a7fc640 1 -- 172.21.15.133:0/1768521196 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840a57d0 con 0x7fa48c0ca000 2023-12-18T10:24:53.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa48a7fc640 1 -- 172.21.15.133:0/1768521196 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840a5930 con 0x7fa48c0ca000 2023-12-18T10:24:53.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa48a7fc640 1 -- 172.21.15.133:0/1768521196 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840a5cc0 con 0x7fa48c0ca000 2023-12-18T10:24:53.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa4921e9640 1 -- 172.21.15.133:0/1768521196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c0ca000 msgr2=0x7fa48c070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:53.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1768521196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c0ca000 0x7fa48c070df0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fa48c06e280 tx=0x7fa48401c910 comp rx=0 tx=0).stop 2023-12-18T10:24:53.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa4921e9640 1 -- 172.21.15.133:0/1768521196 shutdown_connections 2023-12-18T10:24:53.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1768521196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c0ca000 0x7fa48c070df0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1768521196 >> v2:172.21.15.142:3300/0 conn(0x7fa48c1570c0 0x7fa48c06bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa4921e9640 1 -- 172.21.15.133:0/1768521196 >> 172.21.15.133:0/1768521196 conn(0x7fa48c06a3e0 msgr2=0x7fa48c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:53.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa4921e9640 1 -- 172.21.15.133:0/1768521196 shutdown_connections 2023-12-18T10:24:53.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.133+0000 7fa4921e9640 1 -- 172.21.15.133:0/1768521196 wait complete. 2023-12-18T10:24:53.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 Processor -- start 2023-12-18T10:24:53.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 -- start start 2023-12-18T10:24:53.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c06c320 0x7fa48c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:53.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48c0ca000 0x7fa48c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c1570c0 0x7fa48c1f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c157b20 con 0x7fa48c06c320 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0c6da0 con 0x7fa48c1570c0 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c14c4d0 con 0x7fa48c0ca000 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c06c320 0x7fa48c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c06c320 0x7fa48c1575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54480/0 (socket says 172.21.15.133:54480) 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 -- 172.21.15.133:0/1671269871 learned_addr learned my addr 172.21.15.133:0/1671269871 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48bfff640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c1570c0 0x7fa48c1f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:53.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48affd640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48c0ca000 0x7fa48c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:53.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 -- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48c0ca000 msgr2=0x7fa48c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:53.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48c0ca000 0x7fa48c0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 -- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c1570c0 msgr2=0x7fa48c1f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:53.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c1570c0 0x7fa48c1f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 -- 172.21.15.133:0/1671269871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484009b30 con 0x7fa48c06c320 2023-12-18T10:24:53.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48bfff640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c1570c0 0x7fa48c1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:53.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa48b7fe640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c06c320 0x7fa48c1575e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00e930 tx=0x7fa47c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:53.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa473fff640 1 -- 172.21.15.133:0/1671269871 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c009690 con 0x7fa48c06c320 2023-12-18T10:24:53.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa473fff640 1 -- 172.21.15.133:0/1671269871 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00ca00 con 0x7fa48c06c320 2023-12-18T10:24:53.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa473fff640 1 -- 172.21.15.133:0/1671269871 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00cd70 con 0x7fa48c06c320 2023-12-18T10:24:53.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c14c7b0 con 0x7fa48c06c320 2023-12-18T10:24:53.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.137+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c14cd70 con 0x7fa48c06c320 2023-12-18T10:24:53.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.141+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c0735b0 con 0x7fa48c06c320 2023-12-18T10:24:53.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.141+0000 7fa473fff640 1 -- 172.21.15.133:0/1671269871 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa47c013470 con 0x7fa48c06c320 2023-12-18T10:24:53.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.141+0000 7fa473fff640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa478065a60 0x7fa478067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:53.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.141+0000 7fa473fff640 1 -- 172.21.15.133:0/1671269871 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fa47c0835c0 con 0x7fa48c06c320 2023-12-18T10:24:53.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.141+0000 7fa48affd640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa478065a60 0x7fa478067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:53.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.141+0000 7fa48affd640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa478065a60 0x7fa478067f20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa48c148f80 tx=0x7fa480009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:53.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.145+0000 7fa473fff640 1 -- 172.21.15.133:0/1671269871 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa47c050e90 con 0x7fa48c06c320 2023-12-18T10:24:53.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.353+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa48c04e000 con 0x7fa48c06c320 2023-12-18T10:24:53.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.353+0000 7fa473fff640 1 -- 172.21.15.133:0/1671269871 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1958 (secure 0 0 0) 0x7fa47c0544b0 con 0x7fa48c06c320 2023-12-18T10:24:53.355 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:53.355 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":433,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700657,"bytes_used":265076736,"bytes_avail":772829036544,"bytes_total":773094113280,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2023-12-18T10:24:51.182909+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa478065a60 msgr2=0x7fa478067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa478065a60 0x7fa478067f20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa48c148f80 tx=0x7fa480009040 comp rx=0 tx=0).stop 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c06c320 msgr2=0x7fa48c1575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c06c320 0x7fa48c1575e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00e930 tx=0x7fa47c00edf0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 shutdown_connections 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa478065a60 0x7fa478067f20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c1570c0 0x7fa48c1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa48c0ca000 0x7fa48c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 --2- 172.21.15.133:0/1671269871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa48c06c320 0x7fa48c1575e0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 >> 172.21.15.133:0/1671269871 conn(0x7fa48c06a3e0 msgr2=0x7fa48c14ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:53.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 shutdown_connections 2023-12-18T10:24:53.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:53.357+0000 7fa4921e9640 1 -- 172.21.15.133:0/1671269871 wait complete. 2023-12-18T10:24:53.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'b': 'idle+waiting paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:24:54.377 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:54.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f1805d98640 1 Processor -- start 2023-12-18T10:24:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f1805d98640 1 -- start start 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f1805d98640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18001570c0 0x7f180006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f1805d98640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ca000 0x7f1800070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f1805d98640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18000c9460 con 0x7f180006c320 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f1805d98640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180006c7a0 con 0x7f18001570c0 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f1805d98640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18001574a0 con 0x7f18000ca000 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f17ff7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18001570c0 0x7f180006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f17ff7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18001570c0 0x7f180006bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54492/0 (socket says 172.21.15.133:54492) 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f17ff7fe640 1 -- 172.21.15.133:0/1753150887 learned_addr learned my addr 172.21.15.133:0/1753150887 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.525+0000 7f17fffff640 1 --2- 172.21.15.133:0/1753150887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ca000 0x7f1800070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f17ff7fe640 1 -- 172.21.15.133:0/1753150887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ca000 msgr2=0x7f1800070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f17ff7fe640 1 --2- 172.21.15.133:0/1753150887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ca000 0x7f1800070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f17ff7fe640 1 -- 172.21.15.133:0/1753150887 >> v1:172.21.15.142:6789/0 conn(0x7f180006c320 legacy=0x7f18000c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f17ff7fe640 1 -- 172.21.15.133:0/1753150887 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000c8b30 con 0x7f18001570c0 2023-12-18T10:24:54.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f17ff7fe640 1 --2- 172.21.15.133:0/1753150887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18001570c0 0x7f180006bde0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009870 tx=0x7f17f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90195f4aa33ef2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f17fe7fc640 1 -- 172.21.15.133:0/1753150887 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00ab680 con 0x7f18001570c0 2023-12-18T10:24:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f17fe7fc640 1 -- 172.21.15.133:0/1753150887 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00ab7e0 con 0x7f18001570c0 2023-12-18T10:24:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f17fe7fc640 1 -- 172.21.15.133:0/1753150887 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00abb70 con 0x7f18001570c0 2023-12-18T10:24:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f1805d98640 1 -- 172.21.15.133:0/1753150887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18001570c0 msgr2=0x7f180006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.529+0000 7f1805d98640 1 --2- 172.21.15.133:0/1753150887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18001570c0 0x7f180006bde0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009870 tx=0x7f17f001c480 comp rx=0 tx=0).stop 2023-12-18T10:24:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 -- 172.21.15.133:0/1753150887 shutdown_connections 2023-12-18T10:24:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 --2- 172.21.15.133:0/1753150887 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18000ca000 0x7f1800070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 --2- 172.21.15.133:0/1753150887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18001570c0 0x7f180006bde0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 -- 172.21.15.133:0/1753150887 >> 172.21.15.133:0/1753150887 conn(0x7f180006a3e0 msgr2=0x7f18000afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 -- 172.21.15.133:0/1753150887 shutdown_connections 2023-12-18T10:24:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 -- 172.21.15.133:0/1753150887 wait complete. 2023-12-18T10:24:54.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 Processor -- start 2023-12-18T10:24:54.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 -- start start 2023-12-18T10:24:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180006c320 0x7f18000bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ca000 0x7f180015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18001570c0 0x7f18000cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1800159340 con 0x7f180006c320 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1800159620 con 0x7f18000ca000 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f1805d98640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1800159900 con 0x7f18001570c0 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180006c320 0x7f18000bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180006c320 0x7f18000bfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54494/0 (socket says 172.21.15.133:54494) 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 -- 172.21.15.133:0/2683643273 learned_addr learned my addr 172.21.15.133:0/2683643273 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17fffff640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18001570c0 0x7f18000cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17feffd640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ca000 0x7f180015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 -- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18001570c0 msgr2=0x7f18000cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18001570c0 0x7f18000cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 -- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ca000 msgr2=0x7f180015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ca000 0x7f180015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 -- 172.21.15.133:0/2683643273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00094d0 con 0x7f180006c320 2023-12-18T10:24:54.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17feffd640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ca000 0x7f180015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:54.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.533+0000 7f17ff7fe640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180006c320 0x7f18000bfe30 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f17f00ad040 tx=0x7f17f001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:54.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f17e7fff640 1 -- 172.21.15.133:0/2683643273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00ab680 con 0x7f180006c320 2023-12-18T10:24:54.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f17e7fff640 1 -- 172.21.15.133:0/2683643273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00b4820 con 0x7f180006c320 2023-12-18T10:24:54.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1800159be0 con 0x7f180006c320 2023-12-18T10:24:54.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f17e7fff640 1 -- 172.21.15.133:0/2683643273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00b4bd0 con 0x7f180006c320 2023-12-18T10:24:54.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18000c05a0 con 0x7f180006c320 2023-12-18T10:24:54.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18000735b0 con 0x7f180006c320 2023-12-18T10:24:54.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f17e7fff640 1 -- 172.21.15.133:0/2683643273 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f17f00b4d30 con 0x7f180006c320 2023-12-18T10:24:54.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f17e7fff640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f17ec065a60 0x7f17ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f17e7fff640 1 -- 172.21.15.133:0/2683643273 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f17f011e250 con 0x7f180006c320 2023-12-18T10:24:54.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f17feffd640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f17ec065a60 0x7f17ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.537+0000 7f17feffd640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f17ec065a60 0x7f17ec067f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f18000c7b50 tx=0x7f17f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:54.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.541+0000 7f17e7fff640 1 -- 172.21.15.133:0/2683643273 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f17f00eba40 con 0x7f180006c320 2023-12-18T10:24:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.721+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1800159480 con 0x7f180006c320 2023-12-18T10:24:54.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.721+0000 7f17e7fff640 1 -- 172.21.15.133:0/2683643273 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f1800159480 con 0x7f180006c320 2023-12-18T10:24:54.723 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:54.723 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:54.723 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:24:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f17ec065a60 msgr2=0x7f17ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f17ec065a60 0x7f17ec067f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f18000c7b50 tx=0x7f17f4009040 comp rx=0 tx=0).stop 2023-12-18T10:24:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180006c320 msgr2=0x7f18000bfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180006c320 0x7f18000bfe30 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f17f00ad040 tx=0x7f17f001acc0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 shutdown_connections 2023-12-18T10:24:54.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f17ec065a60 0x7f17ec067f20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f18001570c0 0x7f18000cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18000ca000 0x7f180015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 --2- 172.21.15.133:0/2683643273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f180006c320 0x7f18000bfe30 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 >> 172.21.15.133:0/2683643273 conn(0x7f180006a3e0 msgr2=0x7f180014df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 shutdown_connections 2023-12-18T10:24:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.725+0000 7f1805d98640 1 -- 172.21.15.133:0/2683643273 wait complete. 2023-12-18T10:24:54.744 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:54.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:54.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27f118f640 1 Processor -- start 2023-12-18T10:24:54.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27f118f640 1 -- start start 2023-12-18T10:24:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27f118f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27ec15ceb0 0x7f27ec06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27f118f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 0x7f27ec15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27f118f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec160e80 con 0x7f27ec0ce2c0 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27f118f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec161160 con 0x7f27ec15ceb0 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27f118f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec161440 con 0x7f27ec0cf2a0 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27e259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f27ec0ce2c0 0x7f27ec0ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59558/0 (socket says 172.21.15.133:59558) 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27e259c640 1 -- 172.21.15.133:0/2821179404 learned_addr learned my addr 172.21.15.133:0/2821179404 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27ead9d640 1 --2- 172.21.15.133:0/2821179404 >> v2:172.21.15.133:3300/0 conn(0x7f27ec15ceb0 0x7f27ec06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27eb59e640 1 --2- 172.21.15.133:0/2821179404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 0x7f27ec15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27ead9d640 1 -- 172.21.15.133:0/2821179404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 msgr2=0x7f27ec15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27ead9d640 1 --2- 172.21.15.133:0/2821179404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 0x7f27ec15d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27ead9d640 1 -- 172.21.15.133:0/2821179404 >> v1:172.21.15.133:6789/0 conn(0x7f27ec0ce2c0 legacy=0x7f27ec0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27ead9d640 1 -- 172.21.15.133:0/2821179404 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec161720 con 0x7f27ec15ceb0 2023-12-18T10:24:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.881+0000 7f27ea59c640 1 -- 172.21.15.133:0/2821179404 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389364139 0 0) 0x7f27ec160e80 con 0x7f27ec0ce2c0 2023-12-18T10:24:54.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27ead9d640 1 --2- 172.21.15.133:0/2821179404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec06b140 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f27d40097c0 tx=0x7f27d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e7d8c8d0f3d91f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:54.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27ea59c640 1 -- 172.21.15.133:0/2821179404 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40a6040 con 0x7f27ec15ceb0 2023-12-18T10:24:54.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27ea59c640 1 -- 172.21.15.133:0/2821179404 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec15d4a0 con 0x7f27ec15ceb0 2023-12-18T10:24:54.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27ea59c640 1 -- 172.21.15.133:0/2821179404 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40aa820 con 0x7f27ec15ceb0 2023-12-18T10:24:54.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27f118f640 1 -- 172.21.15.133:0/2821179404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 msgr2=0x7f27ec06b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27f118f640 1 --2- 172.21.15.133:0/2821179404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec06b140 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f27d40097c0 tx=0x7f27d401c480 comp rx=0 tx=0).stop 2023-12-18T10:24:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27f118f640 1 -- 172.21.15.133:0/2821179404 shutdown_connections 2023-12-18T10:24:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27f118f640 1 --2- 172.21.15.133:0/2821179404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 0x7f27ec15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27f118f640 1 --2- 172.21.15.133:0/2821179404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec06b140 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27f118f640 1 -- 172.21.15.133:0/2821179404 >> 172.21.15.133:0/2821179404 conn(0x7f27ec069ca0 msgr2=0x7f27ec06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27f118f640 1 -- 172.21.15.133:0/2821179404 shutdown_connections 2023-12-18T10:24:54.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.885+0000 7f27f118f640 1 -- 172.21.15.133:0/2821179404 wait complete. 2023-12-18T10:24:54.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 Processor -- start 2023-12-18T10:24:54.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 -- start start 2023-12-18T10:24:54.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27ec0ce2c0 0x7f27ec154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 0x7f27ec14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0c93d0 con 0x7f27ec15ceb0 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0c2510 con 0x7f27ec0ce2c0 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0c2a50 con 0x7f27ec0cf2a0 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec0cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54512/0 (socket says 172.21.15.133:54512) 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 -- 172.21.15.133:0/2838289421 learned_addr learned my addr 172.21.15.133:0/2838289421 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27ead9d640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27ec0ce2c0 0x7f27ec154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27e259c640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 0x7f27ec14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 -- 172.21.15.133:0/2838289421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 msgr2=0x7f27ec14c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 0x7f27ec14c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 -- 172.21.15.133:0/2838289421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27ec0ce2c0 msgr2=0x7f27ec154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27ec0ce2c0 0x7f27ec154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 -- 172.21.15.133:0/2838289421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d4009420 con 0x7f27ec15ceb0 2023-12-18T10:24:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27eb59e640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec0cbb20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f27e400ef90 tx=0x7f27e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27e3fff640 1 -- 172.21.15.133:0/2838289421 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4009ca0 con 0x7f27ec15ceb0 2023-12-18T10:24:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27e3fff640 1 -- 172.21.15.133:0/2838289421 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e400f040 con 0x7f27ec15ceb0 2023-12-18T10:24:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec0c2770 con 0x7f27ec15ceb0 2023-12-18T10:24:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27e3fff640 1 -- 172.21.15.133:0/2838289421 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40146c0 con 0x7f27ec15ceb0 2023-12-18T10:24:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.889+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec0c8ff0 con 0x7f27ec15ceb0 2023-12-18T10:24:54.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.893+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec0c8b70 con 0x7f27ec15ceb0 2023-12-18T10:24:54.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.893+0000 7f27e3fff640 1 -- 172.21.15.133:0/2838289421 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27e4014820 con 0x7f27ec15ceb0 2023-12-18T10:24:54.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.893+0000 7f27e3fff640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27cc065a60 0x7f27cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:54.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.893+0000 7f27e3fff640 1 -- 172.21.15.133:0/2838289421 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f27e4084200 con 0x7f27ec15ceb0 2023-12-18T10:24:54.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.893+0000 7f27ead9d640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27cc065a60 0x7f27cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:54.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.893+0000 7f27ead9d640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27cc065a60 0x7f27cc067f20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f27d40ae000 tx=0x7f27d40b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:54.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:54.897+0000 7f27e3fff640 1 -- 172.21.15.133:0/2838289421 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f27ec0c8b70 con 0x7f27ec15ceb0 2023-12-18T10:24:55.026 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:24:55.025+0000 7f3bac1eb640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-18T10:24:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.097+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f27ec0c9510 con 0x7f27ec15ceb0 2023-12-18T10:24:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27e3fff640 1 -- 172.21.15.133:0/2838289421 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1958 (secure 0 0 0) 0x7f27ec0c9510 con 0x7f27ec15ceb0 2023-12-18T10:24:55.100 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:55.100 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":435,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700657,"bytes_used":265076736,"bytes_avail":772829036544,"bytes_total":773094113280,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2023-12-18T10:24:51.182909+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:24:55.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27cc065a60 msgr2=0x7f27cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:55.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27cc065a60 0x7f27cc067f20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f27d40ae000 tx=0x7f27d40b5040 comp rx=0 tx=0).stop 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 msgr2=0x7f27ec0cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec0cbb20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f27e400ef90 tx=0x7f27e400c490 comp rx=0 tx=0).stop 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 shutdown_connections 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27cc065a60 0x7f27cc067f20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec15ceb0 0x7f27ec0cbb20 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27ec0cf2a0 0x7f27ec14c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 --2- 172.21.15.133:0/2838289421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27ec0ce2c0 0x7f27ec154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 >> 172.21.15.133:0/2838289421 conn(0x7f27ec069ca0 msgr2=0x7f27ec0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 shutdown_connections 2023-12-18T10:24:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:55.101+0000 7f27f118f640 1 -- 172.21.15.133:0/2838289421 wait complete. 2023-12-18T10:24:55.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'b': 'idle+waiting paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:24:56.122 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:56.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.269+0000 7f150018f640 1 Processor -- start 2023-12-18T10:24:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.269+0000 7f150018f640 1 -- start start 2023-12-18T10:24:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f150018f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14f80c1280 0x7f14f80cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f150018f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f806fdb0 con 0x7f14f80cb340 2023-12-18T10:24:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f150018f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f8164820 con 0x7f14f8160cc0 2023-12-18T10:24:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f150018f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f81654a0 con 0x7f14f80c1280 2023-12-18T10:24:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fe72c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f14f80cb340 0x7f14f80cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59570/0 (socket says 172.21.15.133:59570) 2023-12-18T10:24:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fe72c640 1 -- 172.21.15.133:0/393822606 learned_addr learned my addr 172.21.15.133:0/393822606 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fd72a640 1 --2- 172.21.15.133:0/393822606 >> v2:172.21.15.142:3300/0 conn(0x7f14f80c1280 0x7f14f80cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726664396 0 0) 0x7f14f806fdb0 con 0x7f14f80cb340 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14e4003530 con 0x7f14f80cb340 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638057699 0 0) 0x7f14f8164820 con 0x7f14f8160cc0 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f806fdb0 con 0x7f14f8160cc0 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1089629633 0 0) 0x7f14e4003530 con 0x7f14f80cb340 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 >> v2:172.21.15.142:3300/0 conn(0x7f14f80c1280 msgr2=0x7f14f80cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 --2- 172.21.15.133:0/393822606 >> v2:172.21.15.142:3300/0 conn(0x7f14f80c1280 0x7f14f80cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 >> v1:172.21.15.142:6789/0 conn(0x7f14f8160cc0 legacy=0x7f14f80cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8164b00 con 0x7f14f80cb340 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f14f0001a00 con 0x7f14f80cb340 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 >> v1:172.21.15.133:6789/0 conn(0x7f14f80cb340 legacy=0x7f14f80cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e4003b10 0x7f14e4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14e40047d0 0x7f14e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e4005190 0x7f14e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81654a0 con 0x7f14e40047d0 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e400c0c0 con 0x7f14e4005190 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e400c280 con 0x7f14e4003b10 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fd72a640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14e40047d0 0x7f14e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fdf2b640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e4003b10 0x7f14e4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fe72c640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e4005190 0x7f14e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fd72a640 1 -- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e4003b10 msgr2=0x7f14e4003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fd72a640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e4003b10 0x7f14e4003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fd72a640 1 -- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e4005190 msgr2=0x7f14e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fd72a640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e4005190 0x7f14e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fd72a640 1 -- 172.21.15.133:0/393822606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4003530 con 0x7f14e40047d0 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fe72c640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e4005190 0x7f14e400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.273+0000 7f14fe72c640 1 -- 172.21.15.133:0/393822606 reap_dead start 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f14fd72a640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14e40047d0 0x7f14e4004c50 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009ae0 tx=0x7f14e801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77318c3acf4e225 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e80ab440 con 0x7f14e40047d0 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e80a7070 con 0x7f14e40047d0 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f14fcf29640 1 -- 172.21.15.133:0/393822606 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e80ab7e0 con 0x7f14e40047d0 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f150018f640 1 -- 172.21.15.133:0/393822606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14e40047d0 msgr2=0x7f14e4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f150018f640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14e40047d0 0x7f14e4004c50 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009ae0 tx=0x7f14e801ca50 comp rx=0 tx=0).stop 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f150018f640 1 -- 172.21.15.133:0/393822606 shutdown_connections 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f150018f640 1 --2- 172.21.15.133:0/393822606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14e40047d0 0x7f14e4004c50 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f150018f640 1 -- 172.21.15.133:0/393822606 >> 172.21.15.133:0/393822606 conn(0x7f14f806a3e0 msgr2=0x7f14f80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f150018f640 1 -- 172.21.15.133:0/393822606 shutdown_connections 2023-12-18T10:24:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.277+0000 7f150018f640 1 -- 172.21.15.133:0/393822606 wait complete. 2023-12-18T10:24:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 Processor -- start 2023-12-18T10:24:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 -- start start 2023-12-18T10:24:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e40047d0 0x7f14f8070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f815b8a0 0x7f14f81fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f81fcff0 0x7f14f80c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f815dbd0 con 0x7f14f815b8a0 2023-12-18T10:24:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81fd4a0 con 0x7f14f81fcff0 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f8070f70 con 0x7f14e40047d0 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f815b8a0 0x7f14f81fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f815b8a0 0x7f14f81fcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54528/0 (socket says 172.21.15.133:54528) 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 -- 172.21.15.133:0/354860926 learned_addr learned my addr 172.21.15.133:0/354860926 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fdf2b640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e40047d0 0x7f14f8070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fe72c640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f81fcff0 0x7f14f80c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 -- 172.21.15.133:0/354860926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e40047d0 msgr2=0x7f14f8070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e40047d0 0x7f14f8070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 -- 172.21.15.133:0/354860926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f81fcff0 msgr2=0x7f14f80c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f81fcff0 0x7f14f80c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 -- 172.21.15.133:0/354860926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f815cf50 con 0x7f14f815b8a0 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14fd72a640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f815b8a0 0x7f14f81fcab0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f14e80ad040 tx=0x7f14e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14ee7fc640 1 -- 172.21.15.133:0/354860926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8005d20 con 0x7f14f815b8a0 2023-12-18T10:24:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14ee7fc640 1 -- 172.21.15.133:0/354860926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e8005e80 con 0x7f14f815b8a0 2023-12-18T10:24:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f14ee7fc640 1 -- 172.21.15.133:0/354860926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8006240 con 0x7f14f815b8a0 2023-12-18T10:24:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f815d230 con 0x7f14f815b8a0 2023-12-18T10:24:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f815d7f0 con 0x7f14f815b8a0 2023-12-18T10:24:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.281+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f80735b0 con 0x7f14f815b8a0 2023-12-18T10:24:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.285+0000 7f14ee7fc640 1 -- 172.21.15.133:0/354860926 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14e80063a0 con 0x7f14f815b8a0 2023-12-18T10:24:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.285+0000 7f14ee7fc640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14dc065a60 0x7f14dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.285+0000 7f14ee7fc640 1 -- 172.21.15.133:0/354860926 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f14e811ce50 con 0x7f14f815b8a0 2023-12-18T10:24:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.285+0000 7f14fdf2b640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14dc065a60 0x7f14dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.285+0000 7f14fdf2b640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14dc065a60 0x7f14dc067f20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f14f8160250 tx=0x7f14f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.289+0000 7f14ee7fc640 1 -- 172.21.15.133:0/354860926 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f14e80ea820 con 0x7f14f815b8a0 2023-12-18T10:24:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.469+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14f804e000 con 0x7f14f815b8a0 2023-12-18T10:24:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.469+0000 7f14ee7fc640 1 -- 172.21.15.133:0/354860926 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f14e80c1070 con 0x7f14f815b8a0 2023-12-18T10:24:56.471 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:56.471 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:24:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14dc065a60 msgr2=0x7f14dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14dc065a60 0x7f14dc067f20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f14f8160250 tx=0x7f14f4009040 comp rx=0 tx=0).stop 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f815b8a0 msgr2=0x7f14f81fcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f815b8a0 0x7f14f81fcab0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f14e80ad040 tx=0x7f14e4005800 comp rx=0 tx=0).stop 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 shutdown_connections 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14dc065a60 0x7f14dc067f20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f81fcff0 0x7f14f80c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f815b8a0 0x7f14f81fcab0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 --2- 172.21.15.133:0/354860926 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14e40047d0 0x7f14f8070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 >> 172.21.15.133:0/354860926 conn(0x7f14f806a3e0 msgr2=0x7f14f80cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 shutdown_connections 2023-12-18T10:24:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.473+0000 7f150018f640 1 -- 172.21.15.133:0/354860926 wait complete. 2023-12-18T10:24:56.492 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:56.493 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:56.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.629+0000 7f45ab36d640 1 Processor -- start 2023-12-18T10:24:56.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.629+0000 7f45ab36d640 1 -- start start 2023-12-18T10:24:56.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.629+0000 7f45ab36d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45a40cdd40 0x7f45a40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45ab36d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a4160690 con 0x7f45a406fdb0 2023-12-18T10:24:56.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45ab36d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a40b0d80 con 0x7f45a415c9d0 2023-12-18T10:24:56.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45ab36d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a41603f0 con 0x7f45a40cdd40 2023-12-18T10:24:56.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a990a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f45a406fdb0 0x7f45a40cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59572/0 (socket says 172.21.15.133:59572) 2023-12-18T10:24:56.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a990a640 1 -- 172.21.15.133:0/2622080295 learned_addr learned my addr 172.21.15.133:0/2622080295 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:56.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a8908640 1 --2- 172.21.15.133:0/2622080295 >> v2:172.21.15.142:3300/0 conn(0x7f45a40cdd40 0x7f45a40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435766019 0 0) 0x7f45a4160690 con 0x7f45a406fdb0 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4590003530 con 0x7f45a406fdb0 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2665908011 0 0) 0x7f4590003530 con 0x7f45a406fdb0 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 >> v2:172.21.15.142:3300/0 conn(0x7f45a40cdd40 msgr2=0x7f45a40cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 --2- 172.21.15.133:0/2622080295 >> v2:172.21.15.142:3300/0 conn(0x7f45a40cdd40 0x7f45a40cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 >> v1:172.21.15.142:6789/0 conn(0x7f45a415c9d0 legacy=0x7f45a4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a40ccb00 con 0x7f45a406fdb0 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f459c001a00 con 0x7f45a406fdb0 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a8908640 1 --2- 172.21.15.133:0/2622080295 >> v2:172.21.15.142:3300/0 conn(0x7f45a40cdd40 0x7f45a40cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 >> v1:172.21.15.133:6789/0 conn(0x7f45a406fdb0 legacy=0x7f45a40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590003980 0x7f4590003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4590004380 0x7f4590004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4590005050 0x7f459000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41603f0 con 0x7f4590005050 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459000bfb0 con 0x7f4590003980 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459000c170 con 0x7f4590004380 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a990a640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4590005050 0x7f459000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a9109640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590003980 0x7f4590003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a8908640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4590004380 0x7f4590004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a990a640 1 -- 172.21.15.133:0/2622080295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4590004380 msgr2=0x7f4590004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a990a640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4590004380 0x7f4590004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a990a640 1 -- 172.21.15.133:0/2622080295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590003980 msgr2=0x7f4590003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a990a640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590003980 0x7f4590003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.633+0000 7f45a990a640 1 -- 172.21.15.133:0/2622080295 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590003530 con 0x7f4590005050 2023-12-18T10:24:56.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45a990a640 1 -- 172.21.15.133:0/2622080295 reap_dead start 2023-12-18T10:24:56.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45a990a640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4590005050 0x7f459000b990 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f459c00a830 tx=0x7f459c01faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adaf411de2fdec05 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:56.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0af070 con 0x7f4590005050 2023-12-18T10:24:56.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c0aa4d0 con 0x7f4590005050 2023-12-18T10:24:56.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f459bfff640 1 -- 172.21.15.133:0/2622080295 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c0aa8a0 con 0x7f4590005050 2023-12-18T10:24:56.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 -- 172.21.15.133:0/2622080295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4590005050 msgr2=0x7f459000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4590005050 0x7f459000b990 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f459c00a830 tx=0x7f459c01faa0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 -- 172.21.15.133:0/2622080295 shutdown_connections 2023-12-18T10:24:56.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 --2- 172.21.15.133:0/2622080295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4590005050 0x7f459000b990 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 -- 172.21.15.133:0/2622080295 >> 172.21.15.133:0/2622080295 conn(0x7f45a406a3e0 msgr2=0x7f45a40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:56.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 -- 172.21.15.133:0/2622080295 shutdown_connections 2023-12-18T10:24:56.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 -- 172.21.15.133:0/2622080295 wait complete. 2023-12-18T10:24:56.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 Processor -- start 2023-12-18T10:24:56.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.637+0000 7f45ab36d640 1 -- start start 2023-12-18T10:24:56.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590005050 0x7f45a41e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40b2010 0x7f45a415b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a40b3010 0x7f45a40c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41e6480 con 0x7f45a40b2010 2023-12-18T10:24:56.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40b2490 con 0x7f4590005050 2023-12-18T10:24:56.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41e5ec0 con 0x7f45a40b3010 2023-12-18T10:24:56.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40b2010 0x7f45a415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40b2010 0x7f45a415b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54552/0 (socket says 172.21.15.133:54552) 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 -- 172.21.15.133:0/1842340838 learned_addr learned my addr 172.21.15.133:0/1842340838 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a9109640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590005050 0x7f45a41e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a990a640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a40b3010 0x7f45a40c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 -- 172.21.15.133:0/1842340838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a40b3010 msgr2=0x7f45a40c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a40b3010 0x7f45a40c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 -- 172.21.15.133:0/1842340838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590005050 msgr2=0x7f45a41e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590005050 0x7f45a41e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 -- 172.21.15.133:0/1842340838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a41e61a0 con 0x7f45a40b2010 2023-12-18T10:24:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45a8908640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40b2010 0x7f45a415b600 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f4594011900 tx=0x7f4594011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f4599ffb640 1 -- 172.21.15.133:0/1842340838 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594009650 con 0x7f45a40b2010 2023-12-18T10:24:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f4599ffb640 1 -- 172.21.15.133:0/1842340838 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459400fbd0 con 0x7f45a40b2010 2023-12-18T10:24:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a40b2810 con 0x7f45a40b2010 2023-12-18T10:24:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f4599ffb640 1 -- 172.21.15.133:0/1842340838 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594015460 con 0x7f45a40b2010 2023-12-18T10:24:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a415bb40 con 0x7f45a40b2010 2023-12-18T10:24:56.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a40735b0 con 0x7f45a40b2010 2023-12-18T10:24:56.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.641+0000 7f4599ffb640 1 -- 172.21.15.133:0/1842340838 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45940155c0 con 0x7f45a40b2010 2023-12-18T10:24:56.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.645+0000 7f4599ffb640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4588065a90 0x7f4588067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:56.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.645+0000 7f4599ffb640 1 -- 172.21.15.133:0/1842340838 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4594083890 con 0x7f45a40b2010 2023-12-18T10:24:56.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.645+0000 7f45a9109640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4588065a90 0x7f4588067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:56.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.645+0000 7f45a9109640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4588065a90 0x7f4588067f50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007f50 tx=0x7f45a0007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:56.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.649+0000 7f4599ffb640 1 -- 172.21.15.133:0/1842340838 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4594051080 con 0x7f45a40b2010 2023-12-18T10:24:56.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.849+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f45a404e000 con 0x7f45a40b2010 2023-12-18T10:24:56.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f4599ffb640 1 -- 172.21.15.133:0/1842340838 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1835 (secure 0 0 0) 0x7f45940546a0 con 0x7f45a40b2010 2023-12-18T10:24:56.852 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:56.852 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":436,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700657,"bytes_used":265076736,"bytes_avail":772829036544,"bytes_total":773094113280,"write_bytes_sec":1009,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2023-12-18T10:24:55.183847+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-12-18T10:24:56.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4588065a90 msgr2=0x7f4588067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4588065a90 0x7f4588067f50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007f50 tx=0x7f45a0007ee0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40b2010 msgr2=0x7f45a415b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40b2010 0x7f45a415b600 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f4594011900 tx=0x7f4594011dc0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 shutdown_connections 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4588065a90 0x7f4588067f50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45a40b3010 0x7f45a40c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40b2010 0x7f45a415b600 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 --2- 172.21.15.133:0/1842340838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4590005050 0x7f45a41e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 >> 172.21.15.133:0/1842340838 conn(0x7f45a406a3e0 msgr2=0x7f45a40ae4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 shutdown_connections 2023-12-18T10:24:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:56.853+0000 7f45ab36d640 1 -- 172.21.15.133:0/1842340838 wait complete. 2023-12-18T10:24:56.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'b': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2023-12-18T10:24:57.873 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:58.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e378f640 1 Processor -- start 2023-12-18T10:24:58.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e378f640 1 -- start start 2023-12-18T10:24:58.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e378f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1570c0 0x7f80dc06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e378f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc0c9460 con 0x7f80dc06c320 2023-12-18T10:24:58.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e378f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc1574a0 con 0x7f80dc0ca000 2023-12-18T10:24:58.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e378f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc06c7a0 con 0x7f80dc1570c0 2023-12-18T10:24:58.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e0d2a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f80dc06c320 0x7f80dc0c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59582/0 (socket says 172.21.15.133:59582) 2023-12-18T10:24:58.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e0d2a640 1 -- 172.21.15.133:0/4064084479 learned_addr learned my addr 172.21.15.133:0/4064084479 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:58.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80e152b640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1570c0 0x7f80dc06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875315597 0 0) 0x7f80dc0c9460 con 0x7f80dc06c320 2023-12-18T10:24:58.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80c8003530 con 0x7f80dc06c320 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1792820150 0 0) 0x7f80c8003530 con 0x7f80dc06c320 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1570c0 msgr2=0x7f80dc06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1570c0 0x7f80dc06bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 >> v1:172.21.15.142:6789/0 conn(0x7f80dc0ca000 legacy=0x7f80dc070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0c8b30 con 0x7f80dc06c320 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f80cc001680 con 0x7f80dc06c320 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 >> v1:172.21.15.133:6789/0 conn(0x7f80dc06c320 legacy=0x7f80dc0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1570c0 0x7f80c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8003ef0 0x7f80c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c8004d10 0x7f80c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc06c7a0 con 0x7f80c8004d10 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c800dcb0 con 0x7f80c8003ef0 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.021+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c800de70 con 0x7f80dc1570c0 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e1d2c640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c8004d10 0x7f80c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e0d2a640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8003ef0 0x7f80c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e152b640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1570c0 0x7f80c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e1d2c640 1 -- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1570c0 msgr2=0x7f80c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e1d2c640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1570c0 0x7f80c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e1d2c640 1 -- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8003ef0 msgr2=0x7f80c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e1d2c640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8003ef0 0x7f80c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e1d2c640 1 -- 172.21.15.133:0/4064084479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c8003530 con 0x7f80c8004d10 2023-12-18T10:24:58.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80e1d2c640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c8004d10 0x7f80c8005190 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f80d4001f60 tx=0x7f80d401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07c100b6014f5fc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:58.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d40a7640 con 0x7f80c8004d10 2023-12-18T10:24:58.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d40a77a0 con 0x7f80c8004d10 2023-12-18T10:24:58.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.025+0000 7f80d3fff640 1 -- 172.21.15.133:0/4064084479 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d40a7b90 con 0x7f80c8004d10 2023-12-18T10:24:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- 172.21.15.133:0/4064084479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c8004d10 msgr2=0x7f80c8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 --2- 172.21.15.133:0/4064084479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c8004d10 0x7f80c8005190 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f80d4001f60 tx=0x7f80d401c8f0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 -- 172.21.15.133:0/4064084479 reap_dead start 2023-12-18T10:24:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- 172.21.15.133:0/4064084479 shutdown_connections 2023-12-18T10:24:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- 172.21.15.133:0/4064084479 >> 172.21.15.133:0/4064084479 conn(0x7f80dc06a3e0 msgr2=0x7f80dc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- 172.21.15.133:0/4064084479 shutdown_connections 2023-12-18T10:24:58.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- 172.21.15.133:0/4064084479 wait complete. 2023-12-18T10:24:58.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 Processor -- start 2023-12-18T10:24:58.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- start start 2023-12-18T10:24:58.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8004d10 0x7f80dc0c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1f48d0 0x7f80dc147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80dc1596d0 0x7f80dc159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0cd4c0 con 0x7f80dc1596d0 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc15a0a0 con 0x7f80c8004d10 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e378f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0cc4b0 con 0x7f80dc1f48d0 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80dc1596d0 0x7f80dc159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80dc1596d0 0x7f80dc159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54556/0 (socket says 172.21.15.133:54556) 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 -- 172.21.15.133:0/1966692986 learned_addr learned my addr 172.21.15.133:0/1966692986 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e152b640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8004d10 0x7f80dc0c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e0d2a640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1f48d0 0x7f80dc147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 -- 172.21.15.133:0/1966692986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1f48d0 msgr2=0x7f80dc147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1f48d0 0x7f80dc147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 -- 172.21.15.133:0/1966692986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8004d10 msgr2=0x7f80dc0c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8004d10 0x7f80dc0c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.029+0000 7f80e1d2c640 1 -- 172.21.15.133:0/1966692986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0cd030 con 0x7f80dc1596d0 2023-12-18T10:24:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80e1d2c640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80dc1596d0 0x7f80dc159b60 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f80d4099150 tx=0x7f80c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80d1ffb640 1 -- 172.21.15.133:0/1966692986 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d40a7640 con 0x7f80dc1596d0 2023-12-18T10:24:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80d1ffb640 1 -- 172.21.15.133:0/1966692986 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d40a7b70 con 0x7f80dc1596d0 2023-12-18T10:24:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc0cc700 con 0x7f80dc1596d0 2023-12-18T10:24:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80d1ffb640 1 -- 172.21.15.133:0/1966692986 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d4003980 con 0x7f80dc1596d0 2023-12-18T10:24:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc0cccc0 con 0x7f80dc1596d0 2023-12-18T10:24:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc0735b0 con 0x7f80dc1596d0 2023-12-18T10:24:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80d1ffb640 1 -- 172.21.15.133:0/1966692986 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80d4003ae0 con 0x7f80dc1596d0 2023-12-18T10:24:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80d1ffb640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80c0065a60 0x7f80c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80d1ffb640 1 -- 172.21.15.133:0/1966692986 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f80d411dbb0 con 0x7f80dc1596d0 2023-12-18T10:24:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.033+0000 7f80e152b640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80c0065a60 0x7f80c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.037+0000 7f80e152b640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80c0065a60 0x7f80c0067f20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f80dc15a400 tx=0x7f80d8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:58.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.037+0000 7f80d1ffb640 1 -- 172.21.15.133:0/1966692986 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f80d40eb310 con 0x7f80dc1596d0 2023-12-18T10:24:58.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80dc0cd1c0 con 0x7f80dc1596d0 2023-12-18T10:24:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80d1ffb640 1 -- 172.21.15.133:0/1966692986 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f80d40ee930 con 0x7f80dc1596d0 2023-12-18T10:24:58.220 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:58.220 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:24:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80c0065a60 msgr2=0x7f80c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80c0065a60 0x7f80c0067f20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f80dc15a400 tx=0x7f80d8009190 comp rx=0 tx=0).stop 2023-12-18T10:24:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80dc1596d0 msgr2=0x7f80dc159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80dc1596d0 0x7f80dc159b60 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f80d4099150 tx=0x7f80c8005800 comp rx=0 tx=0).stop 2023-12-18T10:24:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 shutdown_connections 2023-12-18T10:24:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f80c0065a60 0x7f80c0067f20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80dc1596d0 0x7f80dc159b60 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80dc1f48d0 0x7f80dc147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 --2- 172.21.15.133:0/1966692986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80c8004d10 0x7f80dc0c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 >> 172.21.15.133:0/1966692986 conn(0x7f80dc06a3e0 msgr2=0x7f80dc14fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 shutdown_connections 2023-12-18T10:24:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.221+0000 7f80e378f640 1 -- 172.21.15.133:0/1966692986 wait complete. 2023-12-18T10:24:58.241 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:58.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:24:58.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.377+0000 7f1d04f98640 1 Processor -- start 2023-12-18T10:24:58.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.377+0000 7f1d04f98640 1 -- start start 2023-12-18T10:24:58.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.377+0000 7f1d04f98640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d001570c0 0x7f1d0006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.377+0000 7f1d04f98640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d000ca000 0x7f1d00070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.377+0000 7f1d04f98640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d000c9460 con 0x7f1d0006c320 2023-12-18T10:24:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.377+0000 7f1d04f98640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0006c7a0 con 0x7f1d000ca000 2023-12-18T10:24:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.377+0000 7f1d04f98640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d001574a0 con 0x7f1d001570c0 2023-12-18T10:24:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cf7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1d0006c320 0x7f1d000c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59592/0 (socket says 172.21.15.133:59592) 2023-12-18T10:24:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cf7fff640 1 -- 172.21.15.133:0/3420508289 learned_addr learned my addr 172.21.15.133:0/3420508289 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfed9d640 1 --2- 172.21.15.133:0/3420508289 >> v2:172.21.15.133:3300/0 conn(0x7f1d000ca000 0x7f1d00070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfe59c640 1 --2- 172.21.15.133:0/3420508289 >> v2:172.21.15.142:3300/0 conn(0x7f1d001570c0 0x7f1d0006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfdd9b640 1 -- 172.21.15.133:0/3420508289 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338919507 0 0) 0x7f1d000c9460 con 0x7f1d0006c320 2023-12-18T10:24:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfdd9b640 1 -- 172.21.15.133:0/3420508289 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cec003530 con 0x7f1d0006c320 2023-12-18T10:24:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfed9d640 1 -- 172.21.15.133:0/3420508289 >> v2:172.21.15.142:3300/0 conn(0x7f1d001570c0 msgr2=0x7f1d0006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfed9d640 1 --2- 172.21.15.133:0/3420508289 >> v2:172.21.15.142:3300/0 conn(0x7f1d001570c0 0x7f1d0006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfed9d640 1 -- 172.21.15.133:0/3420508289 >> v1:172.21.15.133:6789/0 conn(0x7f1d0006c320 legacy=0x7f1d000c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfed9d640 1 -- 172.21.15.133:0/3420508289 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000c8b30 con 0x7f1d000ca000 2023-12-18T10:24:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfed9d640 1 --2- 172.21.15.133:0/3420508289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d000ca000 0x7f1d00070df0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1d0006e280 tx=0x7f1cf801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648f8811041fb74f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfdd9b640 1 -- 172.21.15.133:0/3420508289 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80a5910 con 0x7f1d000ca000 2023-12-18T10:24:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfdd9b640 1 -- 172.21.15.133:0/3420508289 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf80a5a70 con 0x7f1d000ca000 2023-12-18T10:24:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.381+0000 7f1cfdd9b640 1 -- 172.21.15.133:0/3420508289 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80a5e00 con 0x7f1d000ca000 2023-12-18T10:24:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- 172.21.15.133:0/3420508289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d000ca000 msgr2=0x7f1d00070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 --2- 172.21.15.133:0/3420508289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d000ca000 0x7f1d00070df0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1d0006e280 tx=0x7f1cf801c850 comp rx=0 tx=0).stop 2023-12-18T10:24:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- 172.21.15.133:0/3420508289 shutdown_connections 2023-12-18T10:24:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 --2- 172.21.15.133:0/3420508289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d000ca000 0x7f1d00070df0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 --2- 172.21.15.133:0/3420508289 >> v2:172.21.15.142:3300/0 conn(0x7f1d001570c0 0x7f1d0006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- 172.21.15.133:0/3420508289 >> 172.21.15.133:0/3420508289 conn(0x7f1d0006a3e0 msgr2=0x7f1d000afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- 172.21.15.133:0/3420508289 shutdown_connections 2023-12-18T10:24:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- 172.21.15.133:0/3420508289 wait complete. 2023-12-18T10:24:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 Processor -- start 2023-12-18T10:24:58.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- start start 2023-12-18T10:24:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0006c320 0x7f1d000cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d000ca000 0x7f1d000c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d001570c0 0x7f1d000ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d000cda50 con 0x7f1d001570c0 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d001583b0 con 0x7f1d000ca000 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1d04f98640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d000cb830 con 0x7f1d0006c320 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1cfed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d001570c0 0x7f1d000ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1cfed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d001570c0 0x7f1d000ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54572/0 (socket says 172.21.15.133:54572) 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1cfed9d640 1 -- 172.21.15.133:0/1483785954 learned_addr learned my addr 172.21.15.133:0/1483785954 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1cf7fff640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d000ca000 0x7f1d000c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.385+0000 7f1cfe59c640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0006c320 0x7f1d000cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cfed9d640 1 -- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0006c320 msgr2=0x7f1d000cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cfed9d640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0006c320 0x7f1d000cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cfed9d640 1 -- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d000ca000 msgr2=0x7f1d000c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cfed9d640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d000ca000 0x7f1d000c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cfed9d640 1 -- 172.21.15.133:0/1483785954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8009a70 con 0x7f1d001570c0 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cf7fff640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d000ca000 0x7f1d000c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cfed9d640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d001570c0 0x7f1d000ab8a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80b0040 tx=0x7f1cf80195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cf6ffd640 1 -- 172.21.15.133:0/1483785954 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80b7850 con 0x7f1d001570c0 2023-12-18T10:24:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cf6ffd640 1 -- 172.21.15.133:0/1483785954 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf80b79b0 con 0x7f1d001570c0 2023-12-18T10:24:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cf6ffd640 1 -- 172.21.15.133:0/1483785954 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80b7d60 con 0x7f1d001570c0 2023-12-18T10:24:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d000cbaa0 con 0x7f1d001570c0 2023-12-18T10:24:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d000cc060 con 0x7f1d001570c0 2023-12-18T10:24:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d000735b0 con 0x7f1d001570c0 2023-12-18T10:24:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cf6ffd640 1 -- 172.21.15.133:0/1483785954 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1cf80ad440 con 0x7f1d001570c0 2023-12-18T10:24:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cf6ffd640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ce0065a60 0x7f1ce0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cf6ffd640 1 -- 172.21.15.133:0/1483785954 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f1cf811e210 con 0x7f1d001570c0 2023-12-18T10:24:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.389+0000 7f1cfe59c640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ce0065a60 0x7f1ce0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.393+0000 7f1cfe59c640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ce0065a60 0x7f1ce0067f20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009ac0 tx=0x7f1cf0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.393+0000 7f1cf6ffd640 1 -- 172.21.15.133:0/1483785954 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1cf80ebb20 con 0x7f1d001570c0 2023-12-18T10:24:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1d0004e000 con 0x7f1d001570c0 2023-12-18T10:24:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1cf6ffd640 1 -- 172.21.15.133:0/1483785954 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1834 (secure 0 0 0) 0x7f1cf80ef140 con 0x7f1d001570c0 2023-12-18T10:24:58.600 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:58.600 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":438,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700657,"bytes_used":265076736,"bytes_avail":772829036544,"bytes_total":773094113280,"write_bytes_sec":819,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2023-12-18T10:24:55.183847+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-12-18T10:24:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ce0065a60 msgr2=0x7f1ce0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ce0065a60 0x7f1ce0067f20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009ac0 tx=0x7f1cf0009190 comp rx=0 tx=0).stop 2023-12-18T10:24:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d001570c0 msgr2=0x7f1d000ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d001570c0 0x7f1d000ab8a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80b0040 tx=0x7f1cf80195f0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 shutdown_connections 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1ce0065a60 0x7f1ce0067f20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d001570c0 0x7f1d000ab8a0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d000ca000 0x7f1d000c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 --2- 172.21.15.133:0/1483785954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1d0006c320 0x7f1d000cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 >> 172.21.15.133:0/1483785954 conn(0x7f1d0006a3e0 msgr2=0x7f1d000c1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 shutdown_connections 2023-12-18T10:24:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:58.601+0000 7f1d04f98640 1 -- 172.21.15.133:0/1483785954 wait complete. 2023-12-18T10:24:58.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'b': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2023-12-18T10:24:59.178 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:24:59.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:24:59.622 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:24:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88ca40b640 1 Processor -- start 2023-12-18T10:24:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88ca40b640 1 -- start start 2023-12-18T10:24:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88ca40b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415ceb0 0x7f88c406b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88ca40b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c4160e80 con 0x7f88c40ce2c0 2023-12-18T10:24:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88ca40b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c4161160 con 0x7f88c40cf2a0 2023-12-18T10:24:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88ca40b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4161440 con 0x7f88c415ceb0 2023-12-18T10:24:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c37fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f88c40ce2c0 0x7f88c40ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59594/0 (socket says 172.21.15.133:59594) 2023-12-18T10:24:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c37fe640 1 -- 172.21.15.133:0/1370337190 learned_addr learned my addr 172.21.15.133:0/1370337190 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:24:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399889699 0 0) 0x7f88c4160e80 con 0x7f88c40ce2c0 2023-12-18T10:24:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ac003530 con 0x7f88c40ce2c0 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c3fff640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415ceb0 0x7f88c406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3749811023 0 0) 0x7f88ac003530 con 0x7f88c40ce2c0 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415ceb0 msgr2=0x7f88c406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415ceb0 0x7f88c406b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 >> v1:172.21.15.142:6789/0 conn(0x7f88c40cf2a0 legacy=0x7f88c415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c4161720 con 0x7f88c40ce2c0 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f88b8001680 con 0x7f88c40ce2c0 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 >> v1:172.21.15.133:6789/0 conn(0x7f88c40ce2c0 legacy=0x7f88c40ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415ceb0 0x7f88ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac004d10 0x7f88ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4161440 con 0x7f88ac0039b0 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac00bb20 con 0x7f88ac004d10 2023-12-18T10:24:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac00bcb0 con 0x7f88c415ceb0 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c3fff640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c37fe640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415ceb0 0x7f88ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c89a8640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac004d10 0x7f88ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c3fff640 1 -- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415ceb0 msgr2=0x7f88ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c3fff640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c415ceb0 0x7f88ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c3fff640 1 -- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac004d10 msgr2=0x7f88ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c3fff640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac004d10 0x7f88ac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c3fff640 1 -- 172.21.15.133:0/1370337190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac003530 con 0x7f88ac0039b0 2023-12-18T10:24:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.769+0000 7f88c89a8640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88ac004d10 0x7f88ac005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:24:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88c3fff640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f88b400ba60 tx=0x7f88b401c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d746288da10b8eb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40ab670 con 0x7f88ac0039b0 2023-12-18T10:24:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c415d4a0 con 0x7f88ac0039b0 2023-12-18T10:24:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88c2ffd640 1 -- 172.21.15.133:0/1370337190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40aba10 con 0x7f88ac0039b0 2023-12-18T10:24:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88ca40b640 1 -- 172.21.15.133:0/1370337190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac0039b0 msgr2=0x7f88ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88ca40b640 1 --2- 172.21.15.133:0/1370337190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88ac0039b0 0x7f88ac003dd0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f88b400ba60 tx=0x7f88b401c660 comp rx=0 tx=0).stop 2023-12-18T10:24:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88c89a8640 1 -- 172.21.15.133:0/1370337190 reap_dead start 2023-12-18T10:24:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88ca40b640 1 -- 172.21.15.133:0/1370337190 shutdown_connections 2023-12-18T10:24:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88ca40b640 1 -- 172.21.15.133:0/1370337190 >> 172.21.15.133:0/1370337190 conn(0x7f88c4069ca0 msgr2=0x7f88c406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88ca40b640 1 -- 172.21.15.133:0/1370337190 shutdown_connections 2023-12-18T10:24:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.773+0000 7f88ca40b640 1 -- 172.21.15.133:0/1370337190 wait complete. 2023-12-18T10:24:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 Processor -- start 2023-12-18T10:24:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 -- start start 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88ac0039b0 0x7f88c40c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c41539b0 0x7f88c4152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40c9870 0x7f88c40c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40ca230 con 0x7f88c40c9870 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40c6cc0 con 0x7f88c41539b0 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40c5e10 con 0x7f88ac0039b0 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40c9870 0x7f88c40c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40c9870 0x7f88c40c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54590/0 (socket says 172.21.15.133:54590) 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 -- 172.21.15.133:0/3676024864 learned_addr learned my addr 172.21.15.133:0/3676024864 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c3fff640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88ac0039b0 0x7f88c40c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c37fe640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c41539b0 0x7f88c4152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 -- 172.21.15.133:0/3676024864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88ac0039b0 msgr2=0x7f88c40c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88ac0039b0 0x7f88c40c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 -- 172.21.15.133:0/3676024864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c41539b0 msgr2=0x7f88c4152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c41539b0 0x7f88c4152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 -- 172.21.15.133:0/3676024864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40c60b0 con 0x7f88c40c9870 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c89a8640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40c9870 0x7f88c40c9cf0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f88c40c7620 tx=0x7f88bc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c0ff9640 1 -- 172.21.15.133:0/3676024864 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc00eed0 con 0x7f88c40c9870 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c0ff9640 1 -- 172.21.15.133:0/3676024864 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc006b60 con 0x7f88c40c9870 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c40c6390 con 0x7f88c40c9870 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88c0ff9640 1 -- 172.21.15.133:0/3676024864 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc003980 con 0x7f88c40c9870 2023-12-18T10:24:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.777+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c40c6950 con 0x7f88c40c9870 2023-12-18T10:24:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.781+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c404e000 con 0x7f88c40c9870 2023-12-18T10:24:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.781+0000 7f88c0ff9640 1 -- 172.21.15.133:0/3676024864 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f88bc003ae0 con 0x7f88c40c9870 2023-12-18T10:24:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.781+0000 7f88c0ff9640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88b0065a90 0x7f88b0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:24:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.781+0000 7f88c0ff9640 1 -- 172.21.15.133:0/3676024864 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f88bc082b90 con 0x7f88c40c9870 2023-12-18T10:24:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.781+0000 7f88c3fff640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88b0065a90 0x7f88b0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:24:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.781+0000 7f88c3fff640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88b0065a90 0x7f88b0067f50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f88b40af000 tx=0x7f88b40b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:24:59.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.785+0000 7f88c0ff9640 1 -- 172.21.15.133:0/3676024864 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f88bc0502f0 con 0x7f88c40c9870 2023-12-18T10:24:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.965+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88c40c6e00 con 0x7f88c40c9870 2023-12-18T10:24:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88c0ff9640 1 -- 172.21.15.133:0/3676024864 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f88bc053910 con 0x7f88c40c9870 2023-12-18T10:24:59.968 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:24:59.968 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:24:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:24:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88b0065a90 msgr2=0x7f88b0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88b0065a90 0x7f88b0067f50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f88b40af000 tx=0x7f88b40b6040 comp rx=0 tx=0).stop 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40c9870 msgr2=0x7f88c40c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40c9870 0x7f88c40c9cf0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f88c40c7620 tx=0x7f88bc00eb90 comp rx=0 tx=0).stop 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 shutdown_connections 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88b0065a90 0x7f88b0067f50 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40c9870 0x7f88c40c9cf0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c41539b0 0x7f88c4152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 --2- 172.21.15.133:0/3676024864 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88ac0039b0 0x7f88c40c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 >> 172.21.15.133:0/3676024864 conn(0x7f88c4069ca0 msgr2=0x7f88c4160230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 shutdown_connections 2023-12-18T10:24:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:24:59.969+0000 7f88ca40b640 1 -- 172.21.15.133:0/3676024864 wait complete. 2023-12-18T10:24:59.988 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:24:59.989 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:25:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.129+0000 7f26121a2640 1 Processor -- start 2023-12-18T10:25:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.129+0000 7f26121a2640 1 -- start start 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.129+0000 7f26121a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f260c143f50 0x7f260c0c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.129+0000 7f26121a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c0afd10 0x7f260c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.129+0000 7f26121a2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f260c06bea0 0x7f260c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.129+0000 7f26121a2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0b06d0 con 0x7f260c06bea0 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.129+0000 7f26121a2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0c36c0 con 0x7f260c143f50 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.129+0000 7f26121a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0c39a0 con 0x7f260c0afd10 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f260c06bea0 0x7f260c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f260c06bea0 0x7f260c06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50256/0 (socket says 172.21.15.133:50256) 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 -- 172.21.15.133:0/291067068 learned_addr learned my addr 172.21.15.133:0/291067068 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26111a0640 1 --2- 172.21.15.133:0/291067068 >> v2:172.21.15.142:3300/0 conn(0x7f260c143f50 0x7f260c0c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f261099f640 1 --2- 172.21.15.133:0/291067068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c0afd10 0x7f260c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 -- 172.21.15.133:0/291067068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c0afd10 msgr2=0x7f260c0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 --2- 172.21.15.133:0/291067068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c0afd10 0x7f260c0b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 -- 172.21.15.133:0/291067068 >> v2:172.21.15.142:3300/0 conn(0x7f260c143f50 msgr2=0x7f260c0c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 --2- 172.21.15.133:0/291067068 >> v2:172.21.15.142:3300/0 conn(0x7f260c143f50 0x7f260c0c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 -- 172.21.15.133:0/291067068 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0c3c80 con 0x7f260c06bea0 2023-12-18T10:25:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26111a0640 1 --2- 172.21.15.133:0/291067068 >> v2:172.21.15.142:3300/0 conn(0x7f260c143f50 0x7f260c0c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f261099f640 1 --2- 172.21.15.133:0/291067068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c0afd10 0x7f260c0b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f26119a1640 1 --2- 172.21.15.133:0/291067068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c06c330 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f260c06b810 tx=0x7f260401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6852700c587b66 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:00.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f2603fff640 1 -- 172.21.15.133:0/291067068 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040a5870 con 0x7f260c06bea0 2023-12-18T10:25:00.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f2603fff640 1 -- 172.21.15.133:0/291067068 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26040a59d0 con 0x7f260c06bea0 2023-12-18T10:25:00.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.133+0000 7f2603fff640 1 -- 172.21.15.133:0/291067068 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040a5d60 con 0x7f260c06bea0 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- 172.21.15.133:0/291067068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 msgr2=0x7f260c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 --2- 172.21.15.133:0/291067068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c06c330 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f260c06b810 tx=0x7f260401c9d0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- 172.21.15.133:0/291067068 shutdown_connections 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 --2- 172.21.15.133:0/291067068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c06c330 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 --2- 172.21.15.133:0/291067068 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c0afd10 0x7f260c0b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 --2- 172.21.15.133:0/291067068 >> v2:172.21.15.142:3300/0 conn(0x7f260c143f50 0x7f260c0c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- 172.21.15.133:0/291067068 >> 172.21.15.133:0/291067068 conn(0x7f260c0ce130 msgr2=0x7f260c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- 172.21.15.133:0/291067068 shutdown_connections 2023-12-18T10:25:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- 172.21.15.133:0/291067068 wait complete. 2023-12-18T10:25:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 Processor -- start 2023-12-18T10:25:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- start start 2023-12-18T10:25:00.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260c0afd10 0x7f260c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c143f50 0x7f260c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c143350 con 0x7f260c06bea0 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c1f5b80 con 0x7f260c0afd10 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26121a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c142dd0 con 0x7f260c143f50 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26111a0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26111a0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50262/0 (socket says 172.21.15.133:50262) 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26111a0640 1 -- 172.21.15.133:0/2449098642 learned_addr learned my addr 172.21.15.133:0/2449098642 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f261099f640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260c0afd10 0x7f260c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26119a1640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c143f50 0x7f260c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26111a0640 1 -- 172.21.15.133:0/2449098642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c143f50 msgr2=0x7f260c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26111a0640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c143f50 0x7f260c0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26111a0640 1 -- 172.21.15.133:0/2449098642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260c0afd10 msgr2=0x7f260c0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26111a0640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260c0afd10 0x7f260c0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.137+0000 7f26111a0640 1 -- 172.21.15.133:0/2449098642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604009b30 con 0x7f260c06bea0 2023-12-18T10:25:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f26111a0640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c142890 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f260800c7c0 tx=0x7f260800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f2601ffb640 1 -- 172.21.15.133:0/2449098642 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608007a30 con 0x7f260c06bea0 2023-12-18T10:25:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f2601ffb640 1 -- 172.21.15.133:0/2449098642 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608007b90 con 0x7f260c06bea0 2023-12-18T10:25:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c143070 con 0x7f260c06bea0 2023-12-18T10:25:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f2601ffb640 1 -- 172.21.15.133:0/2449098642 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260800ce70 con 0x7f260c06bea0 2023-12-18T10:25:00.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c1370d0 con 0x7f260c06bea0 2023-12-18T10:25:00.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c136c50 con 0x7f260c06bea0 2023-12-18T10:25:00.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f2601ffb640 1 -- 172.21.15.133:0/2449098642 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f26080113f0 con 0x7f260c06bea0 2023-12-18T10:25:00.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f2601ffb640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f0065a60 0x7f25f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:00.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f2601ffb640 1 -- 172.21.15.133:0/2449098642 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f2608083730 con 0x7f260c06bea0 2023-12-18T10:25:00.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.141+0000 7f261099f640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f0065a60 0x7f25f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:00.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.145+0000 7f261099f640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f0065a60 0x7f25f0067f20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f260c0af930 tx=0x7f25fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.145+0000 7f2601ffb640 1 -- 172.21.15.133:0/2449098642 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f260c136c50 con 0x7f260c06bea0 2023-12-18T10:25:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f260c136c50 con 0x7f260c06bea0 2023-12-18T10:25:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f2601ffb640 1 -- 172.21.15.133:0/2449098642 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1740 (secure 0 0 0) 0x7f260c136c50 con 0x7f260c06bea0 2023-12-18T10:25:00.348 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:00.348 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":440,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706118,"bytes_used":265084928,"bytes_avail":772829028352,"bytes_total":773094113280,"write_bytes_sec":645,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2023-12-18T10:24:59.184719+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f0065a60 msgr2=0x7f25f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f0065a60 0x7f25f0067f20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f260c0af930 tx=0x7f25fc008040 comp rx=0 tx=0).stop 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 msgr2=0x7f260c142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c142890 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f260800c7c0 tx=0x7f260800cc80 comp rx=0 tx=0).stop 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 shutdown_connections 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f25f0065a60 0x7f25f0067f20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f260c143f50 0x7f260c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f260c0afd10 0x7f260c0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 --2- 172.21.15.133:0/2449098642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f260c06bea0 0x7f260c142890 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 >> 172.21.15.133:0/2449098642 conn(0x7f260c0ce130 msgr2=0x7f260c15b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 shutdown_connections 2023-12-18T10:25:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:00.349+0000 7f26121a2640 1 -- 172.21.15.133:0/2449098642 wait complete. 2023-12-18T10:25:00.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]'} 2023-12-18T10:25:01.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:01.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.517+0000 7f6b5e620640 1 Processor -- start 2023-12-18T10:25:01.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.517+0000 7f6b5e620640 1 -- start start 2023-12-18T10:25:01.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b5e620640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b58160cc0 0x7f6b580cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b5e620640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6b580c1280 0x7f6b580cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b5e620640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5806fdb0 con 0x7f6b580c17d0 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b5e620640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b581654a0 con 0x7f6b58160cc0 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b5e620640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b581610a0 con 0x7f6b580c1280 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b57fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b58160cc0 0x7f6b580cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b5cbbd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6b580c17d0 0x7f6b5806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58970/0 (socket says 172.21.15.133:58970) 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b5cbbd640 1 -- 172.21.15.133:0/2062039971 learned_addr learned my addr 172.21.15.133:0/2062039971 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b57fff640 1 --2- 172.21.15.133:0/2062039971 >> v2:172.21.15.133:3300/0 conn(0x7f6b58160cc0 0x7f6b580cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50264/0 (socket says 172.21.15.133:50264) 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b577fe640 1 --2- 172.21.15.133:0/2062039971 >> v2:172.21.15.142:3300/0 conn(0x7f6b580c1280 0x7f6b580cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b57fff640 1 -- 172.21.15.133:0/2062039971 >> v2:172.21.15.142:3300/0 conn(0x7f6b580c1280 msgr2=0x7f6b580cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b57fff640 1 --2- 172.21.15.133:0/2062039971 >> v2:172.21.15.142:3300/0 conn(0x7f6b580c1280 0x7f6b580cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b57fff640 1 -- 172.21.15.133:0/2062039971 >> v1:172.21.15.133:6789/0 conn(0x7f6b580c17d0 legacy=0x7f6b5806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b57fff640 1 -- 172.21.15.133:0/2062039971 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580cb6b0 con 0x7f6b58160cc0 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b577fe640 1 --2- 172.21.15.133:0/2062039971 >> v2:172.21.15.142:3300/0 conn(0x7f6b580c1280 0x7f6b580cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:01.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.521+0000 7f6b56ffd640 1 -- 172.21.15.133:0/2062039971 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512669 0 0) 0x7f6b5806fdb0 con 0x7f6b580c17d0 2023-12-18T10:25:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b57fff640 1 --2- 172.21.15.133:0/2062039971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b58160cc0 0x7f6b580cac30 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f6b580c8ad0 tx=0x7f6b4801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad62eb3bbd2baef server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b56ffd640 1 -- 172.21.15.133:0/2062039971 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480ab600 con 0x7f6b58160cc0 2023-12-18T10:25:01.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b56ffd640 1 -- 172.21.15.133:0/2062039971 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b480a7050 con 0x7f6b58160cc0 2023-12-18T10:25:01.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b56ffd640 1 -- 172.21.15.133:0/2062039971 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480ab980 con 0x7f6b58160cc0 2023-12-18T10:25:01.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- 172.21.15.133:0/2062039971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b58160cc0 msgr2=0x7f6b580cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 --2- 172.21.15.133:0/2062039971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b58160cc0 0x7f6b580cac30 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f6b580c8ad0 tx=0x7f6b4801c3a0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- 172.21.15.133:0/2062039971 shutdown_connections 2023-12-18T10:25:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 --2- 172.21.15.133:0/2062039971 >> v2:172.21.15.142:3300/0 conn(0x7f6b580c1280 0x7f6b580cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 --2- 172.21.15.133:0/2062039971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b58160cc0 0x7f6b580cac30 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- 172.21.15.133:0/2062039971 >> 172.21.15.133:0/2062039971 conn(0x7f6b5806a3e0 msgr2=0x7f6b580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- 172.21.15.133:0/2062039971 shutdown_connections 2023-12-18T10:25:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- 172.21.15.133:0/2062039971 wait complete. 2023-12-18T10:25:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 Processor -- start 2023-12-18T10:25:01.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- start start 2023-12-18T10:25:01.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b580c1280 0x7f6b581586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b580c17d0 0x7f6b5815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b58160cc0 0x7f6b580c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580b3920 con 0x7f6b580c1280 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580c3f70 con 0x7f6b58160cc0 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.525+0000 7f6b5e620640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58160390 con 0x7f6b580c17d0 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b580c1280 0x7f6b581586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b580c1280 0x7f6b581586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50272/0 (socket says 172.21.15.133:50272) 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 -- 172.21.15.133:0/1981483009 learned_addr learned my addr 172.21.15.133:0/1981483009 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b577fe640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b580c17d0 0x7f6b5815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b5cbbd640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b58160cc0 0x7f6b580c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 -- 172.21.15.133:0/1981483009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b580c17d0 msgr2=0x7f6b5815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b580c17d0 0x7f6b5815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 -- 172.21.15.133:0/1981483009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b58160cc0 msgr2=0x7f6b580c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b58160cc0 0x7f6b580c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 -- 172.21.15.133:0/1981483009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48009420 con 0x7f6b580c1280 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b57fff640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b580c1280 0x7f6b581586b0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f6b48018fb0 tx=0x7f6b48019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:01.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b54ff9640 1 -- 172.21.15.133:0/1981483009 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48006e20 con 0x7f6b580c1280 2023-12-18T10:25:01.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b580c4210 con 0x7f6b580c1280 2023-12-18T10:25:01.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b54ff9640 1 -- 172.21.15.133:0/1981483009 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48004030 con 0x7f6b580c1280 2023-12-18T10:25:01.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b54ff9640 1 -- 172.21.15.133:0/1981483009 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480043a0 con 0x7f6b580c1280 2023-12-18T10:25:01.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b580c47d0 con 0x7f6b580c1280 2023-12-18T10:25:01.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b580735b0 con 0x7f6b580c1280 2023-12-18T10:25:01.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.529+0000 7f6b54ff9640 1 -- 172.21.15.133:0/1981483009 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b480b2040 con 0x7f6b580c1280 2023-12-18T10:25:01.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.533+0000 7f6b54ff9640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b44065a60 0x7f6b44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.533+0000 7f6b54ff9640 1 -- 172.21.15.133:0/1981483009 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f6b4811d140 con 0x7f6b580c1280 2023-12-18T10:25:01.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.533+0000 7f6b577fe640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b44065a60 0x7f6b44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.533+0000 7f6b577fe640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b44065a60 0x7f6b44067f20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6b581fcd70 tx=0x7f6b4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:01.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.537+0000 7f6b54ff9640 1 -- 172.21.15.133:0/1981483009 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b480ea8a0 con 0x7f6b580c1280 2023-12-18T10:25:01.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.713+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b5804e000 con 0x7f6b580c1280 2023-12-18T10:25:01.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b54ff9640 1 -- 172.21.15.133:0/1981483009 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f6b480edec0 con 0x7f6b580c1280 2023-12-18T10:25:01.716 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:01.716 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:25:01.716 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:25:01.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b44065a60 msgr2=0x7f6b44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b44065a60 0x7f6b44067f20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6b581fcd70 tx=0x7f6b4c008040 comp rx=0 tx=0).stop 2023-12-18T10:25:01.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b580c1280 msgr2=0x7f6b581586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b580c1280 0x7f6b581586b0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f6b48018fb0 tx=0x7f6b48019140 comp rx=0 tx=0).stop 2023-12-18T10:25:01.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 shutdown_connections 2023-12-18T10:25:01.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b44065a60 0x7f6b44067f20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b58160cc0 0x7f6b580c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b580c17d0 0x7f6b5815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 --2- 172.21.15.133:0/1981483009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b580c1280 0x7f6b581586b0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 >> 172.21.15.133:0/1981483009 conn(0x7f6b5806a3e0 msgr2=0x7f6b58070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:01.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 shutdown_connections 2023-12-18T10:25:01.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.717+0000 7f6b5e620640 1 -- 172.21.15.133:0/1981483009 wait complete. 2023-12-18T10:25:01.737 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'b', 'c'] 2023-12-18T10:25:01.737 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:25:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc2442d640 1 Processor -- start 2023-12-18T10:25:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc2442d640 1 -- start start 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc2442d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbc1c06c4f0 0x7fbc1c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc2442d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc1c0c9e30 0x7fbc1c0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc2442d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1c0c9460 con 0x7fbc1c1570c0 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc2442d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c1574a0 con 0x7fbc1c0c9e30 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc2442d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1c0c8b30 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc229ca640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc1c0c9e30 0x7fbc1c0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc229ca640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc1c0c9e30 0x7fbc1c0ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50278/0 (socket says 172.21.15.133:50278) 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.873+0000 7fbc229ca640 1 -- 172.21.15.133:0/360356762 learned_addr learned my addr 172.21.15.133:0/360356762 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc219c8640 1 --2- 172.21.15.133:0/360356762 >> v2:172.21.15.142:3300/0 conn(0x7fbc1c06c4f0 0x7fbc1c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc229ca640 1 -- 172.21.15.133:0/360356762 >> v2:172.21.15.142:3300/0 conn(0x7fbc1c06c4f0 msgr2=0x7fbc1c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc229ca640 1 --2- 172.21.15.133:0/360356762 >> v2:172.21.15.142:3300/0 conn(0x7fbc1c06c4f0 0x7fbc1c0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc229ca640 1 -- 172.21.15.133:0/360356762 >> v1:172.21.15.142:6789/0 conn(0x7fbc1c1570c0 legacy=0x7fbc1c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc229ca640 1 -- 172.21.15.133:0/360356762 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c0c8e10 con 0x7fbc1c0c9e30 2023-12-18T10:25:01.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc229ca640 1 --2- 172.21.15.133:0/360356762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c0c9e30 0x7fbc1c0ca2c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0ce330 tx=0x7fbc1401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9763c550d0d1e33f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:01.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc211c7640 1 -- 172.21.15.133:0/360356762 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140a5790 con 0x7fbc1c0c9e30 2023-12-18T10:25:01.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc211c7640 1 -- 172.21.15.133:0/360356762 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc140a58f0 con 0x7fbc1c0c9e30 2023-12-18T10:25:01.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.877+0000 7fbc211c7640 1 -- 172.21.15.133:0/360356762 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140a5c80 con 0x7fbc1c0c9e30 2023-12-18T10:25:01.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- 172.21.15.133:0/360356762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c0c9e30 msgr2=0x7fbc1c0ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 --2- 172.21.15.133:0/360356762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c0c9e30 0x7fbc1c0ca2c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0ce330 tx=0x7fbc1401c910 comp rx=0 tx=0).stop 2023-12-18T10:25:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- 172.21.15.133:0/360356762 shutdown_connections 2023-12-18T10:25:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 --2- 172.21.15.133:0/360356762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c0c9e30 0x7fbc1c0ca2c0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 --2- 172.21.15.133:0/360356762 >> v2:172.21.15.142:3300/0 conn(0x7fbc1c06c4f0 0x7fbc1c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- 172.21.15.133:0/360356762 >> 172.21.15.133:0/360356762 conn(0x7fbc1c06a3e0 msgr2=0x7fbc1c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- 172.21.15.133:0/360356762 shutdown_connections 2023-12-18T10:25:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- 172.21.15.133:0/360356762 wait complete. 2023-12-18T10:25:01.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 Processor -- start 2023-12-18T10:25:01.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- start start 2023-12-18T10:25:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c06c4f0 0x7fbc1c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc1c0c9e30 0x7fbc1c148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc1c1570c0 0x7fbc1c14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c0c6d80 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c0cdc80 con 0x7fbc1c1570c0 2023-12-18T10:25:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc2442d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1c0cdf60 con 0x7fbc1c0c9e30 2023-12-18T10:25:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc221c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c06c4f0 0x7fbc1c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc221c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c06c4f0 0x7fbc1c0cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50292/0 (socket says 172.21.15.133:50292) 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc221c9640 1 -- 172.21.15.133:0/3650970632 learned_addr learned my addr 172.21.15.133:0/3650970632 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc229ca640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc1c1570c0 0x7fbc1c14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc219c8640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc1c0c9e30 0x7fbc1c148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc221c9640 1 -- 172.21.15.133:0/3650970632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc1c0c9e30 msgr2=0x7fbc1c148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc221c9640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc1c0c9e30 0x7fbc1c148790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc221c9640 1 -- 172.21.15.133:0/3650970632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc1c1570c0 msgr2=0x7fbc1c14a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc221c9640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc1c1570c0 0x7fbc1c14a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.881+0000 7fbc221c9640 1 -- 172.21.15.133:0/3650970632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc14009b30 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc221c9640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c06c4f0 0x7fbc1c0cbde0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800c3c0 tx=0x7fbc1800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc12ffd640 1 -- 172.21.15.133:0/3650970632 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc180052d0 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc12ffd640 1 -- 172.21.15.133:0/3650970632 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc18005430 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1c0c6730 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc12ffd640 1 -- 172.21.15.133:0/3650970632 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18003840 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1c0cc320 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1c0735b0 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc12ffd640 1 -- 172.21.15.133:0/3650970632 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc180039a0 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc12ffd640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc00065a90 0x7fbc00067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc12ffd640 1 -- 172.21.15.133:0/3650970632 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fbc18082790 con 0x7fbc1c06c4f0 2023-12-18T10:25:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.885+0000 7fbc219c8640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc00065a90 0x7fbc00067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.889+0000 7fbc219c8640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc00065a90 0x7fbc00067f50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0c1200 tx=0x7fbc0c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:01.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:01.889+0000 7fbc12ffd640 1 -- 172.21.15.133:0/3650970632 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbc18050040 con 0x7fbc1c06c4f0 2023-12-18T10:25:02.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.093+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbc1c04e000 con 0x7fbc1c06c4f0 2023-12-18T10:25:02.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.093+0000 7fbc12ffd640 1 -- 172.21.15.133:0/3650970632 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1693 (secure 0 0 0) 0x7fbc18053660 con 0x7fbc1c06c4f0 2023-12-18T10:25:02.095 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:02.095 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":442,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706118,"bytes_used":265084928,"bytes_avail":772829028352,"bytes_total":773094113280,"write_bytes_sec":597,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"c","status":"up:active","gid":8109},{"filesystem_id":6,"rank":1,"name":"b","status":"up:active","gid":8118},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8127}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2023-12-18T10:25:01.185130+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:25:02.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc00065a90 msgr2=0x7fbc00067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc00065a90 0x7fbc00067f50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0c1200 tx=0x7fbc0c009190 comp rx=0 tx=0).stop 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c06c4f0 msgr2=0x7fbc1c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c06c4f0 0x7fbc1c0cbde0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800c3c0 tx=0x7fbc1800c880 comp rx=0 tx=0).stop 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 shutdown_connections 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbc00065a90 0x7fbc00067f50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc1c1570c0 0x7fbc1c14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbc1c0c9e30 0x7fbc1c148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 --2- 172.21.15.133:0/3650970632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1c06c4f0 0x7fbc1c0cbde0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 >> 172.21.15.133:0/3650970632 conn(0x7fbc1c06a3e0 msgr2=0x7fbc1c1584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 shutdown_connections 2023-12-18T10:25:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.097+0000 7fbc2442d640 1 -- 172.21.15.133:0/3650970632 wait complete. 2023-12-18T10:25:02.116 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-12-18T10:25:02.116 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:25:02.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:25:02.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:25:02.259 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:25:02.259 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:25:02.259 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:25:02.269 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:25:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4c16d640 1 Processor -- start 2023-12-18T10:25:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4c16d640 1 -- start start 2023-12-18T10:25:02.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4c16d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb4415a680 0x7fdb4415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4c16d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb4406fdb0 0x7fdb44070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4c16d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4415f100 con 0x7fdb440cac10 2023-12-18T10:25:02.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4c16d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb44070780 con 0x7fdb4415a680 2023-12-18T10:25:02.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4c16d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440ca7d0 con 0x7fdb4406fdb0 2023-12-18T10:25:02.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb49f09640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb4415a680 0x7fdb4415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb49708640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdb440cac10 0x7fdb4415aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58986/0 (socket says 172.21.15.133:58986) 2023-12-18T10:25:02.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb49708640 1 -- 172.21.15.133:0/891199258 learned_addr learned my addr 172.21.15.133:0/891199258 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:02.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb49f09640 1 -- 172.21.15.133:0/891199258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb4406fdb0 msgr2=0x7fdb44070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:02.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4a70a640 1 --2- 172.21.15.133:0/891199258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb4406fdb0 0x7fdb44070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb49f09640 1 --2- 172.21.15.133:0/891199258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb4406fdb0 0x7fdb44070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb49f09640 1 -- 172.21.15.133:0/891199258 >> v1:172.21.15.133:6789/0 conn(0x7fdb440cac10 legacy=0x7fdb4415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb48f07640 1 -- 172.21.15.133:0/891199258 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825587084 0 0) 0x7fdb4415f100 con 0x7fdb440cac10 2023-12-18T10:25:02.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb49f09640 1 -- 172.21.15.133:0/891199258 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4415e860 con 0x7fdb4415a680 2023-12-18T10:25:02.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.449+0000 7fdb4a70a640 1 --2- 172.21.15.133:0/891199258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb4406fdb0 0x7fdb44070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:02.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb49f09640 1 --2- 172.21.15.133:0/891199258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4415a680 0x7fdb4415e160 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fdb400097f0 tx=0x7fdb4001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b967fc09d0c75c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:02.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb48f07640 1 -- 172.21.15.133:0/891199258 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400ab5f0 con 0x7fdb4415a680 2023-12-18T10:25:02.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb48f07640 1 -- 172.21.15.133:0/891199258 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400ab750 con 0x7fdb4415a680 2023-12-18T10:25:02.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb48f07640 1 -- 172.21.15.133:0/891199258 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400abae0 con 0x7fdb4415a680 2023-12-18T10:25:02.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb4c16d640 1 -- 172.21.15.133:0/891199258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4415a680 msgr2=0x7fdb4415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/891199258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4415a680 0x7fdb4415e160 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fdb400097f0 tx=0x7fdb4001c3f0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb4c16d640 1 -- 172.21.15.133:0/891199258 shutdown_connections 2023-12-18T10:25:02.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/891199258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb4406fdb0 0x7fdb44070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/891199258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4415a680 0x7fdb4415e160 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb4c16d640 1 -- 172.21.15.133:0/891199258 >> 172.21.15.133:0/891199258 conn(0x7fdb4406a3e0 msgr2=0x7fdb440afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:02.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb4c16d640 1 -- 172.21.15.133:0/891199258 shutdown_connections 2023-12-18T10:25:02.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.453+0000 7fdb4c16d640 1 -- 172.21.15.133:0/891199258 wait complete. 2023-12-18T10:25:02.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 Processor -- start 2023-12-18T10:25:02.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 -- start start 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4406fdb0 0x7fdb44155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb440cac10 0x7fdb440b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb4415a680 0x7fdb440cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c6f80 con 0x7fdb4406fdb0 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c7b00 con 0x7fdb4415a680 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c7f90 con 0x7fdb440cac10 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4406fdb0 0x7fdb44155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4406fdb0 0x7fdb44155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50316/0 (socket says 172.21.15.133:50316) 2023-12-18T10:25:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 -- 172.21.15.133:0/150610208 learned_addr learned my addr 172.21.15.133:0/150610208 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 -- 172.21.15.133:0/150610208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb440cac10 msgr2=0x7fdb440b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb440cac10 0x7fdb440b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 -- 172.21.15.133:0/150610208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb4415a680 msgr2=0x7fdb440cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb4415a680 0x7fdb440cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 -- 172.21.15.133:0/150610208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb40009420 con 0x7fdb4406fdb0 2023-12-18T10:25:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb49f09640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4406fdb0 0x7fdb44155860 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fdb400ad040 tx=0x7fdb4001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb3a7fc640 1 -- 172.21.15.133:0/150610208 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40004230 con 0x7fdb4406fdb0 2023-12-18T10:25:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb3a7fc640 1 -- 172.21.15.133:0/150610208 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400b9070 con 0x7fdb4406fdb0 2023-12-18T10:25:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb3a7fc640 1 -- 172.21.15.133:0/150610208 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40003620 con 0x7fdb4406fdb0 2023-12-18T10:25:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb440c71d0 con 0x7fdb4406fdb0 2023-12-18T10:25:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb440c7790 con 0x7fdb4406fdb0 2023-12-18T10:25:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.457+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb440735b0 con 0x7fdb4406fdb0 2023-12-18T10:25:02.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.461+0000 7fdb3a7fc640 1 -- 172.21.15.133:0/150610208 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb40003780 con 0x7fdb4406fdb0 2023-12-18T10:25:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.461+0000 7fdb3a7fc640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdb28065a60 0x7fdb28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.461+0000 7fdb3a7fc640 1 -- 172.21.15.133:0/150610208 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fdb400bb070 con 0x7fdb4406fdb0 2023-12-18T10:25:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.461+0000 7fdb49708640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdb28065a60 0x7fdb28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.461+0000 7fdb49708640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdb28065a60 0x7fdb28067f20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdb440c8370 tx=0x7fdb34007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.465+0000 7fdb3a7fc640 1 -- 172.21.15.133:0/150610208 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdb400eb750 con 0x7fdb4406fdb0 2023-12-18T10:25:02.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb4404e000 con 0x7fdb4406fdb0 2023-12-18T10:25:02.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb3a7fc640 1 -- 172.21.15.133:0/150610208 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16491 (secure 0 0 0) 0x7fdb400c4090 con 0x7fdb4406fdb0 2023-12-18T10:25:02.617 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:02.617 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":93,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:24:48.068647+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:24:02.009135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-18T10:24:02.637830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:25:02.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdb28065a60 msgr2=0x7fdb28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdb28065a60 0x7fdb28067f20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdb440c8370 tx=0x7fdb34007970 comp rx=0 tx=0).stop 2023-12-18T10:25:02.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4406fdb0 msgr2=0x7fdb44155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4406fdb0 0x7fdb44155860 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fdb400ad040 tx=0x7fdb4001ac30 comp rx=0 tx=0).stop 2023-12-18T10:25:02.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 shutdown_connections 2023-12-18T10:25:02.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdb28065a60 0x7fdb28067f20 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb4415a680 0x7fdb440cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdb440cac10 0x7fdb440b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 --2- 172.21.15.133:0/150610208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb4406fdb0 0x7fdb44155860 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 >> 172.21.15.133:0/150610208 conn(0x7fdb4406a3e0 msgr2=0x7fdb4415caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:02.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.617+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 shutdown_connections 2023-12-18T10:25:02.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.621+0000 7fdb4c16d640 1 -- 172.21.15.133:0/150610208 wait complete. 2023-12-18T10:25:02.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:24:02.009135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:24:02.637830+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:25:02.639 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:25:02.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.777+0000 7f2e6202d640 1 Processor -- start 2023-12-18T10:25:02.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e6202d640 1 -- start start 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e6202d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c071870 0x7f2e5c071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e6202d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e5c0cbff0 0x7f2e5c0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e6202d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0cc960 con 0x7f2e5c0ca410 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e6202d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c15aab0 con 0x7f2e5c0cbff0 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e6202d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c070df0 con 0x7f2e5c071870 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e5c0ca410 0x7f2e5c159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58988/0 (socket says 172.21.15.133:58988) 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5b7fe640 1 -- 172.21.15.133:0/252467301 learned_addr learned my addr 172.21.15.133:0/252467301 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5bfff640 1 --2- 172.21.15.133:0/252467301 >> v2:172.21.15.133:3300/0 conn(0x7f2e5c0cbff0 0x7f2e5c0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5affd640 1 --2- 172.21.15.133:0/252467301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c071870 0x7f2e5c071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5a7fc640 1 -- 172.21.15.133:0/252467301 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696594209 0 0) 0x7f2e5c0cc960 con 0x7f2e5c0ca410 2023-12-18T10:25:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5a7fc640 1 -- 172.21.15.133:0/252467301 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e44005740 con 0x7f2e5c0ca410 2023-12-18T10:25:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5bfff640 1 -- 172.21.15.133:0/252467301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c071870 msgr2=0x7f2e5c071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5bfff640 1 --2- 172.21.15.133:0/252467301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c071870 0x7f2e5c071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5bfff640 1 -- 172.21.15.133:0/252467301 >> v1:172.21.15.133:6789/0 conn(0x7f2e5c0ca410 legacy=0x7f2e5c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.781+0000 7f2e5bfff640 1 -- 172.21.15.133:0/252467301 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c15a4f0 con 0x7f2e5c0cbff0 2023-12-18T10:25:02.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e5bfff640 1 --2- 172.21.15.133:0/252467301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0cbff0 0x7f2e5c0cc420 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009d90 tx=0x7f2e5401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee74d793381a5039 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:02.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e5a7fc640 1 -- 172.21.15.133:0/252467301 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e540a5950 con 0x7f2e5c0cbff0 2023-12-18T10:25:02.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e5a7fc640 1 -- 172.21.15.133:0/252467301 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e540a5ab0 con 0x7f2e5c0cbff0 2023-12-18T10:25:02.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e5a7fc640 1 -- 172.21.15.133:0/252467301 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e540a5e40 con 0x7f2e5c0cbff0 2023-12-18T10:25:02.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 -- 172.21.15.133:0/252467301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0cbff0 msgr2=0x7f2e5c0cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 --2- 172.21.15.133:0/252467301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0cbff0 0x7f2e5c0cc420 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009d90 tx=0x7f2e5401c890 comp rx=0 tx=0).stop 2023-12-18T10:25:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 -- 172.21.15.133:0/252467301 shutdown_connections 2023-12-18T10:25:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 --2- 172.21.15.133:0/252467301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0cbff0 0x7f2e5c0cc420 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 --2- 172.21.15.133:0/252467301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c071870 0x7f2e5c071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 -- 172.21.15.133:0/252467301 >> 172.21.15.133:0/252467301 conn(0x7f2e5c06a2a0 msgr2=0x7f2e5c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 -- 172.21.15.133:0/252467301 shutdown_connections 2023-12-18T10:25:02.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 -- 172.21.15.133:0/252467301 wait complete. 2023-12-18T10:25:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 Processor -- start 2023-12-18T10:25:02.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.785+0000 7f2e6202d640 1 -- start start 2023-12-18T10:25:02.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e5c071870 0x7f2e5c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0ca410 0x7f2e5c155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c0cbff0 0x7f2e5c1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0c39b0 con 0x7f2e5c0ca410 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c152790 con 0x7f2e5c071870 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0c2d30 con 0x7f2e5c0cbff0 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0ca410 0x7f2e5c155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0ca410 0x7f2e5c155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50344/0 (socket says 172.21.15.133:50344) 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 -- 172.21.15.133:0/3730911239 learned_addr learned my addr 172.21.15.133:0/3730911239 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5bfff640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c0cbff0 0x7f2e5c1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5b7fe640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e5c071870 0x7f2e5c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 -- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c0cbff0 msgr2=0x7f2e5c1556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c0cbff0 0x7f2e5c1556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 -- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e5c071870 msgr2=0x7f2e5c152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e5c071870 0x7f2e5c152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 -- 172.21.15.133:0/3730911239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54009a70 con 0x7f2e5c0ca410 2023-12-18T10:25:02.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5bfff640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c0cbff0 0x7f2e5c1556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:02.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e5affd640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0ca410 0x7f2e5c155180 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000e8a0 tx=0x7f2e5000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:02.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e43fff640 1 -- 172.21.15.133:0/3730911239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50009510 con 0x7f2e5c0ca410 2023-12-18T10:25:02.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e43fff640 1 -- 172.21.15.133:0/3730911239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5000c8e0 con 0x7f2e5c0ca410 2023-12-18T10:25:02.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c0c3010 con 0x7f2e5c0ca410 2023-12-18T10:25:02.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e43fff640 1 -- 172.21.15.133:0/3730911239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5000cc50 con 0x7f2e5c0ca410 2023-12-18T10:25:02.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c0c35d0 con 0x7f2e5c0ca410 2023-12-18T10:25:02.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.789+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c04e000 con 0x7f2e5c0ca410 2023-12-18T10:25:02.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.793+0000 7f2e43fff640 1 -- 172.21.15.133:0/3730911239 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2e50013470 con 0x7f2e5c0ca410 2023-12-18T10:25:02.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.793+0000 7f2e43fff640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e48065a90 0x7f2e48067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:02.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.793+0000 7f2e43fff640 1 -- 172.21.15.133:0/3730911239 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f2e50083400 con 0x7f2e5c0ca410 2023-12-18T10:25:02.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.793+0000 7f2e5b7fe640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e48065a90 0x7f2e48067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:02.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.793+0000 7f2e5b7fe640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e48065a90 0x7f2e48067f50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0011f0 tx=0x7f2e4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:02.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.797+0000 7f2e43fff640 1 -- 172.21.15.133:0/3730911239 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2e50050bf0 con 0x7f2e5c0ca410 2023-12-18T10:25:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.945+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e5c0c1ca0 con 0x7f2e5c0ca410 2023-12-18T10:25:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.945+0000 7f2e43fff640 1 -- 172.21.15.133:0/3730911239 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e50054210 con 0x7f2e5c0ca410 2023-12-18T10:25:02.946 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e48065a90 msgr2=0x7f2e48067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e48065a90 0x7f2e48067f50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0011f0 tx=0x7f2e4c009040 comp rx=0 tx=0).stop 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0ca410 msgr2=0x7f2e5c155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0ca410 0x7f2e5c155180 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000e8a0 tx=0x7f2e5000eca0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 shutdown_connections 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e48065a90 0x7f2e48067f50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e5c0cbff0 0x7f2e5c1556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e5c0ca410 0x7f2e5c155180 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 --2- 172.21.15.133:0/3730911239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e5c071870 0x7f2e5c152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 >> 172.21.15.133:0/3730911239 conn(0x7f2e5c06a2a0 msgr2=0x7f2e5c157e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:02.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 shutdown_connections 2023-12-18T10:25:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:02.949+0000 7f2e6202d640 1 -- 172.21.15.133:0/3730911239 wait complete. 2023-12-18T10:25:02.966 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:25:03.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd673a8c640 1 Processor -- start 2023-12-18T10:25:03.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd673a8c640 1 -- start start 2023-12-18T10:25:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd673a8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd66c071870 0x7fd66c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd673a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c0cbff0 0x7fd66c0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd673a8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66c0cc930 con 0x7fd66c0ca410 2023-12-18T10:25:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd673a8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66c15aab0 con 0x7fd66c071870 2023-12-18T10:25:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd673a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c070df0 con 0x7fd66c0cbff0 2023-12-18T10:25:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd671828640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd66c0ca410 0x7fd66c159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58990/0 (socket says 172.21.15.133:58990) 2023-12-18T10:25:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd671828640 1 -- 172.21.15.133:0/2340549925 learned_addr learned my addr 172.21.15.133:0/2340549925 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd671027640 1 --2- 172.21.15.133:0/2340549925 >> v2:172.21.15.133:3300/0 conn(0x7fd66c071870 0x7fd66c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd672029640 1 --2- 172.21.15.133:0/2340549925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c0cbff0 0x7fd66c0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd670826640 1 -- 172.21.15.133:0/2340549925 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958252085 0 0) 0x7fd66c0cc930 con 0x7fd66c0ca410 2023-12-18T10:25:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd670826640 1 -- 172.21.15.133:0/2340549925 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd658003530 con 0x7fd66c0ca410 2023-12-18T10:25:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd671027640 1 -- 172.21.15.133:0/2340549925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c0cbff0 msgr2=0x7fd66c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd671027640 1 --2- 172.21.15.133:0/2340549925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c0cbff0 0x7fd66c0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd671027640 1 -- 172.21.15.133:0/2340549925 >> v1:172.21.15.133:6789/0 conn(0x7fd66c0ca410 legacy=0x7fd66c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.109+0000 7fd671027640 1 -- 172.21.15.133:0/2340549925 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c15a4f0 con 0x7fd66c071870 2023-12-18T10:25:03.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd671027640 1 --2- 172.21.15.133:0/2340549925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c071870 0x7fd66c071d00 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0097c0 tx=0x7fd65c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5a167b778e7e8a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd670826640 1 -- 172.21.15.133:0/2340549925 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0ab650 con 0x7fd66c071870 2023-12-18T10:25:03.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd670826640 1 -- 172.21.15.133:0/2340549925 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c0ab7b0 con 0x7fd66c071870 2023-12-18T10:25:03.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd670826640 1 -- 172.21.15.133:0/2340549925 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0abb40 con 0x7fd66c071870 2023-12-18T10:25:03.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd673a8c640 1 -- 172.21.15.133:0/2340549925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c071870 msgr2=0x7fd66c071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd673a8c640 1 --2- 172.21.15.133:0/2340549925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c071870 0x7fd66c071d00 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0097c0 tx=0x7fd65c01c450 comp rx=0 tx=0).stop 2023-12-18T10:25:03.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd673a8c640 1 -- 172.21.15.133:0/2340549925 shutdown_connections 2023-12-18T10:25:03.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd673a8c640 1 --2- 172.21.15.133:0/2340549925 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c0cbff0 0x7fd66c0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd673a8c640 1 --2- 172.21.15.133:0/2340549925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c071870 0x7fd66c071d00 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd673a8c640 1 -- 172.21.15.133:0/2340549925 >> 172.21.15.133:0/2340549925 conn(0x7fd66c06a2a0 msgr2=0x7fd66c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:03.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd673a8c640 1 -- 172.21.15.133:0/2340549925 shutdown_connections 2023-12-18T10:25:03.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.113+0000 7fd673a8c640 1 -- 172.21.15.133:0/2340549925 wait complete. 2023-12-18T10:25:03.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 Processor -- start 2023-12-18T10:25:03.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 -- start start 2023-12-18T10:25:03.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c071870 0x7fd66c149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c0ca410 0x7fd66c0c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd66c0cbff0 0x7fd66c0c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c14b380 con 0x7fd66c0ca410 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c152010 con 0x7fd66c0cbff0 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c1528b0 con 0x7fd66c071870 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c0ca410 0x7fd66c0c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c0ca410 0x7fd66c0c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50356/0 (socket says 172.21.15.133:50356) 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 -- 172.21.15.133:0/1464530614 learned_addr learned my addr 172.21.15.133:0/1464530614 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671828640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c071870 0x7fd66c149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd672029640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd66c0cbff0 0x7fd66c0c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 -- 172.21.15.133:0/1464530614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c071870 msgr2=0x7fd66c149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c071870 0x7fd66c149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 -- 172.21.15.133:0/1464530614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd66c0cbff0 msgr2=0x7fd66c0c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd66c0cbff0 0x7fd66c0c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 -- 172.21.15.133:0/1464530614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c009420 con 0x7fd66c0ca410 2023-12-18T10:25:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd671027640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c0ca410 0x7fd66c0c5f00 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0ad040 tx=0x7fd65c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd6627fc640 1 -- 172.21.15.133:0/1464530614 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0b5810 con 0x7fd66c0ca410 2023-12-18T10:25:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd6627fc640 1 -- 172.21.15.133:0/1464530614 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c0b5990 con 0x7fd66c0ca410 2023-12-18T10:25:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c14a030 con 0x7fd66c0ca410 2023-12-18T10:25:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd6627fc640 1 -- 172.21.15.133:0/1464530614 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0b5d40 con 0x7fd66c0ca410 2023-12-18T10:25:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.117+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c152260 con 0x7fd66c0ca410 2023-12-18T10:25:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.121+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c0cc930 con 0x7fd66c0ca410 2023-12-18T10:25:03.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.121+0000 7fd6627fc640 1 -- 172.21.15.133:0/1464530614 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd65c0bf410 con 0x7fd66c0ca410 2023-12-18T10:25:03.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.121+0000 7fd6627fc640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd650065a60 0x7fd650067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.121+0000 7fd6627fc640 1 -- 172.21.15.133:0/1464530614 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd65c11e090 con 0x7fd66c0ca410 2023-12-18T10:25:03.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.121+0000 7fd671828640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd650065a60 0x7fd650067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.121+0000 7fd671828640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd650065a60 0x7fd650067f20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd668005890 tx=0x7fd668009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.125+0000 7fd6627fc640 1 -- 172.21.15.133:0/1464530614 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd65c0eb9d0 con 0x7fd66c0ca410 2023-12-18T10:25:03.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd66c04e000 con 0x7fd66c0ca410 2023-12-18T10:25:03.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd6627fc640 1 -- 172.21.15.133:0/1464530614 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd65c0ab610 con 0x7fd66c0ca410 2023-12-18T10:25:03.277 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd650065a60 msgr2=0x7fd650067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd650065a60 0x7fd650067f20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd668005890 tx=0x7fd668009040 comp rx=0 tx=0).stop 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c0ca410 msgr2=0x7fd66c0c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c0ca410 0x7fd66c0c5f00 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0ad040 tx=0x7fd65c01ac90 comp rx=0 tx=0).stop 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 shutdown_connections 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd650065a60 0x7fd650067f20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd66c0cbff0 0x7fd66c0c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd66c0ca410 0x7fd66c0c5f00 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 --2- 172.21.15.133:0/1464530614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd66c071870 0x7fd66c149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 >> 172.21.15.133:0/1464530614 conn(0x7fd66c06a2a0 msgr2=0x7fd66c154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 shutdown_connections 2023-12-18T10:25:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.277+0000 7fd673a8c640 1 -- 172.21.15.133:0/1464530614 wait complete. 2023-12-18T10:25:03.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:25:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.437+0000 7f14d7bf3640 1 Processor -- start 2023-12-18T10:25:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.437+0000 7f14d7bf3640 1 -- start start 2023-12-18T10:25:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.437+0000 7f14d7bf3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d01582d0 0x7f14d00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.437+0000 7f14d7bf3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14d00ce3b0 0x7f14d00ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.437+0000 7f14d7bf3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d00c9390 con 0x7f14d0070820 2023-12-18T10:25:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d7bf3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d00ced80 con 0x7f14d00ce3b0 2023-12-18T10:25:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d7bf3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d015aee0 con 0x7f14d01582d0 2023-12-18T10:25:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d6190640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14d00ce3b0 0x7f14d00ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d598f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d01582d0 0x7f14d00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d6190640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f14d00ce3b0 0x7f14d00ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:51382/0 (socket says 172.21.15.133:51382) 2023-12-18T10:25:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d6190640 1 -- 172.21.15.133:0/1016601603 learned_addr learned my addr 172.21.15.133:0/1016601603 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d598f640 1 -- 172.21.15.133:0/1016601603 >> v2:172.21.15.142:3300/0 conn(0x7f14d00ce3b0 msgr2=0x7f14d00ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d598f640 1 --2- 172.21.15.133:0/1016601603 >> v2:172.21.15.142:3300/0 conn(0x7f14d00ce3b0 0x7f14d00ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d598f640 1 -- 172.21.15.133:0/1016601603 >> v1:172.21.15.142:6789/0 conn(0x7f14d0070820 legacy=0x7f14d00ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d598f640 1 -- 172.21.15.133:0/1016601603 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d015b1c0 con 0x7f14d01582d0 2023-12-18T10:25:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.441+0000 7f14d598f640 1 --2- 172.21.15.133:0/1016601603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d01582d0 0x7f14d00c8e50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0097c0 tx=0x7f14cc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff627be4b7e1d74b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d498d640 1 -- 172.21.15.133:0/1016601603 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0ab650 con 0x7f14d01582d0 2023-12-18T10:25:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d498d640 1 -- 172.21.15.133:0/1016601603 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc0ab7b0 con 0x7f14d01582d0 2023-12-18T10:25:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d498d640 1 -- 172.21.15.133:0/1016601603 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0abb40 con 0x7f14d01582d0 2023-12-18T10:25:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 -- 172.21.15.133:0/1016601603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d01582d0 msgr2=0x7f14d00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/1016601603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d01582d0 0x7f14d00c8e50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0097c0 tx=0x7f14cc01c450 comp rx=0 tx=0).stop 2023-12-18T10:25:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 -- 172.21.15.133:0/1016601603 shutdown_connections 2023-12-18T10:25:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/1016601603 >> v2:172.21.15.142:3300/0 conn(0x7f14d00ce3b0 0x7f14d00ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/1016601603 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d01582d0 0x7f14d00c8e50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 -- 172.21.15.133:0/1016601603 >> 172.21.15.133:0/1016601603 conn(0x7f14d006a2a0 msgr2=0x7f14d00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 -- 172.21.15.133:0/1016601603 shutdown_connections 2023-12-18T10:25:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 -- 172.21.15.133:0/1016601603 wait complete. 2023-12-18T10:25:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 Processor -- start 2023-12-18T10:25:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.445+0000 7f14d7bf3640 1 -- start start 2023-12-18T10:25:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d0070820 0x7f14d00aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d00ce3b0 0x7f14d00c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01582d0 0x7f14d01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d01609e0 con 0x7f14d01582d0 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d0153180 con 0x7f14d0070820 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d015fdd0 con 0x7f14d00ce3b0 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01582d0 0x7f14d01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01582d0 0x7f14d01598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50362/0 (socket says 172.21.15.133:50362) 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 -- 172.21.15.133:0/2052850647 learned_addr learned my addr 172.21.15.133:0/2052850647 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d598f640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d0070820 0x7f14d00aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d518e640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d00ce3b0 0x7f14d00c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 -- 172.21.15.133:0/2052850647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d00ce3b0 msgr2=0x7f14d00c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d00ce3b0 0x7f14d00c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 -- 172.21.15.133:0/2052850647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d0070820 msgr2=0x7f14d00aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d0070820 0x7f14d00aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 -- 172.21.15.133:0/2052850647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009420 con 0x7f14d01582d0 2023-12-18T10:25:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d6190640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01582d0 0x7f14d01598d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f14c800efc0 tx=0x7f14c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14c67fc640 1 -- 172.21.15.133:0/2052850647 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800cd20 con 0x7f14d01582d0 2023-12-18T10:25:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14c67fc640 1 -- 172.21.15.133:0/2052850647 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c800f040 con 0x7f14d01582d0 2023-12-18T10:25:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14c67fc640 1 -- 172.21.15.133:0/2052850647 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8003be0 con 0x7f14d01582d0 2023-12-18T10:25:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d01600b0 con 0x7f14d01582d0 2023-12-18T10:25:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d0160670 con 0x7f14d01582d0 2023-12-18T10:25:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d0160b90 con 0x7f14d01582d0 2023-12-18T10:25:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.449+0000 7f14c67fc640 1 -- 172.21.15.133:0/2052850647 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14c8003d40 con 0x7f14d01582d0 2023-12-18T10:25:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.453+0000 7f14c67fc640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14b4065a60 0x7f14b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.453+0000 7f14c67fc640 1 -- 172.21.15.133:0/2052850647 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f14c8083850 con 0x7f14d01582d0 2023-12-18T10:25:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.453+0000 7f14d598f640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14b4065a60 0x7f14b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.453+0000 7f14d598f640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14b4065a60 0x7f14b4067f20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0af000 tx=0x7f14cc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.457+0000 7f14c67fc640 1 -- 172.21.15.133:0/2052850647 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f14d0160b90 con 0x7f14d01582d0 2023-12-18T10:25:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14d004e000 con 0x7f14d01582d0 2023-12-18T10:25:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14c67fc640 1 -- 172.21.15.133:0/2052850647 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14c80510f0 con 0x7f14d01582d0 2023-12-18T10:25:03.605 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:25:03.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14b4065a60 msgr2=0x7f14b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14b4065a60 0x7f14b4067f20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0af000 tx=0x7f14cc0a7000 comp rx=0 tx=0).stop 2023-12-18T10:25:03.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01582d0 msgr2=0x7f14d01598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01582d0 0x7f14d01598d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f14c800efc0 tx=0x7f14c800c490 comp rx=0 tx=0).stop 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 shutdown_connections 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f14b4065a60 0x7f14b4067f20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01582d0 0x7f14d01598d0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f14d00ce3b0 0x7f14d00c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 --2- 172.21.15.133:0/2052850647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14d0070820 0x7f14d00aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 >> 172.21.15.133:0/2052850647 conn(0x7f14d006a2a0 msgr2=0x7f14d015dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 shutdown_connections 2023-12-18T10:25:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.605+0000 7f14d7bf3640 1 -- 172.21.15.133:0/2052850647 wait complete. 2023-12-18T10:25:03.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:25:03.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b1d525640 1 Processor -- start 2023-12-18T10:25:03.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b1d525640 1 -- start start 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b1d525640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0b1815ca40 0x7f0b180cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b1d525640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0b180cf7e0 0x7f0b181668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b1d525640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b180d11c0 con 0x7f0b180ce3f0 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b1d525640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b180d0310 con 0x7f0b1815ca40 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b1d525640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b180d05b0 con 0x7f0b180cf7e0 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b16ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0b1815ca40 0x7f0b180cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b16ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0b1815ca40 0x7f0b180cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50374/0 (socket says 172.21.15.133:50374) 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b16ffd640 1 -- 172.21.15.133:0/2185652703 learned_addr learned my addr 172.21.15.133:0/2185652703 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b177fe640 1 --2- 172.21.15.133:0/2185652703 >> v2:172.21.15.142:3300/0 conn(0x7f0b180cf7e0 0x7f0b181668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b16ffd640 1 -- 172.21.15.133:0/2185652703 >> v2:172.21.15.142:3300/0 conn(0x7f0b180cf7e0 msgr2=0x7f0b181668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b16ffd640 1 --2- 172.21.15.133:0/2185652703 >> v2:172.21.15.142:3300/0 conn(0x7f0b180cf7e0 0x7f0b181668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b16ffd640 1 -- 172.21.15.133:0/2185652703 >> v1:172.21.15.142:6789/0 conn(0x7f0b180ce3f0 legacy=0x7f0b180cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:03.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.765+0000 7f0b16ffd640 1 -- 172.21.15.133:0/2185652703 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180d0890 con 0x7f0b1815ca40 2023-12-18T10:25:03.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b16ffd640 1 --2- 172.21.15.133:0/2185652703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b180cdeb0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f0b180ccd20 tx=0x7f0b0801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb3fe071b08ca02 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b167fc640 1 -- 172.21.15.133:0/2185652703 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080aa660 con 0x7f0b1815ca40 2023-12-18T10:25:03.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b167fc640 1 -- 172.21.15.133:0/2185652703 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b080aa7c0 con 0x7f0b1815ca40 2023-12-18T10:25:03.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b167fc640 1 -- 172.21.15.133:0/2185652703 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080aab50 con 0x7f0b1815ca40 2023-12-18T10:25:03.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b1d525640 1 -- 172.21.15.133:0/2185652703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 msgr2=0x7f0b180cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b1d525640 1 --2- 172.21.15.133:0/2185652703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b180cdeb0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f0b180ccd20 tx=0x7f0b0801c500 comp rx=0 tx=0).stop 2023-12-18T10:25:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b1d525640 1 -- 172.21.15.133:0/2185652703 shutdown_connections 2023-12-18T10:25:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b1d525640 1 --2- 172.21.15.133:0/2185652703 >> v2:172.21.15.142:3300/0 conn(0x7f0b180cf7e0 0x7f0b181668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b1d525640 1 --2- 172.21.15.133:0/2185652703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b180cdeb0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b1d525640 1 -- 172.21.15.133:0/2185652703 >> 172.21.15.133:0/2185652703 conn(0x7f0b18089fb0 msgr2=0x7f0b180d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b1d525640 1 -- 172.21.15.133:0/2185652703 shutdown_connections 2023-12-18T10:25:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.769+0000 7f0b1d525640 1 -- 172.21.15.133:0/2185652703 wait complete. 2023-12-18T10:25:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 Processor -- start 2023-12-18T10:25:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 -- start start 2023-12-18T10:25:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b180ce3f0 0x7f0b180c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b180cf7e0 0x7f0b18154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b181f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181550a0 con 0x7f0b1815ca40 2023-12-18T10:25:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181f67d0 con 0x7f0b180ce3f0 2023-12-18T10:25:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b180caf30 con 0x7f0b180cf7e0 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b181f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b16ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b180ce3f0 0x7f0b180c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b181f6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50386/0 (socket says 172.21.15.133:50386) 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 -- 172.21.15.133:0/1122447689 learned_addr learned my addr 172.21.15.133:0/1122447689 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b0e7fc640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b180cf7e0 0x7f0b18154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 -- 172.21.15.133:0/1122447689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b180cf7e0 msgr2=0x7f0b18154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b180cf7e0 0x7f0b18154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 -- 172.21.15.133:0/1122447689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b180ce3f0 msgr2=0x7f0b180c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b180ce3f0 0x7f0b180c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 -- 172.21.15.133:0/1122447689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08009480 con 0x7f0b1815ca40 2023-12-18T10:25:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b16ffd640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b180ce3f0 0x7f0b180c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:03.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b177fe640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b181f6290 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000d4f0 tx=0x7f0b1000d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b0ffff640 1 -- 172.21.15.133:0/1122447689 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b100125f0 con 0x7f0b1815ca40 2023-12-18T10:25:03.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b0ffff640 1 -- 172.21.15.133:0/1122447689 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b10012750 con 0x7f0b1815ca40 2023-12-18T10:25:03.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b180d17d0 con 0x7f0b1815ca40 2023-12-18T10:25:03.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b0ffff640 1 -- 172.21.15.133:0/1122447689 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10012b00 con 0x7f0b1815ca40 2023-12-18T10:25:03.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.773+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b180ca600 con 0x7f0b1815ca40 2023-12-18T10:25:03.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.777+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b180d1630 con 0x7f0b1815ca40 2023-12-18T10:25:03.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.777+0000 7f0b0ffff640 1 -- 172.21.15.133:0/1122447689 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0b10012c60 con 0x7f0b1815ca40 2023-12-18T10:25:03.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.777+0000 7f0b0ffff640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0af8065a60 0x7f0af8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:03.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.777+0000 7f0b0ffff640 1 -- 172.21.15.133:0/1122447689 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f0b10083640 con 0x7f0b1815ca40 2023-12-18T10:25:03.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.777+0000 7f0b16ffd640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0af8065a60 0x7f0af8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:03.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.777+0000 7f0b16ffd640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0af8065a60 0x7f0af8067f20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0b080ae000 tx=0x7f0b080a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.781+0000 7f0b0ffff640 1 -- 172.21.15.133:0/1122447689 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0b180d1630 con 0x7f0b1815ca40 2023-12-18T10:25:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.941+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0b18155200 con 0x7f0b1815ca40 2023-12-18T10:25:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.941+0000 7f0b0ffff640 1 -- 172.21.15.133:0/1122447689 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0b18155200 con 0x7f0b1815ca40 2023-12-18T10:25:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0af8065a60 msgr2=0x7f0af8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0af8065a60 0x7f0af8067f20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0b080ae000 tx=0x7f0b080a7000 comp rx=0 tx=0).stop 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 msgr2=0x7f0b181f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b181f6290 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000d4f0 tx=0x7f0b1000d9b0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 shutdown_connections 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0af8065a60 0x7f0af8067f20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b1815ca40 0x7f0b181f6290 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b180cf7e0 0x7f0b18154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 --2- 172.21.15.133:0/1122447689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b180ce3f0 0x7f0b180c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 >> 172.21.15.133:0/1122447689 conn(0x7f0b18089fb0 msgr2=0x7f0b180ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 shutdown_connections 2023-12-18T10:25:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:03.945+0000 7f0b1d525640 1 -- 172.21.15.133:0/1122447689 wait complete. 2023-12-18T10:25:03.963 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:25:03.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:03.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-18T10:25:03.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[58681]: fuse finished with error 0 and tester_r 0 2023-12-18T10:25:03.985 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:25:03.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:03.985 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-18T10:25:04.069 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:25:04.069 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:25:04.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:25:04.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:25:04.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:04.080 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-18T10:25:04.132 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-18T10:25:04.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:25:04.134 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:25:04.134 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:25:04.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:25:04.143 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:25:04.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:04.143 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-18T10:25:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-18T10:25:04.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:25:04.196 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:25:04.196 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:25:04.205 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:25:04.205 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:25:04.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:04.206 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-18T10:25:04.256 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-18T10:25:04.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:25:04.257 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.393+0000 7f8016a83640 1 Processor -- start 2023-12-18T10:25:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.393+0000 7f8016a83640 1 -- start start 2023-12-18T10:25:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8016a83640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8010160bd0 0x7f8010165000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8016a83640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80100c4550 con 0x7f80100c33d0 2023-12-18T10:25:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8016a83640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8010165540 con 0x7f80100afd10 2023-12-18T10:25:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8016a83640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80100c86f0 con 0x7f8010160bd0 2023-12-18T10:25:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8015a81640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8010160bd0 0x7f8010165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8015280640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f80100c33d0 0x7f80100c49e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58994/0 (socket says 172.21.15.133:58994) 2023-12-18T10:25:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8015280640 1 -- 172.21.15.133:0/747927829 learned_addr learned my addr 172.21.15.133:0/747927829 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:04.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8015a81640 1 -- 172.21.15.133:0/747927829 >> v1:172.21.15.142:6789/0 conn(0x7f80100afd10 legacy=0x7f801006fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:04.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8015a81640 1 -- 172.21.15.133:0/747927829 >> v1:172.21.15.133:6789/0 conn(0x7f80100c33d0 legacy=0x7f80100c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8015a81640 1 -- 172.21.15.133:0/747927829 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100c3940 con 0x7f8010160bd0 2023-12-18T10:25:04.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.397+0000 7f8014a7f640 1 -- 172.21.15.133:0/747927829 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574796867 0 0) 0x7f80100c4550 con 0x7f80100c33d0 2023-12-18T10:25:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8015a81640 1 --2- 172.21.15.133:0/747927829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f8010165000 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f800c0097c0 tx=0x7f800c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4231521c5f475a96 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8014a7f640 1 -- 172.21.15.133:0/747927829 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0a8930 con 0x7f8010160bd0 2023-12-18T10:25:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8014a7f640 1 -- 172.21.15.133:0/747927829 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c0a8a90 con 0x7f8010160bd0 2023-12-18T10:25:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8014a7f640 1 -- 172.21.15.133:0/747927829 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0a8e20 con 0x7f8010160bd0 2023-12-18T10:25:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- 172.21.15.133:0/747927829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 msgr2=0x7f8010165000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 --2- 172.21.15.133:0/747927829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f8010165000 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f800c0097c0 tx=0x7f800c01ec30 comp rx=0 tx=0).stop 2023-12-18T10:25:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- 172.21.15.133:0/747927829 shutdown_connections 2023-12-18T10:25:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 --2- 172.21.15.133:0/747927829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f8010165000 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- 172.21.15.133:0/747927829 >> 172.21.15.133:0/747927829 conn(0x7f80100ce130 msgr2=0x7f80100ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- 172.21.15.133:0/747927829 shutdown_connections 2023-12-18T10:25:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- 172.21.15.133:0/747927829 wait complete. 2023-12-18T10:25:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 Processor -- start 2023-12-18T10:25:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- start start 2023-12-18T10:25:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80100afd10 0x7f801015f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80100c33d0 0x7f801015f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f801015fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80101f61f0 con 0x7f8010160bd0 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801015e770 con 0x7f80100c33d0 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.401+0000 7f8016a83640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801015db60 con 0x7f80100afd10 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f801015fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f801015fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50412/0 (socket says 172.21.15.133:50412) 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 -- 172.21.15.133:0/93217715 learned_addr learned my addr 172.21.15.133:0/93217715 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8015280640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80100c33d0 0x7f801015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8015a81640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80100afd10 0x7f801015f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 -- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80100afd10 msgr2=0x7f801015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80100afd10 0x7f801015f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 -- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80100c33d0 msgr2=0x7f801015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80100c33d0 0x7f801015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 -- 172.21.15.133:0/93217715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c009420 con 0x7f8010160bd0 2023-12-18T10:25:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8015280640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80100c33d0 0x7f801015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016282640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f801015fe70 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f800800c780 tx=0x7f800800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f80067fc640 1 -- 172.21.15.133:0/93217715 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008004b70 con 0x7f8010160bd0 2023-12-18T10:25:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f80067fc640 1 -- 172.21.15.133:0/93217715 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800800ce90 con 0x7f8010160bd0 2023-12-18T10:25:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f80067fc640 1 -- 172.21.15.133:0/93217715 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800a850 con 0x7f8010160bd0 2023-12-18T10:25:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801015de40 con 0x7f8010160bd0 2023-12-18T10:25:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801015e400 con 0x7f8010160bd0 2023-12-18T10:25:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801015e920 con 0x7f8010160bd0 2023-12-18T10:25:04.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f80067fc640 1 -- 172.21.15.133:0/93217715 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f800800a9b0 con 0x7f8010160bd0 2023-12-18T10:25:04.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f80067fc640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7ff4065a60 0x7f7ff4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.405+0000 7f80067fc640 1 -- 172.21.15.133:0/93217715 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f80080834d0 con 0x7f8010160bd0 2023-12-18T10:25:04.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.409+0000 7f8015a81640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7ff4065a60 0x7f7ff4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.409+0000 7f8015a81640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7ff4065a60 0x7f7ff4067f20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f800c0b2000 tx=0x7f800c0aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:04.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.409+0000 7f80067fc640 1 -- 172.21.15.133:0/93217715 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f801015e920 con 0x7f8010160bd0 2023-12-18T10:25:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f801015e8e0 con 0x7f8010160bd0 2023-12-18T10:25:04.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f80067fc640 1 -- 172.21.15.133:0/93217715 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f8008054750 con 0x7f8010160bd0 2023-12-18T10:25:04.593 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:04.593 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:25:04.594 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:25:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7ff4065a60 msgr2=0x7f7ff4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7ff4065a60 0x7f7ff4067f20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f800c0b2000 tx=0x7f800c0aa070 comp rx=0 tx=0).stop 2023-12-18T10:25:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 msgr2=0x7f801015fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f801015fe70 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f800800c780 tx=0x7f800800cc40 comp rx=0 tx=0).stop 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 shutdown_connections 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7ff4065a60 0x7f7ff4067f20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8010160bd0 0x7f801015fe70 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80100c33d0 0x7f801015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 --2- 172.21.15.133:0/93217715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80100afd10 0x7f801015f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.593+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 >> 172.21.15.133:0/93217715 conn(0x7f80100ce130 msgr2=0x7f80100cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.597+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 shutdown_connections 2023-12-18T10:25:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.597+0000 7f8016a83640 1 -- 172.21.15.133:0/93217715 wait complete. 2023-12-18T10:25:04.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:25:04.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552fb60640 1 Processor -- start 2023-12-18T10:25:04.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552fb60640 1 -- start start 2023-12-18T10:25:04.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552fb60640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f552815ca40 0x7f55280cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552fb60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55280ce3f0 0x7f55280cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552fb60640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55280cfa70 con 0x7f55280cf610 2023-12-18T10:25:04.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552fb60640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55280d11c0 con 0x7f552815ca40 2023-12-18T10:25:04.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552fb60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55280d0310 con 0x7f55280ce3f0 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552d8fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f552815ca40 0x7f55280cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552e0fd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f55280cf610 0x7f55281605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58998/0 (socket says 172.21.15.133:58998) 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552d8fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f552815ca40 0x7f55280cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50418/0 (socket says 172.21.15.133:50418) 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552e0fd640 1 -- 172.21.15.133:0/3034850425 learned_addr learned my addr 172.21.15.133:0/3034850425 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552d0fb640 1 --2- 172.21.15.133:0/3034850425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55280ce3f0 0x7f55280cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552d8fc640 1 -- 172.21.15.133:0/3034850425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55280ce3f0 msgr2=0x7f55280cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552d8fc640 1 --2- 172.21.15.133:0/3034850425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55280ce3f0 0x7f55280cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552d8fc640 1 -- 172.21.15.133:0/3034850425 >> v1:172.21.15.133:6789/0 conn(0x7f55280cf610 legacy=0x7f55281605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552d8fc640 1 -- 172.21.15.133:0/3034850425 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55280d05b0 con 0x7f552815ca40 2023-12-18T10:25:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.753+0000 7f552c8fa640 1 -- 172.21.15.133:0/3034850425 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455849689 0 0) 0x7f55280cfa70 con 0x7f55280cf610 2023-12-18T10:25:04.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552d8fc640 1 --2- 172.21.15.133:0/3034850425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f552815ca40 0x7f55280cdeb0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f55240097a0 tx=0x7f552401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0961dc11cb3336 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:04.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552c8fa640 1 -- 172.21.15.133:0/3034850425 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240ad680 con 0x7f552815ca40 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552c8fa640 1 -- 172.21.15.133:0/3034850425 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55240ad7e0 con 0x7f552815ca40 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552c8fa640 1 -- 172.21.15.133:0/3034850425 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55240adb70 con 0x7f552815ca40 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552fb60640 1 -- 172.21.15.133:0/3034850425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f552815ca40 msgr2=0x7f55280cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552fb60640 1 --2- 172.21.15.133:0/3034850425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f552815ca40 0x7f55280cdeb0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f55240097a0 tx=0x7f552401c460 comp rx=0 tx=0).stop 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552fb60640 1 -- 172.21.15.133:0/3034850425 shutdown_connections 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552fb60640 1 --2- 172.21.15.133:0/3034850425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f55280ce3f0 0x7f55280cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552fb60640 1 --2- 172.21.15.133:0/3034850425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f552815ca40 0x7f55280cdeb0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552fb60640 1 -- 172.21.15.133:0/3034850425 >> 172.21.15.133:0/3034850425 conn(0x7f5528089fb0 msgr2=0x7f55280d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552fb60640 1 -- 172.21.15.133:0/3034850425 shutdown_connections 2023-12-18T10:25:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.757+0000 7f552fb60640 1 -- 172.21.15.133:0/3034850425 wait complete. 2023-12-18T10:25:04.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 Processor -- start 2023-12-18T10:25:04.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 -- start start 2023-12-18T10:25:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55280ce3f0 0x7f552814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55280cf610 0x7f552815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f552815ca40 0x7f55280cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5528159790 con 0x7f55280ce3f0 2023-12-18T10:25:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552814d9f0 con 0x7f55280cf610 2023-12-18T10:25:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552814dc40 con 0x7f552815ca40 2023-12-18T10:25:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55280ce3f0 0x7f552814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55280ce3f0 0x7f552814ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50420/0 (socket says 172.21.15.133:50420) 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 -- 172.21.15.133:0/1921759718 learned_addr learned my addr 172.21.15.133:0/1921759718 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d0fb640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55280cf610 0x7f552815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552e0fd640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f552815ca40 0x7f55280cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 -- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f552815ca40 msgr2=0x7f55280cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f552815ca40 0x7f55280cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 -- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55280cf610 msgr2=0x7f552815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55280cf610 0x7f552815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 -- 172.21.15.133:0/1921759718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240093b0 con 0x7f55280ce3f0 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d0fb640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55280cf610 0x7f552815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552d8fc640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55280ce3f0 0x7f552814ca40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f552401a090 tx=0x7f5524019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f551e7fc640 1 -- 172.21.15.133:0/1921759718 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524005db0 con 0x7f55280ce3f0 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f551e7fc640 1 -- 172.21.15.133:0/1921759718 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524004020 con 0x7f55280ce3f0 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552814df20 con 0x7f55280ce3f0 2023-12-18T10:25:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f551e7fc640 1 -- 172.21.15.133:0/1921759718 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524004390 con 0x7f55280ce3f0 2023-12-18T10:25:04.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552815bff0 con 0x7f55280ce3f0 2023-12-18T10:25:04.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.761+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552804e000 con 0x7f55280ce3f0 2023-12-18T10:25:04.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.765+0000 7f551e7fc640 1 -- 172.21.15.133:0/1921759718 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f55240b4040 con 0x7f55280ce3f0 2023-12-18T10:25:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.765+0000 7f551e7fc640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f550c065a60 0x7f550c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.765+0000 7f551e7fc640 1 -- 172.21.15.133:0/1921759718 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f552411d280 con 0x7f55280ce3f0 2023-12-18T10:25:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.765+0000 7f552d0fb640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f550c065a60 0x7f550c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.765+0000 7f552d0fb640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f550c065a60 0x7f550c067f20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f55280b2f50 tx=0x7f5518008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:04.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.769+0000 7f551e7fc640 1 -- 172.21.15.133:0/1921759718 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f55240eaa70 con 0x7f55280ce3f0 2023-12-18T10:25:04.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.917+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55280cff10 con 0x7f55280ce3f0 2023-12-18T10:25:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f551e7fc640 1 -- 172.21.15.133:0/1921759718 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16491 (secure 0 0 0) 0x7f55240044f0 con 0x7f55280ce3f0 2023-12-18T10:25:04.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:04.920 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":93,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:24:48.068647+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:24:02.009135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-18T10:24:02.637830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:25:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f550c065a60 msgr2=0x7f550c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f550c065a60 0x7f550c067f20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f55280b2f50 tx=0x7f5518008040 comp rx=0 tx=0).stop 2023-12-18T10:25:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55280ce3f0 msgr2=0x7f552814ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55280ce3f0 0x7f552814ca40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f552401a090 tx=0x7f5524019200 comp rx=0 tx=0).stop 2023-12-18T10:25:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 shutdown_connections 2023-12-18T10:25:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f550c065a60 0x7f550c067f20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f552815ca40 0x7f55280cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55280cf610 0x7f552815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 --2- 172.21.15.133:0/1921759718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55280ce3f0 0x7f552814ca40 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 >> 172.21.15.133:0/1921759718 conn(0x7f5528089fb0 msgr2=0x7f55280b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 shutdown_connections 2023-12-18T10:25:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:04.921+0000 7f552fb60640 1 -- 172.21.15.133:0/1921759718 wait complete. 2023-12-18T10:25:04.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:24:02.009135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:24:02.637830+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:25:04.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:25:05.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78329a2640 1 Processor -- start 2023-12-18T10:25:05.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78329a2640 1 -- start start 2023-12-18T10:25:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78329a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c0cdfd0 0x7f782c15e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78329a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f782c06bc50 0x7f782c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78329a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c160620 con 0x7f782c06ca30 2023-12-18T10:25:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78329a2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c06c0d0 con 0x7f782c06bc50 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78329a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c160870 con 0x7f782c0cdfd0 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f783119f640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f782c06ca30 0x7f782c0ce3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59014/0 (socket says 172.21.15.133:59014) 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f783119f640 1 -- 172.21.15.133:0/3760719960 learned_addr learned my addr 172.21.15.133:0/3760719960 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78319a0640 1 --2- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c0cdfd0 0x7f782c15e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78321a1640 1 --2- 172.21.15.133:0/3760719960 >> v2:172.21.15.142:3300/0 conn(0x7f782c06bc50 0x7f782c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f783099e640 1 -- 172.21.15.133:0/3760719960 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538157361 0 0) 0x7f782c160620 con 0x7f782c06ca30 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f783099e640 1 -- 172.21.15.133:0/3760719960 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7818003530 con 0x7f782c06ca30 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78321a1640 1 -- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c0cdfd0 msgr2=0x7f782c15e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78321a1640 1 --2- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c0cdfd0 0x7f782c15e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78321a1640 1 -- 172.21.15.133:0/3760719960 >> v1:172.21.15.133:6789/0 conn(0x7f782c06ca30 legacy=0x7f782c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78321a1640 1 -- 172.21.15.133:0/3760719960 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c160b50 con 0x7f782c06bc50 2023-12-18T10:25:05.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.085+0000 7f78319a0640 1 --2- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c0cdfd0 0x7f782c15e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:05.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78321a1640 1 --2- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06bc50 0x7f782c0d0610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7824009d90 tx=0x7f782401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e33df4cc6456114 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f783099e640 1 -- 172.21.15.133:0/3760719960 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240a5920 con 0x7f782c06bc50 2023-12-18T10:25:05.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f783099e640 1 -- 172.21.15.133:0/3760719960 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78240a5a80 con 0x7f782c06bc50 2023-12-18T10:25:05.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f783099e640 1 -- 172.21.15.133:0/3760719960 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240a5df0 con 0x7f782c06bc50 2023-12-18T10:25:05.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78329a2640 1 -- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06bc50 msgr2=0x7f782c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78329a2640 1 --2- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06bc50 0x7f782c0d0610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7824009d90 tx=0x7f782401c950 comp rx=0 tx=0).stop 2023-12-18T10:25:05.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78329a2640 1 -- 172.21.15.133:0/3760719960 shutdown_connections 2023-12-18T10:25:05.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78329a2640 1 --2- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06bc50 0x7f782c0d0610 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78329a2640 1 --2- 172.21.15.133:0/3760719960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c0cdfd0 0x7f782c15e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78329a2640 1 -- 172.21.15.133:0/3760719960 >> 172.21.15.133:0/3760719960 conn(0x7f782c069ca0 msgr2=0x7f782c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:05.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78329a2640 1 -- 172.21.15.133:0/3760719960 shutdown_connections 2023-12-18T10:25:05.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.089+0000 7f78329a2640 1 -- 172.21.15.133:0/3760719960 wait complete. 2023-12-18T10:25:05.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 Processor -- start 2023-12-18T10:25:05.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 -- start start 2023-12-18T10:25:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c06bc50 0x7f782c0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06ca30 0x7f782c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f782c0cdfd0 0x7f782c14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0af630 con 0x7f782c0cdfd0 2023-12-18T10:25:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0b4470 con 0x7f782c06ca30 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c156080 con 0x7f782c06bc50 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f782c0cdfd0 0x7f782c14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f782c0cdfd0 0x7f782c14ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50424/0 (socket says 172.21.15.133:50424) 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 -- 172.21.15.133:0/3328345886 learned_addr learned my addr 172.21.15.133:0/3328345886 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f783119f640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06ca30 0x7f782c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78319a0640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c06bc50 0x7f782c0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 -- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c06bc50 msgr2=0x7f782c0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c06bc50 0x7f782c0c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 -- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06ca30 msgr2=0x7f782c14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06ca30 0x7f782c14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 -- 172.21.15.133:0/3328345886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828009420 con 0x7f782c0cdfd0 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78319a0640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c06bc50 0x7f782c0c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78321a1640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f782c0cdfd0 0x7f782c14ef50 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f782401ce30 tx=0x7f78240196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78227fc640 1 -- 172.21.15.133:0/3328345886 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240a5920 con 0x7f782c0cdfd0 2023-12-18T10:25:05.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78227fc640 1 -- 172.21.15.133:0/3328345886 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824003db0 con 0x7f782c0cdfd0 2023-12-18T10:25:05.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78227fc640 1 -- 172.21.15.133:0/3328345886 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824004240 con 0x7f782c0cdfd0 2023-12-18T10:25:05.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7824009a70 con 0x7f782c0cdfd0 2023-12-18T10:25:05.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.093+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0b46c0 con 0x7f782c0cdfd0 2023-12-18T10:25:05.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.097+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c04e850 con 0x7f782c0cdfd0 2023-12-18T10:25:05.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.097+0000 7f78227fc640 1 -- 172.21.15.133:0/3328345886 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f78240b4070 con 0x7f782c0cdfd0 2023-12-18T10:25:05.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.097+0000 7f78227fc640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7810065a60 0x7f7810067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.097+0000 7f78227fc640 1 -- 172.21.15.133:0/3328345886 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f782411deb0 con 0x7f782c0cdfd0 2023-12-18T10:25:05.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.097+0000 7f78319a0640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7810065a60 0x7f7810067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.097+0000 7f78319a0640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7810065a60 0x7f7810067f20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7828009bd0 tx=0x7f7828008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.101+0000 7f78227fc640 1 -- 172.21.15.133:0/3328345886 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f78240eb6d0 con 0x7f782c0cdfd0 2023-12-18T10:25:05.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f782c0b2c20 con 0x7f782c0cdfd0 2023-12-18T10:25:05.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78227fc640 1 -- 172.21.15.133:0/3328345886 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78240eecf0 con 0x7f782c0cdfd0 2023-12-18T10:25:05.253 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7810065a60 msgr2=0x7f7810067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7810065a60 0x7f7810067f20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7828009bd0 tx=0x7f7828008040 comp rx=0 tx=0).stop 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f782c0cdfd0 msgr2=0x7f782c14ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f782c0cdfd0 0x7f782c14ef50 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f782401ce30 tx=0x7f78240196f0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 shutdown_connections 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7810065a60 0x7f7810067f20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f782c0cdfd0 0x7f782c14ef50 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f782c06ca30 0x7f782c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 --2- 172.21.15.133:0/3328345886 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f782c06bc50 0x7f782c0c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 >> 172.21.15.133:0/3328345886 conn(0x7f782c069ca0 msgr2=0x7f782c0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 shutdown_connections 2023-12-18T10:25:05.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.253+0000 7f78329a2640 1 -- 172.21.15.133:0/3328345886 wait complete. 2023-12-18T10:25:05.274 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:25:05.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.413+0000 7ff1e641f640 1 Processor -- start 2023-12-18T10:25:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.413+0000 7ff1e641f640 1 -- start start 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1e641f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1e0070820 0x7ff1e00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1e641f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e00c9390 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1e641f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e015aee0 con 0x7ff1e01582d0 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1e641f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e015b1c0 con 0x7ff1e0070820 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1e49bc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff1e00ce3b0 0x7ff1e00cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59024/0 (socket says 172.21.15.133:59024) 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1e49bc640 1 -- 172.21.15.133:0/1459522399 learned_addr learned my addr 172.21.15.133:0/1459522399 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1df7fe640 1 --2- 172.21.15.133:0/1459522399 >> v2:172.21.15.142:3300/0 conn(0x7ff1e0070820 0x7ff1e00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1deffd640 1 -- 172.21.15.133:0/1459522399 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204280284 0 0) 0x7ff1e00c9390 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1deffd640 1 -- 172.21.15.133:0/1459522399 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c8003530 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1df7fe640 1 -- 172.21.15.133:0/1459522399 >> v1:172.21.15.142:6789/0 conn(0x7ff1e01582d0 legacy=0x7ff1e00ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1df7fe640 1 -- 172.21.15.133:0/1459522399 >> v1:172.21.15.133:6789/0 conn(0x7ff1e00ce3b0 legacy=0x7ff1e00cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.417+0000 7ff1df7fe640 1 -- 172.21.15.133:0/1459522399 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e015b4a0 con 0x7ff1e0070820 2023-12-18T10:25:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1df7fe640 1 --2- 172.21.15.133:0/1459522399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0070820 0x7ff1e00c8e50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40097c0 tx=0x7ff1d401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfbbc655a2c87ac9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1deffd640 1 -- 172.21.15.133:0/1459522399 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40ab670 con 0x7ff1e0070820 2023-12-18T10:25:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1deffd640 1 -- 172.21.15.133:0/1459522399 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d40ab7d0 con 0x7ff1e0070820 2023-12-18T10:25:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1deffd640 1 -- 172.21.15.133:0/1459522399 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40abb60 con 0x7ff1e0070820 2023-12-18T10:25:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 -- 172.21.15.133:0/1459522399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0070820 msgr2=0x7ff1e00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 --2- 172.21.15.133:0/1459522399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0070820 0x7ff1e00c8e50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40097c0 tx=0x7ff1d401c450 comp rx=0 tx=0).stop 2023-12-18T10:25:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 -- 172.21.15.133:0/1459522399 shutdown_connections 2023-12-18T10:25:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 --2- 172.21.15.133:0/1459522399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e0070820 0x7ff1e00c8e50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 -- 172.21.15.133:0/1459522399 >> 172.21.15.133:0/1459522399 conn(0x7ff1e006a2a0 msgr2=0x7ff1e00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 -- 172.21.15.133:0/1459522399 shutdown_connections 2023-12-18T10:25:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 -- 172.21.15.133:0/1459522399 wait complete. 2023-12-18T10:25:05.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 Processor -- start 2023-12-18T10:25:05.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.421+0000 7ff1e641f640 1 -- start start 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e0070820 0x7ff1e00cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e00ce3b0 0x7ff1e01586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e01582d0 0x7ff1e0158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e015a830 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e01f9980 con 0x7ff1e01582d0 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e01f9bd0 con 0x7ff1e0070820 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e00ce3b0 0x7ff1e01586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e00ce3b0 0x7ff1e01586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50434/0 (socket says 172.21.15.133:50434) 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 -- 172.21.15.133:0/50061837 learned_addr learned my addr 172.21.15.133:0/50061837 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:05.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1dffff640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e0070820 0x7ff1e00cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e49bc640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e01582d0 0x7ff1e0158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 -- 172.21.15.133:0/50061837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e0070820 msgr2=0x7ff1e00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e0070820 0x7ff1e00cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 -- 172.21.15.133:0/50061837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e01582d0 msgr2=0x7ff1e0158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e01582d0 0x7ff1e0158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 -- 172.21.15.133:0/50061837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4009420 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1df7fe640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e00ce3b0 0x7ff1e01586e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4019060 tx=0x7ff1d401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1dcff9640 1 -- 172.21.15.133:0/50061837 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40bf610 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1dcff9640 1 -- 172.21.15.133:0/50061837 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d40bf790 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1dcff9640 1 -- 172.21.15.133:0/50061837 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40bfb40 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e01f9f10 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e01fa750 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e004e000 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.425+0000 7ff1dcff9640 1 -- 172.21.15.133:0/50061837 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff1d40b5400 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.429+0000 7ff1dcff9640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff1cc065a60 0x7ff1cc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.429+0000 7ff1dcff9640 1 -- 172.21.15.133:0/50061837 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff1d411de40 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.429+0000 7ff1dffff640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff1cc065a60 0x7ff1cc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.429+0000 7ff1dffff640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff1cc065a60 0x7ff1cc067f20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0007fd0 tx=0x7ff1d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.433+0000 7ff1dcff9640 1 -- 172.21.15.133:0/50061837 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff1d40eb800 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.577+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1e0166300 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1dcff9640 1 -- 172.21.15.133:0/50061837 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1d40eee20 con 0x7ff1e00ce3b0 2023-12-18T10:25:05.580 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff1cc065a60 msgr2=0x7ff1cc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff1cc065a60 0x7ff1cc067f20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0007fd0 tx=0x7ff1d0009040 comp rx=0 tx=0).stop 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e00ce3b0 msgr2=0x7ff1e01586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e00ce3b0 0x7ff1e01586e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4019060 tx=0x7ff1d401ac90 comp rx=0 tx=0).stop 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 shutdown_connections 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff1cc065a60 0x7ff1cc067f20 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1e01582d0 0x7ff1e0158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e00ce3b0 0x7ff1e01586e0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 --2- 172.21.15.133:0/50061837 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1e0070820 0x7ff1e00cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 >> 172.21.15.133:0/50061837 conn(0x7ff1e006a2a0 msgr2=0x7ff1e00aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:05.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 shutdown_connections 2023-12-18T10:25:05.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.581+0000 7ff1e641f640 1 -- 172.21.15.133:0/50061837 wait complete. 2023-12-18T10:25:05.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:25:05.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f02376b6640 1 Processor -- start 2023-12-18T10:25:05.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f02376b6640 1 -- start start 2023-12-18T10:25:05.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f02376b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02300ceac0 0x7f02300c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f02376b6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300c9390 con 0x7f02301582d0 2023-12-18T10:25:05.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f02376b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023015aee0 con 0x7f0230070820 2023-12-18T10:25:05.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f02376b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023015b1c0 con 0x7f02300ceac0 2023-12-18T10:25:05.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f0235c53640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02300ceac0 0x7f02300c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f0235c53640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02300ceac0 0x7f02300c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50446/0 (socket says 172.21.15.133:50446) 2023-12-18T10:25:05.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f0235c53640 1 -- 172.21.15.133:0/2038621740 learned_addr learned my addr 172.21.15.133:0/2038621740 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:05.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f0235c53640 1 -- 172.21.15.133:0/2038621740 >> v1:172.21.15.142:6789/0 conn(0x7f0230070820 legacy=0x7f02300ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:05.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f0227fff640 1 -- 172.21.15.133:0/2038621740 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395106171 0 0) 0x7f02300c9390 con 0x7f02301582d0 2023-12-18T10:25:05.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f0235c53640 1 -- 172.21.15.133:0/2038621740 >> v1:172.21.15.133:6789/0 conn(0x7f02301582d0 legacy=0x7f02300ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.741+0000 7f0235c53640 1 -- 172.21.15.133:0/2038621740 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023015b4a0 con 0x7f02300ceac0 2023-12-18T10:25:05.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f0235c53640 1 --2- 172.21.15.133:0/2038621740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f02300c8e50 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f0228009e50 tx=0x7f022801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbc102dcaa70615 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f0227fff640 1 -- 172.21.15.133:0/2038621740 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280a5880 con 0x7f02300ceac0 2023-12-18T10:25:05.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f0227fff640 1 -- 172.21.15.133:0/2038621740 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02280a59e0 con 0x7f02300ceac0 2023-12-18T10:25:05.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f0227fff640 1 -- 172.21.15.133:0/2038621740 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280a5d70 con 0x7f02300ceac0 2023-12-18T10:25:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f02376b6640 1 -- 172.21.15.133:0/2038621740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 msgr2=0x7f02300c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f02376b6640 1 --2- 172.21.15.133:0/2038621740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f02300c8e50 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f0228009e50 tx=0x7f022801c9a0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f02376b6640 1 -- 172.21.15.133:0/2038621740 shutdown_connections 2023-12-18T10:25:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f02376b6640 1 --2- 172.21.15.133:0/2038621740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f02300c8e50 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f02376b6640 1 -- 172.21.15.133:0/2038621740 >> 172.21.15.133:0/2038621740 conn(0x7f023006a2a0 msgr2=0x7f02300aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f02376b6640 1 -- 172.21.15.133:0/2038621740 shutdown_connections 2023-12-18T10:25:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.745+0000 7f02376b6640 1 -- 172.21.15.133:0/2038621740 wait complete. 2023-12-18T10:25:05.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 Processor -- start 2023-12-18T10:25:05.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 -- start start 2023-12-18T10:25:05.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0230070820 0x7f023014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f0230152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301582d0 0x7f023014ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300cd1f0 con 0x7f02300ceac0 2023-12-18T10:25:05.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301502e0 con 0x7f0230070820 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300ccba0 con 0x7f02301582d0 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f0230152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f0230152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50460/0 (socket says 172.21.15.133:50460) 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 -- 172.21.15.133:0/3048746660 learned_addr learned my addr 172.21.15.133:0/3048746660 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0235452640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0230070820 0x7f023014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0235c53640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301582d0 0x7f023014ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 -- 172.21.15.133:0/3048746660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301582d0 msgr2=0x7f023014ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301582d0 0x7f023014ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 -- 172.21.15.133:0/3048746660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0230070820 msgr2=0x7f023014d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0230070820 0x7f023014d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 -- 172.21.15.133:0/3048746660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009b30 con 0x7f02300ceac0 2023-12-18T10:25:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0234c51640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f0230152250 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f022000c450 tx=0x7f022000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0225ffb640 1 -- 172.21.15.133:0/3048746660 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220012830 con 0x7f02300ceac0 2023-12-18T10:25:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f0225ffb640 1 -- 172.21.15.133:0/3048746660 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02200129b0 con 0x7f02300ceac0 2023-12-18T10:25:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.749+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02300cce80 con 0x7f02300ceac0 2023-12-18T10:25:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.753+0000 7f0225ffb640 1 -- 172.21.15.133:0/3048746660 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220012d60 con 0x7f02300ceac0 2023-12-18T10:25:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.753+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230152790 con 0x7f02300ceac0 2023-12-18T10:25:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.753+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02300cca00 con 0x7f02300ceac0 2023-12-18T10:25:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.753+0000 7f0225ffb640 1 -- 172.21.15.133:0/3048746660 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f022001c460 con 0x7f02300ceac0 2023-12-18T10:25:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.753+0000 7f0225ffb640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0214065a60 0x7f0214067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.753+0000 7f0225ffb640 1 -- 172.21.15.133:0/3048746660 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f0220083130 con 0x7f02300ceac0 2023-12-18T10:25:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.753+0000 7f0235452640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0214065a60 0x7f0214067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.753+0000 7f0235452640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0214065a60 0x7f0214067f20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f022c007fd0 tx=0x7f022c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:05.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.757+0000 7f0225ffb640 1 -- 172.21.15.133:0/3048746660 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f02300cca00 con 0x7f02300ceac0 2023-12-18T10:25:05.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.905+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02300cca00 con 0x7f02300ceac0 2023-12-18T10:25:05.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.905+0000 7f0225ffb640 1 -- 172.21.15.133:0/3048746660 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02300cca00 con 0x7f02300ceac0 2023-12-18T10:25:05.907 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:25:05.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0214065a60 msgr2=0x7f0214067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0214065a60 0x7f0214067f20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f022c007fd0 tx=0x7f022c009040 comp rx=0 tx=0).stop 2023-12-18T10:25:05.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 msgr2=0x7f0230152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f0230152250 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f022000c450 tx=0x7f022000c910 comp rx=0 tx=0).stop 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 shutdown_connections 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0214065a60 0x7f0214067f20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02301582d0 0x7f023014ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02300ceac0 0x7f0230152250 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 --2- 172.21.15.133:0/3048746660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0230070820 0x7f023014d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 >> 172.21.15.133:0/3048746660 conn(0x7f023006a2a0 msgr2=0x7f0230157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 shutdown_connections 2023-12-18T10:25:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:05.909+0000 7f02376b6640 1 -- 172.21.15.133:0/3048746660 wait complete. 2023-12-18T10:25:05.930 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:06.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5f5151640 1 Processor -- start 2023-12-18T10:25:06.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5f5151640 1 -- start start 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5f5151640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe5f015c730 0x7fe5f00b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5f5151640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5f00cea00 0x7fe5f00cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5f5151640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f00b65c0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5f5151640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f015cb10 con 0x7fe5f00cea00 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5f5151640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00b84c0 con 0x7fe5f015c730 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5ef7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5f00cea00 0x7fe5f00cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5ef7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5f00cea00 0x7fe5f00cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50464/0 (socket says 172.21.15.133:50464) 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5ef7fe640 1 -- 172.21.15.133:0/3526552221 learned_addr learned my addr 172.21.15.133:0/3526552221 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5effff640 1 --2- 172.21.15.133:0/3526552221 >> v2:172.21.15.142:3300/0 conn(0x7fe5f015c730 0x7fe5f00b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5ef7fe640 1 -- 172.21.15.133:0/3526552221 >> v2:172.21.15.142:3300/0 conn(0x7fe5f015c730 msgr2=0x7fe5f00b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:06.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5ef7fe640 1 --2- 172.21.15.133:0/3526552221 >> v2:172.21.15.142:3300/0 conn(0x7fe5f015c730 0x7fe5f00b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5ef7fe640 1 -- 172.21.15.133:0/3526552221 >> v1:172.21.15.142:6789/0 conn(0x7fe5f00cd3a0 legacy=0x7fe5f00b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:06.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.069+0000 7fe5ef7fe640 1 -- 172.21.15.133:0/3526552221 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00cd960 con 0x7fe5f00cea00 2023-12-18T10:25:06.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5ef7fe640 1 --2- 172.21.15.133:0/3526552221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cea00 0x7fe5f00cef60 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00d33f0 tx=0x7fe5e401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd03931817694ab server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5eeffd640 1 -- 172.21.15.133:0/3526552221 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40ac600 con 0x7fe5f00cea00 2023-12-18T10:25:06.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5eeffd640 1 -- 172.21.15.133:0/3526552221 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e40a8050 con 0x7fe5f00cea00 2023-12-18T10:25:06.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5eeffd640 1 -- 172.21.15.133:0/3526552221 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40ac980 con 0x7fe5f00cea00 2023-12-18T10:25:06.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5f5151640 1 -- 172.21.15.133:0/3526552221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cea00 msgr2=0x7fe5f00cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3526552221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cea00 0x7fe5f00cef60 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00d33f0 tx=0x7fe5e401c490 comp rx=0 tx=0).stop 2023-12-18T10:25:06.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5f5151640 1 -- 172.21.15.133:0/3526552221 shutdown_connections 2023-12-18T10:25:06.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3526552221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cea00 0x7fe5f00cef60 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3526552221 >> v2:172.21.15.142:3300/0 conn(0x7fe5f015c730 0x7fe5f00b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5f5151640 1 -- 172.21.15.133:0/3526552221 >> 172.21.15.133:0/3526552221 conn(0x7fe5f006b120 msgr2=0x7fe5f006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:06.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5f5151640 1 -- 172.21.15.133:0/3526552221 shutdown_connections 2023-12-18T10:25:06.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.073+0000 7fe5f5151640 1 -- 172.21.15.133:0/3526552221 wait complete. 2023-12-18T10:25:06.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 Processor -- start 2023-12-18T10:25:06.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 -- start start 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cd3a0 0x7fe5f01538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f00cea00 0x7fe5f015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f015c730 0x7fe5f015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f015d3d0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f014cd90 con 0x7fe5f015c730 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f015cd50 con 0x7fe5f00cea00 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cd3a0 0x7fe5f01538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cd3a0 0x7fe5f01538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50468/0 (socket says 172.21.15.133:50468) 2023-12-18T10:25:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 -- 172.21.15.133:0/3452811217 learned_addr learned my addr 172.21.15.133:0/3452811217 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5ef7fe640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f00cea00 0x7fe5f015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f4950640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f015c730 0x7fe5f015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 -- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f00cea00 msgr2=0x7fe5f015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f00cea00 0x7fe5f015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 -- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f015c730 msgr2=0x7fe5f015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f015c730 0x7fe5f015dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 -- 172.21.15.133:0/3452811217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40094d0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f4950640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f015c730 0x7fe5f015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5effff640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cd3a0 0x7fe5f01538b0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000d620 tx=0x7fe5e000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5ecff9640 1 -- 172.21.15.133:0/3452811217 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e000b620 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5ecff9640 1 -- 172.21.15.133:0/3452811217 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e000b780 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5ecff9640 1 -- 172.21.15.133:0/3452811217 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e000bb10 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f015f2b0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.077+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f0153df0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.081+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f0153fe0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.081+0000 7fe5ecff9640 1 -- 172.21.15.133:0/3452811217 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe5e000bc70 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.081+0000 7fe5ecff9640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe5dc065a60 0x7fe5dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.081+0000 7fe5ecff9640 1 -- 172.21.15.133:0/3452811217 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fe5e0083870 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.081+0000 7fe5ef7fe640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe5dc065a60 0x7fe5dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.081+0000 7fe5ef7fe640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe5dc065a60 0x7fe5dc067f20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40ae000 tx=0x7fe5e40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.085+0000 7fe5ecff9640 1 -- 172.21.15.133:0/3452811217 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe5f0153fe0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.265+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5f0153fe0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5ecff9640 1 -- 172.21.15.133:0/3452811217 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7fe5f0153fe0 con 0x7fe5f00cd3a0 2023-12-18T10:25:06.268 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:06.268 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:25:06.268 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe5dc065a60 msgr2=0x7fe5dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe5dc065a60 0x7fe5dc067f20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40ae000 tx=0x7fe5e40a7000 comp rx=0 tx=0).stop 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cd3a0 msgr2=0x7fe5f01538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cd3a0 0x7fe5f01538b0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000d620 tx=0x7fe5e000dae0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 shutdown_connections 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe5dc065a60 0x7fe5dc067f20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe5f015c730 0x7fe5f015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5f00cea00 0x7fe5f015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 --2- 172.21.15.133:0/3452811217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f00cd3a0 0x7fe5f01538b0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 >> 172.21.15.133:0/3452811217 conn(0x7fe5f006b120 msgr2=0x7fe5f01509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:06.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 shutdown_connections 2023-12-18T10:25:06.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.269+0000 7fe5f5151640 1 -- 172.21.15.133:0/3452811217 wait complete. 2023-12-18T10:25:06.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:25:06.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.425+0000 7f65c5f6d640 1 Processor -- start 2023-12-18T10:25:06.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.425+0000 7f65c5f6d640 1 -- start start 2023-12-18T10:25:06.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65c5f6d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65c0158c20 0x7f65c0070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65c5f6d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c00ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65c5f6d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c0070b80 con 0x7f65c015c800 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65c5f6d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c0070e60 con 0x7f65c0158c20 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65c5f6d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0071140 con 0x7f65c00cb180 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65bf7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65c0158c20 0x7f65c0070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65bf7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65c0158c20 0x7f65c0070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50476/0 (socket says 172.21.15.133:50476) 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65bf7fe640 1 -- 172.21.15.133:0/807978613 learned_addr learned my addr 172.21.15.133:0/807978613 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65bffff640 1 --2- 172.21.15.133:0/807978613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c00ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65bf7fe640 1 -- 172.21.15.133:0/807978613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 msgr2=0x7f65c00ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:06.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65bf7fe640 1 --2- 172.21.15.133:0/807978613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c00ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65bf7fe640 1 -- 172.21.15.133:0/807978613 >> v1:172.21.15.142:6789/0 conn(0x7f65c015c800 legacy=0x7f65c00caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:06.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.429+0000 7f65bf7fe640 1 -- 172.21.15.133:0/807978613 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c0071420 con 0x7f65c0158c20 2023-12-18T10:25:06.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65bf7fe640 1 --2- 172.21.15.133:0/807978613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0070510 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009870 tx=0x7f65b001dfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fbf8fb194232e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65beffd640 1 -- 172.21.15.133:0/807978613 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00ab620 con 0x7f65c0158c20 2023-12-18T10:25:06.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65beffd640 1 -- 172.21.15.133:0/807978613 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00ab780 con 0x7f65c0158c20 2023-12-18T10:25:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65beffd640 1 -- 172.21.15.133:0/807978613 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00abb10 con 0x7f65c0158c20 2023-12-18T10:25:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 -- 172.21.15.133:0/807978613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 msgr2=0x7f65c0070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/807978613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0070510 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009870 tx=0x7f65b001dfb0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 -- 172.21.15.133:0/807978613 shutdown_connections 2023-12-18T10:25:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/807978613 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c00ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/807978613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0070510 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 -- 172.21.15.133:0/807978613 >> 172.21.15.133:0/807978613 conn(0x7f65c006a3e0 msgr2=0x7f65c00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 -- 172.21.15.133:0/807978613 shutdown_connections 2023-12-18T10:25:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 -- 172.21.15.133:0/807978613 wait complete. 2023-12-18T10:25:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 Processor -- start 2023-12-18T10:25:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 -- start start 2023-12-18T10:25:06.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c0144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.433+0000 7f65c5f6d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c015c800 0x7f65c015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65c5f6d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c0146b90 con 0x7f65c0158c20 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65c5f6d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c01452d0 con 0x7f65c015c800 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65c5f6d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c01455b0 con 0x7f65c00cb180 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50490/0 (socket says 172.21.15.133:50490) 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 -- 172.21.15.133:0/1436514379 learned_addr learned my addr 172.21.15.133:0/1436514379 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65bffff640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c015c800 0x7f65c015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65bf7fe640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c0144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 -- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 msgr2=0x7f65c0144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c0144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 -- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c015c800 msgr2=0x7f65c015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c015c800 0x7f65c015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 -- 172.21.15.133:0/1436514379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00094d0 con 0x7f65c0158c20 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65bf7fe640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c0144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65b7fff640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0146650 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f65a800b410 tx=0x7f65a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65bcff9640 1 -- 172.21.15.133:0/1436514379 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8004020 con 0x7f65c0158c20 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65bcff9640 1 -- 172.21.15.133:0/1436514379 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8004180 con 0x7f65c0158c20 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c00c8800 con 0x7f65c0158c20 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65bcff9640 1 -- 172.21.15.133:0/1436514379 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8011630 con 0x7f65c0158c20 2023-12-18T10:25:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c0145b70 con 0x7f65c0158c20 2023-12-18T10:25:06.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c00735b0 con 0x7f65c0158c20 2023-12-18T10:25:06.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.437+0000 7f65bcff9640 1 -- 172.21.15.133:0/1436514379 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f65a8011790 con 0x7f65c0158c20 2023-12-18T10:25:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.441+0000 7f65bcff9640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65a0065a60 0x7f65a0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.441+0000 7f65bcff9640 1 -- 172.21.15.133:0/1436514379 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f65a80830f0 con 0x7f65c0158c20 2023-12-18T10:25:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.441+0000 7f65bf7fe640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65a0065a60 0x7f65a0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.441+0000 7f65bf7fe640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65a0065a60 0x7f65a0067f20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f65b00af000 tx=0x7f65b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.445+0000 7f65bcff9640 1 -- 172.21.15.133:0/1436514379 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f65a80508f0 con 0x7f65c0158c20 2023-12-18T10:25:06.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.593+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c004e000 con 0x7f65c0158c20 2023-12-18T10:25:06.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.593+0000 7f65bcff9640 1 -- 172.21.15.133:0/1436514379 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16491 (secure 0 0 0) 0x7f65a8053f10 con 0x7f65c0158c20 2023-12-18T10:25:06.595 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:06.595 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":93,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:24:48.068647+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:24:02.009135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-18T10:24:02.637830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65a0065a60 msgr2=0x7f65a0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65a0065a60 0x7f65a0067f20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f65b00af000 tx=0x7f65b0008040 comp rx=0 tx=0).stop 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 msgr2=0x7f65c0146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0146650 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f65a800b410 tx=0x7f65a800b8d0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 shutdown_connections 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f65a0065a60 0x7f65a0067f20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65c015c800 0x7f65c015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65c0158c20 0x7f65c0146650 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 --2- 172.21.15.133:0/1436514379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f65c00cb180 0x7f65c0144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 >> 172.21.15.133:0/1436514379 conn(0x7f65c006a3e0 msgr2=0x7f65c00ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 shutdown_connections 2023-12-18T10:25:06.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.597+0000 7f65c5f6d640 1 -- 172.21.15.133:0/1436514379 wait complete. 2023-12-18T10:25:06.616 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-18T10:25:06.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:06.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcefac4640 1 Processor -- start 2023-12-18T10:25:06.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcefac4640 1 -- start start 2023-12-18T10:25:06.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcefac4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdce80cf0d0 0x7fdce80cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcefac4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce81648d0 0x7fdce8166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcefac4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce80cfa70 con 0x7fdce815ca40 2023-12-18T10:25:06.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcefac4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce80d11c0 con 0x7fdce80cf0d0 2023-12-18T10:25:06.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcefac4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80d0310 con 0x7fdce81648d0 2023-12-18T10:25:06.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdced860640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdce815ca40 0x7fdce80cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59052/0 (socket says 172.21.15.133:59052) 2023-12-18T10:25:06.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdced860640 1 -- 172.21.15.133:0/2624122358 learned_addr learned my addr 172.21.15.133:0/2624122358 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdced05f640 1 --2- 172.21.15.133:0/2624122358 >> v2:172.21.15.142:3300/0 conn(0x7fdce80cf0d0 0x7fdce80cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcee061640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce81648d0 0x7fdce8166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11618820 0 0) 0x7fdce80cfa70 con 0x7fdce815ca40 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcd4003530 con 0x7fdce815ca40 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3027469719 0 0) 0x7fdcd4003530 con 0x7fdce815ca40 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce81648d0 msgr2=0x7fdce8166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce81648d0 0x7fdce8166cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 >> v2:172.21.15.142:3300/0 conn(0x7fdce80cf0d0 msgr2=0x7fdce80cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 --2- 172.21.15.133:0/2624122358 >> v2:172.21.15.142:3300/0 conn(0x7fdce80cf0d0 0x7fdce80cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce80d05b0 con 0x7fdce815ca40 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fdce4001800 con 0x7fdce815ca40 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 >> v1:172.21.15.133:6789/0 conn(0x7fdce815ca40 legacy=0x7fdce80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd4003980 0x7fdcd4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.753+0000 7fdcec85e640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd40047d0 0x7fdcd4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdcec85e640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce81648d0 0x7fdcd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80d11c0 con 0x7fdcd4003980 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80d0310 con 0x7fdcd40047d0 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd400b990 con 0x7fdce81648d0 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdced860640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd4003980 0x7fdcd4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdcee061640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce81648d0 0x7fdcd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdced05f640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd40047d0 0x7fdcd4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdced860640 1 -- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce81648d0 msgr2=0x7fdcd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdced860640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdce81648d0 0x7fdcd4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdced860640 1 -- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd40047d0 msgr2=0x7fdcd4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdced860640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcd40047d0 0x7fdcd4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdced860640 1 -- 172.21.15.133:0/2624122358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4003530 con 0x7fdcd4003980 2023-12-18T10:25:06.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdced860640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd4003980 0x7fdcd4003da0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fdce400c240 tx=0x7fdce401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec20e84b186a2a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40070d0 con 0x7fdcd4003980 2023-12-18T10:25:06.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce4007230 con 0x7fdcd4003980 2023-12-18T10:25:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.757+0000 7fdcec85e640 1 -- 172.21.15.133:0/2624122358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40075c0 con 0x7fdcd4003980 2023-12-18T10:25:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- 172.21.15.133:0/2624122358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd4003980 msgr2=0x7fdcd4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 --2- 172.21.15.133:0/2624122358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd4003980 0x7fdcd4003da0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fdce400c240 tx=0x7fdce401cc30 comp rx=0 tx=0).stop 2023-12-18T10:25:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcee061640 1 -- 172.21.15.133:0/2624122358 reap_dead start 2023-12-18T10:25:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- 172.21.15.133:0/2624122358 shutdown_connections 2023-12-18T10:25:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- 172.21.15.133:0/2624122358 >> 172.21.15.133:0/2624122358 conn(0x7fdce8089fb0 msgr2=0x7fdce80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- 172.21.15.133:0/2624122358 shutdown_connections 2023-12-18T10:25:06.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- 172.21.15.133:0/2624122358 wait complete. 2023-12-18T10:25:06.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 Processor -- start 2023-12-18T10:25:06.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- start start 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd4003980 0x7fdce80b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80b52a0 0x7fdce80b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815f570 0x7fdce815f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b5c60 con 0x7fdce815f570 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce815ff30 con 0x7fdce80b52a0 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcefac4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80ca900 con 0x7fdcd4003980 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcee061640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815f570 0x7fdce815f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcee061640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815f570 0x7fdce815f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50518/0 (socket says 172.21.15.133:50518) 2023-12-18T10:25:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdcee061640 1 -- 172.21.15.133:0/2758592400 learned_addr learned my addr 172.21.15.133:0/2758592400 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdced860640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd4003980 0x7fdce80b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.761+0000 7fdced05f640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80b52a0 0x7fdce80b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcee061640 1 -- 172.21.15.133:0/2758592400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd4003980 msgr2=0x7fdce80b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcee061640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd4003980 0x7fdce80b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcee061640 1 -- 172.21.15.133:0/2758592400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80b52a0 msgr2=0x7fdce80b5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcee061640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80b52a0 0x7fdce80b5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcee061640 1 -- 172.21.15.133:0/2758592400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce80b7990 con 0x7fdce815f570 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcee061640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815f570 0x7fdce815f9f0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fdce8067060 tx=0x7fdce0011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcde7fc640 1 -- 172.21.15.133:0/2758592400 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000e040 con 0x7fdce815f570 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcde7fc640 1 -- 172.21.15.133:0/2758592400 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce000f040 con 0x7fdce815f570 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcde7fc640 1 -- 172.21.15.133:0/2758592400 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0015430 con 0x7fdce815f570 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce80b7c70 con 0x7fdce815f570 2023-12-18T10:25:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce80b8230 con 0x7fdce815f570 2023-12-18T10:25:06.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce80cab00 con 0x7fdce815f570 2023-12-18T10:25:06.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcde7fc640 1 -- 172.21.15.133:0/2758592400 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdce0015590 con 0x7fdce815f570 2023-12-18T10:25:06.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcde7fc640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065a90 0x7fdccc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:06.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdcde7fc640 1 -- 172.21.15.133:0/2758592400 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fdce0083be0 con 0x7fdce815f570 2023-12-18T10:25:06.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.765+0000 7fdced860640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065a90 0x7fdccc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:06.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.769+0000 7fdced860640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065a90 0x7fdccc067f50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdce40aa000 tx=0x7fdce40b0040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:06.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.769+0000 7fdcde7fc640 1 -- 172.21.15.133:0/2758592400 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdce80cab00 con 0x7fdce815f570 2023-12-18T10:25:06.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.953+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdce80caac0 con 0x7fdce815f570 2023-12-18T10:25:06.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.953+0000 7fdcde7fc640 1 -- 172.21.15.133:0/2758592400 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7fdce00513d0 con 0x7fdce815f570 2023-12-18T10:25:06.954 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:06.954 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:25:06.954 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065a90 msgr2=0x7fdccc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065a90 0x7fdccc067f50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdce40aa000 tx=0x7fdce40b0040 comp rx=0 tx=0).stop 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815f570 msgr2=0x7fdce815f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815f570 0x7fdce815f9f0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fdce8067060 tx=0x7fdce0011f50 comp rx=0 tx=0).stop 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 shutdown_connections 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdccc065a90 0x7fdccc067f50 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce815f570 0x7fdce815f9f0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdce80b52a0 0x7fdce80b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 --2- 172.21.15.133:0/2758592400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcd4003980 0x7fdce80b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 >> 172.21.15.133:0/2758592400 conn(0x7fdce8089fb0 msgr2=0x7fdce80b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 shutdown_connections 2023-12-18T10:25:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:06.957+0000 7fdcefac4640 1 -- 172.21.15.133:0/2758592400 wait complete. 2023-12-18T10:25:06.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:07.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.113+0000 7f86c9596640 1 Processor -- start 2023-12-18T10:25:07.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.113+0000 7f86c9596640 1 -- start start 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c9596640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c9596640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86c40c9e30 0x7f86c40ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c9596640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c40c9460 con 0x7f86c41570c0 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c9596640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c41574a0 con 0x7f86c40c9e30 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c9596640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c40c8b30 con 0x7f86c406c4f0 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c2ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86c41570c0 0x7f86c406bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59066/0 (socket says 172.21.15.133:59066) 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c2ffd640 1 -- 172.21.15.133:0/531334176 learned_addr learned my addr 172.21.15.133:0/531334176 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c37fe640 1 --2- 172.21.15.133:0/531334176 >> v2:172.21.15.133:3300/0 conn(0x7f86c40c9e30 0x7f86c40ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86bbfff640 1 --2- 172.21.15.133:0/531334176 >> v2:172.21.15.142:3300/0 conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c27fc640 1 -- 172.21.15.133:0/531334176 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924471681 0 0) 0x7f86c40c9460 con 0x7f86c41570c0 2023-12-18T10:25:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c27fc640 1 -- 172.21.15.133:0/531334176 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b0005740 con 0x7f86c41570c0 2023-12-18T10:25:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c37fe640 1 -- 172.21.15.133:0/531334176 >> v2:172.21.15.142:3300/0 conn(0x7f86c406c4f0 msgr2=0x7f86c40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c37fe640 1 --2- 172.21.15.133:0/531334176 >> v2:172.21.15.142:3300/0 conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c37fe640 1 -- 172.21.15.133:0/531334176 >> v1:172.21.15.133:6789/0 conn(0x7f86c41570c0 legacy=0x7f86c406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c37fe640 1 -- 172.21.15.133:0/531334176 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c40c8e10 con 0x7f86c40c9e30 2023-12-18T10:25:07.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.117+0000 7f86c37fe640 1 --2- 172.21.15.133:0/531334176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c40ca2c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f86c40ce330 tx=0x7f86bc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373086cc49025886 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c27fc640 1 -- 172.21.15.133:0/531334176 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0a59d0 con 0x7f86c40c9e30 2023-12-18T10:25:07.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c27fc640 1 -- 172.21.15.133:0/531334176 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0a5b30 con 0x7f86c40c9e30 2023-12-18T10:25:07.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c27fc640 1 -- 172.21.15.133:0/531334176 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0ad440 con 0x7f86c40c9e30 2023-12-18T10:25:07.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- 172.21.15.133:0/531334176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 msgr2=0x7f86c40ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 --2- 172.21.15.133:0/531334176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c40ca2c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f86c40ce330 tx=0x7f86bc01c910 comp rx=0 tx=0).stop 2023-12-18T10:25:07.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- 172.21.15.133:0/531334176 shutdown_connections 2023-12-18T10:25:07.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 --2- 172.21.15.133:0/531334176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c40c9e30 0x7f86c40ca2c0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 --2- 172.21.15.133:0/531334176 >> v2:172.21.15.142:3300/0 conn(0x7f86c406c4f0 0x7f86c40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- 172.21.15.133:0/531334176 >> 172.21.15.133:0/531334176 conn(0x7f86c406a3e0 msgr2=0x7f86c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:07.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- 172.21.15.133:0/531334176 shutdown_connections 2023-12-18T10:25:07.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- 172.21.15.133:0/531334176 wait complete. 2023-12-18T10:25:07.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 Processor -- start 2023-12-18T10:25:07.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- start start 2023-12-18T10:25:07.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c4155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c40c9e30 0x7f86c414eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c41570c0 0x7f86c414d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c4155980 con 0x7f86c41570c0 2023-12-18T10:25:07.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c414c6b0 con 0x7f86c40c9e30 2023-12-18T10:25:07.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c9596640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c414dc90 con 0x7f86c406c4f0 2023-12-18T10:25:07.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c41570c0 0x7f86c414d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c41570c0 0x7f86c414d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50550/0 (socket says 172.21.15.133:50550) 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.121+0000 7f86c37fe640 1 -- 172.21.15.133:0/3685254951 learned_addr learned my addr 172.21.15.133:0/3685254951 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86bbfff640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c40c9e30 0x7f86c414eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c2ffd640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c4155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c37fe640 1 -- 172.21.15.133:0/3685254951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 msgr2=0x7f86c4155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c37fe640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c4155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c37fe640 1 -- 172.21.15.133:0/3685254951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c40c9e30 msgr2=0x7f86c414eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c37fe640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c40c9e30 0x7f86c414eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c37fe640 1 -- 172.21.15.133:0/3685254951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc009a70 con 0x7f86c41570c0 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c37fe640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c41570c0 0x7f86c414d120 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f86bc019520 tx=0x7f86bc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3685254951 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0a59d0 con 0x7f86c41570c0 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3685254951 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc009450 con 0x7f86c41570c0 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3685254951 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b9690 con 0x7f86c41570c0 2023-12-18T10:25:07.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c414df70 con 0x7f86c41570c0 2023-12-18T10:25:07.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c41555a0 con 0x7f86c41570c0 2023-12-18T10:25:07.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c40735b0 con 0x7f86c41570c0 2023-12-18T10:25:07.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.125+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3685254951 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86bc0b97f0 con 0x7f86c41570c0 2023-12-18T10:25:07.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.129+0000 7f86bb7fe640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a30 0x7f86a4067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.129+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3685254951 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f86bc11ec50 con 0x7f86c41570c0 2023-12-18T10:25:07.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.129+0000 7f86c2ffd640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a30 0x7f86a4067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.129+0000 7f86c2ffd640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a30 0x7f86a4067ef0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f86b40011f0 tx=0x7f86b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.133+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3685254951 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86bc124020 con 0x7f86c41570c0 2023-12-18T10:25:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86c404e000 con 0x7f86c41570c0 2023-12-18T10:25:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86bb7fe640 1 -- 172.21.15.133:0/3685254951 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4757 (secure 0 0 0) 0x7f86bc0ec4e0 con 0x7f86c41570c0 2023-12-18T10:25:07.316 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:07.316 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:24:03.649144+0000","modified":"2023-12-18T10:24:48.068897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8127,"mds_1":8118,"mds_2":8109},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8109":{"gid":8109,"name":"c","rank":2,"incarnation":88,"state":"up:active","state_seq":15,"addr":"172.21.15.133:6835/1695888167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1695888167},{"type":"v1","addr":"172.21.15.133:6835","nonce":1695888167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8118":{"gid":8118,"name":"b","rank":1,"incarnation":86,"state":"up:active","state_seq":14,"addr":"172.21.15.142:6835/4118520914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":4118520914},{"type":"v1","addr":"172.21.15.142:6835","nonce":4118520914}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8127":{"gid":8127,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":14,"addr":"172.21.15.133:6837/2531300469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2531300469},{"type":"v1","addr":"172.21.15.133:6837","nonce":2531300469}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-18T10:25:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 95 2023-12-18T10:25:07.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a30 msgr2=0x7f86a4067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a30 0x7f86a4067ef0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f86b40011f0 tx=0x7f86b4009040 comp rx=0 tx=0).stop 2023-12-18T10:25:07.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c41570c0 msgr2=0x7f86c414d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c41570c0 0x7f86c414d120 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f86bc019520 tx=0x7f86bc0196b0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 shutdown_connections 2023-12-18T10:25:07.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f86a4065a30 0x7f86a4067ef0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c41570c0 0x7f86c414d120 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86c40c9e30 0x7f86c414eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 --2- 172.21.15.133:0/3685254951 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f86c406c4f0 0x7f86c4155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 >> 172.21.15.133:0/3685254951 conn(0x7f86c406a3e0 msgr2=0x7f86c40ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:07.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 shutdown_connections 2023-12-18T10:25:07.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.317+0000 7f86c9596640 1 -- 172.21.15.133:0/3685254951 wait complete. 2023-12-18T10:25:07.337 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:25:07.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.473+0000 7f50620e5640 1 Processor -- start 2023-12-18T10:25:07.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.473+0000 7f50620e5640 1 -- start start 2023-12-18T10:25:07.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f50620e5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f505c15a680 0x7f505c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f50620e5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f505c0cac10 0x7f505c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f50620e5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505c15f100 con 0x7f505c15afa0 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f50620e5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c0ca7d0 con 0x7f505c15a680 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f50620e5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505c15e860 con 0x7f505c0cac10 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f505c15a680 0x7f505c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f505c15a680 0x7f505c15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50554/0 (socket says 172.21.15.133:50554) 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505b7fe640 1 -- 172.21.15.133:0/1886849610 learned_addr learned my addr 172.21.15.133:0/1886849610 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505affd640 1 --2- 172.21.15.133:0/1886849610 >> v2:172.21.15.142:3300/0 conn(0x7f505c0cac10 0x7f505c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505b7fe640 1 -- 172.21.15.133:0/1886849610 >> v2:172.21.15.142:3300/0 conn(0x7f505c0cac10 msgr2=0x7f505c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505b7fe640 1 --2- 172.21.15.133:0/1886849610 >> v2:172.21.15.142:3300/0 conn(0x7f505c0cac10 0x7f505c15aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505b7fe640 1 -- 172.21.15.133:0/1886849610 >> v1:172.21.15.142:6789/0 conn(0x7f505c15afa0 legacy=0x7f505c06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:07.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505b7fe640 1 -- 172.21.15.133:0/1886849610 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c15eb40 con 0x7f505c15a680 2023-12-18T10:25:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.477+0000 7f505b7fe640 1 --2- 172.21.15.133:0/1886849610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15a680 0x7f505c15e160 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f504c009870 tx=0x7f504c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35078c3730efa83d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f505a7fc640 1 -- 172.21.15.133:0/1886849610 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0a7070 con 0x7f505c15a680 2023-12-18T10:25:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f505a7fc640 1 -- 172.21.15.133:0/1886849610 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c0ab430 con 0x7f505c15a680 2023-12-18T10:25:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f505a7fc640 1 -- 172.21.15.133:0/1886849610 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c0ab7c0 con 0x7f505c15a680 2023-12-18T10:25:07.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- 172.21.15.133:0/1886849610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15a680 msgr2=0x7f505c15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 --2- 172.21.15.133:0/1886849610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15a680 0x7f505c15e160 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f504c009870 tx=0x7f504c01c430 comp rx=0 tx=0).stop 2023-12-18T10:25:07.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- 172.21.15.133:0/1886849610 shutdown_connections 2023-12-18T10:25:07.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 --2- 172.21.15.133:0/1886849610 >> v2:172.21.15.142:3300/0 conn(0x7f505c0cac10 0x7f505c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 --2- 172.21.15.133:0/1886849610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15a680 0x7f505c15e160 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- 172.21.15.133:0/1886849610 >> 172.21.15.133:0/1886849610 conn(0x7f505c06a3e0 msgr2=0x7f505c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:07.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- 172.21.15.133:0/1886849610 shutdown_connections 2023-12-18T10:25:07.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- 172.21.15.133:0/1886849610 wait complete. 2023-12-18T10:25:07.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 Processor -- start 2023-12-18T10:25:07.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- start start 2023-12-18T10:25:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0cac10 0x7f505c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f505c15a680 0x7f505c139a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15afa0 0x7f505c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c139fb0 con 0x7f505c15afa0 2023-12-18T10:25:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0c6ef0 con 0x7f505c0cac10 2023-12-18T10:25:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.481+0000 7f50620e5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c0c71d0 con 0x7f505c15a680 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15afa0 0x7f505c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15afa0 0x7f505c15c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50564/0 (socket says 172.21.15.133:50564) 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 -- 172.21.15.133:0/1973855898 learned_addr learned my addr 172.21.15.133:0/1973855898 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505b7fe640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0cac10 0x7f505c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505affd640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f505c15a680 0x7f505c139a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 -- 172.21.15.133:0/1973855898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f505c15a680 msgr2=0x7f505c139a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f505c15a680 0x7f505c139a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 -- 172.21.15.133:0/1973855898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0cac10 msgr2=0x7f505c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0cac10 0x7f505c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 -- 172.21.15.133:0/1973855898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0094d0 con 0x7f505c15afa0 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f505bfff640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15afa0 0x7f505c15c570 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f505400b970 tx=0x7f505400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f5043fff640 1 -- 172.21.15.133:0/1973855898 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505400cb40 con 0x7f505c15afa0 2023-12-18T10:25:07.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f5043fff640 1 -- 172.21.15.133:0/1973855898 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505400cca0 con 0x7f505c15afa0 2023-12-18T10:25:07.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c0c74b0 con 0x7f505c15afa0 2023-12-18T10:25:07.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f5043fff640 1 -- 172.21.15.133:0/1973855898 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5054014680 con 0x7f505c15afa0 2023-12-18T10:25:07.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c0c7a70 con 0x7f505c15afa0 2023-12-18T10:25:07.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c0735b0 con 0x7f505c15afa0 2023-12-18T10:25:07.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f5043fff640 1 -- 172.21.15.133:0/1973855898 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f505401d3b0 con 0x7f505c15afa0 2023-12-18T10:25:07.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.485+0000 7f5043fff640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5048065a60 0x7f5048067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.489+0000 7f5043fff640 1 -- 172.21.15.133:0/1973855898 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f50540831b0 con 0x7f505c15afa0 2023-12-18T10:25:07.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.489+0000 7f505b7fe640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5048065a60 0x7f5048067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.489+0000 7f505b7fe640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5048065a60 0x7f5048067f20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f504c0af000 tx=0x7f504c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.493+0000 7f5043fff640 1 -- 172.21.15.133:0/1973855898 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f50540509a0 con 0x7f505c15afa0 2023-12-18T10:25:07.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f505c0c7c90 con 0x7f505c15afa0 2023-12-18T10:25:07.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f5043fff640 1 -- 172.21.15.133:0/1973855898 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16491 (secure 0 0 0) 0x7f5054053fc0 con 0x7f505c15afa0 2023-12-18T10:25:07.645 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:07.645 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":93,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:24:48.068647+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:24:02.009135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-12-18T10:24:02.637830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":7}]},{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.32","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:25:07.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5048065a60 msgr2=0x7f5048067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5048065a60 0x7f5048067f20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f504c0af000 tx=0x7f504c008040 comp rx=0 tx=0).stop 2023-12-18T10:25:07.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15afa0 msgr2=0x7f505c15c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15afa0 0x7f505c15c570 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f505400b970 tx=0x7f505400be30 comp rx=0 tx=0).stop 2023-12-18T10:25:07.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 shutdown_connections 2023-12-18T10:25:07.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5048065a60 0x7f5048067f20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f505c15afa0 0x7f505c15c570 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f505c15a680 0x7f505c139a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 --2- 172.21.15.133:0/1973855898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0cac10 0x7f505c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 >> 172.21.15.133:0/1973855898 conn(0x7f505c06a3e0 msgr2=0x7f505c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:07.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 shutdown_connections 2023-12-18T10:25:07.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.645+0000 7f50620e5640 1 -- 172.21.15.133:0/1973855898 wait complete. 2023-12-18T10:25:07.666 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-18T10:25:07.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88cbec3640 1 Processor -- start 2023-12-18T10:25:07.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88cbec3640 1 -- start start 2023-12-18T10:25:07.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88cbec3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f88c4158c20 0x7f88c4070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88cbec3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88c415c800 0x7f88c40caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88cbec3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c4070b80 con 0x7f88c40cafb0 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88cbec3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c4070e60 con 0x7f88c415c800 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88cbec3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c4071140 con 0x7f88c4158c20 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c945e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88c415c800 0x7f88c40caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c945e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88c415c800 0x7f88c40caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50572/0 (socket says 172.21.15.133:50572) 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c945e640 1 -- 172.21.15.133:0/3846065391 learned_addr learned my addr 172.21.15.133:0/3846065391 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c9c5f640 1 --2- 172.21.15.133:0/3846065391 >> v2:172.21.15.142:3300/0 conn(0x7f88c4158c20 0x7f88c4070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c945e640 1 -- 172.21.15.133:0/3846065391 >> v2:172.21.15.142:3300/0 conn(0x7f88c4158c20 msgr2=0x7f88c4070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c945e640 1 --2- 172.21.15.133:0/3846065391 >> v2:172.21.15.142:3300/0 conn(0x7f88c4158c20 0x7f88c4070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c945e640 1 -- 172.21.15.133:0/3846065391 >> v1:172.21.15.133:6789/0 conn(0x7f88c40cafb0 legacy=0x7f88c406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c945e640 1 -- 172.21.15.133:0/3846065391 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c4071420 con 0x7f88c415c800 2023-12-18T10:25:07.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.809+0000 7f88c8c5d640 1 -- 172.21.15.133:0/3846065391 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534609390 0 0) 0x7f88c4070b80 con 0x7f88c40cafb0 2023-12-18T10:25:07.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88c945e640 1 --2- 172.21.15.133:0/3846065391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40caa70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f88c40cc0c0 tx=0x7f88b401f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be37981eeeeca644 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88c8c5d640 1 -- 172.21.15.133:0/3846065391 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40a7990 con 0x7f88c415c800 2023-12-18T10:25:07.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88c8c5d640 1 -- 172.21.15.133:0/3846065391 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40a7af0 con 0x7f88c415c800 2023-12-18T10:25:07.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88c8c5d640 1 -- 172.21.15.133:0/3846065391 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40a7e80 con 0x7f88c415c800 2023-12-18T10:25:07.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 -- 172.21.15.133:0/3846065391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 msgr2=0x7f88c40caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 --2- 172.21.15.133:0/3846065391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40caa70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f88c40cc0c0 tx=0x7f88b401f380 comp rx=0 tx=0).stop 2023-12-18T10:25:07.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 -- 172.21.15.133:0/3846065391 shutdown_connections 2023-12-18T10:25:07.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 --2- 172.21.15.133:0/3846065391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40caa70 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 --2- 172.21.15.133:0/3846065391 >> v2:172.21.15.142:3300/0 conn(0x7f88c4158c20 0x7f88c4070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 -- 172.21.15.133:0/3846065391 >> 172.21.15.133:0/3846065391 conn(0x7f88c406a3e0 msgr2=0x7f88c40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:07.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 -- 172.21.15.133:0/3846065391 shutdown_connections 2023-12-18T10:25:07.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 -- 172.21.15.133:0/3846065391 wait complete. 2023-12-18T10:25:07.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.813+0000 7f88cbec3640 1 Processor -- start 2023-12-18T10:25:07.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 -- start start 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c40cafb0 0x7f88c4150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c4158c20 0x7f88c41598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40c58c0 con 0x7f88c415c800 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40c5ba0 con 0x7f88c4158c20 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40c5e80 con 0x7f88c40cafb0 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50586/0 (socket says 172.21.15.133:50586) 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 -- 172.21.15.133:0/1895063226 learned_addr learned my addr 172.21.15.133:0/1895063226 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88c945e640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c4158c20 0x7f88c41598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88c9c5f640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c40cafb0 0x7f88c4150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 -- 172.21.15.133:0/1895063226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c40cafb0 msgr2=0x7f88c4150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c40cafb0 0x7f88c4150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 -- 172.21.15.133:0/1895063226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c4158c20 msgr2=0x7f88c41598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:07.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c4158c20 0x7f88c41598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:07.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 -- 172.21.15.133:0/1895063226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b400a670 con 0x7f88c415c800 2023-12-18T10:25:07.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ca460640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40ae810 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f88bc001570 tx=0x7f88bc00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ba7fc640 1 -- 172.21.15.133:0/1895063226 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc003db0 con 0x7f88c415c800 2023-12-18T10:25:07.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ba7fc640 1 -- 172.21.15.133:0/1895063226 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc005070 con 0x7f88c415c800 2023-12-18T10:25:07.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88ba7fc640 1 -- 172.21.15.133:0/1895063226 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc005420 con 0x7f88c415c800 2023-12-18T10:25:07.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c40c8800 con 0x7f88c415c800 2023-12-18T10:25:07.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c40c6440 con 0x7f88c415c800 2023-12-18T10:25:07.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.817+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c40735b0 con 0x7f88c415c800 2023-12-18T10:25:07.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.821+0000 7f88ba7fc640 1 -- 172.21.15.133:0/1895063226 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f88bc005580 con 0x7f88c415c800 2023-12-18T10:25:07.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.821+0000 7f88ba7fc640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88a8065a90 0x7f88a8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:07.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.821+0000 7f88ba7fc640 1 -- 172.21.15.133:0/1895063226 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f88bc082c00 con 0x7f88c415c800 2023-12-18T10:25:07.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.821+0000 7f88c9c5f640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88a8065a90 0x7f88a8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:07.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.821+0000 7f88c9c5f640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88a8065a90 0x7f88a8067f50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f88c000b9d0 tx=0x7f88c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:07.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:07.825+0000 7f88ba7fc640 1 -- 172.21.15.133:0/1895063226 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f88bc089080 con 0x7f88c415c800 2023-12-18T10:25:08.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.009+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f88c404e000 con 0x7f88c415c800 2023-12-18T10:25:08.009 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:25:08.009+0000 7f3ba99e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-18T10:25:08.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.021+0000 7f88ba7fc640 1 -- 172.21.15.133:0/1895063226 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) v1 ==== 161+0+0 (secure 0 0 0) 0x7f88bc017020 con 0x7f88c415c800 2023-12-18T10:25:08.021 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88a8065a90 msgr2=0x7f88a8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88a8065a90 0x7f88a8067f50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f88c000b9d0 tx=0x7f88c0008040 comp rx=0 tx=0).stop 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 msgr2=0x7f88c40ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40ae810 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f88bc001570 tx=0x7f88bc00cd20 comp rx=0 tx=0).stop 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 shutdown_connections 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f88a8065a90 0x7f88a8067f50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c415c800 0x7f88c40ae810 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f88c4158c20 0x7f88c41598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 --2- 172.21.15.133:0/1895063226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f88c40cafb0 0x7f88c4150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 >> 172.21.15.133:0/1895063226 conn(0x7f88c406a3e0 msgr2=0x7f88c4157980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 shutdown_connections 2023-12-18T10:25:08.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.025+0000 7f88cbec3640 1 -- 172.21.15.133:0/1895063226 wait complete. 2023-12-18T10:25:08.033 INFO:tasks.ceph.mds.c.smithi133.stderr: -1098> 2023-12-18T10:24:39.753+0000 7fd33397d640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-12-18T10:24:20.600643+0000 1=0+1) n(v0 rc2023-12-18T10:24:20.600643+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={8307=pAsLsXsFsx/-@6},l=8307 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55e965d11b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.600643+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.600643+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.600643+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-18T10:24:20.600643+0000 2=0+2)","error_str":""},"return_code":-61} 2023-12-18T10:25:08.033 INFO:tasks.ceph.mds.c.smithi133.stderr: -1078> 2023-12-18T10:24:39.753+0000 7fd33397d640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (iversion lock) caps={8307=pAsLsXsFs/-@3},l=8307 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55e965d12100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-12-18T10:25:08.038 INFO:tasks.ceph.mds.b.smithi142.stderr: -1195> 2023-12-18T10:24:39.754+0000 7faf7f44b640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-12-18T10:24:20.596686+0000 1=0+1) n(v2 rc2023-12-18T10:24:20.819738+0000 4=0+4) (inest lock) (iversion lock) caps={8307=pAsLsXsFs/-@7},l=8307 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x56276a1cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.596686+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.819738+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.596686+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-12-18T10:24:20.819738+0000 4=0+4)","error_str":""},"return_code":-61} 2023-12-18T10:25:08.038 INFO:tasks.ceph.mds.b.smithi142.stderr: -1075> 2023-12-18T10:24:39.754+0000 7faf85457640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-12-18T10:24:20.598630+0000 1=0+1) n(v1 rc2023-12-18T10:24:20.819738+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={8307=pAsLsXsFs/-@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x56276a1cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.598630+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.600643+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.598630+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-12-18T10:24:20.819738+0000 3=0+3)","error_str":""},"return_code":-61} 2023-12-18T10:25:08.042 INFO:tasks.ceph.mds.a.smithi133.stderr: -2829> 2023-12-18T10:24:39.753+0000 7f23d12eb640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-12-18T10:24:20.592620+0000 1=0+1) n(v3 rc2023-12-18T10:24:20.819738+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={8307=pAsLsXsFsx/AsLsXsFsx@9},l=8307 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x555f8a050580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.592620+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.819738+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.592620+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-12-18T10:24:20.819738+0000 6=0+6)","error_str":""},"return_code":-61} 2023-12-18T10:25:08.042 INFO:tasks.ceph.mds.a.smithi133.stderr: -2726> 2023-12-18T10:24:39.753+0000 7f23d72f7640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-12-18T10:24:20.594752+0000 1=0+1) n(v4 rc2023-12-18T10:24:20.819738+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={8307=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x555f8a050b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:24:20.594752+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:24:20.819738+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-12-18T10:24:20.594752+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-12-18T10:24:20.819738+0000 5=0+5)","error_str":""},"return_code":-61} 2023-12-18T10:25:08.046 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-18T10:25:08.076 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:25:08.081 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:25:08.090 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:25:08.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0fdbc640 1 Processor -- start 2023-12-18T10:25:08.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0fdbc640 1 -- start start 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0fdbc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c081582d0 0x7f0c080c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0fdbc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c08070820 0x7f0c080ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0fdbc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080c9390 con 0x7f0c080ce3b0 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0fdbc640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0815aee0 con 0x7f0c081582d0 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0fdbc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0815b1c0 con 0x7f0c08070820 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0db58640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c081582d0 0x7f0c080c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0e359640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0c080ce3b0 0x7f0c080cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59088/0 (socket says 172.21.15.133:59088) 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0e359640 1 -- 172.21.15.133:0/2375911500 learned_addr learned my addr 172.21.15.133:0/2375911500 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:08.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0d357640 1 --2- 172.21.15.133:0/2375911500 >> v2:172.21.15.142:3300/0 conn(0x7f0c08070820 0x7f0c080ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:08.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0db58640 1 -- 172.21.15.133:0/2375911500 >> v2:172.21.15.142:3300/0 conn(0x7f0c08070820 msgr2=0x7f0c080ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:08.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0db58640 1 --2- 172.21.15.133:0/2375911500 >> v2:172.21.15.142:3300/0 conn(0x7f0c08070820 0x7f0c080ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0db58640 1 -- 172.21.15.133:0/2375911500 >> v1:172.21.15.133:6789/0 conn(0x7f0c080ce3b0 legacy=0x7f0c080cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:08.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0db58640 1 -- 172.21.15.133:0/2375911500 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0815b4a0 con 0x7f0c081582d0 2023-12-18T10:25:08.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.193+0000 7f0c0cb56640 1 -- 172.21.15.133:0/2375911500 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153941429 0 0) 0x7f0c080c9390 con 0x7f0c080ce3b0 2023-12-18T10:25:08.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0db58640 1 --2- 172.21.15.133:0/2375911500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c080c8e50 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f0c0806dfa0 tx=0x7f0c0401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0b073e33e628a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:08.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0cb56640 1 -- 172.21.15.133:0/2375911500 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c040ab650 con 0x7f0c081582d0 2023-12-18T10:25:08.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0cb56640 1 -- 172.21.15.133:0/2375911500 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c040ab7b0 con 0x7f0c081582d0 2023-12-18T10:25:08.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0cb56640 1 -- 172.21.15.133:0/2375911500 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c040abb40 con 0x7f0c081582d0 2023-12-18T10:25:08.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/2375911500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 msgr2=0x7f0c080c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:08.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/2375911500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c080c8e50 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f0c0806dfa0 tx=0x7f0c0401c430 comp rx=0 tx=0).stop 2023-12-18T10:25:08.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/2375911500 shutdown_connections 2023-12-18T10:25:08.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/2375911500 >> v2:172.21.15.142:3300/0 conn(0x7f0c08070820 0x7f0c080ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/2375911500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c080c8e50 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/2375911500 >> 172.21.15.133:0/2375911500 conn(0x7f0c0806a2a0 msgr2=0x7f0c080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:08.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/2375911500 shutdown_connections 2023-12-18T10:25:08.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.197+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/2375911500 wait complete. 2023-12-18T10:25:08.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 Processor -- start 2023-12-18T10:25:08.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 -- start start 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c08070820 0x7f0c0815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c080ce3b0 0x7f0c08154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c0815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080b1a10 con 0x7f0c081582d0 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080b0e20 con 0x7f0c08070820 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080b1070 con 0x7f0c080ce3b0 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c0815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c0815e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50626/0 (socket says 172.21.15.133:50626) 2023-12-18T10:25:08.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 -- 172.21.15.133:0/4001042755 learned_addr learned my addr 172.21.15.133:0/4001042755 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0db58640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c08070820 0x7f0c0815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0d357640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c080ce3b0 0x7f0c08154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 -- 172.21.15.133:0/4001042755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c080ce3b0 msgr2=0x7f0c08154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c080ce3b0 0x7f0c08154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 -- 172.21.15.133:0/4001042755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c08070820 msgr2=0x7f0c0815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c08070820 0x7f0c0815c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 -- 172.21.15.133:0/4001042755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04009420 con 0x7f0c081582d0 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0e359640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c0815e890 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000c810 tx=0x7f0c0000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0bfe7fc640 1 -- 172.21.15.133:0/4001042755 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0000a640 con 0x7f0c081582d0 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0bfe7fc640 1 -- 172.21.15.133:0/4001042755 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0000a7c0 con 0x7f0c081582d0 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c080b1350 con 0x7f0c081582d0 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0bfe7fc640 1 -- 172.21.15.133:0/4001042755 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0000ab70 con 0x7f0c081582d0 2023-12-18T10:25:08.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0815edd0 con 0x7f0c081582d0 2023-12-18T10:25:08.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.201+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c080b1b50 con 0x7f0c081582d0 2023-12-18T10:25:08.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.205+0000 7f0bfe7fc640 1 -- 172.21.15.133:0/4001042755 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c0000acd0 con 0x7f0c081582d0 2023-12-18T10:25:08.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.205+0000 7f0bfe7fc640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bec065a60 0x7f0bec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:08.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.205+0000 7f0bfe7fc640 1 -- 172.21.15.133:0/4001042755 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6403+0+0 (secure 0 0 0) 0x7f0c00082cd0 con 0x7f0c081582d0 2023-12-18T10:25:08.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.205+0000 7f0c0db58640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bec065a60 0x7f0bec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:08.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.205+0000 7f0c0db58640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bec065a60 0x7f0bec067f20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0c040af000 tx=0x7f0c040a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:08.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.209+0000 7f0bfe7fc640 1 -- 172.21.15.133:0/4001042755 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0c080b1b50 con 0x7f0c081582d0 2023-12-18T10:25:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:08.393+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c080b1b50 con 0x7f0c081582d0 2023-12-18T10:25:09.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.025+0000 7f0bfe7fc640 1 -- 172.21.15.133:0/4001042755 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v97) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c080b1b50 con 0x7f0c081582d0 2023-12-18T10:25:09.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bec065a60 msgr2=0x7f0bec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:09.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bec065a60 0x7f0bec067f20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0c040af000 tx=0x7f0c040a7000 comp rx=0 tx=0).stop 2023-12-18T10:25:09.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 msgr2=0x7f0c0815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:09.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c0815e890 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000c810 tx=0x7f0c0000ccd0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 shutdown_connections 2023-12-18T10:25:09.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0bec065a60 0x7f0bec067f20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c081582d0 0x7f0c0815e890 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c080ce3b0 0x7f0c08154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 --2- 172.21.15.133:0/4001042755 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c08070820 0x7f0c0815c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 >> 172.21.15.133:0/4001042755 conn(0x7f0c0806a2a0 msgr2=0x7f0c080ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:09.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 shutdown_connections 2023-12-18T10:25:09.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.029+0000 7f0c0fdbc640 1 -- 172.21.15.133:0/4001042755 wait complete. 2023-12-18T10:25:09.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-18T10:25:09.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f78fc640 1 Processor -- start 2023-12-18T10:25:09.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f78fc640 1 -- start start 2023-12-18T10:25:09.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f78fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ce6a0 0x7f97f00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:09.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f78fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97f00c89f0 0x7f97f00c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:09.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f78fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f00ad6e0 con 0x7f97f00ca200 2023-12-18T10:25:09.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f78fc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f0159b20 con 0x7f97f00c89f0 2023-12-18T10:25:09.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f78fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00ad9c0 con 0x7f97f00ce6a0 2023-12-18T10:25:09.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5698640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ce6a0 0x7f97f00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:09.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5e99640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97f00c89f0 0x7f97f00c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:09.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5e99640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f97f00c89f0 0x7f97f00c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:51678/0 (socket says 172.21.15.133:51678) 2023-12-18T10:25:09.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f4e97640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f97f00ca200 0x7f97f00cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:53356/0 (socket says 172.21.15.133:53356) 2023-12-18T10:25:09.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5e99640 1 -- 172.21.15.133:0/321252937 learned_addr learned my addr 172.21.15.133:0/321252937 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:09.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5698640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ce6a0 0x7f97f00ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:56220/0 (socket says 172.21.15.133:56220) 2023-12-18T10:25:09.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5e99640 1 -- 172.21.15.133:0/321252937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ce6a0 msgr2=0x7f97f00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:09.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5e99640 1 --2- 172.21.15.133:0/321252937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ce6a0 0x7f97f00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5e99640 1 -- 172.21.15.133:0/321252937 >> v1:172.21.15.142:6789/0 conn(0x7f97f00ca200 legacy=0x7f97f00cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:09.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97f5e99640 1 -- 172.21.15.133:0/321252937 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f006be20 con 0x7f97f00c89f0 2023-12-18T10:25:09.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.241+0000 7f97e7fff640 1 -- 172.21.15.133:0/321252937 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585386269 0 0) 0x7f97f00ad6e0 con 0x7f97f00ca200 2023-12-18T10:25:09.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f5e99640 1 --2- 172.21.15.133:0/321252937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00c89f0 0x7f97f00c8e80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f97e800d150 tx=0x7f97e801ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dffc9b4d028b037 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:09.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97e7fff640 1 -- 172.21.15.133:0/321252937 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800b2d0 con 0x7f97f00c89f0 2023-12-18T10:25:09.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97e7fff640 1 -- 172.21.15.133:0/321252937 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e800b430 con 0x7f97f00c89f0 2023-12-18T10:25:09.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97e7fff640 1 -- 172.21.15.133:0/321252937 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e80a7bd0 con 0x7f97f00c89f0 2023-12-18T10:25:09.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f78fc640 1 -- 172.21.15.133:0/321252937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00c89f0 msgr2=0x7f97f00c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:09.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f78fc640 1 --2- 172.21.15.133:0/321252937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00c89f0 0x7f97f00c8e80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f97e800d150 tx=0x7f97e801ebe0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f78fc640 1 -- 172.21.15.133:0/321252937 shutdown_connections 2023-12-18T10:25:09.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f78fc640 1 --2- 172.21.15.133:0/321252937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00c89f0 0x7f97f00c8e80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f78fc640 1 --2- 172.21.15.133:0/321252937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ce6a0 0x7f97f00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f78fc640 1 -- 172.21.15.133:0/321252937 >> 172.21.15.133:0/321252937 conn(0x7f97f0069e70 msgr2=0x7f97f006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:09.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f78fc640 1 -- 172.21.15.133:0/321252937 shutdown_connections 2023-12-18T10:25:09.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.245+0000 7f97f78fc640 1 -- 172.21.15.133:0/321252937 wait complete. 2023-12-18T10:25:09.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 Processor -- start 2023-12-18T10:25:09.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 -- start start 2023-12-18T10:25:09.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f00c89f0 0x7f97f0163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:09.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ca200 0x7f97f0096d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:09.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00ce6a0 0x7f97f01548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:09.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f01544c0 con 0x7f97f00c89f0 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0097d50 con 0x7f97f00ce6a0 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00972b0 con 0x7f97f00ca200 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f00c89f0 0x7f97f0163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f00c89f0 0x7f97f0163eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50638/0 (socket says 172.21.15.133:50638) 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 -- 172.21.15.133:0/197996831 learned_addr learned my addr 172.21.15.133:0/197996831 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f4e97640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ca200 0x7f97f0096d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5e99640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00ce6a0 0x7f97f01548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 -- 172.21.15.133:0/197996831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ca200 msgr2=0x7f97f0096d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ca200 0x7f97f0096d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 -- 172.21.15.133:0/197996831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00ce6a0 msgr2=0x7f97f01548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00ce6a0 0x7f97f01548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 -- 172.21.15.133:0/197996831 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e800bd40 con 0x7f97f00c89f0 2023-12-18T10:25:09.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f5698640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f00c89f0 0x7f97f0163eb0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e870 tx=0x7f97ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:09.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97e5ffb640 1 -- 172.21.15.133:0/197996831 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec009510 con 0x7f97f00c89f0 2023-12-18T10:25:09.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97e5ffb640 1 -- 172.21.15.133:0/197996831 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00eec0 con 0x7f97f00c89f0 2023-12-18T10:25:09.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97e5ffb640 1 -- 172.21.15.133:0/197996831 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00cb40 con 0x7f97f00c89f0 2023-12-18T10:25:09.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f006cd60 con 0x7f97f00c89f0 2023-12-18T10:25:09.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f0153b20 con 0x7f97f00c89f0 2023-12-18T10:25:09.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.249+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f004e070 con 0x7f97f00c89f0 2023-12-18T10:25:09.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.253+0000 7f97e5ffb640 1 -- 172.21.15.133:0/197996831 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f97ec00cca0 con 0x7f97f00c89f0 2023-12-18T10:25:09.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.253+0000 7f97e5ffb640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f97d4065a60 0x7f97d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:09.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.253+0000 7f97e5ffb640 1 -- 172.21.15.133:0/197996831 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6403+0+0 (secure 0 0 0) 0x7f97ec0834c0 con 0x7f97f00c89f0 2023-12-18T10:25:09.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.253+0000 7f97f4e97640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f97d4065a60 0x7f97d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:09.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.253+0000 7f97f4e97640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f97d4065a60 0x7f97d4067f20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ad500 tx=0x7f97e0007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:09.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.257+0000 7f97e5ffb640 1 -- 172.21.15.133:0/197996831 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f97ec050c60 con 0x7f97f00c89f0 2023-12-18T10:25:09.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:09.409+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97f00cbc10 con 0x7f97f00c89f0 2023-12-18T10:25:10.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.105+0000 7f97e5ffb640 1 -- 172.21.15.133:0/197996831 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) v1 ==== 181+0+0 (secure 0 0 0) 0x7f97ec054280 con 0x7f97f00c89f0 2023-12-18T10:25:10.106 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-18T10:25:10.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f97d4065a60 msgr2=0x7f97d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:10.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f97d4065a60 0x7f97d4067f20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ad500 tx=0x7f97e0007d60 comp rx=0 tx=0).stop 2023-12-18T10:25:10.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f00c89f0 msgr2=0x7f97f0163eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f00c89f0 0x7f97f0163eb0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e870 tx=0x7f97ec00ec70 comp rx=0 tx=0).stop 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 shutdown_connections 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f97d4065a60 0x7f97d4067f20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f97f00ce6a0 0x7f97f01548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f97f00ca200 0x7f97f0096d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 --2- 172.21.15.133:0/197996831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f00c89f0 0x7f97f0163eb0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 >> 172.21.15.133:0/197996831 conn(0x7f97f0069e70 msgr2=0x7f97f00ab290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 shutdown_connections 2023-12-18T10:25:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.109+0000 7f97f78fc640 1 -- 172.21.15.133:0/197996831 wait complete. 2023-12-18T10:25:10.134 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-18T10:25:10.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b76b6640 1 Processor -- start 2023-12-18T10:25:10.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b76b6640 1 -- start start 2023-12-18T10:25:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b76b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45b0160e90 0x7f45b0165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b76b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45b00c1a80 0x7f45b00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b76b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b00b20a0 con 0x7f45b006be20 2023-12-18T10:25:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b76b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b00b2380 con 0x7f45b0160e90 2023-12-18T10:25:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b76b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b00cc5b0 con 0x7f45b00c1a80 2023-12-18T10:25:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b5452640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45b0160e90 0x7f45b0165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b5452640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45b0160e90 0x7f45b0165130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49334/0 (socket says 172.21.15.133:49334) 2023-12-18T10:25:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b5452640 1 -- 172.21.15.133:0/1996333900 learned_addr learned my addr 172.21.15.133:0/1996333900 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:10.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.277+0000 7f45b5c53640 1 --2- 172.21.15.133:0/1996333900 >> v2:172.21.15.142:3300/0 conn(0x7f45b00c1a80 0x7f45b00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:10.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b5452640 1 -- 172.21.15.133:0/1996333900 >> v2:172.21.15.142:3300/0 conn(0x7f45b00c1a80 msgr2=0x7f45b00cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:10.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b5452640 1 --2- 172.21.15.133:0/1996333900 >> v2:172.21.15.142:3300/0 conn(0x7f45b00c1a80 0x7f45b00cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b5452640 1 -- 172.21.15.133:0/1996333900 >> v1:172.21.15.142:6789/0 conn(0x7f45b006be20 legacy=0x7f45b00c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:10.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b5452640 1 -- 172.21.15.133:0/1996333900 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b00cc890 con 0x7f45b0160e90 2023-12-18T10:25:10.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b5452640 1 --2- 172.21.15.133:0/1996333900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b0160e90 0x7f45b0165130 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f45b01647f0 tx=0x7f45ac01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9455fd5ee1af0ae server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:10.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45a7fff640 1 -- 172.21.15.133:0/1996333900 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0a8050 con 0x7f45b0160e90 2023-12-18T10:25:10.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45a7fff640 1 -- 172.21.15.133:0/1996333900 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac0ac5f0 con 0x7f45b0160e90 2023-12-18T10:25:10.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45a7fff640 1 -- 172.21.15.133:0/1996333900 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0ac980 con 0x7f45b0160e90 2023-12-18T10:25:10.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b76b6640 1 -- 172.21.15.133:0/1996333900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b0160e90 msgr2=0x7f45b0165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:10.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b76b6640 1 --2- 172.21.15.133:0/1996333900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b0160e90 0x7f45b0165130 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f45b01647f0 tx=0x7f45ac01c500 comp rx=0 tx=0).stop 2023-12-18T10:25:10.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b76b6640 1 -- 172.21.15.133:0/1996333900 shutdown_connections 2023-12-18T10:25:10.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b76b6640 1 --2- 172.21.15.133:0/1996333900 >> v2:172.21.15.142:3300/0 conn(0x7f45b00c1a80 0x7f45b00cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b76b6640 1 --2- 172.21.15.133:0/1996333900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b0160e90 0x7f45b0165130 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.281+0000 7f45b76b6640 1 -- 172.21.15.133:0/1996333900 >> 172.21.15.133:0/1996333900 conn(0x7f45b0069e70 msgr2=0x7f45b006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:10.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 -- 172.21.15.133:0/1996333900 shutdown_connections 2023-12-18T10:25:10.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 -- 172.21.15.133:0/1996333900 wait complete. 2023-12-18T10:25:10.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 Processor -- start 2023-12-18T10:25:10.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 -- start start 2023-12-18T10:25:10.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b006be20 0x7f45b01606b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b00c1a80 0x7f45b00972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0160e90 0x7f45b015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00ad1c0 con 0x7f45b00c1a80 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b01602a0 con 0x7f45b006be20 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b76b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b015dc20 con 0x7f45b0160e90 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b00c1a80 0x7f45b00972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b00c1a80 0x7f45b00972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49350/0 (socket says 172.21.15.133:49350) 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 -- 172.21.15.133:0/2592349065 learned_addr learned my addr 172.21.15.133:0/2592349065 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b5452640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b006be20 0x7f45b01606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b5c53640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0160e90 0x7f45b015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:10.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 -- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0160e90 msgr2=0x7f45b015f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0160e90 0x7f45b015f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 -- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b006be20 msgr2=0x7f45b01606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b006be20 0x7f45b01606b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 -- 172.21.15.133:0/2592349065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0094d0 con 0x7f45b00c1a80 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b5452640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b006be20 0x7f45b01606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.285+0000 7f45b4c51640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b00c1a80 0x7f45b00972e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f45a000c3d0 tx=0x7f45a000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45a5ffb640 1 -- 172.21.15.133:0/2592349065 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00052d0 con 0x7f45b00c1a80 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45a5ffb640 1 -- 172.21.15.133:0/2592349065 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a0005450 con 0x7f45b00c1a80 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45a5ffb640 1 -- 172.21.15.133:0/2592349065 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0003860 con 0x7f45b00c1a80 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b015d0a0 con 0x7f45b00c1a80 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b015d2f0 con 0x7f45b00c1a80 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b015ddd0 con 0x7f45b00c1a80 2023-12-18T10:25:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45a5ffb640 1 -- 172.21.15.133:0/2592349065 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45a00039c0 con 0x7f45b00c1a80 2023-12-18T10:25:10.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45a5ffb640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4594065a60 0x7f4594067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:10.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45a5ffb640 1 -- 172.21.15.133:0/2592349065 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5965+0+0 (secure 0 0 0) 0x7f45a0082780 con 0x7f45b00c1a80 2023-12-18T10:25:10.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.289+0000 7f45b5452640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4594065a60 0x7f4594067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:10.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.293+0000 7f45b5452640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4594065a60 0x7f4594067f20 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0ae000 tx=0x7f45ac0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:10.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.293+0000 7f45a5ffb640 1 -- 172.21.15.133:0/2592349065 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45b015ddd0 con 0x7f45b00c1a80 2023-12-18T10:25:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:10.457+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45b015ddd0 con 0x7f45b00c1a80 2023-12-18T10:25:11.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45a5ffb640 1 -- 172.21.15.133:0/2592349065 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) v1 ==== 169+0+0 (secure 0 0 0) 0x7f45b015ddd0 con 0x7f45b00c1a80 2023-12-18T10:25:11.109 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-18T10:25:11.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4594065a60 msgr2=0x7f4594067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4594065a60 0x7f4594067f20 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0ae000 tx=0x7f45ac0a7000 comp rx=0 tx=0).stop 2023-12-18T10:25:11.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b00c1a80 msgr2=0x7f45b00972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b00c1a80 0x7f45b00972e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f45a000c3d0 tx=0x7f45a000c890 comp rx=0 tx=0).stop 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 shutdown_connections 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4594065a60 0x7f4594067f20 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45b0160e90 0x7f45b015f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b00c1a80 0x7f45b00972e0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 --2- 172.21.15.133:0/2592349065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45b006be20 0x7f45b01606b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 >> 172.21.15.133:0/2592349065 conn(0x7f45b0069e70 msgr2=0x7f45b00cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 shutdown_connections 2023-12-18T10:25:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.109+0000 7f45b76b6640 1 -- 172.21.15.133:0/2592349065 wait complete. 2023-12-18T10:25:11.134 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-18T10:25:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.273+0000 7f2ab142d640 1 Processor -- start 2023-12-18T10:25:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.273+0000 7f2ab142d640 1 -- start start 2023-12-18T10:25:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2ab142d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2aac0ca410 0x7f2aac159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2ab142d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac159fb0 0x7f2aac071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2ab142d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac070df0 con 0x7f2aac071db0 2023-12-18T10:25:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2ab142d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac15aab0 con 0x7f2aac0ca410 2023-12-18T10:25:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2ab142d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac15a4f0 con 0x7f2aac159fb0 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac159fb0 0x7f2aac071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aaaffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2aac0ca410 0x7f2aac159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac159fb0 0x7f2aac071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:44942/0 (socket says 172.21.15.133:44942) 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aa3fff640 1 -- 172.21.15.133:0/1641825090 learned_addr learned my addr 172.21.15.133:0/1641825090 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aa3fff640 1 -- 172.21.15.133:0/1641825090 >> v2:172.21.15.142:3300/0 conn(0x7f2aac0ca410 msgr2=0x7f2aac159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aa3fff640 1 --2- 172.21.15.133:0/1641825090 >> v2:172.21.15.142:3300/0 conn(0x7f2aac0ca410 0x7f2aac159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aa3fff640 1 -- 172.21.15.133:0/1641825090 >> v1:172.21.15.142:6789/0 conn(0x7f2aac071db0 legacy=0x7f2aac0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aa3fff640 1 -- 172.21.15.133:0/1641825090 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac15a7d0 con 0x7f2aac159fb0 2023-12-18T10:25:11.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.277+0000 7f2aaaffd640 1 --2- 172.21.15.133:0/1641825090 >> v2:172.21.15.142:3300/0 conn(0x7f2aac0ca410 0x7f2aac159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2aa3fff640 1 --2- 172.21.15.133:0/1641825090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac159fb0 0x7f2aac071870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009870 tx=0x7f2a9401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef4cf7df8f4457c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2aaa7fc640 1 -- 172.21.15.133:0/1641825090 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940aa670 con 0x7f2aac159fb0 2023-12-18T10:25:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2aaa7fc640 1 -- 172.21.15.133:0/1641825090 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940aa7d0 con 0x7f2aac159fb0 2023-12-18T10:25:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2aaa7fc640 1 -- 172.21.15.133:0/1641825090 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940aab60 con 0x7f2aac159fb0 2023-12-18T10:25:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- 172.21.15.133:0/1641825090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac159fb0 msgr2=0x7f2aac071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1641825090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac159fb0 0x7f2aac071870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009870 tx=0x7f2a9401c510 comp rx=0 tx=0).stop 2023-12-18T10:25:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- 172.21.15.133:0/1641825090 shutdown_connections 2023-12-18T10:25:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1641825090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac159fb0 0x7f2aac071870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1641825090 >> v2:172.21.15.142:3300/0 conn(0x7f2aac0ca410 0x7f2aac159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- 172.21.15.133:0/1641825090 >> 172.21.15.133:0/1641825090 conn(0x7f2aac06a2a0 msgr2=0x7f2aac0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- 172.21.15.133:0/1641825090 shutdown_connections 2023-12-18T10:25:11.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- 172.21.15.133:0/1641825090 wait complete. 2023-12-18T10:25:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 Processor -- start 2023-12-18T10:25:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- start start 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac071db0 0x7f2aac0c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0ca410 0x7f2aac0c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aac159fb0 0x7f2aac1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0c2d70 con 0x7f2aac159fb0 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0c4a90 con 0x7f2aac071db0 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.281+0000 7f2ab142d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0c4d70 con 0x7f2aac0ca410 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aac159fb0 0x7f2aac1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aac159fb0 0x7f2aac1524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49366/0 (socket says 172.21.15.133:49366) 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 -- 172.21.15.133:0/1778335883 learned_addr learned my addr 172.21.15.133:0/1778335883 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aaaffd640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac071db0 0x7f2aac0c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aa3fff640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0ca410 0x7f2aac0c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 -- 172.21.15.133:0/1778335883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0ca410 msgr2=0x7f2aac0c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0ca410 0x7f2aac0c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 -- 172.21.15.133:0/1778335883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac071db0 msgr2=0x7f2aac0c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac071db0 0x7f2aac0c2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 -- 172.21.15.133:0/1778335883 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c00b6c0 con 0x7f2aac159fb0 2023-12-18T10:25:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aab7fe640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aac159fb0 0x7f2aac1524f0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c730 tx=0x7f2aa400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aa37fe640 1 -- 172.21.15.133:0/1778335883 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4003b80 con 0x7f2aac159fb0 2023-12-18T10:25:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aa37fe640 1 -- 172.21.15.133:0/1778335883 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa4003ce0 con 0x7f2aac159fb0 2023-12-18T10:25:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aa37fe640 1 -- 172.21.15.133:0/1778335883 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa400aa30 con 0x7f2aac159fb0 2023-12-18T10:25:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a940094d0 con 0x7f2aac159fb0 2023-12-18T10:25:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac13f700 con 0x7f2aac159fb0 2023-12-18T10:25:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac0c4f90 con 0x7f2aac159fb0 2023-12-18T10:25:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aa37fe640 1 -- 172.21.15.133:0/1778335883 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2aa400ab90 con 0x7f2aac159fb0 2023-12-18T10:25:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.285+0000 7f2aa37fe640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a8c065a30 0x7f2a8c067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.289+0000 7f2aa37fe640 1 -- 172.21.15.133:0/1778335883 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f2aa4082d20 con 0x7f2aac159fb0 2023-12-18T10:25:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.289+0000 7f2aaaffd640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a8c065a30 0x7f2a8c067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.289+0000 7f2aaaffd640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a8c065a30 0x7f2a8c067ef0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00be70 tx=0x7f2a9c00b3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:11.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.293+0000 7f2aa37fe640 1 -- 172.21.15.133:0/1778335883 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2aa4050800 con 0x7f2aac159fb0 2023-12-18T10:25:11.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.441+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2aac13f8f0 con 0x7f2aac159fb0 2023-12-18T10:25:11.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.445+0000 7f2aa37fe640 1 -- 172.21.15.133:0/1778335883 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2aa4053e20 con 0x7f2aac159fb0 2023-12-18T10:25:11.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a8c065a30 msgr2=0x7f2a8c067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a8c065a30 0x7f2a8c067ef0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00be70 tx=0x7f2a9c00b3a0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aac159fb0 msgr2=0x7f2aac1524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aac159fb0 0x7f2aac1524f0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c730 tx=0x7f2aa400cbf0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 shutdown_connections 2023-12-18T10:25:11.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2a8c065a30 0x7f2a8c067ef0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aac159fb0 0x7f2aac1524f0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2aac0ca410 0x7f2aac0c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 --2- 172.21.15.133:0/1778335883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2aac071db0 0x7f2aac0c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 >> 172.21.15.133:0/1778335883 conn(0x7f2aac06a2a0 msgr2=0x7f2aac0cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:11.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 shutdown_connections 2023-12-18T10:25:11.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.449+0000 7f2ab142d640 1 -- 172.21.15.133:0/1778335883 wait complete. 2023-12-18T10:25:11.468 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2023-12-18T10:25:11.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f62489b3640 1 Processor -- start 2023-12-18T10:25:11.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f62489b3640 1 -- start start 2023-12-18T10:25:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f62489b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62441570c0 0x7f624406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f62489b3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f624406c320 0x7f62440c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f62489b3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62440c9460 con 0x7f62440c9e30 2023-12-18T10:25:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f62489b3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624406c7a0 con 0x7f624406c320 2023-12-18T10:25:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f62489b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62441574a0 con 0x7f62441570c0 2023-12-18T10:25:11.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f6239d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f624406c320 0x7f62440c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f6242d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f62440c9e30 0x7f624415d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53310/0 (socket says 172.21.15.133:53310) 2023-12-18T10:25:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f6242d9d640 1 -- 172.21.15.133:0/339302098 learned_addr learned my addr 172.21.15.133:0/339302098 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.605+0000 7f624259c640 1 --2- 172.21.15.133:0/339302098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62441570c0 0x7f624406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6239d9b640 1 -- 172.21.15.133:0/339302098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62441570c0 msgr2=0x7f624406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6239d9b640 1 --2- 172.21.15.133:0/339302098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62441570c0 0x7f624406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6239d9b640 1 -- 172.21.15.133:0/339302098 >> v1:172.21.15.133:6789/0 conn(0x7f62440c9e30 legacy=0x7f624415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6239d9b640 1 -- 172.21.15.133:0/339302098 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440c8b30 con 0x7f624406c320 2023-12-18T10:25:11.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6241d9b640 1 -- 172.21.15.133:0/339302098 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281913185 0 0) 0x7f62440c9460 con 0x7f62440c9e30 2023-12-18T10:25:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6239d9b640 1 --2- 172.21.15.133:0/339302098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624406c320 0x7f62440c98f0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f62340097c0 tx=0x7f623401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af317538734a8cba server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6241d9b640 1 -- 172.21.15.133:0/339302098 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340ab600 con 0x7f624406c320 2023-12-18T10:25:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6241d9b640 1 -- 172.21.15.133:0/339302098 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62340a7050 con 0x7f624406c320 2023-12-18T10:25:11.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f6241d9b640 1 -- 172.21.15.133:0/339302098 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340ab980 con 0x7f624406c320 2023-12-18T10:25:11.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f62489b3640 1 -- 172.21.15.133:0/339302098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624406c320 msgr2=0x7f62440c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f62489b3640 1 --2- 172.21.15.133:0/339302098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624406c320 0x7f62440c98f0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f62340097c0 tx=0x7f623401c3c0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f62489b3640 1 -- 172.21.15.133:0/339302098 shutdown_connections 2023-12-18T10:25:11.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f62489b3640 1 --2- 172.21.15.133:0/339302098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624406c320 0x7f62440c98f0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f62489b3640 1 --2- 172.21.15.133:0/339302098 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62441570c0 0x7f624406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f62489b3640 1 -- 172.21.15.133:0/339302098 >> 172.21.15.133:0/339302098 conn(0x7f624406a3e0 msgr2=0x7f62440afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:11.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f62489b3640 1 -- 172.21.15.133:0/339302098 shutdown_connections 2023-12-18T10:25:11.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.609+0000 7f62489b3640 1 -- 172.21.15.133:0/339302098 wait complete. 2023-12-18T10:25:11.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f62489b3640 1 Processor -- start 2023-12-18T10:25:11.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f62489b3640 1 -- start start 2023-12-18T10:25:11.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f62489b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624406c320 0x7f624414ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f62489b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62440c9e30 0x7f62440c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f62489b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62441570c0 0x7f62440c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f62489b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624414f1f0 con 0x7f62441570c0 2023-12-18T10:25:11.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f62489b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440cb2c0 con 0x7f624406c320 2023-12-18T10:25:11.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f62489b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62440cb5a0 con 0x7f62440c9e30 2023-12-18T10:25:11.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62441570c0 0x7f62440c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62441570c0 0x7f62440c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49386/0 (socket says 172.21.15.133:49386) 2023-12-18T10:25:11.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 -- 172.21.15.133:0/698222996 learned_addr learned my addr 172.21.15.133:0/698222996 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6239d9b640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62440c9e30 0x7f62440c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f624259c640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624406c320 0x7f624414ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 -- 172.21.15.133:0/698222996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62440c9e30 msgr2=0x7f62440c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62440c9e30 0x7f62440c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 -- 172.21.15.133:0/698222996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624406c320 msgr2=0x7f624414ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624406c320 0x7f624414ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 -- 172.21.15.133:0/698222996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234009420 con 0x7f62441570c0 2023-12-18T10:25:11.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.613+0000 7f6242d9d640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62441570c0 0x7f62440c5990 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f623c001570 tx=0x7f623c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:11.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f623b7fe640 1 -- 172.21.15.133:0/698222996 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00a640 con 0x7f62441570c0 2023-12-18T10:25:11.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f623b7fe640 1 -- 172.21.15.133:0/698222996 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00a7c0 con 0x7f62441570c0 2023-12-18T10:25:11.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f623b7fe640 1 -- 172.21.15.133:0/698222996 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00ab70 con 0x7f62441570c0 2023-12-18T10:25:11.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62440cb880 con 0x7f62441570c0 2023-12-18T10:25:11.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62440cbe40 con 0x7f62441570c0 2023-12-18T10:25:11.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62440735b0 con 0x7f62441570c0 2023-12-18T10:25:11.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f623b7fe640 1 -- 172.21.15.133:0/698222996 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f623c00acd0 con 0x7f62441570c0 2023-12-18T10:25:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f623b7fe640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6224065a90 0x7f6224067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f623b7fe640 1 -- 172.21.15.133:0/698222996 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f623c0824f0 con 0x7f62441570c0 2023-12-18T10:25:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.617+0000 7f624259c640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6224065a90 0x7f6224067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.621+0000 7f624259c640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6224065a90 0x7f6224067f50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6244150000 tx=0x7f622c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.621+0000 7f623b7fe640 1 -- 172.21.15.133:0/698222996 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f623c04ffb0 con 0x7f62441570c0 2023-12-18T10:25:11.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:11.825+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) v1 -- 0x7f62440cc030 con 0x7f62441570c0 2023-12-18T10:25:12.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.121+0000 7f623b7fe640 1 -- 172.21.15.133:0/698222996 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v373) v1 ==== 154+0+0 (secure 0 0 0) 0x7f623c0535d0 con 0x7f62441570c0 2023-12-18T10:25:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6224065a90 msgr2=0x7f6224067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6224065a90 0x7f6224067f50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6244150000 tx=0x7f622c008040 comp rx=0 tx=0).stop 2023-12-18T10:25:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62441570c0 msgr2=0x7f62440c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62441570c0 0x7f62440c5990 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f623c001570 tx=0x7f623c00cca0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 shutdown_connections 2023-12-18T10:25:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6224065a90 0x7f6224067f50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62441570c0 0x7f62440c5990 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f62440c9e30 0x7f62440c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 --2- 172.21.15.133:0/698222996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f624406c320 0x7f624414ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 >> 172.21.15.133:0/698222996 conn(0x7f624406a3e0 msgr2=0x7f6244159130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 shutdown_connections 2023-12-18T10:25:12.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.125+0000 7f62489b3640 1 -- 172.21.15.133:0/698222996 wait complete. 2023-12-18T10:25:12.145 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-12-18T10:25:12.145 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2023-12-18T10:25:12.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2023-12-18T10:25:12.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.281+0000 7f6e86be9640 1 Processor -- start 2023-12-18T10:25:12.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.281+0000 7f6e86be9640 1 -- start start 2023-12-18T10:25:12.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e86be9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800ca000 0x7f6e80164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:12.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e86be9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e800c9460 con 0x7f6e801570c0 2023-12-18T10:25:12.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e86be9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e801574a0 con 0x7f6e8006c4f0 2023-12-18T10:25:12.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e86be9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800c8b30 con 0x7f6e800ca000 2023-12-18T10:25:12.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e84985640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6e801570c0 0x7f6e8006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53320/0 (socket says 172.21.15.133:53320) 2023-12-18T10:25:12.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e84985640 1 -- 172.21.15.133:0/4008600135 learned_addr learned my addr 172.21.15.133:0/4008600135 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:12.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e85186640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800ca000 0x7f6e80164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:12.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677919282 0 0) 0x7f6e800c9460 con 0x7f6e801570c0 2023-12-18T10:25:12.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e68003530 con 0x7f6e801570c0 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246697162 0 0) 0x7f6e801574a0 con 0x7f6e8006c4f0 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e800c9460 con 0x7f6e8006c4f0 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1223754716 0 0) 0x7f6e68003530 con 0x7f6e801570c0 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800ca000 msgr2=0x7f6e80164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800ca000 0x7f6e80164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 >> v1:172.21.15.142:6789/0 conn(0x7f6e8006c4f0 legacy=0x7f6e800c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e800c8e10 con 0x7f6e801570c0 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f6e7c001680 con 0x7f6e801570c0 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 >> v1:172.21.15.133:6789/0 conn(0x7f6e801570c0 legacy=0x7f6e8006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e68003b40 0x7f6e68003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e680047d0 0x7f6e68004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800ca000 0x7f6e680051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800c8b30 con 0x7f6e68003b40 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6800dcb0 con 0x7f6e680047d0 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6800de70 con 0x7f6e800ca000 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e84985640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e68003b40 0x7f6e68003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e77fff640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e680047d0 0x7f6e68004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e85186640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800ca000 0x7f6e680051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e84985640 1 -- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800ca000 msgr2=0x7f6e680051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e84985640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e800ca000 0x7f6e680051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e84985640 1 -- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e680047d0 msgr2=0x7f6e68004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e84985640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e680047d0 0x7f6e68004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.285+0000 7f6e84985640 1 -- 172.21.15.133:0/4008600135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68003530 con 0x7f6e68003b40 2023-12-18T10:25:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e84985640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e68003b40 0x7f6e68003f40 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c190 tx=0x7f6e7c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fe10e66a173cb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0a5930 con 0x7f6e68003b40 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0a5a90 con 0x7f6e68003b40 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e777fe640 1 -- 172.21.15.133:0/4008600135 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0a5e40 con 0x7f6e68003b40 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e86be9640 1 -- 172.21.15.133:0/4008600135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e68003b40 msgr2=0x7f6e68003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e86be9640 1 --2- 172.21.15.133:0/4008600135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e68003b40 0x7f6e68003f40 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c190 tx=0x7f6e7c01cc50 comp rx=0 tx=0).stop 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e85186640 1 -- 172.21.15.133:0/4008600135 reap_dead start 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e86be9640 1 -- 172.21.15.133:0/4008600135 shutdown_connections 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e86be9640 1 -- 172.21.15.133:0/4008600135 >> 172.21.15.133:0/4008600135 conn(0x7f6e8006a3e0 msgr2=0x7f6e800afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e86be9640 1 -- 172.21.15.133:0/4008600135 shutdown_connections 2023-12-18T10:25:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e86be9640 1 -- 172.21.15.133:0/4008600135 wait complete. 2023-12-18T10:25:12.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.289+0000 7f6e86be9640 1 Processor -- start 2023-12-18T10:25:12.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 -- start start 2023-12-18T10:25:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e68003b40 0x7f6e801f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8014a9a0 0x7f6e801fc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e801fc960 0x7f6e80158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e801fcde0 con 0x7f6e801fc960 2023-12-18T10:25:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e801f8d10 con 0x7f6e68003b40 2023-12-18T10:25:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e80148e50 con 0x7f6e8014a9a0 2023-12-18T10:25:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e801fc960 0x7f6e80158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e801fc960 0x7f6e80158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49406/0 (socket says 172.21.15.133:49406) 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 -- 172.21.15.133:0/3200748841 learned_addr learned my addr 172.21.15.133:0/3200748841 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e84985640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e68003b40 0x7f6e801f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e77fff640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8014a9a0 0x7f6e801fc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 -- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8014a9a0 msgr2=0x7f6e801fc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8014a9a0 0x7f6e801fc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 -- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e68003b40 msgr2=0x7f6e801f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e68003b40 0x7f6e801f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 -- 172.21.15.133:0/3200748841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80149130 con 0x7f6e801fc960 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e84985640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e68003b40 0x7f6e801f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e85186640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e801fc960 0x7f6e80158840 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f6e68004750 tx=0x7f6e7800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e757fa640 1 -- 172.21.15.133:0/3200748841 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800e040 con 0x7f6e801fc960 2023-12-18T10:25:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e757fa640 1 -- 172.21.15.133:0/3200748841 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800f040 con 0x7f6e801fc960 2023-12-18T10:25:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e757fa640 1 -- 172.21.15.133:0/3200748841 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78015670 con 0x7f6e801fc960 2023-12-18T10:25:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e80149410 con 0x7f6e801fc960 2023-12-18T10:25:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.293+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e801499d0 con 0x7f6e801fc960 2023-12-18T10:25:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.297+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e800735b0 con 0x7f6e801fc960 2023-12-18T10:25:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.297+0000 7f6e757fa640 1 -- 172.21.15.133:0/3200748841 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e780157d0 con 0x7f6e801fc960 2023-12-18T10:25:12.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.297+0000 7f6e757fa640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a60 0x7f6e6c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:12.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.297+0000 7f6e757fa640 1 -- 172.21.15.133:0/3200748841 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f6e780838d0 con 0x7f6e801fc960 2023-12-18T10:25:12.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.297+0000 7f6e84985640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a60 0x7f6e6c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:12.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.297+0000 7f6e84985640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a60 0x7f6e6c067f20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0aa000 tx=0x7f6e7c001990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:12.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.301+0000 7f6e757fa640 1 -- 172.21.15.133:0/3200748841 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6e78051300 con 0x7f6e801fc960 2023-12-18T10:25:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:12.521+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) v1 -- 0x7f6e8004e000 con 0x7f6e801fc960 2023-12-18T10:25:13.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.125+0000 7f6e757fa640 1 -- 172.21.15.133:0/3200748841 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v374) v1 ==== 168+0+0 (secure 0 0 0) 0x7f6e78054920 con 0x7f6e801fc960 2023-12-18T10:25:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a60 msgr2=0x7f6e6c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a60 0x7f6e6c067f20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0aa000 tx=0x7f6e7c001990 comp rx=0 tx=0).stop 2023-12-18T10:25:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e801fc960 msgr2=0x7f6e80158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e801fc960 0x7f6e80158840 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f6e68004750 tx=0x7f6e7800f580 comp rx=0 tx=0).stop 2023-12-18T10:25:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 shutdown_connections 2023-12-18T10:25:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6e6c065a60 0x7f6e6c067f20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e801fc960 0x7f6e80158840 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e8014a9a0 0x7f6e801fc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 --2- 172.21.15.133:0/3200748841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e68003b40 0x7f6e801f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 >> 172.21.15.133:0/3200748841 conn(0x7f6e8006a3e0 msgr2=0x7f6e800cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 shutdown_connections 2023-12-18T10:25:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.129+0000 7f6e86be9640 1 -- 172.21.15.133:0/3200748841 wait complete. 2023-12-18T10:25:13.149 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-18T10:25:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.289+0000 7f7bddf09640 1 Processor -- start 2023-12-18T10:25:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.289+0000 7f7bddf09640 1 -- start start 2023-12-18T10:25:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bddf09640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7bd8071870 0x7f7bd8071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bddf09640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd8070df0 con 0x7f7bd80cbff0 2023-12-18T10:25:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bddf09640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd815a4f0 con 0x7f7bd80ca410 2023-12-18T10:25:13.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bddf09640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd815aab0 con 0x7f7bd8071870 2023-12-18T10:25:13.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7bd80cbff0 0x7f7bd80ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53334/0 (socket says 172.21.15.133:53334) 2023-12-18T10:25:13.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd7fff640 1 -- 172.21.15.133:0/874469033 learned_addr learned my addr 172.21.15.133:0/874469033 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850339852 0 0) 0x7f7bd8070df0 con 0x7f7bd80cbff0 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bcffff640 1 --2- 172.21.15.133:0/874469033 >> v2:172.21.15.142:3300/0 conn(0x7f7bd8071870 0x7f7bd8071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc4005740 con 0x7f7bd80cbff0 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3896297558 0 0) 0x7f7bc4005740 con 0x7f7bd80cbff0 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 >> v2:172.21.15.142:3300/0 conn(0x7f7bd8071870 msgr2=0x7f7bd8071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 --2- 172.21.15.133:0/874469033 >> v2:172.21.15.142:3300/0 conn(0x7f7bd8071870 0x7f7bd8071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 >> v1:172.21.15.142:6789/0 conn(0x7f7bd80ca410 legacy=0x7f7bd8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd815a7d0 con 0x7f7bd80cbff0 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f7bd0001a00 con 0x7f7bd80cbff0 2023-12-18T10:25:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 >> v1:172.21.15.133:6789/0 conn(0x7f7bd80cbff0 legacy=0x7f7bd80ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc4005b90 0x7f7bc4005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40069e0 0x7f7bc4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc40073a0 0x7f7bc400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd815aab0 con 0x7f7bc40069e0 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc400e240 con 0x7f7bc4005b90 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc400e400 con 0x7f7bc40073a0 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bcffff640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40069e0 0x7f7bc4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd77fe640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc4005b90 0x7f7bc4005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd7fff640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc40073a0 0x7f7bc400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bcffff640 1 -- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc40073a0 msgr2=0x7f7bc400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bcffff640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bc40073a0 0x7f7bc400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bcffff640 1 -- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc4005b90 msgr2=0x7f7bc4005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bcffff640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc4005b90 0x7f7bc4005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bcffff640 1 -- 172.21.15.133:0/874469033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4005740 con 0x7f7bc40069e0 2023-12-18T10:25:13.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd77fe640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc4005b90 0x7f7bc4005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:13.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.293+0000 7f7bd7fff640 1 -- 172.21.15.133:0/874469033 reap_dead start 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bcffff640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40069e0 0x7f7bc4006e60 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009ae0 tx=0x7f7bc001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d438284e94df3c5d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc00a5530 con 0x7f7bc40069e0 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc00a5690 con 0x7f7bc40069e0 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bd6ffd640 1 -- 172.21.15.133:0/874469033 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc00a5a40 con 0x7f7bc40069e0 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bddf09640 1 -- 172.21.15.133:0/874469033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40069e0 msgr2=0x7f7bc4006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bddf09640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40069e0 0x7f7bc4006e60 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009ae0 tx=0x7f7bc001ca50 comp rx=0 tx=0).stop 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bddf09640 1 -- 172.21.15.133:0/874469033 shutdown_connections 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bddf09640 1 --2- 172.21.15.133:0/874469033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40069e0 0x7f7bc4006e60 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bddf09640 1 -- 172.21.15.133:0/874469033 >> 172.21.15.133:0/874469033 conn(0x7f7bd806a2a0 msgr2=0x7f7bd80aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bddf09640 1 -- 172.21.15.133:0/874469033 shutdown_connections 2023-12-18T10:25:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.297+0000 7f7bddf09640 1 -- 172.21.15.133:0/874469033 wait complete. 2023-12-18T10:25:13.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 Processor -- start 2023-12-18T10:25:13.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 -- start start 2023-12-18T10:25:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc40069e0 0x7f7bd814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bd80acc20 0x7f7bd81e3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bd80aeea0 0x7f7bd80af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80af860 con 0x7f7bd80aeea0 2023-12-18T10:25:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80ac790 con 0x7f7bc40069e0 2023-12-18T10:25:13.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd81e31e0 con 0x7f7bd80acc20 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bd80aeea0 0x7f7bd80af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bd80aeea0 0x7f7bd80af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49422/0 (socket says 172.21.15.133:49422) 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 -- 172.21.15.133:0/2965962267 learned_addr learned my addr 172.21.15.133:0/2965962267 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd77fe640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc40069e0 0x7f7bd814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bcffff640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bd80acc20 0x7f7bd81e3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 -- 172.21.15.133:0/2965962267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bd80acc20 msgr2=0x7f7bd81e3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bd80acc20 0x7f7bd81e3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 -- 172.21.15.133:0/2965962267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc40069e0 msgr2=0x7f7bd814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc40069e0 0x7f7bd814ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 -- 172.21.15.133:0/2965962267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd80ab8a0 con 0x7f7bd80aeea0 2023-12-18T10:25:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd7fff640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bd80aeea0 0x7f7bd80af320 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80cd820 tx=0x7f7bd0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd4ff9640 1 -- 172.21.15.133:0/2965962267 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000f950 con 0x7f7bd80aeea0 2023-12-18T10:25:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd4ff9640 1 -- 172.21.15.133:0/2965962267 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000fb10 con 0x7f7bd80aeea0 2023-12-18T10:25:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bd4ff9640 1 -- 172.21.15.133:0/2965962267 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000fec0 con 0x7f7bd80aeea0 2023-12-18T10:25:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd80abb80 con 0x7f7bd80aeea0 2023-12-18T10:25:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd80ac140 con 0x7f7bd80aeea0 2023-12-18T10:25:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.301+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd804e000 con 0x7f7bd80aeea0 2023-12-18T10:25:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.305+0000 7f7bd4ff9640 1 -- 172.21.15.133:0/2965962267 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7bd001f460 con 0x7f7bd80aeea0 2023-12-18T10:25:13.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.305+0000 7f7bd4ff9640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bb8065a60 0x7f7bb8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.305+0000 7f7bd4ff9640 1 -- 172.21.15.133:0/2965962267 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7bd0085e10 con 0x7f7bd80aeea0 2023-12-18T10:25:13.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.305+0000 7f7bd77fe640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bb8065a60 0x7f7bb8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.305+0000 7f7bd77fe640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bb8065a60 0x7f7bb8067f20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8000c10 tx=0x7f7bc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.309+0000 7f7bd4ff9640 1 -- 172.21.15.133:0/2965962267 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7bd0089030 con 0x7f7bd80aeea0 2023-12-18T10:25:13.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.457+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7bd81550a0 con 0x7f7bd80aeea0 2023-12-18T10:25:13.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.461+0000 7f7bd4ff9640 1 -- 172.21.15.133:0/2965962267 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7bd00538d0 con 0x7f7bd80aeea0 2023-12-18T10:25:13.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bb8065a60 msgr2=0x7f7bb8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bb8065a60 0x7f7bb8067f20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8000c10 tx=0x7f7bc8009040 comp rx=0 tx=0).stop 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bd80aeea0 msgr2=0x7f7bd80af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bd80aeea0 0x7f7bd80af320 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80cd820 tx=0x7f7bd0011b60 comp rx=0 tx=0).stop 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 shutdown_connections 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7bb8065a60 0x7f7bb8067f20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bd80aeea0 0x7f7bd80af320 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7bd80acc20 0x7f7bd81e3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 --2- 172.21.15.133:0/2965962267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bc40069e0 0x7f7bd814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 >> 172.21.15.133:0/2965962267 conn(0x7f7bd806a2a0 msgr2=0x7f7bd81555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 shutdown_connections 2023-12-18T10:25:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.465+0000 7f7bddf09640 1 -- 172.21.15.133:0/2965962267 wait complete. 2023-12-18T10:25:13.484 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:25:13.484 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:25:13.558 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:25:13.643 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:25:13.643 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:25:13.643 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:25:13.653 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:25:13.653 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:25:13.653 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:25:13.663 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:25:13.663 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:25:13.663 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:25:13.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:25:13.703 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:25:13.703 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:25:13.716 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:25:13.716 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-18T10:25:13.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:13.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d468c640 1 Processor -- start 2023-12-18T10:25:13.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d468c640 1 -- start start 2023-12-18T10:25:13.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d468c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6cc0cf530 0x7fc6cc168000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d468c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0d11c0 con 0x7fc6cc0cf0d0 2023-12-18T10:25:13.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d468c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0d0310 con 0x7fc6cc15ca40 2023-12-18T10:25:13.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d468c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0d05b0 con 0x7fc6cc0cf530 2023-12-18T10:25:13.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d2c29640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6cc0cf530 0x7fc6cc168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d1c27640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc6cc0cf0d0 0x7fc6cc1648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53342/0 (socket says 172.21.15.133:53342) 2023-12-18T10:25:13.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d1c27640 1 -- 172.21.15.133:0/2321994653 learned_addr learned my addr 172.21.15.133:0/2321994653 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:13.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d2c29640 1 -- 172.21.15.133:0/2321994653 >> v1:172.21.15.142:6789/0 conn(0x7fc6cc15ca40 legacy=0x7fc6cc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:13.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d2c29640 1 -- 172.21.15.133:0/2321994653 >> v1:172.21.15.133:6789/0 conn(0x7fc6cc0cf0d0 legacy=0x7fc6cc1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d2c29640 1 -- 172.21.15.133:0/2321994653 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0d0890 con 0x7fc6cc0cf530 2023-12-18T10:25:13.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.885+0000 7fc6d1426640 1 -- 172.21.15.133:0/2321994653 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926654129 0 0) 0x7fc6cc0d11c0 con 0x7fc6cc0cf0d0 2023-12-18T10:25:13.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d2c29640 1 --2- 172.21.15.133:0/2321994653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc0cf530 0x7fc6cc168000 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009d90 tx=0x7fc6c401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c364280abb903f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:13.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d1426640 1 -- 172.21.15.133:0/2321994653 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40a59a0 con 0x7fc6cc0cf530 2023-12-18T10:25:13.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d1426640 1 -- 172.21.15.133:0/2321994653 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c40a5b00 con 0x7fc6cc0cf530 2023-12-18T10:25:13.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d1426640 1 -- 172.21.15.133:0/2321994653 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40a5e90 con 0x7fc6cc0cf530 2023-12-18T10:25:13.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d468c640 1 -- 172.21.15.133:0/2321994653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc0cf530 msgr2=0x7fc6cc168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d468c640 1 --2- 172.21.15.133:0/2321994653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc0cf530 0x7fc6cc168000 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009d90 tx=0x7fc6c401c8e0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d468c640 1 -- 172.21.15.133:0/2321994653 shutdown_connections 2023-12-18T10:25:13.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d468c640 1 --2- 172.21.15.133:0/2321994653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc0cf530 0x7fc6cc168000 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d468c640 1 -- 172.21.15.133:0/2321994653 >> 172.21.15.133:0/2321994653 conn(0x7fc6cc089fb0 msgr2=0x7fc6cc0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:13.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d468c640 1 -- 172.21.15.133:0/2321994653 shutdown_connections 2023-12-18T10:25:13.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.889+0000 7fc6d468c640 1 -- 172.21.15.133:0/2321994653 wait complete. 2023-12-18T10:25:13.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 Processor -- start 2023-12-18T10:25:13.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 -- start start 2023-12-18T10:25:13.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0cf0d0 0x7fc6cc14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0cf530 0x7fc6cc151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc15ca40 0x7fc6cc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc153240 con 0x7fc6cc15ca40 2023-12-18T10:25:13.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0c9810 con 0x7fc6cc0cf0d0 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1538a0 con 0x7fc6cc0cf530 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc15ca40 0x7fc6cc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc15ca40 0x7fc6cc1519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49430/0 (socket says 172.21.15.133:49430) 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 -- 172.21.15.133:0/1296115550 learned_addr learned my addr 172.21.15.133:0/1296115550 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 -- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0cf530 msgr2=0x7fc6cc151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d1c27640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0cf530 0x7fc6cc151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2428640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0cf0d0 0x7fc6cc14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0cf530 0x7fc6cc151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 -- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0cf0d0 msgr2=0x7fc6cc14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0cf0d0 0x7fc6cc14f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 -- 172.21.15.133:0/1296115550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4009a70 con 0x7fc6cc15ca40 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d1c27640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0cf530 0x7fc6cc151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2428640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0cf0d0 0x7fc6cc14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d2c29640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc15ca40 0x7fc6cc1519b0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fc6c401a510 tx=0x7fc6c4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6c2ffd640 1 -- 172.21.15.133:0/1296115550 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40add90 con 0x7fc6cc15ca40 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6c2ffd640 1 -- 172.21.15.133:0/1296115550 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c40b9450 con 0x7fc6cc15ca40 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc0c9a60 con 0x7fc6cc15ca40 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6c2ffd640 1 -- 172.21.15.133:0/1296115550 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40b97e0 con 0x7fc6cc15ca40 2023-12-18T10:25:13.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc0ca020 con 0x7fc6cc15ca40 2023-12-18T10:25:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.893+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc04e000 con 0x7fc6cc15ca40 2023-12-18T10:25:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.897+0000 7fc6c2ffd640 1 -- 172.21.15.133:0/1296115550 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc6c40b9940 con 0x7fc6cc15ca40 2023-12-18T10:25:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.897+0000 7fc6c2ffd640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6b0065a60 0x7fc6b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.897+0000 7fc6c2ffd640 1 -- 172.21.15.133:0/1296115550 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fc6c411ea00 con 0x7fc6cc15ca40 2023-12-18T10:25:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.897+0000 7fc6d2428640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6b0065a60 0x7fc6b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.897+0000 7fc6d2428640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6b0065a60 0x7fc6b0067f20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0b4140 tx=0x7fc6c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:13.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:13.901+0000 7fc6c2ffd640 1 -- 172.21.15.133:0/1296115550 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc6c40ec4f0 con 0x7fc6cc15ca40 2023-12-18T10:25:14.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.081+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6cc0d1630 con 0x7fc6cc15ca40 2023-12-18T10:25:14.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.081+0000 7fc6c2ffd640 1 -- 172.21.15.133:0/1296115550 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fc6c40bdde0 con 0x7fc6cc15ca40 2023-12-18T10:25:14.081 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:14.081 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":97,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2869887161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2869887161},{"type":"v1","addr":"172.21.15.133:6835","nonce":2869887161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3304047553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":3304047553},{"type":"v1","addr":"172.21.15.142:6835","nonce":3304047553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97},{"gid":7597,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/679758589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":679758589},{"type":"v1","addr":"172.21.15.142:6834","nonce":679758589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":8970,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/549419979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":549419979},{"type":"v1","addr":"172.21.15.133:6837","nonce":549419979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[]} 2023-12-18T10:25:14.082 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 97 2023-12-18T10:25:14.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.081+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6b0065a60 msgr2=0x7fc6b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:14.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.081+0000 7fc6d468c640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6b0065a60 0x7fc6b0067f20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0b4140 tx=0x7fc6c8009040 comp rx=0 tx=0).stop 2023-12-18T10:25:14.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.081+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc15ca40 msgr2=0x7fc6cc1519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:14.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.081+0000 7fc6d468c640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc15ca40 0x7fc6cc1519b0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fc6c401a510 tx=0x7fc6c4019680 comp rx=0 tx=0).stop 2023-12-18T10:25:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.085+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 shutdown_connections 2023-12-18T10:25:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.085+0000 7fc6d468c640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc6b0065a60 0x7fc6b0067f20 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.085+0000 7fc6d468c640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc15ca40 0x7fc6cc1519b0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.085+0000 7fc6d468c640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc6cc0cf530 0x7fc6cc151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.085+0000 7fc6d468c640 1 --2- 172.21.15.133:0/1296115550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6cc0cf0d0 0x7fc6cc14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.085+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 >> 172.21.15.133:0/1296115550 conn(0x7fc6cc089fb0 msgr2=0x7fc6cc0b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.085+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 shutdown_connections 2023-12-18T10:25:14.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.085+0000 7fc6d468c640 1 -- 172.21.15.133:0/1296115550 wait complete. 2023-12-18T10:25:14.102 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-18T10:25:14.102 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-18T10:25:14.103 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-18T10:25:14.103 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:25:14.103 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-18T10:25:14.103 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-18T10:25:14.103 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-18T10:25:14.103 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:25:14.103 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-18T10:25:14.103 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-18T10:25:14.104 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-18T10:25:14.104 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:25:14.104 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-18T10:25:14.104 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-18T10:25:14.104 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-18T10:25:14.104 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:25:14.116 INFO:tasks.ceph.mds.a:Stopped 2023-12-18T10:25:14.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-18T10:25:14.118 INFO:tasks.ceph.mds.c:Stopped 2023-12-18T10:25:14.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-18T10:25:14.119 INFO:tasks.ceph.mds.b:Stopped 2023-12-18T10:25:14.119 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-18T10:25:14.120 INFO:tasks.ceph.mds.d:Stopped 2023-12-18T10:25:14.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-18T10:25:14.166 INFO:tasks.ceph.mds.a:Started 2023-12-18T10:25:14.166 DEBUG:teuthology.parallel:result is None 2023-12-18T10:25:14.168 INFO:tasks.ceph.mds.c:Started 2023-12-18T10:25:14.169 DEBUG:teuthology.parallel:result is None 2023-12-18T10:25:14.171 INFO:tasks.ceph.mds.b:Started 2023-12-18T10:25:14.171 DEBUG:teuthology.parallel:result is None 2023-12-18T10:25:14.173 INFO:tasks.ceph.mds.d:Started 2023-12-18T10:25:14.173 DEBUG:teuthology.parallel:result is None 2023-12-18T10:25:14.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-18T10:25:14.254 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:25:14.254 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:25:14.261 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2023-12-18T10:25:14.261 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:25:14.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-18T10:25:14.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-18T10:25:14.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-18T10:25:14.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-18T10:25:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe834cc4640 1 Processor -- start 2023-12-18T10:25:14.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe834cc4640 1 -- start start 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe834cc4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe83015a680 0x7fe83015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe834cc4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83015f100 con 0x7fe8300cac10 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe834cc4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8300ca7d0 con 0x7fe83006fdb0 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe834cc4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83015e860 con 0x7fe83015a680 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe82e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe83015a680 0x7fe83015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe827fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe8300cac10 0x7fe83015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53364/0 (socket says 172.21.15.133:53364) 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe827fff640 1 -- 172.21.15.133:0/1272195904 learned_addr learned my addr 172.21.15.133:0/1272195904 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe82dd9b640 1 -- 172.21.15.133:0/1272195904 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444313002 0 0) 0x7fe83015f100 con 0x7fe8300cac10 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe82dd9b640 1 -- 172.21.15.133:0/1272195904 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe81c003530 con 0x7fe8300cac10 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe82e59c640 1 -- 172.21.15.133:0/1272195904 >> v1:172.21.15.142:6789/0 conn(0x7fe83006fdb0 legacy=0x7fe8300c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe82dd9b640 1 -- 172.21.15.133:0/1272195904 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822321766 0 0) 0x7fe8300ca7d0 con 0x7fe83006fdb0 2023-12-18T10:25:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe82e59c640 1 -- 172.21.15.133:0/1272195904 >> v1:172.21.15.133:6789/0 conn(0x7fe8300cac10 legacy=0x7fe83015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:14.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.325+0000 7fe82e59c640 1 -- 172.21.15.133:0/1272195904 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83015eb40 con 0x7fe83015a680 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe82e59c640 1 --2- 172.21.15.133:0/1272195904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015a680 0x7fe83015e160 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe8200097f0 tx=0x7fe82001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01f2af2bc0039a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe82dd9b640 1 -- 172.21.15.133:0/1272195904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200ab5f0 con 0x7fe83015a680 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe82dd9b640 1 -- 172.21.15.133:0/1272195904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8200ab750 con 0x7fe83015a680 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe82dd9b640 1 -- 172.21.15.133:0/1272195904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200abae0 con 0x7fe83015a680 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe834cc4640 1 -- 172.21.15.133:0/1272195904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015a680 msgr2=0x7fe83015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe834cc4640 1 --2- 172.21.15.133:0/1272195904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015a680 0x7fe83015e160 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe8200097f0 tx=0x7fe82001c3f0 comp rx=0 tx=0).stop 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe834cc4640 1 -- 172.21.15.133:0/1272195904 shutdown_connections 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe834cc4640 1 --2- 172.21.15.133:0/1272195904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015a680 0x7fe83015e160 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe834cc4640 1 -- 172.21.15.133:0/1272195904 >> 172.21.15.133:0/1272195904 conn(0x7fe83006a3e0 msgr2=0x7fe8300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe834cc4640 1 -- 172.21.15.133:0/1272195904 shutdown_connections 2023-12-18T10:25:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.329+0000 7fe834cc4640 1 -- 172.21.15.133:0/1272195904 wait complete. 2023-12-18T10:25:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 Processor -- start 2023-12-18T10:25:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 -- start start 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83006fdb0 0x7fe830153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cac10 0x7fe8300c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe83015a680 0x7fe83006bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8301576b0 con 0x7fe8300cac10 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830152690 con 0x7fe83015a680 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe830154150 con 0x7fe83006fdb0 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cac10 0x7fe8300c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe82e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83006fdb0 0x7fe830153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cac10 0x7fe8300c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49488/0 (socket says 172.21.15.133:49488) 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 -- 172.21.15.133:0/866487392 learned_addr learned my addr 172.21.15.133:0/866487392 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe82e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83006fdb0 0x7fe830153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:45058/0 (socket says 172.21.15.133:45058) 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe82ed9d640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe83015a680 0x7fe83006bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 -- 172.21.15.133:0/866487392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83006fdb0 msgr2=0x7fe830153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83006fdb0 0x7fe830153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 -- 172.21.15.133:0/866487392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe83015a680 msgr2=0x7fe83006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe83015a680 0x7fe83006bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 -- 172.21.15.133:0/866487392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe820009420 con 0x7fe8300cac10 2023-12-18T10:25:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe827fff640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cac10 0x7fe8300c56a0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe81800c3c0 tx=0x7fe81800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe826ffd640 1 -- 172.21.15.133:0/866487392 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818005cf0 con 0x7fe8300cac10 2023-12-18T10:25:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe826ffd640 1 -- 172.21.15.133:0/866487392 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818005e50 con 0x7fe8300cac10 2023-12-18T10:25:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe826ffd640 1 -- 172.21.15.133:0/866487392 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180072f0 con 0x7fe8300cac10 2023-12-18T10:25:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8300c5be0 con 0x7fe8300cac10 2023-12-18T10:25:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.333+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe830156d80 con 0x7fe8300cac10 2023-12-18T10:25:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.337+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8300735b0 con 0x7fe8300cac10 2023-12-18T10:25:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.337+0000 7fe826ffd640 1 -- 172.21.15.133:0/866487392 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe818007450 con 0x7fe8300cac10 2023-12-18T10:25:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.337+0000 7fe826ffd640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.337+0000 7fe826ffd640 1 -- 172.21.15.133:0/866487392 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe818082660 con 0x7fe8300cac10 2023-12-18T10:25:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.337+0000 7fe82e59c640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.337+0000 7fe82e59c640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe8200af000 tx=0x7fe8200a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.341+0000 7fe826ffd640 1 -- 172.21.15.133:0/866487392 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe818050140 con 0x7fe8300cac10 2023-12-18T10:25:14.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:14.505+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe83004e000 con 0x7fe8300cac10 2023-12-18T10:25:15.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.293+0000 7fe826ffd640 1 -- 172.21.15.133:0/866487392 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v101) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe818017020 con 0x7fe8300cac10 2023-12-18T10:25:15.293 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 msgr2=0x7fe810067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe8200af000 tx=0x7fe8200a7000 comp rx=0 tx=0).stop 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cac10 msgr2=0x7fe8300c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cac10 0x7fe8300c56a0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe81800c3c0 tx=0x7fe81800c880 comp rx=0 tx=0).stop 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 shutdown_connections 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe83015a680 0x7fe83006bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cac10 0x7fe8300c56a0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 --2- 172.21.15.133:0/866487392 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83006fdb0 0x7fe830153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 >> 172.21.15.133:0/866487392 conn(0x7fe83006a3e0 msgr2=0x7fe83015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:15.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 shutdown_connections 2023-12-18T10:25:15.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.297+0000 7fe834cc4640 1 -- 172.21.15.133:0/866487392 wait complete. 2023-12-18T10:25:15.319 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-18T10:25:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba8c3640 1 Processor -- start 2023-12-18T10:25:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba8c3640 1 -- start start 2023-12-18T10:25:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba8c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb4143f50 0x7f4bb40c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba8c3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4bb406c5b0 0x7f4bb40b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba8c3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb40c36c0 con 0x7f4bb40afd10 2023-12-18T10:25:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba8c3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb406ca40 con 0x7f4bb406c5b0 2023-12-18T10:25:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba8c3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40b06d0 con 0x7f4bb4143f50 2023-12-18T10:25:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba0c2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4bb406c5b0 0x7f4bb40b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bb90c0640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4bb40afd10 0x7f4bb406bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53378/0 (socket says 172.21.15.133:53378) 2023-12-18T10:25:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bb90c0640 1 -- 172.21.15.133:0/3765235459 learned_addr learned my addr 172.21.15.133:0/3765235459 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bb98c1640 1 --2- 172.21.15.133:0/3765235459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb4143f50 0x7f4bb40c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba0c2640 1 -- 172.21.15.133:0/3765235459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb4143f50 msgr2=0x7f4bb40c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba0c2640 1 --2- 172.21.15.133:0/3765235459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb4143f50 0x7f4bb40c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba0c2640 1 -- 172.21.15.133:0/3765235459 >> v1:172.21.15.133:6789/0 conn(0x7f4bb40afd10 legacy=0x7f4bb406bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bba0c2640 1 -- 172.21.15.133:0/3765235459 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb40c39a0 con 0x7f4bb406c5b0 2023-12-18T10:25:15.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.461+0000 7f4bb88bf640 1 -- 172.21.15.133:0/3765235459 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539218374 0 0) 0x7f4bb40c36c0 con 0x7f4bb40afd10 2023-12-18T10:25:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba0c2640 1 --2- 172.21.15.133:0/3765235459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb40b0190 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009d90 tx=0x7f4bac01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62030451e05118b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bb88bf640 1 -- 172.21.15.133:0/3765235459 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0a5a30 con 0x7f4bb406c5b0 2023-12-18T10:25:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bb88bf640 1 -- 172.21.15.133:0/3765235459 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac0a5b90 con 0x7f4bb406c5b0 2023-12-18T10:25:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bb88bf640 1 -- 172.21.15.133:0/3765235459 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0ad440 con 0x7f4bb406c5b0 2023-12-18T10:25:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3765235459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 msgr2=0x7f4bb40b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3765235459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb40b0190 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009d90 tx=0x7f4bac01c950 comp rx=0 tx=0).stop 2023-12-18T10:25:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3765235459 shutdown_connections 2023-12-18T10:25:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3765235459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb40b0190 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3765235459 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb4143f50 0x7f4bb40c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3765235459 >> 172.21.15.133:0/3765235459 conn(0x7f4bb40ce130 msgr2=0x7f4bb40ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3765235459 shutdown_connections 2023-12-18T10:25:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.465+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3765235459 wait complete. 2023-12-18T10:25:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 Processor -- start 2023-12-18T10:25:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 -- start start 2023-12-18T10:25:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb40afd10 0x7f4bb413b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb4143f50 0x7f4bb40cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb4159800 con 0x7f4bb406c5b0 2023-12-18T10:25:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40cdb60 con 0x7f4bb4143f50 2023-12-18T10:25:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb4159a10 con 0x7f4bb40afd10 2023-12-18T10:25:15.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb415a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49502/0 (socket says 172.21.15.133:49502) 2023-12-18T10:25:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 -- 172.21.15.133:0/3921735234 learned_addr learned my addr 172.21.15.133:0/3921735234 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 -- 172.21.15.133:0/3921735234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb40afd10 msgr2=0x7f4bb413b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb40afd10 0x7f4bb413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 -- 172.21.15.133:0/3921735234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb4143f50 msgr2=0x7f4bb40cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb4143f50 0x7f4bb40cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 -- 172.21.15.133:0/3921735234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac009a70 con 0x7f4bb406c5b0 2023-12-18T10:25:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bb98c1640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb415a0b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000d5f0 tx=0x7f4bb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4baa7fc640 1 -- 172.21.15.133:0/3921735234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb00125f0 con 0x7f4bb406c5b0 2023-12-18T10:25:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4baa7fc640 1 -- 172.21.15.133:0/3921735234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb0012750 con 0x7f4bb406c5b0 2023-12-18T10:25:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4baa7fc640 1 -- 172.21.15.133:0/3921735234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0012ae0 con 0x7f4bb406c5b0 2023-12-18T10:25:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb4163680 con 0x7f4bb406c5b0 2023-12-18T10:25:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.469+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb4159cf0 con 0x7f4bb406c5b0 2023-12-18T10:25:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.473+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb404e850 con 0x7f4bb406c5b0 2023-12-18T10:25:15.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.473+0000 7f4baa7fc640 1 -- 172.21.15.133:0/3921735234 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4bb0012c40 con 0x7f4bb406c5b0 2023-12-18T10:25:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.473+0000 7f4baa7fc640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.473+0000 7f4baa7fc640 1 -- 172.21.15.133:0/3921735234 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4bb0083520 con 0x7f4bb406c5b0 2023-12-18T10:25:15.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.473+0000 7f4bb90c0640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.473+0000 7f4bb90c0640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40011f0 tx=0x7f4ba4007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:15.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.477+0000 7f4baa7fc640 1 -- 172.21.15.133:0/3921735234 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4bb0051050 con 0x7f4bb406c5b0 2023-12-18T10:25:15.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.677+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4bb40b0940 con 0x7f4bb406c5b0 2023-12-18T10:25:15.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4baa7fc640 1 -- 172.21.15.133:0/3921735234 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4bb0054670 con 0x7f4bb406c5b0 2023-12-18T10:25:15.679 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlq/3QHRAAeGrWPAL1IMuRSsb9HM8t0Q==", 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBleUoUKhAA7KQ881Hp59b6BfYF5Mc8Rw==", 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlsRoJJRAAYgbCztPYO/qzR7wJgYhPqQ==", 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.681 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlr0paMRAAUlbr607Vw8Yc0/S1EvLUUA==", 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.682 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAgHIBlbTjYDhAA2KUnOrWIaGtzxXx9T64djw==", 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjHIBlr8a1FhAAGRT54akJvp65F8xxu9Mw1g==", 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:25:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAmHIBlv+HSHBAAxDHSTox1AtpTMfCNbatjzA==", 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApHIBlj5xPIxAAkZglsOO2rg+8kXVIb+JK+w==", 2023-12-18T10:25:15.684 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAvHIBlhQRmKxAAahzzO4gYz5LHWhvFvZlOAA==", 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.685 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyHIBlatiUMhAAk0X1zO+dYOu5hMZvGBJNkQ==", 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1HIBl86v0OBAA70FwnvAugWtLupto+cbBjg==", 2023-12-18T10:25:15.686 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA5HIBlZAYVBBAAa0V4jDTdYV8TBoNR7SenjQ==", 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.687 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlugNkNRAADsDapfYnOr+gcvgQ4394aA==", 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlM7J1AxAAgoKo5xm3Wz4xWjPX4Mpn0A==", 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:25:15.688 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlrzVcOxAAwwd6eFzNGehg/4chJq1qJA==", 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.689 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAdHIBlRgxmCRAAN/aEmPSonvc17SvLB1GdXQ==", 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAbHIBlJHzPORAAQupFGwV6/izxeyNlnyeMSA==", 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.690 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBlDP4UFhAA8KB7vRFpeBSRad2GRiKh/A==", 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:15.691 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAcHIBl+lIiEhAAx9zNJbwPBf7oGsFzDJKxEw==", 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-18T10:25:15.692 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:15.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 msgr2=0x7f4b98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40011f0 tx=0x7f4ba4007930 comp rx=0 tx=0).stop 2023-12-18T10:25:15.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 msgr2=0x7f4bb415a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb415a0b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000d5f0 tx=0x7f4bb000dab0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 shutdown_connections 2023-12-18T10:25:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb4143f50 0x7f4bb40cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb40afd10 0x7f4bb413b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 --2- 172.21.15.133:0/3921735234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb406c5b0 0x7f4bb415a0b0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 >> 172.21.15.133:0/3921735234 conn(0x7f4bb40ce130 msgr2=0x7f4bb40713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 shutdown_connections 2023-12-18T10:25:15.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.681+0000 7f4bba8c3640 1 -- 172.21.15.133:0/3921735234 wait complete. 2023-12-18T10:25:15.701 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:25:15.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.837+0000 7ff8d8d39640 1 Processor -- start 2023-12-18T10:25:15.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.837+0000 7ff8d8d39640 1 -- start start 2023-12-18T10:25:15.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d8d39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8d41570c0 0x7ff8d406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d8d39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff8d406c320 0x7ff8d40c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d8d39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d40c9460 con 0x7ff8d40c9e30 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d8d39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d406c7a0 con 0x7ff8d41570c0 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d8d39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d41574a0 con 0x7ff8d406c320 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8d41570c0 0x7ff8d406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8d41570c0 0x7ff8d406bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49516/0 (socket says 172.21.15.133:49516) 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d259c640 1 -- 172.21.15.133:0/4101355154 learned_addr learned my addr 172.21.15.133:0/4101355154 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8c9d9b640 1 --2- 172.21.15.133:0/4101355154 >> v2:172.21.15.142:3300/0 conn(0x7ff8d406c320 0x7ff8d40c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d259c640 1 -- 172.21.15.133:0/4101355154 >> v2:172.21.15.142:3300/0 conn(0x7ff8d406c320 msgr2=0x7ff8d40c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d259c640 1 --2- 172.21.15.133:0/4101355154 >> v2:172.21.15.142:3300/0 conn(0x7ff8d406c320 0x7ff8d40c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d259c640 1 -- 172.21.15.133:0/4101355154 >> v1:172.21.15.142:6789/0 conn(0x7ff8d40c9e30 legacy=0x7ff8d415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d259c640 1 -- 172.21.15.133:0/4101355154 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d40c8b30 con 0x7ff8d41570c0 2023-12-18T10:25:15.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8c9d9b640 1 --2- 172.21.15.133:0/4101355154 >> v2:172.21.15.142:3300/0 conn(0x7ff8d406c320 0x7ff8d40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:15.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.841+0000 7ff8d259c640 1 --2- 172.21.15.133:0/4101355154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d406bde0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40ce330 tx=0x7ff8c401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d35d4685d423581 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:15.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d1d9b640 1 -- 172.21.15.133:0/4101355154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40ac640 con 0x7ff8d41570c0 2023-12-18T10:25:15.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d1d9b640 1 -- 172.21.15.133:0/4101355154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c40ac7a0 con 0x7ff8d41570c0 2023-12-18T10:25:15.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d1d9b640 1 -- 172.21.15.133:0/4101355154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40acb30 con 0x7ff8d41570c0 2023-12-18T10:25:15.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- 172.21.15.133:0/4101355154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 msgr2=0x7ff8d406bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/4101355154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d406bde0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40ce330 tx=0x7ff8c401c400 comp rx=0 tx=0).stop 2023-12-18T10:25:15.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- 172.21.15.133:0/4101355154 shutdown_connections 2023-12-18T10:25:15.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/4101355154 >> v2:172.21.15.142:3300/0 conn(0x7ff8d406c320 0x7ff8d40c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/4101355154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d406bde0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- 172.21.15.133:0/4101355154 >> 172.21.15.133:0/4101355154 conn(0x7ff8d406a3e0 msgr2=0x7ff8d40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- 172.21.15.133:0/4101355154 shutdown_connections 2023-12-18T10:25:15.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- 172.21.15.133:0/4101355154 wait complete. 2023-12-18T10:25:15.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 Processor -- start 2023-12-18T10:25:15.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- start start 2023-12-18T10:25:15.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8d406c320 0x7ff8d40cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d40c9e30 0x7ff8d40c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d40c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40c6470 con 0x7ff8d41570c0 2023-12-18T10:25:15.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40c6750 con 0x7ff8d40c9e30 2023-12-18T10:25:15.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.845+0000 7ff8d8d39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d40c6a30 con 0x7ff8d406c320 2023-12-18T10:25:15.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d40c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d40c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49526/0 (socket says 172.21.15.133:49526) 2023-12-18T10:25:15.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 -- 172.21.15.133:0/516148325 learned_addr learned my addr 172.21.15.133:0/516148325 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:15.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8c9d9b640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d40c9e30 0x7ff8d40c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d259c640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8d406c320 0x7ff8d40cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 -- 172.21.15.133:0/516148325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8d406c320 msgr2=0x7ff8d40cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8d406c320 0x7ff8d40cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 -- 172.21.15.133:0/516148325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d40c9e30 msgr2=0x7ff8d40c06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d40c9e30 0x7ff8d40c06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 -- 172.21.15.133:0/516148325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c40094d0 con 0x7ff8d41570c0 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d2d9d640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d40c0be0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00c780 tx=0x7ff8cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8cb7fe640 1 -- 172.21.15.133:0/516148325 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc004b70 con 0x7ff8d41570c0 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8cb7fe640 1 -- 172.21.15.133:0/516148325 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc00ce90 con 0x7ff8d41570c0 2023-12-18T10:25:15.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d40c6d10 con 0x7ff8d41570c0 2023-12-18T10:25:15.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8cb7fe640 1 -- 172.21.15.133:0/516148325 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc00a850 con 0x7ff8d41570c0 2023-12-18T10:25:15.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d40c7510 con 0x7ff8d41570c0 2023-12-18T10:25:15.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d40735b0 con 0x7ff8d41570c0 2023-12-18T10:25:15.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8cb7fe640 1 -- 172.21.15.133:0/516148325 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8cc00a9b0 con 0x7ff8d41570c0 2023-12-18T10:25:15.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.849+0000 7ff8cb7fe640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b4065a60 0x7ff8b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:15.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.853+0000 7ff8cb7fe640 1 -- 172.21.15.133:0/516148325 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff8cc083100 con 0x7ff8d41570c0 2023-12-18T10:25:15.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.853+0000 7ff8d259c640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b4065a60 0x7ff8b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:15.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.853+0000 7ff8d259c640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b4065a60 0x7ff8b4067f20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40ae000 tx=0x7ff8c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:15.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:15.857+0000 7ff8cb7fe640 1 -- 172.21.15.133:0/516148325 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff8cc050c50 con 0x7ff8d41570c0 2023-12-18T10:25:16.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.005+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8d404e000 con 0x7ff8d41570c0 2023-12-18T10:25:16.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.005+0000 7ff8cb7fe640 1 -- 172.21.15.133:0/516148325 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+12644 (secure 0 0 0) 0x7ff8cc054270 con 0x7ff8d41570c0 2023-12-18T10:25:16.007 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":101,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:25:15.290109+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b4065a60 msgr2=0x7ff8b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b4065a60 0x7ff8b4067f20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40ae000 tx=0x7ff8c4008040 comp rx=0 tx=0).stop 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 msgr2=0x7ff8d40c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d40c0be0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00c780 tx=0x7ff8cc00cc40 comp rx=0 tx=0).stop 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 shutdown_connections 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff8b4065a60 0x7ff8b4067f20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8d41570c0 0x7ff8d40c0be0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8d40c9e30 0x7ff8d40c06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 --2- 172.21.15.133:0/516148325 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8d406c320 0x7ff8d40cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 >> 172.21.15.133:0/516148325 conn(0x7ff8d406a3e0 msgr2=0x7ff8d41596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:16.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 shutdown_connections 2023-12-18T10:25:16.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.009+0000 7ff8d8d39640 1 -- 172.21.15.133:0/516148325 wait complete. 2023-12-18T10:25:16.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:25:16.028 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:25:16.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.169+0000 7f6a2fda6640 1 Processor -- start 2023-12-18T10:25:16.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.169+0000 7f6a2fda6640 1 -- start start 2023-12-18T10:25:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2fda6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cde90 0x7f6a280ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2fda6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a280cf170 0x7f6a280cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2fda6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2815cec0 con 0x7f6a2815cae0 2023-12-18T10:25:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2fda6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a280cfb40 con 0x7f6a280cf170 2023-12-18T10:25:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2fda6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280d0530 con 0x7f6a280cde90 2023-12-18T10:25:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2e343640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a280cf170 0x7f6a280cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2e343640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a280cf170 0x7f6a280cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49540/0 (socket says 172.21.15.133:49540) 2023-12-18T10:25:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2e343640 1 -- 172.21.15.133:0/645850993 learned_addr learned my addr 172.21.15.133:0/645850993 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2d341640 1 --2- 172.21.15.133:0/645850993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cde90 0x7f6a280ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2e343640 1 -- 172.21.15.133:0/645850993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cde90 msgr2=0x7f6a280ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2e343640 1 --2- 172.21.15.133:0/645850993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cde90 0x7f6a280ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2e343640 1 -- 172.21.15.133:0/645850993 >> v1:172.21.15.142:6789/0 conn(0x7f6a2815cae0 legacy=0x7f6a280d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2e343640 1 -- 172.21.15.133:0/645850993 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280d0810 con 0x7f6a280cf170 2023-12-18T10:25:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.173+0000 7f6a2d341640 1 --2- 172.21.15.133:0/645850993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cde90 0x7f6a280ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2e343640 1 --2- 172.21.15.133:0/645850993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cf170 0x7f6a280cf600 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009e50 tx=0x7f6a2001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9831014e11d7b233 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2cb40640 1 -- 172.21.15.133:0/645850993 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200a58a0 con 0x7f6a280cf170 2023-12-18T10:25:16.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2cb40640 1 -- 172.21.15.133:0/645850993 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a200a5a00 con 0x7f6a280cf170 2023-12-18T10:25:16.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2cb40640 1 -- 172.21.15.133:0/645850993 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200a5d90 con 0x7f6a280cf170 2023-12-18T10:25:16.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 -- 172.21.15.133:0/645850993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cf170 msgr2=0x7f6a280cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/645850993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cf170 0x7f6a280cf600 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009e50 tx=0x7f6a2001c9e0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 -- 172.21.15.133:0/645850993 shutdown_connections 2023-12-18T10:25:16.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/645850993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cf170 0x7f6a280cf600 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/645850993 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cde90 0x7f6a280ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 -- 172.21.15.133:0/645850993 >> 172.21.15.133:0/645850993 conn(0x7f6a28089fb0 msgr2=0x7f6a280d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:16.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 -- 172.21.15.133:0/645850993 shutdown_connections 2023-12-18T10:25:16.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 -- 172.21.15.133:0/645850993 wait complete. 2023-12-18T10:25:16.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 Processor -- start 2023-12-18T10:25:16.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.177+0000 7f6a2fda6640 1 -- start start 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cde90 0x7f6a280cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cf170 0x7f6a280af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2815cae0 0x7f6a2815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2815d050 con 0x7f6a280cde90 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2815d8f0 con 0x7f6a2815cae0 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280cbbe0 con 0x7f6a280cf170 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cde90 0x7f6a280cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cde90 0x7f6a280cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49554/0 (socket says 172.21.15.133:49554) 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 -- 172.21.15.133:0/835223360 learned_addr learned my addr 172.21.15.133:0/835223360 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2d341640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cf170 0x7f6a280af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2e343640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2815cae0 0x7f6a2815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 -- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cf170 msgr2=0x7f6a280af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cf170 0x7f6a280af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 -- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2815cae0 msgr2=0x7f6a2815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2815cae0 0x7f6a2815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 -- 172.21.15.133:0/835223360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20009b30 con 0x7f6a280cde90 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2d341640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cf170 0x7f6a280af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2e343640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2815cae0 0x7f6a2815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2db42640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cde90 0x7f6a280cb290 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c430 tx=0x7f6a2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a1e7fc640 1 -- 172.21.15.133:0/835223360 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240052d0 con 0x7f6a280cde90 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a1e7fc640 1 -- 172.21.15.133:0/835223360 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24005430 con 0x7f6a280cde90 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2815d2a0 con 0x7f6a280cde90 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a1e7fc640 1 -- 172.21.15.133:0/835223360 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24003890 con 0x7f6a280cde90 2023-12-18T10:25:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a280cb7d0 con 0x7f6a280cde90 2023-12-18T10:25:16.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2804e000 con 0x7f6a280cde90 2023-12-18T10:25:16.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.181+0000 7f6a1e7fc640 1 -- 172.21.15.133:0/835223360 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a240039f0 con 0x7f6a280cde90 2023-12-18T10:25:16.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.185+0000 7f6a1e7fc640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a0c065a60 0x7f6a0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.185+0000 7f6a1e7fc640 1 -- 172.21.15.133:0/835223360 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6a240825f0 con 0x7f6a280cde90 2023-12-18T10:25:16.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.185+0000 7f6a2d341640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a0c065a60 0x7f6a0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.185+0000 7f6a2d341640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a0c065a60 0x7f6a0c067f20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6a280b1430 tx=0x7f6a18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.189+0000 7f6a1e7fc640 1 -- 172.21.15.133:0/835223360 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6a24050120 con 0x7f6a280cde90 2023-12-18T10:25:16.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a280ceae0 con 0x7f6a280cde90 2023-12-18T10:25:16.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a1e7fc640 1 -- 172.21.15.133:0/835223360 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a24017020 con 0x7f6a280cde90 2023-12-18T10:25:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a0c065a60 msgr2=0x7f6a0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a0c065a60 0x7f6a0c067f20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6a280b1430 tx=0x7f6a18008040 comp rx=0 tx=0).stop 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cde90 msgr2=0x7f6a280cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cde90 0x7f6a280cb290 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c430 tx=0x7f6a2400c8f0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 shutdown_connections 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a0c065a60 0x7f6a0c067f20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a2815cae0 0x7f6a2815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a280cf170 0x7f6a280af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 --2- 172.21.15.133:0/835223360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a280cde90 0x7f6a280cb290 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 >> 172.21.15.133:0/835223360 conn(0x7f6a28089fb0 msgr2=0x7f6a2815a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:16.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 shutdown_connections 2023-12-18T10:25:16.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.337+0000 7f6a2fda6640 1 -- 172.21.15.133:0/835223360 wait complete. 2023-12-18T10:25:16.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-18T10:25:16.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a8612640 1 Processor -- start 2023-12-18T10:25:16.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a8612640 1 -- start start 2023-12-18T10:25:16.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a8612640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f36a01570c0 0x7f36a006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a8612640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00c9460 con 0x7f36a006c320 2023-12-18T10:25:16.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a8612640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a01574a0 con 0x7f36a00ca000 2023-12-18T10:25:16.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a8612640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a006c7a0 con 0x7f36a01570c0 2023-12-18T10:25:16.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a5bad640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f36a006c320 0x7f36a00c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53386/0 (socket says 172.21.15.133:53386) 2023-12-18T10:25:16.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a5bad640 1 -- 172.21.15.133:0/3454414048 learned_addr learned my addr 172.21.15.133:0/3454414048 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:16.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a63ae640 1 --2- 172.21.15.133:0/3454414048 >> v2:172.21.15.142:3300/0 conn(0x7f36a01570c0 0x7f36a006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965968342 0 0) 0x7f36a00c9460 con 0x7f36a006c320 2023-12-18T10:25:16.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f368c003530 con 0x7f36a006c320 2023-12-18T10:25:16.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659950792 0 0) 0x7f36a01574a0 con 0x7f36a00ca000 2023-12-18T10:25:16.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a00c9460 con 0x7f36a00ca000 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4252130571 0 0) 0x7f368c003530 con 0x7f36a006c320 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 >> v2:172.21.15.142:3300/0 conn(0x7f36a01570c0 msgr2=0x7f36a006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 --2- 172.21.15.133:0/3454414048 >> v2:172.21.15.142:3300/0 conn(0x7f36a01570c0 0x7f36a006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 >> v1:172.21.15.142:6789/0 conn(0x7f36a00ca000 legacy=0x7f36a0070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00c8b30 con 0x7f36a006c320 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f3690001680 con 0x7f36a006c320 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 >> v1:172.21.15.133:6789/0 conn(0x7f36a006c320 legacy=0x7f36a00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c003b10 0x7f368c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f368c0047d0 0x7f368c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368c005190 0x7f368c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a006c7a0 con 0x7f368c0047d0 2023-12-18T10:25:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c00c0c0 con 0x7f368c005190 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c00c280 con 0x7f368c003b10 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a5bad640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f368c0047d0 0x7f368c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a6baf640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368c005190 0x7f368c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a63ae640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c003b10 0x7f368c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a5bad640 1 -- 172.21.15.133:0/3454414048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c003b10 msgr2=0x7f368c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a5bad640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c003b10 0x7f368c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a5bad640 1 -- 172.21.15.133:0/3454414048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368c005190 msgr2=0x7f368c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a5bad640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f368c005190 0x7f368c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a5bad640 1 -- 172.21.15.133:0/3454414048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c003530 con 0x7f368c0047d0 2023-12-18T10:25:16.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.497+0000 7f36a6baf640 1 -- 172.21.15.133:0/3454414048 reap_dead start 2023-12-18T10:25:16.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a5bad640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f368c0047d0 0x7f368c004c50 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f369000c160 tx=0x7f369001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6a12b9f23feecc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900a5930 con 0x7f368c0047d0 2023-12-18T10:25:16.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36900a5ab0 con 0x7f368c0047d0 2023-12-18T10:25:16.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a53ac640 1 -- 172.21.15.133:0/3454414048 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900a5e60 con 0x7f368c0047d0 2023-12-18T10:25:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a8612640 1 -- 172.21.15.133:0/3454414048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f368c0047d0 msgr2=0x7f368c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a8612640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f368c0047d0 0x7f368c004c50 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f369000c160 tx=0x7f369001cc30 comp rx=0 tx=0).stop 2023-12-18T10:25:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a8612640 1 -- 172.21.15.133:0/3454414048 shutdown_connections 2023-12-18T10:25:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a8612640 1 --2- 172.21.15.133:0/3454414048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f368c0047d0 0x7f368c004c50 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a8612640 1 -- 172.21.15.133:0/3454414048 >> 172.21.15.133:0/3454414048 conn(0x7f36a006a3e0 msgr2=0x7f36a00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a8612640 1 -- 172.21.15.133:0/3454414048 shutdown_connections 2023-12-18T10:25:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.501+0000 7f36a8612640 1 -- 172.21.15.133:0/3454414048 wait complete. 2023-12-18T10:25:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 Processor -- start 2023-12-18T10:25:16.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 -- start start 2023-12-18T10:25:16.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c0047d0 0x7f36a00c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0155720 0x7f36a00c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36a00c8180 0x7f36a00ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00cbef0 con 0x7f36a0155720 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00cca70 con 0x7f36a00c8180 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00cc140 con 0x7f368c0047d0 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0155720 0x7f36a00c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0155720 0x7f36a00c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49560/0 (socket says 172.21.15.133:49560) 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 -- 172.21.15.133:0/3531330324 learned_addr learned my addr 172.21.15.133:0/3531330324 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a63ae640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c0047d0 0x7f36a00c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a6baf640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36a00c8180 0x7f36a00ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 -- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c0047d0 msgr2=0x7f36a00c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c0047d0 0x7f36a00c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 -- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36a00c8180 msgr2=0x7f36a00ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36a00c8180 0x7f36a00ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 -- 172.21.15.133:0/3531330324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00cc420 con 0x7f36a0155720 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a63ae640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c0047d0 0x7f36a00c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a5bad640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0155720 0x7f36a00c7c40 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f36900ab040 tx=0x7f368c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f3696ffd640 1 -- 172.21.15.133:0/3531330324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900072d0 con 0x7f36a0155720 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f3696ffd640 1 -- 172.21.15.133:0/3531330324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36900b2070 con 0x7f36a0155720 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a00cc700 con 0x7f36a0155720 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f3696ffd640 1 -- 172.21.15.133:0/3531330324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900076b0 con 0x7f36a0155720 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.505+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a00ae340 con 0x7f36a0155720 2023-12-18T10:25:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.509+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a00cc8c0 con 0x7f36a0155720 2023-12-18T10:25:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.509+0000 7f3696ffd640 1 -- 172.21.15.133:0/3531330324 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f36900c1450 con 0x7f36a0155720 2023-12-18T10:25:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.509+0000 7f3696ffd640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3684065a90 0x7f3684067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.509+0000 7f3696ffd640 1 -- 172.21.15.133:0/3531330324 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f369011cf70 con 0x7f36a0155720 2023-12-18T10:25:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.509+0000 7f36a63ae640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3684065a90 0x7f3684067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.509+0000 7f36a63ae640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3684065a90 0x7f3684067f50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f36a0072590 tx=0x7f369c00b3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.513+0000 7f3696ffd640 1 -- 172.21.15.133:0/3531330324 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f36900eaab0 con 0x7f36a0155720 2023-12-18T10:25:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.665+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f36a00735b0 con 0x7f36a0155720 2023-12-18T10:25:16.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.665+0000 7f3696ffd640 1 -- 172.21.15.133:0/3531330324 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v101) v1 ==== 84+0+65 (secure 0 0 0) 0x7f36900ee0d0 con 0x7f36a0155720 2023-12-18T10:25:16.667 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:16.667 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-18T10:25:16.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-18T10:25:16.667 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-18T10:25:16.667 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-18T10:25:16.667 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:16.667 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-18T10:25:16.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3684065a90 msgr2=0x7f3684067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3684065a90 0x7f3684067f50 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f36a0072590 tx=0x7f369c00b3a0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0155720 msgr2=0x7f36a00c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0155720 0x7f36a00c7c40 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f36900ab040 tx=0x7f368c005800 comp rx=0 tx=0).stop 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 shutdown_connections 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3684065a90 0x7f3684067f50 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f36a00c8180 0x7f36a00ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0155720 0x7f36a00c7c40 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 --2- 172.21.15.133:0/3531330324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f368c0047d0 0x7f36a00c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 >> 172.21.15.133:0/3531330324 conn(0x7f36a006a3e0 msgr2=0x7f36a00ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 shutdown_connections 2023-12-18T10:25:16.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.669+0000 7f36a8612640 1 -- 172.21.15.133:0/3531330324 wait complete. 2023-12-18T10:25:16.688 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-18T10:25:16.688 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-18T10:25:16.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d695a640 1 Processor -- start 2023-12-18T10:25:16.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d695a640 1 -- start start 2023-12-18T10:25:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d695a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57d015da20 0x7f57d00cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d695a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f57d00d0f60 0x7f57d00ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d695a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d00d0200 con 0x7f57d00cc8f0 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d695a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00cd850 con 0x7f57d015da20 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d695a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00d0b40 con 0x7f57d00d0f60 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d5958640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57d015da20 0x7f57d00cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d5958640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57d015da20 0x7f57d00cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49564/0 (socket says 172.21.15.133:49564) 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d5958640 1 -- 172.21.15.133:0/4227719812 learned_addr learned my addr 172.21.15.133:0/4227719812 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.829+0000 7f57d6159640 1 --1- 172.21.15.133:0/4227719812 >> v1:172.21.15.133:6789/0 conn(0x7f57d00cc8f0 0x7f57d00ccd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53390/0 (socket says 172.21.15.133:53390) 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d5157640 1 --2- 172.21.15.133:0/4227719812 >> v2:172.21.15.142:3300/0 conn(0x7f57d00d0f60 0x7f57d00ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d5958640 1 -- 172.21.15.133:0/4227719812 >> v2:172.21.15.142:3300/0 conn(0x7f57d00d0f60 msgr2=0x7f57d00ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d5958640 1 --2- 172.21.15.133:0/4227719812 >> v2:172.21.15.142:3300/0 conn(0x7f57d00d0f60 0x7f57d00ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d5958640 1 -- 172.21.15.133:0/4227719812 >> v1:172.21.15.133:6789/0 conn(0x7f57d00cc8f0 legacy=0x7f57d00ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d5958640 1 -- 172.21.15.133:0/4227719812 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d015de00 con 0x7f57d015da20 2023-12-18T10:25:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d4956640 1 -- 172.21.15.133:0/4227719812 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246527793 0 0) 0x7f57d00d0200 con 0x7f57d00cc8f0 2023-12-18T10:25:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d5958640 1 --2- 172.21.15.133:0/4227719812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d015da20 0x7f57d00cdfb0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f57d00cfc90 tx=0x7f57cc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c20999e100a4ae3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d4956640 1 -- 172.21.15.133:0/4227719812 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0ad680 con 0x7f57d015da20 2023-12-18T10:25:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d4956640 1 -- 172.21.15.133:0/4227719812 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc0ad7e0 con 0x7f57d015da20 2023-12-18T10:25:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.833+0000 7f57d4956640 1 -- 172.21.15.133:0/4227719812 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0adb70 con 0x7f57d015da20 2023-12-18T10:25:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- 172.21.15.133:0/4227719812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d015da20 msgr2=0x7f57d00cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 --2- 172.21.15.133:0/4227719812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d015da20 0x7f57d00cdfb0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f57d00cfc90 tx=0x7f57cc01c470 comp rx=0 tx=0).stop 2023-12-18T10:25:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- 172.21.15.133:0/4227719812 shutdown_connections 2023-12-18T10:25:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 --2- 172.21.15.133:0/4227719812 >> v2:172.21.15.142:3300/0 conn(0x7f57d00d0f60 0x7f57d00ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 --2- 172.21.15.133:0/4227719812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d015da20 0x7f57d00cdfb0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- 172.21.15.133:0/4227719812 >> 172.21.15.133:0/4227719812 conn(0x7f57d0069ca0 msgr2=0x7f57d006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- 172.21.15.133:0/4227719812 shutdown_connections 2023-12-18T10:25:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- 172.21.15.133:0/4227719812 wait complete. 2023-12-18T10:25:16.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 Processor -- start 2023-12-18T10:25:16.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- start start 2023-12-18T10:25:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d00cc8f0 0x7f57d014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57d00d0f60 0x7f57d0153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57d015da20 0x7f57d0152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0159f00 con 0x7f57d00cc8f0 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0159380 con 0x7f57d00d0f60 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d695a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0159660 con 0x7f57d015da20 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d00cc8f0 0x7f57d014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d00cc8f0 0x7f57d014d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49568/0 (socket says 172.21.15.133:49568) 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 -- 172.21.15.133:0/3498941143 learned_addr learned my addr 172.21.15.133:0/3498941143 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5157640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57d00d0f60 0x7f57d0153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 -- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57d015da20 msgr2=0x7f57d0152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d6159640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57d015da20 0x7f57d0152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57d015da20 0x7f57d0152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 -- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57d00d0f60 msgr2=0x7f57d0153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57d00d0f60 0x7f57d0153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 -- 172.21.15.133:0/3498941143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0094d0 con 0x7f57d00cc8f0 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5157640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57d00d0f60 0x7f57d0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d6159640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57d015da20 0x7f57d0152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.837+0000 7f57d5958640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d00cc8f0 0x7f57d014d5a0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f57cc019080 tx=0x7f57cc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57c67fc640 1 -- 172.21.15.133:0/3498941143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0ade20 con 0x7f57d00cc8f0 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57c67fc640 1 -- 172.21.15.133:0/3498941143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc0b8450 con 0x7f57d00cc8f0 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57c67fc640 1 -- 172.21.15.133:0/3498941143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0b87c0 con 0x7f57d00cc8f0 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d0159940 con 0x7f57d00cc8f0 2023-12-18T10:25:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d014dae0 con 0x7f57d00cc8f0 2023-12-18T10:25:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d00b33e0 con 0x7f57d00cc8f0 2023-12-18T10:25:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57c67fc640 1 -- 172.21.15.133:0/3498941143 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57cc0b4070 con 0x7f57d00cc8f0 2023-12-18T10:25:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57c67fc640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57b4065a60 0x7f57b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57c67fc640 1 -- 172.21.15.133:0/3498941143 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f57cc11d4e0 con 0x7f57d00cc8f0 2023-12-18T10:25:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57d5157640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57b4065a60 0x7f57b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.841+0000 7f57d5157640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57b4065a60 0x7f57b4067f20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f57d014df00 tx=0x7f57c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.845+0000 7f57c67fc640 1 -- 172.21.15.133:0/3498941143 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f57cc0eb1c0 con 0x7f57d00cc8f0 2023-12-18T10:25:16.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:16.993+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f57d004e000 con 0x7f57d00cc8f0 2023-12-18T10:25:17.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.157+0000 7f57c67fc640 1 -- 172.21.15.133:0/3498941143 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v102) v1 ==== 138+0+0 (secure 0 0 0) 0x7f57cc0ee7e0 con 0x7f57d00cc8f0 2023-12-18T10:25:17.156 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-18T10:25:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.157+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57b4065a60 msgr2=0x7f57b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.157+0000 7f57d695a640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57b4065a60 0x7f57b4067f20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f57d014df00 tx=0x7f57c0008040 comp rx=0 tx=0).stop 2023-12-18T10:25:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.157+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d00cc8f0 msgr2=0x7f57d014d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.157+0000 7f57d695a640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d00cc8f0 0x7f57d014d5a0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f57cc019080 tx=0x7f57cc01acb0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.161+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 shutdown_connections 2023-12-18T10:25:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.161+0000 7f57d695a640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57b4065a60 0x7f57b4067f20 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.161+0000 7f57d695a640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f57d015da20 0x7f57d0152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.161+0000 7f57d695a640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57d00d0f60 0x7f57d0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.161+0000 7f57d695a640 1 --2- 172.21.15.133:0/3498941143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d00cc8f0 0x7f57d014d5a0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.161+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 >> 172.21.15.133:0/3498941143 conn(0x7f57d0069ca0 msgr2=0x7f57d014e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.161+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 shutdown_connections 2023-12-18T10:25:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.161+0000 7f57d695a640 1 -- 172.21.15.133:0/3498941143 wait complete. 2023-12-18T10:25:17.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-18T10:25:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79c568c640 1 Processor -- start 2023-12-18T10:25:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79c568c640 1 -- start start 2023-12-18T10:25:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79c568c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 0x7f79c00c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79c568c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79c00afed0 0x7f79c00b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79c568c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f79c0159c60 0x7f79c015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79c568c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c015a630 con 0x7f79c00afed0 2023-12-18T10:25:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79c568c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00b0850 con 0x7f79c0159c60 2023-12-18T10:25:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79c568c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00c8a10 con 0x7f79c00ca9d0 2023-12-18T10:25:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79be7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79c00afed0 0x7f79c00b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79be7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79c00afed0 0x7f79c00b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49578/0 (socket says 172.21.15.133:49578) 2023-12-18T10:25:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79be7fc640 1 -- 172.21.15.133:0/3863959420 learned_addr learned my addr 172.21.15.133:0/3863959420 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79beffd640 1 --2- 172.21.15.133:0/3863959420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 0x7f79c00c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79bf7fe640 1 --2- 172.21.15.133:0/3863959420 >> v2:172.21.15.142:3300/0 conn(0x7f79c0159c60 0x7f79c015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79be7fc640 1 -- 172.21.15.133:0/3863959420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 msgr2=0x7f79c00c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79be7fc640 1 --2- 172.21.15.133:0/3863959420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 0x7f79c00c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79be7fc640 1 -- 172.21.15.133:0/3863959420 >> v2:172.21.15.142:3300/0 conn(0x7f79c0159c60 msgr2=0x7f79c015a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79be7fc640 1 --2- 172.21.15.133:0/3863959420 >> v2:172.21.15.142:3300/0 conn(0x7f79c0159c60 0x7f79c015a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.329+0000 7f79be7fc640 1 -- 172.21.15.133:0/3863959420 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c015a860 con 0x7f79c00afed0 2023-12-18T10:25:17.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79be7fc640 1 --2- 172.21.15.133:0/3863959420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00afed0 0x7f79c00b0310 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f79c00ad9a0 tx=0x7f79b401e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d868912310824b96 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:17.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79bdffb640 1 -- 172.21.15.133:0/3863959420 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40a8670 con 0x7f79c00afed0 2023-12-18T10:25:17.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79bdffb640 1 -- 172.21.15.133:0/3863959420 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b40a87d0 con 0x7f79c00afed0 2023-12-18T10:25:17.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79bdffb640 1 -- 172.21.15.133:0/3863959420 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b40a8b60 con 0x7f79c00afed0 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 -- 172.21.15.133:0/3863959420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00afed0 msgr2=0x7f79c00b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 --2- 172.21.15.133:0/3863959420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00afed0 0x7f79c00b0310 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f79c00ad9a0 tx=0x7f79b401e6e0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 -- 172.21.15.133:0/3863959420 shutdown_connections 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 --2- 172.21.15.133:0/3863959420 >> v2:172.21.15.142:3300/0 conn(0x7f79c0159c60 0x7f79c015a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 --2- 172.21.15.133:0/3863959420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00afed0 0x7f79c00b0310 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 --2- 172.21.15.133:0/3863959420 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 0x7f79c00c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 -- 172.21.15.133:0/3863959420 >> 172.21.15.133:0/3863959420 conn(0x7f79c00ce450 msgr2=0x7f79c00ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 -- 172.21.15.133:0/3863959420 shutdown_connections 2023-12-18T10:25:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.333+0000 7f79c568c640 1 -- 172.21.15.133:0/3863959420 wait complete. 2023-12-18T10:25:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 Processor -- start 2023-12-18T10:25:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 -- start start 2023-12-18T10:25:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79c00afed0 0x7f79c015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 0x7f79c00c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c0159c60 0x7f79c00b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00b2610 con 0x7f79c0159c60 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c015e1b0 con 0x7f79c00afed0 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c015c430 con 0x7f79c00ca9d0 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c0159c60 0x7f79c00b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c0159c60 0x7f79c00b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49584/0 (socket says 172.21.15.133:49584) 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 -- 172.21.15.133:0/447528000 learned_addr learned my addr 172.21.15.133:0/447528000 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79beffd640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79c00afed0 0x7f79c015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79be7fc640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 0x7f79c00c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 -- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 msgr2=0x7f79c00c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 0x7f79c00c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 -- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79c00afed0 msgr2=0x7f79c015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79c00afed0 0x7f79c015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 -- 172.21.15.133:0/447528000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40094d0 con 0x7f79c0159c60 2023-12-18T10:25:17.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79beffd640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79c00afed0 0x7f79c015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:17.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79bf7fe640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c0159c60 0x7f79c00b1010 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009dd0 tx=0x7f79b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:17.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79a77fe640 1 -- 172.21.15.133:0/447528000 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8014480 con 0x7f79c0159c60 2023-12-18T10:25:17.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79a77fe640 1 -- 172.21.15.133:0/447528000 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b800f040 con 0x7f79c0159c60 2023-12-18T10:25:17.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79a77fe640 1 -- 172.21.15.133:0/447528000 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8014840 con 0x7f79c0159c60 2023-12-18T10:25:17.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c015be70 con 0x7f79c0159c60 2023-12-18T10:25:17.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c015dda0 con 0x7f79c0159c60 2023-12-18T10:25:17.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.337+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c0066e70 con 0x7f79c0159c60 2023-12-18T10:25:17.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.341+0000 7f79a77fe640 1 -- 172.21.15.133:0/447528000 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f79b80149a0 con 0x7f79c0159c60 2023-12-18T10:25:17.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.341+0000 7f79a77fe640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f79ac065a60 0x7f79ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:17.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.341+0000 7f79a77fe640 1 -- 172.21.15.133:0/447528000 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f79b8083b10 con 0x7f79c0159c60 2023-12-18T10:25:17.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.341+0000 7f79beffd640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f79ac065a60 0x7f79ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:17.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.341+0000 7f79beffd640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f79ac065a60 0x7f79ac067f20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009bb0 tx=0x7f79b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:17.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.345+0000 7f79a77fe640 1 -- 172.21.15.133:0/447528000 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f79b8051560 con 0x7f79c0159c60 2023-12-18T10:25:17.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:17.497+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f79c004e000 con 0x7f79c0159c60 2023-12-18T10:25:18.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.161+0000 7f79a77fe640 1 -- 172.21.15.133:0/447528000 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v103) v1 ==== 170+0+0 (secure 0 0 0) 0x7f79b8054b80 con 0x7f79c0159c60 2023-12-18T10:25:18.162 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-18T10:25:18.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f79ac065a60 msgr2=0x7f79ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f79ac065a60 0x7f79ac067f20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009bb0 tx=0x7f79b0008040 comp rx=0 tx=0).stop 2023-12-18T10:25:18.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c0159c60 msgr2=0x7f79c00b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c0159c60 0x7f79c00b1010 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009dd0 tx=0x7f79b800c490 comp rx=0 tx=0).stop 2023-12-18T10:25:18.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 shutdown_connections 2023-12-18T10:25:18.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f79ac065a60 0x7f79ac067f20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c0159c60 0x7f79c00b1010 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79c00ca9d0 0x7f79c00c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 --2- 172.21.15.133:0/447528000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79c00afed0 0x7f79c015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.169+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 >> 172.21.15.133:0/447528000 conn(0x7f79c00ce450 msgr2=0x7f79c006bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:18.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.173+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 shutdown_connections 2023-12-18T10:25:18.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.173+0000 7f79c568c640 1 -- 172.21.15.133:0/447528000 wait complete. 2023-12-18T10:25:18.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-18T10:25:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9441a1f640 1 Processor -- start 2023-12-18T10:25:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9441a1f640 1 -- start start 2023-12-18T10:25:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9441a1f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f943c153020 0x7f943c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9441a1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c0ceaa0 0x7f943c070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9441a1f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c0c9730 con 0x7f943c1598d0 2023-12-18T10:25:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9441a1f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0c8e00 con 0x7f943c153020 2023-12-18T10:25:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9441a1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c90e0 con 0x7f943c0ceaa0 2023-12-18T10:25:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9433fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f943c1598d0 0x7f943c0ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53400/0 (socket says 172.21.15.133:53400) 2023-12-18T10:25:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f9433fff640 1 -- 172.21.15.133:0/1442283568 learned_addr learned my addr 172.21.15.133:0/1442283568 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f943b7fe640 1 --2- 172.21.15.133:0/1442283568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c0ceaa0 0x7f943c070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f943affd640 1 --2- 172.21.15.133:0/1442283568 >> v2:172.21.15.142:3300/0 conn(0x7f943c153020 0x7f943c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f943a7fc640 1 -- 172.21.15.133:0/1442283568 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228451686 0 0) 0x7f943c0c9730 con 0x7f943c1598d0 2023-12-18T10:25:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f943a7fc640 1 -- 172.21.15.133:0/1442283568 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9428003530 con 0x7f943c1598d0 2023-12-18T10:25:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f943affd640 1 -- 172.21.15.133:0/1442283568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c0ceaa0 msgr2=0x7f943c070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f943affd640 1 --2- 172.21.15.133:0/1442283568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c0ceaa0 0x7f943c070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f943affd640 1 -- 172.21.15.133:0/1442283568 >> v1:172.21.15.133:6789/0 conn(0x7f943c1598d0 legacy=0x7f943c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.353+0000 7f943affd640 1 -- 172.21.15.133:0/1442283568 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0c93c0 con 0x7f943c153020 2023-12-18T10:25:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f943affd640 1 --2- 172.21.15.133:0/1442283568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 0x7f943c0c9bc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f942c00a960 tx=0x7f942c01d6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82df98cf3fd66a9f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f943a7fc640 1 -- 172.21.15.133:0/1442283568 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0a67c0 con 0x7f943c153020 2023-12-18T10:25:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f943a7fc640 1 -- 172.21.15.133:0/1442283568 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0a6920 con 0x7f943c153020 2023-12-18T10:25:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f943a7fc640 1 -- 172.21.15.133:0/1442283568 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0a6cb0 con 0x7f943c153020 2023-12-18T10:25:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 -- 172.21.15.133:0/1442283568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 msgr2=0x7f943c0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 --2- 172.21.15.133:0/1442283568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 0x7f943c0c9bc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f942c00a960 tx=0x7f942c01d6d0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 -- 172.21.15.133:0/1442283568 shutdown_connections 2023-12-18T10:25:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 --2- 172.21.15.133:0/1442283568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c0ceaa0 0x7f943c070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 --2- 172.21.15.133:0/1442283568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 0x7f943c0c9bc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 -- 172.21.15.133:0/1442283568 >> 172.21.15.133:0/1442283568 conn(0x7f943c06a2a0 msgr2=0x7f943c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 -- 172.21.15.133:0/1442283568 shutdown_connections 2023-12-18T10:25:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 -- 172.21.15.133:0/1442283568 wait complete. 2023-12-18T10:25:18.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.357+0000 7f9441a1f640 1 Processor -- start 2023-12-18T10:25:18.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 -- start start 2023-12-18T10:25:18.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c0ceaa0 0x7f943c151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 0x7f943c0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c1598d0 0x7f943c0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0b18a0 con 0x7f943c0ceaa0 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0b1b80 con 0x7f943c153020 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0b1e60 con 0x7f943c1598d0 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c0ceaa0 0x7f943c151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c0ceaa0 0x7f943c151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49594/0 (socket says 172.21.15.133:49594) 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 -- 172.21.15.133:0/3340538108 learned_addr learned my addr 172.21.15.133:0/3340538108 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9433fff640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 0x7f943c0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943b7fe640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c1598d0 0x7f943c0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 -- 172.21.15.133:0/3340538108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c1598d0 msgr2=0x7f943c0c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c1598d0 0x7f943c0c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 -- 172.21.15.133:0/3340538108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 msgr2=0x7f943c0b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 0x7f943c0b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 -- 172.21.15.133:0/3340538108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c00a5c0 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f943affd640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c0ceaa0 0x7f943c151ab0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f942c01b360 tx=0x7f942c01a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9438ff9640 1 -- 172.21.15.133:0/3340538108 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0ae850 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9438ff9640 1 -- 172.21.15.133:0/3340538108 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0ae9d0 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c0b2140 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9438ff9640 1 -- 172.21.15.133:0/3340538108 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0aed80 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0b1530 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.361+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c15d130 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.365+0000 7f9438ff9640 1 -- 172.21.15.133:0/3340538108 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f942c0b5040 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.365+0000 7f9438ff9640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f941c065a60 0x7f941c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.365+0000 7f9438ff9640 1 -- 172.21.15.133:0/3340538108 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f942c11d7d0 con 0x7f943c0ceaa0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.365+0000 7f9433fff640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f941c065a60 0x7f941c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.365+0000 7f9433fff640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f941c065a60 0x7f941c067f20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f943c0707b0 tx=0x7f9424007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:18.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.369+0000 7f9438ff9640 1 -- 172.21.15.133:0/3340538108 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f942c0eb270 con 0x7f943c0ceaa0 2023-12-18T10:25:18.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.549+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f943c04e000 con 0x7f943c0ceaa0 2023-12-18T10:25:18.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.557+0000 7f9438ff9640 1 -- 172.21.15.133:0/3340538108 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v99) v1 ==== 174+0+0 (secure 0 0 0) 0x7f942c0ee890 con 0x7f943c0ceaa0 2023-12-18T10:25:18.558 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 15 and data pool 16 2023-12-18T10:25:18.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f941c065a60 msgr2=0x7f941c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f941c065a60 0x7f941c067f20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f943c0707b0 tx=0x7f9424007d40 comp rx=0 tx=0).stop 2023-12-18T10:25:18.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c0ceaa0 msgr2=0x7f943c151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c0ceaa0 0x7f943c151ab0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f942c01b360 tx=0x7f942c01a4d0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 shutdown_connections 2023-12-18T10:25:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f941c065a60 0x7f941c067f20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f943c1598d0 0x7f943c0c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f943c153020 0x7f943c0b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 --2- 172.21.15.133:0/3340538108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c0ceaa0 0x7f943c151ab0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.561+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 >> 172.21.15.133:0/3340538108 conn(0x7f943c06a2a0 msgr2=0x7f943c152540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.565+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 shutdown_connections 2023-12-18T10:25:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.565+0000 7f9441a1f640 1 -- 172.21.15.133:0/3340538108 wait complete. 2023-12-18T10:25:18.602 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:25:18.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae3176d640 1 Processor -- start 2023-12-18T10:25:18.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae3176d640 1 -- start start 2023-12-18T10:25:18.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae3176d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae2c15c860 0x7fae2c0d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae3176d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae2c0ce250 0x7fae2c0d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae3176d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c0cddc0 con 0x7fae2c15cc40 2023-12-18T10:25:18.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae3176d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0cffa0 con 0x7fae2c0ce250 2023-12-18T10:25:18.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae3176d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0cd770 con 0x7fae2c15c860 2023-12-18T10:25:18.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae2c0ce250 0x7fae2c0d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2a7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae2c15cc40 0x7fae2c0cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53404/0 (socket says 172.21.15.133:53404) 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2a7fc640 1 -- 172.21.15.133:0/2897081662 learned_addr learned my addr 172.21.15.133:0/2897081662 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae2c0ce250 0x7fae2c0d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49600/0 (socket says 172.21.15.133:49600) 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2affd640 1 --2- 172.21.15.133:0/2897081662 >> v2:172.21.15.142:3300/0 conn(0x7fae2c15c860 0x7fae2c0d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2b7fe640 1 -- 172.21.15.133:0/2897081662 >> v2:172.21.15.142:3300/0 conn(0x7fae2c15c860 msgr2=0x7fae2c0d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2b7fe640 1 --2- 172.21.15.133:0/2897081662 >> v2:172.21.15.142:3300/0 conn(0x7fae2c15c860 0x7fae2c0d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2b7fe640 1 -- 172.21.15.133:0/2897081662 >> v1:172.21.15.133:6789/0 conn(0x7fae2c15cc40 legacy=0x7fae2c0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae2b7fe640 1 -- 172.21.15.133:0/2897081662 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0cda50 con 0x7fae2c0ce250 2023-12-18T10:25:18.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.741+0000 7fae29ffb640 1 -- 172.21.15.133:0/2897081662 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958959196 0 0) 0x7fae2c0cddc0 con 0x7fae2c15cc40 2023-12-18T10:25:18.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae2b7fe640 1 --2- 172.21.15.133:0/2897081662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c0ce250 0x7fae2c0d0d60 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0d0280 tx=0x7fae2401f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989b8ac5b4fbd751 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:18.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae29ffb640 1 -- 172.21.15.133:0/2897081662 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240b0440 con 0x7fae2c0ce250 2023-12-18T10:25:18.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae29ffb640 1 -- 172.21.15.133:0/2897081662 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae240b05a0 con 0x7fae2c0ce250 2023-12-18T10:25:18.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae29ffb640 1 -- 172.21.15.133:0/2897081662 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240b0930 con 0x7fae2c0ce250 2023-12-18T10:25:18.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 -- 172.21.15.133:0/2897081662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c0ce250 msgr2=0x7fae2c0d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 --2- 172.21.15.133:0/2897081662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c0ce250 0x7fae2c0d0d60 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0d0280 tx=0x7fae2401f0f0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 -- 172.21.15.133:0/2897081662 shutdown_connections 2023-12-18T10:25:18.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 --2- 172.21.15.133:0/2897081662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c0ce250 0x7fae2c0d0d60 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 --2- 172.21.15.133:0/2897081662 >> v2:172.21.15.142:3300/0 conn(0x7fae2c15c860 0x7fae2c0d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 -- 172.21.15.133:0/2897081662 >> 172.21.15.133:0/2897081662 conn(0x7fae2c089fb0 msgr2=0x7fae2c09baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:18.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 -- 172.21.15.133:0/2897081662 shutdown_connections 2023-12-18T10:25:18.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 -- 172.21.15.133:0/2897081662 wait complete. 2023-12-18T10:25:18.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 Processor -- start 2023-12-18T10:25:18.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.745+0000 7fae3176d640 1 -- start start 2023-12-18T10:25:18.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c0ce250 0x7fae2c156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2c15c860 0x7fae2c15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c15cc40 0x7fae2c1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c0b75c0 con 0x7fae2c15cc40 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c15ddf0 con 0x7fae2c0ce250 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c15e0d0 con 0x7fae2c15c860 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c15cc40 0x7fae2c1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c15cc40 0x7fae2c1f1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49614/0 (socket says 172.21.15.133:49614) 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 -- 172.21.15.133:0/2496351960 learned_addr learned my addr 172.21.15.133:0/2496351960 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2affd640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c0ce250 0x7fae2c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2a7fc640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2c15c860 0x7fae2c15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 -- 172.21.15.133:0/2496351960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2c15c860 msgr2=0x7fae2c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2c15c860 0x7fae2c15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 -- 172.21.15.133:0/2496351960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c0ce250 msgr2=0x7fae2c156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c0ce250 0x7fae2c156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 -- 172.21.15.133:0/2496351960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009a70 con 0x7fae2c15cc40 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae2b7fe640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c15cc40 0x7fae2c1f1cb0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fae240b3040 tx=0x7fae2401be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae137fe640 1 -- 172.21.15.133:0/2496351960 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240b0440 con 0x7fae2c15cc40 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae137fe640 1 -- 172.21.15.133:0/2496351960 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae240bc860 con 0x7fae2c15cc40 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c15e3b0 con 0x7fae2c15cc40 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae137fe640 1 -- 172.21.15.133:0/2496351960 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240bcc50 con 0x7fae2c15cc40 2023-12-18T10:25:18.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c15e970 con 0x7fae2c15cc40 2023-12-18T10:25:18.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.749+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c15eb30 con 0x7fae2c15cc40 2023-12-18T10:25:18.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.753+0000 7fae137fe640 1 -- 172.21.15.133:0/2496351960 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae240c7460 con 0x7fae2c15cc40 2023-12-18T10:25:18.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.753+0000 7fae137fe640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae18065a60 0x7fae18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:18.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.753+0000 7fae137fe640 1 -- 172.21.15.133:0/2496351960 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fae24121ec0 con 0x7fae2c15cc40 2023-12-18T10:25:18.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.753+0000 7fae2affd640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae18065a60 0x7fae18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:18.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.753+0000 7fae2affd640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae18065a60 0x7fae18067f20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fae1c006fd0 tx=0x7fae1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:18.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.757+0000 7fae137fe640 1 -- 172.21.15.133:0/2496351960 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fae240ef750 con 0x7fae2c15cc40 2023-12-18T10:25:18.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae2c04e000 con 0x7fae2c15cc40 2023-12-18T10:25:18.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae137fe640 1 -- 172.21.15.133:0/2496351960 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16309 (secure 0 0 0) 0x7fae24009450 con 0x7fae2c15cc40 2023-12-18T10:25:18.909 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:18.909 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":104,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:25:18.553007+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:25:17.041912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-18T10:25:17.544282+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae18065a60 msgr2=0x7fae18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae18065a60 0x7fae18067f20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fae1c006fd0 tx=0x7fae1c008040 comp rx=0 tx=0).stop 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c15cc40 msgr2=0x7fae2c1f1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c15cc40 0x7fae2c1f1cb0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fae240b3040 tx=0x7fae2401be90 comp rx=0 tx=0).stop 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 shutdown_connections 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fae18065a60 0x7fae18067f20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae2c15cc40 0x7fae2c1f1cb0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae2c15c860 0x7fae2c15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 --2- 172.21.15.133:0/2496351960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae2c0ce250 0x7fae2c156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 >> 172.21.15.133:0/2496351960 conn(0x7fae2c089fb0 msgr2=0x7fae2c0cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:18.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 shutdown_connections 2023-12-18T10:25:18.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:18.909+0000 7fae3176d640 1 -- 172.21.15.133:0/2496351960 wait complete. 2023-12-18T10:25:18.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:25:19.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01c318640 1 Processor -- start 2023-12-18T10:25:19.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01c318640 1 -- start start 2023-12-18T10:25:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01c318640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe01415ca40 0x7fe0140cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01c318640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0140cf7e0 0x7fe0141668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01c318640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140d11c0 con 0x7fe0140ce3f0 2023-12-18T10:25:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01c318640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0140d0310 con 0x7fe0140cf7e0 2023-12-18T10:25:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01c318640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0140d05b0 con 0x7fe01415ca40 2023-12-18T10:25:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01a8b5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0140cf7e0 0x7fe0141668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01a8b5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0140cf7e0 0x7fe0141668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49624/0 (socket says 172.21.15.133:49624) 2023-12-18T10:25:19.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01a8b5640 1 -- 172.21.15.133:0/2814958034 learned_addr learned my addr 172.21.15.133:0/2814958034 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:19.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01a0b4640 1 --2- 172.21.15.133:0/2814958034 >> v2:172.21.15.142:3300/0 conn(0x7fe01415ca40 0x7fe0140cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01a8b5640 1 -- 172.21.15.133:0/2814958034 >> v2:172.21.15.142:3300/0 conn(0x7fe01415ca40 msgr2=0x7fe0140cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:19.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01a8b5640 1 --2- 172.21.15.133:0/2814958034 >> v2:172.21.15.142:3300/0 conn(0x7fe01415ca40 0x7fe0140cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01a8b5640 1 -- 172.21.15.133:0/2814958034 >> v1:172.21.15.142:6789/0 conn(0x7fe0140ce3f0 legacy=0x7fe0140cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.069+0000 7fe01a8b5640 1 -- 172.21.15.133:0/2814958034 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0140d0890 con 0x7fe0140cf7e0 2023-12-18T10:25:19.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01a8b5640 1 --2- 172.21.15.133:0/2814958034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140cf7e0 0x7fe0141668e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fe0140736e0 tx=0x7fe00c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee17820cda70476 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:19.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe0190b2640 1 -- 172.21.15.133:0/2814958034 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0a5890 con 0x7fe0140cf7e0 2023-12-18T10:25:19.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe0190b2640 1 -- 172.21.15.133:0/2814958034 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c0a59f0 con 0x7fe0140cf7e0 2023-12-18T10:25:19.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe0190b2640 1 -- 172.21.15.133:0/2814958034 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0a5d80 con 0x7fe0140cf7e0 2023-12-18T10:25:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01c318640 1 -- 172.21.15.133:0/2814958034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140cf7e0 msgr2=0x7fe0141668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01c318640 1 --2- 172.21.15.133:0/2814958034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140cf7e0 0x7fe0141668e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fe0140736e0 tx=0x7fe00c01c9d0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01c318640 1 -- 172.21.15.133:0/2814958034 shutdown_connections 2023-12-18T10:25:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01c318640 1 --2- 172.21.15.133:0/2814958034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140cf7e0 0x7fe0141668e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01c318640 1 --2- 172.21.15.133:0/2814958034 >> v2:172.21.15.142:3300/0 conn(0x7fe01415ca40 0x7fe0140cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01c318640 1 -- 172.21.15.133:0/2814958034 >> 172.21.15.133:0/2814958034 conn(0x7fe014089fb0 msgr2=0x7fe0140d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01c318640 1 -- 172.21.15.133:0/2814958034 shutdown_connections 2023-12-18T10:25:19.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.073+0000 7fe01c318640 1 -- 172.21.15.133:0/2814958034 wait complete. 2023-12-18T10:25:19.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 Processor -- start 2023-12-18T10:25:19.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 -- start start 2023-12-18T10:25:19.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140ce3f0 0x7fe014153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0140cf7e0 0x7fe01414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01415ca40 0x7fe01414be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01415f1b0 con 0x7fe0140ce3f0 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01415b450 con 0x7fe01415ca40 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01415b170 con 0x7fe0140cf7e0 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140ce3f0 0x7fe014153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140ce3f0 0x7fe014153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49628/0 (socket says 172.21.15.133:49628) 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 -- 172.21.15.133:0/480276158 learned_addr learned my addr 172.21.15.133:0/480276158 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a8b5640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01415ca40 0x7fe01414be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe0198b3640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0140cf7e0 0x7fe01414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 -- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0140cf7e0 msgr2=0x7fe01414b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0140cf7e0 0x7fe01414b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 -- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01415ca40 msgr2=0x7fe01414be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01415ca40 0x7fe01414be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 -- 172.21.15.133:0/480276158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c009b30 con 0x7fe0140ce3f0 2023-12-18T10:25:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a8b5640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01415ca40 0x7fe01414be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01a0b4640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140ce3f0 0x7fe014153730 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fe01000e9b0 tx=0x7fe01000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe00affd640 1 -- 172.21.15.133:0/480276158 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010009670 con 0x7fe0140ce3f0 2023-12-18T10:25:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe00affd640 1 -- 172.21.15.133:0/480276158 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01000c9a0 con 0x7fe0140ce3f0 2023-12-18T10:25:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe00affd640 1 -- 172.21.15.133:0/480276158 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01000cd10 con 0x7fe0140ce3f0 2023-12-18T10:25:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01415eaf0 con 0x7fe0140ce3f0 2023-12-18T10:25:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe014153c70 con 0x7fe0140ce3f0 2023-12-18T10:25:19.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.077+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01404e000 con 0x7fe0140ce3f0 2023-12-18T10:25:19.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.081+0000 7fe00affd640 1 -- 172.21.15.133:0/480276158 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe010013470 con 0x7fe0140ce3f0 2023-12-18T10:25:19.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.081+0000 7fe00affd640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdff8065a60 0x7fdff8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.081+0000 7fe00affd640 1 -- 172.21.15.133:0/480276158 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe010083800 con 0x7fe0140ce3f0 2023-12-18T10:25:19.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.081+0000 7fe0198b3640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdff8065a60 0x7fdff8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.081+0000 7fe0198b3640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdff8065a60 0x7fdff8067f20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe0141f8890 tx=0x7fe004009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:19.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.085+0000 7fe00affd640 1 -- 172.21.15.133:0/480276158 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe010051110 con 0x7fe0140ce3f0 2023-12-18T10:25:19.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.237+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0140cff10 con 0x7fe0140ce3f0 2023-12-18T10:25:19.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.237+0000 7fe00affd640 1 -- 172.21.15.133:0/480276158 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+16309 (secure 0 0 0) 0x7fe010021090 con 0x7fe0140ce3f0 2023-12-18T10:25:19.239 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:19.239 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":104,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:25:18.553007+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:25:17.041912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-18T10:25:17.544282+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdff8065a60 msgr2=0x7fdff8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdff8065a60 0x7fdff8067f20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe0141f8890 tx=0x7fe004009040 comp rx=0 tx=0).stop 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140ce3f0 msgr2=0x7fe014153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140ce3f0 0x7fe014153730 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fe01000e9b0 tx=0x7fe01000ee70 comp rx=0 tx=0).stop 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 shutdown_connections 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fdff8065a60 0x7fdff8067f20 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe01415ca40 0x7fe01414be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0140cf7e0 0x7fe01414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 --2- 172.21.15.133:0/480276158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0140ce3f0 0x7fe014153730 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 >> 172.21.15.133:0/480276158 conn(0x7fe014089fb0 msgr2=0x7fe0140ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 shutdown_connections 2023-12-18T10:25:19.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.241+0000 7fe01c318640 1 -- 172.21.15.133:0/480276158 wait complete. 2023-12-18T10:25:19.261 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-18T10:25:19.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1de6863640 1 Processor -- start 2023-12-18T10:25:19.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1de6863640 1 -- start start 2023-12-18T10:25:19.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1de6863640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1de00cde90 0x7f1de00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1de6863640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de015cec0 con 0x7f1de00cf170 2023-12-18T10:25:19.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1de6863640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de00d0530 con 0x7f1de015cae0 2023-12-18T10:25:19.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1de6863640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00d0810 con 0x7f1de00cde90 2023-12-18T10:25:19.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1ddf7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1de00cde90 0x7f1de00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1de4e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1de00cf170 0x7f1de006add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53416/0 (socket says 172.21.15.133:53416) 2023-12-18T10:25:19.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1de4e00640 1 -- 172.21.15.133:0/3084625558 learned_addr learned my addr 172.21.15.133:0/3084625558 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:19.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1ddf7fe640 1 -- 172.21.15.133:0/3084625558 >> v1:172.21.15.142:6789/0 conn(0x7f1de015cae0 legacy=0x7f1de00d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1ddf7fe640 1 -- 172.21.15.133:0/3084625558 >> v1:172.21.15.133:6789/0 conn(0x7f1de00cf170 legacy=0x7f1de006add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1ddf7fe640 1 -- 172.21.15.133:0/3084625558 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00d0af0 con 0x7f1de00cde90 2023-12-18T10:25:19.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.401+0000 7f1ddeffd640 1 -- 172.21.15.133:0/3084625558 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285851135 0 0) 0x7f1de015cec0 con 0x7f1de00cf170 2023-12-18T10:25:19.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1ddf7fe640 1 --2- 172.21.15.133:0/3084625558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cde90 0x7f1de00ce2f0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40097c0 tx=0x7f1dd401ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d41b59e352c556 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1ddeffd640 1 -- 172.21.15.133:0/3084625558 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40ab670 con 0x7f1de00cde90 2023-12-18T10:25:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1ddeffd640 1 -- 172.21.15.133:0/3084625558 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd40ab7d0 con 0x7f1de00cde90 2023-12-18T10:25:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1ddeffd640 1 -- 172.21.15.133:0/3084625558 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40abb60 con 0x7f1de00cde90 2023-12-18T10:25:19.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1de6863640 1 -- 172.21.15.133:0/3084625558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cde90 msgr2=0x7f1de00ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1de6863640 1 --2- 172.21.15.133:0/3084625558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cde90 0x7f1de00ce2f0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40097c0 tx=0x7f1dd401ceb0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1de6863640 1 -- 172.21.15.133:0/3084625558 shutdown_connections 2023-12-18T10:25:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1de6863640 1 --2- 172.21.15.133:0/3084625558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cde90 0x7f1de00ce2f0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1de6863640 1 -- 172.21.15.133:0/3084625558 >> 172.21.15.133:0/3084625558 conn(0x7f1de0089fb0 msgr2=0x7f1de00d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1de6863640 1 -- 172.21.15.133:0/3084625558 shutdown_connections 2023-12-18T10:25:19.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.405+0000 7f1de6863640 1 -- 172.21.15.133:0/3084625558 wait complete. 2023-12-18T10:25:19.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 Processor -- start 2023-12-18T10:25:19.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 -- start start 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de00cde90 0x7f1de01570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cf170 0x7f1de00c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de015cae0 0x7f1de00c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00c7980 con 0x7f1de00cf170 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00c6d70 con 0x7f1de00cde90 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00c7050 con 0x7f1de015cae0 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cf170 0x7f1de00c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cf170 0x7f1de00c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49642/0 (socket says 172.21.15.133:49642) 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 -- 172.21.15.133:0/1103675608 learned_addr learned my addr 172.21.15.133:0/1103675608 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddffff640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de00cde90 0x7f1de01570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de4e00640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de015cae0 0x7f1de00c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 -- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de015cae0 msgr2=0x7f1de00c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de015cae0 0x7f1de00c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 -- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de00cde90 msgr2=0x7f1de01570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de00cde90 0x7f1de01570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 -- 172.21.15.133:0/1103675608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd4009420 con 0x7f1de00cf170 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddffff640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de00cde90 0x7f1de01570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de4e00640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de015cae0 0x7f1de00c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddf7fe640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cf170 0x7f1de00c62f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4019060 tx=0x7f1dd401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddcff9640 1 -- 172.21.15.133:0/1103675608 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40b5810 con 0x7f1de00cf170 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddcff9640 1 -- 172.21.15.133:0/1103675608 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd40b5990 con 0x7f1de00cf170 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1ddcff9640 1 -- 172.21.15.133:0/1103675608 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40b5d40 con 0x7f1de00cf170 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de00c7330 con 0x7f1de00cf170 2023-12-18T10:25:19.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.409+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de00cb2d0 con 0x7f1de00cf170 2023-12-18T10:25:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.413+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de004e000 con 0x7f1de00cf170 2023-12-18T10:25:19.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.413+0000 7f1ddcff9640 1 -- 172.21.15.133:0/1103675608 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1dd40b4390 con 0x7f1de00cf170 2023-12-18T10:25:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.413+0000 7f1ddcff9640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1dcc065a60 0x7f1dcc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.413+0000 7f1ddcff9640 1 -- 172.21.15.133:0/1103675608 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1dd411dd60 con 0x7f1de00cf170 2023-12-18T10:25:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.413+0000 7f1ddffff640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1dcc065a60 0x7f1dcc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:19.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.413+0000 7f1ddffff640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1dcc065a60 0x7f1dcc067f20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0000fc0 tx=0x7f1dd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:19.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.417+0000 7f1ddcff9640 1 -- 172.21.15.133:0/1103675608 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1dd40eb6f0 con 0x7f1de00cf170 2023-12-18T10:25:19.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:19.601+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1de00cff40 con 0x7f1de00cf170 2023-12-18T10:25:20.146 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-18T10:25:20.145+0000 7f0203086640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-18T10:25:20.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1ddcff9640 1 -- 172.21.15.133:0/1103675608 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v102) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1dd40eed10 con 0x7f1de00cf170 2023-12-18T10:25:20.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1dcc065a60 msgr2=0x7f1dcc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:20.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1dcc065a60 0x7f1dcc067f20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0000fc0 tx=0x7f1dd0009040 comp rx=0 tx=0).stop 2023-12-18T10:25:20.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cf170 msgr2=0x7f1de00c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cf170 0x7f1de00c62f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4019060 tx=0x7f1dd401ac90 comp rx=0 tx=0).stop 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 shutdown_connections 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1dcc065a60 0x7f1dcc067f20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1de015cae0 0x7f1de00c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de00cf170 0x7f1de00c62f0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 --2- 172.21.15.133:0/1103675608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1de00cde90 0x7f1de01570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.565+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 >> 172.21.15.133:0/1103675608 conn(0x7f1de0089fb0 msgr2=0x7f1de0157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.569+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 shutdown_connections 2023-12-18T10:25:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.569+0000 7f1de6863640 1 -- 172.21.15.133:0/1103675608 wait complete. 2023-12-18T10:25:20.589 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-18T10:25:20.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-18T10:25:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.729+0000 7f429c066640 1 Processor -- start 2023-12-18T10:25:20.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.729+0000 7f429c066640 1 -- start start 2023-12-18T10:25:20.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.729+0000 7f429c066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 0x7f42940ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:20.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.729+0000 7f429c066640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42940c9730 con 0x7f42940ce8d0 2023-12-18T10:25:20.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.729+0000 7f429c066640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42940c8e00 con 0x7f4294153020 2023-12-18T10:25:20.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.729+0000 7f429c066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42940ced60 con 0x7f42941598d0 2023-12-18T10:25:20.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.729+0000 7f429a603640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f42940ce8d0 0x7f4294070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39218/0 (socket says 172.21.15.133:39218) 2023-12-18T10:25:20.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.729+0000 7f429a603640 1 -- 172.21.15.133:0/3250610666 learned_addr learned my addr 172.21.15.133:0/3250610666 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:20.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4299601640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 0x7f42940ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:20.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854265257 0 0) 0x7f42940c9730 con 0x7f42940ce8d0 2023-12-18T10:25:20.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4280003450 con 0x7f42940ce8d0 2023-12-18T10:25:20.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850533420 0 0) 0x7f42940c8e00 con 0x7f4294153020 2023-12-18T10:25:20.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42940c9730 con 0x7f4294153020 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2401029523 0 0) 0x7f4280003450 con 0x7f42940ce8d0 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 msgr2=0x7f42940ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 0x7f42940ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 >> v1:172.21.15.142:6789/0 conn(0x7f4294153020 legacy=0x7f42940c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42940c90e0 con 0x7f42940ce8d0 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f428c001a00 con 0x7f42940ce8d0 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4299601640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 0x7f42940ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 >> v1:172.21.15.133:6789/0 conn(0x7f42940ce8d0 legacy=0x7f4294070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 0x7f4280003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4280004170 0x7f428000a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428000b020 0x7f428000d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42940ced60 con 0x7f428000b020 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428000dd90 con 0x7f4280004170 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428000df50 con 0x7f42941598d0 2023-12-18T10:25:20.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f429a603640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428000b020 0x7f428000d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4299e02640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 0x7f4280003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f4299601640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4280004170 0x7f428000a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f429a603640 1 -- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 msgr2=0x7f4280003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f429a603640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42941598d0 0x7f4280003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f429a603640 1 -- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4280004170 msgr2=0x7f428000a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f429a603640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4280004170 0x7f428000a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.733+0000 7f429a603640 1 -- 172.21.15.133:0/3250610666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284009420 con 0x7f428000b020 2023-12-18T10:25:20.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429a603640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428000b020 0x7f428000d4b0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f428c00a7b0 tx=0x7f428c01d270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b227393811a0f61e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:20.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0ad630 con 0x7f428000b020 2023-12-18T10:25:20.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c0a8070 con 0x7f428000b020 2023-12-18T10:25:20.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f4298e00640 1 -- 172.21.15.133:0/3250610666 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0ada10 con 0x7f428000b020 2023-12-18T10:25:20.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429c066640 1 -- 172.21.15.133:0/3250610666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428000b020 msgr2=0x7f428000d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:20.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429c066640 1 --2- 172.21.15.133:0/3250610666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428000b020 0x7f428000d4b0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f428c00a7b0 tx=0x7f428c01d270 comp rx=0 tx=0).stop 2023-12-18T10:25:20.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429a603640 1 -- 172.21.15.133:0/3250610666 reap_dead start 2023-12-18T10:25:20.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429c066640 1 -- 172.21.15.133:0/3250610666 shutdown_connections 2023-12-18T10:25:20.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429c066640 1 -- 172.21.15.133:0/3250610666 >> 172.21.15.133:0/3250610666 conn(0x7f429406a2a0 msgr2=0x7f42940aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:20.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429c066640 1 -- 172.21.15.133:0/3250610666 shutdown_connections 2023-12-18T10:25:20.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429c066640 1 -- 172.21.15.133:0/3250610666 wait complete. 2023-12-18T10:25:20.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429c066640 1 Processor -- start 2023-12-18T10:25:20.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.737+0000 7f429c066640 1 -- start start 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4294157d70 0x7f429415b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42941606b0 0x7f42940cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f429415bd50 0x7f42940ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42940adf00 con 0x7f429415bd50 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42940aea80 con 0x7f42941606b0 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42940ae150 con 0x7f4294157d70 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f429415bd50 0x7f42940ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f429415bd50 0x7f42940ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57064/0 (socket says 172.21.15.133:57064) 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f4299601640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42941606b0 0x7f42940cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 -- 172.21.15.133:0/1124973035 learned_addr learned my addr 172.21.15.133:0/1124973035 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f4299e02640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4294157d70 0x7f429415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 -- 172.21.15.133:0/1124973035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4294157d70 msgr2=0x7f429415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:20.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4294157d70 0x7f429415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 -- 172.21.15.133:0/1124973035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42941606b0 msgr2=0x7f42940cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:20.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42941606b0 0x7f42940cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:20.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 -- 172.21.15.133:0/1124973035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42940ae430 con 0x7f429415bd50 2023-12-18T10:25:20.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429a603640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f429415bd50 0x7f42940ccd60 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f428c098ba0 tx=0x7f4280003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f428a7fc640 1 -- 172.21.15.133:0/1124973035 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c001f50 con 0x7f429415bd50 2023-12-18T10:25:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f428a7fc640 1 -- 172.21.15.133:0/1124973035 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c0013b0 con 0x7f429415bd50 2023-12-18T10:25:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42940ae710 con 0x7f429415bd50 2023-12-18T10:25:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f428a7fc640 1 -- 172.21.15.133:0/1124973035 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c001a00 con 0x7f429415bd50 2023-12-18T10:25:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4294158150 con 0x7f429415bd50 2023-12-18T10:25:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429404e000 con 0x7f429415bd50 2023-12-18T10:25:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.741+0000 7f428a7fc640 1 -- 172.21.15.133:0/1124973035 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f428c0aa030 con 0x7f429415bd50 2023-12-18T10:25:20.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.745+0000 7f428a7fc640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4278065a90 0x7f4278067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:20.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.745+0000 7f428a7fc640 1 -- 172.21.15.133:0/1124973035 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f428c11caa0 con 0x7f429415bd50 2023-12-18T10:25:20.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.745+0000 7f4299e02640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4278065a90 0x7f4278067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.745+0000 7f4299e02640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4278065a90 0x7f4278067f50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f42900010f0 tx=0x7f4290009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.749+0000 7f428a7fc640 1 -- 172.21.15.133:0/1124973035 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f428c0ea480 con 0x7f429415bd50 2023-12-18T10:25:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:20.929+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f42940aebc0 con 0x7f429415bd50 2023-12-18T10:25:21.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-18T10:25:21.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-18T10:25:21.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-18T10:25:21.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-18T10:25:21.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.573+0000 7f428a7fc640 1 -- 172.21.15.133:0/1124973035 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v103) v1 ==== 122+0+0 (secure 0 0 0) 0x7f428c0ba0c0 con 0x7f429415bd50 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4278065a90 msgr2=0x7f4278067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4278065a90 0x7f4278067f50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f42900010f0 tx=0x7f4290009040 comp rx=0 tx=0).stop 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f429415bd50 msgr2=0x7f42940ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f429415bd50 0x7f42940ccd60 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f428c098ba0 tx=0x7f4280003700 comp rx=0 tx=0).stop 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 shutdown_connections 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4278065a90 0x7f4278067f50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f429415bd50 0x7f42940ccd60 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42941606b0 0x7f42940cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 --2- 172.21.15.133:0/1124973035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4294157d70 0x7f429415b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 >> 172.21.15.133:0/1124973035 conn(0x7f429406a2a0 msgr2=0x7f429415a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 shutdown_connections 2023-12-18T10:25:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.577+0000 7f429c066640 1 -- 172.21.15.133:0/1124973035 wait complete. 2023-12-18T10:25:21.600 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-18T10:25:21.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.741+0000 7fe32abf0640 1 Processor -- start 2023-12-18T10:25:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.741+0000 7fe32abf0640 1 -- start start 2023-12-18T10:25:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.741+0000 7fe32abf0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe32415a680 0x7fe32415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.741+0000 7fe32abf0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3240cac10 0x7fe32415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.741+0000 7fe32abf0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32415f100 con 0x7fe32415afa0 2023-12-18T10:25:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.741+0000 7fe32abf0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3240ca7d0 con 0x7fe32415a680 2023-12-18T10:25:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.741+0000 7fe32abf0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32415e860 con 0x7fe3240cac10 2023-12-18T10:25:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.741+0000 7fe32918d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe32415afa0 0x7fe32406fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39232/0 (socket says 172.21.15.133:39232) 2023-12-18T10:25:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe32918d640 1 -- 172.21.15.133:0/886253601 learned_addr learned my addr 172.21.15.133:0/886253601 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe32898c640 1 --2- 172.21.15.133:0/886253601 >> v2:172.21.15.142:3300/0 conn(0x7fe32415a680 0x7fe32415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe31bfff640 1 --2- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3240cac10 0x7fe32415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe31b7fe640 1 -- 172.21.15.133:0/886253601 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256013688 0 0) 0x7fe32415f100 con 0x7fe32415afa0 2023-12-18T10:25:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe31b7fe640 1 -- 172.21.15.133:0/886253601 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30c003530 con 0x7fe32415afa0 2023-12-18T10:25:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe32898c640 1 -- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3240cac10 msgr2=0x7fe32415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe32898c640 1 --2- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3240cac10 0x7fe32415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe32898c640 1 -- 172.21.15.133:0/886253601 >> v1:172.21.15.133:6789/0 conn(0x7fe32415afa0 legacy=0x7fe32406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe32898c640 1 -- 172.21.15.133:0/886253601 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32415eb40 con 0x7fe32415a680 2023-12-18T10:25:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe31bfff640 1 --2- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3240cac10 0x7fe32415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe32898c640 1 --2- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe32415a680 0x7fe32415e160 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe3200097c0 tx=0x7fe32001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5939d8ce64e2dbc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe31b7fe640 1 -- 172.21.15.133:0/886253601 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3200ab600 con 0x7fe32415a680 2023-12-18T10:25:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe31b7fe640 1 -- 172.21.15.133:0/886253601 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3200a7050 con 0x7fe32415a680 2023-12-18T10:25:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.745+0000 7fe31b7fe640 1 -- 172.21.15.133:0/886253601 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3200ab980 con 0x7fe32415a680 2023-12-18T10:25:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe32415a680 msgr2=0x7fe32415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 --2- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe32415a680 0x7fe32415e160 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe3200097c0 tx=0x7fe32001c3f0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- 172.21.15.133:0/886253601 shutdown_connections 2023-12-18T10:25:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 --2- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3240cac10 0x7fe32415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 --2- 172.21.15.133:0/886253601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe32415a680 0x7fe32415e160 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- 172.21.15.133:0/886253601 >> 172.21.15.133:0/886253601 conn(0x7fe32406a3e0 msgr2=0x7fe3240afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- 172.21.15.133:0/886253601 shutdown_connections 2023-12-18T10:25:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- 172.21.15.133:0/886253601 wait complete. 2023-12-18T10:25:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 Processor -- start 2023-12-18T10:25:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- start start 2023-12-18T10:25:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3240cac10 0x7fe324164c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe32415a680 0x7fe324156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe32415afa0 0x7fe324156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe324157880 con 0x7fe32415afa0 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3241520e0 con 0x7fe3240cac10 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32abf0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240c54d0 con 0x7fe32415a680 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32918d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe32415afa0 0x7fe324156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32918d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe32415afa0 0x7fe324156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57068/0 (socket says 172.21.15.133:57068) 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32918d640 1 -- 172.21.15.133:0/3046108657 learned_addr learned my addr 172.21.15.133:0/3046108657 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe32898c640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3240cac10 0x7fe324164c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.749+0000 7fe31bfff640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe32415a680 0x7fe324156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32918d640 1 -- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe32415a680 msgr2=0x7fe324156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32918d640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe32415a680 0x7fe324156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32918d640 1 -- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3240cac10 msgr2=0x7fe324164c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32918d640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3240cac10 0x7fe324164c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32918d640 1 -- 172.21.15.133:0/3046108657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009420 con 0x7fe32415afa0 2023-12-18T10:25:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32898c640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3240cac10 0x7fe324164c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32918d640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe32415afa0 0x7fe324156d50 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00cad0 tx=0x7fe31c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe3197fa640 1 -- 172.21.15.133:0/3046108657 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00abd0 con 0x7fe32415afa0 2023-12-18T10:25:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe3197fa640 1 -- 172.21.15.133:0/3046108657 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c00ad30 con 0x7fe32415afa0 2023-12-18T10:25:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe3197fa640 1 -- 172.21.15.133:0/3046108657 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00aea0 con 0x7fe32415afa0 2023-12-18T10:25:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe320009420 con 0x7fe32415afa0 2023-12-18T10:25:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3240c5770 con 0x7fe32415afa0 2023-12-18T10:25:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3240735b0 con 0x7fe32415afa0 2023-12-18T10:25:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe3197fa640 1 -- 172.21.15.133:0/3046108657 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe31c007070 con 0x7fe32415afa0 2023-12-18T10:25:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe3197fa640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe310065a60 0x7fe310067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe3197fa640 1 -- 172.21.15.133:0/3046108657 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe31c0831d0 con 0x7fe32415afa0 2023-12-18T10:25:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.753+0000 7fe32898c640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe310065a60 0x7fe310067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.757+0000 7fe32898c640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe310065a60 0x7fe310067f20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe3200ad000 tx=0x7fe3200a4f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.757+0000 7fe3197fa640 1 -- 172.21.15.133:0/3046108657 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe31c050a60 con 0x7fe32415afa0 2023-12-18T10:25:21.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.941+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3241579c0 con 0x7fe32415afa0 2023-12-18T10:25:21.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.941+0000 7fe3197fa640 1 -- 172.21.15.133:0/3046108657 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4725 (secure 0 0 0) 0x7fe3241579c0 con 0x7fe32415afa0 2023-12-18T10:25:21.942 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:21.942 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":103,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9039,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:21.565783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:25:21.942 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 103 2023-12-18T10:25:21.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe310065a60 msgr2=0x7fe310067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:21.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe310065a60 0x7fe310067f20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe3200ad000 tx=0x7fe3200a4f90 comp rx=0 tx=0).stop 2023-12-18T10:25:21.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe32415afa0 msgr2=0x7fe324156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:21.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe32415afa0 0x7fe324156d50 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00cad0 tx=0x7fe31c00cf90 comp rx=0 tx=0).stop 2023-12-18T10:25:21.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 shutdown_connections 2023-12-18T10:25:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe310065a60 0x7fe310067f20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe32415afa0 0x7fe324156d50 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe32415a680 0x7fe324156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 --2- 172.21.15.133:0/3046108657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3240cac10 0x7fe324164c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 >> 172.21.15.133:0/3046108657 conn(0x7fe32406a3e0 msgr2=0x7fe3241523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 shutdown_connections 2023-12-18T10:25:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:21.945+0000 7fe32abf0640 1 -- 172.21.15.133:0/3046108657 wait complete. 2023-12-18T10:25:21.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:25:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe35dbf0640 1 Processor -- start 2023-12-18T10:25:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe35dbf0640 1 -- start start 2023-12-18T10:25:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe35dbf0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe3581570c0 0x7fe35806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe35dbf0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe35806c320 0x7fe3580c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe35dbf0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3580c9460 con 0x7fe3580c9e30 2023-12-18T10:25:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe35dbf0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35806c7a0 con 0x7fe3581570c0 2023-12-18T10:25:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe35dbf0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581574a0 con 0x7fe35806c320 2023-12-18T10:25:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe3577fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe3581570c0 0x7fe35806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe356ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe35806c320 0x7fe3580c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe357fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe3580c9e30 0x7fe35815d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:57870/0 (socket says 172.21.15.133:57870) 2023-12-18T10:25:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe357fff640 1 -- 172.21.15.133:0/2549623028 learned_addr learned my addr 172.21.15.133:0/2549623028 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe3577fe640 1 -- 172.21.15.133:0/2549623028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe35806c320 msgr2=0x7fe3580c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe3577fe640 1 --2- 172.21.15.133:0/2549623028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe35806c320 0x7fe3580c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe3577fe640 1 -- 172.21.15.133:0/2549623028 >> v1:172.21.15.142:6789/0 conn(0x7fe3580c9e30 legacy=0x7fe35815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.101+0000 7fe3577fe640 1 -- 172.21.15.133:0/2549623028 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580c8b30 con 0x7fe3581570c0 2023-12-18T10:25:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe3577fe640 1 --2- 172.21.15.133:0/2549623028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3581570c0 0x7fe35806bde0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe3480097c0 tx=0x7fe34801e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52eb42c05b2b28cc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe3567fc640 1 -- 172.21.15.133:0/2549623028 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480a8660 con 0x7fe3581570c0 2023-12-18T10:25:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe3567fc640 1 -- 172.21.15.133:0/2549623028 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3480a87c0 con 0x7fe3581570c0 2023-12-18T10:25:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe3567fc640 1 -- 172.21.15.133:0/2549623028 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480a8b50 con 0x7fe3581570c0 2023-12-18T10:25:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe35dbf0640 1 -- 172.21.15.133:0/2549623028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3581570c0 msgr2=0x7fe35806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/2549623028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3581570c0 0x7fe35806bde0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe3480097c0 tx=0x7fe34801e690 comp rx=0 tx=0).stop 2023-12-18T10:25:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe35dbf0640 1 -- 172.21.15.133:0/2549623028 shutdown_connections 2023-12-18T10:25:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/2549623028 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe35806c320 0x7fe3580c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/2549623028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3581570c0 0x7fe35806bde0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe35dbf0640 1 -- 172.21.15.133:0/2549623028 >> 172.21.15.133:0/2549623028 conn(0x7fe35806a3e0 msgr2=0x7fe3580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe35dbf0640 1 -- 172.21.15.133:0/2549623028 shutdown_connections 2023-12-18T10:25:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.105+0000 7fe35dbf0640 1 -- 172.21.15.133:0/2549623028 wait complete. 2023-12-18T10:25:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 Processor -- start 2023-12-18T10:25:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 -- start start 2023-12-18T10:25:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35806c320 0x7fe358159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3580c9e30 0x7fe35815b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3581570c0 0x7fe3580ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c56c0 con 0x7fe35806c320 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c2a20 con 0x7fe3580c9e30 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580c2d00 con 0x7fe3581570c0 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35806c320 0x7fe358159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35806c320 0x7fe358159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57078/0 (socket says 172.21.15.133:57078) 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 -- 172.21.15.133:0/1012985356 learned_addr learned my addr 172.21.15.133:0/1012985356 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe357fff640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3581570c0 0x7fe3580ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe356ffd640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3580c9e30 0x7fe35815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 -- 172.21.15.133:0/1012985356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3581570c0 msgr2=0x7fe3580ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3581570c0 0x7fe3580ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 -- 172.21.15.133:0/1012985356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3580c9e30 msgr2=0x7fe35815b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3580c9e30 0x7fe35815b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 -- 172.21.15.133:0/1012985356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348009420 con 0x7fe35806c320 2023-12-18T10:25:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe3577fe640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35806c320 0x7fe358159fc0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe34801c2c0 tx=0x7fe34801b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe33ffff640 1 -- 172.21.15.133:0/1012985356 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480b3920 con 0x7fe35806c320 2023-12-18T10:25:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe33ffff640 1 -- 172.21.15.133:0/1012985356 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3480b3ac0 con 0x7fe35806c320 2023-12-18T10:25:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe33ffff640 1 -- 172.21.15.133:0/1012985356 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480b3e70 con 0x7fe35806c320 2023-12-18T10:25:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.109+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3580c2fe0 con 0x7fe35806c320 2023-12-18T10:25:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.113+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580c35a0 con 0x7fe35806c320 2023-12-18T10:25:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.113+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3580735b0 con 0x7fe35806c320 2023-12-18T10:25:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.113+0000 7fe33ffff640 1 -- 172.21.15.133:0/1012985356 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe3480a9440 con 0x7fe35806c320 2023-12-18T10:25:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.113+0000 7fe33ffff640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe344065a60 0x7fe344067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.113+0000 7fe33ffff640 1 -- 172.21.15.133:0/1012985356 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe34811dcb0 con 0x7fe35806c320 2023-12-18T10:25:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.113+0000 7fe356ffd640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe344065a60 0x7fe344067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.113+0000 7fe356ffd640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe344065a60 0x7fe344067f20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe3580c71b0 tx=0x7fe34c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.117+0000 7fe33ffff640 1 -- 172.21.15.133:0/1012985356 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe3480eb670 con 0x7fe35806c320 2023-12-18T10:25:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.269+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3580c3790 con 0x7fe35806c320 2023-12-18T10:25:22.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe33ffff640 1 -- 172.21.15.133:0/1012985356 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+16296 (secure 0 0 0) 0x7fe3480eec90 con 0x7fe35806c320 2023-12-18T10:25:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:22.272 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":105,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:25:19.556749+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:25:17.041912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-18T10:25:17.544282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:25:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe344065a60 msgr2=0x7fe344067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe344065a60 0x7fe344067f20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe3580c71b0 tx=0x7fe34c009190 comp rx=0 tx=0).stop 2023-12-18T10:25:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35806c320 msgr2=0x7fe358159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35806c320 0x7fe358159fc0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe34801c2c0 tx=0x7fe34801b430 comp rx=0 tx=0).stop 2023-12-18T10:25:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 shutdown_connections 2023-12-18T10:25:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe344065a60 0x7fe344067f20 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe3581570c0 0x7fe3580ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe3580c9e30 0x7fe35815b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 --2- 172.21.15.133:0/1012985356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe35806c320 0x7fe358159fc0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 >> 172.21.15.133:0/1012985356 conn(0x7fe35806a3e0 msgr2=0x7fe3580aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:22.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 shutdown_connections 2023-12-18T10:25:22.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.273+0000 7fe35dbf0640 1 -- 172.21.15.133:0/1012985356 wait complete. 2023-12-18T10:25:22.294 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-18T10:25:22.294 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:25:22.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc1451b3640 1 Processor -- start 2023-12-18T10:25:22.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc1451b3640 1 -- start start 2023-12-18T10:25:22.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc1451b3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1400cac10 0x7fc14015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc1451b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006fdb0 0x7fc140070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc1451b3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14015f100 con 0x7fc14015a680 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc1451b3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc140070780 con 0x7fc1400cac10 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc1451b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1400ca7d0 con 0x7fc14006fdb0 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1400cac10 0x7fc14015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1400cac10 0x7fc14015e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57086/0 (socket says 172.21.15.133:57086) 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13e59c640 1 -- 172.21.15.133:0/259181011 learned_addr learned my addr 172.21.15.133:0/259181011 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13f59e640 1 --2- 172.21.15.133:0/259181011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006fdb0 0x7fc140070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13e59c640 1 -- 172.21.15.133:0/259181011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006fdb0 msgr2=0x7fc140070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13e59c640 1 --2- 172.21.15.133:0/259181011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006fdb0 0x7fc140070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13e59c640 1 -- 172.21.15.133:0/259181011 >> v1:172.21.15.142:6789/0 conn(0x7fc14015a680 legacy=0x7fc14015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13e59c640 1 -- 172.21.15.133:0/259181011 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14015e860 con 0x7fc1400cac10 2023-12-18T10:25:22.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.433+0000 7fc13f59e640 1 --2- 172.21.15.133:0/259181011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006fdb0 0x7fc140070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc13e59c640 1 --2- 172.21.15.133:0/259181011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc14015e160 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc134009870 tx=0x7fc13401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a531cccebc3595d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc13dd9b640 1 -- 172.21.15.133:0/259181011 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340aa610 con 0x7fc1400cac10 2023-12-18T10:25:22.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc13dd9b640 1 -- 172.21.15.133:0/259181011 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1340a6040 con 0x7fc1400cac10 2023-12-18T10:25:22.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc13dd9b640 1 -- 172.21.15.133:0/259181011 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340aa990 con 0x7fc1400cac10 2023-12-18T10:25:22.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc1451b3640 1 -- 172.21.15.133:0/259181011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 msgr2=0x7fc14015e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc1451b3640 1 --2- 172.21.15.133:0/259181011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc14015e160 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc134009870 tx=0x7fc13401c4b0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc1451b3640 1 -- 172.21.15.133:0/259181011 shutdown_connections 2023-12-18T10:25:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc1451b3640 1 --2- 172.21.15.133:0/259181011 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14006fdb0 0x7fc140070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc1451b3640 1 --2- 172.21.15.133:0/259181011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc14015e160 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc1451b3640 1 -- 172.21.15.133:0/259181011 >> 172.21.15.133:0/259181011 conn(0x7fc14006a3e0 msgr2=0x7fc1400afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc1451b3640 1 -- 172.21.15.133:0/259181011 shutdown_connections 2023-12-18T10:25:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.437+0000 7fc1451b3640 1 -- 172.21.15.133:0/259181011 wait complete. 2023-12-18T10:25:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 Processor -- start 2023-12-18T10:25:22.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 -- start start 2023-12-18T10:25:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14006fdb0 0x7fc140151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc140151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14015a680 0x7fc140153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140153d00 con 0x7fc1400cac10 2023-12-18T10:25:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140151150 con 0x7fc14006fdb0 2023-12-18T10:25:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc140155240 con 0x7fc14015a680 2023-12-18T10:25:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc140151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc140151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57096/0 (socket says 172.21.15.133:57096) 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 -- 172.21.15.133:0/3060718056 learned_addr learned my addr 172.21.15.133:0/3060718056 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13f59e640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14015a680 0x7fc140153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13ed9d640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14006fdb0 0x7fc140151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 -- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14015a680 msgr2=0x7fc140153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14015a680 0x7fc140153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 -- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14006fdb0 msgr2=0x7fc140151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14006fdb0 0x7fc140151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 -- 172.21.15.133:0/3060718056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340094d0 con 0x7fc1400cac10 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13f59e640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14015a680 0x7fc140153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc13e59c640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc140151570 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc13401a0e0 tx=0x7fc13401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1277fe640 1 -- 172.21.15.133:0/3060718056 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340bd5f0 con 0x7fc1400cac10 2023-12-18T10:25:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1277fe640 1 -- 172.21.15.133:0/3060718056 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1340bd750 con 0x7fc1400cac10 2023-12-18T10:25:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1401507b0 con 0x7fc1400cac10 2023-12-18T10:25:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1277fe640 1 -- 172.21.15.133:0/3060718056 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340bdb00 con 0x7fc1400cac10 2023-12-18T10:25:22.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc140150d70 con 0x7fc1400cac10 2023-12-18T10:25:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.441+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1400735b0 con 0x7fc1400cac10 2023-12-18T10:25:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.445+0000 7fc1277fe640 1 -- 172.21.15.133:0/3060718056 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc1340b33f0 con 0x7fc1400cac10 2023-12-18T10:25:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.445+0000 7fc1277fe640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc12c065a60 0x7fc12c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.445+0000 7fc1277fe640 1 -- 172.21.15.133:0/3060718056 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc13411de10 con 0x7fc1400cac10 2023-12-18T10:25:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.445+0000 7fc13ed9d640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc12c065a60 0x7fc12c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.445+0000 7fc13ed9d640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc12c065a60 0x7fc12c067f20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc1400b0380 tx=0x7fc130009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.449+0000 7fc1277fe640 1 -- 172.21.15.133:0/3060718056 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc134121030 con 0x7fc1400cac10 2023-12-18T10:25:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.593+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1400c8e10 con 0x7fc12c065a60 2023-12-18T10:25:22.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.601+0000 7fc1277fe640 1 -- 172.21.15.133:0/3060718056 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278573 (secure 0 0 0) 0x7fc130001c80 con 0x7fc12c065a60 2023-12-18T10:25:22.605 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:22.607 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc12c065a60 msgr2=0x7fc12c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc12c065a60 0x7fc12c067f20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc1400b0380 tx=0x7fc130009040 comp rx=0 tx=0).stop 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 msgr2=0x7fc140151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc140151570 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc13401a0e0 tx=0x7fc13401acf0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 shutdown_connections 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc12c065a60 0x7fc12c067f20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc14015a680 0x7fc140153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1400cac10 0x7fc140151570 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 --2- 172.21.15.133:0/3060718056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc14006fdb0 0x7fc140151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 >> 172.21.15.133:0/3060718056 conn(0x7fc14006a3e0 msgr2=0x7fc14015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 shutdown_connections 2023-12-18T10:25:22.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.605+0000 7fc1451b3640 1 -- 172.21.15.133:0/3060718056 wait complete. 2023-12-18T10:25:22.625 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2023-12-18T10:25:21.188612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259420,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754715300,"statfs":{"total":773094113280,"available":772828467200,"internally_reserved":0,"allocated":11300864,"data_stored":5832047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.033918"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160990+0000","last_change":"2023-12-18T10:25:17.160990+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160990+0000","last_undegraded":"2023-12-18T10:25:17.160990+0000","last_fullsized":"2023-12-18T10:25:17.160990+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:33.405328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.171792+0000","last_change":"2023-12-18T10:25:17.171792+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.171792+0000","last_undegraded":"2023-12-18T10:25:17.171792+0000","last_fullsized":"2023-12-18T10:25:17.171792+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:39.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156582+0000","last_change":"2023-12-18T10:25:17.156582+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156582+0000","last_undegraded":"2023-12-18T10:25:17.156582+0000","last_fullsized":"2023-12-18T10:25:17.156582+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:59:11.931460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.168748+0000","last_change":"2023-12-18T10:25:17.168748+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.168748+0000","last_undegraded":"2023-12-18T10:25:17.168748+0000","last_fullsized":"2023-12-18T10:25:17.168748+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:57:53.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.164913+0000","last_change":"2023-12-18T10:25:17.164913+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.164913+0000","last_undegraded":"2023-12-18T10:25:17.164913+0000","last_fullsized":"2023-12-18T10:25:17.164913+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:31:19.235853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159496+0000","last_change":"2023-12-18T10:25:17.159496+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159496+0000","last_undegraded":"2023-12-18T10:25:17.159496+0000","last_fullsized":"2023-12-18T10:25:17.159496+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:23:18.806188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156536+0000","last_change":"2023-12-18T10:25:17.156536+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156536+0000","last_undegraded":"2023-12-18T10:25:17.156536+0000","last_fullsized":"2023-12-18T10:25:17.156536+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:07:06.621984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160926+0000","last_change":"2023-12-18T10:25:17.160926+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160926+0000","last_undegraded":"2023-12-18T10:25:17.160926+0000","last_fullsized":"2023-12-18T10:25:17.160926+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:00:57.260829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156654+0000","last_change":"2023-12-18T10:25:17.156654+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156654+0000","last_undegraded":"2023-12-18T10:25:17.156654+0000","last_fullsized":"2023-12-18T10:25:17.156654+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:28:06.452447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160073+0000","last_change":"2023-12-18T10:25:17.160073+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160073+0000","last_undegraded":"2023-12-18T10:25:17.160073+0000","last_fullsized":"2023-12-18T10:25:17.160073+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:42:45.681860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.165537+0000","last_change":"2023-12-18T10:25:17.165537+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.165537+0000","last_undegraded":"2023-12-18T10:25:17.165537+0000","last_fullsized":"2023-12-18T10:25:17.165537+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:30.804813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160355+0000","last_change":"2023-12-18T10:25:17.160355+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160355+0000","last_undegraded":"2023-12-18T10:25:17.160355+0000","last_fullsized":"2023-12-18T10:25:17.160355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:20.134299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.168222+0000","last_change":"2023-12-18T10:25:17.168222+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.168222+0000","last_undegraded":"2023-12-18T10:25:17.168222+0000","last_fullsized":"2023-12-18T10:25:17.168222+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:46:16.979293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160980+0000","last_change":"2023-12-18T10:25:17.160980+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160980+0000","last_undegraded":"2023-12-18T10:25:17.160980+0000","last_fullsized":"2023-12-18T10:25:17.160980+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:55:31.907598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.170930+0000","last_change":"2023-12-18T10:25:17.170930+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.170930+0000","last_undegraded":"2023-12-18T10:25:17.170930+0000","last_fullsized":"2023-12-18T10:25:17.170930+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:37.231695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156551+0000","last_change":"2023-12-18T10:25:17.156551+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156551+0000","last_undegraded":"2023-12-18T10:25:17.156551+0000","last_fullsized":"2023-12-18T10:25:17.156551+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:52:23.176182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.161324+0000","last_change":"2023-12-18T10:25:17.161324+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.161324+0000","last_undegraded":"2023-12-18T10:25:17.161324+0000","last_fullsized":"2023-12-18T10:25:17.161324+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:21:32.694099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.164910+0000","last_change":"2023-12-18T10:25:17.164910+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.164910+0000","last_undegraded":"2023-12-18T10:25:17.164910+0000","last_fullsized":"2023-12-18T10:25:17.164910+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:10.119938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159630+0000","last_change":"2023-12-18T10:25:17.159630+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159630+0000","last_undegraded":"2023-12-18T10:25:17.159630+0000","last_fullsized":"2023-12-18T10:25:17.159630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:55:57.076492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.170927+0000","last_change":"2023-12-18T10:25:17.170927+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.170927+0000","last_undegraded":"2023-12-18T10:25:17.170927+0000","last_fullsized":"2023-12-18T10:25:17.170927+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:16.763875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.171471+0000","last_change":"2023-12-18T10:25:17.171471+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.171471+0000","last_undegraded":"2023-12-18T10:25:17.171471+0000","last_fullsized":"2023-12-18T10:25:17.171471+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:33:49.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160569+0000","last_change":"2023-12-18T10:25:17.160569+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160569+0000","last_undegraded":"2023-12-18T10:25:17.160569+0000","last_fullsized":"2023-12-18T10:25:17.160569+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:53:14.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.171521+0000","last_change":"2023-12-18T10:25:17.171521+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.171521+0000","last_undegraded":"2023-12-18T10:25:17.171521+0000","last_fullsized":"2023-12-18T10:25:17.171521+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:56:58.730035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.168250+0000","last_change":"2023-12-18T10:25:17.168250+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.168250+0000","last_undegraded":"2023-12-18T10:25:17.168250+0000","last_fullsized":"2023-12-18T10:25:17.168250+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:46:19.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159525+0000","last_change":"2023-12-18T10:25:17.159525+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159525+0000","last_undegraded":"2023-12-18T10:25:17.159525+0000","last_fullsized":"2023-12-18T10:25:17.159525+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:18:02.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159474+0000","last_change":"2023-12-18T10:25:17.159474+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159474+0000","last_undegraded":"2023-12-18T10:25:17.159474+0000","last_fullsized":"2023-12-18T10:25:17.159474+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:19.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.168239+0000","last_change":"2023-12-18T10:25:17.168239+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.168239+0000","last_undegraded":"2023-12-18T10:25:17.168239+0000","last_fullsized":"2023-12-18T10:25:17.168239+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:11.568787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156547+0000","last_change":"2023-12-18T10:25:17.156547+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156547+0000","last_undegraded":"2023-12-18T10:25:17.156547+0000","last_fullsized":"2023-12-18T10:25:17.156547+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:44:44.024501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.170922+0000","last_change":"2023-12-18T10:25:17.170922+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.170922+0000","last_undegraded":"2023-12-18T10:25:17.170922+0000","last_fullsized":"2023-12-18T10:25:17.170922+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:41:07.781582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159545+0000","last_change":"2023-12-18T10:25:17.159545+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159545+0000","last_undegraded":"2023-12-18T10:25:17.159545+0000","last_fullsized":"2023-12-18T10:25:17.159545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:48.530491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.170939+0000","last_change":"2023-12-18T10:25:17.170939+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.170939+0000","last_undegraded":"2023-12-18T10:25:17.170939+0000","last_fullsized":"2023-12-18T10:25:17.170939+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:01:55.510810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.171001+0000","last_change":"2023-12-18T10:25:17.171001+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.171001+0000","last_undegraded":"2023-12-18T10:25:17.171001+0000","last_fullsized":"2023-12-18T10:25:17.171001+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:46:12.832194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":230,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-18T10:25:15.296428+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:25:15.296428+0000","last_peered":"2023-12-18T10:25:15.296428+0000","last_clean":"2023-12-18T10:25:15.296428+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:25:15.296428+0000","last_undegraded":"2023-12-18T10:25:15.296428+0000","last_fullsized":"2023-12-18T10:25:15.296428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1859584,"data_stored":1172549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.624},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.72199999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":1.042,"15min":1.042},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":1.081,"15min":1.081},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.67400000000000004},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":1.097,"15min":1.097},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.748}]},{"osd":4,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.91000000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70699999999999996,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88200000000000001,"5min":1.137,"15min":1.137},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":1.024,"15min":1.024},"last":0.71099999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.76900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.79600000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.018,"5min":1.018,"15min":4.3760000000000003},"last":0.623},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.83899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.49299999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.73299999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.845},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69799999999999995,"15min":0.82499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.179,"5min":1.179,"15min":4.524},"last":0.52000000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":1.121,"5min":1.121,"15min":2.2709999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.746},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.54900000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.80500000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91400000000000003,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.84499999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.0049999999999999,"15min":1.101},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.627,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67600000000000005,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.93500000000000005,"5min":0.98799999999999999,"15min":1.284},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91400000000000003,"5min":1.0880000000000001,"15min":1.129},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.74399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":1.006,"15min":1.0820000000000001},"last":0.751}]}]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.873,"15min":1.0900000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.66500000000000004,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.78600000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65500000000000003,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.85799999999999998,"5min":0.92500000000000004,"15min":3.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":0.879,"15min":0.90500000000000003},"last":0.67700000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.749},"min":{"1min":0.432,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.81000000000000005,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.77100000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":2.0699999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67800000000000005,"15min":0.79100000000000004},"min":{"1min":0.502,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.88200000000000001,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.871}]},{"osd":4,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63300000000000001,"15min":0.89400000000000002},"min":{"1min":0.48899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82899999999999996,"5min":0.88,"15min":8.9740000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68100000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92300000000000004,"5min":0.97899999999999998,"15min":1.2370000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.72999999999999998},"min":{"1min":0.46899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":2.9060000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63700000000000001,"15min":0.76000000000000001},"min":{"1min":0.55300000000000005,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.505}]},{"osd":7,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64400000000000002,"15min":0.68600000000000005},"min":{"1min":0.51300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":1.042,"15min":1.1830000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67400000000000004,"15min":0.79200000000000004},"min":{"1min":0.53600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.503,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91600000000000004,"5min":0.96799999999999997,"15min":1.0249999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.84099999999999997,"5min":0.92800000000000005,"15min":1.1739999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.131},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.54500000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89600000000000002,"5min":1.008,"15min":1.032},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.86199999999999999,"5min":0.94499999999999995,"15min":0.999},"last":0.496},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.63},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68500000000000005,"5min":0.91900000000000004,"15min":0.97399999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.86799999999999999,"15min":0.874},"last":0.61399999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.71799999999999997},"min":{"1min":0.55000000000000004,"5min":0.376,"15min":0.376},"max":{"1min":0.82299999999999995,"5min":1.0109999999999999,"15min":1.073},"last":0.65200000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":1.042},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90500000000000003,"15min":1.1479999999999999},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41699999999999998,"15min":0.42499999999999999},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58999999999999997,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45600000000000002,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.59699999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.41499999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.46400000000000002},"min":{"1min":0.312,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53800000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.66300000000000003,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.57199999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":1.036,"15min":1.254},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.64300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":0.98899999999999999,"15min":1.772},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.01},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.60999999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.167,"15min":1.181},"last":0.86599999999999999}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.171,"15min":1.171},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93700000000000006,"5min":1.0549999999999999,"15min":1.069},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72199999999999998,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.53400000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.751},"min":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90000000000000002,"5min":1.26,"15min":1.26},"last":0.82999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574941,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1253376,"data_stored":576044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.61499999999999999,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.442},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60399999999999998,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.32200000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47699999999999998,"15min":0.49099999999999999},"min":{"1min":0.316,"5min":0.315,"15min":0.315},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.374},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.47799999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.92000000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":1.1599999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.90500000000000003,"5min":1.0469999999999999,"15min":1.698},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.0820000000000001,"15min":1.4219999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.95999999999999996,"15min":1.3069999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.752,"15min":0.80100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":1.085,"15min":1.7549999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0680000000000001,"15min":1.341},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.3939999999999999},"last":0.875}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.61299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.048,"15min":1.282},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.94799999999999995,"5min":1.093,"15min":1.4530000000000001},"last":0.84799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.55800000000000005},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.64400000000000002,"15min":3.976},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":1.9079999999999999},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.59899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":3.786},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.46300000000000002,"15min":0.50700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59599999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.438}]},{"osd":3,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50700000000000001,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.60099999999999998,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.37},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.625},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89300000000000002,"5min":1.1399999999999999,"15min":1.851},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.879},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.995,"5min":1.0960000000000001,"15min":4.1859999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.504},"max":{"1min":0.877,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.01,"5min":1.056,"15min":2.0699999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.94399999999999995,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.57099999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73699999999999999,"15min":0.78500000000000003},"min":{"1min":0.60099999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":2.1890000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77500000000000002,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":0.95599999999999996,"5min":1.0649999999999999,"15min":1.9770000000000001},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1859584,"data_stored":1172549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.439,"15min":0.47899999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.252},"max":{"1min":0.59599999999999997,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66000000000000003,"5min":0.92900000000000005,"15min":1.456},"last":0.46700000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":1.0589999999999999,"15min":1.595},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47299999999999998,"15min":0.55900000000000005},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":2.464},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47199999999999998,"15min":0.51800000000000002},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63500000000000001,"5min":0.85699999999999998,"15min":1.859},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38800000000000001},"max":{"1min":0.67100000000000004,"5min":0.90000000000000002,"15min":1.903},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.0700000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.1279999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.76000000000000001},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.46700000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0720000000000001,"5min":1.278,"15min":1.5700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.53},"last":0.82299999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73099999999999998,"15min":0.78100000000000003},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0469999999999999,"5min":1.349,"15min":1.556},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.77200000000000002},"min":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:25:22.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:25:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f145a6640 1 Processor -- start 2023-12-18T10:25:22.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f145a6640 1 -- start start 2023-12-18T10:25:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f145a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c1570c0 0x7f4f0c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f145a6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f0c0ca000 0x7f4f0c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f145a6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0c9460 con 0x7f4f0c06c320 2023-12-18T10:25:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f145a6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c06c7a0 con 0x7f4f0c0ca000 2023-12-18T10:25:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f145a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c1574a0 con 0x7f4f0c1570c0 2023-12-18T10:25:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f11b41640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4f0c06c320 0x7f4f0c0c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39242/0 (socket says 172.21.15.133:39242) 2023-12-18T10:25:22.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f11b41640 1 -- 172.21.15.133:0/884921484 learned_addr learned my addr 172.21.15.133:0/884921484 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:22.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f12342640 1 --2- 172.21.15.133:0/884921484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c1570c0 0x7f4f0c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f12b43640 1 --2- 172.21.15.133:0/884921484 >> v2:172.21.15.142:3300/0 conn(0x7f4f0c0ca000 0x7f4f0c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f11340640 1 -- 172.21.15.133:0/884921484 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953243983 0 0) 0x7f4f0c0c9460 con 0x7f4f0c06c320 2023-12-18T10:25:22.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f11340640 1 -- 172.21.15.133:0/884921484 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef8003530 con 0x7f4f0c06c320 2023-12-18T10:25:22.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f12342640 1 -- 172.21.15.133:0/884921484 >> v2:172.21.15.142:3300/0 conn(0x7f4f0c0ca000 msgr2=0x7f4f0c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:22.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f12342640 1 --2- 172.21.15.133:0/884921484 >> v2:172.21.15.142:3300/0 conn(0x7f4f0c0ca000 0x7f4f0c070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f12342640 1 -- 172.21.15.133:0/884921484 >> v1:172.21.15.133:6789/0 conn(0x7f4f0c06c320 legacy=0x7f4f0c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f12342640 1 -- 172.21.15.133:0/884921484 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0c8b30 con 0x7f4f0c1570c0 2023-12-18T10:25:22.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.805+0000 7f4f12b43640 1 --2- 172.21.15.133:0/884921484 >> v2:172.21.15.142:3300/0 conn(0x7f4f0c0ca000 0x7f4f0c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f12342640 1 --2- 172.21.15.133:0/884921484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c1570c0 0x7f4f0c06bde0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f080097c0 tx=0x7f4f0801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ca8d2440c93c96 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f11340640 1 -- 172.21.15.133:0/884921484 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080ac620 con 0x7f4f0c1570c0 2023-12-18T10:25:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f11340640 1 -- 172.21.15.133:0/884921484 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f080ac780 con 0x7f4f0c1570c0 2023-12-18T10:25:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f11340640 1 -- 172.21.15.133:0/884921484 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080acb10 con 0x7f4f0c1570c0 2023-12-18T10:25:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f145a6640 1 -- 172.21.15.133:0/884921484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c1570c0 msgr2=0x7f4f0c06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f145a6640 1 --2- 172.21.15.133:0/884921484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c1570c0 0x7f4f0c06bde0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f080097c0 tx=0x7f4f0801c3c0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f145a6640 1 -- 172.21.15.133:0/884921484 shutdown_connections 2023-12-18T10:25:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f145a6640 1 --2- 172.21.15.133:0/884921484 >> v2:172.21.15.142:3300/0 conn(0x7f4f0c0ca000 0x7f4f0c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f145a6640 1 --2- 172.21.15.133:0/884921484 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c1570c0 0x7f4f0c06bde0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f145a6640 1 -- 172.21.15.133:0/884921484 >> 172.21.15.133:0/884921484 conn(0x7f4f0c06a3e0 msgr2=0x7f4f0c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f145a6640 1 -- 172.21.15.133:0/884921484 shutdown_connections 2023-12-18T10:25:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.809+0000 7f4f145a6640 1 -- 172.21.15.133:0/884921484 wait complete. 2023-12-18T10:25:22.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 Processor -- start 2023-12-18T10:25:22.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 -- start start 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c06c320 0x7f4f0c14d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c0ca000 0x7f4f0c14d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0c1570c0 0x7f4f0c0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14d670 con 0x7f4f0c1570c0 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14e290 con 0x7f4f0c0ca000 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14e570 con 0x7f4f0c06c320 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0c1570c0 0x7f4f0c0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0c1570c0 0x7f4f0c0ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57098/0 (socket says 172.21.15.133:57098) 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 -- 172.21.15.133:0/2651453061 learned_addr learned my addr 172.21.15.133:0/2651453061 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12342640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c06c320 0x7f4f0c14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f11b41640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c0ca000 0x7f4f0c14d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 -- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c06c320 msgr2=0x7f4f0c14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c06c320 0x7f4f0c14d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 -- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c0ca000 msgr2=0x7f4f0c14d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c0ca000 0x7f4f0c14d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 -- 172.21.15.133:0/2651453061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f04009a70 con 0x7f4f0c1570c0 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f11b41640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c0ca000 0x7f4f0c14d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f12b43640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0c1570c0 0x7f4f0c0ce210 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400efc0 tx=0x7f4f04009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f02ffd640 1 -- 172.21.15.133:0/2651453061 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04009d70 con 0x7f4f0c1570c0 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f02ffd640 1 -- 172.21.15.133:0/2651453061 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400f040 con 0x7f4f0c1570c0 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f02ffd640 1 -- 172.21.15.133:0/2651453061 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040039a0 con 0x7f4f0c1570c0 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f08009420 con 0x7f4f0c1570c0 2023-12-18T10:25:22.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c14eb30 con 0x7f4f0c1570c0 2023-12-18T10:25:22.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.813+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c0735b0 con 0x7f4f0c1570c0 2023-12-18T10:25:22.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.817+0000 7f4f02ffd640 1 -- 172.21.15.133:0/2651453061 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4f040144a0 con 0x7f4f0c1570c0 2023-12-18T10:25:22.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.817+0000 7f4f02ffd640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef0065a60 0x7f4ef0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:22.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.817+0000 7f4f02ffd640 1 -- 172.21.15.133:0/2651453061 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4f04083e40 con 0x7f4f0c1570c0 2023-12-18T10:25:22.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.817+0000 7f4f12342640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef0065a60 0x7f4ef0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:22.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.817+0000 7f4f12342640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef0065a60 0x7f4ef0067f20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4f080ae000 tx=0x7f4f08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.821+0000 7f4f02ffd640 1 -- 172.21.15.133:0/2651453061 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4f040516b0 con 0x7f4f0c1570c0 2023-12-18T10:25:22.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.969+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f0c0ca8a0 con 0x7f4ef0065a60 2023-12-18T10:25:22.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.977+0000 7f4f02ffd640 1 -- 172.21.15.133:0/2651453061 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278573 (secure 0 0 0) 0x7f4f080ac8f0 con 0x7f4ef0065a60 2023-12-18T10:25:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:22.981 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:25:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef0065a60 msgr2=0x7f4ef0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef0065a60 0x7f4ef0067f20 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4f080ae000 tx=0x7f4f08008040 comp rx=0 tx=0).stop 2023-12-18T10:25:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0c1570c0 msgr2=0x7f4f0c0ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0c1570c0 0x7f4f0c0ce210 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400efc0 tx=0x7f4f04009f90 comp rx=0 tx=0).stop 2023-12-18T10:25:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 shutdown_connections 2023-12-18T10:25:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4ef0065a60 0x7f4ef0067f20 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f0c1570c0 0x7f4f0c0ce210 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f0c0ca000 0x7f4f0c14d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 --2- 172.21.15.133:0/2651453061 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0c06c320 0x7f4f0c14d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 >> 172.21.15.133:0/2651453061 conn(0x7f4f0c06a3e0 msgr2=0x7f4f0c0c1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 shutdown_connections 2023-12-18T10:25:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:22.981+0000 7f4f145a6640 1 -- 172.21.15.133:0/2651453061 wait complete. 2023-12-18T10:25:22.999 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2023-12-18T10:25:21.188612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259420,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754715300,"statfs":{"total":773094113280,"available":772828467200,"internally_reserved":0,"allocated":11300864,"data_stored":5832047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.033918"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160990+0000","last_change":"2023-12-18T10:25:17.160990+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160990+0000","last_undegraded":"2023-12-18T10:25:17.160990+0000","last_fullsized":"2023-12-18T10:25:17.160990+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:33.405328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.171792+0000","last_change":"2023-12-18T10:25:17.171792+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.171792+0000","last_undegraded":"2023-12-18T10:25:17.171792+0000","last_fullsized":"2023-12-18T10:25:17.171792+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:39.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156582+0000","last_change":"2023-12-18T10:25:17.156582+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156582+0000","last_undegraded":"2023-12-18T10:25:17.156582+0000","last_fullsized":"2023-12-18T10:25:17.156582+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:59:11.931460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.168748+0000","last_change":"2023-12-18T10:25:17.168748+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.168748+0000","last_undegraded":"2023-12-18T10:25:17.168748+0000","last_fullsized":"2023-12-18T10:25:17.168748+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:57:53.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.164913+0000","last_change":"2023-12-18T10:25:17.164913+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.164913+0000","last_undegraded":"2023-12-18T10:25:17.164913+0000","last_fullsized":"2023-12-18T10:25:17.164913+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:31:19.235853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159496+0000","last_change":"2023-12-18T10:25:17.159496+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159496+0000","last_undegraded":"2023-12-18T10:25:17.159496+0000","last_fullsized":"2023-12-18T10:25:17.159496+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:23:18.806188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156536+0000","last_change":"2023-12-18T10:25:17.156536+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156536+0000","last_undegraded":"2023-12-18T10:25:17.156536+0000","last_fullsized":"2023-12-18T10:25:17.156536+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:07:06.621984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160926+0000","last_change":"2023-12-18T10:25:17.160926+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160926+0000","last_undegraded":"2023-12-18T10:25:17.160926+0000","last_fullsized":"2023-12-18T10:25:17.160926+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:00:57.260829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156654+0000","last_change":"2023-12-18T10:25:17.156654+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156654+0000","last_undegraded":"2023-12-18T10:25:17.156654+0000","last_fullsized":"2023-12-18T10:25:17.156654+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:28:06.452447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160073+0000","last_change":"2023-12-18T10:25:17.160073+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160073+0000","last_undegraded":"2023-12-18T10:25:17.160073+0000","last_fullsized":"2023-12-18T10:25:17.160073+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:42:45.681860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.165537+0000","last_change":"2023-12-18T10:25:17.165537+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.165537+0000","last_undegraded":"2023-12-18T10:25:17.165537+0000","last_fullsized":"2023-12-18T10:25:17.165537+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:30.804813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160355+0000","last_change":"2023-12-18T10:25:17.160355+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160355+0000","last_undegraded":"2023-12-18T10:25:17.160355+0000","last_fullsized":"2023-12-18T10:25:17.160355+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:20.134299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.168222+0000","last_change":"2023-12-18T10:25:17.168222+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.168222+0000","last_undegraded":"2023-12-18T10:25:17.168222+0000","last_fullsized":"2023-12-18T10:25:17.168222+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:46:16.979293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160980+0000","last_change":"2023-12-18T10:25:17.160980+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160980+0000","last_undegraded":"2023-12-18T10:25:17.160980+0000","last_fullsized":"2023-12-18T10:25:17.160980+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:55:31.907598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.170930+0000","last_change":"2023-12-18T10:25:17.170930+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.170930+0000","last_undegraded":"2023-12-18T10:25:17.170930+0000","last_fullsized":"2023-12-18T10:25:17.170930+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:37.231695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156551+0000","last_change":"2023-12-18T10:25:17.156551+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156551+0000","last_undegraded":"2023-12-18T10:25:17.156551+0000","last_fullsized":"2023-12-18T10:25:17.156551+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:52:23.176182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.161324+0000","last_change":"2023-12-18T10:25:17.161324+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.161324+0000","last_undegraded":"2023-12-18T10:25:17.161324+0000","last_fullsized":"2023-12-18T10:25:17.161324+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:21:32.694099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.164910+0000","last_change":"2023-12-18T10:25:17.164910+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.164910+0000","last_undegraded":"2023-12-18T10:25:17.164910+0000","last_fullsized":"2023-12-18T10:25:17.164910+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:10.119938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159630+0000","last_change":"2023-12-18T10:25:17.159630+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159630+0000","last_undegraded":"2023-12-18T10:25:17.159630+0000","last_fullsized":"2023-12-18T10:25:17.159630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:55:57.076492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.170927+0000","last_change":"2023-12-18T10:25:17.170927+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.170927+0000","last_undegraded":"2023-12-18T10:25:17.170927+0000","last_fullsized":"2023-12-18T10:25:17.170927+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:16.763875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.171471+0000","last_change":"2023-12-18T10:25:17.171471+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.171471+0000","last_undegraded":"2023-12-18T10:25:17.171471+0000","last_fullsized":"2023-12-18T10:25:17.171471+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:33:49.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.160569+0000","last_change":"2023-12-18T10:25:17.160569+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.160569+0000","last_undegraded":"2023-12-18T10:25:17.160569+0000","last_fullsized":"2023-12-18T10:25:17.160569+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:53:14.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.171521+0000","last_change":"2023-12-18T10:25:17.171521+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.171521+0000","last_undegraded":"2023-12-18T10:25:17.171521+0000","last_fullsized":"2023-12-18T10:25:17.171521+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:56:58.730035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.168250+0000","last_change":"2023-12-18T10:25:17.168250+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.168250+0000","last_undegraded":"2023-12-18T10:25:17.168250+0000","last_fullsized":"2023-12-18T10:25:17.168250+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:46:19.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159525+0000","last_change":"2023-12-18T10:25:17.159525+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159525+0000","last_undegraded":"2023-12-18T10:25:17.159525+0000","last_fullsized":"2023-12-18T10:25:17.159525+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:18:02.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159474+0000","last_change":"2023-12-18T10:25:17.159474+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159474+0000","last_undegraded":"2023-12-18T10:25:17.159474+0000","last_fullsized":"2023-12-18T10:25:17.159474+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:19.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.168239+0000","last_change":"2023-12-18T10:25:17.168239+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.168239+0000","last_undegraded":"2023-12-18T10:25:17.168239+0000","last_fullsized":"2023-12-18T10:25:17.168239+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:11.568787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.156547+0000","last_change":"2023-12-18T10:25:17.156547+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.156547+0000","last_undegraded":"2023-12-18T10:25:17.156547+0000","last_fullsized":"2023-12-18T10:25:17.156547+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:44:44.024501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.170922+0000","last_change":"2023-12-18T10:25:17.170922+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.170922+0000","last_undegraded":"2023-12-18T10:25:17.170922+0000","last_fullsized":"2023-12-18T10:25:17.170922+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:41:07.781582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.159545+0000","last_change":"2023-12-18T10:25:17.159545+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.159545+0000","last_undegraded":"2023-12-18T10:25:17.159545+0000","last_fullsized":"2023-12-18T10:25:17.159545+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:48.530491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.170939+0000","last_change":"2023-12-18T10:25:17.170939+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.170939+0000","last_undegraded":"2023-12-18T10:25:17.170939+0000","last_fullsized":"2023-12-18T10:25:17.170939+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:01:55.510810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-18T10:25:18.151482+0000","last_change":"2023-12-18T10:25:18.151482+0000","last_active":"2023-12-18T10:25:18.151482+0000","last_peered":"2023-12-18T10:25:18.151482+0000","last_clean":"2023-12-18T10:25:18.151482+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:18.151482+0000","last_undegraded":"2023-12-18T10:25:18.151482+0000","last_fullsized":"2023-12-18T10:25:18.151482+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2023-12-18T10:25:17.171001+0000","last_change":"2023-12-18T10:25:17.171001+0000","last_active":"2023-12-18T10:25:17.148829+0000","last_peered":"2023-12-18T10:25:17.148829+0000","last_clean":"2023-12-18T10:25:17.148829+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-18T10:25:17.171001+0000","last_undegraded":"2023-12-18T10:25:17.171001+0000","last_fullsized":"2023-12-18T10:25:17.171001+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:46:12.832194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":230,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-18T10:25:15.296428+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:25:15.296428+0000","last_peered":"2023-12-18T10:25:15.296428+0000","last_clean":"2023-12-18T10:25:15.296428+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:25:15.296428+0000","last_undegraded":"2023-12-18T10:25:15.296428+0000","last_fullsized":"2023-12-18T10:25:15.296428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1859584,"data_stored":1172549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.624},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.72199999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":1.042,"15min":1.042},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":1.081,"15min":1.081},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.67400000000000004},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":1.097,"15min":1.097},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.748}]},{"osd":4,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.91000000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70699999999999996,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88200000000000001,"5min":1.137,"15min":1.137},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":1.024,"15min":1.024},"last":0.71099999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.76900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.79600000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.018,"5min":1.018,"15min":4.3760000000000003},"last":0.623},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.83899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.49299999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.73299999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.845},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69799999999999995,"15min":0.82499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.179,"5min":1.179,"15min":4.524},"last":0.52000000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":1.121,"5min":1.121,"15min":2.2709999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.746},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.54900000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.80500000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91400000000000003,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.84499999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.0049999999999999,"15min":1.101},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.627,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67600000000000005,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.93500000000000005,"5min":0.98799999999999999,"15min":1.284},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91400000000000003,"5min":1.0880000000000001,"15min":1.129},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.74399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":1.006,"15min":1.0820000000000001},"last":0.751}]}]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.873,"15min":1.0900000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.66500000000000004,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.78600000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65500000000000003,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.85799999999999998,"5min":0.92500000000000004,"15min":3.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":0.879,"15min":0.90500000000000003},"last":0.67700000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.749},"min":{"1min":0.432,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.81000000000000005,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.77100000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":2.0699999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67800000000000005,"15min":0.79100000000000004},"min":{"1min":0.502,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.88200000000000001,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.871}]},{"osd":4,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63300000000000001,"15min":0.89400000000000002},"min":{"1min":0.48899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82899999999999996,"5min":0.88,"15min":8.9740000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68100000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92300000000000004,"5min":0.97899999999999998,"15min":1.2370000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.72999999999999998},"min":{"1min":0.46899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":2.9060000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63700000000000001,"15min":0.76000000000000001},"min":{"1min":0.55300000000000005,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.505}]},{"osd":7,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64400000000000002,"15min":0.68600000000000005},"min":{"1min":0.51300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":1.042,"15min":1.1830000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67400000000000004,"15min":0.79200000000000004},"min":{"1min":0.53600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.503,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91600000000000004,"5min":0.96799999999999997,"15min":1.0249999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.84099999999999997,"5min":0.92800000000000005,"15min":1.1739999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.131},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.54500000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89600000000000002,"5min":1.008,"15min":1.032},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.86199999999999999,"5min":0.94499999999999995,"15min":0.999},"last":0.496},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.63},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68500000000000005,"5min":0.91900000000000004,"15min":0.97399999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.86799999999999999,"15min":0.874},"last":0.61399999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.71799999999999997},"min":{"1min":0.55000000000000004,"5min":0.376,"15min":0.376},"max":{"1min":0.82299999999999995,"5min":1.0109999999999999,"15min":1.073},"last":0.65200000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":1.042},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90500000000000003,"15min":1.1479999999999999},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41699999999999998,"15min":0.42499999999999999},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58999999999999997,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45600000000000002,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.59699999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.41499999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.46400000000000002},"min":{"1min":0.312,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53800000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.66300000000000003,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.57199999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":1.036,"15min":1.254},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.64300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":0.98899999999999999,"15min":1.772},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.01},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.60999999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.167,"15min":1.181},"last":0.86599999999999999}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.171,"15min":1.171},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93700000000000006,"5min":1.0549999999999999,"15min":1.069},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72199999999999998,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.53400000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.751},"min":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90000000000000002,"5min":1.26,"15min":1.26},"last":0.82999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574941,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1253376,"data_stored":576044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.61499999999999999,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.442},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60399999999999998,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.32200000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47699999999999998,"15min":0.49099999999999999},"min":{"1min":0.316,"5min":0.315,"15min":0.315},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.374},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.47799999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.92000000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":1.1599999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.90500000000000003,"5min":1.0469999999999999,"15min":1.698},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.0820000000000001,"15min":1.4219999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.95999999999999996,"15min":1.3069999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.752,"15min":0.80100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":1.085,"15min":1.7549999999999999},"last":0.86099999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0680000000000001,"15min":1.341},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.3939999999999999},"last":0.875}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.61299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.048,"15min":1.282},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.94799999999999995,"5min":1.093,"15min":1.4530000000000001},"last":0.84799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1265664,"data_stored":582181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.55800000000000005},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.64400000000000002,"15min":3.976},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":1.9079999999999999},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.59899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":3.786},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.46300000000000002,"15min":0.50700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59599999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.438}]},{"osd":3,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50700000000000001,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.60099999999999998,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.37},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.625},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89300000000000002,"5min":1.1399999999999999,"15min":1.851},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.879},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.995,"5min":1.0960000000000001,"15min":4.1859999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.504},"max":{"1min":0.877,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.01,"5min":1.056,"15min":2.0699999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.94399999999999995,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.57099999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73699999999999999,"15min":0.78500000000000003},"min":{"1min":0.60099999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":2.1890000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77500000000000002,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":0.95599999999999996,"5min":1.0649999999999999,"15min":1.9770000000000001},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1859584,"data_stored":1172549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.439,"15min":0.47899999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.252},"max":{"1min":0.59599999999999997,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66000000000000003,"5min":0.92900000000000005,"15min":1.456},"last":0.46700000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":1.0589999999999999,"15min":1.595},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47299999999999998,"15min":0.55900000000000005},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":2.464},"last":0.51700000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47199999999999998,"15min":0.51800000000000002},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63500000000000001,"5min":0.85699999999999998,"15min":1.859},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38800000000000001},"max":{"1min":0.67100000000000004,"5min":0.90000000000000002,"15min":1.903},"last":0.53100000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.0700000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.1279999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.76000000000000001},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.46700000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.79800000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0720000000000001,"5min":1.278,"15min":1.5700000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.53},"last":0.82299999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73099999999999998,"15min":0.78100000000000003},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0469999999999999,"5min":1.349,"15min":1.556},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.77200000000000002},"min":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:25:23.004 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:25:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a92ff3640 1 Processor -- start 2023-12-18T10:25:23.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a92ff3640 1 -- start start 2023-12-18T10:25:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a92ff3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a8c15ca40 0x7f8a8c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a92ff3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a92ff3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8c0cfa70 con 0x7f8a8c0cf610 2023-12-18T10:25:23.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a92ff3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8c0d11c0 con 0x7f8a8c15ca40 2023-12-18T10:25:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a92ff3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0d0310 con 0x7f8a8c0ce3f0 2023-12-18T10:25:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a8bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a90d8f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a8c15ca40 0x7f8a8c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a8bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:40564/0 (socket says 172.21.15.133:40564) 2023-12-18T10:25:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a8bfff640 1 -- 172.21.15.133:0/2045151692 learned_addr learned my addr 172.21.15.133:0/2045151692 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a8bfff640 1 -- 172.21.15.133:0/2045151692 >> v2:172.21.15.142:3300/0 conn(0x7f8a8c15ca40 msgr2=0x7f8a8c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a8bfff640 1 --2- 172.21.15.133:0/2045151692 >> v2:172.21.15.142:3300/0 conn(0x7f8a8c15ca40 0x7f8a8c0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a8bfff640 1 -- 172.21.15.133:0/2045151692 >> v1:172.21.15.142:6789/0 conn(0x7f8a8c0cf610 legacy=0x7f8a8c1605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.185+0000 7f8a8bfff640 1 -- 172.21.15.133:0/2045151692 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c0d05b0 con 0x7f8a8c0ce3f0 2023-12-18T10:25:23.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a8bfff640 1 --2- 172.21.15.133:0/2045151692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0cf0d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8a78006fd0 tx=0x7f8a7801c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ee861aed92b3821 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a8b7fe640 1 -- 172.21.15.133:0/2045151692 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a780ab640 con 0x7f8a8c0ce3f0 2023-12-18T10:25:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a8b7fe640 1 -- 172.21.15.133:0/2045151692 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a780a7070 con 0x7f8a8c0ce3f0 2023-12-18T10:25:23.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a8b7fe640 1 -- 172.21.15.133:0/2045151692 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a780ab9c0 con 0x7f8a8c0ce3f0 2023-12-18T10:25:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a92ff3640 1 -- 172.21.15.133:0/2045151692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 msgr2=0x7f8a8c0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/2045151692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0cf0d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8a78006fd0 tx=0x7f8a7801c520 comp rx=0 tx=0).stop 2023-12-18T10:25:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a92ff3640 1 -- 172.21.15.133:0/2045151692 shutdown_connections 2023-12-18T10:25:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/2045151692 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0cf0d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/2045151692 >> v2:172.21.15.142:3300/0 conn(0x7f8a8c15ca40 0x7f8a8c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a92ff3640 1 -- 172.21.15.133:0/2045151692 >> 172.21.15.133:0/2045151692 conn(0x7f8a8c089fb0 msgr2=0x7f8a8c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a92ff3640 1 -- 172.21.15.133:0/2045151692 shutdown_connections 2023-12-18T10:25:23.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.189+0000 7f8a92ff3640 1 -- 172.21.15.133:0/2045151692 wait complete. 2023-12-18T10:25:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 Processor -- start 2023-12-18T10:25:23.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 -- start start 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a8c0cf610 0x7f8a8c152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a8c15ca40 0x7f8a8c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0c90f0 con 0x7f8a8c15ca40 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c15f070 con 0x7f8a8c0cf610 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c153380 con 0x7f8a8c0ce3f0 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a8c15ca40 0x7f8a8c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a8c15ca40 0x7f8a8c15ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57100/0 (socket says 172.21.15.133:57100) 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 -- 172.21.15.133:0/3565180885 learned_addr learned my addr 172.21.15.133:0/3565180885 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a90d8f640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a8bfff640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a8c0cf610 0x7f8a8c152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 -- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 msgr2=0x7f8a8c0c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 -- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a8c0cf610 msgr2=0x7f8a8c152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a8c0cf610 0x7f8a8c152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 -- 172.21.15.133:0/3565180885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a78009480 con 0x7f8a8c15ca40 2023-12-18T10:25:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a90d8f640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a8bfff640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a8c0cf610 0x7f8a8c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a91590640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a8c15ca40 0x7f8a8c15ad30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400c730 tx=0x7f8a8400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a897fa640 1 -- 172.21.15.133:0/3565180885 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84003b80 con 0x7f8a8c15ca40 2023-12-18T10:25:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a897fa640 1 -- 172.21.15.133:0/3565180885 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a84003ce0 con 0x7f8a8c15ca40 2023-12-18T10:25:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c0c8870 con 0x7f8a8c15ca40 2023-12-18T10:25:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a897fa640 1 -- 172.21.15.133:0/3565180885 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84005310 con 0x7f8a8c15ca40 2023-12-18T10:25:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.193+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c15ea20 con 0x7f8a8c15ca40 2023-12-18T10:25:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.197+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8c15f1e0 con 0x7f8a8c15ca40 2023-12-18T10:25:23.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.197+0000 7f8a897fa640 1 -- 172.21.15.133:0/3565180885 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8a84005680 con 0x7f8a8c15ca40 2023-12-18T10:25:23.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.197+0000 7f8a897fa640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a70065a60 0x7f8a70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.197+0000 7f8a897fa640 1 -- 172.21.15.133:0/3565180885 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8a840832a0 con 0x7f8a8c15ca40 2023-12-18T10:25:23.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.197+0000 7f8a90d8f640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a70065a60 0x7f8a70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.197+0000 7f8a90d8f640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a70065a60 0x7f8a70067f20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009af0 tx=0x7f8a80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.205+0000 7f8a897fa640 1 -- 172.21.15.133:0/3565180885 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8a84050b30 con 0x7f8a8c15ca40 2023-12-18T10:25:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.353+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a8c0d0e50 con 0x7f8a70065a60 2023-12-18T10:25:23.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.361+0000 7f8a897fa640 1 -- 172.21.15.133:0/3565180885 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289544 (secure 0 0 0) 0x7f8a80004030 con 0x7f8a70065a60 2023-12-18T10:25:23.363 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:23.365 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a70065a60 msgr2=0x7f8a70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a70065a60 0x7f8a70067f20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009af0 tx=0x7f8a80008040 comp rx=0 tx=0).stop 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a8c15ca40 msgr2=0x7f8a8c15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a8c15ca40 0x7f8a8c15ad30 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400c730 tx=0x7f8a8400cbf0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 shutdown_connections 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f8a70065a60 0x7f8a70067f20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a8c15ca40 0x7f8a8c15ad30 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a8c0cf610 0x7f8a8c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 --2- 172.21.15.133:0/3565180885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8a8c0ce3f0 0x7f8a8c0c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 >> 172.21.15.133:0/3565180885 conn(0x7f8a8c089fb0 msgr2=0x7f8a8c0b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:23.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 shutdown_connections 2023-12-18T10:25:23.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.365+0000 7f8a92ff3640 1 -- 172.21.15.133:0/3565180885 wait complete. 2023-12-18T10:25:23.384 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2023-12-18T10:25:23.188936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259784,"kb_used_data":11400,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714936,"statfs":{"total":773094113280,"available":772828094464,"internally_reserved":0,"allocated":11673600,"data_stored":6005388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001144"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566155+0000","last_change":"2023-12-18T10:25:18.587171+0000","last_active":"2023-12-18T10:25:19.566155+0000","last_peered":"2023-12-18T10:25:19.566155+0000","last_clean":"2023-12-18T10:25:19.566155+0000","last_became_active":"2023-12-18T10:25:18.586887+0000","last_became_peered":"2023-12-18T10:25:18.586887+0000","last_unstale":"2023-12-18T10:25:19.566155+0000","last_undegraded":"2023-12-18T10:25:19.566155+0000","last_fullsized":"2023-12-18T10:25:19.566155+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:57:33.454865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364550+0000","last_change":"2023-12-18T10:25:18.592190+0000","last_active":"2023-12-18T10:25:20.364550+0000","last_peered":"2023-12-18T10:25:20.364550+0000","last_clean":"2023-12-18T10:25:20.364550+0000","last_became_active":"2023-12-18T10:25:18.590883+0000","last_became_peered":"2023-12-18T10:25:18.590883+0000","last_unstale":"2023-12-18T10:25:20.364550+0000","last_undegraded":"2023-12-18T10:25:20.364550+0000","last_fullsized":"2023-12-18T10:25:20.364550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:57:54.199621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565815+0000","last_change":"2023-12-18T10:25:18.590238+0000","last_active":"2023-12-18T10:25:19.565815+0000","last_peered":"2023-12-18T10:25:19.565815+0000","last_clean":"2023-12-18T10:25:19.565815+0000","last_became_active":"2023-12-18T10:25:18.589982+0000","last_became_peered":"2023-12-18T10:25:18.589982+0000","last_unstale":"2023-12-18T10:25:19.565815+0000","last_undegraded":"2023-12-18T10:25:19.565815+0000","last_fullsized":"2023-12-18T10:25:19.565815+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:33:23.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567044+0000","last_change":"2023-12-18T10:25:18.587238+0000","last_active":"2023-12-18T10:25:19.567044+0000","last_peered":"2023-12-18T10:25:19.567044+0000","last_clean":"2023-12-18T10:25:19.567044+0000","last_became_active":"2023-12-18T10:25:18.586080+0000","last_became_peered":"2023-12-18T10:25:18.586080+0000","last_unstale":"2023-12-18T10:25:19.567044+0000","last_undegraded":"2023-12-18T10:25:19.567044+0000","last_fullsized":"2023-12-18T10:25:19.567044+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:31:22.298032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295899+0000","last_change":"2023-12-18T10:25:18.581846+0000","last_active":"2023-12-18T10:25:20.295899+0000","last_peered":"2023-12-18T10:25:20.295899+0000","last_clean":"2023-12-18T10:25:20.295899+0000","last_became_active":"2023-12-18T10:25:18.580344+0000","last_became_peered":"2023-12-18T10:25:18.580344+0000","last_unstale":"2023-12-18T10:25:20.295899+0000","last_undegraded":"2023-12-18T10:25:20.295899+0000","last_fullsized":"2023-12-18T10:25:20.295899+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:29:42.504233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363336+0000","last_change":"2023-12-18T10:25:18.589801+0000","last_active":"2023-12-18T10:25:20.363336+0000","last_peered":"2023-12-18T10:25:20.363336+0000","last_clean":"2023-12-18T10:25:20.363336+0000","last_became_active":"2023-12-18T10:25:18.589453+0000","last_became_peered":"2023-12-18T10:25:18.589453+0000","last_unstale":"2023-12-18T10:25:20.363336+0000","last_undegraded":"2023-12-18T10:25:20.363336+0000","last_fullsized":"2023-12-18T10:25:20.363336+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:46:17.981946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362921+0000","last_change":"2023-12-18T10:25:18.595252+0000","last_active":"2023-12-18T10:25:20.362921+0000","last_peered":"2023-12-18T10:25:20.362921+0000","last_clean":"2023-12-18T10:25:20.362921+0000","last_became_active":"2023-12-18T10:25:18.594676+0000","last_became_peered":"2023-12-18T10:25:18.594676+0000","last_unstale":"2023-12-18T10:25:20.362921+0000","last_undegraded":"2023-12-18T10:25:20.362921+0000","last_fullsized":"2023-12-18T10:25:20.362921+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:20:17.969046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318484+0000","last_change":"2023-12-18T10:25:18.581711+0000","last_active":"2023-12-18T10:25:20.318484+0000","last_peered":"2023-12-18T10:25:20.318484+0000","last_clean":"2023-12-18T10:25:20.318484+0000","last_became_active":"2023-12-18T10:25:18.581486+0000","last_became_peered":"2023-12-18T10:25:18.581486+0000","last_unstale":"2023-12-18T10:25:20.318484+0000","last_undegraded":"2023-12-18T10:25:20.318484+0000","last_fullsized":"2023-12-18T10:25:20.318484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:16:48.894333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363685+0000","last_change":"2023-12-18T10:25:18.593458+0000","last_active":"2023-12-18T10:25:20.363685+0000","last_peered":"2023-12-18T10:25:20.363685+0000","last_clean":"2023-12-18T10:25:20.363685+0000","last_became_active":"2023-12-18T10:25:18.593185+0000","last_became_peered":"2023-12-18T10:25:18.593185+0000","last_unstale":"2023-12-18T10:25:20.363685+0000","last_undegraded":"2023-12-18T10:25:20.363685+0000","last_fullsized":"2023-12-18T10:25:20.363685+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:26.594432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.296106+0000","last_change":"2023-12-18T10:25:18.591047+0000","last_active":"2023-12-18T10:25:20.296106+0000","last_peered":"2023-12-18T10:25:20.296106+0000","last_clean":"2023-12-18T10:25:20.296106+0000","last_became_active":"2023-12-18T10:25:18.590725+0000","last_became_peered":"2023-12-18T10:25:18.590725+0000","last_unstale":"2023-12-18T10:25:20.296106+0000","last_undegraded":"2023-12-18T10:25:20.296106+0000","last_fullsized":"2023-12-18T10:25:20.296106+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:34.407981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364646+0000","last_change":"2023-12-18T10:25:18.591234+0000","last_active":"2023-12-18T10:25:20.364646+0000","last_peered":"2023-12-18T10:25:20.364646+0000","last_clean":"2023-12-18T10:25:20.364646+0000","last_became_active":"2023-12-18T10:25:18.590849+0000","last_became_peered":"2023-12-18T10:25:18.590849+0000","last_unstale":"2023-12-18T10:25:20.364646+0000","last_undegraded":"2023-12-18T10:25:20.364646+0000","last_fullsized":"2023-12-18T10:25:20.364646+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:53:12.765081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364527+0000","last_change":"2023-12-18T10:25:18.589913+0000","last_active":"2023-12-18T10:25:20.364527+0000","last_peered":"2023-12-18T10:25:20.364527+0000","last_clean":"2023-12-18T10:25:20.364527+0000","last_became_active":"2023-12-18T10:25:18.588523+0000","last_became_peered":"2023-12-18T10:25:18.588523+0000","last_unstale":"2023-12-18T10:25:20.364527+0000","last_undegraded":"2023-12-18T10:25:20.364527+0000","last_fullsized":"2023-12-18T10:25:20.364527+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:35:44.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566909+0000","last_change":"2023-12-18T10:25:18.597402+0000","last_active":"2023-12-18T10:25:19.566909+0000","last_peered":"2023-12-18T10:25:19.566909+0000","last_clean":"2023-12-18T10:25:19.566909+0000","last_became_active":"2023-12-18T10:25:18.597103+0000","last_became_peered":"2023-12-18T10:25:18.597103+0000","last_unstale":"2023-12-18T10:25:19.566909+0000","last_undegraded":"2023-12-18T10:25:19.566909+0000","last_fullsized":"2023-12-18T10:25:19.566909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:13.204679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362763+0000","last_change":"2023-12-18T10:25:18.588540+0000","last_active":"2023-12-18T10:25:20.362763+0000","last_peered":"2023-12-18T10:25:20.362763+0000","last_clean":"2023-12-18T10:25:20.362763+0000","last_became_active":"2023-12-18T10:25:18.588196+0000","last_became_peered":"2023-12-18T10:25:18.588196+0000","last_unstale":"2023-12-18T10:25:20.362763+0000","last_undegraded":"2023-12-18T10:25:20.362763+0000","last_fullsized":"2023-12-18T10:25:20.362763+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:37.244002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362708+0000","last_change":"2023-12-18T10:25:18.593448+0000","last_active":"2023-12-18T10:25:20.362708+0000","last_peered":"2023-12-18T10:25:20.362708+0000","last_clean":"2023-12-18T10:25:20.362708+0000","last_became_active":"2023-12-18T10:25:18.593193+0000","last_became_peered":"2023-12-18T10:25:18.593193+0000","last_unstale":"2023-12-18T10:25:20.362708+0000","last_undegraded":"2023-12-18T10:25:20.362708+0000","last_fullsized":"2023-12-18T10:25:20.362708+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:31.384969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362657+0000","last_change":"2023-12-18T10:25:18.581001+0000","last_active":"2023-12-18T10:25:20.362657+0000","last_peered":"2023-12-18T10:25:20.362657+0000","last_clean":"2023-12-18T10:25:20.362657+0000","last_became_active":"2023-12-18T10:25:18.580702+0000","last_became_peered":"2023-12-18T10:25:18.580702+0000","last_unstale":"2023-12-18T10:25:20.362657+0000","last_undegraded":"2023-12-18T10:25:20.362657+0000","last_fullsized":"2023-12-18T10:25:20.362657+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:05.000600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566226+0000","last_change":"2023-12-18T10:25:18.590525+0000","last_active":"2023-12-18T10:25:19.566226+0000","last_peered":"2023-12-18T10:25:19.566226+0000","last_clean":"2023-12-18T10:25:19.566226+0000","last_became_active":"2023-12-18T10:25:18.590233+0000","last_became_peered":"2023-12-18T10:25:18.590233+0000","last_unstale":"2023-12-18T10:25:19.566226+0000","last_undegraded":"2023-12-18T10:25:19.566226+0000","last_fullsized":"2023-12-18T10:25:19.566226+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:27:19.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364645+0000","last_change":"2023-12-18T10:25:18.592167+0000","last_active":"2023-12-18T10:25:20.364645+0000","last_peered":"2023-12-18T10:25:20.364645+0000","last_clean":"2023-12-18T10:25:20.364645+0000","last_became_active":"2023-12-18T10:25:18.590630+0000","last_became_peered":"2023-12-18T10:25:18.590630+0000","last_unstale":"2023-12-18T10:25:20.364645+0000","last_undegraded":"2023-12-18T10:25:20.364645+0000","last_fullsized":"2023-12-18T10:25:20.364645+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:10:50.244543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566113+0000","last_change":"2023-12-18T10:25:18.589522+0000","last_active":"2023-12-18T10:25:19.566113+0000","last_peered":"2023-12-18T10:25:19.566113+0000","last_clean":"2023-12-18T10:25:19.566113+0000","last_became_active":"2023-12-18T10:25:18.589182+0000","last_became_peered":"2023-12-18T10:25:18.589182+0000","last_unstale":"2023-12-18T10:25:19.566113+0000","last_undegraded":"2023-12-18T10:25:19.566113+0000","last_fullsized":"2023-12-18T10:25:19.566113+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:54:22.565170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364587+0000","last_change":"2023-12-18T10:25:18.579506+0000","last_active":"2023-12-18T10:25:20.364587+0000","last_peered":"2023-12-18T10:25:20.364587+0000","last_clean":"2023-12-18T10:25:20.364587+0000","last_became_active":"2023-12-18T10:25:18.579205+0000","last_became_peered":"2023-12-18T10:25:18.579205+0000","last_unstale":"2023-12-18T10:25:20.364587+0000","last_undegraded":"2023-12-18T10:25:20.364587+0000","last_fullsized":"2023-12-18T10:25:20.364587+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:02:28.250518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318703+0000","last_change":"2023-12-18T10:25:18.593293+0000","last_active":"2023-12-18T10:25:20.318703+0000","last_peered":"2023-12-18T10:25:20.318703+0000","last_clean":"2023-12-18T10:25:20.318703+0000","last_became_active":"2023-12-18T10:25:18.592828+0000","last_became_peered":"2023-12-18T10:25:18.592828+0000","last_unstale":"2023-12-18T10:25:20.318703+0000","last_undegraded":"2023-12-18T10:25:20.318703+0000","last_fullsized":"2023-12-18T10:25:20.318703+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:37:47.715800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295900+0000","last_change":"2023-12-18T10:25:18.589496+0000","last_active":"2023-12-18T10:25:20.295900+0000","last_peered":"2023-12-18T10:25:20.295900+0000","last_clean":"2023-12-18T10:25:20.295900+0000","last_became_active":"2023-12-18T10:25:18.589150+0000","last_became_peered":"2023-12-18T10:25:18.589150+0000","last_unstale":"2023-12-18T10:25:20.295900+0000","last_undegraded":"2023-12-18T10:25:20.295900+0000","last_fullsized":"2023-12-18T10:25:20.295900+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:31.807466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565765+0000","last_change":"2023-12-18T10:25:18.588168+0000","last_active":"2023-12-18T10:25:19.565765+0000","last_peered":"2023-12-18T10:25:19.565765+0000","last_clean":"2023-12-18T10:25:19.565765+0000","last_became_active":"2023-12-18T10:25:18.587806+0000","last_became_peered":"2023-12-18T10:25:18.587806+0000","last_unstale":"2023-12-18T10:25:19.565765+0000","last_undegraded":"2023-12-18T10:25:19.565765+0000","last_fullsized":"2023-12-18T10:25:19.565765+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:56:14.720373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295706+0000","last_change":"2023-12-18T10:25:18.582900+0000","last_active":"2023-12-18T10:25:20.295706+0000","last_peered":"2023-12-18T10:25:20.295706+0000","last_clean":"2023-12-18T10:25:20.295706+0000","last_became_active":"2023-12-18T10:25:18.582639+0000","last_became_peered":"2023-12-18T10:25:18.582639+0000","last_unstale":"2023-12-18T10:25:20.295706+0000","last_undegraded":"2023-12-18T10:25:20.295706+0000","last_fullsized":"2023-12-18T10:25:20.295706+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:55:32.910251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364836+0000","last_change":"2023-12-18T10:25:18.598415+0000","last_active":"2023-12-18T10:25:20.364836+0000","last_peered":"2023-12-18T10:25:20.364836+0000","last_clean":"2023-12-18T10:25:20.364836+0000","last_became_active":"2023-12-18T10:25:18.598122+0000","last_became_peered":"2023-12-18T10:25:18.598122+0000","last_unstale":"2023-12-18T10:25:20.364836+0000","last_undegraded":"2023-12-18T10:25:20.364836+0000","last_fullsized":"2023-12-18T10:25:20.364836+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:39:01.393143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.365141+0000","last_change":"2023-12-18T10:25:18.594542+0000","last_active":"2023-12-18T10:25:20.365141+0000","last_peered":"2023-12-18T10:25:20.365141+0000","last_clean":"2023-12-18T10:25:20.365141+0000","last_became_active":"2023-12-18T10:25:18.594270+0000","last_became_peered":"2023-12-18T10:25:18.594270+0000","last_unstale":"2023-12-18T10:25:20.365141+0000","last_undegraded":"2023-12-18T10:25:20.365141+0000","last_fullsized":"2023-12-18T10:25:20.365141+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:10:43.536993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364755+0000","last_change":"2023-12-18T10:25:18.589423+0000","last_active":"2023-12-18T10:25:20.364755+0000","last_peered":"2023-12-18T10:25:20.364755+0000","last_clean":"2023-12-18T10:25:20.364755+0000","last_became_active":"2023-12-18T10:25:18.589140+0000","last_became_peered":"2023-12-18T10:25:18.589140+0000","last_unstale":"2023-12-18T10:25:20.364755+0000","last_undegraded":"2023-12-18T10:25:20.364755+0000","last_fullsized":"2023-12-18T10:25:20.364755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:05.000600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363280+0000","last_change":"2023-12-18T10:25:18.597867+0000","last_active":"2023-12-18T10:25:20.363280+0000","last_peered":"2023-12-18T10:25:20.363280+0000","last_clean":"2023-12-18T10:25:20.363280+0000","last_became_active":"2023-12-18T10:25:18.597495+0000","last_became_peered":"2023-12-18T10:25:18.597495+0000","last_unstale":"2023-12-18T10:25:20.363280+0000","last_undegraded":"2023-12-18T10:25:20.363280+0000","last_fullsized":"2023-12-18T10:25:20.363280+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:23:19.808841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318699+0000","last_change":"2023-12-18T10:25:18.580831+0000","last_active":"2023-12-18T10:25:20.318699+0000","last_peered":"2023-12-18T10:25:20.318699+0000","last_clean":"2023-12-18T10:25:20.318699+0000","last_became_active":"2023-12-18T10:25:18.578964+0000","last_became_peered":"2023-12-18T10:25:18.578964+0000","last_unstale":"2023-12-18T10:25:20.318699+0000","last_undegraded":"2023-12-18T10:25:20.318699+0000","last_fullsized":"2023-12-18T10:25:20.318699+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:37:55.089493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363847+0000","last_change":"2023-12-18T10:25:18.594215+0000","last_active":"2023-12-18T10:25:20.363847+0000","last_peered":"2023-12-18T10:25:20.363847+0000","last_clean":"2023-12-18T10:25:20.363847+0000","last_became_active":"2023-12-18T10:25:18.593863+0000","last_became_peered":"2023-12-18T10:25:18.593863+0000","last_unstale":"2023-12-18T10:25:20.363847+0000","last_undegraded":"2023-12-18T10:25:20.363847+0000","last_fullsized":"2023-12-18T10:25:20.363847+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:03:21.281143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363027+0000","last_change":"2023-12-18T10:25:18.595424+0000","last_active":"2023-12-18T10:25:20.363027+0000","last_peered":"2023-12-18T10:25:20.363027+0000","last_clean":"2023-12-18T10:25:20.363027+0000","last_became_active":"2023-12-18T10:25:18.594984+0000","last_became_peered":"2023-12-18T10:25:18.594984+0000","last_unstale":"2023-12-18T10:25:20.363027+0000","last_undegraded":"2023-12-18T10:25:20.363027+0000","last_fullsized":"2023-12-18T10:25:20.363027+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:12.571440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318598+0000","last_change":"2023-12-18T10:25:18.574996+0000","last_active":"2023-12-18T10:25:20.318598+0000","last_peered":"2023-12-18T10:25:20.318598+0000","last_clean":"2023-12-18T10:25:20.318598+0000","last_became_active":"2023-12-18T10:25:18.574742+0000","last_became_peered":"2023-12-18T10:25:18.574742+0000","last_unstale":"2023-12-18T10:25:20.318598+0000","last_undegraded":"2023-12-18T10:25:20.318598+0000","last_fullsized":"2023-12-18T10:25:20.318598+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:00:58.261581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565851+0000","last_change":"2023-12-18T10:25:18.587846+0000","last_active":"2023-12-18T10:25:19.565851+0000","last_peered":"2023-12-18T10:25:19.565851+0000","last_clean":"2023-12-18T10:25:19.565851+0000","last_became_active":"2023-12-18T10:25:18.587584+0000","last_became_peered":"2023-12-18T10:25:18.587584+0000","last_unstale":"2023-12-18T10:25:19.565851+0000","last_undegraded":"2023-12-18T10:25:19.565851+0000","last_fullsized":"2023-12-18T10:25:19.565851+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:56:02.496356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"104'4","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.596375+0000","last_change":"2023-12-18T10:25:18.179560+0000","last_active":"2023-12-18T10:25:18.596375+0000","last_peered":"2023-12-18T10:25:18.596375+0000","last_clean":"2023-12-18T10:25:18.596375+0000","last_became_active":"2023-12-18T10:25:18.179222+0000","last_became_peered":"2023-12-18T10:25:18.179222+0000","last_unstale":"2023-12-18T10:25:18.596375+0000","last_undegraded":"2023-12-18T10:25:18.596375+0000","last_fullsized":"2023-12-18T10:25:18.596375+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:33.405328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318525+0000","last_change":"2023-12-18T10:25:18.571453+0000","last_active":"2023-12-18T10:25:20.318525+0000","last_peered":"2023-12-18T10:25:20.318525+0000","last_clean":"2023-12-18T10:25:20.318525+0000","last_became_active":"2023-12-18T10:25:18.571149+0000","last_became_peered":"2023-12-18T10:25:18.571149+0000","last_unstale":"2023-12-18T10:25:20.318525+0000","last_undegraded":"2023-12-18T10:25:20.318525+0000","last_fullsized":"2023-12-18T10:25:20.318525+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:45:58.484999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.573632+0000","last_change":"2023-12-18T10:25:18.185482+0000","last_active":"2023-12-18T10:25:18.573632+0000","last_peered":"2023-12-18T10:25:18.573632+0000","last_clean":"2023-12-18T10:25:18.573632+0000","last_became_active":"2023-12-18T10:25:18.184386+0000","last_became_peered":"2023-12-18T10:25:18.184386+0000","last_unstale":"2023-12-18T10:25:18.573632+0000","last_undegraded":"2023-12-18T10:25:18.573632+0000","last_fullsized":"2023-12-18T10:25:18.573632+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:39.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363942+0000","last_change":"2023-12-18T10:25:18.583966+0000","last_active":"2023-12-18T10:25:20.363942+0000","last_peered":"2023-12-18T10:25:20.363942+0000","last_clean":"2023-12-18T10:25:20.363942+0000","last_became_active":"2023-12-18T10:25:18.583436+0000","last_became_peered":"2023-12-18T10:25:18.583436+0000","last_unstale":"2023-12-18T10:25:20.363942+0000","last_undegraded":"2023-12-18T10:25:20.363942+0000","last_fullsized":"2023-12-18T10:25:20.363942+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:56.928413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.588634+0000","last_change":"2023-12-18T10:25:18.177306+0000","last_active":"2023-12-18T10:25:18.588634+0000","last_peered":"2023-12-18T10:25:18.588634+0000","last_clean":"2023-12-18T10:25:18.588634+0000","last_became_active":"2023-12-18T10:25:18.177039+0000","last_became_peered":"2023-12-18T10:25:18.177039+0000","last_unstale":"2023-12-18T10:25:18.588634+0000","last_undegraded":"2023-12-18T10:25:18.588634+0000","last_fullsized":"2023-12-18T10:25:18.588634+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:59:11.931460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364484+0000","last_change":"2023-12-18T10:25:18.590717+0000","last_active":"2023-12-18T10:25:20.364484+0000","last_peered":"2023-12-18T10:25:20.364484+0000","last_clean":"2023-12-18T10:25:20.364484+0000","last_became_active":"2023-12-18T10:25:18.590120+0000","last_became_peered":"2023-12-18T10:25:18.590120+0000","last_unstale":"2023-12-18T10:25:20.364484+0000","last_undegraded":"2023-12-18T10:25:20.364484+0000","last_fullsized":"2023-12-18T10:25:20.364484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:00:58.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.585225+0000","last_change":"2023-12-18T10:25:18.171420+0000","last_active":"2023-12-18T10:25:18.585225+0000","last_peered":"2023-12-18T10:25:18.585225+0000","last_clean":"2023-12-18T10:25:18.585225+0000","last_became_active":"2023-12-18T10:25:18.171134+0000","last_became_peered":"2023-12-18T10:25:18.171134+0000","last_unstale":"2023-12-18T10:25:18.585225+0000","last_undegraded":"2023-12-18T10:25:18.585225+0000","last_fullsized":"2023-12-18T10:25:18.585225+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:57:53.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567095+0000","last_change":"2023-12-18T10:25:18.585845+0000","last_active":"2023-12-18T10:25:19.567095+0000","last_peered":"2023-12-18T10:25:19.567095+0000","last_clean":"2023-12-18T10:25:19.567095+0000","last_became_active":"2023-12-18T10:25:18.584027+0000","last_became_peered":"2023-12-18T10:25:18.584027+0000","last_unstale":"2023-12-18T10:25:19.567095+0000","last_undegraded":"2023-12-18T10:25:19.567095+0000","last_fullsized":"2023-12-18T10:25:19.567095+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:26:36.885974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.591539+0000","last_change":"2023-12-18T10:25:18.184300+0000","last_active":"2023-12-18T10:25:18.591539+0000","last_peered":"2023-12-18T10:25:18.591539+0000","last_clean":"2023-12-18T10:25:18.591539+0000","last_became_active":"2023-12-18T10:25:18.183998+0000","last_became_peered":"2023-12-18T10:25:18.183998+0000","last_unstale":"2023-12-18T10:25:18.591539+0000","last_undegraded":"2023-12-18T10:25:18.591539+0000","last_fullsized":"2023-12-18T10:25:18.591539+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:31:19.235853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566203+0000","last_change":"2023-12-18T10:25:18.590578+0000","last_active":"2023-12-18T10:25:19.566203+0000","last_peered":"2023-12-18T10:25:19.566203+0000","last_clean":"2023-12-18T10:25:19.566203+0000","last_became_active":"2023-12-18T10:25:18.590316+0000","last_became_peered":"2023-12-18T10:25:18.590316+0000","last_unstale":"2023-12-18T10:25:19.566203+0000","last_undegraded":"2023-12-18T10:25:19.566203+0000","last_fullsized":"2023-12-18T10:25:19.566203+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:56.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.594022+0000","last_change":"2023-12-18T10:25:18.175249+0000","last_active":"2023-12-18T10:25:18.594022+0000","last_peered":"2023-12-18T10:25:18.594022+0000","last_clean":"2023-12-18T10:25:18.594022+0000","last_became_active":"2023-12-18T10:25:18.174954+0000","last_became_peered":"2023-12-18T10:25:18.174954+0000","last_unstale":"2023-12-18T10:25:18.594022+0000","last_undegraded":"2023-12-18T10:25:18.594022+0000","last_fullsized":"2023-12-18T10:25:18.594022+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:23:18.806188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364742+0000","last_change":"2023-12-18T10:25:18.600213+0000","last_active":"2023-12-18T10:25:20.364742+0000","last_peered":"2023-12-18T10:25:20.364742+0000","last_clean":"2023-12-18T10:25:20.364742+0000","last_became_active":"2023-12-18T10:25:18.598593+0000","last_became_peered":"2023-12-18T10:25:18.598593+0000","last_unstale":"2023-12-18T10:25:20.364742+0000","last_undegraded":"2023-12-18T10:25:20.364742+0000","last_fullsized":"2023-12-18T10:25:20.364742+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:18:11.312358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569221+0000","last_change":"2023-12-18T10:25:18.176746+0000","last_active":"2023-12-18T10:25:18.569221+0000","last_peered":"2023-12-18T10:25:18.569221+0000","last_clean":"2023-12-18T10:25:18.569221+0000","last_became_active":"2023-12-18T10:25:18.176486+0000","last_became_peered":"2023-12-18T10:25:18.176486+0000","last_unstale":"2023-12-18T10:25:18.569221+0000","last_undegraded":"2023-12-18T10:25:18.569221+0000","last_fullsized":"2023-12-18T10:25:18.569221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:07:06.621984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567221+0000","last_change":"2023-12-18T10:25:18.587747+0000","last_active":"2023-12-18T10:25:19.567221+0000","last_peered":"2023-12-18T10:25:19.567221+0000","last_clean":"2023-12-18T10:25:19.567221+0000","last_became_active":"2023-12-18T10:25:18.587487+0000","last_became_peered":"2023-12-18T10:25:18.587487+0000","last_unstale":"2023-12-18T10:25:19.567221+0000","last_undegraded":"2023-12-18T10:25:19.567221+0000","last_fullsized":"2023-12-18T10:25:19.567221+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:58:14.653117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.571712+0000","last_change":"2023-12-18T10:25:18.179725+0000","last_active":"2023-12-18T10:25:18.571712+0000","last_peered":"2023-12-18T10:25:18.571712+0000","last_clean":"2023-12-18T10:25:18.571712+0000","last_became_active":"2023-12-18T10:25:18.179456+0000","last_became_peered":"2023-12-18T10:25:18.179456+0000","last_unstale":"2023-12-18T10:25:18.571712+0000","last_undegraded":"2023-12-18T10:25:18.571712+0000","last_fullsized":"2023-12-18T10:25:18.571712+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:00:57.260829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565735+0000","last_change":"2023-12-18T10:25:18.590304+0000","last_active":"2023-12-18T10:25:19.565735+0000","last_peered":"2023-12-18T10:25:19.565735+0000","last_clean":"2023-12-18T10:25:19.565735+0000","last_became_active":"2023-12-18T10:25:18.590015+0000","last_became_peered":"2023-12-18T10:25:18.590015+0000","last_unstale":"2023-12-18T10:25:19.565735+0000","last_undegraded":"2023-12-18T10:25:19.565735+0000","last_fullsized":"2023-12-18T10:25:19.565735+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:31:28.237496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.572715+0000","last_change":"2023-12-18T10:25:18.176167+0000","last_active":"2023-12-18T10:25:18.572715+0000","last_peered":"2023-12-18T10:25:18.572715+0000","last_clean":"2023-12-18T10:25:18.572715+0000","last_became_active":"2023-12-18T10:25:18.175877+0000","last_became_peered":"2023-12-18T10:25:18.175877+0000","last_unstale":"2023-12-18T10:25:18.572715+0000","last_undegraded":"2023-12-18T10:25:18.572715+0000","last_fullsized":"2023-12-18T10:25:18.572715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:28:06.452447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295829+0000","last_change":"2023-12-18T10:25:18.574476+0000","last_active":"2023-12-18T10:25:20.295829+0000","last_peered":"2023-12-18T10:25:20.295829+0000","last_clean":"2023-12-18T10:25:20.295829+0000","last_became_active":"2023-12-18T10:25:18.574237+0000","last_became_peered":"2023-12-18T10:25:18.574237+0000","last_unstale":"2023-12-18T10:25:20.295829+0000","last_undegraded":"2023-12-18T10:25:20.295829+0000","last_fullsized":"2023-12-18T10:25:20.295829+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:41:35.424293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.563039+0000","last_change":"2023-12-18T10:25:18.170536+0000","last_active":"2023-12-18T10:25:18.563039+0000","last_peered":"2023-12-18T10:25:18.563039+0000","last_clean":"2023-12-18T10:25:18.563039+0000","last_became_active":"2023-12-18T10:25:18.169864+0000","last_became_peered":"2023-12-18T10:25:18.169864+0000","last_unstale":"2023-12-18T10:25:18.563039+0000","last_undegraded":"2023-12-18T10:25:18.563039+0000","last_fullsized":"2023-12-18T10:25:18.563039+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:42:45.681860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318662+0000","last_change":"2023-12-18T10:25:18.582635+0000","last_active":"2023-12-18T10:25:20.318662+0000","last_peered":"2023-12-18T10:25:20.318662+0000","last_clean":"2023-12-18T10:25:20.318662+0000","last_became_active":"2023-12-18T10:25:18.580689+0000","last_became_peered":"2023-12-18T10:25:18.580689+0000","last_unstale":"2023-12-18T10:25:20.318662+0000","last_undegraded":"2023-12-18T10:25:20.318662+0000","last_fullsized":"2023-12-18T10:25:20.318662+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:43:33.766934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"104'3","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.593278+0000","last_change":"2023-12-18T10:25:18.182831+0000","last_active":"2023-12-18T10:25:18.593278+0000","last_peered":"2023-12-18T10:25:18.593278+0000","last_clean":"2023-12-18T10:25:18.593278+0000","last_became_active":"2023-12-18T10:25:18.182530+0000","last_became_peered":"2023-12-18T10:25:18.182530+0000","last_unstale":"2023-12-18T10:25:18.593278+0000","last_undegraded":"2023-12-18T10:25:18.593278+0000","last_fullsized":"2023-12-18T10:25:18.593278+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:30.804813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.296018+0000","last_change":"2023-12-18T10:25:18.574749+0000","last_active":"2023-12-18T10:25:20.296018+0000","last_peered":"2023-12-18T10:25:20.296018+0000","last_clean":"2023-12-18T10:25:20.296018+0000","last_became_active":"2023-12-18T10:25:18.574501+0000","last_became_peered":"2023-12-18T10:25:18.574501+0000","last_unstale":"2023-12-18T10:25:20.296018+0000","last_undegraded":"2023-12-18T10:25:20.296018+0000","last_fullsized":"2023-12-18T10:25:20.296018+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:11.122591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"104'6","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.603262+0000","last_change":"2023-12-18T10:25:18.177009+0000","last_active":"2023-12-18T10:25:18.603262+0000","last_peered":"2023-12-18T10:25:18.603262+0000","last_clean":"2023-12-18T10:25:18.603262+0000","last_became_active":"2023-12-18T10:25:18.176711+0000","last_became_peered":"2023-12-18T10:25:18.176711+0000","last_unstale":"2023-12-18T10:25:18.603262+0000","last_undegraded":"2023-12-18T10:25:18.603262+0000","last_fullsized":"2023-12-18T10:25:18.603262+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:20.134299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364202+0000","last_change":"2023-12-18T10:25:18.589073+0000","last_active":"2023-12-18T10:25:20.364202+0000","last_peered":"2023-12-18T10:25:20.364202+0000","last_clean":"2023-12-18T10:25:20.364202+0000","last_became_active":"2023-12-18T10:25:18.588803+0000","last_became_peered":"2023-12-18T10:25:18.588803+0000","last_unstale":"2023-12-18T10:25:20.364202+0000","last_undegraded":"2023-12-18T10:25:20.364202+0000","last_fullsized":"2023-12-18T10:25:20.364202+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:34.407981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.588752+0000","last_change":"2023-12-18T10:25:18.186311+0000","last_active":"2023-12-18T10:25:18.588752+0000","last_peered":"2023-12-18T10:25:18.588752+0000","last_clean":"2023-12-18T10:25:18.588752+0000","last_became_active":"2023-12-18T10:25:18.186032+0000","last_became_peered":"2023-12-18T10:25:18.186032+0000","last_unstale":"2023-12-18T10:25:18.588752+0000","last_undegraded":"2023-12-18T10:25:18.588752+0000","last_fullsized":"2023-12-18T10:25:18.588752+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:46:16.979293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363712+0000","last_change":"2023-12-18T10:25:18.595044+0000","last_active":"2023-12-18T10:25:20.363712+0000","last_peered":"2023-12-18T10:25:20.363712+0000","last_clean":"2023-12-18T10:25:20.363712+0000","last_became_active":"2023-12-18T10:25:18.594496+0000","last_became_peered":"2023-12-18T10:25:18.594496+0000","last_unstale":"2023-12-18T10:25:20.363712+0000","last_undegraded":"2023-12-18T10:25:20.363712+0000","last_fullsized":"2023-12-18T10:25:20.363712+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:55:58.079145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.571971+0000","last_change":"2023-12-18T10:25:18.180549+0000","last_active":"2023-12-18T10:25:18.571971+0000","last_peered":"2023-12-18T10:25:18.571971+0000","last_clean":"2023-12-18T10:25:18.571971+0000","last_became_active":"2023-12-18T10:25:18.180285+0000","last_became_peered":"2023-12-18T10:25:18.180285+0000","last_unstale":"2023-12-18T10:25:18.571971+0000","last_undegraded":"2023-12-18T10:25:18.571971+0000","last_fullsized":"2023-12-18T10:25:18.571971+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:55:31.907598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318663+0000","last_change":"2023-12-18T10:25:18.576153+0000","last_active":"2023-12-18T10:25:20.318663+0000","last_peered":"2023-12-18T10:25:20.318663+0000","last_clean":"2023-12-18T10:25:20.318663+0000","last_became_active":"2023-12-18T10:25:18.574719+0000","last_became_peered":"2023-12-18T10:25:18.574719+0000","last_unstale":"2023-12-18T10:25:20.318663+0000","last_undegraded":"2023-12-18T10:25:20.318663+0000","last_fullsized":"2023-12-18T10:25:20.318663+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:43:33.433576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558615+0000","last_change":"2023-12-18T10:25:18.185928+0000","last_active":"2023-12-18T10:25:18.558615+0000","last_peered":"2023-12-18T10:25:18.558615+0000","last_clean":"2023-12-18T10:25:18.558615+0000","last_became_active":"2023-12-18T10:25:18.185598+0000","last_became_peered":"2023-12-18T10:25:18.185598+0000","last_unstale":"2023-12-18T10:25:18.558615+0000","last_undegraded":"2023-12-18T10:25:18.558615+0000","last_fullsized":"2023-12-18T10:25:18.558615+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:37.231695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566374+0000","last_change":"2023-12-18T10:25:18.596383+0000","last_active":"2023-12-18T10:25:19.566374+0000","last_peered":"2023-12-18T10:25:19.566374+0000","last_clean":"2023-12-18T10:25:19.566374+0000","last_became_active":"2023-12-18T10:25:18.595891+0000","last_became_peered":"2023-12-18T10:25:18.595891+0000","last_unstale":"2023-12-18T10:25:19.566374+0000","last_undegraded":"2023-12-18T10:25:19.566374+0000","last_fullsized":"2023-12-18T10:25:19.566374+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:51:48.242261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"104'8","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.601731+0000","last_change":"2023-12-18T10:25:18.174398+0000","last_active":"2023-12-18T10:25:18.601731+0000","last_peered":"2023-12-18T10:25:18.601731+0000","last_clean":"2023-12-18T10:25:18.601731+0000","last_became_active":"2023-12-18T10:25:18.174088+0000","last_became_peered":"2023-12-18T10:25:18.174088+0000","last_unstale":"2023-12-18T10:25:18.601731+0000","last_undegraded":"2023-12-18T10:25:18.601731+0000","last_fullsized":"2023-12-18T10:25:18.601731+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:52:23.176182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318721+0000","last_change":"2023-12-18T10:25:18.568705+0000","last_active":"2023-12-18T10:25:20.318721+0000","last_peered":"2023-12-18T10:25:20.318721+0000","last_clean":"2023-12-18T10:25:20.318721+0000","last_became_active":"2023-12-18T10:25:18.568399+0000","last_became_peered":"2023-12-18T10:25:18.568399+0000","last_unstale":"2023-12-18T10:25:20.318721+0000","last_undegraded":"2023-12-18T10:25:20.318721+0000","last_fullsized":"2023-12-18T10:25:20.318721+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:57:11.481895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.596897+0000","last_change":"2023-12-18T10:25:18.179664+0000","last_active":"2023-12-18T10:25:18.596897+0000","last_peered":"2023-12-18T10:25:18.596897+0000","last_clean":"2023-12-18T10:25:18.596897+0000","last_became_active":"2023-12-18T10:25:18.179355+0000","last_became_peered":"2023-12-18T10:25:18.179355+0000","last_unstale":"2023-12-18T10:25:18.596897+0000","last_undegraded":"2023-12-18T10:25:18.596897+0000","last_fullsized":"2023-12-18T10:25:18.596897+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:21:32.694099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363406+0000","last_change":"2023-12-18T10:25:18.593608+0000","last_active":"2023-12-18T10:25:20.363406+0000","last_peered":"2023-12-18T10:25:20.363406+0000","last_clean":"2023-12-18T10:25:20.363406+0000","last_became_active":"2023-12-18T10:25:18.593047+0000","last_became_peered":"2023-12-18T10:25:18.593047+0000","last_unstale":"2023-12-18T10:25:20.363406+0000","last_undegraded":"2023-12-18T10:25:20.363406+0000","last_fullsized":"2023-12-18T10:25:20.363406+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:46:20.032305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582725+0000","last_change":"2023-12-18T10:25:18.179329+0000","last_active":"2023-12-18T10:25:18.582725+0000","last_peered":"2023-12-18T10:25:18.582725+0000","last_clean":"2023-12-18T10:25:18.582725+0000","last_became_active":"2023-12-18T10:25:18.179055+0000","last_became_peered":"2023-12-18T10:25:18.179055+0000","last_unstale":"2023-12-18T10:25:18.582725+0000","last_undegraded":"2023-12-18T10:25:18.582725+0000","last_fullsized":"2023-12-18T10:25:18.582725+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:10.119938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295900+0000","last_change":"2023-12-18T10:25:18.580954+0000","last_active":"2023-12-18T10:25:20.295900+0000","last_peered":"2023-12-18T10:25:20.295900+0000","last_clean":"2023-12-18T10:25:20.295900+0000","last_became_active":"2023-12-18T10:25:18.580048+0000","last_became_peered":"2023-12-18T10:25:18.580048+0000","last_unstale":"2023-12-18T10:25:20.295900+0000","last_undegraded":"2023-12-18T10:25:20.295900+0000","last_fullsized":"2023-12-18T10:25:20.295900+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:27:35.783756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582799+0000","last_change":"2023-12-18T10:25:18.185324+0000","last_active":"2023-12-18T10:25:18.582799+0000","last_peered":"2023-12-18T10:25:18.582799+0000","last_clean":"2023-12-18T10:25:18.582799+0000","last_became_active":"2023-12-18T10:25:18.184982+0000","last_became_peered":"2023-12-18T10:25:18.184982+0000","last_unstale":"2023-12-18T10:25:18.582799+0000","last_undegraded":"2023-12-18T10:25:18.582799+0000","last_fullsized":"2023-12-18T10:25:18.582799+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:55:57.076492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565965+0000","last_change":"2023-12-18T10:25:18.587216+0000","last_active":"2023-12-18T10:25:19.565965+0000","last_peered":"2023-12-18T10:25:19.565965+0000","last_clean":"2023-12-18T10:25:19.565965+0000","last_became_active":"2023-12-18T10:25:18.586956+0000","last_became_peered":"2023-12-18T10:25:18.586956+0000","last_unstale":"2023-12-18T10:25:19.565965+0000","last_undegraded":"2023-12-18T10:25:19.565965+0000","last_fullsized":"2023-12-18T10:25:19.565965+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:14:13.023201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.583171+0000","last_change":"2023-12-18T10:25:18.184922+0000","last_active":"2023-12-18T10:25:18.583171+0000","last_peered":"2023-12-18T10:25:18.583171+0000","last_clean":"2023-12-18T10:25:18.583171+0000","last_became_active":"2023-12-18T10:25:18.184665+0000","last_became_peered":"2023-12-18T10:25:18.184665+0000","last_unstale":"2023-12-18T10:25:18.583171+0000","last_undegraded":"2023-12-18T10:25:18.583171+0000","last_fullsized":"2023-12-18T10:25:18.583171+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:16.763875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566176+0000","last_change":"2023-12-18T10:25:18.578960+0000","last_active":"2023-12-18T10:25:19.566176+0000","last_peered":"2023-12-18T10:25:19.566176+0000","last_clean":"2023-12-18T10:25:19.566176+0000","last_became_active":"2023-12-18T10:25:18.578139+0000","last_became_peered":"2023-12-18T10:25:18.578139+0000","last_unstale":"2023-12-18T10:25:19.566176+0000","last_undegraded":"2023-12-18T10:25:19.566176+0000","last_fullsized":"2023-12-18T10:25:19.566176+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:51:58.213095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558590+0000","last_change":"2023-12-18T10:25:18.190645+0000","last_active":"2023-12-18T10:25:18.558590+0000","last_peered":"2023-12-18T10:25:18.558590+0000","last_clean":"2023-12-18T10:25:18.558590+0000","last_became_active":"2023-12-18T10:25:18.190245+0000","last_became_peered":"2023-12-18T10:25:18.190245+0000","last_unstale":"2023-12-18T10:25:18.558590+0000","last_undegraded":"2023-12-18T10:25:18.558590+0000","last_fullsized":"2023-12-18T10:25:18.558590+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:33:49.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567138+0000","last_change":"2023-12-18T10:25:18.591930+0000","last_active":"2023-12-18T10:25:19.567138+0000","last_peered":"2023-12-18T10:25:19.567138+0000","last_clean":"2023-12-18T10:25:19.567138+0000","last_became_active":"2023-12-18T10:25:18.591616+0000","last_became_peered":"2023-12-18T10:25:18.591616+0000","last_unstale":"2023-12-18T10:25:19.567138+0000","last_undegraded":"2023-12-18T10:25:19.567138+0000","last_fullsized":"2023-12-18T10:25:19.567138+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:07:07.624637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582422+0000","last_change":"2023-12-18T10:25:18.178584+0000","last_active":"2023-12-18T10:25:18.582422+0000","last_peered":"2023-12-18T10:25:18.582422+0000","last_clean":"2023-12-18T10:25:18.582422+0000","last_became_active":"2023-12-18T10:25:18.178315+0000","last_became_peered":"2023-12-18T10:25:18.178315+0000","last_unstale":"2023-12-18T10:25:18.582422+0000","last_undegraded":"2023-12-18T10:25:18.582422+0000","last_fullsized":"2023-12-18T10:25:18.582422+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:53:14.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318719+0000","last_change":"2023-12-18T10:25:18.581238+0000","last_active":"2023-12-18T10:25:20.318719+0000","last_peered":"2023-12-18T10:25:20.318719+0000","last_clean":"2023-12-18T10:25:20.318719+0000","last_became_active":"2023-12-18T10:25:18.581012+0000","last_became_peered":"2023-12-18T10:25:18.581012+0000","last_unstale":"2023-12-18T10:25:20.318719+0000","last_undegraded":"2023-12-18T10:25:20.318719+0000","last_fullsized":"2023-12-18T10:25:20.318719+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:47.246006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.559372+0000","last_change":"2023-12-18T10:25:18.188393+0000","last_active":"2023-12-18T10:25:18.559372+0000","last_peered":"2023-12-18T10:25:18.559372+0000","last_clean":"2023-12-18T10:25:18.559372+0000","last_became_active":"2023-12-18T10:25:18.188118+0000","last_became_peered":"2023-12-18T10:25:18.188118+0000","last_unstale":"2023-12-18T10:25:18.559372+0000","last_undegraded":"2023-12-18T10:25:18.559372+0000","last_fullsized":"2023-12-18T10:25:18.559372+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:56:58.730035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565641+0000","last_change":"2023-12-18T10:25:18.584161+0000","last_active":"2023-12-18T10:25:19.565641+0000","last_peered":"2023-12-18T10:25:19.565641+0000","last_clean":"2023-12-18T10:25:19.565641+0000","last_became_active":"2023-12-18T10:25:18.583920+0000","last_became_peered":"2023-12-18T10:25:18.583920+0000","last_unstale":"2023-12-18T10:25:19.565641+0000","last_undegraded":"2023-12-18T10:25:19.565641+0000","last_fullsized":"2023-12-18T10:25:19.565641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:00:29.240668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.580227+0000","last_change":"2023-12-18T10:25:18.186278+0000","last_active":"2023-12-18T10:25:18.580227+0000","last_peered":"2023-12-18T10:25:18.580227+0000","last_clean":"2023-12-18T10:25:18.580227+0000","last_became_active":"2023-12-18T10:25:18.185982+0000","last_became_peered":"2023-12-18T10:25:18.185982+0000","last_unstale":"2023-12-18T10:25:18.580227+0000","last_undegraded":"2023-12-18T10:25:18.580227+0000","last_fullsized":"2023-12-18T10:25:18.580227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:46:19.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363002+0000","last_change":"2023-12-18T10:25:18.586305+0000","last_active":"2023-12-18T10:25:20.363002+0000","last_peered":"2023-12-18T10:25:20.363002+0000","last_clean":"2023-12-18T10:25:20.363002+0000","last_became_active":"2023-12-18T10:25:18.586001+0000","last_became_peered":"2023-12-18T10:25:18.586001+0000","last_unstale":"2023-12-18T10:25:20.363002+0000","last_undegraded":"2023-12-18T10:25:20.363002+0000","last_fullsized":"2023-12-18T10:25:20.363002+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:40:28.778204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.563136+0000","last_change":"2023-12-18T10:25:18.176698+0000","last_active":"2023-12-18T10:25:18.563136+0000","last_peered":"2023-12-18T10:25:18.563136+0000","last_clean":"2023-12-18T10:25:18.563136+0000","last_became_active":"2023-12-18T10:25:18.176184+0000","last_became_peered":"2023-12-18T10:25:18.176184+0000","last_unstale":"2023-12-18T10:25:18.563136+0000","last_undegraded":"2023-12-18T10:25:18.563136+0000","last_fullsized":"2023-12-18T10:25:18.563136+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:18:02.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566897+0000","last_change":"2023-12-18T10:25:18.591625+0000","last_active":"2023-12-18T10:25:19.566897+0000","last_peered":"2023-12-18T10:25:19.566897+0000","last_clean":"2023-12-18T10:25:19.566897+0000","last_became_active":"2023-12-18T10:25:18.591368+0000","last_became_peered":"2023-12-18T10:25:18.591368+0000","last_unstale":"2023-12-18T10:25:19.566897+0000","last_undegraded":"2023-12-18T10:25:19.566897+0000","last_fullsized":"2023-12-18T10:25:19.566897+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:59:12.934113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.580264+0000","last_change":"2023-12-18T10:25:18.184247+0000","last_active":"2023-12-18T10:25:18.580264+0000","last_peered":"2023-12-18T10:25:18.580264+0000","last_clean":"2023-12-18T10:25:18.580264+0000","last_became_active":"2023-12-18T10:25:18.183040+0000","last_became_peered":"2023-12-18T10:25:18.183040+0000","last_unstale":"2023-12-18T10:25:18.580264+0000","last_undegraded":"2023-12-18T10:25:18.580264+0000","last_fullsized":"2023-12-18T10:25:18.580264+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:19.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364978+0000","last_change":"2023-12-18T10:25:18.590958+0000","last_active":"2023-12-18T10:25:20.364978+0000","last_peered":"2023-12-18T10:25:20.364978+0000","last_clean":"2023-12-18T10:25:20.364978+0000","last_became_active":"2023-12-18T10:25:18.590420+0000","last_became_peered":"2023-12-18T10:25:18.590420+0000","last_unstale":"2023-12-18T10:25:20.364978+0000","last_undegraded":"2023-12-18T10:25:20.364978+0000","last_fullsized":"2023-12-18T10:25:20.364978+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:31.384969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.572242+0000","last_change":"2023-12-18T10:25:18.183648+0000","last_active":"2023-12-18T10:25:18.572242+0000","last_peered":"2023-12-18T10:25:18.572242+0000","last_clean":"2023-12-18T10:25:18.572242+0000","last_became_active":"2023-12-18T10:25:18.183338+0000","last_became_peered":"2023-12-18T10:25:18.183338+0000","last_unstale":"2023-12-18T10:25:18.572242+0000","last_undegraded":"2023-12-18T10:25:18.572242+0000","last_fullsized":"2023-12-18T10:25:18.572242+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:11.568787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318790+0000","last_change":"2023-12-18T10:25:18.582814+0000","last_active":"2023-12-18T10:25:20.318790+0000","last_peered":"2023-12-18T10:25:20.318790+0000","last_clean":"2023-12-18T10:25:20.318790+0000","last_became_active":"2023-12-18T10:25:18.581107+0000","last_became_peered":"2023-12-18T10:25:18.581107+0000","last_unstale":"2023-12-18T10:25:20.318790+0000","last_undegraded":"2023-12-18T10:25:20.318790+0000","last_fullsized":"2023-12-18T10:25:20.318790+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:38:23.561988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569175+0000","last_change":"2023-12-18T10:25:18.173996+0000","last_active":"2023-12-18T10:25:18.569175+0000","last_peered":"2023-12-18T10:25:18.569175+0000","last_clean":"2023-12-18T10:25:18.569175+0000","last_became_active":"2023-12-18T10:25:18.173699+0000","last_became_peered":"2023-12-18T10:25:18.173699+0000","last_unstale":"2023-12-18T10:25:18.569175+0000","last_undegraded":"2023-12-18T10:25:18.569175+0000","last_fullsized":"2023-12-18T10:25:18.569175+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:44:44.024501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318671+0000","last_change":"2023-12-18T10:25:18.585426+0000","last_active":"2023-12-18T10:25:20.318671+0000","last_peered":"2023-12-18T10:25:20.318671+0000","last_clean":"2023-12-18T10:25:20.318671+0000","last_became_active":"2023-12-18T10:25:18.580594+0000","last_became_peered":"2023-12-18T10:25:18.580594+0000","last_unstale":"2023-12-18T10:25:20.318671+0000","last_undegraded":"2023-12-18T10:25:20.318671+0000","last_fullsized":"2023-12-18T10:25:20.318671+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:38:14.196425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558747+0000","last_change":"2023-12-18T10:25:18.190190+0000","last_active":"2023-12-18T10:25:18.558747+0000","last_peered":"2023-12-18T10:25:18.558747+0000","last_clean":"2023-12-18T10:25:18.558747+0000","last_became_active":"2023-12-18T10:25:18.189895+0000","last_became_peered":"2023-12-18T10:25:18.189895+0000","last_unstale":"2023-12-18T10:25:18.558747+0000","last_undegraded":"2023-12-18T10:25:18.558747+0000","last_fullsized":"2023-12-18T10:25:18.558747+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:41:07.781582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364893+0000","last_change":"2023-12-18T10:25:18.590562+0000","last_active":"2023-12-18T10:25:20.364893+0000","last_peered":"2023-12-18T10:25:20.364893+0000","last_clean":"2023-12-18T10:25:20.364893+0000","last_became_active":"2023-12-18T10:25:18.590295+0000","last_became_peered":"2023-12-18T10:25:18.590295+0000","last_unstale":"2023-12-18T10:25:20.364893+0000","last_undegraded":"2023-12-18T10:25:20.364893+0000","last_fullsized":"2023-12-18T10:25:20.364893+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:53:12.765081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582516+0000","last_change":"2023-12-18T10:25:18.186738+0000","last_active":"2023-12-18T10:25:18.582516+0000","last_peered":"2023-12-18T10:25:18.582516+0000","last_clean":"2023-12-18T10:25:18.582516+0000","last_became_active":"2023-12-18T10:25:18.186523+0000","last_became_peered":"2023-12-18T10:25:18.186523+0000","last_unstale":"2023-12-18T10:25:18.582516+0000","last_undegraded":"2023-12-18T10:25:18.582516+0000","last_fullsized":"2023-12-18T10:25:18.582516+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:48.530491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364891+0000","last_change":"2023-12-18T10:25:18.595651+0000","last_active":"2023-12-18T10:25:20.364891+0000","last_peered":"2023-12-18T10:25:20.364891+0000","last_clean":"2023-12-18T10:25:20.364891+0000","last_became_active":"2023-12-18T10:25:18.595329+0000","last_became_peered":"2023-12-18T10:25:18.595329+0000","last_unstale":"2023-12-18T10:25:20.364891+0000","last_undegraded":"2023-12-18T10:25:20.364891+0000","last_fullsized":"2023-12-18T10:25:20.364891+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:37:43.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.559436+0000","last_change":"2023-12-18T10:25:18.186677+0000","last_active":"2023-12-18T10:25:18.559436+0000","last_peered":"2023-12-18T10:25:18.559436+0000","last_clean":"2023-12-18T10:25:18.559436+0000","last_became_active":"2023-12-18T10:25:18.186409+0000","last_became_peered":"2023-12-18T10:25:18.186409+0000","last_unstale":"2023-12-18T10:25:18.559436+0000","last_undegraded":"2023-12-18T10:25:18.559436+0000","last_fullsized":"2023-12-18T10:25:18.559436+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:01:55.510810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364295+0000","last_change":"2023-12-18T10:25:18.592647+0000","last_active":"2023-12-18T10:25:20.364295+0000","last_peered":"2023-12-18T10:25:20.364295+0000","last_clean":"2023-12-18T10:25:20.364295+0000","last_became_active":"2023-12-18T10:25:18.592388+0000","last_became_peered":"2023-12-18T10:25:18.592388+0000","last_unstale":"2023-12-18T10:25:20.364295+0000","last_undegraded":"2023-12-18T10:25:20.364295+0000","last_fullsized":"2023-12-18T10:25:20.364295+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:37.244002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.584202+0000","last_change":"2023-12-18T10:25:18.188528+0000","last_active":"2023-12-18T10:25:18.584202+0000","last_peered":"2023-12-18T10:25:18.584202+0000","last_clean":"2023-12-18T10:25:18.584202+0000","last_became_active":"2023-12-18T10:25:18.188173+0000","last_became_peered":"2023-12-18T10:25:18.188173+0000","last_unstale":"2023-12-18T10:25:18.584202+0000","last_undegraded":"2023-12-18T10:25:18.584202+0000","last_fullsized":"2023-12-18T10:25:18.584202+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:46:12.832194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":233,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569491+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:25:18.569491+0000","last_peered":"2023-12-18T10:25:18.569491+0000","last_clean":"2023-12-18T10:25:18.569491+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:25:18.569491+0000","last_undegraded":"2023-12-18T10:25:18.569491+0000","last_fullsized":"2023-12-18T10:25:18.569491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574941,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1904640,"data_stored":1193019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.505}]},{"osd":1,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":1.042,"15min":1.042},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":1.081,"15min":1.081},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.67400000000000004},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83499999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":1.097,"15min":1.097},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.91000000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70699999999999996,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88200000000000001,"5min":1.137,"15min":1.137},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":1.024,"15min":1.024},"last":0.86699999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.76900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.89900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":604659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.79600000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.018,"5min":1.018,"15min":4.3760000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.83899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.56599999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.73299999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.845},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69799999999999995,"15min":0.82499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.179,"5min":1.179,"15min":4.524},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":1.121,"5min":1.121,"15min":2.2709999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.746},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.498}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.80500000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91400000000000003,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.84499999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.62}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.0049999999999999,"15min":1.101},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.627,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67600000000000005,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.93500000000000005,"5min":0.98799999999999999,"15min":1.284},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91400000000000003,"5min":1.0880000000000001,"15min":1.129},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.74399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":1.006,"15min":1.0820000000000001},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1302528,"data_stored":602491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.873,"15min":1.0900000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.66500000000000004,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.78600000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65500000000000003,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.85799999999999998,"5min":0.92500000000000004,"15min":3.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":0.879,"15min":0.90500000000000003},"last":0.67700000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.749},"min":{"1min":0.432,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.81000000000000005,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.77100000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":2.0699999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67800000000000005,"15min":0.79100000000000004},"min":{"1min":0.502,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.88200000000000001,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.871}]},{"osd":4,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63300000000000001,"15min":0.89400000000000002},"min":{"1min":0.48899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82899999999999996,"5min":0.88,"15min":8.9740000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68100000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92300000000000004,"5min":0.97899999999999998,"15min":1.2370000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.72999999999999998},"min":{"1min":0.46899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":2.9060000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63700000000000001,"15min":0.76000000000000001},"min":{"1min":0.55300000000000005,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.505}]},{"osd":7,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64400000000000002,"15min":0.68600000000000005},"min":{"1min":0.51300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":1.042,"15min":1.1830000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67400000000000004,"15min":0.79200000000000004},"min":{"1min":0.53600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":602583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.503,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91600000000000004,"5min":0.96799999999999997,"15min":1.0249999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.84099999999999997,"5min":0.92800000000000005,"15min":1.1739999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.131},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.54500000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89600000000000002,"5min":1.008,"15min":1.032},"last":0.66700000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.86199999999999999,"5min":0.94499999999999995,"15min":0.999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.63},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68500000000000005,"5min":0.91900000000000004,"15min":0.97399999999999998},"last":0.621},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.86799999999999999,"15min":0.874},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.71799999999999997},"min":{"1min":0.55000000000000004,"5min":0.376,"15min":0.376},"max":{"1min":0.82299999999999995,"5min":1.0109999999999999,"15min":1.073},"last":0.79200000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":1.042},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90500000000000003,"15min":1.1479999999999999},"last":0.746}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":603073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41699999999999998,"15min":0.42499999999999999},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58999999999999997,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45600000000000002,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.59699999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.46400000000000002},"min":{"1min":0.312,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53800000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.371},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.66300000000000003,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":1.036,"15min":1.254},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.64300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":0.98899999999999999,"15min":1.772},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.01},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.60999999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.167,"15min":1.181},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.171,"15min":1.171},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93700000000000006,"5min":1.0549999999999999,"15min":1.069},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72199999999999998,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.53400000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.751},"min":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90000000000000002,"5min":1.26,"15min":1.26},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":602525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.61499999999999999,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60399999999999998,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.34200000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47699999999999998,"15min":0.49099999999999999},"min":{"1min":0.316,"5min":0.315,"15min":0.315},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.434},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.92000000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":1.1599999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.90500000000000003,"5min":1.0469999999999999,"15min":1.698},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.0820000000000001,"15min":1.4219999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.95999999999999996,"15min":1.3069999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.752,"15min":0.80100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":1.085,"15min":1.7549999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0680000000000001,"15min":1.341},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.3939999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.61299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.048,"15min":1.282},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.94799999999999995,"5min":1.093,"15min":1.4530000000000001},"last":0.65000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":602525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.55800000000000005},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.64400000000000002,"15min":3.976},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":1.9079999999999999},"last":0.67000000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.59899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":3.786},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.46300000000000002,"15min":0.50700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59599999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50700000000000001,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.60099999999999998,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.625},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.71399999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89300000000000002,"5min":1.1399999999999999,"15min":1.851},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.879},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.995,"5min":1.0960000000000001,"15min":4.1859999999999999},"last":1.024},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.504},"max":{"1min":0.877,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.93200000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.01,"5min":1.056,"15min":2.0699999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.94399999999999995,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.94999999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73699999999999999,"15min":0.78500000000000003},"min":{"1min":0.60099999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":2.1890000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77500000000000002,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":0.95599999999999996,"5min":1.0649999999999999,"15min":1.9770000000000001},"last":1.0089999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1912832,"data_stored":1194513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.439,"15min":0.47899999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.252},"max":{"1min":0.59599999999999997,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66000000000000003,"5min":0.92900000000000005,"15min":1.456},"last":0.45400000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":1.0589999999999999,"15min":1.595},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47299999999999998,"15min":0.55900000000000005},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":2.464},"last":0.495}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47199999999999998,"15min":0.51800000000000002},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63500000000000001,"5min":0.85699999999999998,"15min":1.859},"last":0.436},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38800000000000001},"max":{"1min":0.67100000000000004,"5min":0.90000000000000002,"15min":1.903},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.0700000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.1279999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.623}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.76000000000000001},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.46700000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0720000000000001,"5min":1.278,"15min":1.5700000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.53},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73099999999999998,"15min":0.78100000000000003},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0469999999999999,"5min":1.349,"15min":1.556},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.77200000000000002},"min":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:25:23.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:25:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.561+0000 7f34d50c3640 1 Processor -- start 2023-12-18T10:25:23.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.561+0000 7f34d50c3640 1 -- start start 2023-12-18T10:25:23.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34d50c3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d015c730 0x7f34d00b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34d50c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 0x7f34d00cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34d50c3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34d00cd3a0 0x7f34d00cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34d50c3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d015cb10 con 0x7f34d015c730 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34d50c3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d00b84c0 con 0x7f34d00cd3a0 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34d50c3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00cd960 con 0x7f34d00cea00 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d015c730 0x7f34d00b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34d015c730 0x7f34d00b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57108/0 (socket says 172.21.15.133:57108) 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cffff640 1 -- 172.21.15.133:0/2131888411 learned_addr learned my addr 172.21.15.133:0/2131888411 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cf7fe640 1 --2- 172.21.15.133:0/2131888411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 0x7f34d00cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34d48c2640 1 --2- 172.21.15.133:0/2131888411 >> v2:172.21.15.142:3300/0 conn(0x7f34d00cd3a0 0x7f34d00cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cffff640 1 -- 172.21.15.133:0/2131888411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 msgr2=0x7f34d00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cffff640 1 --2- 172.21.15.133:0/2131888411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 0x7f34d00cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cffff640 1 -- 172.21.15.133:0/2131888411 >> v2:172.21.15.142:3300/0 conn(0x7f34d00cd3a0 msgr2=0x7f34d00cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cffff640 1 --2- 172.21.15.133:0/2131888411 >> v2:172.21.15.142:3300/0 conn(0x7f34d00cd3a0 0x7f34d00cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.565+0000 7f34cffff640 1 -- 172.21.15.133:0/2131888411 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00cdc40 con 0x7f34d015c730 2023-12-18T10:25:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34cffff640 1 --2- 172.21.15.133:0/2131888411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d00b7f80 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f34d0160180 tx=0x7f34c001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f515ee429146b441 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34ceffd640 1 -- 172.21.15.133:0/2131888411 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c00a89b0 con 0x7f34d015c730 2023-12-18T10:25:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34ceffd640 1 -- 172.21.15.133:0/2131888411 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c00a8b10 con 0x7f34d015c730 2023-12-18T10:25:23.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34ceffd640 1 -- 172.21.15.133:0/2131888411 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c00a8ea0 con 0x7f34d015c730 2023-12-18T10:25:23.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 -- 172.21.15.133:0/2131888411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 msgr2=0x7f34d00b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2131888411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d00b7f80 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f34d0160180 tx=0x7f34c001ecf0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 -- 172.21.15.133:0/2131888411 shutdown_connections 2023-12-18T10:25:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2131888411 >> v2:172.21.15.142:3300/0 conn(0x7f34d00cd3a0 0x7f34d00cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2131888411 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 0x7f34d00cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2131888411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d00b7f80 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 -- 172.21.15.133:0/2131888411 >> 172.21.15.133:0/2131888411 conn(0x7f34d006b120 msgr2=0x7f34d006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 -- 172.21.15.133:0/2131888411 shutdown_connections 2023-12-18T10:25:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 -- 172.21.15.133:0/2131888411 wait complete. 2023-12-18T10:25:23.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 Processor -- start 2023-12-18T10:25:23.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.569+0000 7f34d50c3640 1 -- start start 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00cd3a0 0x7f34d00cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 0x7f34d014fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d0150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0140720 con 0x7f34d015c730 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0150790 con 0x7f34d00cd3a0 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00cbae0 con 0x7f34d00cea00 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d0150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d0150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57120/0 (socket says 172.21.15.133:57120) 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 -- 172.21.15.133:0/2933148871 learned_addr learned my addr 172.21.15.133:0/2933148871 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34cffff640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00cd3a0 0x7f34d00cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34cf7fe640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 0x7f34d014fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 -- 172.21.15.133:0/2933148871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 msgr2=0x7f34d014fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 0x7f34d014fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 -- 172.21.15.133:0/2933148871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00cd3a0 msgr2=0x7f34d00cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00cd3a0 0x7f34d00cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 -- 172.21.15.133:0/2933148871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c00094d0 con 0x7f34d015c730 2023-12-18T10:25:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d48c2640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d0150250 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f34c800eed0 tx=0x7f34c800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34ccff9640 1 -- 172.21.15.133:0/2933148871 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8010040 con 0x7f34d015c730 2023-12-18T10:25:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34ccff9640 1 -- 172.21.15.133:0/2933148871 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8014400 con 0x7f34d015c730 2023-12-18T10:25:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34ccff9640 1 -- 172.21.15.133:0/2933148871 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8009ea0 con 0x7f34d015c730 2023-12-18T10:25:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d00cbdc0 con 0x7f34d015c730 2023-12-18T10:25:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d00cc380 con 0x7f34d015c730 2023-12-18T10:25:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d0066c50 con 0x7f34d015c730 2023-12-18T10:25:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.573+0000 7f34ccff9640 1 -- 172.21.15.133:0/2933148871 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34c80147b0 con 0x7f34d015c730 2023-12-18T10:25:23.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.577+0000 7f34ccff9640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f34bc065a60 0x7f34bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.577+0000 7f34ccff9640 1 -- 172.21.15.133:0/2933148871 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f34c8083890 con 0x7f34d015c730 2023-12-18T10:25:23.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.577+0000 7f34cffff640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f34bc065a60 0x7f34bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.577+0000 7f34cffff640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f34bc065a60 0x7f34bc067f20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f34c00b2000 tx=0x7f34c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.581+0000 7f34ccff9640 1 -- 172.21.15.133:0/2933148871 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f34c80511b0 con 0x7f34d015c730 2023-12-18T10:25:23.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f34d004e850 con 0x7f34d015c730 2023-12-18T10:25:23.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34ccff9640 1 -- 172.21.15.133:0/2933148871 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1434 (secure 0 0 0) 0x7f34c80185b0 con 0x7f34d015c730 2023-12-18T10:25:23.784 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:23.784 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":463,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":105,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":266018816,"bytes_avail":772828094464,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":103,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":9048}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2023-12-18T10:25:01.185130+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f34bc065a60 msgr2=0x7f34bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f34bc065a60 0x7f34bc067f20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f34c00b2000 tx=0x7f34c0009040 comp rx=0 tx=0).stop 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 msgr2=0x7f34d0150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d0150250 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f34c800eed0 tx=0x7f34c800b480 comp rx=0 tx=0).stop 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 shutdown_connections 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f34bc065a60 0x7f34bc067f20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d015c730 0x7f34d0150250 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00cea00 0x7f34d014fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 --2- 172.21.15.133:0/2933148871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00cd3a0 0x7f34d00cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 >> 172.21.15.133:0/2933148871 conn(0x7f34d006b120 msgr2=0x7f34d00b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 shutdown_connections 2023-12-18T10:25:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.785+0000 7f34d50c3640 1 -- 172.21.15.133:0/2933148871 wait complete. 2023-12-18T10:25:23.805 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-18T10:25:23.805 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:25:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.941+0000 7f0c78df0640 1 Processor -- start 2023-12-18T10:25:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.941+0000 7f0c78df0640 1 -- start start 2023-12-18T10:25:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c78df0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c740cb180 0x7f0c74070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c78df0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c7415c800 0x7f0c740ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c78df0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c74070b80 con 0x7f0c74158c20 2023-12-18T10:25:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c78df0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c74070e60 con 0x7f0c7415c800 2023-12-18T10:25:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c78df0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c74071140 con 0x7f0c740cb180 2023-12-18T10:25:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c72d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c7415c800 0x7f0c740ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c7259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0c74158c20 0x7f0c740caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39252/0 (socket says 172.21.15.133:39252) 2023-12-18T10:25:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c7259c640 1 -- 172.21.15.133:0/2877538692 learned_addr learned my addr 172.21.15.133:0/2877538692 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c72d9d640 1 -- 172.21.15.133:0/2877538692 >> v2:172.21.15.142:3300/0 conn(0x7f0c740cb180 msgr2=0x7f0c74070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c72d9d640 1 --2- 172.21.15.133:0/2877538692 >> v2:172.21.15.142:3300/0 conn(0x7f0c740cb180 0x7f0c74070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c72d9d640 1 -- 172.21.15.133:0/2877538692 >> v1:172.21.15.133:6789/0 conn(0x7f0c74158c20 legacy=0x7f0c740caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c72d9d640 1 -- 172.21.15.133:0/2877538692 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c74071420 con 0x7f0c7415c800 2023-12-18T10:25:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.945+0000 7f0c72d9d640 1 --2- 172.21.15.133:0/2877538692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7415c800 0x7f0c740ccc10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f0c740cbc00 tx=0x7f0c6c01e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59e52878402ffbf server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c71d9b640 1 -- 172.21.15.133:0/2877538692 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0a69e0 con 0x7f0c7415c800 2023-12-18T10:25:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c71d9b640 1 -- 172.21.15.133:0/2877538692 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c0a6b40 con 0x7f0c7415c800 2023-12-18T10:25:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c71d9b640 1 -- 172.21.15.133:0/2877538692 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0ae440 con 0x7f0c7415c800 2023-12-18T10:25:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- 172.21.15.133:0/2877538692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7415c800 msgr2=0x7f0c740ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 --2- 172.21.15.133:0/2877538692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7415c800 0x7f0c740ccc10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f0c740cbc00 tx=0x7f0c6c01e3c0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- 172.21.15.133:0/2877538692 shutdown_connections 2023-12-18T10:25:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 --2- 172.21.15.133:0/2877538692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7415c800 0x7f0c740ccc10 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 --2- 172.21.15.133:0/2877538692 >> v2:172.21.15.142:3300/0 conn(0x7f0c740cb180 0x7f0c74070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- 172.21.15.133:0/2877538692 >> 172.21.15.133:0/2877538692 conn(0x7f0c7406a3e0 msgr2=0x7f0c740afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- 172.21.15.133:0/2877538692 shutdown_connections 2023-12-18T10:25:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- 172.21.15.133:0/2877538692 wait complete. 2023-12-18T10:25:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 Processor -- start 2023-12-18T10:25:23.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- start start 2023-12-18T10:25:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c740cb180 0x7f0c740c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c74158c20 0x7f0c74151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7415c800 0x7f0c740cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740c6300 con 0x7f0c740cb180 2023-12-18T10:25:23.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740c65e0 con 0x7f0c7415c800 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.949+0000 7f0c78df0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c740c68c0 con 0x7f0c74158c20 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c740cb180 0x7f0c740c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c740cb180 0x7f0c740c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57128/0 (socket says 172.21.15.133:57128) 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 -- 172.21.15.133:0/4265168472 learned_addr learned my addr 172.21.15.133:0/4265168472 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c6bfff640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c74158c20 0x7f0c74151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c72d9d640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7415c800 0x7f0c740cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 -- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c74158c20 msgr2=0x7f0c74151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c74158c20 0x7f0c74151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 -- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7415c800 msgr2=0x7f0c740cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7415c800 0x7f0c740cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 -- 172.21.15.133:0/4265168472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009a70 con 0x7f0c740cb180 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c72d9d640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7415c800 0x7f0c740cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:23.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c7259c640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c740cb180 0x7f0c740c5a00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400c500 tx=0x7f0c6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c6affd640 1 -- 172.21.15.133:0/4265168472 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c64005cf0 con 0x7f0c740cb180 2023-12-18T10:25:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c6affd640 1 -- 172.21.15.133:0/4265168472 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c64005e50 con 0x7f0c740cb180 2023-12-18T10:25:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c740c8800 con 0x7f0c740cb180 2023-12-18T10:25:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c6affd640 1 -- 172.21.15.133:0/4265168472 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c640072f0 con 0x7f0c740cb180 2023-12-18T10:25:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c740c5f40 con 0x7f0c740cb180 2023-12-18T10:25:23.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c740735b0 con 0x7f0c740cb180 2023-12-18T10:25:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c6affd640 1 -- 172.21.15.133:0/4265168472 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c64007450 con 0x7f0c740cb180 2023-12-18T10:25:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c6affd640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c54065a90 0x7f0c54067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.953+0000 7f0c6affd640 1 -- 172.21.15.133:0/4265168472 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0c64082740 con 0x7f0c740cb180 2023-12-18T10:25:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.957+0000 7f0c6bfff640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c54065a90 0x7f0c54067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:23.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.957+0000 7f0c6bfff640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c54065a90 0x7f0c54067f50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0c74157f40 tx=0x7f0c5c009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:23.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:23.961+0000 7f0c6affd640 1 -- 172.21.15.133:0/4265168472 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0c64050100 con 0x7f0c740cb180 2023-12-18T10:25:24.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.105+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c740c8680 con 0x7f0c54065a90 2023-12-18T10:25:24.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.113+0000 7f0c6affd640 1 -- 172.21.15.133:0/4265168472 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289544 (secure 0 0 0) 0x7f0c5c00e820 con 0x7f0c54065a90 2023-12-18T10:25:24.116 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:24.118 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:25:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c54065a90 msgr2=0x7f0c54067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c54065a90 0x7f0c54067f50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0c74157f40 tx=0x7f0c5c009110 comp rx=0 tx=0).stop 2023-12-18T10:25:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c740cb180 msgr2=0x7f0c740c5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:24.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c740cb180 0x7f0c740c5a00 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400c500 tx=0x7f0c6400c9c0 comp rx=0 tx=0).stop 2023-12-18T10:25:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 shutdown_connections 2023-12-18T10:25:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0c54065a90 0x7f0c54067f50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c7415c800 0x7f0c740cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0c74158c20 0x7f0c74151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 --2- 172.21.15.133:0/4265168472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c740cb180 0x7f0c740c5a00 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 >> 172.21.15.133:0/4265168472 conn(0x7f0c7406a3e0 msgr2=0x7f0c740afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 shutdown_connections 2023-12-18T10:25:24.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:24.117+0000 7f0c78df0640 1 -- 172.21.15.133:0/4265168472 wait complete. 2023-12-18T10:25:24.136 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2023-12-18T10:25:23.188936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259784,"kb_used_data":11400,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714936,"statfs":{"total":773094113280,"available":772828094464,"internally_reserved":0,"allocated":11673600,"data_stored":6005388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001144"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566155+0000","last_change":"2023-12-18T10:25:18.587171+0000","last_active":"2023-12-18T10:25:19.566155+0000","last_peered":"2023-12-18T10:25:19.566155+0000","last_clean":"2023-12-18T10:25:19.566155+0000","last_became_active":"2023-12-18T10:25:18.586887+0000","last_became_peered":"2023-12-18T10:25:18.586887+0000","last_unstale":"2023-12-18T10:25:19.566155+0000","last_undegraded":"2023-12-18T10:25:19.566155+0000","last_fullsized":"2023-12-18T10:25:19.566155+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:57:33.454865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364550+0000","last_change":"2023-12-18T10:25:18.592190+0000","last_active":"2023-12-18T10:25:20.364550+0000","last_peered":"2023-12-18T10:25:20.364550+0000","last_clean":"2023-12-18T10:25:20.364550+0000","last_became_active":"2023-12-18T10:25:18.590883+0000","last_became_peered":"2023-12-18T10:25:18.590883+0000","last_unstale":"2023-12-18T10:25:20.364550+0000","last_undegraded":"2023-12-18T10:25:20.364550+0000","last_fullsized":"2023-12-18T10:25:20.364550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:57:54.199621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565815+0000","last_change":"2023-12-18T10:25:18.590238+0000","last_active":"2023-12-18T10:25:19.565815+0000","last_peered":"2023-12-18T10:25:19.565815+0000","last_clean":"2023-12-18T10:25:19.565815+0000","last_became_active":"2023-12-18T10:25:18.589982+0000","last_became_peered":"2023-12-18T10:25:18.589982+0000","last_unstale":"2023-12-18T10:25:19.565815+0000","last_undegraded":"2023-12-18T10:25:19.565815+0000","last_fullsized":"2023-12-18T10:25:19.565815+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:33:23.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567044+0000","last_change":"2023-12-18T10:25:18.587238+0000","last_active":"2023-12-18T10:25:19.567044+0000","last_peered":"2023-12-18T10:25:19.567044+0000","last_clean":"2023-12-18T10:25:19.567044+0000","last_became_active":"2023-12-18T10:25:18.586080+0000","last_became_peered":"2023-12-18T10:25:18.586080+0000","last_unstale":"2023-12-18T10:25:19.567044+0000","last_undegraded":"2023-12-18T10:25:19.567044+0000","last_fullsized":"2023-12-18T10:25:19.567044+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:31:22.298032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295899+0000","last_change":"2023-12-18T10:25:18.581846+0000","last_active":"2023-12-18T10:25:20.295899+0000","last_peered":"2023-12-18T10:25:20.295899+0000","last_clean":"2023-12-18T10:25:20.295899+0000","last_became_active":"2023-12-18T10:25:18.580344+0000","last_became_peered":"2023-12-18T10:25:18.580344+0000","last_unstale":"2023-12-18T10:25:20.295899+0000","last_undegraded":"2023-12-18T10:25:20.295899+0000","last_fullsized":"2023-12-18T10:25:20.295899+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:29:42.504233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363336+0000","last_change":"2023-12-18T10:25:18.589801+0000","last_active":"2023-12-18T10:25:20.363336+0000","last_peered":"2023-12-18T10:25:20.363336+0000","last_clean":"2023-12-18T10:25:20.363336+0000","last_became_active":"2023-12-18T10:25:18.589453+0000","last_became_peered":"2023-12-18T10:25:18.589453+0000","last_unstale":"2023-12-18T10:25:20.363336+0000","last_undegraded":"2023-12-18T10:25:20.363336+0000","last_fullsized":"2023-12-18T10:25:20.363336+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:46:17.981946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362921+0000","last_change":"2023-12-18T10:25:18.595252+0000","last_active":"2023-12-18T10:25:20.362921+0000","last_peered":"2023-12-18T10:25:20.362921+0000","last_clean":"2023-12-18T10:25:20.362921+0000","last_became_active":"2023-12-18T10:25:18.594676+0000","last_became_peered":"2023-12-18T10:25:18.594676+0000","last_unstale":"2023-12-18T10:25:20.362921+0000","last_undegraded":"2023-12-18T10:25:20.362921+0000","last_fullsized":"2023-12-18T10:25:20.362921+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:20:17.969046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318484+0000","last_change":"2023-12-18T10:25:18.581711+0000","last_active":"2023-12-18T10:25:20.318484+0000","last_peered":"2023-12-18T10:25:20.318484+0000","last_clean":"2023-12-18T10:25:20.318484+0000","last_became_active":"2023-12-18T10:25:18.581486+0000","last_became_peered":"2023-12-18T10:25:18.581486+0000","last_unstale":"2023-12-18T10:25:20.318484+0000","last_undegraded":"2023-12-18T10:25:20.318484+0000","last_fullsized":"2023-12-18T10:25:20.318484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:16:48.894333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363685+0000","last_change":"2023-12-18T10:25:18.593458+0000","last_active":"2023-12-18T10:25:20.363685+0000","last_peered":"2023-12-18T10:25:20.363685+0000","last_clean":"2023-12-18T10:25:20.363685+0000","last_became_active":"2023-12-18T10:25:18.593185+0000","last_became_peered":"2023-12-18T10:25:18.593185+0000","last_unstale":"2023-12-18T10:25:20.363685+0000","last_undegraded":"2023-12-18T10:25:20.363685+0000","last_fullsized":"2023-12-18T10:25:20.363685+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:26.594432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.296106+0000","last_change":"2023-12-18T10:25:18.591047+0000","last_active":"2023-12-18T10:25:20.296106+0000","last_peered":"2023-12-18T10:25:20.296106+0000","last_clean":"2023-12-18T10:25:20.296106+0000","last_became_active":"2023-12-18T10:25:18.590725+0000","last_became_peered":"2023-12-18T10:25:18.590725+0000","last_unstale":"2023-12-18T10:25:20.296106+0000","last_undegraded":"2023-12-18T10:25:20.296106+0000","last_fullsized":"2023-12-18T10:25:20.296106+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:34.407981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364646+0000","last_change":"2023-12-18T10:25:18.591234+0000","last_active":"2023-12-18T10:25:20.364646+0000","last_peered":"2023-12-18T10:25:20.364646+0000","last_clean":"2023-12-18T10:25:20.364646+0000","last_became_active":"2023-12-18T10:25:18.590849+0000","last_became_peered":"2023-12-18T10:25:18.590849+0000","last_unstale":"2023-12-18T10:25:20.364646+0000","last_undegraded":"2023-12-18T10:25:20.364646+0000","last_fullsized":"2023-12-18T10:25:20.364646+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:53:12.765081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364527+0000","last_change":"2023-12-18T10:25:18.589913+0000","last_active":"2023-12-18T10:25:20.364527+0000","last_peered":"2023-12-18T10:25:20.364527+0000","last_clean":"2023-12-18T10:25:20.364527+0000","last_became_active":"2023-12-18T10:25:18.588523+0000","last_became_peered":"2023-12-18T10:25:18.588523+0000","last_unstale":"2023-12-18T10:25:20.364527+0000","last_undegraded":"2023-12-18T10:25:20.364527+0000","last_fullsized":"2023-12-18T10:25:20.364527+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:35:44.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566909+0000","last_change":"2023-12-18T10:25:18.597402+0000","last_active":"2023-12-18T10:25:19.566909+0000","last_peered":"2023-12-18T10:25:19.566909+0000","last_clean":"2023-12-18T10:25:19.566909+0000","last_became_active":"2023-12-18T10:25:18.597103+0000","last_became_peered":"2023-12-18T10:25:18.597103+0000","last_unstale":"2023-12-18T10:25:19.566909+0000","last_undegraded":"2023-12-18T10:25:19.566909+0000","last_fullsized":"2023-12-18T10:25:19.566909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:13.204679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362763+0000","last_change":"2023-12-18T10:25:18.588540+0000","last_active":"2023-12-18T10:25:20.362763+0000","last_peered":"2023-12-18T10:25:20.362763+0000","last_clean":"2023-12-18T10:25:20.362763+0000","last_became_active":"2023-12-18T10:25:18.588196+0000","last_became_peered":"2023-12-18T10:25:18.588196+0000","last_unstale":"2023-12-18T10:25:20.362763+0000","last_undegraded":"2023-12-18T10:25:20.362763+0000","last_fullsized":"2023-12-18T10:25:20.362763+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:37.244002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362708+0000","last_change":"2023-12-18T10:25:18.593448+0000","last_active":"2023-12-18T10:25:20.362708+0000","last_peered":"2023-12-18T10:25:20.362708+0000","last_clean":"2023-12-18T10:25:20.362708+0000","last_became_active":"2023-12-18T10:25:18.593193+0000","last_became_peered":"2023-12-18T10:25:18.593193+0000","last_unstale":"2023-12-18T10:25:20.362708+0000","last_undegraded":"2023-12-18T10:25:20.362708+0000","last_fullsized":"2023-12-18T10:25:20.362708+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:31.384969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362657+0000","last_change":"2023-12-18T10:25:18.581001+0000","last_active":"2023-12-18T10:25:20.362657+0000","last_peered":"2023-12-18T10:25:20.362657+0000","last_clean":"2023-12-18T10:25:20.362657+0000","last_became_active":"2023-12-18T10:25:18.580702+0000","last_became_peered":"2023-12-18T10:25:18.580702+0000","last_unstale":"2023-12-18T10:25:20.362657+0000","last_undegraded":"2023-12-18T10:25:20.362657+0000","last_fullsized":"2023-12-18T10:25:20.362657+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:05.000600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566226+0000","last_change":"2023-12-18T10:25:18.590525+0000","last_active":"2023-12-18T10:25:19.566226+0000","last_peered":"2023-12-18T10:25:19.566226+0000","last_clean":"2023-12-18T10:25:19.566226+0000","last_became_active":"2023-12-18T10:25:18.590233+0000","last_became_peered":"2023-12-18T10:25:18.590233+0000","last_unstale":"2023-12-18T10:25:19.566226+0000","last_undegraded":"2023-12-18T10:25:19.566226+0000","last_fullsized":"2023-12-18T10:25:19.566226+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:27:19.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364645+0000","last_change":"2023-12-18T10:25:18.592167+0000","last_active":"2023-12-18T10:25:20.364645+0000","last_peered":"2023-12-18T10:25:20.364645+0000","last_clean":"2023-12-18T10:25:20.364645+0000","last_became_active":"2023-12-18T10:25:18.590630+0000","last_became_peered":"2023-12-18T10:25:18.590630+0000","last_unstale":"2023-12-18T10:25:20.364645+0000","last_undegraded":"2023-12-18T10:25:20.364645+0000","last_fullsized":"2023-12-18T10:25:20.364645+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:10:50.244543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566113+0000","last_change":"2023-12-18T10:25:18.589522+0000","last_active":"2023-12-18T10:25:19.566113+0000","last_peered":"2023-12-18T10:25:19.566113+0000","last_clean":"2023-12-18T10:25:19.566113+0000","last_became_active":"2023-12-18T10:25:18.589182+0000","last_became_peered":"2023-12-18T10:25:18.589182+0000","last_unstale":"2023-12-18T10:25:19.566113+0000","last_undegraded":"2023-12-18T10:25:19.566113+0000","last_fullsized":"2023-12-18T10:25:19.566113+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:54:22.565170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364587+0000","last_change":"2023-12-18T10:25:18.579506+0000","last_active":"2023-12-18T10:25:20.364587+0000","last_peered":"2023-12-18T10:25:20.364587+0000","last_clean":"2023-12-18T10:25:20.364587+0000","last_became_active":"2023-12-18T10:25:18.579205+0000","last_became_peered":"2023-12-18T10:25:18.579205+0000","last_unstale":"2023-12-18T10:25:20.364587+0000","last_undegraded":"2023-12-18T10:25:20.364587+0000","last_fullsized":"2023-12-18T10:25:20.364587+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:02:28.250518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318703+0000","last_change":"2023-12-18T10:25:18.593293+0000","last_active":"2023-12-18T10:25:20.318703+0000","last_peered":"2023-12-18T10:25:20.318703+0000","last_clean":"2023-12-18T10:25:20.318703+0000","last_became_active":"2023-12-18T10:25:18.592828+0000","last_became_peered":"2023-12-18T10:25:18.592828+0000","last_unstale":"2023-12-18T10:25:20.318703+0000","last_undegraded":"2023-12-18T10:25:20.318703+0000","last_fullsized":"2023-12-18T10:25:20.318703+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:37:47.715800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295900+0000","last_change":"2023-12-18T10:25:18.589496+0000","last_active":"2023-12-18T10:25:20.295900+0000","last_peered":"2023-12-18T10:25:20.295900+0000","last_clean":"2023-12-18T10:25:20.295900+0000","last_became_active":"2023-12-18T10:25:18.589150+0000","last_became_peered":"2023-12-18T10:25:18.589150+0000","last_unstale":"2023-12-18T10:25:20.295900+0000","last_undegraded":"2023-12-18T10:25:20.295900+0000","last_fullsized":"2023-12-18T10:25:20.295900+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:31.807466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565765+0000","last_change":"2023-12-18T10:25:18.588168+0000","last_active":"2023-12-18T10:25:19.565765+0000","last_peered":"2023-12-18T10:25:19.565765+0000","last_clean":"2023-12-18T10:25:19.565765+0000","last_became_active":"2023-12-18T10:25:18.587806+0000","last_became_peered":"2023-12-18T10:25:18.587806+0000","last_unstale":"2023-12-18T10:25:19.565765+0000","last_undegraded":"2023-12-18T10:25:19.565765+0000","last_fullsized":"2023-12-18T10:25:19.565765+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:56:14.720373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295706+0000","last_change":"2023-12-18T10:25:18.582900+0000","last_active":"2023-12-18T10:25:20.295706+0000","last_peered":"2023-12-18T10:25:20.295706+0000","last_clean":"2023-12-18T10:25:20.295706+0000","last_became_active":"2023-12-18T10:25:18.582639+0000","last_became_peered":"2023-12-18T10:25:18.582639+0000","last_unstale":"2023-12-18T10:25:20.295706+0000","last_undegraded":"2023-12-18T10:25:20.295706+0000","last_fullsized":"2023-12-18T10:25:20.295706+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:55:32.910251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364836+0000","last_change":"2023-12-18T10:25:18.598415+0000","last_active":"2023-12-18T10:25:20.364836+0000","last_peered":"2023-12-18T10:25:20.364836+0000","last_clean":"2023-12-18T10:25:20.364836+0000","last_became_active":"2023-12-18T10:25:18.598122+0000","last_became_peered":"2023-12-18T10:25:18.598122+0000","last_unstale":"2023-12-18T10:25:20.364836+0000","last_undegraded":"2023-12-18T10:25:20.364836+0000","last_fullsized":"2023-12-18T10:25:20.364836+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:39:01.393143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.365141+0000","last_change":"2023-12-18T10:25:18.594542+0000","last_active":"2023-12-18T10:25:20.365141+0000","last_peered":"2023-12-18T10:25:20.365141+0000","last_clean":"2023-12-18T10:25:20.365141+0000","last_became_active":"2023-12-18T10:25:18.594270+0000","last_became_peered":"2023-12-18T10:25:18.594270+0000","last_unstale":"2023-12-18T10:25:20.365141+0000","last_undegraded":"2023-12-18T10:25:20.365141+0000","last_fullsized":"2023-12-18T10:25:20.365141+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:10:43.536993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364755+0000","last_change":"2023-12-18T10:25:18.589423+0000","last_active":"2023-12-18T10:25:20.364755+0000","last_peered":"2023-12-18T10:25:20.364755+0000","last_clean":"2023-12-18T10:25:20.364755+0000","last_became_active":"2023-12-18T10:25:18.589140+0000","last_became_peered":"2023-12-18T10:25:18.589140+0000","last_unstale":"2023-12-18T10:25:20.364755+0000","last_undegraded":"2023-12-18T10:25:20.364755+0000","last_fullsized":"2023-12-18T10:25:20.364755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:05.000600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363280+0000","last_change":"2023-12-18T10:25:18.597867+0000","last_active":"2023-12-18T10:25:20.363280+0000","last_peered":"2023-12-18T10:25:20.363280+0000","last_clean":"2023-12-18T10:25:20.363280+0000","last_became_active":"2023-12-18T10:25:18.597495+0000","last_became_peered":"2023-12-18T10:25:18.597495+0000","last_unstale":"2023-12-18T10:25:20.363280+0000","last_undegraded":"2023-12-18T10:25:20.363280+0000","last_fullsized":"2023-12-18T10:25:20.363280+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:23:19.808841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318699+0000","last_change":"2023-12-18T10:25:18.580831+0000","last_active":"2023-12-18T10:25:20.318699+0000","last_peered":"2023-12-18T10:25:20.318699+0000","last_clean":"2023-12-18T10:25:20.318699+0000","last_became_active":"2023-12-18T10:25:18.578964+0000","last_became_peered":"2023-12-18T10:25:18.578964+0000","last_unstale":"2023-12-18T10:25:20.318699+0000","last_undegraded":"2023-12-18T10:25:20.318699+0000","last_fullsized":"2023-12-18T10:25:20.318699+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:37:55.089493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363847+0000","last_change":"2023-12-18T10:25:18.594215+0000","last_active":"2023-12-18T10:25:20.363847+0000","last_peered":"2023-12-18T10:25:20.363847+0000","last_clean":"2023-12-18T10:25:20.363847+0000","last_became_active":"2023-12-18T10:25:18.593863+0000","last_became_peered":"2023-12-18T10:25:18.593863+0000","last_unstale":"2023-12-18T10:25:20.363847+0000","last_undegraded":"2023-12-18T10:25:20.363847+0000","last_fullsized":"2023-12-18T10:25:20.363847+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:03:21.281143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363027+0000","last_change":"2023-12-18T10:25:18.595424+0000","last_active":"2023-12-18T10:25:20.363027+0000","last_peered":"2023-12-18T10:25:20.363027+0000","last_clean":"2023-12-18T10:25:20.363027+0000","last_became_active":"2023-12-18T10:25:18.594984+0000","last_became_peered":"2023-12-18T10:25:18.594984+0000","last_unstale":"2023-12-18T10:25:20.363027+0000","last_undegraded":"2023-12-18T10:25:20.363027+0000","last_fullsized":"2023-12-18T10:25:20.363027+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:12.571440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318598+0000","last_change":"2023-12-18T10:25:18.574996+0000","last_active":"2023-12-18T10:25:20.318598+0000","last_peered":"2023-12-18T10:25:20.318598+0000","last_clean":"2023-12-18T10:25:20.318598+0000","last_became_active":"2023-12-18T10:25:18.574742+0000","last_became_peered":"2023-12-18T10:25:18.574742+0000","last_unstale":"2023-12-18T10:25:20.318598+0000","last_undegraded":"2023-12-18T10:25:20.318598+0000","last_fullsized":"2023-12-18T10:25:20.318598+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:00:58.261581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565851+0000","last_change":"2023-12-18T10:25:18.587846+0000","last_active":"2023-12-18T10:25:19.565851+0000","last_peered":"2023-12-18T10:25:19.565851+0000","last_clean":"2023-12-18T10:25:19.565851+0000","last_became_active":"2023-12-18T10:25:18.587584+0000","last_became_peered":"2023-12-18T10:25:18.587584+0000","last_unstale":"2023-12-18T10:25:19.565851+0000","last_undegraded":"2023-12-18T10:25:19.565851+0000","last_fullsized":"2023-12-18T10:25:19.565851+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:56:02.496356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"104'4","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.596375+0000","last_change":"2023-12-18T10:25:18.179560+0000","last_active":"2023-12-18T10:25:18.596375+0000","last_peered":"2023-12-18T10:25:18.596375+0000","last_clean":"2023-12-18T10:25:18.596375+0000","last_became_active":"2023-12-18T10:25:18.179222+0000","last_became_peered":"2023-12-18T10:25:18.179222+0000","last_unstale":"2023-12-18T10:25:18.596375+0000","last_undegraded":"2023-12-18T10:25:18.596375+0000","last_fullsized":"2023-12-18T10:25:18.596375+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:33.405328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318525+0000","last_change":"2023-12-18T10:25:18.571453+0000","last_active":"2023-12-18T10:25:20.318525+0000","last_peered":"2023-12-18T10:25:20.318525+0000","last_clean":"2023-12-18T10:25:20.318525+0000","last_became_active":"2023-12-18T10:25:18.571149+0000","last_became_peered":"2023-12-18T10:25:18.571149+0000","last_unstale":"2023-12-18T10:25:20.318525+0000","last_undegraded":"2023-12-18T10:25:20.318525+0000","last_fullsized":"2023-12-18T10:25:20.318525+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:45:58.484999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.573632+0000","last_change":"2023-12-18T10:25:18.185482+0000","last_active":"2023-12-18T10:25:18.573632+0000","last_peered":"2023-12-18T10:25:18.573632+0000","last_clean":"2023-12-18T10:25:18.573632+0000","last_became_active":"2023-12-18T10:25:18.184386+0000","last_became_peered":"2023-12-18T10:25:18.184386+0000","last_unstale":"2023-12-18T10:25:18.573632+0000","last_undegraded":"2023-12-18T10:25:18.573632+0000","last_fullsized":"2023-12-18T10:25:18.573632+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:39.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363942+0000","last_change":"2023-12-18T10:25:18.583966+0000","last_active":"2023-12-18T10:25:20.363942+0000","last_peered":"2023-12-18T10:25:20.363942+0000","last_clean":"2023-12-18T10:25:20.363942+0000","last_became_active":"2023-12-18T10:25:18.583436+0000","last_became_peered":"2023-12-18T10:25:18.583436+0000","last_unstale":"2023-12-18T10:25:20.363942+0000","last_undegraded":"2023-12-18T10:25:20.363942+0000","last_fullsized":"2023-12-18T10:25:20.363942+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:56.928413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.588634+0000","last_change":"2023-12-18T10:25:18.177306+0000","last_active":"2023-12-18T10:25:18.588634+0000","last_peered":"2023-12-18T10:25:18.588634+0000","last_clean":"2023-12-18T10:25:18.588634+0000","last_became_active":"2023-12-18T10:25:18.177039+0000","last_became_peered":"2023-12-18T10:25:18.177039+0000","last_unstale":"2023-12-18T10:25:18.588634+0000","last_undegraded":"2023-12-18T10:25:18.588634+0000","last_fullsized":"2023-12-18T10:25:18.588634+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:59:11.931460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364484+0000","last_change":"2023-12-18T10:25:18.590717+0000","last_active":"2023-12-18T10:25:20.364484+0000","last_peered":"2023-12-18T10:25:20.364484+0000","last_clean":"2023-12-18T10:25:20.364484+0000","last_became_active":"2023-12-18T10:25:18.590120+0000","last_became_peered":"2023-12-18T10:25:18.590120+0000","last_unstale":"2023-12-18T10:25:20.364484+0000","last_undegraded":"2023-12-18T10:25:20.364484+0000","last_fullsized":"2023-12-18T10:25:20.364484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:00:58.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.585225+0000","last_change":"2023-12-18T10:25:18.171420+0000","last_active":"2023-12-18T10:25:18.585225+0000","last_peered":"2023-12-18T10:25:18.585225+0000","last_clean":"2023-12-18T10:25:18.585225+0000","last_became_active":"2023-12-18T10:25:18.171134+0000","last_became_peered":"2023-12-18T10:25:18.171134+0000","last_unstale":"2023-12-18T10:25:18.585225+0000","last_undegraded":"2023-12-18T10:25:18.585225+0000","last_fullsized":"2023-12-18T10:25:18.585225+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:57:53.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567095+0000","last_change":"2023-12-18T10:25:18.585845+0000","last_active":"2023-12-18T10:25:19.567095+0000","last_peered":"2023-12-18T10:25:19.567095+0000","last_clean":"2023-12-18T10:25:19.567095+0000","last_became_active":"2023-12-18T10:25:18.584027+0000","last_became_peered":"2023-12-18T10:25:18.584027+0000","last_unstale":"2023-12-18T10:25:19.567095+0000","last_undegraded":"2023-12-18T10:25:19.567095+0000","last_fullsized":"2023-12-18T10:25:19.567095+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:26:36.885974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.591539+0000","last_change":"2023-12-18T10:25:18.184300+0000","last_active":"2023-12-18T10:25:18.591539+0000","last_peered":"2023-12-18T10:25:18.591539+0000","last_clean":"2023-12-18T10:25:18.591539+0000","last_became_active":"2023-12-18T10:25:18.183998+0000","last_became_peered":"2023-12-18T10:25:18.183998+0000","last_unstale":"2023-12-18T10:25:18.591539+0000","last_undegraded":"2023-12-18T10:25:18.591539+0000","last_fullsized":"2023-12-18T10:25:18.591539+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:31:19.235853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566203+0000","last_change":"2023-12-18T10:25:18.590578+0000","last_active":"2023-12-18T10:25:19.566203+0000","last_peered":"2023-12-18T10:25:19.566203+0000","last_clean":"2023-12-18T10:25:19.566203+0000","last_became_active":"2023-12-18T10:25:18.590316+0000","last_became_peered":"2023-12-18T10:25:18.590316+0000","last_unstale":"2023-12-18T10:25:19.566203+0000","last_undegraded":"2023-12-18T10:25:19.566203+0000","last_fullsized":"2023-12-18T10:25:19.566203+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:56.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.594022+0000","last_change":"2023-12-18T10:25:18.175249+0000","last_active":"2023-12-18T10:25:18.594022+0000","last_peered":"2023-12-18T10:25:18.594022+0000","last_clean":"2023-12-18T10:25:18.594022+0000","last_became_active":"2023-12-18T10:25:18.174954+0000","last_became_peered":"2023-12-18T10:25:18.174954+0000","last_unstale":"2023-12-18T10:25:18.594022+0000","last_undegraded":"2023-12-18T10:25:18.594022+0000","last_fullsized":"2023-12-18T10:25:18.594022+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:23:18.806188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364742+0000","last_change":"2023-12-18T10:25:18.600213+0000","last_active":"2023-12-18T10:25:20.364742+0000","last_peered":"2023-12-18T10:25:20.364742+0000","last_clean":"2023-12-18T10:25:20.364742+0000","last_became_active":"2023-12-18T10:25:18.598593+0000","last_became_peered":"2023-12-18T10:25:18.598593+0000","last_unstale":"2023-12-18T10:25:20.364742+0000","last_undegraded":"2023-12-18T10:25:20.364742+0000","last_fullsized":"2023-12-18T10:25:20.364742+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:18:11.312358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569221+0000","last_change":"2023-12-18T10:25:18.176746+0000","last_active":"2023-12-18T10:25:18.569221+0000","last_peered":"2023-12-18T10:25:18.569221+0000","last_clean":"2023-12-18T10:25:18.569221+0000","last_became_active":"2023-12-18T10:25:18.176486+0000","last_became_peered":"2023-12-18T10:25:18.176486+0000","last_unstale":"2023-12-18T10:25:18.569221+0000","last_undegraded":"2023-12-18T10:25:18.569221+0000","last_fullsized":"2023-12-18T10:25:18.569221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:07:06.621984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567221+0000","last_change":"2023-12-18T10:25:18.587747+0000","last_active":"2023-12-18T10:25:19.567221+0000","last_peered":"2023-12-18T10:25:19.567221+0000","last_clean":"2023-12-18T10:25:19.567221+0000","last_became_active":"2023-12-18T10:25:18.587487+0000","last_became_peered":"2023-12-18T10:25:18.587487+0000","last_unstale":"2023-12-18T10:25:19.567221+0000","last_undegraded":"2023-12-18T10:25:19.567221+0000","last_fullsized":"2023-12-18T10:25:19.567221+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:58:14.653117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.571712+0000","last_change":"2023-12-18T10:25:18.179725+0000","last_active":"2023-12-18T10:25:18.571712+0000","last_peered":"2023-12-18T10:25:18.571712+0000","last_clean":"2023-12-18T10:25:18.571712+0000","last_became_active":"2023-12-18T10:25:18.179456+0000","last_became_peered":"2023-12-18T10:25:18.179456+0000","last_unstale":"2023-12-18T10:25:18.571712+0000","last_undegraded":"2023-12-18T10:25:18.571712+0000","last_fullsized":"2023-12-18T10:25:18.571712+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:00:57.260829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565735+0000","last_change":"2023-12-18T10:25:18.590304+0000","last_active":"2023-12-18T10:25:19.565735+0000","last_peered":"2023-12-18T10:25:19.565735+0000","last_clean":"2023-12-18T10:25:19.565735+0000","last_became_active":"2023-12-18T10:25:18.590015+0000","last_became_peered":"2023-12-18T10:25:18.590015+0000","last_unstale":"2023-12-18T10:25:19.565735+0000","last_undegraded":"2023-12-18T10:25:19.565735+0000","last_fullsized":"2023-12-18T10:25:19.565735+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:31:28.237496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.572715+0000","last_change":"2023-12-18T10:25:18.176167+0000","last_active":"2023-12-18T10:25:18.572715+0000","last_peered":"2023-12-18T10:25:18.572715+0000","last_clean":"2023-12-18T10:25:18.572715+0000","last_became_active":"2023-12-18T10:25:18.175877+0000","last_became_peered":"2023-12-18T10:25:18.175877+0000","last_unstale":"2023-12-18T10:25:18.572715+0000","last_undegraded":"2023-12-18T10:25:18.572715+0000","last_fullsized":"2023-12-18T10:25:18.572715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:28:06.452447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295829+0000","last_change":"2023-12-18T10:25:18.574476+0000","last_active":"2023-12-18T10:25:20.295829+0000","last_peered":"2023-12-18T10:25:20.295829+0000","last_clean":"2023-12-18T10:25:20.295829+0000","last_became_active":"2023-12-18T10:25:18.574237+0000","last_became_peered":"2023-12-18T10:25:18.574237+0000","last_unstale":"2023-12-18T10:25:20.295829+0000","last_undegraded":"2023-12-18T10:25:20.295829+0000","last_fullsized":"2023-12-18T10:25:20.295829+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:41:35.424293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.563039+0000","last_change":"2023-12-18T10:25:18.170536+0000","last_active":"2023-12-18T10:25:18.563039+0000","last_peered":"2023-12-18T10:25:18.563039+0000","last_clean":"2023-12-18T10:25:18.563039+0000","last_became_active":"2023-12-18T10:25:18.169864+0000","last_became_peered":"2023-12-18T10:25:18.169864+0000","last_unstale":"2023-12-18T10:25:18.563039+0000","last_undegraded":"2023-12-18T10:25:18.563039+0000","last_fullsized":"2023-12-18T10:25:18.563039+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:42:45.681860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318662+0000","last_change":"2023-12-18T10:25:18.582635+0000","last_active":"2023-12-18T10:25:20.318662+0000","last_peered":"2023-12-18T10:25:20.318662+0000","last_clean":"2023-12-18T10:25:20.318662+0000","last_became_active":"2023-12-18T10:25:18.580689+0000","last_became_peered":"2023-12-18T10:25:18.580689+0000","last_unstale":"2023-12-18T10:25:20.318662+0000","last_undegraded":"2023-12-18T10:25:20.318662+0000","last_fullsized":"2023-12-18T10:25:20.318662+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:43:33.766934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"104'3","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.593278+0000","last_change":"2023-12-18T10:25:18.182831+0000","last_active":"2023-12-18T10:25:18.593278+0000","last_peered":"2023-12-18T10:25:18.593278+0000","last_clean":"2023-12-18T10:25:18.593278+0000","last_became_active":"2023-12-18T10:25:18.182530+0000","last_became_peered":"2023-12-18T10:25:18.182530+0000","last_unstale":"2023-12-18T10:25:18.593278+0000","last_undegraded":"2023-12-18T10:25:18.593278+0000","last_fullsized":"2023-12-18T10:25:18.593278+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:30.804813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.296018+0000","last_change":"2023-12-18T10:25:18.574749+0000","last_active":"2023-12-18T10:25:20.296018+0000","last_peered":"2023-12-18T10:25:20.296018+0000","last_clean":"2023-12-18T10:25:20.296018+0000","last_became_active":"2023-12-18T10:25:18.574501+0000","last_became_peered":"2023-12-18T10:25:18.574501+0000","last_unstale":"2023-12-18T10:25:20.296018+0000","last_undegraded":"2023-12-18T10:25:20.296018+0000","last_fullsized":"2023-12-18T10:25:20.296018+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:11.122591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"104'6","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.603262+0000","last_change":"2023-12-18T10:25:18.177009+0000","last_active":"2023-12-18T10:25:18.603262+0000","last_peered":"2023-12-18T10:25:18.603262+0000","last_clean":"2023-12-18T10:25:18.603262+0000","last_became_active":"2023-12-18T10:25:18.176711+0000","last_became_peered":"2023-12-18T10:25:18.176711+0000","last_unstale":"2023-12-18T10:25:18.603262+0000","last_undegraded":"2023-12-18T10:25:18.603262+0000","last_fullsized":"2023-12-18T10:25:18.603262+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:20.134299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364202+0000","last_change":"2023-12-18T10:25:18.589073+0000","last_active":"2023-12-18T10:25:20.364202+0000","last_peered":"2023-12-18T10:25:20.364202+0000","last_clean":"2023-12-18T10:25:20.364202+0000","last_became_active":"2023-12-18T10:25:18.588803+0000","last_became_peered":"2023-12-18T10:25:18.588803+0000","last_unstale":"2023-12-18T10:25:20.364202+0000","last_undegraded":"2023-12-18T10:25:20.364202+0000","last_fullsized":"2023-12-18T10:25:20.364202+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:34.407981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.588752+0000","last_change":"2023-12-18T10:25:18.186311+0000","last_active":"2023-12-18T10:25:18.588752+0000","last_peered":"2023-12-18T10:25:18.588752+0000","last_clean":"2023-12-18T10:25:18.588752+0000","last_became_active":"2023-12-18T10:25:18.186032+0000","last_became_peered":"2023-12-18T10:25:18.186032+0000","last_unstale":"2023-12-18T10:25:18.588752+0000","last_undegraded":"2023-12-18T10:25:18.588752+0000","last_fullsized":"2023-12-18T10:25:18.588752+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:46:16.979293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363712+0000","last_change":"2023-12-18T10:25:18.595044+0000","last_active":"2023-12-18T10:25:20.363712+0000","last_peered":"2023-12-18T10:25:20.363712+0000","last_clean":"2023-12-18T10:25:20.363712+0000","last_became_active":"2023-12-18T10:25:18.594496+0000","last_became_peered":"2023-12-18T10:25:18.594496+0000","last_unstale":"2023-12-18T10:25:20.363712+0000","last_undegraded":"2023-12-18T10:25:20.363712+0000","last_fullsized":"2023-12-18T10:25:20.363712+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:55:58.079145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.571971+0000","last_change":"2023-12-18T10:25:18.180549+0000","last_active":"2023-12-18T10:25:18.571971+0000","last_peered":"2023-12-18T10:25:18.571971+0000","last_clean":"2023-12-18T10:25:18.571971+0000","last_became_active":"2023-12-18T10:25:18.180285+0000","last_became_peered":"2023-12-18T10:25:18.180285+0000","last_unstale":"2023-12-18T10:25:18.571971+0000","last_undegraded":"2023-12-18T10:25:18.571971+0000","last_fullsized":"2023-12-18T10:25:18.571971+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:55:31.907598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318663+0000","last_change":"2023-12-18T10:25:18.576153+0000","last_active":"2023-12-18T10:25:20.318663+0000","last_peered":"2023-12-18T10:25:20.318663+0000","last_clean":"2023-12-18T10:25:20.318663+0000","last_became_active":"2023-12-18T10:25:18.574719+0000","last_became_peered":"2023-12-18T10:25:18.574719+0000","last_unstale":"2023-12-18T10:25:20.318663+0000","last_undegraded":"2023-12-18T10:25:20.318663+0000","last_fullsized":"2023-12-18T10:25:20.318663+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:43:33.433576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558615+0000","last_change":"2023-12-18T10:25:18.185928+0000","last_active":"2023-12-18T10:25:18.558615+0000","last_peered":"2023-12-18T10:25:18.558615+0000","last_clean":"2023-12-18T10:25:18.558615+0000","last_became_active":"2023-12-18T10:25:18.185598+0000","last_became_peered":"2023-12-18T10:25:18.185598+0000","last_unstale":"2023-12-18T10:25:18.558615+0000","last_undegraded":"2023-12-18T10:25:18.558615+0000","last_fullsized":"2023-12-18T10:25:18.558615+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:37.231695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566374+0000","last_change":"2023-12-18T10:25:18.596383+0000","last_active":"2023-12-18T10:25:19.566374+0000","last_peered":"2023-12-18T10:25:19.566374+0000","last_clean":"2023-12-18T10:25:19.566374+0000","last_became_active":"2023-12-18T10:25:18.595891+0000","last_became_peered":"2023-12-18T10:25:18.595891+0000","last_unstale":"2023-12-18T10:25:19.566374+0000","last_undegraded":"2023-12-18T10:25:19.566374+0000","last_fullsized":"2023-12-18T10:25:19.566374+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:51:48.242261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"104'8","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.601731+0000","last_change":"2023-12-18T10:25:18.174398+0000","last_active":"2023-12-18T10:25:18.601731+0000","last_peered":"2023-12-18T10:25:18.601731+0000","last_clean":"2023-12-18T10:25:18.601731+0000","last_became_active":"2023-12-18T10:25:18.174088+0000","last_became_peered":"2023-12-18T10:25:18.174088+0000","last_unstale":"2023-12-18T10:25:18.601731+0000","last_undegraded":"2023-12-18T10:25:18.601731+0000","last_fullsized":"2023-12-18T10:25:18.601731+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:52:23.176182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318721+0000","last_change":"2023-12-18T10:25:18.568705+0000","last_active":"2023-12-18T10:25:20.318721+0000","last_peered":"2023-12-18T10:25:20.318721+0000","last_clean":"2023-12-18T10:25:20.318721+0000","last_became_active":"2023-12-18T10:25:18.568399+0000","last_became_peered":"2023-12-18T10:25:18.568399+0000","last_unstale":"2023-12-18T10:25:20.318721+0000","last_undegraded":"2023-12-18T10:25:20.318721+0000","last_fullsized":"2023-12-18T10:25:20.318721+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:57:11.481895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.596897+0000","last_change":"2023-12-18T10:25:18.179664+0000","last_active":"2023-12-18T10:25:18.596897+0000","last_peered":"2023-12-18T10:25:18.596897+0000","last_clean":"2023-12-18T10:25:18.596897+0000","last_became_active":"2023-12-18T10:25:18.179355+0000","last_became_peered":"2023-12-18T10:25:18.179355+0000","last_unstale":"2023-12-18T10:25:18.596897+0000","last_undegraded":"2023-12-18T10:25:18.596897+0000","last_fullsized":"2023-12-18T10:25:18.596897+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:21:32.694099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363406+0000","last_change":"2023-12-18T10:25:18.593608+0000","last_active":"2023-12-18T10:25:20.363406+0000","last_peered":"2023-12-18T10:25:20.363406+0000","last_clean":"2023-12-18T10:25:20.363406+0000","last_became_active":"2023-12-18T10:25:18.593047+0000","last_became_peered":"2023-12-18T10:25:18.593047+0000","last_unstale":"2023-12-18T10:25:20.363406+0000","last_undegraded":"2023-12-18T10:25:20.363406+0000","last_fullsized":"2023-12-18T10:25:20.363406+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:46:20.032305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582725+0000","last_change":"2023-12-18T10:25:18.179329+0000","last_active":"2023-12-18T10:25:18.582725+0000","last_peered":"2023-12-18T10:25:18.582725+0000","last_clean":"2023-12-18T10:25:18.582725+0000","last_became_active":"2023-12-18T10:25:18.179055+0000","last_became_peered":"2023-12-18T10:25:18.179055+0000","last_unstale":"2023-12-18T10:25:18.582725+0000","last_undegraded":"2023-12-18T10:25:18.582725+0000","last_fullsized":"2023-12-18T10:25:18.582725+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:10.119938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295900+0000","last_change":"2023-12-18T10:25:18.580954+0000","last_active":"2023-12-18T10:25:20.295900+0000","last_peered":"2023-12-18T10:25:20.295900+0000","last_clean":"2023-12-18T10:25:20.295900+0000","last_became_active":"2023-12-18T10:25:18.580048+0000","last_became_peered":"2023-12-18T10:25:18.580048+0000","last_unstale":"2023-12-18T10:25:20.295900+0000","last_undegraded":"2023-12-18T10:25:20.295900+0000","last_fullsized":"2023-12-18T10:25:20.295900+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:27:35.783756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582799+0000","last_change":"2023-12-18T10:25:18.185324+0000","last_active":"2023-12-18T10:25:18.582799+0000","last_peered":"2023-12-18T10:25:18.582799+0000","last_clean":"2023-12-18T10:25:18.582799+0000","last_became_active":"2023-12-18T10:25:18.184982+0000","last_became_peered":"2023-12-18T10:25:18.184982+0000","last_unstale":"2023-12-18T10:25:18.582799+0000","last_undegraded":"2023-12-18T10:25:18.582799+0000","last_fullsized":"2023-12-18T10:25:18.582799+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:55:57.076492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565965+0000","last_change":"2023-12-18T10:25:18.587216+0000","last_active":"2023-12-18T10:25:19.565965+0000","last_peered":"2023-12-18T10:25:19.565965+0000","last_clean":"2023-12-18T10:25:19.565965+0000","last_became_active":"2023-12-18T10:25:18.586956+0000","last_became_peered":"2023-12-18T10:25:18.586956+0000","last_unstale":"2023-12-18T10:25:19.565965+0000","last_undegraded":"2023-12-18T10:25:19.565965+0000","last_fullsized":"2023-12-18T10:25:19.565965+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:14:13.023201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.583171+0000","last_change":"2023-12-18T10:25:18.184922+0000","last_active":"2023-12-18T10:25:18.583171+0000","last_peered":"2023-12-18T10:25:18.583171+0000","last_clean":"2023-12-18T10:25:18.583171+0000","last_became_active":"2023-12-18T10:25:18.184665+0000","last_became_peered":"2023-12-18T10:25:18.184665+0000","last_unstale":"2023-12-18T10:25:18.583171+0000","last_undegraded":"2023-12-18T10:25:18.583171+0000","last_fullsized":"2023-12-18T10:25:18.583171+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:16.763875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566176+0000","last_change":"2023-12-18T10:25:18.578960+0000","last_active":"2023-12-18T10:25:19.566176+0000","last_peered":"2023-12-18T10:25:19.566176+0000","last_clean":"2023-12-18T10:25:19.566176+0000","last_became_active":"2023-12-18T10:25:18.578139+0000","last_became_peered":"2023-12-18T10:25:18.578139+0000","last_unstale":"2023-12-18T10:25:19.566176+0000","last_undegraded":"2023-12-18T10:25:19.566176+0000","last_fullsized":"2023-12-18T10:25:19.566176+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:51:58.213095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558590+0000","last_change":"2023-12-18T10:25:18.190645+0000","last_active":"2023-12-18T10:25:18.558590+0000","last_peered":"2023-12-18T10:25:18.558590+0000","last_clean":"2023-12-18T10:25:18.558590+0000","last_became_active":"2023-12-18T10:25:18.190245+0000","last_became_peered":"2023-12-18T10:25:18.190245+0000","last_unstale":"2023-12-18T10:25:18.558590+0000","last_undegraded":"2023-12-18T10:25:18.558590+0000","last_fullsized":"2023-12-18T10:25:18.558590+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:33:49.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567138+0000","last_change":"2023-12-18T10:25:18.591930+0000","last_active":"2023-12-18T10:25:19.567138+0000","last_peered":"2023-12-18T10:25:19.567138+0000","last_clean":"2023-12-18T10:25:19.567138+0000","last_became_active":"2023-12-18T10:25:18.591616+0000","last_became_peered":"2023-12-18T10:25:18.591616+0000","last_unstale":"2023-12-18T10:25:19.567138+0000","last_undegraded":"2023-12-18T10:25:19.567138+0000","last_fullsized":"2023-12-18T10:25:19.567138+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:07:07.624637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582422+0000","last_change":"2023-12-18T10:25:18.178584+0000","last_active":"2023-12-18T10:25:18.582422+0000","last_peered":"2023-12-18T10:25:18.582422+0000","last_clean":"2023-12-18T10:25:18.582422+0000","last_became_active":"2023-12-18T10:25:18.178315+0000","last_became_peered":"2023-12-18T10:25:18.178315+0000","last_unstale":"2023-12-18T10:25:18.582422+0000","last_undegraded":"2023-12-18T10:25:18.582422+0000","last_fullsized":"2023-12-18T10:25:18.582422+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:53:14.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318719+0000","last_change":"2023-12-18T10:25:18.581238+0000","last_active":"2023-12-18T10:25:20.318719+0000","last_peered":"2023-12-18T10:25:20.318719+0000","last_clean":"2023-12-18T10:25:20.318719+0000","last_became_active":"2023-12-18T10:25:18.581012+0000","last_became_peered":"2023-12-18T10:25:18.581012+0000","last_unstale":"2023-12-18T10:25:20.318719+0000","last_undegraded":"2023-12-18T10:25:20.318719+0000","last_fullsized":"2023-12-18T10:25:20.318719+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:47.246006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.559372+0000","last_change":"2023-12-18T10:25:18.188393+0000","last_active":"2023-12-18T10:25:18.559372+0000","last_peered":"2023-12-18T10:25:18.559372+0000","last_clean":"2023-12-18T10:25:18.559372+0000","last_became_active":"2023-12-18T10:25:18.188118+0000","last_became_peered":"2023-12-18T10:25:18.188118+0000","last_unstale":"2023-12-18T10:25:18.559372+0000","last_undegraded":"2023-12-18T10:25:18.559372+0000","last_fullsized":"2023-12-18T10:25:18.559372+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:56:58.730035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565641+0000","last_change":"2023-12-18T10:25:18.584161+0000","last_active":"2023-12-18T10:25:19.565641+0000","last_peered":"2023-12-18T10:25:19.565641+0000","last_clean":"2023-12-18T10:25:19.565641+0000","last_became_active":"2023-12-18T10:25:18.583920+0000","last_became_peered":"2023-12-18T10:25:18.583920+0000","last_unstale":"2023-12-18T10:25:19.565641+0000","last_undegraded":"2023-12-18T10:25:19.565641+0000","last_fullsized":"2023-12-18T10:25:19.565641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:00:29.240668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.580227+0000","last_change":"2023-12-18T10:25:18.186278+0000","last_active":"2023-12-18T10:25:18.580227+0000","last_peered":"2023-12-18T10:25:18.580227+0000","last_clean":"2023-12-18T10:25:18.580227+0000","last_became_active":"2023-12-18T10:25:18.185982+0000","last_became_peered":"2023-12-18T10:25:18.185982+0000","last_unstale":"2023-12-18T10:25:18.580227+0000","last_undegraded":"2023-12-18T10:25:18.580227+0000","last_fullsized":"2023-12-18T10:25:18.580227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:46:19.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363002+0000","last_change":"2023-12-18T10:25:18.586305+0000","last_active":"2023-12-18T10:25:20.363002+0000","last_peered":"2023-12-18T10:25:20.363002+0000","last_clean":"2023-12-18T10:25:20.363002+0000","last_became_active":"2023-12-18T10:25:18.586001+0000","last_became_peered":"2023-12-18T10:25:18.586001+0000","last_unstale":"2023-12-18T10:25:20.363002+0000","last_undegraded":"2023-12-18T10:25:20.363002+0000","last_fullsized":"2023-12-18T10:25:20.363002+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:40:28.778204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.563136+0000","last_change":"2023-12-18T10:25:18.176698+0000","last_active":"2023-12-18T10:25:18.563136+0000","last_peered":"2023-12-18T10:25:18.563136+0000","last_clean":"2023-12-18T10:25:18.563136+0000","last_became_active":"2023-12-18T10:25:18.176184+0000","last_became_peered":"2023-12-18T10:25:18.176184+0000","last_unstale":"2023-12-18T10:25:18.563136+0000","last_undegraded":"2023-12-18T10:25:18.563136+0000","last_fullsized":"2023-12-18T10:25:18.563136+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:18:02.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566897+0000","last_change":"2023-12-18T10:25:18.591625+0000","last_active":"2023-12-18T10:25:19.566897+0000","last_peered":"2023-12-18T10:25:19.566897+0000","last_clean":"2023-12-18T10:25:19.566897+0000","last_became_active":"2023-12-18T10:25:18.591368+0000","last_became_peered":"2023-12-18T10:25:18.591368+0000","last_unstale":"2023-12-18T10:25:19.566897+0000","last_undegraded":"2023-12-18T10:25:19.566897+0000","last_fullsized":"2023-12-18T10:25:19.566897+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:59:12.934113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.580264+0000","last_change":"2023-12-18T10:25:18.184247+0000","last_active":"2023-12-18T10:25:18.580264+0000","last_peered":"2023-12-18T10:25:18.580264+0000","last_clean":"2023-12-18T10:25:18.580264+0000","last_became_active":"2023-12-18T10:25:18.183040+0000","last_became_peered":"2023-12-18T10:25:18.183040+0000","last_unstale":"2023-12-18T10:25:18.580264+0000","last_undegraded":"2023-12-18T10:25:18.580264+0000","last_fullsized":"2023-12-18T10:25:18.580264+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:19.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364978+0000","last_change":"2023-12-18T10:25:18.590958+0000","last_active":"2023-12-18T10:25:20.364978+0000","last_peered":"2023-12-18T10:25:20.364978+0000","last_clean":"2023-12-18T10:25:20.364978+0000","last_became_active":"2023-12-18T10:25:18.590420+0000","last_became_peered":"2023-12-18T10:25:18.590420+0000","last_unstale":"2023-12-18T10:25:20.364978+0000","last_undegraded":"2023-12-18T10:25:20.364978+0000","last_fullsized":"2023-12-18T10:25:20.364978+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:31.384969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.572242+0000","last_change":"2023-12-18T10:25:18.183648+0000","last_active":"2023-12-18T10:25:18.572242+0000","last_peered":"2023-12-18T10:25:18.572242+0000","last_clean":"2023-12-18T10:25:18.572242+0000","last_became_active":"2023-12-18T10:25:18.183338+0000","last_became_peered":"2023-12-18T10:25:18.183338+0000","last_unstale":"2023-12-18T10:25:18.572242+0000","last_undegraded":"2023-12-18T10:25:18.572242+0000","last_fullsized":"2023-12-18T10:25:18.572242+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:11.568787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318790+0000","last_change":"2023-12-18T10:25:18.582814+0000","last_active":"2023-12-18T10:25:20.318790+0000","last_peered":"2023-12-18T10:25:20.318790+0000","last_clean":"2023-12-18T10:25:20.318790+0000","last_became_active":"2023-12-18T10:25:18.581107+0000","last_became_peered":"2023-12-18T10:25:18.581107+0000","last_unstale":"2023-12-18T10:25:20.318790+0000","last_undegraded":"2023-12-18T10:25:20.318790+0000","last_fullsized":"2023-12-18T10:25:20.318790+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:38:23.561988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569175+0000","last_change":"2023-12-18T10:25:18.173996+0000","last_active":"2023-12-18T10:25:18.569175+0000","last_peered":"2023-12-18T10:25:18.569175+0000","last_clean":"2023-12-18T10:25:18.569175+0000","last_became_active":"2023-12-18T10:25:18.173699+0000","last_became_peered":"2023-12-18T10:25:18.173699+0000","last_unstale":"2023-12-18T10:25:18.569175+0000","last_undegraded":"2023-12-18T10:25:18.569175+0000","last_fullsized":"2023-12-18T10:25:18.569175+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:44:44.024501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318671+0000","last_change":"2023-12-18T10:25:18.585426+0000","last_active":"2023-12-18T10:25:20.318671+0000","last_peered":"2023-12-18T10:25:20.318671+0000","last_clean":"2023-12-18T10:25:20.318671+0000","last_became_active":"2023-12-18T10:25:18.580594+0000","last_became_peered":"2023-12-18T10:25:18.580594+0000","last_unstale":"2023-12-18T10:25:20.318671+0000","last_undegraded":"2023-12-18T10:25:20.318671+0000","last_fullsized":"2023-12-18T10:25:20.318671+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:38:14.196425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558747+0000","last_change":"2023-12-18T10:25:18.190190+0000","last_active":"2023-12-18T10:25:18.558747+0000","last_peered":"2023-12-18T10:25:18.558747+0000","last_clean":"2023-12-18T10:25:18.558747+0000","last_became_active":"2023-12-18T10:25:18.189895+0000","last_became_peered":"2023-12-18T10:25:18.189895+0000","last_unstale":"2023-12-18T10:25:18.558747+0000","last_undegraded":"2023-12-18T10:25:18.558747+0000","last_fullsized":"2023-12-18T10:25:18.558747+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:41:07.781582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364893+0000","last_change":"2023-12-18T10:25:18.590562+0000","last_active":"2023-12-18T10:25:20.364893+0000","last_peered":"2023-12-18T10:25:20.364893+0000","last_clean":"2023-12-18T10:25:20.364893+0000","last_became_active":"2023-12-18T10:25:18.590295+0000","last_became_peered":"2023-12-18T10:25:18.590295+0000","last_unstale":"2023-12-18T10:25:20.364893+0000","last_undegraded":"2023-12-18T10:25:20.364893+0000","last_fullsized":"2023-12-18T10:25:20.364893+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:53:12.765081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582516+0000","last_change":"2023-12-18T10:25:18.186738+0000","last_active":"2023-12-18T10:25:18.582516+0000","last_peered":"2023-12-18T10:25:18.582516+0000","last_clean":"2023-12-18T10:25:18.582516+0000","last_became_active":"2023-12-18T10:25:18.186523+0000","last_became_peered":"2023-12-18T10:25:18.186523+0000","last_unstale":"2023-12-18T10:25:18.582516+0000","last_undegraded":"2023-12-18T10:25:18.582516+0000","last_fullsized":"2023-12-18T10:25:18.582516+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:48.530491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364891+0000","last_change":"2023-12-18T10:25:18.595651+0000","last_active":"2023-12-18T10:25:20.364891+0000","last_peered":"2023-12-18T10:25:20.364891+0000","last_clean":"2023-12-18T10:25:20.364891+0000","last_became_active":"2023-12-18T10:25:18.595329+0000","last_became_peered":"2023-12-18T10:25:18.595329+0000","last_unstale":"2023-12-18T10:25:20.364891+0000","last_undegraded":"2023-12-18T10:25:20.364891+0000","last_fullsized":"2023-12-18T10:25:20.364891+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:37:43.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.559436+0000","last_change":"2023-12-18T10:25:18.186677+0000","last_active":"2023-12-18T10:25:18.559436+0000","last_peered":"2023-12-18T10:25:18.559436+0000","last_clean":"2023-12-18T10:25:18.559436+0000","last_became_active":"2023-12-18T10:25:18.186409+0000","last_became_peered":"2023-12-18T10:25:18.186409+0000","last_unstale":"2023-12-18T10:25:18.559436+0000","last_undegraded":"2023-12-18T10:25:18.559436+0000","last_fullsized":"2023-12-18T10:25:18.559436+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:01:55.510810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364295+0000","last_change":"2023-12-18T10:25:18.592647+0000","last_active":"2023-12-18T10:25:20.364295+0000","last_peered":"2023-12-18T10:25:20.364295+0000","last_clean":"2023-12-18T10:25:20.364295+0000","last_became_active":"2023-12-18T10:25:18.592388+0000","last_became_peered":"2023-12-18T10:25:18.592388+0000","last_unstale":"2023-12-18T10:25:20.364295+0000","last_undegraded":"2023-12-18T10:25:20.364295+0000","last_fullsized":"2023-12-18T10:25:20.364295+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:37.244002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.584202+0000","last_change":"2023-12-18T10:25:18.188528+0000","last_active":"2023-12-18T10:25:18.584202+0000","last_peered":"2023-12-18T10:25:18.584202+0000","last_clean":"2023-12-18T10:25:18.584202+0000","last_became_active":"2023-12-18T10:25:18.188173+0000","last_became_peered":"2023-12-18T10:25:18.188173+0000","last_unstale":"2023-12-18T10:25:18.584202+0000","last_undegraded":"2023-12-18T10:25:18.584202+0000","last_fullsized":"2023-12-18T10:25:18.584202+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:46:12.832194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":233,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569491+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:25:18.569491+0000","last_peered":"2023-12-18T10:25:18.569491+0000","last_clean":"2023-12-18T10:25:18.569491+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:25:18.569491+0000","last_undegraded":"2023-12-18T10:25:18.569491+0000","last_fullsized":"2023-12-18T10:25:18.569491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574941,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1904640,"data_stored":1193019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.505}]},{"osd":1,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":1.042,"15min":1.042},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":1.081,"15min":1.081},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.67400000000000004},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83499999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":1.097,"15min":1.097},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.91000000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70699999999999996,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88200000000000001,"5min":1.137,"15min":1.137},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":1.024,"15min":1.024},"last":0.86699999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.76900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.89900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":604659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.79600000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.018,"5min":1.018,"15min":4.3760000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.83899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.56599999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.73299999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.845},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69799999999999995,"15min":0.82499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.179,"5min":1.179,"15min":4.524},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":1.121,"5min":1.121,"15min":2.2709999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.746},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.498}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.80500000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91400000000000003,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.84499999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.62}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.0049999999999999,"15min":1.101},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.627,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67600000000000005,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.93500000000000005,"5min":0.98799999999999999,"15min":1.284},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91400000000000003,"5min":1.0880000000000001,"15min":1.129},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.74399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":1.006,"15min":1.0820000000000001},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1302528,"data_stored":602491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.873,"15min":1.0900000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.66500000000000004,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.78600000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65500000000000003,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.85799999999999998,"5min":0.92500000000000004,"15min":3.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":0.879,"15min":0.90500000000000003},"last":0.67700000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.749},"min":{"1min":0.432,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.81000000000000005,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.77100000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":2.0699999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67800000000000005,"15min":0.79100000000000004},"min":{"1min":0.502,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.88200000000000001,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.871}]},{"osd":4,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63300000000000001,"15min":0.89400000000000002},"min":{"1min":0.48899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82899999999999996,"5min":0.88,"15min":8.9740000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68100000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92300000000000004,"5min":0.97899999999999998,"15min":1.2370000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.72999999999999998},"min":{"1min":0.46899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":2.9060000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63700000000000001,"15min":0.76000000000000001},"min":{"1min":0.55300000000000005,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.505}]},{"osd":7,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64400000000000002,"15min":0.68600000000000005},"min":{"1min":0.51300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":1.042,"15min":1.1830000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67400000000000004,"15min":0.79200000000000004},"min":{"1min":0.53600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":602583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.503,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91600000000000004,"5min":0.96799999999999997,"15min":1.0249999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.84099999999999997,"5min":0.92800000000000005,"15min":1.1739999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.131},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.54500000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89600000000000002,"5min":1.008,"15min":1.032},"last":0.66700000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.86199999999999999,"5min":0.94499999999999995,"15min":0.999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.63},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68500000000000005,"5min":0.91900000000000004,"15min":0.97399999999999998},"last":0.621},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.86799999999999999,"15min":0.874},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.71799999999999997},"min":{"1min":0.55000000000000004,"5min":0.376,"15min":0.376},"max":{"1min":0.82299999999999995,"5min":1.0109999999999999,"15min":1.073},"last":0.79200000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":1.042},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90500000000000003,"15min":1.1479999999999999},"last":0.746}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":603073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41699999999999998,"15min":0.42499999999999999},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58999999999999997,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45600000000000002,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.59699999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.46400000000000002},"min":{"1min":0.312,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53800000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.371},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.66300000000000003,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":1.036,"15min":1.254},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.64300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":0.98899999999999999,"15min":1.772},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.01},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.60999999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.167,"15min":1.181},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.171,"15min":1.171},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93700000000000006,"5min":1.0549999999999999,"15min":1.069},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72199999999999998,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.53400000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.751},"min":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90000000000000002,"5min":1.26,"15min":1.26},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":602525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.61499999999999999,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60399999999999998,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.34200000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47699999999999998,"15min":0.49099999999999999},"min":{"1min":0.316,"5min":0.315,"15min":0.315},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.434},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.92000000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":1.1599999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.90500000000000003,"5min":1.0469999999999999,"15min":1.698},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.0820000000000001,"15min":1.4219999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.95999999999999996,"15min":1.3069999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.752,"15min":0.80100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":1.085,"15min":1.7549999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0680000000000001,"15min":1.341},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.3939999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.61299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.048,"15min":1.282},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.94799999999999995,"5min":1.093,"15min":1.4530000000000001},"last":0.65000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":602525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.55800000000000005},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.64400000000000002,"15min":3.976},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":1.9079999999999999},"last":0.67000000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.59899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":3.786},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.46300000000000002,"15min":0.50700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59599999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50700000000000001,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.60099999999999998,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.625},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.71399999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89300000000000002,"5min":1.1399999999999999,"15min":1.851},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.879},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.995,"5min":1.0960000000000001,"15min":4.1859999999999999},"last":1.024},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.504},"max":{"1min":0.877,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.93200000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.01,"5min":1.056,"15min":2.0699999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.94399999999999995,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.94999999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73699999999999999,"15min":0.78500000000000003},"min":{"1min":0.60099999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":2.1890000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77500000000000002,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":0.95599999999999996,"5min":1.0649999999999999,"15min":1.9770000000000001},"last":1.0089999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1912832,"data_stored":1194513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.439,"15min":0.47899999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.252},"max":{"1min":0.59599999999999997,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66000000000000003,"5min":0.92900000000000005,"15min":1.456},"last":0.45400000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":1.0589999999999999,"15min":1.595},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47299999999999998,"15min":0.55900000000000005},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":2.464},"last":0.495}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47199999999999998,"15min":0.51800000000000002},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63500000000000001,"5min":0.85699999999999998,"15min":1.859},"last":0.436},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38800000000000001},"max":{"1min":0.67100000000000004,"5min":0.90000000000000002,"15min":1.903},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.0700000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.1279999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.623}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.76000000000000001},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.46700000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0720000000000001,"5min":1.278,"15min":1.5700000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.53},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73099999999999998,"15min":0.78100000000000003},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0469999999999999,"5min":1.349,"15min":1.556},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.77200000000000002},"min":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:25:27.141 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:25:27.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.293+0000 7f2b437b3640 1 Processor -- start 2023-12-18T10:25:27.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.293+0000 7f2b437b3640 1 -- start start 2023-12-18T10:25:27.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b437b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b3c158c20 0x7f2b3c070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b437b3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c070b80 con 0x7f2b3c15c800 2023-12-18T10:25:27.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b437b3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c070e60 con 0x7f2b3c0cb180 2023-12-18T10:25:27.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b437b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c071140 con 0x7f2b3c158c20 2023-12-18T10:25:27.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b40d4e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2b3c15c800 0x7f2b3c0caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39260/0 (socket says 172.21.15.133:39260) 2023-12-18T10:25:27.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b40d4e640 1 -- 172.21.15.133:0/645070216 learned_addr learned my addr 172.21.15.133:0/645070216 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:27.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b4154f640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b3c158c20 0x7f2b3c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946200000 0 0) 0x7f2b3c070b80 con 0x7f2b3c15c800 2023-12-18T10:25:27.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b28003530 con 0x7f2b3c15c800 2023-12-18T10:25:27.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452942641 0 0) 0x7f2b3c070e60 con 0x7f2b3c0cb180 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b3c070b80 con 0x7f2b3c0cb180 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4160720320 0 0) 0x7f2b28003530 con 0x7f2b3c15c800 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b3c158c20 msgr2=0x7f2b3c070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b3c158c20 0x7f2b3c070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 >> v1:172.21.15.142:6789/0 conn(0x7f2b3c0cb180 legacy=0x7f2b3c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c071420 con 0x7f2b3c15c800 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f2b2c001680 con 0x7f2b3c15c800 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 >> v1:172.21.15.133:6789/0 conn(0x7f2b3c15c800 legacy=0x7f2b3c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b28003b40 0x7f2b28003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b3c158c20 0x7f2b280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b28004d10 0x7f2b28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c071140 con 0x7f2b28004d10 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2800ba90 con 0x7f2b28003b40 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2800bc50 con 0x7f2b3c158c20 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b4154f640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b28003b40 0x7f2b28003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b41d50640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b28004d10 0x7f2b28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b40d4e640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b3c158c20 0x7f2b280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b41d50640 1 -- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b3c158c20 msgr2=0x7f2b280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b41d50640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b3c158c20 0x7f2b280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b41d50640 1 -- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b28003b40 msgr2=0x7f2b28003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b41d50640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b28003b40 0x7f2b28003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b41d50640 1 -- 172.21.15.133:0/645070216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28003530 con 0x7f2b28004d10 2023-12-18T10:25:27.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.297+0000 7f2b4154f640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b28003b40 0x7f2b28003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b41d50640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b28004d10 0x7f2b28005190 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0cb610 tx=0x7f2b3401f030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f51b9987fc3b37 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340a8c50 con 0x7f2b28004d10 2023-12-18T10:25:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340a8dd0 con 0x7f2b28004d10 2023-12-18T10:25:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b33fff640 1 -- 172.21.15.133:0/645070216 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34003bc0 con 0x7f2b28004d10 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b437b3640 1 -- 172.21.15.133:0/645070216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b28004d10 msgr2=0x7f2b28005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b437b3640 1 --2- 172.21.15.133:0/645070216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b28004d10 0x7f2b28005190 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c0cb610 tx=0x7f2b3401f030 comp rx=0 tx=0).stop 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b41d50640 1 -- 172.21.15.133:0/645070216 reap_dead start 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b437b3640 1 -- 172.21.15.133:0/645070216 shutdown_connections 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b437b3640 1 -- 172.21.15.133:0/645070216 >> 172.21.15.133:0/645070216 conn(0x7f2b3c06a3e0 msgr2=0x7f2b3c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b437b3640 1 -- 172.21.15.133:0/645070216 shutdown_connections 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.301+0000 7f2b437b3640 1 -- 172.21.15.133:0/645070216 wait complete. 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 Processor -- start 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 -- start start 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b28004d10 0x7f2b3c150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b3c157580 0x7f2b3c1f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b3c0ca510 0x7f2b3c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0caf00 con 0x7f2b3c157580 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c150dc0 con 0x7f2b3c0ca510 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0c2990 con 0x7f2b28004d10 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b3c157580 0x7f2b3c1f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b3c157580 0x7f2b3c1f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57146/0 (socket says 172.21.15.133:57146) 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 -- 172.21.15.133:0/1858577834 learned_addr learned my addr 172.21.15.133:0/1858577834 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b4154f640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b28004d10 0x7f2b3c150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b41d50640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b3c0ca510 0x7f2b3c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 -- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b28004d10 msgr2=0x7f2b3c150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b28004d10 0x7f2b3c150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 -- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b3c0ca510 msgr2=0x7f2b3c0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b3c0ca510 0x7f2b3c0ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 -- 172.21.15.133:0/1858577834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c1f62b0 con 0x7f2b3c157580 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b4154f640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b28004d10 0x7f2b3c150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b41d50640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b3c0ca510 0x7f2b3c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b40d4e640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b3c157580 0x7f2b3c1f5d70 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c007fd0 tx=0x7f2b2c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b31ffb640 1 -- 172.21.15.133:0/1858577834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00f7b0 con 0x7f2b3c157580 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b31ffb640 1 -- 172.21.15.133:0/1858577834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c00f910 con 0x7f2b3c157580 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c0c2c30 con 0x7f2b3c157580 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b31ffb640 1 -- 172.21.15.133:0/1858577834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00fca0 con 0x7f2b3c157580 2023-12-18T10:25:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c0c31f0 con 0x7f2b3c157580 2023-12-18T10:25:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.305+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c0735b0 con 0x7f2b3c157580 2023-12-18T10:25:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.309+0000 7f2b31ffb640 1 -- 172.21.15.133:0/1858577834 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b2c01d460 con 0x7f2b3c157580 2023-12-18T10:25:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.309+0000 7f2b31ffb640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b20065a60 0x7f2b20067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.309+0000 7f2b31ffb640 1 -- 172.21.15.133:0/1858577834 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2b2c083690 con 0x7f2b3c157580 2023-12-18T10:25:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.309+0000 7f2b4154f640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b20065a60 0x7f2b20067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.309+0000 7f2b4154f640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b20065a60 0x7f2b20067f20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800ab40 tx=0x7f2b38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.313+0000 7f2b31ffb640 1 -- 172.21.15.133:0/1858577834 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2b2c050e70 con 0x7f2b3c157580 2023-12-18T10:25:27.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.461+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b3c159000 con 0x7f2b20065a60 2023-12-18T10:25:27.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.469+0000 7f2b31ffb640 1 -- 172.21.15.133:0/1858577834 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289544 (secure 0 0 0) 0x7f2b38012b10 con 0x7f2b20065a60 2023-12-18T10:25:27.471 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:27.472 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:25:27.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b20065a60 msgr2=0x7f2b20067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b20065a60 0x7f2b20067f20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800ab40 tx=0x7f2b38008040 comp rx=0 tx=0).stop 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b3c157580 msgr2=0x7f2b3c1f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b3c157580 0x7f2b3c1f5d70 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c007fd0 tx=0x7f2b2c0074f0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 shutdown_connections 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2b20065a60 0x7f2b20067f20 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b3c0ca510 0x7f2b3c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b3c157580 0x7f2b3c1f5d70 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 --2- 172.21.15.133:0/1858577834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b28004d10 0x7f2b3c150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 >> 172.21.15.133:0/1858577834 conn(0x7f2b3c06a3e0 msgr2=0x7f2b3c0acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 shutdown_connections 2023-12-18T10:25:27.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.473+0000 7f2b437b3640 1 -- 172.21.15.133:0/1858577834 wait complete. 2023-12-18T10:25:27.491 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-12-18T10:25:27.189914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259784,"kb_used_data":11400,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714936,"statfs":{"total":773094113280,"available":772828094464,"internally_reserved":0,"allocated":11673600,"data_stored":6005388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.632958"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566155+0000","last_change":"2023-12-18T10:25:18.587171+0000","last_active":"2023-12-18T10:25:19.566155+0000","last_peered":"2023-12-18T10:25:19.566155+0000","last_clean":"2023-12-18T10:25:19.566155+0000","last_became_active":"2023-12-18T10:25:18.586887+0000","last_became_peered":"2023-12-18T10:25:18.586887+0000","last_unstale":"2023-12-18T10:25:19.566155+0000","last_undegraded":"2023-12-18T10:25:19.566155+0000","last_fullsized":"2023-12-18T10:25:19.566155+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:57:33.454865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364550+0000","last_change":"2023-12-18T10:25:18.592190+0000","last_active":"2023-12-18T10:25:20.364550+0000","last_peered":"2023-12-18T10:25:20.364550+0000","last_clean":"2023-12-18T10:25:20.364550+0000","last_became_active":"2023-12-18T10:25:18.590883+0000","last_became_peered":"2023-12-18T10:25:18.590883+0000","last_unstale":"2023-12-18T10:25:20.364550+0000","last_undegraded":"2023-12-18T10:25:20.364550+0000","last_fullsized":"2023-12-18T10:25:20.364550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:57:54.199621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565815+0000","last_change":"2023-12-18T10:25:18.590238+0000","last_active":"2023-12-18T10:25:19.565815+0000","last_peered":"2023-12-18T10:25:19.565815+0000","last_clean":"2023-12-18T10:25:19.565815+0000","last_became_active":"2023-12-18T10:25:18.589982+0000","last_became_peered":"2023-12-18T10:25:18.589982+0000","last_unstale":"2023-12-18T10:25:19.565815+0000","last_undegraded":"2023-12-18T10:25:19.565815+0000","last_fullsized":"2023-12-18T10:25:19.565815+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:33:23.213315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567044+0000","last_change":"2023-12-18T10:25:18.587238+0000","last_active":"2023-12-18T10:25:19.567044+0000","last_peered":"2023-12-18T10:25:19.567044+0000","last_clean":"2023-12-18T10:25:19.567044+0000","last_became_active":"2023-12-18T10:25:18.586080+0000","last_became_peered":"2023-12-18T10:25:18.586080+0000","last_unstale":"2023-12-18T10:25:19.567044+0000","last_undegraded":"2023-12-18T10:25:19.567044+0000","last_fullsized":"2023-12-18T10:25:19.567044+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:31:22.298032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295899+0000","last_change":"2023-12-18T10:25:18.581846+0000","last_active":"2023-12-18T10:25:20.295899+0000","last_peered":"2023-12-18T10:25:20.295899+0000","last_clean":"2023-12-18T10:25:20.295899+0000","last_became_active":"2023-12-18T10:25:18.580344+0000","last_became_peered":"2023-12-18T10:25:18.580344+0000","last_unstale":"2023-12-18T10:25:20.295899+0000","last_undegraded":"2023-12-18T10:25:20.295899+0000","last_fullsized":"2023-12-18T10:25:20.295899+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:29:42.504233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363336+0000","last_change":"2023-12-18T10:25:18.589801+0000","last_active":"2023-12-18T10:25:20.363336+0000","last_peered":"2023-12-18T10:25:20.363336+0000","last_clean":"2023-12-18T10:25:20.363336+0000","last_became_active":"2023-12-18T10:25:18.589453+0000","last_became_peered":"2023-12-18T10:25:18.589453+0000","last_unstale":"2023-12-18T10:25:20.363336+0000","last_undegraded":"2023-12-18T10:25:20.363336+0000","last_fullsized":"2023-12-18T10:25:20.363336+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:46:17.981946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362921+0000","last_change":"2023-12-18T10:25:18.595252+0000","last_active":"2023-12-18T10:25:20.362921+0000","last_peered":"2023-12-18T10:25:20.362921+0000","last_clean":"2023-12-18T10:25:20.362921+0000","last_became_active":"2023-12-18T10:25:18.594676+0000","last_became_peered":"2023-12-18T10:25:18.594676+0000","last_unstale":"2023-12-18T10:25:20.362921+0000","last_undegraded":"2023-12-18T10:25:20.362921+0000","last_fullsized":"2023-12-18T10:25:20.362921+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:20:17.969046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318484+0000","last_change":"2023-12-18T10:25:18.581711+0000","last_active":"2023-12-18T10:25:20.318484+0000","last_peered":"2023-12-18T10:25:20.318484+0000","last_clean":"2023-12-18T10:25:20.318484+0000","last_became_active":"2023-12-18T10:25:18.581486+0000","last_became_peered":"2023-12-18T10:25:18.581486+0000","last_unstale":"2023-12-18T10:25:20.318484+0000","last_undegraded":"2023-12-18T10:25:20.318484+0000","last_fullsized":"2023-12-18T10:25:20.318484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:16:48.894333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363685+0000","last_change":"2023-12-18T10:25:18.593458+0000","last_active":"2023-12-18T10:25:20.363685+0000","last_peered":"2023-12-18T10:25:20.363685+0000","last_clean":"2023-12-18T10:25:20.363685+0000","last_became_active":"2023-12-18T10:25:18.593185+0000","last_became_peered":"2023-12-18T10:25:18.593185+0000","last_unstale":"2023-12-18T10:25:20.363685+0000","last_undegraded":"2023-12-18T10:25:20.363685+0000","last_fullsized":"2023-12-18T10:25:20.363685+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:26.594432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.296106+0000","last_change":"2023-12-18T10:25:18.591047+0000","last_active":"2023-12-18T10:25:20.296106+0000","last_peered":"2023-12-18T10:25:20.296106+0000","last_clean":"2023-12-18T10:25:20.296106+0000","last_became_active":"2023-12-18T10:25:18.590725+0000","last_became_peered":"2023-12-18T10:25:18.590725+0000","last_unstale":"2023-12-18T10:25:20.296106+0000","last_undegraded":"2023-12-18T10:25:20.296106+0000","last_fullsized":"2023-12-18T10:25:20.296106+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:34.407981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364646+0000","last_change":"2023-12-18T10:25:18.591234+0000","last_active":"2023-12-18T10:25:20.364646+0000","last_peered":"2023-12-18T10:25:20.364646+0000","last_clean":"2023-12-18T10:25:20.364646+0000","last_became_active":"2023-12-18T10:25:18.590849+0000","last_became_peered":"2023-12-18T10:25:18.590849+0000","last_unstale":"2023-12-18T10:25:20.364646+0000","last_undegraded":"2023-12-18T10:25:20.364646+0000","last_fullsized":"2023-12-18T10:25:20.364646+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:53:12.765081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364527+0000","last_change":"2023-12-18T10:25:18.589913+0000","last_active":"2023-12-18T10:25:20.364527+0000","last_peered":"2023-12-18T10:25:20.364527+0000","last_clean":"2023-12-18T10:25:20.364527+0000","last_became_active":"2023-12-18T10:25:18.588523+0000","last_became_peered":"2023-12-18T10:25:18.588523+0000","last_unstale":"2023-12-18T10:25:20.364527+0000","last_undegraded":"2023-12-18T10:25:20.364527+0000","last_fullsized":"2023-12-18T10:25:20.364527+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:35:44.506997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566909+0000","last_change":"2023-12-18T10:25:18.597402+0000","last_active":"2023-12-18T10:25:19.566909+0000","last_peered":"2023-12-18T10:25:19.566909+0000","last_clean":"2023-12-18T10:25:19.566909+0000","last_became_active":"2023-12-18T10:25:18.597103+0000","last_became_peered":"2023-12-18T10:25:18.597103+0000","last_unstale":"2023-12-18T10:25:19.566909+0000","last_undegraded":"2023-12-18T10:25:19.566909+0000","last_fullsized":"2023-12-18T10:25:19.566909+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:59:13.204679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362763+0000","last_change":"2023-12-18T10:25:18.588540+0000","last_active":"2023-12-18T10:25:20.362763+0000","last_peered":"2023-12-18T10:25:20.362763+0000","last_clean":"2023-12-18T10:25:20.362763+0000","last_became_active":"2023-12-18T10:25:18.588196+0000","last_became_peered":"2023-12-18T10:25:18.588196+0000","last_unstale":"2023-12-18T10:25:20.362763+0000","last_undegraded":"2023-12-18T10:25:20.362763+0000","last_fullsized":"2023-12-18T10:25:20.362763+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:37.244002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362708+0000","last_change":"2023-12-18T10:25:18.593448+0000","last_active":"2023-12-18T10:25:20.362708+0000","last_peered":"2023-12-18T10:25:20.362708+0000","last_clean":"2023-12-18T10:25:20.362708+0000","last_became_active":"2023-12-18T10:25:18.593193+0000","last_became_peered":"2023-12-18T10:25:18.593193+0000","last_unstale":"2023-12-18T10:25:20.362708+0000","last_undegraded":"2023-12-18T10:25:20.362708+0000","last_fullsized":"2023-12-18T10:25:20.362708+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:31.384969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.362657+0000","last_change":"2023-12-18T10:25:18.581001+0000","last_active":"2023-12-18T10:25:20.362657+0000","last_peered":"2023-12-18T10:25:20.362657+0000","last_clean":"2023-12-18T10:25:20.362657+0000","last_became_active":"2023-12-18T10:25:18.580702+0000","last_became_peered":"2023-12-18T10:25:18.580702+0000","last_unstale":"2023-12-18T10:25:20.362657+0000","last_undegraded":"2023-12-18T10:25:20.362657+0000","last_fullsized":"2023-12-18T10:25:20.362657+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:05.000600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566226+0000","last_change":"2023-12-18T10:25:18.590525+0000","last_active":"2023-12-18T10:25:19.566226+0000","last_peered":"2023-12-18T10:25:19.566226+0000","last_clean":"2023-12-18T10:25:19.566226+0000","last_became_active":"2023-12-18T10:25:18.590233+0000","last_became_peered":"2023-12-18T10:25:18.590233+0000","last_unstale":"2023-12-18T10:25:19.566226+0000","last_undegraded":"2023-12-18T10:25:19.566226+0000","last_fullsized":"2023-12-18T10:25:19.566226+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:27:19.066786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364645+0000","last_change":"2023-12-18T10:25:18.592167+0000","last_active":"2023-12-18T10:25:20.364645+0000","last_peered":"2023-12-18T10:25:20.364645+0000","last_clean":"2023-12-18T10:25:20.364645+0000","last_became_active":"2023-12-18T10:25:18.590630+0000","last_became_peered":"2023-12-18T10:25:18.590630+0000","last_unstale":"2023-12-18T10:25:20.364645+0000","last_undegraded":"2023-12-18T10:25:20.364645+0000","last_fullsized":"2023-12-18T10:25:20.364645+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:10:50.244543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566113+0000","last_change":"2023-12-18T10:25:18.589522+0000","last_active":"2023-12-18T10:25:19.566113+0000","last_peered":"2023-12-18T10:25:19.566113+0000","last_clean":"2023-12-18T10:25:19.566113+0000","last_became_active":"2023-12-18T10:25:18.589182+0000","last_became_peered":"2023-12-18T10:25:18.589182+0000","last_unstale":"2023-12-18T10:25:19.566113+0000","last_undegraded":"2023-12-18T10:25:19.566113+0000","last_fullsized":"2023-12-18T10:25:19.566113+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:54:22.565170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364587+0000","last_change":"2023-12-18T10:25:18.579506+0000","last_active":"2023-12-18T10:25:20.364587+0000","last_peered":"2023-12-18T10:25:20.364587+0000","last_clean":"2023-12-18T10:25:20.364587+0000","last_became_active":"2023-12-18T10:25:18.579205+0000","last_became_peered":"2023-12-18T10:25:18.579205+0000","last_unstale":"2023-12-18T10:25:20.364587+0000","last_undegraded":"2023-12-18T10:25:20.364587+0000","last_fullsized":"2023-12-18T10:25:20.364587+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:02:28.250518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318703+0000","last_change":"2023-12-18T10:25:18.593293+0000","last_active":"2023-12-18T10:25:20.318703+0000","last_peered":"2023-12-18T10:25:20.318703+0000","last_clean":"2023-12-18T10:25:20.318703+0000","last_became_active":"2023-12-18T10:25:18.592828+0000","last_became_peered":"2023-12-18T10:25:18.592828+0000","last_unstale":"2023-12-18T10:25:20.318703+0000","last_undegraded":"2023-12-18T10:25:20.318703+0000","last_fullsized":"2023-12-18T10:25:20.318703+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:37:47.715800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295900+0000","last_change":"2023-12-18T10:25:18.589496+0000","last_active":"2023-12-18T10:25:20.295900+0000","last_peered":"2023-12-18T10:25:20.295900+0000","last_clean":"2023-12-18T10:25:20.295900+0000","last_became_active":"2023-12-18T10:25:18.589150+0000","last_became_peered":"2023-12-18T10:25:18.589150+0000","last_unstale":"2023-12-18T10:25:20.295900+0000","last_undegraded":"2023-12-18T10:25:20.295900+0000","last_fullsized":"2023-12-18T10:25:20.295900+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:31.807466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565765+0000","last_change":"2023-12-18T10:25:18.588168+0000","last_active":"2023-12-18T10:25:19.565765+0000","last_peered":"2023-12-18T10:25:19.565765+0000","last_clean":"2023-12-18T10:25:19.565765+0000","last_became_active":"2023-12-18T10:25:18.587806+0000","last_became_peered":"2023-12-18T10:25:18.587806+0000","last_unstale":"2023-12-18T10:25:19.565765+0000","last_undegraded":"2023-12-18T10:25:19.565765+0000","last_fullsized":"2023-12-18T10:25:19.565765+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:56:14.720373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295706+0000","last_change":"2023-12-18T10:25:18.582900+0000","last_active":"2023-12-18T10:25:20.295706+0000","last_peered":"2023-12-18T10:25:20.295706+0000","last_clean":"2023-12-18T10:25:20.295706+0000","last_became_active":"2023-12-18T10:25:18.582639+0000","last_became_peered":"2023-12-18T10:25:18.582639+0000","last_unstale":"2023-12-18T10:25:20.295706+0000","last_undegraded":"2023-12-18T10:25:20.295706+0000","last_fullsized":"2023-12-18T10:25:20.295706+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:55:32.910251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364836+0000","last_change":"2023-12-18T10:25:18.598415+0000","last_active":"2023-12-18T10:25:20.364836+0000","last_peered":"2023-12-18T10:25:20.364836+0000","last_clean":"2023-12-18T10:25:20.364836+0000","last_became_active":"2023-12-18T10:25:18.598122+0000","last_became_peered":"2023-12-18T10:25:18.598122+0000","last_unstale":"2023-12-18T10:25:20.364836+0000","last_undegraded":"2023-12-18T10:25:20.364836+0000","last_fullsized":"2023-12-18T10:25:20.364836+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:39:01.393143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.365141+0000","last_change":"2023-12-18T10:25:18.594542+0000","last_active":"2023-12-18T10:25:20.365141+0000","last_peered":"2023-12-18T10:25:20.365141+0000","last_clean":"2023-12-18T10:25:20.365141+0000","last_became_active":"2023-12-18T10:25:18.594270+0000","last_became_peered":"2023-12-18T10:25:18.594270+0000","last_unstale":"2023-12-18T10:25:20.365141+0000","last_undegraded":"2023-12-18T10:25:20.365141+0000","last_fullsized":"2023-12-18T10:25:20.365141+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:10:43.536993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364755+0000","last_change":"2023-12-18T10:25:18.589423+0000","last_active":"2023-12-18T10:25:20.364755+0000","last_peered":"2023-12-18T10:25:20.364755+0000","last_clean":"2023-12-18T10:25:20.364755+0000","last_became_active":"2023-12-18T10:25:18.589140+0000","last_became_peered":"2023-12-18T10:25:18.589140+0000","last_unstale":"2023-12-18T10:25:20.364755+0000","last_undegraded":"2023-12-18T10:25:20.364755+0000","last_fullsized":"2023-12-18T10:25:20.364755+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:38:05.000600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363280+0000","last_change":"2023-12-18T10:25:18.597867+0000","last_active":"2023-12-18T10:25:20.363280+0000","last_peered":"2023-12-18T10:25:20.363280+0000","last_clean":"2023-12-18T10:25:20.363280+0000","last_became_active":"2023-12-18T10:25:18.597495+0000","last_became_peered":"2023-12-18T10:25:18.597495+0000","last_unstale":"2023-12-18T10:25:20.363280+0000","last_undegraded":"2023-12-18T10:25:20.363280+0000","last_fullsized":"2023-12-18T10:25:20.363280+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:23:19.808841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318699+0000","last_change":"2023-12-18T10:25:18.580831+0000","last_active":"2023-12-18T10:25:20.318699+0000","last_peered":"2023-12-18T10:25:20.318699+0000","last_clean":"2023-12-18T10:25:20.318699+0000","last_became_active":"2023-12-18T10:25:18.578964+0000","last_became_peered":"2023-12-18T10:25:18.578964+0000","last_unstale":"2023-12-18T10:25:20.318699+0000","last_undegraded":"2023-12-18T10:25:20.318699+0000","last_fullsized":"2023-12-18T10:25:20.318699+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:37:55.089493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363847+0000","last_change":"2023-12-18T10:25:18.594215+0000","last_active":"2023-12-18T10:25:20.363847+0000","last_peered":"2023-12-18T10:25:20.363847+0000","last_clean":"2023-12-18T10:25:20.363847+0000","last_became_active":"2023-12-18T10:25:18.593863+0000","last_became_peered":"2023-12-18T10:25:18.593863+0000","last_unstale":"2023-12-18T10:25:20.363847+0000","last_undegraded":"2023-12-18T10:25:20.363847+0000","last_fullsized":"2023-12-18T10:25:20.363847+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:03:21.281143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363027+0000","last_change":"2023-12-18T10:25:18.595424+0000","last_active":"2023-12-18T10:25:20.363027+0000","last_peered":"2023-12-18T10:25:20.363027+0000","last_clean":"2023-12-18T10:25:20.363027+0000","last_became_active":"2023-12-18T10:25:18.594984+0000","last_became_peered":"2023-12-18T10:25:18.594984+0000","last_unstale":"2023-12-18T10:25:20.363027+0000","last_undegraded":"2023-12-18T10:25:20.363027+0000","last_fullsized":"2023-12-18T10:25:20.363027+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:12.571440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318598+0000","last_change":"2023-12-18T10:25:18.574996+0000","last_active":"2023-12-18T10:25:20.318598+0000","last_peered":"2023-12-18T10:25:20.318598+0000","last_clean":"2023-12-18T10:25:20.318598+0000","last_became_active":"2023-12-18T10:25:18.574742+0000","last_became_peered":"2023-12-18T10:25:18.574742+0000","last_unstale":"2023-12-18T10:25:20.318598+0000","last_undegraded":"2023-12-18T10:25:20.318598+0000","last_fullsized":"2023-12-18T10:25:20.318598+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:00:58.261581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565851+0000","last_change":"2023-12-18T10:25:18.587846+0000","last_active":"2023-12-18T10:25:19.565851+0000","last_peered":"2023-12-18T10:25:19.565851+0000","last_clean":"2023-12-18T10:25:19.565851+0000","last_became_active":"2023-12-18T10:25:18.587584+0000","last_became_peered":"2023-12-18T10:25:18.587584+0000","last_unstale":"2023-12-18T10:25:19.565851+0000","last_undegraded":"2023-12-18T10:25:19.565851+0000","last_fullsized":"2023-12-18T10:25:19.565851+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:56:02.496356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"104'4","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.596375+0000","last_change":"2023-12-18T10:25:18.179560+0000","last_active":"2023-12-18T10:25:18.596375+0000","last_peered":"2023-12-18T10:25:18.596375+0000","last_clean":"2023-12-18T10:25:18.596375+0000","last_became_active":"2023-12-18T10:25:18.179222+0000","last_became_peered":"2023-12-18T10:25:18.179222+0000","last_unstale":"2023-12-18T10:25:18.596375+0000","last_undegraded":"2023-12-18T10:25:18.596375+0000","last_fullsized":"2023-12-18T10:25:18.596375+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:33.405328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318525+0000","last_change":"2023-12-18T10:25:18.571453+0000","last_active":"2023-12-18T10:25:20.318525+0000","last_peered":"2023-12-18T10:25:20.318525+0000","last_clean":"2023-12-18T10:25:20.318525+0000","last_became_active":"2023-12-18T10:25:18.571149+0000","last_became_peered":"2023-12-18T10:25:18.571149+0000","last_unstale":"2023-12-18T10:25:20.318525+0000","last_undegraded":"2023-12-18T10:25:20.318525+0000","last_fullsized":"2023-12-18T10:25:20.318525+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:45:58.484999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.573632+0000","last_change":"2023-12-18T10:25:18.185482+0000","last_active":"2023-12-18T10:25:18.573632+0000","last_peered":"2023-12-18T10:25:18.573632+0000","last_clean":"2023-12-18T10:25:18.573632+0000","last_became_active":"2023-12-18T10:25:18.184386+0000","last_became_peered":"2023-12-18T10:25:18.184386+0000","last_unstale":"2023-12-18T10:25:18.573632+0000","last_undegraded":"2023-12-18T10:25:18.573632+0000","last_fullsized":"2023-12-18T10:25:18.573632+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:26:39.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363942+0000","last_change":"2023-12-18T10:25:18.583966+0000","last_active":"2023-12-18T10:25:20.363942+0000","last_peered":"2023-12-18T10:25:20.363942+0000","last_clean":"2023-12-18T10:25:20.363942+0000","last_became_active":"2023-12-18T10:25:18.583436+0000","last_became_peered":"2023-12-18T10:25:18.583436+0000","last_unstale":"2023-12-18T10:25:20.363942+0000","last_undegraded":"2023-12-18T10:25:20.363942+0000","last_fullsized":"2023-12-18T10:25:20.363942+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:58:56.928413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.588634+0000","last_change":"2023-12-18T10:25:18.177306+0000","last_active":"2023-12-18T10:25:18.588634+0000","last_peered":"2023-12-18T10:25:18.588634+0000","last_clean":"2023-12-18T10:25:18.588634+0000","last_became_active":"2023-12-18T10:25:18.177039+0000","last_became_peered":"2023-12-18T10:25:18.177039+0000","last_unstale":"2023-12-18T10:25:18.588634+0000","last_undegraded":"2023-12-18T10:25:18.588634+0000","last_fullsized":"2023-12-18T10:25:18.588634+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:59:11.931460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364484+0000","last_change":"2023-12-18T10:25:18.590717+0000","last_active":"2023-12-18T10:25:20.364484+0000","last_peered":"2023-12-18T10:25:20.364484+0000","last_clean":"2023-12-18T10:25:20.364484+0000","last_became_active":"2023-12-18T10:25:18.590120+0000","last_became_peered":"2023-12-18T10:25:18.590120+0000","last_unstale":"2023-12-18T10:25:20.364484+0000","last_undegraded":"2023-12-18T10:25:20.364484+0000","last_fullsized":"2023-12-18T10:25:20.364484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:00:58.263482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.585225+0000","last_change":"2023-12-18T10:25:18.171420+0000","last_active":"2023-12-18T10:25:18.585225+0000","last_peered":"2023-12-18T10:25:18.585225+0000","last_clean":"2023-12-18T10:25:18.585225+0000","last_became_active":"2023-12-18T10:25:18.171134+0000","last_became_peered":"2023-12-18T10:25:18.171134+0000","last_unstale":"2023-12-18T10:25:18.585225+0000","last_undegraded":"2023-12-18T10:25:18.585225+0000","last_fullsized":"2023-12-18T10:25:18.585225+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:57:53.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567095+0000","last_change":"2023-12-18T10:25:18.585845+0000","last_active":"2023-12-18T10:25:19.567095+0000","last_peered":"2023-12-18T10:25:19.567095+0000","last_clean":"2023-12-18T10:25:19.567095+0000","last_became_active":"2023-12-18T10:25:18.584027+0000","last_became_peered":"2023-12-18T10:25:18.584027+0000","last_unstale":"2023-12-18T10:25:19.567095+0000","last_undegraded":"2023-12-18T10:25:19.567095+0000","last_fullsized":"2023-12-18T10:25:19.567095+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:26:36.885974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.591539+0000","last_change":"2023-12-18T10:25:18.184300+0000","last_active":"2023-12-18T10:25:18.591539+0000","last_peered":"2023-12-18T10:25:18.591539+0000","last_clean":"2023-12-18T10:25:18.591539+0000","last_became_active":"2023-12-18T10:25:18.183998+0000","last_became_peered":"2023-12-18T10:25:18.183998+0000","last_unstale":"2023-12-18T10:25:18.591539+0000","last_undegraded":"2023-12-18T10:25:18.591539+0000","last_fullsized":"2023-12-18T10:25:18.591539+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:31:19.235853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566203+0000","last_change":"2023-12-18T10:25:18.590578+0000","last_active":"2023-12-18T10:25:19.566203+0000","last_peered":"2023-12-18T10:25:19.566203+0000","last_clean":"2023-12-18T10:25:19.566203+0000","last_became_active":"2023-12-18T10:25:18.590316+0000","last_became_peered":"2023-12-18T10:25:18.590316+0000","last_unstale":"2023-12-18T10:25:19.566203+0000","last_undegraded":"2023-12-18T10:25:19.566203+0000","last_fullsized":"2023-12-18T10:25:19.566203+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:41:56.770479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.594022+0000","last_change":"2023-12-18T10:25:18.175249+0000","last_active":"2023-12-18T10:25:18.594022+0000","last_peered":"2023-12-18T10:25:18.594022+0000","last_clean":"2023-12-18T10:25:18.594022+0000","last_became_active":"2023-12-18T10:25:18.174954+0000","last_became_peered":"2023-12-18T10:25:18.174954+0000","last_unstale":"2023-12-18T10:25:18.594022+0000","last_undegraded":"2023-12-18T10:25:18.594022+0000","last_fullsized":"2023-12-18T10:25:18.594022+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:23:18.806188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364742+0000","last_change":"2023-12-18T10:25:18.600213+0000","last_active":"2023-12-18T10:25:20.364742+0000","last_peered":"2023-12-18T10:25:20.364742+0000","last_clean":"2023-12-18T10:25:20.364742+0000","last_became_active":"2023-12-18T10:25:18.598593+0000","last_became_peered":"2023-12-18T10:25:18.598593+0000","last_unstale":"2023-12-18T10:25:20.364742+0000","last_undegraded":"2023-12-18T10:25:20.364742+0000","last_fullsized":"2023-12-18T10:25:20.364742+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:18:11.312358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569221+0000","last_change":"2023-12-18T10:25:18.176746+0000","last_active":"2023-12-18T10:25:18.569221+0000","last_peered":"2023-12-18T10:25:18.569221+0000","last_clean":"2023-12-18T10:25:18.569221+0000","last_became_active":"2023-12-18T10:25:18.176486+0000","last_became_peered":"2023-12-18T10:25:18.176486+0000","last_unstale":"2023-12-18T10:25:18.569221+0000","last_undegraded":"2023-12-18T10:25:18.569221+0000","last_fullsized":"2023-12-18T10:25:18.569221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:07:06.621984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567221+0000","last_change":"2023-12-18T10:25:18.587747+0000","last_active":"2023-12-18T10:25:19.567221+0000","last_peered":"2023-12-18T10:25:19.567221+0000","last_clean":"2023-12-18T10:25:19.567221+0000","last_became_active":"2023-12-18T10:25:18.587487+0000","last_became_peered":"2023-12-18T10:25:18.587487+0000","last_unstale":"2023-12-18T10:25:19.567221+0000","last_undegraded":"2023-12-18T10:25:19.567221+0000","last_fullsized":"2023-12-18T10:25:19.567221+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:58:14.653117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.571712+0000","last_change":"2023-12-18T10:25:18.179725+0000","last_active":"2023-12-18T10:25:18.571712+0000","last_peered":"2023-12-18T10:25:18.571712+0000","last_clean":"2023-12-18T10:25:18.571712+0000","last_became_active":"2023-12-18T10:25:18.179456+0000","last_became_peered":"2023-12-18T10:25:18.179456+0000","last_unstale":"2023-12-18T10:25:18.571712+0000","last_undegraded":"2023-12-18T10:25:18.571712+0000","last_fullsized":"2023-12-18T10:25:18.571712+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:00:57.260829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565735+0000","last_change":"2023-12-18T10:25:18.590304+0000","last_active":"2023-12-18T10:25:19.565735+0000","last_peered":"2023-12-18T10:25:19.565735+0000","last_clean":"2023-12-18T10:25:19.565735+0000","last_became_active":"2023-12-18T10:25:18.590015+0000","last_became_peered":"2023-12-18T10:25:18.590015+0000","last_unstale":"2023-12-18T10:25:19.565735+0000","last_undegraded":"2023-12-18T10:25:19.565735+0000","last_fullsized":"2023-12-18T10:25:19.565735+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:31:28.237496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.572715+0000","last_change":"2023-12-18T10:25:18.176167+0000","last_active":"2023-12-18T10:25:18.572715+0000","last_peered":"2023-12-18T10:25:18.572715+0000","last_clean":"2023-12-18T10:25:18.572715+0000","last_became_active":"2023-12-18T10:25:18.175877+0000","last_became_peered":"2023-12-18T10:25:18.175877+0000","last_unstale":"2023-12-18T10:25:18.572715+0000","last_undegraded":"2023-12-18T10:25:18.572715+0000","last_fullsized":"2023-12-18T10:25:18.572715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:28:06.452447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295829+0000","last_change":"2023-12-18T10:25:18.574476+0000","last_active":"2023-12-18T10:25:20.295829+0000","last_peered":"2023-12-18T10:25:20.295829+0000","last_clean":"2023-12-18T10:25:20.295829+0000","last_became_active":"2023-12-18T10:25:18.574237+0000","last_became_peered":"2023-12-18T10:25:18.574237+0000","last_unstale":"2023-12-18T10:25:20.295829+0000","last_undegraded":"2023-12-18T10:25:20.295829+0000","last_fullsized":"2023-12-18T10:25:20.295829+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:41:35.424293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.563039+0000","last_change":"2023-12-18T10:25:18.170536+0000","last_active":"2023-12-18T10:25:18.563039+0000","last_peered":"2023-12-18T10:25:18.563039+0000","last_clean":"2023-12-18T10:25:18.563039+0000","last_became_active":"2023-12-18T10:25:18.169864+0000","last_became_peered":"2023-12-18T10:25:18.169864+0000","last_unstale":"2023-12-18T10:25:18.563039+0000","last_undegraded":"2023-12-18T10:25:18.563039+0000","last_fullsized":"2023-12-18T10:25:18.563039+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:42:45.681860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318662+0000","last_change":"2023-12-18T10:25:18.582635+0000","last_active":"2023-12-18T10:25:20.318662+0000","last_peered":"2023-12-18T10:25:20.318662+0000","last_clean":"2023-12-18T10:25:20.318662+0000","last_became_active":"2023-12-18T10:25:18.580689+0000","last_became_peered":"2023-12-18T10:25:18.580689+0000","last_unstale":"2023-12-18T10:25:20.318662+0000","last_undegraded":"2023-12-18T10:25:20.318662+0000","last_fullsized":"2023-12-18T10:25:20.318662+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:43:33.766934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"104'3","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.593278+0000","last_change":"2023-12-18T10:25:18.182831+0000","last_active":"2023-12-18T10:25:18.593278+0000","last_peered":"2023-12-18T10:25:18.593278+0000","last_clean":"2023-12-18T10:25:18.593278+0000","last_became_active":"2023-12-18T10:25:18.182530+0000","last_became_peered":"2023-12-18T10:25:18.182530+0000","last_unstale":"2023-12-18T10:25:18.593278+0000","last_undegraded":"2023-12-18T10:25:18.593278+0000","last_fullsized":"2023-12-18T10:25:18.593278+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:30.804813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.296018+0000","last_change":"2023-12-18T10:25:18.574749+0000","last_active":"2023-12-18T10:25:20.296018+0000","last_peered":"2023-12-18T10:25:20.296018+0000","last_clean":"2023-12-18T10:25:20.296018+0000","last_became_active":"2023-12-18T10:25:18.574501+0000","last_became_peered":"2023-12-18T10:25:18.574501+0000","last_unstale":"2023-12-18T10:25:20.296018+0000","last_undegraded":"2023-12-18T10:25:20.296018+0000","last_fullsized":"2023-12-18T10:25:20.296018+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:11.122591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"104'6","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.603262+0000","last_change":"2023-12-18T10:25:18.177009+0000","last_active":"2023-12-18T10:25:18.603262+0000","last_peered":"2023-12-18T10:25:18.603262+0000","last_clean":"2023-12-18T10:25:18.603262+0000","last_became_active":"2023-12-18T10:25:18.176711+0000","last_became_peered":"2023-12-18T10:25:18.176711+0000","last_unstale":"2023-12-18T10:25:18.603262+0000","last_undegraded":"2023-12-18T10:25:18.603262+0000","last_fullsized":"2023-12-18T10:25:18.603262+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:25:20.134299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364202+0000","last_change":"2023-12-18T10:25:18.589073+0000","last_active":"2023-12-18T10:25:20.364202+0000","last_peered":"2023-12-18T10:25:20.364202+0000","last_clean":"2023-12-18T10:25:20.364202+0000","last_became_active":"2023-12-18T10:25:18.588803+0000","last_became_peered":"2023-12-18T10:25:18.588803+0000","last_unstale":"2023-12-18T10:25:20.364202+0000","last_undegraded":"2023-12-18T10:25:20.364202+0000","last_fullsized":"2023-12-18T10:25:20.364202+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:58:34.407981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.588752+0000","last_change":"2023-12-18T10:25:18.186311+0000","last_active":"2023-12-18T10:25:18.588752+0000","last_peered":"2023-12-18T10:25:18.588752+0000","last_clean":"2023-12-18T10:25:18.588752+0000","last_became_active":"2023-12-18T10:25:18.186032+0000","last_became_peered":"2023-12-18T10:25:18.186032+0000","last_unstale":"2023-12-18T10:25:18.588752+0000","last_undegraded":"2023-12-18T10:25:18.588752+0000","last_fullsized":"2023-12-18T10:25:18.588752+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:46:16.979293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363712+0000","last_change":"2023-12-18T10:25:18.595044+0000","last_active":"2023-12-18T10:25:20.363712+0000","last_peered":"2023-12-18T10:25:20.363712+0000","last_clean":"2023-12-18T10:25:20.363712+0000","last_became_active":"2023-12-18T10:25:18.594496+0000","last_became_peered":"2023-12-18T10:25:18.594496+0000","last_unstale":"2023-12-18T10:25:20.363712+0000","last_undegraded":"2023-12-18T10:25:20.363712+0000","last_fullsized":"2023-12-18T10:25:20.363712+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:55:58.079145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.571971+0000","last_change":"2023-12-18T10:25:18.180549+0000","last_active":"2023-12-18T10:25:18.571971+0000","last_peered":"2023-12-18T10:25:18.571971+0000","last_clean":"2023-12-18T10:25:18.571971+0000","last_became_active":"2023-12-18T10:25:18.180285+0000","last_became_peered":"2023-12-18T10:25:18.180285+0000","last_unstale":"2023-12-18T10:25:18.571971+0000","last_undegraded":"2023-12-18T10:25:18.571971+0000","last_fullsized":"2023-12-18T10:25:18.571971+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:55:31.907598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318663+0000","last_change":"2023-12-18T10:25:18.576153+0000","last_active":"2023-12-18T10:25:20.318663+0000","last_peered":"2023-12-18T10:25:20.318663+0000","last_clean":"2023-12-18T10:25:20.318663+0000","last_became_active":"2023-12-18T10:25:18.574719+0000","last_became_peered":"2023-12-18T10:25:18.574719+0000","last_unstale":"2023-12-18T10:25:20.318663+0000","last_undegraded":"2023-12-18T10:25:20.318663+0000","last_fullsized":"2023-12-18T10:25:20.318663+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:43:33.433576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558615+0000","last_change":"2023-12-18T10:25:18.185928+0000","last_active":"2023-12-18T10:25:18.558615+0000","last_peered":"2023-12-18T10:25:18.558615+0000","last_clean":"2023-12-18T10:25:18.558615+0000","last_became_active":"2023-12-18T10:25:18.185598+0000","last_became_peered":"2023-12-18T10:25:18.185598+0000","last_unstale":"2023-12-18T10:25:18.558615+0000","last_undegraded":"2023-12-18T10:25:18.558615+0000","last_fullsized":"2023-12-18T10:25:18.558615+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:50:37.231695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566374+0000","last_change":"2023-12-18T10:25:18.596383+0000","last_active":"2023-12-18T10:25:19.566374+0000","last_peered":"2023-12-18T10:25:19.566374+0000","last_clean":"2023-12-18T10:25:19.566374+0000","last_became_active":"2023-12-18T10:25:18.595891+0000","last_became_peered":"2023-12-18T10:25:18.595891+0000","last_unstale":"2023-12-18T10:25:19.566374+0000","last_undegraded":"2023-12-18T10:25:19.566374+0000","last_fullsized":"2023-12-18T10:25:19.566374+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:51:48.242261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"104'8","reported_seq":19,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.601731+0000","last_change":"2023-12-18T10:25:18.174398+0000","last_active":"2023-12-18T10:25:18.601731+0000","last_peered":"2023-12-18T10:25:18.601731+0000","last_clean":"2023-12-18T10:25:18.601731+0000","last_became_active":"2023-12-18T10:25:18.174088+0000","last_became_peered":"2023-12-18T10:25:18.174088+0000","last_unstale":"2023-12-18T10:25:18.601731+0000","last_undegraded":"2023-12-18T10:25:18.601731+0000","last_fullsized":"2023-12-18T10:25:18.601731+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T15:52:23.176182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318721+0000","last_change":"2023-12-18T10:25:18.568705+0000","last_active":"2023-12-18T10:25:20.318721+0000","last_peered":"2023-12-18T10:25:20.318721+0000","last_clean":"2023-12-18T10:25:20.318721+0000","last_became_active":"2023-12-18T10:25:18.568399+0000","last_became_peered":"2023-12-18T10:25:18.568399+0000","last_unstale":"2023-12-18T10:25:20.318721+0000","last_undegraded":"2023-12-18T10:25:20.318721+0000","last_fullsized":"2023-12-18T10:25:20.318721+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:57:11.481895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.596897+0000","last_change":"2023-12-18T10:25:18.179664+0000","last_active":"2023-12-18T10:25:18.596897+0000","last_peered":"2023-12-18T10:25:18.596897+0000","last_clean":"2023-12-18T10:25:18.596897+0000","last_became_active":"2023-12-18T10:25:18.179355+0000","last_became_peered":"2023-12-18T10:25:18.179355+0000","last_unstale":"2023-12-18T10:25:18.596897+0000","last_undegraded":"2023-12-18T10:25:18.596897+0000","last_fullsized":"2023-12-18T10:25:18.596897+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:21:32.694099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363406+0000","last_change":"2023-12-18T10:25:18.593608+0000","last_active":"2023-12-18T10:25:20.363406+0000","last_peered":"2023-12-18T10:25:20.363406+0000","last_clean":"2023-12-18T10:25:20.363406+0000","last_became_active":"2023-12-18T10:25:18.593047+0000","last_became_peered":"2023-12-18T10:25:18.593047+0000","last_unstale":"2023-12-18T10:25:20.363406+0000","last_undegraded":"2023-12-18T10:25:20.363406+0000","last_fullsized":"2023-12-18T10:25:20.363406+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:46:20.032305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"104'1","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582725+0000","last_change":"2023-12-18T10:25:18.179329+0000","last_active":"2023-12-18T10:25:18.582725+0000","last_peered":"2023-12-18T10:25:18.582725+0000","last_clean":"2023-12-18T10:25:18.582725+0000","last_became_active":"2023-12-18T10:25:18.179055+0000","last_became_peered":"2023-12-18T10:25:18.179055+0000","last_unstale":"2023-12-18T10:25:18.582725+0000","last_undegraded":"2023-12-18T10:25:18.582725+0000","last_fullsized":"2023-12-18T10:25:18.582725+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:25:10.119938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.295900+0000","last_change":"2023-12-18T10:25:18.580954+0000","last_active":"2023-12-18T10:25:20.295900+0000","last_peered":"2023-12-18T10:25:20.295900+0000","last_clean":"2023-12-18T10:25:20.295900+0000","last_became_active":"2023-12-18T10:25:18.580048+0000","last_became_peered":"2023-12-18T10:25:18.580048+0000","last_unstale":"2023-12-18T10:25:20.295900+0000","last_undegraded":"2023-12-18T10:25:20.295900+0000","last_fullsized":"2023-12-18T10:25:20.295900+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:27:35.783756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582799+0000","last_change":"2023-12-18T10:25:18.185324+0000","last_active":"2023-12-18T10:25:18.582799+0000","last_peered":"2023-12-18T10:25:18.582799+0000","last_clean":"2023-12-18T10:25:18.582799+0000","last_became_active":"2023-12-18T10:25:18.184982+0000","last_became_peered":"2023-12-18T10:25:18.184982+0000","last_unstale":"2023-12-18T10:25:18.582799+0000","last_undegraded":"2023-12-18T10:25:18.582799+0000","last_fullsized":"2023-12-18T10:25:18.582799+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:55:57.076492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565965+0000","last_change":"2023-12-18T10:25:18.587216+0000","last_active":"2023-12-18T10:25:19.565965+0000","last_peered":"2023-12-18T10:25:19.565965+0000","last_clean":"2023-12-18T10:25:19.565965+0000","last_became_active":"2023-12-18T10:25:18.586956+0000","last_became_peered":"2023-12-18T10:25:18.586956+0000","last_unstale":"2023-12-18T10:25:19.565965+0000","last_undegraded":"2023-12-18T10:25:19.565965+0000","last_fullsized":"2023-12-18T10:25:19.565965+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:14:13.023201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.583171+0000","last_change":"2023-12-18T10:25:18.184922+0000","last_active":"2023-12-18T10:25:18.583171+0000","last_peered":"2023-12-18T10:25:18.583171+0000","last_clean":"2023-12-18T10:25:18.583171+0000","last_became_active":"2023-12-18T10:25:18.184665+0000","last_became_peered":"2023-12-18T10:25:18.184665+0000","last_unstale":"2023-12-18T10:25:18.583171+0000","last_undegraded":"2023-12-18T10:25:18.583171+0000","last_fullsized":"2023-12-18T10:25:18.583171+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T19:36:16.763875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566176+0000","last_change":"2023-12-18T10:25:18.578960+0000","last_active":"2023-12-18T10:25:19.566176+0000","last_peered":"2023-12-18T10:25:19.566176+0000","last_clean":"2023-12-18T10:25:19.566176+0000","last_became_active":"2023-12-18T10:25:18.578139+0000","last_became_peered":"2023-12-18T10:25:18.578139+0000","last_unstale":"2023-12-18T10:25:19.566176+0000","last_undegraded":"2023-12-18T10:25:19.566176+0000","last_fullsized":"2023-12-18T10:25:19.566176+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:51:58.213095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558590+0000","last_change":"2023-12-18T10:25:18.190645+0000","last_active":"2023-12-18T10:25:18.558590+0000","last_peered":"2023-12-18T10:25:18.558590+0000","last_clean":"2023-12-18T10:25:18.558590+0000","last_became_active":"2023-12-18T10:25:18.190245+0000","last_became_peered":"2023-12-18T10:25:18.190245+0000","last_unstale":"2023-12-18T10:25:18.558590+0000","last_undegraded":"2023-12-18T10:25:18.558590+0000","last_fullsized":"2023-12-18T10:25:18.558590+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:33:49.391448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.567138+0000","last_change":"2023-12-18T10:25:18.591930+0000","last_active":"2023-12-18T10:25:19.567138+0000","last_peered":"2023-12-18T10:25:19.567138+0000","last_clean":"2023-12-18T10:25:19.567138+0000","last_became_active":"2023-12-18T10:25:18.591616+0000","last_became_peered":"2023-12-18T10:25:18.591616+0000","last_unstale":"2023-12-18T10:25:19.567138+0000","last_undegraded":"2023-12-18T10:25:19.567138+0000","last_fullsized":"2023-12-18T10:25:19.567138+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:07:07.624637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582422+0000","last_change":"2023-12-18T10:25:18.178584+0000","last_active":"2023-12-18T10:25:18.582422+0000","last_peered":"2023-12-18T10:25:18.582422+0000","last_clean":"2023-12-18T10:25:18.582422+0000","last_became_active":"2023-12-18T10:25:18.178315+0000","last_became_peered":"2023-12-18T10:25:18.178315+0000","last_unstale":"2023-12-18T10:25:18.582422+0000","last_undegraded":"2023-12-18T10:25:18.582422+0000","last_fullsized":"2023-12-18T10:25:18.582422+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:53:14.275325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318719+0000","last_change":"2023-12-18T10:25:18.581238+0000","last_active":"2023-12-18T10:25:20.318719+0000","last_peered":"2023-12-18T10:25:20.318719+0000","last_clean":"2023-12-18T10:25:20.318719+0000","last_became_active":"2023-12-18T10:25:18.581012+0000","last_became_peered":"2023-12-18T10:25:18.581012+0000","last_unstale":"2023-12-18T10:25:20.318719+0000","last_undegraded":"2023-12-18T10:25:20.318719+0000","last_fullsized":"2023-12-18T10:25:20.318719+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:47:47.246006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.559372+0000","last_change":"2023-12-18T10:25:18.188393+0000","last_active":"2023-12-18T10:25:18.559372+0000","last_peered":"2023-12-18T10:25:18.559372+0000","last_clean":"2023-12-18T10:25:18.559372+0000","last_became_active":"2023-12-18T10:25:18.188118+0000","last_became_peered":"2023-12-18T10:25:18.188118+0000","last_unstale":"2023-12-18T10:25:18.559372+0000","last_undegraded":"2023-12-18T10:25:18.559372+0000","last_fullsized":"2023-12-18T10:25:18.559372+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:56:58.730035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.565641+0000","last_change":"2023-12-18T10:25:18.584161+0000","last_active":"2023-12-18T10:25:19.565641+0000","last_peered":"2023-12-18T10:25:19.565641+0000","last_clean":"2023-12-18T10:25:19.565641+0000","last_became_active":"2023-12-18T10:25:18.583920+0000","last_became_peered":"2023-12-18T10:25:18.583920+0000","last_unstale":"2023-12-18T10:25:19.565641+0000","last_undegraded":"2023-12-18T10:25:19.565641+0000","last_fullsized":"2023-12-18T10:25:19.565641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T22:00:29.240668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.580227+0000","last_change":"2023-12-18T10:25:18.186278+0000","last_active":"2023-12-18T10:25:18.580227+0000","last_peered":"2023-12-18T10:25:18.580227+0000","last_clean":"2023-12-18T10:25:18.580227+0000","last_became_active":"2023-12-18T10:25:18.185982+0000","last_became_peered":"2023-12-18T10:25:18.185982+0000","last_unstale":"2023-12-18T10:25:18.580227+0000","last_undegraded":"2023-12-18T10:25:18.580227+0000","last_fullsized":"2023-12-18T10:25:18.580227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T17:46:19.029652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.363002+0000","last_change":"2023-12-18T10:25:18.586305+0000","last_active":"2023-12-18T10:25:20.363002+0000","last_peered":"2023-12-18T10:25:20.363002+0000","last_clean":"2023-12-18T10:25:20.363002+0000","last_became_active":"2023-12-18T10:25:18.586001+0000","last_became_peered":"2023-12-18T10:25:18.586001+0000","last_unstale":"2023-12-18T10:25:20.363002+0000","last_undegraded":"2023-12-18T10:25:20.363002+0000","last_fullsized":"2023-12-18T10:25:20.363002+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:40:28.778204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.563136+0000","last_change":"2023-12-18T10:25:18.176698+0000","last_active":"2023-12-18T10:25:18.563136+0000","last_peered":"2023-12-18T10:25:18.563136+0000","last_clean":"2023-12-18T10:25:18.563136+0000","last_became_active":"2023-12-18T10:25:18.176184+0000","last_became_peered":"2023-12-18T10:25:18.176184+0000","last_unstale":"2023-12-18T10:25:18.563136+0000","last_undegraded":"2023-12-18T10:25:18.563136+0000","last_fullsized":"2023-12-18T10:25:18.563136+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T12:18:02.921368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:19.566897+0000","last_change":"2023-12-18T10:25:18.591625+0000","last_active":"2023-12-18T10:25:19.566897+0000","last_peered":"2023-12-18T10:25:19.566897+0000","last_clean":"2023-12-18T10:25:19.566897+0000","last_became_active":"2023-12-18T10:25:18.591368+0000","last_became_peered":"2023-12-18T10:25:18.591368+0000","last_unstale":"2023-12-18T10:25:19.566897+0000","last_undegraded":"2023-12-18T10:25:19.566897+0000","last_fullsized":"2023-12-18T10:25:19.566897+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:59:12.934113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.580264+0000","last_change":"2023-12-18T10:25:18.184247+0000","last_active":"2023-12-18T10:25:18.580264+0000","last_peered":"2023-12-18T10:25:18.580264+0000","last_clean":"2023-12-18T10:25:18.580264+0000","last_became_active":"2023-12-18T10:25:18.183040+0000","last_became_peered":"2023-12-18T10:25:18.183040+0000","last_unstale":"2023-12-18T10:25:18.580264+0000","last_undegraded":"2023-12-18T10:25:18.580264+0000","last_fullsized":"2023-12-18T10:25:18.580264+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:36:19.749344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364978+0000","last_change":"2023-12-18T10:25:18.590958+0000","last_active":"2023-12-18T10:25:20.364978+0000","last_peered":"2023-12-18T10:25:20.364978+0000","last_clean":"2023-12-18T10:25:20.364978+0000","last_became_active":"2023-12-18T10:25:18.590420+0000","last_became_peered":"2023-12-18T10:25:18.590420+0000","last_unstale":"2023-12-18T10:25:20.364978+0000","last_undegraded":"2023-12-18T10:25:20.364978+0000","last_fullsized":"2023-12-18T10:25:20.364978+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T14:56:31.384969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.572242+0000","last_change":"2023-12-18T10:25:18.183648+0000","last_active":"2023-12-18T10:25:18.572242+0000","last_peered":"2023-12-18T10:25:18.572242+0000","last_clean":"2023-12-18T10:25:18.572242+0000","last_became_active":"2023-12-18T10:25:18.183338+0000","last_became_peered":"2023-12-18T10:25:18.183338+0000","last_unstale":"2023-12-18T10:25:18.572242+0000","last_undegraded":"2023-12-18T10:25:18.572242+0000","last_fullsized":"2023-12-18T10:25:18.572242+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:33:11.568787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318790+0000","last_change":"2023-12-18T10:25:18.582814+0000","last_active":"2023-12-18T10:25:20.318790+0000","last_peered":"2023-12-18T10:25:20.318790+0000","last_clean":"2023-12-18T10:25:20.318790+0000","last_became_active":"2023-12-18T10:25:18.581107+0000","last_became_peered":"2023-12-18T10:25:18.581107+0000","last_unstale":"2023-12-18T10:25:20.318790+0000","last_undegraded":"2023-12-18T10:25:20.318790+0000","last_fullsized":"2023-12-18T10:25:20.318790+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T10:38:23.561988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569175+0000","last_change":"2023-12-18T10:25:18.173996+0000","last_active":"2023-12-18T10:25:18.569175+0000","last_peered":"2023-12-18T10:25:18.569175+0000","last_clean":"2023-12-18T10:25:18.569175+0000","last_became_active":"2023-12-18T10:25:18.173699+0000","last_became_peered":"2023-12-18T10:25:18.173699+0000","last_unstale":"2023-12-18T10:25:18.569175+0000","last_undegraded":"2023-12-18T10:25:18.569175+0000","last_fullsized":"2023-12-18T10:25:18.569175+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T13:44:44.024501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.318671+0000","last_change":"2023-12-18T10:25:18.585426+0000","last_active":"2023-12-18T10:25:20.318671+0000","last_peered":"2023-12-18T10:25:20.318671+0000","last_clean":"2023-12-18T10:25:20.318671+0000","last_became_active":"2023-12-18T10:25:18.580594+0000","last_became_peered":"2023-12-18T10:25:18.580594+0000","last_unstale":"2023-12-18T10:25:20.318671+0000","last_undegraded":"2023-12-18T10:25:20.318671+0000","last_fullsized":"2023-12-18T10:25:20.318671+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T18:38:14.196425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.558747+0000","last_change":"2023-12-18T10:25:18.190190+0000","last_active":"2023-12-18T10:25:18.558747+0000","last_peered":"2023-12-18T10:25:18.558747+0000","last_clean":"2023-12-18T10:25:18.558747+0000","last_became_active":"2023-12-18T10:25:18.189895+0000","last_became_peered":"2023-12-18T10:25:18.189895+0000","last_unstale":"2023-12-18T10:25:18.558747+0000","last_undegraded":"2023-12-18T10:25:18.558747+0000","last_fullsized":"2023-12-18T10:25:18.558747+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T11:41:07.781582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364893+0000","last_change":"2023-12-18T10:25:18.590562+0000","last_active":"2023-12-18T10:25:20.364893+0000","last_peered":"2023-12-18T10:25:20.364893+0000","last_clean":"2023-12-18T10:25:20.364893+0000","last_became_active":"2023-12-18T10:25:18.590295+0000","last_became_peered":"2023-12-18T10:25:18.590295+0000","last_unstale":"2023-12-18T10:25:20.364893+0000","last_undegraded":"2023-12-18T10:25:20.364893+0000","last_fullsized":"2023-12-18T10:25:20.364893+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:53:12.765081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.582516+0000","last_change":"2023-12-18T10:25:18.186738+0000","last_active":"2023-12-18T10:25:18.582516+0000","last_peered":"2023-12-18T10:25:18.582516+0000","last_clean":"2023-12-18T10:25:18.582516+0000","last_became_active":"2023-12-18T10:25:18.186523+0000","last_became_peered":"2023-12-18T10:25:18.186523+0000","last_unstale":"2023-12-18T10:25:18.582516+0000","last_undegraded":"2023-12-18T10:25:18.582516+0000","last_fullsized":"2023-12-18T10:25:18.582516+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:29:48.530491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364891+0000","last_change":"2023-12-18T10:25:18.595651+0000","last_active":"2023-12-18T10:25:20.364891+0000","last_peered":"2023-12-18T10:25:20.364891+0000","last_clean":"2023-12-18T10:25:20.364891+0000","last_became_active":"2023-12-18T10:25:18.595329+0000","last_became_peered":"2023-12-18T10:25:18.595329+0000","last_unstale":"2023-12-18T10:25:20.364891+0000","last_undegraded":"2023-12-18T10:25:20.364891+0000","last_fullsized":"2023-12-18T10:25:20.364891+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:37:43.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.559436+0000","last_change":"2023-12-18T10:25:18.186677+0000","last_active":"2023-12-18T10:25:18.559436+0000","last_peered":"2023-12-18T10:25:18.559436+0000","last_clean":"2023-12-18T10:25:18.559436+0000","last_became_active":"2023-12-18T10:25:18.186409+0000","last_became_peered":"2023-12-18T10:25:18.186409+0000","last_unstale":"2023-12-18T10:25:18.559436+0000","last_undegraded":"2023-12-18T10:25:18.559436+0000","last_fullsized":"2023-12-18T10:25:18.559436+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:01:55.510810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-18T10:25:20.364295+0000","last_change":"2023-12-18T10:25:18.592647+0000","last_active":"2023-12-18T10:25:20.364295+0000","last_peered":"2023-12-18T10:25:20.364295+0000","last_clean":"2023-12-18T10:25:20.364295+0000","last_became_active":"2023-12-18T10:25:18.592388+0000","last_became_peered":"2023-12-18T10:25:18.592388+0000","last_unstale":"2023-12-18T10:25:20.364295+0000","last_undegraded":"2023-12-18T10:25:20.364295+0000","last_fullsized":"2023-12-18T10:25:20.364295+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:18.151482+0000","last_clean_scrub_stamp":"2023-12-18T10:25:18.151482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T20:13:37.244002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"104'2","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.584202+0000","last_change":"2023-12-18T10:25:18.188528+0000","last_active":"2023-12-18T10:25:18.584202+0000","last_peered":"2023-12-18T10:25:18.584202+0000","last_clean":"2023-12-18T10:25:18.584202+0000","last_became_active":"2023-12-18T10:25:18.188173+0000","last_became_peered":"2023-12-18T10:25:18.188173+0000","last_unstale":"2023-12-18T10:25:18.584202+0000","last_undegraded":"2023-12-18T10:25:18.584202+0000","last_fullsized":"2023-12-18T10:25:18.584202+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:25:17.148829+0000","last_clean_scrub_stamp":"2023-12-18T10:25:17.148829+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:46:12.832194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":233,"reported_epoch":104,"state":"active+clean","last_fresh":"2023-12-18T10:25:18.569491+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:25:18.569491+0000","last_peered":"2023-12-18T10:25:18.569491+0000","last_clean":"2023-12-18T10:25:18.569491+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:25:18.569491+0000","last_undegraded":"2023-12-18T10:25:18.569491+0000","last_fullsized":"2023-12-18T10:25:18.569491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574941,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1904640,"data_stored":1193019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.83099999999999996,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.505}]},{"osd":1,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.42599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":1.042,"15min":1.042},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82799999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66900000000000004,"15min":0.63900000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":1.081,"15min":1.081},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.67400000000000004},"min":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.81499999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83499999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.66600000000000004,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.85599999999999998,"5min":1.097,"15min":1.097},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.69599999999999995},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.80400000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81299999999999994,"5min":0.88400000000000001,"15min":0.91000000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70699999999999996,"15min":0.72899999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.82199999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.91900000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.68100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88200000000000001,"5min":1.137,"15min":1.137},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.61499999999999999,"15min":0.66100000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":1.024,"15min":1.024},"last":0.86699999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.74399999999999999,"15min":0.76900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.873,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.89900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1323008,"data_stored":604659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.65100000000000002,"15min":0.79600000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.018,"5min":1.018,"15min":4.3760000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68799999999999994,"15min":0.83899999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.56599999999999995}]},{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66100000000000003,"15min":0.73299999999999998},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.845},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69799999999999995,"15min":0.82499999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.179,"5min":1.179,"15min":4.524},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":1.121,"5min":1.121,"15min":2.2709999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.746},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.498}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71299999999999997,"15min":0.80500000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91400000000000003,"5min":1.0489999999999999,"15min":2.0270000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.84499999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.90500000000000003,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.62}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.65600000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65400000000000003,"15min":0.67900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.88700000000000001,"5min":1.0049999999999999,"15min":1.101},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.627,"15min":0.64200000000000002},"min":{"1min":0.42999999999999999,"5min":0.41099999999999998,"15min":0.38600000000000001},"max":{"1min":0.82299999999999995,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67600000000000005,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.93500000000000005,"5min":0.98799999999999999,"15min":1.284},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.73399999999999999},"min":{"1min":0.45200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91400000000000003,"5min":1.0880000000000001,"15min":1.129},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69199999999999995,"15min":0.74399999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89500000000000002,"5min":1.006,"15min":1.0820000000000001},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1272,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1302528,"data_stored":602491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.66000000000000003},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.32500000000000001},"max":{"1min":0.80000000000000004,"5min":0.873,"15min":1.0900000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.66500000000000004,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.78600000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.65500000000000003,"15min":0.73199999999999998},"min":{"1min":0.45600000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.85799999999999998,"5min":0.92500000000000004,"15min":3.3100000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.879,"5min":0.879,"15min":0.90500000000000003},"last":0.67700000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66100000000000003,"15min":0.749},"min":{"1min":0.432,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.81000000000000005,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67400000000000004,"15min":0.77100000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89100000000000001,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68899999999999995,"15min":0.72899999999999998},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":2.0699999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67800000000000005,"15min":0.79100000000000004},"min":{"1min":0.502,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.88200000000000001,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.871}]},{"osd":4,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.63300000000000001,"15min":0.89400000000000002},"min":{"1min":0.48899999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.82899999999999996,"5min":0.88,"15min":8.9740000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68100000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92300000000000004,"5min":0.97899999999999998,"15min":1.2370000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.72999999999999998},"min":{"1min":0.46899999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":2.9060000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63700000000000001,"15min":0.76000000000000001},"min":{"1min":0.55300000000000005,"5min":0.378,"15min":0.378},"max":{"1min":0.92100000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.505}]},{"osd":7,"last update":"Mon Dec 18 10:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.64400000000000002,"15min":0.68600000000000005},"min":{"1min":0.51300000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.96899999999999997,"5min":1.042,"15min":1.1830000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.67400000000000004,"15min":0.79200000000000004},"min":{"1min":0.53600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.94399999999999995,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":602583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.66800000000000004},"min":{"1min":0.503,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91600000000000004,"5min":0.96799999999999997,"15min":1.0249999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.49299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.84099999999999997,"5min":0.92800000000000005,"15min":1.1739999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.51600000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.131},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66700000000000004,"15min":0.67800000000000005},"min":{"1min":0.54500000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68200000000000005}]},{"osd":2,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.0860000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.71399999999999997},"min":{"1min":0.53800000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89600000000000002,"5min":1.008,"15min":1.032},"last":0.66700000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.499},"max":{"1min":0.86199999999999999,"5min":0.94499999999999995,"15min":0.999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70799999999999996,"15min":0.72099999999999997},"min":{"1min":0.53900000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60099999999999998,"15min":0.63},"min":{"1min":0.439,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68500000000000005,"5min":0.91900000000000004,"15min":0.97399999999999998},"last":0.621},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.77600000000000002,"5min":0.86799999999999999,"15min":0.874},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.41799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.71799999999999997},"min":{"1min":0.55000000000000004,"5min":0.376,"15min":0.376},"max":{"1min":0.82299999999999995,"5min":1.0109999999999999,"15min":1.073},"last":0.79200000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66700000000000004,"15min":0.70399999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89700000000000002,"5min":0.90900000000000003,"15min":1.042},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69199999999999995,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90500000000000003,"15min":1.1479999999999999},"last":0.746}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":603073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41699999999999998,"15min":0.42499999999999999},"min":{"1min":0.30299999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.58999999999999997,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.45600000000000002,"15min":0.498},"min":{"1min":0.32600000000000001,"5min":0.28299999999999997,"15min":0.27800000000000002},"max":{"1min":0.59699999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.442,"15min":0.46400000000000002},"min":{"1min":0.312,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53800000000000003,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.371},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.66300000000000003,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":1.036,"15min":1.254},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.64300000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.755,"5min":0.98899999999999999,"15min":1.772},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.68100000000000005},"min":{"1min":0.45200000000000001,"5min":0.40699999999999997,"15min":0.34399999999999997},"max":{"1min":0.90400000000000003,"5min":0.94799999999999995,"15min":1.01},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70499999999999996,"15min":0.71599999999999997},"min":{"1min":0.60999999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.167,"15min":1.181},"last":0.71399999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.171,"15min":1.171},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68400000000000005,"15min":0.70599999999999996},"min":{"1min":0.503,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93700000000000006,"5min":1.0549999999999999,"15min":1.069},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.60899999999999999,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.88,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72199999999999998,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98699999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72099999999999997,"15min":0.76400000000000001},"min":{"1min":0.53400000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.95799999999999996,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.751},"min":{"1min":0.54700000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90000000000000002,"5min":1.26,"15min":1.26},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":602525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.61499999999999999,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46700000000000003,"15min":0.496},"min":{"1min":0.33300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.60399999999999998,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.34200000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47699999999999998,"15min":0.49099999999999999},"min":{"1min":0.316,"5min":0.315,"15min":0.315},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.434},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76300000000000001,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.48399999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.92000000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.52700000000000002,"15min":0.55800000000000005},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":1.1599999999999999},"last":0.50800000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.78400000000000003},"min":{"1min":0.55900000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.90500000000000003,"5min":1.0469999999999999,"15min":1.698},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.50900000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88500000000000001,"5min":1.0820000000000001,"15min":1.4219999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.873,"5min":0.95999999999999996,"15min":1.3069999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.752,"15min":0.80100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93899999999999995,"5min":1.085,"15min":1.7549999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0680000000000001,"15min":1.341},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.3939999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.61299999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85099999999999998,"5min":1.048,"15min":1.282},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.94799999999999995,"5min":1.093,"15min":1.4530000000000001},"last":0.65000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1306624,"data_stored":602525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.55800000000000005},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.58399999999999996,"5min":0.64400000000000002,"15min":3.976},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":1.9079999999999999},"last":0.67000000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45200000000000001,"15min":0.59899999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":3.786},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.46300000000000002,"15min":0.50700000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59599999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50700000000000001,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.60099999999999998,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.625},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.32400000000000001},"max":{"1min":0.63900000000000001,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.71399999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89300000000000002,"5min":1.1399999999999999,"15min":1.851},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73299999999999998,"15min":0.879},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"max":{"1min":0.95599999999999996,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.86599999999999999},"min":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.435},"max":{"1min":0.995,"5min":1.0960000000000001,"15min":4.1859999999999999},"last":1.024},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72199999999999998,"15min":0.77200000000000002},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.504},"max":{"1min":0.877,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.93200000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.01,"5min":1.056,"15min":2.0699999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.89900000000000002},"min":{"1min":0.56999999999999995,"5min":0.52600000000000002,"15min":0.47099999999999997},"max":{"1min":0.94399999999999995,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.94999999999999996}]},{"osd":7,"last update":"Mon Dec 18 10:25:02 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73699999999999999,"15min":0.78500000000000003},"min":{"1min":0.60099999999999998,"5min":0.499,"15min":0.499},"max":{"1min":0.90600000000000003,"5min":1.0529999999999999,"15min":2.1890000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77500000000000002,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.56499999999999995,"15min":0.52500000000000002},"max":{"1min":0.95599999999999996,"5min":1.0649999999999999,"15min":1.9770000000000001},"last":1.0089999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1912832,"data_stored":1194513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.439,"15min":0.47899999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.252},"max":{"1min":0.59599999999999997,"5min":0.96899999999999997,"15min":1.5109999999999999},"last":0.37},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.66000000000000003,"5min":0.92900000000000005,"15min":1.456},"last":0.45400000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45700000000000002,"15min":0.52600000000000002},"min":{"1min":0.317,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70399999999999996,"5min":1.0589999999999999,"15min":1.595},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47299999999999998,"15min":0.55900000000000005},"min":{"1min":0.33600000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":2.464},"last":0.495}]},{"osd":3,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47199999999999998,"15min":0.51800000000000002},"min":{"1min":0.29899999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63500000000000001,"5min":0.85699999999999998,"15min":1.859},"last":0.436},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55300000000000005,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38800000000000001},"max":{"1min":0.67100000000000004,"5min":0.90000000000000002,"15min":1.903},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78800000000000003,"15min":0.79100000000000004},"min":{"1min":0.55400000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.0700000000000001,"5min":1.3240000000000001,"15min":1.494},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.76700000000000002,"15min":0.76100000000000001},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.1279999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.623}]},{"osd":5,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78500000000000003,"15min":0.76000000000000001},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.46700000000000003},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.79800000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0329999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.78900000000000003},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0720000000000001,"5min":1.278,"15min":1.5700000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73999999999999999,"15min":0.77700000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.53},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Dec 18 10:25:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73099999999999998,"15min":0.78100000000000003},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0469999999999999,"5min":1.349,"15min":1.556},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.77200000000000002},"min":{"1min":0.53100000000000003,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:25:27.496 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-18T10:25:27.497 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-18T10:25:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.677+0000 7ff0b8b2c640 1 Processor -- start 2023-12-18T10:25:27.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.677+0000 7ff0b8b2c640 1 -- start start 2023-12-18T10:25:27.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b8b2c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0b40702d0 0x7ff0b40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b8b2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b40cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b8b2c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0b40ccd60 0x7ff0b415b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b8b2c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b4070bf0 con 0x7ff0b40ccd60 2023-12-18T10:25:27.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b8b2c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b4155410 con 0x7ff0b40702d0 2023-12-18T10:25:27.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b8b2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b415ea60 con 0x7ff0b415e4f0 2023-12-18T10:25:27.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0b40ccd60 0x7ff0b415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0b40ccd60 0x7ff0b415b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57148/0 (socket says 172.21.15.133:57148) 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 -- 172.21.15.133:0/2869791030 learned_addr learned my addr 172.21.15.133:0/2869791030 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0a9d9b640 1 --2- 172.21.15.133:0/2869791030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b40cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b259c640 1 --2- 172.21.15.133:0/2869791030 >> v2:172.21.15.142:3300/0 conn(0x7ff0b40702d0 0x7ff0b40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 -- 172.21.15.133:0/2869791030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 msgr2=0x7ff0b40cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 --2- 172.21.15.133:0/2869791030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b40cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 -- 172.21.15.133:0/2869791030 >> v2:172.21.15.142:3300/0 conn(0x7ff0b40702d0 msgr2=0x7ff0b40706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 --2- 172.21.15.133:0/2869791030 >> v2:172.21.15.142:3300/0 conn(0x7ff0b40702d0 0x7ff0b40706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 -- 172.21.15.133:0/2869791030 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b415ed40 con 0x7ff0b40ccd60 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0a9d9b640 1 --2- 172.21.15.133:0/2869791030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b40cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:27.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b259c640 1 --2- 172.21.15.133:0/2869791030 >> v2:172.21.15.142:3300/0 conn(0x7ff0b40702d0 0x7ff0b40706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:27.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.681+0000 7ff0b2d9d640 1 --2- 172.21.15.133:0/2869791030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40ccd60 0x7ff0b415b530 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7ff0b406cfe0 tx=0x7ff0ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ccc79db957e29c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b1d9b640 1 -- 172.21.15.133:0/2869791030 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0ac600 con 0x7ff0b40ccd60 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b1d9b640 1 -- 172.21.15.133:0/2869791030 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0a8050 con 0x7ff0b40ccd60 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b1d9b640 1 -- 172.21.15.133:0/2869791030 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0ac980 con 0x7ff0b40ccd60 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/2869791030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40ccd60 msgr2=0x7ff0b415b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/2869791030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40ccd60 0x7ff0b415b530 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7ff0b406cfe0 tx=0x7ff0ac01c4d0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/2869791030 shutdown_connections 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/2869791030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40ccd60 0x7ff0b415b530 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/2869791030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b40cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/2869791030 >> v2:172.21.15.142:3300/0 conn(0x7ff0b40702d0 0x7ff0b40706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/2869791030 >> 172.21.15.133:0/2869791030 conn(0x7ff0b40ce450 msgr2=0x7ff0b40ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/2869791030 shutdown_connections 2023-12-18T10:25:27.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/2869791030 wait complete. 2023-12-18T10:25:27.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 Processor -- start 2023-12-18T10:25:27.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 -- start start 2023-12-18T10:25:27.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40702d0 0x7ff0b40c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.685+0000 7ff0b8b2c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b40ccd60 0x7ff0b406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b8b2c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b406c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b8b2c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40c7b10 con 0x7ff0b40702d0 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b8b2c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40c6e90 con 0x7ff0b40ccd60 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b8b2c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40c7170 con 0x7ff0b415e4f0 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40702d0 0x7ff0b40c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40702d0 0x7ff0b40c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57156/0 (socket says 172.21.15.133:57156) 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 -- 172.21.15.133:0/643199365 learned_addr learned my addr 172.21.15.133:0/643199365 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0a9d9b640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b40ccd60 0x7ff0b406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b2d9d640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 -- 172.21.15.133:0/643199365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 msgr2=0x7ff0b406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b406c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 -- 172.21.15.133:0/643199365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b40ccd60 msgr2=0x7ff0b406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b40ccd60 0x7ff0b406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 -- 172.21.15.133:0/643199365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac0094d0 con 0x7ff0b40702d0 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b259c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40702d0 0x7ff0b40c3f30 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4007ef0 tx=0x7ff0a400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0ab7fe640 1 -- 172.21.15.133:0/643199365 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4003ba0 con 0x7ff0b40702d0 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0ab7fe640 1 -- 172.21.15.133:0/643199365 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a400f040 con 0x7ff0b40702d0 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b40c7450 con 0x7ff0b40702d0 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0ab7fe640 1 -- 172.21.15.133:0/643199365 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4004030 con 0x7ff0b40702d0 2023-12-18T10:25:27.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b40c6ab0 con 0x7ff0b40702d0 2023-12-18T10:25:27.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b404e000 con 0x7ff0b40702d0 2023-12-18T10:25:27.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.689+0000 7ff0ab7fe640 1 -- 172.21.15.133:0/643199365 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff0a4004190 con 0x7ff0b40702d0 2023-12-18T10:25:27.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.693+0000 7ff0ab7fe640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff094065a60 0x7ff094067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:27.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.693+0000 7ff0ab7fe640 1 -- 172.21.15.133:0/643199365 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff0a4083450 con 0x7ff0b40702d0 2023-12-18T10:25:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.693+0000 7ff0a9d9b640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff094065a60 0x7ff094067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:27.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.693+0000 7ff0a9d9b640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff094065a60 0x7ff094067f20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4157a30 tx=0x7ff09c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:27.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.697+0000 7ff0ab7fe640 1 -- 172.21.15.133:0/643199365 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff0a4050df0 con 0x7ff0b40702d0 2023-12-18T10:25:27.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.897+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff0b40c7d80 con 0x7ff0b40702d0 2023-12-18T10:25:27.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0ab7fe640 1 -- 172.21.15.133:0/643199365 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff0a4054410 con 0x7ff0b40702d0 2023-12-18T10:25:27.901 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-18T10:25:27.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff094065a60 msgr2=0x7ff094067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff094065a60 0x7ff094067f20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff0b4157a30 tx=0x7ff09c008040 comp rx=0 tx=0).stop 2023-12-18T10:25:27.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40702d0 msgr2=0x7ff0b40c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:27.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40702d0 0x7ff0b40c3f30 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4007ef0 tx=0x7ff0a400d4a0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 shutdown_connections 2023-12-18T10:25:27.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff094065a60 0x7ff094067f20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0b415e4f0 0x7ff0b406c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0b40ccd60 0x7ff0b406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 --2- 172.21.15.133:0/643199365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b40702d0 0x7ff0b40c3f30 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:27.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 >> 172.21.15.133:0/643199365 conn(0x7ff0b40ce450 msgr2=0x7ff0b415d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:27.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 shutdown_connections 2023-12-18T10:25:27.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:27.901+0000 7ff0b8b2c640 1 -- 172.21.15.133:0/643199365 wait complete. 2023-12-18T10:25:27.923 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:28.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5982e8c640 1 Processor -- start 2023-12-18T10:25:28.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5982e8c640 1 -- start start 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5982e8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c070510 0x7f597c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5982e8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f597c0caa70 0x7f597c0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5982e8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c0cb440 con 0x7f597c15c800 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5982e8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c070970 con 0x7f597c0caa70 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5982e8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0b0cb0 con 0x7f597c070510 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5980c28640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f597c15c800 0x7f597c0b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39270/0 (socket says 172.21.15.133:39270) 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5980c28640 1 -- 172.21.15.133:0/3169222747 learned_addr learned my addr 172.21.15.133:0/3169222747 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f597bfff640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c070510 0x7f597c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f5981429640 1 --2- 172.21.15.133:0/3169222747 >> v2:172.21.15.142:3300/0 conn(0x7f597c0caa70 0x7f597c0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.061+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974688780 0 0) 0x7f597c0cb440 con 0x7f597c15c800 2023-12-18T10:25:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f596c005740 con 0x7f597c15c800 2023-12-18T10:25:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3426047176 0 0) 0x7f596c005740 con 0x7f597c15c800 2023-12-18T10:25:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c070510 msgr2=0x7f597c158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c070510 0x7f597c158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 >> v2:172.21.15.142:3300/0 conn(0x7f597c0caa70 msgr2=0x7f597c0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 --2- 172.21.15.133:0/3169222747 >> v2:172.21.15.142:3300/0 conn(0x7f597c0caa70 0x7f597c0caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c070b80 con 0x7f597c15c800 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f5970001680 con 0x7f597c15c800 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 >> v1:172.21.15.133:6789/0 conn(0x7f597c15c800 legacy=0x7f597c0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c070510 0x7f596c005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006110 0x7f596c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f596c006f20 0x7f596c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c070970 con 0x7f596c006f20 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0b0cb0 con 0x7f596c006110 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c00dba0 con 0x7f597c070510 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f5981429640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f596c006f20 0x7f596c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f5980c28640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c070510 0x7f596c005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f597bfff640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006110 0x7f596c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f5981429640 1 -- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c070510 msgr2=0x7f596c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f5981429640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c070510 0x7f596c005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f5981429640 1 -- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006110 msgr2=0x7f596c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f5981429640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006110 0x7f596c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f5981429640 1 -- 172.21.15.133:0/3169222747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c005740 con 0x7f596c006f20 2023-12-18T10:25:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.065+0000 7f5981429640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f596c006f20 0x7f596c0073a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f5974009fc0 tx=0x7f597401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f368994ee2b389a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740a5cb0 con 0x7f596c006f20 2023-12-18T10:25:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400f040 con 0x7f596c006f20 2023-12-18T10:25:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f597b7fe640 1 -- 172.21.15.133:0/3169222747 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740ad680 con 0x7f596c006f20 2023-12-18T10:25:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- 172.21.15.133:0/3169222747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f596c006f20 msgr2=0x7f596c0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 --2- 172.21.15.133:0/3169222747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f596c006f20 0x7f596c0073a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f5974009fc0 tx=0x7f597401cc40 comp rx=0 tx=0).stop 2023-12-18T10:25:28.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5981429640 1 -- 172.21.15.133:0/3169222747 reap_dead start 2023-12-18T10:25:28.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- 172.21.15.133:0/3169222747 shutdown_connections 2023-12-18T10:25:28.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- 172.21.15.133:0/3169222747 >> 172.21.15.133:0/3169222747 conn(0x7f597c06a3e0 msgr2=0x7f597c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:28.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- 172.21.15.133:0/3169222747 shutdown_connections 2023-12-18T10:25:28.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- 172.21.15.133:0/3169222747 wait complete. 2023-12-18T10:25:28.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 Processor -- start 2023-12-18T10:25:28.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- start start 2023-12-18T10:25:28.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006f20 0x7f597c0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c145dd0 0x7f597c0c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f597c0af5a0 0x7f597c0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0aff60 con 0x7f597c0af5a0 2023-12-18T10:25:28.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0b0aa0 con 0x7f596c006f20 2023-12-18T10:25:28.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5982e8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c143350 con 0x7f597c145dd0 2023-12-18T10:25:28.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.069+0000 7f5981429640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f597c0af5a0 0x7f597c0afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5981429640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f597c0af5a0 0x7f597c0afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57168/0 (socket says 172.21.15.133:57168) 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5981429640 1 -- 172.21.15.133:0/4152429041 learned_addr learned my addr 172.21.15.133:0/4152429041 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f597bfff640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c145dd0 0x7f597c0c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5980c28640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006f20 0x7f597c0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5981429640 1 -- 172.21.15.133:0/4152429041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c145dd0 msgr2=0x7f597c0c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5981429640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c145dd0 0x7f597c0c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5981429640 1 -- 172.21.15.133:0/4152429041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006f20 msgr2=0x7f597c0b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5981429640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006f20 0x7f597c0b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5981429640 1 -- 172.21.15.133:0/4152429041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c143630 con 0x7f597c0af5a0 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5981429640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f597c0af5a0 0x7f597c0afa20 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f59740b0040 tx=0x7f5974009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f59797fa640 1 -- 172.21.15.133:0/4152429041 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740039a0 con 0x7f597c0af5a0 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f59797fa640 1 -- 172.21.15.133:0/4152429041 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974003b20 con 0x7f597c0af5a0 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f59797fa640 1 -- 172.21.15.133:0/4152429041 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740ae890 con 0x7f597c0af5a0 2023-12-18T10:25:28.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c143910 con 0x7f597c0af5a0 2023-12-18T10:25:28.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c143ed0 con 0x7f597c0af5a0 2023-12-18T10:25:28.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c0735b0 con 0x7f597c0af5a0 2023-12-18T10:25:28.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.073+0000 7f59797fa640 1 -- 172.21.15.133:0/4152429041 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f59740b4040 con 0x7f597c0af5a0 2023-12-18T10:25:28.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.077+0000 7f59797fa640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5960065a90 0x7f5960067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.077+0000 7f59797fa640 1 -- 172.21.15.133:0/4152429041 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f597411ced0 con 0x7f597c0af5a0 2023-12-18T10:25:28.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.077+0000 7f5980c28640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5960065a90 0x7f5960067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.077+0000 7f5980c28640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5960065a90 0x7f5960067f50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5970000c10 tx=0x7f5970007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.077+0000 7f59797fa640 1 -- 172.21.15.133:0/4152429041 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f59740ea8a0 con 0x7f597c0af5a0 2023-12-18T10:25:28.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.261+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f597c04e000 con 0x7f597c0af5a0 2023-12-18T10:25:28.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.261+0000 7f59797fa640 1 -- 172.21.15.133:0/4152429041 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4725 (secure 0 0 0) 0x7f59740b2020 con 0x7f597c0af5a0 2023-12-18T10:25:28.265 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:28.265 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":103,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9039,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:21.565783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:25:28.266 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 103 2023-12-18T10:25:28.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5960065a90 msgr2=0x7f5960067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5960065a90 0x7f5960067f50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5970000c10 tx=0x7f5970007900 comp rx=0 tx=0).stop 2023-12-18T10:25:28.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f597c0af5a0 msgr2=0x7f597c0afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f597c0af5a0 0x7f597c0afa20 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f59740b0040 tx=0x7f5974009750 comp rx=0 tx=0).stop 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 shutdown_connections 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5960065a90 0x7f5960067f50 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f597c0af5a0 0x7f597c0afa20 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f597c145dd0 0x7f597c0c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 --2- 172.21.15.133:0/4152429041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f596c006f20 0x7f597c0b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 >> 172.21.15.133:0/4152429041 conn(0x7f597c06a3e0 msgr2=0x7f597c156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 shutdown_connections 2023-12-18T10:25:28.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.265+0000 7f5982e8c640 1 -- 172.21.15.133:0/4152429041 wait complete. 2023-12-18T10:25:28.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 103, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:25:18.553341+0000', 'modified': '2023-12-18T10:25:21.565783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9048}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9048': {'gid': 9048, 'name': 'd', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/1819917691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 1819917691}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 1819917691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:25:28.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-18T10:25:28.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-18T10:25:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f33495640 1 Processor -- start 2023-12-18T10:25:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f33495640 1 -- start start 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f33495640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 0x7f3f2c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f33495640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f2c06fdb0 0x7f3f2c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f33495640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2c160690 con 0x7f3f2c15c9d0 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f33495640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c1603f0 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f33495640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0b0d80 con 0x7f3f2c0cdd40 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f31a32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f2c06fdb0 0x7f3f2c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f31a32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f2c06fdb0 0x7f3f2c070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57184/0 (socket says 172.21.15.133:57184) 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f31a32640 1 -- 172.21.15.133:0/3987378809 learned_addr learned my addr 172.21.15.133:0/3987378809 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f30a30640 1 --2- 172.21.15.133:0/3987378809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 0x7f3f2c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f31a32640 1 -- 172.21.15.133:0/3987378809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 msgr2=0x7f3f2c0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f31a32640 1 --2- 172.21.15.133:0/3987378809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 0x7f3f2c0cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f31a32640 1 -- 172.21.15.133:0/3987378809 >> v1:172.21.15.142:6789/0 conn(0x7f3f2c15c9d0 legacy=0x7f3f2c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.825+0000 7f3f31a32640 1 -- 172.21.15.133:0/3987378809 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c0ccb00 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f31a32640 1 --2- 172.21.15.133:0/3987378809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c070240 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009e50 tx=0x7f3f2401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6292eb4e2ce29be7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f23fff640 1 -- 172.21.15.133:0/3987378809 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240a5900 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f23fff640 1 -- 172.21.15.133:0/3987378809 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f240a5a60 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f23fff640 1 -- 172.21.15.133:0/3987378809 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240a5df0 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f33495640 1 -- 172.21.15.133:0/3987378809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 msgr2=0x7f3f2c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f33495640 1 --2- 172.21.15.133:0/3987378809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c070240 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009e50 tx=0x7f3f2401ca10 comp rx=0 tx=0).stop 2023-12-18T10:25:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f33495640 1 -- 172.21.15.133:0/3987378809 shutdown_connections 2023-12-18T10:25:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f33495640 1 --2- 172.21.15.133:0/3987378809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c070240 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f33495640 1 --2- 172.21.15.133:0/3987378809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 0x7f3f2c0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f33495640 1 -- 172.21.15.133:0/3987378809 >> 172.21.15.133:0/3987378809 conn(0x7f3f2c06a3e0 msgr2=0x7f3f2c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:28.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f33495640 1 -- 172.21.15.133:0/3987378809 shutdown_connections 2023-12-18T10:25:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.829+0000 7f3f33495640 1 -- 172.21.15.133:0/3987378809 wait complete. 2023-12-18T10:25:28.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 Processor -- start 2023-12-18T10:25:28.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 -- start start 2023-12-18T10:25:28.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 0x7f3f2c0ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f2c15c9d0 0x7f3f2c0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c1596a0 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c158100 con 0x7f3f2c15c9d0 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c14b9e0 con 0x7f3f2c0cdd40 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57198/0 (socket says 172.21.15.133:57198) 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 -- 172.21.15.133:0/3528853106 learned_addr learned my addr 172.21.15.133:0/3528853106 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 -- 172.21.15.133:0/3528853106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 msgr2=0x7f3f2c0ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 0x7f3f2c0ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 -- 172.21.15.133:0/3528853106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f2c15c9d0 msgr2=0x7f3f2c0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f2c15c9d0 0x7f3f2c0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 -- 172.21.15.133:0/3528853106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24009b30 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f31231640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c157bc0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c3c0 tx=0x7f3f2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f21ffb640 1 -- 172.21.15.133:0/3528853106 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f280052d0 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f21ffb640 1 -- 172.21.15.133:0/3528853106 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28005430 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 -- 172.21.15.133:0/3528853106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c1613b0 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f21ffb640 1 -- 172.21.15.133:0/3528853106 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28003840 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.833+0000 7f3f33495640 1 -- 172.21.15.133:0/3528853106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c158330 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f21ffb640 1 -- 172.21.15.133:0/3528853106 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3f280039a0 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f21ffb640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f10065a60 0x7f3f10067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f21ffb640 1 -- 172.21.15.133:0/3528853106 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f28082810 con 0x7f3f2c06fdb0 2023-12-18T10:25:28.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f10065a60 0x7f3f10067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f36806000 1 Processor -- start 2023-12-18T10:25:28.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f36806000 1 -- start start 2023-12-18T10:25:28.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f10065a60 0x7f3f10067f20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c14f4b0 tx=0x7f3f1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f36806000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 0x55bffccc9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f36806000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc7ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f36806000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc7f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f36806000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffcaa2c90 con 0x55bffccc9990 2023-12-18T10:25:28.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f36806000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffcad4220 con 0x55bffccc9070 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f36806000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bffcad17f0 con 0x55bffcc7f1c0 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc7ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc7ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57200/0 (socket says 172.21.15.133:57200) 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 -- 172.21.15.133:0/3590863043 learned_addr learned my addr 172.21.15.133:0/3590863043 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f31231640 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 0x55bffccc9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f31a32640 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc7f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 -- 172.21.15.133:0/3590863043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 msgr2=0x55bffcc7f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc7f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 -- 172.21.15.133:0/3590863043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 msgr2=0x55bffccc9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 0x55bffccc9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.837+0000 7f3f30a30640 1 -- 172.21.15.133:0/3590863043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bffc7c9890 con 0x55bffccc9990 2023-12-18T10:25:28.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f30a30640 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc7ec80 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00d8b0 tx=0x7f3f1c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df8e81d88bbd9aa server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f16ffd640 1 -- 172.21.15.133:0/3590863043 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0090e0 con 0x55bffccc9990 2023-12-18T10:25:28.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f16ffd640 1 -- 172.21.15.133:0/3590863043 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c014930 con 0x55bffccc9990 2023-12-18T10:25:28.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f16ffd640 1 -- 172.21.15.133:0/3590863043 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c014ce0 con 0x55bffccc9990 2023-12-18T10:25:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- 172.21.15.133:0/3590863043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 msgr2=0x55bffcc7ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc7ec80 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00d8b0 tx=0x7f3f1c010000 comp rx=0 tx=0).stop 2023-12-18T10:25:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- 172.21.15.133:0/3590863043 shutdown_connections 2023-12-18T10:25:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc7f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc7ec80 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 --2- 172.21.15.133:0/3590863043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 0x55bffccc9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- 172.21.15.133:0/3590863043 >> 172.21.15.133:0/3590863043 conn(0x55bffcc85950 msgr2=0x55bffcc7d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- 172.21.15.133:0/3590863043 shutdown_connections 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- 172.21.15.133:0/3590863043 wait complete. 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- start start 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 Processor -- start 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc84740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 0x55bffcc8b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc8b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffcacd0e0 con 0x55bffccc9990 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffca6c310 con 0x55bffccc9070 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bffca8a770 con 0x55bffcc7f1c0 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f36806000 10 client.0 _ll_register_callbacks cb 0x55bffcc6ab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31a32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc8b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31a32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc8b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57206/0 (socket says 172.21.15.133:57206) 2023-12-18T10:25:28.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31a32640 1 -- 172.21.15.133:0/494291945 learned_addr learned my addr 172.21.15.133:0/494291945 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31231640 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc84740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f30a30640 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 0x55bffcc8b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31a32640 1 -- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 msgr2=0x55bffcc84740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31a32640 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc84740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31a32640 1 -- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 msgr2=0x55bffcc8b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31a32640 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 0x55bffcc8b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31a32640 1 -- 172.21.15.133:0/494291945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c00e040 con 0x55bffccc9990 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.841+0000 7f3f31231640 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc84740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f31a32640 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc8b5c0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f3f240af040 tx=0x7f3f240197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600c30e9808f4ac3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 1 -- 172.21.15.133:0/494291945 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f240a5d90 con 0x55bffccc9990 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 -- 172.21.15.133:0/494291945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bffca9cc10 con 0x55bffccc9990 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 1 -- 172.21.15.133:0/494291945 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f240b8440 con 0x55bffccc9990 2023-12-18T10:25:28.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 1 -- 172.21.15.133:0/494291945 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f240b8620 con 0x55bffccc9990 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 10 client.9204 fetch_fsmap learned FSMap version 103 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 -- 172.21.15.133:0/494291945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) v3 -- 0x55bffca92260 con 0x55bffccc9990 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 1 -- 172.21.15.133:0/494291945 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bffca9cc10 con 0x55bffccc9990 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 1 -- 172.21.15.133:0/494291945 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 103) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3f24005d20 con 0x55bffccc9990 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 10 client.9204 fetch_fsmap finished waiting for FSMap version 103 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 10 client.9204 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 20 client.9204 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55bffccd08d0 0x55bffccd0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 4 client.9204 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 -- 172.21.15.133:0/494291945 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bffcacba30 con 0x55bffccd08d0 2023-12-18T10:25:28.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f31231640 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55bffccd08d0 0x55bffccd0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f31231640 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55bffccd08d0 0x55bffccd0cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b14f8f5ef783351 server_cookie=c3e108afc681aaa4 in_seq=0 out_seq=0 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 10 client.9204 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 1 -- 172.21.15.133:0/494291945 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55bffcacba30 con 0x55bffccd08d0 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 10 client.9204 handle_command_reply: tid=0 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 client.9204 shutdown 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 -- 172.21.15.133:0/494291945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 msgr2=0x55bffcc8b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc8b5c0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f3f240af040 tx=0x7f3f240197b0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 -- 172.21.15.133:0/494291945 shutdown_connections 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55bffccd08d0 0x55bffccd0cb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9990 0x55bffcc8b5c0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9070 0x55bffcc8b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f0bfff640 0 client.9204 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:28.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 --2- 172.21.15.133:0/494291945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcc84740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 -- 172.21.15.133:0/494291945 >> 172.21.15.133:0/494291945 conn(0x55bffcc85950 msgr2=0x55bffcc7dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 -- 172.21.15.133:0/494291945 shutdown_connections 2023-12-18T10:25:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 1 -- 172.21.15.133:0/494291945 wait complete. 2023-12-18T10:25:28.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.845+0000 7f3f36806000 20 client.9204 trim_cache size 0 max 16384 2023-12-18T10:25:28.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f36806000 1 Processor -- start 2023-12-18T10:25:28.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f36806000 1 -- start start 2023-12-18T10:25:28.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f36806000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffcc7f1c0 0x55bffcd29b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f36806000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffccc9070 0x55bffcd2a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f36806000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 0x55bffcd2a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f36806000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffc78a940 con 0x55bffcc7f1c0 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f36806000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffca9aa80 con 0x55bffccc9990 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f36806000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bffcac8a50 con 0x55bffccc9070 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffcc7f1c0 0x55bffcd29b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffcc7f1c0 0x55bffcd29b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57220/0 (socket says 172.21.15.133:57220) 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 -- 172.21.15.133:0/3922384717 learned_addr learned my addr 172.21.15.133:0/3922384717 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 -- 172.21.15.133:0/3922384717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffccc9070 msgr2=0x55bffcd2a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 --2- 172.21.15.133:0/3922384717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffccc9070 0x55bffcd2a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 -- 172.21.15.133:0/3922384717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 msgr2=0x55bffcd2a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 --2- 172.21.15.133:0/3922384717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 0x55bffcd2a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 -- 172.21.15.133:0/3922384717 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bffca783b0 con 0x55bffcc7f1c0 2023-12-18T10:25:28.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f31231640 1 --2- 172.21.15.133:0/3922384717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffcc7f1c0 0x55bffcd29b00 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f3f28050240 tx=0x7f3f2801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2588800eb2fd197d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f177fe640 1 -- 172.21.15.133:0/3922384717 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f280520e0 con 0x55bffcc7f1c0 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f177fe640 1 -- 172.21.15.133:0/3922384717 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28050450 con 0x55bffcc7f1c0 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.861+0000 7f3f177fe640 1 -- 172.21.15.133:0/3922384717 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2805ba90 con 0x55bffcc7f1c0 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- 172.21.15.133:0/3922384717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffcc7f1c0 msgr2=0x55bffcd29b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 --2- 172.21.15.133:0/3922384717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffcc7f1c0 0x55bffcd29b00 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f3f28050240 tx=0x7f3f2801e040 comp rx=0 tx=0).stop 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- 172.21.15.133:0/3922384717 shutdown_connections 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 --2- 172.21.15.133:0/3922384717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 0x55bffcd2a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 --2- 172.21.15.133:0/3922384717 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffccc9070 0x55bffcd2a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 --2- 172.21.15.133:0/3922384717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffcc7f1c0 0x55bffcd29b00 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- 172.21.15.133:0/3922384717 >> 172.21.15.133:0/3922384717 conn(0x55bffcc85950 msgr2=0x55bffcc8af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- 172.21.15.133:0/3922384717 shutdown_connections 2023-12-18T10:25:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- 172.21.15.133:0/3922384717 wait complete. 2023-12-18T10:25:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- start start 2023-12-18T10:25:28.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 Processor -- start 2023-12-18T10:25:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcd2ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9070 0x55bffcd2f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 0x55bffccdb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffca73e10 con 0x55bffccc9070 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffcb9db30 con 0x55bffccc9990 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bffcacfc40 con 0x55bffcc7f1c0 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 10 client.0 _ll_register_callbacks cb 0x55bffca7b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9070 0x55bffcd2f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9070 0x55bffcd2f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57236/0 (socket says 172.21.15.133:57236) 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 -- 172.21.15.133:0/1657801702 learned_addr learned my addr 172.21.15.133:0/1657801702 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f31231640 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcd2ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f31a32640 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 0x55bffccdb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 -- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 msgr2=0x55bffcd2ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcd2ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 -- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 msgr2=0x55bffccdb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:28.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 0x55bffccdb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 -- 172.21.15.133:0/1657801702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c158330 con 0x55bffccc9070 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f30a30640 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9070 0x55bffcd2f4b0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c01f000 tx=0x7f3f1c006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f8658c23c6b0c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f0bfff640 1 -- 172.21.15.133:0/1657801702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0090c0 con 0x55bffccc9070 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f0bfff640 1 -- 172.21.15.133:0/1657801702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3f1c029410 con 0x55bffccc9070 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.865+0000 7f3f36806000 1 -- 172.21.15.133:0/1657801702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bffcc853c0 con 0x55bffccc9070 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f0bfff640 1 -- 172.21.15.133:0/1657801702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f1c0295d0 con 0x55bffccc9070 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 10 client.9210 fetch_fsmap learned FSMap version 103 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 -- 172.21.15.133:0/1657801702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) v3 -- 0x55bffc7c9cc0 con 0x55bffccc9070 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f0bfff640 1 -- 172.21.15.133:0/1657801702 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bffcc853c0 con 0x55bffccc9070 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f0bfff640 1 -- 172.21.15.133:0/1657801702 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 103) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3f1c029730 con 0x55bffccc9070 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 10 client.9210 fetch_fsmap finished waiting for FSMap version 103 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 10 client.9210 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:25:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 20 client.9210 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55bffccdb990 0x55bffccdbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 4 client.9210 mds_command: new command op to 9048 tid=0[{"prefix": "status"}] 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 -- 172.21.15.133:0/1657801702 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bffca92e00 con 0x55bffccdb990 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f31231640 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55bffccdb990 0x55bffccdbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f31231640 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55bffccdb990 0x55bffccdbd70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a461da9d973e3ed server_cookie=38a301c44906cdb2 in_seq=0 out_seq=0 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f0bfff640 10 client.9210 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f0bfff640 1 -- 172.21.15.133:0/1657801702 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55bffca92e00 con 0x55bffccdb990 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f0bfff640 10 client.9210 handle_command_reply: tid=0 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 client.9210 shutdown 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 -- 172.21.15.133:0/1657801702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9070 msgr2=0x55bffcd2f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9070 0x55bffcd2f4b0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c01f000 tx=0x7f3f1c006e20 comp rx=0 tx=0).stop 2023-12-18T10:25:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 -- 172.21.15.133:0/1657801702 shutdown_connections 2023-12-18T10:25:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55bffccdb990 0x55bffccdbd70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bffccc9990 0x55bffccdb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55bffccc9070 0x55bffcd2f4b0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 --2- 172.21.15.133:0/1657801702 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bffcc7f1c0 0x55bffcd2ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f0bfff640 0 client.9210 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 -- 172.21.15.133:0/1657801702 >> 172.21.15.133:0/1657801702 conn(0x55bffcc85950 msgr2=0x55bffccc6060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 -- 172.21.15.133:0/1657801702 shutdown_connections 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 1 -- 172.21.15.133:0/1657801702 wait complete. 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f36806000 20 client.9210 trim_cache size 0 max 16384 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:28.873 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 9048, 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 10.314871839, 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 103, 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 105, 2023-12-18T10:25:28.874 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 105, 2023-12-18T10:25:28.877 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 14.603845227000001 2023-12-18T10:25:28.877 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:28.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 -- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f10065a60 msgr2=0x7f3f10067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f10065a60 0x7f3f10067f20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c14f4b0 tx=0x7f3f1c008040 comp rx=0 tx=0).stop 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 -- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 msgr2=0x7f3f2c157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c157bc0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c3c0 tx=0x7f3f2800c880 comp rx=0 tx=0).stop 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 -- 172.21.15.133:0/3528853106 shutdown_connections 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3f10065a60 0x7f3f10067f20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f2c15c9d0 0x7f3f2c0ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f2c0cdd40 0x7f3f2c0ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 --2- 172.21.15.133:0/3528853106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f2c06fdb0 0x7f3f2c157bc0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 -- 172.21.15.133:0/3528853106 >> 172.21.15.133:0/3528853106 conn(0x7f3f2c06a3e0 msgr2=0x7f3f2c0c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 -- 172.21.15.133:0/3528853106 shutdown_connections 2023-12-18T10:25:28.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:28.869+0000 7f3f33495640 1 -- 172.21.15.133:0/3528853106 wait complete. 2023-12-18T10:25:28.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-18T10:25:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feadfd39640 1 Processor -- start 2023-12-18T10:25:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feadfd39640 1 -- start start 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feadfd39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fead80cb340 0x7fead80ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feadfd39640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead806fdb0 con 0x7fead80c1280 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feadfd39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead8164820 con 0x7fead8160cc0 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feadfd39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead81654a0 con 0x7fead80cb340 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feade2d6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fead80cb340 0x7fead80ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feade2d6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fead80cb340 0x7fead80ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57244/0 (socket says 172.21.15.133:57244) 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feadd2d4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fead80c1280 0x7fead80cc400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39276/0 (socket says 172.21.15.133:39276) 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feade2d6640 1 -- 172.21.15.133:0/1959086224 learned_addr learned my addr 172.21.15.133:0/1959086224 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:29.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feade2d6640 1 -- 172.21.15.133:0/1959086224 >> v1:172.21.15.142:6789/0 conn(0x7fead8160cc0 legacy=0x7fead80cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feade2d6640 1 -- 172.21.15.133:0/1959086224 >> v1:172.21.15.133:6789/0 conn(0x7fead80c1280 legacy=0x7fead80cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feade2d6640 1 -- 172.21.15.133:0/1959086224 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8164b00 con 0x7fead80cb340 2023-12-18T10:25:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.029+0000 7feadcad3640 1 -- 172.21.15.133:0/1959086224 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669411646 0 0) 0x7fead806fdb0 con 0x7fead80c1280 2023-12-18T10:25:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feade2d6640 1 --2- 172.21.15.133:0/1959086224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80cb340 0x7fead80ccb10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fead0009e50 tx=0x7fead001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7618e31c5f6afd1f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadcad3640 1 -- 172.21.15.133:0/1959086224 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead00a5750 con 0x7fead80cb340 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadcad3640 1 -- 172.21.15.133:0/1959086224 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead00a58b0 con 0x7fead80cb340 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadcad3640 1 -- 172.21.15.133:0/1959086224 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead00a5c40 con 0x7fead80cb340 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadfd39640 1 -- 172.21.15.133:0/1959086224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80cb340 msgr2=0x7fead80ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadfd39640 1 --2- 172.21.15.133:0/1959086224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80cb340 0x7fead80ccb10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fead0009e50 tx=0x7fead001c980 comp rx=0 tx=0).stop 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadfd39640 1 -- 172.21.15.133:0/1959086224 shutdown_connections 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadfd39640 1 --2- 172.21.15.133:0/1959086224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80cb340 0x7fead80ccb10 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadfd39640 1 -- 172.21.15.133:0/1959086224 >> 172.21.15.133:0/1959086224 conn(0x7fead806a3e0 msgr2=0x7fead80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadfd39640 1 -- 172.21.15.133:0/1959086224 shutdown_connections 2023-12-18T10:25:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.033+0000 7feadfd39640 1 -- 172.21.15.133:0/1959086224 wait complete. 2023-12-18T10:25:29.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 Processor -- start 2023-12-18T10:25:29.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 -- start start 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80c1280 0x7fead80b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80cb340 0x7fead80c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8160cc0 0x7fead8156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8161640 con 0x7fead80c1280 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead8161bc0 con 0x7fead8160cc0 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead80c4340 con 0x7fead80cb340 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80c1280 0x7fead80b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80c1280 0x7fead80b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57252/0 (socket says 172.21.15.133:57252) 2023-12-18T10:25:29.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 -- 172.21.15.133:0/2489558918 learned_addr learned my addr 172.21.15.133:0/2489558918 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feade2d6640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8160cc0 0x7fead8156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadd2d4640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80cb340 0x7fead80c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 -- 172.21.15.133:0/2489558918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80cb340 msgr2=0x7fead80c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80cb340 0x7fead80c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 -- 172.21.15.133:0/2489558918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8160cc0 msgr2=0x7fead8156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8160cc0 0x7fead8156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 -- 172.21.15.133:0/2489558918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0009b30 con 0x7fead80c1280 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feaddad5640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80c1280 0x7fead80b1050 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fead400c3c0 tx=0x7fead400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feace7fc640 1 -- 172.21.15.133:0/2489558918 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead40052d0 con 0x7fead80c1280 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feace7fc640 1 -- 172.21.15.133:0/2489558918 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead4005430 con 0x7fead80c1280 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feace7fc640 1 -- 172.21.15.133:0/2489558918 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4003840 con 0x7fead80c1280 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead80c4620 con 0x7fead80c1280 2023-12-18T10:25:29.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.037+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead8157960 con 0x7fead80c1280 2023-12-18T10:25:29.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.041+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead80735b0 con 0x7fead80c1280 2023-12-18T10:25:29.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.041+0000 7feace7fc640 1 -- 172.21.15.133:0/2489558918 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fead40039a0 con 0x7fead80c1280 2023-12-18T10:25:29.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.041+0000 7feace7fc640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feabc065a60 0x7feabc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:29.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.041+0000 7feace7fc640 1 -- 172.21.15.133:0/2489558918 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fead40828b0 con 0x7fead80c1280 2023-12-18T10:25:29.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.041+0000 7feadd2d4640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feabc065a60 0x7feabc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:29.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.041+0000 7feadd2d4640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feabc065a60 0x7feabc067f20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feac8007fd0 tx=0x7feac8007ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:29.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.045+0000 7feace7fc640 1 -- 172.21.15.133:0/2489558918 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fead4050090 con 0x7fead80c1280 2023-12-18T10:25:29.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.229+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fead804e000 con 0x7fead80c1280 2023-12-18T10:25:29.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.229+0000 7feace7fc640 1 -- 172.21.15.133:0/2489558918 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v103) v1 ==== 53+0+73 (secure 0 0 0) 0x7fead4017070 con 0x7fead80c1280 2023-12-18T10:25:29.230 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feabc065a60 msgr2=0x7feabc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feabc065a60 0x7feabc067f20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feac8007fd0 tx=0x7feac8007ba0 comp rx=0 tx=0).stop 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80c1280 msgr2=0x7fead80b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80c1280 0x7fead80b1050 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fead400c3c0 tx=0x7fead400c880 comp rx=0 tx=0).stop 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 shutdown_connections 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7feabc065a60 0x7feabc067f20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fead8160cc0 0x7fead8156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fead80cb340 0x7fead80c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 --2- 172.21.15.133:0/2489558918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fead80c1280 0x7fead80b1050 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:29.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 >> 172.21.15.133:0/2489558918 conn(0x7fead806a3e0 msgr2=0x7fead80cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:29.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 shutdown_connections 2023-12-18T10:25:29.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:29.233+0000 7feadfd39640 1 -- 172.21.15.133:0/2489558918 wait complete. 2023-12-18T10:25:29.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:25:29.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:25:29.252 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-18T10:25:29.252 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-18T10:25:29.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-18T10:25:29.252 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-18T10:25:29.252 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-18T10:25:29.252 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-18T10:25:29.253 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-18T10:25:29.253 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-18T10:25:29.253 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:25:29.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:29.253 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:25:29.340 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41707sec preferred_lft 41707sec 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:d8:e6:73:0d brd ff:ff:ff:ff:ff:ff 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-18T10:25:29.341 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-18T10:25:29.342 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-18T10:25:29.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:29.343 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-18T10:25:29.401 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-18T10:25:29.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:29.403 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-18T10:25:29.458 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-18T10:25:29.458 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-18T10:25:29.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:29.459 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-18T10:25:29.460 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-18T10:25:29.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-18T10:25:29.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-18T10:25:29.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-18T10:25:29.460 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-18T10:25:29.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:29.554 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:25:29.562 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-18T10:25:29.562 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-18T10:25:29.563 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:25:29.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:29.564 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-18T10:25:29.631 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-18T10:25:29.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:25:29.631 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-18T10:25:29.683 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-18T10:25:29.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-18T10:25:29.683 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:25:29.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:25:29.799 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:25:29.799 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:25:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:25:29.863 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:25:29.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:29.864 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:25:29.919 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-18T10:25:29.919 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-18T10:25:29.966 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-18T10:25:29.987 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-18T10:25:29.987 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-18T10:25:30.051 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-18T10:25:30.052 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-18T10:25:30.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:30.053 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-18T10:25:30.065 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:2023-12-18T10:25:30.064+0000 7f59cba18580 -1 init, newargv = 0x55bcfb38bea0 newargc=15 2023-12-18T10:25:30.068 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[61875]: starting ceph client 2023-12-18T10:25:30.072 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[61875]: starting fuse 2023-12-18T10:25:30.074 INFO:teuthology.orchestra.run.smithi133.stdout:43 2023-12-18T10:25:30.075 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-18T10:25:30.075 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.0")) 2023-12-18T10:25:30.076 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:25:30.194 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.0.61875.asok 2023-12-18T10:25:30.379 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61875.asok 2023-12-18T10:25:30.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:30.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.61875.asok status 2023-12-18T10:25:30.556 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-18T10:25:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "8688b2517b6002b804a4844986e6ed5ce973d99f", 2023-12-18T10:25:30.556 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 18.2.0-1372-g8688b251 (8688b2517b6002b804a4844986e6ed5ce973d99f) reef (stable)", 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "0", 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "61875", 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 9225, 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 9225 2023-12-18T10:25:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1201497467 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 1201497467 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.9225 192.168.0.1:0/1201497467", 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/1201497467", 2023-12-18T10:25:30.558 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-18T10:25:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 103, 2023-12-18T10:25:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 105, 2023-12-18T10:25:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-18T10:25:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-18T10:25:30.559 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-18T10:25:30.559 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:30.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:30.572 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-18T10:25:30.572 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-18T10:25:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-18T10:25:30.581 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-18T10:25:30.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:30.582 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-18T10:25:30.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-18T10:25:30.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.824+0000 7fe574883640 1 Processor -- start 2023-12-18T10:25:30.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.824+0000 7fe574883640 1 -- start start 2023-12-18T10:25:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe574883640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe57015c790 0x7fe570160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe574883640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe57015d280 0x7fe5700b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:30.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe574883640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe570160800 con 0x7fe5700afc10 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe574883640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe570160280 con 0x7fe57015d280 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe574883640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700b05d0 con 0x7fe57015c790 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe56ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe57015d280 0x7fe5700b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe567fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe5700afc10 0x7fe57015cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47854/0 (socket says 172.21.15.133:47854) 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe567fff640 1 -- 172.21.15.133:0/2150888611 learned_addr learned my addr 172.21.15.133:0/2150888611 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe56f7fe640 1 --2- 172.21.15.133:0/2150888611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe57015c790 0x7fe570160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe56ffff640 1 -- 172.21.15.133:0/2150888611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe57015c790 msgr2=0x7fe570160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe56ffff640 1 --2- 172.21.15.133:0/2150888611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe57015c790 0x7fe570160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe56ffff640 1 -- 172.21.15.133:0/2150888611 >> v1:172.21.15.133:6789/0 conn(0x7fe5700afc10 legacy=0x7fe57015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:30.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe56ffff640 1 -- 172.21.15.133:0/2150888611 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5701611d0 con 0x7fe57015d280 2023-12-18T10:25:30.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.828+0000 7fe56effd640 1 -- 172.21.15.133:0/2150888611 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077117881 0 0) 0x7fe570160800 con 0x7fe5700afc10 2023-12-18T10:25:30.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe56ffff640 1 --2- 172.21.15.133:0/2150888611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe5700b0090 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe568009d90 tx=0x7fe56801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0f7ff5f6f94f46 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe56effd640 1 -- 172.21.15.133:0/2150888611 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680a5950 con 0x7fe57015d280 2023-12-18T10:25:30.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe56effd640 1 -- 172.21.15.133:0/2150888611 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5680a5ab0 con 0x7fe57015d280 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe56effd640 1 -- 172.21.15.133:0/2150888611 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680a5e40 con 0x7fe57015d280 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 -- 172.21.15.133:0/2150888611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 msgr2=0x7fe5700b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 --2- 172.21.15.133:0/2150888611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe5700b0090 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe568009d90 tx=0x7fe56801c890 comp rx=0 tx=0).stop 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 -- 172.21.15.133:0/2150888611 shutdown_connections 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 --2- 172.21.15.133:0/2150888611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe5700b0090 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 --2- 172.21.15.133:0/2150888611 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe57015c790 0x7fe570160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 -- 172.21.15.133:0/2150888611 >> 172.21.15.133:0/2150888611 conn(0x7fe57006a2a0 msgr2=0x7fe5700cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 -- 172.21.15.133:0/2150888611 shutdown_connections 2023-12-18T10:25:30.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 -- 172.21.15.133:0/2150888611 wait complete. 2023-12-18T10:25:30.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 Processor -- start 2023-12-18T10:25:30.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.832+0000 7fe574883640 1 -- start start 2023-12-18T10:25:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5700afc10 0x7fe570156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe57015c790 0x7fe570157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe57015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe570157630 con 0x7fe57015d280 2023-12-18T10:25:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe570156a20 con 0x7fe57015c790 2023-12-18T10:25:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe570156d00 con 0x7fe5700afc10 2023-12-18T10:25:30.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe57015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe57015eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41164/0 (socket says 172.21.15.133:41164) 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 -- 172.21.15.133:0/2732156104 learned_addr learned my addr 172.21.15.133:0/2732156104 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe567fff640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe57015c790 0x7fe570157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56f7fe640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5700afc10 0x7fe570156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 -- 172.21.15.133:0/2732156104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5700afc10 msgr2=0x7fe570156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5700afc10 0x7fe570156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 -- 172.21.15.133:0/2732156104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe57015c790 msgr2=0x7fe570157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe57015c790 0x7fe570157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 -- 172.21.15.133:0/2732156104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568009a70 con 0x7fe57015d280 2023-12-18T10:25:30.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56ffff640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe57015eec0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe5680b0040 tx=0x7fe568019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:30.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56cff9640 1 -- 172.21.15.133:0/2732156104 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680ade40 con 0x7fe57015d280 2023-12-18T10:25:30.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56cff9640 1 -- 172.21.15.133:0/2732156104 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe568009450 con 0x7fe57015d280 2023-12-18T10:25:30.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe570156fe0 con 0x7fe57015d280 2023-12-18T10:25:30.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56cff9640 1 -- 172.21.15.133:0/2732156104 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5680b7630 con 0x7fe57015d280 2023-12-18T10:25:30.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe570158000 con 0x7fe57015d280 2023-12-18T10:25:30.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5701577a0 con 0x7fe57015d280 2023-12-18T10:25:30.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.836+0000 7fe56cff9640 1 -- 172.21.15.133:0/2732156104 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe5680b4050 con 0x7fe57015d280 2023-12-18T10:25:30.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.840+0000 7fe56cff9640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe550065a60 0x7fe550067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:30.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.840+0000 7fe56cff9640 1 -- 172.21.15.133:0/2732156104 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe56811e5f0 con 0x7fe57015d280 2023-12-18T10:25:30.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.840+0000 7fe56f7fe640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe550065a60 0x7fe550067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:30.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.840+0000 7fe56f7fe640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe550065a60 0x7fe550067f20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe56000b9d0 tx=0x7fe560008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:30.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:30.844+0000 7fe56cff9640 1 -- 172.21.15.133:0/2732156104 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe5680ebd40 con 0x7fe57015d280 2023-12-18T10:25:31.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.024+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fe57004e850 con 0x7fe57015d280 2023-12-18T10:25:31.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.236+0000 7fe56cff9640 1 -- 172.21.15.133:0/2732156104 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v104) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe5680b20b0 con 0x7fe57015d280 2023-12-18T10:25:31.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.236+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe550065a60 msgr2=0x7fe550067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.236+0000 7fe574883640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe550065a60 0x7fe550067f20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe56000b9d0 tx=0x7fe560008040 comp rx=0 tx=0).stop 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.236+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 msgr2=0x7fe57015eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.236+0000 7fe574883640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe57015eec0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe5680b0040 tx=0x7fe568019630 comp rx=0 tx=0).stop 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.240+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 shutdown_connections 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.240+0000 7fe574883640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe550065a60 0x7fe550067f20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.240+0000 7fe574883640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe57015d280 0x7fe57015eec0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.240+0000 7fe574883640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe57015c790 0x7fe570157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.240+0000 7fe574883640 1 --2- 172.21.15.133:0/2732156104 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe5700afc10 0x7fe570156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.240+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 >> 172.21.15.133:0/2732156104 conn(0x7fe57006a2a0 msgr2=0x7fe57015bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.240+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 shutdown_connections 2023-12-18T10:25:31.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.240+0000 7fe574883640 1 -- 172.21.15.133:0/2732156104 wait complete. 2023-12-18T10:25:31.264 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.400+0000 7f2da772c640 1 Processor -- start 2023-12-18T10:25:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.400+0000 7f2da772c640 1 -- start start 2023-12-18T10:25:31.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da772c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00cac10 0x7f2da015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:31.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da772c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da015f100 con 0x7f2da015a680 2023-12-18T10:25:31.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da772c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da00ca7d0 con 0x7f2da006fdb0 2023-12-18T10:25:31.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da772c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da015e860 con 0x7f2da00cac10 2023-12-18T10:25:31.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da54c8640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2da015a680 0x7f2da015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47856/0 (socket says 172.21.15.133:47856) 2023-12-18T10:25:31.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da54c8640 1 -- 172.21.15.133:0/1506455587 learned_addr learned my addr 172.21.15.133:0/1506455587 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da4cc7640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00cac10 0x7f2da015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922897178 0 0) 0x7f2da015f100 con 0x7f2da015a680 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d8c003530 con 0x7f2da015a680 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816253471 0 0) 0x7f2da00ca7d0 con 0x7f2da006fdb0 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da015f100 con 0x7f2da006fdb0 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4268339184 0 0) 0x7f2d8c003530 con 0x7f2da015a680 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00cac10 msgr2=0x7f2da015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00cac10 0x7f2da015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 >> v1:172.21.15.142:6789/0 conn(0x7f2da006fdb0 legacy=0x7f2da00c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da015eb40 con 0x7f2da015a680 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f2d9c001680 con 0x7f2da015a680 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 >> v1:172.21.15.133:6789/0 conn(0x7f2da015a680 legacy=0x7f2da015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2d8c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d8c0047d0 0x7f2d8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00cac10 0x7f2d8c0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da015e860 con 0x7f2d8c003b40 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c00bad0 con 0x7f2d8c0047d0 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c00bc90 con 0x7f2da00cac10 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da54c8640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2d8c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da4cc7640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d8c0047d0 0x7f2d8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da5cc9640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00cac10 0x7f2d8c0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da54c8640 1 -- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00cac10 msgr2=0x7f2d8c0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da54c8640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da00cac10 0x7f2d8c0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da54c8640 1 -- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d8c0047d0 msgr2=0x7f2d8c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da54c8640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d8c0047d0 0x7f2d8c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.404+0000 7f2da54c8640 1 -- 172.21.15.133:0/1506455587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c003530 con 0x7f2d8c003b40 2023-12-18T10:25:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da54c8640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2d8c003f40 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c160 tx=0x7f2d9c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed28f27a8214805 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0058e0 con 0x7f2d8c003b40 2023-12-18T10:25:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c005a60 con 0x7f2d8c003b40 2023-12-18T10:25:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2d97fff640 1 -- 172.21.15.133:0/1506455587 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c005e10 con 0x7f2d8c003b40 2023-12-18T10:25:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da772c640 1 -- 172.21.15.133:0/1506455587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 msgr2=0x7f2d8c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da772c640 1 --2- 172.21.15.133:0/1506455587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2d8c003f40 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00c160 tx=0x7f2d9c01cb90 comp rx=0 tx=0).stop 2023-12-18T10:25:31.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da5cc9640 1 -- 172.21.15.133:0/1506455587 reap_dead start 2023-12-18T10:25:31.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da772c640 1 -- 172.21.15.133:0/1506455587 shutdown_connections 2023-12-18T10:25:31.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da772c640 1 -- 172.21.15.133:0/1506455587 >> 172.21.15.133:0/1506455587 conn(0x7f2da006a3e0 msgr2=0x7f2da00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:31.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da772c640 1 -- 172.21.15.133:0/1506455587 shutdown_connections 2023-12-18T10:25:31.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da772c640 1 -- 172.21.15.133:0/1506455587 wait complete. 2023-12-18T10:25:31.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da772c640 1 Processor -- start 2023-12-18T10:25:31.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.408+0000 7f2da772c640 1 -- start start 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2da01592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da0159b20 0x7f2da00c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da00c7ab0 0x7f2da015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00c5b90 con 0x7f2d8c003b40 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da0164590 con 0x7f2da00c7ab0 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da0159800 con 0x7f2da0159b20 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2da01592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2da01592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41186/0 (socket says 172.21.15.133:41186) 2023-12-18T10:25:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 -- 172.21.15.133:0/4028645753 learned_addr learned my addr 172.21.15.133:0/4028645753 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da4cc7640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da0159b20 0x7f2da00c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da5cc9640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da00c7ab0 0x7f2da015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 -- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da0159b20 msgr2=0x7f2da00c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da0159b20 0x7f2da00c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 -- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da00c7ab0 msgr2=0x7f2da015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da00c7ab0 0x7f2da015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 -- 172.21.15.133:0/4028645753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00c55d0 con 0x7f2d8c003b40 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da5cc9640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da00c7ab0 0x7f2da015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da54c8640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2da01592c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0ab040 tx=0x7f2d8c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2d95ffb640 1 -- 172.21.15.133:0/4028645753 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0a5870 con 0x7f2d8c003b40 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2d95ffb640 1 -- 172.21.15.133:0/4028645753 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c0a59d0 con 0x7f2d8c003b40 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2d95ffb640 1 -- 172.21.15.133:0/4028645753 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c0a5d40 con 0x7f2d8c003b40 2023-12-18T10:25:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da00c58b0 con 0x7f2d8c003b40 2023-12-18T10:25:31.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da00c6380 con 0x7f2d8c003b40 2023-12-18T10:25:31.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.412+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da00735b0 con 0x7f2d8c003b40 2023-12-18T10:25:31.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.416+0000 7f2d95ffb640 1 -- 172.21.15.133:0/4028645753 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2d9c0047f0 con 0x7f2d8c003b40 2023-12-18T10:25:31.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.416+0000 7f2d95ffb640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2d84065a60 0x7f2d84067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:31.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.416+0000 7f2d95ffb640 1 -- 172.21.15.133:0/4028645753 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2d9c11cf40 con 0x7f2d8c003b40 2023-12-18T10:25:31.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.416+0000 7f2da4cc7640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2d84065a60 0x7f2d84067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.416+0000 7f2da4cc7640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2d84065a60 0x7f2d84067f20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2da00c1480 tx=0x7f2d90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:31.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.420+0000 7f2d95ffb640 1 -- 172.21.15.133:0/4028645753 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2d9c0ea720 con 0x7f2d8c003b40 2023-12-18T10:25:31.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2da0164050 con 0x7f2d8c003b40 2023-12-18T10:25:31.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2d95ffb640 1 -- 172.21.15.133:0/4028645753 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4742 (secure 0 0 0) 0x7f2d9c0edd40 con 0x7f2d8c003b40 2023-12-18T10:25:31.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:31.601 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":105,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9039,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:31.239918+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":9048,"mds_1":9042},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:creating","state_seq":1,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:25:31.601 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 105 2023-12-18T10:25:31.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2d84065a60 msgr2=0x7f2d84067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2d84065a60 0x7f2d84067f20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2da00c1480 tx=0x7f2d90008040 comp rx=0 tx=0).stop 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 msgr2=0x7f2da01592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2da01592c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0ab040 tx=0x7f2d8c005800 comp rx=0 tx=0).stop 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 shutdown_connections 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2d84065a60 0x7f2d84067f20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2da00c7ab0 0x7f2da015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2da0159b20 0x7f2da00c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 --2- 172.21.15.133:0/4028645753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c003b40 0x7f2da01592c0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 >> 172.21.15.133:0/4028645753 conn(0x7f2da006a3e0 msgr2=0x7f2da0072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 shutdown_connections 2023-12-18T10:25:31.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:31.600+0000 7f2da772c640 1 -- 172.21.15.133:0/4028645753 wait complete. 2023-12-18T10:25:32.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 105, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:25:18.553341+0000', 'modified': '2023-12-18T10:25:31.239918+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 9048, 'mds_1': 9042}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9042': {'gid': 9042, 'name': 'a', 'rank': 1, 'incarnation': 105, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.133:6837/1840110844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 1840110844}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1840110844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_9048': {'gid': 9048, 'name': 'd', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/1819917691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 1819917691}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 1819917691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:25:32.024 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9042:up:creating 2023-12-18T10:25:33.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:33.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e70db3640 1 Processor -- start 2023-12-18T10:25:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e70db3640 1 -- start start 2023-12-18T10:25:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e70db3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e6c0cf0d0 0x7f1e6c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e70db3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0cfa70 con 0x7f1e6c15ca40 2023-12-18T10:25:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e70db3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0d11c0 con 0x7f1e6c1648d0 2023-12-18T10:25:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e70db3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0d0310 con 0x7f1e6c0cf0d0 2023-12-18T10:25:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e6a59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1e6c15ca40 0x7f1e6c0cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47860/0 (socket says 172.21.15.133:47860) 2023-12-18T10:25:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e6a59c640 1 -- 172.21.15.133:0/612964328 learned_addr learned my addr 172.21.15.133:0/612964328 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e61d9b640 1 --2- 172.21.15.133:0/612964328 >> v2:172.21.15.142:3300/0 conn(0x7f1e6c0cf0d0 0x7f1e6c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943645217 0 0) 0x7f1e6c0cfa70 con 0x7f1e6c15ca40 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e58003530 con 0x7f1e6c15ca40 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 857726983 0 0) 0x7f1e58003530 con 0x7f1e6c15ca40 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 >> v2:172.21.15.142:3300/0 conn(0x7f1e6c0cf0d0 msgr2=0x7f1e6c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 --2- 172.21.15.133:0/612964328 >> v2:172.21.15.142:3300/0 conn(0x7f1e6c0cf0d0 0x7f1e6c0cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 >> v1:172.21.15.142:6789/0 conn(0x7f1e6c1648d0 legacy=0x7f1e6c166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c0d05b0 con 0x7f1e6c15ca40 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f1e54001800 con 0x7f1e6c15ca40 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 >> v1:172.21.15.133:6789/0 conn(0x7f1e6c15ca40 legacy=0x7f1e6c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003980 0x7f1e58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e580047d0 0x7f1e58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58005190 0x7f1e5800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c0d0310 con 0x7f1e58003980 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5800c030 con 0x7f1e58005190 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.172+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5800c1f0 con 0x7f1e580047d0 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6a59c640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003980 0x7f1e58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6ad9d640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58005190 0x7f1e5800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e61d9b640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e580047d0 0x7f1e58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6a59c640 1 -- 172.21.15.133:0/612964328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e580047d0 msgr2=0x7f1e58004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6a59c640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e580047d0 0x7f1e58004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6a59c640 1 -- 172.21.15.133:0/612964328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58005190 msgr2=0x7f1e5800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6a59c640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58005190 0x7f1e5800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6a59c640 1 -- 172.21.15.133:0/612964328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e58003530 con 0x7f1e58003980 2023-12-18T10:25:33.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6ad9d640 1 -- 172.21.15.133:0/612964328 reap_dead start 2023-12-18T10:25:33.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e6a59c640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003980 0x7f1e58003da0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400c240 tx=0x7f1e5401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80c62b7ea1c7159 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e54007270 con 0x7f1e58003980 2023-12-18T10:25:33.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e540073f0 con 0x7f1e58003980 2023-12-18T10:25:33.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.176+0000 7f1e69d9b640 1 -- 172.21.15.133:0/612964328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e540057b0 con 0x7f1e58003980 2023-12-18T10:25:33.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- 172.21.15.133:0/612964328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003980 msgr2=0x7f1e58003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003980 0x7f1e58003da0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400c240 tx=0x7f1e5401cbf0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- 172.21.15.133:0/612964328 shutdown_connections 2023-12-18T10:25:33.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 --2- 172.21.15.133:0/612964328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e58003980 0x7f1e58003da0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- 172.21.15.133:0/612964328 >> 172.21.15.133:0/612964328 conn(0x7f1e6c089fb0 msgr2=0x7f1e6c0d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:33.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- 172.21.15.133:0/612964328 shutdown_connections 2023-12-18T10:25:33.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- 172.21.15.133:0/612964328 wait complete. 2023-12-18T10:25:33.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 Processor -- start 2023-12-18T10:25:33.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- start start 2023-12-18T10:25:33.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58003980 0x7f1e6c1f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6c15f300 0x7f1e6c1f9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e6c1f5220 0x7f1e6c0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1f9e60 con 0x7f1e6c1f5220 2023-12-18T10:25:33.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1f5fc0 con 0x7f1e58003980 2023-12-18T10:25:33.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e70db3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c15f820 con 0x7f1e6c15f300 2023-12-18T10:25:33.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e6ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e6c1f5220 0x7f1e6c0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e6ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e6c1f5220 0x7f1e6c0b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41196/0 (socket says 172.21.15.133:41196) 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e6ad9d640 1 -- 172.21.15.133:0/4239191825 learned_addr learned my addr 172.21.15.133:0/4239191825 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e6a59c640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58003980 0x7f1e6c1f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.180+0000 7f1e61d9b640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6c15f300 0x7f1e6c1f9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e6ad9d640 1 -- 172.21.15.133:0/4239191825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6c15f300 msgr2=0x7f1e6c1f9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e6ad9d640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6c15f300 0x7f1e6c1f9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e6ad9d640 1 -- 172.21.15.133:0/4239191825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58003980 msgr2=0x7f1e6c1f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e6ad9d640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58003980 0x7f1e6c1f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e6ad9d640 1 -- 172.21.15.133:0/4239191825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c15fb00 con 0x7f1e6c1f5220 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e6ad9d640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e6c1f5220 0x7f1e6c0b21a0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c066fc0 tx=0x7f1e6400fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e637fe640 1 -- 172.21.15.133:0/4239191825 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64006b60 con 0x7f1e6c1f5220 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e637fe640 1 -- 172.21.15.133:0/4239191825 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64006ce0 con 0x7f1e6c1f5220 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e637fe640 1 -- 172.21.15.133:0/4239191825 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64003bc0 con 0x7f1e6c1f5220 2023-12-18T10:25:33.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c15fde0 con 0x7f1e6c1f5220 2023-12-18T10:25:33.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c1f56a0 con 0x7f1e6c1f5220 2023-12-18T10:25:33.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c04e000 con 0x7f1e6c1f5220 2023-12-18T10:25:33.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e637fe640 1 -- 172.21.15.133:0/4239191825 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e64003d20 con 0x7f1e6c1f5220 2023-12-18T10:25:33.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e637fe640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e4c065a60 0x7f1e4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e637fe640 1 -- 172.21.15.133:0/4239191825 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1e64082630 con 0x7f1e6c1f5220 2023-12-18T10:25:33.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.184+0000 7f1e6a59c640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e4c065a60 0x7f1e4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.188+0000 7f1e6a59c640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e4c065a60 0x7f1e4c067f20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1e540ab000 tx=0x7f1e540a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.188+0000 7f1e637fe640 1 -- 172.21.15.133:0/4239191825 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1e6404ff50 con 0x7f1e6c1f5220 2023-12-18T10:25:33.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.372+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e6c15a980 con 0x7f1e6c1f5220 2023-12-18T10:25:33.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.372+0000 7f1e637fe640 1 -- 172.21.15.133:0/4239191825 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4755 (secure 0 0 0) 0x7f1e64053570 con 0x7f1e6c1f5220 2023-12-18T10:25:33.374 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:33.374 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":108,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:33.251090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:25:33.375 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 108 2023-12-18T10:25:33.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e4c065a60 msgr2=0x7f1e4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e4c065a60 0x7f1e4c067f20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1e540ab000 tx=0x7f1e540a7070 comp rx=0 tx=0).stop 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e6c1f5220 msgr2=0x7f1e6c0b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e6c1f5220 0x7f1e6c0b21a0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c066fc0 tx=0x7f1e6400fb40 comp rx=0 tx=0).stop 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 shutdown_connections 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1e4c065a60 0x7f1e4c067f20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e6c1f5220 0x7f1e6c0b21a0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e6c15f300 0x7f1e6c1f9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 --2- 172.21.15.133:0/4239191825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e58003980 0x7f1e6c1f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 >> 172.21.15.133:0/4239191825 conn(0x7f1e6c089fb0 msgr2=0x7f1e6c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 shutdown_connections 2023-12-18T10:25:33.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.376+0000 7f1e70db3640 1 -- 172.21.15.133:0/4239191825 wait complete. 2023-12-18T10:25:33.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 108, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-18T10:25:18.553341+0000', 'modified': '2023-12-18T10:25:33.251090+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 9048, 'mds_1': 9042, 'mds_2': 9039}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9039': {'gid': 9039, 'name': 'c', 'rank': 2, 'incarnation': 107, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.133:6836/3153614779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 3153614779}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 3153614779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_9042': {'gid': 9042, 'name': 'a', 'rank': 1, 'incarnation': 105, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.133:6837/1840110844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 1840110844}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1840110844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_9048': {'gid': 9048, 'name': 'd', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/1819917691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 1819917691}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 1819917691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-18T10:25:33.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-18T10:25:33.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-18T10:25:33.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd2dd7b640 1 Processor -- start 2023-12-18T10:25:33.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd2dd7b640 1 -- start start 2023-12-18T10:25:33.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd2dd7b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd2806c4f0 0x7fbd280c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd2dd7b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd280c9e30 0x7fbd28070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd2dd7b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd280c9460 con 0x7fbd281570c0 2023-12-18T10:25:33.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd2dd7b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd281574a0 con 0x7fbd2806c4f0 2023-12-18T10:25:33.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd2dd7b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280c8b30 con 0x7fbd280c9e30 2023-12-18T10:25:33.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd26ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd2806c4f0 0x7fbd280c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd26ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd2806c4f0 0x7fbd280c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41198/0 (socket says 172.21.15.133:41198) 2023-12-18T10:25:33.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd26ffd640 1 -- 172.21.15.133:0/2710083632 learned_addr learned my addr 172.21.15.133:0/2710083632 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:33.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd26ffd640 1 -- 172.21.15.133:0/2710083632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd280c9e30 msgr2=0x7fbd28070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/2710083632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd280c9e30 0x7fbd28070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd26ffd640 1 -- 172.21.15.133:0/2710083632 >> v1:172.21.15.142:6789/0 conn(0x7fbd281570c0 legacy=0x7fbd2806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.940+0000 7fbd26ffd640 1 -- 172.21.15.133:0/2710083632 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd280c8e10 con 0x7fbd2806c4f0 2023-12-18T10:25:33.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/2710083632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd2806c4f0 0x7fbd280c98f0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009870 tx=0x7fbd1c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40641515d3b9a31 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd267fc640 1 -- 172.21.15.133:0/2710083632 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0aa620 con 0x7fbd2806c4f0 2023-12-18T10:25:33.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd267fc640 1 -- 172.21.15.133:0/2710083632 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0aa780 con 0x7fbd2806c4f0 2023-12-18T10:25:33.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd267fc640 1 -- 172.21.15.133:0/2710083632 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0aab10 con 0x7fbd2806c4f0 2023-12-18T10:25:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/2710083632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd2806c4f0 msgr2=0x7fbd280c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/2710083632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd2806c4f0 0x7fbd280c98f0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009870 tx=0x7fbd1c01c500 comp rx=0 tx=0).stop 2023-12-18T10:25:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/2710083632 shutdown_connections 2023-12-18T10:25:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/2710083632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd280c9e30 0x7fbd28070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/2710083632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd2806c4f0 0x7fbd280c98f0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/2710083632 >> 172.21.15.133:0/2710083632 conn(0x7fbd2806a3e0 msgr2=0x7fbd280afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/2710083632 shutdown_connections 2023-12-18T10:25:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.944+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/2710083632 wait complete. 2023-12-18T10:25:33.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 Processor -- start 2023-12-18T10:25:33.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 -- start start 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2806c4f0 0x7fbd281575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd280c9e30 0x7fbd281561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd281570c0 0x7fbd280c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28147710 con 0x7fbd281570c0 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280c38b0 con 0x7fbd280c9e30 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280c3420 con 0x7fbd2806c4f0 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd281570c0 0x7fbd280c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd281570c0 0x7fbd280c40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41200/0 (socket says 172.21.15.133:41200) 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 -- 172.21.15.133:0/905454741 learned_addr learned my addr 172.21.15.133:0/905454741 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd280c9e30 0x7fbd281561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd277fe640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2806c4f0 0x7fbd281575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 -- 172.21.15.133:0/905454741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2806c4f0 msgr2=0x7fbd281575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2806c4f0 0x7fbd281575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 -- 172.21.15.133:0/905454741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd280c9e30 msgr2=0x7fbd281561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd280c9e30 0x7fbd281561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 -- 172.21.15.133:0/905454741 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0094d0 con 0x7fbd281570c0 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd27fff640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd281570c0 0x7fbd280c40a0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000b970 tx=0x7fbd2000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd0ffff640 1 -- 172.21.15.133:0/905454741 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000cb40 con 0x7fbd281570c0 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd0ffff640 1 -- 172.21.15.133:0/905454741 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2000ccc0 con 0x7fbd281570c0 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/905454741 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd28157b20 con 0x7fbd281570c0 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd0ffff640 1 -- 172.21.15.133:0/905454741 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20014680 con 0x7fbd281570c0 2023-12-18T10:25:33.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.948+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/905454741 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd280c2dd0 con 0x7fbd281570c0 2023-12-18T10:25:33.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd0ffff640 1 -- 172.21.15.133:0/905454741 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd2001d3b0 con 0x7fbd281570c0 2023-12-18T10:25:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd0ffff640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd14065a90 0x7fbd14067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd0ffff640 1 -- 172.21.15.133:0/905454741 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbd200831e0 con 0x7fbd281570c0 2023-12-18T10:25:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd277fe640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd14065a90 0x7fbd14067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd310dd000 1 Processor -- start 2023-12-18T10:25:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd310dd000 1 -- start start 2023-12-18T10:25:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd277fe640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd14065a90 0x7fbd14067f50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fbd280ad710 tx=0x7fbd18009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9c470 0x558545d9c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9cd90 0x558545d9d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545dec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd310dd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558545bbbc90 con 0x558545d9c470 2023-12-18T10:25:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd310dd000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558545bed220 con 0x558545d9cd90 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd310dd000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558545bea7f0 con 0x558545d9d6b0 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd277fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9c470 0x558545d9c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd277fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9c470 0x558545d9c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41216/0 (socket says 172.21.15.133:41216) 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.952+0000 7fbd277fe640 1 -- 172.21.15.133:0/1539763396 learned_addr learned my addr 172.21.15.133:0/1539763396 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd277fe640 1 -- 172.21.15.133:0/1539763396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 msgr2=0x558545dec710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd277fe640 1 --2- 172.21.15.133:0/1539763396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545dec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd277fe640 1 -- 172.21.15.133:0/1539763396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9cd90 msgr2=0x558545d9d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd277fe640 1 --2- 172.21.15.133:0/1539763396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9cd90 0x558545d9d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd277fe640 1 -- 172.21.15.133:0/1539763396 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585458e2890 con 0x558545d9c470 2023-12-18T10:25:33.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd277fe640 1 --2- 172.21.15.133:0/1539763396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9c470 0x558545d9c850 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800eba0 tx=0x7fbd18011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b161c2804cce896 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd0d7fa640 1 -- 172.21.15.133:0/1539763396 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18015ac0 con 0x558545d9c470 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd0d7fa640 1 -- 172.21.15.133:0/1539763396 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18015c20 con 0x558545d9c470 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd0d7fa640 1 -- 172.21.15.133:0/1539763396 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18013450 con 0x558545d9c470 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- 172.21.15.133:0/1539763396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9c470 msgr2=0x558545d9c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 --2- 172.21.15.133:0/1539763396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9c470 0x558545d9c850 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800eba0 tx=0x7fbd18011000 comp rx=0 tx=0).stop 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- 172.21.15.133:0/1539763396 shutdown_connections 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 --2- 172.21.15.133:0/1539763396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545dec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 --2- 172.21.15.133:0/1539763396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9cd90 0x558545d9d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 --2- 172.21.15.133:0/1539763396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9c470 0x558545d9c850 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- 172.21.15.133:0/1539763396 >> 172.21.15.133:0/1539763396 conn(0x558545d98960 msgr2=0x558545d9ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- 172.21.15.133:0/1539763396 shutdown_connections 2023-12-18T10:25:33.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- 172.21.15.133:0/1539763396 wait complete. 2023-12-18T10:25:33.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- start start 2023-12-18T10:25:33.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 Processor -- start 2023-12-18T10:25:33.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545dd52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545dd5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558545be60e0 con 0x558545d9cd90 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558545b85310 con 0x558545d9c470 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558545ba3770 con 0x558545d9d6b0 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd310dd000 10 client.0 _ll_register_callbacks cb 0x558545d83b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd26ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545dd52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd26ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545dd52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41220/0 (socket says 172.21.15.133:41220) 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.956+0000 7fbd26ffd640 1 -- 172.21.15.133:0/869873908 learned_addr learned my addr 172.21.15.133:0/869873908 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd277fe640 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd27fff640 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545dd5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd26ffd640 1 -- 172.21.15.133:0/869873908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 msgr2=0x558545dd5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545dd5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd26ffd640 1 -- 172.21.15.133:0/869873908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 msgr2=0x558545dd4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd26ffd640 1 -- 172.21.15.133:0/869873908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1800e850 con 0x558545d9cd90 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545dd52f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009870 tx=0x7fbd1c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b96812bbda287b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 1 -- 172.21.15.133:0/869873908 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0aac40 con 0x558545d9cd90 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 1 -- 172.21.15.133:0/869873908 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbd1c0aada0 con 0x558545d9cd90 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 -- 172.21.15.133:0/869873908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558545bb5c10 con 0x558545d9cd90 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 1 -- 172.21.15.133:0/869873908 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd1c0bd410 con 0x558545d9cd90 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 10 client.9258 fetch_fsmap learned FSMap version 108 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 -- 172.21.15.133:0/869873908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x558545bab260 con 0x558545d9cd90 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 1 -- 172.21.15.133:0/869873908 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558545bb5c10 con 0x558545d9cd90 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 1 -- 172.21.15.133:0/869873908 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 108) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fbd1c0bd570 con 0x558545d9cd90 2023-12-18T10:25:33.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 10 client.9258 fetch_fsmap finished waiting for FSMap version 108 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 10 client.9258 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 20 client.9258 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x558545df5a80 0x558545df7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 4 client.9258 mds_command: new command op to 9039 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 -- 172.21.15.133:0/869873908 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558545be4a30 con 0x558545df5a80 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd277fe640 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x558545df5a80 0x558545df7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd277fe640 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x558545df5a80 0x558545df7e70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19fd120703612755 server_cookie=36e33c7f25a576f5 in_seq=0 out_seq=0 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 10 client.9258 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 1 -- 172.21.15.133:0/869873908 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558545be4a30 con 0x558545df5a80 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 10 client.9258 handle_command_reply: tid=0 2023-12-18T10:25:33.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 client.9258 shutdown 2023-12-18T10:25:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 -- 172.21.15.133:0/869873908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 msgr2=0x558545dd52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545dd52f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009870 tx=0x7fbd1c01ad40 comp rx=0 tx=0).stop 2023-12-18T10:25:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 -- 172.21.15.133:0/869873908 shutdown_connections 2023-12-18T10:25:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x558545df5a80 0x558545df7e70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545dd5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545dd52f0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd067fc640 0 client.9258 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 --2- 172.21.15.133:0/869873908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 -- 172.21.15.133:0/869873908 >> 172.21.15.133:0/869873908 conn(0x558545d98960 msgr2=0x558545d9ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 -- 172.21.15.133:0/869873908 shutdown_connections 2023-12-18T10:25:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 1 -- 172.21.15.133:0/869873908 wait complete. 2023-12-18T10:25:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.960+0000 7fbd310dd000 20 client.9258 trim_cache size 0 max 16384 2023-12-18T10:25:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd310dd000 1 Processor -- start 2023-12-18T10:25:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd310dd000 1 -- start start 2023-12-18T10:25:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9cd90 0x558545d9ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9d6b0 0x558545d9b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd310dd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585458a3940 con 0x558545d9d6b0 2023-12-18T10:25:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd310dd000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558545da5330 con 0x558545d9c470 2023-12-18T10:25:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd310dd000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558545be1a50 con 0x558545d9cd90 2023-12-18T10:25:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9d6b0 0x558545d9b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9d6b0 0x558545d9b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41226/0 (socket says 172.21.15.133:41226) 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 -- 172.21.15.133:0/3858068140 learned_addr learned my addr 172.21.15.133:0/3858068140 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9cd90 0x558545d9ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 -- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9cd90 msgr2=0x558545d9ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd277fe640 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9cd90 0x558545d9ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 -- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 msgr2=0x558545dd3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 -- 172.21.15.133:0/3858068140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558545b913b0 con 0x558545d9d6b0 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9cd90 0x558545d9ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd277fe640 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.976+0000 7fbd27fff640 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9d6b0 0x558545d9b290 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fbd2005c130 tx=0x7fbd20054150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3547bb951d047e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd0dffb640 1 -- 172.21.15.133:0/3858068140 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2005c660 con 0x558545d9d6b0 2023-12-18T10:25:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd0dffb640 1 -- 172.21.15.133:0/3858068140 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20052ad0 con 0x558545d9d6b0 2023-12-18T10:25:33.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd0dffb640 1 -- 172.21.15.133:0/3858068140 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20050e40 con 0x558545d9d6b0 2023-12-18T10:25:33.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- 172.21.15.133:0/3858068140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9d6b0 msgr2=0x558545d9b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9d6b0 0x558545d9b290 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fbd2005c130 tx=0x7fbd20054150 comp rx=0 tx=0).stop 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- 172.21.15.133:0/3858068140 shutdown_connections 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9d6b0 0x558545d9b290 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9cd90 0x558545d9ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 --2- 172.21.15.133:0/3858068140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545dd3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- 172.21.15.133:0/3858068140 >> 172.21.15.133:0/3858068140 conn(0x558545d98960 msgr2=0x558545da4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- 172.21.15.133:0/3858068140 shutdown_connections 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- 172.21.15.133:0/3858068140 wait complete. 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- start start 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 Processor -- start 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545e3fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545df6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545df73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558545b8e860 con 0x558545d9cd90 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558545be34e0 con 0x558545d9c470 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558545bee4b0 con 0x558545d9d6b0 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 10 client.0 _ll_register_callbacks cb 0x558545b94640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545df6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545df6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41238/0 (socket says 172.21.15.133:41238) 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 -- 172.21.15.133:0/4097030929 learned_addr learned my addr 172.21.15.133:0/4097030929 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd277fe640 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545e3fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd27fff640 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545df73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 -- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 msgr2=0x558545df73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545df73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 -- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 msgr2=0x558545e3fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545e3fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 -- 172.21.15.133:0/4097030929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd280c2dd0 con 0x558545d9cd90 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd27fff640 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545df73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd26ffd640 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545df6eb0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c004710 tx=0x7fbd1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852a785039da0b43 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd067fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd067fc640 1 -- 172.21.15.133:0/4097030929 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0cd070 con 0x558545d9cd90 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd067fc640 1 -- 172.21.15.133:0/4097030929 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbd1c0bd410 con 0x558545d9cd90 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.980+0000 7fbd310dd000 1 -- 172.21.15.133:0/4097030929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558545d9dd80 con 0x558545d9cd90 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd067fc640 1 -- 172.21.15.133:0/4097030929 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd1c0bd5d0 con 0x558545d9cd90 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 10 client.9264 fetch_fsmap learned FSMap version 108 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 -- 172.21.15.133:0/4097030929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x5585458e2cc0 con 0x558545d9cd90 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd067fc640 1 -- 172.21.15.133:0/4097030929 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558545d9dd80 con 0x558545d9cd90 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd067fc640 1 -- 172.21.15.133:0/4097030929 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 108) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fbd1c004040 con 0x558545d9cd90 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 10 client.9264 fetch_fsmap finished waiting for FSMap version 108 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 10 client.9264 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-18T10:25:33.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 20 client.9264 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:33.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x558545df7930 0x558545df7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:33.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 4 client.9264 mds_command: new command op to 9039 tid=0[{"prefix": "status"}] 2023-12-18T10:25:33.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 -- 172.21.15.133:0/4097030929 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558545babe00 con 0x558545df7930 2023-12-18T10:25:33.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd277fe640 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x558545df7930 0x558545df7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd067fc640 10 client.9264 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd277fe640 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x558545df7930 0x558545df7d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=92ee39116012d5d1 server_cookie=c994f4b97e4dce6 in_seq=0 out_seq=0 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd067fc640 1 -- 172.21.15.133:0/4097030929 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x558545babe00 con 0x558545df7930 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd067fc640 10 client.9264 handle_command_reply: tid=0 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 client.9264 shutdown 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 -- 172.21.15.133:0/4097030929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 msgr2=0x558545df6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545df6eb0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c004710 tx=0x7fbd1c008040 comp rx=0 tx=0).stop 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 -- 172.21.15.133:0/4097030929 shutdown_connections 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x558545df7930 0x558545df7d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558545d9d6b0 0x558545df73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558545d9cd90 0x558545df6eb0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 --2- 172.21.15.133:0/4097030929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558545d9c470 0x558545e3fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd067fc640 0 client.9264 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 -- 172.21.15.133:0/4097030929 >> 172.21.15.133:0/4097030929 conn(0x558545d98960 msgr2=0x558545da4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 -- 172.21.15.133:0/4097030929 shutdown_connections 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 1 -- 172.21.15.133:0/4097030929 wait complete. 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd310dd000 20 client.9264 trim_cache size 0 max 16384 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 2, 2023-12-18T10:25:33.989 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 9039, 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 1.7362769600000001, 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 108, 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 105, 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 105, 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 19.726584904999999 2023-12-18T10:25:33.990 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd14065a90 msgr2=0x7fbd14067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd14065a90 0x7fbd14067f50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fbd280ad710 tx=0x7fbd18009060 comp rx=0 tx=0).stop 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd281570c0 msgr2=0x7fbd280c40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd281570c0 0x7fbd280c40a0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000b970 tx=0x7fbd2000be30 comp rx=0 tx=0).stop 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/905454741 shutdown_connections 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd14065a90 0x7fbd14067f50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd281570c0 0x7fbd280c40a0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd280c9e30 0x7fbd281561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 --2- 172.21.15.133:0/905454741 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd2806c4f0 0x7fbd281575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:33.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/905454741 >> 172.21.15.133:0/905454741 conn(0x7fbd2806a3e0 msgr2=0x7fbd2814a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:33.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/905454741 shutdown_connections 2023-12-18T10:25:33.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:33.984+0000 7fbd2dd7b640 1 -- 172.21.15.133:0/905454741 wait complete. 2023-12-18T10:25:34.005 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-18T10:25:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f10560640 1 Processor -- start 2023-12-18T10:25:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f10560640 1 -- start start 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f10560640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4f080704c0 0x7f4f080cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f10560640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f08160690 con 0x7f4f0815c9d0 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f10560640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f080b0d80 con 0x7f4f080cdd40 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f10560640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f081603f0 con 0x7f4f080704c0 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0e2fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4f0815c9d0 0x7f4f08160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47862/0 (socket says 172.21.15.133:47862) 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2323357193 learned_addr learned my addr 172.21.15.133:0/2323357193 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2323357193 >> v2:172.21.15.142:3300/0 conn(0x7f4f080704c0 0x7f4f080cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113891166 0 0) 0x7f4f08160690 con 0x7f4f0815c9d0 2023-12-18T10:25:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ef4003530 con 0x7f4f0815c9d0 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3693060486 0 0) 0x7f4ef4003530 con 0x7f4f0815c9d0 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 >> v2:172.21.15.142:3300/0 conn(0x7f4f080704c0 msgr2=0x7f4f080cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 --2- 172.21.15.133:0/2323357193 >> v2:172.21.15.142:3300/0 conn(0x7f4f080704c0 0x7f4f080cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 >> v1:172.21.15.142:6789/0 conn(0x7f4f080cdd40 legacy=0x7f4f0806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080ccb00 con 0x7f4f0815c9d0 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f4f04001680 con 0x7f4f0815c9d0 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 >> v1:172.21.15.133:6789/0 conn(0x7f4f0815c9d0 legacy=0x7f4f08160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ef4003980 0x7f4ef4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.144+0000 7f4f0d2fa640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ef40047d0 0x7f4ef4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0d2fa640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4ef400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f081603f0 con 0x7f4ef4005190 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef400c030 con 0x7f4ef40047d0 2023-12-18T10:25:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef400c1f0 con 0x7f4ef4003980 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4ef400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ef40047d0 0x7f4ef4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ef4003980 0x7f4ef4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0eafd640 1 -- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ef4003980 msgr2=0x7f4ef4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4ef4003980 0x7f4ef4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0eafd640 1 -- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ef40047d0 msgr2=0x7f4ef4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ef40047d0 0x7f4ef4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0eafd640 1 -- 172.21.15.133:0/2323357193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef4003530 con 0x7f4ef4005190 2023-12-18T10:25:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ef40047d0 0x7f4ef4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0eafd640 1 -- 172.21.15.133:0/2323357193 reap_dead start 2023-12-18T10:25:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4ef400b990 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009fc0 tx=0x7f4f0001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c27ba5437d764e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000a5cb0 con 0x7f4ef4005190 2023-12-18T10:25:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0000f040 con 0x7f4ef4005190 2023-12-18T10:25:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.148+0000 7f4f0d2fa640 1 -- 172.21.15.133:0/2323357193 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00003be0 con 0x7f4ef4005190 2023-12-18T10:25:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- 172.21.15.133:0/2323357193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 msgr2=0x7f4ef400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4ef400b990 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009fc0 tx=0x7f4f0001cca0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- 172.21.15.133:0/2323357193 shutdown_connections 2023-12-18T10:25:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 --2- 172.21.15.133:0/2323357193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4ef400b990 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- 172.21.15.133:0/2323357193 >> 172.21.15.133:0/2323357193 conn(0x7f4f0806a3e0 msgr2=0x7f4f080afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- 172.21.15.133:0/2323357193 shutdown_connections 2023-12-18T10:25:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- 172.21.15.133:0/2323357193 wait complete. 2023-12-18T10:25:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 Processor -- start 2023-12-18T10:25:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- start start 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4f0814d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f080b3830 0x7f4f080b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f080af000 0x7f4f080af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080af9c0 con 0x7f4ef4005190 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0815af00 con 0x7f4f080af000 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f10560640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0814dd20 con 0x7f4f080b3830 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f0e2fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4f0814d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f0e2fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4f0814d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41260/0 (socket says 172.21.15.133:41260) 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/1840997081 learned_addr learned my addr 172.21.15.133:0/1840997081 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f080af000 0x7f4f080af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.152+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f080b3830 0x7f4f080b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f080b3830 msgr2=0x7f4f080b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f080b3830 0x7f4f080b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f080af000 msgr2=0x7f4f080af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f080af000 0x7f4f080af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/1840997081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0815cdb0 con 0x7f4ef4005190 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f080af000 0x7f4f080af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4f0814d7e0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007290 tx=0x7f4f04007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4efeffd640 1 -- 172.21.15.133:0/1840997081 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400f960 con 0x7f4ef4005190 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4efeffd640 1 -- 172.21.15.133:0/1840997081 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400fae0 con 0x7f4ef4005190 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f10560640 1 -- 172.21.15.133:0/1840997081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0815d070 con 0x7f4ef4005190 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4efeffd640 1 -- 172.21.15.133:0/1840997081 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400fe90 con 0x7f4ef4005190 2023-12-18T10:25:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f10560640 1 -- 172.21.15.133:0/1840997081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0815d630 con 0x7f4ef4005190 2023-12-18T10:25:34.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4efeffd640 1 -- 172.21.15.133:0/1840997081 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4f0401d460 con 0x7f4ef4005190 2023-12-18T10:25:34.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4efeffd640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4eec065a60 0x7f4eec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4efeffd640 1 -- 172.21.15.133:0/1840997081 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4f04083590 con 0x7f4ef4005190 2023-12-18T10:25:34.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.156+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4eec065a60 0x7f4eec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 Processor -- start 2023-12-18T10:25:34.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4eec065a60 0x7f4eec067f20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000c10 tx=0x7f4ef8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- start start 2023-12-18T10:25:34.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 0x55ea82eb3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3990 0x55ea82e68c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82e695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea82c8cc90 con 0x55ea82e691c0 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea82cbe220 con 0x55ea82eb3070 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea82cbb7f0 con 0x55ea82eb3990 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82e695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82e695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41268/0 (socket says 172.21.15.133:41268) 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 -- 172.21.15.133:0/3222738862 learned_addr learned my addr 172.21.15.133:0/3222738862 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 0x55ea82eb3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3990 0x55ea82e68c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 -- 172.21.15.133:0/3222738862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3990 msgr2=0x55ea82e68c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3990 0x55ea82e68c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 -- 172.21.15.133:0/3222738862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 msgr2=0x55ea82eb3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 0x55ea82eb3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 -- 172.21.15.133:0/3222738862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea829b3890 con 0x55ea82e691c0 2023-12-18T10:25:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82e695a0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f4f0001c710 tx=0x7f4f0001b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecf7db435503288 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4eebfff640 1 -- 172.21.15.133:0/3222738862 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000a5d70 con 0x55ea82e691c0 2023-12-18T10:25:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4eebfff640 1 -- 172.21.15.133:0/3222738862 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f000039a0 con 0x55ea82e691c0 2023-12-18T10:25:34.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4eebfff640 1 -- 172.21.15.133:0/3222738862 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00003d50 con 0x55ea82e691c0 2023-12-18T10:25:34.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- 172.21.15.133:0/3222738862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 msgr2=0x55ea82e695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82e695a0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f4f0001c710 tx=0x7f4f0001b4e0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- 172.21.15.133:0/3222738862 shutdown_connections 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82e695a0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3990 0x55ea82e68c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 --2- 172.21.15.133:0/3222738862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 0x55ea82eb3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- 172.21.15.133:0/3222738862 >> 172.21.15.133:0/3222738862 conn(0x55ea82e6f950 msgr2=0x55ea82e67560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- 172.21.15.133:0/3222738862 shutdown_connections 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.160+0000 7f4f138b8000 1 -- 172.21.15.133:0/3222738862 wait complete. 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 -- start start 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 Processor -- start 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82eba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3070 0x55ea82ebad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3990 0x55ea82ea1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea82cb70e0 con 0x55ea82e691c0 2023-12-18T10:25:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea82c56310 con 0x55ea82eb3990 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea82c74770 con 0x55ea82eb3070 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 10 client.0 _ll_register_callbacks cb 0x55ea82e54b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82eba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82eba7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41276/0 (socket says 172.21.15.133:41276) 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2743429929 learned_addr learned my addr 172.21.15.133:0/2743429929 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3990 0x55ea82ea1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3070 0x55ea82ebad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2743429929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3070 msgr2=0x55ea82ebad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3070 0x55ea82ebad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2743429929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3990 msgr2=0x55ea82ea1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3990 0x55ea82ea1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2743429929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4003530 con 0x55ea82e691c0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82eba7f0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400f5a0 tx=0x7f4f04054af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8413bcde4b41d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4ee97fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2743429929 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0405c780 con 0x55ea82e691c0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2743429929 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4f040830c0 con 0x55ea82e691c0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 -- 172.21.15.133:0/2743429929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea82c86c10 con 0x55ea82e691c0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2743429929 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f04083280 con 0x55ea82e691c0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 10 client.9276 fetch_fsmap learned FSMap version 108 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 -- 172.21.15.133:0/2743429929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55ea82c7c260 con 0x55ea82e691c0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2743429929 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ea82c86c10 con 0x55ea82e691c0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2743429929 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 108) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f4f04012070 con 0x55ea82e691c0 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 10 client.9276 fetch_fsmap finished waiting for FSMap version 108 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 10 client.9276 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:25:34.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 20 client.9276 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:34.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55ea82ea1da0 0x55ea82ea2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 4 client.9276 mds_command: new command op to 9042 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:34.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f138b8000 1 -- 172.21.15.133:0/2743429929 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea82cb5a30 con 0x55ea82ea1da0 2023-12-18T10:25:34.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.164+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55ea82ea1da0 0x55ea82ea2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55ea82ea1da0 0x55ea82ea2180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24b7a89a985e751f server_cookie=934319b5678fb190 in_seq=0 out_seq=0 2023-12-18T10:25:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4ee97fa640 10 client.9276 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2743429929 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ea82cb5a30 con 0x55ea82ea1da0 2023-12-18T10:25:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4ee97fa640 10 client.9276 handle_command_reply: tid=0 2023-12-18T10:25:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 client.9276 shutdown 2023-12-18T10:25:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 -- 172.21.15.133:0/2743429929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 msgr2=0x55ea82eba7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82eba7f0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400f5a0 tx=0x7f4f04054af0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 -- 172.21.15.133:0/2743429929 shutdown_connections 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55ea82ea1da0 0x55ea82ea2180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3990 0x55ea82ea1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82eb3070 0x55ea82ebad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2743429929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82eba7f0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 -- 172.21.15.133:0/2743429929 >> 172.21.15.133:0/2743429929 conn(0x55ea82e6f950 msgr2=0x55ea82e67c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4ee97fa640 0 client.9276 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 -- 172.21.15.133:0/2743429929 shutdown_connections 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 1 -- 172.21.15.133:0/2743429929 wait complete. 2023-12-18T10:25:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.168+0000 7f4f138b8000 20 client.9276 trim_cache size 0 max 16384 2023-12-18T10:25:34.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f138b8000 1 Processor -- start 2023-12-18T10:25:34.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f138b8000 1 -- start start 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82e6f950 0x55ea82f0b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e691c0 0x55ea82f0bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82eb3070 0x55ea82f0c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f138b8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea82974940 con 0x55ea82eb3070 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f138b8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea82e6c860 con 0x55ea82e6f950 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f138b8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea82d87b30 con 0x55ea82e691c0 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0eafd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82eb3070 0x55ea82f0c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0eafd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82eb3070 0x55ea82f0c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41284/0 (socket says 172.21.15.133:41284) 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0eafd640 1 -- 172.21.15.133:0/2956439788 learned_addr learned my addr 172.21.15.133:0/2956439788 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82e6f950 0x55ea82f0b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e691c0 0x55ea82f0bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0eafd640 1 -- 172.21.15.133:0/2956439788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e691c0 msgr2=0x55ea82f0bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e691c0 0x55ea82f0bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0eafd640 1 -- 172.21.15.133:0/2956439788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82e6f950 msgr2=0x55ea82f0b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82e6f950 0x55ea82f0b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.184+0000 7f4f0eafd640 1 -- 172.21.15.133:0/2956439788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea82c623b0 con 0x55ea82eb3070 2023-12-18T10:25:34.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82eb3070 0x55ea82f0c190 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f4f0001d540 tx=0x7f4f00004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbfa7bf584049a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4efcff9640 1 -- 172.21.15.133:0/2956439788 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000c5070 con 0x55ea82eb3070 2023-12-18T10:25:34.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4efcff9640 1 -- 172.21.15.133:0/2956439788 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f000a5c30 con 0x55ea82eb3070 2023-12-18T10:25:34.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4efcff9640 1 -- 172.21.15.133:0/2956439788 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f000039a0 con 0x55ea82eb3070 2023-12-18T10:25:34.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- 172.21.15.133:0/2956439788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82eb3070 msgr2=0x55ea82f0c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82eb3070 0x55ea82f0c190 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f4f0001d540 tx=0x7f4f00004a50 comp rx=0 tx=0).stop 2023-12-18T10:25:34.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- 172.21.15.133:0/2956439788 shutdown_connections 2023-12-18T10:25:34.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82eb3070 0x55ea82f0c190 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e691c0 0x55ea82f0bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2956439788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82e6f950 0x55ea82f0b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- 172.21.15.133:0/2956439788 >> 172.21.15.133:0/2956439788 conn(0x55ea82eb27c0 msgr2=0x55ea82e9e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- 172.21.15.133:0/2956439788 shutdown_connections 2023-12-18T10:25:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- 172.21.15.133:0/2956439788 wait complete. 2023-12-18T10:25:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- start start 2023-12-18T10:25:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 Processor -- start 2023-12-18T10:25:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82f10140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e6f950 0x55ea82f10680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 0x55ea82ec5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea82c5f860 con 0x55ea82e691c0 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea82c5de10 con 0x55ea82eb3070 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea82cb3cf0 con 0x55ea82e6f950 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f138b8000 10 client.0 _ll_register_callbacks cb 0x55ea82c65640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82f10140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82f10140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41300/0 (socket says 172.21.15.133:41300) 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2684992760 learned_addr learned my addr 172.21.15.133:0/2684992760 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0eafd640 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 0x55ea82ec5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e6f950 0x55ea82f10680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2684992760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e6f950 msgr2=0x55ea82f10680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e6f950 0x55ea82f10680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2684992760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 msgr2=0x55ea82ec5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 0x55ea82ec5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 -- 172.21.15.133:0/2684992760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea829b3890 con 0x55ea82e691c0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4f0e2fc640 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82f10140 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f4f04051450 tx=0x7f4f040817b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e07c50328122b28 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.188+0000 7f4ee97fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2684992760 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04077070 con 0x55ea82e691c0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2684992760 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4f04050a30 con 0x55ea82e691c0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 -- 172.21.15.133:0/2684992760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea82c7ce00 con 0x55ea82e691c0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2684992760 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f04058860 con 0x55ea82e691c0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 10 client.9282 fetch_fsmap learned FSMap version 108 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 -- 172.21.15.133:0/2684992760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55ea829b3cc0 con 0x55ea82e691c0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2684992760 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f04061020 con 0x55ea82e691c0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2684992760 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 108) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f4f04012050 con 0x55ea82e691c0 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 10 client.9282 fetch_fsmap finished waiting for FSMap version 108 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 10 client.9282 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 20 client.9282 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:34.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55ea82eb3990 0x55ea82ec67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 4 client.9282 mds_command: new command op to 9042 tid=0[{"prefix": "status"}] 2023-12-18T10:25:34.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 -- 172.21.15.133:0/2684992760 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ea82cb0160 con 0x55ea82eb3990 2023-12-18T10:25:34.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55ea82eb3990 0x55ea82ec67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f0dafb640 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55ea82eb3990 0x55ea82ec67e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=359154b25a5a8d58 server_cookie=de542765547fc862 in_seq=0 out_seq=0 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 10 client.9282 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 1 -- 172.21.15.133:0/2684992760 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55ea82cb0160 con 0x55ea82eb3990 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 10 client.9282 handle_command_reply: tid=0 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 client.9282 shutdown 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 -- 172.21.15.133:0/2684992760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 msgr2=0x55ea82f10140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82f10140 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f4f04051450 tx=0x7f4f040817b0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 -- 172.21.15.133:0/2684992760 shutdown_connections 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55ea82eb3990 0x55ea82ec67e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea82eb3070 0x55ea82ec5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55ea82e6f950 0x55ea82f10680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4ee97fa640 0 client.9282 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 --2- 172.21.15.133:0/2684992760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ea82e691c0 0x55ea82f10140 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 -- 172.21.15.133:0/2684992760 >> 172.21.15.133:0/2684992760 conn(0x55ea82eb27c0 msgr2=0x55ea82e9ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 -- 172.21.15.133:0/2684992760 shutdown_connections 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 1 -- 172.21.15.133:0/2684992760 wait complete. 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f138b8000 20 client.9282 trim_cache size 0 max 16384 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 1, 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 9042, 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:25:34.197 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:25:34.198 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 2.9534105909999999, 2023-12-18T10:25:34.198 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 108, 2023-12-18T10:25:34.198 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 105, 2023-12-18T10:25:34.198 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 105, 2023-12-18T10:25:34.198 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 19.935012641 2023-12-18T10:25:34.198 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 -- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4eec065a60 msgr2=0x7f4eec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4eec065a60 0x7f4eec067f20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8000c10 tx=0x7f4ef8009040 comp rx=0 tx=0).stop 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 -- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 msgr2=0x7f4f0814d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4f0814d7e0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f4f04007290 tx=0x7f4f04007750 comp rx=0 tx=0).stop 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 -- 172.21.15.133:0/1840997081 shutdown_connections 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4eec065a60 0x7f4eec067f20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f080af000 0x7f4f080af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f080b3830 0x7f4f080b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 --2- 172.21.15.133:0/1840997081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef4005190 0x7f4f0814d7e0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 -- 172.21.15.133:0/1840997081 >> 172.21.15.133:0/1840997081 conn(0x7f4f0806a3e0 msgr2=0x7f4f08072840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 -- 172.21.15.133:0/1840997081 shutdown_connections 2023-12-18T10:25:34.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.192+0000 7f4f10560640 1 -- 172.21.15.133:0/1840997081 wait complete. 2023-12-18T10:25:34.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-18T10:25:34.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.352+0000 7fbfe00c4640 1 Processor -- start 2023-12-18T10:25:34.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.352+0000 7fbfe00c4640 1 -- start start 2023-12-18T10:25:34.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfe00c4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfd8160cc0 0x7fbfd80cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfe00c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbfd80c1280 0x7fbfd80cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfe00c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd806fdb0 con 0x7fbfd80c17d0 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfe00c4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd81654a0 con 0x7fbfd8160cc0 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfe00c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd81610a0 con 0x7fbfd80c1280 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdde60640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfd8160cc0 0x7fbfd80cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfde661640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbfd80c17d0 0x7fbfd806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47878/0 (socket says 172.21.15.133:47878) 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfde661640 1 -- 172.21.15.133:0/2009575955 learned_addr learned my addr 172.21.15.133:0/2009575955 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/2009575955 >> v2:172.21.15.142:3300/0 conn(0x7fbfd80c1280 0x7fbfd80cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdce5e640 1 -- 172.21.15.133:0/2009575955 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609014887 0 0) 0x7fbfd806fdb0 con 0x7fbfd80c17d0 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdce5e640 1 -- 172.21.15.133:0/2009575955 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc4003530 con 0x7fbfd80c17d0 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdde60640 1 -- 172.21.15.133:0/2009575955 >> v2:172.21.15.142:3300/0 conn(0x7fbfd80c1280 msgr2=0x7fbfd80cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdde60640 1 --2- 172.21.15.133:0/2009575955 >> v2:172.21.15.142:3300/0 conn(0x7fbfd80c1280 0x7fbfd80cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdde60640 1 -- 172.21.15.133:0/2009575955 >> v1:172.21.15.133:6789/0 conn(0x7fbfd80c17d0 legacy=0x7fbfd806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdde60640 1 -- 172.21.15.133:0/2009575955 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd80cb6b0 con 0x7fbfd8160cc0 2023-12-18T10:25:34.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.356+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/2009575955 >> v2:172.21.15.142:3300/0 conn(0x7fbfd80c1280 0x7fbfd80cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:34.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfdde60640 1 --2- 172.21.15.133:0/2009575955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8160cc0 0x7fbfd80cac30 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80c8ad0 tx=0x7fbfd401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897773f25cdef426 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfdce5e640 1 -- 172.21.15.133:0/2009575955 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40ab600 con 0x7fbfd8160cc0 2023-12-18T10:25:34.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfdce5e640 1 -- 172.21.15.133:0/2009575955 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd40a7050 con 0x7fbfd8160cc0 2023-12-18T10:25:34.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfdce5e640 1 -- 172.21.15.133:0/2009575955 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40ab980 con 0x7fbfd8160cc0 2023-12-18T10:25:34.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 -- 172.21.15.133:0/2009575955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8160cc0 msgr2=0x7fbfd80cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/2009575955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8160cc0 0x7fbfd80cac30 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80c8ad0 tx=0x7fbfd401c3a0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 -- 172.21.15.133:0/2009575955 shutdown_connections 2023-12-18T10:25:34.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/2009575955 >> v2:172.21.15.142:3300/0 conn(0x7fbfd80c1280 0x7fbfd80cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/2009575955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd8160cc0 0x7fbfd80cac30 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 -- 172.21.15.133:0/2009575955 >> 172.21.15.133:0/2009575955 conn(0x7fbfd806a3e0 msgr2=0x7fbfd80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 -- 172.21.15.133:0/2009575955 shutdown_connections 2023-12-18T10:25:34.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 -- 172.21.15.133:0/2009575955 wait complete. 2023-12-18T10:25:34.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 Processor -- start 2023-12-18T10:25:34.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.360+0000 7fbfe00c4640 1 -- start start 2023-12-18T10:25:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfe00c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd80c1280 0x7fbfd8158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfe00c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd80c17d0 0x7fbfd81612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfe00c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd8160cc0 0x7fbfd80711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfe00c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c8500 con 0x7fbfd80c17d0 2023-12-18T10:25:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfe00c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd8162a90 con 0x7fbfd8160cc0 2023-12-18T10:25:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfe00c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd8159060 con 0x7fbfd80c1280 2023-12-18T10:25:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd80c17d0 0x7fbfd81612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd80c17d0 0x7fbfd81612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41332/0 (socket says 172.21.15.133:41332) 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 -- 172.21.15.133:0/3048427485 learned_addr learned my addr 172.21.15.133:0/3048427485 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfde661640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd8160cc0 0x7fbfd80711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdde60640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd80c1280 0x7fbfd8158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 -- 172.21.15.133:0/3048427485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd80c1280 msgr2=0x7fbfd8158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd80c1280 0x7fbfd8158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 -- 172.21.15.133:0/3048427485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd8160cc0 msgr2=0x7fbfd80711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd8160cc0 0x7fbfd80711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 -- 172.21.15.133:0/3048427485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009420 con 0x7fbfd80c17d0 2023-12-18T10:25:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd80c17d0 0x7fbfd81612c0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800e810 tx=0x7fbfc800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfce7fc640 1 -- 172.21.15.133:0/3048427485 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc800c8d0 con 0x7fbfd80c17d0 2023-12-18T10:25:34.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfce7fc640 1 -- 172.21.15.133:0/3048427485 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc800ca30 con 0x7fbfd80c17d0 2023-12-18T10:25:34.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfce7fc640 1 -- 172.21.15.133:0/3048427485 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc800cdc0 con 0x7fbfd80c17d0 2023-12-18T10:25:34.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfe00c4640 1 -- 172.21.15.133:0/3048427485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd80c8220 con 0x7fbfd80c17d0 2023-12-18T10:25:34.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfe00c4640 1 -- 172.21.15.133:0/3048427485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd8162290 con 0x7fbfd80c17d0 2023-12-18T10:25:34.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.364+0000 7fbfce7fc640 1 -- 172.21.15.133:0/3048427485 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbfc8013410 con 0x7fbfd80c17d0 2023-12-18T10:25:34.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfce7fc640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfbc065a60 0x7fbfbc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfce7fc640 1 -- 172.21.15.133:0/3048427485 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbfc80830b0 con 0x7fbfd80c17d0 2023-12-18T10:25:34.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfdde60640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfbc065a60 0x7fbfbc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfe3426000 1 Processor -- start 2023-12-18T10:25:34.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfe3426000 1 -- start start 2023-12-18T10:25:34.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfdde60640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfbc065a60 0x7fbfbc067f20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40ad000 tx=0x7fbfd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x561826512450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x5618264c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfe3426000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618262ebc90 con 0x5618264c81c0 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfe3426000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56182631d220 con 0x561826512070 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfe3426000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56182631a7f0 con 0x561826512990 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfdde60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x561826512450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfdd65f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x5618264c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41344/0 (socket says 172.21.15.133:41344) 2023-12-18T10:25:34.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 -- 172.21.15.133:0/429821943 learned_addr learned my addr 172.21.15.133:0/429821943 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 -- 172.21.15.133:0/429821943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 msgr2=0x5618264c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 --2- 172.21.15.133:0/429821943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x5618264c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 -- 172.21.15.133:0/429821943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 msgr2=0x561826512450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 --2- 172.21.15.133:0/429821943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x561826512450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 -- 172.21.15.133:0/429821943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561826012890 con 0x5618264c81c0 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfde661640 1 --2- 172.21.15.133:0/429821943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264c85a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0002050 tx=0x7fbfd000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc16e954b83eaa5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfbb7fe640 1 -- 172.21.15.133:0/429821943 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd000ee50 con 0x5618264c81c0 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfbb7fe640 1 -- 172.21.15.133:0/429821943 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0014480 con 0x5618264c81c0 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.368+0000 7fbfbb7fe640 1 -- 172.21.15.133:0/429821943 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00147f0 con 0x5618264c81c0 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- 172.21.15.133:0/429821943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 msgr2=0x5618264c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 --2- 172.21.15.133:0/429821943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264c85a0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0002050 tx=0x7fbfd000e530 comp rx=0 tx=0).stop 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- 172.21.15.133:0/429821943 shutdown_connections 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 --2- 172.21.15.133:0/429821943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264c85a0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 --2- 172.21.15.133:0/429821943 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x5618264c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 --2- 172.21.15.133:0/429821943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x561826512450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- 172.21.15.133:0/429821943 >> 172.21.15.133:0/429821943 conn(0x5618264ce950 msgr2=0x5618264c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- 172.21.15.133:0/429821943 shutdown_connections 2023-12-18T10:25:34.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- 172.21.15.133:0/429821943 wait complete. 2023-12-18T10:25:34.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- start start 2023-12-18T10:25:34.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 Processor -- start 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x5618264d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x5618264d45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618263160e0 con 0x5618264c81c0 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618262b5310 con 0x561826512070 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618262d3770 con 0x561826512990 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 10 client.0 _ll_register_callbacks cb 0x5618264b3b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdde60640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdde60640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41346/0 (socket says 172.21.15.133:41346) 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdde60640 1 -- 172.21.15.133:0/4233559766 learned_addr learned my addr 172.21.15.133:0/4233559766 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x5618264d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfde661640 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x5618264d45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdd65f640 1 -- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 msgr2=0x5618264d45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x5618264d45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdd65f640 1 -- 172.21.15.133:0/4233559766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 msgr2=0x5618264cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdd65f640 1 -- 172.21.15.133:0/4233559766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd000f040 con 0x561826512070 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdde60640 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x5618264d4080 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80542e0 tx=0x7fbfc8054ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2238325b2603c5b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/4233559766 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc805c5c0 con 0x561826512070 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/4233559766 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbfc805c130 con 0x561826512070 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- 172.21.15.133:0/4233559766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618262e5c10 con 0x561826512070 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/4233559766 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfc805c2f0 con 0x561826512070 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 10 client.8626 fetch_fsmap learned FSMap version 108 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfe3426000 1 -- 172.21.15.133:0/4233559766 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x5618262db260 con 0x561826512070 2023-12-18T10:25:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.372+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/4233559766 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5618262e5c10 con 0x561826512070 2023-12-18T10:25:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/4233559766 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 108) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fbfc805a1c0 con 0x561826512070 2023-12-18T10:25:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 10 client.8626 fetch_fsmap finished waiting for FSMap version 108 2023-12-18T10:25:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 10 client.8626 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:25:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 20 client.8626 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5618265198d0 0x561826519cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 4 client.8626 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 -- 172.21.15.133:0/4233559766 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561826314a30 con 0x5618265198d0 2023-12-18T10:25:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfdde60640 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5618265198d0 0x561826519cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfdde60640 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5618265198d0 0x561826519cb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c70f0d043e215a9 server_cookie=81ea10aed4346ebe in_seq=0 out_seq=0 2023-12-18T10:25:34.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfb8ff9640 10 client.8626 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:34.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/4233559766 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561826314a30 con 0x5618265198d0 2023-12-18T10:25:34.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfb8ff9640 10 client.8626 handle_command_reply: tid=0 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 client.8626 shutdown 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 -- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 msgr2=0x5618264d4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x5618264d4080 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80542e0 tx=0x7fbfc8054ce0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 -- 172.21.15.133:0/4233559766 shutdown_connections 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5618265198d0 0x561826519cb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x5618264d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x5618264d4080 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4233559766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x5618264cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfb8ff9640 0 client.8626 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 -- 172.21.15.133:0/4233559766 >> 172.21.15.133:0/4233559766 conn(0x5618264ce950 msgr2=0x5618264c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 -- 172.21.15.133:0/4233559766 shutdown_connections 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 1 -- 172.21.15.133:0/4233559766 wait complete. 2023-12-18T10:25:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.376+0000 7fbfe3426000 20 client.8626 trim_cache size 0 max 16384 2023-12-18T10:25:34.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 Processor -- start 2023-12-18T10:25:34.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- start start 2023-12-18T10:25:34.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618264c81c0 0x561826569ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561826512070 0x56182656a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512990 0x56182656a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x561825fd3940 con 0x561826512070 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56182631a0e0 con 0x561826512990 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x561826318c40 con 0x5618264c81c0 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561826512070 0x56182656a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561826512070 0x56182656a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41358/0 (socket says 172.21.15.133:41358) 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 -- 172.21.15.133:0/4208254081 learned_addr learned my addr 172.21.15.133:0/4208254081 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdde60640 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618264c81c0 0x561826569ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfde661640 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512990 0x56182656a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 -- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618264c81c0 msgr2=0x561826569ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618264c81c0 0x561826569ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 -- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512990 msgr2=0x56182656a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512990 0x56182656a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 -- 172.21.15.133:0/4208254081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618262c13b0 con 0x561826512070 2023-12-18T10:25:34.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfde661640 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512990 0x56182656a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561826512070 0x56182656a410 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8081270 tx=0x7fbfc8056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6fcffcefc408bc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfbbfff640 1 -- 172.21.15.133:0/4208254081 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80721f0 con 0x561826512070 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfbbfff640 1 -- 172.21.15.133:0/4208254081 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8054120 con 0x561826512070 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfbbfff640 1 -- 172.21.15.133:0/4208254081 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc805c5c0 con 0x561826512070 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- 172.21.15.133:0/4208254081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561826512070 msgr2=0x56182656a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561826512070 0x56182656a410 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8081270 tx=0x7fbfc8056000 comp rx=0 tx=0).stop 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- 172.21.15.133:0/4208254081 shutdown_connections 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512990 0x56182656a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561826512070 0x56182656a410 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 --2- 172.21.15.133:0/4208254081 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5618264c81c0 0x561826569ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- 172.21.15.133:0/4208254081 >> 172.21.15.133:0/4208254081 conn(0x5618264ce950 msgr2=0x5618264d3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- 172.21.15.133:0/4208254081 shutdown_connections 2023-12-18T10:25:34.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.392+0000 7fbfe3426000 1 -- 172.21.15.133:0/4208254081 wait complete. 2023-12-18T10:25:34.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 -- start start 2023-12-18T10:25:34.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 Processor -- start 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x56182656e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x56182656edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x561826524310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618263e6b30 con 0x5618264c81c0 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618264b3a10 con 0x561826512070 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5618262da070 con 0x561826512990 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 10 client.0 _ll_register_callbacks cb 0x5618262c4640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x56182656e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x56182656e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41360/0 (socket says 172.21.15.133:41360) 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 -- 172.21.15.133:0/1519829761 learned_addr learned my addr 172.21.15.133:0/1519829761 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x56182656edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfde661640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x561826524310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 -- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 msgr2=0x561826524310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x561826524310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 -- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 msgr2=0x56182656edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x56182656edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 -- 172.21.15.133:0/1519829761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5618262db260 con 0x5618264c81c0 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x56182656edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfde661640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x561826524310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdde60640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x56182656e870 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4008010 tx=0x7fbfd401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c971260121416f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:34.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/1519829761 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40be040 con 0x5618264c81c0 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 -- 172.21.15.133:0/1519829761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618262dbe00 con 0x5618264c81c0 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/1519829761 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbfd40c80e0 con 0x5618264c81c0 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/1519829761 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfd40c82a0 con 0x5618264c81c0 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 10 client.9303 fetch_fsmap learned FSMap version 108 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 -- 172.21.15.133:0/1519829761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x561826012cc0 con 0x5618264c81c0 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/1519829761 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5618262dbe00 con 0x5618264c81c0 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/1519829761 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 108) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fbfd40c8880 con 0x5618264c81c0 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 10 client.9303 fetch_fsmap finished waiting for FSMap version 108 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 10 client.9303 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 20 client.9303 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x561826575740 0x561826577b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 4 client.9303 mds_command: new command op to 9048 tid=0[{"prefix": "status"}] 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfe3426000 1 -- 172.21.15.133:0/1519829761 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56182630f160 con 0x561826575740 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.396+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x561826575740 0x561826577b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfb8ff9640 10 client.9303 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfdd65f640 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x561826575740 0x561826577b30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4c14583c68a0c4 server_cookie=ca1487176b137311 in_seq=0 out_seq=0 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfb8ff9640 1 -- 172.21.15.133:0/1519829761 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x56182630f160 con 0x561826575740 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfb8ff9640 10 client.9303 handle_command_reply: tid=0 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 client.9303 shutdown 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 -- 172.21.15.133:0/1519829761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 msgr2=0x56182656e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x56182656e870 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4008010 tx=0x7fbfd401abe0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 -- 172.21.15.133:0/1519829761 shutdown_connections 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x561826575740 0x561826577b30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x561826512990 0x561826524310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561826512070 0x56182656edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfb8ff9640 0 client.9303 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 --2- 172.21.15.133:0/1519829761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5618264c81c0 0x56182656e870 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 -- 172.21.15.133:0/1519829761 >> 172.21.15.133:0/1519829761 conn(0x5618264ce950 msgr2=0x56182650f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 -- 172.21.15.133:0/1519829761 shutdown_connections 2023-12-18T10:25:34.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 1 -- 172.21.15.133:0/1519829761 wait complete. 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe3426000 20 client.9303 trim_cache size 0 max 16384 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "7fe143ee-5f58-4242-8bb4-33cc87443c22", 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 9048, 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 15.845681069999999, 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 108, 2023-12-18T10:25:34.404 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 105, 2023-12-18T10:25:34.405 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 105, 2023-12-18T10:25:34.405 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 20.134653425 2023-12-18T10:25:34.405 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:34.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 -- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfbc065a60 msgr2=0x7fbfbc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfbc065a60 0x7fbfbc067f20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40ad000 tx=0x7fbfd4008040 comp rx=0 tx=0).stop 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 -- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd80c17d0 msgr2=0x7fbfd81612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd80c17d0 0x7fbfd81612c0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800e810 tx=0x7fbfc800ecd0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 -- 172.21.15.133:0/3048427485 shutdown_connections 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbfbc065a60 0x7fbfbc067f20 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbfd8160cc0 0x7fbfd80711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd80c17d0 0x7fbfd81612c0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 --2- 172.21.15.133:0/3048427485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbfd80c1280 0x7fbfd8158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 -- 172.21.15.133:0/3048427485 >> 172.21.15.133:0/3048427485 conn(0x7fbfd806a3e0 msgr2=0x7fbfd80b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 -- 172.21.15.133:0/3048427485 shutdown_connections 2023-12-18T10:25:34.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.400+0000 7fbfe00c4640 1 -- 172.21.15.133:0/3048427485 wait complete. 2023-12-18T10:25:34.419 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:34.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10cd8f640 1 Processor -- start 2023-12-18T10:25:34.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10cd8f640 1 -- start start 2023-12-18T10:25:34.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10cd8f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc10806c4f0 0x7fc1080c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10cd8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc108070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10cd8f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1080c9460 con 0x7fc1081570c0 2023-12-18T10:25:34.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10cd8f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1081574a0 con 0x7fc10806c4f0 2023-12-18T10:25:34.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10cd8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080c8b30 con 0x7fc1080c9e30 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10659c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc1081570c0 0x7fc10806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47882/0 (socket says 172.21.15.133:47882) 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc10659c640 1 -- 172.21.15.133:0/3245469024 learned_addr learned my addr 172.21.15.133:0/3245469024 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc0fdd9b640 1 --2- 172.21.15.133:0/3245469024 >> v2:172.21.15.133:3300/0 conn(0x7fc10806c4f0 0x7fc1080c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc106d9d640 1 --2- 172.21.15.133:0/3245469024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc108070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc105d9b640 1 -- 172.21.15.133:0/3245469024 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701502273 0 0) 0x7fc1080c9460 con 0x7fc1081570c0 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc105d9b640 1 -- 172.21.15.133:0/3245469024 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f4003530 con 0x7fc1081570c0 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc0fdd9b640 1 -- 172.21.15.133:0/3245469024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 msgr2=0x7fc108070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc0fdd9b640 1 --2- 172.21.15.133:0/3245469024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc108070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc0fdd9b640 1 -- 172.21.15.133:0/3245469024 >> v1:172.21.15.133:6789/0 conn(0x7fc1081570c0 legacy=0x7fc10806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc0fdd9b640 1 -- 172.21.15.133:0/3245469024 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080c8e10 con 0x7fc10806c4f0 2023-12-18T10:25:34.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.556+0000 7fc106d9d640 1 --2- 172.21.15.133:0/3245469024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc108070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:34.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc0fdd9b640 1 --2- 172.21.15.133:0/3245469024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c98f0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097c0 tx=0x7fc0f801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4cea1aa00a9c2f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc105d9b640 1 -- 172.21.15.133:0/3245469024 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80ab600 con 0x7fc10806c4f0 2023-12-18T10:25:34.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc105d9b640 1 -- 172.21.15.133:0/3245469024 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f80a7050 con 0x7fc10806c4f0 2023-12-18T10:25:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3245469024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 msgr2=0x7fc1080c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3245469024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c98f0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097c0 tx=0x7fc0f801c3c0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3245469024 shutdown_connections 2023-12-18T10:25:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3245469024 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc108070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3245469024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c98f0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3245469024 >> 172.21.15.133:0/3245469024 conn(0x7fc10806a3e0 msgr2=0x7fc1080afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3245469024 shutdown_connections 2023-12-18T10:25:34.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.560+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3245469024 wait complete. 2023-12-18T10:25:34.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 Processor -- start 2023-12-18T10:25:34.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 -- start start 2023-12-18T10:25:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc10815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1081570c0 0x7fc1080c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081585f0 con 0x7fc10806c4f0 2023-12-18T10:25:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108157d50 con 0x7fc1081570c0 2023-12-18T10:25:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc108158030 con 0x7fc1080c9e30 2023-12-18T10:25:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41390/0 (socket says 172.21.15.133:41390) 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 -- 172.21.15.133:0/3191710804 learned_addr learned my addr 172.21.15.133:0/3191710804 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc106d9d640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1081570c0 0x7fc1080c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc0fdd9b640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc10815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 -- 172.21.15.133:0/3191710804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 msgr2=0x7fc10815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc10815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 -- 172.21.15.133:0/3191710804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1081570c0 msgr2=0x7fc1080c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1081570c0 0x7fc1080c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 -- 172.21.15.133:0/3191710804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8009420 con 0x7fc10806c4f0 2023-12-18T10:25:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10659c640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c48f0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000c4d0 tx=0x7fc0f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc0ff7fe640 1 -- 172.21.15.133:0/3191710804 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0005cf0 con 0x7fc10806c4f0 2023-12-18T10:25:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc0ff7fe640 1 -- 172.21.15.133:0/3191710804 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0005e50 con 0x7fc10806c4f0 2023-12-18T10:25:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc108158310 con 0x7fc10806c4f0 2023-12-18T10:25:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc0ff7fe640 1 -- 172.21.15.133:0/3191710804 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0007270 con 0x7fc10806c4f0 2023-12-18T10:25:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.564+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1081575e0 con 0x7fc10806c4f0 2023-12-18T10:25:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.568+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1080735b0 con 0x7fc10806c4f0 2023-12-18T10:25:34.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.568+0000 7fc0ff7fe640 1 -- 172.21.15.133:0/3191710804 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc0f00073d0 con 0x7fc10806c4f0 2023-12-18T10:25:34.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.568+0000 7fc0ff7fe640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0e8065a90 0x7fc0e8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:34.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.568+0000 7fc0ff7fe640 1 -- 172.21.15.133:0/3191710804 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc0f0082880 con 0x7fc10806c4f0 2023-12-18T10:25:34.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.568+0000 7fc0fdd9b640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0e8065a90 0x7fc0e8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:34.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.568+0000 7fc0fdd9b640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0e8065a90 0x7fc0e8067f50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ad000 tx=0x7fc0f80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:34.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.572+0000 7fc0ff7fe640 1 -- 172.21.15.133:0/3191710804 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc0f0050110 con 0x7fc10806c4f0 2023-12-18T10:25:34.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.756+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc108144230 con 0x7fc10806c4f0 2023-12-18T10:25:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.756+0000 7fc0ff7fe640 1 -- 172.21.15.133:0/3191710804 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4755 (secure 0 0 0) 0x7fc108144230 con 0x7fc10806c4f0 2023-12-18T10:25:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:34.758 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":108,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:33.251090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:25:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 108 2023-12-18T10:25:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0e8065a90 msgr2=0x7fc0e8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0e8065a90 0x7fc0e8067f50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80ad000 tx=0x7fc0f80a6000 comp rx=0 tx=0).stop 2023-12-18T10:25:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 msgr2=0x7fc1080c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c48f0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000c4d0 tx=0x7fc0f000c990 comp rx=0 tx=0).stop 2023-12-18T10:25:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 shutdown_connections 2023-12-18T10:25:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc0e8065a90 0x7fc0e8067f50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc1081570c0 0x7fc1080c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc1080c9e30 0x7fc10815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 --2- 172.21.15.133:0/3191710804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10806c4f0 0x7fc1080c48f0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 >> 172.21.15.133:0/3191710804 conn(0x7fc10806a3e0 msgr2=0x7fc1080acb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 shutdown_connections 2023-12-18T10:25:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:34.760+0000 7fc10cd8f640 1 -- 172.21.15.133:0/3191710804 wait complete. 2023-12-18T10:25:34.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:34.779 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:25:34.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:34.812 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2023-12-18T10:25:34.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:34.876 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2023-12-18T10:25:34.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:34.930 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2023-12-18T10:25:34.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:34.982 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2023-12-18T10:25:35.034 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:25:35.199 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:25:35.200 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:25:35.200 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:25:37.202 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:25:37.368 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:25:37.368 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:25:37.368 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:25:39.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:25:39.535 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:25:39.535 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:25:39.536 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:25:41.536 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:25:41.702 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:25:41.703 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:25:41.703 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:25:43.704 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:25:43.869 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-12-18T10:25:43.870 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:25:43.870 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:25:45.871 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2023-12-18T10:25:46.038 INFO:teuthology.orchestra.run.smithi142.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2023-12-18T10:25:46.038 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:25:46.038 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2023-12-18T10:25:46.039 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:25:46.205 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:25:46.206 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:25:46.206 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:25:48.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:25:48.370 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:25:48.371 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:25:48.371 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:25:50.372 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-12-18T10:25:50.534 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2023-12-18T10:25:50.535 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2023-12-18T10:25:50.535 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:25:50.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2023-12-18T10:25:50.694 INFO:teuthology.orchestra.run.smithi133.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-12-18T10:25:50.695 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2023-12-18T10:25:50.695 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2023-12-18T10:25:50.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 flush journal 2023-12-18T10:25:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.832+0000 7f0e28db3640 1 Processor -- start 2023-12-18T10:25:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.832+0000 7f0e28db3640 1 -- start start 2023-12-18T10:25:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e28db3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e240ca410 0x7f0e24159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e28db3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e24159fb0 0x7f0e24071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e28db3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e24070df0 con 0x7f0e24071db0 2023-12-18T10:25:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e28db3640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2415aab0 con 0x7f0e24159fb0 2023-12-18T10:25:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e28db3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2415a4f0 con 0x7f0e240ca410 2023-12-18T10:25:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e1bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e24159fb0 0x7f0e24071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e1bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e24159fb0 0x7f0e24071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52450/0 (socket says 172.21.15.133:52450) 2023-12-18T10:25:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e1bfff640 1 -- 172.21.15.133:0/205031877 learned_addr learned my addr 172.21.15.133:0/205031877 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e2259c640 1 --2- 172.21.15.133:0/205031877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e240ca410 0x7f0e24159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e1bfff640 1 -- 172.21.15.133:0/205031877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e240ca410 msgr2=0x7f0e24159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/205031877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e240ca410 0x7f0e24159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e1bfff640 1 -- 172.21.15.133:0/205031877 >> v1:172.21.15.142:6789/0 conn(0x7f0e24071db0 legacy=0x7f0e240cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e1bfff640 1 -- 172.21.15.133:0/205031877 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2415a7d0 con 0x7f0e24159fb0 2023-12-18T10:25:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.836+0000 7f0e21d9b640 1 -- 172.21.15.133:0/205031877 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005369394 0 0) 0x7f0e24070df0 con 0x7f0e24071db0 2023-12-18T10:25:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/205031877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24159fb0 0x7f0e24071870 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009870 tx=0x7f0e0c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842d83987f8166b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e21d9b640 1 -- 172.21.15.133:0/205031877 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0aa670 con 0x7f0e24159fb0 2023-12-18T10:25:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e21d9b640 1 -- 172.21.15.133:0/205031877 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0aa7d0 con 0x7f0e24159fb0 2023-12-18T10:25:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e21d9b640 1 -- 172.21.15.133:0/205031877 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0aab60 con 0x7f0e24159fb0 2023-12-18T10:25:50.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 -- 172.21.15.133:0/205031877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24159fb0 msgr2=0x7f0e24071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 --2- 172.21.15.133:0/205031877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24159fb0 0x7f0e24071870 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009870 tx=0x7f0e0c01c510 comp rx=0 tx=0).stop 2023-12-18T10:25:50.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 -- 172.21.15.133:0/205031877 shutdown_connections 2023-12-18T10:25:50.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 --2- 172.21.15.133:0/205031877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24159fb0 0x7f0e24071870 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 --2- 172.21.15.133:0/205031877 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e240ca410 0x7f0e24159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 -- 172.21.15.133:0/205031877 >> 172.21.15.133:0/205031877 conn(0x7f0e2406a2a0 msgr2=0x7f0e240aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:50.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 -- 172.21.15.133:0/205031877 shutdown_connections 2023-12-18T10:25:50.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 -- 172.21.15.133:0/205031877 wait complete. 2023-12-18T10:25:50.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 Processor -- start 2023-12-18T10:25:50.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.840+0000 7f0e28db3640 1 -- start start 2023-12-18T10:25:50.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e28db3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e24071db0 0x7f0e24151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e28db3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e240ca410 0x7f0e24154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e28db3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e24159fb0 0x7f0e240aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e28db3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e24154340 con 0x7f0e240ca410 2023-12-18T10:25:50.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e28db3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e241517b0 con 0x7f0e24071db0 2023-12-18T10:25:50.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e28db3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e24155580 con 0x7f0e24159fb0 2023-12-18T10:25:50.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e240ca410 0x7f0e24154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e240ca410 0x7f0e24154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52452/0 (socket says 172.21.15.133:52452) 2023-12-18T10:25:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 -- 172.21.15.133:0/2082257665 learned_addr learned my addr 172.21.15.133:0/2082257665 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e2259c640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e24071db0 0x7f0e24151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e22d9d640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e24159fb0 0x7f0e240aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 -- 172.21.15.133:0/2082257665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e24159fb0 msgr2=0x7f0e240aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e24159fb0 0x7f0e240aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 -- 172.21.15.133:0/2082257665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e24071db0 msgr2=0x7f0e24151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e24071db0 0x7f0e24151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 -- 172.21.15.133:0/2082257665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0c0094d0 con 0x7f0e240ca410 2023-12-18T10:25:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e240ca410 0x7f0e24154b10 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0ac040 tx=0x7f0e0c0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1affd640 1 -- 172.21.15.133:0/2082257665 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0b4810 con 0x7f0e240ca410 2023-12-18T10:25:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1affd640 1 -- 172.21.15.133:0/2082257665 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0b49b0 con 0x7f0e240ca410 2023-12-18T10:25:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1affd640 1 -- 172.21.15.133:0/2082257665 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0b4d60 con 0x7f0e240ca410 2023-12-18T10:25:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e28db3640 1 -- 172.21.15.133:0/2082257665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e24155860 con 0x7f0e240ca410 2023-12-18T10:25:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e28db3640 1 -- 172.21.15.133:0/2082257665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e24155e20 con 0x7f0e240ca410 2023-12-18T10:25:50.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.844+0000 7f0e1affd640 1 -- 172.21.15.133:0/2082257665 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e0c0c83f0 con 0x7f0e240ca410 2023-12-18T10:25:50.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e1affd640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e04065a60 0x7f0e04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e1affd640 1 -- 172.21.15.133:0/2082257665 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e0c11e1f0 con 0x7f0e240ca410 2023-12-18T10:25:50.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e04065a60 0x7f0e04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2c12b000 1 Processor -- start 2023-12-18T10:25:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e04065a60 0x7f0e04067f20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0e240c87b0 tx=0x7f0e14009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:50.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2c12b000 1 -- start start 2023-12-18T10:25:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c086a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 0x55aa6c0873a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa6bf4f430 con 0x55aa6c0d0c80 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa6bedd460 con 0x55aa6c0d15a0 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa6bedaa30 con 0x55aa6c086fc0 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52462/0 (socket says 172.21.15.133:52462) 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 -- 172.21.15.133:0/1968978255 learned_addr learned my addr 172.21.15.133:0/1968978255 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 -- 172.21.15.133:0/1968978255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 msgr2=0x55aa6c0873a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 0x55aa6c0873a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c086a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 -- 172.21.15.133:0/1968978255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 msgr2=0x55aa6c086a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c086a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 -- 172.21.15.133:0/1968978255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa6bbd2e20 con 0x55aa6c0d0c80 2023-12-18T10:25:50.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c086a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.848+0000 7f0e2259c640 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1060 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009760 tx=0x7f0e14014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac5bb29abf164ea server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e03fff640 1 -- 172.21.15.133:0/1968978255 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14014bd0 con 0x55aa6c0d0c80 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e03fff640 1 -- 172.21.15.133:0/1968978255 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e14014d30 con 0x55aa6c0d0c80 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e03fff640 1 -- 172.21.15.133:0/1968978255 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14014ea0 con 0x55aa6c0d0c80 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- 172.21.15.133:0/1968978255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 msgr2=0x55aa6c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1060 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009760 tx=0x7f0e14014000 comp rx=0 tx=0).stop 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- 172.21.15.133:0/1968978255 shutdown_connections 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 0x55aa6c0873a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c086a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/1968978255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1060 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- 172.21.15.133:0/1968978255 >> 172.21.15.133:0/1968978255 conn(0x55aa6be85910 msgr2=0x55aa6c085360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:50.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- 172.21.15.133:0/1968978255 shutdown_connections 2023-12-18T10:25:50.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- 172.21.15.133:0/1968978255 wait complete. 2023-12-18T10:25:50.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- start start 2023-12-18T10:25:50.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 Processor -- start 2023-12-18T10:25:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c086fc0 0x55aa6c0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d15a0 0x55aa6c0d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa6bed6320 con 0x55aa6c086fc0 2023-12-18T10:25:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa6be754f0 con 0x55aa6c0d0c80 2023-12-18T10:25:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa6be936e0 con 0x55aa6c0d15a0 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2c12b000 10 client.0 _ll_register_callbacks cb 0x55aa6c072980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c086fc0 0x55aa6c0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c086fc0 0x55aa6c0d01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52474/0 (socket says 172.21.15.133:52474) 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2259c640 1 -- 172.21.15.133:0/3167650133 learned_addr learned my addr 172.21.15.133:0/3167650133 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e22d9d640 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d15a0 0x55aa6c0d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2259c640 1 -- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d15a0 msgr2=0x55aa6c0d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2259c640 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d15a0 0x55aa6c0d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2259c640 1 -- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d0c80 msgr2=0x55aa6c0d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2259c640 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.852+0000 7f0e2259c640 1 -- 172.21.15.133:0/3167650133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e14011b40 con 0x55aa6c086fc0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2259c640 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c086fc0 0x55aa6c0d01c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f0e14011690 tx=0x7f0e14004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd8a95e934f01f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 1 -- 172.21.15.133:0/3167650133 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1402e070 con 0x55aa6c086fc0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 1 -- 172.21.15.133:0/3167650133 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e1401c040 con 0x55aa6c086fc0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 -- 172.21.15.133:0/3167650133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa6be93120 con 0x55aa6c086fc0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 1 -- 172.21.15.133:0/3167650133 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e14004570 con 0x55aa6c086fc0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 10 client.9324 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 -- 172.21.15.133:0/3167650133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55aa6be9b250 con 0x55aa6c086fc0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 1 -- 172.21.15.133:0/3167650133 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aa6be93120 con 0x55aa6c086fc0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 1 -- 172.21.15.133:0/3167650133 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0e14003830 con 0x55aa6c086fc0 2023-12-18T10:25:50.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 10 client.9324 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 10 client.9324 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 20 client.9324 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55aa6c0d28d0 0x55aa6c0d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 4 client.9324 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 -- 172.21.15.133:0/3167650133 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa6bed4c70 con 0x55aa6c0d28d0 2023-12-18T10:25:50.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55aa6c0d28d0 0x55aa6c0d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55aa6c0d28d0 0x55aa6c0d2cb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f438666974bf07f server_cookie=7c540baef247b55c in_seq=0 out_seq=0 2023-12-18T10:25:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 10 client.9324 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 1 -- 172.21.15.133:0/3167650133 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55aa6bed4c70 con 0x55aa6c0d28d0 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 10 client.9324 handle_command_reply: tid=0 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 client.9324 shutdown 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 -- 172.21.15.133:0/3167650133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c086fc0 msgr2=0x55aa6c0d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c086fc0 0x55aa6c0d01c0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f0e14011690 tx=0x7f0e14004740 comp rx=0 tx=0).stop 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 -- 172.21.15.133:0/3167650133 shutdown_connections 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55aa6c0d28d0 0x55aa6c0d2cb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d15a0 0x55aa6c0d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d0c80 0x55aa6c0d1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/3167650133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c086fc0 0x55aa6c0d01c0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 -- 172.21.15.133:0/3167650133 >> 172.21.15.133:0/3167650133 conn(0x55aa6be85910 msgr2=0x55aa6c085a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e017fa640 0 client.9324 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 -- 172.21.15.133:0/3167650133 shutdown_connections 2023-12-18T10:25:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 1 -- 172.21.15.133:0/3167650133 wait complete. 2023-12-18T10:25:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.856+0000 7f0e2c12b000 20 client.9324 trim_cache size 0 max 16384 2023-12-18T10:25:50.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.868+0000 7f0e2c12b000 1 Processor -- start 2023-12-18T10:25:50.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.868+0000 7f0e2c12b000 1 -- start start 2023-12-18T10:25:50.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c086fc0 0x55aa6c0de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d0c80 0x55aa6c0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d15a0 0x55aa6c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa6bb93aa0 con 0x55aa6c0d15a0 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa6bed3b30 con 0x55aa6c086fc0 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa6c08b570 con 0x55aa6c0d0c80 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d15a0 0x55aa6c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d15a0 0x55aa6c0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52476/0 (socket says 172.21.15.133:52476) 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 -- 172.21.15.133:0/2318828980 learned_addr learned my addr 172.21.15.133:0/2318828980 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2259c640 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c086fc0 0x55aa6c0de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d0c80 0x55aa6c0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 -- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d0c80 msgr2=0x55aa6c0cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d0c80 0x55aa6c0cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 -- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c086fc0 msgr2=0x55aa6c0de4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c086fc0 0x55aa6c0de4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 -- 172.21.15.133:0/2318828980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa6be815a0 con 0x55aa6c0d15a0 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d0c80 0x55aa6c0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e22d9d640 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d15a0 0x55aa6c0cf580 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c001e30 tx=0x7f0e1c012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96457ff800954b5f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e18ff9640 1 -- 172.21.15.133:0/2318828980 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c012e40 con 0x55aa6c0d15a0 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e18ff9640 1 -- 172.21.15.133:0/2318828980 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c003980 con 0x55aa6c0d15a0 2023-12-18T10:25:50.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e18ff9640 1 -- 172.21.15.133:0/2318828980 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c003d30 con 0x55aa6c0d15a0 2023-12-18T10:25:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2318828980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d15a0 msgr2=0x55aa6c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d15a0 0x55aa6c0cf580 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c001e30 tx=0x7f0e1c012690 comp rx=0 tx=0).stop 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2318828980 shutdown_connections 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d15a0 0x55aa6c0cf580 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c0d0c80 0x55aa6c0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2318828980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c086fc0 0x55aa6c0de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2318828980 >> 172.21.15.133:0/2318828980 conn(0x55aa6be85910 msgr2=0x55aa6c0dd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2318828980 shutdown_connections 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2318828980 wait complete. 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 -- start start 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.872+0000 7f0e2c12b000 1 Processor -- start 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 0x55aa6c111750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c111fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c1124e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa6c08bc10 con 0x55aa6c0d0c80 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa6bed3720 con 0x55aa6c0d15a0 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa6be94480 con 0x55aa6c086fc0 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 10 client.0 _ll_register_callbacks cb 0x55aa6be8d710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c111fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c111fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52482/0 (socket says 172.21.15.133:52482) 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 -- 172.21.15.133:0/2226660549 learned_addr learned my addr 172.21.15.133:0/2226660549 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2259c640 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 0x55aa6c111750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e22d9d640 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c1124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 -- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 msgr2=0x55aa6c111750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 0x55aa6c111750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 -- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 msgr2=0x55aa6c1124e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c1124e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 -- 172.21.15.133:0/2226660549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c001b10 con 0x55aa6c0d0c80 2023-12-18T10:25:50.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2259c640 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 0x55aa6c111750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e1bfff640 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c111fa0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c01ca80 tx=0x7f0e0c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7a95d5961f54eb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e017fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e017fa640 1 -- 172.21.15.133:0/2226660549 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c104040 con 0x55aa6c0d0c80 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e017fa640 1 -- 172.21.15.133:0/2226660549 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e0c0f76e0 con 0x55aa6c0d0c80 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2226660549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa6be9f6a0 con 0x55aa6c0d0c80 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e017fa640 1 -- 172.21.15.133:0/2226660549 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e0c10d250 con 0x55aa6c0d0c80 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 10 client.9330 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2226660549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55aa6be75110 con 0x55aa6c0d0c80 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e017fa640 1 -- 172.21.15.133:0/2226660549 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aa6be9f6a0 con 0x55aa6c0d0c80 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e017fa640 1 -- 172.21.15.133:0/2226660549 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0e0c0a8050 con 0x55aa6c0d0c80 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 10 client.9330 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 10 client.9330 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 20 client.9330 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55aa6c112a20 0x55aa6c112e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 4 client.9330 mds_command: new command op to 9048 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:25:50.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2226660549 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aa6becf3a0 con 0x55aa6c112a20 2023-12-18T10:25:50.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2259c640 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55aa6c112a20 0x55aa6c112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:50.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e017fa640 10 client.9330 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:50.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.876+0000 7f0e2259c640 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55aa6c112a20 0x55aa6c112e30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8c9e1bd391e05c server_cookie=24ed1c468202e90e in_seq=0 out_seq=0 2023-12-18T10:25:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e017fa640 1 -- 172.21.15.133:0/2226660549 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aa6becf3a0 con 0x55aa6c112a20 2023-12-18T10:25:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e017fa640 10 client.9330 handle_command_reply: tid=0 2023-12-18T10:25:50.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 client.9330 shutdown 2023-12-18T10:25:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2226660549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 msgr2=0x55aa6c111fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c111fa0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c01ca80 tx=0x7f0e0c009240 comp rx=0 tx=0).stop 2023-12-18T10:25:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2226660549 shutdown_connections 2023-12-18T10:25:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55aa6c112a20 0x55aa6c112e30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55aa6c0d15a0 0x55aa6c1124e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55aa6c0d0c80 0x55aa6c111fa0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 --2- 172.21.15.133:0/2226660549 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55aa6c086fc0 0x55aa6c111750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e017fa640 0 client.9330 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2226660549 >> 172.21.15.133:0/2226660549 conn(0x55aa6be85910 msgr2=0x55aa6c0ddc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2226660549 shutdown_connections 2023-12-18T10:25:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 1 -- 172.21.15.133:0/2226660549 wait complete. 2023-12-18T10:25:50.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.892+0000 7f0e2c12b000 20 client.9330 trim_cache size 0 max 16384 2023-12-18T10:25:50.897 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:50.898 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:25:50.898 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:25:50.898 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 -- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e04065a60 msgr2=0x7f0e04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e04065a60 0x7f0e04067f20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0e240c87b0 tx=0x7f0e14009190 comp rx=0 tx=0).stop 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 -- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e240ca410 msgr2=0x7f0e24154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e240ca410 0x7f0e24154b10 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0ac040 tx=0x7f0e0c0192b0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 -- 172.21.15.133:0/2082257665 shutdown_connections 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0e04065a60 0x7f0e04067f20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e24159fb0 0x7f0e240aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e240ca410 0x7f0e24154b10 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 --2- 172.21.15.133:0/2082257665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e24071db0 0x7f0e24151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 -- 172.21.15.133:0/2082257665 >> 172.21.15.133:0/2082257665 conn(0x7f0e2406a2a0 msgr2=0x7f0e241569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 -- 172.21.15.133:0/2082257665 shutdown_connections 2023-12-18T10:25:50.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:50.896+0000 7f0e28db3640 1 -- 172.21.15.133:0/2082257665 wait complete. 2023-12-18T10:25:50.914 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 flush journal 2023-12-18T10:25:51.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd2488b6640 1 Processor -- start 2023-12-18T10:25:51.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd2488b6640 1 -- start start 2023-12-18T10:25:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd2488b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244153020 0x7fd2440c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd2488b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2441598d0 0x7fd2440ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd2488b6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440c9730 con 0x7fd2440ce8d0 2023-12-18T10:25:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd2488b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2440ced60 con 0x7fd2441598d0 2023-12-18T10:25:51.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd2488b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440c8e00 con 0x7fd244153020 2023-12-18T10:25:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd23bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2441598d0 0x7fd2440ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd242d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd2440ce8d0 0x7fd244070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60834/0 (socket says 172.21.15.133:60834) 2023-12-18T10:25:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd242d9d640 1 -- 172.21.15.133:0/1321876511 learned_addr learned my addr 172.21.15.133:0/1321876511 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd24259c640 1 --2- 172.21.15.133:0/1321876511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244153020 0x7fd2440c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd23bfff640 1 -- 172.21.15.133:0/1321876511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244153020 msgr2=0x7fd2440c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd23bfff640 1 --2- 172.21.15.133:0/1321876511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244153020 0x7fd2440c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd23bfff640 1 -- 172.21.15.133:0/1321876511 >> v1:172.21.15.133:6789/0 conn(0x7fd2440ce8d0 legacy=0x7fd244070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd23bfff640 1 -- 172.21.15.133:0/1321876511 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2440c90e0 con 0x7fd2441598d0 2023-12-18T10:25:51.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.052+0000 7fd241d9b640 1 -- 172.21.15.133:0/1321876511 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305068016 0 0) 0x7fd2440c9730 con 0x7fd2440ce8d0 2023-12-18T10:25:51.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd23bfff640 1 --2- 172.21.15.133:0/1321876511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd2440ce390 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0097c0 tx=0x7fd22c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e86048ae711d8bc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd241d9b640 1 -- 172.21.15.133:0/1321876511 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0ab600 con 0x7fd2441598d0 2023-12-18T10:25:51.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd241d9b640 1 -- 172.21.15.133:0/1321876511 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c0a7050 con 0x7fd2441598d0 2023-12-18T10:25:51.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd241d9b640 1 -- 172.21.15.133:0/1321876511 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0ab980 con 0x7fd2441598d0 2023-12-18T10:25:51.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd2488b6640 1 -- 172.21.15.133:0/1321876511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 msgr2=0x7fd2440ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1321876511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd2440ce390 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0097c0 tx=0x7fd22c01c330 comp rx=0 tx=0).stop 2023-12-18T10:25:51.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd2488b6640 1 -- 172.21.15.133:0/1321876511 shutdown_connections 2023-12-18T10:25:51.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1321876511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd2440ce390 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1321876511 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd244153020 0x7fd2440c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd2488b6640 1 -- 172.21.15.133:0/1321876511 >> 172.21.15.133:0/1321876511 conn(0x7fd24406a2a0 msgr2=0x7fd2440aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd2488b6640 1 -- 172.21.15.133:0/1321876511 shutdown_connections 2023-12-18T10:25:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.056+0000 7fd2488b6640 1 -- 172.21.15.133:0/1321876511 wait complete. 2023-12-18T10:25:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 Processor -- start 2023-12-18T10:25:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 -- start start 2023-12-18T10:25:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2440ce8d0 0x7fd24415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd244153020 0x7fd2440c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd244152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd244151ff0 con 0x7fd2441598d0 2023-12-18T10:25:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440c86c0 con 0x7fd244153020 2023-12-18T10:25:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2441519a0 con 0x7fd2440ce8d0 2023-12-18T10:25:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd244152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd244152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52498/0 (socket says 172.21.15.133:52498) 2023-12-18T10:25:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 -- 172.21.15.133:0/1566343258 learned_addr learned my addr 172.21.15.133:0/1566343258 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd24259c640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2440ce8d0 0x7fd24415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd23bfff640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd244153020 0x7fd2440c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 -- 172.21.15.133:0/1566343258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2440ce8d0 msgr2=0x7fd24415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2440ce8d0 0x7fd24415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 -- 172.21.15.133:0/1566343258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd244153020 msgr2=0x7fd2440c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd244153020 0x7fd2440c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 -- 172.21.15.133:0/1566343258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c009420 con 0x7fd2441598d0 2023-12-18T10:25:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd242d9d640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd244152480 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c700 tx=0x7fd23c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd23affd640 1 -- 172.21.15.133:0/1566343258 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00ce10 con 0x7fd2441598d0 2023-12-18T10:25:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd23affd640 1 -- 172.21.15.133:0/1566343258 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00a640 con 0x7fd2441598d0 2023-12-18T10:25:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd23affd640 1 -- 172.21.15.133:0/1566343258 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00aa70 con 0x7fd2441598d0 2023-12-18T10:25:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 -- 172.21.15.133:0/1566343258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd244151c80 con 0x7fd2441598d0 2023-12-18T10:25:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.060+0000 7fd2488b6640 1 -- 172.21.15.133:0/1566343258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24415aa40 con 0x7fd2441598d0 2023-12-18T10:25:51.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.064+0000 7fd23affd640 1 -- 172.21.15.133:0/1566343258 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd23c00abd0 con 0x7fd2441598d0 2023-12-18T10:25:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.064+0000 7fd23affd640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd224065a90 0x7fd224067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.064+0000 7fd23affd640 1 -- 172.21.15.133:0/1566343258 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd23c082670 con 0x7fd2441598d0 2023-12-18T10:25:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.064+0000 7fd24259c640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd224065a90 0x7fd224067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.064+0000 7fd24bc11000 1 Processor -- start 2023-12-18T10:25:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- start start 2023-12-18T10:25:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd224065a90 0x7fd224067f50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd234009ac0 tx=0x7fd234009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 0x5597fa584a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5853a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597fa44d430 con 0x5597fa5cec80 2023-12-18T10:25:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597fa3db460 con 0x5597fa5cf5a0 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597fa3d8a30 con 0x5597fa584fc0 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52512/0 (socket says 172.21.15.133:52512) 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 -- 172.21.15.133:0/3042303384 learned_addr learned my addr 172.21.15.133:0/3042303384 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd242d9d640 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5853a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd23bfff640 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 0x5597fa584a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 -- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 msgr2=0x5597fa5853a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5853a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 -- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 msgr2=0x5597fa584a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 0x5597fa584a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 -- 172.21.15.133:0/3042303384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597fa0d0e20 con 0x5597fa5cec80 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd242d9d640 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5853a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:51.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24259c640 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cf060 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fd234006aa0 tx=0x7fd234014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2c6375b9ba83bd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd223fff640 1 -- 172.21.15.133:0/3042303384 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23401c040 con 0x5597fa5cec80 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd223fff640 1 -- 172.21.15.133:0/3042303384 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234003830 con 0x5597fa5cec80 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd223fff640 1 -- 172.21.15.133:0/3042303384 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234003ba0 con 0x5597fa5cec80 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- 172.21.15.133:0/3042303384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 msgr2=0x5597fa5cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cf060 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fd234006aa0 tx=0x7fd234014000 comp rx=0 tx=0).stop 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- 172.21.15.133:0/3042303384 shutdown_connections 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5853a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 0x5597fa584a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3042303384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cf060 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- 172.21.15.133:0/3042303384 >> 172.21.15.133:0/3042303384 conn(0x5597fa383910 msgr2=0x5597fa583360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- 172.21.15.133:0/3042303384 shutdown_connections 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- 172.21.15.133:0/3042303384 wait complete. 2023-12-18T10:25:51.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.068+0000 7fd24bc11000 1 -- start start 2023-12-18T10:25:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 Processor -- start 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cec80 0x5597fa5d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cf5a0 0x5597fa5d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597fa3d4320 con 0x5597fa5cf5a0 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597fa3734f0 con 0x5597fa5cec80 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597fa3916e0 con 0x5597fa584fc0 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 10 client.0 _ll_register_callbacks cb 0x5597fa570980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24259c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24259c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:35660/0 (socket says 172.21.15.133:35660) 2023-12-18T10:25:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24259c640 1 -- 172.21.15.133:0/1596658623 learned_addr learned my addr 172.21.15.133:0/1596658623 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd242d9d640 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cf5a0 0x5597fa5d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd23bfff640 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cec80 0x5597fa5d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd242d9d640 1 -- 172.21.15.133:0/1596658623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 msgr2=0x5597fa5cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd242d9d640 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd242d9d640 1 -- 172.21.15.133:0/1596658623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cec80 msgr2=0x5597fa5d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd242d9d640 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cec80 0x5597fa5d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd242d9d640 1 -- 172.21.15.133:0/1596658623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2340041a0 con 0x5597fa5cf5a0 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd242d9d640 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cf5a0 0x5597fa5d05e0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00a430 tx=0x7fd23c053500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e371ce62ff5d7f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd2217fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd2217fa640 1 -- 172.21.15.133:0/1596658623 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c05bad0 con 0x5597fa5cf5a0 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd2217fa640 1 -- 172.21.15.133:0/1596658623 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd23c05b640 con 0x5597fa5cf5a0 2023-12-18T10:25:51.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 -- 172.21.15.133:0/1596658623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597fa391120 con 0x5597fa5cf5a0 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd2217fa640 1 -- 172.21.15.133:0/1596658623 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd23c05b800 con 0x5597fa5cf5a0 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 10 client.9345 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 -- 172.21.15.133:0/1596658623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x5597fa399250 con 0x5597fa5cf5a0 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd2217fa640 1 -- 172.21.15.133:0/1596658623 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597fa391120 con 0x5597fa5cf5a0 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd2217fa640 1 -- 172.21.15.133:0/1596658623 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fd23c054b00 con 0x5597fa5cf5a0 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 10 client.9345 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 10 client.9345 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 20 client.9345 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x5597fa5de840 0x5597fa5e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 4 client.9345 mds_command: new command op to 9042 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24bc11000 1 -- 172.21.15.133:0/1596658623 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597fa3d2c70 con 0x5597fa5de840 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24259c640 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x5597fa5de840 0x5597fa5e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd24259c640 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x5597fa5de840 0x5597fa5e0c30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dab3f4b8ce42d94d server_cookie=eb614eaed5680f2a in_seq=0 out_seq=0 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.072+0000 7fd2217fa640 10 client.9345 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd2217fa640 1 -- 172.21.15.133:0/1596658623 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5597fa3d2c70 con 0x5597fa5de840 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd2217fa640 10 client.9345 handle_command_reply: tid=0 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 client.9345 shutdown 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 -- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cf5a0 msgr2=0x5597fa5d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cf5a0 0x5597fa5d05e0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00a430 tx=0x7fd23c053500 comp rx=0 tx=0).stop 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 -- 172.21.15.133:0/1596658623 shutdown_connections 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x5597fa5de840 0x5597fa5e0c30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cf5a0 0x5597fa5d05e0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cec80 0x5597fa5d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd2217fa640 0 client.9345 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 --2- 172.21.15.133:0/1596658623 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 -- 172.21.15.133:0/1596658623 >> 172.21.15.133:0/1596658623 conn(0x5597fa383910 msgr2=0x5597fa583a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 -- 172.21.15.133:0/1596658623 shutdown_connections 2023-12-18T10:25:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 1 -- 172.21.15.133:0/1596658623 wait complete. 2023-12-18T10:25:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.076+0000 7fd24bc11000 20 client.9345 trim_cache size 0 max 16384 2023-12-18T10:25:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24bc11000 1 Processor -- start 2023-12-18T10:25:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24bc11000 1 -- start start 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5e1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5e2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 0x5597fa5c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24bc11000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597fa091aa0 con 0x5597fa5cec80 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24bc11000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597fa3d1720 con 0x5597fa5cf5a0 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24bc11000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597fa48be50 con 0x5597fa584fc0 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5e2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52526/0 (socket says 172.21.15.133:52526) 2023-12-18T10:25:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 -- 172.21.15.133:0/3723223747 learned_addr learned my addr 172.21.15.133:0/3723223747 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd242d9d640 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 0x5597fa5c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd24259c640 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 -- 172.21.15.133:0/3723223747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 msgr2=0x5597fa5e1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5e1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 -- 172.21.15.133:0/3723223747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 msgr2=0x5597fa5c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 0x5597fa5c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 -- 172.21.15.133:0/3723223747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597fa37f5a0 con 0x5597fa5cec80 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd23bfff640 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5e2180 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000c10 tx=0x7fd22c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9946242332c788e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd238ff9640 1 -- 172.21.15.133:0/3723223747 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0bb070 con 0x5597fa5cec80 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd238ff9640 1 -- 172.21.15.133:0/3723223747 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c0ab670 con 0x5597fa5cec80 2023-12-18T10:25:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.088+0000 7fd238ff9640 1 -- 172.21.15.133:0/3723223747 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0aba00 con 0x5597fa5cec80 2023-12-18T10:25:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- 172.21.15.133:0/3723223747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 msgr2=0x5597fa5e2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5e2180 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000c10 tx=0x7fd22c004740 comp rx=0 tx=0).stop 2023-12-18T10:25:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- 172.21.15.133:0/3723223747 shutdown_connections 2023-12-18T10:25:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa5cf5a0 0x5597fa5c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5e2180 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3723223747 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa584fc0 0x5597fa5e1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- 172.21.15.133:0/3723223747 >> 172.21.15.133:0/3723223747 conn(0x5597fa383910 msgr2=0x5597fa58a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- 172.21.15.133:0/3723223747 shutdown_connections 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- 172.21.15.133:0/3723223747 wait complete. 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- start start 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 Processor -- start 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa584fc0 0x5597fa5cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa5cf5a0 0x5597fa5cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597fa4a3140 con 0x5597fa5cec80 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597fa392480 con 0x5597fa584fc0 2023-12-18T10:25:51.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597fa3cfc90 con 0x5597fa5cf5a0 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 10 client.0 _ll_register_callbacks cb 0x5597fa38b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52538/0 (socket says 172.21.15.133:52538) 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 -- 172.21.15.133:0/3483334545 learned_addr learned my addr 172.21.15.133:0/3483334545 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd242d9d640 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa5cf5a0 0x5597fa5cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24259c640 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa584fc0 0x5597fa5cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 -- 172.21.15.133:0/3483334545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa5cf5a0 msgr2=0x5597fa5cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa5cf5a0 0x5597fa5cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 -- 172.21.15.133:0/3483334545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa584fc0 msgr2=0x5597fa5cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa584fc0 0x5597fa5cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 -- 172.21.15.133:0/3483334545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440c90e0 con 0x5597fa5cec80 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd23bfff640 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cb730 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0b8040 tx=0x7fd22c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed415dbf87e1dd5b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd2217fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd2217fa640 1 -- 172.21.15.133:0/3483334545 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0c7450 con 0x5597fa5cec80 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd2217fa640 1 -- 172.21.15.133:0/3483334545 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd22c0c75b0 con 0x5597fa5cec80 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- 172.21.15.133:0/3483334545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597fa588940 con 0x5597fa5cec80 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd2217fa640 1 -- 172.21.15.133:0/3483334545 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd22c0c7770 con 0x5597fa5cec80 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 10 client.9351 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.092+0000 7fd24bc11000 1 -- 172.21.15.133:0/3483334545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x5597fa373110 con 0x5597fa5cec80 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd2217fa640 1 -- 172.21.15.133:0/3483334545 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5597fa588940 con 0x5597fa5cec80 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd2217fa640 1 -- 172.21.15.133:0/3483334545 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fd22c0c78d0 con 0x5597fa5cec80 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd24bc11000 10 client.9351 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd24bc11000 10 client.9351 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd24bc11000 20 client.9351 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x5597fa629160 0x5597fa5cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd24bc11000 4 client.9351 mds_command: new command op to 9042 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:25:51.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd24bc11000 1 -- 172.21.15.133:0/3483334545 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5597fa39d6a0 con 0x5597fa629160 2023-12-18T10:25:51.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd24259c640 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x5597fa629160 0x5597fa5cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd24259c640 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x5597fa629160 0x5597fa5cc1b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e5da027500534c7 server_cookie=4b3f3aff1b78de7e in_seq=0 out_seq=0 2023-12-18T10:25:51.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.096+0000 7fd2217fa640 10 client.9351 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2217fa640 1 -- 172.21.15.133:0/3483334545 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5597fa39d6a0 con 0x5597fa629160 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2217fa640 10 client.9351 handle_command_reply: tid=0 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 client.9351 shutdown 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 -- 172.21.15.133:0/3483334545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 msgr2=0x5597fa5cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cb730 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0b8040 tx=0x7fd22c01ab70 comp rx=0 tx=0).stop 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 -- 172.21.15.133:0/3483334545 shutdown_connections 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x5597fa629160 0x5597fa5cc1b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5597fa5cf5a0 0x5597fa5cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5597fa5cec80 0x5597fa5cb730 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2217fa640 0 client.9351 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 --2- 172.21.15.133:0/3483334545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5597fa584fc0 0x5597fa5cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 -- 172.21.15.133:0/3483334545 >> 172.21.15.133:0/3483334545 conn(0x5597fa383910 msgr2=0x5597fa5e0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 -- 172.21.15.133:0/3483334545 shutdown_connections 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 1 -- 172.21.15.133:0/3483334545 wait complete. 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd24bc11000 20 client.9351 trim_cache size 0 max 16384 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:25:51.107 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 -- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd224065a90 msgr2=0x7fd224067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd224065a90 0x7fd224067f50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd234009ac0 tx=0x7fd234009190 comp rx=0 tx=0).stop 2023-12-18T10:25:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 -- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 msgr2=0x7fd244152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd244152480 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00c700 tx=0x7fd23c00cbc0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 -- 172.21.15.133:0/1566343258 shutdown_connections 2023-12-18T10:25:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd224065a90 0x7fd224067f50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2441598d0 0x7fd244152480 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd244153020 0x7fd2440c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 --2- 172.21.15.133:0/1566343258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2440ce8d0 0x7fd24415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 -- 172.21.15.133:0/1566343258 >> 172.21.15.133:0/1566343258 conn(0x7fd24406a2a0 msgr2=0x7fd2440cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 -- 172.21.15.133:0/1566343258 shutdown_connections 2023-12-18T10:25:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.104+0000 7fd2488b6640 1 -- 172.21.15.133:0/1566343258 wait complete. 2023-12-18T10:25:51.125 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 flush journal 2023-12-18T10:25:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.264+0000 7fd43d798640 1 Processor -- start 2023-12-18T10:25:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.264+0000 7fd43d798640 1 -- start start 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd43d798640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd43815c910 0x7fd438161240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd43d798640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd43806afc0 0x7fd4380ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd43d798640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43815ccf0 0x7fd4380b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd43d798640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4380ce700 con 0x7fd43806afc0 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd43d798640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4380cad80 con 0x7fd43815c910 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd43d798640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4380cb020 con 0x7fd43815ccf0 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd43806afc0 0x7fd4380ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd43806afc0 0x7fd4380ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52542/0 (socket says 172.21.15.133:52542) 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 -- 172.21.15.133:0/2949418959 learned_addr learned my addr 172.21.15.133:0/2949418959 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 -- 172.21.15.133:0/2949418959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43815ccf0 msgr2=0x7fd4380b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/2949418959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43815ccf0 0x7fd4380b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 -- 172.21.15.133:0/2949418959 >> v2:172.21.15.142:3300/0 conn(0x7fd43815c910 msgr2=0x7fd438161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/2949418959 >> v2:172.21.15.142:3300/0 conn(0x7fd43815c910 0x7fd438161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 -- 172.21.15.133:0/2949418959 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4380cf1d0 con 0x7fd43806afc0 2023-12-18T10:25:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/2949418959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43806afc0 0x7fd4380ce1c0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fd4380d1620 tx=0x7fd42001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc69b22e8ce8eeb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd4367fc640 1 -- 172.21.15.133:0/2949418959 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200ac600 con 0x7fd43806afc0 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd4367fc640 1 -- 172.21.15.133:0/2949418959 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4200a8050 con 0x7fd43806afc0 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.268+0000 7fd4367fc640 1 -- 172.21.15.133:0/2949418959 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200ac980 con 0x7fd43806afc0 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- 172.21.15.133:0/2949418959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43806afc0 msgr2=0x7fd4380ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 --2- 172.21.15.133:0/2949418959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43806afc0 0x7fd4380ce1c0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fd4380d1620 tx=0x7fd42001c4d0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- 172.21.15.133:0/2949418959 shutdown_connections 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 --2- 172.21.15.133:0/2949418959 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43815ccf0 0x7fd4380b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 --2- 172.21.15.133:0/2949418959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43806afc0 0x7fd4380ce1c0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 --2- 172.21.15.133:0/2949418959 >> v2:172.21.15.142:3300/0 conn(0x7fd43815c910 0x7fd438161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- 172.21.15.133:0/2949418959 >> 172.21.15.133:0/2949418959 conn(0x7fd4380cd070 msgr2=0x7fd4380cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- 172.21.15.133:0/2949418959 shutdown_connections 2023-12-18T10:25:51.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- 172.21.15.133:0/2949418959 wait complete. 2023-12-18T10:25:51.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 Processor -- start 2023-12-18T10:25:51.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- start start 2023-12-18T10:25:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806afc0 0x7fd438156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43815c910 0x7fd43815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43815ccf0 0x7fd43815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd438157c10 con 0x7fd43815c910 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd438157090 con 0x7fd43815ccf0 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd43d798640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd438157370 con 0x7fd43806afc0 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd42e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43815c910 0x7fd43815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd42e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43815c910 0x7fd43815b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52544/0 (socket says 172.21.15.133:52544) 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd42e7fc640 1 -- 172.21.15.133:0/3776332653 learned_addr learned my addr 172.21.15.133:0/3776332653 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.272+0000 7fd4377fe640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43815ccf0 0x7fd43815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd436ffd640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806afc0 0x7fd438156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42e7fc640 1 -- 172.21.15.133:0/3776332653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806afc0 msgr2=0x7fd438156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806afc0 0x7fd438156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42e7fc640 1 -- 172.21.15.133:0/3776332653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43815ccf0 msgr2=0x7fd43815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43815ccf0 0x7fd43815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42e7fc640 1 -- 172.21.15.133:0/3776332653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200094d0 con 0x7fd43815c910 2023-12-18T10:25:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43815c910 0x7fd43815b4c0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fd42001ab80 tx=0x7fd42001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42ffff640 1 -- 172.21.15.133:0/3776332653 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200b7620 con 0x7fd43815c910 2023-12-18T10:25:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42ffff640 1 -- 172.21.15.133:0/3776332653 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4200b7780 con 0x7fd43815c910 2023-12-18T10:25:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd43d798640 1 -- 172.21.15.133:0/3776332653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd438157650 con 0x7fd43815c910 2023-12-18T10:25:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42ffff640 1 -- 172.21.15.133:0/3776332653 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4200b7af0 con 0x7fd43815c910 2023-12-18T10:25:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd43d798640 1 -- 172.21.15.133:0/3776332653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd438156c80 con 0x7fd43815c910 2023-12-18T10:25:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42ffff640 1 -- 172.21.15.133:0/3776332653 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd4200b3040 con 0x7fd43815c910 2023-12-18T10:25:51.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.276+0000 7fd42ffff640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd418065a60 0x7fd418067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd42ffff640 1 -- 172.21.15.133:0/3776332653 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd42011d490 con 0x7fd43815c910 2023-12-18T10:25:51.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd436ffd640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd418065a60 0x7fd418067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 Processor -- start 2023-12-18T10:25:51.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd436ffd640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd418065a60 0x7fd418067f20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd42800a400 tx=0x7fd42800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- start start 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ebe060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392ebe5a0 0x55c392e73a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392e73fc0 0x55c392e743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c392d3c430 con 0x55c392e73fc0 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c392cca460 con 0x55c392ebdc80 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c392cc7a30 con 0x55c392ebe5a0 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392e73fc0 0x55c392e743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392e73fc0 0x55c392e743a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52554/0 (socket says 172.21.15.133:52554) 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 -- 172.21.15.133:0/114786425 learned_addr learned my addr 172.21.15.133:0/114786425 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd436ffd640 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ebe060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392ebe5a0 0x55c392e73a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 -- 172.21.15.133:0/114786425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392ebe5a0 msgr2=0x55c392e73a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392ebe5a0 0x55c392e73a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 -- 172.21.15.133:0/114786425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 msgr2=0x55c392ebe060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ebe060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 -- 172.21.15.133:0/114786425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3929bfe20 con 0x55c392e73fc0 2023-12-18T10:25:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd4377fe640 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392e73fc0 0x55c392e743a0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fd430009920 tx=0x7fd430009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93827d4fe9da8bfa server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd42cff9640 1 -- 172.21.15.133:0/114786425 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300093f0 con 0x55c392e73fc0 2023-12-18T10:25:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd42cff9640 1 -- 172.21.15.133:0/114786425 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43000ea80 con 0x55c392e73fc0 2023-12-18T10:25:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd42cff9640 1 -- 172.21.15.133:0/114786425 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43000edf0 con 0x55c392e73fc0 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- 172.21.15.133:0/114786425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392e73fc0 msgr2=0x55c392e743a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392e73fc0 0x55c392e743a0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fd430009920 tx=0x7fd430009de0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- 172.21.15.133:0/114786425 shutdown_connections 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392e73fc0 0x55c392e743a0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392ebe5a0 0x55c392e73a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 --2- 172.21.15.133:0/114786425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ebe060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- 172.21.15.133:0/114786425 >> 172.21.15.133:0/114786425 conn(0x55c392c72910 msgr2=0x55c392e72360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- 172.21.15.133:0/114786425 shutdown_connections 2023-12-18T10:25:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.280+0000 7fd440af8000 1 -- 172.21.15.133:0/114786425 wait complete. 2023-12-18T10:25:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 -- start start 2023-12-18T10:25:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 Processor -- start 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392e73fc0 0x55c392ec51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ec5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ebe5a0 0x55c392e7ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c392cc3320 con 0x55c392ebe5a0 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c392c624f0 con 0x55c392ebdc80 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c392c806e0 con 0x55c392e73fc0 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 10 client.0 _ll_register_callbacks cb 0x55c392e5f980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd4377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ebe5a0 0x55c392e7ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd436ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392e73fc0 0x55c392ec51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd42e7fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ec5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd4377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ebe5a0 0x55c392e7ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52556/0 (socket says 172.21.15.133:52556) 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd4377fe640 1 -- 172.21.15.133:0/736728051 learned_addr learned my addr 172.21.15.133:0/736728051 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd42e7fc640 1 -- 172.21.15.133:0/736728051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392e73fc0 msgr2=0x55c392ec51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392e73fc0 0x55c392ec51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd42e7fc640 1 -- 172.21.15.133:0/736728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ebe5a0 msgr2=0x55c392e7ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ebe5a0 0x55c392e7ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd42e7fc640 1 -- 172.21.15.133:0/736728051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd430009550 con 0x55c392ebdc80 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd4377fe640 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ebe5a0 0x55c392e7ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ec5700 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd42001cd70 tx=0x7fd4200eeb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3013c6b00467caa server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd415ffb640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd415ffb640 1 -- 172.21.15.133:0/736728051 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42011d2b0 con 0x55c392ebdc80 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd415ffb640 1 -- 172.21.15.133:0/736728051 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd4200eecb0 con 0x55c392ebdc80 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 -- 172.21.15.133:0/736728051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c392c80120 con 0x55c392ebdc80 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd415ffb640 1 -- 172.21.15.133:0/736728051 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4200eee70 con 0x55c392ebdc80 2023-12-18T10:25:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 10 client.8674 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 -- 172.21.15.133:0/736728051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55c392c88250 con 0x55c392ebdc80 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd415ffb640 1 -- 172.21.15.133:0/736728051 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c392c80120 con 0x55c392ebdc80 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd415ffb640 1 -- 172.21.15.133:0/736728051 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fd4200edf40 con 0x55c392ebdc80 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 10 client.8674 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 10 client.8674 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 20 client.8674 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c392e7fbc0 0x55c392e7ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 4 client.8674 mds_command: new command op to 9039 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd440af8000 1 -- 172.21.15.133:0/736728051 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c392cc1c70 con 0x55c392e7fbc0 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.284+0000 7fd436ffd640 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c392e7fbc0 0x55c392e7ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd436ffd640 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c392e7fbc0 0x55c392e7ffa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3670db81fcf3b4b8 server_cookie=93d6e16c317a120e in_seq=0 out_seq=0 2023-12-18T10:25:51.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd415ffb640 10 client.8674 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:51.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd415ffb640 1 -- 172.21.15.133:0/736728051 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c392cc1c70 con 0x55c392e7fbc0 2023-12-18T10:25:51.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd415ffb640 10 client.8674 handle_command_reply: tid=0 2023-12-18T10:25:51.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 client.8674 shutdown 2023-12-18T10:25:51.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 -- 172.21.15.133:0/736728051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 msgr2=0x55c392ec5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ec5700 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd42001cd70 tx=0x7fd4200eeb10 comp rx=0 tx=0).stop 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 -- 172.21.15.133:0/736728051 shutdown_connections 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c392e7fbc0 0x55c392e7ffa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ebe5a0 0x55c392e7ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392ebdc80 0x55c392ec5700 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 --2- 172.21.15.133:0/736728051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392e73fc0 0x55c392ec51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd415ffb640 0 client.8674 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 -- 172.21.15.133:0/736728051 >> 172.21.15.133:0/736728051 conn(0x55c392c72910 msgr2=0x55c392e72a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 -- 172.21.15.133:0/736728051 shutdown_connections 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 1 -- 172.21.15.133:0/736728051 wait complete. 2023-12-18T10:25:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.288+0000 7fd440af8000 20 client.8674 trim_cache size 0 max 16384 2023-12-18T10:25:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd440af8000 1 Processor -- start 2023-12-18T10:25:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd440af8000 1 -- start start 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd440af8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd440af8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 0x55c392ebd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd440af8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 0x55c392ec19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd440af8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c392980aa0 con 0x55c392ec49f0 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd440af8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c392cbec90 con 0x55c392e73fc0 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd440af8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c392ecb240 con 0x55c392c72910 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52560/0 (socket says 172.21.15.133:52560) 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 -- 172.21.15.133:0/3940124033 learned_addr learned my addr 172.21.15.133:0/3940124033 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 -- 172.21.15.133:0/3940124033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 msgr2=0x55c392ebd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 --2- 172.21.15.133:0/3940124033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 0x55c392ebd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 -- 172.21.15.133:0/3940124033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 msgr2=0x55c392ec19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 --2- 172.21.15.133:0/3940124033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 0x55c392ec19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 -- 172.21.15.133:0/3940124033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c392c6e5a0 con 0x55c392ec49f0 2023-12-18T10:25:51.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd436ffd640 1 --2- 172.21.15.133:0/3940124033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebd1b0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fd42800ac90 tx=0x7fd428011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed5a4977cfef1d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd42d7fa640 1 -- 172.21.15.133:0/3940124033 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428010040 con 0x55c392ec49f0 2023-12-18T10:25:51.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd42d7fa640 1 -- 172.21.15.133:0/3940124033 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42801c040 con 0x55c392ec49f0 2023-12-18T10:25:51.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.300+0000 7fd42d7fa640 1 -- 172.21.15.133:0/3940124033 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd428024d50 con 0x55c392ec49f0 2023-12-18T10:25:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- 172.21.15.133:0/3940124033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 msgr2=0x55c392ebd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 --2- 172.21.15.133:0/3940124033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebd1b0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fd42800ac90 tx=0x7fd428011000 comp rx=0 tx=0).stop 2023-12-18T10:25:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- 172.21.15.133:0/3940124033 shutdown_connections 2023-12-18T10:25:51.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 --2- 172.21.15.133:0/3940124033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 0x55c392ec19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 --2- 172.21.15.133:0/3940124033 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 0x55c392ebd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 --2- 172.21.15.133:0/3940124033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebd1b0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- 172.21.15.133:0/3940124033 >> 172.21.15.133:0/3940124033 conn(0x55c392ec4470 msgr2=0x55c392e79190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- 172.21.15.133:0/3940124033 shutdown_connections 2023-12-18T10:25:51.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- 172.21.15.133:0/3940124033 wait complete. 2023-12-18T10:25:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- start start 2023-12-18T10:25:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 Processor -- start 2023-12-18T10:25:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 0x55c392f17940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 0x55c392eba660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c392cc0b30 con 0x55c392ec49f0 2023-12-18T10:25:51.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c392ec4100 con 0x55c392e73fc0 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c392e79fa0 con 0x55c392c72910 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 10 client.0 _ll_register_callbacks cb 0x55c392c7a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52562/0 (socket says 172.21.15.133:52562) 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 -- 172.21.15.133:0/2478457004 learned_addr learned my addr 172.21.15.133:0/2478457004 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 0x55c392eba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd436ffd640 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 0x55c392f17940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 -- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 msgr2=0x55c392f17940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 0x55c392f17940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 -- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 msgr2=0x55c392eba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:51.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 0x55c392eba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 -- 172.21.15.133:0/2478457004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c392c62110 con 0x55c392ec49f0 2023-12-18T10:25:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd42e7fc640 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 0x55c392eba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd4377fe640 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebaba0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd43000e5a0 tx=0x7fd4300046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922fbd58afb573d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd415ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd415ffb640 1 -- 172.21.15.133:0/2478457004 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430009280 con 0x55c392ec49f0 2023-12-18T10:25:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd415ffb640 1 -- 172.21.15.133:0/2478457004 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd430013bd0 con 0x55c392ec49f0 2023-12-18T10:25:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- 172.21.15.133:0/2478457004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c392e778e0 con 0x55c392ec49f0 2023-12-18T10:25:51.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd415ffb640 1 -- 172.21.15.133:0/2478457004 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4300093e0 con 0x55c392ec49f0 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 10 client.9369 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.304+0000 7fd440af8000 1 -- 172.21.15.133:0/2478457004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55c392bf0e50 con 0x55c392ec49f0 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd415ffb640 1 -- 172.21.15.133:0/2478457004 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c392e778e0 con 0x55c392ec49f0 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd415ffb640 1 -- 172.21.15.133:0/2478457004 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fd430011070 con 0x55c392ec49f0 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd440af8000 10 client.9369 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd440af8000 10 client.9369 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd440af8000 20 client.9369 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd440af8000 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c392ebdc80 0x55c392ebb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd440af8000 4 client.9369 mds_command: new command op to 9039 tid=0[{"prefix": "flush journal"}] 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd440af8000 1 -- 172.21.15.133:0/2478457004 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c392c8c6a0 con 0x55c392ebdc80 2023-12-18T10:25:51.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd436ffd640 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c392ebdc80 0x55c392ebb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd436ffd640 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c392ebdc80 0x55c392ebb0e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8490ae3c5afd64dd server_cookie=8761a5da1a1ad56d in_seq=0 out_seq=0 2023-12-18T10:25:51.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.308+0000 7fd415ffb640 10 client.9369 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:51.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.316+0000 7fd415ffb640 1 -- 172.21.15.133:0/2478457004 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c392c8c6a0 con 0x55c392ebdc80 2023-12-18T10:25:51.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.316+0000 7fd415ffb640 10 client.9369 handle_command_reply: tid=0 2023-12-18T10:25:51.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.316+0000 7fd440af8000 1 client.9369 shutdown 2023-12-18T10:25:51.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.316+0000 7fd440af8000 1 -- 172.21.15.133:0/2478457004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 msgr2=0x55c392ebaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.316+0000 7fd440af8000 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebaba0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd43000e5a0 tx=0x7fd4300046d0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 1 -- 172.21.15.133:0/2478457004 shutdown_connections 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c392ebdc80 0x55c392ebb0e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c392ec49f0 0x55c392ebaba0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c392e73fc0 0x55c392eba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 1 --2- 172.21.15.133:0/2478457004 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c392c72910 0x55c392f17940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd415ffb640 0 client.9369 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 1 -- 172.21.15.133:0/2478457004 >> 172.21.15.133:0/2478457004 conn(0x55c392ec4470 msgr2=0x55c392e79890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 1 -- 172.21.15.133:0/2478457004 shutdown_connections 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 1 -- 172.21.15.133:0/2478457004 wait complete. 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd440af8000 20 client.9369 trim_cache size 0 max 16384 2023-12-18T10:25:51.320 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "", 2023-12-18T10:25:51.321 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:25:51.321 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 -- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd418065a60 msgr2=0x7fd418067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd418065a60 0x7fd418067f20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd42800a400 tx=0x7fd42800d040 comp rx=0 tx=0).stop 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 -- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43815c910 msgr2=0x7fd43815b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43815c910 0x7fd43815b4c0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fd42001ab80 tx=0x7fd42001ad10 comp rx=0 tx=0).stop 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 -- 172.21.15.133:0/3776332653 shutdown_connections 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd418065a60 0x7fd418067f20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43815ccf0 0x7fd43815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43815c910 0x7fd43815b4c0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 --2- 172.21.15.133:0/3776332653 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43806afc0 0x7fd438156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:51.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 -- 172.21.15.133:0/3776332653 >> 172.21.15.133:0/3776332653 conn(0x7fd4380cd070 msgr2=0x7fd43815fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 -- 172.21.15.133:0/3776332653 shutdown_connections 2023-12-18T10:25:51.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:51.320+0000 7fd43d798640 1 -- 172.21.15.133:0/3776332653 wait complete. 2023-12-18T10:25:51.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:25:51.339 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2023-12-18T10:25:51.374 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/ 2023-12-18T10:25:51.374 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4 2023-12-18T10:25:51.374 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5 2023-12-18T10:25:51.374 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6 2023-12-18T10:25:51.374 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7 2023-12-18T10:25:51.374 INFO:teuthology.orchestra.run.smithi133.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2023-12-18T10:25:51.375 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:25:51.375 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:25:51.375 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:25:51.376 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:51.376 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2023-12-18T10:25:51.376 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:25:51.482 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627778 2023-12-18T10:25:51.672 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:25:51.672 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:25:51.672 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:25:51.672 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:51.672 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2023-12-18T10:25:51.672 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:25:51.779 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627779 2023-12-18T10:25:51.968 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:25:51.968 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:25:51.968 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:25:51.968 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:51.968 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2023-12-18T10:25:51.968 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:25:52.079 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627780 2023-12-18T10:25:52.268 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:25:52.268 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:25:52.268 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:25:52.268 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:52.268 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2023-12-18T10:25:52.268 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:25:52.374 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627781 2023-12-18T10:25:52.563 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:25:52.564 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:25:52.564 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:25:52.564 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:52.564 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2023-12-18T10:25:52.564 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:25:52.674 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627782 2023-12-18T10:25:52.863 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-18T10:25:52.863 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-18T10:25:52.863 DEBUG:teuthology.orchestra.run.smithi133:> import stat 2023-12-18T10:25:52.863 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-18T10:25:52.863 DEBUG:teuthology.orchestra.run.smithi133:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2023-12-18T10:25:52.863 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-18T10:25:52.976 INFO:teuthology.orchestra.run.smithi133.stdout:1099511627783 2023-12-18T10:25:53.164 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2023-12-18T10:25:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d24785080 1 Processor -- start 2023-12-18T10:25:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d24785080 1 -- start start 2023-12-18T10:25:53.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d24785080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592bc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d24785080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 0x556d592b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d24785080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 0x556d592bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d24785080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d5912d4d0 con 0x556d59213490 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d24785080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d5912d1d0 con 0x556d59216000 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d24785080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d59123e40 con 0x556d59213870 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d2229f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592bc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d2229f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592bc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52576/0 (socket says 172.21.15.133:52576) 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.252+0000 7f7d2229f640 1 -- 172.21.15.133:0/2570012423 learned_addr learned my addr 172.21.15.133:0/2570012423 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d21a9e640 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 0x556d592b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d22aa0640 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 0x556d592bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 -- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 msgr2=0x556d592b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 0x556d592b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 -- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 msgr2=0x556d592bac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 0x556d592bac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 -- 172.21.15.133:0/2570012423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d18005df0 con 0x556d59213490 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d21a9e640 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 0x556d592b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592bc8d0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a700 tx=0x7f7d1400abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100984a881a2e44f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d20a9c640 1 -- 172.21.15.133:0/2570012423 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400f070 con 0x556d59213490 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d20a9c640 1 -- 172.21.15.133:0/2570012423 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1400ae10 con 0x556d59213490 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d20a9c640 1 -- 172.21.15.133:0/2570012423 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14008bb0 con 0x556d59213490 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- 172.21.15.133:0/2570012423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 msgr2=0x556d592bc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592bc8d0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a700 tx=0x7f7d1400abc0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- 172.21.15.133:0/2570012423 shutdown_connections 2023-12-18T10:25:53.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 0x556d592bac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 0x556d592b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 --2- 172.21.15.133:0/2570012423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592bc8d0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- 172.21.15.133:0/2570012423 >> 172.21.15.133:0/2570012423 conn(0x556d59211e00 msgr2=0x556d592bfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- 172.21.15.133:0/2570012423 shutdown_connections 2023-12-18T10:25:53.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- 172.21.15.133:0/2570012423 wait complete. 2023-12-18T10:25:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 Processor -- start 2023-12-18T10:25:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- start start 2023-12-18T10:25:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 0x556d592b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 0x556d591e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d592b7cf0 con 0x556d59213490 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d592b7f90 con 0x556d59216000 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d24785080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d592b8230 con 0x556d59213870 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52582/0 (socket says 172.21.15.133:52582) 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 -- 172.21.15.133:0/1367766209 learned_addr learned my addr 172.21.15.133:0/1367766209 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 -- 172.21.15.133:0/1367766209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 msgr2=0x556d592b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d21a9e640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 0x556d592b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d22aa0640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 0x556d591e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x556d59213870 0x556d592b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 -- 172.21.15.133:0/1367766209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 msgr2=0x556d591e96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 0x556d591e96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d2229f640 1 -- 172.21.15.133:0/1367766209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1400a430 con 0x556d59213490 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.256+0000 7f7d22aa0640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d59216000 0x556d591e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d2229f640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592b73e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f7d140087e0 tx=0x7f7d14003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d137fe640 1 -- 172.21.15.133:0/1367766209 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d140158b0 con 0x556d59213490 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d137fe640 1 -- 172.21.15.133:0/1367766209 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d14015a30 con 0x556d59213490 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d137fe640 1 -- 172.21.15.133:0/1367766209 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14015de0 con 0x556d59213490 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d5913c070 con 0x556d59213490 2023-12-18T10:25:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d5912f4b0 con 0x556d59213490 2023-12-18T10:25:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d137fe640 1 -- 172.21.15.133:0/1367766209 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d1401c070 con 0x556d59213490 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d137fe640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d04064440 0x7f7d04066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d137fe640 1 -- 172.21.15.133:0/1367766209 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d14083c20 con 0x556d59213490 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d21a9e640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d04064440 0x7f7d04066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d24785080 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x556d591eaaf0 0x556d5922c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 --> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] -- osd_op(unknown.0.0:1 15.12 15:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x556d592b2d60 con 0x556d591eaaf0 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.260+0000 7f7d22aa0640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x556d591eaaf0 0x556d5922c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d21a9e640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d04064440 0x7f7d04066900 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7d180ac000 tx=0x7f7d180a5000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d22aa0640 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x556d591eaaf0 0x556d5922c040 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d22aa0640 1 -- 172.21.15.133:0/1367766209 <== osd.3 v2:172.21.15.133:6824/38188 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v107'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f7d1c00e1d0 con 0x556d591eaaf0 2023-12-18T10:25:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x556d591eaaf0 msgr2=0x556d5922c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x556d591eaaf0 0x556d5922c040 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d04064440 msgr2=0x7f7d04066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d04064440 0x7f7d04066900 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7d180ac000 tx=0x7f7d180a5000 comp rx=0 tx=0).stop 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 msgr2=0x556d592b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 --2- 172.21.15.133:0/1367766209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556d59213490 0x556d592b73e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f7d140087e0 tx=0x7f7d14003030 comp rx=0 tx=0).stop 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d22aa0640 1 -- 172.21.15.133:0/1367766209 reap_dead start 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 shutdown_connections 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 >> 172.21.15.133:0/1367766209 conn(0x556d59211e00 msgr2=0x556d591e59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 shutdown_connections 2023-12-18T10:25:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.264+0000 7f7d24785080 1 -- 172.21.15.133:0/1367766209 wait complete. 2023-12-18T10:25:53.270 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2023-12-18T10:25:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 Processor -- start 2023-12-18T10:25:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- start start 2023-12-18T10:25:53.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef88245f0 0x55cef88c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef883ea30 0x55cef88c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef873b1d0 con 0x55cef8824210 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef8731e40 con 0x55cef88245f0 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cef8826140 con 0x55cef883ea30 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52592/0 (socket says 172.21.15.133:52592) 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 -- 172.21.15.133:0/1868147301 learned_addr learned my addr 172.21.15.133:0/1868147301 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f5810bf9640 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef88245f0 0x55cef88c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f5811bfb640 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef883ea30 0x55cef88c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 -- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef883ea30 msgr2=0x55cef88c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef883ea30 0x55cef88c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 -- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef88245f0 msgr2=0x55cef88c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef88245f0 0x55cef88c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 -- 172.21.15.133:0/1868147301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c00a1c0 con 0x55cef8824210 2023-12-18T10:25:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f5810bf9640 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef88245f0 0x55cef88c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58113fa640 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88c9e30 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f580400a7e0 tx=0x7f580400aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c35e69edcad7d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58037fe640 1 -- 172.21.15.133:0/1868147301 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580400f070 con 0x55cef8824210 2023-12-18T10:25:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58037fe640 1 -- 172.21.15.133:0/1868147301 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804008cc0 con 0x55cef8824210 2023-12-18T10:25:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58037fe640 1 -- 172.21.15.133:0/1868147301 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804013670 con 0x55cef8824210 2023-12-18T10:25:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- 172.21.15.133:0/1868147301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 msgr2=0x55cef88c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88c9e30 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f580400a7e0 tx=0x7f580400aca0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- 172.21.15.133:0/1868147301 shutdown_connections 2023-12-18T10:25:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef883ea30 0x55cef88c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef88245f0 0x55cef88c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 --2- 172.21.15.133:0/1868147301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88c9e30 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- 172.21.15.133:0/1868147301 >> 172.21.15.133:0/1868147301 conn(0x55cef87f2b50 msgr2=0x55cef8825100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- 172.21.15.133:0/1868147301 shutdown_connections 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 -- 172.21.15.133:0/1868147301 wait complete. 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.316+0000 7f58138e0080 1 Processor -- start 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 -- start start 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef88245f0 0x55cef883b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef883ea30 0x55cef883b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef883c8a0 con 0x55cef8824210 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef883c0c0 con 0x55cef883ea30 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cef883c360 con 0x55cef88245f0 2023-12-18T10:25:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52602/0 (socket says 172.21.15.133:52602) 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 -- 172.21.15.133:0/3653754904 learned_addr learned my addr 172.21.15.133:0/3653754904 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f5810bf9640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef88245f0 0x55cef883b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f5811bfb640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef883ea30 0x55cef883b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 -- 172.21.15.133:0/3653754904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef88245f0 msgr2=0x55cef883b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55cef88245f0 0x55cef883b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 -- 172.21.15.133:0/3653754904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef883ea30 msgr2=0x55cef883b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cef883ea30 0x55cef883b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 -- 172.21.15.133:0/3653754904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580400a430 con 0x55cef8824210 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58113fa640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88385e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5804016040 tx=0x7f5804003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58027fc640 1 -- 172.21.15.133:0/3653754904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580401d610 con 0x55cef8824210 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58027fc640 1 -- 172.21.15.133:0/3653754904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580401d770 con 0x55cef8824210 2023-12-18T10:25:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cef8764210 con 0x55cef8824210 2023-12-18T10:25:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58027fc640 1 -- 172.21.15.133:0/3653754904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580401db00 con 0x55cef8824210 2023-12-18T10:25:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.320+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cef874a070 con 0x55cef8824210 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f58027fc640 1 -- 172.21.15.133:0/3653754904 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f580401a050 con 0x55cef8824210 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f58027fc640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57f4064440 0x7f57f4066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f58027fc640 1 -- 172.21.15.133:0/3653754904 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5804083a80 con 0x55cef8824210 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f5810bf9640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57f4064440 0x7f57f4066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f58138e0080 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x55cef8838b20 0x55cef8964c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 --> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] -- osd_op(unknown.0.0:1 15.12 15:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x55cef8950200 con 0x55cef8838b20 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f5811bfb640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x55cef8838b20 0x55cef8964c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f5810bf9640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57f4064440 0x7f57f4066900 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5808009730 tx=0x7f5808005ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f5811bfb640 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x55cef8838b20 0x55cef8964c50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.324+0000 7f5811bfb640 1 -- 172.21.15.133:0/3653754904 <== osd.3 v2:172.21.15.133:6824/38188 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v107'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f580c0a8600 con 0x55cef8838b20 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x55cef8838b20 msgr2=0x55cef8964c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x55cef8838b20 0x55cef8964c50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57f4064440 msgr2=0x7f57f4066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f57f4064440 0x7f57f4066900 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5808009730 tx=0x7f5808005ac0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 msgr2=0x55cef88385e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 --2- 172.21.15.133:0/3653754904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55cef8824210 0x55cef88385e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5804016040 tx=0x7f5804003030 comp rx=0 tx=0).stop 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f5811bfb640 1 -- 172.21.15.133:0/3653754904 reap_dead start 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 shutdown_connections 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 >> 172.21.15.133:0/3653754904 conn(0x55cef87f2b50 msgr2=0x55cef8825100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 shutdown_connections 2023-12-18T10:25:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.328+0000 7f58138e0080 1 -- 172.21.15.133:0/3653754904 wait complete. 2023-12-18T10:25:53.331 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2023-12-18T10:25:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa42247080 1 Processor -- start 2023-12-18T10:25:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa42247080 1 -- start start 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa42247080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa280030c0 0x558e17a45130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa42247080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e179bc940 0x558e179152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa42247080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 0x558e17a46a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa42247080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1788f9c0 con 0x558e179bc940 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa42247080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1782b4d0 con 0x7ffa280030c0 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa42247080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e1782b1d0 con 0x558e179a2590 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3f560640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e179bc940 0x558e179152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3f560640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e179bc940 0x558e179152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52622/0 (socket says 172.21.15.133:52622) 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3f560640 1 -- 172.21.15.133:0/1244146369 learned_addr learned my addr 172.21.15.133:0/1244146369 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3fd61640 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa280030c0 0x558e17a45130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa40562640 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 0x558e17a46a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3f560640 1 -- 172.21.15.133:0/1244146369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 msgr2=0x558e17a46a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3f560640 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 0x558e17a46a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3f560640 1 -- 172.21.15.133:0/1244146369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa280030c0 msgr2=0x558e17a45130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3f560640 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa280030c0 0x558e17a45130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.420+0000 7ffa3f560640 1 -- 172.21.15.133:0/1244146369 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e1782d4b0 con 0x558e179bc940 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3f560640 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e179bc940 0x558e179152d0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ffa3401b2f0 tx=0x7ffa34001ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89deaabb4bbd6404 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3e55e640 1 -- 172.21.15.133:0/1244146369 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340b6680 con 0x558e179bc940 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3e55e640 1 -- 172.21.15.133:0/1244146369 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa340b67e0 con 0x558e179bc940 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3e55e640 1 -- 172.21.15.133:0/1244146369 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340b6b70 con 0x558e179bc940 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- 172.21.15.133:0/1244146369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e179bc940 msgr2=0x558e179152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e179bc940 0x558e179152d0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ffa3401b2f0 tx=0x7ffa34001ff0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- 172.21.15.133:0/1244146369 shutdown_connections 2023-12-18T10:25:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 0x558e17a46a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558e179bc940 0x558e179152d0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 --2- 172.21.15.133:0/1244146369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa280030c0 0x558e17a45130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- 172.21.15.133:0/1244146369 >> 172.21.15.133:0/1244146369 conn(0x558e178e2b50 msgr2=0x558e179bc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- 172.21.15.133:0/1244146369 shutdown_connections 2023-12-18T10:25:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- 172.21.15.133:0/1244146369 wait complete. 2023-12-18T10:25:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 Processor -- start 2023-12-18T10:25:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- start start 2023-12-18T10:25:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 0x558e179a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e179bc940 0x558e1798d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa280030c0 0x558e1798d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e17821e40 con 0x7ffa280030c0 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e1798dc70 con 0x558e179bc940 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e1798df00 con 0x558e179a2590 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa280030c0 0x558e1798d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa280030c0 0x558e1798d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52632/0 (socket says 172.21.15.133:52632) 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 -- 172.21.15.133:0/3199256657 learned_addr learned my addr 172.21.15.133:0/3199256657 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3fd61640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 0x558e179a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3f560640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e179bc940 0x558e1798d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 -- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 msgr2=0x558e179a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558e179a2590 0x558e179a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 -- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e179bc940 msgr2=0x558e1798d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e179bc940 0x558e1798d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 -- 172.21.15.133:0/3199256657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28001e20 con 0x7ffa280030c0 2023-12-18T10:25:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa40562640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa280030c0 0x558e1798d730 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x558e1792e2b0 tx=0x7ffa38011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3d55c640 1 -- 172.21.15.133:0/3199256657 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38013740 con 0x7ffa280030c0 2023-12-18T10:25:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3d55c640 1 -- 172.21.15.133:0/3199256657 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa380138c0 con 0x7ffa280030c0 2023-12-18T10:25:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa3d55c640 1 -- 172.21.15.133:0/3199256657 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38013c70 con 0x7ffa280030c0 2023-12-18T10:25:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.424+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e1782cf10 con 0x7ffa280030c0 2023-12-18T10:25:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e1798e440 con 0x7ffa280030c0 2023-12-18T10:25:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa3d55c640 1 -- 172.21.15.133:0/3199256657 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa38022460 con 0x7ffa280030c0 2023-12-18T10:25:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa3d55c640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa2c064410 0x7ffa2c0668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa3d55c640 1 -- 172.21.15.133:0/3199256657 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffa380823a0 con 0x7ffa280030c0 2023-12-18T10:25:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa3fd61640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa2c064410 0x7ffa2c0668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa42247080 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x558e179a20c0 0x558e1798a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- osd_op(unknown.0.0:1 15.5 15:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x558e1798fe30 con 0x558e179a20c0 2023-12-18T10:25:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa3fd61640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa2c064410 0x7ffa2c0668d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ffa30001cc0 tx=0x7ffa30010040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.428+0000 7ffa3f560640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x558e179a20c0 0x558e1798a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa3f560640 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x558e179a20c0 0x558e1798a940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa3f560640 1 -- 172.21.15.133:0/3199256657 <== osd.6 v2:172.21.15.142:6824/38346 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v107'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ffa340bc020 con 0x558e179a20c0 2023-12-18T10:25:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x558e179a20c0 msgr2=0x558e1798a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x558e179a20c0 0x558e1798a940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa2c064410 msgr2=0x7ffa2c0668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ffa2c064410 0x7ffa2c0668d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ffa30001cc0 tx=0x7ffa30010040 comp rx=0 tx=0).stop 2023-12-18T10:25:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa280030c0 msgr2=0x558e1798d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 --2- 172.21.15.133:0/3199256657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa280030c0 0x558e1798d730 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x558e1792e2b0 tx=0x7ffa38011a10 comp rx=0 tx=0).stop 2023-12-18T10:25:53.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa40562640 1 -- 172.21.15.133:0/3199256657 reap_dead start 2023-12-18T10:25:53.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 shutdown_connections 2023-12-18T10:25:53.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 >> 172.21.15.133:0/3199256657 conn(0x558e178e2b50 msgr2=0x558e179bc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 shutdown_connections 2023-12-18T10:25:53.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.432+0000 7ffa42247080 1 -- 172.21.15.133:0/3199256657 wait complete. 2023-12-18T10:25:53.438 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2023-12-18T10:25:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 Processor -- start 2023-12-18T10:25:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- start start 2023-12-18T10:25:53.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32b210 0x55deeb32c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 0x55deeb33f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32e860 0x55deeb3bc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeb2a69c0 con 0x55deeb32e860 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeb2424d0 con 0x55deeb32b5f0 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55deeb2421d0 con 0x55deeb32b210 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32e860 0x55deeb3bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32e860 0x55deeb3bc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52658/0 (socket says 172.21.15.133:52658) 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 -- 172.21.15.133:0/1741634703 learned_addr learned my addr 172.21.15.133:0/1741634703 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4eeea640 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32b210 0x55deeb32c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4e6e9640 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 0x55deeb33f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 -- 172.21.15.133:0/1741634703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32b210 msgr2=0x55deeb32c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32b210 0x55deeb32c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 -- 172.21.15.133:0/1741634703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 msgr2=0x55deeb33f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 0x55deeb33f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 -- 172.21.15.133:0/1741634703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4800a100 con 0x55deeb32e860 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4f6eb640 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32e860 0x55deeb3bc220 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fcf4801d360 tx=0x7fcf480033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcfcba3b348994c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4d6e7640 1 -- 172.21.15.133:0/1741634703 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480aab30 con 0x55deeb32e860 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4d6e7640 1 -- 172.21.15.133:0/1741634703 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf480aac90 con 0x55deeb32e860 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf4d6e7640 1 -- 172.21.15.133:0/1741634703 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf480bc460 con 0x55deeb32e860 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- 172.21.15.133:0/1741634703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32e860 msgr2=0x55deeb3bc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32e860 0x55deeb3bc220 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fcf4801d360 tx=0x7fcf480033b0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- 172.21.15.133:0/1741634703 shutdown_connections 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32e860 0x55deeb3bc220 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 0x55deeb33f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 --2- 172.21.15.133:0/1741634703 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32b210 0x55deeb32c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- 172.21.15.133:0/1741634703 >> 172.21.15.133:0/1741634703 conn(0x55deeb2f9b50 msgr2=0x55deeb33e280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- 172.21.15.133:0/1741634703 shutdown_connections 2023-12-18T10:25:53.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.484+0000 7fcf513d0080 1 -- 172.21.15.133:0/1741634703 wait complete. 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 Processor -- start 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 -- start start 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32b210 0x55deeb344840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 0x55deeb3b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32e860 0x55deeb3458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeb238e40 con 0x55deeb32b210 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55deeb345110 con 0x55deeb32b5f0 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55deeb3ba430 con 0x55deeb32e860 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32b210 0x55deeb344840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32b210 0x55deeb344840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52670/0 (socket says 172.21.15.133:52670) 2023-12-18T10:25:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 -- 172.21.15.133:0/1373423253 learned_addr learned my addr 172.21.15.133:0/1373423253 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4e6e9640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 0x55deeb3b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4f6eb640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32e860 0x55deeb3458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 -- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32e860 msgr2=0x55deeb3458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32e860 0x55deeb3458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 -- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 msgr2=0x55deeb3b9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55deeb32b5f0 0x55deeb3b9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 -- 172.21.15.133:0/1373423253 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55deeb251070 con 0x55deeb32b210 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4f6eb640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55deeb32e860 0x55deeb3458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf4eeea640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32b210 0x55deeb344840 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000df90 tx=0x7fcf4000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf37fff640 1 -- 172.21.15.133:0/1373423253 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40010620 con 0x55deeb32b210 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf37fff640 1 -- 172.21.15.133:0/1373423253 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf40010780 con 0x55deeb32b210 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf37fff640 1 -- 172.21.15.133:0/1373423253 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40010b30 con 0x55deeb32b210 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55deeb2444b0 con 0x55deeb32b210 2023-12-18T10:25:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.488+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55deeb243f10 con 0x55deeb32b210 2023-12-18T10:25:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf37fff640 1 -- 172.21.15.133:0/1373423253 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcf40010c90 con 0x55deeb32b210 2023-12-18T10:25:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf37fff640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcf3c064410 0x7fcf3c0668d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf37fff640 1 -- 172.21.15.133:0/1373423253 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcf40082360 con 0x55deeb32b210 2023-12-18T10:25:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf4e6e9640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcf3c064410 0x7fcf3c0668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf513d0080 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55deeb345e30 0x55deeb46ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- osd_op(unknown.0.0:1 15.9 15:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x55deeb3416b0 con 0x55deeb345e30 2023-12-18T10:25:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf4e6e9640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcf3c064410 0x7fcf3c0668d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcf44000c10 tx=0x7fcf44003940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf4f6eb640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55deeb345e30 0x55deeb46ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.492+0000 7fcf4f6eb640 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55deeb345e30 0x55deeb46ba10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf4f6eb640 1 -- 172.21.15.133:0/1373423253 <== osd.6 v2:172.21.15.142:6824/38346 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v107'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcf480b9030 con 0x55deeb345e30 2023-12-18T10:25:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55deeb345e30 msgr2=0x55deeb46ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x55deeb345e30 0x55deeb46ba10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcf3c064410 msgr2=0x7fcf3c0668d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcf3c064410 0x7fcf3c0668d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcf44000c10 tx=0x7fcf44003940 comp rx=0 tx=0).stop 2023-12-18T10:25:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32b210 msgr2=0x55deeb344840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 --2- 172.21.15.133:0/1373423253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55deeb32b210 0x55deeb344840 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000df90 tx=0x7fcf4000b6b0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf4f6eb640 1 -- 172.21.15.133:0/1373423253 reap_dead start 2023-12-18T10:25:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 shutdown_connections 2023-12-18T10:25:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 >> 172.21.15.133:0/1373423253 conn(0x55deeb2f9b50 msgr2=0x55deeb3bc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 shutdown_connections 2023-12-18T10:25:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.496+0000 7fcf513d0080 1 -- 172.21.15.133:0/1373423253 wait complete. 2023-12-18T10:25:53.501 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2023-12-18T10:25:53.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.544+0000 7f81f2c38080 1 Processor -- start 2023-12-18T10:25:53.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- start start 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 0x5622691684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x562269169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 0x56226916a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622690d09c0 con 0x5622691555f0 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56226906c4d0 con 0x562269155210 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56226906c1d0 con 0x562269158690 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x562269169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x562269169ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52696/0 (socket says 172.21.15.133:52696) 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 -- 172.21.15.133:0/2660741394 learned_addr learned my addr 172.21.15.133:0/2660741394 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f0752640 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 0x5622691684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f0f53640 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 0x56226916a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 -- 172.21.15.133:0/2660741394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 msgr2=0x56226916a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 0x56226916a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 -- 172.21.15.133:0/2660741394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 msgr2=0x5622691684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 0x5622691684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 -- 172.21.15.133:0/2660741394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0005d30 con 0x5622691555f0 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eff51640 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x562269169ff0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f81e000a500 tx=0x7f81e0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f861b00f4958a3e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eef4f640 1 -- 172.21.15.133:0/2660741394 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00b9640 con 0x5622691555f0 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eef4f640 1 -- 172.21.15.133:0/2660741394 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e00b97c0 con 0x5622691555f0 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81eef4f640 1 -- 172.21.15.133:0/2660741394 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00b9b70 con 0x5622691555f0 2023-12-18T10:25:53.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- 172.21.15.133:0/2660741394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 msgr2=0x562269169ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x562269169ff0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f81e000a500 tx=0x7f81e0003030 comp rx=0 tx=0).stop 2023-12-18T10:25:53.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- 172.21.15.133:0/2660741394 shutdown_connections 2023-12-18T10:25:53.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 0x56226916a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x562269169ff0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 --2- 172.21.15.133:0/2660741394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 0x5622691684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- 172.21.15.133:0/2660741394 >> 172.21.15.133:0/2660741394 conn(0x562269123b50 msgr2=0x56226916e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- 172.21.15.133:0/2660741394 shutdown_connections 2023-12-18T10:25:53.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- 172.21.15.133:0/2660741394 wait complete. 2023-12-18T10:25:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 Processor -- start 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.548+0000 7f81f2c38080 1 -- start start 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f2c38080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 0x562269156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f2c38080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x5622691fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f2c38080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 0x56226928bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f2c38080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562269062e40 con 0x5622691555f0 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f2c38080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622692828e0 con 0x562269155210 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f2c38080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562269282ad0 con 0x562269158690 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x5622691fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x5622691fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52704/0 (socket says 172.21.15.133:52704) 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 -- 172.21.15.133:0/2055038816 learned_addr learned my addr 172.21.15.133:0/2055038816 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f0f53640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 0x56226928bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f0752640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 0x562269156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 -- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 msgr2=0x56226928bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562269158690 0x56226928bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 -- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 msgr2=0x562269156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 0x562269156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 -- 172.21.15.133:0/2055038816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56226907b070 con 0x5622691555f0 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f0752640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562269155210 0x562269156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81eff51640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x5622691fc0b0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f81e000a500 tx=0x7f81e001a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81edf4d640 1 -- 172.21.15.133:0/2055038816 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00af640 con 0x5622691555f0 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81edf4d640 1 -- 172.21.15.133:0/2055038816 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e00b9650 con 0x5622691555f0 2023-12-18T10:25:53.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56226906e4b0 con 0x5622691555f0 2023-12-18T10:25:53.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81edf4d640 1 -- 172.21.15.133:0/2055038816 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00af9a0 con 0x5622691555f0 2023-12-18T10:25:53.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56226906df10 con 0x5622691555f0 2023-12-18T10:25:53.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.552+0000 7f81edf4d640 1 -- 172.21.15.133:0/2055038816 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f81e00afb00 con 0x5622691555f0 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81edf4d640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81dc064440 0x7f81dc066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81edf4d640 1 -- 172.21.15.133:0/2055038816 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f81e0121da0 con 0x5622691555f0 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f0752640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81dc064440 0x7f81dc066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x5622691fc5f0 0x562269284440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- osd_op(unknown.0.0:1 15.5 15:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x56226916fec0 con 0x5622691fc5f0 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f0f53640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x5622691fc5f0 0x562269284440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f0752640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81dc064440 0x7f81dc066900 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f81e8000f90 tx=0x7f81e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f0f53640 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x5622691fc5f0 0x562269284440 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f0f53640 1 -- 172.21.15.133:0/2055038816 <== osd.6 v2:172.21.15.142:6824/38346 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v107'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f81e4011580 con 0x5622691fc5f0 2023-12-18T10:25:53.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x5622691fc5f0 msgr2=0x562269284440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x5622691fc5f0 0x562269284440 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81dc064440 msgr2=0x7f81dc066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f81dc064440 0x7f81dc066900 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f81e8000f90 tx=0x7f81e8008040 comp rx=0 tx=0).stop 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 msgr2=0x5622691fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 --2- 172.21.15.133:0/2055038816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5622691555f0 0x5622691fc0b0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f81e000a500 tx=0x7f81e001a920 comp rx=0 tx=0).stop 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f0f53640 1 -- 172.21.15.133:0/2055038816 reap_dead start 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 shutdown_connections 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 >> 172.21.15.133:0/2055038816 conn(0x562269123b50 msgr2=0x56226916a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 shutdown_connections 2023-12-18T10:25:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.556+0000 7f81f2c38080 1 -- 172.21.15.133:0/2055038816 wait complete. 2023-12-18T10:25:53.563 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2023-12-18T10:25:53.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fbad9a080 1 Processor -- start 2023-12-18T10:25:53.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fbad9a080 1 -- start start 2023-12-18T10:25:53.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fbad9a080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588abf58d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fbad9a080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 0x5588abf55060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fbad9a080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588abf555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fbad9a080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588abebb9c0 con 0x5588abf43690 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fbad9a080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588abe574d0 con 0x5588abf405f0 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fbad9a080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588abe571d0 con 0x5588abf40210 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588abf555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588abf555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52714/0 (socket says 172.21.15.133:52714) 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 -- 172.21.15.133:0/349168239 learned_addr learned my addr 172.21.15.133:0/349168239 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb3fff640 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 0x5588abf55060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb88b4640 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588abf58d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 -- 172.21.15.133:0/349168239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 msgr2=0x5588abf58d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588abf58d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 -- 172.21.15.133:0/349168239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 msgr2=0x5588abf55060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 0x5588abf55060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 -- 172.21.15.133:0/349168239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa4005d30 con 0x5588abf43690 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.608+0000 7f2fb90b5640 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588abf555a0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006f10 tx=0x7f2fb4001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7033511eb1845b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb2ffd640 1 -- 172.21.15.133:0/349168239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004530 con 0x5588abf43690 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb2ffd640 1 -- 172.21.15.133:0/349168239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb40046b0 con 0x5588abf43690 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb2ffd640 1 -- 172.21.15.133:0/349168239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004a60 con 0x5588abf43690 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- 172.21.15.133:0/349168239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 msgr2=0x5588abf555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588abf555a0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006f10 tx=0x7f2fb4001990 comp rx=0 tx=0).stop 2023-12-18T10:25:53.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- 172.21.15.133:0/349168239 shutdown_connections 2023-12-18T10:25:53.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588abf555a0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 0x5588abf55060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 --2- 172.21.15.133:0/349168239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588abf58d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- 172.21.15.133:0/349168239 >> 172.21.15.133:0/349168239 conn(0x5588abf0eb50 msgr2=0x5588abf59810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- 172.21.15.133:0/349168239 shutdown_connections 2023-12-18T10:25:53.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- 172.21.15.133:0/349168239 wait complete. 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 Processor -- start 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- start start 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588ac074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 0x5588abfe5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588ac06f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588abe4de40 con 0x5588abf43690 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588ac077520 con 0x5588abf405f0 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588ac06dd10 con 0x5588abf40210 2023-12-18T10:25:53.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb90b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588ac06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588ac074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588ac074ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:35876/0 (socket says 172.21.15.133:35876) 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 -- 172.21.15.133:0/3141878972 learned_addr learned my addr 172.21.15.133:0/3141878972 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb3fff640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 0x5588abfe5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 -- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 msgr2=0x5588abfe5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5588abf405f0 0x5588abfe5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 -- 172.21.15.133:0/3141878972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 msgr2=0x5588ac06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588ac06f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 -- 172.21.15.133:0/3141878972 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8001e20 con 0x5588abf40210 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb90b5640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588abf43690 0x5588ac06f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb88b4640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588ac074ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00df60 tx=0x7f2fac003ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/3141878972 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac001660 con 0x5588abf40210 2023-12-18T10:25:53.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/3141878972 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0017c0 con 0x5588abf40210 2023-12-18T10:25:53.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588abe594b0 con 0x5588abf40210 2023-12-18T10:25:53.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/3141878972 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac001b50 con 0x5588abf40210 2023-12-18T10:25:53.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.612+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588abe58f10 con 0x5588abf40210 2023-12-18T10:25:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.616+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/3141878972 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fac001cb0 con 0x5588abf40210 2023-12-18T10:25:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.616+0000 7f2fb1ffb640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f9c064470 0x7f2f9c066930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.616+0000 7f2fb1ffb640 1 -- 172.21.15.133:0/3141878972 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fac081fa0 con 0x5588abf40210 2023-12-18T10:25:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.616+0000 7f2fb3fff640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f9c064470 0x7f2f9c066930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.616+0000 7f2fbad9a080 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5588ac075400 0x5588ac080040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.616+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 --> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] -- osd_op(unknown.0.0:1 15.1d 15:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107) v8 -- 0x5588ac06f980 con 0x5588ac075400 2023-12-18T10:25:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.616+0000 7f2fb90b5640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5588ac075400 0x5588ac080040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.616+0000 7f2fb3fff640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f9c064470 0x7f2f9c066930 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40b1000 tx=0x7f2fa40a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fb90b5640 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5588ac075400 0x5588ac080040 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fb90b5640 1 -- 172.21.15.133:0/3141878972 <== osd.4 v2:172.21.15.142:6800/38344 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v107'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2fb4004980 con 0x5588ac075400 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5588ac075400 msgr2=0x5588ac080040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x5588ac075400 0x5588ac080040 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f9c064470 msgr2=0x7f2f9c066930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2f9c064470 0x7f2f9c066930 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40b1000 tx=0x7f2fa40a9070 comp rx=0 tx=0).stop 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 msgr2=0x5588ac074ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 --2- 172.21.15.133:0/3141878972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5588abf40210 0x5588ac074ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00df60 tx=0x7f2fac003ee0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fb90b5640 1 -- 172.21.15.133:0/3141878972 reap_dead start 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 shutdown_connections 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 >> 172.21.15.133:0/3141878972 conn(0x5588abf0eb50 msgr2=0x5588abf53280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 shutdown_connections 2023-12-18T10:25:53.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.620+0000 7f2fbad9a080 1 -- 172.21.15.133:0/3141878972 wait complete. 2023-12-18T10:25:53.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub start /d1/d2/d3 recursive,force 2023-12-18T10:25:53.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73af473640 1 Processor -- start 2023-12-18T10:25:53.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73af473640 1 -- start start 2023-12-18T10:25:53.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73af473640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73a806be20 0x7f73a80c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73af473640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73a80c18b0 0x7f73a80cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73af473640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a80c1cb0 con 0x7f73a8160e90 2023-12-18T10:25:53.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73af473640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a80b20a0 con 0x7f73a806be20 2023-12-18T10:25:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73af473640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a80b2380 con 0x7f73a80c18b0 2023-12-18T10:25:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73aca0e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73a806be20 0x7f73a80c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73ad20f640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f73a8160e90 0x7f73a8165130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60884/0 (socket says 172.21.15.133:60884) 2023-12-18T10:25:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73ad20f640 1 -- 172.21.15.133:0/2744152464 learned_addr learned my addr 172.21.15.133:0/2744152464 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:53.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73aca0e640 1 -- 172.21.15.133:0/2744152464 >> v2:172.21.15.142:3300/0 conn(0x7f73a80c18b0 msgr2=0x7f73a80cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73ada10640 1 --2- 172.21.15.133:0/2744152464 >> v2:172.21.15.142:3300/0 conn(0x7f73a80c18b0 0x7f73a80cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73aca0e640 1 --2- 172.21.15.133:0/2744152464 >> v2:172.21.15.142:3300/0 conn(0x7f73a80c18b0 0x7f73a80cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73aca0e640 1 -- 172.21.15.133:0/2744152464 >> v1:172.21.15.133:6789/0 conn(0x7f73a8160e90 legacy=0x7f73a8165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73a7fff640 1 -- 172.21.15.133:0/2744152464 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168707782 0 0) 0x7f73a80c1cb0 con 0x7f73a8160e90 2023-12-18T10:25:53.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73aca0e640 1 -- 172.21.15.133:0/2744152464 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80cc5b0 con 0x7f73a806be20 2023-12-18T10:25:53.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.812+0000 7f73ada10640 1 --2- 172.21.15.133:0/2744152464 >> v2:172.21.15.142:3300/0 conn(0x7f73a80c18b0 0x7f73a80cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73aca0e640 1 --2- 172.21.15.133:0/2744152464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80c1370 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f73a81647f0 tx=0x7f739401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6990d93ba30af8e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73a7fff640 1 -- 172.21.15.133:0/2744152464 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394004230 con 0x7f73a806be20 2023-12-18T10:25:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73a7fff640 1 -- 172.21.15.133:0/2744152464 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73940a7050 con 0x7f73a806be20 2023-12-18T10:25:53.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73a7fff640 1 -- 172.21.15.133:0/2744152464 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394003620 con 0x7f73a806be20 2023-12-18T10:25:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73af473640 1 -- 172.21.15.133:0/2744152464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 msgr2=0x7f73a80c1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73af473640 1 --2- 172.21.15.133:0/2744152464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80c1370 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f73a81647f0 tx=0x7f739401c460 comp rx=0 tx=0).stop 2023-12-18T10:25:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73af473640 1 -- 172.21.15.133:0/2744152464 shutdown_connections 2023-12-18T10:25:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73af473640 1 --2- 172.21.15.133:0/2744152464 >> v2:172.21.15.142:3300/0 conn(0x7f73a80c18b0 0x7f73a80cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73af473640 1 --2- 172.21.15.133:0/2744152464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80c1370 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73af473640 1 -- 172.21.15.133:0/2744152464 >> 172.21.15.133:0/2744152464 conn(0x7f73a8069e70 msgr2=0x7f73a806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73af473640 1 -- 172.21.15.133:0/2744152464 shutdown_connections 2023-12-18T10:25:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.816+0000 7f73af473640 1 -- 172.21.15.133:0/2744152464 wait complete. 2023-12-18T10:25:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 Processor -- start 2023-12-18T10:25:53.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 -- start start 2023-12-18T10:25:53.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a80c18b0 0x7f73a8070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8160e90 0x7f73a80714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80ad900 con 0x7f73a806be20 2023-12-18T10:25:53.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80ac860 con 0x7f73a80c18b0 2023-12-18T10:25:53.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80acb40 con 0x7f73a8160e90 2023-12-18T10:25:53.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52752/0 (socket says 172.21.15.133:52752) 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 -- 172.21.15.133:0/910054327 learned_addr learned my addr 172.21.15.133:0/910054327 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ada10640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8160e90 0x7f73a80714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73aca0e640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a80c18b0 0x7f73a8070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 -- 172.21.15.133:0/910054327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8160e90 msgr2=0x7f73a80714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8160e90 0x7f73a80714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 -- 172.21.15.133:0/910054327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a80c18b0 msgr2=0x7f73a8070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a80c18b0 0x7f73a8070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 -- 172.21.15.133:0/910054327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394009420 con 0x7f73a806be20 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73ad20f640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80abff0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f739c00c7c0 tx=0x7f739c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73a5ffb640 1 -- 172.21.15.133:0/910054327 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c00a640 con 0x7f73a806be20 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73a5ffb640 1 -- 172.21.15.133:0/910054327 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c00a7c0 con 0x7f73a806be20 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 -- 172.21.15.133:0/910054327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a80ace20 con 0x7f73a806be20 2023-12-18T10:25:53.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73a5ffb640 1 -- 172.21.15.133:0/910054327 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c00ab70 con 0x7f73a806be20 2023-12-18T10:25:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.820+0000 7f73af473640 1 -- 172.21.15.133:0/910054327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a80ad3e0 con 0x7f73a806be20 2023-12-18T10:25:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73a5ffb640 1 -- 172.21.15.133:0/910054327 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f739c00acd0 con 0x7f73a806be20 2023-12-18T10:25:53.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73a5ffb640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f738c065a60 0x7f738c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73a5ffb640 1 -- 172.21.15.133:0/910054327 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f739c082b20 con 0x7f73a806be20 2023-12-18T10:25:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73aca0e640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f738c065a60 0x7f738c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73b27db000 1 Processor -- start 2023-12-18T10:25:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73b27db000 1 -- start start 2023-12-18T10:25:53.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73aca0e640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f738c065a60 0x7f738c067f20 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f73940ad000 tx=0x7f73940a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73b27db000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73b27db000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0677a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73b27db000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b0678340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73b27db000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b053fb00 con 0x5586b0677f60 2023-12-18T10:25:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73b27db000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b04cd140 con 0x5586b06c19e0 2023-12-18T10:25:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73b27db000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586b04ca710 con 0x5586b06c2300 2023-12-18T10:25:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73ada10640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b0678340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73ada10640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b0678340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52760/0 (socket says 172.21.15.133:52760) 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73ada10640 1 -- 172.21.15.133:0/658273492 learned_addr learned my addr 172.21.15.133:0/658273492 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73aca0e640 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0677a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73ad20f640 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73ada10640 1 -- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 msgr2=0x5586b0677a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.824+0000 7f73ada10640 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0677a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ada10640 1 -- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 msgr2=0x5586b06c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ada10640 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ada10640 1 -- 172.21.15.133:0/658273492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586b01c2c90 con 0x5586b0677f60 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73aca0e640 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0677a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:53.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ada10640 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b0678340 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f73a000caa0 tx=0x7f73a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d0206e04c30764 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f7392ffd640 1 -- 172.21.15.133:0/658273492 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a000eb70 con 0x5586b0677f60 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f7392ffd640 1 -- 172.21.15.133:0/658273492 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a000ecd0 con 0x5586b0677f60 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f7392ffd640 1 -- 172.21.15.133:0/658273492 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0013450 con 0x5586b0677f60 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- 172.21.15.133:0/658273492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 msgr2=0x5586b0678340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b0678340 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f73a000caa0 tx=0x7f73a000cf60 comp rx=0 tx=0).stop 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- 172.21.15.133:0/658273492 shutdown_connections 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b0678340 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0677a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 --2- 172.21.15.133:0/658273492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- 172.21.15.133:0/658273492 >> 172.21.15.133:0/658273492 conn(0x5586b0673f10 msgr2=0x5586b0676300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- 172.21.15.133:0/658273492 shutdown_connections 2023-12-18T10:25:53.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- 172.21.15.133:0/658273492 wait complete. 2023-12-18T10:25:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- start start 2023-12-18T10:25:53.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 Processor -- start 2023-12-18T10:25:53.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b067d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06837e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0683d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b04c6000 con 0x5586b0677f60 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b0465980 con 0x5586b06c19e0 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586b0465620 con 0x5586b06c2300 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73b27db000 10 client.0 _ll_register_callbacks cb 0x5586b04bf940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ad20f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b067d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ad20f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b067d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52764/0 (socket says 172.21.15.133:52764) 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ad20f640 1 -- 172.21.15.133:0/985816133 learned_addr learned my addr 172.21.15.133:0/985816133 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ada10640 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0683d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73aca0e640 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06837e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ad20f640 1 -- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 msgr2=0x5586b0683d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ad20f640 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0683d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ad20f640 1 -- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 msgr2=0x5586b06837e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ad20f640 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06837e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.828+0000 7f73ad20f640 1 -- 172.21.15.133:0/985816133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a000c700 con 0x5586b0677f60 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73aca0e640 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06837e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73ad20f640 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b067d0f0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f739c080e90 tx=0x7f739c054800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb5eb53e205ca4d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 1 -- 172.21.15.133:0/985816133 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c05bd90 con 0x5586b0677f60 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 1 -- 172.21.15.133:0/985816133 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f739c05c020 con 0x5586b0677f60 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 -- 172.21.15.133:0/985816133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586b04874f0 con 0x5586b0677f60 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 1 -- 172.21.15.133:0/985816133 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f739c058bb0 con 0x5586b0677f60 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 10 client.9444 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:53.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 -- 172.21.15.133:0/985816133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x5586b048b390 con 0x5586b0677f60 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 1 -- 172.21.15.133:0/985816133 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586b04874f0 con 0x5586b0677f60 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 1 -- 172.21.15.133:0/985816133 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f739c058d10 con 0x5586b0677f60 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 10 client.9444 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 10 client.9444 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 20 client.9444 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5586b06c8e20 0x5586b06c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 4 client.9444 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 -- 172.21.15.133:0/985816133 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586b04caef0 con 0x5586b06c8e20 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73aca0e640 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5586b06c8e20 0x5586b06c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73aca0e640 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5586b06c8e20 0x5586b06c9230 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef459063c302b07a server_cookie=bf0054a7616d0007 in_seq=0 out_seq=0 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 10 client.9444 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:53.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 1 -- 172.21.15.133:0/985816133 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5586b04caef0 con 0x5586b06c8e20 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 10 client.9444 handle_command_reply: tid=0 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 client.9444 shutdown 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 -- 172.21.15.133:0/985816133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 msgr2=0x5586b067d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b067d0f0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f739c080e90 tx=0x7f739c054800 comp rx=0 tx=0).stop 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 -- 172.21.15.133:0/985816133 shutdown_connections 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5586b06c8e20 0x5586b06c9230 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b0683d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b06c19e0 0x5586b06837e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f7387fff640 0 client.9444 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 --2- 172.21.15.133:0/985816133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b0677f60 0x5586b067d0f0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 -- 172.21.15.133:0/985816133 >> 172.21.15.133:0/985816133 conn(0x5586b0673f10 msgr2=0x5586b0676b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 -- 172.21.15.133:0/985816133 shutdown_connections 2023-12-18T10:25:53.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 1 -- 172.21.15.133:0/985816133 wait complete. 2023-12-18T10:25:53.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.832+0000 7f73b27db000 20 client.9444 trim_cache size 0 max 16384 2023-12-18T10:25:53.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73b27db000 1 Processor -- start 2023-12-18T10:25:53.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73b27db000 1 -- start start 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73b27db000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 0x5586b0682790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73b27db000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c19e0 0x5586b0682cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73b27db000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b06c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73b27db000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b0183d40 con 0x5586b06c19e0 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73b27db000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b04804d0 con 0x5586b0677f60 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73b27db000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586b04c7590 con 0x5586b06c2300 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c19e0 0x5586b0682cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c19e0 0x5586b0682cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52780/0 (socket says 172.21.15.133:52780) 2023-12-18T10:25:53.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 -- 172.21.15.133:0/169287 learned_addr learned my addr 172.21.15.133:0/169287 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 -- 172.21.15.133:0/169287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 msgr2=0x5586b06c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 --2- 172.21.15.133:0/169287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b06c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 -- 172.21.15.133:0/169287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 msgr2=0x5586b0682790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 --2- 172.21.15.133:0/169287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 0x5586b0682790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 -- 172.21.15.133:0/169287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586b04714e0 con 0x5586b06c19e0 2023-12-18T10:25:53.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73aca0e640 1 --2- 172.21.15.133:0/169287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c19e0 0x5586b0682cd0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f7394097e20 tx=0x7f73940a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2fb139ed7c441b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73937fe640 1 -- 172.21.15.133:0/169287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940c9620 con 0x5586b06c19e0 2023-12-18T10:25:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73937fe640 1 -- 172.21.15.133:0/169287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73940c9780 con 0x5586b06c19e0 2023-12-18T10:25:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.848+0000 7f73937fe640 1 -- 172.21.15.133:0/169287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940c9af0 con 0x5586b06c19e0 2023-12-18T10:25:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- 172.21.15.133:0/169287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c19e0 msgr2=0x5586b0682cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 --2- 172.21.15.133:0/169287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c19e0 0x5586b0682cd0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f7394097e20 tx=0x7f73940a8000 comp rx=0 tx=0).stop 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- 172.21.15.133:0/169287 shutdown_connections 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 --2- 172.21.15.133:0/169287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c2300 0x5586b06c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 --2- 172.21.15.133:0/169287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c19e0 0x5586b0682cd0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 --2- 172.21.15.133:0/169287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 0x5586b0682790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- 172.21.15.133:0/169287 >> 172.21.15.133:0/169287 conn(0x5586b0673f10 msgr2=0x5586b0676b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- 172.21.15.133:0/169287 shutdown_connections 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- 172.21.15.133:0/169287 wait complete. 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- start start 2023-12-18T10:25:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 Processor -- start 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 0x5586b071ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c19e0 0x5586b07214d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c2300 0x5586b0723a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b04c3810 con 0x5586b06c2300 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b04c1970 con 0x5586b0677f60 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586b0488cd0 con 0x5586b06c19e0 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 10 client.0 _ll_register_callbacks cb 0x5586b04cf610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c2300 0x5586b0723a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c2300 0x5586b0723a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52786/0 (socket says 172.21.15.133:52786) 2023-12-18T10:25:53.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 -- 172.21.15.133:0/816369830 learned_addr learned my addr 172.21.15.133:0/816369830 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73aca0e640 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c19e0 0x5586b07214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ad20f640 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 0x5586b071ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 -- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c19e0 msgr2=0x5586b07214d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c19e0 0x5586b07214d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 -- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 msgr2=0x5586b071ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 0x5586b071ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 -- 172.21.15.133:0/816369830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a80cc5b0 con 0x5586b06c2300 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ad20f640 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 0x5586b071ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73ada10640 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c2300 0x5586b0723a20 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f73a0017040 tx=0x7f73a00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fc67c64213afe2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f7387fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f7387fff640 1 -- 172.21.15.133:0/816369830 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0003820 con 0x5586b06c2300 2023-12-18T10:25:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f7387fff640 1 -- 172.21.15.133:0/816369830 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f73a000c390 con 0x5586b06c2300 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- 172.21.15.133:0/816369830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586b048fcf0 con 0x5586b06c2300 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f7387fff640 1 -- 172.21.15.133:0/816369830 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73a000c590 con 0x5586b06c2300 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 10 client.9450 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 -- 172.21.15.133:0/816369830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x5586b01c30c0 con 0x5586b06c2300 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f7387fff640 1 -- 172.21.15.133:0/816369830 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586b048fcf0 con 0x5586b06c2300 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f7387fff640 1 -- 172.21.15.133:0/816369830 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f73a0011070 con 0x5586b06c2300 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 10 client.9450 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 10 client.9450 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 20 client.9450 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.852+0000 7f73b27db000 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5586b0723f60 0x5586b0726350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 4 client.9450 mds_command: new command op to 9048 tid=0[{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 -- 172.21.15.133:0/816369830 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x5586b04bf080 con 0x5586b0723f60 2023-12-18T10:25:53.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73ad20f640 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5586b0723f60 0x5586b0726350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f7387fff640 10 client.9450 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:53.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73ad20f640 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5586b0723f60 0x5586b0726350 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d6f8b2836756a0f server_cookie=e3477480c34929e9 in_seq=0 out_seq=0 2023-12-18T10:25:53.859 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-18T10:25:53.857+0000 7f01ff87f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-12-18T10:25:34.804037+0000 1=0+1) n(v3 rc2023-12-18T10:25:35.035375+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={9225=pAsLsXsFsx/AsLsXsFsx@9},l=9225 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55ceee436b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.804037+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:35.035375+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.804037+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-12-18T10:25:35.035375+0000 6=0+6)","error_str":""},"return_code":-61} 2023-12-18T10:25:53.860 INFO:tasks.ceph.mds.d.smithi142.stderr:2023-12-18T10:25:53.857+0000 7f020588b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-12-18T10:25:34.806254+0000 1=0+1) n(v4 rc2023-12-18T10:25:35.035375+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={9225=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55ceee437080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.806254+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:35.035375+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.806254+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-12-18T10:25:35.035375+0000 5=0+5)","error_str":""},"return_code":-61} 2023-12-18T10:25:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f7387fff640 1 -- 172.21.15.133:0/816369830 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5586b04bf080 con 0x5586b0723f60 2023-12-18T10:25:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f7387fff640 10 client.9450 handle_command_reply: tid=0 2023-12-18T10:25:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 client.9450 shutdown 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 -- 172.21.15.133:0/816369830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c2300 msgr2=0x5586b0723a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c2300 0x5586b0723a20 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f73a0017040 tx=0x7f73a00046d0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 -- 172.21.15.133:0/816369830 shutdown_connections 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x5586b0723f60 0x5586b0726350 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5586b06c2300 0x5586b0723a20 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5586b06c19e0 0x5586b07214d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 --2- 172.21.15.133:0/816369830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586b0677f60 0x5586b071ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 -- 172.21.15.133:0/816369830 >> 172.21.15.133:0/816369830 conn(0x5586b0673f10 msgr2=0x5586b0683720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f7387fff640 0 client.9450 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 -- 172.21.15.133:0/816369830 shutdown_connections 2023-12-18T10:25:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 1 -- 172.21.15.133:0/816369830 wait complete. 2023-12-18T10:25:53.862 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-18T10:25:53.856+0000 7fd7d20c0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-12-18T10:25:34.808484+0000 1=0+1) n(v2 rc2023-12-18T10:25:35.035375+0000 4=0+4) (inest lock) (iversion lock) caps={9225=pAsLsXsFs/-@7},l=9225 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x56010478d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.808484+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:35.035375+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.808484+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-12-18T10:25:35.035375+0000 4=0+4)","error_str":""},"return_code":-61} 2023-12-18T10:25:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73b27db000 20 client.9450 trim_cache size 0 max 16384 2023-12-18T10:25:53.862 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:53.862 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2023-12-18T10:25:53.862 INFO:teuthology.orchestra.run.smithi133.stdout: "scrub_tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:53.863 INFO:teuthology.orchestra.run.smithi133.stdout: "mode": "asynchronous" 2023-12-18T10:25:53.863 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:53.863 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:25:53.856+0000 7fe41e0c8640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-12-18T10:25:34.812966+0000 1=0+1) n(v0 rc2023-12-18T10:25:34.812966+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={9225=pAsLsXsFsx/-@6},l=9225 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x562107fe3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.812966+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:34.812966+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.812966+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-18T10:25:34.812966+0000 2=0+2)","error_str":""},"return_code":-61} 2023-12-18T10:25:53.863 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-18T10:25:53.856+0000 7fe41e0c8640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (iversion lock) caps={9225=pAsLsXsFs/-@3},l=9225 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x562107fe4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 -- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f738c065a60 msgr2=0x7f738c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f738c065a60 0x7f738c067f20 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f73940ad000 tx=0x7f73940a6000 comp rx=0 tx=0).stop 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 -- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 msgr2=0x7f73a80abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80abff0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f739c00c7c0 tx=0x7f739c00cc80 comp rx=0 tx=0).stop 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 -- 172.21.15.133:0/910054327 shutdown_connections 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f738c065a60 0x7f738c067f20 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f73a8160e90 0x7f73a80714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73a80c18b0 0x7f73a8070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 --2- 172.21.15.133:0/910054327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73a806be20 0x7f73a80abff0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 -- 172.21.15.133:0/910054327 >> 172.21.15.133:0/910054327 conn(0x7f73a8069e70 msgr2=0x7f73a8072670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 -- 172.21.15.133:0/910054327 shutdown_connections 2023-12-18T10:25:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:53.856+0000 7f73af473640 1 -- 172.21.15.133:0/910054327 wait complete. 2023-12-18T10:25:53.865 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-18T10:25:53.860+0000 7fd7d80cc640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-12-18T10:25:34.810793+0000 1=0+1) n(v1 rc2023-12-18T10:25:35.035375+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={9225=pAsLsXsFs/-@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x56010478d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.810793+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:34.812966+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.810793+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-12-18T10:25:35.035375+0000 3=0+3)","error_str":""},"return_code":-61} 2023-12-18T10:25:53.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub pause 2023-12-18T10:25:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.016+0000 7f7d35266640 1 Processor -- start 2023-12-18T10:25:54.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.016+0000 7f7d35266640 1 -- start start 2023-12-18T10:25:54.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.016+0000 7f7d35266640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d300b1c70 0x7f7d300706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.016+0000 7f7d35266640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d30070c20 con 0x7f7d300ce590 2023-12-18T10:25:54.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.016+0000 7f7d35266640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300b17e0 con 0x7f7d301593f0 2023-12-18T10:25:54.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.016+0000 7f7d35266640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d300b20c0 con 0x7f7d300b1c70 2023-12-18T10:25:54.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.016+0000 7f7d267fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7d300ce590 0x7f7d300b24b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60898/0 (socket says 172.21.15.133:60898) 2023-12-18T10:25:54.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.016+0000 7f7d267fc640 1 -- 172.21.15.133:0/523490831 learned_addr learned my addr 172.21.15.133:0/523490831 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:54.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/523490831 >> v2:172.21.15.133:3300/0 conn(0x7f7d300b1c70 0x7f7d300706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2e7fc640 1 -- 172.21.15.133:0/523490831 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471093923 0 0) 0x7f7d20001120 con 0x7f7d300ce590 2023-12-18T10:25:54.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2e7fc640 1 -- 172.21.15.133:0/523490831 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d1c005740 con 0x7f7d300ce590 2023-12-18T10:25:54.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2f7fe640 1 -- 172.21.15.133:0/523490831 >> v1:172.21.15.142:6789/0 conn(0x7f7d301593f0 legacy=0x7f7d300cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2f7fe640 1 -- 172.21.15.133:0/523490831 >> v1:172.21.15.133:6789/0 conn(0x7f7d300ce590 legacy=0x7f7d300b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2f7fe640 1 -- 172.21.15.133:0/523490831 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30071b50 con 0x7f7d300b1c70 2023-12-18T10:25:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/523490831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300b1c70 0x7f7d300706e0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009d90 tx=0x7f7d2801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e6d264ea63eb37 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2e7fc640 1 -- 172.21.15.133:0/523490831 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280a5810 con 0x7f7d300b1c70 2023-12-18T10:25:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2e7fc640 1 -- 172.21.15.133:0/523490831 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280a5970 con 0x7f7d300b1c70 2023-12-18T10:25:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.020+0000 7f7d2e7fc640 1 -- 172.21.15.133:0/523490831 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280a5d00 con 0x7f7d300b1c70 2023-12-18T10:25:54.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- 172.21.15.133:0/523490831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300b1c70 msgr2=0x7f7d300706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 --2- 172.21.15.133:0/523490831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300b1c70 0x7f7d300706e0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009d90 tx=0x7f7d2801c850 comp rx=0 tx=0).stop 2023-12-18T10:25:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- 172.21.15.133:0/523490831 shutdown_connections 2023-12-18T10:25:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 --2- 172.21.15.133:0/523490831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300b1c70 0x7f7d300706e0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- 172.21.15.133:0/523490831 >> 172.21.15.133:0/523490831 conn(0x7f7d3006d8d0 msgr2=0x7f7d30069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- 172.21.15.133:0/523490831 shutdown_connections 2023-12-18T10:25:54.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- 172.21.15.133:0/523490831 wait complete. 2023-12-18T10:25:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 Processor -- start 2023-12-18T10:25:54.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- start start 2023-12-18T10:25:54.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d300b1c70 0x7f7d301497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300ce590 0x7f7d300acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d301593f0 0x7f7d3014b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d301f87b0 con 0x7f7d300ce590 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300ae110 con 0x7f7d301593f0 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d35266640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300ae3f0 con 0x7f7d300b1c70 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d267fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300ce590 0x7f7d300acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d267fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300ce590 0x7f7d300acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52808/0 (socket says 172.21.15.133:52808) 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d267fc640 1 -- 172.21.15.133:0/2531098471 learned_addr learned my addr 172.21.15.133:0/2531098471 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d301593f0 0x7f7d3014b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d300b1c70 0x7f7d301497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d267fc640 1 -- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d300b1c70 msgr2=0x7f7d301497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d300b1c70 0x7f7d301497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d267fc640 1 -- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d301593f0 msgr2=0x7f7d3014b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d301593f0 0x7f7d3014b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d267fc640 1 -- 172.21.15.133:0/2531098471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009a70 con 0x7f7d300ce590 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d301593f0 0x7f7d3014b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.024+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d300b1c70 0x7f7d301497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300ce590 0x7f7d300acc20 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000c4d0 tx=0x7f7d2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d27fff640 1 -- 172.21.15.133:0/2531098471 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20005cf0 con 0x7f7d300ce590 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d27fff640 1 -- 172.21.15.133:0/2531098471 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d20005e50 con 0x7f7d300ce590 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d27fff640 1 -- 172.21.15.133:0/2531098471 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20007290 con 0x7f7d300ce590 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d35266640 1 -- 172.21.15.133:0/2531098471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d300ae6d0 con 0x7f7d300ce590 2023-12-18T10:25:54.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d35266640 1 -- 172.21.15.133:0/2531098471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d300aec90 con 0x7f7d300ce590 2023-12-18T10:25:54.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d27fff640 1 -- 172.21.15.133:0/2531098471 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d200073f0 con 0x7f7d300ce590 2023-12-18T10:25:54.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d27fff640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d10065a60 0x7f7d10067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d27fff640 1 -- 172.21.15.133:0/2531098471 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d200827d0 con 0x7f7d300ce590 2023-12-18T10:25:54.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d10065a60 0x7f7d10067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.028+0000 7f7d385cf000 1 Processor -- start 2023-12-18T10:25:54.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- start start 2023-12-18T10:25:54.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d10065a60 0x7f7d10067f20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7d300b0eb0 tx=0x7f7d18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9e7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e7540 0x55b8fa99ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa99cf60 0x55b8fa99d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa8653d0 con 0x55b8fa9e7540 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa7f3400 con 0x55b8fa9e6c20 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa7f09d0 con 0x55b8fa99cf60 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e7540 0x55b8fa99ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e7540 0x55b8fa99ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52824/0 (socket says 172.21.15.133:52824) 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 -- 172.21.15.133:0/4067216874 learned_addr learned my addr 172.21.15.133:0/4067216874 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 -- 172.21.15.133:0/4067216874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa99cf60 msgr2=0x55b8fa99d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 --2- 172.21.15.133:0/4067216874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa99cf60 0x55b8fa99d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 -- 172.21.15.133:0/4067216874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e6c20 msgr2=0x55b8fa9e7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 --2- 172.21.15.133:0/4067216874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 -- 172.21.15.133:0/4067216874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8fa4e8dc0 con 0x55b8fa9e7540 2023-12-18T10:25:54.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d267fc640 1 --2- 172.21.15.133:0/4067216874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e7540 0x55b8fa99ca20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f7d2005b790 tx=0x7f7d20054550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b06054b2473ea2b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d24ff9640 1 -- 172.21.15.133:0/4067216874 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200076a0 con 0x55b8fa9e7540 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d24ff9640 1 -- 172.21.15.133:0/4067216874 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2006b1c0 con 0x55b8fa9e7540 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d24ff9640 1 -- 172.21.15.133:0/4067216874 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20007800 con 0x55b8fa9e7540 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- 172.21.15.133:0/4067216874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e7540 msgr2=0x55b8fa99ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 --2- 172.21.15.133:0/4067216874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e7540 0x55b8fa99ca20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f7d2005b790 tx=0x7f7d20054550 comp rx=0 tx=0).stop 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- 172.21.15.133:0/4067216874 shutdown_connections 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 --2- 172.21.15.133:0/4067216874 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa99cf60 0x55b8fa99d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 --2- 172.21.15.133:0/4067216874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e7540 0x55b8fa99ca20 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 --2- 172.21.15.133:0/4067216874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- 172.21.15.133:0/4067216874 >> 172.21.15.133:0/4067216874 conn(0x55b8fa79b8b0 msgr2=0x55b8fa99b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- 172.21.15.133:0/4067216874 shutdown_connections 2023-12-18T10:25:54.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- 172.21.15.133:0/4067216874 wait complete. 2023-12-18T10:25:54.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 -- start start 2023-12-18T10:25:54.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.032+0000 7f7d385cf000 1 Processor -- start 2023-12-18T10:25:54.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 0x55b8fa9e7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e7540 0x55b8fa9e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa7ec2c0 con 0x55b8fa99cf60 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa78b490 con 0x55b8fa9e7540 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa7a9680 con 0x55b8fa9e6c20 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 10 client.0 _ll_register_callbacks cb 0x55b8fa988920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52826/0 (socket says 172.21.15.133:52826) 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 -- 172.21.15.133:0/2585972577 learned_addr learned my addr 172.21.15.133:0/2585972577 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e7540 0x55b8fa9e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 0x55b8fa9e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 -- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 msgr2=0x55b8fa9e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 0x55b8fa9e7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 -- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e7540 msgr2=0x55b8fa9e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e7540 0x55b8fa9e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 -- 172.21.15.133:0/2585972577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d300aec90 con 0x55b8fa99cf60 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e6550 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800ce00 tx=0x7f7d180137f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a884304c5cc353 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2585972577 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1801e600 con 0x55b8fa99cf60 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 -- 172.21.15.133:0/2585972577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8fa7a90c0 con 0x55b8fa99cf60 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2585972577 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d18013e20 con 0x55b8fa99cf60 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2585972577 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1801e760 con 0x55b8fa99cf60 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 10 client.9465 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 -- 172.21.15.133:0/2585972577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55b8fa7b11f0 con 0x55b8fa99cf60 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2585972577 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b8fa7a90c0 con 0x55b8fa99cf60 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2585972577 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f7d1801e8c0 con 0x55b8fa99cf60 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 10 client.9465 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 10 client.9465 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 20 client.9465 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55b8fa9e8c00 0x55b8fa9f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 4 client.9465 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:54.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d385cf000 1 -- 172.21.15.133:0/2585972577 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8fa7eac10 con 0x55b8fa9e8c00 2023-12-18T10:25:54.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55b8fa9e8c00 0x55b8fa9f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55b8fa9e8c00 0x55b8fa9f90c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9f29a1a64ffedae server_cookie=2161880c8ed05ea7 in_seq=0 out_seq=0 2023-12-18T10:25:54.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.036+0000 7f7d0dffb640 10 client.9465 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2585972577 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b8fa7eac10 con 0x55b8fa9e8c00 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d0dffb640 10 client.9465 handle_command_reply: tid=0 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 client.9465 shutdown 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 -- 172.21.15.133:0/2585972577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 msgr2=0x55b8fa9e6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e6550 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800ce00 tx=0x7f7d180137f0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 -- 172.21.15.133:0/2585972577 shutdown_connections 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55b8fa9e8c00 0x55b8fa9f90c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa9e7540 0x55b8fa9e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 0x55b8fa9e7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d0dffb640 0 client.9465 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:54.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2585972577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e6550 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 -- 172.21.15.133:0/2585972577 >> 172.21.15.133:0/2585972577 conn(0x55b8fa79b8b0 msgr2=0x55b8fa99ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 -- 172.21.15.133:0/2585972577 shutdown_connections 2023-12-18T10:25:54.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 1 -- 172.21.15.133:0/2585972577 wait complete. 2023-12-18T10:25:54.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.040+0000 7f7d385cf000 20 client.9465 trim_cache size 0 max 16384 2023-12-18T10:25:54.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d385cf000 1 Processor -- start 2023-12-18T10:25:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d385cf000 1 -- start start 2023-12-18T10:25:54.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa79b8b0 0x55b8fa9fa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa99cf60 0x55b8fa9fa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d385cf000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa9a2b80 con 0x55b8fa9e6c20 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d385cf000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa4a9a40 con 0x55b8fa99cf60 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d385cf000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa7eee20 con 0x55b8fa79b8b0 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d2f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d2f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9dffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52832/0 (socket says 172.21.15.133:52832) 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d2f7fe640 1 -- 172.21.15.133:0/2453601848 learned_addr learned my addr 172.21.15.133:0/2453601848 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa99cf60 0x55b8fa9fa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.052+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa79b8b0 0x55b8fa9fa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d2f7fe640 1 -- 172.21.15.133:0/2453601848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa79b8b0 msgr2=0x55b8fa9fa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa79b8b0 0x55b8fa9fa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d2f7fe640 1 -- 172.21.15.133:0/2453601848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa99cf60 msgr2=0x55b8fa9fa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa99cf60 0x55b8fa9fa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d2f7fe640 1 -- 172.21.15.133:0/2453601848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8fa797540 con 0x55b8fa9e6c20 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9dffb0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f7d28019460 tx=0x7f7d28004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5359d2a40ec22b80 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d257fa640 1 -- 172.21.15.133:0/2453601848 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280a5ce0 con 0x55b8fa9e6c20 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d257fa640 1 -- 172.21.15.133:0/2453601848 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280bb070 con 0x55b8fa9e6c20 2023-12-18T10:25:54.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d257fa640 1 -- 172.21.15.133:0/2453601848 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280b7660 con 0x55b8fa9e6c20 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- 172.21.15.133:0/2453601848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e6c20 msgr2=0x55b8fa9dffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9dffb0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f7d28019460 tx=0x7f7d28004a50 comp rx=0 tx=0).stop 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- 172.21.15.133:0/2453601848 shutdown_connections 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa9e6c20 0x55b8fa9dffb0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa99cf60 0x55b8fa9fa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2453601848 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa79b8b0 0x55b8fa9fa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- 172.21.15.133:0/2453601848 >> 172.21.15.133:0/2453601848 conn(0x55b8fa9a2680 msgr2=0x55b8fa9f3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- 172.21.15.133:0/2453601848 shutdown_connections 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- 172.21.15.133:0/2453601848 wait complete. 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- start start 2023-12-18T10:25:54.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 Processor -- start 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa79b8b0 0x55b8fa9e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 0x55b8fa9e3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa9a1b20 con 0x55b8fa99cf60 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa7aa420 con 0x55b8fa79b8b0 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa7ecb40 con 0x55b8fa9e6c20 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d385cf000 10 client.0 _ll_register_callbacks cb 0x55b8fa7a36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d267fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d267fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52848/0 (socket says 172.21.15.133:52848) 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d267fc640 1 -- 172.21.15.133:0/2742002862 learned_addr learned my addr 172.21.15.133:0/2742002862 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa79b8b0 0x55b8fa9e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d2f7fe640 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 0x55b8fa9e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d267fc640 1 -- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 msgr2=0x55b8fa9e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 0x55b8fa9e3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d267fc640 1 -- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa79b8b0 msgr2=0x55b8fa9e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa79b8b0 0x55b8fa9e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.056+0000 7f7d267fc640 1 -- 172.21.15.133:0/2742002862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d30071b50 con 0x55b8fa99cf60 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d267fc640 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e3130 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f7d20052030 tx=0x7f7d200012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd52f9eccfe6fc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2742002862 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200503f0 con 0x55b8fa99cf60 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2742002862 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d20050550 con 0x55b8fa99cf60 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 -- 172.21.15.133:0/2742002862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8fa9a08e0 con 0x55b8fa99cf60 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2742002862 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d200531d0 con 0x55b8fa99cf60 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 10 client.9471 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 -- 172.21.15.133:0/2742002862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55b8fa78b0b0 con 0x55b8fa99cf60 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2742002862 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b8fa9a08e0 con 0x55b8fa99cf60 2023-12-18T10:25:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2742002862 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f7d2005b830 con 0x55b8fa99cf60 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 10 client.9471 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 10 client.9471 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 20 client.9471 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55b8fa9e7540 0x55b8fa9e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 4 client.9471 mds_command: new command op to 9048 tid=0[{"prefix": "scrub pause"}] 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 -- 172.21.15.133:0/2742002862 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x55b8fa7b5640 con 0x55b8fa9e7540 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55b8fa9e7540 0x55b8fa9e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 10 client.9471 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d2effd640 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55b8fa9e7540 0x55b8fa9e3bb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d232c24abc37a4d server_cookie=bdf4f1fa40a3f1f3 in_seq=0 out_seq=0 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 1 -- 172.21.15.133:0/2742002862 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55b8fa7b5640 con 0x55b8fa9e7540 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 10 client.9471 handle_command_reply: tid=0 2023-12-18T10:25:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 client.9471 shutdown 2023-12-18T10:25:54.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 -- 172.21.15.133:0/2742002862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 msgr2=0x55b8fa9e3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e3130 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f7d20052030 tx=0x7f7d200012f0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 -- 172.21.15.133:0/2742002862 shutdown_connections 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55b8fa9e7540 0x55b8fa9e3bb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55b8fa9e6c20 0x55b8fa9e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b8fa99cf60 0x55b8fa9e3130 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d0dffb640 0 client.9471 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 --2- 172.21.15.133:0/2742002862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b8fa79b8b0 0x55b8fa9e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 -- 172.21.15.133:0/2742002862 >> 172.21.15.133:0/2742002862 conn(0x55b8fa9a2680 msgr2=0x55b8fa9f90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 -- 172.21.15.133:0/2742002862 shutdown_connections 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 1 -- 172.21.15.133:0/2742002862 wait complete. 2023-12-18T10:25:54.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d385cf000 20 client.9471 trim_cache size 0 max 16384 2023-12-18T10:25:54.066 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:54.066 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:25:54.066 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 -- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d10065a60 msgr2=0x7f7d10067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d10065a60 0x7f7d10067f20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7d300b0eb0 tx=0x7f7d18008040 comp rx=0 tx=0).stop 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 -- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300ce590 msgr2=0x7f7d300acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300ce590 0x7f7d300acc20 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000c4d0 tx=0x7f7d2000c990 comp rx=0 tx=0).stop 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 -- 172.21.15.133:0/2531098471 shutdown_connections 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d10065a60 0x7f7d10067f20 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d301593f0 0x7f7d3014b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d300ce590 0x7f7d300acc20 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 --2- 172.21.15.133:0/2531098471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d300b1c70 0x7f7d301497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 -- 172.21.15.133:0/2531098471 >> 172.21.15.133:0/2531098471 conn(0x7f7d3006d8d0 msgr2=0x7f7d3015aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 -- 172.21.15.133:0/2531098471 shutdown_connections 2023-12-18T10:25:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.060+0000 7f7d35266640 1 -- 172.21.15.133:0/2531098471 wait complete. 2023-12-18T10:25:54.081 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2023-12-18T10:25:54.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cbb117640 1 Processor -- start 2023-12-18T10:25:54.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cbb117640 1 -- start start 2023-12-18T10:25:54.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cbb117640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2cb40ca410 0x7f2cb4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cbb117640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40cbff0 0x7f2cb40cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cbb117640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40cc930 con 0x7f2cb4159fb0 2023-12-18T10:25:54.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cbb117640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb415aab0 con 0x7f2cb40ca410 2023-12-18T10:25:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cbb117640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4070df0 con 0x7f2cb40cbff0 2023-12-18T10:25:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb96b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40cbff0 0x7f2cb40cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb8eb3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2cb40ca410 0x7f2cb4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb96b4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40cbff0 0x7f2cb40cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:35994/0 (socket says 172.21.15.133:35994) 2023-12-18T10:25:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb3fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2cb4159fb0 0x7f2cb4071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:48232/0 (socket says 172.21.15.133:48232) 2023-12-18T10:25:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb96b4640 1 -- 172.21.15.133:0/2999975858 learned_addr learned my addr 172.21.15.133:0/2999975858 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb96b4640 1 -- 172.21.15.133:0/2999975858 >> v2:172.21.15.142:3300/0 conn(0x7f2cb40ca410 msgr2=0x7f2cb4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/2999975858 >> v2:172.21.15.142:3300/0 conn(0x7f2cb40ca410 0x7f2cb4159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb96b4640 1 -- 172.21.15.133:0/2999975858 >> v1:172.21.15.142:6789/0 conn(0x7f2cb4159fb0 legacy=0x7f2cb4071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb96b4640 1 -- 172.21.15.133:0/2999975858 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb415a4f0 con 0x7f2cb40cbff0 2023-12-18T10:25:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.220+0000 7f2cb37fe640 1 -- 172.21.15.133:0/2999975858 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657999744 0 0) 0x7f2cb40cc930 con 0x7f2cb4159fb0 2023-12-18T10:25:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/2999975858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40cbff0 0x7f2cb40cc3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e50 tx=0x7f2cac01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1043845dc040af82 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cb37fe640 1 -- 172.21.15.133:0/2999975858 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0a58a0 con 0x7f2cb40cbff0 2023-12-18T10:25:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cb37fe640 1 -- 172.21.15.133:0/2999975858 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac0a5a00 con 0x7f2cb40cbff0 2023-12-18T10:25:54.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cb37fe640 1 -- 172.21.15.133:0/2999975858 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0a5d90 con 0x7f2cb40cbff0 2023-12-18T10:25:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cbb117640 1 -- 172.21.15.133:0/2999975858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40cbff0 msgr2=0x7f2cb40cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2999975858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40cbff0 0x7f2cb40cc3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e50 tx=0x7f2cac01c9e0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cbb117640 1 -- 172.21.15.133:0/2999975858 shutdown_connections 2023-12-18T10:25:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2999975858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb40cbff0 0x7f2cb40cc3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2999975858 >> v2:172.21.15.142:3300/0 conn(0x7f2cb40ca410 0x7f2cb4159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cbb117640 1 -- 172.21.15.133:0/2999975858 >> 172.21.15.133:0/2999975858 conn(0x7f2cb406a2a0 msgr2=0x7f2cb40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cbb117640 1 -- 172.21.15.133:0/2999975858 shutdown_connections 2023-12-18T10:25:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.224+0000 7f2cbb117640 1 -- 172.21.15.133:0/2999975858 wait complete. 2023-12-18T10:25:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cbb117640 1 Processor -- start 2023-12-18T10:25:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cbb117640 1 -- start start 2023-12-18T10:25:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cbb117640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb40ca410 0x7f2cb4157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cbb117640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40cbff0 0x7f2cb41f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cbb117640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4159fb0 0x7f2cb41f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cbb117640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb41581f0 con 0x7f2cb40ca410 2023-12-18T10:25:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cbb117640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb41585b0 con 0x7f2cb40cbff0 2023-12-18T10:25:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cbb117640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4158890 con 0x7f2cb4159fb0 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb40ca410 0x7f2cb4157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb40ca410 0x7f2cb4157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52864/0 (socket says 172.21.15.133:52864) 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 -- 172.21.15.133:0/2636636018 learned_addr learned my addr 172.21.15.133:0/2636636018 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4159fb0 0x7f2cb41f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40cbff0 0x7f2cb41f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 -- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4159fb0 msgr2=0x7f2cb41f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4159fb0 0x7f2cb41f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 -- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40cbff0 msgr2=0x7f2cb41f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40cbff0 0x7f2cb41f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 -- 172.21.15.133:0/2636636018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009b30 con 0x7f2cb40ca410 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40cbff0 0x7f2cb41f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb40ca410 0x7f2cb4157af0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800e9d0 tx=0x7f2ca800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.228+0000 7f2cb17fa640 1 -- 172.21.15.133:0/2636636018 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800de60 con 0x7f2cb40ca410 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cb17fa640 1 -- 172.21.15.133:0/2636636018 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8010440 con 0x7f2cb40ca410 2023-12-18T10:25:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cbb117640 1 -- 172.21.15.133:0/2636636018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb4158b70 con 0x7f2cb40ca410 2023-12-18T10:25:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cb17fa640 1 -- 172.21.15.133:0/2636636018 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80107b0 con 0x7f2cb40ca410 2023-12-18T10:25:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cbb117640 1 -- 172.21.15.133:0/2636636018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb4159370 con 0x7f2cb40ca410 2023-12-18T10:25:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cb17fa640 1 -- 172.21.15.133:0/2636636018 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ca8010910 con 0x7f2cb40ca410 2023-12-18T10:25:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cb17fa640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c98065a60 0x7f2c98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cb17fa640 1 -- 172.21.15.133:0/2636636018 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ca8083770 con 0x7f2cb40ca410 2023-12-18T10:25:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c98065a60 0x7f2c98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cbe477000 1 Processor -- start 2023-12-18T10:25:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cbe477000 1 -- start start 2023-12-18T10:25:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.232+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c98065a60 0x7f2c98067f20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40c51b0 tx=0x7f2ca0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3889060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb383ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb383f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb3707430 con 0x55abb38895a0 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb3695460 con 0x55abb3888c80 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55abb3692a30 con 0x55abb383efc0 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb383ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb383ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52866/0 (socket says 172.21.15.133:52866) 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 -- 172.21.15.133:0/3632823878 learned_addr learned my addr 172.21.15.133:0/3632823878 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb383f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3889060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 -- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 msgr2=0x55abb383f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb383f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 -- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 msgr2=0x55abb3889060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3889060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 -- 172.21.15.133:0/3632823878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abb338ae20 con 0x55abb38895a0 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb383f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb383ea80 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40ccac0 tx=0x7f2ca0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6b1e42c776dd6c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2c9e7fc640 1 -- 172.21.15.133:0/3632823878 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000d9a0 con 0x55abb38895a0 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2c9e7fc640 1 -- 172.21.15.133:0/3632823878 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca000db00 con 0x55abb38895a0 2023-12-18T10:25:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2c9e7fc640 1 -- 172.21.15.133:0/3632823878 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000de90 con 0x55abb38895a0 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- 172.21.15.133:0/3632823878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 msgr2=0x55abb383ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb383ea80 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40ccac0 tx=0x7f2ca0010000 comp rx=0 tx=0).stop 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- 172.21.15.133:0/3632823878 shutdown_connections 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb383f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb383ea80 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3632823878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3889060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- 172.21.15.133:0/3632823878 >> 172.21.15.133:0/3632823878 conn(0x55abb363d910 msgr2=0x55abb383d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- 172.21.15.133:0/3632823878 shutdown_connections 2023-12-18T10:25:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- 172.21.15.133:0/3632823878 wait complete. 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 -- start start 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.236+0000 7f2cbe477000 1 Processor -- start 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb38900c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3890600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb3889980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb368e320 con 0x55abb38895a0 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb362d4f0 con 0x55abb3888c80 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55abb364b6e0 con 0x55abb383efc0 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 10 client.0 _ll_register_callbacks cb 0x55abb382a980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb3889980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb3889980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52880/0 (socket says 172.21.15.133:52880) 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 -- 172.21.15.133:0/3274403248 learned_addr learned my addr 172.21.15.133:0/3274403248 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3890600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb38900c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 -- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 msgr2=0x55abb38900c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb38900c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 -- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 msgr2=0x55abb3890600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3890600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 -- 172.21.15.133:0/3274403248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca00070d0 con 0x55abb38895a0 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb38900c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3890600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb3889980 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f2cac01a610 tx=0x7f2cac01b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9de686889d3d6c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 1 -- 172.21.15.133:0/3274403248 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0039a0 con 0x55abb38895a0 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 1 -- 172.21.15.133:0/3274403248 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2cac0c1c20 con 0x55abb38895a0 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 -- 172.21.15.133:0/3274403248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abb364b120 con 0x55abb38895a0 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 1 -- 172.21.15.133:0/3274403248 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cac0c1de0 con 0x55abb38895a0 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 10 client.9480 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:54.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 -- 172.21.15.133:0/3274403248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55abb3653250 con 0x55abb38895a0 2023-12-18T10:25:54.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 1 -- 172.21.15.133:0/3274403248 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abb364b120 con 0x55abb38895a0 2023-12-18T10:25:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 1 -- 172.21.15.133:0/3274403248 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f2cac0be030 con 0x55abb38895a0 2023-12-18T10:25:54.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 10 client.9480 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 10 client.9480 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 20 client.9480 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55abb388a720 0x55abb388ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 4 client.9480 mds_command: new command op to 9042 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 -- 172.21.15.133:0/3274403248 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abb368cc70 con 0x55abb388a720 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55abb388a720 0x55abb388ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 10 client.9480 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55abb388a720 0x55abb388ab30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=922baac19902c1e9 server_cookie=4ad0161a9b77467f in_seq=0 out_seq=0 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 1 -- 172.21.15.133:0/3274403248 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55abb368cc70 con 0x55abb388a720 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2c937fe640 10 client.9480 handle_command_reply: tid=0 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.240+0000 7f2cbe477000 1 client.9480 shutdown 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 -- 172.21.15.133:0/3274403248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 msgr2=0x55abb3889980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb3889980 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f2cac01a610 tx=0x7f2cac01b220 comp rx=0 tx=0).stop 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 -- 172.21.15.133:0/3274403248 shutdown_connections 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55abb388a720 0x55abb388ab30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb3889980 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb3888c80 0x55abb3890600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3274403248 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb383efc0 0x55abb38900c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2c937fe640 0 client.9480 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 -- 172.21.15.133:0/3274403248 >> 172.21.15.133:0/3274403248 conn(0x55abb363d910 msgr2=0x55abb383da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 -- 172.21.15.133:0/3274403248 shutdown_connections 2023-12-18T10:25:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 1 -- 172.21.15.133:0/3274403248 wait complete. 2023-12-18T10:25:54.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.244+0000 7f2cbe477000 20 client.9480 trim_cache size 0 max 16384 2023-12-18T10:25:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cbe477000 1 Processor -- start 2023-12-18T10:25:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cbe477000 1 -- start start 2023-12-18T10:25:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb383efc0 0x55abb3888490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 0x55abb388db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38895a0 0x55abb388e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cbe477000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb334baa0 con 0x55abb383efc0 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cbe477000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb3692320 con 0x55abb38895a0 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cbe477000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55abb3896140 con 0x55abb3888c80 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cb8eb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb383efc0 0x55abb3888490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cb8eb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb383efc0 0x55abb3888490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52884/0 (socket says 172.21.15.133:52884) 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cb8eb3640 1 -- 172.21.15.133:0/1329046383 learned_addr learned my addr 172.21.15.133:0/1329046383 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cb8eb3640 1 -- 172.21.15.133:0/1329046383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 msgr2=0x55abb388db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/1329046383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 0x55abb388db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cb8eb3640 1 -- 172.21.15.133:0/1329046383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38895a0 msgr2=0x55abb388e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/1329046383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38895a0 0x55abb388e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.256+0000 7f2cb8eb3640 1 -- 172.21.15.133:0/1329046383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abb36395a0 con 0x55abb383efc0 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/1329046383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb383efc0 0x55abb3888490 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8054980 tx=0x7f2ca8083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e288d2557f34d84 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2c9effd640 1 -- 172.21.15.133:0/1329046383 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8081bb0 con 0x55abb383efc0 2023-12-18T10:25:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2c9effd640 1 -- 172.21.15.133:0/1329046383 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8053020 con 0x55abb383efc0 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2c9effd640 1 -- 172.21.15.133:0/1329046383 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8051390 con 0x55abb383efc0 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- 172.21.15.133:0/1329046383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb383efc0 msgr2=0x55abb3888490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 --2- 172.21.15.133:0/1329046383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb383efc0 0x55abb3888490 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8054980 tx=0x7f2ca8083040 comp rx=0 tx=0).stop 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- 172.21.15.133:0/1329046383 shutdown_connections 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 --2- 172.21.15.133:0/1329046383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38895a0 0x55abb388e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 --2- 172.21.15.133:0/1329046383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 0x55abb388db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 --2- 172.21.15.133:0/1329046383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb383efc0 0x55abb3888490 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- 172.21.15.133:0/1329046383 >> 172.21.15.133:0/1329046383 conn(0x55abb363d910 msgr2=0x55abb38446a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- 172.21.15.133:0/1329046383 shutdown_connections 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- 172.21.15.133:0/1329046383 wait complete. 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- start start 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 Processor -- start 2023-12-18T10:25:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 0x55abb38c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb38ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38cabf0 0x55abb38cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb368bb30 con 0x55abb38895a0 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abb36d14d0 con 0x55abb38cabf0 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55abb3896a10 con 0x55abb3888c80 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cbe477000 10 client.0 _ll_register_callbacks cb 0x55abb3645710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb38ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb38ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52900/0 (socket says 172.21.15.133:52900) 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb3fff640 1 -- 172.21.15.133:0/3614758743 learned_addr learned my addr 172.21.15.133:0/3614758743 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 0x55abb38c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb96b4640 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38cabf0 0x55abb38cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb3fff640 1 -- 172.21.15.133:0/3614758743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 msgr2=0x55abb38c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 0x55abb38c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb3fff640 1 -- 172.21.15.133:0/3614758743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38cabf0 msgr2=0x55abb38cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38cabf0 0x55abb38cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.260+0000 7f2cb3fff640 1 -- 172.21.15.133:0/3614758743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb4159370 con 0x55abb38895a0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cb3fff640 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb38ca6b0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0005bf0 tx=0x7f2ca0001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467158b85d2b1c0a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 1 -- 172.21.15.133:0/3614758743 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0020860 con 0x55abb38895a0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 1 -- 172.21.15.133:0/3614758743 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ca002ec10 con 0x55abb38895a0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 -- 172.21.15.133:0/3614758743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abb3842940 con 0x55abb38895a0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 1 -- 172.21.15.133:0/3614758743 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca000d5c0 con 0x55abb38895a0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 10 client.9486 fetch_fsmap learned FSMap version 110 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 -- 172.21.15.133:0/3614758743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55abb362d110 con 0x55abb38895a0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 1 -- 172.21.15.133:0/3614758743 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55abb3842940 con 0x55abb38895a0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 1 -- 172.21.15.133:0/3614758743 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 110) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f2ca002b070 con 0x55abb38895a0 2023-12-18T10:25:54.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 10 client.9486 fetch_fsmap finished waiting for FSMap version 110 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 10 client.9486 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 20 client.9486 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55abb38cb510 0x55abb38cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 4 client.9486 mds_command: new command op to 9042 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 -- 172.21.15.133:0/3614758743 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55abb36576a0 con 0x55abb38cb510 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55abb38cb510 0x55abb38cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cb8eb3640 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55abb38cb510 0x55abb38cb920 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51de42a7665c557e server_cookie=b024cf3ec0b3e715 in_seq=0 out_seq=0 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 10 client.9486 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 1 -- 172.21.15.133:0/3614758743 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55abb36576a0 con 0x55abb38cb510 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 10 client.9486 handle_command_reply: tid=0 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 client.9486 shutdown 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 -- 172.21.15.133:0/3614758743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 msgr2=0x55abb38ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb38ca6b0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0005bf0 tx=0x7f2ca0001090 comp rx=0 tx=0).stop 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 -- 172.21.15.133:0/3614758743 shutdown_connections 2023-12-18T10:25:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x55abb38cb510 0x55abb38cb920 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55abb38cabf0 0x55abb38cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55abb38895a0 0x55abb38ca6b0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2c937fe640 0 client.9486 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 --2- 172.21.15.133:0/3614758743 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55abb3888c80 0x55abb38c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 -- 172.21.15.133:0/3614758743 >> 172.21.15.133:0/3614758743 conn(0x55abb363d910 msgr2=0x55abb388cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 -- 172.21.15.133:0/3614758743 shutdown_connections 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 1 -- 172.21.15.133:0/3614758743 wait complete. 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.264+0000 7f2cbe477000 20 client.9486 trim_cache size 0 max 16384 2023-12-18T10:25:54.272 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:54.273 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 -- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c98065a60 msgr2=0x7f2c98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c98065a60 0x7f2c98067f20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40c51b0 tx=0x7f2ca0009040 comp rx=0 tx=0).stop 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 -- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb40ca410 msgr2=0x7f2cb4157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb40ca410 0x7f2cb4157af0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800e9d0 tx=0x7f2ca800ee90 comp rx=0 tx=0).stop 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 -- 172.21.15.133:0/2636636018 shutdown_connections 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2c98065a60 0x7f2c98067f20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cb4159fb0 0x7f2cb41f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cb40cbff0 0x7f2cb41f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 --2- 172.21.15.133:0/2636636018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb40ca410 0x7f2cb4157af0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 -- 172.21.15.133:0/2636636018 >> 172.21.15.133:0/2636636018 conn(0x7f2cb406a2a0 msgr2=0x7f2cb40c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 -- 172.21.15.133:0/2636636018 shutdown_connections 2023-12-18T10:25:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.268+0000 7f2cbb117640 1 -- 172.21.15.133:0/2636636018 wait complete. 2023-12-18T10:25:54.287 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:54.288 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2023-12-18T10:25:54.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.424+0000 7fe2f8efc640 1 Processor -- start 2023-12-18T10:25:54.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.424+0000 7fe2f8efc640 1 -- start start 2023-12-18T10:25:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f8efc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f41582d0 0x7fe2f40c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f8efc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40c9390 con 0x7fe2f40ce3b0 2023-12-18T10:25:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f8efc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f415aee0 con 0x7fe2f4070820 2023-12-18T10:25:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f8efc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f415b1c0 con 0x7fe2f41582d0 2023-12-18T10:25:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f2d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe2f40ce3b0 0x7fe2f40cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60912/0 (socket says 172.21.15.133:60912) 2023-12-18T10:25:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/3619062193 learned_addr learned my addr 172.21.15.133:0/3619062193 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f259c640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f41582d0 0x7fe2f40c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234037401 0 0) 0x7fe2f40c9390 con 0x7fe2f40ce3b0 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e0003530 con 0x7fe2f40ce3b0 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859477530 0 0) 0x7fe2f415aee0 con 0x7fe2f4070820 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f40c9390 con 0x7fe2f4070820 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 819379567 0 0) 0x7fe2e0003530 con 0x7fe2f40ce3b0 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f41582d0 msgr2=0x7fe2f40c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f41582d0 0x7fe2f40c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 >> v1:172.21.15.142:6789/0 conn(0x7fe2f4070820 legacy=0x7fe2f40ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f415b4a0 con 0x7fe2f40ce3b0 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fe2ec001680 con 0x7fe2f40ce3b0 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 >> v1:172.21.15.133:6789/0 conn(0x7fe2f40ce3b0 legacy=0x7fe2f40cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2e0003b40 0x7fe2e0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e00047d0 0x7fe2e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e0005190 0x7fe2e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f415b1c0 con 0x7fe2e00047d0 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e000bf80 con 0x7fe2e0003b40 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e000c140 con 0x7fe2e0005190 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f259c640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2f41582d0 0x7fe2f40c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e00047d0 0x7fe2e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e0005190 0x7fe2e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2f259c640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2e0003b40 0x7fe2e0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e0005190 msgr2=0x7fe2e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e0005190 0x7fe2e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2e0003b40 msgr2=0x7fe2e0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2e0003b40 0x7fe2e0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.428+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/3619062193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0003530 con 0x7fe2e00047d0 2023-12-18T10:25:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e00047d0 0x7fe2e0004c50 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc001fd0 tx=0x7fe2dc01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265b548852a8b1f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0a8c70 con 0x7fe2e00047d0 2023-12-18T10:25:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0a8df0 con 0x7fe2e00047d0 2023-12-18T10:25:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f1d9b640 1 -- 172.21.15.133:0/3619062193 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc003bc0 con 0x7fe2e00047d0 2023-12-18T10:25:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f8efc640 1 -- 172.21.15.133:0/3619062193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e00047d0 msgr2=0x7fe2e0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f8efc640 1 --2- 172.21.15.133:0/3619062193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e00047d0 0x7fe2e0004c50 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc001fd0 tx=0x7fe2dc01f050 comp rx=0 tx=0).stop 2023-12-18T10:25:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/3619062193 reap_dead start 2023-12-18T10:25:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f8efc640 1 -- 172.21.15.133:0/3619062193 shutdown_connections 2023-12-18T10:25:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f8efc640 1 -- 172.21.15.133:0/3619062193 >> 172.21.15.133:0/3619062193 conn(0x7fe2f406a2a0 msgr2=0x7fe2f40aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f8efc640 1 -- 172.21.15.133:0/3619062193 shutdown_connections 2023-12-18T10:25:54.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.432+0000 7fe2f8efc640 1 -- 172.21.15.133:0/3619062193 wait complete. 2023-12-18T10:25:54.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 Processor -- start 2023-12-18T10:25:54.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 -- start start 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e00047d0 0x7fe2f4152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f40c6410 0x7fe2f40c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f40c7230 0x7fe2f41598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f41533f0 con 0x7fe2f40c7230 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40c76c0 con 0x7fe2f40c6410 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f415a4f0 con 0x7fe2e00047d0 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f40c7230 0x7fe2f41598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f40c7230 0x7fe2f41598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52922/0 (socket says 172.21.15.133:52922) 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/683682908 learned_addr learned my addr 172.21.15.133:0/683682908 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f40c6410 0x7fe2f40c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f259c640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e00047d0 0x7fe2f4152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/683682908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e00047d0 msgr2=0x7fe2f4152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e00047d0 0x7fe2f4152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/683682908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f40c6410 msgr2=0x7fe2f40c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f40c6410 0x7fe2f40c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/683682908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40c5690 con 0x7fe2f40c7230 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f40c7230 0x7fe2f41598a0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40ce790 tx=0x7fe2ec007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2eb7fe640 1 -- 172.21.15.133:0/683682908 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00f8b0 con 0x7fe2f40c7230 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2eb7fe640 1 -- 172.21.15.133:0/683682908 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec00fa30 con 0x7fe2f40c7230 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 -- 172.21.15.133:0/683682908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f40c5930 con 0x7fe2f40c7230 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2eb7fe640 1 -- 172.21.15.133:0/683682908 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00fde0 con 0x7fe2f40c7230 2023-12-18T10:25:54.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.436+0000 7fe2f8efc640 1 -- 172.21.15.133:0/683682908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f40c5ef0 con 0x7fe2f40c7230 2023-12-18T10:25:54.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2eb7fe640 1 -- 172.21.15.133:0/683682908 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe2ec01c3b0 con 0x7fe2f40c7230 2023-12-18T10:25:54.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2eb7fe640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2d4065a90 0x7fe2d4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2eb7fe640 1 -- 172.21.15.133:0/683682908 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2ec082830 con 0x7fe2f40c7230 2023-12-18T10:25:54.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2f259c640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2d4065a90 0x7fe2d4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2fc260000 1 Processor -- start 2023-12-18T10:25:54.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2f259c640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2d4065a90 0x7fe2d4067f50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40cf000 tx=0x7fe2e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2fc260000 1 -- start start 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16662b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec16667f0 0x55fec161be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec161c3d0 0x55fec161c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2fc260000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec14e0430 con 0x55fec161c3d0 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2fc260000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec146e460 con 0x55fec16667f0 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2fc260000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fec146ba30 con 0x55fec1665ed0 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2f2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec161c3d0 0x55fec161c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2f259c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2f2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec161c3d0 0x55fec161c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52938/0 (socket says 172.21.15.133:52938) 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/116192290 learned_addr learned my addr 172.21.15.133:0/116192290 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.440+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/116192290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec16667f0 0x55fec161be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/116192290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 msgr2=0x55fec16662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/116192290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/116192290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec16667f0 msgr2=0x55fec161be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/116192290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec16667f0 0x55fec161be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/116192290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fec1163e20 con 0x55fec161c3d0 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/116192290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec161c3d0 0x55fec161c7b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec05b760 tx=0x7fe2ec0538a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca8682ab5fff2bb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2d3fff640 1 -- 172.21.15.133:0/116192290 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec057ae0 con 0x55fec161c3d0 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2d3fff640 1 -- 172.21.15.133:0/116192290 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec05bc90 con 0x55fec161c3d0 2023-12-18T10:25:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2d3fff640 1 -- 172.21.15.133:0/116192290 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec050470 con 0x55fec161c3d0 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- 172.21.15.133:0/116192290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec161c3d0 msgr2=0x55fec161c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 --2- 172.21.15.133:0/116192290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec161c3d0 0x55fec161c7b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec05b760 tx=0x7fe2ec0538a0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- 172.21.15.133:0/116192290 shutdown_connections 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 --2- 172.21.15.133:0/116192290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec161c3d0 0x55fec161c7b0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 --2- 172.21.15.133:0/116192290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec16667f0 0x55fec161be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 --2- 172.21.15.133:0/116192290 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- 172.21.15.133:0/116192290 >> 172.21.15.133:0/116192290 conn(0x55fec1416910 msgr2=0x55fec1616360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- 172.21.15.133:0/116192290 shutdown_connections 2023-12-18T10:25:54.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- 172.21.15.133:0/116192290 wait complete. 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- start start 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 Processor -- start 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1653230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec1666bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec1667110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1467320 con 0x55fec1665ed0 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec14064f0 con 0x55fec161c3d0 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fec14246e0 con 0x55fec16667f0 2023-12-18T10:25:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.444+0000 7fe2fc260000 10 client.0 _ll_register_callbacks cb 0x55fec1603980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec1666bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec1666bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52944/0 (socket says 172.21.15.133:52944) 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/4222862142 learned_addr learned my addr 172.21.15.133:0/4222862142 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec1667110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2f259c640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1653230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 msgr2=0x55fec1667110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec1667110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 msgr2=0x55fec1653230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1653230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/4222862142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f40c5ef0 con 0x55fec1665ed0 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec1667110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2f259c640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1653230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec1666bd0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc005040 tx=0x7fe2dc01bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6b7fa07962c72b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 1 -- 172.21.15.133:0/4222862142 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc003980 con 0x55fec1665ed0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 1 -- 172.21.15.133:0/4222862142 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2dc003ae0 con 0x55fec1665ed0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 -- 172.21.15.133:0/4222862142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fec1424120 con 0x55fec1665ed0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 1 -- 172.21.15.133:0/4222862142 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2dc003ca0 con 0x55fec1665ed0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 10 client.9498 fetch_fsmap learned FSMap version 111 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 -- 172.21.15.133:0/4222862142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55fec142c250 con 0x55fec1665ed0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 1 -- 172.21.15.133:0/4222862142 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fec1424120 con 0x55fec1665ed0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 1 -- 172.21.15.133:0/4222862142 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 111) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe2dc005070 con 0x55fec1665ed0 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 10 client.9498 fetch_fsmap finished waiting for FSMap version 111 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 10 client.9498 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 20 client.9498 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55fec1667b20 0x55fec1667f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 4 client.9498 mds_command: new command op to 9039 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 -- 172.21.15.133:0/4222862142 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fec1465c70 con 0x55fec1667b20 2023-12-18T10:25:54.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2f259c640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55fec1667b20 0x55fec1667f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2f259c640 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55fec1667b20 0x55fec1667f30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b12f84d108b61a5a server_cookie=a4d86b8f659bfa9d in_seq=0 out_seq=0 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 10 client.9498 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 1 -- 172.21.15.133:0/4222862142 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55fec1465c70 con 0x55fec1667b20 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 10 client.9498 handle_command_reply: tid=0 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 client.9498 shutdown 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 -- 172.21.15.133:0/4222862142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 msgr2=0x55fec1666bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec1666bd0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc005040 tx=0x7fe2dc01bdf0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 -- 172.21.15.133:0/4222862142 shutdown_connections 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55fec1667b20 0x55fec1667f30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec1667110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec1666bd0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 --2- 172.21.15.133:0/4222862142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1653230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2d17fa640 0 client.9498 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 -- 172.21.15.133:0/4222862142 >> 172.21.15.133:0/4222862142 conn(0x55fec1416910 msgr2=0x55fec1615ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 -- 172.21.15.133:0/4222862142 shutdown_connections 2023-12-18T10:25:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 1 -- 172.21.15.133:0/4222862142 wait complete. 2023-12-18T10:25:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.448+0000 7fe2fc260000 20 client.9498 trim_cache size 0 max 16384 2023-12-18T10:25:54.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2fc260000 1 Processor -- start 2023-12-18T10:25:54.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2fc260000 1 -- start start 2023-12-18T10:25:54.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec16be250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec16667f0 0x55fec16becd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2fc260000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1124aa0 con 0x55fec16667f0 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2fc260000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec146b320 con 0x55fec161c3d0 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2fc260000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fec1425480 con 0x55fec1665ed0 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec16667f0 0x55fec16becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec16667f0 0x55fec16becd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52956/0 (socket says 172.21.15.133:52956) 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/2269972519 learned_addr learned my addr 172.21.15.133:0/2269972519 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f259c640 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec16be250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 msgr2=0x55fec16be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16be790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 msgr2=0x55fec16be250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec16be250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 -- 172.21.15.133:0/2269972519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fec14125a0 con 0x55fec16667f0 2023-12-18T10:25:54.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:54.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f259c640 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec16be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:54.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec16667f0 0x55fec16becd0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec081fd0 tx=0x7fe2ec082070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0116d147014fb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2e8d99640 1 -- 172.21.15.133:0/2269972519 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec05bc90 con 0x55fec16667f0 2023-12-18T10:25:54.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2e8d99640 1 -- 172.21.15.133:0/2269972519 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec057ae0 con 0x55fec16667f0 2023-12-18T10:25:54.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.464+0000 7fe2e8d99640 1 -- 172.21.15.133:0/2269972519 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec052100 con 0x55fec16667f0 2023-12-18T10:25:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- 172.21.15.133:0/2269972519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec16667f0 msgr2=0x55fec16becd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec16667f0 0x55fec16becd0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec081fd0 tx=0x7fe2ec082070 comp rx=0 tx=0).stop 2023-12-18T10:25:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- 172.21.15.133:0/2269972519 shutdown_connections 2023-12-18T10:25:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec16667f0 0x55fec16becd0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec1665ed0 0x55fec16be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2269972519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec16be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- 172.21.15.133:0/2269972519 >> 172.21.15.133:0/2269972519 conn(0x55fec1416910 msgr2=0x55fec1615ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- 172.21.15.133:0/2269972519 shutdown_connections 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- 172.21.15.133:0/2269972519 wait complete. 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- start start 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 Processor -- start 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1652eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec16a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec16a7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec1623950 con 0x55fec1665ed0 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec146f6f0 con 0x55fec161c3d0 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fec1469e80 con 0x55fec16667f0 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 10 client.0 _ll_register_callbacks cb 0x55fec141e710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec16a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec16a72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52962/0 (socket says 172.21.15.133:52962) 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/2619505171 learned_addr learned my addr 172.21.15.133:0/2619505171 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2f259c640 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1652eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2f2d9d640 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec16a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/2619505171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 msgr2=0x55fec16a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec16a7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/2619505171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 msgr2=0x55fec1652eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1652eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 -- 172.21.15.133:0/2619505171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fec1163e20 con 0x55fec1665ed0 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2e9d9b640 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec16a72f0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc01f8f0 tx=0x7fe2dc0aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa12682fb4c89bd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2d17fa640 1 -- 172.21.15.133:0/2619505171 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc001dc0 con 0x55fec1665ed0 2023-12-18T10:25:54.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2d17fa640 1 -- 172.21.15.133:0/2619505171 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2dc005580 con 0x55fec1665ed0 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- 172.21.15.133:0/2619505171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fec14306a0 con 0x55fec1665ed0 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2d17fa640 1 -- 172.21.15.133:0/2619505171 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2dc007e00 con 0x55fec1665ed0 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 10 client.9504 fetch_fsmap learned FSMap version 111 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- 172.21.15.133:0/2619505171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x55fec1406110 con 0x55fec1665ed0 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2d17fa640 1 -- 172.21.15.133:0/2619505171 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fec14306a0 con 0x55fec1665ed0 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2d17fa640 1 -- 172.21.15.133:0/2619505171 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 111) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe2dc0d4070 con 0x55fec1665ed0 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 10 client.9504 fetch_fsmap finished waiting for FSMap version 111 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 10 client.9504 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 20 client.9504 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55fec16a7d70 0x55fec16c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 4 client.9504 mds_command: new command op to 9039 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.468+0000 7fe2fc260000 1 -- 172.21.15.133:0/2619505171 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fec14603a0 con 0x55fec16a7d70 2023-12-18T10:25:54.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f259c640 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55fec16a7d70 0x55fec16c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f259c640 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55fec16a7d70 0x55fec16c34b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=74070a87a46e20ed server_cookie=e65dd04718b647f5 in_seq=0 out_seq=0 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2d17fa640 10 client.9504 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2d17fa640 1 -- 172.21.15.133:0/2619505171 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55fec14603a0 con 0x55fec16a7d70 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2d17fa640 10 client.9504 handle_command_reply: tid=0 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 client.9504 shutdown 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 -- 172.21.15.133:0/2619505171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 msgr2=0x55fec16a72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec16a72f0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc01f8f0 tx=0x7fe2dc0aa000 comp rx=0 tx=0).stop 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 -- 172.21.15.133:0/2619505171 shutdown_connections 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55fec16a7d70 0x55fec16c34b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55fec16667f0 0x55fec16a7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55fec1665ed0 0x55fec16a72f0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 --2- 172.21.15.133:0/2619505171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fec161c3d0 0x55fec1652eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2d17fa640 0 client.9504 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 -- 172.21.15.133:0/2619505171 >> 172.21.15.133:0/2619505171 conn(0x55fec1416910 msgr2=0x55fec1616360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 -- 172.21.15.133:0/2619505171 shutdown_connections 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 1 -- 172.21.15.133:0/2619505171 wait complete. 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2fc260000 20 client.9504 trim_cache size 0 max 16384 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:54.477 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:54.478 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:54.478 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 -- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2d4065a90 msgr2=0x7fe2d4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2d4065a90 0x7fe2d4067f50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40cf000 tx=0x7fe2e4009190 comp rx=0 tx=0).stop 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 -- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f40c7230 msgr2=0x7fe2f41598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f40c7230 0x7fe2f41598a0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40ce790 tx=0x7fe2ec007720 comp rx=0 tx=0).stop 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 -- 172.21.15.133:0/683682908 shutdown_connections 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe2d4065a90 0x7fe2d4067f50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2f40c7230 0x7fe2f41598a0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe2f40c6410 0x7fe2f40c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 --2- 172.21.15.133:0/683682908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe2e00047d0 0x7fe2f4152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 -- 172.21.15.133:0/683682908 >> 172.21.15.133:0/683682908 conn(0x7fe2f406a2a0 msgr2=0x7fe2f40ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 -- 172.21.15.133:0/683682908 shutdown_connections 2023-12-18T10:25:54.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.472+0000 7fe2f8efc640 1 -- 172.21.15.133:0/683682908 wait complete. 2023-12-18T10:25:54.492 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:54.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-12-18T10:25:54.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a38841640 1 Processor -- start 2023-12-18T10:25:54.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a38841640 1 -- start start 2023-12-18T10:25:54.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a38841640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a34070820 0x7f7a340c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a38841640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a340c9390 con 0x7f7a340ce3b0 2023-12-18T10:25:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a38841640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3415aee0 con 0x7f7a341582d0 2023-12-18T10:25:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a38841640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3415b1c0 con 0x7f7a34070820 2023-12-18T10:25:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a29d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a34070820 0x7f7a340c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a32d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7a340ce3b0 0x7f7a340cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60918/0 (socket says 172.21.15.133:60918) 2023-12-18T10:25:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a32d9d640 1 -- 172.21.15.133:0/1775563183 learned_addr learned my addr 172.21.15.133:0/1775563183 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:54.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1775563183 >> v1:172.21.15.142:6789/0 conn(0x7f7a341582d0 legacy=0x7f7a340ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1775563183 >> v1:172.21.15.133:6789/0 conn(0x7f7a340ce3b0 legacy=0x7f7a340cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1775563183 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3415b4a0 con 0x7f7a34070820 2023-12-18T10:25:54.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.632+0000 7f7a31d9b640 1 -- 172.21.15.133:0/1775563183 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209025641 0 0) 0x7f7a340c9390 con 0x7f7a340ce3b0 2023-12-18T10:25:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1775563183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a340c8e50 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0097c0 tx=0x7f7a1c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0913601f89fb6f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a31d9b640 1 -- 172.21.15.133:0/1775563183 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0ab670 con 0x7f7a34070820 2023-12-18T10:25:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a31d9b640 1 -- 172.21.15.133:0/1775563183 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0ab7d0 con 0x7f7a34070820 2023-12-18T10:25:54.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a31d9b640 1 -- 172.21.15.133:0/1775563183 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0abb60 con 0x7f7a34070820 2023-12-18T10:25:54.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a38841640 1 -- 172.21.15.133:0/1775563183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 msgr2=0x7f7a340c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a38841640 1 --2- 172.21.15.133:0/1775563183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a340c8e50 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0097c0 tx=0x7f7a1c01c450 comp rx=0 tx=0).stop 2023-12-18T10:25:54.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a38841640 1 -- 172.21.15.133:0/1775563183 shutdown_connections 2023-12-18T10:25:54.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a38841640 1 --2- 172.21.15.133:0/1775563183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a340c8e50 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a38841640 1 -- 172.21.15.133:0/1775563183 >> 172.21.15.133:0/1775563183 conn(0x7f7a3406a2a0 msgr2=0x7f7a340aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a38841640 1 -- 172.21.15.133:0/1775563183 shutdown_connections 2023-12-18T10:25:54.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.636+0000 7f7a38841640 1 -- 172.21.15.133:0/1775563183 wait complete. 2023-12-18T10:25:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 Processor -- start 2023-12-18T10:25:54.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 -- start start 2023-12-18T10:25:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a3414d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a340ce3b0 0x7f7a34151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a341582d0 0x7f7a340cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c37f0 con 0x7f7a34070820 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414dd00 con 0x7f7a341582d0 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34152860 con 0x7f7a340ce3b0 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a3414d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a3414d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52974/0 (socket says 172.21.15.133:52974) 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 -- 172.21.15.133:0/1506540911 learned_addr learned my addr 172.21.15.133:0/1506540911 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a32d9d640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a341582d0 0x7f7a340cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a340ce3b0 0x7f7a34151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 -- 172.21.15.133:0/1506540911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a340ce3b0 msgr2=0x7f7a34151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a340ce3b0 0x7f7a34151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 -- 172.21.15.133:0/1506540911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a341582d0 msgr2=0x7f7a340cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a341582d0 0x7f7a340cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 -- 172.21.15.133:0/1506540911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c009420 con 0x7f7a34070820 2023-12-18T10:25:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a3259c640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a3414d7c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c7d0 tx=0x7f7a2400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a2b7fe640 1 -- 172.21.15.133:0/1506540911 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24003b80 con 0x7f7a34070820 2023-12-18T10:25:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a2b7fe640 1 -- 172.21.15.133:0/1506540911 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24003ce0 con 0x7f7a34070820 2023-12-18T10:25:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a2b7fe640 1 -- 172.21.15.133:0/1506540911 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400aa90 con 0x7f7a34070820 2023-12-18T10:25:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 -- 172.21.15.133:0/1506540911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a34152b40 con 0x7f7a34070820 2023-12-18T10:25:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.640+0000 7f7a38841640 1 -- 172.21.15.133:0/1506540911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a34152e20 con 0x7f7a34070820 2023-12-18T10:25:54.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.644+0000 7f7a2b7fe640 1 -- 172.21.15.133:0/1506540911 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7a2400abf0 con 0x7f7a34070820 2023-12-18T10:25:54.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.644+0000 7f7a2b7fe640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a14065a60 0x7f7a14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.644+0000 7f7a2b7fe640 1 -- 172.21.15.133:0/1506540911 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a24082ff0 con 0x7f7a34070820 2023-12-18T10:25:54.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.644+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a14065a60 0x7f7a14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.644+0000 7f7a3bbaa000 1 Processor -- start 2023-12-18T10:25:54.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.644+0000 7f7a3bbaa000 1 -- start start 2023-12-18T10:25:54.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.644+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a14065a60 0x7f7a14067f20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0af000 tx=0x7f7a1c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb3655c80 0x558eb3656060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb36565a0 0x558eb360ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 0x558eb360c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb34d4430 con 0x558eb36565a0 2023-12-18T10:25:54.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb3462460 con 0x558eb3655c80 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558eb345fa30 con 0x558eb360bfc0 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb36565a0 0x558eb360ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb36565a0 0x558eb360ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52978/0 (socket says 172.21.15.133:52978) 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1710447148 learned_addr learned my addr 172.21.15.133:0/1710447148 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3259c640 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb3655c80 0x558eb3656060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a32d9d640 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 0x558eb360c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1710447148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 msgr2=0x558eb360c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 0x558eb360c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1710447148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb3655c80 msgr2=0x558eb3656060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb3655c80 0x558eb3656060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1710447148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb3157e20 con 0x558eb36565a0 2023-12-18T10:25:54.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb36565a0 0x558eb360ba80 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c019060 tx=0x7f7a1c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e74040e8bd345b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a13fff640 1 -- 172.21.15.133:0/1710447148 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0b6b60 con 0x558eb36565a0 2023-12-18T10:25:54.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a13fff640 1 -- 172.21.15.133:0/1710447148 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0c6070 con 0x558eb36565a0 2023-12-18T10:25:54.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a13fff640 1 -- 172.21.15.133:0/1710447148 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0abe40 con 0x558eb36565a0 2023-12-18T10:25:54.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1710447148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb36565a0 msgr2=0x558eb360ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb36565a0 0x558eb360ba80 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c019060 tx=0x7f7a1c004740 comp rx=0 tx=0).stop 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1710447148 shutdown_connections 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 0x558eb360c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb36565a0 0x558eb360ba80 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1710447148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb3655c80 0x558eb3656060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1710447148 >> 172.21.15.133:0/1710447148 conn(0x558eb340a910 msgr2=0x558eb360a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1710447148 shutdown_connections 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1710447148 wait complete. 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 -- start start 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.648+0000 7f7a3bbaa000 1 Processor -- start 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb3655150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 0x558eb3656980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb3656ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb345b320 con 0x558eb360bfc0 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb33fa4f0 con 0x558eb36565a0 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558eb34186e0 con 0x558eb3655c80 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 10 client.0 _ll_register_callbacks cb 0x558eb35f7980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb3655150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb3655150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52982/0 (socket says 172.21.15.133:52982) 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 -- 172.21.15.133:0/3401805388 learned_addr learned my addr 172.21.15.133:0/3401805388 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 0x558eb3656980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a32d9d640 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb3656ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 -- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 msgr2=0x558eb3656980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 0x558eb3656980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 -- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 msgr2=0x558eb3656ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb3656ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 -- 172.21.15.133:0/3401805388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0bc070 con 0x558eb360bfc0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3259c640 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb3655150 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f7a240816f0 tx=0x7f7a240546c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2609ca34014db959 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 1 -- 172.21.15.133:0/3401805388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2405c020 con 0x558eb360bfc0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 1 -- 172.21.15.133:0/3401805388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a2405c180 con 0x558eb360bfc0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/3401805388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558eb3418120 con 0x558eb360bfc0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 1 -- 172.21.15.133:0/3401805388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a2405a0b0 con 0x558eb360bfc0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 10 client.9519 fetch_fsmap learned FSMap version 111 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/3401805388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x558eb3420250 con 0x558eb360bfc0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 1 -- 172.21.15.133:0/3401805388 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb3418120 con 0x558eb360bfc0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 1 -- 172.21.15.133:0/3401805388 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 111) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f7a24019020 con 0x558eb360bfc0 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 10 client.9519 fetch_fsmap finished waiting for FSMap version 111 2023-12-18T10:25:54.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 10 client.9519 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 20 client.9519 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x558eb36578d0 0x558eb3657ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 4 client.9519 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/3401805388 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558eb3459c70 con 0x558eb36578d0 2023-12-18T10:25:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x558eb36578d0 0x558eb3657ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x558eb36578d0 0x558eb3657ce0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1afb17424b64e4 server_cookie=93ade8eb2e77f7f4 in_seq=0 out_seq=0 2023-12-18T10:25:54.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 10 client.9519 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 1 -- 172.21.15.133:0/3401805388 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558eb3459c70 con 0x558eb36578d0 2023-12-18T10:25:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 10 client.9519 handle_command_reply: tid=0 2023-12-18T10:25:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 client.9519 shutdown 2023-12-18T10:25:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/3401805388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 msgr2=0x558eb3655150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb3655150 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f7a240816f0 tx=0x7f7a240546c0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/3401805388 shutdown_connections 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x558eb36578d0 0x558eb3657ce0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb3656ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 0x558eb3656980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a117fa640 0 client.9519 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/3401805388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb3655150 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/3401805388 >> 172.21.15.133:0/3401805388 conn(0x558eb340a910 msgr2=0x558eb360aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.652+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/3401805388 shutdown_connections 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.656+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/3401805388 wait complete. 2023-12-18T10:25:54.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.656+0000 7f7a3bbaa000 20 client.9519 trim_cache size 0 max 16384 2023-12-18T10:25:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3bbaa000 1 Processor -- start 2023-12-18T10:25:54.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3bbaa000 1 -- start start 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 0x558eb3663720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb3655c80 0x558eb3654040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb3654580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb3118aa0 con 0x558eb3655c80 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb345a040 con 0x558eb36565a0 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558eb3458b30 con 0x558eb360bfc0 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb3655c80 0x558eb3654040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb3655c80 0x558eb3654040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52998/0 (socket says 172.21.15.133:52998) 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1478514139 learned_addr learned my addr 172.21.15.133:0/1478514139 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a3259c640 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 0x558eb3663720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a32d9d640 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb3654580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1478514139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 msgr2=0x558eb3663720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 0x558eb3663720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1478514139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 msgr2=0x558eb3654580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb3654580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 -- 172.21.15.133:0/1478514139 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eb34065a0 con 0x558eb3655c80 2023-12-18T10:25:54.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.668+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb3655c80 0x558eb3654040 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c01c930 tx=0x7f7a1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5520f809fa762ecf server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a28d99640 1 -- 172.21.15.133:0/1478514139 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0b6ae0 con 0x558eb3655c80 2023-12-18T10:25:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a28d99640 1 -- 172.21.15.133:0/1478514139 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0c6040 con 0x558eb3655c80 2023-12-18T10:25:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a28d99640 1 -- 172.21.15.133:0/1478514139 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0b6e40 con 0x558eb3655c80 2023-12-18T10:25:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1478514139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb3655c80 msgr2=0x558eb3654040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb3655c80 0x558eb3654040 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c01c930 tx=0x7f7a1c008040 comp rx=0 tx=0).stop 2023-12-18T10:25:54.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1478514139 shutdown_connections 2023-12-18T10:25:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb3654580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb3655c80 0x558eb3654040 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1478514139 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb360bfc0 0x558eb3663720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1478514139 >> 172.21.15.133:0/1478514139 conn(0x558eb340a910 msgr2=0x558eb36625c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1478514139 shutdown_connections 2023-12-18T10:25:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1478514139 wait complete. 2023-12-18T10:25:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- start start 2023-12-18T10:25:54.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 Processor -- start 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb36967e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 0x558eb36971b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb36976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb3458720 con 0x558eb360bfc0 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eb360bae0 con 0x558eb36565a0 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x558eb3419480 con 0x558eb3655c80 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3bbaa000 10 client.0 _ll_register_callbacks cb 0x558eb3412710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb36967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb36967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53008/0 (socket says 172.21.15.133:53008) 2023-12-18T10:25:54.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 -- 172.21.15.133:0/1317270383 learned_addr learned my addr 172.21.15.133:0/1317270383 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 0x558eb36971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a32d9d640 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb36976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 -- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 msgr2=0x558eb36971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 0x558eb36971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 -- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 msgr2=0x558eb36976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb36976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 -- 172.21.15.133:0/1317270383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0cf040 con 0x558eb360bfc0 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a3259c640 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb36967e0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c7a0 tx=0x7f7a24057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d57f576de2fe1b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.672+0000 7f7a117fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 1 -- 172.21.15.133:0/1317270383 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24050370 con 0x558eb360bfc0 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 1 -- 172.21.15.133:0/1317270383 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a240504d0 con 0x558eb360bfc0 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1317270383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558eb34246a0 con 0x558eb360bfc0 2023-12-18T10:25:54.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 1 -- 172.21.15.133:0/1317270383 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a240506d0 con 0x558eb360bfc0 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 10 client.9525 fetch_fsmap learned FSMap version 111 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1317270383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x558eb33fa110 con 0x558eb360bfc0 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 1 -- 172.21.15.133:0/1317270383 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558eb34246a0 con 0x558eb360bfc0 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 1 -- 172.21.15.133:0/1317270383 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 111) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f7a2407b020 con 0x558eb360bfc0 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 10 client.9525 fetch_fsmap finished waiting for FSMap version 111 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 10 client.9525 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 20 client.9525 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x558eb3697c30 0x558eb3698010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 4 client.9525 mds_command: new command op to 9048 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1317270383 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558eb34543a0 con 0x558eb3697c30 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x558eb3697c30 0x558eb3698010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 10 client.9525 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a29d9b640 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x558eb3697c30 0x558eb3698010 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e7c6aae3ab4561 server_cookie=a8fe88e819a50599 in_seq=0 out_seq=0 2023-12-18T10:25:54.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 1 -- 172.21.15.133:0/1317270383 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x558eb34543a0 con 0x558eb3697c30 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 10 client.9525 handle_command_reply: tid=0 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 client.9525 shutdown 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1317270383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 msgr2=0x558eb36967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb36967e0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c7a0 tx=0x7f7a24057040 comp rx=0 tx=0).stop 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1317270383 shutdown_connections 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x558eb3697c30 0x558eb3698010 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558eb36565a0 0x558eb36976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x558eb3655c80 0x558eb36971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a117fa640 0 client.9525 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 --2- 172.21.15.133:0/1317270383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x558eb360bfc0 0x558eb36967e0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1317270383 >> 172.21.15.133:0/1317270383 conn(0x558eb340a910 msgr2=0x558eb3662cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1317270383 shutdown_connections 2023-12-18T10:25:54.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 1 -- 172.21.15.133:0/1317270383 wait complete. 2023-12-18T10:25:54.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a3bbaa000 20 client.9525 trim_cache size 0 max 16384 2023-12-18T10:25:54.682 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:54.685 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:54.685 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:54.685 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:54.685 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:54.685 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:54.685 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:54.686 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:54.686 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:54.686 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 -- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a14065a60 msgr2=0x7f7a14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a14065a60 0x7f7a14067f20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0af000 tx=0x7f7a1c0a7000 comp rx=0 tx=0).stop 2023-12-18T10:25:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 -- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 msgr2=0x7f7a3414d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a3414d7c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400c7d0 tx=0x7f7a2400cc90 comp rx=0 tx=0).stop 2023-12-18T10:25:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 -- 172.21.15.133:0/1506540911 shutdown_connections 2023-12-18T10:25:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7a14065a60 0x7f7a14067f20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a341582d0 0x7f7a340cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a340ce3b0 0x7f7a34151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 --2- 172.21.15.133:0/1506540911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a34070820 0x7f7a3414d7c0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 -- 172.21.15.133:0/1506540911 >> 172.21.15.133:0/1506540911 conn(0x7f7a3406a2a0 msgr2=0x7f7a3406be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 -- 172.21.15.133:0/1506540911 shutdown_connections 2023-12-18T10:25:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.676+0000 7f7a38841640 1 -- 172.21.15.133:0/1506540911 wait complete. 2023-12-18T10:25:54.697 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:54.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1196cca640 1 Processor -- start 2023-12-18T10:25:54.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1196cca640 1 -- start start 2023-12-18T10:25:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1196cca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f11901601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1196cca640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1190160ba0 con 0x7f1190160700 2023-12-18T10:25:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1196cca640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1190160e80 con 0x7f11900cd480 2023-12-18T10:25:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1196cca640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1190161160 con 0x7f11900ce400 2023-12-18T10:25:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f11954c7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1190160700 0x7f11900ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60924/0 (socket says 172.21.15.133:60924) 2023-12-18T10:25:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f11954c7640 1 -- 172.21.15.133:0/2052747916 learned_addr learned my addr 172.21.15.133:0/2052747916 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f11901601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294310047 0 0) 0x7f1190160ba0 con 0x7f1190160700 2023-12-18T10:25:54.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117c003530 con 0x7f1190160700 2023-12-18T10:25:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384014172 0 0) 0x7f1190160e80 con 0x7f11900cd480 2023-12-18T10:25:54.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1190160ba0 con 0x7f11900cd480 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2744100205 0 0) 0x7f117c003530 con 0x7f1190160700 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 msgr2=0x7f11901601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f11901601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 >> v1:172.21.15.142:6789/0 conn(0x7f11900cd480 legacy=0x7f119006b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119006af50 con 0x7f1190160700 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f1180001680 con 0x7f1190160700 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f11901601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 >> v1:172.21.15.133:6789/0 conn(0x7f1190160700 legacy=0x7f11900ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f117c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117c004080 0x7f117c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f117c004d10 0x7f117c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190161160 con 0x7f117c004080 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c00bad0 con 0x7f117c004d10 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c00bc90 con 0x7f11900ce400 2023-12-18T10:25:54.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f11954c7640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117c004080 0x7f117c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f117c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f11964c9640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f117c004d10 0x7f117c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1195cc8640 1 -- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f117c004d10 msgr2=0x7f117c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f117c004d10 0x7f117c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1195cc8640 1 -- 172.21.15.133:0/2052747916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117c004080 msgr2=0x7f117c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117c004080 0x7f117c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f1195cc8640 1 -- 172.21.15.133:0/2052747916 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c009420 con 0x7f11900ce400 2023-12-18T10:25:54.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.836+0000 7f11954c7640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117c004080 0x7f117c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:54.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f117c003b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f118c009c90 tx=0x7f118c01cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55520a60a507bf82 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c004030 con 0x7f11900ce400 2023-12-18T10:25:54.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c004190 con 0x7f11900ce400 2023-12-18T10:25:54.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1194cc6640 1 -- 172.21.15.133:0/2052747916 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c0a58e0 con 0x7f11900ce400 2023-12-18T10:25:54.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1196cca640 1 -- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 msgr2=0x7f117c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1196cca640 1 --2- 172.21.15.133:0/2052747916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f117c003b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f118c009c90 tx=0x7f118c01cc20 comp rx=0 tx=0).stop 2023-12-18T10:25:54.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f11964c9640 1 -- 172.21.15.133:0/2052747916 reap_dead start 2023-12-18T10:25:54.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1196cca640 1 -- 172.21.15.133:0/2052747916 shutdown_connections 2023-12-18T10:25:54.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1196cca640 1 -- 172.21.15.133:0/2052747916 >> 172.21.15.133:0/2052747916 conn(0x7f1190069ca0 msgr2=0x7f119006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:54.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1196cca640 1 -- 172.21.15.133:0/2052747916 shutdown_connections 2023-12-18T10:25:54.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.840+0000 7f1196cca640 1 -- 172.21.15.133:0/2052747916 wait complete. 2023-12-18T10:25:54.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 Processor -- start 2023-12-18T10:25:54.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 -- start start 2023-12-18T10:25:54.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f11901e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11901e8780 0x7f11901f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11901f5a70 0x7f11901f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11901f6440 con 0x7f11901f5a70 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119015c290 con 0x7f11901e8780 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11901e8c90 con 0x7f11900ce400 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11901f5a70 0x7f11901f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11901f5a70 0x7f11901f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53026/0 (socket says 172.21.15.133:53026) 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 -- 172.21.15.133:0/2025404268 learned_addr learned my addr 172.21.15.133:0/2025404268 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f11901e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11954c7640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11901e8780 0x7f11901f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 -- 172.21.15.133:0/2025404268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 msgr2=0x7f11901e8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f11901e8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 -- 172.21.15.133:0/2025404268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11901e8780 msgr2=0x7f11901f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11901e8780 0x7f11901f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:54.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 -- 172.21.15.133:0/2025404268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11901e8f70 con 0x7f11901f5a70 2023-12-18T10:25:54.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11964c9640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11901f5a70 0x7f11901f5f00 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1190071dc0 tx=0x7f118800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11867fc640 1 -- 172.21.15.133:0/2025404268 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188006d70 con 0x7f11901f5a70 2023-12-18T10:25:54.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11867fc640 1 -- 172.21.15.133:0/2025404268 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188003980 con 0x7f11901f5a70 2023-12-18T10:25:54.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f11867fc640 1 -- 172.21.15.133:0/2025404268 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188003d30 con 0x7f11901f5a70 2023-12-18T10:25:54.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11901e9250 con 0x7f11901f5a70 2023-12-18T10:25:54.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.844+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11900c4100 con 0x7f11901f5a70 2023-12-18T10:25:54.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.848+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900c4320 con 0x7f11901f5a70 2023-12-18T10:25:54.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.848+0000 7f11867fc640 1 -- 172.21.15.133:0/2025404268 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11880050d0 con 0x7f11901f5a70 2023-12-18T10:25:54.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.848+0000 7f11867fc640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1174065a60 0x7f1174067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:54.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.848+0000 7f11867fc640 1 -- 172.21.15.133:0/2025404268 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11880824a0 con 0x7f11901f5a70 2023-12-18T10:25:54.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.848+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1174065a60 0x7f1174067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:54.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.848+0000 7f1195cc8640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1174065a60 0x7f1174067f20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f118c0ae000 tx=0x7f118c0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:54.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:54.852+0000 7f11867fc640 1 -- 172.21.15.133:0/2025404268 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f118804fe40 con 0x7f11901f5a70 2023-12-18T10:25:55.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.032+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f119004e850 con 0x7f11901f5a70 2023-12-18T10:25:55.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.032+0000 7f11867fc640 1 -- 172.21.15.133:0/2025404268 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4761 (secure 0 0 0) 0x7f1188053460 con 0x7f11901f5a70 2023-12-18T10:25:55.034 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:55.035 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":111,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:54.267892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:25:55.035 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 111 2023-12-18T10:25:55.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1174065a60 msgr2=0x7f1174067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:55.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1174065a60 0x7f1174067f20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f118c0ae000 tx=0x7f118c0046d0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11901f5a70 msgr2=0x7f11901f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11901f5a70 0x7f11901f5f00 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1190071dc0 tx=0x7f118800ff70 comp rx=0 tx=0).stop 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 shutdown_connections 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1174065a60 0x7f1174067f20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11901f5a70 0x7f11901f5f00 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11901e8780 0x7f11901f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 --2- 172.21.15.133:0/2025404268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11900ce400 0x7f11901e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 >> 172.21.15.133:0/2025404268 conn(0x7f1190069ca0 msgr2=0x7f119015cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 shutdown_connections 2023-12-18T10:25:55.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.036+0000 7f1196cca640 1 -- 172.21.15.133:0/2025404268 wait complete. 2023-12-18T10:25:55.056 DEBUG:tasks.cephfs.test_multimds_misc:current active=['d', 'a', 'c'] 2023-12-18T10:25:55.056 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:25:55.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788e895640 1 Processor -- start 2023-12-18T10:25:55.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788e895640 1 -- start start 2023-12-18T10:25:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788e895640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f788815ca40 0x7f78880cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788e895640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880ce3f0 0x7f78880cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788e895640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78880cfa70 con 0x7f78880cf610 2023-12-18T10:25:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788e895640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78880d11c0 con 0x7f788815ca40 2023-12-18T10:25:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788e895640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78880d0310 con 0x7f78880ce3f0 2023-12-18T10:25:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788ce32640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f78880cf610 0x7f78881605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60938/0 (socket says 172.21.15.133:60938) 2023-12-18T10:25:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f788ce32640 1 -- 172.21.15.133:0/1475730987 learned_addr learned my addr 172.21.15.133:0/1475730987 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7887fff640 1 --2- 172.21.15.133:0/1475730987 >> v2:172.21.15.142:3300/0 conn(0x7f788815ca40 0x7f78880cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f78877fe640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880ce3f0 0x7f78880cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771101422 0 0) 0x7f78880cfa70 con 0x7f78880cf610 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7870003530 con 0x7f78880cf610 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1305545723 0 0) 0x7f7870003530 con 0x7f78880cf610 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880ce3f0 msgr2=0x7f78880cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880ce3f0 0x7f78880cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 >> v2:172.21.15.142:3300/0 conn(0x7f788815ca40 msgr2=0x7f78880cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 --2- 172.21.15.133:0/1475730987 >> v2:172.21.15.142:3300/0 conn(0x7f788815ca40 0x7f78880cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78880d05b0 con 0x7f78880cf610 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f7880001a00 con 0x7f78880cf610 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.192+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 >> v1:172.21.15.133:6789/0 conn(0x7f78880cf610 legacy=0x7f78881605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7870003980 0x7f7870003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78700047d0 0x7f7870004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880ce3f0 0x7f7870005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78880d11c0 con 0x7f78700047d0 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78880d0310 con 0x7f7870003980 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787000b990 con 0x7f78880ce3f0 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f78877fe640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78700047d0 0x7f7870004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7887fff640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7870003980 0x7f7870003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f788ce32640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880ce3f0 0x7f7870005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f78877fe640 1 -- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880ce3f0 msgr2=0x7f7870005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f78877fe640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880ce3f0 0x7f7870005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f78877fe640 1 -- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7870003980 msgr2=0x7f7870003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:55.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f78877fe640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7870003980 0x7f7870003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f78877fe640 1 -- 172.21.15.133:0/1475730987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870003530 con 0x7f78700047d0 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f78877fe640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78700047d0 0x7f7870004c50 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f787c009ac0 tx=0x7f787c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b12ef5523f25d0d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0059a0 con 0x7f78700047d0 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c005b00 con 0x7f78700047d0 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.196+0000 7f7886ffd640 1 -- 172.21.15.133:0/1475730987 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c006030 con 0x7f78700047d0 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- 172.21.15.133:0/1475730987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78700047d0 msgr2=0x7f7870004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 --2- 172.21.15.133:0/1475730987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78700047d0 0x7f7870004c50 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f787c009ac0 tx=0x7f787c01ca30 comp rx=0 tx=0).stop 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 -- 172.21.15.133:0/1475730987 reap_dead start 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- 172.21.15.133:0/1475730987 shutdown_connections 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- 172.21.15.133:0/1475730987 >> 172.21.15.133:0/1475730987 conn(0x7f7888089fb0 msgr2=0x7f78880d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- 172.21.15.133:0/1475730987 shutdown_connections 2023-12-18T10:25:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- 172.21.15.133:0/1475730987 wait complete. 2023-12-18T10:25:55.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 Processor -- start 2023-12-18T10:25:55.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- start start 2023-12-18T10:25:55.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700047d0 0x7f78880b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880c9810 0x7f78880cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78880cc480 0x7f788815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788815fe80 con 0x7f78880cc480 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78880cc900 con 0x7f78700047d0 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788e895640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78880b5a60 con 0x7f78880c9810 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78880cc480 0x7f788815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78880cc480 0x7f788815eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53040/0 (socket says 172.21.15.133:53040) 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 -- 172.21.15.133:0/1371197150 learned_addr learned my addr 172.21.15.133:0/1371197150 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f7887fff640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700047d0 0x7f78880b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f78877fe640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880c9810 0x7f78880cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 -- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880c9810 msgr2=0x7f78880cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880c9810 0x7f78880cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 -- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700047d0 msgr2=0x7f78880b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:55.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700047d0 0x7f78880b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f788ce32640 1 -- 172.21.15.133:0/1371197150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788815f8c0 con 0x7f78880cc480 2023-12-18T10:25:55.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.200+0000 7f78877fe640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880c9810 0x7f78880cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:55.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f788ce32640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78880cc480 0x7f788815eb90 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f7880001340 tx=0x7f7880011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:55.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f7884ff9640 1 -- 172.21.15.133:0/1371197150 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788000f920 con 0x7f78880cc480 2023-12-18T10:25:55.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f7884ff9640 1 -- 172.21.15.133:0/1371197150 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788000fac0 con 0x7f78880cc480 2023-12-18T10:25:55.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f7884ff9640 1 -- 172.21.15.133:0/1371197150 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788000fe70 con 0x7f78880cc480 2023-12-18T10:25:55.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788815fba0 con 0x7f78880cc480 2023-12-18T10:25:55.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78880b2940 con 0x7f78880cc480 2023-12-18T10:25:55.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78880b5550 con 0x7f78880cc480 2023-12-18T10:25:55.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f7884ff9640 1 -- 172.21.15.133:0/1371197150 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f788001f460 con 0x7f78880cc480 2023-12-18T10:25:55.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f7884ff9640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7874065a90 0x7f7874067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:55.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f7884ff9640 1 -- 172.21.15.133:0/1371197150 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7880086190 con 0x7f78880cc480 2023-12-18T10:25:55.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.204+0000 7f7887fff640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7874065a90 0x7f7874067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:55.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.208+0000 7f7887fff640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7874065a90 0x7f7874067f50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7878009c40 tx=0x7f7878006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:55.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.208+0000 7f7884ff9640 1 -- 172.21.15.133:0/1371197150 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f78880b5550 con 0x7f78880cc480 2023-12-18T10:25:55.271 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:25:55.272+0000 7f3bac1eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-18T10:25:55.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f78880b2b90 con 0x7f78880cc480 2023-12-18T10:25:55.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f7884ff9640 1 -- 172.21.15.133:0/1371197150 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1717 (secure 0 0 0) 0x7f78880b2b90 con 0x7f78880cc480 2023-12-18T10:25:55.417 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:55.417 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"2 MDSs report damaged metadata","count":2},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":495,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694751,"bytes_used":266510336,"bytes_avail":772827602944,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":13821,"read_op_per_sec":0,"write_op_per_sec":10},"fsmap":{"epoch":112,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"c","status":"up:active","gid":9039},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":9042},{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":9048}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2023-12-18T10:25:01.185130+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:25:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7874065a90 msgr2=0x7f7874067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7874065a90 0x7f7874067f50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7878009c40 tx=0x7f7878006f90 comp rx=0 tx=0).stop 2023-12-18T10:25:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78880cc480 msgr2=0x7f788815eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78880cc480 0x7f788815eb90 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f7880001340 tx=0x7f7880011b60 comp rx=0 tx=0).stop 2023-12-18T10:25:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 shutdown_connections 2023-12-18T10:25:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7874065a90 0x7f7874067f50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78880cc480 0x7f788815eb90 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78880c9810 0x7f78880cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 --2- 172.21.15.133:0/1371197150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78700047d0 0x7f78880b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.416+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 >> 172.21.15.133:0/1371197150 conn(0x7f7888089fb0 msgr2=0x7f788815ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.420+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 shutdown_connections 2023-12-18T10:25:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:55.420+0000 7f788e895640 1 -- 172.21.15.133:0/1371197150 wait complete. 2023-12-18T10:25:55.438 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-12-18T10:25:56.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:56.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2051136640 1 Processor -- start 2023-12-18T10:25:56.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2051136640 1 -- start start 2023-12-18T10:25:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2051136640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f204c15c730 0x7f204c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2051136640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c0cea00 0x7f204c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2051136640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f204c0cd3a0 0x7f204c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2051136640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c15cb10 con 0x7f204c15c730 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2051136640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c0b84c0 con 0x7f204c0cd3a0 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2051136640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0cd960 con 0x7f204c0cea00 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f204c15c730 0x7f204c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f204c15c730 0x7f204c0b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53042/0 (socket says 172.21.15.133:53042) 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204bfff640 1 -- 172.21.15.133:0/1118903305 learned_addr learned my addr 172.21.15.133:0/1118903305 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f2050935640 1 --2- 172.21.15.133:0/1118903305 >> v2:172.21.15.142:3300/0 conn(0x7f204c0cd3a0 0x7f204c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204b7fe640 1 --2- 172.21.15.133:0/1118903305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c0cea00 0x7f204c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204bfff640 1 -- 172.21.15.133:0/1118903305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c0cea00 msgr2=0x7f204c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204bfff640 1 --2- 172.21.15.133:0/1118903305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c0cea00 0x7f204c0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204bfff640 1 -- 172.21.15.133:0/1118903305 >> v2:172.21.15.142:3300/0 conn(0x7f204c0cd3a0 msgr2=0x7f204c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204bfff640 1 --2- 172.21.15.133:0/1118903305 >> v2:172.21.15.142:3300/0 conn(0x7f204c0cd3a0 0x7f204c0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.588+0000 7f204bfff640 1 -- 172.21.15.133:0/1118903305 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0cdc40 con 0x7f204c15c730 2023-12-18T10:25:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f204bfff640 1 --2- 172.21.15.133:0/1118903305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c15c730 0x7f204c0b7f80 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f204c160180 tx=0x7f203c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1a40cf78c3a93b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f204affd640 1 -- 172.21.15.133:0/1118903305 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c0a89b0 con 0x7f204c15c730 2023-12-18T10:25:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f204affd640 1 -- 172.21.15.133:0/1118903305 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c0a8b10 con 0x7f204c15c730 2023-12-18T10:25:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f204affd640 1 -- 172.21.15.133:0/1118903305 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c0a8ea0 con 0x7f204c15c730 2023-12-18T10:25:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 -- 172.21.15.133:0/1118903305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c15c730 msgr2=0x7f204c0b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 --2- 172.21.15.133:0/1118903305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c15c730 0x7f204c0b7f80 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f204c160180 tx=0x7f203c01ecf0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 -- 172.21.15.133:0/1118903305 shutdown_connections 2023-12-18T10:25:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 --2- 172.21.15.133:0/1118903305 >> v2:172.21.15.142:3300/0 conn(0x7f204c0cd3a0 0x7f204c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 --2- 172.21.15.133:0/1118903305 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c0cea00 0x7f204c0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 --2- 172.21.15.133:0/1118903305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c15c730 0x7f204c0b7f80 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 -- 172.21.15.133:0/1118903305 >> 172.21.15.133:0/1118903305 conn(0x7f204c06b120 msgr2=0x7f204c06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 -- 172.21.15.133:0/1118903305 shutdown_connections 2023-12-18T10:25:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 -- 172.21.15.133:0/1118903305 wait complete. 2023-12-18T10:25:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.592+0000 7f2051136640 1 Processor -- start 2023-12-18T10:25:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 -- start start 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204c0cd3a0 0x7f204c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c0cea00 0x7f204c14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c15c730 0x7f204c150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c140720 con 0x7f204c0cea00 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c150790 con 0x7f204c0cd3a0 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0cbae0 con 0x7f204c15c730 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c0cea00 0x7f204c14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c0cea00 0x7f204c14fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53050/0 (socket says 172.21.15.133:53050) 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 -- 172.21.15.133:0/1505682446 learned_addr learned my addr 172.21.15.133:0/1505682446 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2050935640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c15c730 0x7f204c150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204bfff640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204c0cd3a0 0x7f204c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 -- 172.21.15.133:0/1505682446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c15c730 msgr2=0x7f204c150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c15c730 0x7f204c150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 -- 172.21.15.133:0/1505682446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204c0cd3a0 msgr2=0x7f204c0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204c0cd3a0 0x7f204c0cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 -- 172.21.15.133:0/1505682446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c0094d0 con 0x7f204c0cea00 2023-12-18T10:25:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f204b7fe640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c0cea00 0x7f204c14fd10 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f204000d800 tx=0x7f204000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2048ff9640 1 -- 172.21.15.133:0/1505682446 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000b6c0 con 0x7f204c0cea00 2023-12-18T10:25:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2048ff9640 1 -- 172.21.15.133:0/1505682446 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204000b820 con 0x7f204c0cea00 2023-12-18T10:25:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c0cbdc0 con 0x7f204c0cea00 2023-12-18T10:25:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2048ff9640 1 -- 172.21.15.133:0/1505682446 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204000bb90 con 0x7f204c0cea00 2023-12-18T10:25:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c0cc380 con 0x7f204c0cea00 2023-12-18T10:25:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.596+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c066c50 con 0x7f204c0cea00 2023-12-18T10:25:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.600+0000 7f2048ff9640 1 -- 172.21.15.133:0/1505682446 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f204000bcf0 con 0x7f204c0cea00 2023-12-18T10:25:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.600+0000 7f2048ff9640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2038065a60 0x7f2038067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.600+0000 7f2048ff9640 1 -- 172.21.15.133:0/1505682446 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2040083800 con 0x7f204c0cea00 2023-12-18T10:25:56.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.600+0000 7f204bfff640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2038065a60 0x7f2038067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.600+0000 7f204bfff640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2038065a60 0x7f2038067f20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f203c0b2000 tx=0x7f203c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.604+0000 7f2048ff9640 1 -- 172.21.15.133:0/1505682446 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2040051050 con 0x7f204c0cea00 2023-12-18T10:25:56.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.784+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f204c04e850 con 0x7f204c0cea00 2023-12-18T10:25:56.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.784+0000 7f2048ff9640 1 -- 172.21.15.133:0/1505682446 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4763 (secure 0 0 0) 0x7f2040054670 con 0x7f204c0cea00 2023-12-18T10:25:56.787 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:56.787 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":112,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:55.274988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":6,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:25:56.787 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 112 2023-12-18T10:25:56.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2038065a60 msgr2=0x7f2038067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2038065a60 0x7f2038067f20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f203c0b2000 tx=0x7f203c009040 comp rx=0 tx=0).stop 2023-12-18T10:25:56.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c0cea00 msgr2=0x7f204c14fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c0cea00 0x7f204c14fd10 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f204000d800 tx=0x7f204000dcc0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 shutdown_connections 2023-12-18T10:25:56.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2038065a60 0x7f2038067f20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204c15c730 0x7f204c150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f204c0cea00 0x7f204c14fd10 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 --2- 172.21.15.133:0/1505682446 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f204c0cd3a0 0x7f204c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 >> 172.21.15.133:0/1505682446 conn(0x7f204c06b120 msgr2=0x7f204c0b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 shutdown_connections 2023-12-18T10:25:56.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.788+0000 7f2051136640 1 -- 172.21.15.133:0/1505682446 wait complete. 2023-12-18T10:25:56.808 DEBUG:tasks.cephfs.test_multimds_misc:current active=['d', 'a', 'c'] 2023-12-18T10:25:56.808 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:25:56.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.944+0000 7f0183e12640 1 Processor -- start 2023-12-18T10:25:56.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.944+0000 7f0183e12640 1 -- start start 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.944+0000 7f0183e12640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f017c06c4f0 0x7f017c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.944+0000 7f0183e12640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017c0c9460 con 0x7f017c0c9e30 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.944+0000 7f0183e12640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017c1574a0 con 0x7f017c1570c0 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.944+0000 7f0183e12640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017c0c8b30 con 0x7f017c06c4f0 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.944+0000 7f01823af640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f017c0c9e30 0x7f017c070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60954/0 (socket says 172.21.15.133:60954) 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.944+0000 7f01823af640 1 -- 172.21.15.133:0/2906688559 learned_addr learned my addr 172.21.15.133:0/2906688559 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f01813ad640 1 --2- 172.21.15.133:0/2906688559 >> v2:172.21.15.142:3300/0 conn(0x7f017c06c4f0 0x7f017c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f0180bac640 1 -- 172.21.15.133:0/2906688559 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403156577 0 0) 0x7f017c0c9460 con 0x7f017c0c9e30 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f0180bac640 1 -- 172.21.15.133:0/2906688559 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0168003530 con 0x7f017c0c9e30 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f0180bac640 1 -- 172.21.15.133:0/2906688559 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115694185 0 0) 0x7f017c1574a0 con 0x7f017c1570c0 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f0180bac640 1 -- 172.21.15.133:0/2906688559 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f017c0c9460 con 0x7f017c1570c0 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f0180bac640 1 -- 172.21.15.133:0/2906688559 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1716094953 0 0) 0x7f0168003530 con 0x7f017c0c9e30 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f01813ad640 1 -- 172.21.15.133:0/2906688559 >> v1:172.21.15.142:6789/0 conn(0x7f017c1570c0 legacy=0x7f017c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f01813ad640 1 -- 172.21.15.133:0/2906688559 >> v1:172.21.15.133:6789/0 conn(0x7f017c0c9e30 legacy=0x7f017c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f01813ad640 1 -- 172.21.15.133:0/2906688559 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0c8e10 con 0x7f017c06c4f0 2023-12-18T10:25:56.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f01813ad640 1 --2- 172.21.15.133:0/2906688559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c06c4f0 0x7f017c0c98f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f016c0097c0 tx=0x7f016c01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe0d462bbac2a373 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:56.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f0180bac640 1 -- 172.21.15.133:0/2906688559 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174001a00 con 0x7f017c06c4f0 2023-12-18T10:25:56.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f0180bac640 1 -- 172.21.15.133:0/2906688559 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c0a7050 con 0x7f017c06c4f0 2023-12-18T10:25:56.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.948+0000 7f0180bac640 1 -- 172.21.15.133:0/2906688559 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c0ab400 con 0x7f017c06c4f0 2023-12-18T10:25:56.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- 172.21.15.133:0/2906688559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c06c4f0 msgr2=0x7f017c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 --2- 172.21.15.133:0/2906688559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c06c4f0 0x7f017c0c98f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f016c0097c0 tx=0x7f016c01c2e0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- 172.21.15.133:0/2906688559 shutdown_connections 2023-12-18T10:25:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 --2- 172.21.15.133:0/2906688559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c06c4f0 0x7f017c0c98f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- 172.21.15.133:0/2906688559 >> 172.21.15.133:0/2906688559 conn(0x7f017c06a3e0 msgr2=0x7f017c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- 172.21.15.133:0/2906688559 shutdown_connections 2023-12-18T10:25:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- 172.21.15.133:0/2906688559 wait complete. 2023-12-18T10:25:56.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 Processor -- start 2023-12-18T10:25:56.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- start start 2023-12-18T10:25:56.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f017c06c4f0 0x7f017c147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c0c9e30 0x7f017c0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f017c1570c0 0x7f017c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c0c32e0 con 0x7f017c1570c0 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c0c3580 con 0x7f017c0c9e30 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0183e12640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c0c3860 con 0x7f017c06c4f0 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f01823af640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f017c1570c0 0x7f017c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f01823af640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f017c1570c0 0x7f017c0c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53066/0 (socket says 172.21.15.133:53066) 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f01823af640 1 -- 172.21.15.133:0/3982668617 learned_addr learned my addr 172.21.15.133:0/3982668617 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f01813ad640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c0c9e30 0x7f017c0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.952+0000 7f0181bae640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f017c06c4f0 0x7f017c147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01823af640 1 -- 172.21.15.133:0/3982668617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f017c06c4f0 msgr2=0x7f017c147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01823af640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f017c06c4f0 0x7f017c147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01823af640 1 -- 172.21.15.133:0/3982668617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c0c9e30 msgr2=0x7f017c0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01823af640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c0c9e30 0x7f017c0c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01823af640 1 -- 172.21.15.133:0/3982668617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c009420 con 0x7f017c1570c0 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01823af640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f017c1570c0 0x7f017c0c4340 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f0174001fb0 tx=0x7f017400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01727fc640 1 -- 172.21.15.133:0/3982668617 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174012400 con 0x7f017c1570c0 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01727fc640 1 -- 172.21.15.133:0/3982668617 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174012560 con 0x7f017c1570c0 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01727fc640 1 -- 172.21.15.133:0/3982668617 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174012910 con 0x7f017c1570c0 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c0c3b40 con 0x7f017c1570c0 2023-12-18T10:25:56.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c1482f0 con 0x7f017c1570c0 2023-12-18T10:25:56.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c0735b0 con 0x7f017c1570c0 2023-12-18T10:25:56.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01727fc640 1 -- 172.21.15.133:0/3982668617 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0174012a70 con 0x7f017c1570c0 2023-12-18T10:25:56.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01727fc640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0160065a60 0x7f0160067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f01727fc640 1 -- 172.21.15.133:0/3982668617 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0174083a30 con 0x7f017c1570c0 2023-12-18T10:25:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.956+0000 7f0181bae640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0160065a60 0x7f0160067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:56.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.960+0000 7f0181bae640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0160065a60 0x7f0160067f20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0178007fd0 tx=0x7f0178007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:56.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:56.960+0000 7f01727fc640 1 -- 172.21.15.133:0/3982668617 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f01740512a0 con 0x7f017c1570c0 2023-12-18T10:25:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.164+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f017c06fe80 con 0x7f017c1570c0 2023-12-18T10:25:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f01727fc640 1 -- 172.21.15.133:0/3982668617 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1928 (secure 0 0 0) 0x7f01740548c0 con 0x7f017c1570c0 2023-12-18T10:25:57.167 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:57.167 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":497,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694751,"bytes_used":266510336,"bytes_avail":772827602944,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":13709,"read_op_per_sec":0,"write_op_per_sec":10},"fsmap":{"epoch":113,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"c","status":"up:active","gid":9039},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":9042},{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":9048}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2023-12-18T10:25:55.196454+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-12-18T10:25:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0160065a60 msgr2=0x7f0160067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0160065a60 0x7f0160067f20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0178007fd0 tx=0x7f0178007d30 comp rx=0 tx=0).stop 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f017c1570c0 msgr2=0x7f017c0c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f017c1570c0 0x7f017c0c4340 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f0174001fb0 tx=0x7f017400a430 comp rx=0 tx=0).stop 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 shutdown_connections 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0160065a60 0x7f0160067f20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f017c1570c0 0x7f017c0c4340 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017c0c9e30 0x7f017c0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 --2- 172.21.15.133:0/3982668617 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f017c06c4f0 0x7f017c147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 >> 172.21.15.133:0/3982668617 conn(0x7f017c06a3e0 msgr2=0x7f017c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 shutdown_connections 2023-12-18T10:25:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.168+0000 7f0183e12640 1 -- 172.21.15.133:0/3982668617 wait complete. 2023-12-18T10:25:57.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:25:57.189 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub abort 2023-12-18T10:25:57.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.328+0000 7f5fe2d25640 1 Processor -- start 2023-12-18T10:25:57.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.328+0000 7f5fe2d25640 1 -- start start 2023-12-18T10:25:57.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe2d25640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5fdc0ca410 0x7f5fdc159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe2d25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc159fb0 0x7f5fdc071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe2d25640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc070df0 con 0x7f5fdc071db0 2023-12-18T10:25:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe2d25640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fdc15aab0 con 0x7f5fdc0ca410 2023-12-18T10:25:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe2d25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15a4f0 con 0x7f5fdc159fb0 2023-12-18T10:25:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe0ac1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5fdc0ca410 0x7f5fdc159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe0ac1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5fdc0ca410 0x7f5fdc159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53068/0 (socket says 172.21.15.133:53068) 2023-12-18T10:25:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/3608403198 learned_addr learned my addr 172.21.15.133:0/3608403198 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/3608403198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc159fb0 0x7f5fdc071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/3608403198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc159fb0 msgr2=0x7f5fdc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/3608403198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc159fb0 0x7f5fdc071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/3608403198 >> v1:172.21.15.142:6789/0 conn(0x7f5fdc071db0 legacy=0x7f5fdc0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/3608403198 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc15a7d0 con 0x7f5fdc0ca410 2023-12-18T10:25:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.332+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/3608403198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc159fb0 0x7f5fdc071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:57.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/3608403198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc0ca410 0x7f5fdc159a70 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009870 tx=0x7f5fd801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1513d429bd4d296a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fd37fe640 1 -- 172.21.15.133:0/3608403198 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80aa670 con 0x7f5fdc0ca410 2023-12-18T10:25:57.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fd37fe640 1 -- 172.21.15.133:0/3608403198 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd80aa7d0 con 0x7f5fdc0ca410 2023-12-18T10:25:57.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fd37fe640 1 -- 172.21.15.133:0/3608403198 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80aab60 con 0x7f5fdc0ca410 2023-12-18T10:25:57.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 -- 172.21.15.133:0/3608403198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc0ca410 msgr2=0x7f5fdc159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/3608403198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc0ca410 0x7f5fdc159a70 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009870 tx=0x7f5fd801c510 comp rx=0 tx=0).stop 2023-12-18T10:25:57.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 -- 172.21.15.133:0/3608403198 shutdown_connections 2023-12-18T10:25:57.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/3608403198 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc159fb0 0x7f5fdc071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/3608403198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc0ca410 0x7f5fdc159a70 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 -- 172.21.15.133:0/3608403198 >> 172.21.15.133:0/3608403198 conn(0x7f5fdc06a2a0 msgr2=0x7f5fdc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 -- 172.21.15.133:0/3608403198 shutdown_connections 2023-12-18T10:25:57.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 -- 172.21.15.133:0/3608403198 wait complete. 2023-12-18T10:25:57.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 Processor -- start 2023-12-18T10:25:57.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 -- start start 2023-12-18T10:25:57.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc071db0 0x7f5fdc150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc0ca410 0x7f5fdc0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc159fb0 0x7f5fdc0c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.336+0000 7f5fe2d25640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c56b0 con 0x7f5fdc159fb0 2023-12-18T10:25:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe2d25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c4c80 con 0x7f5fdc071db0 2023-12-18T10:25:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe2d25640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc0c5950 con 0x7f5fdc0ca410 2023-12-18T10:25:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe12c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc159fb0 0x7f5fdc0c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc071db0 0x7f5fdc150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc071db0 0x7f5fdc150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:53200/0 (socket says 172.21.15.133:53200) 2023-12-18T10:25:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe12c2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc159fb0 0x7f5fdc0c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53082/0 (socket says 172.21.15.133:53082) 2023-12-18T10:25:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/1600178168 learned_addr learned my addr 172.21.15.133:0/1600178168 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc0ca410 0x7f5fdc0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/1600178168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc0ca410 msgr2=0x7f5fdc0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc0ca410 0x7f5fdc0c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc159fb0 msgr2=0x7f5fdc0c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc159fb0 0x7f5fdc0c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/1600178168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd80094d0 con 0x7f5fdc071db0 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe12c2640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc159fb0 0x7f5fdc0c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc071db0 0x7f5fdc150980 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80ac040 tx=0x7f5fd801ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fd17fa640 1 -- 172.21.15.133:0/1600178168 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80b3800 con 0x7f5fdc071db0 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fd17fa640 1 -- 172.21.15.133:0/1600178168 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd80b3980 con 0x7f5fdc071db0 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe2d25640 1 -- 172.21.15.133:0/1600178168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc0c5c30 con 0x7f5fdc071db0 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fd17fa640 1 -- 172.21.15.133:0/1600178168 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80b3d30 con 0x7f5fdc071db0 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fe2d25640 1 -- 172.21.15.133:0/1600178168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc0c4f60 con 0x7f5fdc071db0 2023-12-18T10:25:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.340+0000 7f5fd17fa640 1 -- 172.21.15.133:0/1600178168 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5fd80b2380 con 0x7f5fdc071db0 2023-12-18T10:25:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd17fa640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fc8065a60 0x7f5fc8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd17fa640 1 -- 172.21.15.133:0/1600178168 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fd811d3d0 con 0x7f5fdc071db0 2023-12-18T10:25:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 Processor -- start 2023-12-18T10:25:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fc8065a60 0x7f5fc8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 -- start start 2023-12-18T10:25:57.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fc8065a60 0x7f5fc8067f20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0ad020 tx=0x7f5fcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 0x55db6f70d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70d540 0x55db6f6c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f6c2f60 0x55db6f6c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6f58b3d0 con 0x55db6f70d540 2023-12-18T10:25:57.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6f519400 con 0x55db6f70cc20 2023-12-18T10:25:57.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db6f5169d0 con 0x55db6f6c2f60 2023-12-18T10:25:57.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70d540 0x55db6f6c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70d540 0x55db6f6c2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53098/0 (socket says 172.21.15.133:53098) 2023-12-18T10:25:57.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 -- 172.21.15.133:0/186597255 learned_addr learned my addr 172.21.15.133:0/186597255 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe12c2640 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f6c2f60 0x55db6f6c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 0x55db6f70d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 -- 172.21.15.133:0/186597255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f6c2f60 msgr2=0x55db6f6c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f6c2f60 0x55db6f6c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 -- 172.21.15.133:0/186597255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 msgr2=0x55db6f70d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 0x55db6f70d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 -- 172.21.15.133:0/186597255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6f20edc0 con 0x55db6f70d540 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70d540 0x55db6f6c2a20 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc011a40 tx=0x7f5fcc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60feca946b9776 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fc27fc640 1 -- 172.21.15.133:0/186597255 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc015bc0 con 0x55db6f70d540 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fc27fc640 1 -- 172.21.15.133:0/186597255 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc015d20 con 0x55db6f70d540 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fc27fc640 1 -- 172.21.15.133:0/186597255 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc021640 con 0x55db6f70d540 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 -- 172.21.15.133:0/186597255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70d540 msgr2=0x55db6f6c2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.344+0000 7f5fe6095000 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70d540 0x55db6f6c2a20 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc011a40 tx=0x7f5fcc014000 comp rx=0 tx=0).stop 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- 172.21.15.133:0/186597255 shutdown_connections 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f6c2f60 0x55db6f6c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70d540 0x55db6f6c2a20 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 --2- 172.21.15.133:0/186597255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 0x55db6f70d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- 172.21.15.133:0/186597255 >> 172.21.15.133:0/186597255 conn(0x55db6f4c18b0 msgr2=0x55db6f6c1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- 172.21.15.133:0/186597255 shutdown_connections 2023-12-18T10:25:57.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- 172.21.15.133:0/186597255 wait complete. 2023-12-18T10:25:57.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- start start 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 Processor -- start 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f70d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70cc20 0x55db6f70de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70d540 0x55db6f70e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6f5122c0 con 0x55db6f6c2f60 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6f4b1490 con 0x55db6f70d540 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db6f4cf680 con 0x55db6f70cc20 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 10 client.0 _ll_register_callbacks cb 0x55db6f6ae920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f70d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f70d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53102/0 (socket says 172.21.15.133:53102) 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/3020455654 learned_addr learned my addr 172.21.15.133:0/3020455654 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70cc20 0x55db6f70de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe12c2640 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70d540 0x55db6f70e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70cc20 msgr2=0x55db6f70de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70cc20 0x55db6f70de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70d540 msgr2=0x55db6f70e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70d540 0x55db6f70e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/3020455654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc00e040 con 0x55db6f6c2f60 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70cc20 0x55db6f70de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f70d920 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009870 tx=0x7f5fd80ee900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feaa348eb61c35b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/3020455654 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80c2070 con 0x55db6f6c2f60 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/3020455654 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fd80f63a0 con 0x55db6f6c2f60 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- 172.21.15.133:0/3020455654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db6f4cf0c0 con 0x55db6f6c2f60 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/3020455654 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fd80f6580 con 0x55db6f6c2f60 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 10 client.9561 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:57.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- 172.21.15.133:0/3020455654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x55db6f4d71f0 con 0x55db6f6c2f60 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/3020455654 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db6f4cf0c0 con 0x55db6f6c2f60 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/3020455654 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5fd80a8050 con 0x55db6f6c2f60 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 10 client.9561 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 10 client.9561 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 20 client.9561 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55db6f70edb0 0x55db6f71e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 4 client.9561 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.348+0000 7f5fe6095000 1 -- 172.21.15.133:0/3020455654 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db6f510c10 con 0x55db6f70edb0 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55db6f70edb0 0x55db6f71e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55db6f70edb0 0x55db6f71e7f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83242e97ec4f505a server_cookie=642606d7687fae1e in_seq=0 out_seq=0 2023-12-18T10:25:57.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fbb7fe640 10 client.9561 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/3020455654 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55db6f510c10 con 0x55db6f70edb0 2023-12-18T10:25:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fbb7fe640 10 client.9561 handle_command_reply: tid=0 2023-12-18T10:25:57.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 client.9561 shutdown 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 -- 172.21.15.133:0/3020455654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 msgr2=0x55db6f70d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f70d920 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009870 tx=0x7f5fd80ee900 comp rx=0 tx=0).stop 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 -- 172.21.15.133:0/3020455654 shutdown_connections 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55db6f70edb0 0x55db6f71e7f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70d540 0x55db6f70e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70cc20 0x55db6f70de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fbb7fe640 0 client.9561 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 --2- 172.21.15.133:0/3020455654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f70d920 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 -- 172.21.15.133:0/3020455654 >> 172.21.15.133:0/3020455654 conn(0x55db6f4c18b0 msgr2=0x55db6f6c1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 -- 172.21.15.133:0/3020455654 shutdown_connections 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 1 -- 172.21.15.133:0/3020455654 wait complete. 2023-12-18T10:25:57.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.352+0000 7f5fe6095000 20 client.9561 trim_cache size 0 max 16384 2023-12-18T10:25:57.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.364+0000 7f5fe6095000 1 Processor -- start 2023-12-18T10:25:57.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.364+0000 7f5fe6095000 1 -- start start 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f6c2f60 0x55db6f71f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70cc20 0x55db6f71fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f705fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6f1cfa40 con 0x55db6f70cc20 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6f4d8260 con 0x55db6f6c2f60 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db6f50fad0 con 0x55db6f70d540 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70cc20 0x55db6f71fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70cc20 0x55db6f71fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53112/0 (socket says 172.21.15.133:53112) 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 -- 172.21.15.133:0/129765094 learned_addr learned my addr 172.21.15.133:0/129765094 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f6c2f60 0x55db6f71f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe12c2640 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f705fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 -- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 msgr2=0x55db6f705fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f705fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 -- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f6c2f60 msgr2=0x55db6f71f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f6c2f60 0x55db6f71f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 -- 172.21.15.133:0/129765094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db6f4bd540 con 0x55db6f70cc20 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f6c2f60 0x55db6f71f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe12c2640 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f705fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70cc20 0x55db6f71fd40 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc023040 tx=0x7f5fcc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4d571f61f204f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fc2ffd640 1 -- 172.21.15.133:0/129765094 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc009f50 con 0x55db6f70cc20 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fc2ffd640 1 -- 172.21.15.133:0/129765094 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc034040 con 0x55db6f70cc20 2023-12-18T10:25:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fc2ffd640 1 -- 172.21.15.133:0/129765094 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0343b0 con 0x55db6f70cc20 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- 172.21.15.133:0/129765094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70cc20 msgr2=0x55db6f71fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70cc20 0x55db6f71fd40 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc023040 tx=0x7f5fcc016000 comp rx=0 tx=0).stop 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- 172.21.15.133:0/129765094 shutdown_connections 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f705fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f70cc20 0x55db6f71fd40 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 --2- 172.21.15.133:0/129765094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f6c2f60 0x55db6f71f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- 172.21.15.133:0/129765094 >> 172.21.15.133:0/129765094 conn(0x55db6f4c18b0 msgr2=0x55db6f6c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- 172.21.15.133:0/129765094 shutdown_connections 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- 172.21.15.133:0/129765094 wait complete. 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 -- start start 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.368+0000 7f5fe6095000 1 Processor -- start 2023-12-18T10:25:57.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f76a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 0x55db6f76a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f709190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6f6c2a80 con 0x55db6f6c2f60 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db6f719440 con 0x55db6f70cc20 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db6f50dc30 con 0x55db6f70d540 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 10 client.0 _ll_register_callbacks cb 0x55db6f4c96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f76a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f76a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53124/0 (socket says 172.21.15.133:53124) 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/2470310852 learned_addr learned my addr 172.21.15.133:0/2470310852 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 0x55db6f76a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe12c2640 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f709190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 msgr2=0x55db6f709190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f709190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 msgr2=0x55db6f76a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 0x55db6f76a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 -- 172.21.15.133:0/2470310852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db6f20edc0 con 0x55db6f6c2f60 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe12c2640 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f709190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe0ac1640 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f76a340 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80eb320 tx=0x7f5fd811b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fd67c6515aec1d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/2470310852 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80c2070 con 0x55db6f6c2f60 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/2470310852 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fd80f4430 con 0x55db6f6c2f60 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- 172.21.15.133:0/2470310852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db6f6c68e0 con 0x55db6f6c2f60 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/2470310852 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fd8109070 con 0x55db6f6c2f60 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 10 client.9567 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- 172.21.15.133:0/2470310852 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x55db6f4b10b0 con 0x55db6f6c2f60 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/2470310852 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db6f6c68e0 con 0x55db6f6c2f60 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/2470310852 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5fd80a8040 con 0x55db6f6c2f60 2023-12-18T10:25:57.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 10 client.9567 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 10 client.9567 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 20 client.9567 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55db6f7096d0 0x55db6f709ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 4 client.9567 mds_command: new command op to 9048 tid=0[{"prefix": "scrub abort"}] 2023-12-18T10:25:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- 172.21.15.133:0/2470310852 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x55db6f4db640 con 0x55db6f7096d0 2023-12-18T10:25:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55db6f7096d0 0x55db6f709ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 10 client.9567 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fd3fff640 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55db6f7096d0 0x55db6f709ae0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7c4b468c730ab0b server_cookie=31fcab1a3e98bbbc in_seq=0 out_seq=0 2023-12-18T10:25:57.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 1 -- 172.21.15.133:0/2470310852 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55db6f4db640 con 0x55db6f7096d0 2023-12-18T10:25:57.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 10 client.9567 handle_command_reply: tid=0 2023-12-18T10:25:57.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 client.9567 shutdown 2023-12-18T10:25:57.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- 172.21.15.133:0/2470310852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 msgr2=0x55db6f76a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f76a340 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80eb320 tx=0x7f5fd811b5d0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- 172.21.15.133:0/2470310852 shutdown_connections 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55db6f7096d0 0x55db6f709ae0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55db6f70d540 0x55db6f709190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55db6f70cc20 0x55db6f76a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fbb7fe640 0 client.9567 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 --2- 172.21.15.133:0/2470310852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55db6f6c2f60 0x55db6f76a340 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- 172.21.15.133:0/2470310852 >> 172.21.15.133:0/2470310852 conn(0x55db6f4c18b0 msgr2=0x55db6f71e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- 172.21.15.133:0/2470310852 shutdown_connections 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.372+0000 7f5fe6095000 1 -- 172.21.15.133:0/2470310852 wait complete. 2023-12-18T10:25:57.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe6095000 20 client.9567 trim_cache size 0 max 16384 2023-12-18T10:25:57.380 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:57.380 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:25:57.380 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:57.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 -- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fc8065a60 msgr2=0x7f5fc8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fc8065a60 0x7f5fc8067f20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0ad020 tx=0x7f5fcc008040 comp rx=0 tx=0).stop 2023-12-18T10:25:57.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 -- 172.21.15.133:0/1600178168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc071db0 msgr2=0x7f5fdc150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc071db0 0x7f5fdc150980 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80ac040 tx=0x7f5fd801ad50 comp rx=0 tx=0).stop 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 -- 172.21.15.133:0/1600178168 shutdown_connections 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5fc8065a60 0x7f5fc8067f20 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fdc159fb0 0x7f5fdc0c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5fdc0ca410 0x7f5fdc0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 --2- 172.21.15.133:0/1600178168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fdc071db0 0x7f5fdc150980 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 -- 172.21.15.133:0/1600178168 >> 172.21.15.133:0/1600178168 conn(0x7f5fdc06a2a0 msgr2=0x7f5fdc0cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 -- 172.21.15.133:0/1600178168 shutdown_connections 2023-12-18T10:25:57.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.376+0000 7f5fe2d25640 1 -- 172.21.15.133:0/1600178168 wait complete. 2023-12-18T10:25:57.394 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2023-12-18T10:25:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff545f39640 1 Processor -- start 2023-12-18T10:25:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff545f39640 1 -- start start 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff545f39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff540153020 0x7ff5400c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff545f39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5400ceaa0 0x7ff540070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff545f39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5400c9730 con 0x7ff5401598d0 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff545f39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5400c8e00 con 0x7ff540153020 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff545f39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400c90e0 con 0x7ff5400ceaa0 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff53f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff540153020 0x7ff5400c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff53f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff540153020 0x7ff5400c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53134/0 (socket says 172.21.15.133:53134) 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff53f7fe640 1 -- 172.21.15.133:0/2289002657 learned_addr learned my addr 172.21.15.133:0/2289002657 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff53ffff640 1 --2- 172.21.15.133:0/2289002657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5400ceaa0 0x7ff540070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff53f7fe640 1 -- 172.21.15.133:0/2289002657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5400ceaa0 msgr2=0x7ff540070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/2289002657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5400ceaa0 0x7ff540070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff53f7fe640 1 -- 172.21.15.133:0/2289002657 >> v1:172.21.15.142:6789/0 conn(0x7ff5401598d0 legacy=0x7ff5400ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.536+0000 7ff53f7fe640 1 -- 172.21.15.133:0/2289002657 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5400c93c0 con 0x7ff540153020 2023-12-18T10:25:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/2289002657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff540153020 0x7ff5400c9bc0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7ff53000bb10 tx=0x7ff53001ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e970fbda4ba2e8c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff53e7fc640 1 -- 172.21.15.133:0/2289002657 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300a7b80 con 0x7ff540153020 2023-12-18T10:25:57.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff53e7fc640 1 -- 172.21.15.133:0/2289002657 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5300a7ce0 con 0x7ff540153020 2023-12-18T10:25:57.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff53e7fc640 1 -- 172.21.15.133:0/2289002657 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300af660 con 0x7ff540153020 2023-12-18T10:25:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff545f39640 1 -- 172.21.15.133:0/2289002657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff540153020 msgr2=0x7ff5400c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff545f39640 1 --2- 172.21.15.133:0/2289002657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff540153020 0x7ff5400c9bc0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7ff53000bb10 tx=0x7ff53001ea90 comp rx=0 tx=0).stop 2023-12-18T10:25:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff545f39640 1 -- 172.21.15.133:0/2289002657 shutdown_connections 2023-12-18T10:25:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff545f39640 1 --2- 172.21.15.133:0/2289002657 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5400ceaa0 0x7ff540070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff545f39640 1 --2- 172.21.15.133:0/2289002657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff540153020 0x7ff5400c9bc0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff545f39640 1 -- 172.21.15.133:0/2289002657 >> 172.21.15.133:0/2289002657 conn(0x7ff54006a2a0 msgr2=0x7ff5400aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff545f39640 1 -- 172.21.15.133:0/2289002657 shutdown_connections 2023-12-18T10:25:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.540+0000 7ff545f39640 1 -- 172.21.15.133:0/2289002657 wait complete. 2023-12-18T10:25:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 Processor -- start 2023-12-18T10:25:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 -- start start 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400ceaa0 0x7ff5401415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff540153020 0x7ff54014ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5401598d0 0x7ff54014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400b40c0 con 0x7ff5400ceaa0 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff540141ae0 con 0x7ff540153020 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400c8390 con 0x7ff5401598d0 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400ceaa0 0x7ff5401415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400ceaa0 0x7ff5401415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53138/0 (socket says 172.21.15.133:53138) 2023-12-18T10:25:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 -- 172.21.15.133:0/3418190332 learned_addr learned my addr 172.21.15.133:0/3418190332 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53effd640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff540153020 0x7ff54014ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53ffff640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5401598d0 0x7ff54014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 -- 172.21.15.133:0/3418190332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5401598d0 msgr2=0x7ff54014f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5401598d0 0x7ff54014f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 -- 172.21.15.133:0/3418190332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff540153020 msgr2=0x7ff54014ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff540153020 0x7ff54014ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 -- 172.21.15.133:0/3418190332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53000b770 con 0x7ff5400ceaa0 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400ceaa0 0x7ff5401415a0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7ff53000b2c0 tx=0x7ff53001d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff527fff640 1 -- 172.21.15.133:0/3418190332 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300a7b80 con 0x7ff5400ceaa0 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff527fff640 1 -- 172.21.15.133:0/3418190332 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5300ba480 con 0x7ff5400ceaa0 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff527fff640 1 -- 172.21.15.133:0/3418190332 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300ba810 con 0x7ff5400ceaa0 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 -- 172.21.15.133:0/3418190332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff54014fdd0 con 0x7ff5400ceaa0 2023-12-18T10:25:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.544+0000 7ff545f39640 1 -- 172.21.15.133:0/3418190332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff540150390 con 0x7ff5400ceaa0 2023-12-18T10:25:57.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff527fff640 1 -- 172.21.15.133:0/3418190332 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff5300ba970 con 0x7ff5400ceaa0 2023-12-18T10:25:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff527fff640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff52c065a60 0x7ff52c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff527fff640 1 -- 172.21.15.133:0/3418190332 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff53011eae0 con 0x7ff5400ceaa0 2023-12-18T10:25:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff53effd640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff52c065a60 0x7ff52c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff5492ab000 1 Processor -- start 2023-12-18T10:25:57.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff53effd640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff52c065a60 0x7ff52c067f20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff540151700 tx=0x7ff534009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff5492ab000 1 -- start start 2023-12-18T10:25:57.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 0x563a97d47a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97d483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff5492ab000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a97c10430 con 0x563a97d47fc0 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff5492ab000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a97b9e460 con 0x563a97d91c80 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff5492ab000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a97b9ba30 con 0x563a97d925a0 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.548+0000 7ff53ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97d483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97d483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53146/0 (socket says 172.21.15.133:53146) 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 -- 172.21.15.133:0/1655235123 learned_addr learned my addr 172.21.15.133:0/1655235123 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53effd640 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 0x563a97d47a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 -- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 msgr2=0x563a97d47a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 0x563a97d47a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 -- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 msgr2=0x563a97d92060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 -- 172.21.15.133:0/1655235123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a97893e20 con 0x563a97d47fc0 2023-12-18T10:25:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97d483a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7ff538009f20 tx=0x7ff5380077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e8c86661d975d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5257fa640 1 -- 172.21.15.133:0/1655235123 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5380147e0 con 0x563a97d47fc0 2023-12-18T10:25:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5257fa640 1 -- 172.21.15.133:0/1655235123 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800f050 con 0x563a97d47fc0 2023-12-18T10:25:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5257fa640 1 -- 172.21.15.133:0/1655235123 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538014b60 con 0x563a97d47fc0 2023-12-18T10:25:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- 172.21.15.133:0/1655235123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 msgr2=0x563a97d483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97d483a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7ff538009f20 tx=0x7ff5380077c0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- 172.21.15.133:0/1655235123 shutdown_connections 2023-12-18T10:25:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97d483a0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 0x563a97d47a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1655235123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- 172.21.15.133:0/1655235123 >> 172.21.15.133:0/1655235123 conn(0x563a97b46910 msgr2=0x563a97d46360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- 172.21.15.133:0/1655235123 shutdown_connections 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- 172.21.15.133:0/1655235123 wait complete. 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- start start 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 Processor -- start 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d47fc0 0x563a97d92980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d925a0 0x563a97d93400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a97b97320 con 0x563a97d925a0 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a97b364f0 con 0x563a97d91c80 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a97b546e0 con 0x563a97d47fc0 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff5492ab000 10 client.0 _ll_register_callbacks cb 0x563a97d33980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d925a0 0x563a97d93400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d925a0 0x563a97d93400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53148/0 (socket says 172.21.15.133:53148) 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53ffff640 1 -- 172.21.15.133:0/1184763941 learned_addr learned my addr 172.21.15.133:0/1184763941 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.552+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d47fc0 0x563a97d92980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53effd640 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53ffff640 1 -- 172.21.15.133:0/1184763941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d47fc0 msgr2=0x563a97d92980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53ffff640 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d47fc0 0x563a97d92980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53ffff640 1 -- 172.21.15.133:0/1184763941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 msgr2=0x563a97d92ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53ffff640 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53ffff640 1 -- 172.21.15.133:0/1184763941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff540150390 con 0x563a97d925a0 2023-12-18T10:25:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53ffff640 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d925a0 0x563a97d93400 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7ff538000f90 tx=0x7ff538004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146f212ac61b3cf server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 1 -- 172.21.15.133:0/1184763941 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538009410 con 0x563a97d925a0 2023-12-18T10:25:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 1 -- 172.21.15.133:0/1184763941 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff538015670 con 0x563a97d925a0 2023-12-18T10:25:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 -- 172.21.15.133:0/1184763941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a97b54120 con 0x563a97d925a0 2023-12-18T10:25:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 1 -- 172.21.15.133:0/1184763941 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff538015830 con 0x563a97d925a0 2023-12-18T10:25:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 10 client.9579 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:57.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 -- 172.21.15.133:0/1184763941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x7ff538009b50 con 0x563a97d925a0 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 1 -- 172.21.15.133:0/1184763941 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563a97b54120 con 0x563a97d925a0 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 1 -- 172.21.15.133:0/1184763941 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7ff538015990 con 0x563a97d925a0 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 10 client.9579 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 10 client.9579 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 20 client.9579 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x563a97da1840 0x563a97da3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 4 client.9579 mds_command: new command op to 9042 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 -- 172.21.15.133:0/1184763941 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a97b95c70 con 0x563a97da1840 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x563a97da1840 0x563a97da3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x563a97da1840 0x563a97da3c30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4c2353501613d1b server_cookie=d87211b3f00ba88a in_seq=0 out_seq=0 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 10 client.9579 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 1 -- 172.21.15.133:0/1184763941 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563a97b95c70 con 0x563a97da1840 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 10 client.9579 handle_command_reply: tid=0 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 client.9579 shutdown 2023-12-18T10:25:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 -- 172.21.15.133:0/1184763941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d925a0 msgr2=0x563a97d93400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d925a0 0x563a97d93400 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7ff538000f90 tx=0x7ff538004ac0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 -- 172.21.15.133:0/1184763941 shutdown_connections 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x563a97da1840 0x563a97da3c30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d925a0 0x563a97d93400 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97d92ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff51e7fc640 0 client.9579 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 --2- 172.21.15.133:0/1184763941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d47fc0 0x563a97d92980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 -- 172.21.15.133:0/1184763941 >> 172.21.15.133:0/1184763941 conn(0x563a97b46910 msgr2=0x563a97d46a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 -- 172.21.15.133:0/1184763941 shutdown_connections 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 1 -- 172.21.15.133:0/1184763941 wait complete. 2023-12-18T10:25:57.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.556+0000 7ff5492ab000 20 client.9579 trim_cache size 0 max 16384 2023-12-18T10:25:57.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff5492ab000 1 Processor -- start 2023-12-18T10:25:57.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff5492ab000 1 -- start start 2023-12-18T10:25:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97da4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d91c80 0x563a97da5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d925a0 0x563a97d8b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff5492ab000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a97854aa0 con 0x563a97d47fc0 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff5492ab000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a97b92c90 con 0x563a97d925a0 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff5492ab000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a97b3c820 con 0x563a97d91c80 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97da4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97da4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53158/0 (socket says 172.21.15.133:53158) 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 -- 172.21.15.133:0/2260664194 learned_addr learned my addr 172.21.15.133:0/2260664194 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53ffff640 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d925a0 0x563a97d8b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53effd640 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d91c80 0x563a97da5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 -- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d91c80 msgr2=0x563a97da5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d91c80 0x563a97da5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 -- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d925a0 msgr2=0x563a97d8b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d925a0 0x563a97d8b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 -- 172.21.15.133:0/2260664194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a97b5c250 con 0x563a97d47fc0 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53ffff640 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d925a0 0x563a97d8b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53effd640 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d91c80 0x563a97da5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97da4c40 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7ff5300ec3d0 tx=0x7ff5300c6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f083226ca08941b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff525ffb640 1 -- 172.21.15.133:0/2260664194 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53010b070 con 0x563a97d47fc0 2023-12-18T10:25:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff525ffb640 1 -- 172.21.15.133:0/2260664194 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53011a070 con 0x563a97d47fc0 2023-12-18T10:25:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.572+0000 7ff525ffb640 1 -- 172.21.15.133:0/2260664194 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300efed0 con 0x563a97d47fc0 2023-12-18T10:25:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- 172.21.15.133:0/2260664194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 msgr2=0x563a97da4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97da4c40 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7ff5300ec3d0 tx=0x7ff5300c6040 comp rx=0 tx=0).stop 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- 172.21.15.133:0/2260664194 shutdown_connections 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d925a0 0x563a97d8b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d91c80 0x563a97da5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 --2- 172.21.15.133:0/2260664194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97da4c40 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- 172.21.15.133:0/2260664194 >> 172.21.15.133:0/2260664194 conn(0x563a97b46910 msgr2=0x563a97d4d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- 172.21.15.133:0/2260664194 shutdown_connections 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- 172.21.15.133:0/2260664194 wait complete. 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- start start 2023-12-18T10:25:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 Processor -- start 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97defe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97df03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 0x563a97d8e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a97d9e3f0 con 0x563a97d47fc0 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a97b94720 con 0x563a97d91c80 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a97d9f120 con 0x563a97d925a0 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 10 client.0 _ll_register_callbacks cb 0x563a97b4e710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97defe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97defe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53170/0 (socket says 172.21.15.133:53170) 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 -- 172.21.15.133:0/222630908 learned_addr learned my addr 172.21.15.133:0/222630908 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53effd640 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97df03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53ffff640 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 0x563a97d8e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 -- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 msgr2=0x563a97d8e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 0x563a97d8e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 -- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 msgr2=0x563a97df03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97df03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 -- 172.21.15.133:0/222630908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5300c9070 con 0x563a97d47fc0 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53effd640 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97df03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53f7fe640 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97defe90 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7ff53001d1a0 tx=0x7ff53011cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d8dd56a1f8f52 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff51e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff51e7fc640 1 -- 172.21.15.133:0/222630908 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530113070 con 0x563a97d47fc0 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff51e7fc640 1 -- 172.21.15.133:0/222630908 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff53010c070 con 0x563a97d47fc0 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- 172.21.15.133:0/222630908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a97d4b940 con 0x563a97d47fc0 2023-12-18T10:25:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff51e7fc640 1 -- 172.21.15.133:0/222630908 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff53010b030 con 0x563a97d47fc0 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 10 client.9585 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- 172.21.15.133:0/222630908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x563a97b425a0 con 0x563a97d47fc0 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff51e7fc640 1 -- 172.21.15.133:0/222630908 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563a97d4b940 con 0x563a97d47fc0 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff51e7fc640 1 -- 172.21.15.133:0/222630908 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7ff5300b6030 con 0x563a97d47fc0 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 10 client.9585 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 10 client.9585 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 20 client.9585 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x563a97d8e730 0x563a97d8eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 4 client.9585 mds_command: new command op to 9042 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff5492ab000 1 -- 172.21.15.133:0/222630908 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563a97b606a0 con 0x563a97d8e730 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.576+0000 7ff53effd640 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x563a97d8e730 0x563a97d8eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff51e7fc640 10 client.9585 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff53effd640 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x563a97d8e730 0x563a97d8eb40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c873feae4cde0666 server_cookie=4b64767833aafa9e in_seq=0 out_seq=0 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff51e7fc640 1 -- 172.21.15.133:0/222630908 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x563a97b606a0 con 0x563a97d8e730 2023-12-18T10:25:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff51e7fc640 10 client.9585 handle_command_reply: tid=0 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 client.9585 shutdown 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 -- 172.21.15.133:0/222630908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 msgr2=0x563a97defe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97defe90 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7ff53001d1a0 tx=0x7ff53011cce0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 -- 172.21.15.133:0/222630908 shutdown_connections 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x563a97d8e730 0x563a97d8eb40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x563a97d925a0 0x563a97d8e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff51e7fc640 0 client.9585 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563a97d91c80 0x563a97df03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 --2- 172.21.15.133:0/222630908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563a97d47fc0 0x563a97defe90 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 -- 172.21.15.133:0/222630908 >> 172.21.15.133:0/222630908 conn(0x563a97b46910 msgr2=0x563a97da3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 -- 172.21.15.133:0/222630908 shutdown_connections 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 1 -- 172.21.15.133:0/222630908 wait complete. 2023-12-18T10:25:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff5492ab000 20 client.9585 trim_cache size 0 max 16384 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:57.585 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 -- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff52c065a60 msgr2=0x7ff52c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff52c065a60 0x7ff52c067f20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff540151700 tx=0x7ff534009040 comp rx=0 tx=0).stop 2023-12-18T10:25:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 -- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400ceaa0 msgr2=0x7ff5401415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400ceaa0 0x7ff5401415a0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7ff53000b2c0 tx=0x7ff53001d330 comp rx=0 tx=0).stop 2023-12-18T10:25:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 -- 172.21.15.133:0/3418190332 shutdown_connections 2023-12-18T10:25:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff52c065a60 0x7ff52c067f20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5401598d0 0x7ff54014f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff540153020 0x7ff54014ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 --2- 172.21.15.133:0/3418190332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400ceaa0 0x7ff5401415a0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 -- 172.21.15.133:0/3418190332 >> 172.21.15.133:0/3418190332 conn(0x7ff54006a2a0 msgr2=0x7ff540151930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 -- 172.21.15.133:0/3418190332 shutdown_connections 2023-12-18T10:25:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.580+0000 7ff545f39640 1 -- 172.21.15.133:0/3418190332 wait complete. 2023-12-18T10:25:57.599 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:57.599 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2023-12-18T10:25:57.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.736+0000 7fc3f40b6640 1 Processor -- start 2023-12-18T10:25:57.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f40b6640 1 -- start start 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f40b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3ec0ca410 0x7fc3ec159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f40b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc3ec0cbff0 0x7fc3ec0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f40b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0cc930 con 0x7fc3ec159fb0 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f40b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec15aab0 con 0x7fc3ec0ca410 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f40b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec070df0 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f1e52640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3ec0ca410 0x7fc3ec159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f1e52640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3ec0ca410 0x7fc3ec159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53180/0 (socket says 172.21.15.133:53180) 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f1e52640 1 -- 172.21.15.133:0/252926257 learned_addr learned my addr 172.21.15.133:0/252926257 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f2653640 1 --2- 172.21.15.133:0/252926257 >> v2:172.21.15.142:3300/0 conn(0x7fc3ec0cbff0 0x7fc3ec0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f1e52640 1 -- 172.21.15.133:0/252926257 >> v2:172.21.15.142:3300/0 conn(0x7fc3ec0cbff0 msgr2=0x7fc3ec0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/252926257 >> v2:172.21.15.142:3300/0 conn(0x7fc3ec0cbff0 0x7fc3ec0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f1e52640 1 -- 172.21.15.133:0/252926257 >> v1:172.21.15.142:6789/0 conn(0x7fc3ec159fb0 legacy=0x7fc3ec071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.740+0000 7fc3f1e52640 1 -- 172.21.15.133:0/252926257 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec15a4f0 con 0x7fc3ec0ca410 2023-12-18T10:25:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/252926257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0ca410 0x7fc3ec159a70 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0c1ef0 tx=0x7fc3e801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18872be5c289bd4c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f0e50640 1 -- 172.21.15.133:0/252926257 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80a86b0 con 0x7fc3ec0ca410 2023-12-18T10:25:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f0e50640 1 -- 172.21.15.133:0/252926257 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e80a8810 con 0x7fc3ec0ca410 2023-12-18T10:25:57.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f0e50640 1 -- 172.21.15.133:0/252926257 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80a8ba0 con 0x7fc3ec0ca410 2023-12-18T10:25:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 -- 172.21.15.133:0/252926257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0ca410 msgr2=0x7fc3ec159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/252926257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0ca410 0x7fc3ec159a70 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0c1ef0 tx=0x7fc3e801e6e0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 -- 172.21.15.133:0/252926257 shutdown_connections 2023-12-18T10:25:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/252926257 >> v2:172.21.15.142:3300/0 conn(0x7fc3ec0cbff0 0x7fc3ec0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/252926257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0ca410 0x7fc3ec159a70 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 -- 172.21.15.133:0/252926257 >> 172.21.15.133:0/252926257 conn(0x7fc3ec06a2a0 msgr2=0x7fc3ec0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 -- 172.21.15.133:0/252926257 shutdown_connections 2023-12-18T10:25:57.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 -- 172.21.15.133:0/252926257 wait complete. 2023-12-18T10:25:57.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 Processor -- start 2023-12-18T10:25:57.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.744+0000 7fc3f40b6640 1 -- start start 2023-12-18T10:25:57.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f40b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3ec0ca410 0x7fc3ec1f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f40b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0cbff0 0x7fc3ec14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f40b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3ec159fb0 0x7fc3ec15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f40b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec1f8fa0 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f40b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec14dde0 con 0x7fc3ec159fb0 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f40b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec1f4c00 con 0x7fc3ec0ca410 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1651640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0cbff0 0x7fc3ec14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1e52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3ec0ca410 0x7fc3ec1f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1e52640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3ec0ca410 0x7fc3ec1f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:36332/0 (socket says 172.21.15.133:36332) 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1e52640 1 -- 172.21.15.133:0/716388244 learned_addr learned my addr 172.21.15.133:0/716388244 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1651640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0cbff0 0x7fc3ec14d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53184/0 (socket says 172.21.15.133:53184) 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f2653640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3ec159fb0 0x7fc3ec15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1651640 1 -- 172.21.15.133:0/716388244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3ec0ca410 msgr2=0x7fc3ec1f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1651640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3ec0ca410 0x7fc3ec1f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1651640 1 -- 172.21.15.133:0/716388244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3ec159fb0 msgr2=0x7fc3ec15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1651640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3ec159fb0 0x7fc3ec15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1651640 1 -- 172.21.15.133:0/716388244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80094d0 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3ec0ca410 0x7fc3ec1f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:57.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f1651640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0cbff0 0x7fc3ec14d8a0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00c390 tx=0x7fc3dc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3e27fc640 1 -- 172.21.15.133:0/716388244 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0052d0 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3e27fc640 1 -- 172.21.15.133:0/716388244 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc005430 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3e27fc640 1 -- 172.21.15.133:0/716388244 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc007260 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f40b6640 1 -- 172.21.15.133:0/716388244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec14ef50 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.748+0000 7fc3f40b6640 1 -- 172.21.15.133:0/716388244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec1f5180 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3e27fc640 1 -- 172.21.15.133:0/716388244 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3dc0073c0 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3e27fc640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3d0065a60 0x7fc3d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3e27fc640 1 -- 172.21.15.133:0/716388244 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc3dc082570 con 0x7fc3ec0cbff0 2023-12-18T10:25:57.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3d0065a60 0x7fc3d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f7416000 1 Processor -- start 2023-12-18T10:25:57.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f7416000 1 -- start start 2023-12-18T10:25:57.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3d0065a60 0x7fc3d0067f20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc3e801c310 tx=0x7fc3e80a9000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21543060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c215435a0 0x564c214f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c214f8fc0 0x564c214f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f7416000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c213c1430 con 0x564c21542c80 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f7416000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c2134f460 con 0x564c215435a0 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f7416000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c2134ca30 con 0x564c214f8fc0 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21543060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21543060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53198/0 (socket says 172.21.15.133:53198) 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 -- 172.21.15.133:0/506811593 learned_addr learned my addr 172.21.15.133:0/506811593 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1651640 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c215435a0 0x564c214f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f2653640 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c214f8fc0 0x564c214f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 -- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c214f8fc0 msgr2=0x564c214f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c214f8fc0 0x564c214f93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 -- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c215435a0 msgr2=0x564c214f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.752+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c215435a0 0x564c214f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f1e52640 1 -- 172.21.15.133:0/506811593 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c21044e20 con 0x564c21542c80 2023-12-18T10:25:57.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f2653640 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c214f8fc0 0x564c214f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21543060 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fc3e801e720 tx=0x7fc3e8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e4b9f9134ae662 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3cf7fe640 1 -- 172.21.15.133:0/506811593 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80c0070 con 0x564c21542c80 2023-12-18T10:25:57.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3cf7fe640 1 -- 172.21.15.133:0/506811593 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e80bb910 con 0x564c21542c80 2023-12-18T10:25:57.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3cf7fe640 1 -- 172.21.15.133:0/506811593 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80bbc80 con 0x564c21542c80 2023-12-18T10:25:57.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- 172.21.15.133:0/506811593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 msgr2=0x564c21543060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21543060 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fc3e801e720 tx=0x7fc3e8004740 comp rx=0 tx=0).stop 2023-12-18T10:25:57.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- 172.21.15.133:0/506811593 shutdown_connections 2023-12-18T10:25:57.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c214f8fc0 0x564c214f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c215435a0 0x564c214f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 --2- 172.21.15.133:0/506811593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21543060 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- 172.21.15.133:0/506811593 >> 172.21.15.133:0/506811593 conn(0x564c212f7910 msgr2=0x564c214f7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- 172.21.15.133:0/506811593 shutdown_connections 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- 172.21.15.133:0/506811593 wait complete. 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- start start 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 Processor -- start 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c214f8fc0 0x564c2154a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c21542c80 0x564c2154a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 0x564c21543980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c21348320 con 0x564c214f8fc0 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c212e74f0 con 0x564c21542c80 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c213056e0 con 0x564c215435a0 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f7416000 10 client.0 _ll_register_callbacks cb 0x564c214e4980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f1e52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c214f8fc0 0x564c2154a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f1e52640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c214f8fc0 0x564c2154a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53202/0 (socket says 172.21.15.133:53202) 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f1e52640 1 -- 172.21.15.133:0/484335324 learned_addr learned my addr 172.21.15.133:0/484335324 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f1651640 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c21542c80 0x564c2154a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.756+0000 7fc3f2653640 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 0x564c21543980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f1e52640 1 -- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 msgr2=0x564c21543980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 0x564c21543980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f1e52640 1 -- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c21542c80 msgr2=0x564c2154a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c21542c80 0x564c2154a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f1e52640 1 -- 172.21.15.133:0/484335324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec15a4f0 con 0x564c214f8fc0 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f2653640 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 0x564c21543980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c214f8fc0 0x564c2154a0c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8024cd0 tx=0x7fc3e801cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc3c60148ed74e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 1 -- 172.21.15.133:0/484335324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80c0040 con 0x564c214f8fc0 2023-12-18T10:25:57.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 -- 172.21.15.133:0/484335324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c21305120 con 0x564c214f8fc0 2023-12-18T10:25:57.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 1 -- 172.21.15.133:0/484335324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc3e80ac070 con 0x564c214f8fc0 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 1 -- 172.21.15.133:0/484335324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3e80bbb10 con 0x564c214f8fc0 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 10 client.9597 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 -- 172.21.15.133:0/484335324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x564c2130d250 con 0x564c214f8fc0 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 1 -- 172.21.15.133:0/484335324 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564c21305120 con 0x564c214f8fc0 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 1 -- 172.21.15.133:0/484335324 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fc3e80bbc70 con 0x564c214f8fc0 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 10 client.9597 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 10 client.9597 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 20 client.9597 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x564c21544720 0x564c21544b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 4 client.9597 mds_command: new command op to 9039 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 -- 172.21.15.133:0/484335324 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c21346c70 con 0x564c21544720 2023-12-18T10:25:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f1651640 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x564c21544720 0x564c21544b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f1651640 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x564c21544720 0x564c21544b00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e82f5d6eda844dbd server_cookie=9239644322e7a5e6 in_seq=0 out_seq=0 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 10 client.9597 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 1 -- 172.21.15.133:0/484335324 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x564c21346c70 con 0x564c21544720 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 10 client.9597 handle_command_reply: tid=0 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 client.9597 shutdown 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 -- 172.21.15.133:0/484335324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c214f8fc0 msgr2=0x564c2154a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c214f8fc0 0x564c2154a0c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8024cd0 tx=0x7fc3e801cf20 comp rx=0 tx=0).stop 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 -- 172.21.15.133:0/484335324 shutdown_connections 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x564c21544720 0x564c21544b00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 0x564c21543980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c21542c80 0x564c2154a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3ccff9640 0 client.9597 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 --2- 172.21.15.133:0/484335324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c214f8fc0 0x564c2154a0c0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 -- 172.21.15.133:0/484335324 >> 172.21.15.133:0/484335324 conn(0x564c212f7910 msgr2=0x564c214f7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 -- 172.21.15.133:0/484335324 shutdown_connections 2023-12-18T10:25:57.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 1 -- 172.21.15.133:0/484335324 wait complete. 2023-12-18T10:25:57.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.760+0000 7fc3f7416000 20 client.9597 trim_cache size 0 max 16384 2023-12-18T10:25:57.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 Processor -- start 2023-12-18T10:25:57.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 -- start start 2023-12-18T10:25:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21547b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21548060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 0x564c2153c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c21005aa0 con 0x564c21542c80 2023-12-18T10:25:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c21343c90 con 0x564c214f8fc0 2023-12-18T10:25:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c214f8ae0 con 0x564c215435a0 2023-12-18T10:25:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21548060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21548060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53208/0 (socket says 172.21.15.133:53208) 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 -- 172.21.15.133:0/3625313798 learned_addr learned my addr 172.21.15.133:0/3625313798 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/3625313798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21547b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 -- 172.21.15.133:0/3625313798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 msgr2=0x564c2153c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 --2- 172.21.15.133:0/3625313798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 0x564c2153c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 -- 172.21.15.133:0/3625313798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 msgr2=0x564c21547b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 --2- 172.21.15.133:0/3625313798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21547b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 -- 172.21.15.133:0/3625313798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c212f35a0 con 0x564c21542c80 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f1651640 1 --2- 172.21.15.133:0/3625313798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21548060 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc053750 tx=0x7fc3dc01d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce24961ecf68a5e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3cffff640 1 -- 172.21.15.133:0/3625313798 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0809b0 con 0x564c21542c80 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3cffff640 1 -- 172.21.15.133:0/3625313798 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc051e40 con 0x564c21542c80 2023-12-18T10:25:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3cffff640 1 -- 172.21.15.133:0/3625313798 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc05b540 con 0x564c21542c80 2023-12-18T10:25:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 -- 172.21.15.133:0/3625313798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 msgr2=0x564c21548060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 --2- 172.21.15.133:0/3625313798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21548060 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc053750 tx=0x7fc3dc01d040 comp rx=0 tx=0).stop 2023-12-18T10:25:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 -- 172.21.15.133:0/3625313798 shutdown_connections 2023-12-18T10:25:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 --2- 172.21.15.133:0/3625313798 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c215435a0 0x564c2153c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 --2- 172.21.15.133:0/3625313798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c21542c80 0x564c21548060 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 --2- 172.21.15.133:0/3625313798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21547b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.776+0000 7fc3f7416000 1 -- 172.21.15.133:0/3625313798 >> 172.21.15.133:0/3625313798 conn(0x564c212f7910 msgr2=0x564c214fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- 172.21.15.133:0/3625313798 shutdown_connections 2023-12-18T10:25:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- 172.21.15.133:0/3625313798 wait complete. 2023-12-18T10:25:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- start start 2023-12-18T10:25:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 Processor -- start 2023-12-18T10:25:57.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21583a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c21542c80 0x564c21584290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c215435a0 0x564c215847d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c21417140 con 0x564c215435a0 2023-12-18T10:25:57.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c21306480 con 0x564c214f8fc0 2023-12-18T10:25:57.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x564c21345720 con 0x564c21542c80 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 10 client.0 _ll_register_callbacks cb 0x564c212ff710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c215435a0 0x564c215847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c215435a0 0x564c215847d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53210/0 (socket says 172.21.15.133:53210) 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 -- 172.21.15.133:0/675119860 learned_addr learned my addr 172.21.15.133:0/675119860 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 -- 172.21.15.133:0/675119860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c21542c80 msgr2=0x564c21584290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c21542c80 0x564c21584290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21583a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 -- 172.21.15.133:0/675119860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 msgr2=0x564c21583a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21583a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 -- 172.21.15.133:0/675119860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec1f5180 con 0x564c215435a0 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21583a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f2653640 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c215435a0 0x564c215847d0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4004660 tx=0x7fc3e4007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d929ded333eeeb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3ccff9640 1 -- 172.21.15.133:0/675119860 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400e040 con 0x564c215435a0 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3ccff9640 1 -- 172.21.15.133:0/675119860 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc3e4017440 con 0x564c215435a0 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- 172.21.15.133:0/675119860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c213116a0 con 0x564c215435a0 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3ccff9640 1 -- 172.21.15.133:0/675119860 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3e4017600 con 0x564c215435a0 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 10 client.9603 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- 172.21.15.133:0/675119860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x564c212e7110 con 0x564c215435a0 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3ccff9640 1 -- 172.21.15.133:0/675119860 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564c213116a0 con 0x564c215435a0 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3ccff9640 1 -- 172.21.15.133:0/675119860 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fc3e4014050 con 0x564c215435a0 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 10 client.9603 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 10 client.9603 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 20 client.9603 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x564c21584d10 0x564c21585120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 4 client.9603 mds_command: new command op to 9039 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.780+0000 7fc3f7416000 1 -- 172.21.15.133:0/675119860 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564c213413a0 con 0x564c21584d10 2023-12-18T10:25:57.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x564c21584d10 0x564c21585120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f1e52640 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x564c21584d10 0x564c21585120 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea35c75db8943be7 server_cookie=41391a2b92e71c93 in_seq=0 out_seq=0 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3ccff9640 10 client.9603 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3ccff9640 1 -- 172.21.15.133:0/675119860 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x564c213413a0 con 0x564c21584d10 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3ccff9640 10 client.9603 handle_command_reply: tid=0 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 client.9603 shutdown 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 -- 172.21.15.133:0/675119860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c215435a0 msgr2=0x564c215847d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c215435a0 0x564c215847d0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4004660 tx=0x7fc3e4007700 comp rx=0 tx=0).stop 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 -- 172.21.15.133:0/675119860 shutdown_connections 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x564c21584d10 0x564c21585120 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564c215435a0 0x564c215847d0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x564c21542c80 0x564c21584290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3ccff9640 0 client.9603 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 --2- 172.21.15.133:0/675119860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564c214f8fc0 0x564c21583a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 -- 172.21.15.133:0/675119860 >> 172.21.15.133:0/675119860 conn(0x564c212f7910 msgr2=0x564c21546b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 -- 172.21.15.133:0/675119860 shutdown_connections 2023-12-18T10:25:57.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 1 -- 172.21.15.133:0/675119860 wait complete. 2023-12-18T10:25:57.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f7416000 20 client.9603 trim_cache size 0 max 16384 2023-12-18T10:25:57.788 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:57.789 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 -- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3d0065a60 msgr2=0x7fc3d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3d0065a60 0x7fc3d0067f20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc3e801c310 tx=0x7fc3e80a9000 comp rx=0 tx=0).stop 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 -- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0cbff0 msgr2=0x7fc3ec14d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0cbff0 0x7fc3ec14d8a0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00c390 tx=0x7fc3dc00c850 comp rx=0 tx=0).stop 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 -- 172.21.15.133:0/716388244 shutdown_connections 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc3d0065a60 0x7fc3d0067f20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3ec159fb0 0x7fc3ec15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3ec0cbff0 0x7fc3ec14d8a0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 --2- 172.21.15.133:0/716388244 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc3ec0ca410 0x7fc3ec1f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 -- 172.21.15.133:0/716388244 >> 172.21.15.133:0/716388244 conn(0x7fc3ec06a2a0 msgr2=0x7fc3ec0c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 -- 172.21.15.133:0/716388244 shutdown_connections 2023-12-18T10:25:57.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.784+0000 7fc3f40b6640 1 -- 172.21.15.133:0/716388244 wait complete. 2023-12-18T10:25:57.803 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:57.804 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-12-18T10:25:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.940+0000 7fc58b6f9640 1 Processor -- start 2023-12-18T10:25:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.940+0000 7fc58b6f9640 1 -- start start 2023-12-18T10:25:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc58b6f9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5841582d0 0x7fc5840c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc58b6f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 0x7fc5840ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc58b6f9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840c9390 con 0x7fc584070820 2023-12-18T10:25:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc58b6f9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5840ced80 con 0x7fc5841582d0 2023-12-18T10:25:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc58b6f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58415aee0 con 0x7fc5840ce3b0 2023-12-18T10:25:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc589495640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc5841582d0 0x7fc5840c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc588c94640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc584070820 0x7fc5840ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:48324/0 (socket says 172.21.15.133:48324) 2023-12-18T10:25:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc588c94640 1 -- 172.21.15.133:0/3388350635 learned_addr learned my addr 172.21.15.133:0/3388350635 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc589c96640 1 --2- 172.21.15.133:0/3388350635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 0x7fc5840ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc589495640 1 -- 172.21.15.133:0/3388350635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 msgr2=0x7fc5840ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc589495640 1 --2- 172.21.15.133:0/3388350635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 0x7fc5840ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc589495640 1 -- 172.21.15.133:0/3388350635 >> v1:172.21.15.142:6789/0 conn(0x7fc584070820 legacy=0x7fc5840ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.944+0000 7fc589495640 1 -- 172.21.15.133:0/3388350635 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58415b1c0 con 0x7fc5841582d0 2023-12-18T10:25:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc589495640 1 --2- 172.21.15.133:0/3388350635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 0x7fc5840c8e50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc5800097c0 tx=0x7fc58001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24631e6c3d38b7d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc57bfff640 1 -- 172.21.15.133:0/3388350635 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800ab650 con 0x7fc5841582d0 2023-12-18T10:25:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc57bfff640 1 -- 172.21.15.133:0/3388350635 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800ab7b0 con 0x7fc5841582d0 2023-12-18T10:25:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc57bfff640 1 -- 172.21.15.133:0/3388350635 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800abb40 con 0x7fc5841582d0 2023-12-18T10:25:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 -- 172.21.15.133:0/3388350635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 msgr2=0x7fc5840c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/3388350635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 0x7fc5840c8e50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc5800097c0 tx=0x7fc58001c450 comp rx=0 tx=0).stop 2023-12-18T10:25:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 -- 172.21.15.133:0/3388350635 shutdown_connections 2023-12-18T10:25:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/3388350635 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 0x7fc5840ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/3388350635 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 0x7fc5840c8e50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 -- 172.21.15.133:0/3388350635 >> 172.21.15.133:0/3388350635 conn(0x7fc58406a2a0 msgr2=0x7fc5840aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 -- 172.21.15.133:0/3388350635 shutdown_connections 2023-12-18T10:25:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 -- 172.21.15.133:0/3388350635 wait complete. 2023-12-18T10:25:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 Processor -- start 2023-12-18T10:25:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.948+0000 7fc58b6f9640 1 -- start start 2023-12-18T10:25:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc58b6f9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc584070820 0x7fc5841636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc58b6f9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 0x7fc5841f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc58b6f9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 0x7fc584153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc58b6f9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc584164900 con 0x7fc584070820 2023-12-18T10:25:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc58b6f9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58415a200 con 0x7fc5841582d0 2023-12-18T10:25:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc58b6f9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc584163c80 con 0x7fc5840ce3b0 2023-12-18T10:25:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc584070820 0x7fc5841636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc584070820 0x7fc5841636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53216/0 (socket says 172.21.15.133:53216) 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 -- 172.21.15.133:0/2103853602 learned_addr learned my addr 172.21.15.133:0/2103853602 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589c96640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 0x7fc584153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc588c94640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 0x7fc5841f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 -- 172.21.15.133:0/2103853602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 msgr2=0x7fc5841f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 0x7fc5841f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 -- 172.21.15.133:0/2103853602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 msgr2=0x7fc584153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 0x7fc584153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 -- 172.21.15.133:0/2103853602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580009420 con 0x7fc584070820 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc589495640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc584070820 0x7fc5841636a0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fc5800ad040 tx=0x7fc58001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc579ffb640 1 -- 172.21.15.133:0/2103853602 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b5810 con 0x7fc584070820 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc579ffb640 1 -- 172.21.15.133:0/2103853602 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800b5990 con 0x7fc584070820 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc58b6f9640 1 -- 172.21.15.133:0/2103853602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc584163f60 con 0x7fc584070820 2023-12-18T10:25:57.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc579ffb640 1 -- 172.21.15.133:0/2103853602 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b5d40 con 0x7fc584070820 2023-12-18T10:25:57.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.952+0000 7fc58b6f9640 1 -- 172.21.15.133:0/2103853602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc584164520 con 0x7fc584070820 2023-12-18T10:25:57.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc579ffb640 1 -- 172.21.15.133:0/2103853602 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc5800c83f0 con 0x7fc584070820 2023-12-18T10:25:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc579ffb640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc568065a90 0x7fc568067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc579ffb640 1 -- 172.21.15.133:0/2103853602 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc58011e310 con 0x7fc584070820 2023-12-18T10:25:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc588c94640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc568065a90 0x7fc568067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc58ea54000 1 Processor -- start 2023-12-18T10:25:57.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc588c94640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc568065a90 0x7fc568067f50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc5840c8490 tx=0x7fc574009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc58ea54000 1 -- start start 2023-12-18T10:25:57.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219037060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e2190375a0 0x55e218feca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e218fed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc58ea54000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e218eb5430 con 0x55e2190375a0 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc58ea54000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e218e43460 con 0x55e218fecfc0 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc58ea54000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e218e40a30 con 0x55e219036c80 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc588c94640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e2190375a0 0x55e218feca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc588c94640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e2190375a0 0x55e218feca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53224/0 (socket says 172.21.15.133:53224) 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc588c94640 1 -- 172.21.15.133:0/3959839151 learned_addr learned my addr 172.21.15.133:0/3959839151 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc589495640 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219037060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.956+0000 7fc589c96640 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e218fed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 -- 172.21.15.133:0/3959839151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 msgr2=0x55e219037060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219037060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 -- 172.21.15.133:0/3959839151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 msgr2=0x55e218fed3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e218fed3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 -- 172.21.15.133:0/3959839151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e218b38e20 con 0x55e2190375a0 2023-12-18T10:25:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e2190375a0 0x55e218feca80 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fc574001e40 tx=0x7fc574011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc320ab581f5cdca server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc56effd640 1 -- 172.21.15.133:0/3959839151 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574005e10 con 0x55e2190375a0 2023-12-18T10:25:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc56effd640 1 -- 172.21.15.133:0/3959839151 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400e7b0 con 0x55e2190375a0 2023-12-18T10:25:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc56effd640 1 -- 172.21.15.133:0/3959839151 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400eb20 con 0x55e2190375a0 2023-12-18T10:25:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- 172.21.15.133:0/3959839151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e2190375a0 msgr2=0x55e218feca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e2190375a0 0x55e218feca80 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fc574001e40 tx=0x7fc574011000 comp rx=0 tx=0).stop 2023-12-18T10:25:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- 172.21.15.133:0/3959839151 shutdown_connections 2023-12-18T10:25:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e218fed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e2190375a0 0x55e218feca80 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 --2- 172.21.15.133:0/3959839151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219037060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- 172.21.15.133:0/3959839151 >> 172.21.15.133:0/3959839151 conn(0x55e218deb910 msgr2=0x55e218feb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- 172.21.15.133:0/3959839151 shutdown_connections 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- 172.21.15.133:0/3959839151 wait complete. 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- start start 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 Processor -- start 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e2190364e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e219036c80 0x55e219037980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219037ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e218e3c320 con 0x55e219036c80 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e218ddb4f0 con 0x55e218fecfc0 2023-12-18T10:25:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e218df96e0 con 0x55e2190375a0 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc58ea54000 10 client.0 _ll_register_callbacks cb 0x55e218fd8980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e219036c80 0x55e219037980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e219036c80 0x55e219037980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53232/0 (socket says 172.21.15.133:53232) 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc588c94640 1 -- 172.21.15.133:0/2716665313 learned_addr learned my addr 172.21.15.133:0/2716665313 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.960+0000 7fc589c96640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219037ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc588c94640 1 -- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 msgr2=0x55e219037ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc588c94640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219037ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc588c94640 1 -- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 msgr2=0x55e2190364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc589495640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e2190364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc588c94640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e2190364e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc588c94640 1 -- 172.21.15.133:0/2716665313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57400f040 con 0x55e219036c80 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc589c96640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219037ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc589495640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e2190364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc588c94640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e219036c80 0x55e219037980 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc574001560 tx=0x7fc574000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd613d6a009d7fe server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 1 -- 172.21.15.133:0/2716665313 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574027070 con 0x55e219036c80 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 1 -- 172.21.15.133:0/2716665313 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc574005e10 con 0x55e219036c80 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 -- 172.21.15.133:0/2716665313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e218df9120 con 0x55e219036c80 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 1 -- 172.21.15.133:0/2716665313 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57400ed70 con 0x55e219036c80 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 10 client.9612 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 -- 172.21.15.133:0/2716665313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x55e218e01250 con 0x55e219036c80 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 1 -- 172.21.15.133:0/2716665313 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e218df9120 con 0x55e219036c80 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 1 -- 172.21.15.133:0/2716665313 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fc574021450 con 0x55e219036c80 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 10 client.9612 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 10 client.9612 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 20 client.9612 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55e2190388d0 0x55e219038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 4 client.9612 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:57.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 -- 172.21.15.133:0/2716665313 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e218e3ac70 con 0x55e2190388d0 2023-12-18T10:25:57.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc589495640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55e2190388d0 0x55e219038ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc589495640 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55e2190388d0 0x55e219038ce0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d3d26c67e858afe server_cookie=68913f5e0d6b1ead in_seq=0 out_seq=0 2023-12-18T10:25:57.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 10 client.9612 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 1 -- 172.21.15.133:0/2716665313 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55e218e3ac70 con 0x55e2190388d0 2023-12-18T10:25:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 10 client.9612 handle_command_reply: tid=0 2023-12-18T10:25:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 client.9612 shutdown 2023-12-18T10:25:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 -- 172.21.15.133:0/2716665313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e219036c80 msgr2=0x55e219037980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e219036c80 0x55e219037980 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc574001560 tx=0x7fc574000ee0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 -- 172.21.15.133:0/2716665313 shutdown_connections 2023-12-18T10:25:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55e2190388d0 0x55e219038ce0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219037ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e219036c80 0x55e219037980 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc563fff640 0 client.9612 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 --2- 172.21.15.133:0/2716665313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e218fecfc0 0x55e2190364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 -- 172.21.15.133:0/2716665313 >> 172.21.15.133:0/2716665313 conn(0x55e218deb910 msgr2=0x55e218feba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 -- 172.21.15.133:0/2716665313 shutdown_connections 2023-12-18T10:25:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 1 -- 172.21.15.133:0/2716665313 wait complete. 2023-12-18T10:25:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.964+0000 7fc58ea54000 20 client.9612 trim_cache size 0 max 16384 2023-12-18T10:25:57.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 Processor -- start 2023-12-18T10:25:57.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 -- start start 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219035040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e219036c80 0x55e219035580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219046e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e218af9aa0 con 0x55e218fecfc0 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e218e39b30 con 0x55e219036c80 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e218de1820 con 0x55e2190375a0 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219035040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219035040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53234/0 (socket says 172.21.15.133:53234) 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 -- 172.21.15.133:0/1795722680 learned_addr learned my addr 172.21.15.133:0/1795722680 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 -- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 msgr2=0x55e219046e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589c96640 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219046e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc588c94640 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e219036c80 0x55e219035580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219046e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 -- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e219036c80 msgr2=0x55e219035580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e219036c80 0x55e219035580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 -- 172.21.15.133:0/1795722680 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e218de75a0 con 0x55e218fecfc0 2023-12-18T10:25:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc588c94640 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e219036c80 0x55e219035580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589c96640 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219046e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc589495640 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219035040 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc580097f20 tx=0x7fc5800c1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e1d6dbc63d7446 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc56f7fe640 1 -- 172.21.15.133:0/1795722680 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b5ea0 con 0x55e218fecfc0 2023-12-18T10:25:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc56f7fe640 1 -- 172.21.15.133:0/1795722680 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800f3770 con 0x55e218fecfc0 2023-12-18T10:25:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc56f7fe640 1 -- 172.21.15.133:0/1795722680 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800f7920 con 0x55e218fecfc0 2023-12-18T10:25:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 -- 172.21.15.133:0/1795722680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 msgr2=0x55e219035040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219035040 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc580097f20 tx=0x7fc5800c1040 comp rx=0 tx=0).stop 2023-12-18T10:25:57.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 -- 172.21.15.133:0/1795722680 shutdown_connections 2023-12-18T10:25:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e2190375a0 0x55e219046e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e219036c80 0x55e219035580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1795722680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219035040 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.980+0000 7fc58ea54000 1 -- 172.21.15.133:0/1795722680 >> 172.21.15.133:0/1795722680 conn(0x55e218deb910 msgr2=0x55e219043c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- 172.21.15.133:0/1795722680 shutdown_connections 2023-12-18T10:25:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- 172.21.15.133:0/1795722680 wait complete. 2023-12-18T10:25:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- start start 2023-12-18T10:25:57.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 Processor -- start 2023-12-18T10:25:57.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219093900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219049ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e2190375a0 0x55e21904a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e218f0b140 con 0x55e218fecfc0 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e218ff1510 con 0x55e2190375a0 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e218e39720 con 0x55e219036c80 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 10 client.0 _ll_register_callbacks cb 0x55e218df3710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219093900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219093900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53238/0 (socket says 172.21.15.133:53238) 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 -- 172.21.15.133:0/1991818110 learned_addr learned my addr 172.21.15.133:0/1991818110 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589c96640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e2190375a0 0x55e21904a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc588c94640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219049ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 -- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 msgr2=0x55e219049ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219049ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 -- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e2190375a0 msgr2=0x55e21904a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e2190375a0 0x55e21904a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 -- 172.21.15.133:0/1991818110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc584164520 con 0x55e218fecfc0 2023-12-18T10:25:57.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589c96640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e2190375a0 0x55e21904a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc588c94640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219049ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc589495640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219093900 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fc580097f20 tx=0x7fc58011e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d59a5755b965ae server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc563fff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc563fff640 1 -- 172.21.15.133:0/1991818110 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b5ea0 con 0x55e218fecfc0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc563fff640 1 -- 172.21.15.133:0/1991818110 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc58011c750 con 0x55e218fecfc0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- 172.21.15.133:0/1991818110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e218ff0940 con 0x55e218fecfc0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc563fff640 1 -- 172.21.15.133:0/1991818110 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5800ec100 con 0x55e218fecfc0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 10 client.9618 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- 172.21.15.133:0/1991818110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x55e218ddb110 con 0x55e218fecfc0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc563fff640 1 -- 172.21.15.133:0/1991818110 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5800ff080 con 0x55e218fecfc0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc563fff640 1 -- 172.21.15.133:0/1991818110 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fc5800f7490 con 0x55e218fecfc0 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 10 client.9618 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 10 client.9618 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 20 client.9618 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:57.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55e21904a550 0x55e21904a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 4 client.9618 mds_command: new command op to 9048 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc58ea54000 1 -- 172.21.15.133:0/1991818110 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e218e056a0 con 0x55e21904a550 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.984+0000 7fc588c94640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55e21904a550 0x55e21904a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc563fff640 10 client.9618 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc588c94640 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55e21904a550 0x55e21904a960 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5de2e743bff00c8f server_cookie=c6b20b2c0b321b05 in_seq=0 out_seq=0 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc563fff640 1 -- 172.21.15.133:0/1991818110 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x7fc574019120 con 0x55e21904a550 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc563fff640 10 client.9618 handle_command_reply: tid=0 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 client.9618 shutdown 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 -- 172.21.15.133:0/1991818110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 msgr2=0x55e219093900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219093900 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fc580097f20 tx=0x7fc58011e040 comp rx=0 tx=0).stop 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 -- 172.21.15.133:0/1991818110 shutdown_connections 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55e21904a550 0x55e21904a960 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e2190375a0 0x55e21904a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e219036c80 0x55e219049ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 --2- 172.21.15.133:0/1991818110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e218fecfc0 0x55e219093900 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 -- 172.21.15.133:0/1991818110 >> 172.21.15.133:0/1991818110 conn(0x55e218deb910 msgr2=0x55e219035950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc563fff640 0 client.9618 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 -- 172.21.15.133:0/1991818110 shutdown_connections 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 1 -- 172.21.15.133:0/1991818110 wait complete. 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58ea54000 20 client.9618 trim_cache size 0 max 16384 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:57.992 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:57.993 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:57.993 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:57.993 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:57.993 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:57.993 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:57.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 -- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc568065a90 msgr2=0x7fc568067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc568065a90 0x7fc568067f50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc5840c8490 tx=0x7fc574009040 comp rx=0 tx=0).stop 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 -- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc584070820 msgr2=0x7fc5841636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc584070820 0x7fc5841636a0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fc5800ad040 tx=0x7fc58001ac90 comp rx=0 tx=0).stop 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 -- 172.21.15.133:0/2103853602 shutdown_connections 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fc568065a90 0x7fc568067f50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc5841582d0 0x7fc584153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc5840ce3b0 0x7fc5841f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 --2- 172.21.15.133:0/2103853602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc584070820 0x7fc5841636a0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 -- 172.21.15.133:0/2103853602 >> 172.21.15.133:0/2103853602 conn(0x7fc58406a2a0 msgr2=0x7fc5841586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 -- 172.21.15.133:0/2103853602 shutdown_connections 2023-12-18T10:25:57.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:57.988+0000 7fc58b6f9640 1 -- 172.21.15.133:0/2103853602 wait complete. 2023-12-18T10:25:58.007 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:58.007 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2023-12-18T10:25:58.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5c70a640 1 Processor -- start 2023-12-18T10:25:58.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5c70a640 1 -- start start 2023-12-18T10:25:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5c70a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee54070820 0x7fee540c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5c70a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee540ce3b0 0x7fee540ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5c70a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540c9390 con 0x7fee541582d0 2023-12-18T10:25:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5c70a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540ced80 con 0x7fee54070820 2023-12-18T10:25:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5c70a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415aee0 con 0x7fee540ce3b0 2023-12-18T10:25:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5a4a6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fee541582d0 0x7fee540ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60962/0 (socket says 172.21.15.133:60962) 2023-12-18T10:25:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5a4a6640 1 -- 172.21.15.133:0/1626357695 learned_addr learned my addr 172.21.15.133:0/1626357695 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee59ca5640 1 --2- 172.21.15.133:0/1626357695 >> v2:172.21.15.133:3300/0 conn(0x7fee54070820 0x7fee540c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee5aca7640 1 --2- 172.21.15.133:0/1626357695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee540ce3b0 0x7fee540ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee59ca5640 1 -- 172.21.15.133:0/1626357695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee540ce3b0 msgr2=0x7fee540ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee59ca5640 1 --2- 172.21.15.133:0/1626357695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee540ce3b0 0x7fee540ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee59ca5640 1 -- 172.21.15.133:0/1626357695 >> v1:172.21.15.133:6789/0 conn(0x7fee541582d0 legacy=0x7fee540ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee59ca5640 1 -- 172.21.15.133:0/1626357695 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5415b1c0 con 0x7fee54070820 2023-12-18T10:25:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.148+0000 7fee594a4640 1 -- 172.21.15.133:0/1626357695 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364917085 0 0) 0x7fee540c9390 con 0x7fee541582d0 2023-12-18T10:25:58.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee59ca5640 1 --2- 172.21.15.133:0/1626357695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee54070820 0x7fee540c8e50 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fee440097c0 tx=0x7fee4401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6c3d3e4ea47644 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee594a4640 1 -- 172.21.15.133:0/1626357695 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440ab650 con 0x7fee54070820 2023-12-18T10:25:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee594a4640 1 -- 172.21.15.133:0/1626357695 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee440ab7b0 con 0x7fee54070820 2023-12-18T10:25:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee594a4640 1 -- 172.21.15.133:0/1626357695 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440abb40 con 0x7fee54070820 2023-12-18T10:25:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee5c70a640 1 -- 172.21.15.133:0/1626357695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee54070820 msgr2=0x7fee540c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1626357695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee54070820 0x7fee540c8e50 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fee440097c0 tx=0x7fee4401c450 comp rx=0 tx=0).stop 2023-12-18T10:25:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee5c70a640 1 -- 172.21.15.133:0/1626357695 shutdown_connections 2023-12-18T10:25:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1626357695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee540ce3b0 0x7fee540ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1626357695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee54070820 0x7fee540c8e50 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee5c70a640 1 -- 172.21.15.133:0/1626357695 >> 172.21.15.133:0/1626357695 conn(0x7fee5406a2a0 msgr2=0x7fee540aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee5c70a640 1 -- 172.21.15.133:0/1626357695 shutdown_connections 2023-12-18T10:25:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.152+0000 7fee5c70a640 1 -- 172.21.15.133:0/1626357695 wait complete. 2023-12-18T10:25:58.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 Processor -- start 2023-12-18T10:25:58.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 -- start start 2023-12-18T10:25:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee54070820 0x7fee540c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee540ce3b0 0x7fee5413fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee541582d0 0x7fee540c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c4510 con 0x7fee540ce3b0 2023-12-18T10:25:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c3640 con 0x7fee541582d0 2023-12-18T10:25:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee541400d0 con 0x7fee54070820 2023-12-18T10:25:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee540ce3b0 0x7fee5413fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee540ce3b0 0x7fee5413fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53252/0 (socket says 172.21.15.133:53252) 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 -- 172.21.15.133:0/1611540401 learned_addr learned my addr 172.21.15.133:0/1611540401 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee54070820 0x7fee540c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5aca7640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee541582d0 0x7fee540c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 -- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee54070820 msgr2=0x7fee540c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee54070820 0x7fee540c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 -- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee541582d0 msgr2=0x7fee540c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee541582d0 0x7fee540c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 -- 172.21.15.133:0/1611540401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee44009420 con 0x7fee540ce3b0 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee54070820 0x7fee540c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5aca7640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee541582d0 0x7fee540c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee59ca5640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee540ce3b0 0x7fee5413fb90 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fee440097c0 tx=0x7fee4401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee4affd640 1 -- 172.21.15.133:0/1611540401 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44004220 con 0x7fee540ce3b0 2023-12-18T10:25:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee4affd640 1 -- 172.21.15.133:0/1611540401 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee440b9070 con 0x7fee540ce3b0 2023-12-18T10:25:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 -- 172.21.15.133:0/1611540401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540c3890 con 0x7fee540ce3b0 2023-12-18T10:25:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee4affd640 1 -- 172.21.15.133:0/1611540401 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44003620 con 0x7fee540ce3b0 2023-12-18T10:25:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.156+0000 7fee5c70a640 1 -- 172.21.15.133:0/1611540401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540c3e50 con 0x7fee540ce3b0 2023-12-18T10:25:58.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.160+0000 7fee4affd640 1 -- 172.21.15.133:0/1611540401 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fee44003780 con 0x7fee540ce3b0 2023-12-18T10:25:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.160+0000 7fee4affd640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee38065a60 0x7fee38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.160+0000 7fee4affd640 1 -- 172.21.15.133:0/1611540401 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee440bb070 con 0x7fee540ce3b0 2023-12-18T10:25:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.160+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee38065a60 0x7fee38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.160+0000 7fee5fa70000 1 Processor -- start 2023-12-18T10:25:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.160+0000 7fee5fa70000 1 -- start start 2023-12-18T10:25:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.160+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee38065a60 0x7fee38067f20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fee50000f70 tx=0x7fee50007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb98060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb4da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb4dfc0 0x56539eb4e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539ea16430 con 0x56539eb97c80 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539e9a4460 con 0x56539eb4dfc0 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56539e9a1a30 con 0x56539eb985a0 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb98060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb98060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53260/0 (socket says 172.21.15.133:53260) 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 -- 172.21.15.133:0/2417271191 learned_addr learned my addr 172.21.15.133:0/2417271191 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5aca7640 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb4dfc0 0x56539eb4e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee59ca5640 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb4da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 -- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 msgr2=0x56539eb4da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb4da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 -- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb4dfc0 msgr2=0x56539eb4e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb4dfc0 0x56539eb4e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 -- 172.21.15.133:0/2417271191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56539e699e20 con 0x56539eb97c80 2023-12-18T10:25:58.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5aca7640 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb4dfc0 0x56539eb4e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb98060 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fee50005e50 tx=0x7fee50012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5bb395bd6a7cd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee37fff640 1 -- 172.21.15.133:0/2417271191 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50015110 con 0x56539eb97c80 2023-12-18T10:25:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee37fff640 1 -- 172.21.15.133:0/2417271191 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee50015270 con 0x56539eb97c80 2023-12-18T10:25:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee37fff640 1 -- 172.21.15.133:0/2417271191 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50015bc0 con 0x56539eb97c80 2023-12-18T10:25:58.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- 172.21.15.133:0/2417271191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 msgr2=0x56539eb98060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb98060 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fee50005e50 tx=0x7fee50012000 comp rx=0 tx=0).stop 2023-12-18T10:25:58.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- 172.21.15.133:0/2417271191 shutdown_connections 2023-12-18T10:25:58.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb4dfc0 0x56539eb4e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb4da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 --2- 172.21.15.133:0/2417271191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb98060 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- 172.21.15.133:0/2417271191 >> 172.21.15.133:0/2417271191 conn(0x56539e94c910 msgr2=0x56539eb4c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- 172.21.15.133:0/2417271191 shutdown_connections 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- 172.21.15.133:0/2417271191 wait complete. 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 -- start start 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.164+0000 7fee5fa70000 1 Processor -- start 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539eb98980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb97c80 0x56539eb98ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb99400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539e99d320 con 0x56539eb4dfc0 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539e93c4f0 con 0x56539eb97c80 2023-12-18T10:25:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56539e95a6e0 con 0x56539eb985a0 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 10 client.0 _ll_register_callbacks cb 0x56539eb39980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539eb98980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539eb98980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53268/0 (socket says 172.21.15.133:53268) 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 -- 172.21.15.133:0/3954614196 learned_addr learned my addr 172.21.15.133:0/3954614196 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee59ca5640 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb97c80 0x56539eb98ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5aca7640 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb99400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 -- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 msgr2=0x56539eb99400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb99400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 -- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb97c80 msgr2=0x56539eb98ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb97c80 0x56539eb98ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 -- 172.21.15.133:0/3954614196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5000f040 con 0x56539eb4dfc0 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5aca7640 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb99400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539eb98980 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x56539ea4c180 tx=0x7fee50000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce17c2f33ba41721 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 1 -- 172.21.15.133:0/3954614196 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50026070 con 0x56539eb4dfc0 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 1 -- 172.21.15.133:0/3954614196 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee50015cd0 con 0x56539eb4dfc0 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- 172.21.15.133:0/3954614196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56539e95a120 con 0x56539eb4dfc0 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 1 -- 172.21.15.133:0/3954614196 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee50015e90 con 0x56539eb4dfc0 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 10 client.9633 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- 172.21.15.133:0/3954614196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x56539e962250 con 0x56539eb4dfc0 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 1 -- 172.21.15.133:0/3954614196 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56539e95a120 con 0x56539eb4dfc0 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 1 -- 172.21.15.133:0/3954614196 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fee50021450 con 0x56539eb4dfc0 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 10 client.9633 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 10 client.9633 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 20 client.9633 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56539eba7840 0x56539eba9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 4 client.9633 mds_command: new command op to 9042 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- 172.21.15.133:0/3954614196 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56539e99bc70 con 0x56539eba7840 2023-12-18T10:25:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee59ca5640 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56539eba7840 0x56539eba9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee59ca5640 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56539eba7840 0x56539eba9c30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7ec46a59275e630 server_cookie=d1efedaf75feeb10 in_seq=0 out_seq=0 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 10 client.9633 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 1 -- 172.21.15.133:0/3954614196 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56539e99bc70 con 0x56539eba7840 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 10 client.9633 handle_command_reply: tid=0 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 client.9633 shutdown 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- 172.21.15.133:0/3954614196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 msgr2=0x56539eb98980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539eb98980 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x56539ea4c180 tx=0x7fee50000ee0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- 172.21.15.133:0/3954614196 shutdown_connections 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56539eba7840 0x56539eba9c30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb985a0 0x56539eb99400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb97c80 0x56539eb98ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 --2- 172.21.15.133:0/3954614196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539eb98980 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee357fa640 0 client.9633 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.168+0000 7fee5fa70000 1 -- 172.21.15.133:0/3954614196 >> 172.21.15.133:0/3954614196 conn(0x56539e94c910 msgr2=0x56539eb4ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.172+0000 7fee5fa70000 1 -- 172.21.15.133:0/3954614196 shutdown_connections 2023-12-18T10:25:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.172+0000 7fee5fa70000 1 -- 172.21.15.133:0/3954614196 wait complete. 2023-12-18T10:25:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.172+0000 7fee5fa70000 20 client.9633 trim_cache size 0 max 16384 2023-12-18T10:25:58.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.184+0000 7fee5fa70000 1 Processor -- start 2023-12-18T10:25:58.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.184+0000 7fee5fa70000 1 -- start start 2023-12-18T10:25:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539ebaac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb97c80 0x56539ebab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 0x56539eb91010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539e65aaa0 con 0x56539eb4dfc0 2023-12-18T10:25:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539e998c90 con 0x56539eb985a0 2023-12-18T10:25:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56539eba5120 con 0x56539eb97c80 2023-12-18T10:25:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539ebaac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539ebaac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53276/0 (socket says 172.21.15.133:53276) 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 -- 172.21.15.133:0/985300546 learned_addr learned my addr 172.21.15.133:0/985300546 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee59ca5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb97c80 0x56539ebab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5aca7640 1 --2- 172.21.15.133:0/985300546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 0x56539eb91010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 -- 172.21.15.133:0/985300546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb97c80 msgr2=0x56539ebab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/985300546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb97c80 0x56539ebab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 -- 172.21.15.133:0/985300546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 msgr2=0x56539eb91010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/985300546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 0x56539eb91010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 -- 172.21.15.133:0/985300546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56539e9485a0 con 0x56539eb4dfc0 2023-12-18T10:25:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/985300546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539ebaac40 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fee50000f20 tx=0x7fee50026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac22508f5129c4a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee48ff9640 1 -- 172.21.15.133:0/985300546 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50015940 con 0x56539eb4dfc0 2023-12-18T10:25:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee48ff9640 1 -- 172.21.15.133:0/985300546 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5000b070 con 0x56539eb4dfc0 2023-12-18T10:25:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee48ff9640 1 -- 172.21.15.133:0/985300546 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50021910 con 0x56539eb4dfc0 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- 172.21.15.133:0/985300546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 msgr2=0x56539ebaac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 --2- 172.21.15.133:0/985300546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539ebaac40 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fee50000f20 tx=0x7fee50026000 comp rx=0 tx=0).stop 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- 172.21.15.133:0/985300546 shutdown_connections 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 --2- 172.21.15.133:0/985300546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 0x56539eb91010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 --2- 172.21.15.133:0/985300546 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb97c80 0x56539ebab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 --2- 172.21.15.133:0/985300546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb4dfc0 0x56539ebaac40 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- 172.21.15.133:0/985300546 >> 172.21.15.133:0/985300546 conn(0x56539e94c910 msgr2=0x56539eb536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- 172.21.15.133:0/985300546 shutdown_connections 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- 172.21.15.133:0/985300546 wait complete. 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 -- start start 2023-12-18T10:25:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.188+0000 7fee5fa70000 1 Processor -- start 2023-12-18T10:25:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb4dfc0 0x56539ebf4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb941f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 0x56539eb94730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539eba43f0 con 0x56539eb97c80 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539e95b480 con 0x56539eb985a0 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56539eb4dae0 con 0x56539eb4dfc0 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 10 client.0 _ll_register_callbacks cb 0x56539e954710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5a4a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb4dfc0 0x56539ebf4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5a4a6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb4dfc0 0x56539ebf4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:36488/0 (socket says 172.21.15.133:36488) 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5a4a6640 1 -- 172.21.15.133:0/4167831212 learned_addr learned my addr 172.21.15.133:0/4167831212 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee59ca5640 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb941f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5aca7640 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 0x56539eb94730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee59ca5640 1 -- 172.21.15.133:0/4167831212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb4dfc0 msgr2=0x56539ebf4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee59ca5640 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb4dfc0 0x56539ebf4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee59ca5640 1 -- 172.21.15.133:0/4167831212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 msgr2=0x56539eb94730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee59ca5640 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 0x56539eb94730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee59ca5640 1 -- 172.21.15.133:0/4167831212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56539e962250 con 0x56539eb97c80 2023-12-18T10:25:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb4dfc0 0x56539ebf4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee59ca5640 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb941f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fee44000c10 tx=0x7fee440f3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e82abeccfc1b31c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 1 -- 172.21.15.133:0/4167831212 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440f6f70 con 0x56539eb97c80 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 1 -- 172.21.15.133:0/4167831212 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee440f70d0 con 0x56539eb97c80 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- 172.21.15.133:0/4167831212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56539eb51940 con 0x56539eb97c80 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 1 -- 172.21.15.133:0/4167831212 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee440f50b0 con 0x56539eb97c80 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 10 client.9639 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- 172.21.15.133:0/4167831212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x56539e93c110 con 0x56539eb97c80 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 1 -- 172.21.15.133:0/4167831212 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56539eb51940 con 0x56539eb97c80 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 1 -- 172.21.15.133:0/4167831212 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fee440f5210 con 0x56539eb97c80 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 10 client.9639 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 10 client.9639 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 20 client.9639 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56539eb94c70 0x56539eb95080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 4 client.9639 mds_command: new command op to 9042 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- 172.21.15.133:0/4167831212 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56539e9666a0 con 0x56539eb94c70 2023-12-18T10:25:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56539eb94c70 0x56539eb95080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 10 client.9639 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5a4a6640 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56539eb94c70 0x56539eb95080 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a5cb11fe56eae4ac server_cookie=62be76ca01d961ec in_seq=0 out_seq=0 2023-12-18T10:25:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 1 -- 172.21.15.133:0/4167831212 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x56539e9666a0 con 0x56539eb94c70 2023-12-18T10:25:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 10 client.9639 handle_command_reply: tid=0 2023-12-18T10:25:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 client.9639 shutdown 2023-12-18T10:25:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 msgr2=0x56539eb941f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb941f0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fee44000c10 tx=0x7fee440f3f90 comp rx=0 tx=0).stop 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- 172.21.15.133:0/4167831212 shutdown_connections 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56539eb94c70 0x56539eb95080 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56539eb985a0 0x56539eb94730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56539eb97c80 0x56539eb941f0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee357fa640 0 client.9639 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 --2- 172.21.15.133:0/4167831212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56539eb4dfc0 0x56539ebf4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- 172.21.15.133:0/4167831212 >> 172.21.15.133:0/4167831212 conn(0x56539e94c910 msgr2=0x56539eba9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- 172.21.15.133:0/4167831212 shutdown_connections 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 1 -- 172.21.15.133:0/4167831212 wait complete. 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.192+0000 7fee5fa70000 20 client.9639 trim_cache size 0 max 16384 2023-12-18T10:25:58.199 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:58.200 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 -- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee38065a60 msgr2=0x7fee38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee38065a60 0x7fee38067f20 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fee50000f70 tx=0x7fee50007cb0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 -- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee540ce3b0 msgr2=0x7fee5413fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee540ce3b0 0x7fee5413fb90 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fee440097c0 tx=0x7fee4401ac90 comp rx=0 tx=0).stop 2023-12-18T10:25:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 -- 172.21.15.133:0/1611540401 shutdown_connections 2023-12-18T10:25:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fee38065a60 0x7fee38067f20 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee541582d0 0x7fee540c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee540ce3b0 0x7fee5413fb90 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 --2- 172.21.15.133:0/1611540401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fee54070820 0x7fee540c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 -- 172.21.15.133:0/1611540401 >> 172.21.15.133:0/1611540401 conn(0x7fee5406a2a0 msgr2=0x7fee541547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 -- 172.21.15.133:0/1611540401 shutdown_connections 2023-12-18T10:25:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.196+0000 7fee5c70a640 1 -- 172.21.15.133:0/1611540401 wait complete. 2023-12-18T10:25:58.214 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:58.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2023-12-18T10:25:58.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.352+0000 7f2e231cb640 1 Processor -- start 2023-12-18T10:25:58.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.352+0000 7f2e231cb640 1 -- start start 2023-12-18T10:25:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.352+0000 7f2e231cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c15a390 0x7f2e1c06b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.352+0000 7f2e231cb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e1c06ca30 0x7f2e1c0b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.352+0000 7f2e231cb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c160940 con 0x7f2e1c15a770 2023-12-18T10:25:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.352+0000 7f2e231cb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c06b780 con 0x7f2e1c06ca30 2023-12-18T10:25:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.352+0000 7f2e231cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c06ba40 con 0x7f2e1c15a390 2023-12-18T10:25:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e219c8640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e1c15a770 0x7f2e1c160dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60964/0 (socket says 172.21.15.133:60964) 2023-12-18T10:25:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e219c8640 1 -- 172.21.15.133:0/1761638173 learned_addr learned my addr 172.21.15.133:0/1761638173 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e221c9640 1 --2- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c15a390 0x7f2e1c06b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e229ca640 1 --2- 172.21.15.133:0/1761638173 >> v2:172.21.15.142:3300/0 conn(0x7f2e1c06ca30 0x7f2e1c0b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e211c7640 1 -- 172.21.15.133:0/1761638173 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661350979 0 0) 0x7f2e1c160940 con 0x7f2e1c15a770 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e211c7640 1 -- 172.21.15.133:0/1761638173 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e08003530 con 0x7f2e1c15a770 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e229ca640 1 -- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c15a390 msgr2=0x7f2e1c06b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e229ca640 1 --2- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c15a390 0x7f2e1c06b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e229ca640 1 -- 172.21.15.133:0/1761638173 >> v1:172.21.15.133:6789/0 conn(0x7f2e1c15a770 legacy=0x7f2e1c160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e229ca640 1 -- 172.21.15.133:0/1761638173 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c06bd20 con 0x7f2e1c06ca30 2023-12-18T10:25:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e221c9640 1 --2- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c15a390 0x7f2e1c06b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e229ca640 1 --2- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 0x7f2e1c0b1f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009d90 tx=0x7f2e1401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad7194bd41f9127 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e211c7640 1 -- 172.21.15.133:0/1761638173 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140a5860 con 0x7f2e1c06ca30 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e211c7640 1 -- 172.21.15.133:0/1761638173 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e140a59c0 con 0x7f2e1c06ca30 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.356+0000 7f2e211c7640 1 -- 172.21.15.133:0/1761638173 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140a5d50 con 0x7f2e1c06ca30 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 msgr2=0x7f2e1c0b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 --2- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 0x7f2e1c0b1f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2e14009d90 tx=0x7f2e1401c890 comp rx=0 tx=0).stop 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- 172.21.15.133:0/1761638173 shutdown_connections 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 --2- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 0x7f2e1c0b1f90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 --2- 172.21.15.133:0/1761638173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c15a390 0x7f2e1c06b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- 172.21.15.133:0/1761638173 >> 172.21.15.133:0/1761638173 conn(0x7f2e1c0ccf90 msgr2=0x7f2e1c0cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- 172.21.15.133:0/1761638173 shutdown_connections 2023-12-18T10:25:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- 172.21.15.133:0/1761638173 wait complete. 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 Processor -- start 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- start start 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 0x7f2e1c0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1c15a390 0x7f2e1c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c152a30 0x7f2e1c15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c155720 con 0x7f2e1c15a390 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c155950 con 0x7f2e1c06ca30 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e231cb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c155c30 con 0x7f2e1c152a30 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e219c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1c15a390 0x7f2e1c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e219c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1c15a390 0x7f2e1c1551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53288/0 (socket says 172.21.15.133:53288) 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e219c8640 1 -- 172.21.15.133:0/3746674916 learned_addr learned my addr 172.21.15.133:0/3746674916 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e221c9640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 0x7f2e1c0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e229ca640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c152a30 0x7f2e1c15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e219c8640 1 -- 172.21.15.133:0/3746674916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c152a30 msgr2=0x7f2e1c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.360+0000 7f2e219c8640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c152a30 0x7f2e1c15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e219c8640 1 -- 172.21.15.133:0/3746674916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 msgr2=0x7f2e1c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e219c8640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 0x7f2e1c0b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e219c8640 1 -- 172.21.15.133:0/3746674916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18009420 con 0x7f2e1c15a390 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e219c8640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1c15a390 0x7f2e1c1551e0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c4d0 tx=0x7f2e0c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e12ffd640 1 -- 172.21.15.133:0/3746674916 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c005cf0 con 0x7f2e1c15a390 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e12ffd640 1 -- 172.21.15.133:0/3746674916 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c005e50 con 0x7f2e1c15a390 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e12ffd640 1 -- 172.21.15.133:0/3746674916 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c007270 con 0x7f2e1c15a390 2023-12-18T10:25:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e231cb640 1 -- 172.21.15.133:0/3746674916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e14009a70 con 0x7f2e1c15a390 2023-12-18T10:25:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e231cb640 1 -- 172.21.15.133:0/3746674916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c1561f0 con 0x7f2e1c15a390 2023-12-18T10:25:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e12ffd640 1 -- 172.21.15.133:0/3746674916 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2e0c0073d0 con 0x7f2e1c15a390 2023-12-18T10:25:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e12ffd640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e00065a60 0x7f2e00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e12ffd640 1 -- 172.21.15.133:0/3746674916 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e0c0828e0 con 0x7f2e1c15a390 2023-12-18T10:25:58.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.364+0000 7f2e221c9640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e00065a60 0x7f2e00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 Processor -- start 2023-12-18T10:25:58.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e221c9640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e00065a60 0x7f2e00067f20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009cf0 tx=0x7f2e18009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- start start 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d58c80 0x55c590d59060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d595a0 0x55c590d0ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d0efc0 0x55c590d0f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590bd7430 con 0x55c590d0efc0 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590b65460 con 0x55c590d595a0 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c590b62a30 con 0x55c590d58c80 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d0efc0 0x55c590d0f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d0efc0 0x55c590d0f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53298/0 (socket says 172.21.15.133:53298) 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 -- 172.21.15.133:0/412643386 learned_addr learned my addr 172.21.15.133:0/412643386 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e221c9640 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d58c80 0x55c590d59060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e219c8640 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d595a0 0x55c590d0ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 -- 172.21.15.133:0/412643386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d58c80 msgr2=0x55c590d59060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d58c80 0x55c590d59060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 -- 172.21.15.133:0/412643386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d595a0 msgr2=0x55c590d0ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d595a0 0x55c590d0ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 -- 172.21.15.133:0/412643386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c59085ae20 con 0x55c590d0efc0 2023-12-18T10:25:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e229ca640 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d0efc0 0x55c590d0f3a0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2e140b0040 tx=0x7f2e14004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc9adc56639a0f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2dfffff640 1 -- 172.21.15.133:0/412643386 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140a5b30 con 0x55c590d0efc0 2023-12-18T10:25:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2dfffff640 1 -- 172.21.15.133:0/412643386 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e140a5c90 con 0x55c590d0efc0 2023-12-18T10:25:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2dfffff640 1 -- 172.21.15.133:0/412643386 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140ad440 con 0x55c590d0efc0 2023-12-18T10:25:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- 172.21.15.133:0/412643386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d0efc0 msgr2=0x55c590d0f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d0efc0 0x55c590d0f3a0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2e140b0040 tx=0x7f2e14004ac0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- 172.21.15.133:0/412643386 shutdown_connections 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d0efc0 0x55c590d0f3a0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d595a0 0x55c590d0ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 --2- 172.21.15.133:0/412643386 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d58c80 0x55c590d59060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- 172.21.15.133:0/412643386 >> 172.21.15.133:0/412643386 conn(0x55c590b0d910 msgr2=0x55c590d0d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- 172.21.15.133:0/412643386 shutdown_connections 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.368+0000 7f2e2779d000 1 -- 172.21.15.133:0/412643386 wait complete. 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 -- start start 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 Processor -- start 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d59b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d5a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d5a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590b5e320 con 0x55c590d58c80 2023-12-18T10:25:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590afd4f0 con 0x55c590d0efc0 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c590b1b6e0 con 0x55c590d595a0 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 10 client.0 _ll_register_callbacks cb 0x55c590cfa980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d5a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d5a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53300/0 (socket says 172.21.15.133:53300) 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 -- 172.21.15.133:0/3977467969 learned_addr learned my addr 172.21.15.133:0/3977467969 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e221c9640 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d59b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e229ca640 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d5a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 -- 172.21.15.133:0/3977467969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 msgr2=0x55c590d5a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d5a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 -- 172.21.15.133:0/3977467969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 msgr2=0x55c590d59b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d59b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 -- 172.21.15.133:0/3977467969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c06bd20 con 0x55c590d58c80 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e219c8640 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d5a0a0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c053a80 tx=0x7f2e0c05bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d203047c4083cf server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2dfd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/3977467969 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c053270 con 0x55c590d58c80 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/3977467969 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e0c0533d0 con 0x55c590d58c80 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 -- 172.21.15.133:0/3977467969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c590b1b120 con 0x55c590d58c80 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/3977467969 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e0c05b8b0 con 0x55c590d58c80 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 10 client.9651 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 -- 172.21.15.133:0/3977467969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x55c590b23250 con 0x55c590d58c80 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/3977467969 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c590b1b120 con 0x55c590d58c80 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/3977467969 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f2e0c04fb70 con 0x55c590d58c80 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 10 client.9651 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 10 client.9651 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:58.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 20 client.9651 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:58.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c590d68840 0x55c590d6ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 4 client.9651 mds_command: new command op to 9039 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:58.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e2779d000 1 -- 172.21.15.133:0/3977467969 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c590b5cc70 con 0x55c590d68840 2023-12-18T10:25:58.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.372+0000 7f2e221c9640 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c590d68840 0x55c590d6ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2dfd7fa640 10 client.9651 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e221c9640 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c590d68840 0x55c590d6ac30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=516b2aa15fcc514c server_cookie=5eccade7a42964e7 in_seq=0 out_seq=0 2023-12-18T10:25:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/3977467969 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c590b5cc70 con 0x55c590d68840 2023-12-18T10:25:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2dfd7fa640 10 client.9651 handle_command_reply: tid=0 2023-12-18T10:25:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 client.9651 shutdown 2023-12-18T10:25:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 -- 172.21.15.133:0/3977467969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 msgr2=0x55c590d5a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d5a0a0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c053a80 tx=0x7f2e0c05bd40 comp rx=0 tx=0).stop 2023-12-18T10:25:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 -- 172.21.15.133:0/3977467969 shutdown_connections 2023-12-18T10:25:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c590d68840 0x55c590d6ac30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d5a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d5a0a0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 --2- 172.21.15.133:0/3977467969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d59b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2dfd7fa640 0 client.9651 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 -- 172.21.15.133:0/3977467969 >> 172.21.15.133:0/3977467969 conn(0x55c590b0d910 msgr2=0x55c590d0da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 -- 172.21.15.133:0/3977467969 shutdown_connections 2023-12-18T10:25:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 1 -- 172.21.15.133:0/3977467969 wait complete. 2023-12-18T10:25:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.376+0000 7f2e2779d000 20 client.9651 trim_cache size 0 max 16384 2023-12-18T10:25:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.388+0000 7f2e2779d000 1 Processor -- start 2023-12-18T10:25:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.388+0000 7f2e2779d000 1 -- start start 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d6bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d6c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d52010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59081baa0 con 0x55c590d58c80 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590b60e80 con 0x55c590d0efc0 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c590d655a0 con 0x55c590d595a0 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d6c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d6c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53316/0 (socket says 172.21.15.133:53316) 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 -- 172.21.15.133:0/4182078761 learned_addr learned my addr 172.21.15.133:0/4182078761 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e221c9640 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d6bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e229ca640 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d52010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 -- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 msgr2=0x55c590d52010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d52010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 -- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 msgr2=0x55c590d6bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d6bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 -- 172.21.15.133:0/4182078761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c590b095a0 con 0x55c590d58c80 2023-12-18T10:25:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e221c9640 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d6bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e229ca640 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d52010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e219c8640 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d6c180 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0507a0 tx=0x7f2e0c055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd51abfa049f73a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e10ff9640 1 -- 172.21.15.133:0/4182078761 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00e040 con 0x55c590d58c80 2023-12-18T10:25:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e10ff9640 1 -- 172.21.15.133:0/4182078761 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c080b50 con 0x55c590d58c80 2023-12-18T10:25:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e10ff9640 1 -- 172.21.15.133:0/4182078761 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c053270 con 0x55c590d58c80 2023-12-18T10:25:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- 172.21.15.133:0/4182078761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 msgr2=0x55c590d6c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d6c180 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0507a0 tx=0x7f2e0c055000 comp rx=0 tx=0).stop 2023-12-18T10:25:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- 172.21.15.133:0/4182078761 shutdown_connections 2023-12-18T10:25:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d52010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d6c180 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- 172.21.15.133:0/4182078761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590d6bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- 172.21.15.133:0/4182078761 >> 172.21.15.133:0/4182078761 conn(0x55c590b0d910 msgr2=0x55c590d144a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- 172.21.15.133:0/4182078761 shutdown_connections 2023-12-18T10:25:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- 172.21.15.133:0/4182078761 wait complete. 2023-12-18T10:25:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- start start 2023-12-18T10:25:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 Processor -- start 2023-12-18T10:25:58.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590db5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d54d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d552d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590c2d140 con 0x55c590d58c80 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c590b5b720 con 0x55c590d0efc0 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.392+0000 7f2e2779d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c590b1c480 con 0x55c590d595a0 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 10 client.0 _ll_register_callbacks cb 0x55c590b15710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d54d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d54d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53318/0 (socket says 172.21.15.133:53318) 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e221c9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590db5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 -- 172.21.15.133:0/1881065972 learned_addr learned my addr 172.21.15.133:0/1881065972 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e229ca640 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 -- 172.21.15.133:0/1881065972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 msgr2=0x55c590d552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 -- 172.21.15.133:0/1881065972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 msgr2=0x55c590db5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590db5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 -- 172.21.15.133:0/1881065972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c590b23250 con 0x55c590d58c80 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e221c9640 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590db5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e219c8640 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d54d90 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c053d10 tx=0x7f2e0c080ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d03673b00f8e22 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/1881065972 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c05bab0 con 0x55c590d58c80 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/1881065972 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e0c052ce0 con 0x55c590d58c80 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 -- 172.21.15.133:0/1881065972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c590d12940 con 0x55c590d58c80 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/1881065972 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e0c00e040 con 0x55c590d58c80 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 10 client.9657 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 -- 172.21.15.133:0/1881065972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x55c590afd110 con 0x55c590d58c80 2023-12-18T10:25:58.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/1881065972 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c590d12940 con 0x55c590d58c80 2023-12-18T10:25:58.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/1881065972 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f2e0c052ec0 con 0x55c590d58c80 2023-12-18T10:25:58.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 10 client.9657 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:58.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 10 client.9657 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:58.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 20 client.9657 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:58.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c590d55810 0x55c590d55c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 4 client.9657 mds_command: new command op to 9039 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 -- 172.21.15.133:0/1881065972 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c590b276a0 con 0x55c590d55810 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e221c9640 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c590d55810 0x55c590d55c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e221c9640 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c590d55810 0x55c590d55c20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=555b3e71dd55c11b server_cookie=fa402e66ae4ff19b in_seq=0 out_seq=0 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 10 client.9657 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 1 -- 172.21.15.133:0/1881065972 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55c590b276a0 con 0x55c590d55810 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 10 client.9657 handle_command_reply: tid=0 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 client.9657 shutdown 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 -- 172.21.15.133:0/1881065972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 msgr2=0x55c590d54d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d54d90 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c053d10 tx=0x7f2e0c080ae0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 -- 172.21.15.133:0/1881065972 shutdown_connections 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55c590d55810 0x55c590d55c20 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55c590d595a0 0x55c590d552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c590d58c80 0x55c590d54d90 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 --2- 172.21.15.133:0/1881065972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c590d0efc0 0x55c590db5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2dfd7fa640 0 client.9657 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 -- 172.21.15.133:0/1881065972 >> 172.21.15.133:0/1881065972 conn(0x55c590b0d910 msgr2=0x55c590d6ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 -- 172.21.15.133:0/1881065972 shutdown_connections 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 1 -- 172.21.15.133:0/1881065972 wait complete. 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e2779d000 20 client.9657 trim_cache size 0 max 16384 2023-12-18T10:25:58.403 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:58.404 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 -- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e00065a60 msgr2=0x7f2e00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e00065a60 0x7f2e00067f20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009cf0 tx=0x7f2e18009190 comp rx=0 tx=0).stop 2023-12-18T10:25:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 -- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1c15a390 msgr2=0x7f2e1c1551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1c15a390 0x7f2e1c1551e0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c4d0 tx=0x7f2e0c00c990 comp rx=0 tx=0).stop 2023-12-18T10:25:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 -- 172.21.15.133:0/3746674916 shutdown_connections 2023-12-18T10:25:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e00065a60 0x7f2e00067f20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e1c152a30 0x7f2e1c15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1c15a390 0x7f2e1c1551e0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 --2- 172.21.15.133:0/3746674916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e1c06ca30 0x7f2e1c0b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.396+0000 7f2e231cb640 1 -- 172.21.15.133:0/3746674916 >> 172.21.15.133:0/3746674916 conn(0x7f2e1c0ccf90 msgr2=0x7f2e1c15b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.400+0000 7f2e231cb640 1 -- 172.21.15.133:0/3746674916 shutdown_connections 2023-12-18T10:25:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.400+0000 7f2e231cb640 1 -- 172.21.15.133:0/3746674916 wait complete. 2023-12-18T10:25:58.417 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:58.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-12-18T10:25:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f528222d640 1 Processor -- start 2023-12-18T10:25:58.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f528222d640 1 -- start start 2023-12-18T10:25:58.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f528222d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f527c15cae0 0x7f527c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f528222d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f527c0cde90 0x7f527c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f528222d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c15cec0 con 0x7f527c0cf170 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f528222d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c0d0530 con 0x7f527c15cae0 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f528222d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c0d0810 con 0x7f527c0cde90 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f527c15cae0 0x7f527c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f527c15cae0 0x7f527c0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53320/0 (socket says 172.21.15.133:53320) 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527b7fe640 1 -- 172.21.15.133:0/2254149158 learned_addr learned my addr 172.21.15.133:0/2254149158 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527affd640 1 --2- 172.21.15.133:0/2254149158 >> v2:172.21.15.142:3300/0 conn(0x7f527c0cde90 0x7f527c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527b7fe640 1 -- 172.21.15.133:0/2254149158 >> v2:172.21.15.142:3300/0 conn(0x7f527c0cde90 msgr2=0x7f527c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527b7fe640 1 --2- 172.21.15.133:0/2254149158 >> v2:172.21.15.142:3300/0 conn(0x7f527c0cde90 0x7f527c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527b7fe640 1 -- 172.21.15.133:0/2254149158 >> v1:172.21.15.142:6789/0 conn(0x7f527c0cf170 legacy=0x7f527c06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527b7fe640 1 -- 172.21.15.133:0/2254149158 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0d0af0 con 0x7f527c15cae0 2023-12-18T10:25:58.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.556+0000 7f527affd640 1 --2- 172.21.15.133:0/2254149158 >> v2:172.21.15.142:3300/0 conn(0x7f527c0cde90 0x7f527c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f527b7fe640 1 --2- 172.21.15.133:0/2254149158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c15cae0 0x7f527c0d12f0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f527c0b8890 tx=0x7f526c01cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53887710fa964dd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f527a7fc640 1 -- 172.21.15.133:0/2254149158 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0aa650 con 0x7f527c15cae0 2023-12-18T10:25:58.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f527a7fc640 1 -- 172.21.15.133:0/2254149158 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0aa7b0 con 0x7f527c15cae0 2023-12-18T10:25:58.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f527a7fc640 1 -- 172.21.15.133:0/2254149158 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0aab40 con 0x7f527c15cae0 2023-12-18T10:25:58.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f528222d640 1 -- 172.21.15.133:0/2254149158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c15cae0 msgr2=0x7f527c0d12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f528222d640 1 --2- 172.21.15.133:0/2254149158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c15cae0 0x7f527c0d12f0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f527c0b8890 tx=0x7f526c01cf30 comp rx=0 tx=0).stop 2023-12-18T10:25:58.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f528222d640 1 -- 172.21.15.133:0/2254149158 shutdown_connections 2023-12-18T10:25:58.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f528222d640 1 --2- 172.21.15.133:0/2254149158 >> v2:172.21.15.142:3300/0 conn(0x7f527c0cde90 0x7f527c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f528222d640 1 --2- 172.21.15.133:0/2254149158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c15cae0 0x7f527c0d12f0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f528222d640 1 -- 172.21.15.133:0/2254149158 >> 172.21.15.133:0/2254149158 conn(0x7f527c089fb0 msgr2=0x7f527c0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f528222d640 1 -- 172.21.15.133:0/2254149158 shutdown_connections 2023-12-18T10:25:58.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.560+0000 7f528222d640 1 -- 172.21.15.133:0/2254149158 wait complete. 2023-12-18T10:25:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 Processor -- start 2023-12-18T10:25:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 -- start start 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c0cde90 0x7f527c1f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f527c0cf170 0x7f527c0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f527c15cae0 0x7f527c158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0af6c0 con 0x7f527c0cde90 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0b7730 con 0x7f527c0cf170 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c0b72a0 con 0x7f527c15cae0 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c0cde90 0x7f527c1f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c0cde90 0x7f527c1f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53326/0 (socket says 172.21.15.133:53326) 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 -- 172.21.15.133:0/2781081997 learned_addr learned my addr 172.21.15.133:0/2781081997 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527bfff640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f527c15cae0 0x7f527c158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527affd640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f527c0cf170 0x7f527c0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 -- 172.21.15.133:0/2781081997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f527c15cae0 msgr2=0x7f527c158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f527c15cae0 0x7f527c158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 -- 172.21.15.133:0/2781081997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f527c0cf170 msgr2=0x7f527c0cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f527c0cf170 0x7f527c0cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 -- 172.21.15.133:0/2781081997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c009480 con 0x7f527c0cde90 2023-12-18T10:25:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f527b7fe640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c0cde90 0x7f527c1f8390 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f526c0190e0 tx=0x7f526c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f5263fff640 1 -- 172.21.15.133:0/2781081997 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0aad30 con 0x7f527c0cde90 2023-12-18T10:25:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f5263fff640 1 -- 172.21.15.133:0/2781081997 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0aae90 con 0x7f527c0cde90 2023-12-18T10:25:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f5263fff640 1 -- 172.21.15.133:0/2781081997 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c005bc0 con 0x7f527c0cde90 2023-12-18T10:25:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 -- 172.21.15.133:0/2781081997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c0cfb10 con 0x7f527c0cde90 2023-12-18T10:25:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.564+0000 7f528222d640 1 -- 172.21.15.133:0/2781081997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c0b63d0 con 0x7f527c0cde90 2023-12-18T10:25:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.568+0000 7f5263fff640 1 -- 172.21.15.133:0/2781081997 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f526c003620 con 0x7f527c0cde90 2023-12-18T10:25:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.568+0000 7f5263fff640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5268065a60 0x7f5268067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.568+0000 7f5263fff640 1 -- 172.21.15.133:0/2781081997 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f526c11dc70 con 0x7f527c0cde90 2023-12-18T10:25:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.568+0000 7f527affd640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5268065a60 0x7f5268067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.568+0000 7f5285594000 1 Processor -- start 2023-12-18T10:25:58.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.568+0000 7f5285594000 1 -- start start 2023-12-18T10:25:58.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.568+0000 7f527affd640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5268065a60 0x7f5268067f20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f527c1678c0 tx=0x7f5270008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf591c80 0x55d0cf592060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf547a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf547fc0 0x55d0cf5483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf410430 con 0x55d0cf547fc0 2023-12-18T10:25:58.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf39e460 con 0x55d0cf591c80 2023-12-18T10:25:58.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf39ba30 con 0x55d0cf5925a0 2023-12-18T10:25:58.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf591c80 0x55d0cf592060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527affd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf547a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf591c80 0x55d0cf592060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:53510/0 (socket says 172.21.15.133:53510) 2023-12-18T10:25:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf547fc0 0x55d0cf5483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 -- 172.21.15.133:0/4173090902 learned_addr learned my addr 172.21.15.133:0/4173090902 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 -- 172.21.15.133:0/4173090902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 msgr2=0x55d0cf547a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf547a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 -- 172.21.15.133:0/4173090902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf547fc0 msgr2=0x55d0cf5483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf547fc0 0x55d0cf5483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 -- 172.21.15.133:0/4173090902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0cf093e20 con 0x55d0cf591c80 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527affd640 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf547a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527bfff640 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf547fc0 0x55d0cf5483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f527b7fe640 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf591c80 0x55d0cf592060 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f526c0eb7b0 tx=0x7f526c0eef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f88330ea77f7f455 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f52617fa640 1 -- 172.21.15.133:0/4173090902 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0f71e0 con 0x55d0cf591c80 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f52617fa640 1 -- 172.21.15.133:0/4173090902 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0ed3f0 con 0x55d0cf591c80 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f52617fa640 1 -- 172.21.15.133:0/4173090902 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0eb9c0 con 0x55d0cf591c80 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- 172.21.15.133:0/4173090902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf591c80 msgr2=0x55d0cf592060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf591c80 0x55d0cf592060 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f526c0eb7b0 tx=0x7f526c0eef20 comp rx=0 tx=0).stop 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- 172.21.15.133:0/4173090902 shutdown_connections 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf547fc0 0x55d0cf5483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf547a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 --2- 172.21.15.133:0/4173090902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf591c80 0x55d0cf592060 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- 172.21.15.133:0/4173090902 >> 172.21.15.133:0/4173090902 conn(0x55d0cf346910 msgr2=0x55d0cf546360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- 172.21.15.133:0/4173090902 shutdown_connections 2023-12-18T10:25:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- 172.21.15.133:0/4173090902 wait complete. 2023-12-18T10:25:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.572+0000 7f5285594000 1 -- start start 2023-12-18T10:25:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 Processor -- start 2023-12-18T10:25:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf598f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf599460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf552e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf397320 con 0x55d0cf591c80 2023-12-18T10:25:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf3364f0 con 0x55d0cf547fc0 2023-12-18T10:25:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf3546e0 con 0x55d0cf5925a0 2023-12-18T10:25:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 10 client.0 _ll_register_callbacks cb 0x55d0cf533980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf599460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf599460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53332/0 (socket says 172.21.15.133:53332) 2023-12-18T10:25:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 -- 172.21.15.133:0/474147212 learned_addr learned my addr 172.21.15.133:0/474147212 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527b7fe640 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf598f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527bfff640 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf552e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 -- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 msgr2=0x55d0cf552e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf552e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 -- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 msgr2=0x55d0cf598f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf598f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 -- 172.21.15.133:0/474147212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c15cec0 con 0x55d0cf591c80 2023-12-18T10:25:58.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527bfff640 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf552e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:58.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527affd640 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf599460 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f52700156f0 tx=0x7f52700046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ded311746b100b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f525a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f525a7fc640 1 -- 172.21.15.133:0/474147212 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270014720 con 0x55d0cf591c80 2023-12-18T10:25:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f525a7fc640 1 -- 172.21.15.133:0/474147212 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5270014880 con 0x55d0cf591c80 2023-12-18T10:25:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 -- 172.21.15.133:0/474147212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0cf354120 con 0x55d0cf591c80 2023-12-18T10:25:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f525a7fc640 1 -- 172.21.15.133:0/474147212 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5270014a40 con 0x55d0cf591c80 2023-12-18T10:25:58.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 10 client.9669 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:58.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 -- 172.21.15.133:0/474147212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x7f527000e040 con 0x55d0cf591c80 2023-12-18T10:25:58.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f525a7fc640 1 -- 172.21.15.133:0/474147212 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d0cf354120 con 0x55d0cf591c80 2023-12-18T10:25:58.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f525a7fc640 1 -- 172.21.15.133:0/474147212 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5270028020 con 0x55d0cf591c80 2023-12-18T10:25:58.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 10 client.9669 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:58.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 10 client.9669 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:58.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 20 client.9669 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:58.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55d0cf553bc0 0x55d0cf553fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 4 client.9669 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:58.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f5285594000 1 -- 172.21.15.133:0/474147212 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0cf395c70 con 0x55d0cf553bc0 2023-12-18T10:25:58.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.576+0000 7f527b7fe640 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55d0cf553bc0 0x55d0cf553fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f527b7fe640 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55d0cf553bc0 0x55d0cf553fd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e47d11ac0c50c95 server_cookie=c29a0fc4969d7467 in_seq=0 out_seq=0 2023-12-18T10:25:58.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f525a7fc640 10 client.9669 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f525a7fc640 1 -- 172.21.15.133:0/474147212 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55d0cf395c70 con 0x55d0cf553bc0 2023-12-18T10:25:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f525a7fc640 10 client.9669 handle_command_reply: tid=0 2023-12-18T10:25:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 client.9669 shutdown 2023-12-18T10:25:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 -- 172.21.15.133:0/474147212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 msgr2=0x55d0cf599460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf599460 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f52700156f0 tx=0x7f52700046d0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 -- 172.21.15.133:0/474147212 shutdown_connections 2023-12-18T10:25:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55d0cf553bc0 0x55d0cf553fd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf552e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f525a7fc640 0 client.9669 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf599460 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 --2- 172.21.15.133:0/474147212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf598f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 -- 172.21.15.133:0/474147212 >> 172.21.15.133:0/474147212 conn(0x55d0cf346910 msgr2=0x55d0cf546a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 -- 172.21.15.133:0/474147212 shutdown_connections 2023-12-18T10:25:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 1 -- 172.21.15.133:0/474147212 wait complete. 2023-12-18T10:25:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.580+0000 7f5285594000 20 client.9669 trim_cache size 0 max 16384 2023-12-18T10:25:58.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5285594000 1 Processor -- start 2023-12-18T10:25:58.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5285594000 1 -- start start 2023-12-18T10:25:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5285594000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf5979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5285594000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf597f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5285594000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf58a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5285594000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf054aa0 con 0x55d0cf591c80 2023-12-18T10:25:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5285594000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf394b30 con 0x55d0cf547fc0 2023-12-18T10:25:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5285594000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf592bb0 con 0x55d0cf5925a0 2023-12-18T10:25:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf597f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf5979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527bfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf58a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf597f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53340/0 (socket says 172.21.15.133:53340) 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 -- 172.21.15.133:0/2342236422 learned_addr learned my addr 172.21.15.133:0/2342236422 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf5979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:53530/0 (socket says 172.21.15.133:53530) 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 -- 172.21.15.133:0/2342236422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 msgr2=0x55d0cf58a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 --2- 172.21.15.133:0/2342236422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf58a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 -- 172.21.15.133:0/2342236422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 msgr2=0x55d0cf5979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 --2- 172.21.15.133:0/2342236422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf5979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 -- 172.21.15.133:0/2342236422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0b63d0 con 0x55d0cf591c80 2023-12-18T10:25:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527b7fe640 1 --2- 172.21.15.133:0/2342236422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf5979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f527affd640 1 --2- 172.21.15.133:0/2342236422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf597f20 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f5270008010 tx=0x7f5270024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774d216574645a75 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5261ffb640 1 -- 172.21.15.133:0/2342236422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270014c40 con 0x55d0cf591c80 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5261ffb640 1 -- 172.21.15.133:0/2342236422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5270014e20 con 0x55d0cf591c80 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.596+0000 7f5261ffb640 1 -- 172.21.15.133:0/2342236422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270022d70 con 0x55d0cf591c80 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- 172.21.15.133:0/2342236422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 msgr2=0x55d0cf597f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 --2- 172.21.15.133:0/2342236422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf597f20 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f5270008010 tx=0x7f5270024000 comp rx=0 tx=0).stop 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- 172.21.15.133:0/2342236422 shutdown_connections 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 --2- 172.21.15.133:0/2342236422 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf5925a0 0x55d0cf58a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 --2- 172.21.15.133:0/2342236422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf591c80 0x55d0cf597f20 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 --2- 172.21.15.133:0/2342236422 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf5979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- 172.21.15.133:0/2342236422 >> 172.21.15.133:0/2342236422 conn(0x55d0cf346910 msgr2=0x55d0cf5962c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- 172.21.15.133:0/2342236422 shutdown_connections 2023-12-18T10:25:58.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- 172.21.15.133:0/2342236422 wait complete. 2023-12-18T10:25:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- start start 2023-12-18T10:25:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 Processor -- start 2023-12-18T10:25:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf591480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf591c80 0x55d0cf5eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf5925a0 0x55d0cf5ef520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf44ee50 con 0x55d0cf5925a0 2023-12-18T10:25:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf394720 con 0x55d0cf547fc0 2023-12-18T10:25:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d0cf59f500 con 0x55d0cf591c80 2023-12-18T10:25:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f5285594000 10 client.0 _ll_register_callbacks cb 0x55d0cf34e710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf5925a0 0x55d0cf5ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf591480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf5925a0 0x55d0cf5ef520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53348/0 (socket says 172.21.15.133:53348) 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 -- 172.21.15.133:0/3798082284 learned_addr learned my addr 172.21.15.133:0/3798082284 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527affd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf591c80 0x55d0cf5eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 -- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf591c80 msgr2=0x55d0cf5eefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf591c80 0x55d0cf5eefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 -- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 msgr2=0x55d0cf591480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf591480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 -- 172.21.15.133:0/3798082284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0cf093e20 con 0x55d0cf5925a0 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f527bfff640 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf5925a0 0x55d0cf5ef520 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f5274005280 tx=0x7f5274005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d97e9c2aaa8ba server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f525a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.600+0000 7f525a7fc640 1 -- 172.21.15.133:0/3798082284 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274017990 con 0x55d0cf5925a0 2023-12-18T10:25:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 -- 172.21.15.133:0/3798082284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0cf3606a0 con 0x55d0cf5925a0 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f525a7fc640 1 -- 172.21.15.133:0/3798082284 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5274017af0 con 0x55d0cf5925a0 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f525a7fc640 1 -- 172.21.15.133:0/3798082284 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5274017cf0 con 0x55d0cf5925a0 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 10 client.9675 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 -- 172.21.15.133:0/3798082284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x7f527000e040 con 0x55d0cf5925a0 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f525a7fc640 1 -- 172.21.15.133:0/3798082284 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d0cf3606a0 con 0x55d0cf5925a0 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f525a7fc640 1 -- 172.21.15.133:0/3798082284 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5274012040 con 0x55d0cf5925a0 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 10 client.9675 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 10 client.9675 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 20 client.9675 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55d0cf5efa60 0x55d0cf58fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 4 client.9675 mds_command: new command op to 9048 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 -- 172.21.15.133:0/3798082284 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d0cf3903a0 con 0x55d0cf5efa60 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f527b7fe640 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55d0cf5efa60 0x55d0cf58fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f525a7fc640 10 client.9675 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f527b7fe640 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55d0cf5efa60 0x55d0cf58fbc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f8d0ab14b69e61 server_cookie=66c3fd2b7f3622bb in_seq=0 out_seq=0 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f525a7fc640 1 -- 172.21.15.133:0/3798082284 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55d0cf3903a0 con 0x55d0cf5efa60 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f525a7fc640 10 client.9675 handle_command_reply: tid=0 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 client.9675 shutdown 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 -- 172.21.15.133:0/3798082284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf5925a0 msgr2=0x55d0cf5ef520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf5925a0 0x55d0cf5ef520 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f5274005280 tx=0x7f5274005740 comp rx=0 tx=0).stop 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 -- 172.21.15.133:0/3798082284 shutdown_connections 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55d0cf5efa60 0x55d0cf58fbc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d0cf5925a0 0x55d0cf5ef520 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55d0cf591c80 0x55d0cf5eefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 --2- 172.21.15.133:0/3798082284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d0cf547fc0 0x55d0cf591480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f525a7fc640 0 client.9675 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 -- 172.21.15.133:0/3798082284 >> 172.21.15.133:0/3798082284 conn(0x55d0cf346910 msgr2=0x55d0cf5982f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 -- 172.21.15.133:0/3798082284 shutdown_connections 2023-12-18T10:25:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 1 -- 172.21.15.133:0/3798082284 wait complete. 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f5285594000 20 client.9675 trim_cache size 0 max 16384 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:58.610 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 -- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5268065a60 msgr2=0x7f5268067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5268065a60 0x7f5268067f20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f527c1678c0 tx=0x7f5270008040 comp rx=0 tx=0).stop 2023-12-18T10:25:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 -- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c0cde90 msgr2=0x7f527c1f8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c0cde90 0x7f527c1f8390 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f526c0190e0 tx=0x7f526c019270 comp rx=0 tx=0).stop 2023-12-18T10:25:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 -- 172.21.15.133:0/2781081997 shutdown_connections 2023-12-18T10:25:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5268065a60 0x7f5268067f20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f527c15cae0 0x7f527c158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f527c0cf170 0x7f527c0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 --2- 172.21.15.133:0/2781081997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f527c0cde90 0x7f527c1f8390 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 -- 172.21.15.133:0/2781081997 >> 172.21.15.133:0/2781081997 conn(0x7f527c089fb0 msgr2=0x7f527c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 -- 172.21.15.133:0/2781081997 shutdown_connections 2023-12-18T10:25:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.604+0000 7f528222d640 1 -- 172.21.15.133:0/2781081997 wait complete. 2023-12-18T10:25:58.624 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:58.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:25:58.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.760+0000 7f46dbd39640 1 Processor -- start 2023-12-18T10:25:58.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.760+0000 7f46dbd39640 1 -- start start 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46dbd39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46dbd39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46d406fdb0 0x7f46d4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46dbd39640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d4160690 con 0x7f46d415c9d0 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46dbd39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d41603f0 con 0x7f46d406fdb0 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46dbd39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d40b0d80 con 0x7f46d40cdd40 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46d9ad5640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f46d415c9d0 0x7f46d4160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60978/0 (socket says 172.21.15.133:60978) 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46d9ad5640 1 -- 172.21.15.133:0/2919030814 learned_addr learned my addr 172.21.15.133:0/2919030814 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46da2d6640 1 --2- 172.21.15.133:0/2919030814 >> v2:172.21.15.133:3300/0 conn(0x7f46d406fdb0 0x7f46d4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46d92d4640 1 --2- 172.21.15.133:0/2919030814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46d8ad3640 1 -- 172.21.15.133:0/2919030814 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807815007 0 0) 0x7f46d4160690 con 0x7f46d415c9d0 2023-12-18T10:25:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46d8ad3640 1 -- 172.21.15.133:0/2919030814 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c0003530 con 0x7f46d415c9d0 2023-12-18T10:25:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46da2d6640 1 -- 172.21.15.133:0/2919030814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 msgr2=0x7f46d40cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46da2d6640 1 --2- 172.21.15.133:0/2919030814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d40cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46da2d6640 1 -- 172.21.15.133:0/2919030814 >> v1:172.21.15.133:6789/0 conn(0x7f46d415c9d0 legacy=0x7f46d4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.764+0000 7f46da2d6640 1 -- 172.21.15.133:0/2919030814 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d40ccb00 con 0x7f46d406fdb0 2023-12-18T10:25:58.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46da2d6640 1 --2- 172.21.15.133:0/2919030814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d406fdb0 0x7f46d4070240 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009d90 tx=0x7f46cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b003ad16c2b9900 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46d8ad3640 1 -- 172.21.15.133:0/2919030814 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0a5a30 con 0x7f46d406fdb0 2023-12-18T10:25:58.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46d8ad3640 1 -- 172.21.15.133:0/2919030814 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc0a5b90 con 0x7f46d406fdb0 2023-12-18T10:25:58.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46d8ad3640 1 -- 172.21.15.133:0/2919030814 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0ad440 con 0x7f46d406fdb0 2023-12-18T10:25:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 -- 172.21.15.133:0/2919030814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d406fdb0 msgr2=0x7f46d4070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2919030814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d406fdb0 0x7f46d4070240 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009d90 tx=0x7f46cc01c950 comp rx=0 tx=0).stop 2023-12-18T10:25:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 -- 172.21.15.133:0/2919030814 shutdown_connections 2023-12-18T10:25:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2919030814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d406fdb0 0x7f46d4070240 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2919030814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d40cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 -- 172.21.15.133:0/2919030814 >> 172.21.15.133:0/2919030814 conn(0x7f46d406a3e0 msgr2=0x7f46d40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 -- 172.21.15.133:0/2919030814 shutdown_connections 2023-12-18T10:25:58.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 -- 172.21.15.133:0/2919030814 wait complete. 2023-12-18T10:25:58.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 Processor -- start 2023-12-18T10:25:58.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.768+0000 7f46dbd39640 1 -- start start 2023-12-18T10:25:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d406fdb0 0x7f46d41493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d415c9d0 0x7f46d415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4159500 con 0x7f46d415c9d0 2023-12-18T10:25:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d40c7260 con 0x7f46d406fdb0 2023-12-18T10:25:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d40c4b30 con 0x7f46d40cdd40 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d415c9d0 0x7f46d415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d415c9d0 0x7f46d415bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53358/0 (socket says 172.21.15.133:53358) 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 -- 172.21.15.133:0/2429288475 learned_addr learned my addr 172.21.15.133:0/2429288475 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46d92d4640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46d9ad5640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d406fdb0 0x7f46d41493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 -- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 msgr2=0x7f46d415b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d415b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 -- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d406fdb0 msgr2=0x7f46d41493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d406fdb0 0x7f46d41493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 -- 172.21.15.133:0/2429288475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc009a70 con 0x7f46d415c9d0 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46d9ad5640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d406fdb0 0x7f46d41493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46d92d4640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d415b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46da2d6640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d415c9d0 0x7f46d415bd70 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0b0040 tx=0x7f46cc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46ca7fc640 1 -- 172.21.15.133:0/2429288475 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0adce0 con 0x7f46d415c9d0 2023-12-18T10:25:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46ca7fc640 1 -- 172.21.15.133:0/2429288475 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc0ade40 con 0x7f46d415c9d0 2023-12-18T10:25:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d41613b0 con 0x7f46d415c9d0 2023-12-18T10:25:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46ca7fc640 1 -- 172.21.15.133:0/2429288475 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc0b7650 con 0x7f46d415c9d0 2023-12-18T10:25:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d40c5060 con 0x7f46d415c9d0 2023-12-18T10:25:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d40735b0 con 0x7f46d415c9d0 2023-12-18T10:25:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.772+0000 7f46ca7fc640 1 -- 172.21.15.133:0/2429288475 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f46cc0b4050 con 0x7f46d415c9d0 2023-12-18T10:25:58.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.776+0000 7f46ca7fc640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46b8065a60 0x7f46b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:58.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.776+0000 7f46ca7fc640 1 -- 172.21.15.133:0/2429288475 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46cc11e290 con 0x7f46d415c9d0 2023-12-18T10:25:58.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.776+0000 7f46d9ad5640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46b8065a60 0x7f46b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:58.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.776+0000 7f46d9ad5640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46b8065a60 0x7f46b8067f20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f46d00011f0 tx=0x7f46d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:58.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.780+0000 7f46ca7fc640 1 -- 172.21.15.133:0/2429288475 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f46cc0ebb70 con 0x7f46d415c9d0 2023-12-18T10:25:58.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.960+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46d404e000 con 0x7f46d415c9d0 2023-12-18T10:25:58.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.960+0000 7f46ca7fc640 1 -- 172.21.15.133:0/2429288475 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7f46cc009450 con 0x7f46d415c9d0 2023-12-18T10:25:58.961 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:58.961 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:25:58.962 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:25:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46b8065a60 msgr2=0x7f46b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46b8065a60 0x7f46b8067f20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f46d00011f0 tx=0x7f46d0009040 comp rx=0 tx=0).stop 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d415c9d0 msgr2=0x7f46d415bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d415c9d0 0x7f46d415bd70 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0b0040 tx=0x7f46cc0196f0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 shutdown_connections 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f46b8065a60 0x7f46b8067f20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46d415c9d0 0x7f46d415bd70 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46d40cdd40 0x7f46d415b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 --2- 172.21.15.133:0/2429288475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46d406fdb0 0x7f46d41493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 >> 172.21.15.133:0/2429288475 conn(0x7f46d406a3e0 msgr2=0x7f46d4155950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 shutdown_connections 2023-12-18T10:25:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:58.964+0000 7f46dbd39640 1 -- 172.21.15.133:0/2429288475 wait complete. 2023-12-18T10:25:58.982 DEBUG:tasks.cephfs.test_multimds_misc:current active=['d', 'a', 'c'] 2023-12-18T10:25:58.982 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:25:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e360d1640 1 Processor -- start 2023-12-18T10:25:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e360d1640 1 -- start start 2023-12-18T10:25:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e360d1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e3015ca40 0x7f3e300cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e360d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e301668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e360d1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e300d11c0 con 0x7f3e300ce3f0 2023-12-18T10:25:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e360d1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e300d0310 con 0x7f3e3015ca40 2023-12-18T10:25:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e360d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300d05b0 con 0x7f3e300cf7e0 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e301668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e3015ca40 0x7f3e300cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2effd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3e300ce3f0 0x7f3e300cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:48354/0 (socket says 172.21.15.133:48354) 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2effd640 1 -- 172.21.15.133:0/976575701 learned_addr learned my addr 172.21.15.133:0/976575701 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2e7fc640 1 -- 172.21.15.133:0/976575701 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243025015 0 0) 0x7f3e300d11c0 con 0x7f3e300ce3f0 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/976575701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 msgr2=0x7f3e301668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2f7fe640 1 --2- 172.21.15.133:0/976575701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e301668e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/976575701 >> v1:172.21.15.142:6789/0 conn(0x7f3e300ce3f0 legacy=0x7f3e300cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/976575701 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300d0890 con 0x7f3e3015ca40 2023-12-18T10:25:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.120+0000 7f3e2ffff640 1 --2- 172.21.15.133:0/976575701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e301668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e2f7fe640 1 --2- 172.21.15.133:0/976575701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 0x7f3e300cdeb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3e200097a0 tx=0x7f3e2001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=504f12a02d649b39 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e2e7fc640 1 -- 172.21.15.133:0/976575701 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200ab660 con 0x7f3e3015ca40 2023-12-18T10:25:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e2e7fc640 1 -- 172.21.15.133:0/976575701 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e200ab7c0 con 0x7f3e3015ca40 2023-12-18T10:25:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e2e7fc640 1 -- 172.21.15.133:0/976575701 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200abb50 con 0x7f3e3015ca40 2023-12-18T10:25:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e360d1640 1 -- 172.21.15.133:0/976575701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 msgr2=0x7f3e300cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e360d1640 1 --2- 172.21.15.133:0/976575701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 0x7f3e300cdeb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3e200097a0 tx=0x7f3e2001c460 comp rx=0 tx=0).stop 2023-12-18T10:25:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e360d1640 1 -- 172.21.15.133:0/976575701 shutdown_connections 2023-12-18T10:25:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e360d1640 1 --2- 172.21.15.133:0/976575701 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e301668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e360d1640 1 --2- 172.21.15.133:0/976575701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 0x7f3e300cdeb0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e360d1640 1 -- 172.21.15.133:0/976575701 >> 172.21.15.133:0/976575701 conn(0x7f3e30089fb0 msgr2=0x7f3e300d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e360d1640 1 -- 172.21.15.133:0/976575701 shutdown_connections 2023-12-18T10:25:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.124+0000 7f3e360d1640 1 -- 172.21.15.133:0/976575701 wait complete. 2023-12-18T10:25:59.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 Processor -- start 2023-12-18T10:25:59.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 -- start start 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e300ce3f0 0x7f3e30159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e3014b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 0x7f3e300b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300b0650 con 0x7f3e300ce3f0 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3015ff30 con 0x7f3e3015ca40 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300af9d0 con 0x7f3e300cf7e0 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e300ce3f0 0x7f3e30159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e300ce3f0 0x7f3e30159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53364/0 (socket says 172.21.15.133:53364) 2023-12-18T10:25:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/4011210845 learned_addr learned my addr 172.21.15.133:0/4011210845 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2effd640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e3014b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 msgr2=0x7f3e3014b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2ffff640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 0x7f3e300b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e3014b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 msgr2=0x7f3e300b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 0x7f3e300b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 -- 172.21.15.133:0/4011210845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e28009a70 con 0x7f3e300ce3f0 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2effd640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e3014b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2ffff640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 0x7f3e300b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e2f7fe640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e300ce3f0 0x7f3e30159c30 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ad040 tx=0x7f3e2001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e17fff640 1 -- 172.21.15.133:0/4011210845 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200bf610 con 0x7f3e300ce3f0 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e17fff640 1 -- 172.21.15.133:0/4011210845 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e200bf770 con 0x7f3e300ce3f0 2023-12-18T10:25:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.128+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e200093b0 con 0x7f3e300ce3f0 2023-12-18T10:25:59.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.132+0000 7f3e17fff640 1 -- 172.21.15.133:0/4011210845 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200bfb20 con 0x7f3e300ce3f0 2023-12-18T10:25:59.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.132+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e300d17d0 con 0x7f3e300ce3f0 2023-12-18T10:25:59.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.132+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e300b08c0 con 0x7f3e300ce3f0 2023-12-18T10:25:59.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.132+0000 7f3e17fff640 1 -- 172.21.15.133:0/4011210845 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3e200a9070 con 0x7f3e300ce3f0 2023-12-18T10:25:59.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.132+0000 7f3e17fff640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e1c065a90 0x7f3e1c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.132+0000 7f3e17fff640 1 -- 172.21.15.133:0/4011210845 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3e2011da60 con 0x7f3e300ce3f0 2023-12-18T10:25:59.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.132+0000 7f3e2effd640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e1c065a90 0x7f3e1c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.132+0000 7f3e2effd640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e1c065a90 0x7f3e1c067f50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3e300b30d0 tx=0x7f3e24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.136+0000 7f3e17fff640 1 -- 172.21.15.133:0/4011210845 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3e200eb3d0 con 0x7f3e300ce3f0 2023-12-18T10:25:59.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3e3004e000 con 0x7f3e300ce3f0 2023-12-18T10:25:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e17fff640 1 -- 172.21.15.133:0/4011210845 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1927 (secure 0 0 0) 0x7f3e200ee9f0 con 0x7f3e300ce3f0 2023-12-18T10:25:59.344 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:25:59.344 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":499,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694751,"bytes_used":266510336,"bytes_avail":772827602944,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":11057,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":113,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"c","status":"up:active","gid":9039},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":9042},{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":9048}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2023-12-18T10:25:55.196454+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-12-18T10:25:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e1c065a90 msgr2=0x7f3e1c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e1c065a90 0x7f3e1c067f50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3e300b30d0 tx=0x7f3e24009040 comp rx=0 tx=0).stop 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e300ce3f0 msgr2=0x7f3e30159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e300ce3f0 0x7f3e30159c30 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f3e200ad040 tx=0x7f3e2001aca0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 shutdown_connections 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3e1c065a90 0x7f3e1c067f50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e3015ca40 0x7f3e300b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3e300cf7e0 0x7f3e3014b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 --2- 172.21.15.133:0/4011210845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e300ce3f0 0x7f3e30159c30 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 >> 172.21.15.133:0/4011210845 conn(0x7f3e30089fb0 msgr2=0x7f3e300ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 shutdown_connections 2023-12-18T10:25:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.344+0000 7f3e360d1640 1 -- 172.21.15.133:0/4011210845 wait complete. 2023-12-18T10:25:59.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:25:59.366 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub resume 2023-12-18T10:25:59.415 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:25:59.418 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:25:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.504+0000 7fa633f6d640 1 Processor -- start 2023-12-18T10:25:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.504+0000 7fa633f6d640 1 -- start start 2023-12-18T10:25:59.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa633f6d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa62c1582d0 0x7fa62c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa633f6d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0c9390 con 0x7fa62c070820 2023-12-18T10:25:59.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa633f6d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c15aee0 con 0x7fa62c0ce3b0 2023-12-18T10:25:59.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa633f6d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c15b1c0 con 0x7fa62c1582d0 2023-12-18T10:25:59.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa631508640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa62c070820 0x7fa62c0ca5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60980/0 (socket says 172.21.15.133:60980) 2023-12-18T10:25:59.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa631508640 1 -- 172.21.15.133:0/2909577954 learned_addr learned my addr 172.21.15.133:0/2909577954 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa631d09640 1 --2- 172.21.15.133:0/2909577954 >> v2:172.21.15.142:3300/0 conn(0x7fa62c1582d0 0x7fa62c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381923023 0 0) 0x7fa62c0c9390 con 0x7fa62c070820 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa618003530 con 0x7fa62c070820 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1131691721 0 0) 0x7fa618003530 con 0x7fa62c070820 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 >> v2:172.21.15.142:3300/0 conn(0x7fa62c1582d0 msgr2=0x7fa62c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 --2- 172.21.15.133:0/2909577954 >> v2:172.21.15.142:3300/0 conn(0x7fa62c1582d0 0x7fa62c0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 >> v1:172.21.15.142:6789/0 conn(0x7fa62c0ce3b0 legacy=0x7fa62c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c15b4a0 con 0x7fa62c070820 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fa61c001680 con 0x7fa62c070820 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 >> v1:172.21.15.133:6789/0 conn(0x7fa62c070820 legacy=0x7fa62c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa618003980 0x7fa618003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6180047d0 0x7fa618004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa61800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c15b1c0 con 0x7fa618005190 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61800c030 con 0x7fa618003980 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61800c1f0 con 0x7fa6180047d0 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa63250a640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa61800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa631d09640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa618003980 0x7fa618003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa631508640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6180047d0 0x7fa618004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa63250a640 1 -- 172.21.15.133:0/2909577954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6180047d0 msgr2=0x7fa618004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa63250a640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6180047d0 0x7fa618004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa63250a640 1 -- 172.21.15.133:0/2909577954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa618003980 msgr2=0x7fa618003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa63250a640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa618003980 0x7fa618003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.508+0000 7fa63250a640 1 -- 172.21.15.133:0/2909577954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618003530 con 0x7fa618005190 2023-12-18T10:25:59.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa63250a640 1 -- 172.21.15.133:0/2909577954 reap_dead start 2023-12-18T10:25:59.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa63250a640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa61800b990 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fa624001e70 tx=0x7fa62401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43775c4694ba0bae server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624003b80 con 0x7fa618005190 2023-12-18T10:25:59.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624003d20 con 0x7fa618005190 2023-12-18T10:25:59.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa630d07640 1 -- 172.21.15.133:0/2909577954 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624005260 con 0x7fa618005190 2023-12-18T10:25:59.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa633f6d640 1 -- 172.21.15.133:0/2909577954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 msgr2=0x7fa61800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa633f6d640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa61800b990 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fa624001e70 tx=0x7fa62401c760 comp rx=0 tx=0).stop 2023-12-18T10:25:59.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa633f6d640 1 -- 172.21.15.133:0/2909577954 shutdown_connections 2023-12-18T10:25:59.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa633f6d640 1 --2- 172.21.15.133:0/2909577954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa61800b990 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa633f6d640 1 -- 172.21.15.133:0/2909577954 >> 172.21.15.133:0/2909577954 conn(0x7fa62c06a2a0 msgr2=0x7fa62c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa633f6d640 1 -- 172.21.15.133:0/2909577954 shutdown_connections 2023-12-18T10:25:59.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.512+0000 7fa633f6d640 1 -- 172.21.15.133:0/2909577954 wait complete. 2023-12-18T10:25:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 Processor -- start 2023-12-18T10:25:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 -- start start 2023-12-18T10:25:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa62c0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62c15c080 0x7fa62c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62c1548f0 0x7fa62c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c15d090 con 0x7fa618005190 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c15cad0 con 0x7fa62c15c080 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c15cdb0 con 0x7fa62c1548f0 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa62c0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa62c0cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53382/0 (socket says 172.21.15.133:53382) 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 -- 172.21.15.133:0/3876768606 learned_addr learned my addr 172.21.15.133:0/3876768606 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa63250a640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62c1548f0 0x7fa62c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631508640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62c15c080 0x7fa62c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 -- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62c1548f0 msgr2=0x7fa62c15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62c1548f0 0x7fa62c15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 -- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62c15c080 msgr2=0x7fa62c1543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62c15c080 0x7fa62c1543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 -- 172.21.15.133:0/3876768606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c153bb0 con 0x7fa618005190 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa63250a640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62c1548f0 0x7fa62c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa631d09640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa62c0cd2a0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fa628011960 tx=0x7fa628011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa6227fc640 1 -- 172.21.15.133:0/3876768606 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62800faf0 con 0x7fa618005190 2023-12-18T10:25:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa6227fc640 1 -- 172.21.15.133:0/3876768606 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62800fc50 con 0x7fa618005190 2023-12-18T10:25:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 -- 172.21.15.133:0/3876768606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c153e90 con 0x7fa618005190 2023-12-18T10:25:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa6227fc640 1 -- 172.21.15.133:0/3876768606 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628014440 con 0x7fa618005190 2023-12-18T10:25:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.516+0000 7fa633f6d640 1 -- 172.21.15.133:0/3876768606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c0cd7e0 con 0x7fa618005190 2023-12-18T10:25:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6227fc640 1 -- 172.21.15.133:0/3876768606 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa6280145a0 con 0x7fa618005190 2023-12-18T10:25:59.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6227fc640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa610065a60 0x7fa610067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6227fc640 1 -- 172.21.15.133:0/3876768606 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa628083be0 con 0x7fa618005190 2023-12-18T10:25:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631508640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa610065a60 0x7fa610067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6372cf000 1 Processor -- start 2023-12-18T10:25:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6372cf000 1 -- start start 2023-12-18T10:25:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631508640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa610065a60 0x7fa610067f20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa61c001060 tx=0x7fa61c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x556631443060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x5566313f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 0x5566313f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6372cf000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566312c1430 con 0x556631442c80 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6372cf000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663124f460 con 0x5566313f8fc0 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa6372cf000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55663124ca30 con 0x5566314435a0 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x556631443060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x556631443060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53388/0 (socket says 172.21.15.133:53388) 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 -- 172.21.15.133:0/513160639 learned_addr learned my addr 172.21.15.133:0/513160639 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631508640 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x5566313f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa63250a640 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 0x5566313f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 -- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 msgr2=0x5566313f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x5566313f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 -- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 msgr2=0x5566313f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 0x5566313f93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 -- 172.21.15.133:0/513160639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556630f44e20 con 0x556631442c80 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631508640 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x5566313f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa631d09640 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x556631443060 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fa6280515f0 tx=0x7fa628054a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ef50f7eb9d0d63 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa60f7fe640 1 -- 172.21.15.133:0/513160639 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628058f20 con 0x556631442c80 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa60f7fe640 1 -- 172.21.15.133:0/513160639 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62805d0d0 con 0x556631442c80 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.520+0000 7fa60f7fe640 1 -- 172.21.15.133:0/513160639 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628082020 con 0x556631442c80 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- 172.21.15.133:0/513160639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 msgr2=0x556631443060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x556631443060 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fa6280515f0 tx=0x7fa628054a50 comp rx=0 tx=0).stop 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- 172.21.15.133:0/513160639 shutdown_connections 2023-12-18T10:25:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 0x5566313f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x5566313f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 --2- 172.21.15.133:0/513160639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x556631443060 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- 172.21.15.133:0/513160639 >> 172.21.15.133:0/513160639 conn(0x5566311f7910 msgr2=0x5566313f7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- 172.21.15.133:0/513160639 shutdown_connections 2023-12-18T10:25:59.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- 172.21.15.133:0/513160639 wait complete. 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- start start 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 Processor -- start 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631443980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 0x556631443ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x556631444400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556631248320 con 0x5566313f8fc0 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566311e74f0 con 0x556631442c80 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566312056e0 con 0x5566314435a0 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa6372cf000 10 client.0 _ll_register_callbacks cb 0x5566313e4980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631443980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631443980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53390/0 (socket says 172.21.15.133:53390) 2023-12-18T10:25:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 -- 172.21.15.133:0/2558463761 learned_addr learned my addr 172.21.15.133:0/2558463761 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631508640 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 0x556631443ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa63250a640 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x556631444400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 -- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 msgr2=0x556631444400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x556631444400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 -- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 msgr2=0x556631443ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 0x556631443ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 -- 172.21.15.133:0/2558463761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c0cd7e0 con 0x5566313f8fc0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa63250a640 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x556631444400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa631d09640 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631443980 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fa628011930 tx=0x7fa628016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869ee715ba312258 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa60cff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa60cff9640 1 -- 172.21.15.133:0/2558463761 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628076070 con 0x5566313f8fc0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.524+0000 7fa60cff9640 1 -- 172.21.15.133:0/2558463761 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa6280545e0 con 0x5566313f8fc0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 -- 172.21.15.133:0/2558463761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556631205120 con 0x5566313f8fc0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa60cff9640 1 -- 172.21.15.133:0/2558463761 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa628082150 con 0x5566313f8fc0 2023-12-18T10:25:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 10 client.9699 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 -- 172.21.15.133:0/2558463761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x55663120d250 con 0x5566313f8fc0 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa60cff9640 1 -- 172.21.15.133:0/2558463761 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556631205120 con 0x5566313f8fc0 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa60cff9640 1 -- 172.21.15.133:0/2558463761 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fa628079020 con 0x5566313f8fc0 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 10 client.9699 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 10 client.9699 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 20 client.9699 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x556631452840 0x556631454c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 4 client.9699 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 -- 172.21.15.133:0/2558463761 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556631246c70 con 0x556631452840 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa631508640 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x556631452840 0x556631454c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa631508640 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x556631452840 0x556631454c30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9c09428bd7fa12c server_cookie=ee107c314054bf7e in_seq=0 out_seq=0 2023-12-18T10:25:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa60cff9640 10 client.9699 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa60cff9640 1 -- 172.21.15.133:0/2558463761 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x556631246c70 con 0x556631452840 2023-12-18T10:25:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa60cff9640 10 client.9699 handle_command_reply: tid=0 2023-12-18T10:25:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 client.9699 shutdown 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 -- 172.21.15.133:0/2558463761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 msgr2=0x556631443980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631443980 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fa628011930 tx=0x7fa628016000 comp rx=0 tx=0).stop 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 -- 172.21.15.133:0/2558463761 shutdown_connections 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x556631452840 0x556631454c30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x556631444400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 0x556631443ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa60cff9640 0 client.9699 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2558463761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631443980 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 -- 172.21.15.133:0/2558463761 >> 172.21.15.133:0/2558463761 conn(0x5566311f7910 msgr2=0x5566313f7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 -- 172.21.15.133:0/2558463761 shutdown_connections 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 1 -- 172.21.15.133:0/2558463761 wait complete. 2023-12-18T10:25:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.528+0000 7fa6372cf000 20 client.9699 trim_cache size 0 max 16384 2023-12-18T10:25:59.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 Processor -- start 2023-12-18T10:25:59.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- start start 2023-12-18T10:25:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631455c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 0x556631456180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x55663143c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x556630f05aa0 con 0x5566313f8fc0 2023-12-18T10:25:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566312ffe50 con 0x556631442c80 2023-12-18T10:25:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x556631245720 con 0x5566314435a0 2023-12-18T10:25:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631455c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631455c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53406/0 (socket says 172.21.15.133:53406) 2023-12-18T10:25:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 -- 172.21.15.133:0/1881726053 learned_addr learned my addr 172.21.15.133:0/1881726053 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 -- 172.21.15.133:0/1881726053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 msgr2=0x55663143c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 --2- 172.21.15.133:0/1881726053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x55663143c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 -- 172.21.15.133:0/1881726053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 msgr2=0x556631456180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 --2- 172.21.15.133:0/1881726053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 0x556631456180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 -- 172.21.15.133:0/1881726053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566311f35a0 con 0x5566313f8fc0 2023-12-18T10:25:59.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa631d09640 1 --2- 172.21.15.133:0/1881726053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631455c40 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fa628006dd0 tx=0x7fa62806e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ffcd9d302b163f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa60ffff640 1 -- 172.21.15.133:0/1881726053 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628082150 con 0x5566313f8fc0 2023-12-18T10:25:59.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa60ffff640 1 -- 172.21.15.133:0/1881726053 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa628070070 con 0x5566313f8fc0 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa60ffff640 1 -- 172.21.15.133:0/1881726053 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6280548b0 con 0x5566313f8fc0 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- 172.21.15.133:0/1881726053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 msgr2=0x556631455c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 --2- 172.21.15.133:0/1881726053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631455c40 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fa628006dd0 tx=0x7fa62806e070 comp rx=0 tx=0).stop 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- 172.21.15.133:0/1881726053 shutdown_connections 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 --2- 172.21.15.133:0/1881726053 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x55663143c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 --2- 172.21.15.133:0/1881726053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556631442c80 0x556631456180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 --2- 172.21.15.133:0/1881726053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566313f8fc0 0x556631455c40 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- 172.21.15.133:0/1881726053 >> 172.21.15.133:0/1881726053 conn(0x5566311f7910 msgr2=0x5566313fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- 172.21.15.133:0/1881726053 shutdown_connections 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.544+0000 7fa6372cf000 1 -- 172.21.15.133:0/1881726053 wait complete. 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 -- start start 2023-12-18T10:25:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 Processor -- start 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 0x5566314a0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x5566314a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x55663143ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663124ae80 con 0x556631442c80 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556631206480 con 0x5566313f8fc0 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55663124c320 con 0x5566314435a0 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 10 client.0 _ll_register_callbacks cb 0x5566311ff710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x5566314a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x5566314a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53420/0 (socket says 172.21.15.133:53420) 2023-12-18T10:25:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 -- 172.21.15.133:0/2776776262 learned_addr learned my addr 172.21.15.133:0/2776776262 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631d09640 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 0x5566314a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa63250a640 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x55663143ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 -- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 msgr2=0x55663143ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x55663143ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 -- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 msgr2=0x5566314a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 0x5566314a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 -- 172.21.15.133:0/2776776262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55663120d250 con 0x556631442c80 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631508640 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x5566314a0c50 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0019e0 tx=0x7fa61c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686d7238b117a131 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa60cff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa60cff9640 1 -- 172.21.15.133:0/2776776262 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c010ee0 con 0x556631442c80 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa60cff9640 1 -- 172.21.15.133:0/2776776262 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa61c01c040 con 0x556631442c80 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 -- 172.21.15.133:0/2776776262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566313fc940 con 0x556631442c80 2023-12-18T10:25:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa60cff9640 1 -- 172.21.15.133:0/2776776262 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa61c014600 con 0x556631442c80 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 10 client.9705 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 -- 172.21.15.133:0/2776776262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x5566311e7110 con 0x556631442c80 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa60cff9640 1 -- 172.21.15.133:0/2776776262 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5566313fc940 con 0x556631442c80 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa60cff9640 1 -- 172.21.15.133:0/2776776262 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fa61c014760 con 0x556631442c80 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 10 client.9705 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 10 client.9705 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 20 client.9705 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55663143f2d0 0x55663143f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 4 client.9705 mds_command: new command op to 9048 tid=0[{"prefix": "scrub resume"}] 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa6372cf000 1 -- 172.21.15.133:0/2776776262 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x5566312116a0 con 0x55663143f2d0 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.548+0000 7fa631d09640 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55663143f2d0 0x55663143f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa631d09640 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55663143f2d0 0x55663143f6e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f52fd52e5c7ca8 server_cookie=ec6dc2c0826691cc in_seq=0 out_seq=0 2023-12-18T10:25:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa60cff9640 10 client.9705 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa60cff9640 1 -- 172.21.15.133:0/2776776262 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5566312116a0 con 0x55663143f2d0 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa60cff9640 10 client.9705 handle_command_reply: tid=0 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 client.9705 shutdown 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 -- 172.21.15.133:0/2776776262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 msgr2=0x5566314a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x5566314a0c50 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0019e0 tx=0x7fa61c001970 comp rx=0 tx=0).stop 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 -- 172.21.15.133:0/2776776262 shutdown_connections 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x55663143f2d0 0x55663143f6e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5566314435a0 0x55663143ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556631442c80 0x5566314a0c50 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 --2- 172.21.15.133:0/2776776262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5566313f8fc0 0x5566314a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 -- 172.21.15.133:0/2776776262 >> 172.21.15.133:0/2776776262 conn(0x5566311f7910 msgr2=0x556631454c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa60cff9640 0 client.9705 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 -- 172.21.15.133:0/2776776262 shutdown_connections 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 1 -- 172.21.15.133:0/2776776262 wait complete. 2023-12-18T10:25:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa6372cf000 20 client.9705 trim_cache size 0 max 16384 2023-12-18T10:25:59.556 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:59.556 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0 2023-12-18T10:25:59.556 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 -- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa610065a60 msgr2=0x7fa610067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa610065a60 0x7fa610067f20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa61c001060 tx=0x7fa61c009040 comp rx=0 tx=0).stop 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 -- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 msgr2=0x7fa62c0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa62c0cd2a0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fa628011960 tx=0x7fa628011e20 comp rx=0 tx=0).stop 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 -- 172.21.15.133:0/3876768606 shutdown_connections 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa610065a60 0x7fa610067f20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa62c1548f0 0x7fa62c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa62c15c080 0x7fa62c1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 --2- 172.21.15.133:0/3876768606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa618005190 0x7fa62c0cd2a0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 -- 172.21.15.133:0/3876768606 >> 172.21.15.133:0/3876768606 conn(0x7fa62c06a2a0 msgr2=0x7fa62c070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 -- 172.21.15.133:0/3876768606 shutdown_connections 2023-12-18T10:25:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.552+0000 7fa633f6d640 1 -- 172.21.15.133:0/3876768606 wait complete. 2023-12-18T10:25:59.571 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2023-12-18T10:25:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe979097640 1 Processor -- start 2023-12-18T10:25:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe979097640 1 -- start start 2023-12-18T10:25:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe979097640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe97406c780 0x7fe9740cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe979097640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9740c9920 con 0x7fe9740cd2c0 2023-12-18T10:25:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe979097640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe974160400 con 0x7fe974070620 2023-12-18T10:25:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe979097640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe974070b20 con 0x7fe97406c780 2023-12-18T10:25:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97359e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe9740cd2c0 0x7fe9740c9210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60994/0 (socket says 172.21.15.133:60994) 2023-12-18T10:25:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97359e640 1 -- 172.21.15.133:0/2739691357 learned_addr learned my addr 172.21.15.133:0/2739691357 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908335642 0 0) 0x7fe9740c9920 con 0x7fe9740cd2c0 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe95c003530 con 0x7fe9740cd2c0 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe972d9d640 1 --2- 172.21.15.133:0/2739691357 >> v2:172.21.15.142:3300/0 conn(0x7fe97406c780 0x7fe9740cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1823495207 0 0) 0x7fe95c003530 con 0x7fe9740cd2c0 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 >> v2:172.21.15.142:3300/0 conn(0x7fe97406c780 msgr2=0x7fe9740cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 --2- 172.21.15.133:0/2739691357 >> v2:172.21.15.142:3300/0 conn(0x7fe97406c780 0x7fe9740cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 >> v1:172.21.15.142:6789/0 conn(0x7fe974070620 legacy=0x7fe97406cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe974070e00 con 0x7fe9740cd2c0 2023-12-18T10:25:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fe96c001a00 con 0x7fe9740cd2c0 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 >> v1:172.21.15.133:6789/0 conn(0x7fe9740cd2c0 legacy=0x7fe9740c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe95c003980 0x7fe95c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe95c0047d0 0x7fe95c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe95c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe974070b20 con 0x7fe95c005190 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c00c0e0 con 0x7fe95c0047d0 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c00c2a0 con 0x7fe95c003980 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe972d9d640 1 --2- 172.21.15.133:0/2739691357 >> v2:172.21.15.142:3300/0 conn(0x7fe97406c780 0x7fe9740cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97359e640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe95c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97259c640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe95c0047d0 0x7fe95c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe972d9d640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe95c003980 0x7fe95c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97359e640 1 -- 172.21.15.133:0/2739691357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe95c003980 msgr2=0x7fe95c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97359e640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe95c003980 0x7fe95c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97359e640 1 -- 172.21.15.133:0/2739691357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe95c0047d0 msgr2=0x7fe95c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97359e640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe95c0047d0 0x7fe95c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.756+0000 7fe97359e640 1 -- 172.21.15.133:0/2739691357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c003530 con 0x7fe95c005190 2023-12-18T10:25:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe97359e640 1 -- 172.21.15.133:0/2739691357 reap_dead start 2023-12-18T10:25:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe97359e640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe95c00b990 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00a830 tx=0x7fe96c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc12757fcfa24ce server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0072d0 con 0x7fe95c005190 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c0a8070 con 0x7fe95c005190 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe971d9b640 1 -- 172.21.15.133:0/2739691357 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0076b0 con 0x7fe95c005190 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe979097640 1 -- 172.21.15.133:0/2739691357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 msgr2=0x7fe95c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe979097640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe95c00b990 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00a830 tx=0x7fe96c01d340 comp rx=0 tx=0).stop 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe979097640 1 -- 172.21.15.133:0/2739691357 shutdown_connections 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe979097640 1 --2- 172.21.15.133:0/2739691357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe95c00b990 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe979097640 1 -- 172.21.15.133:0/2739691357 >> 172.21.15.133:0/2739691357 conn(0x7fe9740cebc0 msgr2=0x7fe9740cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe979097640 1 -- 172.21.15.133:0/2739691357 shutdown_connections 2023-12-18T10:25:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.760+0000 7fe979097640 1 -- 172.21.15.133:0/2739691357 wait complete. 2023-12-18T10:25:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 Processor -- start 2023-12-18T10:25:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 -- start start 2023-12-18T10:25:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe97414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9740aec60 0x7fe9740c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9740af0e0 0x7fe9740c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97415d270 con 0x7fe95c005190 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97415c390 con 0x7fe9740aec60 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97415d9f0 con 0x7fe9740af0e0 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe97414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe97414f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53442/0 (socket says 172.21.15.133:53442) 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 -- 172.21.15.133:0/1073351234 learned_addr learned my addr 172.21.15.133:0/1073351234 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe97259c640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9740aec60 0x7fe9740c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe97359e640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9740af0e0 0x7fe9740c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 -- 172.21.15.133:0/1073351234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9740af0e0 msgr2=0x7fe9740c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9740af0e0 0x7fe9740c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 -- 172.21.15.133:0/1073351234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9740aec60 msgr2=0x7fe9740c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9740aec60 0x7fe9740c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 -- 172.21.15.133:0/1073351234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97415c5f0 con 0x7fe95c005190 2023-12-18T10:25:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe972d9d640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe97414f270 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fe9640115b0 tx=0x7fe964011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe95b7fe640 1 -- 172.21.15.133:0/1073351234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964004440 con 0x7fe95c005190 2023-12-18T10:25:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe95b7fe640 1 -- 172.21.15.133:0/1073351234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe964003620 con 0x7fe95c005190 2023-12-18T10:25:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 -- 172.21.15.133:0/1073351234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97415c8d0 con 0x7fe95c005190 2023-12-18T10:25:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe95b7fe640 1 -- 172.21.15.133:0/1073351234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964003990 con 0x7fe95c005190 2023-12-18T10:25:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.764+0000 7fe979097640 1 -- 172.21.15.133:0/1073351234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97415ce90 con 0x7fe95c005190 2023-12-18T10:25:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.768+0000 7fe95b7fe640 1 -- 172.21.15.133:0/1073351234 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe964003af0 con 0x7fe95c005190 2023-12-18T10:25:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.768+0000 7fe95b7fe640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe960065a90 0x7fe960067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.768+0000 7fe95b7fe640 1 -- 172.21.15.133:0/1073351234 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe9640836f0 con 0x7fe95c005190 2023-12-18T10:25:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.768+0000 7fe97259c640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe960065a90 0x7fe960067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.768+0000 7fe97c40d000 1 Processor -- start 2023-12-18T10:25:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.768+0000 7fe97259c640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe960065a90 0x7fe960067f50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe9740cf9d0 tx=0x7fe968009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.768+0000 7fe97c40d000 1 -- start start 2023-12-18T10:25:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.768+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f0565a0 0x56003f00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 0x56003f00c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003eed4430 con 0x56003f055c80 2023-12-18T10:25:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ee62460 con 0x56003f00bfc0 2023-12-18T10:25:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56003ee5fa30 con 0x56003f0565a0 2023-12-18T10:25:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53458/0 (socket says 172.21.15.133:53458) 2023-12-18T10:25:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 -- 172.21.15.133:0/1562945679 learned_addr learned my addr 172.21.15.133:0/1562945679 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97259c640 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f0565a0 0x56003f00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97359e640 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 0x56003f00c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 -- 172.21.15.133:0/1562945679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f0565a0 msgr2=0x56003f00ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f0565a0 0x56003f00ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 -- 172.21.15.133:0/1562945679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 msgr2=0x56003f00c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 0x56003f00c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 -- 172.21.15.133:0/1562945679 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56003eb57e20 con 0x56003f055c80 2023-12-18T10:25:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe972d9d640 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056060 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fe964054c40 tx=0x7fe964054710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f33cfe3087f05d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe958ff9640 1 -- 172.21.15.133:0/1562945679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96406c1c0 con 0x56003f055c80 2023-12-18T10:25:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe958ff9640 1 -- 172.21.15.133:0/1562945679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe964003da0 con 0x56003f055c80 2023-12-18T10:25:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe958ff9640 1 -- 172.21.15.133:0/1562945679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9640513c0 con 0x56003f055c80 2023-12-18T10:25:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- 172.21.15.133:0/1562945679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 msgr2=0x56003f056060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056060 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fe964054c40 tx=0x7fe964054710 comp rx=0 tx=0).stop 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- 172.21.15.133:0/1562945679 shutdown_connections 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 0x56003f00c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f0565a0 0x56003f00ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- 172.21.15.133:0/1562945679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056060 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- 172.21.15.133:0/1562945679 >> 172.21.15.133:0/1562945679 conn(0x56003ee0a910 msgr2=0x56003f00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- 172.21.15.133:0/1562945679 shutdown_connections 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- 172.21.15.133:0/1562945679 wait complete. 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- start start 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 Processor -- start 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f00bfc0 0x56003f0553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f056ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ee5b320 con 0x56003f055c80 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003edfa4f0 con 0x56003f0565a0 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56003ee186e0 con 0x56003f00bfc0 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.772+0000 7fe97c40d000 10 client.0 _ll_register_callbacks cb 0x56003eff7980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f00bfc0 0x56003f0553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f00bfc0 0x56003f0553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:36696/0 (socket says 172.21.15.133:36696) 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 -- 172.21.15.133:0/2238690358 learned_addr learned my addr 172.21.15.133:0/2238690358 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97359e640 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f056ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 -- 172.21.15.133:0/2238690358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 msgr2=0x56003f056ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f056ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 -- 172.21.15.133:0/2238690358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 msgr2=0x56003f056980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 -- 172.21.15.133:0/2238690358 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97415ce90 con 0x56003f00bfc0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97259c640 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe972d9d640 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f00bfc0 0x56003f0553d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe964058bf0 tx=0x7fe964011f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d5851dd6d6cc4c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 10 client.0 ms_handle_connect on v2:172.21.15.142:3301/0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 1 -- 172.21.15.133:0/2238690358 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96405c750 con 0x56003f00bfc0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 1 -- 172.21.15.133:0/2238690358 <== mon.2 v2:172.21.15.142:3301/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe96405c8b0 con 0x56003f00bfc0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 -- 172.21.15.133:0/2238690358 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56003ee18120 con 0x56003f00bfc0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 1 -- 172.21.15.133:0/2238690358 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe964050aa0 con 0x56003f00bfc0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 10 client.8021 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 -- 172.21.15.133:0/2238690358 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x56003ee20250 con 0x56003f00bfc0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 1 -- 172.21.15.133:0/2238690358 <== mon.2 v2:172.21.15.142:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56003ee18120 con 0x56003f00bfc0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 1 -- 172.21.15.133:0/2238690358 <== mon.2 v2:172.21.15.142:3301/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe964050c00 con 0x56003f00bfc0 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 10 client.8021 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:59.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 10 client.8021 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 20 client.8021 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56003f0578d0 0x56003f057ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 4 client.8021 mds_command: new command op to 9042 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 -- 172.21.15.133:0/2238690358 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56003ee59c70 con 0x56003f0578d0 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97259c640 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56003f0578d0 0x56003f057ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97259c640 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56003f0578d0 0x56003f057ce0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=68354582e1f9d401 server_cookie=12102416fb2287d4 in_seq=0 out_seq=0 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 10 client.8021 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 1 -- 172.21.15.133:0/2238690358 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56003ee59c70 con 0x56003f0578d0 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 10 client.8021 handle_command_reply: tid=0 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 client.8021 shutdown 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 -- 172.21.15.133:0/2238690358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f00bfc0 msgr2=0x56003f0553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f00bfc0 0x56003f0553d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe964058bf0 tx=0x7fe964011f70 comp rx=0 tx=0).stop 2023-12-18T10:25:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 -- 172.21.15.133:0/2238690358 shutdown_connections 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56003f0578d0 0x56003f057ce0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f056ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f055c80 0x56003f056980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe951ffb640 0 client.8021 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 --2- 172.21.15.133:0/2238690358 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f00bfc0 0x56003f0553d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 -- 172.21.15.133:0/2238690358 >> 172.21.15.133:0/2238690358 conn(0x56003ee0a910 msgr2=0x56003f00aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 -- 172.21.15.133:0/2238690358 shutdown_connections 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 1 -- 172.21.15.133:0/2238690358 wait complete. 2023-12-18T10:25:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.776+0000 7fe97c40d000 20 client.8021 trim_cache size 0 max 16384 2023-12-18T10:25:59.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97c40d000 1 Processor -- start 2023-12-18T10:25:59.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97c40d000 1 -- start start 2023-12-18T10:25:59.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 0x56003f054040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 0x56003f054580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f0565a0 0x56003f065fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97c40d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003eb18aa0 con 0x56003f0565a0 2023-12-18T10:25:59.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97c40d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ee56c90 con 0x56003f00bfc0 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97c40d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56003ee9e4d0 con 0x56003f055c80 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f0565a0 0x56003f065fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f0565a0 0x56003f065fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53468/0 (socket says 172.21.15.133:53468) 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 -- 172.21.15.133:0/3737252141 learned_addr learned my addr 172.21.15.133:0/3737252141 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe972d9d640 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 0x56003f054040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97259c640 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 0x56003f054580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 -- 172.21.15.133:0/3737252141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 msgr2=0x56003f054580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 0x56003f054580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 -- 172.21.15.133:0/3737252141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 msgr2=0x56003f054040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 0x56003f054040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 -- 172.21.15.133:0/3737252141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56003ee065a0 con 0x56003f0565a0 2023-12-18T10:25:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe97359e640 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f0565a0 0x56003f065fa0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fe96c01dbe0 tx=0x7fe96c001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee21ede3b28df4a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe9597fa640 1 -- 172.21.15.133:0/3737252141 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c001260 con 0x56003f0565a0 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe9597fa640 1 -- 172.21.15.133:0/3737252141 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c004b70 con 0x56003f0565a0 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.792+0000 7fe9597fa640 1 -- 172.21.15.133:0/3737252141 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0017c0 con 0x56003f0565a0 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- 172.21.15.133:0/3737252141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f0565a0 msgr2=0x56003f065fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f0565a0 0x56003f065fa0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fe96c01dbe0 tx=0x7fe96c001d90 comp rx=0 tx=0).stop 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- 172.21.15.133:0/3737252141 shutdown_connections 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f0565a0 0x56003f065fa0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 0x56003f054580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3737252141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f00bfc0 0x56003f054040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- 172.21.15.133:0/3737252141 >> 172.21.15.133:0/3737252141 conn(0x56003ee0a910 msgr2=0x56003f0625c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- 172.21.15.133:0/3737252141 shutdown_connections 2023-12-18T10:25:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- 172.21.15.133:0/3737252141 wait complete. 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- start start 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 Processor -- start 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f00bfc0 0x56003f0971b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 0x56003f0976f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f097c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ee19480 con 0x56003f00bfc0 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003f00bae0 con 0x56003f0565a0 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x56003ee58720 con 0x56003f055c80 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 10 client.0 _ll_register_callbacks cb 0x56003ee12710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f00bfc0 0x56003f0971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f00bfc0 0x56003f0971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53472/0 (socket says 172.21.15.133:53472) 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 -- 172.21.15.133:0/3844646241 learned_addr learned my addr 172.21.15.133:0/3844646241 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97359e640 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f097c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97259c640 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 0x56003f0976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 -- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 msgr2=0x56003f0976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 0x56003f0976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 -- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 msgr2=0x56003f097c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f097c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 -- 172.21.15.133:0/3844646241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c003530 con 0x56003f00bfc0 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97359e640 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f097c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe972d9d640 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f00bfc0 0x56003f0971b0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fe96405c6b0 tx=0x7fe964004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a404aa0a4c5efa52 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe951ffb640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe951ffb640 1 -- 172.21.15.133:0/3844646241 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964054610 con 0x56003f00bfc0 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe951ffb640 1 -- 172.21.15.133:0/3844646241 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe964058a30 con 0x56003f00bfc0 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- 172.21.15.133:0/3844646241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56003f00f940 con 0x56003f00bfc0 2023-12-18T10:25:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe951ffb640 1 -- 172.21.15.133:0/3844646241 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe964050ff0 con 0x56003f00bfc0 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 10 client.9723 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- 172.21.15.133:0/3844646241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x56003edfa110 con 0x56003f00bfc0 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe951ffb640 1 -- 172.21.15.133:0/3844646241 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56003f00f940 con 0x56003f00bfc0 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe951ffb640 1 -- 172.21.15.133:0/3844646241 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe964063020 con 0x56003f00bfc0 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 10 client.9723 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 10 client.9723 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 20 client.9723 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56003f098170 0x56003f098550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 4 client.9723 mds_command: new command op to 9042 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97c40d000 1 -- 172.21.15.133:0/3844646241 --> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56003ee246a0 con 0x56003f098170 2023-12-18T10:25:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.796+0000 7fe97259c640 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56003f098170 0x56003f098550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97259c640 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56003f098170 0x56003f098550 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6890d84c58c7468 server_cookie=5260e87266f723b2 in_seq=0 out_seq=0 2023-12-18T10:25:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe951ffb640 10 client.9723 ms_handle_connect on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe951ffb640 1 -- 172.21.15.133:0/3844646241 <== mds.1 v2:172.21.15.133:6835/1840110844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x56003ee246a0 con 0x56003f098170 2023-12-18T10:25:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe951ffb640 10 client.9723 handle_command_reply: tid=0 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 client.9723 shutdown 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 -- 172.21.15.133:0/3844646241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f00bfc0 msgr2=0x56003f0971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f00bfc0 0x56003f0971b0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fe96405c6b0 tx=0x7fe964004620 comp rx=0 tx=0).stop 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 -- 172.21.15.133:0/3844646241 shutdown_connections 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.133:6835/1840110844,v1:172.21.15.133:6837/1840110844] conn(0x56003f098170 0x56003f098550 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56003f0565a0 0x56003f097c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x56003f055c80 0x56003f0976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 --2- 172.21.15.133:0/3844646241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56003f00bfc0 0x56003f0971b0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe951ffb640 0 client.9723 ms_handle_reset on v2:172.21.15.133:6835/1840110844 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 -- 172.21.15.133:0/3844646241 >> 172.21.15.133:0/3844646241 conn(0x56003ee0a910 msgr2=0x56003f062cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 -- 172.21.15.133:0/3844646241 shutdown_connections 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 1 -- 172.21.15.133:0/3844646241 wait complete. 2023-12-18T10:25:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe97c40d000 20 client.9723 trim_cache size 0 max 16384 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:25:59.805 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:25:59.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 -- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe960065a90 msgr2=0x7fe960067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe960065a90 0x7fe960067f50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe9740cf9d0 tx=0x7fe968009040 comp rx=0 tx=0).stop 2023-12-18T10:25:59.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 -- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 msgr2=0x7fe97414f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe97414f270 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fe9640115b0 tx=0x7fe964011a70 comp rx=0 tx=0).stop 2023-12-18T10:25:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 -- 172.21.15.133:0/1073351234 shutdown_connections 2023-12-18T10:25:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe960065a90 0x7fe960067f50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9740af0e0 0x7fe9740c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9740aec60 0x7fe9740c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 --2- 172.21.15.133:0/1073351234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe95c005190 0x7fe97414f270 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 -- 172.21.15.133:0/1073351234 >> 172.21.15.133:0/1073351234 conn(0x7fe9740cebc0 msgr2=0x7fe97415f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 -- 172.21.15.133:0/1073351234 shutdown_connections 2023-12-18T10:25:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.800+0000 7fe979097640 1 -- 172.21.15.133:0/1073351234 wait complete. 2023-12-18T10:25:59.819 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:25:59.819 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2023-12-18T10:25:59.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.956+0000 7f6703109640 1 Processor -- start 2023-12-18T10:25:59.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.956+0000 7f6703109640 1 -- start start 2023-12-18T10:25:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f6703109640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f66fc0ca410 0x7f66fc159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f6703109640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc159fb0 0x7f66fc071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f6703109640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66fc071db0 0x7f66fc0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f6703109640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc15aab0 con 0x7f66fc071db0 2023-12-18T10:25:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f6703109640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc070df0 con 0x7f66fc0ca410 2023-12-18T10:25:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f6703109640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc15a4f0 con 0x7f66fc159fb0 2023-12-18T10:25:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f67016a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66fc071db0 0x7f66fc0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f67016a6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66fc071db0 0x7f66fc0cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38412/0 (socket says 172.21.15.133:38412) 2023-12-18T10:25:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f67016a6640 1 -- 172.21.15.133:0/1960809468 learned_addr learned my addr 172.21.15.133:0/1960809468 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f66f3fff640 1 --2- 172.21.15.133:0/1960809468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc159fb0 0x7f66fc071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f6700ea5640 1 --2- 172.21.15.133:0/1960809468 >> v2:172.21.15.142:3300/0 conn(0x7f66fc0ca410 0x7f66fc159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f67016a6640 1 -- 172.21.15.133:0/1960809468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc159fb0 msgr2=0x7f66fc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f67016a6640 1 --2- 172.21.15.133:0/1960809468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc159fb0 0x7f66fc071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f67016a6640 1 -- 172.21.15.133:0/1960809468 >> v2:172.21.15.142:3300/0 conn(0x7f66fc0ca410 msgr2=0x7f66fc159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f67016a6640 1 --2- 172.21.15.133:0/1960809468 >> v2:172.21.15.142:3300/0 conn(0x7f66fc0ca410 0x7f66fc159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f67016a6640 1 -- 172.21.15.133:0/1960809468 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc15a7d0 con 0x7f66fc071db0 2023-12-18T10:25:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f66f3fff640 1 --2- 172.21.15.133:0/1960809468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc159fb0 0x7f66fc071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.960+0000 7f6700ea5640 1 --2- 172.21.15.133:0/1960809468 >> v2:172.21.15.142:3300/0 conn(0x7f66fc0ca410 0x7f66fc159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:25:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f67016a6640 1 --2- 172.21.15.133:0/1960809468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0cbff0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0cbfa0 tx=0x7f66f401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec57ca893e1fc13 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f66f37fe640 1 -- 172.21.15.133:0/1960809468 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40a5730 con 0x7f66fc071db0 2023-12-18T10:25:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f66f37fe640 1 -- 172.21.15.133:0/1960809468 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f40a5890 con 0x7f66fc071db0 2023-12-18T10:25:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f66f37fe640 1 -- 172.21.15.133:0/1960809468 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40a5c20 con 0x7f66fc071db0 2023-12-18T10:25:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 -- 172.21.15.133:0/1960809468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 msgr2=0x7f66fc0cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 --2- 172.21.15.133:0/1960809468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0cbff0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f66fc0cbfa0 tx=0x7f66f401c9a0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 -- 172.21.15.133:0/1960809468 shutdown_connections 2023-12-18T10:25:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 --2- 172.21.15.133:0/1960809468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0cbff0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 --2- 172.21.15.133:0/1960809468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc159fb0 0x7f66fc071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 --2- 172.21.15.133:0/1960809468 >> v2:172.21.15.142:3300/0 conn(0x7f66fc0ca410 0x7f66fc159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 -- 172.21.15.133:0/1960809468 >> 172.21.15.133:0/1960809468 conn(0x7f66fc06a2a0 msgr2=0x7f66fc0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 -- 172.21.15.133:0/1960809468 shutdown_connections 2023-12-18T10:25:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 -- 172.21.15.133:0/1960809468 wait complete. 2023-12-18T10:25:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 Processor -- start 2023-12-18T10:25:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.964+0000 7f6703109640 1 -- start start 2023-12-18T10:25:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6703109640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6703109640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc0ca410 0x7f66fc0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6703109640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc159fb0 0x7f66fc1f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6703109640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc1f80a0 con 0x7f66fc071db0 2023-12-18T10:25:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6703109640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc152bc0 con 0x7f66fc159fb0 2023-12-18T10:25:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6703109640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc152ea0 con 0x7f66fc0ca410 2023-12-18T10:25:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0c15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38416/0 (socket says 172.21.15.133:38416) 2023-12-18T10:25:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 -- 172.21.15.133:0/590898334 learned_addr learned my addr 172.21.15.133:0/590898334 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f66f3fff640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc0ca410 0x7f66fc0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f67016a6640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc159fb0 0x7f66fc1f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 -- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc0ca410 msgr2=0x7f66fc0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc0ca410 0x7f66fc0ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 -- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc159fb0 msgr2=0x7f66fc1f4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc159fb0 0x7f66fc1f4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 -- 172.21.15.133:0/590898334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009b30 con 0x7f66fc071db0 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f66f3fff640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc0ca410 0x7f66fc0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6700ea5640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0c15b0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f66f800c7c0 tx=0x7f66f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f66f17fa640 1 -- 172.21.15.133:0/590898334 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8007a30 con 0x7f66fc071db0 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f66f17fa640 1 -- 172.21.15.133:0/590898334 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f8007b90 con 0x7f66fc071db0 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f66f17fa640 1 -- 172.21.15.133:0/590898334 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800ce70 con 0x7f66fc071db0 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6703109640 1 -- 172.21.15.133:0/590898334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc153180 con 0x7f66fc071db0 2023-12-18T10:25:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.968+0000 7f6703109640 1 -- 172.21.15.133:0/590898334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc0acda0 con 0x7f66fc071db0 2023-12-18T10:25:59.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f66f17fa640 1 -- 172.21.15.133:0/590898334 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f66f80113f0 con 0x7f66fc071db0 2023-12-18T10:25:59.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f66f17fa640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66e8065a90 0x7f66e8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f66f17fa640 1 -- 172.21.15.133:0/590898334 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66f8083650 con 0x7f66fc071db0 2023-12-18T10:25:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f66f3fff640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66e8065a90 0x7f66e8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6706469000 1 Processor -- start 2023-12-18T10:25:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6706469000 1 -- start start 2023-12-18T10:25:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f66f3fff640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66e8065a90 0x7f66e8067f50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f66ec006fd0 tx=0x7f66ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6706469000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b206c80 0x55dc4b207060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6706469000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 0x55dc4b1bca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6706469000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b1bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6706469000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b085430 con 0x55dc4b1bcfc0 2023-12-18T10:25:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6706469000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b013460 con 0x55dc4b206c80 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6706469000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b010a30 con 0x55dc4b2075a0 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b1bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 0x55dc4b1bca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b1bd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38424/0 (socket says 172.21.15.133:38424) 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 -- 172.21.15.133:0/878576709 learned_addr learned my addr 172.21.15.133:0/878576709 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6700ea5640 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b206c80 0x55dc4b207060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 -- 172.21.15.133:0/878576709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 msgr2=0x55dc4b1bca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 0x55dc4b1bca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 -- 172.21.15.133:0/878576709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b206c80 msgr2=0x55dc4b207060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b206c80 0x55dc4b207060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 -- 172.21.15.133:0/878576709 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc4ad08e20 con 0x55dc4b1bcfc0 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f6700ea5640 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b206c80 0x55dc4b207060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:25:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.972+0000 7f67016a6640 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b1bd3a0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f66f40af040 tx=0x7f66f4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aef4a4a5c304860 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66e27fc640 1 -- 172.21.15.133:0/878576709 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40a5c00 con 0x55dc4b1bcfc0 2023-12-18T10:25:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66e27fc640 1 -- 172.21.15.133:0/878576709 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f40a5d80 con 0x55dc4b1bcfc0 2023-12-18T10:25:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66e27fc640 1 -- 172.21.15.133:0/878576709 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f40b6630 con 0x55dc4b1bcfc0 2023-12-18T10:25:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- 172.21.15.133:0/878576709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b1bcfc0 msgr2=0x55dc4b1bd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b1bd3a0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f66f40af040 tx=0x7f66f4004ac0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- 172.21.15.133:0/878576709 shutdown_connections 2023-12-18T10:25:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b1bd3a0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 0x55dc4b1bca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 --2- 172.21.15.133:0/878576709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b206c80 0x55dc4b207060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- 172.21.15.133:0/878576709 >> 172.21.15.133:0/878576709 conn(0x55dc4afbb910 msgr2=0x55dc4b1bb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- 172.21.15.133:0/878576709 shutdown_connections 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- 172.21.15.133:0/878576709 wait complete. 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- start start 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 Processor -- start 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b20deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 0x55dc4b207980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b00c320 con 0x55dc4b206c80 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4afab4f0 con 0x55dc4b1bcfc0 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc4afc96e0 con 0x55dc4b2075a0 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6706469000 10 client.0 _ll_register_callbacks cb 0x55dc4b1a8980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:25:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f6700ea5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b20deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38428/0 (socket says 172.21.15.133:38428) 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 -- 172.21.15.133:0/3743847865 learned_addr learned my addr 172.21.15.133:0/3743847865 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f67016a6640 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 0x55dc4b207980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 -- 172.21.15.133:0/3743847865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 msgr2=0x55dc4b207980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 0x55dc4b207980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 -- 172.21.15.133:0/3743847865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b1bcfc0 msgr2=0x55dc4b20deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b20deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 -- 172.21.15.133:0/3743847865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc0acda0 con 0x55dc4b206c80 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66f3fff640 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20e3f0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f66fc1f7ed0 tx=0x7f66ec0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd288fde2f5be529 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.976+0000 7f66db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 1 -- 172.21.15.133:0/3743847865 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec0159a0 con 0x55dc4b206c80 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 1 -- 172.21.15.133:0/3743847865 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66ec015b00 con 0x55dc4b206c80 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 -- 172.21.15.133:0/3743847865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc4afc9120 con 0x55dc4b206c80 2023-12-18T10:25:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 1 -- 172.21.15.133:0/3743847865 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66ec015cc0 con 0x55dc4b206c80 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 10 client.9735 fetch_fsmap learned FSMap version 113 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 -- 172.21.15.133:0/3743847865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x7f66fc15a7d0 con 0x55dc4b206c80 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 1 -- 172.21.15.133:0/3743847865 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc4afc9120 con 0x55dc4b206c80 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 1 -- 172.21.15.133:0/3743847865 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f66ec02a440 con 0x55dc4b206c80 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 10 client.9735 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 10 client.9735 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 20 client.9735 populate_metadata read hostname 'smithi133' 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55dc4b208720 0x55dc4b208b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 4 client.9735 mds_command: new command op to 9039 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 -- 172.21.15.133:0/3743847865 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc4b00ac70 con 0x55dc4b208720 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6700ea5640 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55dc4b208720 0x55dc4b208b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6700ea5640 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55dc4b208720 0x55dc4b208b00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b79603ced56e00 server_cookie=5c3efc7965688cd7 in_seq=0 out_seq=0 2023-12-18T10:25:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 10 client.9735 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 1 -- 172.21.15.133:0/3743847865 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55dc4b00ac70 con 0x55dc4b208720 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 10 client.9735 handle_command_reply: tid=0 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 client.9735 shutdown 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 -- 172.21.15.133:0/3743847865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 msgr2=0x55dc4b20e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20e3f0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f66fc1f7ed0 tx=0x7f66ec0046d0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 -- 172.21.15.133:0/3743847865 shutdown_connections 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55dc4b208720 0x55dc4b208b00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b2075a0 0x55dc4b207980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20e3f0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f66db7fe640 0 client.9735 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:25:59.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 --2- 172.21.15.133:0/3743847865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b1bcfc0 0x55dc4b20deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 -- 172.21.15.133:0/3743847865 >> 172.21.15.133:0/3743847865 conn(0x55dc4afbb910 msgr2=0x55dc4b1bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:25:59.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 -- 172.21.15.133:0/3743847865 shutdown_connections 2023-12-18T10:25:59.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 1 -- 172.21.15.133:0/3743847865 wait complete. 2023-12-18T10:25:59.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.980+0000 7f6706469000 20 client.9735 trim_cache size 0 max 16384 2023-12-18T10:25:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 Processor -- start 2023-12-18T10:25:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- start start 2023-12-18T10:25:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b2066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 0x55dc4b20c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:25:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4acc9aa0 con 0x55dc4b206c80 2023-12-18T10:25:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4afca480 con 0x55dc4b2075a0 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b009720 con 0x55dc4b1bcfc0 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38430/0 (socket says 172.21.15.133:38430) 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 -- 172.21.15.133:0/2181191197 learned_addr learned my addr 172.21.15.133:0/2181191197 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6700ea5640 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b2066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f67016a6640 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 0x55dc4b20c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 -- 172.21.15.133:0/2181191197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 msgr2=0x55dc4b2066a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b2066a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 -- 172.21.15.133:0/2181191197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 msgr2=0x55dc4b20c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 0x55dc4b20c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 -- 172.21.15.133:0/2181191197 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc4afd1250 con 0x55dc4b206c80 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66f3fff640 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20bb20 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f66ec006f90 tx=0x7f66ec022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f23fbb84a3b5d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:25:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66e2ffd640 1 -- 172.21.15.133:0/2181191197 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec014e80 con 0x55dc4b206c80 2023-12-18T10:25:59.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66e2ffd640 1 -- 172.21.15.133:0/2181191197 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ec038070 con 0x55dc4b206c80 2023-12-18T10:25:59.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f66e2ffd640 1 -- 172.21.15.133:0/2181191197 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec02a9a0 con 0x55dc4b206c80 2023-12-18T10:25:59.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- 172.21.15.133:0/2181191197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 msgr2=0x55dc4b20bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20bb20 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f66ec006f90 tx=0x7f66ec022000 comp rx=0 tx=0).stop 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- 172.21.15.133:0/2181191197 shutdown_connections 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 0x55dc4b20c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b20bb20 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 --2- 172.21.15.133:0/2181191197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b2066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- 172.21.15.133:0/2181191197 >> 172.21.15.133:0/2181191197 conn(0x55dc4afbb910 msgr2=0x55dc4b1c2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- 172.21.15.133:0/2181191197 shutdown_connections 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:25:59.996+0000 7f6706469000 1 -- 172.21.15.133:0/2181191197 wait complete. 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 -- start start 2023-12-18T10:26:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 Processor -- start 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b264300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b264840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 0x55dc4b202c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b0c3e50 con 0x55dc4b206c80 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b064bb0 con 0x55dc4b2075a0 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc4afb1cf0 con 0x55dc4b1bcfc0 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 10 client.0 _ll_register_callbacks cb 0x55dc4afc3710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b264840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6700ea5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b264300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b264840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38446/0 (socket says 172.21.15.133:38446) 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6700ea5640 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b264300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:41982/0 (socket says 172.21.15.133:41982) 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 -- 172.21.15.133:0/1287804468 learned_addr learned my addr 172.21.15.133:0/1287804468 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f67016a6640 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 0x55dc4b202c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 -- 172.21.15.133:0/1287804468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 msgr2=0x55dc4b264300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b264300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 -- 172.21.15.133:0/1287804468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 msgr2=0x55dc4b202c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 0x55dc4b202c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 -- 172.21.15.133:0/1287804468 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc15a7d0 con 0x55dc4b206c80 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66f3fff640 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b264840 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f66ec000c10 tx=0x7f66ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e029db803b25c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66db7fe640 1 -- 172.21.15.133:0/1287804468 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec014e80 con 0x55dc4b206c80 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66db7fe640 1 -- 172.21.15.133:0/1287804468 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66ec02a440 con 0x55dc4b206c80 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 -- 172.21.15.133:0/1287804468 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc4b1c0940 con 0x55dc4b206c80 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f66db7fe640 1 -- 172.21.15.133:0/1287804468 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66ec02abe0 con 0x55dc4b206c80 2023-12-18T10:26:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 10 client.9741 fetch_fsmap learned FSMap version 113 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.000+0000 7f6706469000 1 -- 172.21.15.133:0/1287804468 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x55dc4afb75a0 con 0x55dc4b206c80 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f66db7fe640 1 -- 172.21.15.133:0/1287804468 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc4b1c0940 con 0x55dc4b206c80 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f66db7fe640 1 -- 172.21.15.133:0/1287804468 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f66ec0157a0 con 0x55dc4b206c80 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 10 client.9741 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 10 client.9741 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.c 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 20 client.9741 populate_metadata read hostname 'smithi133' 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55dc4b203190 0x55dc4b203570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 4 client.9741 mds_command: new command op to 9039 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 -- 172.21.15.133:0/1287804468 --> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dc4afd56a0 con 0x55dc4b203190 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6700ea5640 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55dc4b203190 0x55dc4b203570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f66db7fe640 10 client.9741 ms_handle_connect on v2:172.21.15.133:6834/3153614779 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6700ea5640 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55dc4b203190 0x55dc4b203570 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa4d0494439f234f server_cookie=d5031aa4298b0a64 in_seq=0 out_seq=0 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f66db7fe640 1 -- 172.21.15.133:0/1287804468 <== mds.2 v2:172.21.15.133:6834/3153614779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55dc4afd56a0 con 0x55dc4b203190 2023-12-18T10:26:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f66db7fe640 10 client.9741 handle_command_reply: tid=0 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 client.9741 shutdown 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 -- 172.21.15.133:0/1287804468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 msgr2=0x55dc4b264840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b264840 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f66ec000c10 tx=0x7f66ec016000 comp rx=0 tx=0).stop 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 -- 172.21.15.133:0/1287804468 shutdown_connections 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.133:6834/3153614779,v1:172.21.15.133:6836/3153614779] conn(0x55dc4b203190 0x55dc4b203570 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc4b2075a0 0x55dc4b202c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55dc4b206c80 0x55dc4b264840 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 --2- 172.21.15.133:0/1287804468 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55dc4b1bcfc0 0x55dc4b264300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f66db7fe640 0 client.9741 ms_handle_reset on v2:172.21.15.133:6834/3153614779 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 -- 172.21.15.133:0/1287804468 >> 172.21.15.133:0/1287804468 conn(0x55dc4afbb910 msgr2=0x55dc4b20ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 -- 172.21.15.133:0/1287804468 shutdown_connections 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 1 -- 172.21.15.133:0/1287804468 wait complete. 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6706469000 20 client.9741 trim_cache size 0 max 16384 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:26:00.009 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:26:00.010 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:26:00.010 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:26:00.010 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 -- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66e8065a90 msgr2=0x7f66e8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66e8065a90 0x7f66e8067f50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f66ec006fd0 tx=0x7f66ec008040 comp rx=0 tx=0).stop 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 -- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 msgr2=0x7f66fc0c15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0c15b0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f66f800c7c0 tx=0x7f66f800cc80 comp rx=0 tx=0).stop 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 -- 172.21.15.133:0/590898334 shutdown_connections 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66e8065a90 0x7f66e8067f50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66fc159fb0 0x7f66fc1f4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f66fc0ca410 0x7f66fc0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 --2- 172.21.15.133:0/590898334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66fc071db0 0x7f66fc0c15b0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 -- 172.21.15.133:0/590898334 >> 172.21.15.133:0/590898334 conn(0x7f66fc06a2a0 msgr2=0x7f66fc157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 -- 172.21.15.133:0/590898334 shutdown_connections 2023-12-18T10:26:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.004+0000 7f6703109640 1 -- 172.21.15.133:0/590898334 wait complete. 2023-12-18T10:26:00.024 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:26:00.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-12-18T10:26:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7b59c0640 1 Processor -- start 2023-12-18T10:26:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7b59c0640 1 -- start start 2023-12-18T10:26:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7b59c0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7b00ca410 0x7fb7b0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7b59c0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b0070df0 con 0x7fb7b00cbff0 2023-12-18T10:26:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7b59c0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b015a4f0 con 0x7fb7b0159fb0 2023-12-18T10:26:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7b59c0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b015aab0 con 0x7fb7b00ca410 2023-12-18T10:26:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7af7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb7b00cbff0 0x7fb7b00ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44454/0 (socket says 172.21.15.133:44454) 2023-12-18T10:26:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2494314785 learned_addr learned my addr 172.21.15.133:0/2494314785 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/2494314785 >> v2:172.21.15.142:3300/0 conn(0x7fb7b00ca410 0x7fb7b0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7ae7fc640 1 -- 172.21.15.133:0/2494314785 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771934906 0 0) 0x7fb7b0070df0 con 0x7fb7b00cbff0 2023-12-18T10:26:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7ae7fc640 1 -- 172.21.15.133:0/2494314785 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb79c003530 con 0x7fb7b00cbff0 2023-12-18T10:26:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7ae7fc640 1 -- 172.21.15.133:0/2494314785 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2007258055 0 0) 0x7fb79c003530 con 0x7fb7b00cbff0 2023-12-18T10:26:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7aeffd640 1 -- 172.21.15.133:0/2494314785 >> v1:172.21.15.142:6789/0 conn(0x7fb7b0159fb0 legacy=0x7fb7b0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7aeffd640 1 -- 172.21.15.133:0/2494314785 >> v1:172.21.15.133:6789/0 conn(0x7fb7b00cbff0 legacy=0x7fb7b00ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.168+0000 7fb7aeffd640 1 -- 172.21.15.133:0/2494314785 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b015a7d0 con 0x7fb7b00ca410 2023-12-18T10:26:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/2494314785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00ca410 0x7fb7b0159a70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00097c0 tx=0x7fb7a001c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbdbc6fa445d8864 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7ae7fc640 1 -- 172.21.15.133:0/2494314785 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8001a00 con 0x7fb7b00ca410 2023-12-18T10:26:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7ae7fc640 1 -- 172.21.15.133:0/2494314785 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a00a7050 con 0x7fb7b00ca410 2023-12-18T10:26:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7ae7fc640 1 -- 172.21.15.133:0/2494314785 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a00ab620 con 0x7fb7b00ca410 2023-12-18T10:26:00.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7b59c0640 1 -- 172.21.15.133:0/2494314785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00ca410 msgr2=0x7fb7b0159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7b59c0640 1 --2- 172.21.15.133:0/2494314785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00ca410 0x7fb7b0159a70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00097c0 tx=0x7fb7a001c250 comp rx=0 tx=0).stop 2023-12-18T10:26:00.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7b59c0640 1 -- 172.21.15.133:0/2494314785 shutdown_connections 2023-12-18T10:26:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7b59c0640 1 --2- 172.21.15.133:0/2494314785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00ca410 0x7fb7b0159a70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7b59c0640 1 -- 172.21.15.133:0/2494314785 >> 172.21.15.133:0/2494314785 conn(0x7fb7b006a2a0 msgr2=0x7fb7b00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7b59c0640 1 -- 172.21.15.133:0/2494314785 shutdown_connections 2023-12-18T10:26:00.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.172+0000 7fb7b59c0640 1 -- 172.21.15.133:0/2494314785 wait complete. 2023-12-18T10:26:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 Processor -- start 2023-12-18T10:26:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 -- start start 2023-12-18T10:26:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7b00ca410 0x7fb7b00c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00cbff0 0x7fb7b00c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b0159fb0 0x7fb7b00c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00c7400 con 0x7fb7b0159fb0 2023-12-18T10:26:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b0155400 con 0x7fb7b00cbff0 2023-12-18T10:26:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b00c21c0 con 0x7fb7b00ca410 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b0159fb0 0x7fb7b00c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b0159fb0 0x7fb7b00c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38454/0 (socket says 172.21.15.133:38454) 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 -- 172.21.15.133:0/948501015 learned_addr learned my addr 172.21.15.133:0/948501015 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7a7fff640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00cbff0 0x7fb7b00c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7b00ca410 0x7fb7b00c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 -- 172.21.15.133:0/948501015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7b00ca410 msgr2=0x7fb7b00c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7b00ca410 0x7fb7b00c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 -- 172.21.15.133:0/948501015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00cbff0 msgr2=0x7fb7b00c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00cbff0 0x7fb7b00c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 -- 172.21.15.133:0/948501015 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a0009420 con 0x7fb7b0159fb0 2023-12-18T10:26:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b0159fb0 0x7fb7b00c4490 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800caf0 tx=0x7fb7a8002110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7acff9640 1 -- 172.21.15.133:0/948501015 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800a730 con 0x7fb7b0159fb0 2023-12-18T10:26:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7acff9640 1 -- 172.21.15.133:0/948501015 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a800a8b0 con 0x7fb7b0159fb0 2023-12-18T10:26:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 -- 172.21.15.133:0/948501015 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b01f2310 con 0x7fb7b0159fb0 2023-12-18T10:26:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7acff9640 1 -- 172.21.15.133:0/948501015 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800ac60 con 0x7fb7b0159fb0 2023-12-18T10:26:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.176+0000 7fb7b59c0640 1 -- 172.21.15.133:0/948501015 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b00c5a90 con 0x7fb7b0159fb0 2023-12-18T10:26:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.180+0000 7fb7acff9640 1 -- 172.21.15.133:0/948501015 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb7a80070d0 con 0x7fb7b0159fb0 2023-12-18T10:26:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.180+0000 7fb7acff9640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb790065a90 0x7fb790067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.180+0000 7fb7acff9640 1 -- 172.21.15.133:0/948501015 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb7a80828b0 con 0x7fb7b0159fb0 2023-12-18T10:26:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.180+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb790065a90 0x7fb790067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.180+0000 7fb7b8d2f000 1 Processor -- start 2023-12-18T10:26:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.180+0000 7fb7b8d2f000 1 -- start start 2023-12-18T10:26:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.180+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb790065a90 0x7fb790067f50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00ad000 tx=0x7fb7a00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f1c80 0x562b5c4f2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4a7fc0 0x562b5c4a83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5c370430 con 0x562b5c4f25a0 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5c2fe460 con 0x562b5c4a7fc0 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b5c2fba30 con 0x562b5c4f1c80 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7aeffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f1c80 0x562b5c4f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4a7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38470/0 (socket says 172.21.15.133:38470) 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 -- 172.21.15.133:0/2740374628 learned_addr learned my addr 172.21.15.133:0/2740374628 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/2740374628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4a7fc0 0x562b5c4a83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 -- 172.21.15.133:0/2740374628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f1c80 msgr2=0x562b5c4f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 --2- 172.21.15.133:0/2740374628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f1c80 0x562b5c4f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 -- 172.21.15.133:0/2740374628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4a7fc0 msgr2=0x562b5c4a83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 --2- 172.21.15.133:0/2740374628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4a7fc0 0x562b5c4a83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 -- 172.21.15.133:0/2740374628 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b5bff3e20 con 0x562b5c4f25a0 2023-12-18T10:26:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a7fff640 1 --2- 172.21.15.133:0/2740374628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4a7a80 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb798011570 tx=0x7fb798011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96696dd0edae173e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a57fa640 1 -- 172.21.15.133:0/2740374628 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb798004020 con 0x562b5c4f25a0 2023-12-18T10:26:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a57fa640 1 -- 172.21.15.133:0/2740374628 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb798004180 con 0x562b5c4f25a0 2023-12-18T10:26:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7a57fa640 1 -- 172.21.15.133:0/2740374628 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980042f0 con 0x562b5c4f25a0 2023-12-18T10:26:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2740374628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 msgr2=0x562b5c4a7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2740374628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4a7a80 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb798011570 tx=0x7fb798011a30 comp rx=0 tx=0).stop 2023-12-18T10:26:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2740374628 shutdown_connections 2023-12-18T10:26:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2740374628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4a7fc0 0x562b5c4a83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2740374628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4a7a80 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2740374628 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f1c80 0x562b5c4f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2740374628 >> 172.21.15.133:0/2740374628 conn(0x562b5c2a6910 msgr2=0x562b5c4a6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2740374628 shutdown_connections 2023-12-18T10:26:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2740374628 wait complete. 2023-12-18T10:26:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 -- start start 2023-12-18T10:26:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.184+0000 7fb7b8d2f000 1 Processor -- start 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 0x562b5c4f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c4f9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5c2f7320 con 0x562b5c4f25a0 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5c2964f0 con 0x562b5c4f1c80 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b5c2b46e0 con 0x562b5c4a7fc0 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 10 client.0 _ll_register_callbacks cb 0x562b5c493980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7a7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c4f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38476/0 (socket says 172.21.15.133:38476) 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2558517161 learned_addr learned my addr 172.21.15.133:0/2558517161 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 0x562b5c4f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 msgr2=0x562b5c4f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 0x562b5c4f93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 msgr2=0x562b5c4f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c4f9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2558517161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7980111d0 con 0x562b5c4f25a0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4b2e50 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8053e00 tx=0x7fb7a8057bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c896a94917b12c server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2558517161 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a805b910 con 0x562b5c4f25a0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2558517161 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb7a805ba70 con 0x562b5c4f25a0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2558517161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b5c2b4120 con 0x562b5c4f25a0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2558517161 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7a806b1b0 con 0x562b5c4f25a0 2023-12-18T10:26:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 10 client.9753 fetch_fsmap learned FSMap version 113 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2558517161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x562b5c2bc250 con 0x562b5c4f25a0 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2558517161 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b5c2b4120 con 0x562b5c4f25a0 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2558517161 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fb7a804fc60 con 0x562b5c4f25a0 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 10 client.9753 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 10 client.9753 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 20 client.9753 populate_metadata read hostname 'smithi133' 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x562b5c4b3bc0 0x562b5c4b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 4 client.9753 mds_command: new command op to 9048 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2558517161 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b5c2f5c70 con 0x562b5c4b3bc0 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x562b5c4b3bc0 0x562b5c4b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x562b5c4b3bc0 0x562b5c4b3fd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96ed93b73348907 server_cookie=1616b81c02c7e467 in_seq=0 out_seq=0 2023-12-18T10:26:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 10 client.9753 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2558517161 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x562b5c2f5c70 con 0x562b5c4b3bc0 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 10 client.9753 handle_command_reply: tid=0 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 client.9753 shutdown 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2558517161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 msgr2=0x562b5c4b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4b2e50 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8053e00 tx=0x7fb7a8057bf0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2558517161 shutdown_connections 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x562b5c4b3bc0 0x562b5c4b3fd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c4b2e50 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c4f9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb78e7fc640 0 client.9753 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2558517161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 0x562b5c4f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.188+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2558517161 >> 172.21.15.133:0/2558517161 conn(0x562b5c2a6910 msgr2=0x562b5c4a6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.192+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2558517161 shutdown_connections 2023-12-18T10:26:00.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.192+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2558517161 wait complete. 2023-12-18T10:26:00.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.192+0000 7fb7b8d2f000 20 client.9753 trim_cache size 0 max 16384 2023-12-18T10:26:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7b8d2f000 1 Processor -- start 2023-12-18T10:26:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7b8d2f000 1 -- start start 2023-12-18T10:26:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4a7fc0 0x562b5c549b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c54a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f25a0 0x562b5c54a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5bfb4aa0 con 0x562b5c4a7fc0 2023-12-18T10:26:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5c2f4720 con 0x562b5c4f1c80 2023-12-18T10:26:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b5c33a4d0 con 0x562b5c4f25a0 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7aeffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4a7fc0 0x562b5c549b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7aeffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4a7fc0 0x562b5c549b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38480/0 (socket says 172.21.15.133:38480) 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7aeffd640 1 -- 172.21.15.133:0/3150934379 learned_addr learned my addr 172.21.15.133:0/3150934379 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f25a0 0x562b5c54a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7a7fff640 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c54a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7aeffd640 1 -- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f25a0 msgr2=0x562b5c54a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f25a0 0x562b5c54a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7aeffd640 1 -- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 msgr2=0x562b5c54a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c54a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7aeffd640 1 -- 172.21.15.133:0/3150934379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b5c2a25a0 con 0x562b5c4a7fc0 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.204+0000 7fb7a7fff640 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c54a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4a7fc0 0x562b5c549b40 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00097c0 tx=0x7fb7a0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0f8fb37d0a1c80 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7a5ffb640 1 -- 172.21.15.133:0/3150934379 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a00c8040 con 0x562b5c4a7fc0 2023-12-18T10:26:00.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7a5ffb640 1 -- 172.21.15.133:0/3150934379 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a00ce330 con 0x562b5c4a7fc0 2023-12-18T10:26:00.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7a5ffb640 1 -- 172.21.15.133:0/3150934379 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a00ceab0 con 0x562b5c4a7fc0 2023-12-18T10:26:00.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/3150934379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4a7fc0 msgr2=0x562b5c549b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4a7fc0 0x562b5c549b40 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00097c0 tx=0x7fb7a0004740 comp rx=0 tx=0).stop 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/3150934379 shutdown_connections 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4f25a0 0x562b5c54a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c54a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/3150934379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4a7fc0 0x562b5c549b40 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/3150934379 >> 172.21.15.133:0/3150934379 conn(0x562b5c2a6910 msgr2=0x562b5c4ee1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/3150934379 shutdown_connections 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/3150934379 wait complete. 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- start start 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 Processor -- start 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 0x562b5c549330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c504520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c504a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5c4a7ae0 con 0x562b5c4f25a0 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5c2f7ba0 con 0x562b5c4f1c80 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b5c2c37a0 con 0x562b5c4a7fc0 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7b8d2f000 10 client.0 _ll_register_callbacks cb 0x562b5c2ae710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c504a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c504a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38490/0 (socket says 172.21.15.133:38490) 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2943050508 learned_addr learned my addr 172.21.15.133:0/2943050508 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 0x562b5c549330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7a7fff640 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c504520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 msgr2=0x562b5c549330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 0x562b5c549330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 msgr2=0x562b5c504520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c504520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 -- 172.21.15.133:0/2943050508 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b015a7d0 con 0x562b5c4f25a0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb7af7fe640 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c504a60 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8082010 tx=0x7fb7a8009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c6e42aa042973 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb78e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.208+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2943050508 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a80501b0 con 0x562b5c4f25a0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2943050508 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb7a806b1b0 con 0x562b5c4f25a0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2943050508 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b5c4ab8e0 con 0x562b5c4f25a0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2943050508 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7a806b370 con 0x562b5c4f25a0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 10 client.9759 fetch_fsmap learned FSMap version 113 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2943050508 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) v3 -- 0x562b5c296110 con 0x562b5c4f25a0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2943050508 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b5c4ab8e0 con 0x562b5c4f25a0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2943050508 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 113) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fb7a805b910 con 0x562b5c4f25a0 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 10 client.9759 fetch_fsmap finished waiting for FSMap version 113 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 10 client.9759 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2023-12-18T10:26:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 20 client.9759 populate_metadata read hostname 'smithi133' 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x562b5c504fa0 0x562b5c5053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 4 client.9759 mds_command: new command op to 9048 tid=0[{"prefix": "scrub status"}] 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2943050508 --> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b5c2c06a0 con 0x562b5c504fa0 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x562b5c504fa0 0x562b5c5053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7aeffd640 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x562b5c504fa0 0x562b5c5053b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ae80c132555632 server_cookie=9a0572884f315e7d in_seq=0 out_seq=0 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb78e7fc640 10 client.9759 ms_handle_connect on v2:172.21.15.142:6833/1819917691 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb78e7fc640 1 -- 172.21.15.133:0/2943050508 <== mds.0 v2:172.21.15.142:6833/1819917691 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x562b5c2c06a0 con 0x562b5c504fa0 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb78e7fc640 10 client.9759 handle_command_reply: tid=0 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 client.9759 shutdown 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2943050508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 msgr2=0x562b5c504a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c504a60 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8082010 tx=0x7fb7a8009070 comp rx=0 tx=0).stop 2023-12-18T10:26:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2943050508 shutdown_connections 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:6833/1819917691,v1:172.21.15.142:6835/1819917691] conn(0x562b5c504fa0 0x562b5c5053b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562b5c4f25a0 0x562b5c504a60 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562b5c4f1c80 0x562b5c504520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 --2- 172.21.15.133:0/2943050508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x562b5c4a7fc0 0x562b5c549330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb78e7fc640 0 client.9759 ms_handle_reset on v2:172.21.15.142:6833/1819917691 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2943050508 >> 172.21.15.133:0/2943050508 conn(0x562b5c2a6910 msgr2=0x562b5c4eea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2943050508 shutdown_connections 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 1 -- 172.21.15.133:0/2943050508 wait complete. 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b8d2f000 20 client.9759 trim_cache size 0 max 16384 2023-12-18T10:26:00.218 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "scrubs": { 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "b365728f-f4d9-4343-b553-9830d2254a9d": { 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/d1/d2/d3", 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "tag": "b365728f-f4d9-4343-b553-9830d2254a9d", 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: "options": "recursive,force" 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-18T10:26:00.219 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 -- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb790065a90 msgr2=0x7fb790067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb790065a90 0x7fb790067f50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00ad000 tx=0x7fb7a00a6000 comp rx=0 tx=0).stop 2023-12-18T10:26:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 -- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b0159fb0 msgr2=0x7fb7b00c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b0159fb0 0x7fb7b00c4490 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800caf0 tx=0x7fb7a8002110 comp rx=0 tx=0).stop 2023-12-18T10:26:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 -- 172.21.15.133:0/948501015 shutdown_connections 2023-12-18T10:26:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fb790065a90 0x7fb790067f50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7b0159fb0 0x7fb7b00c4490 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7b00cbff0 0x7fb7b00c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 --2- 172.21.15.133:0/948501015 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7b00ca410 0x7fb7b00c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 -- 172.21.15.133:0/948501015 >> 172.21.15.133:0/948501015 conn(0x7fb7b006a2a0 msgr2=0x7fb7b00ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 -- 172.21.15.133:0/948501015 shutdown_connections 2023-12-18T10:26:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.212+0000 7fb7b59c0640 1 -- 172.21.15.133:0/948501015 wait complete. 2023-12-18T10:26:00.232 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-18T10:26:00.233 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:00.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.368+0000 7f4bbc118640 1 Processor -- start 2023-12-18T10:26:00.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.368+0000 7f4bbc118640 1 -- start start 2023-12-18T10:26:00.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bbc118640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bbc118640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb4160690 con 0x7f4bb40cdd40 2023-12-18T10:26:00.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bbc118640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb40b0d80 con 0x7f4bb406fdb0 2023-12-18T10:26:00.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bbc118640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb41603f0 con 0x7f4bb415c9d0 2023-12-18T10:26:00.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb96b3640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4bb40cdd40 0x7f4bb4160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44470/0 (socket says 172.21.15.133:44470) 2023-12-18T10:26:00.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb96b3640 1 -- 172.21.15.133:0/987796424 learned_addr learned my addr 172.21.15.133:0/987796424 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:00.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb9eb4640 1 --2- 172.21.15.133:0/987796424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb8eb2640 1 -- 172.21.15.133:0/987796424 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617227265 0 0) 0x7f4bb4160690 con 0x7f4bb40cdd40 2023-12-18T10:26:00.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb8eb2640 1 -- 172.21.15.133:0/987796424 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba0003530 con 0x7f4bb40cdd40 2023-12-18T10:26:00.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb8eb2640 1 -- 172.21.15.133:0/987796424 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883987714 0 0) 0x7f4bb40b0d80 con 0x7f4bb406fdb0 2023-12-18T10:26:00.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb8eb2640 1 -- 172.21.15.133:0/987796424 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb4160690 con 0x7f4bb406fdb0 2023-12-18T10:26:00.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb9eb4640 1 -- 172.21.15.133:0/987796424 >> v1:172.21.15.142:6789/0 conn(0x7f4bb406fdb0 legacy=0x7f4bb40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb9eb4640 1 -- 172.21.15.133:0/987796424 >> v1:172.21.15.133:6789/0 conn(0x7f4bb40cdd40 legacy=0x7f4bb4160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.372+0000 7f4bb9eb4640 1 -- 172.21.15.133:0/987796424 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb40ccb00 con 0x7f4bb415c9d0 2023-12-18T10:26:00.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bb9eb4640 1 --2- 172.21.15.133:0/987796424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40cc400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00097f0 tx=0x7f4bb001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4af8f52113b03e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bb8eb2640 1 -- 172.21.15.133:0/987796424 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb00ac630 con 0x7f4bb415c9d0 2023-12-18T10:26:00.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bb8eb2640 1 -- 172.21.15.133:0/987796424 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb00ac790 con 0x7f4bb415c9d0 2023-12-18T10:26:00.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bb8eb2640 1 -- 172.21.15.133:0/987796424 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb00acb20 con 0x7f4bb415c9d0 2023-12-18T10:26:00.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 -- 172.21.15.133:0/987796424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 msgr2=0x7f4bb40cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 --2- 172.21.15.133:0/987796424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40cc400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00097f0 tx=0x7f4bb001c4c0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 -- 172.21.15.133:0/987796424 shutdown_connections 2023-12-18T10:26:00.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 --2- 172.21.15.133:0/987796424 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40cc400 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 -- 172.21.15.133:0/987796424 >> 172.21.15.133:0/987796424 conn(0x7f4bb406a3e0 msgr2=0x7f4bb40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 -- 172.21.15.133:0/987796424 shutdown_connections 2023-12-18T10:26:00.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 -- 172.21.15.133:0/987796424 wait complete. 2023-12-18T10:26:00.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 Processor -- start 2023-12-18T10:26:00.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.376+0000 7f4bbc118640 1 -- start start 2023-12-18T10:26:00.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb406fdb0 0x7f4bb40c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb40cdd40 0x7f4bb4152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40ab940 con 0x7f4bb40cdd40 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40c4bd0 con 0x7f4bb406fdb0 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40c4eb0 con 0x7f4bb415c9d0 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb40cdd40 0x7f4bb4152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb40cdd40 0x7f4bb4152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38506/0 (socket says 172.21.15.133:38506) 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 -- 172.21.15.133:0/948318144 learned_addr learned my addr 172.21.15.133:0/948318144 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb9eb4640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb406fdb0 0x7f4bb40c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bba6b5640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 -- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 msgr2=0x7f4bb40c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 -- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb406fdb0 msgr2=0x7f4bb40c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb406fdb0 0x7f4bb40c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 -- 172.21.15.133:0/948318144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb0009420 con 0x7f4bb40cdd40 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bba6b5640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bb96b3640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb40cdd40 0x7f4bb4152f40 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c4d0 tx=0x7f4ba400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4baa7fc640 1 -- 172.21.15.133:0/948318144 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4005cf0 con 0x7f4bb40cdd40 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4baa7fc640 1 -- 172.21.15.133:0/948318144 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba4005e50 con 0x7f4bb40cdd40 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4baa7fc640 1 -- 172.21.15.133:0/948318144 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40072b0 con 0x7f4bb40cdd40 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb41613b0 con 0x7f4bb40cdd40 2023-12-18T10:26:00.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb40abec0 con 0x7f4bb40cdd40 2023-12-18T10:26:00.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb40735b0 con 0x7f4bb40cdd40 2023-12-18T10:26:00.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.380+0000 7f4baa7fc640 1 -- 172.21.15.133:0/948318144 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4ba4007410 con 0x7f4bb40cdd40 2023-12-18T10:26:00.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.384+0000 7f4baa7fc640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.384+0000 7f4baa7fc640 1 -- 172.21.15.133:0/948318144 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ba4082880 con 0x7f4bb40cdd40 2023-12-18T10:26:00.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.384+0000 7f4bb9eb4640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.384+0000 7f4bb9eb4640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00ae000 tx=0x7f4bb00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.388+0000 7f4baa7fc640 1 -- 172.21.15.133:0/948318144 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4ba4050180 con 0x7f4bb40cdd40 2023-12-18T10:26:00.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.568+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bb40ac0e0 con 0x7f4bb40cdd40 2023-12-18T10:26:00.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.568+0000 7f4baa7fc640 1 -- 172.21.15.133:0/948318144 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7f4ba40537a0 con 0x7f4bb40cdd40 2023-12-18T10:26:00.571 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:00.571 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:26:00.571 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:26:00.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 msgr2=0x7f4b98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00ae000 tx=0x7f4bb00a7000 comp rx=0 tx=0).stop 2023-12-18T10:26:00.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb40cdd40 msgr2=0x7f4bb4152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb40cdd40 0x7f4bb4152f40 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c4d0 tx=0x7f4ba400c990 comp rx=0 tx=0).stop 2023-12-18T10:26:00.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 shutdown_connections 2023-12-18T10:26:00.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4b98065a60 0x7f4b98067f20 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4bb415c9d0 0x7f4bb40c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb40cdd40 0x7f4bb4152f40 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 --2- 172.21.15.133:0/948318144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4bb406fdb0 0x7f4bb40c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 >> 172.21.15.133:0/948318144 conn(0x7f4bb406a3e0 msgr2=0x7f4bb415bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 shutdown_connections 2023-12-18T10:26:00.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.572+0000 7f4bbc118640 1 -- 172.21.15.133:0/948318144 wait complete. 2023-12-18T10:26:00.591 DEBUG:tasks.cephfs.test_multimds_misc:current active=['d', 'a', 'c'] 2023-12-18T10:26:00.591 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:26:00.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f933e020640 1 Processor -- start 2023-12-18T10:26:00.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f933e020640 1 -- start start 2023-12-18T10:26:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f933e020640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f933815ca40 0x7f93380cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f933e020640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93380d11c0 con 0x7f93380ce3f0 2023-12-18T10:26:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f933e020640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93380d0310 con 0x7f93380cf7e0 2023-12-18T10:26:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f933e020640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93380d05b0 con 0x7f933815ca40 2023-12-18T10:26:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f932ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f93380ce3f0 0x7f93380cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44482/0 (socket says 172.21.15.133:44482) 2023-12-18T10:26:00.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f932ffff640 1 -- 172.21.15.133:0/2929777841 learned_addr learned my addr 172.21.15.133:0/2929777841 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f93377fe640 1 --2- 172.21.15.133:0/2929777841 >> v2:172.21.15.142:3300/0 conn(0x7f933815ca40 0x7f93380cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f9336ffd640 1 -- 172.21.15.133:0/2929777841 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243877965 0 0) 0x7f93380d11c0 con 0x7f93380ce3f0 2023-12-18T10:26:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f9336ffd640 1 -- 172.21.15.133:0/2929777841 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9324003530 con 0x7f93380ce3f0 2023-12-18T10:26:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f93377fe640 1 -- 172.21.15.133:0/2929777841 >> v1:172.21.15.142:6789/0 conn(0x7f93380cf7e0 legacy=0x7f93381668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f93377fe640 1 -- 172.21.15.133:0/2929777841 >> v1:172.21.15.133:6789/0 conn(0x7f93380ce3f0 legacy=0x7f93380cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.728+0000 7f93377fe640 1 -- 172.21.15.133:0/2929777841 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380d0890 con 0x7f933815ca40 2023-12-18T10:26:00.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f93377fe640 1 --2- 172.21.15.133:0/2929777841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933815ca40 0x7f93380cdeb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f93280097a0 tx=0x7f932801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf971c093509c8f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f9336ffd640 1 -- 172.21.15.133:0/2929777841 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280ab660 con 0x7f933815ca40 2023-12-18T10:26:00.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f9336ffd640 1 -- 172.21.15.133:0/2929777841 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93280ab7c0 con 0x7f933815ca40 2023-12-18T10:26:00.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f9336ffd640 1 -- 172.21.15.133:0/2929777841 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280abb50 con 0x7f933815ca40 2023-12-18T10:26:00.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f933e020640 1 -- 172.21.15.133:0/2929777841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933815ca40 msgr2=0x7f93380cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f933e020640 1 --2- 172.21.15.133:0/2929777841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933815ca40 0x7f93380cdeb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f93280097a0 tx=0x7f932801c460 comp rx=0 tx=0).stop 2023-12-18T10:26:00.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f933e020640 1 -- 172.21.15.133:0/2929777841 shutdown_connections 2023-12-18T10:26:00.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f933e020640 1 --2- 172.21.15.133:0/2929777841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f933815ca40 0x7f93380cdeb0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f933e020640 1 -- 172.21.15.133:0/2929777841 >> 172.21.15.133:0/2929777841 conn(0x7f9338089fb0 msgr2=0x7f93380d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f933e020640 1 -- 172.21.15.133:0/2929777841 shutdown_connections 2023-12-18T10:26:00.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.732+0000 7f933e020640 1 -- 172.21.15.133:0/2929777841 wait complete. 2023-12-18T10:26:00.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 Processor -- start 2023-12-18T10:26:00.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 -- start start 2023-12-18T10:26:00.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93380ce3f0 0x7f9338152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93380cf7e0 0x7f93381555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f933815ca40 0x7f9338155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9338155150 con 0x7f93380cf7e0 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93380b58e0 con 0x7f93380ce3f0 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93380b7a00 con 0x7f933815ca40 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93380cf7e0 0x7f93381555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93380cf7e0 0x7f93381555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38516/0 (socket says 172.21.15.133:38516) 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 -- 172.21.15.133:0/2666869466 learned_addr learned my addr 172.21.15.133:0/2666869466 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f93377fe640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93380ce3f0 0x7f9338152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f9337fff640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f933815ca40 0x7f9338155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 -- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f933815ca40 msgr2=0x7f9338155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f933815ca40 0x7f9338155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 -- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93380ce3f0 msgr2=0x7f9338152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93380ce3f0 0x7f9338152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 -- 172.21.15.133:0/2666869466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280093b0 con 0x7f93380cf7e0 2023-12-18T10:26:00.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f9337fff640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f933815ca40 0x7f9338155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:00.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f932ffff640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93380cf7e0 0x7f93381555e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f9320001270 tx=0x7f932000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f9334ff9640 1 -- 172.21.15.133:0/2666869466 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320007270 con 0x7f93380cf7e0 2023-12-18T10:26:00.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f9334ff9640 1 -- 172.21.15.133:0/2666869466 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93200073d0 con 0x7f93380cf7e0 2023-12-18T10:26:00.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93380d17d0 con 0x7f93380cf7e0 2023-12-18T10:26:00.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f9334ff9640 1 -- 172.21.15.133:0/2666869466 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932000ce50 con 0x7f93380cf7e0 2023-12-18T10:26:00.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.736+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93380b7fc0 con 0x7f93380cf7e0 2023-12-18T10:26:00.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.740+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93380d1630 con 0x7f93380cf7e0 2023-12-18T10:26:00.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.740+0000 7f9334ff9640 1 -- 172.21.15.133:0/2666869466 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f93200057b0 con 0x7f93380cf7e0 2023-12-18T10:26:00.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.740+0000 7f9334ff9640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9318065a60 0x7f9318067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:00.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.740+0000 7f9334ff9640 1 -- 172.21.15.133:0/2666869466 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9320082880 con 0x7f93380cf7e0 2023-12-18T10:26:00.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.740+0000 7f93377fe640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9318065a60 0x7f9318067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:00.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.740+0000 7f93377fe640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9318065a60 0x7f9318067f20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f93280af000 tx=0x7f93280a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:00.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.744+0000 7f9334ff9640 1 -- 172.21.15.133:0/2666869466 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f93380d1630 con 0x7f93380cf7e0 2023-12-18T10:26:00.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.944+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f93380d1630 con 0x7f93380cf7e0 2023-12-18T10:26:00.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.944+0000 7f9334ff9640 1 -- 172.21.15.133:0/2666869466 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1926 (secure 0 0 0) 0x7f93200177a0 con 0x7f93380cf7e0 2023-12-18T10:26:00.946 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:00.946 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":500,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695325,"bytes_used":266510336,"bytes_avail":772827602944,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6947,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":113,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"c","status":"up:active","gid":9039},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":9042},{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":9048}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2023-12-18T10:25:55.196454+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-12-18T10:26:00.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9318065a60 msgr2=0x7f9318067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9318065a60 0x7f9318067f20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f93280af000 tx=0x7f93280a7000 comp rx=0 tx=0).stop 2023-12-18T10:26:00.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93380cf7e0 msgr2=0x7f93381555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:00.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93380cf7e0 0x7f93381555e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f9320001270 tx=0x7f932000cb10 comp rx=0 tx=0).stop 2023-12-18T10:26:00.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 shutdown_connections 2023-12-18T10:26:00.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9318065a60 0x7f9318067f20 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f933815ca40 0x7f9338155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93380cf7e0 0x7f93381555e0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 --2- 172.21.15.133:0/2666869466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93380ce3f0 0x7f9338152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:00.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 >> 172.21.15.133:0/2666869466 conn(0x7f9338089fb0 msgr2=0x7f93380d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:00.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 shutdown_connections 2023-12-18T10:26:00.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:00.948+0000 7f933e020640 1 -- 172.21.15.133:0/2666869466 wait complete. 2023-12-18T10:26:00.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:26:01.968 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:02.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.116+0000 7f2fc62df640 1 Processor -- start 2023-12-18T10:26:02.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.116+0000 7f2fc62df640 1 -- start start 2023-12-18T10:26:02.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.116+0000 7f2fc62df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc0164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.116+0000 7f2fc62df640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc00c9460 con 0x7f2fc01570c0 2023-12-18T10:26:02.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.116+0000 7f2fc62df640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc01574a0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.116+0000 7f2fc62df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00c8b30 con 0x7f2fc00ca000 2023-12-18T10:26:02.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.116+0000 7f2fbffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2fc01570c0 0x7f2fc006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44498/0 (socket says 172.21.15.133:44498) 2023-12-18T10:26:02.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.116+0000 7f2fbffff640 1 -- 172.21.15.133:0/2246843363 learned_addr learned my addr 172.21.15.133:0/2246843363 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fc487c640 1 --2- 172.21.15.133:0/2246843363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc0164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fbeffd640 1 -- 172.21.15.133:0/2246843363 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021259113 0 0) 0x7f2fc00c9460 con 0x7f2fc01570c0 2023-12-18T10:26:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fbeffd640 1 -- 172.21.15.133:0/2246843363 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa8003530 con 0x7f2fc01570c0 2023-12-18T10:26:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fbeffd640 1 -- 172.21.15.133:0/2246843363 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205103008 0 0) 0x7f2fc01574a0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fbeffd640 1 -- 172.21.15.133:0/2246843363 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc00c9460 con 0x7f2fc006c4f0 2023-12-18T10:26:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fc487c640 1 -- 172.21.15.133:0/2246843363 >> v1:172.21.15.142:6789/0 conn(0x7f2fc006c4f0 legacy=0x7f2fc00c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fc487c640 1 -- 172.21.15.133:0/2246843363 >> v1:172.21.15.133:6789/0 conn(0x7f2fc01570c0 legacy=0x7f2fc006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fc487c640 1 -- 172.21.15.133:0/2246843363 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00c8e10 con 0x7f2fc00ca000 2023-12-18T10:26:02.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fc487c640 1 --2- 172.21.15.133:0/2246843363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc0164230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009dc0 tx=0x7f2fb801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e2c6b0733d2e74 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:02.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fbeffd640 1 -- 172.21.15.133:0/2246843363 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80a5930 con 0x7f2fc00ca000 2023-12-18T10:26:02.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fbeffd640 1 -- 172.21.15.133:0/2246843363 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb80a5a90 con 0x7f2fc00ca000 2023-12-18T10:26:02.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.120+0000 7f2fbeffd640 1 -- 172.21.15.133:0/2246843363 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80a5e20 con 0x7f2fc00ca000 2023-12-18T10:26:02.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- 172.21.15.133:0/2246843363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 msgr2=0x7f2fc0164230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 --2- 172.21.15.133:0/2246843363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc0164230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009dc0 tx=0x7f2fb801c8b0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- 172.21.15.133:0/2246843363 shutdown_connections 2023-12-18T10:26:02.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 --2- 172.21.15.133:0/2246843363 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc0164230 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- 172.21.15.133:0/2246843363 >> 172.21.15.133:0/2246843363 conn(0x7f2fc006a3e0 msgr2=0x7f2fc00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:02.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- 172.21.15.133:0/2246843363 shutdown_connections 2023-12-18T10:26:02.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- 172.21.15.133:0/2246843363 wait complete. 2023-12-18T10:26:02.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 Processor -- start 2023-12-18T10:26:02.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- start start 2023-12-18T10:26:02.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc006c4f0 0x7f2fc014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc00c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc01570c0 0x7f2fc00c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc0157ee0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc014ae30 con 0x7f2fc01570c0 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc62df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00c8290 con 0x7f2fc00ca000 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc006c4f0 0x7f2fc014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fbffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc006c4f0 0x7f2fc014a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38518/0 (socket says 172.21.15.133:38518) 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fbffff640 1 -- 172.21.15.133:0/2001776339 learned_addr learned my addr 172.21.15.133:0/2001776339 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fbf7fe640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc00c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.124+0000 7f2fc487c640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc01570c0 0x7f2fc00c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbffff640 1 -- 172.21.15.133:0/2001776339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 msgr2=0x7f2fc00c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbffff640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc00c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbffff640 1 -- 172.21.15.133:0/2001776339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc01570c0 msgr2=0x7f2fc00c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbffff640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc01570c0 0x7f2fc00c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbffff640 1 -- 172.21.15.133:0/2001776339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8009a70 con 0x7f2fc006c4f0 2023-12-18T10:26:02.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbffff640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc006c4f0 0x7f2fc014a360 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000c450 tx=0x7f2fb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:02.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbcff9640 1 -- 172.21.15.133:0/2001776339 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0005cf0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbcff9640 1 -- 172.21.15.133:0/2001776339 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0005e50 con 0x7f2fc006c4f0 2023-12-18T10:26:02.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc0158130 con 0x7f2fc006c4f0 2023-12-18T10:26:02.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbcff9640 1 -- 172.21.15.133:0/2001776339 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb00072b0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc01586f0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc00735b0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbcff9640 1 -- 172.21.15.133:0/2001776339 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fb0007410 con 0x7f2fc006c4f0 2023-12-18T10:26:02.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbcff9640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fac065a60 0x7f2fac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbcff9640 1 -- 172.21.15.133:0/2001776339 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fb00827a0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.128+0000 7f2fbf7fe640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fac065a60 0x7f2fac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.132+0000 7f2fbf7fe640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fac065a60 0x7f2fac067f20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0163f60 tx=0x7f2fb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:02.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.132+0000 7f2fbcff9640 1 -- 172.21.15.133:0/2001776339 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2fb00500b0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fc004e000 con 0x7f2fc006c4f0 2023-12-18T10:26:02.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fbcff9640 1 -- 172.21.15.133:0/2001776339 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7f2fb00536d0 con 0x7f2fc006c4f0 2023-12-18T10:26:02.316 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:02.316 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:26:02.316 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:26:02.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fac065a60 msgr2=0x7f2fac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fac065a60 0x7f2fac067f20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0163f60 tx=0x7f2fb4009040 comp rx=0 tx=0).stop 2023-12-18T10:26:02.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc006c4f0 msgr2=0x7f2fc014a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc006c4f0 0x7f2fc014a360 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000c450 tx=0x7f2fb000c910 comp rx=0 tx=0).stop 2023-12-18T10:26:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 shutdown_connections 2023-12-18T10:26:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2fac065a60 0x7f2fac067f20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2fc01570c0 0x7f2fc00c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2fc00ca000 0x7f2fc00c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 --2- 172.21.15.133:0/2001776339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc006c4f0 0x7f2fc014a360 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 >> 172.21.15.133:0/2001776339 conn(0x7f2fc006a3e0 msgr2=0x7f2fc014e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 shutdown_connections 2023-12-18T10:26:02.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.316+0000 7f2fc62df640 1 -- 172.21.15.133:0/2001776339 wait complete. 2023-12-18T10:26:02.337 DEBUG:tasks.cephfs.test_multimds_misc:current active=['d', 'a', 'c'] 2023-12-18T10:26:02.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:26:02.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.472+0000 7fe835960640 1 Processor -- start 2023-12-18T10:26:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.472+0000 7fe835960640 1 -- start start 2023-12-18T10:26:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe835960640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe83006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe835960640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8300cefe0 0x7fe8300cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe835960640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe83015d2d0 0x7fe83015d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe835960640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83006c140 con 0x7fe8300cefe0 2023-12-18T10:26:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe835960640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83015cf10 con 0x7fe83015d2d0 2023-12-18T10:26:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe835960640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83015e000 con 0x7fe83015cb30 2023-12-18T10:26:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe8267fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8300cefe0 0x7fe8300cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe8267fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8300cefe0 0x7fe8300cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38526/0 (socket says 172.21.15.133:38526) 2023-12-18T10:26:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe8267fc640 1 -- 172.21.15.133:0/2431342170 learned_addr learned my addr 172.21.15.133:0/2431342170 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe82effd640 1 --2- 172.21.15.133:0/2431342170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe83006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe82f7fe640 1 --2- 172.21.15.133:0/2431342170 >> v2:172.21.15.142:3300/0 conn(0x7fe83015d2d0 0x7fe83015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe8267fc640 1 -- 172.21.15.133:0/2431342170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 msgr2=0x7fe83006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe8267fc640 1 --2- 172.21.15.133:0/2431342170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe83006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe8267fc640 1 -- 172.21.15.133:0/2431342170 >> v2:172.21.15.142:3300/0 conn(0x7fe83015d2d0 msgr2=0x7fe83015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe8267fc640 1 --2- 172.21.15.133:0/2431342170 >> v2:172.21.15.142:3300/0 conn(0x7fe83015d2d0 0x7fe83015d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe8267fc640 1 -- 172.21.15.133:0/2431342170 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8300cf960 con 0x7fe8300cefe0 2023-12-18T10:26:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe82effd640 1 --2- 172.21.15.133:0/2431342170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe83006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.476+0000 7fe82f7fe640 1 --2- 172.21.15.133:0/2431342170 >> v2:172.21.15.142:3300/0 conn(0x7fe83015d2d0 0x7fe83015d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:02.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe8267fc640 1 --2- 172.21.15.133:0/2431342170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cefe0 0x7fe8300cf420 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fe8300cfe30 tx=0x7fe81801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f5091c7e80ec15 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:02.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe82e7fc640 1 -- 172.21.15.133:0/2431342170 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180a5820 con 0x7fe8300cefe0 2023-12-18T10:26:02.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe82e7fc640 1 -- 172.21.15.133:0/2431342170 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8180a5980 con 0x7fe8300cefe0 2023-12-18T10:26:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe82e7fc640 1 -- 172.21.15.133:0/2431342170 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180a5d10 con 0x7fe8300cefe0 2023-12-18T10:26:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- 172.21.15.133:0/2431342170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cefe0 msgr2=0x7fe8300cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 --2- 172.21.15.133:0/2431342170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cefe0 0x7fe8300cf420 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fe8300cfe30 tx=0x7fe81801c9a0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- 172.21.15.133:0/2431342170 shutdown_connections 2023-12-18T10:26:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 --2- 172.21.15.133:0/2431342170 >> v2:172.21.15.142:3300/0 conn(0x7fe83015d2d0 0x7fe83015d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 --2- 172.21.15.133:0/2431342170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8300cefe0 0x7fe8300cf420 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 --2- 172.21.15.133:0/2431342170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe83006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- 172.21.15.133:0/2431342170 >> 172.21.15.133:0/2431342170 conn(0x7fe830089fb0 msgr2=0x7fe83009b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- 172.21.15.133:0/2431342170 shutdown_connections 2023-12-18T10:26:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- 172.21.15.133:0/2431342170 wait complete. 2023-12-18T10:26:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 Processor -- start 2023-12-18T10:26:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- start start 2023-12-18T10:26:02.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8300cefe0 0x7fe83015f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe830158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015d2d0 0x7fe8300b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8301f4c90 con 0x7fe83015d2d0 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830158e40 con 0x7fe8300cefe0 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.480+0000 7fe835960640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe830159050 con 0x7fe83015cb30 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015d2d0 0x7fe8300b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe8267fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe830158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82effd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8300cefe0 0x7fe83015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe8267fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe830158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:42066/0 (socket says 172.21.15.133:42066) 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe8267fc640 1 -- 172.21.15.133:0/264355535 learned_addr learned my addr 172.21.15.133:0/264355535 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82f7fe640 1 -- 172.21.15.133:0/264355535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 msgr2=0x7fe830158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82f7fe640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe830158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82f7fe640 1 -- 172.21.15.133:0/264355535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8300cefe0 msgr2=0x7fe83015f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82f7fe640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8300cefe0 0x7fe83015f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82f7fe640 1 -- 172.21.15.133:0/264355535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009b30 con 0x7fe83015d2d0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe8267fc640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe830158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82f7fe640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015d2d0 0x7fe8300b54a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fe82800c5c0 tx=0x7fe82800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82cff9640 1 -- 172.21.15.133:0/264355535 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828011800 con 0x7fe83015d2d0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82cff9640 1 -- 172.21.15.133:0/264355535 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe828011980 con 0x7fe83015d2d0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82cff9640 1 -- 172.21.15.133:0/264355535 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828011d30 con 0x7fe83015d2d0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe830159330 con 0x7fe83015d2d0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8301598f0 con 0x7fe83015d2d0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe830159dd0 con 0x7fe83015d2d0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.484+0000 7fe82cff9640 1 -- 172.21.15.133:0/264355535 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe828022350 con 0x7fe83015d2d0 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.488+0000 7fe82cff9640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.488+0000 7fe82cff9640 1 -- 172.21.15.133:0/264355535 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe828083300 con 0x7fe83015d2d0 2023-12-18T10:26:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.488+0000 7fe82effd640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.488+0000 7fe82effd640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe830168920 tx=0x7fe820008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:02.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.488+0000 7fe82cff9640 1 -- 172.21.15.133:0/264355535 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe828050b80 con 0x7fe83015d2d0 2023-12-18T10:26:02.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.692+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe83015dc70 con 0x7fe83015d2d0 2023-12-18T10:26:02.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.692+0000 7fe82cff9640 1 -- 172.21.15.133:0/264355535 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1967 (secure 0 0 0) 0x7fe8280541a0 con 0x7fe83015d2d0 2023-12-18T10:26:02.693 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:02.693 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":502,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":695325,"bytes_used":266510336,"bytes_avail":772827602944,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6398,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":113,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"c","status":"up:active","gid":9039},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":9042},{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":9048}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2023-12-18T10:26:01.197678+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-12-18T10:26:02.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 msgr2=0x7fe810067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe830168920 tx=0x7fe820008040 comp rx=0 tx=0).stop 2023-12-18T10:26:02.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015d2d0 msgr2=0x7fe8300b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015d2d0 0x7fe8300b54a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fe82800c5c0 tx=0x7fe82800ca80 comp rx=0 tx=0).stop 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 shutdown_connections 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe810065a60 0x7fe810067f20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe83015d2d0 0x7fe8300b54a0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe83015cb30 0x7fe830158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 --2- 172.21.15.133:0/264355535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8300cefe0 0x7fe83015f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 >> 172.21.15.133:0/264355535 conn(0x7fe830089fb0 msgr2=0x7fe8300d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 shutdown_connections 2023-12-18T10:26:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:02.696+0000 7fe835960640 1 -- 172.21.15.133:0/264355535 wait complete. 2023-12-18T10:26:02.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:26:03.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:03.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ecd8b6640 1 Processor -- start 2023-12-18T10:26:03.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ecd8b6640 1 -- start start 2023-12-18T10:26:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ecd8b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec80ca000 0x7f0ec8164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ecd8b6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec80c9460 con 0x7f0ec81570c0 2023-12-18T10:26:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ecd8b6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec81574a0 con 0x7f0ec806c4f0 2023-12-18T10:26:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ecd8b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80c8b30 con 0x7f0ec80ca000 2023-12-18T10:26:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec6ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0ec81570c0 0x7f0ec806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44504/0 (socket says 172.21.15.133:44504) 2023-12-18T10:26:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec6ffd640 1 -- 172.21.15.133:0/1770869404 learned_addr learned my addr 172.21.15.133:0/1770869404 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:03.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec77fe640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec80ca000 0x7f0ec8164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:03.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083489950 0 0) 0x7f0ec80c9460 con 0x7f0ec81570c0 2023-12-18T10:26:03.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb4003530 con 0x7f0ec81570c0 2023-12-18T10:26:03.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1422739619 0 0) 0x7f0eb4003530 con 0x7f0ec81570c0 2023-12-18T10:26:03.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec80ca000 msgr2=0x7f0ec8164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:03.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec80ca000 0x7f0ec8164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 >> v1:172.21.15.142:6789/0 conn(0x7f0ec806c4f0 legacy=0x7f0ec80c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80c8e10 con 0x7f0ec81570c0 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f0eb8001680 con 0x7f0ec81570c0 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.856+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 >> v1:172.21.15.133:6789/0 conn(0x7f0ec81570c0 legacy=0x7f0ec806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40039b0 0x7f0eb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0eb4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec80ca000 0x7f0eb40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80c8b30 con 0x7f0eb40047d0 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb400dcd0 con 0x7f0eb40039b0 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb400de90 con 0x7f0ec80ca000 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ebe7fc640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0eb4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec6ffd640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40039b0 0x7f0eb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec77fe640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec80ca000 0x7f0eb40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ebe7fc640 1 -- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec80ca000 msgr2=0x7f0eb40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ebe7fc640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec80ca000 0x7f0eb40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ebe7fc640 1 -- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40039b0 msgr2=0x7f0eb4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ebe7fc640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0eb40039b0 0x7f0eb4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ebe7fc640 1 -- 172.21.15.133:0/1770869404 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4003530 con 0x7f0eb40047d0 2023-12-18T10:26:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ebe7fc640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0eb4004c50 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0001780 tx=0x7f0eb001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de206b79cc61f39a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00052d0 con 0x7f0eb40047d0 2023-12-18T10:26:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb00a7050 con 0x7f0eb40047d0 2023-12-18T10:26:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.860+0000 7f0ec67fc640 1 -- 172.21.15.133:0/1770869404 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0003600 con 0x7f0eb40047d0 2023-12-18T10:26:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/1770869404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 msgr2=0x7f0eb4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 --2- 172.21.15.133:0/1770869404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0eb4004c50 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0001780 tx=0x7f0eb001c3d0 comp rx=0 tx=0).stop 2023-12-18T10:26:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec77fe640 1 -- 172.21.15.133:0/1770869404 reap_dead start 2023-12-18T10:26:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/1770869404 shutdown_connections 2023-12-18T10:26:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/1770869404 >> 172.21.15.133:0/1770869404 conn(0x7f0ec806a3e0 msgr2=0x7f0ec80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/1770869404 shutdown_connections 2023-12-18T10:26:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/1770869404 wait complete. 2023-12-18T10:26:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 Processor -- start 2023-12-18T10:26:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- start start 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0ec80c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec8157ff0 0x7f0ec815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec8158470 0x7f0ec815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec8151330 con 0x7f0eb40047d0 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec8151750 con 0x7f0ec8157ff0 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ecd8b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec81593b0 con 0x7f0ec8158470 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0ec80c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0ec80c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38568/0 (socket says 172.21.15.133:38568) 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec6ffd640 1 -- 172.21.15.133:0/2139477740 learned_addr learned my addr 172.21.15.133:0/2139477740 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ebe7fc640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec8157ff0 0x7f0ec815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec77fe640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec8158470 0x7f0ec815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec6ffd640 1 -- 172.21.15.133:0/2139477740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec8158470 msgr2=0x7f0ec815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec6ffd640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec8158470 0x7f0ec815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:03.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec6ffd640 1 -- 172.21.15.133:0/2139477740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec8157ff0 msgr2=0x7f0ec815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec6ffd640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec8157ff0 0x7f0ec815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.864+0000 7f0ec6ffd640 1 -- 172.21.15.133:0/2139477740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec81503f0 con 0x7f0eb40047d0 2023-12-18T10:26:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ec6ffd640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0ec80c6d10 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8007320 tx=0x7f0eb80077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ec4ff9640 1 -- 172.21.15.133:0/2139477740 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800f980 con 0x7f0eb40047d0 2023-12-18T10:26:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ec4ff9640 1 -- 172.21.15.133:0/2139477740 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800fae0 con 0x7f0eb40047d0 2023-12-18T10:26:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec80c7250 con 0x7f0eb40047d0 2023-12-18T10:26:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ec4ff9640 1 -- 172.21.15.133:0/2139477740 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800fe90 con 0x7f0eb40047d0 2023-12-18T10:26:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec8150990 con 0x7f0eb40047d0 2023-12-18T10:26:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec80735b0 con 0x7f0eb40047d0 2023-12-18T10:26:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ec4ff9640 1 -- 172.21.15.133:0/2139477740 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0eb80133b0 con 0x7f0eb40047d0 2023-12-18T10:26:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ec4ff9640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ea8065a60 0x7f0ea8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ec4ff9640 1 -- 172.21.15.133:0/2139477740 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0eb8082b90 con 0x7f0eb40047d0 2023-12-18T10:26:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.868+0000 7f0ebe7fc640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ea8065a60 0x7f0ea8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:03.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.872+0000 7f0ebe7fc640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ea8065a60 0x7f0ea8067f20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0001750 tx=0x7f0eb00011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:03.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:03.872+0000 7f0ec4ff9640 1 -- 172.21.15.133:0/2139477740 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0eb8050490 con 0x7f0eb40047d0 2023-12-18T10:26:04.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.056+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ec81515a0 con 0x7f0eb40047d0 2023-12-18T10:26:04.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.056+0000 7f0ec4ff9640 1 -- 172.21.15.133:0/2139477740 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7f0eb8053ab0 con 0x7f0eb40047d0 2023-12-18T10:26:04.057 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:04.057 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:26:04.057 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:26:04.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ea8065a60 msgr2=0x7f0ea8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ea8065a60 0x7f0ea8067f20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0001750 tx=0x7f0eb00011a0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 msgr2=0x7f0ec80c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0ec80c6d10 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8007320 tx=0x7f0eb80077e0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 shutdown_connections 2023-12-18T10:26:04.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ea8065a60 0x7f0ea8067f20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ec8158470 0x7f0ec815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ec8157ff0 0x7f0ec815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 --2- 172.21.15.133:0/2139477740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb40047d0 0x7f0ec80c6d10 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 >> 172.21.15.133:0/2139477740 conn(0x7f0ec806a3e0 msgr2=0x7f0ec80ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:04.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 shutdown_connections 2023-12-18T10:26:04.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.060+0000 7f0ecd8b6640 1 -- 172.21.15.133:0/2139477740 wait complete. 2023-12-18T10:26:04.080 DEBUG:tasks.cephfs.test_multimds_misc:current active=['d', 'a', 'c'] 2023-12-18T10:26:04.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:26:04.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd402d640 1 Processor -- start 2023-12-18T10:26:04.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd402d640 1 -- start start 2023-12-18T10:26:04.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd402d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1dcc06c4f0 0x7f1dcc0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:04.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd402d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0c9460 con 0x7f1dcc0c9e30 2023-12-18T10:26:04.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd402d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc1574a0 con 0x7f1dcc1570c0 2023-12-18T10:26:04.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd402d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0c8b30 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd25ca640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1dcc0c9e30 0x7f1dcc070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44514/0 (socket says 172.21.15.133:44514) 2023-12-18T10:26:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd25ca640 1 -- 172.21.15.133:0/4088292415 learned_addr learned my addr 172.21.15.133:0/4088292415 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd15c8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1dcc06c4f0 0x7f1dcc0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd0dc7640 1 -- 172.21.15.133:0/4088292415 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469392938 0 0) 0x7f1dcc0c9460 con 0x7f1dcc0c9e30 2023-12-18T10:26:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd15c8640 1 -- 172.21.15.133:0/4088292415 >> v1:172.21.15.142:6789/0 conn(0x7f1dcc1570c0 legacy=0x7f1dcc06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd15c8640 1 -- 172.21.15.133:0/4088292415 >> v1:172.21.15.133:6789/0 conn(0x7f1dcc0c9e30 legacy=0x7f1dcc070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.216+0000 7f1dd15c8640 1 -- 172.21.15.133:0/4088292415 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0c8e10 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd15c8640 1 --2- 172.21.15.133:0/4088292415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c98f0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0097c0 tx=0x7f1dbc01e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b96c1a09ece23a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:04.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd0dc7640 1 -- 172.21.15.133:0/4088292415 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0a8660 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd0dc7640 1 -- 172.21.15.133:0/4088292415 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0a87c0 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd0dc7640 1 -- 172.21.15.133:0/4088292415 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0a8b50 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd402d640 1 -- 172.21.15.133:0/4088292415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 msgr2=0x7f1dcc0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd402d640 1 --2- 172.21.15.133:0/4088292415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c98f0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0097c0 tx=0x7f1dbc01e690 comp rx=0 tx=0).stop 2023-12-18T10:26:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd402d640 1 -- 172.21.15.133:0/4088292415 shutdown_connections 2023-12-18T10:26:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd402d640 1 --2- 172.21.15.133:0/4088292415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c98f0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd402d640 1 -- 172.21.15.133:0/4088292415 >> 172.21.15.133:0/4088292415 conn(0x7f1dcc06a3e0 msgr2=0x7f1dcc0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd402d640 1 -- 172.21.15.133:0/4088292415 shutdown_connections 2023-12-18T10:26:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.220+0000 7f1dd402d640 1 -- 172.21.15.133:0/4088292415 wait complete. 2023-12-18T10:26:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 Processor -- start 2023-12-18T10:26:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 -- start start 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dcc0c9e30 0x7f1dcc14aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc1570c0 0x7f1dcc14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0ad7e0 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0ad120 con 0x7f1dcc1570c0 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0ad500 con 0x7f1dcc0c9e30 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38576/0 (socket says 172.21.15.133:38576) 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 -- 172.21.15.133:0/3046727214 learned_addr learned my addr 172.21.15.133:0/3046727214 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd15c8640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dcc0c9e30 0x7f1dcc14aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd25ca640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc1570c0 0x7f1dcc14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 -- 172.21.15.133:0/3046727214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dcc0c9e30 msgr2=0x7f1dcc14aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dcc0c9e30 0x7f1dcc14aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 -- 172.21.15.133:0/3046727214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc1570c0 msgr2=0x7f1dcc14b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc1570c0 0x7f1dcc14b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 -- 172.21.15.133:0/3046727214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc009420 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd1dc9640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c4930 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c3c0 tx=0x7f1dc800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dc27fc640 1 -- 172.21.15.133:0/3046727214 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80052d0 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dc27fc640 1 -- 172.21.15.133:0/3046727214 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8005430 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dc27fc640 1 -- 172.21.15.133:0/3046727214 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8003840 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc0c1fc0 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc0c22a0 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.224+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc0735b0 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.228+0000 7f1dc27fc640 1 -- 172.21.15.133:0/3046727214 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1dc80039a0 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.228+0000 7f1dc27fc640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1db0065a90 0x7f1db0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.228+0000 7f1dc27fc640 1 -- 172.21.15.133:0/3046727214 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1dc8082800 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.228+0000 7f1dd15c8640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1db0065a90 0x7f1db0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:04.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.228+0000 7f1dd15c8640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1db0065a90 0x7f1db0067f50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0b1000 tx=0x7f1dbc0b4040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.232+0000 7f1dc27fc640 1 -- 172.21.15.133:0/3046727214 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1dc8050050 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.436+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1dcc04e000 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.436+0000 7f1dc27fc640 1 -- 172.21.15.133:0/3046727214 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1967 (secure 0 0 0) 0x7f1dc8053670 con 0x7f1dcc06c4f0 2023-12-18T10:26:04.438 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:04.438 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":504,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700657,"bytes_used":266518528,"bytes_avail":772827594752,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7081,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":113,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"c","status":"up:active","gid":9039},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":9042},{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":9048}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2023-12-18T10:26:01.197678+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2023-12-18T10:26:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1db0065a90 msgr2=0x7f1db0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1db0065a90 0x7f1db0067f50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0b1000 tx=0x7f1dbc0b4040 comp rx=0 tx=0).stop 2023-12-18T10:26:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 msgr2=0x7f1dcc0c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c4930 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c3c0 tx=0x7f1dc800c880 comp rx=0 tx=0).stop 2023-12-18T10:26:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 shutdown_connections 2023-12-18T10:26:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f1db0065a90 0x7f1db0067f50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1dcc1570c0 0x7f1dcc14b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1dcc0c9e30 0x7f1dcc14aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 --2- 172.21.15.133:0/3046727214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dcc06c4f0 0x7f1dcc0c4930 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 >> 172.21.15.133:0/3046727214 conn(0x7f1dcc06a3e0 msgr2=0x7f1dcc15bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 shutdown_connections 2023-12-18T10:26:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:04.440+0000 7f1dd402d640 1 -- 172.21.15.133:0/3046727214 wait complete. 2023-12-18T10:26:04.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2023-12-18T10:26:05.045 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:26:05.044+0000 7f3bac1eb640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-18T10:26:05.459 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f678b441640 1 Processor -- start 2023-12-18T10:26:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f678b441640 1 -- start start 2023-12-18T10:26:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f678b441640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f678415a680 0x7f678415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f678b441640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67840cac10 0x7f678415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f678b441640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678415f100 con 0x7f678415afa0 2023-12-18T10:26:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f678b441640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67840ca7d0 con 0x7f67840cac10 2023-12-18T10:26:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f678b441640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678415e860 con 0x7f678415a680 2023-12-18T10:26:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f67889dc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67840cac10 0x7f678415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f67889dc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67840cac10 0x7f678415aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38584/0 (socket says 172.21.15.133:38584) 2023-12-18T10:26:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.600+0000 7f67889dc640 1 -- 172.21.15.133:0/2471953349 learned_addr learned my addr 172.21.15.133:0/2471953349 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f67891dd640 1 --2- 172.21.15.133:0/2471953349 >> v2:172.21.15.142:3300/0 conn(0x7f678415a680 0x7f678415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f67889dc640 1 -- 172.21.15.133:0/2471953349 >> v2:172.21.15.142:3300/0 conn(0x7f678415a680 msgr2=0x7f678415e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f67889dc640 1 --2- 172.21.15.133:0/2471953349 >> v2:172.21.15.142:3300/0 conn(0x7f678415a680 0x7f678415e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f67889dc640 1 -- 172.21.15.133:0/2471953349 >> v1:172.21.15.142:6789/0 conn(0x7f678415afa0 legacy=0x7f678406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f67889dc640 1 -- 172.21.15.133:0/2471953349 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678415eb40 con 0x7f67840cac10 2023-12-18T10:26:05.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f67889dc640 1 --2- 172.21.15.133:0/2471953349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f678415aa60 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f6774009870 tx=0x7f677401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d769e4f977dfd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:05.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f677bfff640 1 -- 172.21.15.133:0/2471953349 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67740a7070 con 0x7f67840cac10 2023-12-18T10:26:05.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f677bfff640 1 -- 172.21.15.133:0/2471953349 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67740ab430 con 0x7f67840cac10 2023-12-18T10:26:05.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.604+0000 7f677bfff640 1 -- 172.21.15.133:0/2471953349 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67740ab7c0 con 0x7f67840cac10 2023-12-18T10:26:05.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- 172.21.15.133:0/2471953349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 msgr2=0x7f678415aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:05.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 --2- 172.21.15.133:0/2471953349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f678415aa60 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f6774009870 tx=0x7f677401c430 comp rx=0 tx=0).stop 2023-12-18T10:26:05.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- 172.21.15.133:0/2471953349 shutdown_connections 2023-12-18T10:26:05.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 --2- 172.21.15.133:0/2471953349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f678415aa60 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 --2- 172.21.15.133:0/2471953349 >> v2:172.21.15.142:3300/0 conn(0x7f678415a680 0x7f678415e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- 172.21.15.133:0/2471953349 >> 172.21.15.133:0/2471953349 conn(0x7f678406a3e0 msgr2=0x7f67840afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:05.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- 172.21.15.133:0/2471953349 shutdown_connections 2023-12-18T10:26:05.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- 172.21.15.133:0/2471953349 wait complete. 2023-12-18T10:26:05.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 Processor -- start 2023-12-18T10:26:05.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- start start 2023-12-18T10:26:05.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f67840c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f678415a680 0x7f678406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678415afa0 0x7f6784150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840c7750 con 0x7f67840cac10 2023-12-18T10:26:05.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840c6eb0 con 0x7f678415afa0 2023-12-18T10:26:05.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f678b441640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67840c7190 con 0x7f678415a680 2023-12-18T10:26:05.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67891dd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f67840c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67891dd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f67840c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38596/0 (socket says 172.21.15.133:38596) 2023-12-18T10:26:05.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67891dd640 1 -- 172.21.15.133:0/405025051 learned_addr learned my addr 172.21.15.133:0/405025051 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:05.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67889dc640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f678415a680 0x7f678406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67899de640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678415afa0 0x7f6784150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67891dd640 1 -- 172.21.15.133:0/405025051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f678415a680 msgr2=0x7f678406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:05.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67891dd640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f678415a680 0x7f678406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67891dd640 1 -- 172.21.15.133:0/405025051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678415afa0 msgr2=0x7f6784150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67891dd640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678415afa0 0x7f6784150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.608+0000 7f67891dd640 1 -- 172.21.15.133:0/405025051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740094d0 con 0x7f67840cac10 2023-12-18T10:26:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f67891dd640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f67840c65b0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f678000d800 tx=0x7f678000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f6779ffb640 1 -- 172.21.15.133:0/405025051 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000b6c0 con 0x7f67840cac10 2023-12-18T10:26:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f6779ffb640 1 -- 172.21.15.133:0/405025051 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000b820 con 0x7f67840cac10 2023-12-18T10:26:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67840c7470 con 0x7f67840cac10 2023-12-18T10:26:05.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f6779ffb640 1 -- 172.21.15.133:0/405025051 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000bb90 con 0x7f67840cac10 2023-12-18T10:26:05.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67840c6af0 con 0x7f67840cac10 2023-12-18T10:26:05.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67840735b0 con 0x7f67840cac10 2023-12-18T10:26:05.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f6779ffb640 1 -- 172.21.15.133:0/405025051 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f678000bcf0 con 0x7f67840cac10 2023-12-18T10:26:05.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f6779ffb640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6768065a60 0x7f6768067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f6779ffb640 1 -- 172.21.15.133:0/405025051 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6780083800 con 0x7f67840cac10 2023-12-18T10:26:05.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.612+0000 7f67889dc640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6768065a60 0x7f6768067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.616+0000 7f67889dc640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6768065a60 0x7f6768067f20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f67740af000 tx=0x7f6774008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:05.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.616+0000 7f6779ffb640 1 -- 172.21.15.133:0/405025051 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6780051050 con 0x7f67840cac10 2023-12-18T10:26:05.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.796+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f678404e000 con 0x7f67840cac10 2023-12-18T10:26:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.796+0000 7f6779ffb640 1 -- 172.21.15.133:0/405025051 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7f6780054670 con 0x7f67840cac10 2023-12-18T10:26:05.798 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:05.798 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:26:05.798 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6768065a60 msgr2=0x7f6768067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6768065a60 0x7f6768067f20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f67740af000 tx=0x7f6774008040 comp rx=0 tx=0).stop 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 msgr2=0x7f67840c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f67840c65b0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f678000d800 tx=0x7f678000dcc0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 shutdown_connections 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6768065a60 0x7f6768067f20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f678415afa0 0x7f6784150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f678415a680 0x7f678406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 --2- 172.21.15.133:0/405025051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67840cac10 0x7f67840c65b0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 >> 172.21.15.133:0/405025051 conn(0x7f678406a3e0 msgr2=0x7f67840cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:05.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 shutdown_connections 2023-12-18T10:26:05.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.800+0000 7f678b441640 1 -- 172.21.15.133:0/405025051 wait complete. 2023-12-18T10:26:05.819 DEBUG:tasks.cephfs.test_multimds_misc:current active=['d', 'a', 'c'] 2023-12-18T10:26:05.819 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-18T10:26:05.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67154d1640 1 Processor -- start 2023-12-18T10:26:05.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67154d1640 1 -- start start 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67154d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67101570c0 0x7f671006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67154d1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f671006c320 0x7f67100c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67154d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67100c9e30 0x7f67100ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67154d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671006c7a0 con 0x7f67100c9e30 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67154d1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67100c9460 con 0x7f671006c320 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67154d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67101574a0 con 0x7f67101570c0 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67100c9e30 0x7f67100ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67100c9e30 0x7f67100ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38602/0 (socket says 172.21.15.133:38602) 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670f7fe640 1 -- 172.21.15.133:0/344997922 learned_addr learned my addr 172.21.15.133:0/344997922 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670effd640 1 --2- 172.21.15.133:0/344997922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67101570c0 0x7f671006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f67067fc640 1 --2- 172.21.15.133:0/344997922 >> v2:172.21.15.142:3300/0 conn(0x7f671006c320 0x7f67100c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670f7fe640 1 -- 172.21.15.133:0/344997922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67101570c0 msgr2=0x7f671006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670f7fe640 1 --2- 172.21.15.133:0/344997922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67101570c0 0x7f671006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670f7fe640 1 -- 172.21.15.133:0/344997922 >> v2:172.21.15.142:3300/0 conn(0x7f671006c320 msgr2=0x7f67100c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:05.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670f7fe640 1 --2- 172.21.15.133:0/344997922 >> v2:172.21.15.142:3300/0 conn(0x7f671006c320 0x7f67100c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.956+0000 7f670f7fe640 1 -- 172.21.15.133:0/344997922 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100c8b30 con 0x7f67100c9e30 2023-12-18T10:26:05.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f670f7fe640 1 --2- 172.21.15.133:0/344997922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67100c9e30 0x7f67100ca2c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f671006e0a0 tx=0x7f670801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7b5ae8472d9d86 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:05.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f670e7fc640 1 -- 172.21.15.133:0/344997922 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080a5790 con 0x7f67100c9e30 2023-12-18T10:26:05.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f670e7fc640 1 -- 172.21.15.133:0/344997922 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67080a58f0 con 0x7f67100c9e30 2023-12-18T10:26:05.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f670e7fc640 1 -- 172.21.15.133:0/344997922 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080a5c80 con 0x7f67100c9e30 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 -- 172.21.15.133:0/344997922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67100c9e30 msgr2=0x7f67100ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 --2- 172.21.15.133:0/344997922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67100c9e30 0x7f67100ca2c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f671006e0a0 tx=0x7f670801c910 comp rx=0 tx=0).stop 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 -- 172.21.15.133:0/344997922 shutdown_connections 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 --2- 172.21.15.133:0/344997922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67100c9e30 0x7f67100ca2c0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 --2- 172.21.15.133:0/344997922 >> v2:172.21.15.142:3300/0 conn(0x7f671006c320 0x7f67100c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 --2- 172.21.15.133:0/344997922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f67101570c0 0x7f671006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 -- 172.21.15.133:0/344997922 >> 172.21.15.133:0/344997922 conn(0x7f671006a3e0 msgr2=0x7f67100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 -- 172.21.15.133:0/344997922 shutdown_connections 2023-12-18T10:26:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.960+0000 7f67154d1640 1 -- 172.21.15.133:0/344997922 wait complete. 2023-12-18T10:26:05.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 Processor -- start 2023-12-18T10:26:05.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 -- start start 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f671006c320 0x7f67100c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67100c9e30 0x7f6710163640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67101570c0 0x7f6710163b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c7700 con 0x7f67101570c0 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c6b30 con 0x7f67100c9e30 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67100c6dd0 con 0x7f671006c320 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67101570c0 0x7f6710163b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f671006c320 0x7f67100c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67067fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67100c9e30 0x7f6710163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67101570c0 0x7f6710163b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38616/0 (socket says 172.21.15.133:38616) 2023-12-18T10:26:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670f7fe640 1 -- 172.21.15.133:0/328657027 learned_addr learned my addr 172.21.15.133:0/328657027 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670effd640 1 -- 172.21.15.133:0/328657027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67100c9e30 msgr2=0x7f6710163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670effd640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67100c9e30 0x7f6710163640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670effd640 1 -- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67101570c0 msgr2=0x7f6710163b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670effd640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67101570c0 0x7f6710163b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670effd640 1 -- 172.21.15.133:0/328657027 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009b30 con 0x7f671006c320 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67067fc640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67100c9e30 0x7f6710163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f670effd640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f671006c320 0x7f67100c7b90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f670000d5d0 tx=0x7f670000da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f6707fff640 1 -- 172.21.15.133:0/328657027 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000125f0 con 0x7f671006c320 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f6707fff640 1 -- 172.21.15.133:0/328657027 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700012750 con 0x7f671006c320 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f6707fff640 1 -- 172.21.15.133:0/328657027 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700012ae0 con 0x7f671006c320 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67100c70b0 con 0x7f671006c320 2023-12-18T10:26:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.964+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67100c80d0 con 0x7f671006c320 2023-12-18T10:26:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.968+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67100735b0 con 0x7f671006c320 2023-12-18T10:26:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.968+0000 7f6707fff640 1 -- 172.21.15.133:0/328657027 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6700012c40 con 0x7f671006c320 2023-12-18T10:26:05.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.968+0000 7f6707fff640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66f0065ab0 0x7f66f0067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:05.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.968+0000 7f6707fff640 1 -- 172.21.15.133:0/328657027 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6700083540 con 0x7f671006c320 2023-12-18T10:26:05.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.968+0000 7f67067fc640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66f0065ab0 0x7f66f0067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:05.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.968+0000 7f67067fc640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66f0065ab0 0x7f66f0067f70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f67101652e0 tx=0x7f66f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:05.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:05.972+0000 7f6707fff640 1 -- 172.21.15.133:0/328657027 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6700050e40 con 0x7f671006c320 2023-12-18T10:26:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.180+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f671004e000 con 0x7f671006c320 2023-12-18T10:26:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.180+0000 7f6707fff640 1 -- 172.21.15.133:0/328657027 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1918 (secure 0 0 0) 0x7f6700054460 con 0x7f671006c320 2023-12-18T10:26:06.182 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:06.182 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":506,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1702894672,"num_in_osds":8,"osd_in_since":1702894662,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700657,"bytes_used":266518528,"bytes_avail":772827594752,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":113,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"c","status":"up:active","gid":9039},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":9042},{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":9048}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2023-12-18T10:26:05.198652+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-18T10:26:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66f0065ab0 msgr2=0x7f66f0067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66f0065ab0 0x7f66f0067f70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f67101652e0 tx=0x7f66f8008040 comp rx=0 tx=0).stop 2023-12-18T10:26:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f671006c320 msgr2=0x7f67100c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f671006c320 0x7f67100c7b90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f670000d5d0 tx=0x7f670000da90 comp rx=0 tx=0).stop 2023-12-18T10:26:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 shutdown_connections 2023-12-18T10:26:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f66f0065ab0 0x7f66f0067f70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67101570c0 0x7f6710163b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67100c9e30 0x7f6710163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 --2- 172.21.15.133:0/328657027 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f671006c320 0x7f67100c7b90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 >> 172.21.15.133:0/328657027 conn(0x7f671006a3e0 msgr2=0x7f67100c4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 shutdown_connections 2023-12-18T10:26:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.184+0000 7f67154d1640 1 -- 172.21.15.133:0/328657027 wait complete. 2023-12-18T10:26:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2023-12-18T10:26:06.204 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-18T10:26:06.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:26:06.301 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-18T10:26:06.347 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-18T10:26:06.347 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:26:06.347 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:26:06.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:26:06.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31de2a640 1 Processor -- start 2023-12-18T10:26:06.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31de2a640 1 -- start start 2023-12-18T10:26:06.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31de2a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd31815c730 0x7fd3180b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31de2a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180cea00 0x7fd3180cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31de2a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180b65c0 con 0x7fd3180cd3a0 2023-12-18T10:26:06.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31de2a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31815cb10 con 0x7fd31815c730 2023-12-18T10:26:06.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31de2a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180b84c0 con 0x7fd3180cea00 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd317fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180cea00 0x7fd3180cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31ce28640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd31815c730 0x7fd3180b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd317fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180cea00 0x7fd3180cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:42148/0 (socket says 172.21.15.133:42148) 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd317fff640 1 -- 172.21.15.133:0/967482725 learned_addr learned my addr 172.21.15.133:0/967482725 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd317fff640 1 -- 172.21.15.133:0/967482725 >> v2:172.21.15.142:3300/0 conn(0x7fd31815c730 msgr2=0x7fd3180b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd317fff640 1 --2- 172.21.15.133:0/967482725 >> v2:172.21.15.142:3300/0 conn(0x7fd31815c730 0x7fd3180b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd317fff640 1 -- 172.21.15.133:0/967482725 >> v1:172.21.15.142:6789/0 conn(0x7fd3180cd3a0 legacy=0x7fd3180b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd317fff640 1 -- 172.21.15.133:0/967482725 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180cd960 con 0x7fd3180cea00 2023-12-18T10:26:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.540+0000 7fd31ce28640 1 --2- 172.21.15.133:0/967482725 >> v2:172.21.15.142:3300/0 conn(0x7fd31815c730 0x7fd3180b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd317fff640 1 --2- 172.21.15.133:0/967482725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180cea00 0x7fd3180cef60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd304009870 tx=0x7fd30401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d9f1bf75ba3b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd3177fe640 1 -- 172.21.15.133:0/967482725 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3040a8a30 con 0x7fd3180cea00 2023-12-18T10:26:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd3177fe640 1 -- 172.21.15.133:0/967482725 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3040a8b90 con 0x7fd3180cea00 2023-12-18T10:26:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd3177fe640 1 -- 172.21.15.133:0/967482725 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3040b0440 con 0x7fd3180cea00 2023-12-18T10:26:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd31de2a640 1 -- 172.21.15.133:0/967482725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180cea00 msgr2=0x7fd3180cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd31de2a640 1 --2- 172.21.15.133:0/967482725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180cea00 0x7fd3180cef60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd304009870 tx=0x7fd30401ed30 comp rx=0 tx=0).stop 2023-12-18T10:26:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd31de2a640 1 -- 172.21.15.133:0/967482725 shutdown_connections 2023-12-18T10:26:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd31de2a640 1 --2- 172.21.15.133:0/967482725 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd3180cea00 0x7fd3180cef60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd31de2a640 1 --2- 172.21.15.133:0/967482725 >> v2:172.21.15.142:3300/0 conn(0x7fd31815c730 0x7fd3180b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd31de2a640 1 -- 172.21.15.133:0/967482725 >> 172.21.15.133:0/967482725 conn(0x7fd31806b120 msgr2=0x7fd31806b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd31de2a640 1 -- 172.21.15.133:0/967482725 shutdown_connections 2023-12-18T10:26:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.544+0000 7fd31de2a640 1 -- 172.21.15.133:0/967482725 wait complete. 2023-12-18T10:26:06.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 Processor -- start 2023-12-18T10:26:06.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 -- start start 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180cd3a0 0x7fd318143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180cea00 0x7fd31815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd31815c730 0x7fd31815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd318158520 con 0x7fd3180cd3a0 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31815e240 con 0x7fd3180cea00 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31815dc80 con 0x7fd31815c730 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180cd3a0 0x7fd318143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180cd3a0 0x7fd318143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38632/0 (socket says 172.21.15.133:38632) 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 -- 172.21.15.133:0/1209632909 learned_addr learned my addr 172.21.15.133:0/1209632909 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd317fff640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180cea00 0x7fd31815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31d629640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd31815c730 0x7fd31815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 -- 172.21.15.133:0/1209632909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd31815c730 msgr2=0x7fd31815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd31815c730 0x7fd31815ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 -- 172.21.15.133:0/1209632909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180cea00 msgr2=0x7fd31815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180cea00 0x7fd31815ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 -- 172.21.15.133:0/1209632909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009420 con 0x7fd3180cd3a0 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31ce28640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180cd3a0 0x7fd318143730 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00e980 tx=0x7fd30c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd3157fa640 1 -- 172.21.15.133:0/1209632909 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c00ca00 con 0x7fd3180cd3a0 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd3157fa640 1 -- 172.21.15.133:0/1209632909 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c00cb60 con 0x7fd3180cd3a0 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3040094d0 con 0x7fd3180cd3a0 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd3157fa640 1 -- 172.21.15.133:0/1209632909 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c013470 con 0x7fd3180cd3a0 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3180c96c0 con 0x7fd3180cd3a0 2023-12-18T10:26:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.548+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd318066c50 con 0x7fd3180cd3a0 2023-12-18T10:26:06.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.552+0000 7fd3157fa640 1 -- 172.21.15.133:0/1209632909 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd30c0135d0 con 0x7fd3180cd3a0 2023-12-18T10:26:06.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.552+0000 7fd3157fa640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2fc065a60 0x7fd2fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.552+0000 7fd3157fa640 1 -- 172.21.15.133:0/1209632909 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd30c083610 con 0x7fd3180cd3a0 2023-12-18T10:26:06.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.552+0000 7fd317fff640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2fc065a60 0x7fd2fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.552+0000 7fd317fff640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2fc065a60 0x7fd2fc067f20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd3040b2000 tx=0x7fd304008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:06.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.556+0000 7fd3157fa640 1 -- 172.21.15.133:0/1209632909 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd30c050dd0 con 0x7fd3180cd3a0 2023-12-18T10:26:06.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.712+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd31804e850 con 0x7fd3180cd3a0 2023-12-18T10:26:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.712+0000 7fd3157fa640 1 -- 172.21.15.133:0/1209632909 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16346 (secure 0 0 0) 0x7fd30c0543f0 con 0x7fd3180cd3a0 2023-12-18T10:26:06.713 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:06.713 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":107,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:25:48.135263+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:25:17.041912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-18T10:25:17.544282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.22","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:26:06.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2fc065a60 msgr2=0x7fd2fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2fc065a60 0x7fd2fc067f20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd3040b2000 tx=0x7fd304008040 comp rx=0 tx=0).stop 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180cd3a0 msgr2=0x7fd318143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180cd3a0 0x7fd318143730 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00e980 tx=0x7fd30c00ee40 comp rx=0 tx=0).stop 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 shutdown_connections 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd2fc065a60 0x7fd2fc067f20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd31815c730 0x7fd31815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3180cea00 0x7fd31815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 --2- 172.21.15.133:0/1209632909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3180cd3a0 0x7fd318143730 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 >> 172.21.15.133:0/1209632909 conn(0x7fd31806b120 msgr2=0x7fd318153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 shutdown_connections 2023-12-18T10:26:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.716+0000 7fd31de2a640 1 -- 172.21.15.133:0/1209632909 wait complete. 2023-12-18T10:26:06.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:25:17.041912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:25:17.544282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:26:06.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:26:06.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.872+0000 7f45b0ae5640 1 Processor -- start 2023-12-18T10:26:06.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.872+0000 7f45b0ae5640 1 -- start start 2023-12-18T10:26:06.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45b0ae5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45ac071870 0x7f45ac071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45b0ae5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45ac0cbff0 0x7f45ac0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45b0ae5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac0cc930 con 0x7f45ac0ca410 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45b0ae5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac15aab0 con 0x7f45ac0cbff0 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45b0ae5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac070df0 con 0x7f45ac071870 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45aad9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45ac0cbff0 0x7f45ac0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45aad9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45ac0cbff0 0x7f45ac0cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38634/0 (socket says 172.21.15.133:38634) 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45aad9d640 1 -- 172.21.15.133:0/1492299559 learned_addr learned my addr 172.21.15.133:0/1492299559 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45a3fff640 1 --2- 172.21.15.133:0/1492299559 >> v2:172.21.15.142:3300/0 conn(0x7f45ac071870 0x7f45ac071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45aad9d640 1 -- 172.21.15.133:0/1492299559 >> v2:172.21.15.142:3300/0 conn(0x7f45ac071870 msgr2=0x7f45ac071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45aad9d640 1 --2- 172.21.15.133:0/1492299559 >> v2:172.21.15.142:3300/0 conn(0x7f45ac071870 0x7f45ac071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45aad9d640 1 -- 172.21.15.133:0/1492299559 >> v1:172.21.15.142:6789/0 conn(0x7f45ac0ca410 legacy=0x7f45ac159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:06.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.876+0000 7f45aad9d640 1 -- 172.21.15.133:0/1492299559 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac15a4f0 con 0x7f45ac0cbff0 2023-12-18T10:26:06.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45aad9d640 1 --2- 172.21.15.133:0/1492299559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0cbff0 0x7f45ac0cc3f0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0c1ef0 tx=0x7f45a401eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c48d8b833f5cff8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:06.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45a9d9b640 1 -- 172.21.15.133:0/1492299559 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a40a7a20 con 0x7f45ac0cbff0 2023-12-18T10:26:06.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45a9d9b640 1 -- 172.21.15.133:0/1492299559 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a40a7b80 con 0x7f45ac0cbff0 2023-12-18T10:26:06.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45a9d9b640 1 -- 172.21.15.133:0/1492299559 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a40af3f0 con 0x7f45ac0cbff0 2023-12-18T10:26:06.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 -- 172.21.15.133:0/1492299559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0cbff0 msgr2=0x7f45ac0cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/1492299559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0cbff0 0x7f45ac0cc3f0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0c1ef0 tx=0x7f45a401eb50 comp rx=0 tx=0).stop 2023-12-18T10:26:06.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 -- 172.21.15.133:0/1492299559 shutdown_connections 2023-12-18T10:26:06.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/1492299559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0cbff0 0x7f45ac0cc3f0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/1492299559 >> v2:172.21.15.142:3300/0 conn(0x7f45ac071870 0x7f45ac071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 -- 172.21.15.133:0/1492299559 >> 172.21.15.133:0/1492299559 conn(0x7f45ac06a2a0 msgr2=0x7f45ac0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:06.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 -- 172.21.15.133:0/1492299559 shutdown_connections 2023-12-18T10:26:06.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 -- 172.21.15.133:0/1492299559 wait complete. 2023-12-18T10:26:06.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 Processor -- start 2023-12-18T10:26:06.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.880+0000 7f45b0ae5640 1 -- start start 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45ac071870 0x7f45ac1489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0ca410 0x7f45ac155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45ac0cbff0 0x7f45ac14db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac156500 con 0x7f45ac0ca410 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac158960 con 0x7f45ac0cbff0 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac158bb0 con 0x7f45ac071870 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0ca410 0x7f45ac155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0ca410 0x7f45ac155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38650/0 (socket says 172.21.15.133:38650) 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 -- 172.21.15.133:0/3293483524 learned_addr learned my addr 172.21.15.133:0/3293483524 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45aa59c640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45ac071870 0x7f45ac1489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45aad9d640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45ac0cbff0 0x7f45ac14db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 -- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45ac071870 msgr2=0x7f45ac1489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45ac071870 0x7f45ac1489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 -- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45ac0cbff0 msgr2=0x7f45ac14db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:06.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45ac0cbff0 0x7f45ac14db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:06.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 -- 172.21.15.133:0/3293483524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4009b30 con 0x7f45ac0ca410 2023-12-18T10:26:06.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45aa59c640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45ac071870 0x7f45ac1489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:06.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45aad9d640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45ac0cbff0 0x7f45ac14db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:06.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a3fff640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0ca410 0x7f45ac155fc0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f459400d620 tx=0x7f459400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:06.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a2ffd640 1 -- 172.21.15.133:0/3293483524 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400b620 con 0x7f45ac0ca410 2023-12-18T10:26:06.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a2ffd640 1 -- 172.21.15.133:0/3293483524 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459400b780 con 0x7f45ac0ca410 2023-12-18T10:26:06.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a2ffd640 1 -- 172.21.15.133:0/3293483524 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459400bb10 con 0x7f45ac0ca410 2023-12-18T10:26:06.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac158e90 con 0x7f45ac0ca410 2023-12-18T10:26:06.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac0af010 con 0x7f45ac0ca410 2023-12-18T10:26:06.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0af1d0 con 0x7f45ac0ca410 2023-12-18T10:26:06.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.884+0000 7f45a2ffd640 1 -- 172.21.15.133:0/3293483524 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f459400bc70 con 0x7f45ac0ca410 2023-12-18T10:26:06.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.888+0000 7f45a2ffd640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f458c065a60 0x7f458c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:06.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.888+0000 7f45a2ffd640 1 -- 172.21.15.133:0/3293483524 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4594083750 con 0x7f45ac0ca410 2023-12-18T10:26:06.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.888+0000 7f45aa59c640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f458c065a60 0x7f458c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:06.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.888+0000 7f45aa59c640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f458c065a60 0x7f458c067f20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f459c003ec0 tx=0x7f459c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:06.892+0000 7f45a2ffd640 1 -- 172.21.15.133:0/3293483524 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4594051040 con 0x7f45ac0ca410 2023-12-18T10:26:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45ac04e000 con 0x7f45ac0ca410 2023-12-18T10:26:07.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45a2ffd640 1 -- 172.21.15.133:0/3293483524 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4594054660 con 0x7f45ac0ca410 2023-12-18T10:26:07.044 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:26:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f458c065a60 msgr2=0x7f458c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f458c065a60 0x7f458c067f20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f459c003ec0 tx=0x7f459c009040 comp rx=0 tx=0).stop 2023-12-18T10:26:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0ca410 msgr2=0x7f45ac155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0ca410 0x7f45ac155fc0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f459400d620 tx=0x7f459400dae0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 shutdown_connections 2023-12-18T10:26:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f458c065a60 0x7f458c067f20 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45ac0cbff0 0x7f45ac14db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45ac0ca410 0x7f45ac155fc0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 --2- 172.21.15.133:0/3293483524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45ac071870 0x7f45ac1489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 >> 172.21.15.133:0/3293483524 conn(0x7f45ac06a2a0 msgr2=0x7f45ac152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 shutdown_connections 2023-12-18T10:26:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.044+0000 7f45b0ae5640 1 -- 172.21.15.133:0/3293483524 wait complete. 2023-12-18T10:26:07.065 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:26:07.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd624b6640 1 Processor -- start 2023-12-18T10:26:07.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd624b6640 1 -- start start 2023-12-18T10:26:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd624b6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd5c0ca410 0x7fbd5c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd624b6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbd5c159fb0 0x7fbd5c071870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd624b6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5c070df0 con 0x7fbd5c071db0 2023-12-18T10:26:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd624b6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5c15aab0 con 0x7fbd5c0ca410 2023-12-18T10:26:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd624b6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5c15a4f0 con 0x7fbd5c159fb0 2023-12-18T10:26:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd5bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd5c0ca410 0x7fbd5c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd60a53640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbd5c071db0 0x7fbd5c0cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44522/0 (socket says 172.21.15.133:44522) 2023-12-18T10:26:07.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd60a53640 1 -- 172.21.15.133:0/4132625891 learned_addr learned my addr 172.21.15.133:0/4132625891 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:07.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd5b7fe640 1 --2- 172.21.15.133:0/4132625891 >> v2:172.21.15.142:3300/0 conn(0x7fbd5c159fb0 0x7fbd5c071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd5bfff640 1 -- 172.21.15.133:0/4132625891 >> v2:172.21.15.142:3300/0 conn(0x7fbd5c159fb0 msgr2=0x7fbd5c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:07.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd5bfff640 1 --2- 172.21.15.133:0/4132625891 >> v2:172.21.15.142:3300/0 conn(0x7fbd5c159fb0 0x7fbd5c071870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd5affd640 1 -- 172.21.15.133:0/4132625891 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534505145 0 0) 0x7fbd5c070df0 con 0x7fbd5c071db0 2023-12-18T10:26:07.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd5bfff640 1 -- 172.21.15.133:0/4132625891 >> v1:172.21.15.133:6789/0 conn(0x7fbd5c071db0 legacy=0x7fbd5c0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd5bfff640 1 -- 172.21.15.133:0/4132625891 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c15a7d0 con 0x7fbd5c0ca410 2023-12-18T10:26:07.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.208+0000 7fbd5b7fe640 1 --2- 172.21.15.133:0/4132625891 >> v2:172.21.15.142:3300/0 conn(0x7fbd5c159fb0 0x7fbd5c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:07.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd5bfff640 1 --2- 172.21.15.133:0/4132625891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c0ca410 0x7fbd5c159a70 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0cbeb0 tx=0x7fbd4c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386538dc195bc0bd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd5affd640 1 -- 172.21.15.133:0/4132625891 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0ab600 con 0x7fbd5c0ca410 2023-12-18T10:26:07.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd5affd640 1 -- 172.21.15.133:0/4132625891 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c0a7050 con 0x7fbd5c0ca410 2023-12-18T10:26:07.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd5affd640 1 -- 172.21.15.133:0/4132625891 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0ab980 con 0x7fbd5c0ca410 2023-12-18T10:26:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd624b6640 1 -- 172.21.15.133:0/4132625891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c0ca410 msgr2=0x7fbd5c159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd624b6640 1 --2- 172.21.15.133:0/4132625891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c0ca410 0x7fbd5c159a70 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0cbeb0 tx=0x7fbd4c01c430 comp rx=0 tx=0).stop 2023-12-18T10:26:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd624b6640 1 -- 172.21.15.133:0/4132625891 shutdown_connections 2023-12-18T10:26:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd624b6640 1 --2- 172.21.15.133:0/4132625891 >> v2:172.21.15.142:3300/0 conn(0x7fbd5c159fb0 0x7fbd5c071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd624b6640 1 --2- 172.21.15.133:0/4132625891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c0ca410 0x7fbd5c159a70 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd624b6640 1 -- 172.21.15.133:0/4132625891 >> 172.21.15.133:0/4132625891 conn(0x7fbd5c06a2a0 msgr2=0x7fbd5c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd624b6640 1 -- 172.21.15.133:0/4132625891 shutdown_connections 2023-12-18T10:26:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.212+0000 7fbd624b6640 1 -- 172.21.15.133:0/4132625891 wait complete. 2023-12-18T10:26:07.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 Processor -- start 2023-12-18T10:26:07.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 -- start start 2023-12-18T10:26:07.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c071db0 0x7fbd5c150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd5c0ca410 0x7fbd5c0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd5c159fb0 0x7fbd5c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c15bfa0 con 0x7fbd5c071db0 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c0a81d0 con 0x7fbd5c0ca410 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c15b9e0 con 0x7fbd5c159fb0 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c071db0 0x7fbd5c150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c071db0 0x7fbd5c150680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38662/0 (socket says 172.21.15.133:38662) 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 -- 172.21.15.133:0/2892573151 learned_addr learned my addr 172.21.15.133:0/2892573151 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd60a53640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd5c159fb0 0x7fbd5c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5b7fe640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd5c0ca410 0x7fbd5c0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 -- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd5c159fb0 msgr2=0x7fbd5c0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd5c159fb0 0x7fbd5c0b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 -- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd5c0ca410 msgr2=0x7fbd5c0aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd5c0ca410 0x7fbd5c0aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 -- 172.21.15.133:0/2892573151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c009420 con 0x7fbd5c071db0 2023-12-18T10:26:07.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5b7fe640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd5c0ca410 0x7fbd5c0aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:07.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd60a53640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd5c159fb0 0x7fbd5c0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:07.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd5bfff640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c071db0 0x7fbd5c150680 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c01a060 tx=0x7fbd4c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd58ff9640 1 -- 172.21.15.133:0/2892573151 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c004230 con 0x7fbd5c071db0 2023-12-18T10:26:07.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd58ff9640 1 -- 172.21.15.133:0/2892573151 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c004390 con 0x7fbd5c071db0 2023-12-18T10:26:07.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5c15bcc0 con 0x7fbd5c071db0 2023-12-18T10:26:07.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd58ff9640 1 -- 172.21.15.133:0/2892573151 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c003820 con 0x7fbd5c071db0 2023-12-18T10:26:07.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.216+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c0ad7a0 con 0x7fbd5c071db0 2023-12-18T10:26:07.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.220+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5c0ad320 con 0x7fbd5c071db0 2023-12-18T10:26:07.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.220+0000 7fbd58ff9640 1 -- 172.21.15.133:0/2892573151 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd4c0b2040 con 0x7fbd5c071db0 2023-12-18T10:26:07.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.220+0000 7fbd58ff9640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd48065a60 0x7fbd48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.220+0000 7fbd58ff9640 1 -- 172.21.15.133:0/2892573151 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbd4c11c760 con 0x7fbd5c071db0 2023-12-18T10:26:07.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.220+0000 7fbd5b7fe640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd48065a60 0x7fbd48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.220+0000 7fbd5b7fe640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd48065a60 0x7fbd48067f20 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c1531e0 tx=0x7fbd50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.224+0000 7fbd58ff9640 1 -- 172.21.15.133:0/2892573151 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbd5c0ad320 con 0x7fbd5c071db0 2023-12-18T10:26:07.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd5c0ad320 con 0x7fbd5c071db0 2023-12-18T10:26:07.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd58ff9640 1 -- 172.21.15.133:0/2892573151 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd5c0ad320 con 0x7fbd5c071db0 2023-12-18T10:26:07.379 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd48065a60 msgr2=0x7fbd48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd48065a60 0x7fbd48067f20 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c1531e0 tx=0x7fbd50008040 comp rx=0 tx=0).stop 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c071db0 msgr2=0x7fbd5c150680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c071db0 0x7fbd5c150680 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c01a060 tx=0x7fbd4c0191d0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 shutdown_connections 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbd48065a60 0x7fbd48067f20 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbd5c159fb0 0x7fbd5c0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd5c0ca410 0x7fbd5c0aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 --2- 172.21.15.133:0/2892573151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd5c071db0 0x7fbd5c150680 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 >> 172.21.15.133:0/2892573151 conn(0x7fbd5c06a2a0 msgr2=0x7fbd5c15c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 shutdown_connections 2023-12-18T10:26:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.380+0000 7fbd624b6640 1 -- 172.21.15.133:0/2892573151 wait complete. 2023-12-18T10:26:07.401 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:26:07.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39f0ec4640 1 Processor -- start 2023-12-18T10:26:07.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39f0ec4640 1 -- start start 2023-12-18T10:26:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39f0ec4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 0x7f39ec0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39f0ec4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f39ec0cf170 0x7f39ec0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39f0ec4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ec15cec0 con 0x7f39ec15cae0 2023-12-18T10:26:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39f0ec4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ec0cfb40 con 0x7f39ec0cf170 2023-12-18T10:26:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39f0ec4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0d0530 con 0x7f39ec0cde90 2023-12-18T10:26:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39ead9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f39ec0cf170 0x7f39ec0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39ea59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f39ec15cae0 0x7f39ec0d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44530/0 (socket says 172.21.15.133:44530) 2023-12-18T10:26:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39ea59c640 1 -- 172.21.15.133:0/2461740149 learned_addr learned my addr 172.21.15.133:0/2461740149 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:07.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39e1d9b640 1 --2- 172.21.15.133:0/2461740149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 0x7f39ec0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39ead9d640 1 -- 172.21.15.133:0/2461740149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 msgr2=0x7f39ec0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:07.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39ead9d640 1 --2- 172.21.15.133:0/2461740149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 0x7f39ec0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39ead9d640 1 -- 172.21.15.133:0/2461740149 >> v1:172.21.15.133:6789/0 conn(0x7f39ec15cae0 legacy=0x7f39ec0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39ead9d640 1 -- 172.21.15.133:0/2461740149 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec0d0810 con 0x7f39ec0cf170 2023-12-18T10:26:07.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.540+0000 7f39e9d9b640 1 -- 172.21.15.133:0/2461740149 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943626287 0 0) 0x7f39ec15cec0 con 0x7f39ec15cae0 2023-12-18T10:26:07.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39ead9d640 1 --2- 172.21.15.133:0/2461740149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec0cf170 0x7f39ec0cf600 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009d90 tx=0x7f39e401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11b821ae58a81ba server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39e9d9b640 1 -- 172.21.15.133:0/2461740149 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40a59e0 con 0x7f39ec0cf170 2023-12-18T10:26:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39e9d9b640 1 -- 172.21.15.133:0/2461740149 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e40a5b40 con 0x7f39ec0cf170 2023-12-18T10:26:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39e9d9b640 1 -- 172.21.15.133:0/2461740149 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40ad440 con 0x7f39ec0cf170 2023-12-18T10:26:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39f0ec4640 1 -- 172.21.15.133:0/2461740149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec0cf170 msgr2=0x7f39ec0cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/2461740149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec0cf170 0x7f39ec0cf600 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009d90 tx=0x7f39e401c920 comp rx=0 tx=0).stop 2023-12-18T10:26:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39f0ec4640 1 -- 172.21.15.133:0/2461740149 shutdown_connections 2023-12-18T10:26:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/2461740149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec0cf170 0x7f39ec0cf600 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/2461740149 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 0x7f39ec0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39f0ec4640 1 -- 172.21.15.133:0/2461740149 >> 172.21.15.133:0/2461740149 conn(0x7f39ec089fb0 msgr2=0x7f39ec0d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39f0ec4640 1 -- 172.21.15.133:0/2461740149 shutdown_connections 2023-12-18T10:26:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.544+0000 7f39f0ec4640 1 -- 172.21.15.133:0/2461740149 wait complete. 2023-12-18T10:26:07.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 Processor -- start 2023-12-18T10:26:07.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 -- start start 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 0x7f39ec156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ec0cf170 0x7f39ec157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec15cae0 0x7f39ec0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0c6330 con 0x7f39ec15cae0 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0cbd90 con 0x7f39ec0cf170 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec0cc070 con 0x7f39ec0cde90 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec15cae0 0x7f39ec0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec15cae0 0x7f39ec0b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38676/0 (socket says 172.21.15.133:38676) 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 -- 172.21.15.133:0/287624425 learned_addr learned my addr 172.21.15.133:0/287624425 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39e1d9b640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ec0cf170 0x7f39ec157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ea59c640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 0x7f39ec156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 -- 172.21.15.133:0/287624425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 msgr2=0x7f39ec156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 0x7f39ec156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 -- 172.21.15.133:0/287624425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ec0cf170 msgr2=0x7f39ec157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ec0cf170 0x7f39ec157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 -- 172.21.15.133:0/287624425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4009a70 con 0x7f39ec15cae0 2023-12-18T10:26:07.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39ead9d640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec15cae0 0x7f39ec0b0aa0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f39e401afd0 tx=0x7f39e40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39e37fe640 1 -- 172.21.15.133:0/287624425 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40add90 con 0x7f39ec15cae0 2023-12-18T10:26:07.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39e37fe640 1 -- 172.21.15.133:0/287624425 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e4009450 con 0x7f39ec15cae0 2023-12-18T10:26:07.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ec0cc350 con 0x7f39ec15cae0 2023-12-18T10:26:07.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39e37fe640 1 -- 172.21.15.133:0/287624425 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40b9670 con 0x7f39ec15cae0 2023-12-18T10:26:07.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.548+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec1574e0 con 0x7f39ec15cae0 2023-12-18T10:26:07.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.552+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ec0c64a0 con 0x7f39ec15cae0 2023-12-18T10:26:07.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.552+0000 7f39e37fe640 1 -- 172.21.15.133:0/287624425 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39e40039a0 con 0x7f39ec15cae0 2023-12-18T10:26:07.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.552+0000 7f39e37fe640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f39cc065a90 0x7f39cc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.552+0000 7f39e37fe640 1 -- 172.21.15.133:0/287624425 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39e411eb30 con 0x7f39ec15cae0 2023-12-18T10:26:07.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.552+0000 7f39ea59c640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f39cc065a90 0x7f39cc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.552+0000 7f39ea59c640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f39cc065a90 0x7f39cc067f50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f39d40016e0 tx=0x7f39d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.556+0000 7f39e37fe640 1 -- 172.21.15.133:0/287624425 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39e40ec380 con 0x7f39ec15cae0 2023-12-18T10:26:07.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.708+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39ec0cc800 con 0x7f39ec15cae0 2023-12-18T10:26:07.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.708+0000 7f39e37fe640 1 -- 172.21.15.133:0/287624425 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39e40ef9a0 con 0x7f39ec15cae0 2023-12-18T10:26:07.709 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:26:07.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f39cc065a90 msgr2=0x7f39cc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f39cc065a90 0x7f39cc067f50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f39d40016e0 tx=0x7f39d4009040 comp rx=0 tx=0).stop 2023-12-18T10:26:07.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec15cae0 msgr2=0x7f39ec0b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec15cae0 0x7f39ec0b0aa0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f39e401afd0 tx=0x7f39e40196c0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 shutdown_connections 2023-12-18T10:26:07.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f39cc065a90 0x7f39cc067f50 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39ec15cae0 0x7f39ec0b0aa0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39ec0cf170 0x7f39ec157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 --2- 172.21.15.133:0/287624425 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39ec0cde90 0x7f39ec156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 >> 172.21.15.133:0/287624425 conn(0x7f39ec089fb0 msgr2=0x7f39ec0b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:07.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 shutdown_connections 2023-12-18T10:26:07.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.712+0000 7f39f0ec4640 1 -- 172.21.15.133:0/287624425 wait complete. 2023-12-18T10:26:07.731 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-18T10:26:07.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f9035edf640 1 Processor -- start 2023-12-18T10:26:07.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f9035edf640 1 -- start start 2023-12-18T10:26:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f9035edf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903015ca40 0x7f90300cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f9035edf640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90300cf7e0 0x7f90301668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f9035edf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90300d11c0 con 0x7f90300ce3f0 2023-12-18T10:26:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f9035edf640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90300d0310 con 0x7f90300cf7e0 2023-12-18T10:26:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f9035edf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90300d05b0 con 0x7f903015ca40 2023-12-18T10:26:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90300cf7e0 0x7f90301668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90300cf7e0 0x7f90301668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38682/0 (socket says 172.21.15.133:38682) 2023-12-18T10:26:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902ffff640 1 -- 172.21.15.133:0/4223080470 learned_addr learned my addr 172.21.15.133:0/4223080470 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902f7fe640 1 --2- 172.21.15.133:0/4223080470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903015ca40 0x7f90300cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902ffff640 1 -- 172.21.15.133:0/4223080470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903015ca40 msgr2=0x7f90300cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902ffff640 1 --2- 172.21.15.133:0/4223080470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903015ca40 0x7f90300cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902ffff640 1 -- 172.21.15.133:0/4223080470 >> v1:172.21.15.142:6789/0 conn(0x7f90300ce3f0 legacy=0x7f90300cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902ffff640 1 -- 172.21.15.133:0/4223080470 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90300d0890 con 0x7f90300cf7e0 2023-12-18T10:26:07.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.868+0000 7f902f7fe640 1 --2- 172.21.15.133:0/4223080470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903015ca40 0x7f90300cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:07.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f902ffff640 1 --2- 172.21.15.133:0/4223080470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90300cf7e0 0x7f90301668e0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f9028009e50 tx=0x7f902801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70868862deafd149 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f902e7fc640 1 -- 172.21.15.133:0/4223080470 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90280a58e0 con 0x7f90300cf7e0 2023-12-18T10:26:07.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f902e7fc640 1 -- 172.21.15.133:0/4223080470 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90280a5a40 con 0x7f90300cf7e0 2023-12-18T10:26:07.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f902e7fc640 1 -- 172.21.15.133:0/4223080470 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90280a5dd0 con 0x7f90300cf7e0 2023-12-18T10:26:07.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f9035edf640 1 -- 172.21.15.133:0/4223080470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90300cf7e0 msgr2=0x7f90301668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f9035edf640 1 --2- 172.21.15.133:0/4223080470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90300cf7e0 0x7f90301668e0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f9028009e50 tx=0x7f902801ca10 comp rx=0 tx=0).stop 2023-12-18T10:26:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f9035edf640 1 -- 172.21.15.133:0/4223080470 shutdown_connections 2023-12-18T10:26:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f9035edf640 1 --2- 172.21.15.133:0/4223080470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90300cf7e0 0x7f90301668e0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f9035edf640 1 --2- 172.21.15.133:0/4223080470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f903015ca40 0x7f90300cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f9035edf640 1 -- 172.21.15.133:0/4223080470 >> 172.21.15.133:0/4223080470 conn(0x7f9030089fb0 msgr2=0x7f90300d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f9035edf640 1 -- 172.21.15.133:0/4223080470 shutdown_connections 2023-12-18T10:26:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.872+0000 7f9035edf640 1 -- 172.21.15.133:0/4223080470 wait complete. 2023-12-18T10:26:07.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 Processor -- start 2023-12-18T10:26:07.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 -- start start 2023-12-18T10:26:07.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90300ce3f0 0x7f90301fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90300cf7e0 0x7f9030159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f903015ca40 0x7f9030159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300ca850 con 0x7f903015ca40 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90301fd470 con 0x7f90300ce3f0 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90300cb260 con 0x7f90300cf7e0 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f903015ca40 0x7f9030159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f903015ca40 0x7f9030159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38696/0 (socket says 172.21.15.133:38696) 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 -- 172.21.15.133:0/1837864880 learned_addr learned my addr 172.21.15.133:0/1837864880 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902f7fe640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90300ce3f0 0x7f90301fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902effd640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90300cf7e0 0x7f9030159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 -- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90300cf7e0 msgr2=0x7f9030159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90300cf7e0 0x7f9030159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 -- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90300ce3f0 msgr2=0x7f90301fcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90300ce3f0 0x7f90301fcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 -- 172.21.15.133:0/1837864880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9028009b30 con 0x7f903015ca40 2023-12-18T10:26:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902f7fe640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90300ce3f0 0x7f90301fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f902ffff640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f903015ca40 0x7f9030159790 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f902801a640 tx=0x7f90280197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9017fff640 1 -- 172.21.15.133:0/1837864880 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90280b8640 con 0x7f903015ca40 2023-12-18T10:26:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9017fff640 1 -- 172.21.15.133:0/1837864880 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90280b87a0 con 0x7f903015ca40 2023-12-18T10:26:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90300c9cd0 con 0x7f903015ca40 2023-12-18T10:26:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.876+0000 7f9017fff640 1 -- 172.21.15.133:0/1837864880 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90280b8b30 con 0x7f903015ca40 2023-12-18T10:26:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.880+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90300ca290 con 0x7f903015ca40 2023-12-18T10:26:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.880+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903004e000 con 0x7f903015ca40 2023-12-18T10:26:07.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.880+0000 7f9017fff640 1 -- 172.21.15.133:0/1837864880 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90280b8c90 con 0x7f903015ca40 2023-12-18T10:26:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.880+0000 7f9017fff640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f901c065a30 0x7f901c067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.880+0000 7f9017fff640 1 -- 172.21.15.133:0/1837864880 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f902811e9f0 con 0x7f903015ca40 2023-12-18T10:26:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.880+0000 7f902f7fe640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f901c065a30 0x7f901c067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.880+0000 7f902f7fe640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f901c065a30 0x7f901c067ef0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9020006fd0 tx=0x7f9020008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:07.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:07.884+0000 7f9017fff640 1 -- 172.21.15.133:0/1837864880 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f90280ec1b0 con 0x7f903015ca40 2023-12-18T10:26:08.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90300cff10 con 0x7f903015ca40 2023-12-18T10:26:08.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9017fff640 1 -- 172.21.15.133:0/1837864880 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v107) v1 ==== 80+0+0 (secure 0 0 0) 0x7f90280ef7d0 con 0x7f903015ca40 2023-12-18T10:26:08.048 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-18T10:26:08.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f901c065a30 msgr2=0x7f901c067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f901c065a30 0x7f901c067ef0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9020006fd0 tx=0x7f9020008040 comp rx=0 tx=0).stop 2023-12-18T10:26:08.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f903015ca40 msgr2=0x7f9030159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f903015ca40 0x7f9030159790 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f902801a640 tx=0x7f90280197b0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 shutdown_connections 2023-12-18T10:26:08.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f901c065a30 0x7f901c067ef0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f903015ca40 0x7f9030159790 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90300cf7e0 0x7f9030159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 --2- 172.21.15.133:0/1837864880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90300ce3f0 0x7f90301fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 >> 172.21.15.133:0/1837864880 conn(0x7f9030089fb0 msgr2=0x7f90300b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:08.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 shutdown_connections 2023-12-18T10:26:08.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.048+0000 7f9035edf640 1 -- 172.21.15.133:0/1837864880 wait complete. 2023-12-18T10:26:08.069 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-18T10:26:08.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:08.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-18T10:26:08.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi133.stderr:ceph-fuse[61875]: fuse finished with error 0 and tester_r 0 2023-12-18T10:26:08.090 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:26:08.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:08.091 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-18T10:26:08.260 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:26:08.260 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:26:08.270 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:26:08.270 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:26:08.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:08.270 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-18T10:26:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-18T10:26:08.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:26:08.321 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:26:08.321 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:26:08.330 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:26:08.330 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:26:08.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:08.330 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-18T10:26:08.379 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-18T10:26:08.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:26:08.381 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:26:08.381 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:26:08.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:26:08.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:26:08.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:08.391 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-18T10:26:08.440 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-18T10:26:08.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:26:08.441 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:08.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.576+0000 7f7d5ca55640 1 Processor -- start 2023-12-18T10:26:08.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.576+0000 7f7d5ca55640 1 -- start start 2023-12-18T10:26:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.576+0000 7f7d5ca55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d5806c4f0 0x7f7d580c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.576+0000 7f7d5ca55640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d580c9e30 0x7f7d58070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.576+0000 7f7d5ca55640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d580c9460 con 0x7f7d581570c0 2023-12-18T10:26:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.576+0000 7f7d5ca55640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d581574a0 con 0x7f7d580c9e30 2023-12-18T10:26:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.576+0000 7f7d5ca55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d580c8b30 con 0x7f7d5806c4f0 2023-12-18T10:26:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.576+0000 7f7d5659c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7d581570c0 0x7f7d5806bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44532/0 (socket says 172.21.15.133:44532) 2023-12-18T10:26:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d5659c640 1 -- 172.21.15.133:0/1377854950 learned_addr learned my addr 172.21.15.133:0/1377854950 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:08.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d56d9d640 1 --2- 172.21.15.133:0/1377854950 >> v2:172.21.15.133:3300/0 conn(0x7f7d580c9e30 0x7f7d58070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d4ffff640 1 --2- 172.21.15.133:0/1377854950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d5806c4f0 0x7f7d580c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d56d9d640 1 -- 172.21.15.133:0/1377854950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d5806c4f0 msgr2=0x7f7d580c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d56d9d640 1 --2- 172.21.15.133:0/1377854950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d5806c4f0 0x7f7d580c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d56d9d640 1 -- 172.21.15.133:0/1377854950 >> v1:172.21.15.133:6789/0 conn(0x7f7d581570c0 legacy=0x7f7d5806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d56d9d640 1 -- 172.21.15.133:0/1377854950 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d580c8e10 con 0x7f7d580c9e30 2023-12-18T10:26:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d55d9b640 1 -- 172.21.15.133:0/1377854950 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976437995 0 0) 0x7f7d580c9460 con 0x7f7d581570c0 2023-12-18T10:26:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d56d9d640 1 --2- 172.21.15.133:0/1377854950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d580c9e30 0x7f7d58070df0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009d90 tx=0x7f7d5001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11974b4b01437860 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d55d9b640 1 -- 172.21.15.133:0/1377854950 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500a5860 con 0x7f7d580c9e30 2023-12-18T10:26:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d55d9b640 1 -- 172.21.15.133:0/1377854950 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d500a59c0 con 0x7f7d580c9e30 2023-12-18T10:26:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.580+0000 7f7d55d9b640 1 -- 172.21.15.133:0/1377854950 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500a5d50 con 0x7f7d580c9e30 2023-12-18T10:26:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1377854950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d580c9e30 msgr2=0x7f7d58070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1377854950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d580c9e30 0x7f7d58070df0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009d90 tx=0x7f7d5001c890 comp rx=0 tx=0).stop 2023-12-18T10:26:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1377854950 shutdown_connections 2023-12-18T10:26:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1377854950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d580c9e30 0x7f7d58070df0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1377854950 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d5806c4f0 0x7f7d580c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1377854950 >> 172.21.15.133:0/1377854950 conn(0x7f7d5806a3e0 msgr2=0x7f7d580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1377854950 shutdown_connections 2023-12-18T10:26:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1377854950 wait complete. 2023-12-18T10:26:08.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 Processor -- start 2023-12-18T10:26:08.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- start start 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d5806c4f0 0x7f7d5815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d580c9e30 0x7f7d580cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d581570c0 0x7f7d580cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5815bd10 con 0x7f7d581570c0 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d580c55d0 con 0x7f7d5806c4f0 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5ca55640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d580cc040 con 0x7f7d580c9e30 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d56d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d581570c0 0x7f7d580cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d56d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d581570c0 0x7f7d580cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38706/0 (socket says 172.21.15.133:38706) 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d56d9d640 1 -- 172.21.15.133:0/1834588605 learned_addr learned my addr 172.21.15.133:0/1834588605 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d5659c640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d5806c4f0 0x7f7d5815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d4ffff640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d580c9e30 0x7f7d580cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d56d9d640 1 -- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d580c9e30 msgr2=0x7f7d580cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d56d9d640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d580c9e30 0x7f7d580cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d56d9d640 1 -- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d5806c4f0 msgr2=0x7f7d5815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d56d9d640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d5806c4f0 0x7f7d5815ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d56d9d640 1 -- 172.21.15.133:0/1834588605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d50009a70 con 0x7f7d581570c0 2023-12-18T10:26:08.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.584+0000 7f7d4ffff640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d580c9e30 0x7f7d580cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:08.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d56d9d640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d581570c0 0x7f7d580cd8c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f7d5001a4c0 tx=0x7f7d50019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d4effd640 1 -- 172.21.15.133:0/1834588605 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500ad850 con 0x7f7d581570c0 2023-12-18T10:26:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d4effd640 1 -- 172.21.15.133:0/1834588605 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d500ad9b0 con 0x7f7d581570c0 2023-12-18T10:26:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d4effd640 1 -- 172.21.15.133:0/1834588605 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d500add20 con 0x7f7d581570c0 2023-12-18T10:26:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5815b1a0 con 0x7f7d581570c0 2023-12-18T10:26:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5815b750 con 0x7f7d581570c0 2023-12-18T10:26:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d580735b0 con 0x7f7d581570c0 2023-12-18T10:26:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d4effd640 1 -- 172.21.15.133:0/1834588605 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d500b4070 con 0x7f7d581570c0 2023-12-18T10:26:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d4effd640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d38065a60 0x7f7d38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d4effd640 1 -- 172.21.15.133:0/1834588605 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d5011deb0 con 0x7f7d581570c0 2023-12-18T10:26:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d5659c640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d38065a60 0x7f7d38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.588+0000 7f7d5659c640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d38065a60 0x7f7d38067f20 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000f70 tx=0x7f7d48007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:08.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.592+0000 7f7d4effd640 1 -- 172.21.15.133:0/1834588605 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d500eb790 con 0x7f7d581570c0 2023-12-18T10:26:08.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d580c5790 con 0x7f7d581570c0 2023-12-18T10:26:08.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d4effd640 1 -- 172.21.15.133:0/1834588605 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7f7d500eedb0 con 0x7f7d581570c0 2023-12-18T10:26:08.776 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:08.776 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:26:08.777 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:26:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d38065a60 msgr2=0x7f7d38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d38065a60 0x7f7d38067f20 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000f70 tx=0x7f7d48007b60 comp rx=0 tx=0).stop 2023-12-18T10:26:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d581570c0 msgr2=0x7f7d580cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d581570c0 0x7f7d580cd8c0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f7d5001a4c0 tx=0x7f7d50019630 comp rx=0 tx=0).stop 2023-12-18T10:26:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 shutdown_connections 2023-12-18T10:26:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7d38065a60 0x7f7d38067f20 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d581570c0 0x7f7d580cd8c0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d580c9e30 0x7f7d580cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 --2- 172.21.15.133:0/1834588605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d5806c4f0 0x7f7d5815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 >> 172.21.15.133:0/1834588605 conn(0x7f7d5806a3e0 msgr2=0x7f7d580c37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:08.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 shutdown_connections 2023-12-18T10:26:08.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.776+0000 7f7d5ca55640 1 -- 172.21.15.133:0/1834588605 wait complete. 2023-12-18T10:26:08.797 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:26:08.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.932+0000 7f3ee797b640 1 Processor -- start 2023-12-18T10:26:08.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.932+0000 7f3ee797b640 1 -- start start 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee797b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ee0160cc0 0x7f3ee00cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee797b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee00c17d0 0x7f3ee00cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee797b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee006fdb0 con 0x7f3ee00c1280 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee797b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee01654a0 con 0x7f3ee0160cc0 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee797b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee01610a0 con 0x7f3ee00c17d0 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee4f16640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3ee00c1280 0x7f3ee006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44540/0 (socket says 172.21.15.133:44540) 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee4f16640 1 -- 172.21.15.133:0/570581757 learned_addr learned my addr 172.21.15.133:0/570581757 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5f18640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee00c17d0 0x7f3ee00cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5717640 1 --2- 172.21.15.133:0/570581757 >> v2:172.21.15.142:3300/0 conn(0x7f3ee0160cc0 0x7f3ee00cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002233927 0 0) 0x7f3ee006fdb0 con 0x7f3ee00c1280 2023-12-18T10:26:08.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ecc003530 con 0x7f3ee00c1280 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644603242 0 0) 0x7f3ecc003530 con 0x7f3ee00c1280 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee00c17d0 msgr2=0x7f3ee00cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee00c17d0 0x7f3ee00cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 >> v2:172.21.15.142:3300/0 conn(0x7f3ee0160cc0 msgr2=0x7f3ee00cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 --2- 172.21.15.133:0/570581757 >> v2:172.21.15.142:3300/0 conn(0x7f3ee0160cc0 0x7f3ee00cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee00cb6b0 con 0x7f3ee00c1280 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f3ed0001680 con 0x7f3ee00c1280 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 >> v1:172.21.15.133:6789/0 conn(0x7f3ee00c1280 legacy=0x7f3ee006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee00c17d0 0x7f3ecc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc003f00 0x7f3ecc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc004d10 0x7f3ecc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee01654a0 con 0x7f3ecc004d10 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee01610a0 con 0x7f3ecc003f00 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc00b9e0 con 0x7f3ee00c17d0 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5f18640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc004d10 0x7f3ecc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5717640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee00c17d0 0x7f3ecc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee4f16640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc003f00 0x7f3ecc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5f18640 1 -- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee00c17d0 msgr2=0x7f3ecc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5f18640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee00c17d0 0x7f3ecc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5f18640 1 -- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc003f00 msgr2=0x7f3ecc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5f18640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc003f00 0x7f3ecc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.936+0000 7f3ee5f18640 1 -- 172.21.15.133:0/570581757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc003530 con 0x7f3ecc004d10 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee5f18640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc004d10 0x7f3ecc005190 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800e170 tx=0x7f3ed801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c12446a764db89 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80a5c50 con 0x7f3ecc004d10 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed800f040 con 0x7f3ecc004d10 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ed7fff640 1 -- 172.21.15.133:0/570581757 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80ad440 con 0x7f3ecc004d10 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee797b640 1 -- 172.21.15.133:0/570581757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc004d10 msgr2=0x7f3ecc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee797b640 1 --2- 172.21.15.133:0/570581757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc004d10 0x7f3ecc005190 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800e170 tx=0x7f3ed801cc40 comp rx=0 tx=0).stop 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee5f18640 1 -- 172.21.15.133:0/570581757 reap_dead start 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee797b640 1 -- 172.21.15.133:0/570581757 shutdown_connections 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee797b640 1 -- 172.21.15.133:0/570581757 >> 172.21.15.133:0/570581757 conn(0x7f3ee006a3e0 msgr2=0x7f3ee00afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee797b640 1 -- 172.21.15.133:0/570581757 shutdown_connections 2023-12-18T10:26:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee797b640 1 -- 172.21.15.133:0/570581757 wait complete. 2023-12-18T10:26:08.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee797b640 1 Processor -- start 2023-12-18T10:26:08.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.940+0000 7f3ee797b640 1 -- start start 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc004d10 0x7f3ee0149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ee00c1e90 0x7f3ee014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee014fc70 0x7f3ee01f9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee00b39f0 con 0x7f3ee00c1e90 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee0150660 con 0x7f3ecc004d10 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee01500f0 con 0x7f3ee014fc70 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ee00c1e90 0x7f3ee014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee5717640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc004d10 0x7f3ee0149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ee00c1e90 0x7f3ee014f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38738/0 (socket says 172.21.15.133:38738) 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 -- 172.21.15.133:0/2291363496 learned_addr learned my addr 172.21.15.133:0/2291363496 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee5f18640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee014fc70 0x7f3ee01f9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 -- 172.21.15.133:0/2291363496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee014fc70 msgr2=0x7f3ee01f9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee014fc70 0x7f3ee01f9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 -- 172.21.15.133:0/2291363496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc004d10 msgr2=0x7f3ee0149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc004d10 0x7f3ee0149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 -- 172.21.15.133:0/2291363496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee00b3150 con 0x7f3ee00c1e90 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee4f16640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ee00c1e90 0x7f3ee014f730 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00122e0 tx=0x7f3ed00126e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ed5ffb640 1 -- 172.21.15.133:0/2291363496 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0000ee0 con 0x7f3ee00c1e90 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ed5ffb640 1 -- 172.21.15.133:0/2291363496 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0014770 con 0x7f3ee00c1e90 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ed5ffb640 1 -- 172.21.15.133:0/2291363496 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0014b20 con 0x7f3ee00c1e90 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee00b3430 con 0x7f3ee00c1e90 2023-12-18T10:26:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee015da30 con 0x7f3ee00c1e90 2023-12-18T10:26:08.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.944+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee00735b0 con 0x7f3ee00c1e90 2023-12-18T10:26:08.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.948+0000 7f3ed5ffb640 1 -- 172.21.15.133:0/2291363496 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ed0014c80 con 0x7f3ee00c1e90 2023-12-18T10:26:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.948+0000 7f3ed5ffb640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ec4065a90 0x7f3ec4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.948+0000 7f3ed5ffb640 1 -- 172.21.15.133:0/2291363496 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ed00859a0 con 0x7f3ee00c1e90 2023-12-18T10:26:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.948+0000 7f3ee5717640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ec4065a90 0x7f3ec4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.948+0000 7f3ee5717640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ec4065a90 0x7f3ec4067f50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009c60 tx=0x7f3edc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:08.952+0000 7f3ed5ffb640 1 -- 172.21.15.133:0/2291363496 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3ed00532b0 con 0x7f3ee00c1e90 2023-12-18T10:26:09.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.100+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ee015d890 con 0x7f3ee00c1e90 2023-12-18T10:26:09.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ed5ffb640 1 -- 172.21.15.133:0/2291363496 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16346 (secure 0 0 0) 0x7f3ee015d890 con 0x7f3ee00c1e90 2023-12-18T10:26:09.104 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:09.104 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":107,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:25:48.135263+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:25:17.041912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-18T10:25:17.544282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.22","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ec4065a90 msgr2=0x7f3ec4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ec4065a90 0x7f3ec4067f50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009c60 tx=0x7f3edc009190 comp rx=0 tx=0).stop 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ee00c1e90 msgr2=0x7f3ee014f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ee00c1e90 0x7f3ee014f730 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00122e0 tx=0x7f3ed00126e0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 shutdown_connections 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f3ec4065a90 0x7f3ec4067f50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ee014fc70 0x7f3ee01f9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ee00c1e90 0x7f3ee014f730 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 --2- 172.21.15.133:0/2291363496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ecc004d10 0x7f3ee0149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 >> 172.21.15.133:0/2291363496 conn(0x7f3ee006a3e0 msgr2=0x7f3ee00c8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:09.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 shutdown_connections 2023-12-18T10:26:09.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.104+0000 7f3ee797b640 1 -- 172.21.15.133:0/2291363496 wait complete. 2023-12-18T10:26:09.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-18T10:17:53.161748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-18T10:25:17.041912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-12-18T10:25:17.544282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-18T10:26:09.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-18T10:26:09.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47f516d640 1 Processor -- start 2023-12-18T10:26:09.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47f516d640 1 -- start start 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47f516d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47f00ca410 0x7f47f0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47f516d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f00cbff0 0x7f47f00cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47f516d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f00cc930 con 0x7f47f0159fb0 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47f516d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f015aab0 con 0x7f47f00ca410 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47f516d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f0070df0 con 0x7f47f00cbff0 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47eed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47f00ca410 0x7f47f0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47eed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47f00ca410 0x7f47f0159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38748/0 (socket says 172.21.15.133:38748) 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47eed9d640 1 -- 172.21.15.133:0/2481372528 learned_addr learned my addr 172.21.15.133:0/2481372528 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:09.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47ef59e640 1 --2- 172.21.15.133:0/2481372528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f00cbff0 0x7f47f00cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47eed9d640 1 -- 172.21.15.133:0/2481372528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f00cbff0 msgr2=0x7f47f00cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:09.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47eed9d640 1 --2- 172.21.15.133:0/2481372528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f00cbff0 0x7f47f00cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47eed9d640 1 -- 172.21.15.133:0/2481372528 >> v1:172.21.15.133:6789/0 conn(0x7f47f0159fb0 legacy=0x7f47f0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47edd9b640 1 -- 172.21.15.133:0/2481372528 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452035472 0 0) 0x7f47f00cc930 con 0x7f47f0159fb0 2023-12-18T10:26:09.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.268+0000 7f47eed9d640 1 -- 172.21.15.133:0/2481372528 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f015a4f0 con 0x7f47f00ca410 2023-12-18T10:26:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47eed9d640 1 --2- 172.21.15.133:0/2481372528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00ca410 0x7f47f0159a70 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009870 tx=0x7f47e001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63643cc1061200fc server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47edd9b640 1 -- 172.21.15.133:0/2481372528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e00aa670 con 0x7f47f00ca410 2023-12-18T10:26:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47edd9b640 1 -- 172.21.15.133:0/2481372528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e00aa7d0 con 0x7f47f00ca410 2023-12-18T10:26:09.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47edd9b640 1 -- 172.21.15.133:0/2481372528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e00aab60 con 0x7f47f00ca410 2023-12-18T10:26:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47f516d640 1 -- 172.21.15.133:0/2481372528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00ca410 msgr2=0x7f47f0159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47f516d640 1 --2- 172.21.15.133:0/2481372528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00ca410 0x7f47f0159a70 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009870 tx=0x7f47e001c510 comp rx=0 tx=0).stop 2023-12-18T10:26:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47f516d640 1 -- 172.21.15.133:0/2481372528 shutdown_connections 2023-12-18T10:26:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47f516d640 1 --2- 172.21.15.133:0/2481372528 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f00cbff0 0x7f47f00cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47f516d640 1 --2- 172.21.15.133:0/2481372528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00ca410 0x7f47f0159a70 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47f516d640 1 -- 172.21.15.133:0/2481372528 >> 172.21.15.133:0/2481372528 conn(0x7f47f006a2a0 msgr2=0x7f47f00aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47f516d640 1 -- 172.21.15.133:0/2481372528 shutdown_connections 2023-12-18T10:26:09.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.272+0000 7f47f516d640 1 -- 172.21.15.133:0/2481372528 wait complete. 2023-12-18T10:26:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 Processor -- start 2023-12-18T10:26:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 -- start start 2023-12-18T10:26:09.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f00ca410 0x7f47f01590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00cbff0 0x7f47f00adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f0159fb0 0x7f47f00ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f014b110 con 0x7f47f00cbff0 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f014b3d0 con 0x7f47f00ca410 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01f50c0 con 0x7f47f0159fb0 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00cbff0 0x7f47f00adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00cbff0 0x7f47f00adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38758/0 (socket says 172.21.15.133:38758) 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 -- 172.21.15.133:0/4186070308 learned_addr learned my addr 172.21.15.133:0/4186070308 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ef59e640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f0159fb0 0x7f47f00ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47eed9d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f00ca410 0x7f47f01590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 -- 172.21.15.133:0/4186070308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f0159fb0 msgr2=0x7f47f00ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f0159fb0 0x7f47f00ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 -- 172.21.15.133:0/4186070308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f00ca410 msgr2=0x7f47f01590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f00ca410 0x7f47f01590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 -- 172.21.15.133:0/4186070308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00094d0 con 0x7f47f00cbff0 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47ee59c640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00cbff0 0x7f47f00adc90 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f47e400c470 tx=0x7f47e400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47d77fe640 1 -- 172.21.15.133:0/4186070308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40052d0 con 0x7f47f00cbff0 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47d77fe640 1 -- 172.21.15.133:0/4186070308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e4005450 con 0x7f47f00cbff0 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f01f53a0 con 0x7f47f00cbff0 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47d77fe640 1 -- 172.21.15.133:0/4186070308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4012870 con 0x7f47f00cbff0 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.276+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f01f4850 con 0x7f47f00cbff0 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.280+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f01f5850 con 0x7f47f00cbff0 2023-12-18T10:26:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.280+0000 7f47d77fe640 1 -- 172.21.15.133:0/4186070308 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f47e40129d0 con 0x7f47f00cbff0 2023-12-18T10:26:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.280+0000 7f47d77fe640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47dc065a90 0x7f47dc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.280+0000 7f47d77fe640 1 -- 172.21.15.133:0/4186070308 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47e4082e20 con 0x7f47f00cbff0 2023-12-18T10:26:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.280+0000 7f47eed9d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47dc065a90 0x7f47dc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.280+0000 7f47eed9d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47dc065a90 0x7f47dc067f50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f47e00ae000 tx=0x7f47e00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.284+0000 7f47d77fe640 1 -- 172.21.15.133:0/4186070308 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f47e4054120 con 0x7f47f00cbff0 2023-12-18T10:26:09.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47f004e000 con 0x7f47f00cbff0 2023-12-18T10:26:09.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47d77fe640 1 -- 172.21.15.133:0/4186070308 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47e4053cb0 con 0x7f47f00cbff0 2023-12-18T10:26:09.436 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47dc065a90 msgr2=0x7f47dc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47dc065a90 0x7f47dc067f50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f47e00ae000 tx=0x7f47e00a7000 comp rx=0 tx=0).stop 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00cbff0 msgr2=0x7f47f00adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00cbff0 0x7f47f00adc90 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f47e400c470 tx=0x7f47e400c930 comp rx=0 tx=0).stop 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 shutdown_connections 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f47dc065a90 0x7f47dc067f50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47f0159fb0 0x7f47f00ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f00cbff0 0x7f47f00adc90 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 --2- 172.21.15.133:0/4186070308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47f00ca410 0x7f47f01590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 >> 172.21.15.133:0/4186070308 conn(0x7f47f006a2a0 msgr2=0x7f47f00aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 shutdown_connections 2023-12-18T10:26:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.436+0000 7f47f516d640 1 -- 172.21.15.133:0/4186070308 wait complete. 2023-12-18T10:26:09.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-18T10:26:09.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.596+0000 7fd4428df640 1 Processor -- start 2023-12-18T10:26:09.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.596+0000 7fd4428df640 1 -- start start 2023-12-18T10:26:09.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd4428df640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd43c153020 0x7fd43c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd4428df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c1598d0 0x7fd43c0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd4428df640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0c9730 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd4428df640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43c0ced60 con 0x7fd43c153020 2023-12-18T10:26:09.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd4428df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0c8e00 con 0x7fd43c1598d0 2023-12-18T10:26:09.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd43c153020 0x7fd43c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd440e7c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd43c0ce8d0 0x7fd43c070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:44568/0 (socket says 172.21.15.133:44568) 2023-12-18T10:26:09.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd440e7c640 1 -- 172.21.15.133:0/3098337125 learned_addr learned my addr 172.21.15.133:0/3098337125 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:09.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43b7fe640 1 --2- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c1598d0 0x7fd43c0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43affd640 1 -- 172.21.15.133:0/3098337125 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004949111 0 0) 0x7fd43c0c9730 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43affd640 1 -- 172.21.15.133:0/3098337125 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd424003530 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43bfff640 1 -- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c1598d0 msgr2=0x7fd43c0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:09.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43bfff640 1 --2- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c1598d0 0x7fd43c0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43bfff640 1 -- 172.21.15.133:0/3098337125 >> v1:172.21.15.133:6789/0 conn(0x7fd43c0ce8d0 legacy=0x7fd43c070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43bfff640 1 -- 172.21.15.133:0/3098337125 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0c90e0 con 0x7fd43c153020 2023-12-18T10:26:09.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.600+0000 7fd43b7fe640 1 --2- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c1598d0 0x7fd43c0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:09.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd43bfff640 1 --2- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c153020 0x7fd43c0c9bc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0097c0 tx=0x7fd42c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e832b5c5138ee0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd43affd640 1 -- 172.21.15.133:0/3098337125 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0ab600 con 0x7fd43c153020 2023-12-18T10:26:09.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd43affd640 1 -- 172.21.15.133:0/3098337125 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0a7050 con 0x7fd43c153020 2023-12-18T10:26:09.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd43affd640 1 -- 172.21.15.133:0/3098337125 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0ab980 con 0x7fd43c153020 2023-12-18T10:26:09.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 -- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c153020 msgr2=0x7fd43c0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 --2- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c153020 0x7fd43c0c9bc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0097c0 tx=0x7fd42c01c330 comp rx=0 tx=0).stop 2023-12-18T10:26:09.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 -- 172.21.15.133:0/3098337125 shutdown_connections 2023-12-18T10:26:09.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 --2- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c1598d0 0x7fd43c0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 --2- 172.21.15.133:0/3098337125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c153020 0x7fd43c0c9bc0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 -- 172.21.15.133:0/3098337125 >> 172.21.15.133:0/3098337125 conn(0x7fd43c06a2a0 msgr2=0x7fd43c0aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:09.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 -- 172.21.15.133:0/3098337125 shutdown_connections 2023-12-18T10:26:09.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 -- 172.21.15.133:0/3098337125 wait complete. 2023-12-18T10:26:09.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 Processor -- start 2023-12-18T10:26:09.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 -- start start 2023-12-18T10:26:09.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43c0ce8d0 0x7fd43c0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c153020 0x7fd43c0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.604+0000 7fd4428df640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c1598d0 0x7fd43c0b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd4428df640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c151d50 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd4428df640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b1c40 con 0x7fd43c1598d0 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd4428df640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0b1f20 con 0x7fd43c153020 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43c0ce8d0 0x7fd43c0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43c0ce8d0 0x7fd43c0b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38770/0 (socket says 172.21.15.133:38770) 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 -- 172.21.15.133:0/849705442 learned_addr learned my addr 172.21.15.133:0/849705442 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43b7fe640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c153020 0x7fd43c0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd440e7c640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c1598d0 0x7fd43c0b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 -- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c153020 msgr2=0x7fd43c0b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c153020 0x7fd43c0b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 -- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c1598d0 msgr2=0x7fd43c0b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c1598d0 0x7fd43c0b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 -- 172.21.15.133:0/849705442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430009420 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd440e7c640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c1598d0 0x7fd43c0b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:09.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd43bfff640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43c0ce8d0 0x7fd43c0b3470 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fd42c019f60 tx=0x7fd42c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd438ff9640 1 -- 172.21.15.133:0/849705442 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b7450 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd438ff9640 1 -- 172.21.15.133:0/849705442 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c0b75d0 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd438ff9640 1 -- 172.21.15.133:0/849705442 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b7980 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c009420 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c0b24e0 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c04e000 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.608+0000 7fd438ff9640 1 -- 172.21.15.133:0/849705442 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd42c0b7ae0 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.612+0000 7fd438ff9640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd428065a60 0x7fd428067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.612+0000 7fd438ff9640 1 -- 172.21.15.133:0/849705442 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd42c11d8f0 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.612+0000 7fd43b7fe640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd428065a60 0x7fd428067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.612+0000 7fd43b7fe640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd428065a60 0x7fd428067f20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0c6bb0 tx=0x7fd430009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.616+0000 7fd438ff9640 1 -- 172.21.15.133:0/849705442 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd42c0eb140 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd43c0cc600 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd438ff9640 1 -- 172.21.15.133:0/849705442 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd42c0b0020 con 0x7fd43c0ce8d0 2023-12-18T10:26:09.764 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd428065a60 msgr2=0x7fd428067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd428065a60 0x7fd428067f20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0c6bb0 tx=0x7fd430009190 comp rx=0 tx=0).stop 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43c0ce8d0 msgr2=0x7fd43c0b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43c0ce8d0 0x7fd43c0b3470 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fd42c019f60 tx=0x7fd42c01ab70 comp rx=0 tx=0).stop 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 shutdown_connections 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fd428065a60 0x7fd428067f20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd43c1598d0 0x7fd43c0b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd43c153020 0x7fd43c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 --2- 172.21.15.133:0/849705442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd43c0ce8d0 0x7fd43c0b3470 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 >> 172.21.15.133:0/849705442 conn(0x7fd43c06a2a0 msgr2=0x7fd43c157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 shutdown_connections 2023-12-18T10:26:09.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.764+0000 7fd4428df640 1 -- 172.21.15.133:0/849705442 wait complete. 2023-12-18T10:26:09.785 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-18T10:26:09.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.924+0000 7f45ee6d8640 1 Processor -- start 2023-12-18T10:26:09.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.924+0000 7f45ee6d8640 1 -- start start 2023-12-18T10:26:09.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.924+0000 7f45ee6d8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45e80cb690 0x7f45e815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.924+0000 7f45ee6d8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f45e815d920 0x7f45e815c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.924+0000 7f45ee6d8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e8160860 con 0x7f45e80adb30 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.924+0000 7f45ee6d8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e81611e0 con 0x7f45e80cb690 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.924+0000 7f45ee6d8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e815e110 con 0x7f45e815d920 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45dffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45e80cb690 0x7f45e815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45dffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45e80cb690 0x7f45e815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53824/0 (socket says 172.21.15.133:53824) 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45dffff640 1 -- 172.21.15.133:0/2261946831 learned_addr learned my addr 172.21.15.133:0/2261946831 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45ecc75640 1 --2- 172.21.15.133:0/2261946831 >> v2:172.21.15.142:3300/0 conn(0x7f45e815d920 0x7f45e815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45dffff640 1 -- 172.21.15.133:0/2261946831 >> v2:172.21.15.142:3300/0 conn(0x7f45e815d920 msgr2=0x7f45e815c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45dffff640 1 --2- 172.21.15.133:0/2261946831 >> v2:172.21.15.142:3300/0 conn(0x7f45e815d920 0x7f45e815c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45dffff640 1 -- 172.21.15.133:0/2261946831 >> v1:172.21.15.142:6789/0 conn(0x7f45e80adb30 legacy=0x7f45e80caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45dffff640 1 -- 172.21.15.133:0/2261946831 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8160b20 con 0x7f45e80cb690 2023-12-18T10:26:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45ecc75640 1 --2- 172.21.15.133:0/2261946831 >> v2:172.21.15.142:3300/0 conn(0x7f45e815d920 0x7f45e815c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:09.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45dffff640 1 --2- 172.21.15.133:0/2261946831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80cb690 0x7f45e815d3e0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f45e80c57f0 tx=0x7f45d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407e23edb0da33e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45e77fe640 1 -- 172.21.15.133:0/2261946831 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00aa650 con 0x7f45e80cb690 2023-12-18T10:26:09.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45e77fe640 1 -- 172.21.15.133:0/2261946831 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d00aa7b0 con 0x7f45e80cb690 2023-12-18T10:26:09.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.928+0000 7f45e77fe640 1 -- 172.21.15.133:0/2261946831 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00aab40 con 0x7f45e80cb690 2023-12-18T10:26:09.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- 172.21.15.133:0/2261946831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80cb690 msgr2=0x7f45e815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/2261946831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80cb690 0x7f45e815d3e0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f45e80c57f0 tx=0x7f45d001c4d0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- 172.21.15.133:0/2261946831 shutdown_connections 2023-12-18T10:26:09.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/2261946831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80cb690 0x7f45e815d3e0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/2261946831 >> v2:172.21.15.142:3300/0 conn(0x7f45e815d920 0x7f45e815c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- 172.21.15.133:0/2261946831 >> 172.21.15.133:0/2261946831 conn(0x7f45e80b0380 msgr2=0x7f45e80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:09.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- 172.21.15.133:0/2261946831 shutdown_connections 2023-12-18T10:26:09.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- 172.21.15.133:0/2261946831 wait complete. 2023-12-18T10:26:09.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 Processor -- start 2023-12-18T10:26:09.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- start start 2023-12-18T10:26:09.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80adb30 0x7f45e81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e80cb690 0x7f45e815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e815d920 0x7f45e806d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e814d3a0 con 0x7f45e80adb30 2023-12-18T10:26:09.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e814d1c0 con 0x7f45e815d920 2023-12-18T10:26:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ee6d8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e815f0d0 con 0x7f45e80cb690 2023-12-18T10:26:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45e7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80adb30 0x7f45e81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45e7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80adb30 0x7f45e81581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53832/0 (socket says 172.21.15.133:53832) 2023-12-18T10:26:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45e7fff640 1 -- 172.21.15.133:0/1105049406 learned_addr learned my addr 172.21.15.133:0/1105049406 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45ecc75640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e815d920 0x7f45e806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45dffff640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e80cb690 0x7f45e815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45e7fff640 1 -- 172.21.15.133:0/1105049406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e80cb690 msgr2=0x7f45e815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45e7fff640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e80cb690 0x7f45e815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45e7fff640 1 -- 172.21.15.133:0/1105049406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e815d920 msgr2=0x7f45e806d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:09.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45e7fff640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e815d920 0x7f45e806d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:09.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.932+0000 7f45e7fff640 1 -- 172.21.15.133:0/1105049406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d00094d0 con 0x7f45e80adb30 2023-12-18T10:26:09.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45e7fff640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80adb30 0x7f45e81581f0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c3a0 tx=0x7f45d800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45e57fa640 1 -- 172.21.15.133:0/1105049406 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d80052d0 con 0x7f45e80adb30 2023-12-18T10:26:09.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45e57fa640 1 -- 172.21.15.133:0/1105049406 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d8005430 con 0x7f45e80adb30 2023-12-18T10:26:09.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e8158820 con 0x7f45e80adb30 2023-12-18T10:26:09.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45e57fa640 1 -- 172.21.15.133:0/1105049406 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8007260 con 0x7f45e80adb30 2023-12-18T10:26:09.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e814d8d0 con 0x7f45e80adb30 2023-12-18T10:26:09.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e80cd0a0 con 0x7f45e80adb30 2023-12-18T10:26:09.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45e57fa640 1 -- 172.21.15.133:0/1105049406 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45d80073c0 con 0x7f45e80adb30 2023-12-18T10:26:09.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45e57fa640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f45c8065a90 0x7f45c8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:09.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45e57fa640 1 -- 172.21.15.133:0/1105049406 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f45d80826d0 con 0x7f45e80adb30 2023-12-18T10:26:09.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.936+0000 7f45dffff640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f45c8065a90 0x7f45c8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:09.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.940+0000 7f45dffff640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f45c8065a90 0x7f45c8067f50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f45d00ae000 tx=0x7f45d00b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:09.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:09.940+0000 7f45e57fa640 1 -- 172.21.15.133:0/1105049406 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45d804ff40 con 0x7f45e80adb30 2023-12-18T10:26:10.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45e804e000 con 0x7f45e80adb30 2023-12-18T10:26:10.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45e57fa640 1 -- 172.21.15.133:0/1105049406 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45d8053560 con 0x7f45e80adb30 2023-12-18T10:26:10.096 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f45c8065a90 msgr2=0x7f45c8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f45c8065a90 0x7f45c8067f50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f45d00ae000 tx=0x7f45d00b5040 comp rx=0 tx=0).stop 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80adb30 msgr2=0x7f45e81581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80adb30 0x7f45e81581f0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c3a0 tx=0x7f45d800c860 comp rx=0 tx=0).stop 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 shutdown_connections 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f45c8065a90 0x7f45c8067f50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45e815d920 0x7f45e806d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f45e80cb690 0x7f45e815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 --2- 172.21.15.133:0/1105049406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45e80adb30 0x7f45e81581f0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 >> 172.21.15.133:0/1105049406 conn(0x7f45e80b0380 msgr2=0x7f45e80c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 shutdown_connections 2023-12-18T10:26:10.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.096+0000 7f45ee6d8640 1 -- 172.21.15.133:0/1105049406 wait complete. 2023-12-18T10:26:10.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbadd7a2640 1 Processor -- start 2023-12-18T10:26:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbadd7a2640 1 -- start start 2023-12-18T10:26:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbadd7a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad80b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbadd7a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbad806ffe0 0x7fbad80c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbadd7a2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad80cbc70 con 0x7fbad806fb60 2023-12-18T10:26:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbadd7a2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad80b0630 con 0x7fbad806ffe0 2023-12-18T10:26:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbadd7a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80c3bb0 con 0x7fbad80afd10 2023-12-18T10:26:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad77fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbad806fb60 0x7fbad80cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:39770/0 (socket says 172.21.15.133:39770) 2023-12-18T10:26:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad77fe640 1 -- 172.21.15.133:0/3002457161 learned_addr learned my addr 172.21.15.133:0/3002457161 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbadcfa1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbad806ffe0 0x7fbad80c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.256+0000 7fbad7fff640 1 --2- 172.21.15.133:0/3002457161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad80b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad6ffd640 1 -- 172.21.15.133:0/3002457161 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022707312 0 0) 0x7fbad80cbc70 con 0x7fbad806fb60 2023-12-18T10:26:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad6ffd640 1 -- 172.21.15.133:0/3002457161 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbac0003530 con 0x7fbad806fb60 2023-12-18T10:26:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad7fff640 1 -- 172.21.15.133:0/3002457161 >> v2:172.21.15.142:3300/0 conn(0x7fbad806ffe0 msgr2=0x7fbad80c2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad7fff640 1 --2- 172.21.15.133:0/3002457161 >> v2:172.21.15.142:3300/0 conn(0x7fbad806ffe0 0x7fbad80c2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad7fff640 1 -- 172.21.15.133:0/3002457161 >> v1:172.21.15.142:6789/0 conn(0x7fbad806fb60 legacy=0x7fbad80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad7fff640 1 -- 172.21.15.133:0/3002457161 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad80c3e90 con 0x7fbad80afd10 2023-12-18T10:26:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbadcfa1640 1 --2- 172.21.15.133:0/3002457161 >> v2:172.21.15.142:3300/0 conn(0x7fbad806ffe0 0x7fbad80c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:10.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad7fff640 1 --2- 172.21.15.133:0/3002457161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad80b00f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097c0 tx=0x7fbac801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d4af88834fff44 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.260+0000 7fbad6ffd640 1 -- 172.21.15.133:0/3002457161 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80ab600 con 0x7fbad80afd10 2023-12-18T10:26:10.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbad6ffd640 1 -- 172.21.15.133:0/3002457161 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac80a7050 con 0x7fbad80afd10 2023-12-18T10:26:10.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbad6ffd640 1 -- 172.21.15.133:0/3002457161 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80ab980 con 0x7fbad80afd10 2023-12-18T10:26:10.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- 172.21.15.133:0/3002457161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 msgr2=0x7fbad80b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/3002457161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad80b00f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097c0 tx=0x7fbac801c480 comp rx=0 tx=0).stop 2023-12-18T10:26:10.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- 172.21.15.133:0/3002457161 shutdown_connections 2023-12-18T10:26:10.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/3002457161 >> v2:172.21.15.142:3300/0 conn(0x7fbad806ffe0 0x7fbad80c2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/3002457161 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad80b00f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- 172.21.15.133:0/3002457161 >> 172.21.15.133:0/3002457161 conn(0x7fbad80ce130 msgr2=0x7fbad80ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:10.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- 172.21.15.133:0/3002457161 shutdown_connections 2023-12-18T10:26:10.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- 172.21.15.133:0/3002457161 wait complete. 2023-12-18T10:26:10.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 Processor -- start 2023-12-18T10:26:10.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- start start 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbad806fb60 0x7fbad8158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbad806ffe0 0x7fbad8166640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad8166b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81661b0 con 0x7fbad806ffe0 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad81655a0 con 0x7fbad806fb60 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadd7a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad8165880 con 0x7fbad80afd10 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbad806ffe0 0x7fbad8166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbad806ffe0 0x7fbad8166640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53844/0 (socket says 172.21.15.133:53844) 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbad77fe640 1 -- 172.21.15.133:0/104840401 learned_addr learned my addr 172.21.15.133:0/104840401 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbad7fff640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbad806fb60 0x7fbad8158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.264+0000 7fbadcfa1640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad8166b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad77fe640 1 -- 172.21.15.133:0/104840401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 msgr2=0x7fbad8166b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad77fe640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad8166b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad77fe640 1 -- 172.21.15.133:0/104840401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbad806fb60 msgr2=0x7fbad8158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad77fe640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbad806fb60 0x7fbad8158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad77fe640 1 -- 172.21.15.133:0/104840401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad0009a70 con 0x7fbad806ffe0 2023-12-18T10:26:10.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad77fe640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbad806ffe0 0x7fbad8166640 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c420 tx=0x7fbacc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad4ff9640 1 -- 172.21.15.133:0/104840401 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc005cf0 con 0x7fbad806ffe0 2023-12-18T10:26:10.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad4ff9640 1 -- 172.21.15.133:0/104840401 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc005e50 con 0x7fbad806ffe0 2023-12-18T10:26:10.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad4ff9640 1 -- 172.21.15.133:0/104840401 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0072d0 con 0x7fbad806ffe0 2023-12-18T10:26:10.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac8009420 con 0x7fbad806ffe0 2023-12-18T10:26:10.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad8165e40 con 0x7fbad806ffe0 2023-12-18T10:26:10.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad8166360 con 0x7fbad806ffe0 2023-12-18T10:26:10.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad4ff9640 1 -- 172.21.15.133:0/104840401 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbacc007430 con 0x7fbad806ffe0 2023-12-18T10:26:10.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad4ff9640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbac4065a90 0x7fbac4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad4ff9640 1 -- 172.21.15.133:0/104840401 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbacc082800 con 0x7fbad806ffe0 2023-12-18T10:26:10.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.268+0000 7fbad7fff640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbac4065a90 0x7fbac4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.272+0000 7fbad7fff640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbac4065a90 0x7fbac4067f50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbac80ad000 tx=0x7fbac80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.276+0000 7fbad4ff9640 1 -- 172.21.15.133:0/104840401 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbad8166360 con 0x7fbad806ffe0 2023-12-18T10:26:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.456+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbad8166360 con 0x7fbad806ffe0 2023-12-18T10:26:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.456+0000 7fbad4ff9640 1 -- 172.21.15.133:0/104840401 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7fbad8166360 con 0x7fbad806ffe0 2023-12-18T10:26:10.459 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:10.459 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:26:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:26:10.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbac4065a90 msgr2=0x7fbac4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbac4065a90 0x7fbac4067f50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbac80ad000 tx=0x7fbac80a6000 comp rx=0 tx=0).stop 2023-12-18T10:26:10.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbad806ffe0 msgr2=0x7fbad8166640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbad806ffe0 0x7fbad8166640 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c420 tx=0x7fbacc00c820 comp rx=0 tx=0).stop 2023-12-18T10:26:10.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 shutdown_connections 2023-12-18T10:26:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbac4065a90 0x7fbac4067f50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbad80afd10 0x7fbad8166b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbad806ffe0 0x7fbad8166640 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 --2- 172.21.15.133:0/104840401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbad806fb60 0x7fbad8158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 >> 172.21.15.133:0/104840401 conn(0x7fbad80ce130 msgr2=0x7fbad80cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 shutdown_connections 2023-12-18T10:26:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.460+0000 7fbadd7a2640 1 -- 172.21.15.133:0/104840401 wait complete. 2023-12-18T10:26:10.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:26:10.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.616+0000 7f948f59e640 1 Processor -- start 2023-12-18T10:26:10.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.616+0000 7f948f59e640 1 -- start start 2023-12-18T10:26:10.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948f59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94900afd10 0x7f94900b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949006fb60 0x7f949006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948f59e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f94900cc6c0 0x7f94900ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948f59e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900cbc70 con 0x7f94900afd10 2023-12-18T10:26:10.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948f59e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900b0630 con 0x7f94900cc6c0 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c3bb0 con 0x7f949006fb60 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94900afd10 0x7f94900b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94900afd10 0x7f94900b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53856/0 (socket says 172.21.15.133:53856) 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948e59c640 1 -- 172.21.15.133:0/2243957328 learned_addr learned my addr 172.21.15.133:0/2243957328 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948ed9d640 1 --2- 172.21.15.133:0/2243957328 >> v2:172.21.15.142:3300/0 conn(0x7f94900cc6c0 0x7f94900ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f9487fff640 1 --2- 172.21.15.133:0/2243957328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949006fb60 0x7f949006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948e59c640 1 -- 172.21.15.133:0/2243957328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949006fb60 msgr2=0x7f949006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948e59c640 1 --2- 172.21.15.133:0/2243957328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949006fb60 0x7f949006ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948e59c640 1 -- 172.21.15.133:0/2243957328 >> v2:172.21.15.142:3300/0 conn(0x7f94900cc6c0 msgr2=0x7f94900ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:10.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948e59c640 1 --2- 172.21.15.133:0/2243957328 >> v2:172.21.15.142:3300/0 conn(0x7f94900cc6c0 0x7f94900ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.620+0000 7f948e59c640 1 -- 172.21.15.133:0/2243957328 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94900c3e90 con 0x7f94900afd10 2023-12-18T10:26:10.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948e59c640 1 --2- 172.21.15.133:0/2243957328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900afd10 0x7f94900b00f0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f94900ce060 tx=0x7f948001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd96404ff05afae8 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948dd9b640 1 -- 172.21.15.133:0/2243957328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800aa5f0 con 0x7f94900afd10 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948dd9b640 1 -- 172.21.15.133:0/2243957328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800aa750 con 0x7f94900afd10 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948dd9b640 1 -- 172.21.15.133:0/2243957328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800aaae0 con 0x7f94900afd10 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 -- 172.21.15.133:0/2243957328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900afd10 msgr2=0x7f94900b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 --2- 172.21.15.133:0/2243957328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900afd10 0x7f94900b00f0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f94900ce060 tx=0x7f948001c4d0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 -- 172.21.15.133:0/2243957328 shutdown_connections 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 --2- 172.21.15.133:0/2243957328 >> v2:172.21.15.142:3300/0 conn(0x7f94900cc6c0 0x7f94900ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 --2- 172.21.15.133:0/2243957328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f949006fb60 0x7f949006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 --2- 172.21.15.133:0/2243957328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900afd10 0x7f94900b00f0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 -- 172.21.15.133:0/2243957328 >> 172.21.15.133:0/2243957328 conn(0x7f94900ce130 msgr2=0x7f94900ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 -- 172.21.15.133:0/2243957328 shutdown_connections 2023-12-18T10:26:10.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 -- 172.21.15.133:0/2243957328 wait complete. 2023-12-18T10:26:10.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 Processor -- start 2023-12-18T10:26:10.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.624+0000 7f948f59e640 1 -- start start 2023-12-18T10:26:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949006fb60 0x7f949015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94900afd10 0x7f9490162950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900cc6c0 0x7f9490161c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c5310 con 0x7f94900cc6c0 2023-12-18T10:26:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c55f0 con 0x7f949006fb60 2023-12-18T10:26:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900c58d0 con 0x7f94900afd10 2023-12-18T10:26:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900cc6c0 0x7f9490161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900cc6c0 0x7f9490161c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53868/0 (socket says 172.21.15.133:53868) 2023-12-18T10:26:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 -- 172.21.15.133:0/2656160992 learned_addr learned my addr 172.21.15.133:0/2656160992 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948e59c640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949006fb60 0x7f949015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f9487fff640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94900afd10 0x7f9490162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 -- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94900afd10 msgr2=0x7f9490162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94900afd10 0x7f9490162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 -- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949006fb60 msgr2=0x7f949015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949006fb60 0x7f949015c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 -- 172.21.15.133:0/2656160992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800094d0 con 0x7f94900cc6c0 2023-12-18T10:26:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948e59c640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949006fb60 0x7f949015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948ed9d640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900cc6c0 0x7f9490161c30 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f948800efc0 tx=0x7f948800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f9486ffd640 1 -- 172.21.15.133:0/2656160992 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9488009ba0 con 0x7f94900cc6c0 2023-12-18T10:26:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f9486ffd640 1 -- 172.21.15.133:0/2656160992 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800f040 con 0x7f94900cc6c0 2023-12-18T10:26:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f9486ffd640 1 -- 172.21.15.133:0/2656160992 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880146c0 con 0x7f94900cc6c0 2023-12-18T10:26:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900c5bb0 con 0x7f94900cc6c0 2023-12-18T10:26:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94900c7fb0 con 0x7f94900cc6c0 2023-12-18T10:26:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94900c60d0 con 0x7f94900cc6c0 2023-12-18T10:26:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.628+0000 7f9486ffd640 1 -- 172.21.15.133:0/2656160992 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9488014820 con 0x7f94900cc6c0 2023-12-18T10:26:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.632+0000 7f9486ffd640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9470065a90 0x7f9470067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.632+0000 7f9486ffd640 1 -- 172.21.15.133:0/2656160992 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9488083fe0 con 0x7f94900cc6c0 2023-12-18T10:26:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.632+0000 7f948e59c640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9470065a90 0x7f9470067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.632+0000 7f948e59c640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9470065a90 0x7f9470067f50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f94800ae000 tx=0x7f94800a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.636+0000 7f9486ffd640 1 -- 172.21.15.133:0/2656160992 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f94900c60d0 con 0x7f94900cc6c0 2023-12-18T10:26:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.784+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94900c60d0 con 0x7f94900cc6c0 2023-12-18T10:26:10.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f9486ffd640 1 -- 172.21.15.133:0/2656160992 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16346 (secure 0 0 0) 0x7f94900c60d0 con 0x7f94900cc6c0 2023-12-18T10:26:10.788 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:10.788 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":107,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:25:48.135263+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:25:17.041912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-18T10:25:17.544282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.22","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:26:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9470065a90 msgr2=0x7f9470067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9470065a90 0x7f9470067f50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f94800ae000 tx=0x7f94800a7000 comp rx=0 tx=0).stop 2023-12-18T10:26:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900cc6c0 msgr2=0x7f9490161c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900cc6c0 0x7f9490161c30 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f948800efc0 tx=0x7f948800c490 comp rx=0 tx=0).stop 2023-12-18T10:26:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 shutdown_connections 2023-12-18T10:26:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9470065a90 0x7f9470067f50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94900cc6c0 0x7f9490161c30 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94900afd10 0x7f9490162950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 --2- 172.21.15.133:0/2656160992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f949006fb60 0x7f949015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 >> 172.21.15.133:0/2656160992 conn(0x7f94900ce130 msgr2=0x7f94901611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 shutdown_connections 2023-12-18T10:26:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.788+0000 7f948f59e640 1 -- 172.21.15.133:0/2656160992 wait complete. 2023-12-18T10:26:10.810 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-18T10:26:10.810 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.944+0000 7fa57208c640 1 Processor -- start 2023-12-18T10:26:10.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.944+0000 7fa57208c640 1 -- start start 2023-12-18T10:26:10.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa57208c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa56c06c4f0 0x7fa56c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa57208c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c0c9e30 0x7fa56c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa57208c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56c0c9460 con 0x7fa56c1570c0 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa57208c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56c1574a0 con 0x7fa56c06c4f0 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa57208c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0c8b30 con 0x7fa56c0c9e30 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa56c06c4f0 0x7fa56c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa56c1570c0 0x7fa56c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33034/0 (socket says 172.21.15.133:33034) 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56b7fe640 1 -- 172.21.15.133:0/933039544 learned_addr learned my addr 172.21.15.133:0/933039544 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56bfff640 1 --2- 172.21.15.133:0/933039544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c0c9e30 0x7fa56c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56affd640 1 -- 172.21.15.133:0/933039544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c0c9e30 msgr2=0x7fa56c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56affd640 1 --2- 172.21.15.133:0/933039544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c0c9e30 0x7fa56c070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56affd640 1 -- 172.21.15.133:0/933039544 >> v1:172.21.15.133:6789/0 conn(0x7fa56c1570c0 legacy=0x7fa56c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56affd640 1 -- 172.21.15.133:0/933039544 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0c8e10 con 0x7fa56c06c4f0 2023-12-18T10:26:10.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.948+0000 7fa56a7fc640 1 -- 172.21.15.133:0/933039544 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709261457 0 0) 0x7fa56c0c9460 con 0x7fa56c1570c0 2023-12-18T10:26:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa56affd640 1 --2- 172.21.15.133:0/933039544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c0c98f0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa5600097c0 tx=0x7fa56001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4053b9617172e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa56a7fc640 1 -- 172.21.15.133:0/933039544 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600ab600 con 0x7fa56c06c4f0 2023-12-18T10:26:10.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa56a7fc640 1 -- 172.21.15.133:0/933039544 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5600a7050 con 0x7fa56c06c4f0 2023-12-18T10:26:10.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa56a7fc640 1 -- 172.21.15.133:0/933039544 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600ab980 con 0x7fa56c06c4f0 2023-12-18T10:26:10.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 -- 172.21.15.133:0/933039544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 msgr2=0x7fa56c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 --2- 172.21.15.133:0/933039544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c0c98f0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa5600097c0 tx=0x7fa56001c3c0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 -- 172.21.15.133:0/933039544 shutdown_connections 2023-12-18T10:26:10.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 --2- 172.21.15.133:0/933039544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c0c9e30 0x7fa56c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 --2- 172.21.15.133:0/933039544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c0c98f0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 -- 172.21.15.133:0/933039544 >> 172.21.15.133:0/933039544 conn(0x7fa56c06a3e0 msgr2=0x7fa56c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:10.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 -- 172.21.15.133:0/933039544 shutdown_connections 2023-12-18T10:26:10.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 -- 172.21.15.133:0/933039544 wait complete. 2023-12-18T10:26:10.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 Processor -- start 2023-12-18T10:26:10.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.952+0000 7fa57208c640 1 -- start start 2023-12-18T10:26:10.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa56c0c9e30 0x7fa56c1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c1570c0 0x7fa56c0cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0c85f0 con 0x7fa56c06c4f0 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c15ac60 con 0x7fa56c0c9e30 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c150900 con 0x7fa56c1570c0 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53894/0 (socket says 172.21.15.133:53894) 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 -- 172.21.15.133:0/1570229201 learned_addr learned my addr 172.21.15.133:0/1570229201 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56affd640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa56c0c9e30 0x7fa56c1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56bfff640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c1570c0 0x7fa56c0cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 -- 172.21.15.133:0/1570229201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c1570c0 msgr2=0x7fa56c0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c1570c0 0x7fa56c0cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 -- 172.21.15.133:0/1570229201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa56c0c9e30 msgr2=0x7fa56c1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa56c0c9e30 0x7fa56c1503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 -- 172.21.15.133:0/1570229201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560009420 con 0x7fa56c06c4f0 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa56b7fe640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c150af0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c520 tx=0x7fa55c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa553fff640 1 -- 172.21.15.133:0/1570229201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0074e0 con 0x7fa56c06c4f0 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa553fff640 1 -- 172.21.15.133:0/1570229201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c007640 con 0x7fa56c06c4f0 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa553fff640 1 -- 172.21.15.133:0/1570229201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0049f0 con 0x7fa56c06c4f0 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c1f4b10 con 0x7fa56c06c4f0 2023-12-18T10:26:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c15b190 con 0x7fa56c06c4f0 2023-12-18T10:26:10.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c0735b0 con 0x7fa56c06c4f0 2023-12-18T10:26:10.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.956+0000 7fa553fff640 1 -- 172.21.15.133:0/1570229201 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa55c004b50 con 0x7fa56c06c4f0 2023-12-18T10:26:10.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.960+0000 7fa553fff640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa558065a60 0x7fa558067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:10.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.960+0000 7fa553fff640 1 -- 172.21.15.133:0/1570229201 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa55c0825a0 con 0x7fa56c06c4f0 2023-12-18T10:26:10.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.960+0000 7fa56affd640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa558065a60 0x7fa558067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:10.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.960+0000 7fa56affd640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa558065a60 0x7fa558067f20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa5600ad000 tx=0x7fa5600a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:10.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:10.964+0000 7fa553fff640 1 -- 172.21.15.133:0/1570229201 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa55c04fe10 con 0x7fa56c06c4f0 2023-12-18T10:26:11.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.144+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa56c0ce010 con 0x7fa56c06c4f0 2023-12-18T10:26:11.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa553fff640 1 -- 172.21.15.133:0/1570229201 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7fa55c053430 con 0x7fa56c06c4f0 2023-12-18T10:26:11.147 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:11.147 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:26:11.148 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:26:11.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa558065a60 msgr2=0x7fa558067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa558065a60 0x7fa558067f20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa5600ad000 tx=0x7fa5600a6000 comp rx=0 tx=0).stop 2023-12-18T10:26:11.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 msgr2=0x7fa56c150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c150af0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c520 tx=0x7fa55c00c9e0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 shutdown_connections 2023-12-18T10:26:11.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa558065a60 0x7fa558067f20 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa56c1570c0 0x7fa56c0cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa56c0c9e30 0x7fa56c1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 --2- 172.21.15.133:0/1570229201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c06c4f0 0x7fa56c150af0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 >> 172.21.15.133:0/1570229201 conn(0x7fa56c06a3e0 msgr2=0x7fa56c1575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:11.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 shutdown_connections 2023-12-18T10:26:11.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.148+0000 7fa57208c640 1 -- 172.21.15.133:0/1570229201 wait complete. 2023-12-18T10:26:11.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:11.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35daf39640 1 Processor -- start 2023-12-18T10:26:11.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35daf39640 1 -- start start 2023-12-18T10:26:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35daf39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f35d415a680 0x7f35d415e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35daf39640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f35d406fdb0 0x7f35d4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35daf39640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d415f100 con 0x7f35d40cac10 2023-12-18T10:26:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35daf39640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d4070780 con 0x7f35d415a680 2023-12-18T10:26:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35daf39640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40ca7d0 con 0x7f35d406fdb0 2023-12-18T10:26:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d8cd5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f35d415a680 0x7f35d415e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d8cd5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f35d415a680 0x7f35d415e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53910/0 (socket says 172.21.15.133:53910) 2023-12-18T10:26:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d8cd5640 1 -- 172.21.15.133:0/327658831 learned_addr learned my addr 172.21.15.133:0/327658831 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d94d6640 1 --2- 172.21.15.133:0/327658831 >> v2:172.21.15.142:3300/0 conn(0x7f35d406fdb0 0x7f35d4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d8cd5640 1 -- 172.21.15.133:0/327658831 >> v2:172.21.15.142:3300/0 conn(0x7f35d406fdb0 msgr2=0x7f35d4070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d8cd5640 1 --2- 172.21.15.133:0/327658831 >> v2:172.21.15.142:3300/0 conn(0x7f35d406fdb0 0x7f35d4070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d8cd5640 1 -- 172.21.15.133:0/327658831 >> v1:172.21.15.142:6789/0 conn(0x7f35d40cac10 legacy=0x7f35d415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d8cd5640 1 -- 172.21.15.133:0/327658831 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d415e860 con 0x7f35d415a680 2023-12-18T10:26:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.308+0000 7f35d94d6640 1 --2- 172.21.15.133:0/327658831 >> v2:172.21.15.142:3300/0 conn(0x7f35d406fdb0 0x7f35d4070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:11.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35d8cd5640 1 --2- 172.21.15.133:0/327658831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d415a680 0x7f35d415e160 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009870 tx=0x7f35d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea504a26d143836 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35cb7fe640 1 -- 172.21.15.133:0/327658831 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00a7070 con 0x7f35d415a680 2023-12-18T10:26:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35cb7fe640 1 -- 172.21.15.133:0/327658831 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d00ab430 con 0x7f35d415a680 2023-12-18T10:26:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35cb7fe640 1 -- 172.21.15.133:0/327658831 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00ab7c0 con 0x7f35d415a680 2023-12-18T10:26:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35daf39640 1 -- 172.21.15.133:0/327658831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d415a680 msgr2=0x7f35d415e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35daf39640 1 --2- 172.21.15.133:0/327658831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d415a680 0x7f35d415e160 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009870 tx=0x7f35d001c430 comp rx=0 tx=0).stop 2023-12-18T10:26:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35daf39640 1 -- 172.21.15.133:0/327658831 shutdown_connections 2023-12-18T10:26:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35daf39640 1 --2- 172.21.15.133:0/327658831 >> v2:172.21.15.142:3300/0 conn(0x7f35d406fdb0 0x7f35d4070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35daf39640 1 --2- 172.21.15.133:0/327658831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d415a680 0x7f35d415e160 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35daf39640 1 -- 172.21.15.133:0/327658831 >> 172.21.15.133:0/327658831 conn(0x7f35d406a3e0 msgr2=0x7f35d40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35daf39640 1 -- 172.21.15.133:0/327658831 shutdown_connections 2023-12-18T10:26:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.312+0000 7f35daf39640 1 -- 172.21.15.133:0/327658831 wait complete. 2023-12-18T10:26:11.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 Processor -- start 2023-12-18T10:26:11.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 -- start start 2023-12-18T10:26:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d406fdb0 0x7f35d4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d40cac10 0x7f35d40ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d415a680 0x7f35d40cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40c4440 con 0x7f35d406fdb0 2023-12-18T10:26:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40c3b40 con 0x7f35d40cac10 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d415de70 con 0x7f35d415a680 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d406fdb0 0x7f35d4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d406fdb0 0x7f35d4155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53920/0 (socket says 172.21.15.133:53920) 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 -- 172.21.15.133:0/73381690 learned_addr learned my addr 172.21.15.133:0/73381690 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 -- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d415a680 msgr2=0x7f35d40cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d94d6640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d415a680 0x7f35d40cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35cbfff640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d40cac10 0x7f35d40ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d415a680 0x7f35d40cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 -- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d40cac10 msgr2=0x7f35d40ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d40cac10 0x7f35d40ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 -- 172.21.15.133:0/73381690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00094d0 con 0x7f35d406fdb0 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d94d6640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d415a680 0x7f35d40cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35cbfff640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d40cac10 0x7f35d40ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35d8cd5640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d406fdb0 0x7f35d4155480 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f35d00ad040 tx=0x7f35d00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35c97fa640 1 -- 172.21.15.133:0/73381690 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00bc070 con 0x7f35d406fdb0 2023-12-18T10:26:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35c97fa640 1 -- 172.21.15.133:0/73381690 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d00b4630 con 0x7f35d406fdb0 2023-12-18T10:26:11.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35c97fa640 1 -- 172.21.15.133:0/73381690 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00b4a00 con 0x7f35d406fdb0 2023-12-18T10:26:11.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d40c3df0 con 0x7f35d406fdb0 2023-12-18T10:26:11.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.316+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d4156220 con 0x7f35d406fdb0 2023-12-18T10:26:11.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.320+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d40735b0 con 0x7f35d406fdb0 2023-12-18T10:26:11.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.320+0000 7f35c97fa640 1 -- 172.21.15.133:0/73381690 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f35d00b4b60 con 0x7f35d406fdb0 2023-12-18T10:26:11.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.320+0000 7f35c97fa640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35c0065a60 0x7f35c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.320+0000 7f35c97fa640 1 -- 172.21.15.133:0/73381690 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35d011cce0 con 0x7f35d406fdb0 2023-12-18T10:26:11.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.320+0000 7f35cbfff640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35c0065a60 0x7f35c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.320+0000 7f35cbfff640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35c0065a60 0x7f35c0067f20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f35d415d2b0 tx=0x7f35c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.324+0000 7f35c97fa640 1 -- 172.21.15.133:0/73381690 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f35d00ea650 con 0x7f35d406fdb0 2023-12-18T10:26:11.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.504+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35d404e000 con 0x7f35d406fdb0 2023-12-18T10:26:11.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.504+0000 7f35c97fa640 1 -- 172.21.15.133:0/73381690 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4764 (secure 0 0 0) 0x7f35d00edc70 con 0x7f35d406fdb0 2023-12-18T10:26:11.505 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:11.506 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-18T10:25:18.553341+0000","modified":"2023-12-18T10:25:57.050520+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":9048,"mds_1":9042,"mds_2":9039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9039":{"gid":9039,"name":"c","rank":2,"incarnation":107,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6836/3153614779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3153614779},{"type":"v1","addr":"172.21.15.133:6836","nonce":3153614779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9042":{"gid":9042,"name":"a","rank":1,"incarnation":105,"state":"up:active","state_seq":12,"addr":"172.21.15.133:6837/1840110844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1840110844},{"type":"v1","addr":"172.21.15.133:6837","nonce":1840110844}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_9048":{"gid":9048,"name":"d","rank":0,"incarnation":99,"state":"up:active","state_seq":12,"addr":"172.21.15.142:6835/1819917691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":1819917691},{"type":"v1","addr":"172.21.15.142:6835","nonce":1819917691}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-18T10:26:11.506 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 113 2023-12-18T10:26:11.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35c0065a60 msgr2=0x7f35c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35c0065a60 0x7f35c0067f20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f35d415d2b0 tx=0x7f35c4008040 comp rx=0 tx=0).stop 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d406fdb0 msgr2=0x7f35d4155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d406fdb0 0x7f35d4155480 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f35d00ad040 tx=0x7f35d00191d0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 shutdown_connections 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f35c0065a60 0x7f35c0067f20 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f35d415a680 0x7f35d40cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f35d40cac10 0x7f35d40ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 --2- 172.21.15.133:0/73381690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35d406fdb0 0x7f35d4155480 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 >> 172.21.15.133:0/73381690 conn(0x7f35d406a3e0 msgr2=0x7f35d40af290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 shutdown_connections 2023-12-18T10:26:11.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.508+0000 7f35daf39640 1 -- 172.21.15.133:0/73381690 wait complete. 2023-12-18T10:26:11.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:26:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff09676d640 1 Processor -- start 2023-12-18T10:26:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff09676d640 1 -- start start 2023-12-18T10:26:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff09676d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff09006c4f0 0x7ff0900c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff09676d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0900c9e30 0x7ff090070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff09676d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0900c9460 con 0x7ff0901570c0 2023-12-18T10:26:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff09676d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0901574a0 con 0x7ff0900c9e30 2023-12-18T10:26:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff09676d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900c8b30 con 0x7ff09006c4f0 2023-12-18T10:26:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff08ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff0901570c0 0x7ff09006bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33046/0 (socket says 172.21.15.133:33046) 2023-12-18T10:26:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff08ffff640 1 -- 172.21.15.133:0/690623157 learned_addr learned my addr 172.21.15.133:0/690623157 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff094d0a640 1 --2- 172.21.15.133:0/690623157 >> v2:172.21.15.133:3300/0 conn(0x7ff0900c9e30 0x7ff090070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff094d0a640 1 -- 172.21.15.133:0/690623157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff09006c4f0 msgr2=0x7ff0900c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff094d0a640 1 --2- 172.21.15.133:0/690623157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff09006c4f0 0x7ff0900c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff094d0a640 1 -- 172.21.15.133:0/690623157 >> v1:172.21.15.133:6789/0 conn(0x7ff0901570c0 legacy=0x7ff09006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff094d0a640 1 -- 172.21.15.133:0/690623157 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900c8e10 con 0x7ff0900c9e30 2023-12-18T10:26:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.664+0000 7ff08effd640 1 -- 172.21.15.133:0/690623157 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382665711 0 0) 0x7ff0900c9460 con 0x7ff0901570c0 2023-12-18T10:26:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff094d0a640 1 --2- 172.21.15.133:0/690623157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0900c9e30 0x7ff090070df0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7ff088009d90 tx=0x7ff08801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361388f8a0bd7c19 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff08effd640 1 -- 172.21.15.133:0/690623157 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880a5a10 con 0x7ff0900c9e30 2023-12-18T10:26:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff08effd640 1 -- 172.21.15.133:0/690623157 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880a5b70 con 0x7ff0900c9e30 2023-12-18T10:26:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff08effd640 1 -- 172.21.15.133:0/690623157 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880ad440 con 0x7ff0900c9e30 2023-12-18T10:26:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff09676d640 1 -- 172.21.15.133:0/690623157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0900c9e30 msgr2=0x7ff090070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff09676d640 1 --2- 172.21.15.133:0/690623157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0900c9e30 0x7ff090070df0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7ff088009d90 tx=0x7ff08801c950 comp rx=0 tx=0).stop 2023-12-18T10:26:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff09676d640 1 -- 172.21.15.133:0/690623157 shutdown_connections 2023-12-18T10:26:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff09676d640 1 --2- 172.21.15.133:0/690623157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0900c9e30 0x7ff090070df0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff09676d640 1 --2- 172.21.15.133:0/690623157 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff09006c4f0 0x7ff0900c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff09676d640 1 -- 172.21.15.133:0/690623157 >> 172.21.15.133:0/690623157 conn(0x7ff09006a3e0 msgr2=0x7ff0900afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff09676d640 1 -- 172.21.15.133:0/690623157 shutdown_connections 2023-12-18T10:26:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.668+0000 7ff09676d640 1 -- 172.21.15.133:0/690623157 wait complete. 2023-12-18T10:26:11.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 Processor -- start 2023-12-18T10:26:11.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 -- start start 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09006c4f0 0x7ff0900cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900c9e30 0x7ff09014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0901570c0 0x7ff0901504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090151e60 con 0x7ff09006c4f0 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0901520b0 con 0x7ff0900c9e30 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900c4360 con 0x7ff0901570c0 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09006c4f0 0x7ff0900cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09006c4f0 0x7ff0900cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53942/0 (socket says 172.21.15.133:53942) 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 -- 172.21.15.133:0/1655921987 learned_addr learned my addr 172.21.15.133:0/1655921987 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff094d0a640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0901570c0 0x7ff0901504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08f7fe640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900c9e30 0x7ff09014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 -- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0901570c0 msgr2=0x7ff0901504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0901570c0 0x7ff0901504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 -- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900c9e30 msgr2=0x7ff09014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900c9e30 0x7ff09014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 -- 172.21.15.133:0/1655921987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088009a70 con 0x7ff09006c4f0 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08f7fe640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900c9e30 0x7ff09014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08ffff640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09006c4f0 0x7ff0900cd1a0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7ff08000c480 tx=0x7ff08000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08cff9640 1 -- 172.21.15.133:0/1655921987 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800074e0 con 0x7ff09006c4f0 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08cff9640 1 -- 172.21.15.133:0/1655921987 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff080007660 con 0x7ff09006c4f0 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff08cff9640 1 -- 172.21.15.133:0/1655921987 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080004a30 con 0x7ff09006c4f0 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09014be30 con 0x7ff09006c4f0 2023-12-18T10:26:11.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0900c4b60 con 0x7ff09006c4f0 2023-12-18T10:26:11.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.672+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0900c49b0 con 0x7ff09006c4f0 2023-12-18T10:26:11.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.676+0000 7ff08cff9640 1 -- 172.21.15.133:0/1655921987 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff080004b90 con 0x7ff09006c4f0 2023-12-18T10:26:11.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.676+0000 7ff08cff9640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff07c065a60 0x7ff07c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.676+0000 7ff08cff9640 1 -- 172.21.15.133:0/1655921987 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff080082410 con 0x7ff09006c4f0 2023-12-18T10:26:11.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.676+0000 7ff08f7fe640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff07c065a60 0x7ff07c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.676+0000 7ff08f7fe640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff07c065a60 0x7ff07c067f20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff09014ee00 tx=0x7ff084008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.680+0000 7ff08cff9640 1 -- 172.21.15.133:0/1655921987 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff0800537a0 con 0x7ff09006c4f0 2023-12-18T10:26:11.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.832+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0900735b0 con 0x7ff09006c4f0 2023-12-18T10:26:11.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.832+0000 7ff08cff9640 1 -- 172.21.15.133:0/1655921987 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16346 (secure 0 0 0) 0x7ff080053330 con 0x7ff09006c4f0 2023-12-18T10:26:11.833 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:11.834 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":107,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:25:48.135263+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-12-18T10:25:17.041912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-12-18T10:25:17.544282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.22","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:26:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.832+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff07c065a60 msgr2=0x7ff07c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff07c065a60 0x7ff07c067f20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff09014ee00 tx=0x7ff084008040 comp rx=0 tx=0).stop 2023-12-18T10:26:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09006c4f0 msgr2=0x7ff0900cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09006c4f0 0x7ff0900cd1a0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7ff08000c480 tx=0x7ff08000c940 comp rx=0 tx=0).stop 2023-12-18T10:26:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 shutdown_connections 2023-12-18T10:26:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff07c065a60 0x7ff07c067f20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0901570c0 0x7ff0901504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0900c9e30 0x7ff09014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 --2- 172.21.15.133:0/1655921987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09006c4f0 0x7ff0900cd1a0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 >> 172.21.15.133:0/1655921987 conn(0x7ff09006a3e0 msgr2=0x7ff0900ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:11.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 shutdown_connections 2023-12-18T10:26:11.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.836+0000 7ff09676d640 1 -- 172.21.15.133:0/1655921987 wait complete. 2023-12-18T10:26:11.855 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-18T10:26:11.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.992+0000 7f11fb02d640 1 Processor -- start 2023-12-18T10:26:11.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.992+0000 7f11fb02d640 1 -- start start 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.992+0000 7f11fb02d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f11f415c800 0x7f11f4070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.992+0000 7f11fb02d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11f4158c20 0x7f11f40b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.992+0000 7f11fb02d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f41590b0 con 0x7f11f40caa70 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.992+0000 7f11fb02d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f4070b80 con 0x7f11f4158c20 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.992+0000 7f11fb02d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f4070e60 con 0x7f11f415c800 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.992+0000 7f11f3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11f4158c20 0x7f11f40b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f95ca640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f11f40caa70 0x7f11f40caec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33054/0 (socket says 172.21.15.133:33054) 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11f4158c20 0x7f11f40b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53950/0 (socket says 172.21.15.133:53950) 2023-12-18T10:26:11.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f95ca640 1 -- 172.21.15.133:0/4204737306 learned_addr learned my addr 172.21.15.133:0/4204737306 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:11.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f8dc9640 1 --2- 172.21.15.133:0/4204737306 >> v2:172.21.15.142:3300/0 conn(0x7f11f415c800 0x7f11f4070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:11.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f3fff640 1 -- 172.21.15.133:0/4204737306 >> v2:172.21.15.142:3300/0 conn(0x7f11f415c800 msgr2=0x7f11f4070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:11.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f3fff640 1 --2- 172.21.15.133:0/4204737306 >> v2:172.21.15.142:3300/0 conn(0x7f11f415c800 0x7f11f4070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f3fff640 1 -- 172.21.15.133:0/4204737306 >> v1:172.21.15.133:6789/0 conn(0x7f11f40caa70 legacy=0x7f11f40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f3fff640 1 -- 172.21.15.133:0/4204737306 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4071140 con 0x7f11f4158c20 2023-12-18T10:26:11.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f37fe640 1 -- 172.21.15.133:0/4204737306 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111071051 0 0) 0x7f11f41590b0 con 0x7f11f40caa70 2023-12-18T10:26:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f3fff640 1 --2- 172.21.15.133:0/4204737306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f40b05a0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f11f40cc0c0 tx=0x7f11e001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63dcdb3ce2460c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f37fe640 1 -- 172.21.15.133:0/4204737306 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00ac600 con 0x7f11f4158c20 2023-12-18T10:26:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f37fe640 1 -- 172.21.15.133:0/4204737306 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e00a8050 con 0x7f11f4158c20 2023-12-18T10:26:11.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:11.996+0000 7f11f37fe640 1 -- 172.21.15.133:0/4204737306 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00ac980 con 0x7f11f4158c20 2023-12-18T10:26:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- 172.21.15.133:0/4204737306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 msgr2=0x7f11f40b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 --2- 172.21.15.133:0/4204737306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f40b05a0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f11f40cc0c0 tx=0x7f11e001c3a0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- 172.21.15.133:0/4204737306 shutdown_connections 2023-12-18T10:26:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 --2- 172.21.15.133:0/4204737306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f40b05a0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:11.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 --2- 172.21.15.133:0/4204737306 >> v2:172.21.15.142:3300/0 conn(0x7f11f415c800 0x7f11f4070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- 172.21.15.133:0/4204737306 >> 172.21.15.133:0/4204737306 conn(0x7f11f406a3e0 msgr2=0x7f11f40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- 172.21.15.133:0/4204737306 shutdown_connections 2023-12-18T10:26:12.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- 172.21.15.133:0/4204737306 wait complete. 2023-12-18T10:26:12.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 Processor -- start 2023-12-18T10:26:12.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- start start 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11f40caa70 0x7f11f40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f415bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11f415c800 0x7f11f414f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f414fbc0 con 0x7f11f4158c20 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f415c0e0 con 0x7f11f40caa70 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11fb02d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f414f630 con 0x7f11f415c800 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f415bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f415bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53966/0 (socket says 172.21.15.133:53966) 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f3fff640 1 -- 172.21.15.133:0/3342276477 learned_addr learned my addr 172.21.15.133:0/3342276477 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f95ca640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11f415c800 0x7f11f414f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f8dc9640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11f40caa70 0x7f11f40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f3fff640 1 -- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11f415c800 msgr2=0x7f11f414f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f3fff640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11f415c800 0x7f11f414f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f3fff640 1 -- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11f40caa70 msgr2=0x7f11f40b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f3fff640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11f40caa70 0x7f11f40b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f3fff640 1 -- 172.21.15.133:0/3342276477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0009420 con 0x7f11f4158c20 2023-12-18T10:26:12.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.000+0000 7f11f8dc9640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11f40caa70 0x7f11f40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:12.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11f3fff640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f415bba0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f11e0018fb0 tx=0x7f11e001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:12.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11f17fa640 1 -- 172.21.15.133:0/3342276477 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00b5830 con 0x7f11f4158c20 2023-12-18T10:26:12.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11f17fa640 1 -- 172.21.15.133:0/3342276477 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e00b59b0 con 0x7f11f4158c20 2023-12-18T10:26:12.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11f17fa640 1 -- 172.21.15.133:0/3342276477 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00b5d60 con 0x7f11f4158c20 2023-12-18T10:26:12.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f40c8800 con 0x7f11f4158c20 2023-12-18T10:26:12.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f40b2750 con 0x7f11f4158c20 2023-12-18T10:26:12.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f40735b0 con 0x7f11f4158c20 2023-12-18T10:26:12.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11f17fa640 1 -- 172.21.15.133:0/3342276477 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11e00b3070 con 0x7f11f4158c20 2023-12-18T10:26:12.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11f17fa640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f11d8065a90 0x7f11d8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11f17fa640 1 -- 172.21.15.133:0/3342276477 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11e011dd80 con 0x7f11f4158c20 2023-12-18T10:26:12.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.004+0000 7f11f8dc9640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f11d8065a90 0x7f11d8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.008+0000 7f11f8dc9640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f11d8065a90 0x7f11d8067f50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f11f41f8730 tx=0x7f11e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.008+0000 7f11f17fa640 1 -- 172.21.15.133:0/3342276477 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f11e00eb5d0 con 0x7f11f4158c20 2023-12-18T10:26:12.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.196+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f11f40ce160 con 0x7f11f4158c20 2023-12-18T10:26:12.197 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-18T10:26:12.196+0000 7f3ba99e6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-18T10:26:12.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.204+0000 7f11f17fa640 1 -- 172.21.15.133:0/3342276477 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v114) v1 ==== 161+0+0 (secure 0 0 0) 0x7f11e00eebf0 con 0x7f11f4158c20 2023-12-18T10:26:12.206 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-18T10:26:12.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f11d8065a90 msgr2=0x7f11d8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f11d8065a90 0x7f11d8067f50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f11f41f8730 tx=0x7f11e8008040 comp rx=0 tx=0).stop 2023-12-18T10:26:12.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 msgr2=0x7f11f415bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f415bba0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f11e0018fb0 tx=0x7f11e001abe0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 shutdown_connections 2023-12-18T10:26:12.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f11d8065a90 0x7f11d8067f50 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f11f415c800 0x7f11f414f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f4158c20 0x7f11f415bba0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 --2- 172.21.15.133:0/3342276477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11f40caa70 0x7f11f40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 >> 172.21.15.133:0/3342276477 conn(0x7f11f406a3e0 msgr2=0x7f11f40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:12.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 shutdown_connections 2023-12-18T10:26:12.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.208+0000 7f11fb02d640 1 -- 172.21.15.133:0/3342276477 wait complete. 2023-12-18T10:26:12.217 INFO:tasks.ceph.mds.c.smithi133.stderr: -983> 2023-12-18T10:25:53.856+0000 7fe41e0c8640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2023-12-18T10:25:34.812966+0000 1=0+1) n(v0 rc2023-12-18T10:25:34.812966+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={9225=pAsLsXsFsx/-@6},l=9225 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x562107fe3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.812966+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:34.812966+0000 2=0+2)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.812966+0000 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-18T10:25:34.812966+0000 2=0+2)","error_str":""},"return_code":-61} 2023-12-18T10:26:12.217 INFO:tasks.ceph.mds.c.smithi133.stderr: -968> 2023-12-18T10:25:53.856+0000 7fe41e0c8640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (iversion lock) caps={9225=pAsLsXsFs/-@3},l=9225 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x562107fe4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2023-12-18T10:26:12.221 INFO:tasks.ceph.mds.a.smithi133.stderr: -1094> 2023-12-18T10:25:53.856+0000 7fd7d20c0640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2023-12-18T10:25:34.808484+0000 1=0+1) n(v2 rc2023-12-18T10:25:35.035375+0000 4=0+4) (inest lock) (iversion lock) caps={9225=pAsLsXsFs/-@7},l=9225 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x56010478d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.808484+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:35.035375+0000 4=0+4)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.808484+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-12-18T10:25:35.035375+0000 4=0+4)","error_str":""},"return_code":-61} 2023-12-18T10:26:12.221 INFO:tasks.ceph.mds.a.smithi133.stderr: -974> 2023-12-18T10:25:53.860+0000 7fd7d80cc640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2023-12-18T10:25:34.810793+0000 1=0+1) n(v1 rc2023-12-18T10:25:35.035375+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={9225=pAsLsXsFs/-@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x56010478d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.810793+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:34.812966+0000 3=0+3)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.810793+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-12-18T10:25:35.035375+0000 3=0+3)","error_str":""},"return_code":-61} 2023-12-18T10:26:12.227 INFO:tasks.ceph.mds.d.smithi142.stderr: -2308> 2023-12-18T10:25:53.857+0000 7f01ff87f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2023-12-18T10:25:34.804037+0000 1=0+1) n(v3 rc2023-12-18T10:25:35.035375+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={9225=pAsLsXsFsx/AsLsXsFsx@9},l=9225 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55ceee436b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.804037+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:35.035375+0000 6=0+6)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.804037+0000 1=0+1)","memory_value.rstat":"n(v3 rc2023-12-18T10:25:35.035375+0000 6=0+6)","error_str":""},"return_code":-61} 2023-12-18T10:26:12.227 INFO:tasks.ceph.mds.d.smithi142.stderr: -2208> 2023-12-18T10:25:53.857+0000 7f020588b640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2023-12-18T10:25:34.806254+0000 1=0+1) n(v4 rc2023-12-18T10:25:35.035375+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={9225=pAsLsXsFs/-@11} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55ceee437080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-18T10:25:34.806254+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-12-18T10:25:35.035375+0000 5=0+5)","memory_value.dirstat":"f(v0 m2023-12-18T10:25:34.806254+0000 1=0+1)","memory_value.rstat":"n(v4 rc2023-12-18T10:25:35.035375+0000 5=0+5)","error_str":""},"return_code":-61} 2023-12-18T10:26:12.230 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-18T10:26:12.264 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-18T10:26:12.266 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-18T10:26:12.275 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2023-12-18T10:26:12.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78ff10a640 1 Processor -- start 2023-12-18T10:26:12.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78ff10a640 1 -- start start 2023-12-18T10:26:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78ff10a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78f80cde90 0x7f78f80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78ff10a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f815cec0 con 0x7f78f815cae0 2023-12-18T10:26:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78ff10a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f80d0530 con 0x7f78f80cf170 2023-12-18T10:26:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78ff10a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f80d0810 con 0x7f78f80cde90 2023-12-18T10:26:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78effff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78f80cde90 0x7f78f80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78fcea6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f78f815cae0 0x7f78f80d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33062/0 (socket says 172.21.15.133:33062) 2023-12-18T10:26:12.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78effff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78f80cde90 0x7f78f80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53996/0 (socket says 172.21.15.133:53996) 2023-12-18T10:26:12.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78fcea6640 1 -- 172.21.15.133:0/3787628119 learned_addr learned my addr 172.21.15.133:0/3787628119 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:12.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78effff640 1 -- 172.21.15.133:0/3787628119 >> v1:172.21.15.142:6789/0 conn(0x7f78f80cf170 legacy=0x7f78f806add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78effff640 1 -- 172.21.15.133:0/3787628119 >> v1:172.21.15.133:6789/0 conn(0x7f78f815cae0 legacy=0x7f78f80d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78effff640 1 -- 172.21.15.133:0/3787628119 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80d0af0 con 0x7f78f80cde90 2023-12-18T10:26:12.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.376+0000 7f78ef7fe640 1 -- 172.21.15.133:0/3787628119 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035175667 0 0) 0x7f78f815cec0 con 0x7f78f815cae0 2023-12-18T10:26:12.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78effff640 1 --2- 172.21.15.133:0/3787628119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80cde90 0x7f78f80ce2f0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f78e80097c0 tx=0x7f78e801ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4a4c6f309798e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:12.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ef7fe640 1 -- 172.21.15.133:0/3787628119 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e80ab670 con 0x7f78f80cde90 2023-12-18T10:26:12.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ef7fe640 1 -- 172.21.15.133:0/3787628119 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e80ab7d0 con 0x7f78f80cde90 2023-12-18T10:26:12.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ef7fe640 1 -- 172.21.15.133:0/3787628119 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e80abb60 con 0x7f78f80cde90 2023-12-18T10:26:12.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ff10a640 1 -- 172.21.15.133:0/3787628119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80cde90 msgr2=0x7f78f80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ff10a640 1 --2- 172.21.15.133:0/3787628119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80cde90 0x7f78f80ce2f0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f78e80097c0 tx=0x7f78e801ceb0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ff10a640 1 -- 172.21.15.133:0/3787628119 shutdown_connections 2023-12-18T10:26:12.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ff10a640 1 --2- 172.21.15.133:0/3787628119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80cde90 0x7f78f80ce2f0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ff10a640 1 -- 172.21.15.133:0/3787628119 >> 172.21.15.133:0/3787628119 conn(0x7f78f8089fb0 msgr2=0x7f78f80d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:12.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ff10a640 1 -- 172.21.15.133:0/3787628119 shutdown_connections 2023-12-18T10:26:12.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.380+0000 7f78ff10a640 1 -- 172.21.15.133:0/3787628119 wait complete. 2023-12-18T10:26:12.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 Processor -- start 2023-12-18T10:26:12.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 -- start start 2023-12-18T10:26:12.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78f80cde90 0x7f78f81505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78f80cf170 0x7f78f80ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f815cae0 0x7f78f8158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80caaf0 con 0x7f78f815cae0 2023-12-18T10:26:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80cadd0 con 0x7f78f80cf170 2023-12-18T10:26:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80cb0b0 con 0x7f78f80cde90 2023-12-18T10:26:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f815cae0 0x7f78f8158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f815cae0 0x7f78f8158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54002/0 (socket says 172.21.15.133:54002) 2023-12-18T10:26:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 -- 172.21.15.133:0/262588937 learned_addr learned my addr 172.21.15.133:0/262588937 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78effff640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78f80cf170 0x7f78f80ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fcea6640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78f80cde90 0x7f78f81505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 -- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78f80cde90 msgr2=0x7f78f81505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78f80cde90 0x7f78f81505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 -- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78f80cf170 msgr2=0x7f78f80ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78f80cf170 0x7f78f80ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 -- 172.21.15.133:0/262588937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e8009420 con 0x7f78f815cae0 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fcea6640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78f80cde90 0x7f78f81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78fd6a7640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f815cae0 0x7f78f8158cd0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c6c0 tx=0x7f78f000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ed7fa640 1 -- 172.21.15.133:0/262588937 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0003b80 con 0x7f78f815cae0 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ed7fa640 1 -- 172.21.15.133:0/262588937 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0003ce0 con 0x7f78f815cae0 2023-12-18T10:26:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ed7fa640 1 -- 172.21.15.133:0/262588937 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00052f0 con 0x7f78f815cae0 2023-12-18T10:26:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f80cfb10 con 0x7f78f815cae0 2023-12-18T10:26:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.384+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f80cb670 con 0x7f78f815cae0 2023-12-18T10:26:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.388+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f80cb860 con 0x7f78f815cae0 2023-12-18T10:26:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.388+0000 7f78ed7fa640 1 -- 172.21.15.133:0/262588937 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f78f0005450 con 0x7f78f815cae0 2023-12-18T10:26:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.388+0000 7f78ed7fa640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f78e4065a60 0x7f78e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.388+0000 7f78ed7fa640 1 -- 172.21.15.133:0/262588937 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f78f0083250 con 0x7f78f815cae0 2023-12-18T10:26:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.388+0000 7f78fcea6640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f78e4065a60 0x7f78e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.388+0000 7f78fcea6640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f78e4065a60 0x7f78e4067f20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f78f4001630 tx=0x7f78f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:12.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.392+0000 7f78ed7fa640 1 -- 172.21.15.133:0/262588937 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f78f0050910 con 0x7f78f815cae0 2023-12-18T10:26:12.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:12.572+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f78f804e000 con 0x7f78f815cae0 2023-12-18T10:26:13.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.208+0000 7f78ed7fa640 1 -- 172.21.15.133:0/262588937 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v115) v1 ==== 104+0+0 (secure 0 0 0) 0x7f78f0053f30 con 0x7f78f815cae0 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.208+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f78e4065a60 msgr2=0x7f78e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.208+0000 7f78ff10a640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f78e4065a60 0x7f78e4067f20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f78f4001630 tx=0x7f78f4009040 comp rx=0 tx=0).stop 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.208+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f815cae0 msgr2=0x7f78f8158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.208+0000 7f78ff10a640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f815cae0 0x7f78f8158cd0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c6c0 tx=0x7f78f000cb80 comp rx=0 tx=0).stop 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.212+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 shutdown_connections 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.212+0000 7f78ff10a640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f78e4065a60 0x7f78e4067f20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.212+0000 7f78ff10a640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f815cae0 0x7f78f8158cd0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.212+0000 7f78ff10a640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78f80cf170 0x7f78f80ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.212+0000 7f78ff10a640 1 --2- 172.21.15.133:0/262588937 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f78f80cde90 0x7f78f81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.212+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 >> 172.21.15.133:0/262588937 conn(0x7f78f8089fb0 msgr2=0x7f78f8157680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:13.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.212+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 shutdown_connections 2023-12-18T10:26:13.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.212+0000 7f78ff10a640 1 -- 172.21.15.133:0/262588937 wait complete. 2023-12-18T10:26:13.234 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-18T10:26:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.416+0000 7f6bdbcc4640 1 Processor -- start 2023-12-18T10:26:13.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.416+0000 7f6bdbcc4640 1 -- start start 2023-12-18T10:26:13.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bdbcc4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6bd40ce6a0 0x7f6bd40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:13.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bdbcc4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd40ad6e0 con 0x7f6bd40ca200 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bdbcc4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd40ad9c0 con 0x7f6bd40c89f0 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bdbcc4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd4159b20 con 0x7f6bd40ce6a0 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd925f640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6bd40ca200 0x7f6bd40cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33078/0 (socket says 172.21.15.133:33078) 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd925f640 1 -- 172.21.15.133:0/3322416064 learned_addr learned my addr 172.21.15.133:0/3322416064 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd9a60640 1 --2- 172.21.15.133:0/3322416064 >> v2:172.21.15.142:3300/0 conn(0x7f6bd40ce6a0 0x7f6bd40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd8a5e640 1 -- 172.21.15.133:0/3322416064 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784506569 0 0) 0x7f6bd40ad6e0 con 0x7f6bd40ca200 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd8a5e640 1 -- 172.21.15.133:0/3322416064 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc0003530 con 0x7f6bd40ca200 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd8a5e640 1 -- 172.21.15.133:0/3322416064 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 786271852 0 0) 0x7f6bc0003530 con 0x7f6bd40ca200 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd9a60640 1 -- 172.21.15.133:0/3322416064 >> v1:172.21.15.142:6789/0 conn(0x7f6bd40c89f0 legacy=0x7f6bd40c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd9a60640 1 -- 172.21.15.133:0/3322416064 >> v1:172.21.15.133:6789/0 conn(0x7f6bd40ca200 legacy=0x7f6bd40cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:13.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.420+0000 7f6bd9a60640 1 -- 172.21.15.133:0/3322416064 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd406be20 con 0x7f6bd40ce6a0 2023-12-18T10:26:13.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bd9a60640 1 --2- 172.21.15.133:0/3322416064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 0x7f6bd40ca730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00097f0 tx=0x7f6bd001e580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b684a5c5232e825a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bd8a5e640 1 -- 172.21.15.133:0/3322416064 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4001680 con 0x7f6bd40ce6a0 2023-12-18T10:26:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bd8a5e640 1 -- 172.21.15.133:0/3322416064 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd00ad450 con 0x7f6bd40ce6a0 2023-12-18T10:26:13.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bd8a5e640 1 -- 172.21.15.133:0/3322416064 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00ad7e0 con 0x7f6bd40ce6a0 2023-12-18T10:26:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/3322416064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 msgr2=0x7f6bd40ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 --2- 172.21.15.133:0/3322416064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 0x7f6bd40ca730 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00097f0 tx=0x7f6bd001e580 comp rx=0 tx=0).stop 2023-12-18T10:26:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/3322416064 shutdown_connections 2023-12-18T10:26:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 --2- 172.21.15.133:0/3322416064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 0x7f6bd40ca730 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/3322416064 >> 172.21.15.133:0/3322416064 conn(0x7f6bd4069e70 msgr2=0x7f6bd406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/3322416064 shutdown_connections 2023-12-18T10:26:13.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/3322416064 wait complete. 2023-12-18T10:26:13.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 Processor -- start 2023-12-18T10:26:13.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.424+0000 7f6bdbcc4640 1 -- start start 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bd40c89f0 0x7f6bd4154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd40ca200 0x7f6bd40c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 0x7f6bd40c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40b0d50 con 0x7f6bd40ca200 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c7ed0 con 0x7f6bd40ce6a0 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c81b0 con 0x7f6bd40c89f0 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd40ca200 0x7f6bd40c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd40ca200 0x7f6bd40c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54008/0 (socket says 172.21.15.133:54008) 2023-12-18T10:26:13.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 -- 172.21.15.133:0/1035630111 learned_addr learned my addr 172.21.15.133:0/1035630111 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd9a60640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bd40c89f0 0x7f6bd4154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bda261640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 0x7f6bd40c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 -- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bd40c89f0 msgr2=0x7f6bd4154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bd40c89f0 0x7f6bd4154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 -- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 msgr2=0x7f6bd40c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 0x7f6bd40c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 -- 172.21.15.133:0/1035630111 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009420 con 0x7f6bd40ca200 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bda261640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 0x7f6bd40c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:13.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bd925f640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd40ca200 0x7f6bd40c7000 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c780 tx=0x7f6bc400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:13.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bca7fc640 1 -- 172.21.15.133:0/1035630111 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4005cf0 con 0x7f6bd40ca200 2023-12-18T10:26:13.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bca7fc640 1 -- 172.21.15.133:0/1035630111 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc4005e50 con 0x7f6bd40ca200 2023-12-18T10:26:13.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bca7fc640 1 -- 172.21.15.133:0/1035630111 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc40072b0 con 0x7f6bd40ca200 2023-12-18T10:26:13.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd40b0a90 con 0x7f6bd40ca200 2023-12-18T10:26:13.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd406a250 con 0x7f6bd40ca200 2023-12-18T10:26:13.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd406a4d0 con 0x7f6bd40ca200 2023-12-18T10:26:13.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.428+0000 7f6bca7fc640 1 -- 172.21.15.133:0/1035630111 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6bc4007410 con 0x7f6bd40ca200 2023-12-18T10:26:13.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.432+0000 7f6bca7fc640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bb8065a90 0x7f6bb8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:13.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.432+0000 7f6bca7fc640 1 -- 172.21.15.133:0/1035630111 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f6bc4082b30 con 0x7f6bd40ca200 2023-12-18T10:26:13.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.432+0000 7f6bd9a60640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bb8065a90 0x7f6bb8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:13.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.432+0000 7f6bd9a60640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bb8065a90 0x7f6bb8067f50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00b1000 tx=0x7f6bd00a9000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.436+0000 7f6bca7fc640 1 -- 172.21.15.133:0/1035630111 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6bd406a4d0 con 0x7f6bd40ca200 2023-12-18T10:26:13.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:13.588+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6bd406a4d0 con 0x7f6bd40ca200 2023-12-18T10:26:14.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.212+0000 7f6bca7fc640 1 -- 172.21.15.133:0/1035630111 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6bd406a4d0 con 0x7f6bd40ca200 2023-12-18T10:26:14.214 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-18T10:26:14.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bb8065a90 msgr2=0x7f6bb8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bb8065a90 0x7f6bb8067f50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00b1000 tx=0x7f6bd00a9000 comp rx=0 tx=0).stop 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd40ca200 msgr2=0x7f6bd40c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd40ca200 0x7f6bd40c7000 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c780 tx=0x7f6bc400cc40 comp rx=0 tx=0).stop 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 shutdown_connections 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6bb8065a90 0x7f6bb8067f50 secure :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00b1000 tx=0x7f6bd00a9000 comp rx=0 tx=0).stop 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bd40ce6a0 0x7f6bd40c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd40ca200 0x7f6bd40c7000 secure :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400c780 tx=0x7f6bc400cc40 comp rx=0 tx=0).stop 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 --2- 172.21.15.133:0/1035630111 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6bd40c89f0 0x7f6bd4154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:14.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.216+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 >> 172.21.15.133:0/1035630111 conn(0x7f6bd4069e70 msgr2=0x7f6bd40717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:14.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.220+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 shutdown_connections 2023-12-18T10:26:14.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.220+0000 7f6bdbcc4640 1 -- 172.21.15.133:0/1035630111 wait complete. 2023-12-18T10:26:14.243 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-18T10:26:14.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.384+0000 7f466348c640 1 Processor -- start 2023-12-18T10:26:14.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.384+0000 7f466348c640 1 -- start start 2023-12-18T10:26:14.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.384+0000 7f466348c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f465c0ce6a0 0x7f465c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:14.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.384+0000 7f466348c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0ad6e0 con 0x7f465c0ca200 2023-12-18T10:26:14.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.384+0000 7f466348c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0ad9c0 con 0x7f465c0c89f0 2023-12-18T10:26:14.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.384+0000 7f466348c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c159b20 con 0x7f465c0ce6a0 2023-12-18T10:26:14.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4660a27640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f465c0ca200 0x7f465c0cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33090/0 (socket says 172.21.15.133:33090) 2023-12-18T10:26:14.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4660a27640 1 -- 172.21.15.133:0/3086938373 learned_addr learned my addr 172.21.15.133:0/3086938373 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:14.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4661228640 1 --2- 172.21.15.133:0/3086938373 >> v2:172.21.15.142:3300/0 conn(0x7f465c0ce6a0 0x7f465c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4653fff640 1 -- 172.21.15.133:0/3086938373 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298211027 0 0) 0x7f465c0ad6e0 con 0x7f465c0ca200 2023-12-18T10:26:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4653fff640 1 -- 172.21.15.133:0/3086938373 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4648003530 con 0x7f465c0ca200 2023-12-18T10:26:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4661228640 1 -- 172.21.15.133:0/3086938373 >> v1:172.21.15.142:6789/0 conn(0x7f465c0c89f0 legacy=0x7f465c0c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4661228640 1 -- 172.21.15.133:0/3086938373 >> v1:172.21.15.133:6789/0 conn(0x7f465c0ca200 legacy=0x7f465c0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4661228640 1 -- 172.21.15.133:0/3086938373 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c06be20 con 0x7f465c0ce6a0 2023-12-18T10:26:14.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4661228640 1 --2- 172.21.15.133:0/3086938373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ce6a0 0x7f465c0ca730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f46580097f0 tx=0x7f465801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ea2edc01afdc8a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:14.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4653fff640 1 -- 172.21.15.133:0/3086938373 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580ab650 con 0x7f465c0ce6a0 2023-12-18T10:26:14.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4653fff640 1 -- 172.21.15.133:0/3086938373 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46580ab7b0 con 0x7f465c0ce6a0 2023-12-18T10:26:14.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.388+0000 7f4653fff640 1 -- 172.21.15.133:0/3086938373 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580abb40 con 0x7f465c0ce6a0 2023-12-18T10:26:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- 172.21.15.133:0/3086938373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ce6a0 msgr2=0x7f465c0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 --2- 172.21.15.133:0/3086938373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ce6a0 0x7f465c0ca730 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f46580097f0 tx=0x7f465801c450 comp rx=0 tx=0).stop 2023-12-18T10:26:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- 172.21.15.133:0/3086938373 shutdown_connections 2023-12-18T10:26:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 --2- 172.21.15.133:0/3086938373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ce6a0 0x7f465c0ca730 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- 172.21.15.133:0/3086938373 >> 172.21.15.133:0/3086938373 conn(0x7f465c069e70 msgr2=0x7f465c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- 172.21.15.133:0/3086938373 shutdown_connections 2023-12-18T10:26:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- 172.21.15.133:0/3086938373 wait complete. 2023-12-18T10:26:14.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 Processor -- start 2023-12-18T10:26:14.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- start start 2023-12-18T10:26:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f465c0c89f0 0x7f465c0acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ca200 0x7f465c0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f465c0ce6a0 0x7f465c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0ad1d0 con 0x7f465c0c89f0 2023-12-18T10:26:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0afc10 con 0x7f465c0ca200 2023-12-18T10:26:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f466348c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0afef0 con 0x7f465c0ce6a0 2023-12-18T10:26:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f4661228640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f465c0c89f0 0x7f465c0acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f4661228640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f465c0c89f0 0x7f465c0acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54022/0 (socket says 172.21.15.133:54022) 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.392+0000 7f4661228640 1 -- 172.21.15.133:0/2943820917 learned_addr learned my addr 172.21.15.133:0/2943820917 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4660a27640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ca200 0x7f465c0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4661a29640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f465c0ce6a0 0x7f465c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4661228640 1 -- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f465c0ce6a0 msgr2=0x7f465c15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4661228640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f465c0ce6a0 0x7f465c15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4661228640 1 -- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ca200 msgr2=0x7f465c0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4661228640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ca200 0x7f465c0add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4661228640 1 -- 172.21.15.133:0/2943820917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658009420 con 0x7f465c0c89f0 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4661a29640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f465c0ce6a0 0x7f465c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4660a27640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ca200 0x7f465c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4661228640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f465c0c89f0 0x7f465c0acc90 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f46580ad040 tx=0x7f465801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4651ffb640 1 -- 172.21.15.133:0/2943820917 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580b5810 con 0x7f465c0c89f0 2023-12-18T10:26:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4651ffb640 1 -- 172.21.15.133:0/2943820917 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46580b5990 con 0x7f465c0c89f0 2023-12-18T10:26:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4651ffb640 1 -- 172.21.15.133:0/2943820917 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580b5d40 con 0x7f465c0c89f0 2023-12-18T10:26:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c0b01d0 con 0x7f465c0c89f0 2023-12-18T10:26:14.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c0b0790 con 0x7f465c0c89f0 2023-12-18T10:26:14.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465c04e070 con 0x7f465c0c89f0 2023-12-18T10:26:14.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.396+0000 7f4651ffb640 1 -- 172.21.15.133:0/2943820917 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f46580b4390 con 0x7f465c0c89f0 2023-12-18T10:26:14.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.400+0000 7f4651ffb640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4640065a60 0x7f4640067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:14.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.400+0000 7f4651ffb640 1 -- 172.21.15.133:0/2943820917 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f465811dcd0 con 0x7f465c0c89f0 2023-12-18T10:26:14.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.400+0000 7f4660a27640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4640065a60 0x7f4640067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:14.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.400+0000 7f4660a27640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4640065a60 0x7f4640067f20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f465c159e40 tx=0x7f464c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:14.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.404+0000 7f4651ffb640 1 -- 172.21.15.133:0/2943820917 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f46580eb5e0 con 0x7f465c0c89f0 2023-12-18T10:26:14.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:14.556+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f465c06d8f0 con 0x7f465c0c89f0 2023-12-18T10:26:15.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.224+0000 7f4651ffb640 1 -- 172.21.15.133:0/2943820917 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) v1 ==== 169+0+0 (secure 0 0 0) 0x7f46580ab610 con 0x7f465c0c89f0 2023-12-18T10:26:15.225 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-18T10:26:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4640065a60 msgr2=0x7f4640067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4640065a60 0x7f4640067f20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f465c159e40 tx=0x7f464c009040 comp rx=0 tx=0).stop 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f465c0c89f0 msgr2=0x7f465c0acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f465c0c89f0 0x7f465c0acc90 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f46580ad040 tx=0x7f465801ac90 comp rx=0 tx=0).stop 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 shutdown_connections 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4640065a60 0x7f4640067f20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f465c0ce6a0 0x7f465c15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f465c0ca200 0x7f465c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 --2- 172.21.15.133:0/2943820917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f465c0c89f0 0x7f465c0acc90 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 >> 172.21.15.133:0/2943820917 conn(0x7f465c069e70 msgr2=0x7f465c071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 shutdown_connections 2023-12-18T10:26:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.228+0000 7f466348c640 1 -- 172.21.15.133:0/2943820917 wait complete. 2023-12-18T10:26:15.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-18T10:26:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.388+0000 7f773f59e640 1 Processor -- start 2023-12-18T10:26:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.388+0000 7f773f59e640 1 -- start start 2023-12-18T10:26:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.388+0000 7f773f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f774015ca70 0x7f77400d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.388+0000 7f773f59e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400d17c0 con 0x7f774015c690 2023-12-18T10:26:15.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.388+0000 7f773f59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400d1cb0 con 0x7f77400cd520 2023-12-18T10:26:15.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.388+0000 7f773f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400b1c20 con 0x7f774015ca70 2023-12-18T10:26:15.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.388+0000 7f773e59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f774015c690 0x7f77400cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33102/0 (socket says 172.21.15.133:33102) 2023-12-18T10:26:15.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.388+0000 7f773e59c640 1 -- 172.21.15.133:0/3213626167 learned_addr learned my addr 172.21.15.133:0/3213626167 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:15.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773ed9d640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f774015ca70 0x7f77400d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838983238 0 0) 0x7f77400d17c0 con 0x7f774015c690 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f772c003530 con 0x7f774015c690 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 959033120 0 0) 0x7f772c003530 con 0x7f774015c690 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f774015ca70 msgr2=0x7f77400d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f774015ca70 0x7f77400d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 >> v1:172.21.15.142:6789/0 conn(0x7f77400cd520 legacy=0x7f77400b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77400d1f90 con 0x7f774015c690 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7f7730001680 con 0x7f774015c690 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 >> v1:172.21.15.133:6789/0 conn(0x7f774015c690 legacy=0x7f77400cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f772c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f774015ca70 0x7f772c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f772c004d10 0x7f772c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400b1c20 con 0x7f772c0039b0 2023-12-18T10:26:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c00bb00 con 0x7f772c004d10 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c00bcc0 con 0x7f774015ca70 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773e59c640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f772c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f7735d9b640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f774015ca70 0x7f772c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773ed9d640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f772c004d10 0x7f772c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773e59c640 1 -- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f774015ca70 msgr2=0x7f772c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773e59c640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f774015ca70 0x7f772c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773e59c640 1 -- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f772c004d10 msgr2=0x7f772c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773e59c640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f772c004d10 0x7f772c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773e59c640 1 -- 172.21.15.133:0/3213626167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c003530 con 0x7f772c0039b0 2023-12-18T10:26:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.392+0000 7f773ed9d640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f772c004d10 0x7f772c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:15.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773e59c640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f772c003dd0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f773000c210 tx=0x7f773001f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5092c690e60af229 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:15.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730005ae0 con 0x7f772c0039b0 2023-12-18T10:26:15.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300ab070 con 0x7f772c0039b0 2023-12-18T10:26:15.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773dd9b640 1 -- 172.21.15.133:0/3213626167 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730007070 con 0x7f772c0039b0 2023-12-18T10:26:15.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 -- 172.21.15.133:0/3213626167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 msgr2=0x7f772c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 --2- 172.21.15.133:0/3213626167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f772c003dd0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f773000c210 tx=0x7f773001f370 comp rx=0 tx=0).stop 2023-12-18T10:26:15.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773ed9d640 1 -- 172.21.15.133:0/3213626167 reap_dead start 2023-12-18T10:26:15.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 -- 172.21.15.133:0/3213626167 shutdown_connections 2023-12-18T10:26:15.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 -- 172.21.15.133:0/3213626167 >> 172.21.15.133:0/3213626167 conn(0x7f77400717d0 msgr2=0x7f7740071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:15.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 -- 172.21.15.133:0/3213626167 shutdown_connections 2023-12-18T10:26:15.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 -- 172.21.15.133:0/3213626167 wait complete. 2023-12-18T10:26:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 Processor -- start 2023-12-18T10:26:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 -- start start 2023-12-18T10:26:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.396+0000 7f773f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f77401f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773f59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7740151690 0x7f774014e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773f59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f774014e910 0x7f774014b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773f59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774014df40 con 0x7f772c0039b0 2023-12-18T10:26:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773f59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f56e0 con 0x7f774014e910 2023-12-18T10:26:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773f59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f5990 con 0x7f7740151690 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f77401f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f77401f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54028/0 (socket says 172.21.15.133:54028) 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 -- 172.21.15.133:0/136598631 learned_addr learned my addr 172.21.15.133:0/136598631 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f7735d9b640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7740151690 0x7f774014e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 -- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7740151690 msgr2=0x7f774014e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773ed9d640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f774014e910 0x7f774014b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7740151690 0x7f774014e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 -- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f774014e910 msgr2=0x7f774014b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f774014e910 0x7f774014b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 -- 172.21.15.133:0/136598631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77401f5c70 con 0x7f772c0039b0 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773ed9d640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f774014e910 0x7f774014b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773e59c640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f77401f51a0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f7730025fe0 tx=0x7f772c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f77377fe640 1 -- 172.21.15.133:0/136598631 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730001640 con 0x7f772c0039b0 2023-12-18T10:26:15.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f77377fe640 1 -- 172.21.15.133:0/136598631 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730007070 con 0x7f772c0039b0 2023-12-18T10:26:15.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f77377fe640 1 -- 172.21.15.133:0/136598631 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730007400 con 0x7f772c0039b0 2023-12-18T10:26:15.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77401f5f50 con 0x7f772c0039b0 2023-12-18T10:26:15.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77401f1a30 con 0x7f772c0039b0 2023-12-18T10:26:15.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774004e000 con 0x7f772c0039b0 2023-12-18T10:26:15.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.400+0000 7f77377fe640 1 -- 172.21.15.133:0/136598631 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7730007560 con 0x7f772c0039b0 2023-12-18T10:26:15.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.404+0000 7f77377fe640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7720065a60 0x7f7720067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.404+0000 7f77377fe640 1 -- 172.21.15.133:0/136598631 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f773011fe90 con 0x7f772c0039b0 2023-12-18T10:26:15.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.404+0000 7f7735d9b640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7720065a60 0x7f7720067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.404+0000 7f7735d9b640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7720065a60 0x7f7720067f20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f77400d2c40 tx=0x7f7728009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:15.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.408+0000 7f77377fe640 1 -- 172.21.15.133:0/136598631 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f77300ed830 con 0x7f772c0039b0 2023-12-18T10:26:15.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.556+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f77400d02a0 con 0x7f772c0039b0 2023-12-18T10:26:15.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.564+0000 7f77377fe640 1 -- 172.21.15.133:0/136598631 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7730121020 con 0x7f772c0039b0 2023-12-18T10:26:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7720065a60 msgr2=0x7f7720067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7720065a60 0x7f7720067f20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f77400d2c40 tx=0x7f7728009040 comp rx=0 tx=0).stop 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 msgr2=0x7f77401f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f77401f51a0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f7730025fe0 tx=0x7f772c005800 comp rx=0 tx=0).stop 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 shutdown_connections 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f7720065a60 0x7f7720067f20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f774014e910 0x7f774014b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7740151690 0x7f774014e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 --2- 172.21.15.133:0/136598631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c0039b0 0x7f77401f51a0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 >> 172.21.15.133:0/136598631 conn(0x7f77400717d0 msgr2=0x7f77400cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 shutdown_connections 2023-12-18T10:26:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.568+0000 7f773f59e640 1 -- 172.21.15.133:0/136598631 wait complete. 2023-12-18T10:26:15.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2023-12-18T10:26:15.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f94922d1640 1 Processor -- start 2023-12-18T10:26:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f94922d1640 1 -- start start 2023-12-18T10:26:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f94922d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c06c4f0 0x7f948c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f94922d1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f948c0c9e30 0x7f948c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f94922d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0c9460 con 0x7f948c1570c0 2023-12-18T10:26:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f94922d1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c1574a0 con 0x7f948c0c9e30 2023-12-18T10:26:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f94922d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0c8b30 con 0x7f948c06c4f0 2023-12-18T10:26:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f948bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f948c1570c0 0x7f948c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33114/0 (socket says 172.21.15.133:33114) 2023-12-18T10:26:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f948bfff640 1 -- 172.21.15.133:0/3081656298 learned_addr learned my addr 172.21.15.133:0/3081656298 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f948b7fe640 1 --2- 172.21.15.133:0/3081656298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c06c4f0 0x7f948c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f949086e640 1 --2- 172.21.15.133:0/3081656298 >> v2:172.21.15.142:3300/0 conn(0x7f948c0c9e30 0x7f948c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f948affd640 1 -- 172.21.15.133:0/3081656298 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203511087 0 0) 0x7f948c0c9460 con 0x7f948c1570c0 2023-12-18T10:26:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f948affd640 1 -- 172.21.15.133:0/3081656298 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9474003530 con 0x7f948c1570c0 2023-12-18T10:26:15.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f948b7fe640 1 -- 172.21.15.133:0/3081656298 >> v2:172.21.15.142:3300/0 conn(0x7f948c0c9e30 msgr2=0x7f948c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:15.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f948affd640 1 -- 172.21.15.133:0/3081656298 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3811506113 0 0) 0x7f9474003530 con 0x7f948c1570c0 2023-12-18T10:26:15.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.732+0000 7f948b7fe640 1 --2- 172.21.15.133:0/3081656298 >> v2:172.21.15.142:3300/0 conn(0x7f948c0c9e30 0x7f948c070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.736+0000 7f948b7fe640 1 -- 172.21.15.133:0/3081656298 >> v1:172.21.15.133:6789/0 conn(0x7f948c1570c0 legacy=0x7f948c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.736+0000 7f948b7fe640 1 -- 172.21.15.133:0/3081656298 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0c8e10 con 0x7f948c06c4f0 2023-12-18T10:26:15.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.736+0000 7f949086e640 1 --2- 172.21.15.133:0/3081656298 >> v2:172.21.15.142:3300/0 conn(0x7f948c0c9e30 0x7f948c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:15.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.736+0000 7f948b7fe640 1 --2- 172.21.15.133:0/3081656298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c06c4f0 0x7f948c0c98f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94800097c0 tx=0x7f948001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9911ac9e4a7369df server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:15.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.736+0000 7f948affd640 1 -- 172.21.15.133:0/3081656298 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c001680 con 0x7f948c06c4f0 2023-12-18T10:26:15.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.736+0000 7f948affd640 1 -- 172.21.15.133:0/3081656298 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800a7050 con 0x7f948c06c4f0 2023-12-18T10:26:15.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.736+0000 7f948affd640 1 -- 172.21.15.133:0/3081656298 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800ab620 con 0x7f948c06c4f0 2023-12-18T10:26:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- 172.21.15.133:0/3081656298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c06c4f0 msgr2=0x7f948c0c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 --2- 172.21.15.133:0/3081656298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c06c4f0 0x7f948c0c98f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94800097c0 tx=0x7f948001c2e0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- 172.21.15.133:0/3081656298 shutdown_connections 2023-12-18T10:26:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 --2- 172.21.15.133:0/3081656298 >> v2:172.21.15.142:3300/0 conn(0x7f948c0c9e30 0x7f948c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 --2- 172.21.15.133:0/3081656298 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c06c4f0 0x7f948c0c98f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- 172.21.15.133:0/3081656298 >> 172.21.15.133:0/3081656298 conn(0x7f948c06a3e0 msgr2=0x7f948c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:15.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- 172.21.15.133:0/3081656298 shutdown_connections 2023-12-18T10:26:15.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- 172.21.15.133:0/3081656298 wait complete. 2023-12-18T10:26:15.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 Processor -- start 2023-12-18T10:26:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- start start 2023-12-18T10:26:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f948c06c4f0 0x7f948c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c0c9e30 0x7f948c150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c1570c0 0x7f948c155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c157bf0 con 0x7f948c0c9e30 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c150cc0 con 0x7f948c06c4f0 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f94922d1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1575e0 con 0x7f948c1570c0 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c0c9e30 0x7f948c150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c0c9e30 0x7f948c150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54038/0 (socket says 172.21.15.133:54038) 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948b7fe640 1 -- 172.21.15.133:0/297844922 learned_addr learned my addr 172.21.15.133:0/297844922 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f949086e640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c1570c0 0x7f948c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948bfff640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f948c06c4f0 0x7f948c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948b7fe640 1 -- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c1570c0 msgr2=0x7f948c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948b7fe640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c1570c0 0x7f948c155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948b7fe640 1 -- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f948c06c4f0 msgr2=0x7f948c153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948b7fe640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f948c06c4f0 0x7f948c153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948b7fe640 1 -- 172.21.15.133:0/297844922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484009a70 con 0x7f948c0c9e30 2023-12-18T10:26:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.740+0000 7f948bfff640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f948c06c4f0 0x7f948c153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f948b7fe640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c0c9e30 0x7f948c150780 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f948001a990 tx=0x7f948001ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f9488ff9640 1 -- 172.21.15.133:0/297844922 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480006e20 con 0x7f948c0c9e30 2023-12-18T10:26:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f9488ff9640 1 -- 172.21.15.133:0/297844922 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800b7450 con 0x7f948c0c9e30 2023-12-18T10:26:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f9488ff9640 1 -- 172.21.15.133:0/297844922 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800b77e0 con 0x7f948c0c9e30 2023-12-18T10:26:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9480009420 con 0x7f948c0c9e30 2023-12-18T10:26:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c1543a0 con 0x7f948c0c9e30 2023-12-18T10:26:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c0735b0 con 0x7f948c0c9e30 2023-12-18T10:26:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f9488ff9640 1 -- 172.21.15.133:0/297844922 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f94800b7940 con 0x7f948c0c9e30 2023-12-18T10:26:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f9488ff9640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9478065a60 0x7f9478067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f9488ff9640 1 -- 172.21.15.133:0/297844922 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f948011d730 con 0x7f948c0c9e30 2023-12-18T10:26:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.744+0000 7f948bfff640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9478065a60 0x7f9478067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:15.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.748+0000 7f948bfff640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9478065a60 0x7f9478067f20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f947c005890 tx=0x7f947c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.748+0000 7f9488ff9640 1 -- 172.21.15.133:0/297844922 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f94800eb1f0 con 0x7f948c0c9e30 2023-12-18T10:26:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:15.948+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) v1 -- 0x7f948c0adc40 con 0x7f948c0c9e30 2023-12-18T10:26:16.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f9488ff9640 1 -- 172.21.15.133:0/297844922 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v430) v1 ==== 165+0+0 (secure 0 0 0) 0x7f94800bb0e0 con 0x7f948c0c9e30 2023-12-18T10:26:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9478065a60 msgr2=0x7f9478067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9478065a60 0x7f9478067f20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f947c005890 tx=0x7f947c009040 comp rx=0 tx=0).stop 2023-12-18T10:26:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c0c9e30 msgr2=0x7f948c150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c0c9e30 0x7f948c150780 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f948001a990 tx=0x7f948001ab20 comp rx=0 tx=0).stop 2023-12-18T10:26:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 shutdown_connections 2023-12-18T10:26:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9478065a60 0x7f9478067f20 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f948c1570c0 0x7f948c155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948c0c9e30 0x7f948c150780 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 --2- 172.21.15.133:0/297844922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f948c06c4f0 0x7f948c153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 >> 172.21.15.133:0/297844922 conn(0x7f948c06a3e0 msgr2=0x7f948c15c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 shutdown_connections 2023-12-18T10:26:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:16.216+0000 7f94922d1640 1 -- 172.21.15.133:0/297844922 wait complete. 2023-12-18T10:26:16.238 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2023-12-18T10:26:16.238 INFO:tasks.cephfs_test_runner: 2023-12-18T10:26:16.238 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-18T10:26:16.238 INFO:tasks.cephfs_test_runner:Ran 6 tests in 440.200s 2023-12-18T10:26:16.238 INFO:tasks.cephfs_test_runner: 2023-12-18T10:26:16.238 INFO:tasks.cephfs_test_runner:OK 2023-12-18T10:26:16.239 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-18T10:26:16.248 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-18T10:26:16.255 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-18T10:26:16.255 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:26:16.256 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:26:16.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:26:16.265 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-18T10:26:16.265 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:26:16.315 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-18T10:26:16.315 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:26:16.315 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:26:16.326 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:26:16.326 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-12-18T10:26:16.326 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-18T10:26:16.376 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-18T10:26:16.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:16.376 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-12-18T10:26:16.428 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-18T10:26:16.429 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-18T10:26:16.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:16.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-18T10:26:16.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:16.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-18T10:26:16.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:16.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-12-18T10:26:16.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:16.770 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-18T10:26:16.780 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-18T10:26:16.780 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-18T10:26:16.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:16.781 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-18T10:26:16.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:16.845 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-18T10:26:16.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-18T10:26:16.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-12-18T10:26:17.161 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-18T10:26:17.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-18T10:26:17.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:26:17.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9fd0f2640 1 Processor -- start 2023-12-18T10:26:17.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9fd0f2640 1 -- start start 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9fd0f2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9f806c4f0 0x7fe9f80c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9fd0f2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe9f80c9e30 0x7fe9f80ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9fd0f2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80c9460 con 0x7fe9f81570c0 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9fd0f2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f81574a0 con 0x7fe9f806c4f0 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9fd0f2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f80c8b30 con 0x7fe9f80c9e30 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9f659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9f806c4f0 0x7fe9f80c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9f659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9f806c4f0 0x7fe9f80c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54044/0 (socket says 172.21.15.133:54044) 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9f659c640 1 -- 172.21.15.133:0/4236995070 learned_addr learned my addr 172.21.15.133:0/4236995070 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:17.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9f759e640 1 --2- 172.21.15.133:0/4236995070 >> v2:172.21.15.142:3300/0 conn(0x7fe9f80c9e30 0x7fe9f80ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9f659c640 1 -- 172.21.15.133:0/4236995070 >> v2:172.21.15.142:3300/0 conn(0x7fe9f80c9e30 msgr2=0x7fe9f80ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:17.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9f659c640 1 --2- 172.21.15.133:0/4236995070 >> v2:172.21.15.142:3300/0 conn(0x7fe9f80c9e30 0x7fe9f80ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.312+0000 7fe9f659c640 1 -- 172.21.15.133:0/4236995070 >> v1:172.21.15.133:6789/0 conn(0x7fe9f81570c0 legacy=0x7fe9f806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9f5d9b640 1 -- 172.21.15.133:0/4236995070 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964992902 0 0) 0x7fe9f80c9460 con 0x7fe9f81570c0 2023-12-18T10:26:17.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9f659c640 1 -- 172.21.15.133:0/4236995070 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80c8e10 con 0x7fe9f806c4f0 2023-12-18T10:26:17.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9f659c640 1 --2- 172.21.15.133:0/4236995070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f806c4f0 0x7fe9f80c98f0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fe9f806fb70 tx=0x7fe9ec01ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c015c64aaac6c68e server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9f5d9b640 1 -- 172.21.15.133:0/4236995070 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0a7ca0 con 0x7fe9f806c4f0 2023-12-18T10:26:17.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9f5d9b640 1 -- 172.21.15.133:0/4236995070 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec0a7e00 con 0x7fe9f806c4f0 2023-12-18T10:26:17.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9f5d9b640 1 -- 172.21.15.133:0/4236995070 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0af660 con 0x7fe9f806c4f0 2023-12-18T10:26:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/4236995070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f806c4f0 msgr2=0x7fe9f80c98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/4236995070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f806c4f0 0x7fe9f80c98f0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fe9f806fb70 tx=0x7fe9ec01ebd0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/4236995070 shutdown_connections 2023-12-18T10:26:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/4236995070 >> v2:172.21.15.142:3300/0 conn(0x7fe9f80c9e30 0x7fe9f80ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/4236995070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f806c4f0 0x7fe9f80c98f0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/4236995070 >> 172.21.15.133:0/4236995070 conn(0x7fe9f806a3e0 msgr2=0x7fe9f80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/4236995070 shutdown_connections 2023-12-18T10:26:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.316+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/4236995070 wait complete. 2023-12-18T10:26:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9fd0f2640 1 Processor -- start 2023-12-18T10:26:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9fd0f2640 1 -- start start 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9fd0f2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f806c4f0 0x7fe9f80ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9fd0f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f80c9e30 0x7fe9f8163990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9fd0f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9f81570c0 0x7fe9f8147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9fd0f2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f814ae30 con 0x7fe9f80c9e30 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9fd0f2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f814b110 con 0x7fe9f806c4f0 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9fd0f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f814b3f0 con 0x7fe9f81570c0 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f80c9e30 0x7fe9f8163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f80c9e30 0x7fe9f8163990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54052/0 (socket says 172.21.15.133:54052) 2023-12-18T10:26:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 -- 172.21.15.133:0/1491338958 learned_addr learned my addr 172.21.15.133:0/1491338958 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f759e640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9f81570c0 0x7fe9f8147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f6d9d640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f806c4f0 0x7fe9f80ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 -- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9f81570c0 msgr2=0x7fe9f8147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9f81570c0 0x7fe9f8147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 -- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f806c4f0 msgr2=0x7fe9f80ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f806c4f0 0x7fe9f80ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 -- 172.21.15.133:0/1491338958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec00b770 con 0x7fe9f80c9e30 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f759e640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9f81570c0 0x7fe9f8147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f6d9d640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f806c4f0 0x7fe9f80ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.320+0000 7fe9f659c640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f80c9e30 0x7fe9f8163990 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec01b7e0 tx=0x7fe9ec01b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9df7fe640 1 -- 172.21.15.133:0/1491338958 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0a7ca0 con 0x7fe9f80c9e30 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9df7fe640 1 -- 172.21.15.133:0/1491338958 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec004020 con 0x7fe9f80c9e30 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9df7fe640 1 -- 172.21.15.133:0/1491338958 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0043b0 con 0x7fe9f80c9e30 2023-12-18T10:26:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f814b6d0 con 0x7fe9f80c9e30 2023-12-18T10:26:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f80c4b80 con 0x7fe9f80c9e30 2023-12-18T10:26:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f80735b0 con 0x7fe9f80c9e30 2023-12-18T10:26:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9df7fe640 1 -- 172.21.15.133:0/1491338958 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe9ec0b6070 con 0x7fe9f80c9e30 2023-12-18T10:26:17.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9df7fe640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9e4065a60 0x7fe9e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9df7fe640 1 -- 172.21.15.133:0/1491338958 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe9ec11dbd0 con 0x7fe9f80c9e30 2023-12-18T10:26:17.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9f6d9d640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9e4065a60 0x7fe9e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.324+0000 7fe9f6d9d640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9e4065a60 0x7fe9e4067f20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000f70 tx=0x7fe9e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.328+0000 7fe9df7fe640 1 -- 172.21.15.133:0/1491338958 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe9ec0eb600 con 0x7fe9f80c9e30 2023-12-18T10:26:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.476+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9f80ca8a0 con 0x7fe9e4065a60 2023-12-18T10:26:17.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9df7fe640 1 -- 172.21.15.133:0/1491338958 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50780 (secure 0 0 0) 0x7fe9e8001c90 con 0x7fe9e4065a60 2023-12-18T10:26:17.481 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:26:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9e4065a60 msgr2=0x7fe9e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9e4065a60 0x7fe9e4067f20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000f70 tx=0x7fe9e8009040 comp rx=0 tx=0).stop 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f80c9e30 msgr2=0x7fe9f8163990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f80c9e30 0x7fe9f8163990 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec01b7e0 tx=0x7fe9ec01b970 comp rx=0 tx=0).stop 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 shutdown_connections 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fe9e4065a60 0x7fe9e4067f20 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe9f81570c0 0x7fe9f8147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9f80c9e30 0x7fe9f8163990 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 --2- 172.21.15.133:0/1491338958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9f806c4f0 0x7fe9f80ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 >> 172.21.15.133:0/1491338958 conn(0x7fe9f806a3e0 msgr2=0x7fe9f80cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 shutdown_connections 2023-12-18T10:26:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.480+0000 7fe9fd0f2640 1 -- 172.21.15.133:0/1491338958 wait complete. 2023-12-18T10:26:17.502 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2023-12-18T10:26:17.201057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260364,"kb_used_data":11980,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714356,"statfs":{"total":773094113280,"available":772827500544,"internally_reserved":0,"allocated":12267520,"data_stored":6380884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-110289,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-235,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001219"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":237,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-18T10:25:57.955365+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:25:57.955365+0000","last_peered":"2023-12-18T10:25:57.955365+0000","last_clean":"2023-12-18T10:25:57.955365+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:25:57.955365+0000","last_undegraded":"2023-12-18T10:25:57.955365+0000","last_fullsized":"2023-12-18T10:25:57.955365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1974272,"data_stored":1234611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.879},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.44400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84299999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82699999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":1.097,"15min":1.097},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80500000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.70899999999999996,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66800000000000004,"15min":0.68100000000000005},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.378,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.496}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.753,"15min":0.76900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1482752,"data_stored":722639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65900000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85399999999999998,"5min":1.018,"15min":4.3760000000000003},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.81699999999999995},"min":{"1min":0.44400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78500000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84499999999999997,"5min":1.179,"15min":4.524},"last":0.76900000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70399999999999996,"15min":0.76700000000000002},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":0.77300000000000002,"5min":1.121,"15min":2.2709999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.73799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.65400000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.79200000000000004},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.95199999999999996,"15min":2.0270000000000001},"last":0.747},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.82599999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.79000000000000004,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.98199999999999998,"15min":1.101},"last":0.79700000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83699999999999997,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.98799999999999999,"15min":1.284},"last":0.91700000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0369999999999999,"15min":1.129},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.73599999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.006,"15min":1.0820000000000001},"last":0.78500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1355776,"data_stored":622602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.873,"15min":1.0900000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.91200000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":3.3100000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.879,"15min":0.90500000000000003},"last":0.84799999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.67100000000000004,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66900000000000004,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":2.0699999999999998},"last":0.871},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67900000000000005,"15min":0.78100000000000003},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.90200000000000002,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.86499999999999999},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":8.9740000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.52400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.2370000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.71799999999999997},"min":{"1min":0.49399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":2.9060000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.747},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.92300000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.496}]},{"osd":7,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.96899999999999997,"15min":1.1830000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":636536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.53700000000000003,"5min":0.33900000000000002,"15min":0.32800000000000001},"max":{"1min":0.90300000000000002,"5min":0.91600000000000004,"15min":1.0249999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67600000000000005,"15min":0.69799999999999995},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.1739999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":1.131},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.90300000000000002,"15min":0.98799999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84899999999999998,"5min":0.95499999999999996,"15min":1.0860000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.008,"15min":1.032},"last":0.63900000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":0.88700000000000001,"15min":0.999},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.57299999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.86799999999999999,"15min":0.874},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64000000000000001,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68600000000000005,"15min":0.71699999999999997},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":1.0109999999999999,"15min":1.073},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.52600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.872,"5min":0.90900000000000003,"15min":1.042},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70299999999999996,"15min":0.72899999999999998},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.1479999999999999},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574952,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1351680,"data_stored":622512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.49099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72499999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42899999999999999,"15min":0.45800000000000002},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67100000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.441}]},{"osd":2,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69399999999999995,"5min":1.036,"15min":1.254},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.63600000000000001},"min":{"1min":0.45200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":0.98899999999999999,"15min":1.772},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66100000000000003,"15min":0.67800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.94799999999999995,"15min":1.01},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":1.167,"15min":1.181},"last":0.62}]},{"osd":5,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":1.171,"15min":1.171},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.069},"last":0.57999999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.872,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.76700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45000000000000001},"max":{"1min":0.85899999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71599999999999997,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72099999999999997,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91300000000000003,"5min":1.26,"15min":1.26},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1347584,"data_stored":629468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.56000000000000005,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45000000000000001,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.37}]},{"osd":1,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54000000000000004,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.92000000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52200000000000002,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.1599999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.77800000000000002},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.97699999999999998,"15min":1.698},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.4219999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":0.93400000000000005,"15min":1.3069999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.79300000000000004},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.7549999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93700000000000006,"5min":1.0189999999999999,"15min":1.341},"last":0.503},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.76700000000000002},"min":{"1min":0.53300000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95199999999999996,"5min":1.107,"15min":1.3939999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.77100000000000002},"min":{"1min":0.57299999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.282},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.91100000000000003,"5min":1.0489999999999999,"15min":1.4530000000000001},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1347584,"data_stored":621942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.54300000000000004},"min":{"1min":0.24299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":3.976},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.9079999999999999},"last":0.379}]},{"osd":2,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.58599999999999997},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":3.786},"last":0.442},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83899999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.497,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.71399999999999997,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72299999999999998,"15min":0.78200000000000003},"min":{"1min":0.51400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.1140000000000001,"15min":1.851},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72899999999999998,"15min":0.86099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.85299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.024,"15min":4.1859999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70899999999999996,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.504},"max":{"1min":0.94699999999999995,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.79700000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96599999999999997,"5min":1.056,"15min":2.0699999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47099999999999997},"max":{"1min":0.94999999999999996,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.80900000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.0269999999999999,"15min":2.1890000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.04,"15min":1.9770000000000001},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":2027520,"data_stored":1290574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":1.5109999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.505,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.82999999999999996,"15min":1.456},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45000000000000001,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64700000000000002,"5min":0.70399999999999996,"15min":1.595},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46899999999999997,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":2.464},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46800000000000003,"15min":0.51200000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.85699999999999998,"15min":1.859},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54700000000000004,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77700000000000002,"15min":1.903},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.494},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.61399999999999999,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0249999999999999,"5min":1.1279999999999999,"15min":1.2949999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.46700000000000003},"max":{"1min":0.995,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79300000000000004},"min":{"1min":0.57399999999999995,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0629999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.78300000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":1.0720000000000001,"15min":1.5700000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.95499999999999996,"5min":1.089,"15min":1.53},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72399999999999998,"15min":0.77400000000000002},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.0469999999999999,"15min":1.556},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":0.91400000000000003,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:26:17.503 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:26:17.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0327a8c640 1 Processor -- start 2023-12-18T10:26:17.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0327a8c640 1 -- start start 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0327a8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0320069ca0 0x7f032006a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0327a8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f032015caf0 0x7f03200cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0327a8c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03200ccde0 con 0x7f03200cdc20 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0327a8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032006a5c0 con 0x7f0320069ca0 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0327a8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03200cc820 con 0x7f032015caf0 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0325828640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0320069ca0 0x7f032006a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0326029640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f03200cdc20 0x7f03200717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33122/0 (socket says 172.21.15.133:33122) 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0325828640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0320069ca0 0x7f032006a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54066/0 (socket says 172.21.15.133:54066) 2023-12-18T10:26:17.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0326029640 1 -- 172.21.15.133:0/2390310292 learned_addr learned my addr 172.21.15.133:0/2390310292 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0325027640 1 --2- 172.21.15.133:0/2390310292 >> v2:172.21.15.142:3300/0 conn(0x7f032015caf0 0x7f03200cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0325828640 1 -- 172.21.15.133:0/2390310292 >> v2:172.21.15.142:3300/0 conn(0x7f032015caf0 msgr2=0x7f03200cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0325828640 1 --2- 172.21.15.133:0/2390310292 >> v2:172.21.15.142:3300/0 conn(0x7f032015caf0 0x7f03200cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0325828640 1 -- 172.21.15.133:0/2390310292 >> v1:172.21.15.133:6789/0 conn(0x7f03200cdc20 legacy=0x7f03200717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0325828640 1 -- 172.21.15.133:0/2390310292 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200ccb00 con 0x7f0320069ca0 2023-12-18T10:26:17.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.640+0000 7f0324826640 1 -- 172.21.15.133:0/2390310292 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763065422 0 0) 0x7f03200ccde0 con 0x7f03200cdc20 2023-12-18T10:26:17.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0325828640 1 --2- 172.21.15.133:0/2390310292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0320069ca0 0x7f032006a080 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f03200d05a0 tx=0x7f031c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3867a19255a36901 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0324826640 1 -- 172.21.15.133:0/2390310292 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c0a7070 con 0x7f0320069ca0 2023-12-18T10:26:17.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0324826640 1 -- 172.21.15.133:0/2390310292 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c0ab430 con 0x7f0320069ca0 2023-12-18T10:26:17.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0324826640 1 -- 172.21.15.133:0/2390310292 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c0ab7c0 con 0x7f0320069ca0 2023-12-18T10:26:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0327a8c640 1 -- 172.21.15.133:0/2390310292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0320069ca0 msgr2=0x7f032006a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0327a8c640 1 --2- 172.21.15.133:0/2390310292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0320069ca0 0x7f032006a080 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f03200d05a0 tx=0x7f031c01c430 comp rx=0 tx=0).stop 2023-12-18T10:26:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0327a8c640 1 -- 172.21.15.133:0/2390310292 shutdown_connections 2023-12-18T10:26:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0327a8c640 1 --2- 172.21.15.133:0/2390310292 >> v2:172.21.15.142:3300/0 conn(0x7f032015caf0 0x7f03200cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0327a8c640 1 --2- 172.21.15.133:0/2390310292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0320069ca0 0x7f032006a080 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0327a8c640 1 -- 172.21.15.133:0/2390310292 >> 172.21.15.133:0/2390310292 conn(0x7f032006cf80 msgr2=0x7f032006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0327a8c640 1 -- 172.21.15.133:0/2390310292 shutdown_connections 2023-12-18T10:26:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.644+0000 7f0327a8c640 1 -- 172.21.15.133:0/2390310292 wait complete. 2023-12-18T10:26:17.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 Processor -- start 2023-12-18T10:26:17.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 -- start start 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0320069ca0 0x7f03200c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03200cdc20 0x7f03200ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032015caf0 0x7f03200c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0320159e90 con 0x7f03200cdc20 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032015a0f0 con 0x7f032015caf0 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03200c3590 con 0x7f0320069ca0 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03200cdc20 0x7f03200ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03200cdc20 0x7f03200ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54070/0 (socket says 172.21.15.133:54070) 2023-12-18T10:26:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 -- 172.21.15.133:0/93472875 learned_addr learned my addr 172.21.15.133:0/93472875 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325828640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0320069ca0 0x7f03200c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0326029640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032015caf0 0x7f03200c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 -- 172.21.15.133:0/93472875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0320069ca0 msgr2=0x7f03200c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0320069ca0 0x7f03200c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 -- 172.21.15.133:0/93472875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032015caf0 msgr2=0x7f03200c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032015caf0 0x7f03200c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 -- 172.21.15.133:0/93472875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c009420 con 0x7f03200cdc20 2023-12-18T10:26:17.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0325027640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03200cdc20 0x7f03200ab8a0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f031000d800 tx=0x7f031000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f03167fc640 1 -- 172.21.15.133:0/93472875 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000b6c0 con 0x7f03200cdc20 2023-12-18T10:26:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f03167fc640 1 -- 172.21.15.133:0/93472875 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031000b820 con 0x7f03200cdc20 2023-12-18T10:26:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03200c3830 con 0x7f03200cdc20 2023-12-18T10:26:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f03167fc640 1 -- 172.21.15.133:0/93472875 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000bbb0 con 0x7f03200cdc20 2023-12-18T10:26:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.648+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03200c3df0 con 0x7f03200cdc20 2023-12-18T10:26:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.652+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032004e000 con 0x7f03200cdc20 2023-12-18T10:26:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.652+0000 7f03167fc640 1 -- 172.21.15.133:0/93472875 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f031000bd10 con 0x7f03200cdc20 2023-12-18T10:26:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.652+0000 7f03167fc640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0304065a60 0x7f0304067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.652+0000 7f03167fc640 1 -- 172.21.15.133:0/93472875 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f0310083490 con 0x7f03200cdc20 2023-12-18T10:26:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.652+0000 7f0325828640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0304065a60 0x7f0304067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.652+0000 7f0325828640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0304065a60 0x7f0304067f20 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f031c0af000 tx=0x7f031c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.656+0000 7f03167fc640 1 -- 172.21.15.133:0/93472875 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0310050ff0 con 0x7f03200cdc20 2023-12-18T10:26:17.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.804+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03200cc430 con 0x7f0304065a60 2023-12-18T10:26:17.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.804+0000 7f03167fc640 1 -- 172.21.15.133:0/93472875 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50780 (secure 0 0 0) 0x7f031c004320 con 0x7f0304065a60 2023-12-18T10:26:17.807 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:17.807 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0304065a60 msgr2=0x7f0304067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0304065a60 0x7f0304067f20 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f031c0af000 tx=0x7f031c0a7000 comp rx=0 tx=0).stop 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03200cdc20 msgr2=0x7f03200ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03200cdc20 0x7f03200ab8a0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f031000d800 tx=0x7f031000dcc0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 shutdown_connections 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0304065a60 0x7f0304067f20 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f032015caf0 0x7f03200c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03200cdc20 0x7f03200ab8a0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 --2- 172.21.15.133:0/93472875 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0320069ca0 0x7f03200c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 >> 172.21.15.133:0/93472875 conn(0x7f032006cf80 msgr2=0x7f032006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:17.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 shutdown_connections 2023-12-18T10:26:17.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.808+0000 7f0327a8c640 1 -- 172.21.15.133:0/93472875 wait complete. 2023-12-18T10:26:17.828 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2023-12-18T10:26:17.201057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260364,"kb_used_data":11980,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714356,"statfs":{"total":773094113280,"available":772827500544,"internally_reserved":0,"allocated":12267520,"data_stored":6380884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-110289,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-235,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001219"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":237,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-18T10:25:57.955365+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:25:57.955365+0000","last_peered":"2023-12-18T10:25:57.955365+0000","last_clean":"2023-12-18T10:25:57.955365+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:25:57.955365+0000","last_undegraded":"2023-12-18T10:25:57.955365+0000","last_fullsized":"2023-12-18T10:25:57.955365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1974272,"data_stored":1234611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.879},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.44400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84299999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82699999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":1.097,"15min":1.097},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80500000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.70899999999999996,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66800000000000004,"15min":0.68100000000000005},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.378,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.496}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.753,"15min":0.76900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1482752,"data_stored":722639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65900000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85399999999999998,"5min":1.018,"15min":4.3760000000000003},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.81699999999999995},"min":{"1min":0.44400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78500000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84499999999999997,"5min":1.179,"15min":4.524},"last":0.76900000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70399999999999996,"15min":0.76700000000000002},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":0.77300000000000002,"5min":1.121,"15min":2.2709999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.73799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.65400000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.79200000000000004},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.95199999999999996,"15min":2.0270000000000001},"last":0.747},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.82599999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.79000000000000004,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.98199999999999998,"15min":1.101},"last":0.79700000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83699999999999997,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.98799999999999999,"15min":1.284},"last":0.91700000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0369999999999999,"15min":1.129},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.73599999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.006,"15min":1.0820000000000001},"last":0.78500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1355776,"data_stored":622602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.873,"15min":1.0900000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.91200000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":3.3100000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.879,"15min":0.90500000000000003},"last":0.84799999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.67100000000000004,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66900000000000004,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":2.0699999999999998},"last":0.871},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67900000000000005,"15min":0.78100000000000003},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.90200000000000002,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.86499999999999999},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":8.9740000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.52400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.2370000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.71799999999999997},"min":{"1min":0.49399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":2.9060000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.747},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.92300000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.496}]},{"osd":7,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.96899999999999997,"15min":1.1830000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":636536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.53700000000000003,"5min":0.33900000000000002,"15min":0.32800000000000001},"max":{"1min":0.90300000000000002,"5min":0.91600000000000004,"15min":1.0249999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67600000000000005,"15min":0.69799999999999995},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.1739999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":1.131},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.90300000000000002,"15min":0.98799999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84899999999999998,"5min":0.95499999999999996,"15min":1.0860000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.008,"15min":1.032},"last":0.63900000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":0.88700000000000001,"15min":0.999},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.57299999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.86799999999999999,"15min":0.874},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64000000000000001,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68600000000000005,"15min":0.71699999999999997},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":1.0109999999999999,"15min":1.073},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.52600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.872,"5min":0.90900000000000003,"15min":1.042},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70299999999999996,"15min":0.72899999999999998},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.1479999999999999},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574952,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1351680,"data_stored":622512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.49099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72499999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42899999999999999,"15min":0.45800000000000002},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67100000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.441}]},{"osd":2,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69399999999999995,"5min":1.036,"15min":1.254},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.63600000000000001},"min":{"1min":0.45200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":0.98899999999999999,"15min":1.772},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66100000000000003,"15min":0.67800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.94799999999999995,"15min":1.01},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":1.167,"15min":1.181},"last":0.62}]},{"osd":5,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":1.171,"15min":1.171},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.069},"last":0.57999999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.872,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.76700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45000000000000001},"max":{"1min":0.85899999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71599999999999997,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72099999999999997,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91300000000000003,"5min":1.26,"15min":1.26},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1347584,"data_stored":629468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.56000000000000005,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45000000000000001,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.37}]},{"osd":1,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54000000000000004,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.92000000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52200000000000002,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.1599999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.77800000000000002},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.97699999999999998,"15min":1.698},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.4219999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":0.93400000000000005,"15min":1.3069999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.79300000000000004},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.7549999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93700000000000006,"5min":1.0189999999999999,"15min":1.341},"last":0.503},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.76700000000000002},"min":{"1min":0.53300000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95199999999999996,"5min":1.107,"15min":1.3939999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.77100000000000002},"min":{"1min":0.57299999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.282},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.91100000000000003,"5min":1.0489999999999999,"15min":1.4530000000000001},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1347584,"data_stored":621942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.54300000000000004},"min":{"1min":0.24299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":3.976},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.9079999999999999},"last":0.379}]},{"osd":2,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.58599999999999997},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":3.786},"last":0.442},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83899999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.497,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.71399999999999997,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72299999999999998,"15min":0.78200000000000003},"min":{"1min":0.51400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.1140000000000001,"15min":1.851},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72899999999999998,"15min":0.86099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.85299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.024,"15min":4.1859999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70899999999999996,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.504},"max":{"1min":0.94699999999999995,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.79700000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96599999999999997,"5min":1.056,"15min":2.0699999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47099999999999997},"max":{"1min":0.94999999999999996,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.80900000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.0269999999999999,"15min":2.1890000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.04,"15min":1.9770000000000001},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":2027520,"data_stored":1290574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":1.5109999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.505,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.82999999999999996,"15min":1.456},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45000000000000001,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64700000000000002,"5min":0.70399999999999996,"15min":1.595},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46899999999999997,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":2.464},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46800000000000003,"15min":0.51200000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.85699999999999998,"15min":1.859},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54700000000000004,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77700000000000002,"15min":1.903},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.494},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.61399999999999999,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0249999999999999,"5min":1.1279999999999999,"15min":1.2949999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.46700000000000003},"max":{"1min":0.995,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79300000000000004},"min":{"1min":0.57399999999999995,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0629999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.78300000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":1.0720000000000001,"15min":1.5700000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.95499999999999996,"5min":1.089,"15min":1.53},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72399999999999998,"15min":0.77400000000000002},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.0469999999999999,"15min":1.556},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":0.91400000000000003,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:26:17.829 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-18T10:26:17.829 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:26:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f28122f2640 1 Processor -- start 2023-12-18T10:26:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f28122f2640 1 -- start start 2023-12-18T10:26:17.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f28122f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce2c0 0x7f280c0ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f28122f2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c160e80 con 0x7f280c15ceb0 2023-12-18T10:26:17.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f28122f2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c161160 con 0x7f280c0ce720 2023-12-18T10:26:17.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f28122f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c161440 con 0x7f280c0ce2c0 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f280c15ceb0 0x7f280c06b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33132/0 (socket says 172.21.15.133:33132) 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280bfff640 1 -- 172.21.15.133:0/2835136698 learned_addr learned my addr 172.21.15.133:0/2835136698 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280b7fe640 1 --2- 172.21.15.133:0/2835136698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce2c0 0x7f280c0ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280affd640 1 -- 172.21.15.133:0/2835136698 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71030936 0 0) 0x7f280c160e80 con 0x7f280c15ceb0 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280affd640 1 -- 172.21.15.133:0/2835136698 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f4003530 con 0x7f280c15ceb0 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280affd640 1 -- 172.21.15.133:0/2835136698 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338901849 0 0) 0x7f280c161160 con 0x7f280c0ce720 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280affd640 1 -- 172.21.15.133:0/2835136698 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c160e80 con 0x7f280c0ce720 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280b7fe640 1 -- 172.21.15.133:0/2835136698 >> v1:172.21.15.142:6789/0 conn(0x7f280c0ce720 legacy=0x7f280c15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280b7fe640 1 -- 172.21.15.133:0/2835136698 >> v1:172.21.15.133:6789/0 conn(0x7f280c15ceb0 legacy=0x7f280c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280affd640 1 -- 172.21.15.133:0/2835136698 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2032469963 0 0) 0x7f27f4003530 con 0x7f280c15ceb0 2023-12-18T10:26:17.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.968+0000 7f280b7fe640 1 -- 172.21.15.133:0/2835136698 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c161720 con 0x7f280c0ce2c0 2023-12-18T10:26:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f280b7fe640 1 --2- 172.21.15.133:0/2835136698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce2c0 0x7f280c0ceb90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28000097f0 tx=0x7f280001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa78c8fab5c65c9d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f280affd640 1 -- 172.21.15.133:0/2835136698 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc001680 con 0x7f280c0ce2c0 2023-12-18T10:26:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f280affd640 1 -- 172.21.15.133:0/2835136698 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28000a7050 con 0x7f280c0ce2c0 2023-12-18T10:26:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f280affd640 1 -- 172.21.15.133:0/2835136698 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000ab620 con 0x7f280c0ce2c0 2023-12-18T10:26:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f28122f2640 1 -- 172.21.15.133:0/2835136698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce2c0 msgr2=0x7f280c0ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f28122f2640 1 --2- 172.21.15.133:0/2835136698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce2c0 0x7f280c0ceb90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28000097f0 tx=0x7f280001c3e0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f28122f2640 1 -- 172.21.15.133:0/2835136698 shutdown_connections 2023-12-18T10:26:17.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f28122f2640 1 --2- 172.21.15.133:0/2835136698 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce2c0 0x7f280c0ceb90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f28122f2640 1 -- 172.21.15.133:0/2835136698 >> 172.21.15.133:0/2835136698 conn(0x7f280c069ca0 msgr2=0x7f280c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:17.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f28122f2640 1 -- 172.21.15.133:0/2835136698 shutdown_connections 2023-12-18T10:26:17.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.972+0000 7f28122f2640 1 -- 172.21.15.133:0/2835136698 wait complete. 2023-12-18T10:26:17.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 Processor -- start 2023-12-18T10:26:17.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 -- start start 2023-12-18T10:26:17.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f280c0ce2c0 0x7f280c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce720 0x7f280c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c15ceb0 0x7f280c0b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0b5e20 con 0x7f280c0ce2c0 2023-12-18T10:26:17.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c1500b0 con 0x7f280c15ceb0 2023-12-18T10:26:17.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c150390 con 0x7f280c0ce720 2023-12-18T10:26:17.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f280c0ce2c0 0x7f280c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f280c0ce2c0 0x7f280c0b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54078/0 (socket says 172.21.15.133:54078) 2023-12-18T10:26:17.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 -- 172.21.15.133:0/1391659538 learned_addr learned my addr 172.21.15.133:0/1391659538 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:17.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280b7fe640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce720 0x7f280c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f281088f640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c15ceb0 0x7f280c0b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 -- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce720 msgr2=0x7f280c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce720 0x7f280c0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 -- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c15ceb0 msgr2=0x7f280c0b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c15ceb0 0x7f280c0b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 -- 172.21.15.133:0/1391659538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800009420 con 0x7f280c0ce2c0 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f281088f640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c15ceb0 0x7f280c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280b7fe640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce720 0x7f280c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f280bfff640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f280c0ce2c0 0x7f280c0b3400 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c760 tx=0x7f27fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f2808ff9640 1 -- 172.21.15.133:0/1391659538 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc005ae0 con 0x7f280c0ce2c0 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f2808ff9640 1 -- 172.21.15.133:0/1391659538 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc005c60 con 0x7f280c0ce2c0 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f2808ff9640 1 -- 172.21.15.133:0/1391659538 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0072b0 con 0x7f280c0ce2c0 2023-12-18T10:26:17.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.976+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c150670 con 0x7f280c0ce2c0 2023-12-18T10:26:17.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.980+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c14ea20 con 0x7f280c0ce2c0 2023-12-18T10:26:17.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.980+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c04e000 con 0x7f280c0ce2c0 2023-12-18T10:26:17.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.980+0000 7f2808ff9640 1 -- 172.21.15.133:0/1391659538 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27fc007410 con 0x7f280c0ce2c0 2023-12-18T10:26:17.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.980+0000 7f2808ff9640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27f8065a90 0x7f27f8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:17.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.980+0000 7f2808ff9640 1 -- 172.21.15.133:0/1391659538 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f27fc082dd0 con 0x7f280c0ce2c0 2023-12-18T10:26:17.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.980+0000 7f280b7fe640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27f8065a90 0x7f27f8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:17.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.980+0000 7f280b7fe640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27f8065a90 0x7f27f8067f50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f28000ad000 tx=0x7f2800008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:17.984+0000 7f2808ff9640 1 -- 172.21.15.133:0/1391659538 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f27fc050800 con 0x7f280c0ce2c0 2023-12-18T10:26:18.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.132+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f280c150220 con 0x7f27f8065a90 2023-12-18T10:26:18.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.132+0000 7f2808ff9640 1 -- 172.21.15.133:0/1391659538 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50780 (secure 0 0 0) 0x7f280c150220 con 0x7f27f8065a90 2023-12-18T10:26:18.135 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:18.135 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:26:18.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27f8065a90 msgr2=0x7f27f8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:18.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27f8065a90 0x7f27f8067f50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f28000ad000 tx=0x7f2800008040 comp rx=0 tx=0).stop 2023-12-18T10:26:18.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f280c0ce2c0 msgr2=0x7f280c0b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f280c0ce2c0 0x7f280c0b3400 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c760 tx=0x7f27fc00cc20 comp rx=0 tx=0).stop 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 shutdown_connections 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f27f8065a90 0x7f27f8067f50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f280c15ceb0 0x7f280c0b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f280c0ce720 0x7f280c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 --2- 172.21.15.133:0/1391659538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f280c0ce2c0 0x7f280c0b3400 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 >> 172.21.15.133:0/1391659538 conn(0x7f280c069ca0 msgr2=0x7f280c15e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 shutdown_connections 2023-12-18T10:26:18.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.136+0000 7f28122f2640 1 -- 172.21.15.133:0/1391659538 wait complete. 2023-12-18T10:26:18.155 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2023-12-18T10:26:17.201057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260364,"kb_used_data":11980,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714356,"statfs":{"total":773094113280,"available":772827500544,"internally_reserved":0,"allocated":12267520,"data_stored":6380884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-110289,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-235,"num_write_kb":-185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001219"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":237,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-12-18T10:25:57.955365+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:25:57.955365+0000","last_peered":"2023-12-18T10:25:57.955365+0000","last_clean":"2023-12-18T10:25:57.955365+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:25:57.955365+0000","last_undegraded":"2023-12-18T10:25:57.955365+0000","last_fullsized":"2023-12-18T10:25:57.955365+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1974272,"data_stored":1234611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.65700000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.879},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.44400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84299999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82699999999999996}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":1.097,"15min":1.097},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80500000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.70899999999999996,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66800000000000004,"15min":0.68100000000000005},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.378,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.496}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.753,"15min":0.76900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1482752,"data_stored":722639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65900000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85399999999999998,"5min":1.018,"15min":4.3760000000000003},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.81699999999999995},"min":{"1min":0.44400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78500000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84499999999999997,"5min":1.179,"15min":4.524},"last":0.76900000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70399999999999996,"15min":0.76700000000000002},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":0.77300000000000002,"5min":1.121,"15min":2.2709999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.73799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.65400000000000003}]},{"osd":3,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.79200000000000004},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.95199999999999996,"15min":2.0270000000000001},"last":0.747},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.82599999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.79000000000000004,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.98199999999999998,"15min":1.101},"last":0.79700000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83699999999999997,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.98799999999999999,"15min":1.284},"last":0.91700000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0369999999999999,"15min":1.129},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.73599999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.006,"15min":1.0820000000000001},"last":0.78500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1355776,"data_stored":622602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.873,"15min":1.0900000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.91200000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":3.3100000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.879,"15min":0.90500000000000003},"last":0.84799999999999998}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.67100000000000004,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66900000000000004,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":2.0699999999999998},"last":0.871},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67900000000000005,"15min":0.78100000000000003},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.90200000000000002,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.86499999999999999},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":8.9740000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.52400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.2370000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.71799999999999997},"min":{"1min":0.49399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":2.9060000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.747},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.92300000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.496}]},{"osd":7,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.96899999999999997,"15min":1.1830000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":636536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.53700000000000003,"5min":0.33900000000000002,"15min":0.32800000000000001},"max":{"1min":0.90300000000000002,"5min":0.91600000000000004,"15min":1.0249999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67600000000000005,"15min":0.69799999999999995},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.1739999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":1.131},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.90300000000000002,"15min":0.98799999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84899999999999998,"5min":0.95499999999999996,"15min":1.0860000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.008,"15min":1.032},"last":0.63900000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":0.88700000000000001,"15min":0.999},"last":0.621},{"interface":"front","average":{"1min":0.753,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.57299999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.86799999999999999,"15min":0.874},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64000000000000001,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68600000000000005,"15min":0.71699999999999997},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":1.0109999999999999,"15min":1.073},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.52600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.872,"5min":0.90900000000000003,"15min":1.042},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70299999999999996,"15min":0.72899999999999998},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.1479999999999999},"last":0.61099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574952,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1351680,"data_stored":622512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.49099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72499999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42899999999999999,"15min":0.45800000000000002},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67100000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.441}]},{"osd":2,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69399999999999995,"5min":1.036,"15min":1.254},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.63600000000000001},"min":{"1min":0.45200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":0.98899999999999999,"15min":1.772},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66100000000000003,"15min":0.67800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.94799999999999995,"15min":1.01},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":1.167,"15min":1.181},"last":0.62}]},{"osd":5,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":1.171,"15min":1.171},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.069},"last":0.57999999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.872,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.76700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45000000000000001},"max":{"1min":0.85899999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71599999999999997,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72099999999999997,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91300000000000003,"5min":1.26,"15min":1.26},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1347584,"data_stored":629468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.56000000000000005,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45000000000000001,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.37}]},{"osd":1,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54000000000000004,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.92000000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52200000000000002,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.1599999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.77800000000000002},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.97699999999999998,"15min":1.698},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.4219999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":0.93400000000000005,"15min":1.3069999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.79300000000000004},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.7549999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93700000000000006,"5min":1.0189999999999999,"15min":1.341},"last":0.503},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.76700000000000002},"min":{"1min":0.53300000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95199999999999996,"5min":1.107,"15min":1.3939999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.77100000000000002},"min":{"1min":0.57299999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.282},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.91100000000000003,"5min":1.0489999999999999,"15min":1.4530000000000001},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1347584,"data_stored":621942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.54300000000000004},"min":{"1min":0.24299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":3.976},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.9079999999999999},"last":0.379}]},{"osd":2,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.58599999999999997},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":3.786},"last":0.442},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83899999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.497,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.71399999999999997,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.45400000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72299999999999998,"15min":0.78200000000000003},"min":{"1min":0.51400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.1140000000000001,"15min":1.851},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72899999999999998,"15min":0.86099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.85299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.024,"15min":4.1859999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70899999999999996,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.504},"max":{"1min":0.94699999999999995,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.79700000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96599999999999997,"5min":1.056,"15min":2.0699999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47099999999999997},"max":{"1min":0.94999999999999996,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.80900000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.0269999999999999,"15min":2.1890000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.04,"15min":1.9770000000000001},"last":0.70499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":2027520,"data_stored":1290574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":1.5109999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.505,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.82999999999999996,"15min":1.456},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45000000000000001,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64700000000000002,"5min":0.70399999999999996,"15min":1.595},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46899999999999997,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":2.464},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46800000000000003,"15min":0.51200000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.85699999999999998,"15min":1.859},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54700000000000004,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77700000000000002,"15min":1.903},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.494},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.61399999999999999,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0249999999999999,"5min":1.1279999999999999,"15min":1.2949999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.46700000000000003},"max":{"1min":0.995,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79300000000000004},"min":{"1min":0.57399999999999995,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0629999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.78300000000000003}]},{"osd":6,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":1.0720000000000001,"15min":1.5700000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.95499999999999996,"5min":1.089,"15min":1.53},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72399999999999998,"15min":0.77400000000000002},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.0469999999999999,"15min":1.556},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":0.91400000000000003,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.72499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:26:18.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-18T10:26:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b47187640 1 Processor -- start 2023-12-18T10:26:18.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b47187640 1 -- start start 2023-12-18T10:26:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b47187640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b4015c730 0x7f6b400b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b47187640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b400cea00 0x7f6b400cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b47187640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b400b65c0 con 0x7f6b400cd3a0 2023-12-18T10:26:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b47187640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4015cb10 con 0x7f6b400cea00 2023-12-18T10:26:18.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b47187640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b84c0 con 0x7f6b4015c730 2023-12-18T10:26:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b45984640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b400cea00 0x7f6b400cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b45984640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b400cea00 0x7f6b400cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54088/0 (socket says 172.21.15.133:54088) 2023-12-18T10:26:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b45984640 1 -- 172.21.15.133:0/313277010 learned_addr learned my addr 172.21.15.133:0/313277010 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b45984640 1 -- 172.21.15.133:0/313277010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b4015c730 msgr2=0x7f6b400b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b45984640 1 --2- 172.21.15.133:0/313277010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b4015c730 0x7f6b400b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b45984640 1 -- 172.21.15.133:0/313277010 >> v1:172.21.15.142:6789/0 conn(0x7f6b400cd3a0 legacy=0x7f6b400b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:18.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.296+0000 7f6b45984640 1 -- 172.21.15.133:0/313277010 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400cd960 con 0x7f6b400cea00 2023-12-18T10:26:18.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b45984640 1 --2- 172.21.15.133:0/313277010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b400cea00 0x7f6b400cef60 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f6b400b50d0 tx=0x7f6b3001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4efd07d85064a28 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:18.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b45183640 1 -- 172.21.15.133:0/313277010 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b300a8970 con 0x7f6b400cea00 2023-12-18T10:26:18.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b45183640 1 -- 172.21.15.133:0/313277010 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b300a8ad0 con 0x7f6b400cea00 2023-12-18T10:26:18.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b45183640 1 -- 172.21.15.133:0/313277010 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b300a8e60 con 0x7f6b400cea00 2023-12-18T10:26:18.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b47187640 1 -- 172.21.15.133:0/313277010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b400cea00 msgr2=0x7f6b400cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b47187640 1 --2- 172.21.15.133:0/313277010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b400cea00 0x7f6b400cef60 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f6b400b50d0 tx=0x7f6b3001ecb0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b47187640 1 -- 172.21.15.133:0/313277010 shutdown_connections 2023-12-18T10:26:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b47187640 1 --2- 172.21.15.133:0/313277010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b400cea00 0x7f6b400cef60 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b47187640 1 --2- 172.21.15.133:0/313277010 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b4015c730 0x7f6b400b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b47187640 1 -- 172.21.15.133:0/313277010 >> 172.21.15.133:0/313277010 conn(0x7f6b4006b120 msgr2=0x7f6b4006b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b47187640 1 -- 172.21.15.133:0/313277010 shutdown_connections 2023-12-18T10:26:18.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.300+0000 7f6b47187640 1 -- 172.21.15.133:0/313277010 wait complete. 2023-12-18T10:26:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 Processor -- start 2023-12-18T10:26:18.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 -- start start 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b400cd3a0 0x7f6b401f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b400cea00 0x7f6b40155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b4015c730 0x7f6b4015e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4014a210 con 0x7f6b4015c730 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4015e6d0 con 0x7f6b400cea00 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40154240 con 0x7f6b400cd3a0 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b4015c730 0x7f6b4015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b4015c730 0x7f6b4015e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54096/0 (socket says 172.21.15.133:54096) 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 -- 172.21.15.133:0/3315102117 learned_addr learned my addr 172.21.15.133:0/3315102117 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46185640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b400cd3a0 0x7f6b401f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b45984640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b400cea00 0x7f6b40155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:18.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 -- 172.21.15.133:0/3315102117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b400cd3a0 msgr2=0x7f6b401f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b400cd3a0 0x7f6b401f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 -- 172.21.15.133:0/3315102117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b400cea00 msgr2=0x7f6b40155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b400cea00 0x7f6b40155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 -- 172.21.15.133:0/3315102117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300094d0 con 0x7f6b4015c730 2023-12-18T10:26:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b46986640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b4015c730 0x7f6b4015e190 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c780 tx=0x7f6b3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b36ffd640 1 -- 172.21.15.133:0/3315102117 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38004b70 con 0x7f6b4015c730 2023-12-18T10:26:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b36ffd640 1 -- 172.21.15.133:0/3315102117 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3800ce90 con 0x7f6b4015c730 2023-12-18T10:26:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b40154490 con 0x7f6b4015c730 2023-12-18T10:26:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b36ffd640 1 -- 172.21.15.133:0/3315102117 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800a850 con 0x7f6b4015c730 2023-12-18T10:26:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.304+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b40154a50 con 0x7f6b4015c730 2023-12-18T10:26:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.308+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b40066c50 con 0x7f6b4015c730 2023-12-18T10:26:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.308+0000 7f6b36ffd640 1 -- 172.21.15.133:0/3315102117 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b3800a9b0 con 0x7f6b4015c730 2023-12-18T10:26:18.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.308+0000 7f6b36ffd640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b24065a60 0x7f6b24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:18.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.308+0000 7f6b36ffd640 1 -- 172.21.15.133:0/3315102117 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f6b380830e0 con 0x7f6b4015c730 2023-12-18T10:26:18.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.308+0000 7f6b46185640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b24065a60 0x7f6b24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.308+0000 7f6b46185640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b24065a60 0x7f6b24067f20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6b4015f680 tx=0x7f6b3c006f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:18.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.312+0000 7f6b36ffd640 1 -- 172.21.15.133:0/3315102117 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b38050c50 con 0x7f6b4015c730 2023-12-18T10:26:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.464+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b4004e850 con 0x7f6b4015c730 2023-12-18T10:26:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.464+0000 7f6b36ffd640 1 -- 172.21.15.133:0/3315102117 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+13047 (secure 0 0 0) 0x7f6b38054270 con 0x7f6b4015c730 2023-12-18T10:26:18.466 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:18.466 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":110,"fsid":"7fe143ee-5f58-4242-8bb4-33cc87443c22","created":"2023-12-18T10:17:40.099339+0000","modified":"2023-12-18T10:26:15.211905+0000","last_up_change":"2023-12-18T10:17:52.382211+0000","last_in_change":"2023-12-18T10:17:42.655955+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-18T10:17:53.161748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4bc3d1af-2be3-4a30-a186-eef044c37551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":38183},{"type":"v1","addr":"172.21.15.133:6809","nonce":38183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":38183},{"type":"v1","addr":"172.21.15.133:6811","nonce":38183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":38183},{"type":"v1","addr":"172.21.15.133:6815","nonce":38183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":38183},{"type":"v1","addr":"172.21.15.133:6813","nonce":38183}]},"public_addr":"172.21.15.133:6809/38183","cluster_addr":"172.21.15.133:6811/38183","heartbeat_back_addr":"172.21.15.133:6815/38183","heartbeat_front_addr":"172.21.15.133:6813/38183","state":["exists","up"]},{"osd":1,"uuid":"ce868f18-cb40-44a9-a22d-96e4e89fae3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":38184},{"type":"v1","addr":"172.21.15.133:6801","nonce":38184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":38184},{"type":"v1","addr":"172.21.15.133:6803","nonce":38184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":38184},{"type":"v1","addr":"172.21.15.133:6807","nonce":38184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":38184},{"type":"v1","addr":"172.21.15.133:6805","nonce":38184}]},"public_addr":"172.21.15.133:6801/38184","cluster_addr":"172.21.15.133:6803/38184","heartbeat_back_addr":"172.21.15.133:6807/38184","heartbeat_front_addr":"172.21.15.133:6805/38184","state":["exists","up"]},{"osd":2,"uuid":"b32d4100-94ff-42fc-a875-23edfda1f1ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":38205},{"type":"v1","addr":"172.21.15.133:6817","nonce":38205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":38205},{"type":"v1","addr":"172.21.15.133:6819","nonce":38205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":38205},{"type":"v1","addr":"172.21.15.133:6823","nonce":38205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":38205},{"type":"v1","addr":"172.21.15.133:6821","nonce":38205}]},"public_addr":"172.21.15.133:6817/38205","cluster_addr":"172.21.15.133:6819/38205","heartbeat_back_addr":"172.21.15.133:6823/38205","heartbeat_front_addr":"172.21.15.133:6821/38205","state":["exists","up"]},{"osd":3,"uuid":"df872fbf-221e-4007-9058-ebd940ace311","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":38188},{"type":"v1","addr":"172.21.15.133:6825","nonce":38188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":38188},{"type":"v1","addr":"172.21.15.133:6827","nonce":38188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":38188},{"type":"v1","addr":"172.21.15.133:6831","nonce":38188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":38188},{"type":"v1","addr":"172.21.15.133:6829","nonce":38188}]},"public_addr":"172.21.15.133:6825/38188","cluster_addr":"172.21.15.133:6827/38188","heartbeat_back_addr":"172.21.15.133:6831/38188","heartbeat_front_addr":"172.21.15.133:6829/38188","state":["exists","up"]},{"osd":4,"uuid":"3115d287-cde8-4aad-8efb-f82780bbf5aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":38344},{"type":"v1","addr":"172.21.15.142:6801","nonce":38344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":38344},{"type":"v1","addr":"172.21.15.142:6803","nonce":38344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":38344},{"type":"v1","addr":"172.21.15.142:6807","nonce":38344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":38344},{"type":"v1","addr":"172.21.15.142:6805","nonce":38344}]},"public_addr":"172.21.15.142:6801/38344","cluster_addr":"172.21.15.142:6803/38344","heartbeat_back_addr":"172.21.15.142:6807/38344","heartbeat_front_addr":"172.21.15.142:6805/38344","state":["exists","up"]},{"osd":5,"uuid":"c9471f90-81ae-47e0-9227-aad21906cfd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":38345},{"type":"v1","addr":"172.21.15.142:6809","nonce":38345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":38345},{"type":"v1","addr":"172.21.15.142:6811","nonce":38345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":38345},{"type":"v1","addr":"172.21.15.142:6815","nonce":38345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":38345},{"type":"v1","addr":"172.21.15.142:6813","nonce":38345}]},"public_addr":"172.21.15.142:6809/38345","cluster_addr":"172.21.15.142:6811/38345","heartbeat_back_addr":"172.21.15.142:6815/38345","heartbeat_front_addr":"172.21.15.142:6813/38345","state":["exists","up"]},{"osd":6,"uuid":"d6f9484d-a126-4456-a6d4-4f9494bbb5e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":38346},{"type":"v1","addr":"172.21.15.142:6825","nonce":38346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":38346},{"type":"v1","addr":"172.21.15.142:6827","nonce":38346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":38346},{"type":"v1","addr":"172.21.15.142:6831","nonce":38346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":38346},{"type":"v1","addr":"172.21.15.142:6829","nonce":38346}]},"public_addr":"172.21.15.142:6825/38346","cluster_addr":"172.21.15.142:6827/38346","heartbeat_back_addr":"172.21.15.142:6831/38346","heartbeat_front_addr":"172.21.15.142:6829/38346","state":["exists","up"]},{"osd":7,"uuid":"6df648c5-a417-44b3-b14b-6acaa248274b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":38355},{"type":"v1","addr":"172.21.15.142:6817","nonce":38355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":38355},{"type":"v1","addr":"172.21.15.142:6819","nonce":38355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":38355},{"type":"v1","addr":"172.21.15.142:6823","nonce":38355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":38355},{"type":"v1","addr":"172.21.15.142:6821","nonce":38355}]},"public_addr":"172.21.15.142:6817/38355","cluster_addr":"172.21.15.142:6819/38355","heartbeat_back_addr":"172.21.15.142:6823/38355","heartbeat_front_addr":"172.21.15.142:6821/38355","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.324788+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.199753+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.315857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.109440+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.269669+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.244469+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.650904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-18T10:17:48.512972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/1840110844":"2023-12-19T10:26:12.200312+0000","172.21.15.133:6835/1840110844":"2023-12-19T10:26:12.200312+0000","172.21.15.133:6836/3153614779":"2023-12-19T10:26:12.200300+0000","172.21.15.133:6834/3153614779":"2023-12-19T10:26:12.200300+0000","172.21.15.142:6835/1819917691":"2023-12-19T10:26:12.200317+0000","172.21.15.142:6833/1819917691":"2023-12-19T10:26:12.200317+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-18T10:26:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b24065a60 msgr2=0x7f6b24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b24065a60 0x7f6b24067f20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6b4015f680 tx=0x7f6b3c006f90 comp rx=0 tx=0).stop 2023-12-18T10:26:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b4015c730 msgr2=0x7f6b4015e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b4015c730 0x7f6b4015e190 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c780 tx=0x7f6b3800cc40 comp rx=0 tx=0).stop 2023-12-18T10:26:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 shutdown_connections 2023-12-18T10:26:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6b24065a60 0x7f6b24067f20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b4015c730 0x7f6b4015e190 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b400cea00 0x7f6b40155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 --2- 172.21.15.133:0/3315102117 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b400cd3a0 0x7f6b401f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 >> 172.21.15.133:0/3315102117 conn(0x7f6b4006b120 msgr2=0x7f6b40151020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 shutdown_connections 2023-12-18T10:26:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:18.468+0000 7f6b47187640 1 -- 172.21.15.133:0/3315102117 wait complete. 2023-12-18T10:26:19.488 INFO:tasks.ceph:Scrubbing osd.0 2023-12-18T10:26:19.488 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-18T10:26:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43af466640 1 Processor -- start 2023-12-18T10:26:19.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43af466640 1 -- start start 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43af466640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43a8160e90 0x7f43a8165130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43af466640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a806be20 0x7f43a80c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43af466640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43a80c18b0 0x7f43a80cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43af466640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a80c1d00 con 0x7f43a80c18b0 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43af466640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a80b20a0 con 0x7f43a8160e90 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43af466640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80b2380 con 0x7f43a806be20 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ad202640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43a8160e90 0x7f43a8165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ada03640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43a80c18b0 0x7f43a80cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43aca01640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a806be20 0x7f43a80c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ad202640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f43a8160e90 0x7f43a8165130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:45522/0 (socket says 172.21.15.133:45522) 2023-12-18T10:26:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ada03640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43a80c18b0 0x7f43a80cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54100/0 (socket says 172.21.15.133:54100) 2023-12-18T10:26:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ad202640 1 -- 172.21.15.133:0/4215373625 learned_addr learned my addr 172.21.15.133:0/4215373625 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ada03640 1 -- 172.21.15.133:0/4215373625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a806be20 msgr2=0x7f43a80c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ada03640 1 --2- 172.21.15.133:0/4215373625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a806be20 0x7f43a80c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ada03640 1 -- 172.21.15.133:0/4215373625 >> v2:172.21.15.142:3300/0 conn(0x7f43a8160e90 msgr2=0x7f43a8165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ada03640 1 --2- 172.21.15.133:0/4215373625 >> v2:172.21.15.142:3300/0 conn(0x7f43a8160e90 0x7f43a8165130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.640+0000 7f43ada03640 1 -- 172.21.15.133:0/4215373625 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80cc5b0 con 0x7f43a80c18b0 2023-12-18T10:26:19.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43ada03640 1 --2- 172.21.15.133:0/4215373625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a80c18b0 0x7f43a80cd090 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f43a80cbf20 tx=0x7f43a001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0139c3b8ec6a39 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:19.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f439ffff640 1 -- 172.21.15.133:0/4215373625 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a00a5880 con 0x7f43a80c18b0 2023-12-18T10:26:19.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f439ffff640 1 -- 172.21.15.133:0/4215373625 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a00a59e0 con 0x7f43a80c18b0 2023-12-18T10:26:19.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f439ffff640 1 -- 172.21.15.133:0/4215373625 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a00a5d70 con 0x7f43a80c18b0 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 -- 172.21.15.133:0/4215373625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a80c18b0 msgr2=0x7f43a80cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 --2- 172.21.15.133:0/4215373625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a80c18b0 0x7f43a80cd090 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f43a80cbf20 tx=0x7f43a001c910 comp rx=0 tx=0).stop 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 -- 172.21.15.133:0/4215373625 shutdown_connections 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 --2- 172.21.15.133:0/4215373625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a80c18b0 0x7f43a80cd090 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 --2- 172.21.15.133:0/4215373625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a806be20 0x7f43a80c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 --2- 172.21.15.133:0/4215373625 >> v2:172.21.15.142:3300/0 conn(0x7f43a8160e90 0x7f43a8165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 -- 172.21.15.133:0/4215373625 >> 172.21.15.133:0/4215373625 conn(0x7f43a8069e70 msgr2=0x7f43a806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 -- 172.21.15.133:0/4215373625 shutdown_connections 2023-12-18T10:26:19.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.644+0000 7f43af466640 1 -- 172.21.15.133:0/4215373625 wait complete. 2023-12-18T10:26:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 Processor -- start 2023-12-18T10:26:19.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 -- start start 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a806be20 0x7f43a815e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80c18b0 0x7f43a815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a8160e90 0x7f43a8162d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a815d760 con 0x7f43a806be20 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8071320 con 0x7f43a8160e90 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a815d9b0 con 0x7f43a80c18b0 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a806be20 0x7f43a815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a806be20 0x7f43a815e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54116/0 (socket says 172.21.15.133:54116) 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 -- 172.21.15.133:0/2245682922 learned_addr learned my addr 172.21.15.133:0/2245682922 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ada03640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a8160e90 0x7f43a8162d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43aca01640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80c18b0 0x7f43a815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 -- 172.21.15.133:0/2245682922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80c18b0 msgr2=0x7f43a815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f43a80c18b0 0x7f43a815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 -- 172.21.15.133:0/2245682922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a8160e90 msgr2=0x7f43a8162d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a8160e90 0x7f43a8162d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 -- 172.21.15.133:0/2245682922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0009a70 con 0x7f43a806be20 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ada03640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f43a8160e90 0x7f43a8162d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43ad202640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a806be20 0x7f43a815e250 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f43a400e7f0 tx=0x7f43a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4009580 con 0x7f43a806be20 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a400c940 con 0x7f43a806be20 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400ccf0 con 0x7f43a806be20 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.648+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a815dc90 con 0x7f43a806be20 2023-12-18T10:26:19.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a815caf0 con 0x7f43a806be20 2023-12-18T10:26:19.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43a80adb60 con 0x7f43a806be20 2023-12-18T10:26:19.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f43a4013470 con 0x7f43a806be20 2023-12-18T10:26:19.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f439dffb640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f438c065a90 0x7f438c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f43a40834d0 con 0x7f43a806be20 2023-12-18T10:26:19.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f43aca01640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f438c065a90 0x7f438c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f439dffb640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f438c06bed0 0x7f438c06e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f438c06e9e0 con 0x7f438c06bed0 2023-12-18T10:26:19.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.652+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43a4083840 con 0x7f43a806be20 2023-12-18T10:26:19.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.656+0000 7f43ada03640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f438c06bed0 0x7f438c06e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.656+0000 7f43aca01640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f438c065a90 0x7f438c067f50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f43a81fcc60 tx=0x7f4398008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:19.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.656+0000 7f43ada03640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f438c06bed0 0x7f438c06e310 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:19.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.656+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 <== osd.0 v2:172.21.15.133:6808/38183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f438c06e9e0 con 0x7f438c06bed0 2023-12-18T10:26:19.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 --> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f43a8165670 con 0x7f438c06bed0 2023-12-18T10:26:19.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f439dffb640 1 -- 172.21.15.133:0/2245682922 <== osd.0 v2:172.21.15.133:6808/38183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f43a0009450 con 0x7f438c06bed0 2023-12-18T10:26:19.669 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:19.669 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-18T10:26:19.669 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f438c06bed0 msgr2=0x7f438c06e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6808/38183,v1:172.21.15.133:6809/38183] conn(0x7f438c06bed0 0x7f438c06e310 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f438c065a90 msgr2=0x7f438c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f438c065a90 0x7f438c067f50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f43a81fcc60 tx=0x7f4398008040 comp rx=0 tx=0).stop 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a806be20 msgr2=0x7f43a815e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 --2- 172.21.15.133:0/2245682922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43a806be20 0x7f43a815e250 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f43a400e7f0 tx=0x7f43a400ecb0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43ada03640 1 -- 172.21.15.133:0/2245682922 reap_dead start 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 shutdown_connections 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 >> 172.21.15.133:0/2245682922 conn(0x7f43a8069e70 msgr2=0x7f43a80ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:19.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 shutdown_connections 2023-12-18T10:26:19.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.668+0000 7f43af466640 1 -- 172.21.15.133:0/2245682922 wait complete. 2023-12-18T10:26:19.688 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-18T10:26:19.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.824+0000 7f4da548c640 1 Processor -- start 2023-12-18T10:26:19.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.824+0000 7f4da548c640 1 -- start start 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4da548c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da015a0a0 0x7f4da015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4da548c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4da015a480 0x7f4da00cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4da548c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da015d680 con 0x7f4da015a900 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4da548c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da00cd0f0 con 0x7f4da015a480 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4da548c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da015d920 con 0x7f4da015a0a0 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4d97fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4da015a480 0x7f4da00cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4d97fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4da015a480 0x7f4da00cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54132/0 (socket says 172.21.15.133:54132) 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4d97fff640 1 -- 172.21.15.133:0/3471832934 learned_addr learned my addr 172.21.15.133:0/3471832934 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4d9effd640 1 --2- 172.21.15.133:0/3471832934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da015a0a0 0x7f4da015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4d97fff640 1 -- 172.21.15.133:0/3471832934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da015a0a0 msgr2=0x7f4da015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4d97fff640 1 --2- 172.21.15.133:0/3471832934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da015a0a0 0x7f4da015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4d97fff640 1 -- 172.21.15.133:0/3471832934 >> v1:172.21.15.142:6789/0 conn(0x7f4da015a900 legacy=0x7f4da00b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.828+0000 7f4d97fff640 1 -- 172.21.15.133:0/3471832934 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da015dc00 con 0x7f4da015a480 2023-12-18T10:26:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4d97fff640 1 --2- 172.21.15.133:0/3471832934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a480 0x7f4da00cab10 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800bb10 tx=0x7f4d8801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6a3c9489b84ddb server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4d9e7fc640 1 -- 172.21.15.133:0/3471832934 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880a7bc0 con 0x7f4da015a480 2023-12-18T10:26:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4d9e7fc640 1 -- 172.21.15.133:0/3471832934 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d880a7d20 con 0x7f4da015a480 2023-12-18T10:26:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4d9e7fc640 1 -- 172.21.15.133:0/3471832934 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880af660 con 0x7f4da015a480 2023-12-18T10:26:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 -- 172.21.15.133:0/3471832934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a480 msgr2=0x7f4da00cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 --2- 172.21.15.133:0/3471832934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a480 0x7f4da00cab10 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800bb10 tx=0x7f4d8801ebe0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 -- 172.21.15.133:0/3471832934 shutdown_connections 2023-12-18T10:26:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 --2- 172.21.15.133:0/3471832934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a480 0x7f4da00cab10 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 --2- 172.21.15.133:0/3471832934 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da015a0a0 0x7f4da015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 -- 172.21.15.133:0/3471832934 >> 172.21.15.133:0/3471832934 conn(0x7f4da006cf80 msgr2=0x7f4da006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 -- 172.21.15.133:0/3471832934 shutdown_connections 2023-12-18T10:26:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 -- 172.21.15.133:0/3471832934 wait complete. 2023-12-18T10:26:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 Processor -- start 2023-12-18T10:26:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.832+0000 7f4da548c640 1 -- start start 2023-12-18T10:26:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a0a0 0x7f4da00c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4da015a480 0x7f4da00c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da00c8d20 0x7f4da0143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da01541b0 con 0x7f4da015a0a0 2023-12-18T10:26:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00c91e0 con 0x7f4da015a480 2023-12-18T10:26:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00c94c0 con 0x7f4da00c8d20 2023-12-18T10:26:19.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a0a0 0x7f4da00c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a0a0 0x7f4da00c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54144/0 (socket says 172.21.15.133:54144) 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 -- 172.21.15.133:0/2173806381 learned_addr learned my addr 172.21.15.133:0/2173806381 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d97fff640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4da015a480 0x7f4da00c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9f7fe640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da00c8d20 0x7f4da0143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 -- 172.21.15.133:0/2173806381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da00c8d20 msgr2=0x7f4da0143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da00c8d20 0x7f4da0143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 -- 172.21.15.133:0/2173806381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4da015a480 msgr2=0x7f4da00c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4da015a480 0x7f4da00c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 -- 172.21.15.133:0/2173806381 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8800b770 con 0x7f4da015a0a0 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d9effd640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a0a0 0x7f4da00c6850 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000d800 tx=0x7f4d9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d977fe640 1 -- 172.21.15.133:0/2173806381 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000b6c0 con 0x7f4da015a0a0 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d977fe640 1 -- 172.21.15.133:0/2173806381 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9000b820 con 0x7f4da015a0a0 2023-12-18T10:26:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da00c97a0 con 0x7f4da015a0a0 2023-12-18T10:26:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d977fe640 1 -- 172.21.15.133:0/2173806381 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000bb90 con 0x7f4da015a0a0 2023-12-18T10:26:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da00c6d90 con 0x7f4da015a0a0 2023-12-18T10:26:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da00c6f80 con 0x7f4da015a0a0 2023-12-18T10:26:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.836+0000 7f4d977fe640 1 -- 172.21.15.133:0/2173806381 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d9000bcf0 con 0x7f4da015a0a0 2023-12-18T10:26:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.840+0000 7f4d977fe640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4d80065a90 0x7f4d80067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.840+0000 7f4d977fe640 1 -- 172.21.15.133:0/2173806381 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f4d900835e0 con 0x7f4da015a0a0 2023-12-18T10:26:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.840+0000 7f4d97fff640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4d80065a90 0x7f4d80067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.840+0000 7f4d97fff640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4d80065a90 0x7f4d80067f50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4d880b1000 tx=0x7f4d880a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:19.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.844+0000 7f4d977fe640 1 -- 172.21.15.133:0/2173806381 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4da00c6f80 con 0x7f4da015a0a0 2023-12-18T10:26:19.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.992+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f4da00cec40 con 0x7f4d80065a90 2023-12-18T10:26:19.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.992+0000 7f4d977fe640 1 -- 172.21.15.133:0/2173806381 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4d880a7e90 con 0x7f4d80065a90 2023-12-18T10:26:19.994 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 0 to deep-scrub 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4d80065a90 msgr2=0x7f4d80067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4d80065a90 0x7f4d80067f50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4d880b1000 tx=0x7f4d880a9070 comp rx=0 tx=0).stop 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a0a0 msgr2=0x7f4da00c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a0a0 0x7f4da00c6850 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000d800 tx=0x7f4d9000dcc0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 shutdown_connections 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f4d80065a90 0x7f4d80067f50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4da00c8d20 0x7f4da0143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4da015a480 0x7f4da00c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 --2- 172.21.15.133:0/2173806381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4da015a0a0 0x7f4da00c6850 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:19.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 >> 172.21.15.133:0/2173806381 conn(0x7f4da006cf80 msgr2=0x7f4da0158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:19.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 shutdown_connections 2023-12-18T10:26:19.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:19.996+0000 7f4da548c640 1 -- 172.21.15.133:0/2173806381 wait complete. 2023-12-18T10:26:20.015 INFO:tasks.ceph:Scrubbing osd.1 2023-12-18T10:26:20.015 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-18T10:26:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff72a96d640 1 Processor -- start 2023-12-18T10:26:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff72a96d640 1 -- start start 2023-12-18T10:26:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff72a96d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 0x7ff72406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff72a96d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff7240ab190 0x7ff7240ab620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff72a96d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7240b28a0 con 0x7ff7240ce5d0 2023-12-18T10:26:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff72a96d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72415ab30 con 0x7ff7240ab190 2023-12-18T10:26:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff72a96d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240b1c90 con 0x7ff72406d440 2023-12-18T10:26:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff723fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff7240ce5d0 0x7ff7240ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54814/0 (socket says 172.21.15.133:54814) 2023-12-18T10:26:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff723fff640 1 -- 172.21.15.133:0/1246012036 learned_addr learned my addr 172.21.15.133:0/1246012036 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff7237fe640 1 --2- 172.21.15.133:0/1246012036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 0x7ff72406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff728f0a640 1 --2- 172.21.15.133:0/1246012036 >> v2:172.21.15.142:3300/0 conn(0x7ff7240ab190 0x7ff7240ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff722ffd640 1 -- 172.21.15.133:0/1246012036 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684417927 0 0) 0x7ff7240b28a0 con 0x7ff7240ce5d0 2023-12-18T10:26:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff722ffd640 1 -- 172.21.15.133:0/1246012036 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff70c003530 con 0x7ff7240ce5d0 2023-12-18T10:26:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff722ffd640 1 -- 172.21.15.133:0/1246012036 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1246308229 0 0) 0x7ff70c003530 con 0x7ff7240ce5d0 2023-12-18T10:26:20.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff7237fe640 1 -- 172.21.15.133:0/1246012036 >> v2:172.21.15.142:3300/0 conn(0x7ff7240ab190 msgr2=0x7ff7240ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff7237fe640 1 --2- 172.21.15.133:0/1246012036 >> v2:172.21.15.142:3300/0 conn(0x7ff7240ab190 0x7ff7240ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff7237fe640 1 -- 172.21.15.133:0/1246012036 >> v1:172.21.15.133:6789/0 conn(0x7ff7240ce5d0 legacy=0x7ff7240ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff7237fe640 1 -- 172.21.15.133:0/1246012036 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7240b1f70 con 0x7ff72406d440 2023-12-18T10:26:20.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.160+0000 7ff728f0a640 1 --2- 172.21.15.133:0/1246012036 >> v2:172.21.15.142:3300/0 conn(0x7ff7240ab190 0x7ff7240ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff7237fe640 1 --2- 172.21.15.133:0/1246012036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 0x7ff72406d8a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff7180097c0 tx=0x7ff71801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d13eafb390215af server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff722ffd640 1 -- 172.21.15.133:0/1246012036 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff714001680 con 0x7ff72406d440 2023-12-18T10:26:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff722ffd640 1 -- 172.21.15.133:0/1246012036 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7180a7050 con 0x7ff72406d440 2023-12-18T10:26:20.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff722ffd640 1 -- 172.21.15.133:0/1246012036 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7180ab600 con 0x7ff72406d440 2023-12-18T10:26:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff72a96d640 1 -- 172.21.15.133:0/1246012036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 msgr2=0x7ff72406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff72a96d640 1 --2- 172.21.15.133:0/1246012036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 0x7ff72406d8a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff7180097c0 tx=0x7ff71801c370 comp rx=0 tx=0).stop 2023-12-18T10:26:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff72a96d640 1 -- 172.21.15.133:0/1246012036 shutdown_connections 2023-12-18T10:26:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff72a96d640 1 --2- 172.21.15.133:0/1246012036 >> v2:172.21.15.142:3300/0 conn(0x7ff7240ab190 0x7ff7240ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff72a96d640 1 --2- 172.21.15.133:0/1246012036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 0x7ff72406d8a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff72a96d640 1 -- 172.21.15.133:0/1246012036 >> 172.21.15.133:0/1246012036 conn(0x7ff724069e70 msgr2=0x7ff72406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff72a96d640 1 -- 172.21.15.133:0/1246012036 shutdown_connections 2023-12-18T10:26:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.164+0000 7ff72a96d640 1 -- 172.21.15.133:0/1246012036 wait complete. 2023-12-18T10:26:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 Processor -- start 2023-12-18T10:26:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 -- start start 2023-12-18T10:26:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 0x7ff7240972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7240ab190 0x7ff7240c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7240ce5d0 0x7ff7240cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240c2630 con 0x7ff7240ce5d0 2023-12-18T10:26:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240c7f20 con 0x7ff7240ab190 2023-12-18T10:26:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7240c1f70 con 0x7ff72406d440 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7240ce5d0 0x7ff7240cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7240ce5d0 0x7ff7240cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43214/0 (socket says 172.21.15.133:43214) 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 -- 172.21.15.133:0/734857815 learned_addr learned my addr 172.21.15.133:0/734857815 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff723fff640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 0x7ff7240972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff7237fe640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7240ab190 0x7ff7240c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 -- 172.21.15.133:0/734857815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 msgr2=0x7ff7240972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff72406d440 0x7ff7240972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 -- 172.21.15.133:0/734857815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7240ab190 msgr2=0x7ff7240c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff7240ab190 0x7ff7240c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 -- 172.21.15.133:0/734857815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c009a70 con 0x7ff7240ce5d0 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff728f0a640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7240ce5d0 0x7ff7240cd240 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00efc0 tx=0x7ff71c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c009cd0 con 0x7ff7240ce5d0 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00f040 con 0x7ff7240ce5d0 2023-12-18T10:26:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff718009420 con 0x7ff7240ce5d0 2023-12-18T10:26:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0039a0 con 0x7ff7240ce5d0 2023-12-18T10:26:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.168+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7240b2eb0 con 0x7ff7240ce5d0 2023-12-18T10:26:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7240b2d30 con 0x7ff7240ce5d0 2023-12-18T10:26:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff71c027480 con 0x7ff7240ce5d0 2023-12-18T10:26:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff720ff9640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff710065a60 0x7ff710067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7ff71c0846a0 con 0x7ff7240ce5d0 2023-12-18T10:26:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff720ff9640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7ff71006bea0 0x7ff71006e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 --> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff71006e9b0 con 0x7ff71006bea0 2023-12-18T10:26:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff723fff640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff710065a60 0x7ff710067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff71c084a10 con 0x7ff7240ce5d0 2023-12-18T10:26:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff7237fe640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7ff71006bea0 0x7ff71006e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff723fff640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff710065a60 0x7ff710067f20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff714006b60 tx=0x7ff714001dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.172+0000 7ff7237fe640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7ff71006bea0 0x7ff71006e2e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.176+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 <== osd.1 v2:172.21.15.133:6800/38184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff71006e9b0 con 0x7ff71006bea0 2023-12-18T10:26:20.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 --> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff7240b18b0 con 0x7ff71006bea0 2023-12-18T10:26:20.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff720ff9640 1 -- 172.21.15.133:0/734857815 <== osd.1 v2:172.21.15.133:6800/38184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff718004260 con 0x7ff71006bea0 2023-12-18T10:26:20.188 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:20.188 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-18T10:26:20.188 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7ff71006bea0 msgr2=0x7ff71006e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6800/38184,v1:172.21.15.133:6801/38184] conn(0x7ff71006bea0 0x7ff71006e2e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff710065a60 msgr2=0x7ff710067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff710065a60 0x7ff710067f20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff714006b60 tx=0x7ff714001dd0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7240ce5d0 msgr2=0x7ff7240cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 --2- 172.21.15.133:0/734857815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7240ce5d0 0x7ff7240cd240 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00efc0 tx=0x7ff71c00c490 comp rx=0 tx=0).stop 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff728f0a640 1 -- 172.21.15.133:0/734857815 reap_dead start 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 shutdown_connections 2023-12-18T10:26:20.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 >> 172.21.15.133:0/734857815 conn(0x7ff724069e70 msgr2=0x7ff7240cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:20.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 shutdown_connections 2023-12-18T10:26:20.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.188+0000 7ff72a96d640 1 -- 172.21.15.133:0/734857815 wait complete. 2023-12-18T10:26:20.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-18T10:26:20.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.344+0000 7f54bb4d8640 1 Processor -- start 2023-12-18T10:26:20.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.344+0000 7f54bb4d8640 1 -- start start 2023-12-18T10:26:20.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.344+0000 7f54bb4d8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54b4160cc0 0x7f54b40cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.344+0000 7f54bb4d8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1280 0x7f54b40cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.344+0000 7f54bb4d8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c17d0 0x7f54b406bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.344+0000 7f54bb4d8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b41654a0 con 0x7f54b4160cc0 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.344+0000 7f54bb4d8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b41610a0 con 0x7f54b40c1280 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.344+0000 7f54bb4d8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b406fdb0 con 0x7f54b40c17d0 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54b4160cc0 0x7f54b40cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54b4160cc0 0x7f54b40cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43222/0 (socket says 172.21.15.133:43222) 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 -- 172.21.15.133:0/3871213978 learned_addr learned my addr 172.21.15.133:0/3871213978 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b8a73640 1 --2- 172.21.15.133:0/3871213978 >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1280 0x7f54b40cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9a75640 1 --2- 172.21.15.133:0/3871213978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c17d0 0x7f54b406bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 -- 172.21.15.133:0/3871213978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c17d0 msgr2=0x7f54b406bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 --2- 172.21.15.133:0/3871213978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c17d0 0x7f54b406bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 -- 172.21.15.133:0/3871213978 >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1280 msgr2=0x7f54b40cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 --2- 172.21.15.133:0/3871213978 >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1280 0x7f54b40cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 -- 172.21.15.133:0/3871213978 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40cb6b0 con 0x7f54b4160cc0 2023-12-18T10:26:20.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b8a73640 1 --2- 172.21.15.133:0/3871213978 >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1280 0x7f54b40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:20.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9a75640 1 --2- 172.21.15.133:0/3871213978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c17d0 0x7f54b406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:20.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54b9274640 1 --2- 172.21.15.133:0/3871213978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b40cac30 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f54b40c8ad0 tx=0x7f54b001c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08e61e4a5439ff7 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54abfff640 1 -- 172.21.15.133:0/3871213978 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00ab600 con 0x7f54b4160cc0 2023-12-18T10:26:20.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54abfff640 1 -- 172.21.15.133:0/3871213978 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b00a7050 con 0x7f54b4160cc0 2023-12-18T10:26:20.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.348+0000 7f54abfff640 1 -- 172.21.15.133:0/3871213978 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00ab980 con 0x7f54b4160cc0 2023-12-18T10:26:20.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- 172.21.15.133:0/3871213978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 msgr2=0x7f54b40cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/3871213978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b40cac30 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f54b40c8ad0 tx=0x7f54b001c180 comp rx=0 tx=0).stop 2023-12-18T10:26:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- 172.21.15.133:0/3871213978 shutdown_connections 2023-12-18T10:26:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/3871213978 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c17d0 0x7f54b406bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/3871213978 >> v2:172.21.15.142:3300/0 conn(0x7f54b40c1280 0x7f54b40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/3871213978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b40cac30 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- 172.21.15.133:0/3871213978 >> 172.21.15.133:0/3871213978 conn(0x7f54b406a3e0 msgr2=0x7f54b40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- 172.21.15.133:0/3871213978 shutdown_connections 2023-12-18T10:26:20.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- 172.21.15.133:0/3871213978 wait complete. 2023-12-18T10:26:20.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 Processor -- start 2023-12-18T10:26:20.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- start start 2023-12-18T10:26:20.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c1280 0x7f54b4153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40c17d0 0x7f54b4159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b4159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4153a50 con 0x7f54b4160cc0 2023-12-18T10:26:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4154190 con 0x7f54b40c17d0 2023-12-18T10:26:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54bb4d8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4154470 con 0x7f54b40c1280 2023-12-18T10:26:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54b9a75640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b4159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54b9a75640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b4159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43224/0 (socket says 172.21.15.133:43224) 2023-12-18T10:26:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54b9a75640 1 -- 172.21.15.133:0/1352902731 learned_addr learned my addr 172.21.15.133:0/1352902731 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:20.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54b9274640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c1280 0x7f54b4153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.352+0000 7f54b8a73640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40c17d0 0x7f54b4159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54b9a75640 1 -- 172.21.15.133:0/1352902731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c1280 msgr2=0x7f54b4153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54b9a75640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c1280 0x7f54b4153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54b9a75640 1 -- 172.21.15.133:0/1352902731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40c17d0 msgr2=0x7f54b4159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54b9a75640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40c17d0 0x7f54b4159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54b9a75640 1 -- 172.21.15.133:0/1352902731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b00094d0 con 0x7f54b4160cc0 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54b9a75640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b4159bc0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f54ac007ef0 tx=0x7f54ac00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54a9ffb640 1 -- 172.21.15.133:0/1352902731 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac003ba0 con 0x7f54b4160cc0 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54a9ffb640 1 -- 172.21.15.133:0/1352902731 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00f040 con 0x7f54b4160cc0 2023-12-18T10:26:20.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b4154750 con 0x7f54b4160cc0 2023-12-18T10:26:20.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54a9ffb640 1 -- 172.21.15.133:0/1352902731 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00de80 con 0x7f54b4160cc0 2023-12-18T10:26:20.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b4154d10 con 0x7f54b4160cc0 2023-12-18T10:26:20.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b40735b0 con 0x7f54b4160cc0 2023-12-18T10:26:20.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54a9ffb640 1 -- 172.21.15.133:0/1352902731 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f54ac004030 con 0x7f54b4160cc0 2023-12-18T10:26:20.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54a9ffb640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5498065a60 0x7f5498067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54a9ffb640 1 -- 172.21.15.133:0/1352902731 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f54ac083300 con 0x7f54b4160cc0 2023-12-18T10:26:20.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.356+0000 7f54b9274640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5498065a60 0x7f5498067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.360+0000 7f54b9274640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5498065a60 0x7f5498067f20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f54b00ad000 tx=0x7f54b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.360+0000 7f54a9ffb640 1 -- 172.21.15.133:0/1352902731 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f54ac050e80 con 0x7f54b4160cc0 2023-12-18T10:26:20.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f54b41650c0 con 0x7f5498065a60 2023-12-18T10:26:20.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54a9ffb640 1 -- 172.21.15.133:0/1352902731 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f54b00bb090 con 0x7f5498065a60 2023-12-18T10:26:20.513 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 1 to deep-scrub 2023-12-18T10:26:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5498065a60 msgr2=0x7f5498067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5498065a60 0x7f5498067f20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f54b00ad000 tx=0x7f54b0008040 comp rx=0 tx=0).stop 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 msgr2=0x7f54b4159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b4159bc0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f54ac007ef0 tx=0x7f54ac00d4a0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 shutdown_connections 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f5498065a60 0x7f5498067f20 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54b4160cc0 0x7f54b4159bc0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f54b40c17d0 0x7f54b4159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 --2- 172.21.15.133:0/1352902731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f54b40c1280 0x7f54b4153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 >> 172.21.15.133:0/1352902731 conn(0x7f54b406a3e0 msgr2=0x7f54b4070300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 shutdown_connections 2023-12-18T10:26:20.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.512+0000 7f54bb4d8640 1 -- 172.21.15.133:0/1352902731 wait complete. 2023-12-18T10:26:20.534 INFO:tasks.ceph:Scrubbing osd.2 2023-12-18T10:26:20.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-18T10:26:20.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a79873640 1 Processor -- start 2023-12-18T10:26:20.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a79873640 1 -- start start 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a79873640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ca730 0x7f6a740c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a79873640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a740ad6e0 con 0x7f6a740ce6a0 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a79873640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a740ad9c0 con 0x7f6a740ca200 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a79873640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74159b20 con 0x7f6a740ca730 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a72ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6a740ce6a0 0x7f6a740cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54818/0 (socket says 172.21.15.133:54818) 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a72ffd640 1 -- 172.21.15.133:0/1105592155 learned_addr learned my addr 172.21.15.133:0/1105592155 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a737fe640 1 --2- 172.21.15.133:0/1105592155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ca730 0x7f6a740c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a727fc640 1 -- 172.21.15.133:0/1105592155 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907866118 0 0) 0x7f6a740ad6e0 con 0x7f6a740ce6a0 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a727fc640 1 -- 172.21.15.133:0/1105592155 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a60003530 con 0x7f6a740ce6a0 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a737fe640 1 -- 172.21.15.133:0/1105592155 >> v1:172.21.15.142:6789/0 conn(0x7f6a740ca200 legacy=0x7f6a740c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a727fc640 1 -- 172.21.15.133:0/1105592155 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470652521 0 0) 0x7f6a740ad9c0 con 0x7f6a740ca200 2023-12-18T10:26:20.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a737fe640 1 -- 172.21.15.133:0/1105592155 >> v1:172.21.15.133:6789/0 conn(0x7f6a740ce6a0 legacy=0x7f6a740cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.676+0000 7f6a737fe640 1 -- 172.21.15.133:0/1105592155 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7406be20 con 0x7f6a740ca730 2023-12-18T10:26:20.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a737fe640 1 --2- 172.21.15.133:0/1105592155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ca730 0x7f6a740c9100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009df0 tx=0x7f6a6c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a04209221dcbe30 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a727fc640 1 -- 172.21.15.133:0/1105592155 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0a5910 con 0x7f6a740ca730 2023-12-18T10:26:20.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a727fc640 1 -- 172.21.15.133:0/1105592155 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0a5a70 con 0x7f6a740ca730 2023-12-18T10:26:20.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a727fc640 1 -- 172.21.15.133:0/1105592155 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0a5e00 con 0x7f6a740ca730 2023-12-18T10:26:20.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 -- 172.21.15.133:0/1105592155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ca730 msgr2=0x7f6a740c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 --2- 172.21.15.133:0/1105592155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ca730 0x7f6a740c9100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009df0 tx=0x7f6a6c01c940 comp rx=0 tx=0).stop 2023-12-18T10:26:20.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 -- 172.21.15.133:0/1105592155 shutdown_connections 2023-12-18T10:26:20.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 --2- 172.21.15.133:0/1105592155 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ca730 0x7f6a740c9100 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 -- 172.21.15.133:0/1105592155 >> 172.21.15.133:0/1105592155 conn(0x7f6a74069e70 msgr2=0x7f6a7406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:20.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 -- 172.21.15.133:0/1105592155 shutdown_connections 2023-12-18T10:26:20.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 -- 172.21.15.133:0/1105592155 wait complete. 2023-12-18T10:26:20.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 Processor -- start 2023-12-18T10:26:20.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.680+0000 7f6a79873640 1 -- start start 2023-12-18T10:26:20.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a740ca200 0x7f6a74162c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a740ca730 0x7f6a7415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ce6a0 0x7f6a74152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74164410 con 0x7f6a740ca200 2023-12-18T10:26:20.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74161750 con 0x7f6a740ca730 2023-12-18T10:26:20.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74163b70 con 0x7f6a740ce6a0 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a740ca200 0x7f6a74162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a740ca200 0x7f6a74162c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43236/0 (socket says 172.21.15.133:43236) 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 -- 172.21.15.133:0/2016536324 learned_addr learned my addr 172.21.15.133:0/2016536324 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a737fe640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ce6a0 0x7f6a74152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a740ca730 0x7f6a7415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 -- 172.21.15.133:0/2016536324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ce6a0 msgr2=0x7f6a74152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ce6a0 0x7f6a74152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 -- 172.21.15.133:0/2016536324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a740ca730 msgr2=0x7f6a7415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a740ca730 0x7f6a7415b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 -- 172.21.15.133:0/2016536324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c009a70 con 0x7f6a740ca200 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a72ffd640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a740ca200 0x7f6a74162c20 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c3c0 tx=0x7f6a6400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64005cf0 con 0x7f6a740ca200 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64005e50 con 0x7f6a740ca200 2023-12-18T10:26:20.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640072f0 con 0x7f6a740ca200 2023-12-18T10:26:20.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7406cd60 con 0x7f6a740ca200 2023-12-18T10:26:20.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a74164130 con 0x7f6a740ca200 2023-12-18T10:26:20.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.684+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a7406cbe0 con 0x7f6a740ca200 2023-12-18T10:26:20.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a64007450 con 0x7f6a740ca200 2023-12-18T10:26:20.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a70ff9640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 0x7f6a54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f6a640825d0 con 0x7f6a740ca200 2023-12-18T10:26:20.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 0x7f6a54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a70ff9640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6a5406bea0 0x7f6a5406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 --> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a5406e9b0 con 0x7f6a5406bea0 2023-12-18T10:26:20.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a64084bb0 con 0x7f6a740ca200 2023-12-18T10:26:20.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a737fe640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6a5406bea0 0x7f6a5406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 0x7f6a54067f20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6a740b0e90 tx=0x7f6a5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a737fe640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6a5406bea0 0x7f6a5406e2e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.688+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 <== osd.2 v2:172.21.15.133:6816/38205 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6a5406e9b0 con 0x7f6a5406bea0 2023-12-18T10:26:20.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.700+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 --> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a7406c6c0 con 0x7f6a5406bea0 2023-12-18T10:26:20.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.700+0000 7f6a70ff9640 1 -- 172.21.15.133:0/2016536324 <== osd.2 v2:172.21.15.133:6816/38205 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6a6c0a5710 con 0x7f6a5406bea0 2023-12-18T10:26:20.703 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:20.703 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-18T10:26:20.703 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:20.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6a5406bea0 msgr2=0x7f6a5406e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6816/38205,v1:172.21.15.133:6817/38205] conn(0x7f6a5406bea0 0x7f6a5406e2e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 msgr2=0x7f6a54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 0x7f6a54067f20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6a740b0e90 tx=0x7f6a5c009040 comp rx=0 tx=0).stop 2023-12-18T10:26:20.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a740ca200 msgr2=0x7f6a74162c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 --2- 172.21.15.133:0/2016536324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a740ca200 0x7f6a74162c20 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c3c0 tx=0x7f6a6400c880 comp rx=0 tx=0).stop 2023-12-18T10:26:20.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a737fe640 1 -- 172.21.15.133:0/2016536324 reap_dead start 2023-12-18T10:26:20.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 shutdown_connections 2023-12-18T10:26:20.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 >> 172.21.15.133:0/2016536324 conn(0x7f6a74069e70 msgr2=0x7f6a740ab190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:20.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 shutdown_connections 2023-12-18T10:26:20.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.704+0000 7f6a79873640 1 -- 172.21.15.133:0/2016536324 wait complete. 2023-12-18T10:26:20.721 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-18T10:26:20.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e34ba6640 1 Processor -- start 2023-12-18T10:26:20.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e34ba6640 1 -- start start 2023-12-18T10:26:20.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e34ba6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e301570c0 0x7f2e3006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e34ba6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e300ca000 0x7f2e30070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e34ba6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e300c9460 con 0x7f2e3006c320 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e34ba6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3006c7a0 con 0x7f2e300ca000 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e34ba6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e301574a0 con 0x7f2e301570c0 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e300ca000 0x7f2e30070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2dd9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e3006c320 0x7f2e300c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54824/0 (socket says 172.21.15.133:54824) 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2dd9b640 1 -- 172.21.15.133:0/324215830 learned_addr learned my addr 172.21.15.133:0/324215830 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2ed9d640 1 -- 172.21.15.133:0/324215830 >> v2:172.21.15.142:3300/0 conn(0x7f2e301570c0 msgr2=0x7f2e3006bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2e59c640 1 --2- 172.21.15.133:0/324215830 >> v2:172.21.15.142:3300/0 conn(0x7f2e301570c0 0x7f2e3006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2ed9d640 1 --2- 172.21.15.133:0/324215830 >> v2:172.21.15.142:3300/0 conn(0x7f2e301570c0 0x7f2e3006bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2ed9d640 1 -- 172.21.15.133:0/324215830 >> v1:172.21.15.133:6789/0 conn(0x7f2e3006c320 legacy=0x7f2e300c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2ed9d640 1 -- 172.21.15.133:0/324215830 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e300c8b30 con 0x7f2e300ca000 2023-12-18T10:26:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2d59a640 1 -- 172.21.15.133:0/324215830 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290976782 0 0) 0x7f2e300c9460 con 0x7f2e3006c320 2023-12-18T10:26:20.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.860+0000 7f2e2e59c640 1 --2- 172.21.15.133:0/324215830 >> v2:172.21.15.142:3300/0 conn(0x7f2e301570c0 0x7f2e3006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-18T10:26:20.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e2ed9d640 1 --2- 172.21.15.133:0/324215830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e30070df0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f2e3006e280 tx=0x7f2e2801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf50d52f2a77bfaa server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e2d59a640 1 -- 172.21.15.133:0/324215830 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e280a5910 con 0x7f2e300ca000 2023-12-18T10:26:20.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e2d59a640 1 -- 172.21.15.133:0/324215830 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e280a5a70 con 0x7f2e300ca000 2023-12-18T10:26:20.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e2d59a640 1 -- 172.21.15.133:0/324215830 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e280a5e00 con 0x7f2e300ca000 2023-12-18T10:26:20.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e34ba6640 1 -- 172.21.15.133:0/324215830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 msgr2=0x7f2e30070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/324215830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e30070df0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f2e3006e280 tx=0x7f2e2801c850 comp rx=0 tx=0).stop 2023-12-18T10:26:20.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e34ba6640 1 -- 172.21.15.133:0/324215830 shutdown_connections 2023-12-18T10:26:20.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/324215830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e30070df0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/324215830 >> v2:172.21.15.142:3300/0 conn(0x7f2e301570c0 0x7f2e3006bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e34ba6640 1 -- 172.21.15.133:0/324215830 >> 172.21.15.133:0/324215830 conn(0x7f2e3006a3e0 msgr2=0x7f2e300afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:20.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e34ba6640 1 -- 172.21.15.133:0/324215830 shutdown_connections 2023-12-18T10:26:20.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.864+0000 7f2e34ba6640 1 -- 172.21.15.133:0/324215830 wait complete. 2023-12-18T10:26:20.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 Processor -- start 2023-12-18T10:26:20.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 -- start start 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e3006c320 0x7f2e300c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e300acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e301570c0 0x7f2e300c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301f8280 con 0x7f2e300ca000 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301f8560 con 0x7f2e301570c0 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e301f8840 con 0x7f2e3006c320 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e300acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e300acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43254/0 (socket says 172.21.15.133:43254) 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 -- 172.21.15.133:0/4005080487 learned_addr learned my addr 172.21.15.133:0/4005080487 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2e59c640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e3006c320 0x7f2e300c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2ed9d640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e301570c0 0x7f2e300c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 -- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e3006c320 msgr2=0x7f2e300c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e3006c320 0x7f2e300c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 -- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e301570c0 msgr2=0x7f2e300c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e301570c0 0x7f2e300c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 -- 172.21.15.133:0/4005080487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e28009a70 con 0x7f2e300ca000 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2ed9d640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e301570c0 0x7f2e300c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e2dd9b640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e300acc80 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f2e240011f0 tx=0x7f2e2400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e1effd640 1 -- 172.21.15.133:0/4005080487 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240074e0 con 0x7f2e300ca000 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e1effd640 1 -- 172.21.15.133:0/4005080487 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24007640 con 0x7f2e300ca000 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e1effd640 1 -- 172.21.15.133:0/4005080487 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24004a10 con 0x7f2e300ca000 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e301f8b20 con 0x7f2e300ca000 2023-12-18T10:26:20.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e300ad1c0 con 0x7f2e300ca000 2023-12-18T10:26:20.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.868+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e300735b0 con 0x7f2e300ca000 2023-12-18T10:26:20.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.872+0000 7f2e1effd640 1 -- 172.21.15.133:0/4005080487 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2e24004b70 con 0x7f2e300ca000 2023-12-18T10:26:20.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.872+0000 7f2e1effd640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e10065a90 0x7f2e10067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:20.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.872+0000 7f2e1effd640 1 -- 172.21.15.133:0/4005080487 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f2e240820b0 con 0x7f2e300ca000 2023-12-18T10:26:20.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.872+0000 7f2e2e59c640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e10065a90 0x7f2e10067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:20.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.872+0000 7f2e2e59c640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e10065a90 0x7f2e10067f50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2e301f7d70 tx=0x7f2e20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:20.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:20.876+0000 7f2e1effd640 1 -- 172.21.15.133:0/4005080487 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2e2404fcc0 con 0x7f2e300ca000 2023-12-18T10:26:21.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e301f86d0 con 0x7f2e10065a90 2023-12-18T10:26:21.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e1effd640 1 -- 172.21.15.133:0/4005080487 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2e301f86d0 con 0x7f2e10065a90 2023-12-18T10:26:21.025 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 2 to deep-scrub 2023-12-18T10:26:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e10065a90 msgr2=0x7f2e10067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e10065a90 0x7f2e10067f50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2e301f7d70 tx=0x7f2e20008040 comp rx=0 tx=0).stop 2023-12-18T10:26:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 msgr2=0x7f2e300acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e300acc80 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f2e240011f0 tx=0x7f2e2400c9b0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 shutdown_connections 2023-12-18T10:26:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f2e10065a90 0x7f2e10067f50 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e301570c0 0x7f2e300c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e300ca000 0x7f2e300acc80 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 --2- 172.21.15.133:0/4005080487 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2e3006c320 0x7f2e300c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 >> 172.21.15.133:0/4005080487 conn(0x7f2e3006a3e0 msgr2=0x7f2e30158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.024+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 shutdown_connections 2023-12-18T10:26:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.028+0000 7f2e34ba6640 1 -- 172.21.15.133:0/4005080487 wait complete. 2023-12-18T10:26:21.046 INFO:tasks.ceph:Scrubbing osd.3 2023-12-18T10:26:21.046 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-18T10:26:21.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa142af0640 1 Processor -- start 2023-12-18T10:26:21.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa142af0640 1 -- start start 2023-12-18T10:26:21.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa142af0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0d0f60 0x7fa13c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa142af0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c0d0200 con 0x7fa13c0ce6c0 2023-12-18T10:26:21.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa142af0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c15de00 con 0x7fa13c15da20 2023-12-18T10:26:21.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa142af0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0cd850 con 0x7fa13c0d0f60 2023-12-18T10:26:21.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa1412ed640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa13c0ce6c0 0x7fa13c0cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54838/0 (socket says 172.21.15.133:54838) 2023-12-18T10:26:21.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa1412ed640 1 -- 172.21.15.133:0/1596064125 learned_addr learned my addr 172.21.15.133:0/1596064125 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:21.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa1422ef640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0d0f60 0x7fa13c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631393130 0 0) 0x7fa13c0d0200 con 0x7fa13c0ce6c0 2023-12-18T10:26:21.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa128003530 con 0x7fa13c0ce6c0 2023-12-18T10:26:21.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2390472483 0 0) 0x7fa128003530 con 0x7fa13c0ce6c0 2023-12-18T10:26:21.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0d0f60 msgr2=0x7fa13c152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa140aec640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0d0f60 0x7fa13c152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.188+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 >> v1:172.21.15.142:6789/0 conn(0x7fa13c15da20 legacy=0x7fa13c0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c0cd570 con 0x7fa13c0ce6c0 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fa12c001680 con 0x7fa13c0ce6c0 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 >> v1:172.21.15.133:6789/0 conn(0x7fa13c0ce6c0 legacy=0x7fa13c0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa128003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0d0f60 0x7fa1280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128004d10 0x7fa128005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0cd850 con 0x7fa1280039b0 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12800ba40 con 0x7fa128004d10 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12800bc00 con 0x7fa13c0d0f60 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa141aee640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa128003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa1412ed640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0d0f60 0x7fa1280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa1422ef640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128004d10 0x7fa128005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa141aee640 1 -- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0d0f60 msgr2=0x7fa1280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:21.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa141aee640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0d0f60 0x7fa1280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa141aee640 1 -- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128004d10 msgr2=0x7fa128005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:21.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa141aee640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128004d10 0x7fa128005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa141aee640 1 -- 172.21.15.133:0/1596064125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128003530 con 0x7fa1280039b0 2023-12-18T10:26:21.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa1422ef640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa128004d10 0x7fa128005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:21.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa141aee640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa128003d90 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fa138001860 tx=0x7fa13801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbdef5e9667ee4b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380ac640 con 0x7fa1280039b0 2023-12-18T10:26:21.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1380ac7a0 con 0x7fa1280039b0 2023-12-18T10:26:21.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.192+0000 7fa140aec640 1 -- 172.21.15.133:0/1596064125 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380acb50 con 0x7fa1280039b0 2023-12-18T10:26:21.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- 172.21.15.133:0/1596064125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 msgr2=0x7fa128003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 --2- 172.21.15.133:0/1596064125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa128003d90 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fa138001860 tx=0x7fa13801c500 comp rx=0 tx=0).stop 2023-12-18T10:26:21.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa1422ef640 1 -- 172.21.15.133:0/1596064125 reap_dead start 2023-12-18T10:26:21.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- 172.21.15.133:0/1596064125 shutdown_connections 2023-12-18T10:26:21.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- 172.21.15.133:0/1596064125 >> 172.21.15.133:0/1596064125 conn(0x7fa13c069ca0 msgr2=0x7fa13c06a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:21.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- 172.21.15.133:0/1596064125 shutdown_connections 2023-12-18T10:26:21.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- 172.21.15.133:0/1596064125 wait complete. 2023-12-18T10:26:21.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 Processor -- start 2023-12-18T10:26:21.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- start start 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa13c14c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa13c15f770 0x7fa13c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0b0820 0x7fa13c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0d0b40 con 0x7fa1280039b0 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0b0ca0 con 0x7fa13c15f770 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa142af0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c0c6e90 con 0x7fa13c0b0820 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa141aee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa13c14c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa141aee640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa13c14c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43284/0 (socket says 172.21.15.133:43284) 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa141aee640 1 -- 172.21.15.133:0/1888820252 learned_addr learned my addr 172.21.15.133:0/1888820252 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa1412ed640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa13c15f770 0x7fa13c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa1422ef640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0b0820 0x7fa13c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa141aee640 1 -- 172.21.15.133:0/1888820252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0b0820 msgr2=0x7fa13c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa141aee640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0b0820 0x7fa13c15e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa141aee640 1 -- 172.21.15.133:0/1888820252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa13c15f770 msgr2=0x7fa13c0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa141aee640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa13c15f770 0x7fa13c0b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa141aee640 1 -- 172.21.15.133:0/1888820252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c0c6310 con 0x7fa1280039b0 2023-12-18T10:26:21.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa1412ed640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa13c15f770 0x7fa13c0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:21.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.196+0000 7fa1422ef640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa13c0b0820 0x7fa13c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:21.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa141aee640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa13c14c810 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fa13801c330 tx=0x7fa128005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138005070 con 0x7fa1280039b0 2023-12-18T10:26:21.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1380051d0 con 0x7fa1280039b0 2023-12-18T10:26:21.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c0c65f0 con 0x7fa1280039b0 2023-12-18T10:26:21.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380067e0 con 0x7fa1280039b0 2023-12-18T10:26:21.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c0c6bb0 con 0x7fa1280039b0 2023-12-18T10:26:21.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa13c04e000 con 0x7fa1280039b0 2023-12-18T10:26:21.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa1380b3050 con 0x7fa1280039b0 2023-12-18T10:26:21.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa120065a60 0x7fa120067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fa13811db00 con 0x7fa1280039b0 2023-12-18T10:26:21.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7fa12006bea0 0x7fa12006e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1412ed640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa120065a60 0x7fa120067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 --> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa12006e9b0 con 0x7fa12006bea0 2023-12-18T10:26:21.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa13811de70 con 0x7fa1280039b0 2023-12-18T10:26:21.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.200+0000 7fa1422ef640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7fa12006bea0 0x7fa12006e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.204+0000 7fa1412ed640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa120065a60 0x7fa120067f20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa12c001210 tx=0x7fa12c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.204+0000 7fa1422ef640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7fa12006bea0 0x7fa12006e2e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.204+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 <== osd.3 v2:172.21.15.133:6824/38188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa12006e9b0 con 0x7fa12006bea0 2023-12-18T10:26:21.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 --> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa13c0b6360 con 0x7fa12006bea0 2023-12-18T10:26:21.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa1327fc640 1 -- 172.21.15.133:0/1888820252 <== osd.3 v2:172.21.15.133:6824/38188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa13c0b6360 con 0x7fa12006bea0 2023-12-18T10:26:21.216 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:21.217 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-18T10:26:21.217 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:21.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7fa12006bea0 msgr2=0x7fa12006e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6824/38188,v1:172.21.15.133:6825/38188] conn(0x7fa12006bea0 0x7fa12006e2e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa120065a60 msgr2=0x7fa120067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fa120065a60 0x7fa120067f20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa12c001210 tx=0x7fa12c009040 comp rx=0 tx=0).stop 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 msgr2=0x7fa13c14c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 --2- 172.21.15.133:0/1888820252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1280039b0 0x7fa13c14c810 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fa13801c330 tx=0x7fa128005800 comp rx=0 tx=0).stop 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa1422ef640 1 -- 172.21.15.133:0/1888820252 reap_dead start 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 shutdown_connections 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 >> 172.21.15.133:0/1888820252 conn(0x7fa13c069ca0 msgr2=0x7fa13c06adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 shutdown_connections 2023-12-18T10:26:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.216+0000 7fa142af0640 1 -- 172.21.15.133:0/1888820252 wait complete. 2023-12-18T10:26:21.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-18T10:26:21.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.372+0000 7f9b86c1f640 1 Processor -- start 2023-12-18T10:26:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.372+0000 7f9b86c1f640 1 -- start start 2023-12-18T10:26:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.372+0000 7f9b86c1f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b8015a680 0x7f9b8015e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.372+0000 7f9b86c1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8006fdb0 0x7f9b80070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.372+0000 7f9b86c1f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8015f100 con 0x7f9b800cac10 2023-12-18T10:26:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.372+0000 7f9b86c1f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b80070780 con 0x7f9b8015a680 2023-12-18T10:26:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.372+0000 7f9b86c1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800ca7d0 con 0x7f9b8006fdb0 2023-12-18T10:26:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b851bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8006fdb0 0x7f9b80070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b849bb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b8015a680 0x7f9b8015e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b851bc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8006fdb0 0x7f9b80070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:60332/0 (socket says 172.21.15.133:60332) 2023-12-18T10:26:21.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b77fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9b800cac10 0x7f9b8015aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:39612/0 (socket says 172.21.15.133:39612) 2023-12-18T10:26:21.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b851bc640 1 -- 172.21.15.133:0/2449139625 learned_addr learned my addr 172.21.15.133:0/2449139625 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:21.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b851bc640 1 -- 172.21.15.133:0/2449139625 >> v2:172.21.15.142:3300/0 conn(0x7f9b8015a680 msgr2=0x7f9b8015e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:21.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b851bc640 1 --2- 172.21.15.133:0/2449139625 >> v2:172.21.15.142:3300/0 conn(0x7f9b8015a680 0x7f9b8015e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b851bc640 1 -- 172.21.15.133:0/2449139625 >> v1:172.21.15.142:6789/0 conn(0x7f9b800cac10 legacy=0x7f9b8015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b777fe640 1 -- 172.21.15.133:0/2449139625 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381913779 0 0) 0x7f9b8015f100 con 0x7f9b800cac10 2023-12-18T10:26:21.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b851bc640 1 -- 172.21.15.133:0/2449139625 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8015e860 con 0x7f9b8006fdb0 2023-12-18T10:26:21.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b849bb640 1 --2- 172.21.15.133:0/2449139625 >> v2:172.21.15.142:3300/0 conn(0x7f9b8015a680 0x7f9b8015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:21.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b851bc640 1 --2- 172.21.15.133:0/2449139625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8006fdb0 0x7f9b80070240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009e80 tx=0x7f9b7801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310c0ec0d909bc66 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b777fe640 1 -- 172.21.15.133:0/2449139625 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780a5820 con 0x7f9b8006fdb0 2023-12-18T10:26:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b777fe640 1 -- 172.21.15.133:0/2449139625 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b780a5980 con 0x7f9b8006fdb0 2023-12-18T10:26:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.376+0000 7f9b777fe640 1 -- 172.21.15.133:0/2449139625 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780a5d10 con 0x7f9b8006fdb0 2023-12-18T10:26:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- 172.21.15.133:0/2449139625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8006fdb0 msgr2=0x7f9b80070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/2449139625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8006fdb0 0x7f9b80070240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009e80 tx=0x7f9b7801c960 comp rx=0 tx=0).stop 2023-12-18T10:26:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- 172.21.15.133:0/2449139625 shutdown_connections 2023-12-18T10:26:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/2449139625 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8006fdb0 0x7f9b80070240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/2449139625 >> v2:172.21.15.142:3300/0 conn(0x7f9b8015a680 0x7f9b8015e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- 172.21.15.133:0/2449139625 >> 172.21.15.133:0/2449139625 conn(0x7f9b8006a3e0 msgr2=0x7f9b800afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- 172.21.15.133:0/2449139625 shutdown_connections 2023-12-18T10:26:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- 172.21.15.133:0/2449139625 wait complete. 2023-12-18T10:26:21.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 Processor -- start 2023-12-18T10:26:21.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- start start 2023-12-18T10:26:21.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8006fdb0 0x7f9b800ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b800cac10 0x7f9b801636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8015a680 0x7f9b80163c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c36a0 con 0x7f9b8015a680 2023-12-18T10:26:21.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800aee10 con 0x7f9b8006fdb0 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b86c1f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800c2a20 con 0x7f9b800cac10 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.380+0000 7f9b851bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8015a680 0x7f9b80163c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b851bc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8015a680 0x7f9b80163c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43286/0 (socket says 172.21.15.133:43286) 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b851bc640 1 -- 172.21.15.133:0/3553482529 learned_addr learned my addr 172.21.15.133:0/3553482529 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b77fff640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b800cac10 0x7f9b801636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b849bb640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8006fdb0 0x7f9b800ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b851bc640 1 -- 172.21.15.133:0/3553482529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b800cac10 msgr2=0x7f9b801636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b851bc640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b800cac10 0x7f9b801636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b851bc640 1 -- 172.21.15.133:0/3553482529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8006fdb0 msgr2=0x7f9b800ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b851bc640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8006fdb0 0x7f9b800ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b851bc640 1 -- 172.21.15.133:0/3553482529 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c009420 con 0x7f9b8015a680 2023-12-18T10:26:21.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b851bc640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8015a680 0x7f9b80163c00 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009e80 tx=0x7f9b78019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b757fa640 1 -- 172.21.15.133:0/3553482529 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780b8470 con 0x7f9b8015a680 2023-12-18T10:26:21.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b757fa640 1 -- 172.21.15.133:0/3553482529 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b780b85d0 con 0x7f9b8015a680 2023-12-18T10:26:21.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b78009b30 con 0x7f9b8015a680 2023-12-18T10:26:21.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b757fa640 1 -- 172.21.15.133:0/3553482529 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b780b8960 con 0x7f9b8015a680 2023-12-18T10:26:21.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b800c2fe0 con 0x7f9b8015a680 2023-12-18T10:26:21.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b800735b0 con 0x7f9b8015a680 2023-12-18T10:26:21.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b757fa640 1 -- 172.21.15.133:0/3553482529 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b780b8ac0 con 0x7f9b8015a680 2023-12-18T10:26:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.384+0000 7f9b757fa640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.388+0000 7f9b757fa640 1 -- 172.21.15.133:0/3553482529 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f9b7811dbb0 con 0x7f9b8015a680 2023-12-18T10:26:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.388+0000 7f9b849bb640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.388+0000 7f9b849bb640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9b801f8870 tx=0x7f9b7c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.392+0000 7f9b757fa640 1 -- 172.21.15.133:0/3553482529 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b780eb690 con 0x7f9b8015a680 2023-12-18T10:26:21.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.540+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b800c8e10 con 0x7f9b6c065a60 2023-12-18T10:26:21.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.540+0000 7f9b757fa640 1 -- 172.21.15.133:0/3553482529 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9b7c009c50 con 0x7f9b6c065a60 2023-12-18T10:26:21.543 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 3 to deep-scrub 2023-12-18T10:26:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 msgr2=0x7f9b6c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9b801f8870 tx=0x7f9b7c009190 comp rx=0 tx=0).stop 2023-12-18T10:26:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8015a680 msgr2=0x7f9b80163c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8015a680 0x7f9b80163c00 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009e80 tx=0x7f9b78019700 comp rx=0 tx=0).stop 2023-12-18T10:26:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 shutdown_connections 2023-12-18T10:26:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f9b6c065a60 0x7f9b6c067f20 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b8015a680 0x7f9b80163c00 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b800cac10 0x7f9b801636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 --2- 172.21.15.133:0/3553482529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b8006fdb0 0x7f9b800ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 >> 172.21.15.133:0/3553482529 conn(0x7f9b8006a3e0 msgr2=0x7f9b8015aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:21.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 shutdown_connections 2023-12-18T10:26:21.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.544+0000 7f9b86c1f640 1 -- 172.21.15.133:0/3553482529 wait complete. 2023-12-18T10:26:21.564 INFO:tasks.ceph:Scrubbing osd.4 2023-12-18T10:26:21.564 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-18T10:26:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.704+0000 7f6a799ce640 1 Processor -- start 2023-12-18T10:26:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.704+0000 7f6a799ce640 1 -- start start 2023-12-18T10:26:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a799ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7406c530 0x7f6a740ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a799ce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a740ceb10 0x7f6a74144840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a799ce640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7415cdf0 con 0x7f6a74146370 2023-12-18T10:26:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a799ce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a740cefa0 con 0x7f6a740ceb10 2023-12-18T10:26:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a799ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7406ca80 con 0x7f6a7406c530 2023-12-18T10:26:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a72ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6a74146370 0x7f6a740cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54844/0 (socket says 172.21.15.133:54844) 2023-12-18T10:26:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a72ffd640 1 -- 172.21.15.133:0/3712401598 learned_addr learned my addr 172.21.15.133:0/3712401598 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/3712401598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7406c530 0x7f6a740ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a737fe640 1 --2- 172.21.15.133:0/3712401598 >> v2:172.21.15.142:3300/0 conn(0x7f6a740ceb10 0x7f6a74144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a727fc640 1 -- 172.21.15.133:0/3712401598 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453511212 0 0) 0x7f6a7415cdf0 con 0x7f6a74146370 2023-12-18T10:26:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a727fc640 1 -- 172.21.15.133:0/3712401598 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a60003530 con 0x7f6a74146370 2023-12-18T10:26:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a6bfff640 1 -- 172.21.15.133:0/3712401598 >> v2:172.21.15.142:3300/0 conn(0x7f6a740ceb10 msgr2=0x7f6a74144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/3712401598 >> v2:172.21.15.142:3300/0 conn(0x7f6a740ceb10 0x7f6a74144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a6bfff640 1 -- 172.21.15.133:0/3712401598 >> v1:172.21.15.133:6789/0 conn(0x7f6a74146370 legacy=0x7f6a740cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.708+0000 7f6a6bfff640 1 -- 172.21.15.133:0/3712401598 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7406cd60 con 0x7f6a7406c530 2023-12-18T10:26:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/3712401598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7406c530 0x7f6a740ce5d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097c0 tx=0x7f6a5c01c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b3df6c275302f80 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a727fc640 1 -- 172.21.15.133:0/3712401598 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64001680 con 0x7f6a7406c530 2023-12-18T10:26:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a727fc640 1 -- 172.21.15.133:0/3712401598 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c0a7050 con 0x7f6a7406c530 2023-12-18T10:26:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a727fc640 1 -- 172.21.15.133:0/3712401598 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0ab600 con 0x7f6a7406c530 2023-12-18T10:26:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 -- 172.21.15.133:0/3712401598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7406c530 msgr2=0x7f6a740ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 --2- 172.21.15.133:0/3712401598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7406c530 0x7f6a740ce5d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097c0 tx=0x7f6a5c01c2c0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 -- 172.21.15.133:0/3712401598 shutdown_connections 2023-12-18T10:26:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 --2- 172.21.15.133:0/3712401598 >> v2:172.21.15.142:3300/0 conn(0x7f6a740ceb10 0x7f6a74144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 --2- 172.21.15.133:0/3712401598 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a7406c530 0x7f6a740ce5d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 -- 172.21.15.133:0/3712401598 >> 172.21.15.133:0/3712401598 conn(0x7f6a74069e70 msgr2=0x7f6a7406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 -- 172.21.15.133:0/3712401598 shutdown_connections 2023-12-18T10:26:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 -- 172.21.15.133:0/3712401598 wait complete. 2023-12-18T10:26:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 Processor -- start 2023-12-18T10:26:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.712+0000 7f6a799ce640 1 -- start start 2023-12-18T10:26:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a7406c530 0x7f6a7415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ceb10 0x7f6a7415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a74146370 0x7f6a7415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a741539a0 con 0x7f6a7406c530 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7415a8a0 con 0x7f6a74146370 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74153c10 con 0x7f6a740ceb10 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a7406c530 0x7f6a7415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a7406c530 0x7f6a7415d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43288/0 (socket says 172.21.15.133:43288) 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 -- 172.21.15.133:0/1439979681 learned_addr learned my addr 172.21.15.133:0/1439979681 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ceb10 0x7f6a7415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a737fe640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a74146370 0x7f6a7415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 -- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ceb10 msgr2=0x7f6a7415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a740ceb10 0x7f6a7415a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 -- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a74146370 msgr2=0x7f6a7415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a74146370 0x7f6a7415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 -- 172.21.15.133:0/1439979681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5c009420 con 0x7f6a7406c530 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a72ffd640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a7406c530 0x7f6a7415d990 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c7a0 tx=0x7f6a6400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a640074e0 con 0x7f6a7406c530 2023-12-18T10:26:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a64007660 con 0x7f6a7406c530 2023-12-18T10:26:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7406dca0 con 0x7f6a7406c530 2023-12-18T10:26:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a64004a30 con 0x7f6a7406c530 2023-12-18T10:26:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7415c620 con 0x7f6a7406c530 2023-12-18T10:26:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a7406db20 con 0x7f6a7406c530 2023-12-18T10:26:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.716+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a64004b90 con 0x7f6a7406c530 2023-12-18T10:26:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a70ff9640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 0x7f6a54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f6a64082860 con 0x7f6a7406c530 2023-12-18T10:26:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a70ff9640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7f6a5406bea0 0x7f6a5406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 --> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a5406e9b0 con 0x7f6a5406bea0 2023-12-18T10:26:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a640872c0 con 0x7f6a7406c530 2023-12-18T10:26:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 0x7f6a54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a737fe640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7f6a5406bea0 0x7f6a5406e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a6bfff640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 0x7f6a54067f20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0ad000 tx=0x7f6a5c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a737fe640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7f6a5406bea0 0x7f6a5406e2e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.720+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 <== osd.4 v2:172.21.15.142:6800/38344 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6a5406e9b0 con 0x7f6a5406bea0 2023-12-18T10:26:21.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 --> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a7406d600 con 0x7f6a5406bea0 2023-12-18T10:26:21.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a70ff9640 1 -- 172.21.15.133:0/1439979681 <== osd.4 v2:172.21.15.142:6800/38344 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6a6c00f040 con 0x7f6a5406bea0 2023-12-18T10:26:21.737 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:21.737 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-18T10:26:21.737 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7f6a5406bea0 msgr2=0x7f6a5406e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.142:6800/38344,v1:172.21.15.142:6801/38344] conn(0x7f6a5406bea0 0x7f6a5406e2e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 msgr2=0x7f6a54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f6a54065a60 0x7f6a54067f20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0ad000 tx=0x7f6a5c0a6000 comp rx=0 tx=0).stop 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a7406c530 msgr2=0x7f6a7415d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 --2- 172.21.15.133:0/1439979681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a7406c530 0x7f6a7415d990 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400c7a0 tx=0x7f6a6400cc60 comp rx=0 tx=0).stop 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a737fe640 1 -- 172.21.15.133:0/1439979681 reap_dead start 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 shutdown_connections 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 >> 172.21.15.133:0/1439979681 conn(0x7f6a74069e70 msgr2=0x7f6a7406fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.732+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 shutdown_connections 2023-12-18T10:26:21.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.736+0000 7f6a799ce640 1 -- 172.21.15.133:0/1439979681 wait complete. 2023-12-18T10:26:21.753 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-18T10:26:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d45752640 1 Processor -- start 2023-12-18T10:26:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d45752640 1 -- start start 2023-12-18T10:26:21.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d45752640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0d400ce2c0 0x7f0d400ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d45752640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d40160e80 con 0x7f0d400ce750 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d45752640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d40161160 con 0x7f0d4015ceb0 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d45752640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d40161440 con 0x7f0d400ce2c0 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d3e7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0d400ce2c0 0x7f0d400ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d3e7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0d400ce2c0 0x7f0d400ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43292/0 (socket says 172.21.15.133:43292) 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d3e7fc640 1 -- 172.21.15.133:0/2682867509 learned_addr learned my addr 172.21.15.133:0/2682867509 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d3f7fe640 1 --1- 172.21.15.133:0/2682867509 >> v1:172.21.15.133:6789/0 conn(0x7f0d400ce750 0x7f0d4015d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54846/0 (socket says 172.21.15.133:54846) 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d3e7fc640 1 -- 172.21.15.133:0/2682867509 >> v1:172.21.15.142:6789/0 conn(0x7f0d4015ceb0 legacy=0x7f0d4006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d3e7fc640 1 -- 172.21.15.133:0/2682867509 >> v1:172.21.15.133:6789/0 conn(0x7f0d400ce750 legacy=0x7f0d4015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d3e7fc640 1 -- 172.21.15.133:0/2682867509 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40161720 con 0x7f0d400ce2c0 2023-12-18T10:26:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.892+0000 7f0d3dffb640 1 -- 172.21.15.133:0/2682867509 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214014877 0 0) 0x7f0d40160e80 con 0x7f0d400ce750 2023-12-18T10:26:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d3e7fc640 1 --2- 172.21.15.133:0/2682867509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce2c0 0x7f0d400ceb90 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009870 tx=0x7f0d2801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d763b022c5f6408b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d3dffb640 1 -- 172.21.15.133:0/2682867509 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280ab650 con 0x7f0d400ce2c0 2023-12-18T10:26:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d3dffb640 1 -- 172.21.15.133:0/2682867509 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4015d4a0 con 0x7f0d400ce2c0 2023-12-18T10:26:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d3dffb640 1 -- 172.21.15.133:0/2682867509 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280ab9d0 con 0x7f0d400ce2c0 2023-12-18T10:26:21.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d45752640 1 -- 172.21.15.133:0/2682867509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce2c0 msgr2=0x7f0d400ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d45752640 1 --2- 172.21.15.133:0/2682867509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce2c0 0x7f0d400ceb90 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009870 tx=0x7f0d2801c540 comp rx=0 tx=0).stop 2023-12-18T10:26:21.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d45752640 1 -- 172.21.15.133:0/2682867509 shutdown_connections 2023-12-18T10:26:21.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d45752640 1 --2- 172.21.15.133:0/2682867509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce2c0 0x7f0d400ceb90 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d45752640 1 -- 172.21.15.133:0/2682867509 >> 172.21.15.133:0/2682867509 conn(0x7f0d40069ca0 msgr2=0x7f0d4006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:21.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d45752640 1 -- 172.21.15.133:0/2682867509 shutdown_connections 2023-12-18T10:26:21.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.896+0000 7f0d45752640 1 -- 172.21.15.133:0/2682867509 wait complete. 2023-12-18T10:26:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 Processor -- start 2023-12-18T10:26:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 -- start start 2023-12-18T10:26:21.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d400ce2c0 0x7f0d400c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce750 0x7f0d400c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4015ceb0 0x7f0d401f9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400c6da0 con 0x7f0d400ce750 2023-12-18T10:26:21.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401fa0f0 con 0x7f0d4015ceb0 2023-12-18T10:26:21.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4014d440 con 0x7f0d400ce2c0 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce750 0x7f0d400c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce750 0x7f0d400c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43298/0 (socket says 172.21.15.133:43298) 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 -- 172.21.15.133:0/4222074619 learned_addr learned my addr 172.21.15.133:0/4222074619 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3effd640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d400ce2c0 0x7f0d400c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3f7fe640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4015ceb0 0x7f0d401f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 -- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d400ce2c0 msgr2=0x7f0d400c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d400ce2c0 0x7f0d400c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 -- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4015ceb0 msgr2=0x7f0d401f9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4015ceb0 0x7f0d401f9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 -- 172.21.15.133:0/4222074619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d280094d0 con 0x7f0d400ce750 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3f7fe640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4015ceb0 0x7f0d401f9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:21.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d3e7fc640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce750 0x7f0d400c6860 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009870 tx=0x7f0d2801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d377fe640 1 -- 172.21.15.133:0/4222074619 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280abd70 con 0x7f0d400ce750 2023-12-18T10:26:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d377fe640 1 -- 172.21.15.133:0/4222074619 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d280b8070 con 0x7f0d400ce750 2023-12-18T10:26:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d377fe640 1 -- 172.21.15.133:0/4222074619 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28004230 con 0x7f0d400ce750 2023-12-18T10:26:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d400c77b0 con 0x7f0d400ce750 2023-12-18T10:26:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4014d0d0 con 0x7f0d400ce750 2023-12-18T10:26:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.900+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4014d5d0 con 0x7f0d400ce750 2023-12-18T10:26:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.904+0000 7f0d377fe640 1 -- 172.21.15.133:0/4222074619 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d28004390 con 0x7f0d400ce750 2023-12-18T10:26:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.904+0000 7f0d377fe640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d20065a90 0x7f0d20067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.904+0000 7f0d377fe640 1 -- 172.21.15.133:0/4222074619 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f0d2811d620 con 0x7f0d400ce750 2023-12-18T10:26:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.904+0000 7f0d3effd640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d20065a90 0x7f0d20067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.904+0000 7f0d3effd640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d20065a90 0x7f0d20067f50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0d4014e2d0 tx=0x7f0d30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:21.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:21.908+0000 7f0d377fe640 1 -- 172.21.15.133:0/4222074619 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0d280eb0e0 con 0x7f0d400ce750 2023-12-18T10:26:22.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.056+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d400cf4e0 con 0x7f0d20065a90 2023-12-18T10:26:22.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.056+0000 7f0d377fe640 1 -- 172.21.15.133:0/4222074619 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0d30001470 con 0x7f0d20065a90 2023-12-18T10:26:22.058 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 4 to deep-scrub 2023-12-18T10:26:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d20065a90 msgr2=0x7f0d20067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d20065a90 0x7f0d20067f50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0d4014e2d0 tx=0x7f0d30009040 comp rx=0 tx=0).stop 2023-12-18T10:26:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce750 msgr2=0x7f0d400c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce750 0x7f0d400c6860 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f0d28009870 tx=0x7f0d2801ad80 comp rx=0 tx=0).stop 2023-12-18T10:26:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 shutdown_connections 2023-12-18T10:26:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0d20065a90 0x7f0d20067f50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d4015ceb0 0x7f0d401f9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d400ce750 0x7f0d400c6860 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 --2- 172.21.15.133:0/4222074619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d400ce2c0 0x7f0d400c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 >> 172.21.15.133:0/4222074619 conn(0x7f0d40069ca0 msgr2=0x7f0d4006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 shutdown_connections 2023-12-18T10:26:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.060+0000 7f0d45752640 1 -- 172.21.15.133:0/4222074619 wait complete. 2023-12-18T10:26:22.080 INFO:tasks.ceph:Scrubbing osd.5 2023-12-18T10:26:22.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-18T10:26:22.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.220+0000 7fef4da12640 1 Processor -- start 2023-12-18T10:26:22.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.220+0000 7fef4da12640 1 -- start start 2023-12-18T10:26:22.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef4da12640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 0x7fef480d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef4da12640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef480d12b0 0x7fef4806bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef4da12640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef480af360 con 0x7fef4815cab0 2023-12-18T10:26:22.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef4da12640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef480d1740 con 0x7fef480d12b0 2023-12-18T10:26:22.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef4da12640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef480ce6b0 con 0x7fef480d07c0 2023-12-18T10:26:22.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef477fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef480d12b0 0x7fef4806bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef477fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef480d12b0 0x7fef4806bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43302/0 (socket says 172.21.15.133:43302) 2023-12-18T10:26:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef477fe640 1 -- 172.21.15.133:0/4150264760 learned_addr learned my addr 172.21.15.133:0/4150264760 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef3ffff640 1 --2- 172.21.15.133:0/4150264760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 0x7fef480d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef477fe640 1 -- 172.21.15.133:0/4150264760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 msgr2=0x7fef480d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef477fe640 1 --2- 172.21.15.133:0/4150264760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 0x7fef480d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef477fe640 1 -- 172.21.15.133:0/4150264760 >> v1:172.21.15.142:6789/0 conn(0x7fef4815cab0 legacy=0x7fef480cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.224+0000 7fef477fe640 1 -- 172.21.15.133:0/4150264760 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4806ae90 con 0x7fef480d12b0 2023-12-18T10:26:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef477fe640 1 --2- 172.21.15.133:0/4150264760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 0x7fef4806bc50 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fef40009e50 tx=0x7fef4001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e860b2132716f2fd server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef467fc640 1 -- 172.21.15.133:0/4150264760 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400a5740 con 0x7fef480d12b0 2023-12-18T10:26:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef467fc640 1 -- 172.21.15.133:0/4150264760 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef400a58a0 con 0x7fef480d12b0 2023-12-18T10:26:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef467fc640 1 -- 172.21.15.133:0/4150264760 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400a5c30 con 0x7fef480d12b0 2023-12-18T10:26:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 -- 172.21.15.133:0/4150264760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 msgr2=0x7fef4806bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 --2- 172.21.15.133:0/4150264760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 0x7fef4806bc50 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fef40009e50 tx=0x7fef4001c9d0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 -- 172.21.15.133:0/4150264760 shutdown_connections 2023-12-18T10:26:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 --2- 172.21.15.133:0/4150264760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 0x7fef4806bc50 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 --2- 172.21.15.133:0/4150264760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 0x7fef480d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 -- 172.21.15.133:0/4150264760 >> 172.21.15.133:0/4150264760 conn(0x7fef48089fb0 msgr2=0x7fef480d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 -- 172.21.15.133:0/4150264760 shutdown_connections 2023-12-18T10:26:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 -- 172.21.15.133:0/4150264760 wait complete. 2023-12-18T10:26:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 Processor -- start 2023-12-18T10:26:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.228+0000 7fef4da12640 1 -- start start 2023-12-18T10:26:22.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 0x7fef48152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 0x7fef481509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef4815cab0 0x7fef480c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef481551e0 con 0x7fef480d12b0 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48154f00 con 0x7fef4815cab0 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef480c6410 con 0x7fef480d07c0 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 0x7fef481509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef46ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 0x7fef48152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 0x7fef481509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43306/0 (socket says 172.21.15.133:43306) 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 -- 172.21.15.133:0/1804771928 learned_addr learned my addr 172.21.15.133:0/1804771928 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef477fe640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef4815cab0 0x7fef480c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 -- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 msgr2=0x7fef48152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fef480d07c0 0x7fef48152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 -- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef4815cab0 msgr2=0x7fef480c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef4815cab0 0x7fef480c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 -- 172.21.15.133:0/1804771928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40009b30 con 0x7fef480d12b0 2023-12-18T10:26:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef3ffff640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 0x7fef481509b0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fef3000d5f0 tx=0x7fef3000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300125f0 con 0x7fef480d12b0 2023-12-18T10:26:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30012750 con 0x7fef480d12b0 2023-12-18T10:26:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef480c66f0 con 0x7fef480d12b0 2023-12-18T10:26:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30012ae0 con 0x7fef480d12b0 2023-12-18T10:26:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef48154b40 con 0x7fef480d12b0 2023-12-18T10:26:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef4806b730 con 0x7fef480d12b0 2023-12-18T10:26:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.232+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fef30012c40 con 0x7fef480d12b0 2023-12-18T10:26:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef44ff9640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fef28065a60 0x7fef28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fef30083400 con 0x7fef480d12b0 2023-12-18T10:26:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef46ffd640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fef28065a60 0x7fef28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef44ff9640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7fef2806bea0 0x7fef2806e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 --> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef2806e9b0 con 0x7fef2806bea0 2023-12-18T10:26:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef300859e0 con 0x7fef480d12b0 2023-12-18T10:26:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef477fe640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7fef2806bea0 0x7fef2806e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef46ffd640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fef28065a60 0x7fef28067f20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fef38007fd0 tx=0x7fef38007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef477fe640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7fef2806bea0 0x7fef2806e2e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.236+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 <== osd.5 v2:172.21.15.142:6808/38345 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fef2806e9b0 con 0x7fef2806bea0 2023-12-18T10:26:22.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.248+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 --> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef480c6ba0 con 0x7fef2806bea0 2023-12-18T10:26:22.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.248+0000 7fef44ff9640 1 -- 172.21.15.133:0/1804771928 <== osd.5 v2:172.21.15.142:6808/38345 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fef400090d0 con 0x7fef2806bea0 2023-12-18T10:26:22.250 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:22.251 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-18T10:26:22.251 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:22.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.248+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7fef2806bea0 msgr2=0x7fef2806e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.248+0000 7fef4da12640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.142:6808/38345,v1:172.21.15.142:6809/38345] conn(0x7fef2806bea0 0x7fef2806e2e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fef28065a60 msgr2=0x7fef28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef4da12640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fef28065a60 0x7fef28067f20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fef38007fd0 tx=0x7fef38007e40 comp rx=0 tx=0).stop 2023-12-18T10:26:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 msgr2=0x7fef481509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef4da12640 1 --2- 172.21.15.133:0/1804771928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef480d12b0 0x7fef481509b0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fef3000d5f0 tx=0x7fef3000dab0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef477fe640 1 -- 172.21.15.133:0/1804771928 reap_dead start 2023-12-18T10:26:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 shutdown_connections 2023-12-18T10:26:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 >> 172.21.15.133:0/1804771928 conn(0x7fef48089fb0 msgr2=0x7fef480b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 shutdown_connections 2023-12-18T10:26:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.252+0000 7fef4da12640 1 -- 172.21.15.133:0/1804771928 wait complete. 2023-12-18T10:26:22.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-18T10:26:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0ee17a2640 1 Processor -- start 2023-12-18T10:26:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0ee17a2640 1 -- start start 2023-12-18T10:26:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0ee17a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1599c0 0x7f0edc0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0ee17a2640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc0b34c0 con 0x7f0edc153c50 2023-12-18T10:26:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0ee17a2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc06d030 con 0x7f0edc06eb10 2023-12-18T10:26:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0ee17a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0b30f0 con 0x7f0edc1599c0 2023-12-18T10:26:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0edbfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0edc153c50 0x7f0edc15d000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54862/0 (socket says 172.21.15.133:54862) 2023-12-18T10:26:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0edbfff640 1 -- 172.21.15.133:0/1853157824 learned_addr learned my addr 172.21.15.133:0/1853157824 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.408+0000 7f0edb7fe640 1 --2- 172.21.15.133:0/1853157824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1599c0 0x7f0edc0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edaffd640 1 -- 172.21.15.133:0/1853157824 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769405902 0 0) 0x7f0edc0b34c0 con 0x7f0edc153c50 2023-12-18T10:26:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edaffd640 1 -- 172.21.15.133:0/1853157824 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4005740 con 0x7f0edc153c50 2023-12-18T10:26:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edb7fe640 1 -- 172.21.15.133:0/1853157824 >> v1:172.21.15.142:6789/0 conn(0x7f0edc06eb10 legacy=0x7f0edc0b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edb7fe640 1 -- 172.21.15.133:0/1853157824 >> v1:172.21.15.133:6789/0 conn(0x7f0edc153c50 legacy=0x7f0edc15d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edaffd640 1 -- 172.21.15.133:0/1853157824 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4130505411 0 0) 0x7f0ec4005740 con 0x7f0edc153c50 2023-12-18T10:26:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edb7fe640 1 -- 172.21.15.133:0/1853157824 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc159f40 con 0x7f0edc1599c0 2023-12-18T10:26:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edb7fe640 1 --2- 172.21.15.133:0/1853157824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1599c0 0x7f0edc0b2bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00097f0 tx=0x7f0ed001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3868c7b9ec7ea6ed server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edaffd640 1 -- 172.21.15.133:0/1853157824 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc001680 con 0x7f0edc1599c0 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edaffd640 1 -- 172.21.15.133:0/1853157824 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed00a7050 con 0x7f0edc1599c0 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.412+0000 7f0edaffd640 1 -- 172.21.15.133:0/1853157824 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00ab600 con 0x7f0edc1599c0 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- 172.21.15.133:0/1853157824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1599c0 msgr2=0x7f0edc0b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 --2- 172.21.15.133:0/1853157824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1599c0 0x7f0edc0b2bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00097f0 tx=0x7f0ed001c3e0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- 172.21.15.133:0/1853157824 shutdown_connections 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 --2- 172.21.15.133:0/1853157824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc1599c0 0x7f0edc0b2bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- 172.21.15.133:0/1853157824 >> 172.21.15.133:0/1853157824 conn(0x7f0edc0b0ea0 msgr2=0x7f0edc0b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- 172.21.15.133:0/1853157824 shutdown_connections 2023-12-18T10:26:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- 172.21.15.133:0/1853157824 wait complete. 2023-12-18T10:26:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 Processor -- start 2023-12-18T10:26:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- start start 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc06eb10 0x7f0edc150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc153c50 0x7f0edc155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0edc1599c0 0x7f0edc143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc155970 con 0x7f0edc1599c0 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc144230 con 0x7f0edc153c50 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee17a2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc155b80 con 0x7f0edc06eb10 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee0fa1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0edc1599c0 0x7f0edc143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee0fa1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0edc1599c0 0x7f0edc143cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43320/0 (socket says 172.21.15.133:43320) 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee0fa1640 1 -- 172.21.15.133:0/3828802696 learned_addr learned my addr 172.21.15.133:0/3828802696 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0edbfff640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc06eb10 0x7f0edc150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0edb7fe640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc153c50 0x7f0edc155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee0fa1640 1 -- 172.21.15.133:0/3828802696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc06eb10 msgr2=0x7f0edc150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee0fa1640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc06eb10 0x7f0edc150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee0fa1640 1 -- 172.21.15.133:0/3828802696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc153c50 msgr2=0x7f0edc155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee0fa1640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc153c50 0x7f0edc155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.416+0000 7f0ee0fa1640 1 -- 172.21.15.133:0/3828802696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0009420 con 0x7f0edc1599c0 2023-12-18T10:26:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ee0fa1640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0edc1599c0 0x7f0edc143cf0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c730 tx=0x7f0ed400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ed8ff9640 1 -- 172.21.15.133:0/3828802696 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4003b80 con 0x7f0edc1599c0 2023-12-18T10:26:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ed8ff9640 1 -- 172.21.15.133:0/3828802696 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed4003ce0 con 0x7f0edc1599c0 2023-12-18T10:26:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ed8ff9640 1 -- 172.21.15.133:0/3828802696 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400aa30 con 0x7f0edc1599c0 2023-12-18T10:26:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0edc155e60 con 0x7f0edc1599c0 2023-12-18T10:26:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc156420 con 0x7f0edc1599c0 2023-12-18T10:26:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0edc04e850 con 0x7f0edc1599c0 2023-12-18T10:26:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ed8ff9640 1 -- 172.21.15.133:0/3828802696 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0ed400ab90 con 0x7f0edc1599c0 2023-12-18T10:26:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ed8ff9640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ec8065a60 0x7f0ec8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0ed8ff9640 1 -- 172.21.15.133:0/3828802696 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f0ed4082ec0 con 0x7f0edc1599c0 2023-12-18T10:26:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0edbfff640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ec8065a60 0x7f0ec8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.420+0000 7f0edbfff640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ec8065a60 0x7f0ec8067f20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0011f0 tx=0x7f0ecc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.424+0000 7f0ed8ff9640 1 -- 172.21.15.133:0/3828802696 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0ed40508f0 con 0x7f0edc1599c0 2023-12-18T10:26:22.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.572+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0edc15a7e0 con 0x7f0ec8065a60 2023-12-18T10:26:22.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ed8ff9640 1 -- 172.21.15.133:0/3828802696 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0ecc0058e0 con 0x7f0ec8065a60 2023-12-18T10:26:22.575 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 5 to deep-scrub 2023-12-18T10:26:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ec8065a60 msgr2=0x7f0ec8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ec8065a60 0x7f0ec8067f20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0011f0 tx=0x7f0ecc009040 comp rx=0 tx=0).stop 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0edc1599c0 msgr2=0x7f0edc143cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0edc1599c0 0x7f0edc143cf0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c730 tx=0x7f0ed400cbf0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 shutdown_connections 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0ec8065a60 0x7f0ec8067f20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0edc1599c0 0x7f0edc143cf0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0edc153c50 0x7f0edc155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 --2- 172.21.15.133:0/3828802696 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0edc06eb10 0x7f0edc150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 >> 172.21.15.133:0/3828802696 conn(0x7f0edc0b0ea0 msgr2=0x7f0edc0b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 shutdown_connections 2023-12-18T10:26:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.576+0000 7f0ee17a2640 1 -- 172.21.15.133:0/3828802696 wait complete. 2023-12-18T10:26:22.597 INFO:tasks.ceph:Scrubbing osd.6 2023-12-18T10:26:22.597 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-18T10:26:22.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91ea18f640 1 Processor -- start 2023-12-18T10:26:22.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91ea18f640 1 -- start start 2023-12-18T10:26:22.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91ea18f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91e40cb480 0x7f91e40b2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91ea18f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91e40b2da0 0x7f91e415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91ea18f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e406bf30 con 0x7f91e40719b0 2023-12-18T10:26:22.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91ea18f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e406cbb0 con 0x7f91e40b2da0 2023-12-18T10:26:22.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91ea18f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40cd2a0 con 0x7f91e40cb480 2023-12-18T10:26:22.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e37fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f91e40719b0 0x7f91e40cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54872/0 (socket says 172.21.15.133:54872) 2023-12-18T10:26:22.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e37fe640 1 -- 172.21.15.133:0/532498742 learned_addr learned my addr 172.21.15.133:0/532498742 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:22.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e3fff640 1 --2- 172.21.15.133:0/532498742 >> v2:172.21.15.133:3300/0 conn(0x7f91e40b2da0 0x7f91e415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e2ffd640 1 --2- 172.21.15.133:0/532498742 >> v2:172.21.15.142:3300/0 conn(0x7f91e40cb480 0x7f91e40b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e27fc640 1 -- 172.21.15.133:0/532498742 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613449970 0 0) 0x7f91e406bf30 con 0x7f91e40719b0 2023-12-18T10:26:22.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e27fc640 1 -- 172.21.15.133:0/532498742 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91cc003530 con 0x7f91e40719b0 2023-12-18T10:26:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e3fff640 1 -- 172.21.15.133:0/532498742 >> v2:172.21.15.142:3300/0 conn(0x7f91e40cb480 msgr2=0x7f91e40b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e3fff640 1 --2- 172.21.15.133:0/532498742 >> v2:172.21.15.142:3300/0 conn(0x7f91e40cb480 0x7f91e40b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e3fff640 1 -- 172.21.15.133:0/532498742 >> v1:172.21.15.133:6789/0 conn(0x7f91e40719b0 legacy=0x7f91e40cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.740+0000 7f91e3fff640 1 -- 172.21.15.133:0/532498742 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40b2200 con 0x7f91e40b2da0 2023-12-18T10:26:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91e3fff640 1 --2- 172.21.15.133:0/532498742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 0x7f91e415b9b0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f91e40cbbb0 tx=0x7f91dc01da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a4ece6f2e9025a server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91e27fc640 1 -- 172.21.15.133:0/532498742 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0a6950 con 0x7f91e40b2da0 2023-12-18T10:26:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91e27fc640 1 -- 172.21.15.133:0/532498742 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc0a6ab0 con 0x7f91e40b2da0 2023-12-18T10:26:22.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91e27fc640 1 -- 172.21.15.133:0/532498742 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0a6e40 con 0x7f91e40b2da0 2023-12-18T10:26:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91ea18f640 1 -- 172.21.15.133:0/532498742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 msgr2=0x7f91e415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91ea18f640 1 --2- 172.21.15.133:0/532498742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 0x7f91e415b9b0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f91e40cbbb0 tx=0x7f91dc01da20 comp rx=0 tx=0).stop 2023-12-18T10:26:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91ea18f640 1 -- 172.21.15.133:0/532498742 shutdown_connections 2023-12-18T10:26:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91ea18f640 1 --2- 172.21.15.133:0/532498742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 0x7f91e415b9b0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91ea18f640 1 --2- 172.21.15.133:0/532498742 >> v2:172.21.15.142:3300/0 conn(0x7f91e40cb480 0x7f91e40b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91ea18f640 1 -- 172.21.15.133:0/532498742 >> 172.21.15.133:0/532498742 conn(0x7f91e4069e70 msgr2=0x7f91e406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91ea18f640 1 -- 172.21.15.133:0/532498742 shutdown_connections 2023-12-18T10:26:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.744+0000 7f91ea18f640 1 -- 172.21.15.133:0/532498742 wait complete. 2023-12-18T10:26:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 Processor -- start 2023-12-18T10:26:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 -- start start 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e40719b0 0x7f91e4159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 0x7f91e415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e40cb480 0x7f91e41592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e415c800 con 0x7f91e40b2da0 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e415caa0 con 0x7f91e40719b0 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e415cd80 con 0x7f91e40cb480 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 0x7f91e415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 0x7f91e415c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43340/0 (socket says 172.21.15.133:43340) 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 -- 172.21.15.133:0/13205372 learned_addr learned my addr 172.21.15.133:0/13205372 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e37fe640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e40719b0 0x7f91e4159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e3fff640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e40cb480 0x7f91e41592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 -- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e40cb480 msgr2=0x7f91e41592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91e40cb480 0x7f91e41592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 -- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e40719b0 msgr2=0x7f91e4159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91e40719b0 0x7f91e4159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 -- 172.21.15.133:0/13205372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc009a70 con 0x7f91e40b2da0 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91e2ffd640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 0x7f91e415c2c0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f91d800d5f0 tx=0x7f91d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d80125f0 con 0x7f91e40b2da0 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8012750 con 0x7f91e40b2da0 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8012ae0 con 0x7f91e40b2da0 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e40c1f50 con 0x7f91e40b2da0 2023-12-18T10:26:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e40c2510 con 0x7f91e40b2da0 2023-12-18T10:26:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.748+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91e4071d90 con 0x7f91e40b2da0 2023-12-18T10:26:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f91d8012c40 con 0x7f91e40b2da0 2023-12-18T10:26:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91cbfff640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f91d0065a60 0x7f91d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f91d80834f0 con 0x7f91e40b2da0 2023-12-18T10:26:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91e37fe640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f91d0065a60 0x7f91d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91cbfff640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7f91d006bea0 0x7f91d006e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91d006e9b0 con 0x7f91d006bea0 2023-12-18T10:26:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91d8085bb0 con 0x7f91e40b2da0 2023-12-18T10:26:22.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91e37fe640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f91d0065a60 0x7f91d0067f20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f91d40011f0 tx=0x7f91d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91e3fff640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7f91d006bea0 0x7f91d006e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91e3fff640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7f91d006bea0 0x7f91d006e2e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.752+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 <== osd.6 v2:172.21.15.142:6824/38346 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f91d006e9b0 con 0x7f91d006bea0 2023-12-18T10:26:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 --> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f91e406c7d0 con 0x7f91d006bea0 2023-12-18T10:26:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91cbfff640 1 -- 172.21.15.133:0/13205372 <== osd.6 v2:172.21.15.142:6824/38346 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f91dc0a6750 con 0x7f91d006bea0 2023-12-18T10:26:22.769 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:22.770 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-18T10:26:22.770 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7f91d006bea0 msgr2=0x7f91d006e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.142:6824/38346,v1:172.21.15.142:6825/38346] conn(0x7f91d006bea0 0x7f91d006e2e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f91d0065a60 msgr2=0x7f91d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f91d0065a60 0x7f91d0067f20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f91d40011f0 tx=0x7f91d4009040 comp rx=0 tx=0).stop 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 msgr2=0x7f91e415c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 --2- 172.21.15.133:0/13205372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e40b2da0 0x7f91e415c2c0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f91d800d5f0 tx=0x7f91d800dab0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91e3fff640 1 -- 172.21.15.133:0/13205372 reap_dead start 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 shutdown_connections 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 >> 172.21.15.133:0/13205372 conn(0x7f91e4069e70 msgr2=0x7f91e415fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 shutdown_connections 2023-12-18T10:26:22.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.768+0000 7f91ea18f640 1 -- 172.21.15.133:0/13205372 wait complete. 2023-12-18T10:26:22.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-18T10:26:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8c04c4640 1 Processor -- start 2023-12-18T10:26:22.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8c04c4640 1 -- start start 2023-12-18T10:26:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8c04c4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8b80cf0d0 0x7ff8b80cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8c04c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b80cfa70 con 0x7ff8b815ca40 2023-12-18T10:26:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8c04c4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b80d11c0 con 0x7ff8b81648d0 2023-12-18T10:26:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8c04c4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b80d0310 con 0x7ff8b80cf0d0 2023-12-18T10:26:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8bda5f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8b80cf0d0 0x7ff8b80cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8bda5f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8b80cf0d0 0x7ff8b80cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43346/0 (socket says 172.21.15.133:43346) 2023-12-18T10:26:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8bda5f640 1 -- 172.21.15.133:0/4166824956 learned_addr learned my addr 172.21.15.133:0/4166824956 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:22.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8bda5f640 1 -- 172.21.15.133:0/4166824956 >> v1:172.21.15.142:6789/0 conn(0x7ff8b81648d0 legacy=0x7ff8b8166cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8bda5f640 1 -- 172.21.15.133:0/4166824956 >> v1:172.21.15.133:6789/0 conn(0x7ff8b815ca40 legacy=0x7ff8b80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.924+0000 7ff8bda5f640 1 -- 172.21.15.133:0/4166824956 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b80d05b0 con 0x7ff8b80cf0d0 2023-12-18T10:26:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8bda5f640 1 --2- 172.21.15.133:0/4166824956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b80cf0d0 0x7ff8b80cf530 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8006fd0 tx=0x7ff8a801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbf0c02a86221b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8bd25e640 1 -- 172.21.15.133:0/4166824956 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80aa610 con 0x7ff8b80cf0d0 2023-12-18T10:26:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8bd25e640 1 -- 172.21.15.133:0/4166824956 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80a6040 con 0x7ff8b80cf0d0 2023-12-18T10:26:22.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8bd25e640 1 -- 172.21.15.133:0/4166824956 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80aa990 con 0x7ff8b80cf0d0 2023-12-18T10:26:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8c04c4640 1 -- 172.21.15.133:0/4166824956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b80cf0d0 msgr2=0x7ff8b80cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8c04c4640 1 --2- 172.21.15.133:0/4166824956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b80cf0d0 0x7ff8b80cf530 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8006fd0 tx=0x7ff8a801c4b0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8c04c4640 1 -- 172.21.15.133:0/4166824956 shutdown_connections 2023-12-18T10:26:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8c04c4640 1 --2- 172.21.15.133:0/4166824956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b80cf0d0 0x7ff8b80cf530 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8c04c4640 1 -- 172.21.15.133:0/4166824956 >> 172.21.15.133:0/4166824956 conn(0x7ff8b8089fb0 msgr2=0x7ff8b80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:22.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8c04c4640 1 -- 172.21.15.133:0/4166824956 shutdown_connections 2023-12-18T10:26:22.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.928+0000 7ff8c04c4640 1 -- 172.21.15.133:0/4166824956 wait complete. 2023-12-18T10:26:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 Processor -- start 2023-12-18T10:26:22.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 -- start start 2023-12-18T10:26:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80cf0d0 0x7ff8b814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b815ca40 0x7ff8b815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b81648d0 0x7ff8b80c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b814b9e0 con 0x7ff8b81648d0 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80c67b0 con 0x7ff8b80cf0d0 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80c6a90 con 0x7ff8b815ca40 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b81648d0 0x7ff8b80c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b81648d0 0x7ff8b80c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43356/0 (socket says 172.21.15.133:43356) 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 -- 172.21.15.133:0/3428876423 learned_addr learned my addr 172.21.15.133:0/3428876423 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bda5f640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b815ca40 0x7ff8b815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8be260640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80cf0d0 0x7ff8b814b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 -- 172.21.15.133:0/3428876423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b815ca40 msgr2=0x7ff8b815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b815ca40 0x7ff8b815bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 -- 172.21.15.133:0/3428876423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80cf0d0 msgr2=0x7ff8b814b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80cf0d0 0x7ff8b814b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 -- 172.21.15.133:0/3428876423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8009480 con 0x7ff8b81648d0 2023-12-18T10:26:22.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8bea61640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b81648d0 0x7ff8b80c8890 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000b9e0 tx=0x7ff8b000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8aeffd640 1 -- 172.21.15.133:0/3428876423 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000ca40 con 0x7ff8b81648d0 2023-12-18T10:26:22.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8aeffd640 1 -- 172.21.15.133:0/3428876423 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b000cba0 con 0x7ff8b81648d0 2023-12-18T10:26:22.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b80c6d70 con 0x7ff8b81648d0 2023-12-18T10:26:22.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8aeffd640 1 -- 172.21.15.133:0/3428876423 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0014440 con 0x7ff8b81648d0 2023-12-18T10:26:22.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.932+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b80c73c0 con 0x7ff8b81648d0 2023-12-18T10:26:22.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.936+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b80b2a00 con 0x7ff8b81648d0 2023-12-18T10:26:22.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.936+0000 7ff8aeffd640 1 -- 172.21.15.133:0/3428876423 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8b001d3b0 con 0x7ff8b81648d0 2023-12-18T10:26:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.936+0000 7ff8aeffd640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff89c065a90 0x7ff89c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.936+0000 7ff8aeffd640 1 -- 172.21.15.133:0/3428876423 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7ff8b0082d90 con 0x7ff8b81648d0 2023-12-18T10:26:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.936+0000 7ff8be260640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff89c065a90 0x7ff89c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:22.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.936+0000 7ff8be260640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff89c065a90 0x7ff89c067f50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4007fd0 tx=0x7ff8b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:22.940+0000 7ff8aeffd640 1 -- 172.21.15.133:0/3428876423 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff8b0050900 con 0x7ff8b81648d0 2023-12-18T10:26:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8b815ce20 con 0x7ff89c065a90 2023-12-18T10:26:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8aeffd640 1 -- 172.21.15.133:0/3428876423 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff8b40014e0 con 0x7ff89c065a90 2023-12-18T10:26:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 6 to deep-scrub 2023-12-18T10:26:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff89c065a90 msgr2=0x7ff89c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff89c065a90 0x7ff89c067f50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4007fd0 tx=0x7ff8b4009040 comp rx=0 tx=0).stop 2023-12-18T10:26:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b81648d0 msgr2=0x7ff8b80c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b81648d0 0x7ff8b80c8890 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000b9e0 tx=0x7ff8b000bea0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 shutdown_connections 2023-12-18T10:26:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7ff89c065a90 0x7ff89c067f50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b81648d0 0x7ff8b80c8890 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff8b815ca40 0x7ff8b815bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.092+0000 7ff8c04c4640 1 --2- 172.21.15.133:0/3428876423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8b80cf0d0 0x7ff8b814b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.096+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 >> 172.21.15.133:0/3428876423 conn(0x7ff8b8089fb0 msgr2=0x7ff8b80d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.096+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 shutdown_connections 2023-12-18T10:26:23.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.096+0000 7ff8c04c4640 1 -- 172.21.15.133:0/3428876423 wait complete. 2023-12-18T10:26:23.114 INFO:tasks.ceph:Scrubbing osd.7 2023-12-18T10:26:23.115 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-18T10:26:23.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.256+0000 7fcfe56fc640 1 Processor -- start 2023-12-18T10:26:23.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.256+0000 7fcfe56fc640 1 -- start start 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.256+0000 7fcfe56fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcfe006d8a0 0x7fcfe00ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.256+0000 7fcfe56fc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe00b28a0 con 0x7fcfe00ce5d0 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.256+0000 7fcfe56fc640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe015ab30 con 0x7fcfe006d440 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.256+0000 7fcfe56fc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe006dcf0 con 0x7fcfe006d8a0 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.256+0000 7fcfdeffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcfe00ce5d0 0x7fcfe00ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54892/0 (socket says 172.21.15.133:54892) 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.256+0000 7fcfdeffd640 1 -- 172.21.15.133:0/2833768678 learned_addr learned my addr 172.21.15.133:0/2833768678 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307762886 0 0) 0x7fcfe00b28a0 con 0x7fcfe00ce5d0 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfdf7fe640 1 --2- 172.21.15.133:0/2833768678 >> v2:172.21.15.142:3300/0 conn(0x7fcfe006d8a0 0x7fcfe00ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfcc003530 con 0x7fcfe00ce5d0 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4280071277 0 0) 0x7fcfcc003530 con 0x7fcfe00ce5d0 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 >> v2:172.21.15.142:3300/0 conn(0x7fcfe006d8a0 msgr2=0x7fcfe00ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 --2- 172.21.15.133:0/2833768678 >> v2:172.21.15.142:3300/0 conn(0x7fcfe006d8a0 0x7fcfe00ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 >> v1:172.21.15.142:6789/0 conn(0x7fcfe006d440 legacy=0x7fcfe00ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00b1c90 con 0x7fcfe00ce5d0 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 141329668 0 0) 0x7fcfd0001a00 con 0x7fcfe00ce5d0 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 >> v1:172.21.15.133:6789/0 conn(0x7fcfe00ce5d0 legacy=0x7fcfe00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc003980 0x7fcfcc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc0047d0 0x7fcfcc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfcc005190 0x7fcfcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc00c000 con 0x7fcfcc0047d0 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc00c170 con 0x7fcfcc003980 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc00c330 con 0x7fcfcc005190 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfd67fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc0047d0 0x7fcfcc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfdeffd640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc003980 0x7fcfcc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfdf7fe640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfcc005190 0x7fcfcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfd67fc640 1 -- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfcc005190 msgr2=0x7fcfcc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfd67fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfcc005190 0x7fcfcc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfd67fc640 1 -- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc003980 msgr2=0x7fcfcc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfd67fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc003980 0x7fcfcc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfd67fc640 1 -- 172.21.15.133:0/2833768678 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc003530 con 0x7fcfcc0047d0 2023-12-18T10:26:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfdf7fe640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfcc005190 0x7fcfcc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.260+0000 7fcfdf7fe640 1 -- 172.21.15.133:0/2833768678 reap_dead start 2023-12-18T10:26:23.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfd67fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc0047d0 0x7fcfcc004c50 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8001780 tx=0x7fcfc801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f13fe9c97140d0b server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80a4ea0 con 0x7fcfcc0047d0 2023-12-18T10:26:23.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80a7050 con 0x7fcfcc0047d0 2023-12-18T10:26:23.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfde7fc640 1 -- 172.21.15.133:0/2833768678 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8003600 con 0x7fcfcc0047d0 2023-12-18T10:26:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- 172.21.15.133:0/2833768678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc0047d0 msgr2=0x7fcfcc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc0047d0 0x7fcfcc004c50 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8001780 tx=0x7fcfc801c3e0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- 172.21.15.133:0/2833768678 shutdown_connections 2023-12-18T10:26:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 --2- 172.21.15.133:0/2833768678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc0047d0 0x7fcfcc004c50 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- 172.21.15.133:0/2833768678 >> 172.21.15.133:0/2833768678 conn(0x7fcfe0069e70 msgr2=0x7fcfe006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- 172.21.15.133:0/2833768678 shutdown_connections 2023-12-18T10:26:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- 172.21.15.133:0/2833768678 wait complete. 2023-12-18T10:26:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 Processor -- start 2023-12-18T10:26:23.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- start start 2023-12-18T10:26:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc0047d0 0x7fcfe015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfe0159370 0x7fcfe0158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe00b0e80 0x7fcfe015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0159120 con 0x7fcfe00b0e80 2023-12-18T10:26:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00c4d30 con 0x7fcfcc0047d0 2023-12-18T10:26:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.264+0000 7fcfe56fc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00c4770 con 0x7fcfe0159370 2023-12-18T10:26:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe00b0e80 0x7fcfe015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe00b0e80 0x7fcfe015ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43362/0 (socket says 172.21.15.133:43362) 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 -- 172.21.15.133:0/3649793205 learned_addr learned my addr 172.21.15.133:0/3649793205 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdeffd640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc0047d0 0x7fcfe015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfd67fc640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfe0159370 0x7fcfe0158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 -- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfe0159370 msgr2=0x7fcfe0158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfe0159370 0x7fcfe0158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 -- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc0047d0 msgr2=0x7fcfe015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc0047d0 0x7fcfe015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 -- 172.21.15.133:0/3649793205 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00c4a50 con 0x7fcfe00b0e80 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdeffd640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfcc0047d0 0x7fcfe015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfdf7fe640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe00b0e80 0x7fcfe015ad50 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00c90b0 tx=0x7fcfd8011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8004230 con 0x7fcfe00b0e80 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd80043b0 con 0x7fcfe00b0e80 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe015dc20 con 0x7fcfe00b0e80 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8015970 con 0x7fcfe00b0e80 2023-12-18T10:26:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe00b1330 con 0x7fcfe00b0e80 2023-12-18T10:26:23.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfe00b2250 con 0x7fcfe00b0e80 2023-12-18T10:26:23.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcfd8015ad0 con 0x7fcfe00b0e80 2023-12-18T10:26:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.268+0000 7fcfd7fff640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfc0065a90 0x7fcfc0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fcfd80830b0 con 0x7fcfe00b0e80 2023-12-18T10:26:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfd7fff640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7fcfc006bed0 0x7fcfc006e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfdeffd640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfc0065a90 0x7fcfc0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 --> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfc006e9e0 con 0x7fcfc006bed0 2023-12-18T10:26:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfd8085690 con 0x7fcfe00b0e80 2023-12-18T10:26:23.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfd67fc640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7fcfc006bed0 0x7fcfc006e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfdeffd640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfc0065a90 0x7fcfc0067f50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00639f0 tx=0x7fcfd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfd67fc640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7fcfc006bed0 0x7fcfc006e310 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.272+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 <== osd.7 v2:172.21.15.142:6816/38355 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcfc006e9e0 con 0x7fcfc006bed0 2023-12-18T10:26:23.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 --> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcfe00b1f70 con 0x7fcfc006bed0 2023-12-18T10:26:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfd7fff640 1 -- 172.21.15.133:0/3649793205 <== osd.7 v2:172.21.15.142:6816/38355 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcfc80051d0 con 0x7fcfc006bed0 2023-12-18T10:26:23.286 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-18T10:26:23.286 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-18T10:26:23.286 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-18T10:26:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7fcfc006bed0 msgr2=0x7fcfc006e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.142:6816/38355,v1:172.21.15.142:6817/38355] conn(0x7fcfc006bed0 0x7fcfc006e310 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfc0065a90 msgr2=0x7fcfc0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fcfc0065a90 0x7fcfc0067f50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00639f0 tx=0x7fcfd0009040 comp rx=0 tx=0).stop 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe00b0e80 msgr2=0x7fcfe015ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 --2- 172.21.15.133:0/3649793205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfe00b0e80 0x7fcfe015ad50 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00c90b0 tx=0x7fcfd8011920 comp rx=0 tx=0).stop 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfdf7fe640 1 -- 172.21.15.133:0/3649793205 reap_dead start 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 shutdown_connections 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 >> 172.21.15.133:0/3649793205 conn(0x7fcfe0069e70 msgr2=0x7fcfe0070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.284+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 shutdown_connections 2023-12-18T10:26:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.288+0000 7fcfe56fc640 1 -- 172.21.15.133:0/3649793205 wait complete. 2023-12-18T10:26:23.304 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-18T10:26:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.440+0000 7f03ac1ce640 1 Processor -- start 2023-12-18T10:26:23.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.440+0000 7f03ac1ce640 1 -- start start 2023-12-18T10:26:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03ac1ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a40c1280 0x7f03a40cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03ac1ce640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03a40cb340 0x7f03a40cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03ac1ce640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a406fdb0 con 0x7f03a4160cc0 2023-12-18T10:26:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03ac1ce640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a41654a0 con 0x7f03a40cb340 2023-12-18T10:26:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03ac1ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a41610a0 con 0x7f03a40c1280 2023-12-18T10:26:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a9769640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a40c1280 0x7f03a40cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03aa76b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03a40cb340 0x7f03a40cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a9769640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a40c1280 0x7f03a40cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.133:60444/0 (socket says 172.21.15.133:60444) 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a9769640 1 -- 172.21.15.133:0/1296653224 learned_addr learned my addr 172.21.15.133:0/1296653224 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a9f6a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f03a4160cc0 0x7f03a40cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.133:39674/0 (socket says 172.21.15.133:39674) 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a9769640 1 -- 172.21.15.133:0/1296653224 >> v2:172.21.15.142:3300/0 conn(0x7f03a40cb340 msgr2=0x7f03a40cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a9769640 1 --2- 172.21.15.133:0/1296653224 >> v2:172.21.15.142:3300/0 conn(0x7f03a40cb340 0x7f03a40cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a9769640 1 -- 172.21.15.133:0/1296653224 >> v1:172.21.15.142:6789/0 conn(0x7f03a4160cc0 legacy=0x7f03a40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a8f68640 1 -- 172.21.15.133:0/1296653224 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887062929 0 0) 0x7f03a406fdb0 con 0x7f03a4160cc0 2023-12-18T10:26:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.444+0000 7f03a9769640 1 -- 172.21.15.133:0/1296653224 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a4164820 con 0x7f03a40c1280 2023-12-18T10:26:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03a9769640 1 --2- 172.21.15.133:0/1296653224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a40c1280 0x7f03a40cc400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03940098a0 tx=0x7f039401c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d2b2f1c07afeff server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03a8f68640 1 -- 172.21.15.133:0/1296653224 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940ab600 con 0x7f03a40c1280 2023-12-18T10:26:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03a8f68640 1 -- 172.21.15.133:0/1296653224 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03940a7050 con 0x7f03a40c1280 2023-12-18T10:26:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03a8f68640 1 -- 172.21.15.133:0/1296653224 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940ab980 con 0x7f03a40c1280 2023-12-18T10:26:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 -- 172.21.15.133:0/1296653224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a40c1280 msgr2=0x7f03a40cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/1296653224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a40c1280 0x7f03a40cc400 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03940098a0 tx=0x7f039401c3d0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 -- 172.21.15.133:0/1296653224 shutdown_connections 2023-12-18T10:26:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/1296653224 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a40c1280 0x7f03a40cc400 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/1296653224 >> v2:172.21.15.142:3300/0 conn(0x7f03a40cb340 0x7f03a40cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 -- 172.21.15.133:0/1296653224 >> 172.21.15.133:0/1296653224 conn(0x7f03a406a3e0 msgr2=0x7f03a40afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 -- 172.21.15.133:0/1296653224 shutdown_connections 2023-12-18T10:26:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 -- 172.21.15.133:0/1296653224 wait complete. 2023-12-18T10:26:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 Processor -- start 2023-12-18T10:26:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.448+0000 7f03ac1ce640 1 -- start start 2023-12-18T10:26:23.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a40c1280 0x7f03a40c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03a40cb340 0x7f03a415db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a4160cc0 0x7f03a40b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a4161d40 con 0x7f03a40c1280 2023-12-18T10:26:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a415e0d0 con 0x7f03a40cb340 2023-12-18T10:26:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40c3390 con 0x7f03a4160cc0 2023-12-18T10:26:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a40c1280 0x7f03a40c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a40c1280 0x7f03a40c2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43368/0 (socket says 172.21.15.133:43368) 2023-12-18T10:26:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 -- 172.21.15.133:0/3354619985 learned_addr learned my addr 172.21.15.133:0/3354619985 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03aa76b640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a4160cc0 0x7f03a40b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9769640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03a40cb340 0x7f03a415db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 -- 172.21.15.133:0/3354619985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a4160cc0 msgr2=0x7f03a40b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a4160cc0 0x7f03a40b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 -- 172.21.15.133:0/3354619985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03a40cb340 msgr2=0x7f03a415db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03a40cb340 0x7f03a415db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 -- 172.21.15.133:0/3354619985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940094d0 con 0x7f03a40c1280 2023-12-18T10:26:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03a9f6a640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a40c1280 0x7f03a40c2d80 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f03a000c4b0 tx=0x7f03a000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f039a7fc640 1 -- 172.21.15.133:0/3354619985 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00074e0 con 0x7f03a40c1280 2023-12-18T10:26:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f039a7fc640 1 -- 172.21.15.133:0/3354619985 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0007660 con 0x7f03a40c1280 2023-12-18T10:26:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f039a7fc640 1 -- 172.21.15.133:0/3354619985 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0004a30 con 0x7f03a40c1280 2023-12-18T10:26:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a40c3670 con 0x7f03a40c1280 2023-12-18T10:26:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a4161f70 con 0x7f03a40c1280 2023-12-18T10:26:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a40735b0 con 0x7f03a40c1280 2023-12-18T10:26:23.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.452+0000 7f039a7fc640 1 -- 172.21.15.133:0/3354619985 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f03a0004b90 con 0x7f03a40c1280 2023-12-18T10:26:23.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.456+0000 7f039a7fc640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0388065a60 0x7f0388067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.456+0000 7f039a7fc640 1 -- 172.21.15.133:0/3354619985 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f03a00821e0 con 0x7f03a40c1280 2023-12-18T10:26:23.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.456+0000 7f03a9769640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0388065a60 0x7f0388067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.456+0000 7f03a9769640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0388065a60 0x7f0388067f20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f03940ad000 tx=0x7f0394008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.460+0000 7f039a7fc640 1 -- 172.21.15.133:0/3354619985 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f03a004fcd0 con 0x7f03a40c1280 2023-12-18T10:26:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.608+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f03a40b0c70 con 0x7f0388065a60 2023-12-18T10:26:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.608+0000 7f039a7fc640 1 -- 172.21.15.133:0/3354619985 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f03940ab680 con 0x7f0388065a60 2023-12-18T10:26:23.610 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 7 to deep-scrub 2023-12-18T10:26:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0388065a60 msgr2=0x7f0388067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0388065a60 0x7f0388067f20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f03940ad000 tx=0x7f0394008040 comp rx=0 tx=0).stop 2023-12-18T10:26:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a40c1280 msgr2=0x7f03a40c2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a40c1280 0x7f03a40c2d80 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f03a000c4b0 tx=0x7f03a000c970 comp rx=0 tx=0).stop 2023-12-18T10:26:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 shutdown_connections 2023-12-18T10:26:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0388065a60 0x7f0388067f20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03a4160cc0 0x7f03a40b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03a40cb340 0x7f03a415db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 --2- 172.21.15.133:0/3354619985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a40c1280 0x7f03a40c2d80 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 >> 172.21.15.133:0/3354619985 conn(0x7f03a406a3e0 msgr2=0x7f03a40aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 shutdown_connections 2023-12-18T10:26:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.612+0000 7f03ac1ce640 1 -- 172.21.15.133:0/3354619985 wait complete. 2023-12-18T10:26:23.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:26:23.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.768+0000 7f0457cfc640 1 Processor -- start 2023-12-18T10:26:23.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.768+0000 7f0457cfc640 1 -- start start 2023-12-18T10:26:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.768+0000 7f0457cfc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f04500cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0457cfc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f04500cb340 0x7f04500cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0457cfc640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045006fdb0 con 0x7f0450160cc0 2023-12-18T10:26:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0457cfc640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04501654a0 con 0x7f04500cb340 2023-12-18T10:26:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0457cfc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04501610a0 con 0x7f04500c1280 2023-12-18T10:26:23.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0455a98640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0450160cc0 0x7f04500cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54894/0 (socket says 172.21.15.133:54894) 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0455a98640 1 -- 172.21.15.133:0/644646421 learned_addr learned my addr 172.21.15.133:0/644646421 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0455297640 1 --2- 172.21.15.133:0/644646421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f04500cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0456299640 1 --2- 172.21.15.133:0/644646421 >> v2:172.21.15.142:3300/0 conn(0x7f04500cb340 0x7f04500cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0454a96640 1 -- 172.21.15.133:0/644646421 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754757843 0 0) 0x7f045006fdb0 con 0x7f0450160cc0 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0454a96640 1 -- 172.21.15.133:0/644646421 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f043c003530 con 0x7f0450160cc0 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0455297640 1 -- 172.21.15.133:0/644646421 >> v2:172.21.15.142:3300/0 conn(0x7f04500cb340 msgr2=0x7f04500cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0455297640 1 --2- 172.21.15.133:0/644646421 >> v2:172.21.15.142:3300/0 conn(0x7f04500cb340 0x7f04500cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0455297640 1 -- 172.21.15.133:0/644646421 >> v1:172.21.15.133:6789/0 conn(0x7f0450160cc0 legacy=0x7f04500cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0455297640 1 -- 172.21.15.133:0/644646421 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0450164820 con 0x7f04500c1280 2023-12-18T10:26:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.772+0000 7f0455297640 1 --2- 172.21.15.133:0/644646421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f04500cc400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f04400097f0 tx=0x7f044001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84ec6606648ce39f server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0454a96640 1 -- 172.21.15.133:0/644646421 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04400ab600 con 0x7f04500c1280 2023-12-18T10:26:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0454a96640 1 -- 172.21.15.133:0/644646421 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04400a7050 con 0x7f04500c1280 2023-12-18T10:26:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0454a96640 1 -- 172.21.15.133:0/644646421 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04400ab980 con 0x7f04500c1280 2023-12-18T10:26:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- 172.21.15.133:0/644646421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 msgr2=0x7f04500cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 --2- 172.21.15.133:0/644646421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f04500cc400 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f04400097f0 tx=0x7f044001c330 comp rx=0 tx=0).stop 2023-12-18T10:26:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- 172.21.15.133:0/644646421 shutdown_connections 2023-12-18T10:26:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 --2- 172.21.15.133:0/644646421 >> v2:172.21.15.142:3300/0 conn(0x7f04500cb340 0x7f04500cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 --2- 172.21.15.133:0/644646421 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f04500cc400 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- 172.21.15.133:0/644646421 >> 172.21.15.133:0/644646421 conn(0x7f045006a3e0 msgr2=0x7f04500afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- 172.21.15.133:0/644646421 shutdown_connections 2023-12-18T10:26:23.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- 172.21.15.133:0/644646421 wait complete. 2023-12-18T10:26:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 Processor -- start 2023-12-18T10:26:23.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- start start 2023-12-18T10:26:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f045015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04500cb340 0x7f04501611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0450160cc0 0x7f0450161720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04500b3ce0 con 0x7f0450160cc0 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04500b3a00 con 0x7f04500cb340 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0457cfc640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045015cc80 con 0x7f04500c1280 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0456299640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0450160cc0 0x7f0450161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0456299640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0450160cc0 0x7f0450161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43372/0 (socket says 172.21.15.133:43372) 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0456299640 1 -- 172.21.15.133:0/3212935791 learned_addr learned my addr 172.21.15.133:0/3212935791 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0455a98640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f045015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.776+0000 7f0455297640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04500cb340 0x7f04501611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0456299640 1 -- 172.21.15.133:0/3212935791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 msgr2=0x7f045015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0456299640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f045015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0456299640 1 -- 172.21.15.133:0/3212935791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04500cb340 msgr2=0x7f04501611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0456299640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04500cb340 0x7f04501611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0456299640 1 -- 172.21.15.133:0/3212935791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440009420 con 0x7f0450160cc0 2023-12-18T10:26:23.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0456299640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0450160cc0 0x7f0450161720 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f044800efc0 tx=0x7f044800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f04467fc640 1 -- 172.21.15.133:0/3212935791 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448014480 con 0x7f0450160cc0 2023-12-18T10:26:23.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f04467fc640 1 -- 172.21.15.133:0/3212935791 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044800f040 con 0x7f0450160cc0 2023-12-18T10:26:23.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045015cf60 con 0x7f0450160cc0 2023-12-18T10:26:23.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f04467fc640 1 -- 172.21.15.133:0/3212935791 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448014820 con 0x7f0450160cc0 2023-12-18T10:26:23.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045015be90 con 0x7f0450160cc0 2023-12-18T10:26:23.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04500735b0 con 0x7f0450160cc0 2023-12-18T10:26:23.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f04467fc640 1 -- 172.21.15.133:0/3212935791 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0448014980 con 0x7f0450160cc0 2023-12-18T10:26:23.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f04467fc640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0434065a90 0x7f0434067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:23.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f04467fc640 1 -- 172.21.15.133:0/3212935791 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f0448083a90 con 0x7f0450160cc0 2023-12-18T10:26:23.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.780+0000 7f0455a98640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0434065a90 0x7f0434067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:23.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.784+0000 7f0455a98640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0434065a90 0x7f0434067f50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f044c0011f0 tx=0x7f044c007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.784+0000 7f04467fc640 1 -- 172.21.15.133:0/3212935791 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0448051600 con 0x7f0450160cc0 2023-12-18T10:26:23.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.932+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f045015cdf0 con 0x7f0434065a90 2023-12-18T10:26:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.932+0000 7f04467fc640 1 -- 172.21.15.133:0/3212935791 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50621 (secure 0 0 0) 0x7f045015cdf0 con 0x7f0434065a90 2023-12-18T10:26:23.935 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:23.937 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:26:23.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0434065a90 msgr2=0x7f0434067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0434065a90 0x7f0434067f50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f044c0011f0 tx=0x7f044c007d40 comp rx=0 tx=0).stop 2023-12-18T10:26:23.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0450160cc0 msgr2=0x7f0450161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0450160cc0 0x7f0450161720 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f044800efc0 tx=0x7f044800c490 comp rx=0 tx=0).stop 2023-12-18T10:26:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 shutdown_connections 2023-12-18T10:26:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f0434065a90 0x7f0434067f50 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0450160cc0 0x7f0450161720 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04500cb340 0x7f04501611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 --2- 172.21.15.133:0/3212935791 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04500c1280 0x7f045015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 >> 172.21.15.133:0/3212935791 conn(0x7f045006a3e0 msgr2=0x7f045015fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 shutdown_connections 2023-12-18T10:26:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:23.936+0000 7f0457cfc640 1 -- 172.21.15.133:0/3212935791 wait complete. 2023-12-18T10:26:23.956 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2023-12-18T10:26:23.202161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260264,"kb_used_data":11880,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714456,"statfs":{"total":773094113280,"available":772827602944,"internally_reserved":0,"allocated":12165120,"data_stored":6256064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.987976"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":239,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-12-18T10:26:15.070426+0000","last_change":"2023-12-18T10:17:55.004722+0000","last_active":"2023-12-18T10:26:15.070426+0000","last_peered":"2023-12-18T10:26:15.070426+0000","last_clean":"2023-12-18T10:26:15.070426+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:26:15.070426+0000","last_undegraded":"2023-12-18T10:26:15.070426+0000","last_fullsized":"2023-12-18T10:26:15.070426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-18T10:17:53.395208+0000","last_clean_scrub_stamp":"2023-12-18T10:17:53.395208+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T21:40:47.479338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574953,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1966080,"data_stored":1224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.44400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.79900000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":1.097,"15min":1.097},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.78200000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.70899999999999996,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.71699999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66800000000000004,"15min":0.68100000000000005},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.378,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.753,"15min":0.76900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.83499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65900000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85399999999999998,"5min":1.018,"15min":4.3760000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.81699999999999995},"min":{"1min":0.44400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78500000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.503},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84499999999999997,"5min":1.179,"15min":4.524},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70399999999999996,"15min":0.76700000000000002},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":0.77300000000000002,"5min":1.121,"15min":2.2709999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.73799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.62}]},{"osd":3,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.79200000000000004},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.95199999999999996,"15min":2.0270000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.82599999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.79000000000000004,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.98199999999999998,"15min":1.101},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83699999999999997,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.98799999999999999,"15min":1.284},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0369999999999999,"15min":1.129},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.73599999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.006,"15min":1.0820000000000001},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.873,"15min":1.0900000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.91200000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":3.3100000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.879,"15min":0.90500000000000003},"last":0.432}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.67100000000000004,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66900000000000004,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.498}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":2.0699999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67900000000000005,"15min":0.78100000000000003},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.90200000000000002,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.45200000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.86499999999999999},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":8.9740000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.52400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.2370000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.71799999999999997},"min":{"1min":0.49399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":2.9060000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.747},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.92300000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.96899999999999997,"15min":1.1830000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.627}]}]},{"osd":4,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.53700000000000003,"5min":0.33900000000000002,"15min":0.32800000000000001},"max":{"1min":0.90300000000000002,"5min":0.91600000000000004,"15min":1.0249999999999999},"last":0.751},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67600000000000005,"15min":0.69799999999999995},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.1739999999999999},"last":0.69999999999999996}]},{"osd":1,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":1.131},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.90300000000000002,"15min":0.98799999999999999},"last":0.83099999999999996}]},{"osd":2,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84899999999999998,"5min":0.95499999999999996,"15min":1.0860000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.008,"15min":1.032},"last":0.81000000000000005}]},{"osd":3,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":0.88700000000000001,"15min":0.999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.57299999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"last":0.84899999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.86799999999999999,"15min":0.874},"last":0.59599999999999997}]},{"osd":6,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64000000000000001,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68600000000000005,"15min":0.71699999999999997},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":1.0109999999999999,"15min":1.073},"last":0.623}]},{"osd":7,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.52600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.872,"5min":0.90900000000000003,"15min":1.042},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70299999999999996,"15min":0.72899999999999998},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.1479999999999999},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.49099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72499999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.375}]},{"osd":1,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42899999999999999,"15min":0.45800000000000002},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.434},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67100000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69399999999999995,"5min":1.036,"15min":1.254},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.63600000000000001},"min":{"1min":0.45200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":0.98899999999999999,"15min":1.772},"last":0.46700000000000003}]},{"osd":4,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66100000000000003,"15min":0.67800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.94799999999999995,"15min":1.01},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":1.167,"15min":1.181},"last":0.55900000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":1.171,"15min":1.171},"last":0.625},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.069},"last":0.54500000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.872,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.76700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45000000000000001},"max":{"1min":0.85899999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71599999999999997,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72099999999999997,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91300000000000003,"5min":1.26,"15min":1.26},"last":0.66000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.56000000000000005,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.438},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45000000000000001,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.48899999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54000000000000004,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.92000000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52200000000000002,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.1599999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.77800000000000002},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.97699999999999998,"15min":1.698},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.4219999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":0.93400000000000005,"15min":1.3069999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.79300000000000004},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.7549999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93700000000000006,"5min":1.0189999999999999,"15min":1.341},"last":0.629},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.76700000000000002},"min":{"1min":0.53300000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95199999999999996,"5min":1.107,"15min":1.3939999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.77100000000000002},"min":{"1min":0.57299999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.282},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.91100000000000003,"5min":1.0489999999999999,"15min":1.4530000000000001},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.54300000000000004},"min":{"1min":0.24299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":3.976},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.9079999999999999},"last":0.371}]},{"osd":2,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.58599999999999997},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":3.786},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83899999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.497,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.71399999999999997,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.443}]},{"osd":4,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72299999999999998,"15min":0.78200000000000003},"min":{"1min":0.51400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.1140000000000001,"15min":1.851},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72899999999999998,"15min":0.86099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.85299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.024,"15min":4.1859999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70899999999999996,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.504},"max":{"1min":0.94699999999999995,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.79700000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96599999999999997,"5min":1.056,"15min":2.0699999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47099999999999997},"max":{"1min":0.94999999999999996,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.64100000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.0269999999999999,"15min":2.1890000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.04,"15min":1.9770000000000001},"last":0.56000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1966080,"data_stored":1224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":1.5109999999999999},"last":0.439},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.505,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.82999999999999996,"15min":1.456},"last":0.39900000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45000000000000001,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64700000000000002,"5min":0.70399999999999996,"15min":1.595},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46899999999999997,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":2.464},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46800000000000003,"15min":0.51200000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.85699999999999998,"15min":1.859},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54700000000000004,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77700000000000002,"15min":1.903},"last":0.48999999999999999}]},{"osd":4,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.494},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.61399999999999999,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0249999999999999,"5min":1.1279999999999999,"15min":1.2949999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.46700000000000003},"max":{"1min":0.995,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79300000000000004},"min":{"1min":0.57399999999999995,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0629999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.745}]},{"osd":6,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":1.0720000000000001,"15min":1.5700000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.95499999999999996,"5min":1.089,"15min":1.53},"last":0.75700000000000001}]},{"osd":7,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72399999999999998,"15min":0.77400000000000002},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.0469999999999999,"15min":1.556},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":0.91400000000000003,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:26:23.962 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-18T10:17:53.395208+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=18, tm_hour=10, tm_min=17, tm_sec=53, tm_wday=0, tm_yday=352, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=18, tm_hour=10, tm_min=26, tm_sec=18, tm_wday=0, tm_yday=352, tm_isdst=0) 2023-12-18T10:26:23.962 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-18T10:26:29.520 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:26:29.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:26:43.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-18T10:26:44.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.107+0000 7f860c139640 1 Processor -- start 2023-12-18T10:26:44.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860c139640 1 -- start start 2023-12-18T10:26:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860c139640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8604158c20 0x7f8604070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860c139640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86040cb180 0x7f86040ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860c139640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8604070b80 con 0x7f860415c800 2023-12-18T10:26:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860c139640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8604070e60 con 0x7f86040cb180 2023-12-18T10:26:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860c139640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8604071140 con 0x7f8604158c20 2023-12-18T10:26:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860a6d6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86040cb180 0x7f86040ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f8609ed5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8604158c20 0x7f8604070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860a6d6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f86040cb180 0x7f86040ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.133:35632/0 (socket says 172.21.15.133:35632) 2023-12-18T10:26:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860a6d6640 1 -- 172.21.15.133:0/1177884030 learned_addr learned my addr 172.21.15.133:0/1177884030 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f8609ed5640 1 -- 172.21.15.133:0/1177884030 >> v2:172.21.15.142:3300/0 conn(0x7f86040cb180 msgr2=0x7f86040ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f8609ed5640 1 --2- 172.21.15.133:0/1177884030 >> v2:172.21.15.142:3300/0 conn(0x7f86040cb180 0x7f86040ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f8609ed5640 1 -- 172.21.15.133:0/1177884030 >> v1:172.21.15.142:6789/0 conn(0x7f860415c800 legacy=0x7f86040caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f8609ed5640 1 -- 172.21.15.133:0/1177884030 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604071420 con 0x7f8604158c20 2023-12-18T10:26:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f860a6d6640 1 --2- 172.21.15.133:0/1177884030 >> v2:172.21.15.142:3300/0 conn(0x7f86040cb180 0x7f86040ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-18T10:26:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.111+0000 7f8608ed3640 1 -- 172.21.15.133:0/1177884030 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791599845 0 0) 0x7f8604070b80 con 0x7f860415c800 2023-12-18T10:26:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f8609ed5640 1 --2- 172.21.15.133:0/1177884030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8604158c20 0x7f8604070510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f86000097c0 tx=0x7f860001ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f77864f1a478d3ef server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f8608ed3640 1 -- 172.21.15.133:0/1177884030 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000ad660 con 0x7f8604158c20 2023-12-18T10:26:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f8608ed3640 1 -- 172.21.15.133:0/1177884030 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000ad7c0 con 0x7f8604158c20 2023-12-18T10:26:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f8608ed3640 1 -- 172.21.15.133:0/1177884030 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000adb50 con 0x7f8604158c20 2023-12-18T10:26:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 -- 172.21.15.133:0/1177884030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8604158c20 msgr2=0x7f8604070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 --2- 172.21.15.133:0/1177884030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8604158c20 0x7f8604070510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f86000097c0 tx=0x7f860001ce20 comp rx=0 tx=0).stop 2023-12-18T10:26:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 -- 172.21.15.133:0/1177884030 shutdown_connections 2023-12-18T10:26:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 --2- 172.21.15.133:0/1177884030 >> v2:172.21.15.142:3300/0 conn(0x7f86040cb180 0x7f86040ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 --2- 172.21.15.133:0/1177884030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8604158c20 0x7f8604070510 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 -- 172.21.15.133:0/1177884030 >> 172.21.15.133:0/1177884030 conn(0x7f860406a3e0 msgr2=0x7f86040afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 -- 172.21.15.133:0/1177884030 shutdown_connections 2023-12-18T10:26:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 -- 172.21.15.133:0/1177884030 wait complete. 2023-12-18T10:26:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.115+0000 7f860c139640 1 Processor -- start 2023-12-18T10:26:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 -- start start 2023-12-18T10:26:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86040cb180 0x7f86040b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8604158c20 0x7f8604145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860415c800 0x7f8604146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040ca0f0 con 0x7f8604158c20 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040b2f20 con 0x7f86040cb180 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86040b3200 con 0x7f860415c800 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8604158c20 0x7f8604145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8604158c20 0x7f8604145760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59920/0 (socket says 172.21.15.133:59920) 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 -- 172.21.15.133:0/3714541592 learned_addr learned my addr 172.21.15.133:0/3714541592 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f8609ed5640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86040cb180 0x7f86040b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860a6d6640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860415c800 0x7f8604146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 -- 172.21.15.133:0/3714541592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860415c800 msgr2=0x7f8604146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860415c800 0x7f8604146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 -- 172.21.15.133:0/3714541592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86040cb180 msgr2=0x7f86040b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86040cb180 0x7f86040b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 -- 172.21.15.133:0/3714541592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc009b30 con 0x7f8604158c20 2023-12-18T10:26:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f86096d4640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8604158c20 0x7f8604145760 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f85f4001ec0 tx=0x7f85f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f85fa7fc640 1 -- 172.21.15.133:0/3714541592 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40054e0 con 0x7f8604158c20 2023-12-18T10:26:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f85fa7fc640 1 -- 172.21.15.133:0/3714541592 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f4003600 con 0x7f8604158c20 2023-12-18T10:26:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8600009420 con 0x7f8604158c20 2023-12-18T10:26:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f85fa7fc640 1 -- 172.21.15.133:0/3714541592 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40039b0 con 0x7f8604158c20 2023-12-18T10:26:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86040c8800 con 0x7f8604158c20 2023-12-18T10:26:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.119+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86040735b0 con 0x7f8604158c20 2023-12-18T10:26:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.123+0000 7f85fa7fc640 1 -- 172.21.15.133:0/3714541592 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f85f4003b10 con 0x7f8604158c20 2023-12-18T10:26:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.123+0000 7f85fa7fc640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85e8065a60 0x7f85e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.123+0000 7f85fa7fc640 1 -- 172.21.15.133:0/3714541592 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f85f4082650 con 0x7f8604158c20 2023-12-18T10:26:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.123+0000 7f8609ed5640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85e8065a60 0x7f85e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.123+0000 7f8609ed5640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85e8065a60 0x7f85e8067f20 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f86000af000 tx=0x7f8600004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.127+0000 7f85fa7fc640 1 -- 172.21.15.133:0/3714541592 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f85f4050130 con 0x7f8604158c20 2023-12-18T10:26:44.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.275+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 --> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86040cd150 con 0x7f85e8065a60 2023-12-18T10:26:44.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.275+0000 7f85fa7fc640 1 -- 172.21.15.133:0/3714541592 <== mgr.4104 v2:172.21.15.133:6832/38097 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50721 (secure 0 0 0) 0x7f86000ad930 con 0x7f85e8065a60 2023-12-18T10:26:44.278 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:44.278 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-18T10:26:44.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85e8065a60 msgr2=0x7f85e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85e8065a60 0x7f85e8067f20 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f86000af000 tx=0x7f8600004740 comp rx=0 tx=0).stop 2023-12-18T10:26:44.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8604158c20 msgr2=0x7f8604145760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8604158c20 0x7f8604145760 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f85f4001ec0 tx=0x7f85f400c8e0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 shutdown_connections 2023-12-18T10:26:44.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f85e8065a60 0x7f85e8067f20 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f860415c800 0x7f8604146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8604158c20 0x7f8604145760 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 --2- 172.21.15.133:0/3714541592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86040cb180 0x7f86040b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 >> 172.21.15.133:0/3714541592 conn(0x7f860406a3e0 msgr2=0x7f86040af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:44.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 shutdown_connections 2023-12-18T10:26:44.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.279+0000 7f860c139640 1 -- 172.21.15.133:0/3714541592 wait complete. 2023-12-18T10:26:44.298 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2023-12-18T10:26:43.206185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260264,"kb_used_data":11880,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714456,"statfs":{"total":773094113280,"available":772827602944,"internally_reserved":0,"allocated":12165120,"data_stored":6256064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002360"},"pg_stats":[{"pgid":"1.0","version":"110'119","reported_seq":253,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-12-18T10:26:28.454711+0000","last_change":"2023-12-18T10:26:28.454823+0000","last_active":"2023-12-18T10:26:28.454711+0000","last_peered":"2023-12-18T10:26:28.454711+0000","last_clean":"2023-12-18T10:26:28.454711+0000","last_became_active":"2023-12-18T10:17:55.003604+0000","last_became_peered":"2023-12-18T10:17:55.003604+0000","last_unstale":"2023-12-18T10:26:28.454711+0000","last_undegraded":"2023-12-18T10:26:28.454711+0000","last_fullsized":"2023-12-18T10:26:28.454711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'119","last_scrub_stamp":"2023-12-18T10:26:28.454688+0000","last_deep_scrub":"110'119","last_deep_scrub_stamp":"2023-12-18T10:26:28.454688+0000","last_clean_scrub_stamp":"2023-12-18T10:26:28.454688+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-19T16:23:30.389963+0000","scrub_duration":0.0083572249999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1966080,"data_stored":1224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.629},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.504}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.44400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.64400000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.39600000000000002},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.68999999999999995}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.442,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":1.097,"15min":1.097},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.69699999999999995},"min":{"1min":0.45800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.91000000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.70899999999999996,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.434,"15min":0.434},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.60299999999999998}]},{"osd":5,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66800000000000004,"15min":0.68100000000000005},"min":{"1min":0.44,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.63100000000000001,"15min":0.66100000000000003},"min":{"1min":0.378,"5min":0.375,"15min":0.35499999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.70499999999999996}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88600000000000001,"5min":0.93600000000000005,"15min":0.97899999999999998},"last":0.627},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.753,"15min":0.76900000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.745}]}]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65900000000000003,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85399999999999998,"5min":1.018,"15min":4.3760000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.66600000000000004,"15min":0.81699999999999995},"min":{"1min":0.44400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":0.98999999999999999,"15min":4.4669999999999996},"last":0.73299999999999998}]},{"osd":1,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66500000000000004,"15min":0.72299999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.78500000000000003,"5min":0.94699999999999995,"15min":1.845},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69099999999999995,"15min":0.80900000000000005},"min":{"1min":0.52000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84499999999999997,"5min":1.179,"15min":4.524},"last":0.70999999999999996}]},{"osd":2,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70399999999999996,"15min":0.76700000000000002},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.48099999999999998},"max":{"1min":0.77300000000000002,"5min":1.121,"15min":2.2709999999999999},"last":0.753},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68799999999999994,"15min":0.73799999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.0940000000000001,"15min":1.925},"last":0.63300000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.79200000000000004},"min":{"1min":0.55400000000000005,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79700000000000004,"5min":0.95199999999999996,"15min":2.0270000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.82599999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.79000000000000004,"5min":0.91000000000000003,"15min":4.3079999999999998},"last":0.56599999999999995}]},{"osd":4,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78700000000000003,"5min":0.90800000000000003,"15min":1.054},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64200000000000002,"15min":0.67200000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78100000000000003,"5min":0.98199999999999998,"15min":1.101},"last":0.54000000000000004}]},{"osd":5,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83699999999999997,"5min":0.93300000000000005,"15min":1.1240000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":0.98799999999999999,"15min":1.284},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Dec 18 10:26:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44900000000000001},"max":{"1min":0.84799999999999998,"5min":1.0369999999999999,"15min":1.129},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68999999999999995,"15min":0.73599999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88500000000000001,"5min":1.006,"15min":1.0820000000000001},"last":0.52500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.61899999999999999,"15min":0.65500000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32500000000000001},"max":{"1min":0.84499999999999997,"5min":0.873,"15min":1.0900000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.72499999999999998},"min":{"1min":0.442,"5min":0.41699999999999998,"15min":0.30499999999999999},"max":{"1min":0.91200000000000003,"5min":1.0529999999999999,"15min":2.7949999999999999},"last":0.79400000000000004}]},{"osd":1,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65900000000000003,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":3.3100000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.879,"15min":0.90500000000000003},"last":0.72099999999999997}]},{"osd":2,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.67100000000000004,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.34799999999999998},"max":{"1min":0.94999999999999996,"5min":0.98899999999999999,"15min":2.9449999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66900000000000004,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":3.2730000000000001},"last":0.87}]},{"osd":3,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":2.0699999999999998},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67900000000000005,"15min":0.78100000000000003},"min":{"1min":0.52600000000000002,"5min":0.44900000000000001,"15min":0.42599999999999999},"max":{"1min":0.90200000000000002,"5min":1.0229999999999999,"15min":2.8420000000000001},"last":0.88200000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.86499999999999999},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":8.9740000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67800000000000005,"15min":0.69299999999999995},"min":{"1min":0.52400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.2370000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61599999999999999,"15min":0.71799999999999997},"min":{"1min":0.49399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":2.9060000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.747},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.92300000000000004,"5min":0.96399999999999997,"15min":3.3319999999999999},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.68200000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.38800000000000001},"max":{"1min":0.86799999999999999,"5min":0.96899999999999997,"15min":1.1830000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.78200000000000003},"min":{"1min":0.47999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.97599999999999998,"5min":1.0900000000000001,"15min":2.9790000000000001},"last":0.69199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.53700000000000003,"5min":0.33900000000000002,"15min":0.32800000000000001},"max":{"1min":0.90300000000000002,"5min":0.91600000000000004,"15min":1.0249999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67600000000000005,"15min":0.69799999999999995},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.1739999999999999},"last":0.875}]},{"osd":1,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":1.131},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.90300000000000002,"15min":0.98799999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84899999999999998,"5min":0.95499999999999996,"15min":1.0860000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.008,"15min":1.032},"last":0.84399999999999997}]},{"osd":3,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.68500000000000005,"15min":0.70899999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.83199999999999996,"5min":0.88700000000000001,"15min":0.999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.71099999999999997,"15min":0.72199999999999998},"min":{"1min":0.57299999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.441},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61799999999999999,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.85399999999999998,"5min":0.86799999999999999,"15min":0.874},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64000000000000001,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68600000000000005,"15min":0.71699999999999997},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.95699999999999996,"5min":1.0109999999999999,"15min":1.073},"last":0.55700000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66900000000000004,"15min":0.70199999999999996},"min":{"1min":0.52600000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.872,"5min":0.90900000000000003,"15min":1.042},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70299999999999996,"15min":0.72899999999999998},"min":{"1min":0.46899999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.073,"5min":1.073,"15min":1.1479999999999999},"last":0.496}]}]},{"osd":3,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40799999999999997,"15min":0.42299999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55000000000000004,"5min":0.84899999999999998,"15min":0.93799999999999994},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.45400000000000001,"15min":0.49099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.72499999999999998,"5min":0.80200000000000005,"15min":1.9530000000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.42899999999999999,"15min":0.45800000000000002},"min":{"1min":0.29599999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56599999999999995,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.377},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.67100000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53700000000000003,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69399999999999995,"5min":1.036,"15min":1.254},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.63600000000000001},"min":{"1min":0.45200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89400000000000002,"5min":0.98899999999999999,"15min":1.772},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66100000000000003,"15min":0.67800000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.94799999999999995,"15min":1.01},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":1.167,"15min":1.181},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.51300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":1.171,"15min":1.171},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.48299999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.73499999999999999,"5min":1.0549999999999999,"15min":1.069},"last":0.67300000000000004}]},{"osd":6,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.76300000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.52300000000000002},"max":{"1min":0.872,"5min":1.2230000000000001,"15min":1.3520000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.76700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45000000000000001},"max":{"1min":0.85899999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.81299999999999994}]},{"osd":7,"last update":"Mon Dec 18 10:26:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71599999999999997,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72099999999999997,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.91300000000000003,"5min":1.26,"15min":1.26},"last":0.83299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42299999999999999,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.26700000000000002,"15min":0.25800000000000001},"max":{"1min":0.56000000000000005,"5min":0.66000000000000003,"15min":0.83699999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45000000000000001,"15min":0.48899999999999999},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.56299999999999994,"5min":0.68899999999999995,"15min":0.89700000000000002},"last":0.42799999999999999}]},{"osd":1,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46300000000000002,"15min":0.48699999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63,"5min":0.70699999999999996,"15min":1.0880000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47899999999999998,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.54000000000000004,"5min":0.81699999999999995,"15min":1.0429999999999999},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46400000000000002,"15min":0.48099999999999998},"min":{"1min":0.33200000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.92000000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52200000000000002,"15min":0.55400000000000005},"min":{"1min":0.378,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":1.1599999999999999},"last":0.623}]},{"osd":4,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72799999999999998,"15min":0.77800000000000002},"min":{"1min":0.55500000000000005,"5min":0.51500000000000001,"15min":0.48299999999999998},"max":{"1min":0.89700000000000002,"5min":0.97699999999999998,"15min":1.698},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.748},"min":{"1min":0.57299999999999995,"5min":0.432,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.4219999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70299999999999996,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":0.88300000000000001,"5min":0.93400000000000005,"15min":1.3069999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.79300000000000004},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92100000000000004,"5min":0.99099999999999999,"15min":1.7549999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93700000000000006,"5min":1.0189999999999999,"15min":1.341},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72799999999999998,"15min":0.76700000000000002},"min":{"1min":0.53300000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.95199999999999996,"5min":1.107,"15min":1.3939999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Mon Dec 18 10:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72799999999999998,"15min":0.77100000000000002},"min":{"1min":0.57299999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.282},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.77100000000000002},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":0.91100000000000003,"5min":1.0489999999999999,"15min":1.4530000000000001},"last":0.83899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":634416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.40999999999999998,"15min":0.54300000000000004},"min":{"1min":0.24299999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":3.976},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.439,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.9079999999999999},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.58599999999999997},"min":{"1min":0.307,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":3.786},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.501},"min":{"1min":0.32500000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.83899999999999997,"5min":0.86799999999999999,"15min":2.2170000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.497,"15min":0.61899999999999999},"min":{"1min":0.37,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92200000000000004,"5min":0.93100000000000005,"15min":3.6400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.48899999999999999,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.71399999999999997,"5min":0.91800000000000004,"15min":3.2440000000000002},"last":0.51100000000000001}]},{"osd":4,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72299999999999998,"15min":0.78200000000000003},"min":{"1min":0.51400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90800000000000003,"5min":1.1140000000000001,"15min":1.851},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.72899999999999998,"15min":0.86099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":1.0589999999999999,"15min":4.5129999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.85299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.435},"max":{"1min":1.024,"5min":1.024,"15min":4.1859999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70899999999999996,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.504},"max":{"1min":0.94699999999999995,"5min":1.0840000000000001,"15min":2.1080000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.79700000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96599999999999997,"5min":1.056,"15min":2.0699999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47099999999999997},"max":{"1min":0.94999999999999996,"5min":1.1439999999999999,"15min":4.3529999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Mon Dec 18 10:26:03 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72199999999999998,"15min":0.77700000000000002},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.0269999999999999,"15min":2.1890000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.04,"15min":1.9770000000000001},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574958,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1966080,"data_stored":1224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.252},"max":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":1.5109999999999999},"last":0.504},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.505,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.34599999999999997},"max":{"1min":0.68200000000000005,"5min":0.82999999999999996,"15min":1.456},"last":0.52300000000000002}]},{"osd":2,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45000000000000001,"15min":0.51700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64700000000000002,"5min":0.70399999999999996,"15min":1.595},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46899999999999997,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.30399999999999999,"15min":0.29999999999999999},"max":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":2.464},"last":0.44600000000000001}]},{"osd":3,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46800000000000003,"15min":0.51200000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71899999999999997,"5min":0.85699999999999998,"15min":1.859},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54700000000000004,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38800000000000001},"max":{"1min":0.77200000000000002,"5min":0.77700000000000002,"15min":1.903},"last":0.55900000000000005}]},{"osd":4,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.494},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.76300000000000001},"min":{"1min":0.61399999999999999,"5min":0.44700000000000001,"15min":0.42899999999999999},"max":{"1min":1.0249999999999999,"5min":1.1279999999999999,"15min":1.2949999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79400000000000004,"15min":0.76300000000000001},"min":{"1min":0.56899999999999995,"5min":0.55000000000000004,"15min":0.46700000000000003},"max":{"1min":0.995,"5min":1.1659999999999999,"15min":1.2589999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79300000000000004},"min":{"1min":0.57399999999999995,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":1.0629999999999999,"5min":1.1579999999999999,"15min":1.544},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":1.0720000000000001,"15min":1.5700000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.95499999999999996,"5min":1.089,"15min":1.53},"last":0.77400000000000002}]},{"osd":7,"last update":"Mon Dec 18 10:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72399999999999998,"15min":0.77400000000000002},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.0469999999999999,"15min":1.556},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.76800000000000002},"min":{"1min":0.52200000000000002,"5min":0.51900000000000002,"15min":0.47999999999999998},"max":{"1min":0.91400000000000003,"5min":1.1970000000000001,"15min":1.2909999999999999},"last":0.79300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-18T10:26:44.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-18T10:26:44.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f840ee8c640 1 Processor -- start 2023-12-18T10:26:44.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f840ee8c640 1 -- start start 2023-12-18T10:26:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f840ee8c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f84080c92b0 0x7f8408160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f840ee8c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f84080c9690 0x7f84080ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f840ee8c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84080ced20 con 0x7f84080ce8f0 2023-12-18T10:26:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f840ee8c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8408142fb0 con 0x7f84080c9690 2023-12-18T10:26:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f840ee8c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8408142cd0 con 0x7f84080c92b0 2023-12-18T10:26:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f83fffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f84080c9690 0x7f84080ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f83fffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f84080c9690 0x7f84080ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59936/0 (socket says 172.21.15.133:59936) 2023-12-18T10:26:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f83fffff640 1 -- 172.21.15.133:0/391326158 learned_addr learned my addr 172.21.15.133:0/391326158 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f840cc28640 1 --2- 172.21.15.133:0/391326158 >> v2:172.21.15.142:3300/0 conn(0x7f84080c92b0 0x7f8408160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f83fffff640 1 -- 172.21.15.133:0/391326158 >> v2:172.21.15.142:3300/0 conn(0x7f84080c92b0 msgr2=0x7f8408160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f83fffff640 1 --2- 172.21.15.133:0/391326158 >> v2:172.21.15.142:3300/0 conn(0x7f84080c92b0 0x7f8408160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f83fffff640 1 -- 172.21.15.133:0/391326158 >> v1:172.21.15.142:6789/0 conn(0x7f84080ce8f0 legacy=0x7f8408142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.435+0000 7f83fffff640 1 -- 172.21.15.133:0/391326158 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84081604c0 con 0x7f84080c9690 2023-12-18T10:26:44.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f83fffff640 1 --2- 172.21.15.133:0/391326158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080c9690 0x7f84080ce3b0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f84080b07c0 tx=0x7f83f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c72c3b39364526 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f83ff7fe640 1 -- 172.21.15.133:0/391326158 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80ab670 con 0x7f84080c9690 2023-12-18T10:26:44.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f83ff7fe640 1 -- 172.21.15.133:0/391326158 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80ab7d0 con 0x7f84080c9690 2023-12-18T10:26:44.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f83ff7fe640 1 -- 172.21.15.133:0/391326158 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80abb60 con 0x7f84080c9690 2023-12-18T10:26:44.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f840ee8c640 1 -- 172.21.15.133:0/391326158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080c9690 msgr2=0x7f84080ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f840ee8c640 1 --2- 172.21.15.133:0/391326158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080c9690 0x7f84080ce3b0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f84080b07c0 tx=0x7f83f801c470 comp rx=0 tx=0).stop 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f840ee8c640 1 -- 172.21.15.133:0/391326158 shutdown_connections 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f840ee8c640 1 --2- 172.21.15.133:0/391326158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080c9690 0x7f84080ce3b0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f840ee8c640 1 --2- 172.21.15.133:0/391326158 >> v2:172.21.15.142:3300/0 conn(0x7f84080c92b0 0x7f8408160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f840ee8c640 1 -- 172.21.15.133:0/391326158 >> 172.21.15.133:0/391326158 conn(0x7f840806a2a0 msgr2=0x7f84080aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f840ee8c640 1 -- 172.21.15.133:0/391326158 shutdown_connections 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.439+0000 7f840ee8c640 1 -- 172.21.15.133:0/391326158 wait complete. 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 Processor -- start 2023-12-18T10:26:44.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 -- start start 2023-12-18T10:26:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080c92b0 0x7f840815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84080c9690 0x7f84080aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080ce8f0 0x7f84080af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84080abdf0 con 0x7f84080ce8f0 2023-12-18T10:26:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84080ac0d0 con 0x7f84080c92b0 2023-12-18T10:26:44.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84080ac3b0 con 0x7f84080c9690 2023-12-18T10:26:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080ce8f0 0x7f84080af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080ce8f0 0x7f84080af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59942/0 (socket says 172.21.15.133:59942) 2023-12-18T10:26:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 -- 172.21.15.133:0/1881335897 learned_addr learned my addr 172.21.15.133:0/1881335897 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840cc28640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080c92b0 0x7f840815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f83fffff640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84080c9690 0x7f84080aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 -- 172.21.15.133:0/1881335897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84080c9690 msgr2=0x7f84080aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84080c9690 0x7f84080aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 -- 172.21.15.133:0/1881335897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080c92b0 msgr2=0x7f840815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080c92b0 0x7f840815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 -- 172.21.15.133:0/1881335897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80094d0 con 0x7f84080ce8f0 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840d429640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080ce8f0 0x7f84080af490 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f840000c730 tx=0x7f840000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f83fd7fa640 1 -- 172.21.15.133:0/1881335897 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400003ba0 con 0x7f84080ce8f0 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f83fd7fa640 1 -- 172.21.15.133:0/1881335897 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400003d00 con 0x7f84080ce8f0 2023-12-18T10:26:44.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f83fd7fa640 1 -- 172.21.15.133:0/1881335897 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400005310 con 0x7f84080ce8f0 2023-12-18T10:26:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84080ac690 con 0x7f84080ce8f0 2023-12-18T10:26:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.443+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84080c6c70 con 0x7f84080ce8f0 2023-12-18T10:26:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.447+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840804e000 con 0x7f84080ce8f0 2023-12-18T10:26:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.447+0000 7f83fd7fa640 1 -- 172.21.15.133:0/1881335897 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8400005680 con 0x7f84080ce8f0 2023-12-18T10:26:44.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.447+0000 7f83fd7fa640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f83f4065a90 0x7f83f4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.447+0000 7f83fd7fa640 1 -- 172.21.15.133:0/1881335897 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f8400082ee0 con 0x7f84080ce8f0 2023-12-18T10:26:44.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.447+0000 7f840cc28640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f83f4065a90 0x7f83f4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.447+0000 7f840cc28640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f83f4065a90 0x7f83f4067f50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8404009b60 tx=0x7f8404009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.451+0000 7f83fd7fa640 1 -- 172.21.15.133:0/1881335897 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8400050a50 con 0x7f84080ce8f0 2023-12-18T10:26:44.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.603+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f84080b0c00 con 0x7f84080ce8f0 2023-12-18T10:26:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.607+0000 7f83fd7fa640 1 -- 172.21.15.133:0/1881335897 <== mon.0 v2:172.21.15.133:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8400050a50 con 0x7f84080ce8f0 2023-12-18T10:26:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.607+0000 7f83fd7fa640 1 -- 172.21.15.133:0/1881335897 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8400054070 con 0x7f84080ce8f0 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f83f4065a90 msgr2=0x7f83f4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f83f4065a90 0x7f83f4067f50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8404009b60 tx=0x7f8404009190 comp rx=0 tx=0).stop 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080ce8f0 msgr2=0x7f84080af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080ce8f0 0x7f84080af490 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f840000c730 tx=0x7f840000cbf0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 shutdown_connections 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7f83f4065a90 0x7f83f4067f50 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84080ce8f0 0x7f84080af490 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f84080c9690 0x7f84080aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 --2- 172.21.15.133:0/1881335897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84080c92b0 0x7f840815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 >> 172.21.15.133:0/1881335897 conn(0x7f840806a2a0 msgr2=0x7f840806fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 shutdown_connections 2023-12-18T10:26:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.611+0000 7f840ee8c640 1 -- 172.21.15.133:0/1881335897 wait complete. 2023-12-18T10:26:44.632 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-18T10:26:44.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-18T10:26:44.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.767+0000 7fbf54255640 1 Processor -- start 2023-12-18T10:26:44.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.767+0000 7fbf54255640 1 -- start start 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf54255640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf4c158c20 0x7fbf4c070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf54255640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 0x7fbf4c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf54255640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c070b80 con 0x7fbf4c15c800 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf54255640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c070e60 con 0x7fbf4c158c20 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf54255640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c071140 con 0x7fbf4c0cb180 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf51ff1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf4c158c20 0x7fbf4c070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf51ff1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf4c158c20 0x7fbf4c070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59946/0 (socket says 172.21.15.133:59946) 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf51ff1640 1 -- 172.21.15.133:0/1158455084 learned_addr learned my addr 172.21.15.133:0/1158455084 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf527f2640 1 --2- 172.21.15.133:0/1158455084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 0x7fbf4c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf51ff1640 1 -- 172.21.15.133:0/1158455084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 msgr2=0x7fbf4c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-18T10:26:44.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf51ff1640 1 --2- 172.21.15.133:0/1158455084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 0x7fbf4c0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf51ff1640 1 -- 172.21.15.133:0/1158455084 >> v1:172.21.15.142:6789/0 conn(0x7fbf4c15c800 legacy=0x7fbf4c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf51ff1640 1 -- 172.21.15.133:0/1158455084 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c071420 con 0x7fbf4c158c20 2023-12-18T10:26:44.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf51ff1640 1 --2- 172.21.15.133:0/1158455084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c158c20 0x7fbf4c070510 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009870 tx=0x7fbf4801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c831bd15d226068d server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.771+0000 7fbf50fef640 1 -- 172.21.15.133:0/1158455084 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf480ac640 con 0x7fbf4c158c20 2023-12-18T10:26:44.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf50fef640 1 -- 172.21.15.133:0/1158455084 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf480ac7a0 con 0x7fbf4c158c20 2023-12-18T10:26:44.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf50fef640 1 -- 172.21.15.133:0/1158455084 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf480acb50 con 0x7fbf4c158c20 2023-12-18T10:26:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- 172.21.15.133:0/1158455084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c158c20 msgr2=0x7fbf4c070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 --2- 172.21.15.133:0/1158455084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c158c20 0x7fbf4c070510 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009870 tx=0x7fbf4801cee0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- 172.21.15.133:0/1158455084 shutdown_connections 2023-12-18T10:26:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 --2- 172.21.15.133:0/1158455084 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 0x7fbf4c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 --2- 172.21.15.133:0/1158455084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c158c20 0x7fbf4c070510 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- 172.21.15.133:0/1158455084 >> 172.21.15.133:0/1158455084 conn(0x7fbf4c06a3e0 msgr2=0x7fbf4c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- 172.21.15.133:0/1158455084 shutdown_connections 2023-12-18T10:26:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- 172.21.15.133:0/1158455084 wait complete. 2023-12-18T10:26:44.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 Processor -- start 2023-12-18T10:26:44.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- start start 2023-12-18T10:26:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 0x7fbf4c14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c158c20 0x7fbf4c0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c15c800 0x7fbf4c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c6890 con 0x7fbf4c15c800 2023-12-18T10:26:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c14b5e0 con 0x7fbf4c158c20 2023-12-18T10:26:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf54255640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c14b8c0 con 0x7fbf4c0cb180 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf527f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c15c800 0x7fbf4c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf527f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c15c800 0x7fbf4c14a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59956/0 (socket says 172.21.15.133:59956) 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf527f2640 1 -- 172.21.15.133:0/3040449821 learned_addr learned my addr 172.21.15.133:0/3040449821 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf51ff1640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 0x7fbf4c14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.775+0000 7fbf517f0640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c158c20 0x7fbf4c0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf527f2640 1 -- 172.21.15.133:0/3040449821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 msgr2=0x7fbf4c14f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf527f2640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 0x7fbf4c14f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf527f2640 1 -- 172.21.15.133:0/3040449821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c158c20 msgr2=0x7fbf4c0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf527f2640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c158c20 0x7fbf4c0ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf527f2640 1 -- 172.21.15.133:0/3040449821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480094d0 con 0x7fbf4c15c800 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf527f2640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c15c800 0x7fbf4c14a190 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fbf44007e30 tx=0x7fbf4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf427fc640 1 -- 172.21.15.133:0/3040449821 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44014620 con 0x7fbf4c15c800 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf427fc640 1 -- 172.21.15.133:0/3040449821 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbf4400ee90 con 0x7fbf4c15c800 2023-12-18T10:26:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf427fc640 1 -- 172.21.15.133:0/3040449821 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440149e0 con 0x7fbf4c15c800 2023-12-18T10:26:44.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c0c8800 con 0x7fbf4c15c800 2023-12-18T10:26:44.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c14be80 con 0x7fbf4c15c800 2023-12-18T10:26:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c0735b0 con 0x7fbf4c15c800 2023-12-18T10:26:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf427fc640 1 -- 172.21.15.133:0/3040449821 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbf44014b40 con 0x7fbf4c15c800 2023-12-18T10:26:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf427fc640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbf30065a60 0x7fbf30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-18T10:26:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf427fc640 1 -- 172.21.15.133:0/3040449821 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fbf44083950 con 0x7fbf4c15c800 2023-12-18T10:26:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.779+0000 7fbf51ff1640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbf30065a60 0x7fbf30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-18T10:26:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.783+0000 7fbf51ff1640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbf30065a60 0x7fbf30067f20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fbf480ae000 tx=0x7fbf48004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-18T10:26:44.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.783+0000 7fbf427fc640 1 -- 172.21.15.133:0/3040449821 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbf44051440 con 0x7fbf4c15c800 2023-12-18T10:26:44.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.963+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf4c0c6a90 con 0x7fbf4c15c800 2023-12-18T10:26:44.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.963+0000 7fbf427fc640 1 -- 172.21.15.133:0/3040449821 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+3542 (secure 0 0 0) 0x7fbf4c0c6a90 con 0x7fbf4c15c800 2023-12-18T10:26:44.966 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-18T10:26:44.966 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":115,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8419,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2026177573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2026177573},{"type":"v1","addr":"172.21.15.142:6834","nonce":2026177573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9148,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2997954652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2997954652},{"type":"v1","addr":"172.21.15.133:6836","nonce":2997954652}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":9151,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/244529412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":244529412},{"type":"v1","addr":"172.21.15.133:6837","nonce":244529412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115},{"gid":9154,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2017600627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2017600627},{"type":"v1","addr":"172.21.15.142:6835","nonce":2017600627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[]} 2023-12-18T10:26:44.966 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 115 2023-12-18T10:26:44.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbf30065a60 msgr2=0x7fbf30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbf30065a60 0x7fbf30067f20 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fbf480ae000 tx=0x7fbf48004740 comp rx=0 tx=0).stop 2023-12-18T10:26:44.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c15c800 msgr2=0x7fbf4c14a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-18T10:26:44.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c15c800 0x7fbf4c14a190 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fbf44007e30 tx=0x7fbf4400e4b0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 shutdown_connections 2023-12-18T10:26:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:6832/38097,v1:172.21.15.133:6833/38097] conn(0x7fbf30065a60 0x7fbf30067f20 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf4c15c800 0x7fbf4c14a190 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbf4c158c20 0x7fbf4c0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 --2- 172.21.15.133:0/3040449821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbf4c0cb180 0x7fbf4c14f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-18T10:26:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 >> 172.21.15.133:0/3040449821 conn(0x7fbf4c06a3e0 msgr2=0x7fbf4c150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-18T10:26:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 shutdown_connections 2023-12-18T10:26:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-18T10:26:44.967+0000 7fbf54255640 1 -- 172.21.15.133:0/3040449821 wait complete. 2023-12-18T10:26:44.987 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-18T10:26:44.988 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-18T10:26:44.988 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-18T10:26:44.988 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.000 INFO:tasks.ceph.mds.a:Stopped 2023-12-18T10:26:45.000 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-18T10:26:45.001 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.055 INFO:tasks.ceph.mds.c:Stopped 2023-12-18T10:26:45.055 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-18T10:26:45.055 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.071 INFO:tasks.ceph.mds.b:Stopped 2023-12-18T10:26:45.071 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-18T10:26:45.071 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.129 INFO:tasks.ceph.mds.d:Stopped 2023-12-18T10:26:45.129 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-18T10:26:45.130 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-18T10:26:45.130 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.218 INFO:tasks.ceph.osd.0:Stopped 2023-12-18T10:26:45.218 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-18T10:26:45.218 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.319 INFO:tasks.ceph.osd.1:Stopped 2023-12-18T10:26:45.319 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-18T10:26:45.319 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.392 INFO:tasks.ceph.osd.2:Stopped 2023-12-18T10:26:45.392 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-18T10:26:45.392 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.493 INFO:tasks.ceph.osd.3:Stopped 2023-12-18T10:26:45.493 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-18T10:26:45.493 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.579 INFO:tasks.ceph.osd.4:Stopped 2023-12-18T10:26:45.579 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-18T10:26:45.579 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:45.671 INFO:tasks.ceph.osd.5:Stopped 2023-12-18T10:26:45.672 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-18T10:26:45.672 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:47.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-18T10:26:51.774 INFO:tasks.ceph.osd.6:Stopped 2023-12-18T10:26:51.775 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-18T10:26:51.775 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:51.838 INFO:tasks.ceph.osd.7:Stopped 2023-12-18T10:26:51.838 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-18T10:26:51.839 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-18T10:26:51.839 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:51.895 INFO:tasks.ceph.mgr.y:Stopped 2023-12-18T10:26:51.896 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-18T10:26:51.896 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:51.947 INFO:tasks.ceph.mgr.x:Stopped 2023-12-18T10:26:51.947 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-18T10:26:51.948 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-18T10:26:51.948 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:51.968 INFO:tasks.ceph.mon.a:Stopped 2023-12-18T10:26:51.968 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-18T10:26:51.968 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:51.985 INFO:tasks.ceph.mon.b:Stopped 2023-12-18T10:26:51.985 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-18T10:26:51.985 INFO:teuthology.orchestra.run:waiting for 300 2023-12-18T10:26:52.045 INFO:tasks.ceph.mon.c:Stopped 2023-12-18T10:26:52.045 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-18T10:26:52.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Scrub error on inode' | head -n 1 2023-12-18T10:26:52.077 INFO:teuthology.orchestra.run.smithi133.stdout:2023-12-18T10:22:50.005207+0000 mon.a (mon.0) 791 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-12-18T10:26:52.078 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-18T10:26:52.078 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Scrub error on inode' | head -n 1 2023-12-18T10:26:52.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Scrub error on inode' | head -n 1 2023-12-18T10:26:52.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-18T10:26:52.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Scrub error on inode' | head -n 1 2023-12-18T10:26:52.296 INFO:teuthology.orchestra.run.smithi133.stdout:2023-12-18T10:22:50.005207+0000 mon.a (mon.0) 791 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-12-18T10:26:52.297 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:26:52.298 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-18T10:26:52.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:26:52.575 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-18T10:26:52.745 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:26:52.746 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-18T10:26:52.927 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:26:52.927 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-18T10:26:53.079 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:26:53.079 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-18T10:26:53.282 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:26:53.282 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-18T10:26:53.475 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:26:53.476 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-18T10:26:53.641 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:26:53.641 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-18T10:26:53.816 INFO:tasks.ceph:Archiving mon data... 2023-12-18T10:26:53.817 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/data/mon.a.tgz 2023-12-18T10:26:53.818 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-18T10:26:53.827 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.PePJXwiywp 2023-12-18T10:26:53.827 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PePJXwiywp 2023-12-18T10:26:53.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.PePJXwiywp 2023-12-18T10:26:54.039 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.PePJXwiywp is 378KB 2023-12-18T10:26:54.105 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.PePJXwiywp 2023-12-18T10:26:54.113 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/data/mon.b.tgz 2023-12-18T10:26:54.113 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-12-18T10:26:54.122 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.6iTe0Oz7zE 2023-12-18T10:26:54.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6iTe0Oz7zE 2023-12-18T10:26:54.259 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.6iTe0Oz7zE 2023-12-18T10:26:54.340 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.6iTe0Oz7zE is 381KB 2023-12-18T10:26:54.402 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.6iTe0Oz7zE 2023-12-18T10:26:54.410 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/data/mon.c.tgz 2023-12-18T10:26:54.410 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-12-18T10:26:54.459 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.uRa1czcy6H 2023-12-18T10:26:54.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uRa1czcy6H 2023-12-18T10:26:54.590 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.uRa1czcy6H 2023-12-18T10:26:54.664 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.uRa1czcy6H is 381KB 2023-12-18T10:26:54.725 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.uRa1czcy6H 2023-12-18T10:26:54.734 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-18T10:26:54.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-18T10:26:54.738 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-18T10:26:54.798 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-18T10:26:54.798 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-18T10:26:54.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-18T10:26:54.835 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-18T10:26:54.870 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-18T10:26:54.876 INFO:tasks.ceph:Archiving crash dumps... 2023-12-18T10:26:54.878 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/remote/smithi133/crash 2023-12-18T10:26:54.879 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-18T10:26:54.907 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/remote/smithi142/crash 2023-12-18T10:26:54.908 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-18T10:26:54.941 INFO:tasks.ceph:Shutting down logrotate 2023-12-18T10:26:54.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:26:54.957 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-18T10:26:55.043 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-18T10:26:55.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-18T10:26:55.094 INFO:tasks.ceph:Compressing logs... 2023-12-18T10:26:55.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-18T10:26:55.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-18T10:27:01.419 INFO:tasks.ceph:Archiving logs... 2023-12-18T10:27:01.420 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/remote/smithi133/log 2023-12-18T10:27:01.421 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-18T10:27:02.609 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/remote/smithi142/log 2023-12-18T10:27:02.610 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-18T10:27:03.223 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-18T10:27:03.232 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-18T10:27:03.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-18T10:27:03.236 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-18T10:27:03.309 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-18T10:27:03.318 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-18T10:27:03.318 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-18T10:27:03.322 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-18T10:27:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-12-18T10:27:03.334 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-12-18T10:27:03.334 INFO:teuthology.orchestra.run.smithi133.stdout:*hv01.front.sepi 44.4.53.2 2 u 20 64 377 0.089 -3.056 1.423 2023-12-18T10:27:03.334 INFO:teuthology.orchestra.run.smithi133.stdout:+hv02.front.sepi 63.231.80.2 3 u 21 64 377 0.069 -1.497 1.142 2023-12-18T10:27:03.334 INFO:teuthology.orchestra.run.smithi133.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.066 -1.878 1.329 2023-12-18T10:27:03.334 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-12-18T10:27:03.336 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2023-12-18T10:27:03.336 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2023-12-18T10:27:03.337 INFO:teuthology.orchestra.run.smithi142.stdout:*hv01.front.sepi 44.4.53.2 2 u 14 64 377 0.102 -4.318 1.686 2023-12-18T10:27:03.337 INFO:teuthology.orchestra.run.smithi142.stdout:+hv02.front.sepi 63.231.80.2 3 u 22 64 377 0.072 -4.064 1.764 2023-12-18T10:27:03.337 INFO:teuthology.orchestra.run.smithi142.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.065 -1.365 1.297 2023-12-18T10:27:03.337 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2023-12-18T10:27:03.338 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-18T10:27:03.349 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-18T10:27:03.349 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-18T10:27:03.357 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-18T10:27:03.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-18T10:27:03.383 INFO:teuthology.task.internal:Duration was 1543.281133 seconds 2023-12-18T10:27:03.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-18T10:27:03.393 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-18T10:27:03.393 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-18T10:27:03.397 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-18T10:27:03.505 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-18T10:27:03.505 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2023-12-18T10:27:03.505 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-18T10:27:03.528 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2023-12-18T10:27:03.529 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-18T10:27:03.550 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-18T10:27:03.551 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-18T10:27:03.573 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-18T10:27:03.629 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-18T10:27:03.629 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-18T10:27:03.657 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-18T10:27:03.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-18T10:27:03.749 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-18T10:27:03.749 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-18T10:27:03.770 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-18T10:27:03.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-18T10:27:03.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-18T10:27:03.817 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-18T10:27:03.832 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2023-12-18T10:27:03.849 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2023-12-18T10:27:03.868 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-18T10:27:03.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:27:03.902 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-18T10:27:03.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-18T10:27:03.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-18T10:27:03.933 INFO:teuthology.task.internal:Transferring archived files... 2023-12-18T10:27:03.934 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/remote/smithi133 2023-12-18T10:27:03.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-18T10:27:03.967 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411/remote/smithi142 2023-12-18T10:27:03.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-18T10:27:03.992 INFO:teuthology.task.internal:Removing archive directory... 2023-12-18T10:27:03.992 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-18T10:27:04.013 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-18T10:27:04.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-18T10:27:04.050 INFO:teuthology.task.internal:Not uploading archives. 2023-12-18T10:27:04.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-18T10:27:04.062 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-18T10:27:04.062 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-18T10:27:04.069 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-18T10:27:04.074 INFO:teuthology.orchestra.run.smithi133.stdout: 655442 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 18 10:27 /home/ubuntu/cephtest 2023-12-18T10:27:04.095 INFO:teuthology.orchestra.run.smithi142.stdout: 658054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 18 10:27 /home/ubuntu/cephtest 2023-12-18T10:27:04.097 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-18T10:27:04.109 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-18T10:27:04.130 INFO:teuthology.nuke:Checking targets against current locks 2023-12-18T10:27:04.155 DEBUG:teuthology.nuke:shortname: smithi133 2023-12-18T10:27:04.155 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-18T10:27:04.175 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-18 09:35:59.913648', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4Na7RJPKURD8+eDOvklrAlHYhShrfslpCJWzht5uER5Hra5sfrayjckMt1JAENAtg0Mt8kdjxNmDVo6Zy2IFM='} 2023-12-18T10:27:04.180 DEBUG:teuthology.nuke:shortname: smithi142 2023-12-18T10:27:04.180 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-18T10:27:04.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-18_09:35:32-fs-wip-vshankar-testing1-2023-12-18-1207-reef-testing-default-smithi/7495411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-18 09:35:59.915473', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXvK7iKGMW7gzxDEwIb5C/d8syMDoSiPZ7UmjlldA84GDswvqpEUd+w6QKaPN+HAeOPCYQ8DmJmH6fpHQuq+jw='} 2023-12-18T10:27:04.218 INFO:teuthology.orchestra.console.smithi133:Power off 2023-12-18T10:27:04.218 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-18T10:27:04.243 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-12-18T10:27:04.243 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-18T10:27:04.258 INFO:teuthology.orchestra.console.smithi142:Power off 2023-12-18T10:27:04.258 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-18T10:27:04.267 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-18T10:27:04.280 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-12-18T10:27:04.280 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-18T10:27:04.302 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-18T10:27:08.269 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-18T10:27:08.304 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-18T10:27:08.379 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-18T10:27:08.413 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-12-18T10:27:12.380 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-18T10:27:12.414 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-18T10:27:12.490 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-18T10:27:12.523 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-12-18T10:27:12.623 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-12-18T10:27:16.494 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-18T10:27:16.604 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-12-18T10:27:16.705 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-12-18T10:27:16.810 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} duration: 1543.281132698059 failure_reason: '"2023-12-18T10:22:50.005207+0000 mon.a (mon.0) 791 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default mon.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: scheduled_vshankar@teuthology success: false 2023-12-18T10:27:16.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-18T10:27:16.895 INFO:teuthology.run:FAIL